2023-12-19T18:41:56.154 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T18:41:56.155 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497300 --name yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} --verbose --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497300/orig.config.yaml 2023-12-19T18:41:56.198 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T18:41:56.281 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497300 branch: wip-yuri8-testing-2023-12-15-0911 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} email: null first_in_suite: false job_id: '7497300' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri8-testing-2023-12-15-0911 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri8-testing-2023-12-15-0911 sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 2960 sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri8-testing-2023-12-15-0911 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi133.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOiwAvMPqBpBT7+At01rwE1NfuL/yZnpe8bVCaNZkmAa8nNUD2uKTh04rt0lDa3nJ45uG412tRYK9uCA7+yz1I8= smithi138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDxgT3ZvKLV/Q68TqGAzAD69RmTsjiuEKXKuXDAL4WWESBTXsOez31TH+mGPRA2H2xO5NiDqWA0paTMeJMW3GvQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-19_15:49:15 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-19T18:41:56.282 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa; will attempt to use it 2023-12-19T18:41:56.282 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks 2023-12-19T18:41:56.283 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-19T18:41:56.284 INFO:teuthology.task.internal:Checking packages... 2023-12-19T18:41:56.306 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'c7586e95519b7be76f3b6e3a4b333888baf46bc9' 2023-12-19T18:41:56.306 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-19T18:41:56.306 INFO:teuthology.packaging:ref: None 2023-12-19T18:41:56.306 INFO:teuthology.packaging:tag: None 2023-12-19T18:41:56.306 INFO:teuthology.packaging:branch: wip-yuri8-testing-2023-12-15-0911 2023-12-19T18:41:56.306 INFO:teuthology.packaging:sha1: c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-19T18:41:56.307 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri8-testing-2023-12-15-0911 2023-12-19T18:41:56.528 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-202-gc7586e95-1jammy 2023-12-19T18:41:56.530 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-19T18:41:56.536 INFO:teuthology.task.internal:no buildpackages task found 2023-12-19T18:41:56.536 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-19T18:41:56.721 INFO:teuthology.task.internal:Saving configuration 2023-12-19T18:41:56.737 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-19T18:41:56.744 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T18:41:56.770 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497300', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 18:36:13.403409', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDuSBfzKALUUH/vPnkTd+rgIX/TJ3YCCYp8E6L/+k/94'} 2023-12-19T18:41:56.794 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497300', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 18:36:13.401620', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPEO6x3Dpd4lB5U07Obc6lTr+tPUQ5yncCHRa93qNfA6'} 2023-12-19T18:41:56.794 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-19T18:41:56.800 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2023-12-19T18:41:56.800 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2023-12-19T18:41:56.800 INFO:teuthology.run_tasks:Running task console_log... 2023-12-19T18:41:56.898 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5b71c09c10>, signals=[15]) 2023-12-19T18:41:56.898 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-19T18:41:56.904 INFO:teuthology.task.internal:Opening connections... 2023-12-19T18:41:56.904 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi133.front.sepia.ceph.com 2023-12-19T18:41:56.906 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:41:56.981 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi138.front.sepia.ceph.com 2023-12-19T18:41:56.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:41:57.057 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-19T18:41:57.063 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2023-12-19T18:41:57.069 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2023-12-19T18:41:57.069 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-12-19T18:41:57.117 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-19T18:41:57.117 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu" 2023-12-19T18:41:57.117 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="22.04" 2023-12-19T18:41:57.117 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-19T18:41:57.117 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=jammy 2023-12-19T18:41:57.118 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu 2023-12-19T18:41:57.118 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian 2023-12-19T18:41:57.118 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-19T18:41:57.118 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-19T18:41:57.118 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-19T18:41:57.118 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-19T18:41:57.118 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=jammy 2023-12-19T18:41:57.119 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-12-19T18:41:57.148 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2023-12-19T18:41:57.154 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2023-12-19T18:41:57.154 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2023-12-19T18:41:57.202 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-19T18:41:57.202 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Ubuntu" 2023-12-19T18:41:57.203 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="22.04" 2023-12-19T18:41:57.203 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-19T18:41:57.203 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_CODENAME=jammy 2023-12-19T18:41:57.203 INFO:teuthology.orchestra.run.smithi138.stdout:ID=ubuntu 2023-12-19T18:41:57.203 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE=debian 2023-12-19T18:41:57.203 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-19T18:41:57.203 INFO:teuthology.orchestra.run.smithi138.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-19T18:41:57.203 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-19T18:41:57.203 INFO:teuthology.orchestra.run.smithi138.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-19T18:41:57.203 INFO:teuthology.orchestra.run.smithi138.stdout:UBUNTU_CODENAME=jammy 2023-12-19T18:41:57.203 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2023-12-19T18:41:57.223 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-19T18:41:57.232 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-19T18:41:57.254 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-19T18:41:57.258 DEBUG:teuthology.orchestra.run.smithi133:> test '!' -e /home/ubuntu/cephtest 2023-12-19T18:41:57.260 DEBUG:teuthology.orchestra.run.smithi138:> test '!' -e /home/ubuntu/cephtest 2023-12-19T18:41:57.264 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-19T18:41:57.280 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-19T18:41:57.280 DEBUG:teuthology.orchestra.run.smithi133:> test -z $(ls -A /var/lib/ceph) 2023-12-19T18:41:57.307 DEBUG:teuthology.orchestra.run.smithi138:> test -z $(ls -A /var/lib/ceph) 2023-12-19T18:41:57.324 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-19T18:41:57.379 INFO:teuthology.run_tasks:Running task kernel... 2023-12-19T18:41:57.393 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-12-19T18:41:57.393 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2023-12-19T18:41:57.393 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-12-19T18:41:57.394 DEBUG:teuthology.orchestra.run.smithi133:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-19T18:41:57.394 DEBUG:teuthology.orchestra.run.smithi138:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-19T18:41:57.398 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:41:57.399 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-12-19T18:41:57.402 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:41:57.403 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-12-19T18:41:57.640 DEBUG:teuthology.task.kernel:sha1 for client.1 is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T18:41:57.640 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-19T18:41:57.641 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2023-12-19T18:41:57.646 INFO:teuthology.orchestra.run.smithi138.stdout:5.15.0-56-generic 2023-12-19T18:41:57.646 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T18:41:57.646 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-19T18:41:57.647 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2023-12-19T18:41:57.647 DEBUG:teuthology.orchestra.run.smithi138:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-19T18:41:57.663 DEBUG:teuthology.task.kernel:sha1 for client.0 is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T18:41:57.663 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-19T18:41:57.663 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2023-12-19T18:41:57.669 INFO:teuthology.orchestra.run.smithi133.stdout:5.15.0-56-generic 2023-12-19T18:41:57.669 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T18:41:57.669 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-19T18:41:57.669 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-12-19T18:41:57.670 DEBUG:teuthology.orchestra.run.smithi133:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-19T18:41:57.704 INFO:teuthology.orchestra.run.smithi138.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-12-19T18:41:57.728 INFO:teuthology.orchestra.run.smithi133.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-12-19T18:41:57.844 INFO:teuthology.orchestra.run.smithi138.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-12-19T18:41:57.844 INFO:teuthology.orchestra.run.smithi138.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-12-19T18:41:57.844 INFO:teuthology.orchestra.run.smithi138.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-12-19T18:41:57.844 INFO:teuthology.orchestra.run.smithi138.stderr:hint: 2023-12-19T18:41:57.844 INFO:teuthology.orchestra.run.smithi138.stderr:hint: git config --global init.defaultBranch 2023-12-19T18:41:57.844 INFO:teuthology.orchestra.run.smithi138.stderr:hint: 2023-12-19T18:41:57.844 INFO:teuthology.orchestra.run.smithi138.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-12-19T18:41:57.844 INFO:teuthology.orchestra.run.smithi138.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-12-19T18:41:57.844 INFO:teuthology.orchestra.run.smithi138.stderr:hint: 2023-12-19T18:41:57.844 INFO:teuthology.orchestra.run.smithi138.stderr:hint: git branch -m 2023-12-19T18:41:57.845 INFO:teuthology.orchestra.run.smithi138.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-19T18:41:57.847 DEBUG:teuthology.orchestra.run.smithi138:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-19T18:41:57.887 INFO:teuthology.orchestra.run.smithi133.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-12-19T18:41:57.887 INFO:teuthology.orchestra.run.smithi133.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-12-19T18:41:57.887 INFO:teuthology.orchestra.run.smithi133.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-12-19T18:41:57.887 INFO:teuthology.orchestra.run.smithi133.stderr:hint: 2023-12-19T18:41:57.887 INFO:teuthology.orchestra.run.smithi133.stderr:hint: git config --global init.defaultBranch 2023-12-19T18:41:57.887 INFO:teuthology.orchestra.run.smithi133.stderr:hint: 2023-12-19T18:41:57.887 INFO:teuthology.orchestra.run.smithi133.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-12-19T18:41:57.887 INFO:teuthology.orchestra.run.smithi133.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-12-19T18:41:57.887 INFO:teuthology.orchestra.run.smithi133.stderr:hint: 2023-12-19T18:41:57.887 INFO:teuthology.orchestra.run.smithi133.stderr:hint: git branch -m 2023-12-19T18:41:57.888 INFO:teuthology.orchestra.run.smithi133.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-19T18:41:57.891 DEBUG:teuthology.orchestra.run.smithi133:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-19T18:41:57.913 DEBUG:teuthology.orchestra.run.smithi138:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-19T18:41:57.958 DEBUG:teuthology.orchestra.run.smithi133:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-19T18:41:57.966 DEBUG:teuthology.orchestra.run.smithi138:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-19T18:41:58.014 DEBUG:teuthology.orchestra.run.smithi133:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-19T18:43:36.621 INFO:teuthology.orchestra.run.smithi138.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-19T18:43:36.622 INFO:teuthology.orchestra.run.smithi138.stderr: * [new branch] main -> origin/main 2023-12-19T18:43:36.654 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20190312 -> 20190312 2023-12-19T18:43:36.654 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20190416 -> 20190416 2023-12-19T18:43:36.654 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20190514 -> 20190514 2023-12-19T18:43:36.654 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20190618 -> 20190618 2023-12-19T18:43:36.654 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20190717 -> 20190717 2023-12-19T18:43:36.654 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20190815 -> 20190815 2023-12-19T18:43:36.654 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20190923 -> 20190923 2023-12-19T18:43:36.654 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20191022 -> 20191022 2023-12-19T18:43:36.656 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20191215 -> 20191215 2023-12-19T18:43:36.656 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200122 -> 20200122 2023-12-19T18:43:36.656 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200316 -> 20200316 2023-12-19T18:43:36.656 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200421 -> 20200421 2023-12-19T18:43:36.656 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200519 -> 20200519 2023-12-19T18:43:36.656 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200619 -> 20200619 2023-12-19T18:43:36.656 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200721 -> 20200721 2023-12-19T18:43:36.656 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200817 -> 20200817 2023-12-19T18:43:36.656 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20200918 -> 20200918 2023-12-19T18:43:36.657 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20201022 -> 20201022 2023-12-19T18:43:36.657 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20201118 -> 20201118 2023-12-19T18:43:36.657 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20201218 -> 20201218 2023-12-19T18:43:36.657 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20210208 -> 20210208 2023-12-19T18:43:36.657 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20210315 -> 20210315 2023-12-19T18:43:36.657 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20210511 -> 20210511 2023-12-19T18:43:36.657 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20210716 -> 20210716 2023-12-19T18:43:36.658 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20210818 -> 20210818 2023-12-19T18:43:36.658 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20210919 -> 20210919 2023-12-19T18:43:36.658 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20211027 -> 20211027 2023-12-19T18:43:36.659 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20211216 -> 20211216 2023-12-19T18:43:36.659 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220209 -> 20220209 2023-12-19T18:43:36.659 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220310 -> 20220310 2023-12-19T18:43:36.659 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220411 -> 20220411 2023-12-19T18:43:36.661 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220509 -> 20220509 2023-12-19T18:43:36.661 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220610 -> 20220610 2023-12-19T18:43:36.661 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220708 -> 20220708 2023-12-19T18:43:36.662 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220815 -> 20220815 2023-12-19T18:43:36.662 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20220913 -> 20220913 2023-12-19T18:43:36.662 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20221012 -> 20221012 2023-12-19T18:43:36.662 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20221109 -> 20221109 2023-12-19T18:43:36.662 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20221214 -> 20221214 2023-12-19T18:43:36.662 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20230117 -> 20230117 2023-12-19T18:43:36.662 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20230210 -> 20230210 2023-12-19T18:43:36.662 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20230310 -> 20230310 2023-12-19T18:43:36.662 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20230404 -> 20230404 2023-12-19T18:43:36.662 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20230515 -> 20230515 2023-12-19T18:43:36.662 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20230625 -> 20230625 2023-12-19T18:43:36.662 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20230804 -> 20230804 2023-12-19T18:43:36.663 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20230919 -> 20230919 2023-12-19T18:43:36.663 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20231030 -> 20231030 2023-12-19T18:43:36.663 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20231111 -> 20231111 2023-12-19T18:43:36.663 INFO:teuthology.orchestra.run.smithi138.stderr: * [new tag] 20231211 -> 20231211 2023-12-19T18:43:40.643 INFO:teuthology.orchestra.run.smithi138.stderr:Updating files: 51% (1679/3256) Updating files: 52% (1694/3256) Updating files: 53% (1726/3256) Updating files: 54% (1759/3256) Updating files: 55% (1791/3256) Updating files: 56% (1824/3256) Updating files: 57% (1856/3256) Updating files: 58% (1889/3256) Updating files: 59% (1922/3256) Updating files: 60% (1954/3256) Updating files: 61% (1987/3256) Updating files: 62% (2019/3256) Updating files: 63% (2052/3256) Updating files: 64% (2084/3256) Updating files: 65% (2117/3256) Updating files: 65% (2121/3256) Updating files: 66% (2149/3256) Updating files: 67% (2182/3256) Updating files: 68% (2215/3256) Updating files: 69% (2247/3256) Updating files: 70% (2280/3256) Updating files: 71% (2312/3256) Updating files: 72% (2345/3256) Updating files: 73% (2377/3256) Updating files: 74% (2410/3256) Updating files: 75% (2442/3256) Updating files: 76% (2475/3256) Updating files: 77% (2508/3256) Updating files: 78% (2540/3256) Updating files: 79% (2573/3256) Updating files: 80% (2605/3256) Updating files: 81% (2638/3256) Updating files: 81% (2658/3256) Updating files: 82% (2670/3256) Updating files: 83% (2703/3256) Updating files: 84% (2736/3256) Updating files: 85% (2768/3256) Updating files: 86% (2801/3256) Updating files: 87% (2833/3256) Updating files: 88% (2866/3256) Updating files: 89% (2898/3256) Updating files: 90% (2931/3256) Updating files: 91% (2963/3256) Updating files: 92% (2996/3256) Updating files: 93% (3029/3256) Updating files: 94% (3061/3256) Updating files: 95% (3094/3256) Updating files: 96% (3126/3256) Updating files: 97% (3159/3256) Updating files: 98% (3191/3256) Updating files: 99% (3224/3256) Updating files: 100% (3256/3256) Updating files: 100% (3256/3256), done. 2023-12-19T18:43:40.648 INFO:teuthology.orchestra.run.smithi138.stdout:HEAD is now at c156e6be Merge branch 'robot/pr-0-1702625169' into 'main' 2023-12-19T18:43:40.669 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.1... 2023-12-19T18:43:40.669 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T18:43:40.810 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ 2023-12-19T18:43:40.811 DEBUG:teuthology.orchestra.run.smithi138:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ --input-file=- 2023-12-19T18:43:40.814 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi138.front.sepia.ceph.com to complete... 2023-12-19T18:43:42.761 INFO:teuthology.orchestra.run.smithi133.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-19T18:43:42.762 INFO:teuthology.orchestra.run.smithi133.stderr: * [new branch] main -> origin/main 2023-12-19T18:43:42.793 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20190312 -> 20190312 2023-12-19T18:43:42.794 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20190416 -> 20190416 2023-12-19T18:43:42.794 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20190514 -> 20190514 2023-12-19T18:43:42.794 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20190618 -> 20190618 2023-12-19T18:43:42.794 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20190717 -> 20190717 2023-12-19T18:43:42.794 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20190815 -> 20190815 2023-12-19T18:43:42.794 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20190923 -> 20190923 2023-12-19T18:43:42.794 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20191022 -> 20191022 2023-12-19T18:43:42.794 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20191215 -> 20191215 2023-12-19T18:43:42.794 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200122 -> 20200122 2023-12-19T18:43:42.794 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200316 -> 20200316 2023-12-19T18:43:42.796 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200421 -> 20200421 2023-12-19T18:43:42.796 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200519 -> 20200519 2023-12-19T18:43:42.796 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200619 -> 20200619 2023-12-19T18:43:42.796 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200721 -> 20200721 2023-12-19T18:43:42.797 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200817 -> 20200817 2023-12-19T18:43:42.797 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20200918 -> 20200918 2023-12-19T18:43:42.797 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20201022 -> 20201022 2023-12-19T18:43:42.797 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20201118 -> 20201118 2023-12-19T18:43:42.797 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20201218 -> 20201218 2023-12-19T18:43:42.797 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20210208 -> 20210208 2023-12-19T18:43:42.797 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20210315 -> 20210315 2023-12-19T18:43:42.797 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20210511 -> 20210511 2023-12-19T18:43:42.797 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20210716 -> 20210716 2023-12-19T18:43:42.797 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20210818 -> 20210818 2023-12-19T18:43:42.797 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20210919 -> 20210919 2023-12-19T18:43:42.797 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20211027 -> 20211027 2023-12-19T18:43:42.797 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20211216 -> 20211216 2023-12-19T18:43:42.797 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220209 -> 20220209 2023-12-19T18:43:42.797 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220310 -> 20220310 2023-12-19T18:43:42.798 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220411 -> 20220411 2023-12-19T18:43:42.799 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220509 -> 20220509 2023-12-19T18:43:42.800 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220610 -> 20220610 2023-12-19T18:43:42.800 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220708 -> 20220708 2023-12-19T18:43:42.800 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220815 -> 20220815 2023-12-19T18:43:42.800 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20220913 -> 20220913 2023-12-19T18:43:42.800 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20221012 -> 20221012 2023-12-19T18:43:42.800 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20221109 -> 20221109 2023-12-19T18:43:42.800 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20221214 -> 20221214 2023-12-19T18:43:42.800 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230117 -> 20230117 2023-12-19T18:43:42.800 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230210 -> 20230210 2023-12-19T18:43:42.800 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230310 -> 20230310 2023-12-19T18:43:42.800 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230404 -> 20230404 2023-12-19T18:43:42.800 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230515 -> 20230515 2023-12-19T18:43:42.800 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230625 -> 20230625 2023-12-19T18:43:42.800 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230804 -> 20230804 2023-12-19T18:43:42.800 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20230919 -> 20230919 2023-12-19T18:43:42.801 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20231030 -> 20231030 2023-12-19T18:43:42.801 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20231111 -> 20231111 2023-12-19T18:43:42.801 INFO:teuthology.orchestra.run.smithi133.stderr: * [new tag] 20231211 -> 20231211 2023-12-19T18:43:43.758 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19 18:43:43 URL:https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb [38930180/38930180] -> "/tmp/linux-image.deb" [1] 2023-12-19T18:43:43.759 INFO:teuthology.orchestra.run.smithi138.stderr:FINISHED --2023-12-19 18:43:43-- 2023-12-19T18:43:43.759 INFO:teuthology.orchestra.run.smithi138.stderr:Total wall clock time: 2.9s 2023-12-19T18:43:43.759 INFO:teuthology.orchestra.run.smithi138.stderr:Downloaded: 1 files, 37M in 2.7s (13.7 MB/s) 2023-12-19T18:43:43.762 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.1... 2023-12-19T18:43:43.763 DEBUG:teuthology.orchestra.run.smithi138:> sudo dpkg -i /tmp/linux-image.deb 2023-12-19T18:43:44.077 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-image-6.6.0-gcd68252d7b4d. 2023-12-19T18:43:46.104 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-12-19T18:43:46.108 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-19T18:43:46.328 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-19T18:43:46.820 INFO:teuthology.orchestra.run.smithi133.stderr:Updating files: 50% (1637/3256) Updating files: 51% (1661/3256) Updating files: 52% (1694/3256) Updating files: 53% (1726/3256) Updating files: 54% (1759/3256) Updating files: 55% (1791/3256) Updating files: 56% (1824/3256) Updating files: 57% (1856/3256) Updating files: 58% (1889/3256) Updating files: 59% (1922/3256) Updating files: 60% (1954/3256) Updating files: 61% (1987/3256) Updating files: 62% (2019/3256) Updating files: 63% (2052/3256) Updating files: 64% (2084/3256) Updating files: 64% (2105/3256) Updating files: 65% (2117/3256) Updating files: 66% (2149/3256) Updating files: 67% (2182/3256) Updating files: 68% (2215/3256) Updating files: 69% (2247/3256) Updating files: 70% (2280/3256) Updating files: 71% (2312/3256) Updating files: 72% (2345/3256) Updating files: 73% (2377/3256) Updating files: 74% (2410/3256) Updating files: 75% (2442/3256) Updating files: 76% (2475/3256) Updating files: 77% (2508/3256) Updating files: 78% (2540/3256) Updating files: 79% (2573/3256) Updating files: 80% (2605/3256) Updating files: 81% (2638/3256) Updating files: 81% (2652/3256) Updating files: 82% (2670/3256) Updating files: 83% (2703/3256) Updating files: 84% (2736/3256) Updating files: 85% (2768/3256) Updating files: 86% (2801/3256) Updating files: 87% (2833/3256) Updating files: 88% (2866/3256) Updating files: 89% (2898/3256) Updating files: 90% (2931/3256) Updating files: 91% (2963/3256) Updating files: 92% (2996/3256) Updating files: 93% (3029/3256) Updating files: 94% (3061/3256) Updating files: 95% (3094/3256) Updating files: 96% (3126/3256) Updating files: 97% (3159/3256) Updating files: 98% (3191/3256) Updating files: 99% (3224/3256) Updating files: 100% (3256/3256) Updating files: 100% (3256/3256), done. 2023-12-19T18:43:46.825 INFO:teuthology.orchestra.run.smithi133.stdout:HEAD is now at c156e6be Merge branch 'robot/pr-0-1702625169' into 'main' 2023-12-19T18:43:46.846 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.0... 2023-12-19T18:43:46.846 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T18:43:46.998 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ 2023-12-19T18:43:46.998 DEBUG:teuthology.orchestra.run.smithi133:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ --input-file=- 2023-12-19T18:43:47.001 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi133.front.sepia.ceph.com to complete... 2023-12-19T18:43:48.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19 18:43:48 URL:https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb [38930180/38930180] -> "/tmp/linux-image.deb" [1] 2023-12-19T18:43:48.518 INFO:teuthology.orchestra.run.smithi133.stderr:FINISHED --2023-12-19 18:43:48-- 2023-12-19T18:43:48.518 INFO:teuthology.orchestra.run.smithi133.stderr:Total wall clock time: 1.5s 2023-12-19T18:43:48.518 INFO:teuthology.orchestra.run.smithi133.stderr:Downloaded: 1 files, 37M in 1.4s (27.1 MB/s) 2023-12-19T18:43:48.522 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.0... 2023-12-19T18:43:48.522 DEBUG:teuthology.orchestra.run.smithi133:> sudo dpkg -i /tmp/linux-image.deb 2023-12-19T18:43:48.788 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package linux-image-6.6.0-gcd68252d7b4d. 2023-12-19T18:43:49.653 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-19T18:43:49.761 INFO:teuthology.orchestra.run.smithi138.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T18:43:50.761 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-12-19T18:43:50.765 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-19T18:43:50.916 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-19T18:43:54.579 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-19T18:43:54.711 INFO:teuthology.orchestra.run.smithi133.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T18:44:11.167 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub' 2023-12-19T18:44:11.177 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-19T18:44:11.209 INFO:teuthology.orchestra.run.smithi138.stderr:Generating grub configuration file ... 2023-12-19T18:44:11.600 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T18:44:11.619 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T18:44:12.002 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-19T18:44:12.016 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-19T18:44:12.085 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-19T18:44:12.090 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-19T18:44:12.229 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-19T18:44:12.230 INFO:teuthology.orchestra.run.smithi138.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-19T18:44:12.230 INFO:teuthology.orchestra.run.smithi138.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-19T18:44:12.274 INFO:teuthology.orchestra.run.smithi138.stderr:done 2023-12-19T18:44:12.475 DEBUG:teuthology.orchestra.run.smithi138:> dpkg-deb -c /tmp/linux-image.deb 2023-12-19T18:44:12.482 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./ 2023-12-19T18:44:12.482 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./boot/ 2023-12-19T18:44:12.482 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 4415617 2023-12-08 17:49 ./boot/System.map-6.6.0-gcd68252d7b4d 2023-12-19T18:44:12.491 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 169214 2023-12-08 17:49 ./boot/config-6.6.0-gcd68252d7b4d 2023-12-19T18:44:12.492 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11352864 2023-12-08 17:49 ./boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T18:44:12.509 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/ 2023-12-19T18:44:12.509 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/ 2023-12-19T18:44:12.509 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postinst.d/ 2023-12-19T18:44:12.509 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postrm.d/ 2023-12-19T18:44:12.509 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/preinst.d/ 2023-12-19T18:44:12.509 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/prerm.d/ 2023-12-19T18:44:12.509 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/ 2023-12-19T18:44:12.509 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/ 2023-12-19T18:44:12.509 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/ 2023-12-19T18:44:12.509 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/ 2023-12-19T18:44:12.510 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/ 2023-12-19T18:44:12.510 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/ 2023-12-19T18:44:12.510 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ 2023-12-19T18:44:12.510 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 490233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-19T18:44:12.512 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-19T18:44:12.512 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-19T18:44:12.512 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-19T18:44:12.512 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 93113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-19T18:44:12.513 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 106729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-19T18:44:12.513 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 152241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-19T18:44:12.513 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-19T18:44:12.513 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-19T18:44:12.513 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 83889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-19T18:44:12.513 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-19T18:44:12.513 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-19T18:44:12.513 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-19T18:44:12.513 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-19T18:44:12.513 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-19T18:44:12.513 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-19T18:44:12.513 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 58585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-19T18:44:12.513 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-19T18:44:12.514 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-19T18:44:12.514 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-19T18:44:12.514 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/ 2023-12-19T18:44:12.514 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/ 2023-12-19T18:44:12.514 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/ 2023-12-19T18:44:12.514 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-19T18:44:12.514 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpuid.ko 2023-12-19T18:44:12.514 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/msr.ko 2023-12-19T18:44:12.514 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/ 2023-12-19T18:44:12.514 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 354433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-19T18:44:12.514 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 881625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-19T18:44:12.515 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 2275865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-19T18:44:12.526 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ 2023-12-19T18:44:12.526 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/af_alg.ko 2023-12-19T18:44:12.526 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_hash.ko 2023-12-19T18:44:12.526 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_skcipher.ko 2023-12-19T18:44:12.526 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-19T18:44:12.526 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-19T18:44:12.526 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-19T18:44:12.526 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/ 2023-12-19T18:44:12.526 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-19T18:44:12.527 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/ 2023-12-19T18:44:12.527 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-19T18:44:12.527 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-19T18:44:12.527 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-19T18:44:12.527 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-19T18:44:12.527 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-19T18:44:12.527 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-19T18:44:12.527 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-19T18:44:12.527 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-19T18:44:12.527 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-19T18:44:12.527 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-19T18:44:12.527 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-19T18:44:12.527 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-19T18:44:12.528 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-19T18:44:12.528 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-19T18:44:12.528 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-19T18:44:12.528 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-19T18:44:12.528 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-19T18:44:12.528 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-19T18:44:12.528 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cryptd.ko 2023-12-19T18:44:12.528 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-19T18:44:12.528 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_simd.ko 2023-12-19T18:44:12.528 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-19T18:44:12.528 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-19T18:44:12.528 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-19T18:44:12.529 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-19T18:44:12.529 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-19T18:44:12.529 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-19T18:44:12.529 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-19T18:44:12.529 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-19T18:44:12.529 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lrw.ko 2023-12-19T18:44:12.529 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-19T18:44:12.529 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-19T18:44:12.529 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-19T18:44:12.529 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-19T18:44:12.529 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-19T18:44:12.529 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-19T18:44:12.530 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-19T18:44:12.530 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-19T18:44:12.530 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-19T18:44:12.530 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 149193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-19T18:44:12.530 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-19T18:44:12.530 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-19T18:44:12.530 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-19T18:44:12.530 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-19T18:44:12.530 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-19T18:44:12.530 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-19T18:44:12.530 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-19T18:44:12.530 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xts.ko 2023-12-19T18:44:12.530 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-19T18:44:12.530 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ 2023-12-19T18:44:12.530 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ 2023-12-19T18:44:12.531 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_extlog.ko 2023-12-19T18:44:12.531 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-19T18:44:12.531 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-19T18:44:12.531 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/ 2023-12-19T18:44:12.531 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/einj.ko 2023-12-19T18:44:12.531 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-19T18:44:12.531 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-19T18:44:12.531 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-19T18:44:12.531 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-19T18:44:12.531 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 103025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-19T18:44:12.531 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ 2023-12-19T18:44:12.531 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-19T18:44:12.531 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 88865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci.ko 2023-12-19T18:44:12.531 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-19T18:44:12.531 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 88289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci.ko 2023-12-19T18:44:12.532 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-19T18:44:12.532 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-19T18:44:12.532 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-19T18:44:12.532 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-19T18:44:12.532 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-19T18:44:12.532 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-19T18:44:12.532 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-19T18:44:12.532 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-19T18:44:12.532 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-19T18:44:12.532 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-19T18:44:12.532 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-19T18:44:12.532 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-19T18:44:12.532 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-19T18:44:12.532 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-19T18:44:12.532 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-19T18:44:12.533 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-19T18:44:12.533 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-19T18:44:12.533 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-19T18:44:12.533 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_legacy.ko 2023-12-19T18:44:12.533 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-19T18:44:12.533 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-19T18:44:12.533 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-19T18:44:12.533 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-19T18:44:12.533 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-19T18:44:12.533 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-19T18:44:12.533 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-19T18:44:12.533 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-19T18:44:12.533 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-19T18:44:12.533 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-19T18:44:12.533 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-19T18:44:12.534 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-19T18:44:12.534 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-19T18:44:12.534 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_radisys.ko 2023-12-19T18:44:12.534 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-19T18:44:12.534 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rz1000.ko 2023-12-19T18:44:12.534 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-19T18:44:12.534 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-19T18:44:12.534 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-19T18:44:12.534 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-19T18:44:12.534 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-19T18:44:12.534 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-19T18:44:12.534 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-19T18:44:12.534 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-19T18:44:12.534 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 83345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-19T18:44:12.534 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-19T18:44:12.535 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-19T18:44:12.535 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-19T18:44:12.535 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-19T18:44:12.535 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-19T18:44:12.535 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-19T18:44:12.535 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-19T18:44:12.535 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-19T18:44:12.535 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-19T18:44:12.535 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-19T18:44:12.535 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-19T18:44:12.535 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ 2023-12-19T18:44:12.535 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-19T18:44:12.535 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/ 2023-12-19T18:44:12.535 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 124473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-19T18:44:12.536 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/ 2023-12-19T18:44:12.536 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/ 2023-12-19T18:44:12.536 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 113665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-19T18:44:12.536 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/ 2023-12-19T18:44:12.536 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 965585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-19T18:44:12.536 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 173225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-19T18:44:12.536 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/ 2023-12-19T18:44:12.536 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 94297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-19T18:44:12.536 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 115793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-19T18:44:12.584 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/ 2023-12-19T18:44:12.584 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 110385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-19T18:44:12.584 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 98193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-19T18:44:12.584 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 263769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-19T18:44:12.585 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/ 2023-12-19T18:44:12.585 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 98145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-19T18:44:12.585 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/ 2023-12-19T18:44:12.585 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-19T18:44:12.585 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ 2023-12-19T18:44:12.585 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/applicom.ko 2023-12-19T18:44:12.585 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-19T18:44:12.585 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/ 2023-12-19T18:44:12.585 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-19T18:44:12.585 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-19T18:44:12.585 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-19T18:44:12.585 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-19T18:44:12.586 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-19T18:44:12.586 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ 2023-12-19T18:44:12.586 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-19T18:44:12.586 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 148601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-19T18:44:12.586 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-19T18:44:12.586 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 139313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-19T18:44:12.586 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-19T18:44:12.586 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-19T18:44:12.586 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-19T18:44:12.586 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/ 2023-12-19T18:44:12.586 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 84097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-19T18:44:12.586 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/nvram.ko 2023-12-19T18:44:12.586 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-19T18:44:12.586 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-19T18:44:12.587 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/ 2023-12-19T18:44:12.587 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-19T18:44:12.587 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-19T18:44:12.587 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-19T18:44:12.587 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-19T18:44:12.587 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-19T18:44:12.587 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-19T18:44:12.587 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-19T18:44:12.587 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/ 2023-12-19T18:44:12.587 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-19T18:44:12.587 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-19T18:44:12.587 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-19T18:44:12.587 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/ 2023-12-19T18:44:12.587 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-palmas.ko 2023-12-19T18:44:12.587 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-si5351.ko 2023-12-19T18:44:12.588 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-twl6040.ko 2023-12-19T18:44:12.588 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-wm831x.ko 2023-12-19T18:44:12.588 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/ 2023-12-19T18:44:12.588 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-19T18:44:12.588 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-19T18:44:12.588 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-19T18:44:12.588 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ 2023-12-19T18:44:12.588 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ 2023-12-19T18:44:12.588 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-19T18:44:12.588 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 243025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-19T18:44:12.588 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/ 2023-12-19T18:44:12.588 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/ 2023-12-19T18:44:12.588 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-19T18:44:12.588 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 438761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-19T18:44:12.589 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-19T18:44:12.589 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-19T18:44:12.589 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-19T18:44:12.589 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-19T18:44:12.589 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/ 2023-12-19T18:44:12.589 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-19T18:44:12.589 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/ 2023-12-19T18:44:12.589 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-19T18:44:12.589 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ 2023-12-19T18:44:12.589 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/ 2023-12-19T18:44:12.589 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-19T18:44:12.589 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ 2023-12-19T18:44:12.589 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 122569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-19T18:44:12.589 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ 2023-12-19T18:44:12.590 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 79953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-19T18:44:12.590 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-19T18:44:12.590 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 63617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-19T18:44:12.590 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-19T18:44:12.590 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-19T18:44:12.590 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-19T18:44:12.590 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-19T18:44:12.590 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-19T18:44:12.590 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-19T18:44:12.590 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-19T18:44:12.590 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-19T18:44:12.590 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 56825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-19T18:44:12.590 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-19T18:44:12.591 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/ 2023-12-19T18:44:12.591 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-gpio.ko 2023-12-19T18:44:12.591 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max14577.ko 2023-12-19T18:44:12.591 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max77693.ko 2023-12-19T18:44:12.591 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max8997.ko 2023-12-19T18:44:12.591 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-palmas.ko 2023-12-19T18:44:12.591 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-19T18:44:12.591 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-19T18:44:12.591 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/ 2023-12-19T18:44:12.591 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-19T18:44:12.591 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/ 2023-12-19T18:44:12.591 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-19T18:44:12.591 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-19T18:44:12.591 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/ 2023-12-19T18:44:12.591 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-19T18:44:12.592 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-19T18:44:12.592 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-arizona.ko 2023-12-19T18:44:12.592 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9052.ko 2023-12-19T18:44:12.592 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9055.ko 2023-12-19T18:44:12.592 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-dln2.ko 2023-12-19T18:44:12.592 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 77849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-19T18:44:12.592 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-generic.ko 2023-12-19T18:44:12.592 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-19T18:44:12.592 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-19T18:44:12.592 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-kempld.ko 2023-12-19T18:44:12.592 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-19T18:44:12.592 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max7300.ko 2023-12-19T18:44:12.592 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max730x.ko 2023-12-19T18:44:12.592 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max732x.ko 2023-12-19T18:44:12.593 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-19T18:44:12.593 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-19T18:44:12.593 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-19T18:44:12.593 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-19T18:44:12.593 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch.ko 2023-12-19T18:44:12.593 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-19T18:44:12.593 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-19T18:44:12.593 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-19T18:44:12.593 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-19T18:44:12.593 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-19T18:44:12.593 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-vx855.ko 2023-12-19T18:44:12.593 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-19T18:44:12.593 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-19T18:44:12.594 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-19T18:44:12.594 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/ 2023-12-19T18:44:12.594 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-a4tech.ko 2023-12-19T18:44:12.594 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-apple.ko 2023-12-19T18:44:12.594 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-19T18:44:12.594 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-19T18:44:12.594 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-19T18:44:12.594 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-belkin.ko 2023-12-19T18:44:12.594 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cherry.ko 2023-12-19T18:44:12.594 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-chicony.ko 2023-12-19T18:44:12.594 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cp2112.ko 2023-12-19T18:44:12.594 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cypress.ko 2023-12-19T18:44:12.594 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-19T18:44:12.594 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-19T18:44:12.595 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-19T18:44:12.595 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-19T18:44:12.595 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ezkey.ko 2023-12-19T18:44:12.595 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-19T18:44:12.595 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-generic.ko 2023-12-19T18:44:12.595 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-19T18:44:12.595 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-19T18:44:12.595 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-19T18:44:12.595 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-19T18:44:12.595 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-19T18:44:12.595 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-19T18:44:12.595 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-19T18:44:12.595 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kensington.ko 2023-12-19T18:44:12.595 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-19T18:44:12.596 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-19T18:44:12.596 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-19T18:44:12.596 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-19T18:44:12.596 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-19T18:44:12.596 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lg-g15.ko 2023-12-19T18:44:12.596 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 58185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-19T18:44:12.596 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 101481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-19T18:44:12.596 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 80993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech.ko 2023-12-19T18:44:12.596 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-magicmouse.ko 2023-12-19T18:44:12.596 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-microsoft.ko 2023-12-19T18:44:12.596 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-monterey.ko 2023-12-19T18:44:12.596 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-19T18:44:12.596 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ntrig.ko 2023-12-19T18:44:12.597 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-19T18:44:12.597 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-19T18:44:12.597 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-19T18:44:12.597 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 72937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-19T18:44:12.597 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-19T18:44:12.597 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-19T18:44:12.597 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-19T18:44:12.597 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-19T18:44:12.597 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-19T18:44:12.597 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-19T18:44:12.597 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-19T18:44:12.597 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-19T18:44:12.598 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-19T18:44:12.598 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-19T18:44:12.598 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-19T18:44:12.598 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-19T18:44:12.598 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-19T18:44:12.598 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-19T18:44:12.598 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-19T18:44:12.598 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-19T18:44:12.598 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-19T18:44:12.598 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-19T18:44:12.598 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-19T18:44:12.598 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-19T18:44:12.598 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-19T18:44:12.598 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-19T18:44:12.599 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-19T18:44:12.599 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-19T18:44:12.599 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-19T18:44:12.599 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-19T18:44:12.599 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-19T18:44:12.599 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-19T18:44:12.599 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-19T18:44:12.599 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 71073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-19T18:44:12.599 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-19T18:44:12.599 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 143473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-19T18:44:12.599 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-19T18:44:12.599 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-19T18:44:12.599 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-19T18:44:12.600 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 267825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid.ko 2023-12-19T18:44:12.600 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-19T18:44:12.600 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/ 2023-12-19T18:44:12.600 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 125721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-19T18:44:12.600 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-19T18:44:12.600 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-19T18:44:12.600 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 217873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-19T18:44:12.600 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/ 2023-12-19T18:44:12.600 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 64201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-19T18:44:12.600 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 89625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-19T18:44:12.600 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 305465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-19T18:44:12.600 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ 2023-12-19T18:44:12.600 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-19T18:44:12.600 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-19T18:44:12.601 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-19T18:44:12.601 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-19T18:44:12.601 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-19T18:44:12.601 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-19T18:44:12.601 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-19T18:44:12.601 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 97977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-19T18:44:12.601 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-19T18:44:12.601 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-19T18:44:12.601 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-19T18:44:12.601 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-19T18:44:12.601 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-19T18:44:12.601 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-19T18:44:12.601 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 74433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-19T18:44:12.601 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-19T18:44:12.602 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-19T18:44:12.602 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-19T18:44:12.602 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-19T18:44:12.602 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-19T18:44:12.602 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-19T18:44:12.602 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 58617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-19T18:44:12.602 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-19T18:44:12.602 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-19T18:44:12.602 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-19T18:44:12.602 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-19T18:44:12.602 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-19T18:44:12.602 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-19T18:44:12.602 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 99601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-19T18:44:12.603 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-19T18:44:12.603 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-19T18:44:12.603 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-19T18:44:12.603 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc2103.ko 2023-12-19T18:44:12.603 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-19T18:44:12.603 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-19T18:44:12.603 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 94457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-19T18:44:12.603 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-19T18:44:12.603 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-19T18:44:12.603 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-19T18:44:12.603 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-19T18:44:12.603 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-19T18:44:12.603 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-19T18:44:12.603 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-19T18:44:12.603 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hih6130.ko 2023-12-19T18:44:12.604 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-19T18:44:12.604 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-19T18:44:12.604 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-19T18:44:12.604 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-19T18:44:12.604 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-19T18:44:12.604 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-19T18:44:12.604 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-19T18:44:12.604 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 130449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-19T18:44:12.604 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/jc42.ko 2023-12-19T18:44:12.604 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-19T18:44:12.604 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-19T18:44:12.604 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-19T18:44:12.604 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 48601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-19T18:44:12.604 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-19T18:44:12.605 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-19T18:44:12.605 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-19T18:44:12.605 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-19T18:44:12.605 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-19T18:44:12.605 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-19T18:44:12.605 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 72833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-19T18:44:12.605 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-19T18:44:12.605 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-19T18:44:12.605 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-19T18:44:12.605 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 108841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-19T18:44:12.605 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-19T18:44:12.605 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-19T18:44:12.605 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-19T18:44:12.605 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-19T18:44:12.606 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-19T18:44:12.606 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-19T18:44:12.606 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-19T18:44:12.606 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-19T18:44:12.606 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-19T18:44:12.606 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-19T18:44:12.606 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-19T18:44:12.606 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-19T18:44:12.606 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-19T18:44:12.606 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-19T18:44:12.606 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-19T18:44:12.606 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-19T18:44:12.607 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-19T18:44:12.607 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-19T18:44:12.607 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-19T18:44:12.607 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-19T18:44:12.607 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-19T18:44:12.607 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 119817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-19T18:44:12.607 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-19T18:44:12.607 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-19T18:44:12.607 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 82337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-19T18:44:12.607 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-19T18:44:12.607 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-19T18:44:12.607 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ 2023-12-19T18:44:12.608 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-19T18:44:12.608 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-19T18:44:12.608 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-19T18:44:12.608 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-19T18:44:12.608 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-19T18:44:12.609 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-19T18:44:12.609 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-19T18:44:12.609 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 82577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-19T18:44:12.609 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-19T18:44:12.609 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-19T18:44:12.609 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-19T18:44:12.609 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-19T18:44:12.609 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-19T18:44:12.609 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-19T18:44:12.609 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-19T18:44:12.609 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-19T18:44:12.609 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-19T18:44:12.609 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-19T18:44:12.610 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-19T18:44:12.610 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-19T18:44:12.610 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-19T18:44:12.610 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-19T18:44:12.610 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-19T18:44:12.610 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-19T18:44:12.610 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-19T18:44:12.610 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-19T18:44:12.610 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-19T18:44:12.610 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-19T18:44:12.610 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-19T18:44:12.610 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-19T18:44:12.610 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-19T18:44:12.610 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-19T18:44:12.610 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 57449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-19T18:44:12.611 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-19T18:44:12.611 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 71345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-19T18:44:12.611 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 63225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-19T18:44:12.611 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 71321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-19T18:44:12.611 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 101473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-19T18:44:12.611 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 119505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-19T18:44:12.611 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-19T18:44:12.611 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-19T18:44:12.611 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-19T18:44:12.611 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-19T18:44:12.611 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/ 2023-12-19T18:44:12.611 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/ 2023-12-19T18:44:12.612 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-19T18:44:12.612 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-19T18:44:12.612 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/ 2023-12-19T18:44:12.612 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-19T18:44:12.612 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-19T18:44:12.612 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-19T18:44:12.612 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-19T18:44:12.612 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-19T18:44:12.612 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-19T18:44:12.612 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-19T18:44:12.612 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 6929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-19T18:44:12.612 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-19T18:44:12.612 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-19T18:44:12.613 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-19T18:44:12.613 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-19T18:44:12.613 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-19T18:44:12.613 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-19T18:44:12.613 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-19T18:44:12.613 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-19T18:44:12.613 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-19T18:44:12.613 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-19T18:44:12.613 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-19T18:44:12.613 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-19T18:44:12.613 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-19T18:44:12.613 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-19T18:44:12.613 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-19T18:44:12.614 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-19T18:44:12.614 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-19T18:44:12.614 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-19T18:44:12.614 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-19T18:44:12.614 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-19T18:44:12.614 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-19T18:44:12.614 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-19T18:44:12.614 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-19T18:44:12.614 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-19T18:44:12.614 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-19T18:44:12.614 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-19T18:44:12.614 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-19T18:44:12.614 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-19T18:44:12.615 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-19T18:44:12.615 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-19T18:44:12.615 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-19T18:44:12.615 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-19T18:44:12.615 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/ 2023-12-19T18:44:12.615 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-19T18:44:12.615 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-19T18:44:12.615 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-19T18:44:12.615 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ 2023-12-19T18:44:12.615 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ 2023-12-19T18:44:12.615 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 273609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-19T18:44:12.615 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 879969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-19T18:44:12.615 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 69273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-19T18:44:12.616 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 324217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-19T18:44:12.616 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 97985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-19T18:44:12.616 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 282273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-19T18:44:12.616 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-19T18:44:12.616 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ 2023-12-19T18:44:12.616 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-19T18:44:12.616 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 493073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-19T18:44:12.616 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/ 2023-12-19T18:44:12.616 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 419737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-19T18:44:12.616 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/ 2023-12-19T18:44:12.616 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 739025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-19T18:44:12.616 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ 2023-12-19T18:44:12.616 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 296625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-19T18:44:12.616 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-19T18:44:12.616 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 153697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-19T18:44:12.616 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/ 2023-12-19T18:44:12.617 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 168969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-19T18:44:12.617 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ 2023-12-19T18:44:12.617 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-19T18:44:12.617 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 263081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-19T18:44:12.617 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ 2023-12-19T18:44:12.617 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 100241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-19T18:44:12.617 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ 2023-12-19T18:44:12.617 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 111425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-19T18:44:12.617 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ 2023-12-19T18:44:12.617 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 128753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-19T18:44:12.617 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ 2023-12-19T18:44:12.617 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 129529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-19T18:44:12.618 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ 2023-12-19T18:44:12.618 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/evbug.ko 2023-12-19T18:44:12.618 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ff-memless.ko 2023-12-19T18:44:12.618 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/ 2023-12-19T18:44:12.618 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-19T18:44:12.618 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-19T18:44:12.618 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-19T18:44:12.618 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-19T18:44:12.618 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/ 2023-12-19T18:44:12.618 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-19T18:44:12.618 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-19T18:44:12.618 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-19T18:44:12.619 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-19T18:44:12.619 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-19T18:44:12.619 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-19T18:44:12.619 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-19T18:44:12.619 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8323.ko 2023-12-19T18:44:12.619 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8333.ko 2023-12-19T18:44:12.619 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-19T18:44:12.619 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-19T18:44:12.619 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-19T18:44:12.619 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-19T18:44:12.619 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-19T18:44:12.620 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-19T18:44:12.620 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt1070.ko 2023-12-19T18:44:12.620 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt2160.ko 2023-12-19T18:44:12.620 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-19T18:44:12.620 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/stowaway.ko 2023-12-19T18:44:12.620 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-19T18:44:12.620 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-19T18:44:12.620 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-19T18:44:12.620 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-19T18:44:12.620 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-19T18:44:12.620 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/matrix-keymap.ko 2023-12-19T18:44:12.620 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/ 2023-12-19T18:44:12.620 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-19T18:44:12.621 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-19T18:44:12.621 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 123681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-19T18:44:12.621 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 89449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-19T18:44:12.621 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-19T18:44:12.621 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 335929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/psmouse.ko 2023-12-19T18:44:12.621 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-19T18:44:12.621 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-19T18:44:12.621 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-19T18:44:12.621 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-19T18:44:12.621 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/ 2023-12-19T18:44:12.621 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 109873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-19T18:44:12.621 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ 2023-12-19T18:44:12.622 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-19T18:44:12.622 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-19T18:44:12.622 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ct82c710.ko 2023-12-19T18:44:12.622 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-19T18:44:12.622 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/parkbd.ko 2023-12-19T18:44:12.622 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/pcips2.ko 2023-12-19T18:44:12.622 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ps2mult.ko 2023-12-19T18:44:12.622 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-19T18:44:12.622 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serport.ko 2023-12-19T18:44:12.622 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-19T18:44:12.622 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/ 2023-12-19T18:44:12.622 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/ 2023-12-19T18:44:12.622 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-19T18:44:12.622 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/ 2023-12-19T18:44:12.622 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-88pm860x.ko 2023-12-19T18:44:12.623 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-adp5520.ko 2023-12-19T18:44:12.623 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-bd2802.ko 2023-12-19T18:44:12.623 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-19T18:44:12.623 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da903x.ko 2023-12-19T18:44:12.623 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da9052.ko 2023-12-19T18:44:12.623 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-gpio.ko 2023-12-19T18:44:12.623 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-19T18:44:12.623 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3533.ko 2023-12-19T18:44:12.623 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm355x.ko 2023-12-19T18:44:12.623 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3642.ko 2023-12-19T18:44:12.623 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-19T18:44:12.623 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp8788.ko 2023-12-19T18:44:12.623 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-max8997.ko 2023-12-19T18:44:12.623 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-mc13783.ko 2023-12-19T18:44:12.624 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-19T18:44:12.624 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca9532.ko 2023-12-19T18:44:12.624 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca955x.ko 2023-12-19T18:44:12.624 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca963x.ko 2023-12-19T18:44:12.624 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-19T18:44:12.624 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-tca6507.ko 2023-12-19T18:44:12.624 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-19T18:44:12.624 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm8350.ko 2023-12-19T18:44:12.624 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ 2023-12-19T18:44:12.624 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-19T18:44:12.624 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-19T18:44:12.624 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-19T18:44:12.624 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-19T18:44:12.624 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-19T18:44:12.624 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-19T18:44:12.625 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-19T18:44:12.625 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-19T18:44:12.625 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/ 2023-12-19T18:44:12.625 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/ 2023-12-19T18:44:12.625 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 654969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-19T18:44:12.625 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-19T18:44:12.625 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 89601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bufio.ko 2023-12-19T18:44:12.625 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-19T18:44:12.625 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 156009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-19T18:44:12.625 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 106897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-19T18:44:12.625 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-19T18:44:12.625 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-era.ko 2023-12-19T18:44:12.625 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-19T18:44:12.626 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-19T18:44:12.626 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log.ko 2023-12-19T18:44:12.626 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-mirror.ko 2023-12-19T18:44:12.626 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-19T18:44:12.626 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-19T18:44:12.626 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-19T18:44:12.626 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-region-hash.ko 2023-12-19T18:44:12.626 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-19T18:44:12.626 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-19T18:44:12.626 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 109529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-snapshot.ko 2023-12-19T18:44:12.626 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-19T18:44:12.626 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 181865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-19T18:44:12.626 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-19T18:44:12.626 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-zero.ko 2023-12-19T18:44:12.626 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-19T18:44:12.627 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-19T18:44:12.627 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-19T18:44:12.627 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/ 2023-12-19T18:44:12.627 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 199937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-19T18:44:12.627 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-19T18:44:12.627 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 113073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-19T18:44:12.627 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 158681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-19T18:44:12.627 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 395721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-19T18:44:12.627 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/ 2023-12-19T18:44:12.627 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/ 2023-12-19T18:44:12.627 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 178137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-19T18:44:12.627 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 63385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-19T18:44:12.627 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-19T18:44:12.627 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-19T18:44:12.627 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 123321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-19T18:44:12.628 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 79041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-19T18:44:12.628 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-19T18:44:12.628 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ 2023-12-19T18:44:12.628 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm800.ko 2023-12-19T18:44:12.628 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm805.ko 2023-12-19T18:44:12.628 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm80x.ko 2023-12-19T18:44:12.628 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona-i2c.ko 2023-12-19T18:44:12.628 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 123721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona.ko 2023-12-19T18:44:12.628 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/bcm590xx.ko 2023-12-19T18:44:12.628 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-19T18:44:12.628 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/dln2.ko 2023-12-19T18:44:12.628 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/janz-cmodio.ko 2023-12-19T18:44:12.628 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/kempld-core.ko 2023-12-19T18:44:12.628 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-core.ko 2023-12-19T18:44:12.628 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-19T18:44:12.629 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lp3943.ko 2023-12-19T18:44:12.629 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-19T18:44:12.629 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-19T18:44:12.629 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/max8907.ko 2023-12-19T18:44:12.629 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-19T18:44:12.629 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-19T18:44:12.629 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/menf21bmc.ko 2023-12-19T18:44:12.629 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-19T18:44:12.629 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-19T18:44:12.629 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633.ko 2023-12-19T18:44:12.629 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-19T18:44:12.629 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/retu-mfd.ko 2023-12-19T18:44:12.629 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 80425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/si476x-core.ko 2023-12-19T18:44:12.629 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 48457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-19T18:44:12.630 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-19T18:44:12.630 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps65010.ko 2023-12-19T18:44:12.630 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps6507x.ko 2023-12-19T18:44:12.630 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-19T18:44:12.630 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-19T18:44:12.630 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-19T18:44:12.630 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wm8994.ko 2023-12-19T18:44:12.630 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ 2023-12-19T18:44:12.630 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-19T18:44:12.630 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 48489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot.ko 2023-12-19T18:44:12.630 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/ 2023-12-19T18:44:12.630 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-19T18:44:12.630 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-19T18:44:12.631 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-19T18:44:12.631 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-19T18:44:12.631 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/ 2023-12-19T18:44:12.631 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-19T18:44:12.631 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/core.ko 2023-12-19T18:44:12.631 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/ 2023-12-19T18:44:12.631 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-19T18:44:12.631 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ds1682.ko 2023-12-19T18:44:12.632 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/dummy-irq.ko 2023-12-19T18:44:12.632 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/ 2023-12-19T18:44:12.632 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/echo.ko 2023-12-19T18:44:12.632 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/ 2023-12-19T18:44:12.632 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-19T18:44:12.632 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-19T18:44:12.632 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-19T18:44:12.632 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-19T18:44:12.632 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-19T18:44:12.632 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/ 2023-12-19T18:44:12.632 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 152201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-19T18:44:12.633 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hmc6352.ko 2023-12-19T18:44:12.633 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-19T18:44:12.633 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ 2023-12-19T18:44:12.633 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 72129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-19T18:44:12.633 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ics932s401.ko 2023-12-19T18:44:12.633 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-19T18:44:12.633 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-19T18:44:12.633 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/ 2023-12-19T18:44:12.633 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-19T18:44:12.633 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-19T18:44:12.633 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/ 2023-12-19T18:44:12.633 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 125209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-19T18:44:12.633 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 56521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-19T18:44:12.634 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 310113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-19T18:44:12.634 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/phantom.ko 2023-12-19T18:44:12.634 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/ 2023-12-19T18:44:12.634 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 74265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-19T18:44:12.634 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-19T18:44:12.634 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-19T18:44:12.634 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-19T18:44:12.634 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 48697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-19T18:44:12.634 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/ 2023-12-19T18:44:12.634 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 183609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-19T18:44:12.635 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ 2023-12-19T18:44:12.635 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/ 2023-12-19T18:44:12.635 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 490129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-19T18:44:12.635 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/ 2023-12-19T18:44:12.635 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/ 2023-12-19T18:44:12.635 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 106033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-19T18:44:12.635 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-19T18:44:12.635 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-19T18:44:12.635 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-19T18:44:12.635 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 453737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-19T18:44:12.635 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-19T18:44:12.635 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-19T18:44:12.635 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ 2023-12-19T18:44:12.635 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/ 2023-12-19T18:44:12.635 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-19T18:44:12.636 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-19T18:44:12.636 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 130553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-19T18:44:12.636 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 68849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-19T18:44:12.636 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ 2023-12-19T18:44:12.636 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-19T18:44:12.636 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-19T18:44:12.636 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-19T18:44:12.636 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 99049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-19T18:44:12.636 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/ 2023-12-19T18:44:12.636 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-19T18:44:12.636 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/ 2023-12-19T18:44:12.636 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 69137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-19T18:44:12.636 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/ 2023-12-19T18:44:12.636 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-19T18:44:12.636 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/ 2023-12-19T18:44:12.637 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-19T18:44:12.637 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/ 2023-12-19T18:44:12.637 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-19T18:44:12.637 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-19T18:44:12.637 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 87297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-19T18:44:12.637 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/ 2023-12-19T18:44:12.637 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-19T18:44:12.637 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 97337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-19T18:44:12.637 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-19T18:44:12.637 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 104673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-19T18:44:12.637 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-19T18:44:12.637 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 90257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-19T18:44:12.637 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-19T18:44:12.637 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 81569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-19T18:44:12.638 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 69729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-19T18:44:12.638 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/ 2023-12-19T18:44:12.638 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-19T18:44:12.638 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 176761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-19T18:44:12.638 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-19T18:44:12.638 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1421497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-19T18:44:12.638 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 128569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-19T18:44:12.638 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-19T18:44:12.638 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 132089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-19T18:44:12.638 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 312081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-19T18:44:12.638 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/ 2023-12-19T18:44:12.638 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-19T18:44:12.638 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 323513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-19T18:44:12.638 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/ 2023-12-19T18:44:12.639 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-19T18:44:12.639 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 193497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-19T18:44:12.639 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-19T18:44:12.639 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 347417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-19T18:44:12.639 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-19T18:44:12.639 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1044497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-19T18:44:12.639 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-19T18:44:12.639 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 166193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-19T18:44:12.639 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-19T18:44:12.639 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-19T18:44:12.639 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/ 2023-12-19T18:44:12.639 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-19T18:44:12.639 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 204345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-19T18:44:12.696 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/ 2023-12-19T18:44:12.696 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-19T18:44:12.696 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 69449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-19T18:44:12.696 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-19T18:44:12.696 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 141225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-19T18:44:12.696 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-19T18:44:12.696 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-19T18:44:12.696 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-19T18:44:12.697 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/ 2023-12-19T18:44:12.697 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-19T18:44:12.697 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 62833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-19T18:44:12.697 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-19T18:44:12.697 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-19T18:44:12.697 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/ 2023-12-19T18:44:12.697 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-19T18:44:12.697 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 281137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-19T18:44:12.697 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-19T18:44:12.697 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-19T18:44:12.697 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/ 2023-12-19T18:44:12.697 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-19T18:44:12.697 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ 2023-12-19T18:44:12.697 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 90465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-19T18:44:12.698 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-19T18:44:12.698 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 295577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-19T18:44:12.698 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-19T18:44:12.698 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 584497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-19T18:44:12.698 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-19T18:44:12.698 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 246209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-19T18:44:12.698 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-19T18:44:12.698 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 925825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-19T18:44:12.698 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-19T18:44:12.698 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 302937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-19T18:44:12.698 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/ 2023-12-19T18:44:12.698 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 514641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-19T18:44:12.698 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-19T18:44:12.698 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 93593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-19T18:44:12.699 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-19T18:44:12.699 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 734305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-19T18:44:12.699 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-19T18:44:12.699 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 151769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-19T18:44:12.699 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 86921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-19T18:44:12.699 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/ 2023-12-19T18:44:12.699 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-19T18:44:12.699 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 102289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-19T18:44:12.699 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 122649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-19T18:44:12.699 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/ 2023-12-19T18:44:12.699 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-19T18:44:12.699 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 727601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-19T18:44:12.699 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 278937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-19T18:44:12.699 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-19T18:44:12.699 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-19T18:44:12.700 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1113681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-19T18:44:12.700 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ 2023-12-19T18:44:12.700 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-19T18:44:12.700 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-19T18:44:12.700 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-19T18:44:12.700 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 95665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-19T18:44:12.700 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/ 2023-12-19T18:44:12.700 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-19T18:44:12.700 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 108649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-19T18:44:12.700 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ 2023-12-19T18:44:12.700 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 73441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-19T18:44:12.700 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-19T18:44:12.701 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/ 2023-12-19T18:44:12.701 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 150905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-19T18:44:12.701 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/ 2023-12-19T18:44:12.701 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 136721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-19T18:44:12.701 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/ 2023-12-19T18:44:12.701 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-19T18:44:12.701 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-19T18:44:12.701 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/ 2023-12-19T18:44:12.701 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-19T18:44:12.701 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 227897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-19T18:44:12.701 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 87081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-19T18:44:12.701 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-19T18:44:12.701 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 672049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-19T18:44:12.701 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/ 2023-12-19T18:44:12.702 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-19T18:44:12.702 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/ 2023-12-19T18:44:12.702 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 67385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-19T18:44:12.702 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 83985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-19T18:44:12.702 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-19T18:44:12.702 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 189801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-19T18:44:12.702 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/ 2023-12-19T18:44:12.702 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-19T18:44:12.702 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 104241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-19T18:44:12.702 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/ 2023-12-19T18:44:12.702 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1052497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-19T18:44:12.702 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/ 2023-12-19T18:44:12.702 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-19T18:44:12.703 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/ 2023-12-19T18:44:12.703 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-19T18:44:12.703 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 63337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-19T18:44:12.703 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/ 2023-12-19T18:44:12.703 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-19T18:44:12.703 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 67193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-19T18:44:12.703 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 73409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-19T18:44:12.703 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 68177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-19T18:44:12.703 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/ 2023-12-19T18:44:12.703 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-19T18:44:12.703 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-19T18:44:12.703 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-19T18:44:12.703 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-19T18:44:12.704 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 487025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-19T18:44:12.704 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/ 2023-12-19T18:44:12.704 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 103337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-19T18:44:12.704 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 166097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-19T18:44:12.704 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-19T18:44:12.704 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-19T18:44:12.704 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/ 2023-12-19T18:44:12.704 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-19T18:44:12.704 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/ 2023-12-19T18:44:12.704 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 86529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-19T18:44:12.704 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/ 2023-12-19T18:44:12.704 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 80273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-19T18:44:12.704 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 83633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-19T18:44:12.704 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/ 2023-12-19T18:44:12.705 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-19T18:44:12.705 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-19T18:44:12.705 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/ 2023-12-19T18:44:12.705 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-19T18:44:12.705 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/ 2023-12-19T18:44:12.705 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/defxx.ko 2023-12-19T18:44:12.705 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/ 2023-12-19T18:44:12.705 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 216985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-19T18:44:12.705 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 77345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-19T18:44:12.705 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/ 2023-12-19T18:44:12.705 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 235521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-19T18:44:12.705 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/ 2023-12-19T18:44:12.705 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-19T18:44:12.705 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-19T18:44:12.706 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ 2023-12-19T18:44:12.706 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 83769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-19T18:44:12.706 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 62145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-19T18:44:12.706 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-19T18:44:12.706 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/ 2023-12-19T18:44:12.706 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-19T18:44:12.706 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-19T18:44:12.706 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-19T18:44:12.706 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-19T18:44:12.706 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-19T18:44:12.706 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-19T18:44:12.706 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-19T18:44:12.706 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-19T18:44:12.706 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/ 2023-12-19T18:44:12.707 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-19T18:44:12.707 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-19T18:44:12.707 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ 2023-12-19T18:44:12.707 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-19T18:44:12.707 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-19T18:44:12.707 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-19T18:44:12.707 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-19T18:44:12.707 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-19T18:44:12.707 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-19T18:44:12.707 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-19T18:44:12.707 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-19T18:44:12.707 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-19T18:44:12.707 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-19T18:44:12.707 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 82049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-19T18:44:12.708 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 76113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-19T18:44:12.708 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-19T18:44:12.708 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 97857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-19T18:44:12.708 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-19T18:44:12.708 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-19T18:44:12.708 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-19T18:44:12.708 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-19T18:44:12.708 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-19T18:44:12.708 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/ 2023-12-19T18:44:12.708 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/plip.ko 2023-12-19T18:44:12.708 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ 2023-12-19T18:44:12.708 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-19T18:44:12.708 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-19T18:44:12.708 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-19T18:44:12.708 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-19T18:44:12.709 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-19T18:44:12.709 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-19T18:44:12.709 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-19T18:44:12.709 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-19T18:44:12.709 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sb1000.ko 2023-12-19T18:44:12.709 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/ 2023-12-19T18:44:12.709 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-19T18:44:12.709 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-19T18:44:12.709 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 64449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-19T18:44:12.709 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/ 2023-12-19T18:44:12.709 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 106169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-19T18:44:12.709 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-19T18:44:12.709 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-19T18:44:12.709 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-19T18:44:12.710 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-19T18:44:12.710 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-19T18:44:12.710 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 87017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-19T18:44:12.710 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/ 2023-12-19T18:44:12.710 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 144297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-19T18:44:12.710 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/ 2023-12-19T18:44:12.710 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 297329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-19T18:44:12.710 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/ 2023-12-19T18:44:12.710 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 144585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-19T18:44:12.710 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ 2023-12-19T18:44:12.710 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-19T18:44:12.710 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/ 2023-12-19T18:44:12.710 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/ 2023-12-19T18:44:12.710 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 265121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-19T18:44:12.710 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 102209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-19T18:44:12.711 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/ 2023-12-19T18:44:12.711 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 133841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-19T18:44:12.711 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-19T18:44:12.711 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 84465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-19T18:44:12.711 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-19T18:44:12.711 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/ 2023-12-19T18:44:12.711 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/ 2023-12-19T18:44:12.711 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-19T18:44:12.711 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-19T18:44:12.711 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-19T18:44:12.711 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pci-stub.ko 2023-12-19T18:44:12.711 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-19T18:44:12.711 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/ 2023-12-19T18:44:12.711 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-19T18:44:12.712 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 145809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia.ko 2023-12-19T18:44:12.712 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 62137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-19T18:44:12.712 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-19T18:44:12.712 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-19T18:44:12.712 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 112889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-19T18:44:12.712 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/ 2023-12-19T18:44:12.712 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/ 2023-12-19T18:44:12.712 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-19T18:44:12.712 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/ 2023-12-19T18:44:12.712 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-19T18:44:12.712 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/ 2023-12-19T18:44:12.712 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/ 2023-12-19T18:44:12.712 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-19T18:44:12.712 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/ 2023-12-19T18:44:12.712 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/ 2023-12-19T18:44:12.713 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-19T18:44:12.713 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-19T18:44:12.713 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-19T18:44:12.713 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-19T18:44:12.713 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-19T18:44:12.713 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-19T18:44:12.713 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-19T18:44:12.713 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ 2023-12-19T18:44:12.713 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 67097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-19T18:44:12.713 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-19T18:44:12.713 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-19T18:44:12.713 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-19T18:44:12.713 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-19T18:44:12.713 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 127441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-19T18:44:12.714 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-19T18:44:12.714 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-19T18:44:12.714 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-19T18:44:12.714 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-19T18:44:12.714 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-19T18:44:12.714 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-19T18:44:12.714 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-19T18:44:12.714 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/ 2023-12-19T18:44:12.714 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-19T18:44:12.714 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-19T18:44:12.714 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-19T18:44:12.714 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-19T18:44:12.714 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-19T18:44:12.714 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-19T18:44:12.714 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-19T18:44:12.715 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-19T18:44:12.715 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-19T18:44:12.715 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-19T18:44:12.715 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-19T18:44:12.715 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-19T18:44:12.715 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 57569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-19T18:44:12.715 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/ 2023-12-19T18:44:12.715 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ 2023-12-19T18:44:12.715 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-19T18:44:12.715 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-19T18:44:12.715 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-19T18:44:12.715 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-19T18:44:12.715 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-19T18:44:12.715 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-19T18:44:12.716 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9030_battery.ko 2023-12-19T18:44:12.716 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9052-battery.ko 2023-12-19T18:44:12.716 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-19T18:44:12.716 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-19T18:44:12.716 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-19T18:44:12.716 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-19T18:44:12.716 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/gpio-charger.ko 2023-12-19T18:44:12.716 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-19T18:44:12.716 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-19T18:44:12.716 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max14577_charger.ko 2023-12-19T18:44:12.716 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17040_battery.ko 2023-12-19T18:44:12.716 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17042_battery.ko 2023-12-19T18:44:12.716 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8903_charger.ko 2023-12-19T18:44:12.716 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8925_power.ko 2023-12-19T18:44:12.717 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-19T18:44:12.717 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/sbs-battery.ko 2023-12-19T18:44:12.717 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/test_power.ko 2023-12-19T18:44:12.717 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-19T18:44:12.717 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-19T18:44:12.717 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_power.ko 2023-12-19T18:44:12.717 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm8350_power.ko 2023-12-19T18:44:12.717 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/ 2023-12-19T18:44:12.717 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-19T18:44:12.717 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-19T18:44:12.717 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/ 2023-12-19T18:44:12.717 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/ 2023-12-19T18:44:12.717 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-19T18:44:12.717 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-19T18:44:12.717 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-19T18:44:12.718 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-19T18:44:12.718 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ 2023-12-19T18:44:12.718 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-19T18:44:12.718 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-19T18:44:12.718 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/ 2023-12-19T18:44:12.718 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-19T18:44:12.718 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-19T18:44:12.718 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-19T18:44:12.718 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9052.ko 2023-12-19T18:44:12.718 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9055.ko 2023-12-19T18:44:12.718 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9063.ko 2023-12-19T18:44:12.718 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-19T18:44:12.718 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 68577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-19T18:44:12.718 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-19T18:44:12.718 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-19T18:44:12.719 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-19T18:44:12.719 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-19T18:44:12.719 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-19T18:44:12.719 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-19T18:44:12.719 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-19T18:44:12.719 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-19T18:44:12.719 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-19T18:44:12.719 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-19T18:44:12.719 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-19T18:44:12.719 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-19T18:44:12.719 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-19T18:44:12.719 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-19T18:44:12.719 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-19T18:44:12.719 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-19T18:44:12.719 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-19T18:44:12.720 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8907.ko 2023-12-19T18:44:12.720 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8925.ko 2023-12-19T18:44:12.720 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8997.ko 2023-12-19T18:44:12.720 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8998.ko 2023-12-19T18:44:12.720 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-19T18:44:12.720 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-19T18:44:12.720 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-palmas.ko 2023-12-19T18:44:12.720 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-19T18:44:12.720 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-19T18:44:12.720 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-19T18:44:12.720 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-19T18:44:12.720 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-19T18:44:12.720 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-19T18:44:12.721 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-19T18:44:12.721 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-19T18:44:12.721 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-19T18:44:12.721 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-19T18:44:12.721 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-19T18:44:12.721 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-19T18:44:12.721 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-19T18:44:12.721 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-19T18:44:12.721 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-19T18:44:12.721 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-19T18:44:12.721 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-19T18:44:12.721 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-19T18:44:12.721 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-19T18:44:12.721 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ 2023-12-19T18:44:12.722 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 77617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-19T18:44:12.722 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 57665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-19T18:44:12.722 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-19T18:44:12.722 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 135185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-19T18:44:12.722 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-19T18:44:12.722 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/ 2023-12-19T18:44:12.722 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 272305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-19T18:44:12.722 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 100617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-19T18:44:12.722 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/ 2023-12-19T18:44:12.722 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 356201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-19T18:44:12.722 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 295801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-19T18:44:12.722 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/ 2023-12-19T18:44:12.722 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 189185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-19T18:44:12.722 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-19T18:44:12.722 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/ 2023-12-19T18:44:12.723 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 106881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-19T18:44:12.723 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-19T18:44:12.723 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/ 2023-12-19T18:44:12.723 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 246985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-19T18:44:12.723 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/ 2023-12-19T18:44:12.723 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1171945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-19T18:44:12.723 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/ 2023-12-19T18:44:12.723 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 237273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-19T18:44:12.723 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/ 2023-12-19T18:44:12.723 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 115369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-19T18:44:12.723 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-19T18:44:12.723 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/ 2023-12-19T18:44:12.723 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 308921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-19T18:44:12.723 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/ 2023-12-19T18:44:12.723 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-19T18:44:12.724 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 76145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-19T18:44:12.724 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-19T18:44:12.724 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 101449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-19T18:44:12.724 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 146689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-19T18:44:12.724 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 75553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-19T18:44:12.724 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-19T18:44:12.724 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/ 2023-12-19T18:44:12.724 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 212425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-19T18:44:12.724 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-19T18:44:12.724 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/ 2023-12-19T18:44:12.724 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-19T18:44:12.724 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 158505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-19T18:44:12.724 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fdomain.ko 2023-12-19T18:44:12.724 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/ 2023-12-19T18:44:12.724 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 263489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-19T18:44:12.724 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 201817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-19T18:44:12.725 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-19T18:44:12.725 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-19T18:44:12.725 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/imm.ko 2023-12-19T18:44:12.725 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-19T18:44:12.725 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 266537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-19T18:44:12.725 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 101881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-19T18:44:12.725 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/ 2023-12-19T18:44:12.725 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 317153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-19T18:44:12.725 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-19T18:44:12.725 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-19T18:44:12.725 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/ 2023-12-19T18:44:12.725 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 314865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-19T18:44:12.725 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 145585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-19T18:44:12.726 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-19T18:44:12.726 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/ 2023-12-19T18:44:12.726 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 216665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-19T18:44:12.726 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/ 2023-12-19T18:44:12.726 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 2197249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-19T18:44:12.726 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/ 2023-12-19T18:44:12.726 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 73569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-19T18:44:12.726 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-19T18:44:12.726 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 310617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-19T18:44:12.726 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 84721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-19T18:44:12.726 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/ 2023-12-19T18:44:12.726 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 659825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-19T18:44:12.726 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/ 2023-12-19T18:44:12.726 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 119561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-19T18:44:12.726 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-19T18:44:12.727 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/ 2023-12-19T18:44:12.727 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 81625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-19T18:44:12.727 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-19T18:44:12.727 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-19T18:44:12.727 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-19T18:44:12.727 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/ 2023-12-19T18:44:12.727 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 364105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-19T18:44:12.727 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 123617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-19T18:44:12.727 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ppa.ko 2023-12-19T18:44:12.727 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-19T18:44:12.727 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/ 2023-12-19T18:44:12.727 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1876689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-19T18:44:12.727 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 85289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-19T18:44:12.728 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/ 2023-12-19T18:44:12.728 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 559033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-19T18:44:12.728 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qlogicfas408.ko 2023-12-19T18:44:12.728 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-19T18:44:12.728 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 238761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-19T18:44:12.728 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 173937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-19T18:44:12.728 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 279313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-19T18:44:12.728 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 97729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-19T18:44:12.728 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 73881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-19T18:44:12.728 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-19T18:44:12.728 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-19T18:44:12.728 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 115889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-19T18:44:12.728 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-19T18:44:12.728 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-19T18:44:12.729 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 162121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-19T18:44:12.729 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-19T18:44:12.729 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-19T18:44:12.729 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-19T18:44:12.729 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/xen-scsifront.ko 2023-12-19T18:44:12.729 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ 2023-12-19T18:44:12.729 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 129441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-19T18:44:12.729 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/ 2023-12-19T18:44:12.729 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/ 2023-12-19T18:44:12.729 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 736601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-19T18:44:12.729 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/ 2023-12-19T18:44:12.729 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-19T18:44:12.729 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-19T18:44:12.729 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-19T18:44:12.730 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 930257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-19T18:44:12.730 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-19T18:44:12.730 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 122521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-19T18:44:12.730 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/ 2023-12-19T18:44:12.730 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 75593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-19T18:44:12.730 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/ 2023-12-19T18:44:12.730 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/ 2023-12-19T18:44:12.730 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-19T18:44:12.730 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-19T18:44:12.730 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-19T18:44:12.730 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-19T18:44:12.730 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-19T18:44:12.730 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-19T18:44:12.730 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-19T18:44:12.730 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-19T18:44:12.731 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-19T18:44:12.731 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-19T18:44:12.731 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-19T18:44:12.731 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-19T18:44:12.731 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-19T18:44:12.731 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-19T18:44:12.731 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-19T18:44:12.731 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-19T18:44:12.731 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-19T18:44:12.731 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ 2023-12-19T18:44:12.731 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ 2023-12-19T18:44:12.731 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-19T18:44:12.731 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 57865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/moxa.ko 2023-12-19T18:44:12.731 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 50953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/mxser.ko 2023-12-19T18:44:12.732 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 108601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-19T18:44:12.732 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-19T18:44:12.732 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-19T18:44:12.732 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/ 2023-12-19T18:44:12.732 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/ 2023-12-19T18:44:12.732 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-19T18:44:12.732 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-19T18:44:12.732 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-19T18:44:12.732 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_uart.ko 2023-12-19T18:44:12.732 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-19T18:44:12.732 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 72425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-19T18:44:12.732 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/ 2023-12-19T18:44:12.732 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 103073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-19T18:44:12.732 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/rp2.ko 2023-12-19T18:44:12.732 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-19T18:44:12.733 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/ 2023-12-19T18:44:12.733 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ 2023-12-19T18:44:12.733 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 531265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-19T18:44:12.733 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ 2023-12-19T18:44:12.733 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-19T18:44:12.733 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-19T18:44:12.733 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/ 2023-12-19T18:44:12.733 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-19T18:44:12.733 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-19T18:44:12.733 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-19T18:44:12.733 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-19T18:44:12.733 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_mf624.ko 2023-12-19T18:44:12.733 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_netx.ko 2023-12-19T18:44:12.733 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-19T18:44:12.733 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-19T18:44:12.734 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-19T18:44:12.734 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/ 2023-12-19T18:44:12.734 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/ 2023-12-19T18:44:12.734 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 73297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-19T18:44:12.734 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ 2023-12-19T18:44:12.734 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 144377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-19T18:44:12.734 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-19T18:44:12.734 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-19T18:44:12.734 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-19T18:44:12.734 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/ 2023-12-19T18:44:12.734 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 87089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-19T18:44:12.734 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-19T18:44:12.734 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-19T18:44:12.734 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 89857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-19T18:44:12.735 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ 2023-12-19T18:44:12.735 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ulpi.ko 2023-12-19T18:44:12.735 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/ 2023-12-19T18:44:12.735 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-19T18:44:12.735 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/ 2023-12-19T18:44:12.735 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-19T18:44:12.735 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-19T18:44:12.735 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 448505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-19T18:44:12.735 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/ 2023-12-19T18:44:12.735 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/ 2023-12-19T18:44:12.735 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-19T18:44:12.735 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-19T18:44:12.735 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-19T18:44:12.735 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-19T18:44:12.736 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-19T18:44:12.736 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-19T18:44:12.736 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 92489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-19T18:44:12.736 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-19T18:44:12.736 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 122081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-19T18:44:12.736 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 57681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-19T18:44:12.736 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-19T18:44:12.736 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-19T18:44:12.736 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-19T18:44:12.736 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 85609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-19T18:44:12.736 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-19T18:44:12.736 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 58113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-19T18:44:12.736 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 67337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-19T18:44:12.736 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/ 2023-12-19T18:44:12.736 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-19T18:44:12.737 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-19T18:44:12.737 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-19T18:44:12.737 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-19T18:44:12.737 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-19T18:44:12.737 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-19T18:44:12.737 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-19T18:44:12.737 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-19T18:44:12.737 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-19T18:44:12.737 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-19T18:44:12.737 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-19T18:44:12.737 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-19T18:44:12.737 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 62185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-19T18:44:12.737 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-19T18:44:12.737 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 161225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-19T18:44:12.737 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/ 2023-12-19T18:44:12.738 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-19T18:44:12.738 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-19T18:44:12.738 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 157681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-19T18:44:12.738 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-19T18:44:12.738 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-19T18:44:12.738 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 69705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-19T18:44:12.738 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 56033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-19T18:44:12.738 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 76057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-19T18:44:12.738 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 75073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-19T18:44:12.738 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 73169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-19T18:44:12.738 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 65809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-19T18:44:12.738 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-19T18:44:12.738 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 81505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-19T18:44:12.738 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 156073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-19T18:44:12.738 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ 2023-12-19T18:44:12.739 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-19T18:44:12.739 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 80113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-19T18:44:12.739 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 87353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-19T18:44:12.739 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-19T18:44:12.739 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-19T18:44:12.739 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811_cs.ko 2023-12-19T18:44:12.739 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-19T18:44:12.739 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-19T18:44:12.739 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/ 2023-12-19T18:44:12.739 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-19T18:44:12.739 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-19T18:44:12.739 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ 2023-12-19T18:44:12.739 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-19T18:44:12.739 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-19T18:44:12.739 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-19T18:44:12.740 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cytherm.ko 2023-12-19T18:44:12.740 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ehset.ko 2023-12-19T18:44:12.740 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-19T18:44:12.740 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-19T18:44:12.740 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-19T18:44:12.740 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-19T18:44:12.740 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-19T18:44:12.740 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-19T18:44:12.740 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-19T18:44:12.740 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-19T18:44:12.740 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/lvstest.ko 2023-12-19T18:44:12.740 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/ 2023-12-19T18:44:12.740 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 64841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-19T18:44:12.740 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-19T18:44:12.740 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-19T18:44:12.740 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-19T18:44:12.741 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-19T18:44:12.741 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbtest.ko 2023-12-19T18:44:12.741 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-19T18:44:12.741 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-19T18:44:12.741 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/ 2023-12-19T18:44:12.741 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 72953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/usbmon.ko 2023-12-19T18:44:12.741 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/ 2023-12-19T18:44:12.741 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 301697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-19T18:44:12.741 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/ 2023-12-19T18:44:12.741 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-19T18:44:12.741 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-19T18:44:12.741 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-19T18:44:12.741 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-19T18:44:12.741 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ 2023-12-19T18:44:12.742 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-19T18:44:12.742 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-19T18:44:12.742 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-19T18:44:12.742 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-19T18:44:12.742 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-19T18:44:12.742 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-19T18:44:12.742 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 58217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-19T18:44:12.742 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-19T18:44:12.742 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-19T18:44:12.742 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/f81232.ko 2023-12-19T18:44:12.742 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 175137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-19T18:44:12.742 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-19T18:44:12.742 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 137081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-19T18:44:12.742 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 124833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-19T18:44:12.742 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 67769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-19T18:44:12.743 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-19T18:44:12.743 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-19T18:44:12.743 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 58233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-19T18:44:12.743 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 107521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-19T18:44:12.743 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-19T18:44:12.743 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-19T18:44:12.743 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-19T18:44:12.743 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-19T18:44:12.743 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/metro-usb.ko 2023-12-19T18:44:12.743 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-19T18:44:12.743 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 78217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-19T18:44:12.743 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 56337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mxuport.ko 2023-12-19T18:44:12.743 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-19T18:44:12.743 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-19T18:44:12.743 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-19T18:44:12.744 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 191137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-19T18:44:12.744 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-19T18:44:12.744 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-19T18:44:12.744 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-19T18:44:12.744 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-19T18:44:12.744 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-19T18:44:12.744 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-19T18:44:12.744 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 51625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-19T18:44:12.744 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-19T18:44:12.744 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-19T18:44:12.744 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-19T18:44:12.744 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-19T18:44:12.744 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-19T18:44:12.744 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-19T18:44:12.744 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-19T18:44:12.745 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 125609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usbserial.ko 2023-12-19T18:44:12.745 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-19T18:44:12.745 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-19T18:44:12.745 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-19T18:44:12.745 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-19T18:44:12.745 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ 2023-12-19T18:44:12.745 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 52913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-19T18:44:12.745 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-19T18:44:12.745 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-19T18:44:12.745 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-19T18:44:12.745 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-19T18:44:12.745 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-19T18:44:12.745 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-19T18:44:12.745 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-19T18:44:12.746 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-19T18:44:12.746 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-19T18:44:12.746 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-19T18:44:12.746 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-19T18:44:12.746 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-19T18:44:12.746 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-19T18:44:12.746 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 179969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-19T18:44:12.746 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/ 2023-12-19T18:44:12.746 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 67481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-19T18:44:12.746 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 72177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-19T18:44:12.746 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 107001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-19T18:44:12.746 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/ 2023-12-19T18:44:12.746 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/ 2023-12-19T18:44:12.746 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 154297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-19T18:44:12.746 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-19T18:44:12.746 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 108737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-19T18:44:12.746 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 77609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-19T18:44:12.747 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/ 2023-12-19T18:44:12.747 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 113785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-19T18:44:12.747 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-19T18:44:12.747 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 58089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-19T18:44:12.747 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 89249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-19T18:44:12.747 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/ 2023-12-19T18:44:12.747 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/ 2023-12-19T18:44:12.747 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-19T18:44:12.747 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-19T18:44:12.747 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-19T18:44:12.747 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-19T18:44:12.747 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-19T18:44:12.747 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-19T18:44:12.747 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-19T18:44:12.748 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/bd6107.ko 2023-12-19T18:44:12.748 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-19T18:44:12.748 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-19T18:44:12.748 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-19T18:44:12.748 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-19T18:44:12.748 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-19T18:44:12.748 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-19T18:44:12.748 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-19T18:44:12.748 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-19T18:44:12.748 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-19T18:44:12.748 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-19T18:44:12.748 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-19T18:44:12.748 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-19T18:44:12.748 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-19T18:44:12.749 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/ 2023-12-19T18:44:12.749 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ 2023-12-19T18:44:12.749 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-19T18:44:12.749 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-19T18:44:12.749 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-19T18:44:12.749 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-19T18:44:12.749 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/ 2023-12-19T18:44:12.749 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-19T18:44:12.749 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-19T18:44:12.749 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-19T18:44:12.749 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-19T18:44:12.749 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-19T18:44:12.749 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-19T18:44:12.749 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-19T18:44:12.750 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-19T18:44:12.750 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-19T18:44:12.750 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-19T18:44:12.750 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 56425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-19T18:44:12.750 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 102673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-19T18:44:12.750 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ 2023-12-19T18:44:12.750 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/acquirewdt.ko 2023-12-19T18:44:12.750 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/advantechwdt.ko 2023-12-19T18:44:12.750 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-19T18:44:12.750 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-19T18:44:12.750 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-19T18:44:12.750 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-19T18:44:12.750 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-19T18:44:12.750 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-19T18:44:12.751 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/dw_wdt.ko 2023-12-19T18:44:12.751 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-19T18:44:12.751 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-19T18:44:12.751 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-19T18:44:12.751 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-19T18:44:12.751 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-19T18:44:12.751 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-19T18:44:12.751 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-19T18:44:12.751 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-19T18:44:12.751 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-19T18:44:12.751 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-19T18:44:12.751 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-19T18:44:12.751 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-19T18:44:12.751 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-19T18:44:12.752 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-19T18:44:12.752 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-19T18:44:12.752 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-19T18:44:12.752 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-19T18:44:12.752 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-19T18:44:12.752 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-19T18:44:12.752 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-19T18:44:12.752 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/retu_wdt.ko 2023-12-19T18:44:12.752 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-19T18:44:12.752 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-19T18:44:12.752 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-19T18:44:12.752 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-19T18:44:12.752 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-19T18:44:12.752 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-19T18:44:12.752 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-19T18:44:12.753 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-19T18:44:12.753 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-19T18:44:12.753 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-19T18:44:12.753 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-19T18:44:12.753 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-19T18:44:12.753 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-19T18:44:12.753 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-19T18:44:12.753 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-19T18:44:12.753 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-19T18:44:12.753 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-19T18:44:12.754 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-19T18:44:12.754 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/ 2023-12-19T18:44:12.754 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-19T18:44:12.754 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-19T18:44:12.754 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-19T18:44:12.754 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/ 2023-12-19T18:44:12.754 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 176377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-19T18:44:12.754 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-19T18:44:12.754 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 71249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-scsiback.ko 2023-12-19T18:44:12.754 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/ 2023-12-19T18:44:12.754 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-19T18:44:12.754 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ 2023-12-19T18:44:12.754 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/ 2023-12-19T18:44:12.754 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 166425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-19T18:44:12.754 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/ 2023-12-19T18:44:12.755 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/adfs.ko 2023-12-19T18:44:12.755 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/ 2023-12-19T18:44:12.755 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 163593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-19T18:44:12.755 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/ 2023-12-19T18:44:12.755 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 932817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/kafs.ko 2023-12-19T18:44:12.755 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/ 2023-12-19T18:44:12.755 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 101057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/autofs4.ko 2023-12-19T18:44:12.755 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/ 2023-12-19T18:44:12.755 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 64545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-19T18:44:12.755 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/ 2023-12-19T18:44:12.755 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/bfs.ko 2023-12-19T18:44:12.755 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-19T18:44:12.755 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/ 2023-12-19T18:44:12.755 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 3402729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-19T18:44:12.755 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/ 2023-12-19T18:44:12.756 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 306009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-19T18:44:12.756 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ 2023-12-19T18:44:12.756 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1333017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-19T18:44:12.756 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/ 2023-12-19T18:44:12.756 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 100801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-19T18:44:12.756 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/ 2023-12-19T18:44:12.756 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 108393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/configfs.ko 2023-12-19T18:44:12.756 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/ 2023-12-19T18:44:12.756 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 29625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-19T18:44:12.756 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/ 2023-12-19T18:44:12.756 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 642513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-19T18:44:12.756 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/ 2023-12-19T18:44:12.756 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/efs.ko 2023-12-19T18:44:12.756 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/ 2023-12-19T18:44:12.757 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1505025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-19T18:44:12.757 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/ 2023-12-19T18:44:12.757 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-19T18:44:12.757 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/ 2023-12-19T18:44:12.757 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/freevxfs.ko 2023-12-19T18:44:12.757 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/ 2023-12-19T18:44:12.757 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 226481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-19T18:44:12.757 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/ 2023-12-19T18:44:12.757 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-19T18:44:12.757 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/ 2023-12-19T18:44:12.757 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1231529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-19T18:44:12.805 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/ 2023-12-19T18:44:12.805 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 141209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-19T18:44:12.805 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/ 2023-12-19T18:44:12.805 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 222817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-19T18:44:12.805 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/ 2023-12-19T18:44:12.805 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 192329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/hpfs.ko 2023-12-19T18:44:12.805 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/ 2023-12-19T18:44:12.805 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 74065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-19T18:44:12.805 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/ 2023-12-19T18:44:12.805 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 419497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-19T18:44:12.805 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/ 2023-12-19T18:44:12.805 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 280313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-19T18:44:12.806 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/ 2023-12-19T18:44:12.806 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 89193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-19T18:44:12.806 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/ 2023-12-19T18:44:12.806 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 124649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-19T18:44:12.806 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/ 2023-12-19T18:44:12.806 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/ 2023-12-19T18:44:12.806 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 81449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-19T18:44:12.806 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/ 2023-12-19T18:44:12.806 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 59449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-19T18:44:12.806 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/ 2023-12-19T18:44:12.806 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 117465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-19T18:44:12.806 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1055721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-19T18:44:12.806 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv2.ko 2023-12-19T18:44:12.806 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 120177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-19T18:44:12.807 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 2042137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-19T18:44:12.807 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/ 2023-12-19T18:44:12.807 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-19T18:44:12.807 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-19T18:44:12.807 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/ 2023-12-19T18:44:12.807 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1516873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-19T18:44:12.807 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/ 2023-12-19T18:44:12.807 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 592833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-19T18:44:12.807 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/ 2023-12-19T18:44:12.807 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-19T18:44:12.807 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-19T18:44:12.807 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-19T18:44:12.807 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-19T18:44:12.807 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-19T18:44:12.807 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-19T18:44:12.807 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-19T18:44:12.808 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-19T18:44:12.808 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-19T18:44:12.808 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-19T18:44:12.808 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-19T18:44:12.808 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ascii.ko 2023-12-19T18:44:12.808 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-19T18:44:12.808 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-19T18:44:12.808 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-19T18:44:12.808 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-19T18:44:12.808 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-19T18:44:12.808 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-19T18:44:12.808 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-19T18:44:12.808 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-19T18:44:12.808 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-19T18:44:12.808 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-19T18:44:12.809 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-19T18:44:12.809 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-19T18:44:12.809 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-19T18:44:12.809 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-19T18:44:12.809 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-19T18:44:12.809 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-19T18:44:12.809 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-19T18:44:12.809 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-19T18:44:12.809 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 94137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-19T18:44:12.809 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 142673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-19T18:44:12.809 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 165745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-19T18:44:12.809 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 118121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-19T18:44:12.809 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-19T18:44:12.809 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-19T18:44:12.809 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-19T18:44:12.810 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-19T18:44:12.810 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-19T18:44:12.810 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-19T18:44:12.810 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-19T18:44:12.810 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-19T18:44:12.810 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-19T18:44:12.810 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-19T18:44:12.810 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-19T18:44:12.810 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-19T18:44:12.810 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-19T18:44:12.810 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-19T18:44:12.810 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-19T18:44:12.810 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-19T18:44:12.810 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-19T18:44:12.811 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ 2023-12-19T18:44:12.811 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 219417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ntfs.ko 2023-12-19T18:44:12.811 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ 2023-12-19T18:44:12.811 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ 2023-12-19T18:44:12.811 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 244409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-19T18:44:12.811 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ 2023-12-19T18:44:12.811 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 440737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-19T18:44:12.811 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ 2023-12-19T18:44:12.811 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-19T18:44:12.811 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 2592433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-19T18:44:12.811 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-19T18:44:12.811 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-19T18:44:12.811 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-19T18:44:12.811 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/ 2023-12-19T18:44:12.811 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/omfs.ko 2023-12-19T18:44:12.812 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/ 2023-12-19T18:44:12.812 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 352161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-19T18:44:12.812 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ 2023-12-19T18:44:12.812 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-19T18:44:12.812 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/ 2023-12-19T18:44:12.812 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/qnx4.ko 2023-12-19T18:44:12.812 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/ 2023-12-19T18:44:12.812 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 46689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/qnx6.ko 2023-12-19T18:44:12.812 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/ 2023-12-19T18:44:12.812 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_tree.ko 2023-12-19T18:44:12.812 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v1.ko 2023-12-19T18:44:12.812 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v2.ko 2023-12-19T18:44:12.812 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/ 2023-12-19T18:44:12.812 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 532673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-19T18:44:12.812 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/ 2023-12-19T18:44:12.813 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-19T18:44:12.813 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/ 2023-12-19T18:44:12.813 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/ 2023-12-19T18:44:12.813 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 2668401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-19T18:44:12.813 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/ 2023-12-19T18:44:12.813 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-19T18:44:12.813 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-19T18:44:12.813 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/ 2023-12-19T18:44:12.813 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 134641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-19T18:44:12.813 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/ 2023-12-19T18:44:12.813 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 90721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-19T18:44:12.813 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/ 2023-12-19T18:44:12.813 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 247737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-19T18:44:12.813 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ 2023-12-19T18:44:12.813 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 162497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-19T18:44:12.814 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/ 2023-12-19T18:44:12.814 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 4011017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-19T18:44:12.814 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/ 2023-12-19T18:44:12.814 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/ 2023-12-19T18:44:12.814 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 75489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/locktorture.ko 2023-12-19T18:44:12.814 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/ 2023-12-19T18:44:12.814 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/test_udelay.ko 2023-12-19T18:44:12.814 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-19T18:44:12.814 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ 2023-12-19T18:44:12.814 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 6833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-19T18:44:12.814 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 6529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc7.ko 2023-12-19T18:44:12.814 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-19T18:44:12.814 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/ 2023-12-19T18:44:12.814 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-19T18:44:12.814 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-19T18:44:12.815 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/interval_tree_test.ko 2023-12-19T18:44:12.815 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-19T18:44:12.815 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-19T18:44:12.815 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/ 2023-12-19T18:44:12.815 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-19T18:44:12.815 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-19T18:44:12.815 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/ 2023-12-19T18:44:12.815 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 6617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-19T18:44:12.815 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/memory-notifier-error-inject.ko 2023-12-19T18:44:12.815 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/notifier-error-inject.ko 2023-12-19T18:44:12.815 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/percpu_test.ko 2023-12-19T18:44:12.815 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/pm-notifier-error-inject.ko 2023-12-19T18:44:12.815 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/ 2023-12-19T18:44:12.815 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 143433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-19T18:44:12.815 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/rbtree_test.ko 2023-12-19T18:44:12.816 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/ 2023-12-19T18:44:12.816 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-19T18:44:12.816 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-kstrtox.ko 2023-12-19T18:44:12.816 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-string_helpers.ko 2023-12-19T18:44:12.816 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 4760425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_bpf.ko 2023-12-19T18:44:12.816 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_firmware.ko 2023-12-19T18:44:12.816 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 6369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_module.ko 2023-12-19T18:44:12.816 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_user_copy.ko 2023-12-19T18:44:12.816 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-19T18:44:12.816 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-19T18:44:12.816 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-19T18:44:12.816 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/ 2023-12-19T18:44:12.816 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/xz_dec_test.ko 2023-12-19T18:44:12.816 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/ 2023-12-19T18:44:12.816 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-19T18:44:12.817 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ 2023-12-19T18:44:12.817 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/ 2023-12-19T18:44:12.817 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-19T18:44:12.817 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-19T18:44:12.817 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-19T18:44:12.817 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-19T18:44:12.817 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 6985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-19T18:44:12.817 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-19T18:44:12.817 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-19T18:44:12.817 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-19T18:44:12.817 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/ 2023-12-19T18:44:12.817 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-19T18:44:12.817 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-19T18:44:12.817 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-19T18:44:12.818 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-19T18:44:12.818 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-19T18:44:12.818 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/ 2023-12-19T18:44:12.818 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 81737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-19T18:44:12.818 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/ 2023-12-19T18:44:12.818 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 198337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-19T18:44:12.818 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-19T18:44:12.818 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-19T18:44:12.818 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-19T18:44:12.818 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/ 2023-12-19T18:44:12.818 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 649297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-19T18:44:12.818 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/ 2023-12-19T18:44:12.818 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 63809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-19T18:44:12.818 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 777689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-19T18:44:12.818 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ 2023-12-19T18:44:12.819 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-19T18:44:12.819 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-19T18:44:12.819 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-19T18:44:12.819 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-19T18:44:12.819 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-19T18:44:12.819 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-19T18:44:12.819 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-19T18:44:12.819 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-19T18:44:12.819 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-19T18:44:12.819 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-19T18:44:12.819 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-19T18:44:12.819 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-19T18:44:12.819 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-19T18:44:12.819 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-19T18:44:12.819 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-19T18:44:12.820 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-19T18:44:12.820 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-19T18:44:12.820 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-19T18:44:12.820 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-19T18:44:12.820 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-19T18:44:12.820 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 55929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-19T18:44:12.820 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-19T18:44:12.820 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-19T18:44:12.820 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/ 2023-12-19T18:44:12.820 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1046681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-19T18:44:12.820 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/ 2023-12-19T18:44:12.820 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 125993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-19T18:44:12.820 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/ 2023-12-19T18:44:12.820 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 194209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-19T18:44:12.820 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-19T18:44:12.821 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 57881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-19T18:44:12.821 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-19T18:44:12.821 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/ 2023-12-19T18:44:12.821 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 390473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-19T18:44:12.821 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-19T18:44:12.821 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-19T18:44:12.821 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-19T18:44:12.821 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-19T18:44:12.821 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/ 2023-12-19T18:44:12.821 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 99729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/hsr.ko 2023-12-19T18:44:12.821 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ 2023-12-19T18:44:12.821 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ 2023-12-19T18:44:12.821 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 45233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-19T18:44:12.821 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 254625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-19T18:44:12.822 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-19T18:44:12.822 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ 2023-12-19T18:44:12.822 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-19T18:44:12.822 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-19T18:44:12.822 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 48337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-19T18:44:12.822 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-19T18:44:12.822 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 48657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-19T18:44:12.822 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-19T18:44:12.822 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-19T18:44:12.822 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-19T18:44:12.822 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-19T18:44:12.822 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-19T18:44:12.822 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ 2023-12-19T18:44:12.822 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-19T18:44:12.822 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-19T18:44:12.823 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-19T18:44:12.823 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-19T18:44:12.823 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-19T18:44:12.823 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-19T18:44:12.823 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-19T18:44:12.823 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-19T18:44:12.823 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-19T18:44:12.823 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-19T18:44:12.823 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-19T18:44:12.823 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-19T18:44:12.823 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-19T18:44:12.823 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-19T18:44:12.823 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-19T18:44:12.823 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-19T18:44:12.823 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-19T18:44:12.824 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-19T18:44:12.824 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-19T18:44:12.824 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-19T18:44:12.824 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-19T18:44:12.824 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-19T18:44:12.824 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-19T18:44:12.824 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-19T18:44:12.824 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-19T18:44:12.824 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-19T18:44:12.824 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-19T18:44:12.824 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-19T18:44:12.824 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-19T18:44:12.824 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-19T18:44:12.824 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-19T18:44:12.824 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-19T18:44:12.825 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-19T18:44:12.825 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-19T18:44:12.825 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-19T18:44:12.825 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-19T18:44:12.825 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-19T18:44:12.825 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-19T18:44:12.825 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-19T18:44:12.825 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-19T18:44:12.825 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 41665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-19T18:44:12.825 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-19T18:44:12.825 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ 2023-12-19T18:44:12.825 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-19T18:44:12.825 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-19T18:44:12.825 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-19T18:44:12.826 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 80897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_gre.ko 2023-12-19T18:44:12.826 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 93577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-19T18:44:12.826 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-19T18:44:12.826 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-19T18:44:12.826 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-19T18:44:12.826 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/mip6.ko 2023-12-19T18:44:12.826 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ 2023-12-19T18:44:12.826 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-19T18:44:12.826 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-19T18:44:12.826 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-19T18:44:12.826 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-19T18:44:12.826 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-19T18:44:12.826 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-19T18:44:12.826 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-19T18:44:12.826 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-19T18:44:12.827 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-19T18:44:12.827 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-19T18:44:12.827 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-19T18:44:12.827 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-19T18:44:12.827 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-19T18:44:12.827 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-19T18:44:12.827 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-19T18:44:12.827 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-19T18:44:12.827 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-19T18:44:12.827 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-19T18:44:12.827 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-19T18:44:12.827 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-19T18:44:12.827 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-19T18:44:12.827 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-19T18:44:12.827 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-19T18:44:12.828 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-19T18:44:12.828 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-19T18:44:12.828 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 74073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-19T18:44:12.828 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-19T18:44:12.828 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-19T18:44:12.828 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/ 2023-12-19T18:44:12.828 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 82833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-19T18:44:12.828 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/ 2023-12-19T18:44:12.828 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 125281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-19T18:44:12.828 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-19T18:44:12.828 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 25953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-19T18:44:12.828 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-19T18:44:12.828 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-19T18:44:12.828 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-19T18:44:12.828 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 53241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-19T18:44:12.829 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/ 2023-12-19T18:44:12.829 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 47977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/lapb.ko 2023-12-19T18:44:12.829 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/ 2023-12-19T18:44:12.829 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-19T18:44:12.829 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 267913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc2.ko 2023-12-19T18:44:12.829 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/ 2023-12-19T18:44:12.829 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 290417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-19T18:44:12.829 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/ 2023-12-19T18:44:12.829 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-19T18:44:12.829 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ 2023-12-19T18:44:12.829 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ 2023-12-19T18:44:12.829 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 119585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-19T18:44:12.829 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-19T18:44:12.829 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-19T18:44:12.829 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-19T18:44:12.830 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 100297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-19T18:44:12.830 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 101441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-19T18:44:12.830 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 102817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-19T18:44:12.830 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 103417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-19T18:44:12.830 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 112849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-19T18:44:12.830 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 60329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-19T18:44:12.830 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 109593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-19T18:44:12.830 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 113129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-19T18:44:12.830 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 112585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-19T18:44:12.830 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 111585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-19T18:44:12.830 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 114465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-19T18:44:12.830 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-19T18:44:12.830 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ 2023-12-19T18:44:12.830 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 411729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-19T18:44:12.830 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-19T18:44:12.831 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-19T18:44:12.831 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-19T18:44:12.831 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-19T18:44:12.831 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-19T18:44:12.831 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-19T18:44:12.831 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-19T18:44:12.831 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-19T18:44:12.831 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-19T18:44:12.831 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-19T18:44:12.831 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-19T18:44:12.831 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-19T18:44:12.831 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-19T18:44:12.831 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-19T18:44:12.831 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 408257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-19T18:44:12.831 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-19T18:44:12.831 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-19T18:44:12.832 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-19T18:44:12.832 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 118145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-19T18:44:12.832 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-19T18:44:12.832 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-19T18:44:12.832 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 107233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-19T18:44:12.832 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-19T18:44:12.832 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-19T18:44:12.832 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-19T18:44:12.832 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-19T18:44:12.832 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-19T18:44:12.832 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-19T18:44:12.832 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 89425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-19T18:44:12.832 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-19T18:44:12.832 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 37129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-19T18:44:12.832 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 95353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-19T18:44:12.833 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-19T18:44:12.833 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-19T18:44:12.833 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-19T18:44:12.833 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-19T18:44:12.833 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-19T18:44:12.833 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 44065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-19T18:44:12.833 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 615649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-19T18:44:12.833 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 42561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-19T18:44:12.833 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-19T18:44:12.833 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-19T18:44:12.833 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 39785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-19T18:44:12.833 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-19T18:44:12.833 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-19T18:44:12.833 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-19T18:44:12.834 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-19T18:44:12.834 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 40721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-19T18:44:12.834 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-19T18:44:12.834 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-19T18:44:12.834 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-19T18:44:12.834 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-19T18:44:12.834 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-19T18:44:12.834 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-19T18:44:12.834 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-19T18:44:12.834 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-19T18:44:12.834 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-19T18:44:12.834 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_osf.ko 2023-12-19T18:44:12.834 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-19T18:44:12.834 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-19T18:44:12.834 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-19T18:44:12.834 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-19T18:44:12.835 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-19T18:44:12.835 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_synproxy.ko 2023-12-19T18:44:12.835 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tproxy.ko 2023-12-19T18:44:12.835 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 89313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/x_tables.ko 2023-12-19T18:44:12.835 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-19T18:44:12.835 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-19T18:44:12.835 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-19T18:44:12.835 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-19T18:44:12.835 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 18169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-19T18:44:12.835 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-19T18:44:12.835 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-19T18:44:12.835 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-19T18:44:12.835 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-19T18:44:12.835 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-19T18:44:12.835 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-19T18:44:12.835 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-19T18:44:12.836 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-19T18:44:12.836 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-19T18:44:12.836 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-19T18:44:12.836 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-19T18:44:12.836 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-19T18:44:12.836 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 14337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-19T18:44:12.836 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-19T18:44:12.836 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-19T18:44:12.836 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-19T18:44:12.836 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-19T18:44:12.836 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-19T18:44:12.836 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-19T18:44:12.836 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-19T18:44:12.836 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-19T18:44:12.836 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-19T18:44:12.837 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-19T18:44:12.837 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-19T18:44:12.837 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-19T18:44:12.837 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-19T18:44:12.837 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-19T18:44:12.837 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-19T18:44:12.837 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-19T18:44:12.837 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-19T18:44:12.837 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-19T18:44:12.837 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-19T18:44:12.837 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-19T18:44:12.837 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-19T18:44:12.837 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-19T18:44:12.837 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-19T18:44:12.837 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-19T18:44:12.838 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-19T18:44:12.838 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-19T18:44:12.838 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-19T18:44:12.838 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-19T18:44:12.838 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-19T18:44:12.838 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-19T18:44:12.838 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-19T18:44:12.838 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-19T18:44:12.838 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-19T18:44:12.838 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-19T18:44:12.838 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-19T18:44:12.838 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-19T18:44:12.838 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-19T18:44:12.838 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-19T18:44:12.838 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-19T18:44:12.839 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-19T18:44:12.839 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-19T18:44:12.839 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-19T18:44:12.839 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-19T18:44:12.839 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-19T18:44:12.839 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-19T18:44:12.839 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-19T18:44:12.839 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 16089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-19T18:44:12.839 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-19T18:44:12.839 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-19T18:44:12.839 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-19T18:44:12.839 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 8553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-19T18:44:12.839 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpudp.ko 2023-12-19T18:44:12.839 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-19T18:44:12.840 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-19T18:44:12.840 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/ 2023-12-19T18:44:12.840 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-19T18:44:12.840 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/ 2023-12-19T18:44:12.840 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-19T18:44:12.840 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/ 2023-12-19T18:44:12.840 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 380033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-19T18:44:12.840 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-19T18:44:12.840 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-19T18:44:12.840 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 11793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-19T18:44:12.840 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/ 2023-12-19T18:44:12.840 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-19T18:44:12.840 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/ 2023-12-19T18:44:12.840 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 110201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/phonet.ko 2023-12-19T18:44:12.840 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/pn_pep.ko 2023-12-19T18:44:12.840 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/ 2023-12-19T18:44:12.841 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 251481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-19T18:44:12.841 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 164937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-19T18:44:12.841 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 67377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-19T18:44:12.841 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/ 2023-12-19T18:44:12.841 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 819657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/rxrpc.ko 2023-12-19T18:44:12.841 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/ 2023-12-19T18:44:12.841 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-19T18:44:12.841 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-19T18:44:12.841 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-19T18:44:12.841 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-19T18:44:12.841 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-19T18:44:12.841 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 43449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-19T18:44:12.841 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-19T18:44:12.841 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-19T18:44:12.841 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-19T18:44:12.842 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-19T18:44:12.842 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-19T18:44:12.842 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-19T18:44:12.842 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_cgroup.ko 2023-12-19T18:44:12.842 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-19T18:44:12.842 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-19T18:44:12.842 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 38425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-19T18:44:12.842 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 61409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-19T18:44:12.842 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-19T18:44:12.842 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 13409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-19T18:44:12.842 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-19T18:44:12.842 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-19T18:44:12.842 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-19T18:44:12.842 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-19T18:44:12.842 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 21649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-19T18:44:12.843 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-19T18:44:12.843 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 34633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-19T18:44:12.843 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 33609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-19T18:44:12.843 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq_codel.ko 2023-12-19T18:44:12.843 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 35433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-19T18:44:12.843 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-19T18:44:12.843 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-19T18:44:12.843 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 66393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-19T18:44:12.843 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-19T18:44:12.843 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 30273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-19T18:44:12.843 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-19T18:44:12.843 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-19T18:44:12.843 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 36137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-19T18:44:12.843 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 27497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-19T18:44:12.843 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-19T18:44:12.844 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-19T18:44:12.844 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 48729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-19T18:44:12.844 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 32905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-19T18:44:12.844 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 26881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-19T18:44:12.844 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 31353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-19T18:44:12.844 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-19T18:44:12.844 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 28105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-19T18:44:12.844 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/ 2023-12-19T18:44:12.844 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 929745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-19T18:44:12.844 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 19033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-19T18:44:12.844 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/ 2023-12-19T18:44:12.844 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/ 2023-12-19T18:44:12.844 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 336529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-19T18:44:12.844 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 54737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-19T18:44:12.844 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 1520097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-19T18:44:12.845 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/ 2023-12-19T18:44:12.845 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 707657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-19T18:44:12.845 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/ 2023-12-19T18:44:12.845 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-19T18:44:12.845 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 862665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-19T18:44:12.845 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/ 2023-12-19T18:44:12.845 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-19T18:44:12.845 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/ 2023-12-19T18:44:12.845 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 85409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-19T18:44:12.845 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 68049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-19T18:44:12.845 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 96193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-19T18:44:12.845 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 10705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-19T18:44:12.845 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 17521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-19T18:44:12.846 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/ 2023-12-19T18:44:12.846 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 125177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/x25.ko 2023-12-19T18:44:12.846 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/ 2023-12-19T18:44:12.846 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 22657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_algo.ko 2023-12-19T18:44:12.846 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 20649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-19T18:44:12.846 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 102257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_user.ko 2023-12-19T18:44:12.846 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/ 2023-12-19T18:44:12.846 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/ 2023-12-19T18:44:12.846 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 15537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-19T18:44:12.846 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 640081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-19T18:44:12.846 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 624107 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-19T18:44:12.846 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 7663 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-19T18:44:12.846 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 23428 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-19T18:44:12.847 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 9821 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-19T18:44:12.847 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 70004 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-19T18:44:12.847 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 146313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-19T18:44:12.847 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 232548 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-19T18:44:12.847 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 210 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-19T18:44:12.847 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 72606 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-19T18:44:12.847 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 879 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-19T18:44:12.847 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 254438 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-19T18:44:12.847 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 309363 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-19T18:44:12.847 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/ 2023-12-19T18:44:12.847 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/ 2023-12-19T18:44:12.847 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/ 2023-12-19T18:44:12.847 INFO:teuthology.orchestra.run.smithi138.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/ 2023-12-19T18:44:12.847 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 170 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/changelog.Debian.gz 2023-12-19T18:44:12.848 INFO:teuthology.orchestra.run.smithi138.stdout:-rw-r--r-- root/root 691 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/copyright 2023-12-19T18:44:12.848 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-19T18:44:12.848 INFO:teuthology.task.kernel:searching for kernel 6.6.0-gcd68252d7b4d 2023-12-19T18:44:12.849 DEBUG:teuthology.orchestra.run.smithi138:> egrep '(submenu|menuentry.*6.6.0-gcd68252d7b4d).*{' /boot/grub/grub.cfg 2023-12-19T18:44:12.855 INFO:teuthology.orchestra.run.smithi138.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-19T18:44:12.855 INFO:teuthology.orchestra.run.smithi138.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-19T18:44:12.855 INFO:teuthology.orchestra.run.smithi138.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-19T18:44:12.856 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-19T18:44:12.856 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-gcd68252d7b4d 2023-12-19T18:44:12.856 DEBUG:teuthology.orchestra.run.smithi138:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-19T18:44:12.898 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi138.front.sepia.ceph.com to complete... 2023-12-19T18:44:13.883 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub' 2023-12-19T18:44:13.884 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-19T18:44:13.889 INFO:teuthology.orchestra.run.smithi138.stderr:Generating grub configuration file ... 2023-12-19T18:44:14.175 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T18:44:14.180 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T18:44:14.498 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-19T18:44:14.503 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-19T18:44:14.542 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-19T18:44:14.547 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-19T18:44:14.670 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-19T18:44:14.670 INFO:teuthology.orchestra.run.smithi138.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-19T18:44:14.670 INFO:teuthology.orchestra.run.smithi138.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-19T18:44:14.698 INFO:teuthology.orchestra.run.smithi138.stderr:done 2023-12-19T18:44:16.101 INFO:teuthology.orchestra.run.smithi133.stderr:Sourcing file `/etc/default/grub' 2023-12-19T18:44:16.111 INFO:teuthology.orchestra.run.smithi133.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-19T18:44:16.142 INFO:teuthology.orchestra.run.smithi133.stderr:Generating grub configuration file ... 2023-12-19T18:44:16.483 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T18:44:16.500 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T18:44:16.810 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-19T18:44:16.816 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-19T18:44:16.875 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-19T18:44:16.881 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-19T18:44:17.048 INFO:teuthology.orchestra.run.smithi133.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-19T18:44:17.048 INFO:teuthology.orchestra.run.smithi133.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-19T18:44:17.048 INFO:teuthology.orchestra.run.smithi133.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-19T18:44:17.093 INFO:teuthology.orchestra.run.smithi133.stderr:done 2023-12-19T18:44:17.277 DEBUG:teuthology.orchestra.run.smithi133:> dpkg-deb -c /tmp/linux-image.deb 2023-12-19T18:44:17.285 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./ 2023-12-19T18:44:17.285 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./boot/ 2023-12-19T18:44:17.285 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 4415617 2023-12-08 17:49 ./boot/System.map-6.6.0-gcd68252d7b4d 2023-12-19T18:44:17.297 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 169214 2023-12-08 17:49 ./boot/config-6.6.0-gcd68252d7b4d 2023-12-19T18:44:17.297 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11352864 2023-12-08 17:49 ./boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T18:44:17.319 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/ 2023-12-19T18:44:17.319 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/ 2023-12-19T18:44:17.319 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postinst.d/ 2023-12-19T18:44:17.319 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postrm.d/ 2023-12-19T18:44:17.319 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/preinst.d/ 2023-12-19T18:44:17.319 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/prerm.d/ 2023-12-19T18:44:17.319 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/ 2023-12-19T18:44:17.319 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/ 2023-12-19T18:44:17.319 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/ 2023-12-19T18:44:17.319 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/ 2023-12-19T18:44:17.319 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/ 2023-12-19T18:44:17.320 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/ 2023-12-19T18:44:17.320 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ 2023-12-19T18:44:17.320 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 490233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-19T18:44:17.320 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-19T18:44:17.320 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-19T18:44:17.320 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-19T18:44:17.320 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 93113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-19T18:44:17.320 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 106729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-19T18:44:17.320 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 152241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-19T18:44:17.320 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-19T18:44:17.320 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-19T18:44:17.320 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 83889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-19T18:44:17.320 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-19T18:44:17.320 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-19T18:44:17.320 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-19T18:44:17.321 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-19T18:44:17.321 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-19T18:44:17.321 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-19T18:44:17.321 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 58585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-19T18:44:17.321 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-19T18:44:17.321 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-19T18:44:17.321 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-19T18:44:17.321 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/ 2023-12-19T18:44:17.321 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/ 2023-12-19T18:44:17.321 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/ 2023-12-19T18:44:17.321 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-19T18:44:17.321 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpuid.ko 2023-12-19T18:44:17.321 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/msr.ko 2023-12-19T18:44:17.321 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/ 2023-12-19T18:44:17.322 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 354433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-19T18:44:17.324 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 881625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-19T18:44:17.325 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 2275865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-19T18:44:17.335 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ 2023-12-19T18:44:17.335 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/af_alg.ko 2023-12-19T18:44:17.335 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_hash.ko 2023-12-19T18:44:17.335 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_skcipher.ko 2023-12-19T18:44:17.336 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-19T18:44:17.336 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-19T18:44:17.336 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-19T18:44:17.336 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/ 2023-12-19T18:44:17.336 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-19T18:44:17.336 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/ 2023-12-19T18:44:17.336 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-19T18:44:17.336 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-19T18:44:17.336 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-19T18:44:17.336 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-19T18:44:17.336 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-19T18:44:17.336 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-19T18:44:17.336 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-19T18:44:17.336 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-19T18:44:17.337 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-19T18:44:17.337 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-19T18:44:17.337 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-19T18:44:17.337 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-19T18:44:17.337 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-19T18:44:17.337 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-19T18:44:17.337 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-19T18:44:17.337 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-19T18:44:17.337 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-19T18:44:17.337 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-19T18:44:17.337 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cryptd.ko 2023-12-19T18:44:17.337 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-19T18:44:17.337 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_simd.ko 2023-12-19T18:44:17.337 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-19T18:44:17.338 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-19T18:44:17.338 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-19T18:44:17.338 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-19T18:44:17.338 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-19T18:44:17.338 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-19T18:44:17.338 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-19T18:44:17.338 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-19T18:44:17.338 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lrw.ko 2023-12-19T18:44:17.338 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-19T18:44:17.338 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-19T18:44:17.338 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-19T18:44:17.338 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-19T18:44:17.338 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-19T18:44:17.338 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-19T18:44:17.338 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-19T18:44:17.338 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-19T18:44:17.339 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-19T18:44:17.339 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 149193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-19T18:44:17.339 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-19T18:44:17.339 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-19T18:44:17.339 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-19T18:44:17.339 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-19T18:44:17.339 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-19T18:44:17.339 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-19T18:44:17.339 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-19T18:44:17.339 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xts.ko 2023-12-19T18:44:17.339 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-19T18:44:17.339 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ 2023-12-19T18:44:17.339 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ 2023-12-19T18:44:17.339 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_extlog.ko 2023-12-19T18:44:17.340 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-19T18:44:17.340 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-19T18:44:17.340 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/ 2023-12-19T18:44:17.340 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/einj.ko 2023-12-19T18:44:17.340 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-19T18:44:17.340 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-19T18:44:17.340 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-19T18:44:17.340 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-19T18:44:17.340 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 103025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-19T18:44:17.340 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ 2023-12-19T18:44:17.340 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-19T18:44:17.340 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 88865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci.ko 2023-12-19T18:44:17.340 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-19T18:44:17.340 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 88289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci.ko 2023-12-19T18:44:17.340 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-19T18:44:17.341 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-19T18:44:17.341 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-19T18:44:17.341 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-19T18:44:17.341 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-19T18:44:17.341 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-19T18:44:17.341 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-19T18:44:17.341 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-19T18:44:17.341 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-19T18:44:17.341 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-19T18:44:17.342 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-19T18:44:17.342 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-19T18:44:17.342 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-19T18:44:17.342 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-19T18:44:17.342 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-19T18:44:17.342 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-19T18:44:17.342 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-19T18:44:17.342 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-19T18:44:17.342 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_legacy.ko 2023-12-19T18:44:17.342 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-19T18:44:17.342 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-19T18:44:17.342 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-19T18:44:17.342 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-19T18:44:17.342 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-19T18:44:17.342 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-19T18:44:17.343 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-19T18:44:17.343 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-19T18:44:17.343 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-19T18:44:17.343 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-19T18:44:17.343 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-19T18:44:17.343 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-19T18:44:17.343 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-19T18:44:17.343 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_radisys.ko 2023-12-19T18:44:17.343 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-19T18:44:17.343 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rz1000.ko 2023-12-19T18:44:17.343 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-19T18:44:17.343 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-19T18:44:17.343 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-19T18:44:17.343 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-19T18:44:17.343 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-19T18:44:17.344 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-19T18:44:17.344 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-19T18:44:17.344 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-19T18:44:17.344 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 83345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-19T18:44:17.344 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-19T18:44:17.344 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-19T18:44:17.344 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-19T18:44:17.344 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-19T18:44:17.344 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-19T18:44:17.344 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-19T18:44:17.344 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-19T18:44:17.344 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-19T18:44:17.344 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-19T18:44:17.345 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-19T18:44:17.345 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-19T18:44:17.345 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ 2023-12-19T18:44:17.345 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-19T18:44:17.345 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/ 2023-12-19T18:44:17.345 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 124473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-19T18:44:17.345 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/ 2023-12-19T18:44:17.345 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/ 2023-12-19T18:44:17.345 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 113665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-19T18:44:17.345 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/ 2023-12-19T18:44:17.345 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 965585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-19T18:44:17.345 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 173225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-19T18:44:17.345 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/ 2023-12-19T18:44:17.345 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 94297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-19T18:44:17.345 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 115793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-19T18:44:17.398 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/ 2023-12-19T18:44:17.398 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 110385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-19T18:44:17.398 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 98193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-19T18:44:17.398 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 263769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-19T18:44:17.399 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/ 2023-12-19T18:44:17.399 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 98145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-19T18:44:17.399 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/ 2023-12-19T18:44:17.399 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-19T18:44:17.399 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ 2023-12-19T18:44:17.399 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/applicom.ko 2023-12-19T18:44:17.399 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-19T18:44:17.399 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/ 2023-12-19T18:44:17.399 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-19T18:44:17.399 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-19T18:44:17.399 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-19T18:44:17.399 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-19T18:44:17.399 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-19T18:44:17.399 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ 2023-12-19T18:44:17.399 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-19T18:44:17.400 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 148601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-19T18:44:17.400 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-19T18:44:17.400 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 139313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-19T18:44:17.400 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-19T18:44:17.400 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-19T18:44:17.400 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-19T18:44:17.400 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/ 2023-12-19T18:44:17.400 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 84097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-19T18:44:17.400 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/nvram.ko 2023-12-19T18:44:17.400 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-19T18:44:17.400 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-19T18:44:17.400 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/ 2023-12-19T18:44:17.400 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-19T18:44:17.400 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-19T18:44:17.400 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-19T18:44:17.401 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-19T18:44:17.401 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-19T18:44:17.401 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-19T18:44:17.401 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-19T18:44:17.401 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/ 2023-12-19T18:44:17.401 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-19T18:44:17.401 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-19T18:44:17.401 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-19T18:44:17.401 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/ 2023-12-19T18:44:17.401 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-palmas.ko 2023-12-19T18:44:17.401 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-si5351.ko 2023-12-19T18:44:17.401 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-twl6040.ko 2023-12-19T18:44:17.401 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-wm831x.ko 2023-12-19T18:44:17.401 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/ 2023-12-19T18:44:17.401 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-19T18:44:17.402 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-19T18:44:17.402 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-19T18:44:17.402 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ 2023-12-19T18:44:17.402 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ 2023-12-19T18:44:17.402 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-19T18:44:17.402 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 243025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-19T18:44:17.402 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/ 2023-12-19T18:44:17.402 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/ 2023-12-19T18:44:17.402 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-19T18:44:17.402 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 438761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-19T18:44:17.402 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-19T18:44:17.402 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-19T18:44:17.402 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-19T18:44:17.402 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-19T18:44:17.403 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/ 2023-12-19T18:44:17.403 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-19T18:44:17.403 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/ 2023-12-19T18:44:17.403 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-19T18:44:17.403 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ 2023-12-19T18:44:17.403 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/ 2023-12-19T18:44:17.403 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-19T18:44:17.403 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ 2023-12-19T18:44:17.403 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 122569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-19T18:44:17.403 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ 2023-12-19T18:44:17.403 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 79953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-19T18:44:17.403 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-19T18:44:17.403 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 63617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-19T18:44:17.403 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-19T18:44:17.404 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-19T18:44:17.404 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-19T18:44:17.404 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-19T18:44:17.404 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-19T18:44:17.404 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 52041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-19T18:44:17.404 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-19T18:44:17.404 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-19T18:44:17.404 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 56825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-19T18:44:17.404 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-19T18:44:17.404 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/ 2023-12-19T18:44:17.404 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-gpio.ko 2023-12-19T18:44:17.404 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max14577.ko 2023-12-19T18:44:17.404 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max77693.ko 2023-12-19T18:44:17.405 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max8997.ko 2023-12-19T18:44:17.405 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-palmas.ko 2023-12-19T18:44:17.405 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-19T18:44:17.405 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-19T18:44:17.405 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/ 2023-12-19T18:44:17.405 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-19T18:44:17.405 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/ 2023-12-19T18:44:17.405 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-19T18:44:17.405 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-19T18:44:17.405 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/ 2023-12-19T18:44:17.406 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-19T18:44:17.406 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-19T18:44:17.406 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-arizona.ko 2023-12-19T18:44:17.406 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9052.ko 2023-12-19T18:44:17.406 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9055.ko 2023-12-19T18:44:17.406 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-dln2.ko 2023-12-19T18:44:17.406 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 77849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-19T18:44:17.406 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-generic.ko 2023-12-19T18:44:17.406 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-19T18:44:17.406 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-19T18:44:17.406 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-kempld.ko 2023-12-19T18:44:17.406 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-19T18:44:17.406 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max7300.ko 2023-12-19T18:44:17.406 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max730x.ko 2023-12-19T18:44:17.406 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max732x.ko 2023-12-19T18:44:17.406 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-19T18:44:17.407 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-19T18:44:17.407 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-19T18:44:17.407 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-19T18:44:17.407 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch.ko 2023-12-19T18:44:17.407 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-19T18:44:17.407 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-19T18:44:17.407 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-19T18:44:17.407 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-19T18:44:17.407 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-19T18:44:17.407 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-vx855.ko 2023-12-19T18:44:17.407 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-19T18:44:17.407 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-19T18:44:17.407 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-19T18:44:17.407 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/ 2023-12-19T18:44:17.407 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-a4tech.ko 2023-12-19T18:44:17.408 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-apple.ko 2023-12-19T18:44:17.408 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-19T18:44:17.408 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-19T18:44:17.408 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-19T18:44:17.408 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-belkin.ko 2023-12-19T18:44:17.408 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cherry.ko 2023-12-19T18:44:17.408 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-chicony.ko 2023-12-19T18:44:17.408 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cp2112.ko 2023-12-19T18:44:17.408 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cypress.ko 2023-12-19T18:44:17.408 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-19T18:44:17.408 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-19T18:44:17.408 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-19T18:44:17.408 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-19T18:44:17.408 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ezkey.ko 2023-12-19T18:44:17.409 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-19T18:44:17.409 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-generic.ko 2023-12-19T18:44:17.409 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-19T18:44:17.409 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-19T18:44:17.409 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-19T18:44:17.409 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-19T18:44:17.409 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-19T18:44:17.409 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-19T18:44:17.409 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-19T18:44:17.409 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kensington.ko 2023-12-19T18:44:17.409 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-19T18:44:17.409 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-19T18:44:17.409 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-19T18:44:17.409 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-19T18:44:17.410 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-19T18:44:17.410 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lg-g15.ko 2023-12-19T18:44:17.410 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 58185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-19T18:44:17.410 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 101481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-19T18:44:17.410 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 80993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech.ko 2023-12-19T18:44:17.410 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-magicmouse.ko 2023-12-19T18:44:17.410 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-microsoft.ko 2023-12-19T18:44:17.410 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-monterey.ko 2023-12-19T18:44:17.410 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-19T18:44:17.410 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ntrig.ko 2023-12-19T18:44:17.410 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-19T18:44:17.410 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-19T18:44:17.410 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-19T18:44:17.411 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 72937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-19T18:44:17.411 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-19T18:44:17.411 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-19T18:44:17.411 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-19T18:44:17.411 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-19T18:44:17.411 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-19T18:44:17.411 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-19T18:44:17.411 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-19T18:44:17.411 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-19T18:44:17.411 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-19T18:44:17.412 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-19T18:44:17.412 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-19T18:44:17.412 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-19T18:44:17.412 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-19T18:44:17.412 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-19T18:44:17.412 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-19T18:44:17.412 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-19T18:44:17.412 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-19T18:44:17.412 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-19T18:44:17.412 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-19T18:44:17.412 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-19T18:44:17.412 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-19T18:44:17.412 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-19T18:44:17.412 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-19T18:44:17.413 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-19T18:44:17.413 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-19T18:44:17.413 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-19T18:44:17.413 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-19T18:44:17.413 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-19T18:44:17.413 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-19T18:44:17.413 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 71073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-19T18:44:17.413 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-19T18:44:17.413 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 143473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-19T18:44:17.413 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-19T18:44:17.413 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-19T18:44:17.413 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-19T18:44:17.414 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 267825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid.ko 2023-12-19T18:44:17.414 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-19T18:44:17.414 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/ 2023-12-19T18:44:17.414 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 125721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-19T18:44:17.414 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-19T18:44:17.414 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-19T18:44:17.414 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 217873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-19T18:44:17.414 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/ 2023-12-19T18:44:17.414 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 64201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-19T18:44:17.414 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-19T18:44:17.414 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 305465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-19T18:44:17.414 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ 2023-12-19T18:44:17.414 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-19T18:44:17.414 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 61393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-19T18:44:17.415 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-19T18:44:17.415 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-19T18:44:17.415 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-19T18:44:17.415 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-19T18:44:17.415 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-19T18:44:17.415 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 97977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-19T18:44:17.415 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-19T18:44:17.415 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 45553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-19T18:44:17.415 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-19T18:44:17.415 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-19T18:44:17.416 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-19T18:44:17.416 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-19T18:44:17.416 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 74433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-19T18:44:17.416 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-19T18:44:17.416 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-19T18:44:17.416 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-19T18:44:17.416 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-19T18:44:17.416 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 55201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-19T18:44:17.416 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-19T18:44:17.416 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 58617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-19T18:44:17.416 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-19T18:44:17.416 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-19T18:44:17.416 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-19T18:44:17.416 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-19T18:44:17.416 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-19T18:44:17.417 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-19T18:44:17.417 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 99601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-19T18:44:17.417 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-19T18:44:17.417 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-19T18:44:17.417 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-19T18:44:17.417 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc2103.ko 2023-12-19T18:44:17.417 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-19T18:44:17.417 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-19T18:44:17.417 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 94457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-19T18:44:17.417 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-19T18:44:17.417 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-19T18:44:17.417 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 55449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-19T18:44:17.417 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-19T18:44:17.417 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-19T18:44:17.417 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-19T18:44:17.418 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 45529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-19T18:44:17.418 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hih6130.ko 2023-12-19T18:44:17.418 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-19T18:44:17.418 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-19T18:44:17.418 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-19T18:44:17.418 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-19T18:44:17.418 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-19T18:44:17.418 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-19T18:44:17.418 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-19T18:44:17.418 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 130449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-19T18:44:17.418 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/jc42.ko 2023-12-19T18:44:17.418 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-19T18:44:17.418 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-19T18:44:17.418 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-19T18:44:17.418 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 48601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-19T18:44:17.419 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-19T18:44:17.419 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-19T18:44:17.419 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-19T18:44:17.419 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-19T18:44:17.419 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-19T18:44:17.419 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-19T18:44:17.419 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 72833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-19T18:44:17.419 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-19T18:44:17.419 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-19T18:44:17.419 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-19T18:44:17.419 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 108841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-19T18:44:17.419 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-19T18:44:17.419 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-19T18:44:17.419 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-19T18:44:17.420 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-19T18:44:17.420 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-19T18:44:17.420 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-19T18:44:17.420 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-19T18:44:17.420 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-19T18:44:17.420 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-19T18:44:17.420 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-19T18:44:17.420 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-19T18:44:17.420 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-19T18:44:17.420 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-19T18:44:17.420 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-19T18:44:17.420 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-19T18:44:17.420 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-19T18:44:17.420 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-19T18:44:17.420 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-19T18:44:17.421 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-19T18:44:17.421 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-19T18:44:17.421 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-19T18:44:17.421 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 119817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-19T18:44:17.421 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-19T18:44:17.421 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 59737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-19T18:44:17.421 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 82337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-19T18:44:17.421 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-19T18:44:17.421 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-19T18:44:17.421 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ 2023-12-19T18:44:17.421 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-19T18:44:17.421 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-19T18:44:17.421 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-19T18:44:17.421 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-19T18:44:17.422 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-19T18:44:17.422 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-19T18:44:17.422 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-19T18:44:17.422 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 82577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-19T18:44:17.422 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-19T18:44:17.422 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-19T18:44:17.422 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-19T18:44:17.422 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-19T18:44:17.422 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-19T18:44:17.422 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-19T18:44:17.422 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-19T18:44:17.422 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-19T18:44:17.422 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-19T18:44:17.422 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-19T18:44:17.422 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-19T18:44:17.423 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-19T18:44:17.423 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-19T18:44:17.423 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-19T18:44:17.423 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-19T18:44:17.423 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-19T18:44:17.423 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-19T18:44:17.423 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-19T18:44:17.423 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-19T18:44:17.423 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-19T18:44:17.423 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-19T18:44:17.423 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-19T18:44:17.423 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 52457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-19T18:44:17.423 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-19T18:44:17.423 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-19T18:44:17.423 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-19T18:44:17.424 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 71345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-19T18:44:17.424 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 63225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-19T18:44:17.424 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 71321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-19T18:44:17.424 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 101473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-19T18:44:17.424 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 119505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-19T18:44:17.424 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-19T18:44:17.424 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-19T18:44:17.424 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-19T18:44:17.424 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-19T18:44:17.424 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/ 2023-12-19T18:44:17.424 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/ 2023-12-19T18:44:17.424 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-19T18:44:17.424 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-19T18:44:17.425 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/ 2023-12-19T18:44:17.425 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-19T18:44:17.425 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-19T18:44:17.425 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-19T18:44:17.425 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-19T18:44:17.425 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-19T18:44:17.425 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-19T18:44:17.425 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-19T18:44:17.425 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 6929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-19T18:44:17.425 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-19T18:44:17.425 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-19T18:44:17.425 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-19T18:44:17.426 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-19T18:44:17.426 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-19T18:44:17.426 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-19T18:44:17.426 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-19T18:44:17.426 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-19T18:44:17.426 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-19T18:44:17.426 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-19T18:44:17.426 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-19T18:44:17.426 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-19T18:44:17.426 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-19T18:44:17.427 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-19T18:44:17.427 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-19T18:44:17.427 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-19T18:44:17.427 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-19T18:44:17.427 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-19T18:44:17.427 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-19T18:44:17.427 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-19T18:44:17.427 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-19T18:44:17.427 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-19T18:44:17.427 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-19T18:44:17.427 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-19T18:44:17.427 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-19T18:44:17.428 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-19T18:44:17.428 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-19T18:44:17.428 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-19T18:44:17.428 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-19T18:44:17.428 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-19T18:44:17.428 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-19T18:44:17.428 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-19T18:44:17.428 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/ 2023-12-19T18:44:17.428 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-19T18:44:17.428 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-19T18:44:17.428 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-19T18:44:17.428 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ 2023-12-19T18:44:17.428 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ 2023-12-19T18:44:17.428 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 273609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-19T18:44:17.428 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 879969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-19T18:44:17.428 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 69273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-19T18:44:17.429 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 324217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-19T18:44:17.429 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 97985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-19T18:44:17.429 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 282273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-19T18:44:17.429 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-19T18:44:17.429 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ 2023-12-19T18:44:17.429 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-19T18:44:17.429 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 493073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-19T18:44:17.429 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/ 2023-12-19T18:44:17.429 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 419737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-19T18:44:17.429 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/ 2023-12-19T18:44:17.429 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 739025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-19T18:44:17.429 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ 2023-12-19T18:44:17.429 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 296625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-19T18:44:17.429 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-19T18:44:17.430 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 153697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-19T18:44:17.430 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/ 2023-12-19T18:44:17.430 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 168969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-19T18:44:17.430 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ 2023-12-19T18:44:17.430 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-19T18:44:17.430 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 263081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-19T18:44:17.430 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ 2023-12-19T18:44:17.430 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 100241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-19T18:44:17.430 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ 2023-12-19T18:44:17.430 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 111425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-19T18:44:17.430 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ 2023-12-19T18:44:17.430 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 128753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-19T18:44:17.430 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ 2023-12-19T18:44:17.430 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 129529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-19T18:44:17.430 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ 2023-12-19T18:44:17.431 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/evbug.ko 2023-12-19T18:44:17.431 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ff-memless.ko 2023-12-19T18:44:17.431 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/ 2023-12-19T18:44:17.431 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-19T18:44:17.431 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-19T18:44:17.431 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-19T18:44:17.431 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-19T18:44:17.431 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/ 2023-12-19T18:44:17.431 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-19T18:44:17.431 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-19T18:44:17.431 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-19T18:44:17.431 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-19T18:44:17.431 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-19T18:44:17.431 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-19T18:44:17.431 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-19T18:44:17.432 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8323.ko 2023-12-19T18:44:17.432 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8333.ko 2023-12-19T18:44:17.432 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-19T18:44:17.432 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-19T18:44:17.432 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-19T18:44:17.432 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-19T18:44:17.432 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-19T18:44:17.432 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-19T18:44:17.432 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt1070.ko 2023-12-19T18:44:17.432 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt2160.ko 2023-12-19T18:44:17.432 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-19T18:44:17.432 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/stowaway.ko 2023-12-19T18:44:17.432 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-19T18:44:17.432 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-19T18:44:17.433 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-19T18:44:17.433 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-19T18:44:17.433 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-19T18:44:17.433 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/matrix-keymap.ko 2023-12-19T18:44:17.433 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/ 2023-12-19T18:44:17.433 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-19T18:44:17.433 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-19T18:44:17.433 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 123681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-19T18:44:17.433 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-19T18:44:17.433 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-19T18:44:17.433 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 335929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/psmouse.ko 2023-12-19T18:44:17.433 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-19T18:44:17.433 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-19T18:44:17.433 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-19T18:44:17.434 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-19T18:44:17.434 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/ 2023-12-19T18:44:17.434 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 109873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-19T18:44:17.434 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ 2023-12-19T18:44:17.434 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-19T18:44:17.434 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-19T18:44:17.434 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ct82c710.ko 2023-12-19T18:44:17.434 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-19T18:44:17.434 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/parkbd.ko 2023-12-19T18:44:17.434 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/pcips2.ko 2023-12-19T18:44:17.434 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ps2mult.ko 2023-12-19T18:44:17.434 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-19T18:44:17.434 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serport.ko 2023-12-19T18:44:17.434 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-19T18:44:17.435 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/ 2023-12-19T18:44:17.435 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/ 2023-12-19T18:44:17.435 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-19T18:44:17.435 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/ 2023-12-19T18:44:17.435 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-88pm860x.ko 2023-12-19T18:44:17.435 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-adp5520.ko 2023-12-19T18:44:17.435 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 59753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-bd2802.ko 2023-12-19T18:44:17.435 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-19T18:44:17.435 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da903x.ko 2023-12-19T18:44:17.435 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da9052.ko 2023-12-19T18:44:17.435 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-gpio.ko 2023-12-19T18:44:17.435 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-19T18:44:17.435 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3533.ko 2023-12-19T18:44:17.435 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm355x.ko 2023-12-19T18:44:17.435 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3642.ko 2023-12-19T18:44:17.436 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-19T18:44:17.436 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp8788.ko 2023-12-19T18:44:17.436 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-max8997.ko 2023-12-19T18:44:17.436 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-mc13783.ko 2023-12-19T18:44:17.436 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-19T18:44:17.436 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca9532.ko 2023-12-19T18:44:17.436 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca955x.ko 2023-12-19T18:44:17.436 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca963x.ko 2023-12-19T18:44:17.436 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-19T18:44:17.436 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-tca6507.ko 2023-12-19T18:44:17.436 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-19T18:44:17.437 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm8350.ko 2023-12-19T18:44:17.437 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ 2023-12-19T18:44:17.437 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-19T18:44:17.437 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-19T18:44:17.437 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-19T18:44:17.437 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-19T18:44:17.438 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-19T18:44:17.438 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-19T18:44:17.438 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-19T18:44:17.438 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-19T18:44:17.438 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/ 2023-12-19T18:44:17.438 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/ 2023-12-19T18:44:17.439 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 654969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-19T18:44:17.439 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-19T18:44:17.439 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bufio.ko 2023-12-19T18:44:17.439 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-19T18:44:17.439 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 156009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-19T18:44:17.439 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 106897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-19T18:44:17.439 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-19T18:44:17.439 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-era.ko 2023-12-19T18:44:17.439 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-19T18:44:17.439 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-19T18:44:17.440 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log.ko 2023-12-19T18:44:17.440 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-mirror.ko 2023-12-19T18:44:17.440 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-19T18:44:17.440 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-19T18:44:17.440 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-19T18:44:17.440 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-region-hash.ko 2023-12-19T18:44:17.440 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-19T18:44:17.440 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-19T18:44:17.440 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 109529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-snapshot.ko 2023-12-19T18:44:17.440 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-19T18:44:17.440 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 181865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-19T18:44:17.440 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-19T18:44:17.440 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-zero.ko 2023-12-19T18:44:17.440 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-19T18:44:17.441 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-19T18:44:17.441 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-19T18:44:17.441 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/ 2023-12-19T18:44:17.441 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 199937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-19T18:44:17.441 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-19T18:44:17.441 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 113073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-19T18:44:17.441 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 158681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-19T18:44:17.441 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 395721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-19T18:44:17.441 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/ 2023-12-19T18:44:17.441 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/ 2023-12-19T18:44:17.441 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 178137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-19T18:44:17.441 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 63385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-19T18:44:17.441 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-19T18:44:17.442 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-19T18:44:17.442 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 123321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-19T18:44:17.442 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 79041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-19T18:44:17.442 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-19T18:44:17.442 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ 2023-12-19T18:44:17.442 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm800.ko 2023-12-19T18:44:17.442 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm805.ko 2023-12-19T18:44:17.442 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm80x.ko 2023-12-19T18:44:17.442 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona-i2c.ko 2023-12-19T18:44:17.442 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 123721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona.ko 2023-12-19T18:44:17.442 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/bcm590xx.ko 2023-12-19T18:44:17.442 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-19T18:44:17.442 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/dln2.ko 2023-12-19T18:44:17.442 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/janz-cmodio.ko 2023-12-19T18:44:17.443 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/kempld-core.ko 2023-12-19T18:44:17.443 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-core.ko 2023-12-19T18:44:17.443 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-19T18:44:17.443 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lp3943.ko 2023-12-19T18:44:17.443 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-19T18:44:17.443 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-19T18:44:17.443 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/max8907.ko 2023-12-19T18:44:17.443 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-19T18:44:17.443 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-19T18:44:17.443 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/menf21bmc.ko 2023-12-19T18:44:17.443 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-19T18:44:17.443 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-19T18:44:17.443 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633.ko 2023-12-19T18:44:17.443 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-19T18:44:17.443 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/retu-mfd.ko 2023-12-19T18:44:17.444 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 80425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/si476x-core.ko 2023-12-19T18:44:17.444 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 48457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-19T18:44:17.444 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-19T18:44:17.444 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps65010.ko 2023-12-19T18:44:17.444 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps6507x.ko 2023-12-19T18:44:17.444 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-19T18:44:17.444 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-19T18:44:17.444 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-19T18:44:17.444 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wm8994.ko 2023-12-19T18:44:17.444 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ 2023-12-19T18:44:17.444 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-19T18:44:17.444 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 48489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot.ko 2023-12-19T18:44:17.445 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/ 2023-12-19T18:44:17.445 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-19T18:44:17.445 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-19T18:44:17.445 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-19T18:44:17.445 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 45593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-19T18:44:17.445 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/ 2023-12-19T18:44:17.445 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-19T18:44:17.445 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/core.ko 2023-12-19T18:44:17.445 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/ 2023-12-19T18:44:17.445 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-19T18:44:17.445 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ds1682.ko 2023-12-19T18:44:17.445 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/dummy-irq.ko 2023-12-19T18:44:17.445 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/ 2023-12-19T18:44:17.445 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/echo.ko 2023-12-19T18:44:17.446 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/ 2023-12-19T18:44:17.446 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-19T18:44:17.446 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-19T18:44:17.446 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-19T18:44:17.446 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-19T18:44:17.446 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-19T18:44:17.446 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/ 2023-12-19T18:44:17.446 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 152201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-19T18:44:17.446 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hmc6352.ko 2023-12-19T18:44:17.446 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-19T18:44:17.446 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ 2023-12-19T18:44:17.446 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 72129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-19T18:44:17.446 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ics932s401.ko 2023-12-19T18:44:17.446 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-19T18:44:17.447 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-19T18:44:17.447 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/ 2023-12-19T18:44:17.447 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-19T18:44:17.447 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-19T18:44:17.447 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/ 2023-12-19T18:44:17.447 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 125209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-19T18:44:17.447 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 56521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-19T18:44:17.447 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 310113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-19T18:44:17.447 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/phantom.ko 2023-12-19T18:44:17.447 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/ 2023-12-19T18:44:17.447 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 74265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-19T18:44:17.447 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-19T18:44:17.447 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-19T18:44:17.448 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-19T18:44:17.448 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 48697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-19T18:44:17.448 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/ 2023-12-19T18:44:17.448 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 183609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-19T18:44:17.448 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ 2023-12-19T18:44:17.448 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/ 2023-12-19T18:44:17.448 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 490129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-19T18:44:17.448 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/ 2023-12-19T18:44:17.448 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/ 2023-12-19T18:44:17.448 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 106033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-19T18:44:17.448 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-19T18:44:17.448 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-19T18:44:17.448 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-19T18:44:17.448 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 453737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-19T18:44:17.448 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-19T18:44:17.449 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-19T18:44:17.449 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ 2023-12-19T18:44:17.449 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/ 2023-12-19T18:44:17.449 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 45785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-19T18:44:17.449 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-19T18:44:17.449 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 130553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-19T18:44:17.449 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 68849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-19T18:44:17.449 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ 2023-12-19T18:44:17.449 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-19T18:44:17.449 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 59689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-19T18:44:17.449 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-19T18:44:17.450 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 99049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-19T18:44:17.450 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/ 2023-12-19T18:44:17.450 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-19T18:44:17.450 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/ 2023-12-19T18:44:17.450 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 69137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-19T18:44:17.450 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/ 2023-12-19T18:44:17.451 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 59585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-19T18:44:17.451 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/ 2023-12-19T18:44:17.451 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-19T18:44:17.451 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/ 2023-12-19T18:44:17.451 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-19T18:44:17.451 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-19T18:44:17.452 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 87297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-19T18:44:17.452 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/ 2023-12-19T18:44:17.452 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-19T18:44:17.452 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 97337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-19T18:44:17.452 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-19T18:44:17.452 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 104673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-19T18:44:17.453 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-19T18:44:17.453 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 90257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-19T18:44:17.453 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-19T18:44:17.453 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 81569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-19T18:44:17.453 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 69729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-19T18:44:17.453 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/ 2023-12-19T18:44:17.454 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-19T18:44:17.454 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 176761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-19T18:44:17.454 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-19T18:44:17.454 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1421497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-19T18:44:17.454 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 128569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-19T18:44:17.454 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-19T18:44:17.455 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 132089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-19T18:44:17.455 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 312081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-19T18:44:17.455 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/ 2023-12-19T18:44:17.455 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-19T18:44:17.455 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 323513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-19T18:44:17.455 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/ 2023-12-19T18:44:17.456 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-19T18:44:17.456 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 193497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-19T18:44:17.456 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-19T18:44:17.456 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 347417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-19T18:44:17.456 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-19T18:44:17.456 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1044497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-19T18:44:17.548 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-19T18:44:17.548 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 166193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-19T18:44:17.548 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-19T18:44:17.548 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-19T18:44:17.548 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/ 2023-12-19T18:44:17.548 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-19T18:44:17.548 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 204345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-19T18:44:17.548 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/ 2023-12-19T18:44:17.548 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-19T18:44:17.548 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 69449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-19T18:44:17.548 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-19T18:44:17.548 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 141225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-19T18:44:17.548 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-19T18:44:17.549 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-19T18:44:17.549 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-19T18:44:17.549 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/ 2023-12-19T18:44:17.549 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-19T18:44:17.549 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 62833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-19T18:44:17.549 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 45721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-19T18:44:17.549 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-19T18:44:17.549 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/ 2023-12-19T18:44:17.549 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-19T18:44:17.549 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 281137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-19T18:44:17.549 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-19T18:44:17.549 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-19T18:44:17.549 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/ 2023-12-19T18:44:17.549 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 45345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-19T18:44:17.550 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ 2023-12-19T18:44:17.550 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 90465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-19T18:44:17.550 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-19T18:44:17.550 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 295577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-19T18:44:17.550 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-19T18:44:17.550 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 584497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-19T18:44:17.550 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-19T18:44:17.550 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 246209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-19T18:44:17.550 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-19T18:44:17.550 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 925825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-19T18:44:17.550 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-19T18:44:17.550 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 302937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-19T18:44:17.551 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/ 2023-12-19T18:44:17.551 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 514641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-19T18:44:17.551 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-19T18:44:17.551 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 93593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-19T18:44:17.551 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-19T18:44:17.551 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 734305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-19T18:44:17.551 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-19T18:44:17.551 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 151769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-19T18:44:17.552 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 86921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-19T18:44:17.552 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/ 2023-12-19T18:44:17.552 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-19T18:44:17.552 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 102289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-19T18:44:17.552 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 122649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-19T18:44:17.552 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/ 2023-12-19T18:44:17.552 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-19T18:44:17.552 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 727601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-19T18:44:17.552 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 278937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-19T18:44:17.552 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-19T18:44:17.552 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-19T18:44:17.552 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1113681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-19T18:44:17.552 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ 2023-12-19T18:44:17.553 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-19T18:44:17.553 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-19T18:44:17.553 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-19T18:44:17.553 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 95665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-19T18:44:17.553 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/ 2023-12-19T18:44:17.553 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-19T18:44:17.553 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 108649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-19T18:44:17.553 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ 2023-12-19T18:44:17.553 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 73441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-19T18:44:17.553 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-19T18:44:17.553 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/ 2023-12-19T18:44:17.553 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 150905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-19T18:44:17.554 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/ 2023-12-19T18:44:17.554 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 136721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-19T18:44:17.554 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/ 2023-12-19T18:44:17.554 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-19T18:44:17.554 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-19T18:44:17.554 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/ 2023-12-19T18:44:17.554 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-19T18:44:17.554 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 227897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-19T18:44:17.554 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 87081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-19T18:44:17.554 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-19T18:44:17.554 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 672049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-19T18:44:17.554 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/ 2023-12-19T18:44:17.555 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-19T18:44:17.555 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/ 2023-12-19T18:44:17.555 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-19T18:44:17.555 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 83985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-19T18:44:17.555 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-19T18:44:17.555 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 189801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-19T18:44:17.556 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/ 2023-12-19T18:44:17.556 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-19T18:44:17.556 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 104241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-19T18:44:17.556 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/ 2023-12-19T18:44:17.556 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1052497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-19T18:44:17.556 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/ 2023-12-19T18:44:17.557 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-19T18:44:17.557 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/ 2023-12-19T18:44:17.557 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-19T18:44:17.557 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 63337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-19T18:44:17.557 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/ 2023-12-19T18:44:17.557 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 61537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-19T18:44:17.557 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-19T18:44:17.557 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 73409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-19T18:44:17.557 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 68177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-19T18:44:17.558 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/ 2023-12-19T18:44:17.558 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-19T18:44:17.558 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-19T18:44:17.558 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-19T18:44:17.558 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-19T18:44:17.558 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 487025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-19T18:44:17.558 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/ 2023-12-19T18:44:17.558 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 103337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-19T18:44:17.558 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 166097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-19T18:44:17.558 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-19T18:44:17.558 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-19T18:44:17.558 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/ 2023-12-19T18:44:17.558 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-19T18:44:17.558 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/ 2023-12-19T18:44:17.558 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 86529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-19T18:44:17.559 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/ 2023-12-19T18:44:17.559 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 80273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-19T18:44:17.559 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 83633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-19T18:44:17.559 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/ 2023-12-19T18:44:17.559 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-19T18:44:17.559 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-19T18:44:17.559 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/ 2023-12-19T18:44:17.559 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 59993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-19T18:44:17.559 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/ 2023-12-19T18:44:17.559 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/defxx.ko 2023-12-19T18:44:17.559 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/ 2023-12-19T18:44:17.559 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 216985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-19T18:44:17.559 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 77345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-19T18:44:17.559 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/ 2023-12-19T18:44:17.559 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 235521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-19T18:44:17.560 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/ 2023-12-19T18:44:17.560 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-19T18:44:17.560 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-19T18:44:17.560 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ 2023-12-19T18:44:17.560 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 83769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-19T18:44:17.560 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 62145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-19T18:44:17.560 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-19T18:44:17.560 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/ 2023-12-19T18:44:17.560 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-19T18:44:17.560 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-19T18:44:17.560 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-19T18:44:17.560 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-19T18:44:17.560 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-19T18:44:17.560 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-19T18:44:17.560 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-19T18:44:17.561 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-19T18:44:17.561 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/ 2023-12-19T18:44:17.561 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-19T18:44:17.561 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-19T18:44:17.561 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ 2023-12-19T18:44:17.561 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-19T18:44:17.561 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-19T18:44:17.561 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-19T18:44:17.561 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-19T18:44:17.561 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-19T18:44:17.561 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-19T18:44:17.561 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-19T18:44:17.561 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-19T18:44:17.561 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-19T18:44:17.562 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-19T18:44:17.562 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 82049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-19T18:44:17.562 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 76113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-19T18:44:17.562 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-19T18:44:17.562 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 97857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-19T18:44:17.562 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-19T18:44:17.562 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-19T18:44:17.562 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-19T18:44:17.562 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-19T18:44:17.562 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-19T18:44:17.562 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/ 2023-12-19T18:44:17.562 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/plip.ko 2023-12-19T18:44:17.562 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ 2023-12-19T18:44:17.562 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-19T18:44:17.562 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-19T18:44:17.562 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-19T18:44:17.563 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-19T18:44:17.563 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-19T18:44:17.563 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-19T18:44:17.563 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-19T18:44:17.563 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-19T18:44:17.563 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sb1000.ko 2023-12-19T18:44:17.563 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/ 2023-12-19T18:44:17.563 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-19T18:44:17.563 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-19T18:44:17.563 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 64449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-19T18:44:17.563 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/ 2023-12-19T18:44:17.563 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 106169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-19T18:44:17.563 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-19T18:44:17.563 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-19T18:44:17.564 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-19T18:44:17.564 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-19T18:44:17.564 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-19T18:44:17.564 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 87017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-19T18:44:17.564 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/ 2023-12-19T18:44:17.564 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 144297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-19T18:44:17.564 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/ 2023-12-19T18:44:17.564 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 297329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-19T18:44:17.564 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/ 2023-12-19T18:44:17.565 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 144585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-19T18:44:17.565 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ 2023-12-19T18:44:17.565 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-19T18:44:17.565 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/ 2023-12-19T18:44:17.565 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/ 2023-12-19T18:44:17.565 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 265121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-19T18:44:17.565 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 102209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-19T18:44:17.565 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/ 2023-12-19T18:44:17.565 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 133841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-19T18:44:17.566 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-19T18:44:17.566 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 84465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-19T18:44:17.566 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-19T18:44:17.566 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/ 2023-12-19T18:44:17.566 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/ 2023-12-19T18:44:17.566 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-19T18:44:17.566 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-19T18:44:17.566 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-19T18:44:17.566 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pci-stub.ko 2023-12-19T18:44:17.566 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-19T18:44:17.566 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/ 2023-12-19T18:44:17.566 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-19T18:44:17.566 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 145809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia.ko 2023-12-19T18:44:17.566 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 62137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-19T18:44:17.566 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-19T18:44:17.567 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-19T18:44:17.567 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 112889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-19T18:44:17.567 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/ 2023-12-19T18:44:17.567 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/ 2023-12-19T18:44:17.567 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-19T18:44:17.567 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/ 2023-12-19T18:44:17.567 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-19T18:44:17.567 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/ 2023-12-19T18:44:17.567 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/ 2023-12-19T18:44:17.567 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-19T18:44:17.567 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/ 2023-12-19T18:44:17.567 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/ 2023-12-19T18:44:17.567 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-19T18:44:17.567 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-19T18:44:17.567 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-19T18:44:17.568 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-19T18:44:17.568 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-19T18:44:17.568 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-19T18:44:17.568 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-19T18:44:17.568 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ 2023-12-19T18:44:17.568 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-19T18:44:17.568 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-19T18:44:17.568 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-19T18:44:17.568 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 59665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-19T18:44:17.568 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-19T18:44:17.568 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 127441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-19T18:44:17.568 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-19T18:44:17.568 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-19T18:44:17.568 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-19T18:44:17.569 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-19T18:44:17.569 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-19T18:44:17.569 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-19T18:44:17.569 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-19T18:44:17.569 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/ 2023-12-19T18:44:17.569 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-19T18:44:17.569 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-19T18:44:17.569 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-19T18:44:17.569 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-19T18:44:17.569 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-19T18:44:17.569 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-19T18:44:17.569 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-19T18:44:17.569 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-19T18:44:17.569 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-19T18:44:17.569 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-19T18:44:17.570 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-19T18:44:17.570 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-19T18:44:17.570 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-19T18:44:17.570 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/ 2023-12-19T18:44:17.570 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ 2023-12-19T18:44:17.570 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-19T18:44:17.570 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-19T18:44:17.570 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 55057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-19T18:44:17.570 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-19T18:44:17.570 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-19T18:44:17.570 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-19T18:44:17.570 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9030_battery.ko 2023-12-19T18:44:17.570 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9052-battery.ko 2023-12-19T18:44:17.570 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-19T18:44:17.570 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-19T18:44:17.571 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-19T18:44:17.571 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-19T18:44:17.571 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/gpio-charger.ko 2023-12-19T18:44:17.571 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-19T18:44:17.571 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-19T18:44:17.571 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max14577_charger.ko 2023-12-19T18:44:17.571 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17040_battery.ko 2023-12-19T18:44:17.571 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17042_battery.ko 2023-12-19T18:44:17.571 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8903_charger.ko 2023-12-19T18:44:17.571 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8925_power.ko 2023-12-19T18:44:17.571 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-19T18:44:17.571 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/sbs-battery.ko 2023-12-19T18:44:17.571 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/test_power.ko 2023-12-19T18:44:17.571 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-19T18:44:17.571 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-19T18:44:17.572 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_power.ko 2023-12-19T18:44:17.572 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm8350_power.ko 2023-12-19T18:44:17.572 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/ 2023-12-19T18:44:17.572 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-19T18:44:17.572 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-19T18:44:17.572 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/ 2023-12-19T18:44:17.572 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/ 2023-12-19T18:44:17.572 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-19T18:44:17.572 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-19T18:44:17.572 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-19T18:44:17.572 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-19T18:44:17.572 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ 2023-12-19T18:44:17.572 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-19T18:44:17.572 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-19T18:44:17.572 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/ 2023-12-19T18:44:17.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-19T18:44:17.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-19T18:44:17.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-19T18:44:17.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9052.ko 2023-12-19T18:44:17.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9055.ko 2023-12-19T18:44:17.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9063.ko 2023-12-19T18:44:17.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-19T18:44:17.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 68577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-19T18:44:17.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-19T18:44:17.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-19T18:44:17.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-19T18:44:17.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-19T18:44:17.573 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-19T18:44:17.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-19T18:44:17.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-19T18:44:17.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-19T18:44:17.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-19T18:44:17.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-19T18:44:17.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-19T18:44:17.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-19T18:44:17.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-19T18:44:17.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-19T18:44:17.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-19T18:44:17.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-19T18:44:17.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-19T18:44:17.574 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8907.ko 2023-12-19T18:44:17.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8925.ko 2023-12-19T18:44:17.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8997.ko 2023-12-19T18:44:17.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8998.ko 2023-12-19T18:44:17.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-19T18:44:17.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-19T18:44:17.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-palmas.ko 2023-12-19T18:44:17.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-19T18:44:17.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-19T18:44:17.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-19T18:44:17.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-19T18:44:17.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-19T18:44:17.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-19T18:44:17.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-19T18:44:17.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-19T18:44:17.575 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-19T18:44:17.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-19T18:44:17.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-19T18:44:17.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-19T18:44:17.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-19T18:44:17.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-19T18:44:17.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-19T18:44:17.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-19T18:44:17.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-19T18:44:17.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-19T18:44:17.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-19T18:44:17.576 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ 2023-12-19T18:44:17.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 77617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-19T18:44:17.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-19T18:44:17.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 55105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-19T18:44:17.576 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 135185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-19T18:44:17.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-19T18:44:17.577 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/ 2023-12-19T18:44:17.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 272305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-19T18:44:17.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 100617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-19T18:44:17.577 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/ 2023-12-19T18:44:17.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 356201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-19T18:44:17.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 295801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-19T18:44:17.577 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/ 2023-12-19T18:44:17.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 189185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-19T18:44:17.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-19T18:44:17.577 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/ 2023-12-19T18:44:17.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 106881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-19T18:44:17.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-19T18:44:17.577 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/ 2023-12-19T18:44:17.577 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 246985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-19T18:44:17.578 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/ 2023-12-19T18:44:17.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1171945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-19T18:44:17.578 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/ 2023-12-19T18:44:17.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 237273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-19T18:44:17.578 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/ 2023-12-19T18:44:17.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 115369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-19T18:44:17.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-19T18:44:17.578 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/ 2023-12-19T18:44:17.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 308921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-19T18:44:17.578 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/ 2023-12-19T18:44:17.578 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-19T18:44:17.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 76145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-19T18:44:17.578 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-19T18:44:17.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 101449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-19T18:44:17.578 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 146689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-19T18:44:17.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 75553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-19T18:44:17.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-19T18:44:17.579 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/ 2023-12-19T18:44:17.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 212425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-19T18:44:17.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-19T18:44:17.579 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/ 2023-12-19T18:44:17.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-19T18:44:17.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 158505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-19T18:44:17.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fdomain.ko 2023-12-19T18:44:17.579 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/ 2023-12-19T18:44:17.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 263489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-19T18:44:17.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 201817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-19T18:44:17.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-19T18:44:17.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-19T18:44:17.579 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/imm.ko 2023-12-19T18:44:17.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-19T18:44:17.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 266537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-19T18:44:17.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 101881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-19T18:44:17.580 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/ 2023-12-19T18:44:17.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 317153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-19T18:44:17.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-19T18:44:17.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 52961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-19T18:44:17.580 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/ 2023-12-19T18:44:17.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 314865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-19T18:44:17.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 145585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-19T18:44:17.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-19T18:44:17.580 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/ 2023-12-19T18:44:17.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 216665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-19T18:44:17.580 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/ 2023-12-19T18:44:17.580 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 2197249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-19T18:44:17.580 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/ 2023-12-19T18:44:17.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 73569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-19T18:44:17.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-19T18:44:17.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 310617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-19T18:44:17.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 84721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-19T18:44:17.581 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/ 2023-12-19T18:44:17.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 659825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-19T18:44:17.581 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/ 2023-12-19T18:44:17.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 119561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-19T18:44:17.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-19T18:44:17.581 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/ 2023-12-19T18:44:17.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 81625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-19T18:44:17.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-19T18:44:17.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-19T18:44:17.581 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-19T18:44:17.581 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/ 2023-12-19T18:44:17.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 364105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-19T18:44:17.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 123617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-19T18:44:17.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ppa.ko 2023-12-19T18:44:17.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 55361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-19T18:44:17.582 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/ 2023-12-19T18:44:17.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1876689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-19T18:44:17.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 85289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-19T18:44:17.582 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/ 2023-12-19T18:44:17.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 559033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-19T18:44:17.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qlogicfas408.ko 2023-12-19T18:44:17.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-19T18:44:17.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 238761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-19T18:44:17.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 173937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-19T18:44:17.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 279313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-19T18:44:17.582 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 97729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-19T18:44:17.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 73881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-19T18:44:17.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-19T18:44:17.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-19T18:44:17.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 115889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-19T18:44:17.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-19T18:44:17.583 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-19T18:44:17.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 162121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-19T18:44:17.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-19T18:44:17.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-19T18:44:17.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-19T18:44:17.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/xen-scsifront.ko 2023-12-19T18:44:17.583 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ 2023-12-19T18:44:17.583 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 129441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-19T18:44:17.583 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/ 2023-12-19T18:44:17.583 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/ 2023-12-19T18:44:17.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 736601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-19T18:44:17.584 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/ 2023-12-19T18:44:17.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-19T18:44:17.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-19T18:44:17.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-19T18:44:17.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 930257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-19T18:44:17.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-19T18:44:17.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 122521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-19T18:44:17.584 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/ 2023-12-19T18:44:17.584 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 75593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-19T18:44:17.584 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/ 2023-12-19T18:44:17.584 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/ 2023-12-19T18:44:17.584 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-19T18:44:17.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-19T18:44:17.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-19T18:44:17.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-19T18:44:17.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-19T18:44:17.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-19T18:44:17.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-19T18:44:17.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-19T18:44:17.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-19T18:44:17.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-19T18:44:17.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-19T18:44:17.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-19T18:44:17.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-19T18:44:17.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-19T18:44:17.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-19T18:44:17.585 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-19T18:44:17.586 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-19T18:44:17.586 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ 2023-12-19T18:44:17.586 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ 2023-12-19T18:44:17.586 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-19T18:44:17.586 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/moxa.ko 2023-12-19T18:44:17.586 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 50953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/mxser.ko 2023-12-19T18:44:17.586 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 108601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-19T18:44:17.586 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-19T18:44:17.586 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-19T18:44:17.586 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/ 2023-12-19T18:44:17.586 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/ 2023-12-19T18:44:17.586 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-19T18:44:17.586 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 59497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-19T18:44:17.586 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-19T18:44:17.586 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_uart.ko 2023-12-19T18:44:17.587 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-19T18:44:17.587 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 72425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-19T18:44:17.587 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/ 2023-12-19T18:44:17.587 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 103073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-19T18:44:17.587 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/rp2.ko 2023-12-19T18:44:17.587 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 52817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-19T18:44:17.587 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/ 2023-12-19T18:44:17.587 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ 2023-12-19T18:44:17.587 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 531265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-19T18:44:17.587 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ 2023-12-19T18:44:17.587 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-19T18:44:17.587 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-19T18:44:17.587 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/ 2023-12-19T18:44:17.587 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-19T18:44:17.587 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-19T18:44:17.587 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-19T18:44:17.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-19T18:44:17.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_mf624.ko 2023-12-19T18:44:17.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_netx.ko 2023-12-19T18:44:17.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-19T18:44:17.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-19T18:44:17.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-19T18:44:17.588 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/ 2023-12-19T18:44:17.588 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/ 2023-12-19T18:44:17.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 73297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-19T18:44:17.588 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ 2023-12-19T18:44:17.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 144377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-19T18:44:17.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-19T18:44:17.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-19T18:44:17.588 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-19T18:44:17.588 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/ 2023-12-19T18:44:17.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 87089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-19T18:44:17.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-19T18:44:17.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-19T18:44:17.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-19T18:44:17.589 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ 2023-12-19T18:44:17.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ulpi.ko 2023-12-19T18:44:17.589 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/ 2023-12-19T18:44:17.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-19T18:44:17.589 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/ 2023-12-19T18:44:17.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-19T18:44:17.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-19T18:44:17.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 448505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-19T18:44:17.589 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/ 2023-12-19T18:44:17.589 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/ 2023-12-19T18:44:17.589 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-19T18:44:17.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-19T18:44:17.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-19T18:44:17.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-19T18:44:17.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-19T18:44:17.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-19T18:44:17.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 92489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-19T18:44:17.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-19T18:44:17.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 122081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-19T18:44:17.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-19T18:44:17.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-19T18:44:17.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-19T18:44:17.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-19T18:44:17.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 85609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-19T18:44:17.590 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-19T18:44:17.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 58113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-19T18:44:17.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-19T18:44:17.591 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/ 2023-12-19T18:44:17.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-19T18:44:17.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-19T18:44:17.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-19T18:44:17.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-19T18:44:17.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-19T18:44:17.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-19T18:44:17.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-19T18:44:17.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-19T18:44:17.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-19T18:44:17.591 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-19T18:44:17.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-19T18:44:17.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-19T18:44:17.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 62185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-19T18:44:17.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-19T18:44:17.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 161225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-19T18:44:17.592 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/ 2023-12-19T18:44:17.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-19T18:44:17.592 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-19T18:44:17.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 157681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-19T18:44:17.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-19T18:44:17.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 52721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-19T18:44:17.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 69705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-19T18:44:17.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 56033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-19T18:44:17.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 76057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-19T18:44:17.592 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 75073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-19T18:44:17.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 73169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-19T18:44:17.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 65809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-19T18:44:17.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-19T18:44:17.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 81505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-19T18:44:17.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 156073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-19T18:44:17.593 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ 2023-12-19T18:44:17.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-19T18:44:17.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 80113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-19T18:44:17.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 87353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-19T18:44:17.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-19T18:44:17.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-19T18:44:17.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811_cs.ko 2023-12-19T18:44:17.593 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-19T18:44:17.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-19T18:44:17.594 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/ 2023-12-19T18:44:17.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-19T18:44:17.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-19T18:44:17.594 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ 2023-12-19T18:44:17.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-19T18:44:17.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-19T18:44:17.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-19T18:44:17.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cytherm.ko 2023-12-19T18:44:17.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ehset.ko 2023-12-19T18:44:17.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-19T18:44:17.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-19T18:44:17.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-19T18:44:17.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-19T18:44:17.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-19T18:44:17.594 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-19T18:44:17.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-19T18:44:17.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-19T18:44:17.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/lvstest.ko 2023-12-19T18:44:17.595 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/ 2023-12-19T18:44:17.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 64841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-19T18:44:17.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-19T18:44:17.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-19T18:44:17.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-19T18:44:17.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-19T18:44:17.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbtest.ko 2023-12-19T18:44:17.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-19T18:44:17.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-19T18:44:17.595 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/ 2023-12-19T18:44:17.595 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 72953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/usbmon.ko 2023-12-19T18:44:17.595 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/ 2023-12-19T18:44:17.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 301697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-19T18:44:17.596 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/ 2023-12-19T18:44:17.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-19T18:44:17.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-19T18:44:17.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-19T18:44:17.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-19T18:44:17.596 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ 2023-12-19T18:44:17.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-19T18:44:17.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-19T18:44:17.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-19T18:44:17.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-19T18:44:17.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-19T18:44:17.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-19T18:44:17.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 58217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-19T18:44:17.596 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-19T18:44:17.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-19T18:44:17.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/f81232.ko 2023-12-19T18:44:17.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 175137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-19T18:44:17.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-19T18:44:17.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 137081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-19T18:44:17.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 124833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-19T18:44:17.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-19T18:44:17.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-19T18:44:17.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-19T18:44:17.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 58233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-19T18:44:17.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 107521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-19T18:44:17.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-19T18:44:17.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-19T18:44:17.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-19T18:44:17.597 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-19T18:44:17.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/metro-usb.ko 2023-12-19T18:44:17.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-19T18:44:17.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 78217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-19T18:44:17.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 56337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mxuport.ko 2023-12-19T18:44:17.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-19T18:44:17.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-19T18:44:17.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-19T18:44:17.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 191137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-19T18:44:17.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-19T18:44:17.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-19T18:44:17.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-19T18:44:17.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-19T18:44:17.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-19T18:44:17.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-19T18:44:17.598 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 51625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-19T18:44:17.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-19T18:44:17.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-19T18:44:17.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-19T18:44:17.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-19T18:44:17.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-19T18:44:17.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-19T18:44:17.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-19T18:44:17.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 125609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usbserial.ko 2023-12-19T18:44:17.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-19T18:44:17.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-19T18:44:17.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-19T18:44:17.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-19T18:44:17.599 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ 2023-12-19T18:44:17.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 52913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-19T18:44:17.599 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-19T18:44:17.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-19T18:44:17.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-19T18:44:17.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-19T18:44:17.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-19T18:44:17.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-19T18:44:17.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-19T18:44:17.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-19T18:44:17.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-19T18:44:17.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-19T18:44:17.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-19T18:44:17.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-19T18:44:17.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-19T18:44:17.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 179969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-19T18:44:17.600 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/ 2023-12-19T18:44:17.600 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-19T18:44:17.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 72177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-19T18:44:17.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 107001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-19T18:44:17.601 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/ 2023-12-19T18:44:17.601 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/ 2023-12-19T18:44:17.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 154297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-19T18:44:17.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-19T18:44:17.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 108737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-19T18:44:17.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 77609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-19T18:44:17.601 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/ 2023-12-19T18:44:17.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 113785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-19T18:44:17.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-19T18:44:17.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 58089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-19T18:44:17.601 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-19T18:44:17.601 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/ 2023-12-19T18:44:17.601 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/ 2023-12-19T18:44:17.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-19T18:44:17.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-19T18:44:17.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-19T18:44:17.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-19T18:44:17.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-19T18:44:17.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-19T18:44:17.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-19T18:44:17.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/bd6107.ko 2023-12-19T18:44:17.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-19T18:44:17.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-19T18:44:17.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-19T18:44:17.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-19T18:44:17.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-19T18:44:17.602 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-19T18:44:17.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-19T18:44:17.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-19T18:44:17.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-19T18:44:17.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-19T18:44:17.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-19T18:44:17.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-19T18:44:17.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-19T18:44:17.603 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/ 2023-12-19T18:44:17.603 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ 2023-12-19T18:44:17.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-19T18:44:17.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-19T18:44:17.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-19T18:44:17.603 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-19T18:44:17.604 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/ 2023-12-19T18:44:17.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-19T18:44:17.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-19T18:44:17.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-19T18:44:17.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-19T18:44:17.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-19T18:44:17.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-19T18:44:17.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-19T18:44:17.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-19T18:44:17.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-19T18:44:17.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-19T18:44:17.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 56425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-19T18:44:17.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 102673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-19T18:44:17.604 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ 2023-12-19T18:44:17.604 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/acquirewdt.ko 2023-12-19T18:44:17.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/advantechwdt.ko 2023-12-19T18:44:17.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-19T18:44:17.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-19T18:44:17.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-19T18:44:17.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-19T18:44:17.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-19T18:44:17.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-19T18:44:17.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/dw_wdt.ko 2023-12-19T18:44:17.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-19T18:44:17.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-19T18:44:17.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-19T18:44:17.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-19T18:44:17.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-19T18:44:17.605 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-19T18:44:17.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-19T18:44:17.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-19T18:44:17.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-19T18:44:17.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-19T18:44:17.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-19T18:44:17.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-19T18:44:17.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-19T18:44:17.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-19T18:44:17.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-19T18:44:17.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-19T18:44:17.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-19T18:44:17.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-19T18:44:17.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-19T18:44:17.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-19T18:44:17.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/retu_wdt.ko 2023-12-19T18:44:17.606 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-19T18:44:17.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-19T18:44:17.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-19T18:44:17.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-19T18:44:17.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-19T18:44:17.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-19T18:44:17.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-19T18:44:17.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-19T18:44:17.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-19T18:44:17.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-19T18:44:17.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-19T18:44:17.607 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-19T18:44:17.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-19T18:44:17.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-19T18:44:17.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-19T18:44:17.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-19T18:44:17.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-19T18:44:17.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-19T18:44:17.608 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/ 2023-12-19T18:44:17.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-19T18:44:17.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-19T18:44:17.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-19T18:44:17.608 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/ 2023-12-19T18:44:17.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 176377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-19T18:44:17.608 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-19T18:44:17.609 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 71249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-scsiback.ko 2023-12-19T18:44:17.609 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/ 2023-12-19T18:44:17.609 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-19T18:44:17.609 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ 2023-12-19T18:44:17.609 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/ 2023-12-19T18:44:17.609 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 166425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-19T18:44:17.609 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/ 2023-12-19T18:44:17.609 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 61073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/adfs.ko 2023-12-19T18:44:17.609 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/ 2023-12-19T18:44:17.609 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 163593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-19T18:44:17.610 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/ 2023-12-19T18:44:17.610 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 932817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/kafs.ko 2023-12-19T18:44:17.610 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/ 2023-12-19T18:44:17.610 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 101057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/autofs4.ko 2023-12-19T18:44:17.610 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/ 2023-12-19T18:44:17.610 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 64545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-19T18:44:17.610 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/ 2023-12-19T18:44:17.610 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/bfs.ko 2023-12-19T18:44:17.610 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-19T18:44:17.610 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/ 2023-12-19T18:44:17.610 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 3402729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-19T18:44:17.610 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/ 2023-12-19T18:44:17.610 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 306009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-19T18:44:17.610 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ 2023-12-19T18:44:17.610 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1333017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-19T18:44:17.610 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/ 2023-12-19T18:44:17.611 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 100801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-19T18:44:17.611 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/ 2023-12-19T18:44:17.611 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 108393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/configfs.ko 2023-12-19T18:44:17.611 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/ 2023-12-19T18:44:17.611 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 29625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-19T18:44:17.611 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/ 2023-12-19T18:44:17.611 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 642513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-19T18:44:17.611 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/ 2023-12-19T18:44:17.611 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/efs.ko 2023-12-19T18:44:17.611 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/ 2023-12-19T18:44:17.611 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1505025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-19T18:44:17.611 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/ 2023-12-19T18:44:17.611 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-19T18:44:17.611 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/ 2023-12-19T18:44:17.611 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/freevxfs.ko 2023-12-19T18:44:17.612 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/ 2023-12-19T18:44:17.612 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 226481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-19T18:44:17.612 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/ 2023-12-19T18:44:17.612 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-19T18:44:17.612 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/ 2023-12-19T18:44:17.612 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1231529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-19T18:44:17.612 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/ 2023-12-19T18:44:17.612 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 141209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-19T18:44:17.612 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/ 2023-12-19T18:44:17.612 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 222817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-19T18:44:17.612 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/ 2023-12-19T18:44:17.612 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 192329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/hpfs.ko 2023-12-19T18:44:17.612 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/ 2023-12-19T18:44:17.612 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 74065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-19T18:44:17.612 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/ 2023-12-19T18:44:17.613 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 419497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-19T18:44:17.613 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/ 2023-12-19T18:44:17.613 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 280313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-19T18:44:17.613 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/ 2023-12-19T18:44:17.613 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-19T18:44:17.613 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/ 2023-12-19T18:44:17.613 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 124649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-19T18:44:17.613 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/ 2023-12-19T18:44:17.613 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/ 2023-12-19T18:44:17.613 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 81449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-19T18:44:17.613 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/ 2023-12-19T18:44:17.613 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 59449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-19T18:44:17.613 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/ 2023-12-19T18:44:17.613 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 117465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-19T18:44:17.614 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1055721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-19T18:44:17.614 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv2.ko 2023-12-19T18:44:17.614 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 120177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-19T18:44:17.614 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 2042137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-19T18:44:17.614 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/ 2023-12-19T18:44:17.614 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-19T18:44:17.614 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-19T18:44:17.614 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/ 2023-12-19T18:44:17.614 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1516873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-19T18:44:17.614 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/ 2023-12-19T18:44:17.614 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 592833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-19T18:44:17.614 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/ 2023-12-19T18:44:17.614 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-19T18:44:17.614 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-19T18:44:17.615 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-19T18:44:17.615 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-19T18:44:17.615 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-19T18:44:17.615 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-19T18:44:17.615 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-19T18:44:17.615 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-19T18:44:17.615 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-19T18:44:17.615 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-19T18:44:17.615 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-19T18:44:17.615 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ascii.ko 2023-12-19T18:44:17.615 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-19T18:44:17.615 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-19T18:44:17.615 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-19T18:44:17.615 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-19T18:44:17.615 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-19T18:44:17.616 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-19T18:44:17.616 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-19T18:44:17.616 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-19T18:44:17.616 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-19T18:44:17.616 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-19T18:44:17.616 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-19T18:44:17.616 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-19T18:44:17.616 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-19T18:44:17.616 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-19T18:44:17.616 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-19T18:44:17.616 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-19T18:44:17.616 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-19T18:44:17.616 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-19T18:44:17.616 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 94137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-19T18:44:17.616 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 142673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-19T18:44:17.616 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 165745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-19T18:44:17.617 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 118121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-19T18:44:17.617 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-19T18:44:17.617 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-19T18:44:17.617 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-19T18:44:17.617 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-19T18:44:17.617 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-19T18:44:17.617 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-19T18:44:17.617 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-19T18:44:17.617 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-19T18:44:17.617 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-19T18:44:17.617 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-19T18:44:17.617 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-19T18:44:17.617 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-19T18:44:17.617 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-19T18:44:17.617 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-19T18:44:17.618 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-19T18:44:17.618 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-19T18:44:17.618 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-19T18:44:17.618 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ 2023-12-19T18:44:17.618 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 219417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ntfs.ko 2023-12-19T18:44:17.618 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ 2023-12-19T18:44:17.618 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ 2023-12-19T18:44:17.618 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 244409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-19T18:44:17.618 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ 2023-12-19T18:44:17.618 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 440737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-19T18:44:17.618 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ 2023-12-19T18:44:17.618 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-19T18:44:17.618 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 2592433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-19T18:44:17.618 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-19T18:44:17.618 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-19T18:44:17.619 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-19T18:44:17.619 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/ 2023-12-19T18:44:17.619 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/omfs.ko 2023-12-19T18:44:17.619 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/ 2023-12-19T18:44:17.619 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 352161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-19T18:44:17.619 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ 2023-12-19T18:44:17.619 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-19T18:44:17.619 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/ 2023-12-19T18:44:17.619 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/qnx4.ko 2023-12-19T18:44:17.619 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/ 2023-12-19T18:44:17.619 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 46689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/qnx6.ko 2023-12-19T18:44:17.619 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/ 2023-12-19T18:44:17.619 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_tree.ko 2023-12-19T18:44:17.619 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v1.ko 2023-12-19T18:44:17.619 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v2.ko 2023-12-19T18:44:17.619 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/ 2023-12-19T18:44:17.620 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 532673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-19T18:44:17.620 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/ 2023-12-19T18:44:17.620 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-19T18:44:17.620 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/ 2023-12-19T18:44:17.620 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/ 2023-12-19T18:44:17.620 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 2668401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-19T18:44:17.620 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/ 2023-12-19T18:44:17.620 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-19T18:44:17.620 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-19T18:44:17.620 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/ 2023-12-19T18:44:17.620 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 134641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-19T18:44:17.620 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/ 2023-12-19T18:44:17.620 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 90721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-19T18:44:17.620 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/ 2023-12-19T18:44:17.620 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 247737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-19T18:44:17.621 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ 2023-12-19T18:44:17.621 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 162497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-19T18:44:17.621 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/ 2023-12-19T18:44:17.621 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 4011017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-19T18:44:17.673 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/ 2023-12-19T18:44:17.673 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/ 2023-12-19T18:44:17.673 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 75489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/locktorture.ko 2023-12-19T18:44:17.674 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/ 2023-12-19T18:44:17.674 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/test_udelay.ko 2023-12-19T18:44:17.674 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-19T18:44:17.674 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ 2023-12-19T18:44:17.674 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 6833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-19T18:44:17.674 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 6529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc7.ko 2023-12-19T18:44:17.674 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-19T18:44:17.674 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/ 2023-12-19T18:44:17.674 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-19T18:44:17.674 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-19T18:44:17.674 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/interval_tree_test.ko 2023-12-19T18:44:17.674 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-19T18:44:17.674 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-19T18:44:17.674 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/ 2023-12-19T18:44:17.674 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-19T18:44:17.675 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-19T18:44:17.675 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/ 2023-12-19T18:44:17.675 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 6617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-19T18:44:17.675 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/memory-notifier-error-inject.ko 2023-12-19T18:44:17.675 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/notifier-error-inject.ko 2023-12-19T18:44:17.675 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/percpu_test.ko 2023-12-19T18:44:17.675 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/pm-notifier-error-inject.ko 2023-12-19T18:44:17.675 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/ 2023-12-19T18:44:17.675 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 143433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-19T18:44:17.675 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/rbtree_test.ko 2023-12-19T18:44:17.675 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/ 2023-12-19T18:44:17.675 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-19T18:44:17.675 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-kstrtox.ko 2023-12-19T18:44:17.675 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-string_helpers.ko 2023-12-19T18:44:17.675 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 4760425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_bpf.ko 2023-12-19T18:44:17.676 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_firmware.ko 2023-12-19T18:44:17.676 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 6369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_module.ko 2023-12-19T18:44:17.676 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_user_copy.ko 2023-12-19T18:44:17.676 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-19T18:44:17.676 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-19T18:44:17.676 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-19T18:44:17.676 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/ 2023-12-19T18:44:17.676 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/xz_dec_test.ko 2023-12-19T18:44:17.676 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/ 2023-12-19T18:44:17.676 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-19T18:44:17.676 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ 2023-12-19T18:44:17.676 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/ 2023-12-19T18:44:17.676 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 55737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-19T18:44:17.676 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-19T18:44:17.676 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-19T18:44:17.677 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-19T18:44:17.677 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 6985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-19T18:44:17.677 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-19T18:44:17.677 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-19T18:44:17.677 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-19T18:44:17.677 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/ 2023-12-19T18:44:17.677 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-19T18:44:17.677 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-19T18:44:17.677 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-19T18:44:17.677 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-19T18:44:17.677 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-19T18:44:17.677 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/ 2023-12-19T18:44:17.677 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 81737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-19T18:44:17.677 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/ 2023-12-19T18:44:17.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 198337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-19T18:44:17.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-19T18:44:17.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-19T18:44:17.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-19T18:44:17.678 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/ 2023-12-19T18:44:17.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 649297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-19T18:44:17.678 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/ 2023-12-19T18:44:17.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 63809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-19T18:44:17.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 777689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-19T18:44:17.678 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ 2023-12-19T18:44:17.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-19T18:44:17.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-19T18:44:17.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-19T18:44:17.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-19T18:44:17.678 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-19T18:44:17.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-19T18:44:17.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-19T18:44:17.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-19T18:44:17.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-19T18:44:17.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-19T18:44:17.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-19T18:44:17.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-19T18:44:17.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-19T18:44:17.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-19T18:44:17.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-19T18:44:17.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-19T18:44:17.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-19T18:44:17.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-19T18:44:17.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-19T18:44:17.679 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-19T18:44:17.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 55929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-19T18:44:17.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-19T18:44:17.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-19T18:44:17.680 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/ 2023-12-19T18:44:17.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1046681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-19T18:44:17.680 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/ 2023-12-19T18:44:17.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 125993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-19T18:44:17.680 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/ 2023-12-19T18:44:17.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 194209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-19T18:44:17.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-19T18:44:17.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 57881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-19T18:44:17.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-19T18:44:17.680 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/ 2023-12-19T18:44:17.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 390473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-19T18:44:17.680 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-19T18:44:17.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-19T18:44:17.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-19T18:44:17.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-19T18:44:17.681 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/ 2023-12-19T18:44:17.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 99729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/hsr.ko 2023-12-19T18:44:17.681 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ 2023-12-19T18:44:17.681 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ 2023-12-19T18:44:17.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 45233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-19T18:44:17.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 254625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-19T18:44:17.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-19T18:44:17.681 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ 2023-12-19T18:44:17.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-19T18:44:17.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-19T18:44:17.681 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 48337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-19T18:44:17.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-19T18:44:17.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 48657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-19T18:44:17.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-19T18:44:17.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 61225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-19T18:44:17.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-19T18:44:17.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-19T18:44:17.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-19T18:44:17.682 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ 2023-12-19T18:44:17.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-19T18:44:17.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-19T18:44:17.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-19T18:44:17.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-19T18:44:17.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-19T18:44:17.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-19T18:44:17.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-19T18:44:17.682 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-19T18:44:17.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-19T18:44:17.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-19T18:44:17.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-19T18:44:17.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-19T18:44:17.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-19T18:44:17.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-19T18:44:17.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-19T18:44:17.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-19T18:44:17.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-19T18:44:17.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-19T18:44:17.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-19T18:44:17.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-19T18:44:17.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-19T18:44:17.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-19T18:44:17.683 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-19T18:44:17.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-19T18:44:17.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-19T18:44:17.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-19T18:44:17.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-19T18:44:17.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-19T18:44:17.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-19T18:44:17.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-19T18:44:17.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-19T18:44:17.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-19T18:44:17.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-19T18:44:17.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-19T18:44:17.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-19T18:44:17.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-19T18:44:17.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-19T18:44:17.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-19T18:44:17.684 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-19T18:44:17.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-19T18:44:17.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 41665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-19T18:44:17.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-19T18:44:17.685 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ 2023-12-19T18:44:17.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-19T18:44:17.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-19T18:44:17.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-19T18:44:17.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 80897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_gre.ko 2023-12-19T18:44:17.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 93577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-19T18:44:17.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-19T18:44:17.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-19T18:44:17.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-19T18:44:17.685 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/mip6.ko 2023-12-19T18:44:17.685 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ 2023-12-19T18:44:17.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-19T18:44:17.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-19T18:44:17.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-19T18:44:17.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-19T18:44:17.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-19T18:44:17.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-19T18:44:17.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-19T18:44:17.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-19T18:44:17.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-19T18:44:17.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-19T18:44:17.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-19T18:44:17.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-19T18:44:17.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-19T18:44:17.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-19T18:44:17.686 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-19T18:44:17.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-19T18:44:17.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-19T18:44:17.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-19T18:44:17.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-19T18:44:17.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-19T18:44:17.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-19T18:44:17.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-19T18:44:17.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-19T18:44:17.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-19T18:44:17.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-19T18:44:17.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 74073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-19T18:44:17.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-19T18:44:17.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-19T18:44:17.687 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/ 2023-12-19T18:44:17.687 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 82833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-19T18:44:17.687 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/ 2023-12-19T18:44:17.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 125281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-19T18:44:17.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-19T18:44:17.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 25953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-19T18:44:17.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-19T18:44:17.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-19T18:44:17.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-19T18:44:17.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 53241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-19T18:44:17.688 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/ 2023-12-19T18:44:17.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 47977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/lapb.ko 2023-12-19T18:44:17.688 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/ 2023-12-19T18:44:17.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-19T18:44:17.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 267913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc2.ko 2023-12-19T18:44:17.688 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/ 2023-12-19T18:44:17.688 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 290417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-19T18:44:17.688 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/ 2023-12-19T18:44:17.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-19T18:44:17.689 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ 2023-12-19T18:44:17.689 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ 2023-12-19T18:44:17.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 119585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-19T18:44:17.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-19T18:44:17.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-19T18:44:17.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-19T18:44:17.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 100297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-19T18:44:17.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 101441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-19T18:44:17.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 102817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-19T18:44:17.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 103417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-19T18:44:17.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 112849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-19T18:44:17.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 60329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-19T18:44:17.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 109593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-19T18:44:17.689 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 113129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-19T18:44:17.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 112585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-19T18:44:17.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 111585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-19T18:44:17.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 114465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-19T18:44:17.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-19T18:44:17.690 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ 2023-12-19T18:44:17.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 411729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-19T18:44:17.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-19T18:44:17.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-19T18:44:17.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-19T18:44:17.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-19T18:44:17.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-19T18:44:17.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-19T18:44:17.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-19T18:44:17.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-19T18:44:17.690 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-19T18:44:17.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-19T18:44:17.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-19T18:44:17.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-19T18:44:17.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-19T18:44:17.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-19T18:44:17.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 408257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-19T18:44:17.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-19T18:44:17.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-19T18:44:17.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-19T18:44:17.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 118145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-19T18:44:17.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-19T18:44:17.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-19T18:44:17.691 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 107233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-19T18:44:17.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-19T18:44:17.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-19T18:44:17.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-19T18:44:17.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-19T18:44:17.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-19T18:44:17.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-19T18:44:17.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-19T18:44:17.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-19T18:44:17.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 37129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-19T18:44:17.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 95353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-19T18:44:17.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-19T18:44:17.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-19T18:44:17.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-19T18:44:17.692 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-19T18:44:17.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-19T18:44:17.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 44065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-19T18:44:17.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 615649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-19T18:44:17.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 42561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-19T18:44:17.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-19T18:44:17.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-19T18:44:17.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 39785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-19T18:44:17.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-19T18:44:17.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-19T18:44:17.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-19T18:44:17.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-19T18:44:17.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 40721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-19T18:44:17.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-19T18:44:17.693 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-19T18:44:17.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-19T18:44:17.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-19T18:44:17.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-19T18:44:17.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-19T18:44:17.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-19T18:44:17.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-19T18:44:17.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-19T18:44:17.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_osf.ko 2023-12-19T18:44:17.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-19T18:44:17.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-19T18:44:17.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-19T18:44:17.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-19T18:44:17.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-19T18:44:17.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_synproxy.ko 2023-12-19T18:44:17.694 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tproxy.ko 2023-12-19T18:44:17.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 89313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/x_tables.ko 2023-12-19T18:44:17.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-19T18:44:17.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-19T18:44:17.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-19T18:44:17.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-19T18:44:17.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 18169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-19T18:44:17.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-19T18:44:17.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-19T18:44:17.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-19T18:44:17.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-19T18:44:17.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-19T18:44:17.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-19T18:44:17.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-19T18:44:17.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-19T18:44:17.695 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-19T18:44:17.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-19T18:44:17.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-19T18:44:17.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-19T18:44:17.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 14337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-19T18:44:17.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-19T18:44:17.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-19T18:44:17.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-19T18:44:17.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-19T18:44:17.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-19T18:44:17.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-19T18:44:17.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-19T18:44:17.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-19T18:44:17.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-19T18:44:17.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-19T18:44:17.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-19T18:44:17.696 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-19T18:44:17.697 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-19T18:44:17.697 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-19T18:44:17.697 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-19T18:44:17.697 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-19T18:44:17.697 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-19T18:44:17.697 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-19T18:44:17.697 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-19T18:44:17.697 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-19T18:44:17.697 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-19T18:44:17.697 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-19T18:44:17.697 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-19T18:44:17.697 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-19T18:44:17.697 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-19T18:44:17.697 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-19T18:44:17.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-19T18:44:17.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-19T18:44:17.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-19T18:44:17.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-19T18:44:17.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-19T18:44:17.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-19T18:44:17.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-19T18:44:17.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-19T18:44:17.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-19T18:44:17.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-19T18:44:17.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-19T18:44:17.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-19T18:44:17.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-19T18:44:17.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-19T18:44:17.698 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-19T18:44:17.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-19T18:44:17.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-19T18:44:17.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-19T18:44:17.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-19T18:44:17.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-19T18:44:17.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 16089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-19T18:44:17.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-19T18:44:17.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-19T18:44:17.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-19T18:44:17.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 8553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-19T18:44:17.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpudp.ko 2023-12-19T18:44:17.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-19T18:44:17.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-19T18:44:17.699 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/ 2023-12-19T18:44:17.699 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-19T18:44:17.699 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/ 2023-12-19T18:44:17.700 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-19T18:44:17.700 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/ 2023-12-19T18:44:17.700 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 380033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-19T18:44:17.700 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-19T18:44:17.700 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-19T18:44:17.700 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 11793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-19T18:44:17.700 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/ 2023-12-19T18:44:17.700 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-19T18:44:17.700 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/ 2023-12-19T18:44:17.700 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 110201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/phonet.ko 2023-12-19T18:44:17.700 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/pn_pep.ko 2023-12-19T18:44:17.700 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/ 2023-12-19T18:44:17.700 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 251481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-19T18:44:17.700 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 164937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-19T18:44:17.700 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 67377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-19T18:44:17.701 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/ 2023-12-19T18:44:17.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 819657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/rxrpc.ko 2023-12-19T18:44:17.701 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/ 2023-12-19T18:44:17.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-19T18:44:17.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-19T18:44:17.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-19T18:44:17.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-19T18:44:17.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-19T18:44:17.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 43449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-19T18:44:17.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-19T18:44:17.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-19T18:44:17.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-19T18:44:17.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-19T18:44:17.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-19T18:44:17.701 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-19T18:44:17.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_cgroup.ko 2023-12-19T18:44:17.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-19T18:44:17.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-19T18:44:17.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 38425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-19T18:44:17.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 61409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-19T18:44:17.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-19T18:44:17.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 13409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-19T18:44:17.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-19T18:44:17.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-19T18:44:17.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-19T18:44:17.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-19T18:44:17.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 21649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-19T18:44:17.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-19T18:44:17.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 34633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-19T18:44:17.702 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 33609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-19T18:44:17.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq_codel.ko 2023-12-19T18:44:17.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 35433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-19T18:44:17.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-19T18:44:17.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-19T18:44:17.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 66393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-19T18:44:17.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-19T18:44:17.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 30273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-19T18:44:17.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-19T18:44:17.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-19T18:44:17.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 36137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-19T18:44:17.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 27497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-19T18:44:17.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-19T18:44:17.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-19T18:44:17.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 48729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-19T18:44:17.703 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 32905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-19T18:44:17.704 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 26881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-19T18:44:17.704 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 31353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-19T18:44:17.704 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-19T18:44:17.704 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 28105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-19T18:44:17.704 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/ 2023-12-19T18:44:17.704 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 929745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-19T18:44:17.704 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 19033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-19T18:44:17.704 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/ 2023-12-19T18:44:17.704 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/ 2023-12-19T18:44:17.704 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 336529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-19T18:44:17.704 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 54737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-19T18:44:17.704 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 1520097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-19T18:44:17.704 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/ 2023-12-19T18:44:17.704 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 707657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-19T18:44:17.704 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/ 2023-12-19T18:44:17.705 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-19T18:44:17.705 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 862665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-19T18:44:17.705 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/ 2023-12-19T18:44:17.705 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-19T18:44:17.705 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/ 2023-12-19T18:44:17.705 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 85409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-19T18:44:17.705 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 68049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-19T18:44:17.705 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 96193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-19T18:44:17.705 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 10705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-19T18:44:17.705 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 17521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-19T18:44:17.705 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/ 2023-12-19T18:44:17.705 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 125177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/x25.ko 2023-12-19T18:44:17.705 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/ 2023-12-19T18:44:17.705 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 22657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_algo.ko 2023-12-19T18:44:17.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 20649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-19T18:44:17.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 102257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_user.ko 2023-12-19T18:44:17.706 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/ 2023-12-19T18:44:17.706 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/ 2023-12-19T18:44:17.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 15537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-19T18:44:17.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 640081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-19T18:44:17.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 624107 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-19T18:44:17.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 7663 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-19T18:44:17.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 23428 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-19T18:44:17.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 9821 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-19T18:44:17.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 70004 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-19T18:44:17.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 146313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-19T18:44:17.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 232548 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-19T18:44:17.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 210 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-19T18:44:17.706 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 72606 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-19T18:44:17.707 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 879 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-19T18:44:17.707 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 254438 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-19T18:44:17.707 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 309363 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-19T18:44:17.707 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/ 2023-12-19T18:44:17.707 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/ 2023-12-19T18:44:17.707 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/ 2023-12-19T18:44:17.707 INFO:teuthology.orchestra.run.smithi133.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/ 2023-12-19T18:44:17.707 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 170 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/changelog.Debian.gz 2023-12-19T18:44:17.707 INFO:teuthology.orchestra.run.smithi133.stdout:-rw-r--r-- root/root 691 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/copyright 2023-12-19T18:44:17.708 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-19T18:44:17.708 INFO:teuthology.task.kernel:searching for kernel 6.6.0-gcd68252d7b4d 2023-12-19T18:44:17.708 DEBUG:teuthology.orchestra.run.smithi133:> egrep '(submenu|menuentry.*6.6.0-gcd68252d7b4d).*{' /boot/grub/grub.cfg 2023-12-19T18:44:17.721 INFO:teuthology.orchestra.run.smithi133.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-19T18:44:17.722 INFO:teuthology.orchestra.run.smithi133.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-19T18:44:17.722 INFO:teuthology.orchestra.run.smithi133.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-19T18:44:17.722 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-19T18:44:17.722 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-gcd68252d7b4d 2023-12-19T18:44:17.722 DEBUG:teuthology.orchestra.run.smithi133:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-19T18:44:17.769 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi133.front.sepia.ceph.com to complete... 2023-12-19T18:44:18.155 INFO:teuthology.orchestra.run.smithi133.stderr:Sourcing file `/etc/default/grub' 2023-12-19T18:44:18.155 INFO:teuthology.orchestra.run.smithi133.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-19T18:44:18.167 INFO:teuthology.orchestra.run.smithi133.stderr:Generating grub configuration file ... 2023-12-19T18:44:18.365 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T18:44:18.371 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T18:44:18.628 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-19T18:44:18.633 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-19T18:44:18.675 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-19T18:44:18.680 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-19T18:44:18.804 INFO:teuthology.orchestra.run.smithi133.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-19T18:44:18.804 INFO:teuthology.orchestra.run.smithi133.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-19T18:44:18.805 INFO:teuthology.orchestra.run.smithi133.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-19T18:44:18.825 INFO:teuthology.orchestra.run.smithi133.stderr:done 2023-12-19T18:44:45.838 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-12-19T18:44:45.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-12-19T18:44:45.839 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:44:49.953 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-12-19T18:44:49.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-12-19T18:44:49.954 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:45:04.402 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-12-19T18:45:08.497 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-12-19T18:45:13.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-12-19T18:45:13.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:45:16.465 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-12-19T18:45:17.499 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-12-19T18:45:17.500 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:45:20.561 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-12-19T18:45:28.473 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-12-19T18:45:28.474 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:45:32.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-12-19T18:45:32.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:45:46.904 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2023-12-19T18:45:50.993 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-12-19T18:46:01.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-12-19T18:46:01.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:46:02.135 DEBUG:teuthology.orchestra.run.smithi138:> true 2023-12-19T18:46:02.835 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-12-19T18:46:02.835 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-gcd68252d7b4d"... 2023-12-19T18:46:02.835 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2023-12-19T18:46:02.885 INFO:teuthology.orchestra.run.smithi138.stdout:6.6.0-gcd68252d7b4d 2023-12-19T18:46:02.885 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-19T18:46:02.885 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-19T18:46:02.885 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-19T18:46:03.887 DEBUG:teuthology.parallel:result is None 2023-12-19T18:46:05.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-12-19T18:46:05.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:46:06.321 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-12-19T18:46:07.546 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-12-19T18:46:07.546 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-gcd68252d7b4d"... 2023-12-19T18:46:07.546 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2023-12-19T18:46:07.599 INFO:teuthology.orchestra.run.smithi133.stdout:6.6.0-gcd68252d7b4d 2023-12-19T18:46:07.600 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-19T18:46:07.600 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-19T18:46:07.600 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-19T18:46:08.601 DEBUG:teuthology.parallel:result is None 2023-12-19T18:46:08.601 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-19T18:46:08.617 INFO:teuthology.task.internal:Creating test directory... 2023-12-19T18:46:08.618 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-19T18:46:08.621 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-19T18:46:08.631 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-19T18:46:08.638 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-19T18:46:08.664 INFO:teuthology.task.internal:Creating archive directory... 2023-12-19T18:46:08.665 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-19T18:46:08.675 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-19T18:46:08.701 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-19T18:46:08.708 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-19T18:46:08.708 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-19T18:46:08.739 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-19T18:46:08.813 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T18:46:08.830 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T18:46:08.852 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T18:46:08.872 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T18:46:08.875 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-19T18:46:08.881 INFO:teuthology.task.internal:Configuring sudo... 2023-12-19T18:46:08.882 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-19T18:46:08.885 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-19T18:46:08.907 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-19T18:46:08.918 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-19T18:46:08.918 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-19T18:46:08.951 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-19T18:46:08.960 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T18:46:09.008 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T18:46:09.061 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:46:09.061 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-19T18:46:09.140 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T18:46:09.149 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T18:46:09.201 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:46:09.201 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-19T18:46:09.277 DEBUG:teuthology.orchestra.run.smithi133:> sudo service rsyslog restart 2023-12-19T18:46:09.280 DEBUG:teuthology.orchestra.run.smithi138:> sudo service rsyslog restart 2023-12-19T18:46:09.399 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-19T18:46:09.406 INFO:teuthology.task.internal:Starting timer... 2023-12-19T18:46:09.406 INFO:teuthology.run_tasks:Running task pcp... 2023-12-19T18:46:09.426 INFO:teuthology.run_tasks:Running task selinux... 2023-12-19T18:46:09.449 DEBUG:teuthology.task.selinux:Excluding smithi133: OS 'ubuntu' does not support SELinux 2023-12-19T18:46:09.449 DEBUG:teuthology.task.selinux:Excluding smithi138: OS 'ubuntu' does not support SELinux 2023-12-19T18:46:09.450 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-19T18:46:09.450 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-12-19T18:46:09.450 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-19T18:46:09.450 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-19T18:46:09.475 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-19T18:46:09.475 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-19T18:46:09.493 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-19T18:46:09.494 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi133.front.sepia.ceph.com,smithi138.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-19T18:54:49.692 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi133.front.sepia.ceph.com'), Remote(name='ubuntu@smithi138.front.sepia.ceph.com')] 2023-12-19T18:54:49.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-12-19T18:54:49.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:54:49.776 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-12-19T18:54:49.904 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-12-19T18:54:49.905 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-12-19T18:54:49.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T18:54:49.989 DEBUG:teuthology.orchestra.run.smithi138:> true 2023-12-19T18:54:50.120 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2023-12-19T18:54:50.121 INFO:teuthology.run_tasks:Running task clock... 2023-12-19T18:54:50.133 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-19T18:54:50.133 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-19T18:54:50.134 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T18:54:50.138 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-19T18:54:50.138 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T18:54:50.173 INFO:teuthology.orchestra.run.smithi133.stdout:19 Dec 18:54:50 ntpd[27960]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-12-19T18:54:50.173 INFO:teuthology.orchestra.run.smithi133.stdout:19 Dec 18:54:50 ntpd[27960]: Command line: ntpd -gq 2023-12-19T18:54:50.173 INFO:teuthology.orchestra.run.smithi133.stdout:19 Dec 18:54:50 ntpd[27960]: ---------------------------------------------------- 2023-12-19T18:54:50.173 INFO:teuthology.orchestra.run.smithi133.stdout:19 Dec 18:54:50 ntpd[27960]: ntp-4 is maintained by Network Time Foundation, 2023-12-19T18:54:50.174 INFO:teuthology.orchestra.run.smithi133.stdout:19 Dec 18:54:50 ntpd[27960]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-12-19T18:54:50.174 INFO:teuthology.orchestra.run.smithi133.stdout:19 Dec 18:54:50 ntpd[27960]: corporation. Support and training for ntp-4 are 2023-12-19T18:54:50.174 INFO:teuthology.orchestra.run.smithi133.stdout:19 Dec 18:54:50 ntpd[27960]: available at https://www.nwtime.org/support 2023-12-19T18:54:50.174 INFO:teuthology.orchestra.run.smithi133.stdout:19 Dec 18:54:50 ntpd[27960]: ---------------------------------------------------- 2023-12-19T18:54:50.174 INFO:teuthology.orchestra.run.smithi133.stdout:19 Dec 18:54:50 ntpd[27960]: proto: precision = 0.046 usec (-24) 2023-12-19T18:54:50.174 INFO:teuthology.orchestra.run.smithi133.stdout:19 Dec 18:54:50 ntpd[27960]: basedate set to 2022-02-04 2023-12-19T18:54:50.174 INFO:teuthology.orchestra.run.smithi133.stdout:19 Dec 18:54:50 ntpd[27960]: gps base set to 2022-02-06 (week 2196) 2023-12-19T18:54:50.175 INFO:teuthology.orchestra.run.smithi133.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-19T18:54:50.175 INFO:teuthology.orchestra.run.smithi133.stdout:19 Dec 18:54:50 ntpd[27960]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-19T18:54:50.176 INFO:teuthology.orchestra.run.smithi133.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-19T18:54:50.177 INFO:teuthology.orchestra.run.smithi133.stdout:19 Dec 18:54:50 ntpd[27960]: restrict ::: KOD does nothing without LIMITED. 2023-12-19T18:54:50.177 INFO:teuthology.orchestra.run.smithi133.stdout:19 Dec 18:54:50 ntpd[27960]: Listen and drop on 0 v6wildcard [::]:123 2023-12-19T18:54:50.177 INFO:teuthology.orchestra.run.smithi133.stdout:19 Dec 18:54:50 ntpd[27960]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-19T18:54:50.177 INFO:teuthology.orchestra.run.smithi133.stdout:19 Dec 18:54:50 ntpd[27960]: Listen normally on 2 lo 127.0.0.1:123 2023-12-19T18:54:50.177 INFO:teuthology.orchestra.run.smithi133.stdout:19 Dec 18:54:50 ntpd[27960]: Listen normally on 3 enp3s0f1 172.21.15.133:123 2023-12-19T18:54:50.177 INFO:teuthology.orchestra.run.smithi133.stdout:19 Dec 18:54:50 ntpd[27960]: Listen normally on 4 lo [::1]:123 2023-12-19T18:54:50.177 INFO:teuthology.orchestra.run.smithi133.stdout:19 Dec 18:54:50 ntpd[27960]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8087%5]:123 2023-12-19T18:54:50.178 INFO:teuthology.orchestra.run.smithi133.stdout:19 Dec 18:54:50 ntpd[27960]: Listening on routing socket on fd #22 for interface updates 2023-12-19T18:54:50.201 INFO:teuthology.orchestra.run.smithi138.stdout:19 Dec 18:54:50 ntpd[27971]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-12-19T18:54:50.201 INFO:teuthology.orchestra.run.smithi138.stdout:19 Dec 18:54:50 ntpd[27971]: Command line: ntpd -gq 2023-12-19T18:54:50.202 INFO:teuthology.orchestra.run.smithi138.stdout:19 Dec 18:54:50 ntpd[27971]: ---------------------------------------------------- 2023-12-19T18:54:50.202 INFO:teuthology.orchestra.run.smithi138.stdout:19 Dec 18:54:50 ntpd[27971]: ntp-4 is maintained by Network Time Foundation, 2023-12-19T18:54:50.202 INFO:teuthology.orchestra.run.smithi138.stdout:19 Dec 18:54:50 ntpd[27971]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-12-19T18:54:50.202 INFO:teuthology.orchestra.run.smithi138.stdout:19 Dec 18:54:50 ntpd[27971]: corporation. Support and training for ntp-4 are 2023-12-19T18:54:50.202 INFO:teuthology.orchestra.run.smithi138.stdout:19 Dec 18:54:50 ntpd[27971]: available at https://www.nwtime.org/support 2023-12-19T18:54:50.202 INFO:teuthology.orchestra.run.smithi138.stdout:19 Dec 18:54:50 ntpd[27971]: ---------------------------------------------------- 2023-12-19T18:54:50.203 INFO:teuthology.orchestra.run.smithi138.stdout:19 Dec 18:54:50 ntpd[27971]: proto: precision = 0.041 usec (-24) 2023-12-19T18:54:50.203 INFO:teuthology.orchestra.run.smithi138.stdout:19 Dec 18:54:50 ntpd[27971]: basedate set to 2022-02-04 2023-12-19T18:54:50.204 INFO:teuthology.orchestra.run.smithi138.stdout:19 Dec 18:54:50 ntpd[27971]: gps base set to 2022-02-06 (week 2196) 2023-12-19T18:54:50.204 INFO:teuthology.orchestra.run.smithi138.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-19T18:54:50.205 INFO:teuthology.orchestra.run.smithi138.stdout:19 Dec 18:54:50 ntpd[27971]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-19T18:54:50.205 INFO:teuthology.orchestra.run.smithi138.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-19T18:54:50.207 INFO:teuthology.orchestra.run.smithi138.stdout:19 Dec 18:54:50 ntpd[27971]: restrict ::: KOD does nothing without LIMITED. 2023-12-19T18:54:50.207 INFO:teuthology.orchestra.run.smithi138.stdout:19 Dec 18:54:50 ntpd[27971]: Listen and drop on 0 v6wildcard [::]:123 2023-12-19T18:54:50.207 INFO:teuthology.orchestra.run.smithi138.stdout:19 Dec 18:54:50 ntpd[27971]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-19T18:54:50.207 INFO:teuthology.orchestra.run.smithi138.stdout:19 Dec 18:54:50 ntpd[27971]: Listen normally on 2 lo 127.0.0.1:123 2023-12-19T18:54:50.208 INFO:teuthology.orchestra.run.smithi138.stdout:19 Dec 18:54:50 ntpd[27971]: Listen normally on 3 enp3s0f1 172.21.15.138:123 2023-12-19T18:54:50.208 INFO:teuthology.orchestra.run.smithi138.stdout:19 Dec 18:54:50 ntpd[27971]: Listen normally on 4 lo [::1]:123 2023-12-19T18:54:50.208 INFO:teuthology.orchestra.run.smithi138.stdout:19 Dec 18:54:50 ntpd[27971]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f71%5]:123 2023-12-19T18:54:50.209 INFO:teuthology.orchestra.run.smithi138.stdout:19 Dec 18:54:50 ntpd[27971]: Listening on routing socket on fd #22 for interface updates 2023-12-19T18:54:51.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:51 ntpd[27960]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:51.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:51 ntpd[27960]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:51.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:51 ntpd[27960]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:51.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:51 ntpd[27960]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:51.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:51 ntpd[27960]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T18:54:51.175 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:51 ntpd[27960]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T18:54:51.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:51 ntpd[27971]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:51.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:51 ntpd[27971]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:51.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:51 ntpd[27971]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:51.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:51 ntpd[27971]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:51.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:51 ntpd[27971]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T18:54:51.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:51 ntpd[27971]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T18:54:52.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:52 ntpd[27960]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:52.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:52 ntpd[27960]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:52.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:52 ntpd[27960]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:52.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:52 ntpd[27960]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:52.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:52 ntpd[27960]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T18:54:52.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:52 ntpd[27960]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T18:54:53.178 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:53 ntpd[27960]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:53.179 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:53 ntpd[27960]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:53.179 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:53 ntpd[27960]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:53.179 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:53 ntpd[27960]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:53.179 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:53 ntpd[27960]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T18:54:53.179 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:53 ntpd[27960]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T18:54:53.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:53 ntpd[27971]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:53.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:53 ntpd[27971]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:53.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:53 ntpd[27971]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:53.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:53 ntpd[27971]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:53.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:53 ntpd[27971]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:53.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:53 ntpd[27971]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:53.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:53 ntpd[27971]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T18:54:53.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:53 ntpd[27971]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T18:54:53.203 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:53 ntpd[27971]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:53.203 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:53 ntpd[27971]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:53.203 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:53 ntpd[27971]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T18:54:53.203 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:53 ntpd[27971]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T18:54:54.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:54 ntpd[27960]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:54.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:54 ntpd[27960]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:54.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:54 ntpd[27960]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:54.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:54 ntpd[27960]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:54.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:54 ntpd[27960]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T18:54:54.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:54 ntpd[27960]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T18:54:54.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:54 ntpd[27971]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:54.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:54 ntpd[27971]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:54.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:54 ntpd[27971]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:54.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:54 ntpd[27971]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:54.203 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:54 ntpd[27971]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:54.203 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:54 ntpd[27971]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:54.203 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:54 ntpd[27971]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T18:54:54.203 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:54 ntpd[27971]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T18:54:55.175 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:55 ntpd[27960]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:55.175 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:55 ntpd[27960]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:55.175 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:55 ntpd[27960]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:55.175 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:55 ntpd[27960]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:55.175 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:55 ntpd[27960]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:55.175 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:55 ntpd[27960]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:55.175 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:55 ntpd[27960]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:55.175 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:55 ntpd[27960]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:55.175 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:55 ntpd[27960]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T18:54:55.175 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:55 ntpd[27960]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T18:54:55.175 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:55 ntpd[27960]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:55.176 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:55 ntpd[27960]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:55.176 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:55 ntpd[27960]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T18:54:55.176 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:55 ntpd[27960]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T18:54:55.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:55 ntpd[27971]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:55.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:55 ntpd[27971]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:55.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:55 ntpd[27971]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:55.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:55 ntpd[27971]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:55.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:55 ntpd[27971]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:55.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:55 ntpd[27971]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:55.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:55 ntpd[27971]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T18:54:55.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:55 ntpd[27971]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T18:54:55.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:55 ntpd[27971]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:55.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:55 ntpd[27971]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:55.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:55 ntpd[27971]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T18:54:55.203 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:55 ntpd[27971]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T18:54:56.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:56 ntpd[27960]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:56.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:56 ntpd[27960]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:56.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:56 ntpd[27960]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:56.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:56 ntpd[27960]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:56.175 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:56 ntpd[27960]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T18:54:56.175 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:56 ntpd[27960]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T18:54:56.201 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:56 ntpd[27971]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:56.201 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:56 ntpd[27971]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:56.201 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:56 ntpd[27971]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:56.201 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:56 ntpd[27971]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:56.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:56 ntpd[27971]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T18:54:56.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:56 ntpd[27971]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T18:54:57.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:57 ntpd[27960]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:57.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:57 ntpd[27960]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:57.174 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:57 ntpd[27960]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:57.175 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:57 ntpd[27960]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:57.175 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:57 ntpd[27960]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:57.175 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:57 ntpd[27960]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:57.175 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:57 ntpd[27960]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T18:54:57.175 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:57 ntpd[27960]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T18:54:57.175 INFO:teuthology.orchestra.run.smithi133.stdout:19 Dec 18:54:57 ntpd[27960]: ntpd: time slew -0.000950 s 2023-12-19T18:54:57.175 INFO:teuthology.orchestra.run.smithi133.stdout:ntpd: time slew -0.000950s 2023-12-19T18:54:57.176 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:57 ntpd[27960]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-19T18:54:57.176 INFO:teuthology.orchestra.run.smithi133.stderr:19 Dec 18:54:57 ntpd[27960]: can't open /var/log/ntpstats/loopstats.20231219: Permission denied 2023-12-19T18:54:57.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:57 ntpd[27971]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:57.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:57 ntpd[27971]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:57.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:57 ntpd[27971]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:57.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:57 ntpd[27971]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:57.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:57 ntpd[27971]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:57.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:57 ntpd[27971]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:57.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:57 ntpd[27971]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T18:54:57.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:57 ntpd[27971]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T18:54:57.202 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:57 ntpd[27971]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T18:54:57.203 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:57 ntpd[27971]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T18:54:57.203 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:57 ntpd[27971]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T18:54:57.203 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:57 ntpd[27971]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T18:54:57.203 INFO:teuthology.orchestra.run.smithi138.stdout:19 Dec 18:54:57 ntpd[27971]: ntpd: time slew -0.001350 s 2023-12-19T18:54:57.203 INFO:teuthology.orchestra.run.smithi138.stdout:ntpd: time slew -0.001350s 2023-12-19T18:54:57.203 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:57 ntpd[27971]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-19T18:54:57.204 INFO:teuthology.orchestra.run.smithi138.stderr:19 Dec 18:54:57 ntpd[27971]: can't open /var/log/ntpstats/loopstats.20231219: Permission denied 2023-12-19T18:54:57.269 INFO:teuthology.orchestra.run.smithi133.stdout: remote refid st t when poll reach delay offset jitter 2023-12-19T18:54:57.269 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================== 2023-12-19T18:54:57.269 INFO:teuthology.orchestra.run.smithi133.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T18:54:57.269 INFO:teuthology.orchestra.run.smithi133.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T18:54:57.269 INFO:teuthology.orchestra.run.smithi133.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T18:54:57.269 INFO:teuthology.orchestra.run.smithi133.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T18:54:57.316 INFO:teuthology.orchestra.run.smithi138.stdout: remote refid st t when poll reach delay offset jitter 2023-12-19T18:54:57.316 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================== 2023-12-19T18:54:57.316 INFO:teuthology.orchestra.run.smithi138.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T18:54:57.316 INFO:teuthology.orchestra.run.smithi138.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T18:54:57.316 INFO:teuthology.orchestra.run.smithi138.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T18:54:57.316 INFO:teuthology.orchestra.run.smithi138.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T18:54:57.317 INFO:teuthology.run_tasks:Running task install... 2023-12-19T18:54:57.327 DEBUG:teuthology.task.install:project ceph 2023-12-19T18:54:57.327 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9'}} 2023-12-19T18:54:57.327 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9'} 2023-12-19T18:54:57.327 INFO:teuthology.task.install:Using flavor: default 2023-12-19T18:54:57.334 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-19T18:54:57.334 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2023-12-19T18:54:57.334 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-key list | grep Ceph 2023-12-19T18:54:57.335 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-key list | grep Ceph 2023-12-19T18:54:57.440 INFO:teuthology.orchestra.run.smithi133.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-12-19T18:54:57.467 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-12-19T18:54:57.520 INFO:teuthology.orchestra.run.smithi138.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-19T18:54:57.520 INFO:teuthology.orchestra.run.smithi138.stdout:uid [ unknown] Ceph.com (release key) 2023-12-19T18:54:57.521 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-19T18:54:57.521 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-19T18:54:57.521 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-19T18:54:57.573 INFO:teuthology.orchestra.run.smithi133.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-19T18:54:57.573 INFO:teuthology.orchestra.run.smithi133.stdout:uid [ unknown] Ceph.com (release key) 2023-12-19T18:54:57.574 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-19T18:54:57.574 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-19T18:54:57.574 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-19T18:54:57.840 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default/ 2023-12-19T18:54:57.840 INFO:teuthology.task.install.deb:Package version is 19.0.0-202-gc7586e95-1jammy 2023-12-19T18:54:57.864 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default/ 2023-12-19T18:54:57.864 INFO:teuthology.task.install.deb:Package version is 19.0.0-202-gc7586e95-1jammy 2023-12-19T18:54:58.184 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:54:58.184 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-19T18:54:58.205 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2023-12-19T18:54:58.250 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:54:58.250 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-19T18:54:58.273 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get update 2023-12-19T18:54:58.388 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-19T18:54:58.393 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-19T18:54:58.410 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-19T18:54:58.508 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-12-19T18:54:58.596 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-19T18:54:58.666 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-12-19T18:54:58.702 INFO:teuthology.orchestra.run.smithi138.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy InRelease 2023-12-19T18:54:58.778 INFO:teuthology.orchestra.run.smithi133.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy InRelease 2023-12-19T18:54:58.790 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-12-19T18:54:58.862 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-19T18:54:58.866 INFO:teuthology.orchestra.run.smithi133.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-12-19T18:54:58.878 INFO:teuthology.orchestra.run.smithi138.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy Release.gpg 2023-12-19T18:54:58.955 INFO:teuthology.orchestra.run.smithi133.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy Release.gpg 2023-12-19T18:54:58.965 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,390 B] 2023-12-19T18:54:59.022 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-19T18:54:59.043 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,390 B] 2023-12-19T18:54:59.065 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-12-19T18:54:59.145 INFO:teuthology.orchestra.run.smithi133.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-12-19T18:54:59.263 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 139 kB in 1s (166 kB/s) 2023-12-19T18:54:59.342 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 147 kB in 1s (175 kB/s) 2023-12-19T18:55:00.202 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2023-12-19T18:55:00.217 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-202-gc7586e95-1jammy cephadm=19.0.0-202-gc7586e95-1jammy ceph-mds=19.0.0-202-gc7586e95-1jammy ceph-mgr=19.0.0-202-gc7586e95-1jammy ceph-common=19.0.0-202-gc7586e95-1jammy ceph-fuse=19.0.0-202-gc7586e95-1jammy ceph-test=19.0.0-202-gc7586e95-1jammy ceph-volume=19.0.0-202-gc7586e95-1jammy radosgw=19.0.0-202-gc7586e95-1jammy python3-rados=19.0.0-202-gc7586e95-1jammy python3-rgw=19.0.0-202-gc7586e95-1jammy python3-cephfs=19.0.0-202-gc7586e95-1jammy python3-rbd=19.0.0-202-gc7586e95-1jammy libcephfs2=19.0.0-202-gc7586e95-1jammy libcephfs-dev=19.0.0-202-gc7586e95-1jammy librados2=19.0.0-202-gc7586e95-1jammy librbd1=19.0.0-202-gc7586e95-1jammy rbd-fuse=19.0.0-202-gc7586e95-1jammy python3-cephfs=19.0.0-202-gc7586e95-1jammy cephfs-shell=19.0.0-202-gc7586e95-1jammy cephfs-top=19.0.0-202-gc7586e95-1jammy cephfs-mirror=19.0.0-202-gc7586e95-1jammy 2023-12-19T18:55:00.272 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2023-12-19T18:55:00.287 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-202-gc7586e95-1jammy cephadm=19.0.0-202-gc7586e95-1jammy ceph-mds=19.0.0-202-gc7586e95-1jammy ceph-mgr=19.0.0-202-gc7586e95-1jammy ceph-common=19.0.0-202-gc7586e95-1jammy ceph-fuse=19.0.0-202-gc7586e95-1jammy ceph-test=19.0.0-202-gc7586e95-1jammy ceph-volume=19.0.0-202-gc7586e95-1jammy radosgw=19.0.0-202-gc7586e95-1jammy python3-rados=19.0.0-202-gc7586e95-1jammy python3-rgw=19.0.0-202-gc7586e95-1jammy python3-cephfs=19.0.0-202-gc7586e95-1jammy python3-rbd=19.0.0-202-gc7586e95-1jammy libcephfs2=19.0.0-202-gc7586e95-1jammy libcephfs-dev=19.0.0-202-gc7586e95-1jammy librados2=19.0.0-202-gc7586e95-1jammy librbd1=19.0.0-202-gc7586e95-1jammy rbd-fuse=19.0.0-202-gc7586e95-1jammy python3-cephfs=19.0.0-202-gc7586e95-1jammy cephfs-shell=19.0.0-202-gc7586e95-1jammy cephfs-top=19.0.0-202-gc7586e95-1jammy cephfs-mirror=19.0.0-202-gc7586e95-1jammy 2023-12-19T18:55:00.291 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2023-12-19T18:55:00.361 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2023-12-19T18:55:00.465 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2023-12-19T18:55:00.466 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2023-12-19T18:55:00.527 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2023-12-19T18:55:00.528 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2023-12-19T18:55:00.622 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2023-12-19T18:55:00.622 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-19T18:55:00.622 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-19T18:55:00.622 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-19T18:55:00.622 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-19T18:55:00.623 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-19T18:55:00.623 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-19T18:55:00.623 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2023-12-19T18:55:00.623 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-19T18:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-12-19T18:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-12-19T18:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-12-19T18:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-12-19T18:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-12-19T18:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-12-19T18:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-12-19T18:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-12-19T18:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-12-19T18:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-12-19T18:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-12-19T18:55:00.625 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-12-19T18:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-12-19T18:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-19T18:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-12-19T18:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-12-19T18:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-12-19T18:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-12-19T18:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-19T18:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-12-19T18:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-12-19T18:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-12-19T18:55:00.626 INFO:teuthology.orchestra.run.smithi138.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-12-19T18:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2023-12-19T18:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-12-19T18:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-12-19T18:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-12-19T18:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-12-19T18:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-12-19T18:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-12-19T18:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-12-19T18:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout:Recommended packages: 2023-12-19T18:55:00.627 INFO:teuthology.orchestra.run.smithi138.stdout: btrfs-tools 2023-12-19T18:55:00.682 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages were automatically installed and are no longer required: 2023-12-19T18:55:00.682 INFO:teuthology.orchestra.run.smithi133.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-19T18:55:00.682 INFO:teuthology.orchestra.run.smithi133.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-19T18:55:00.682 INFO:teuthology.orchestra.run.smithi133.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-19T18:55:00.682 INFO:teuthology.orchestra.run.smithi133.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-19T18:55:00.683 INFO:teuthology.orchestra.run.smithi133.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-19T18:55:00.683 INFO:teuthology.orchestra.run.smithi133.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-19T18:55:00.684 INFO:teuthology.orchestra.run.smithi133.stdout:The following additional packages will be installed: 2023-12-19T18:55:00.684 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-19T18:55:00.684 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-12-19T18:55:00.684 INFO:teuthology.orchestra.run.smithi133.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-12-19T18:55:00.684 INFO:teuthology.orchestra.run.smithi133.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-12-19T18:55:00.684 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-12-19T18:55:00.685 INFO:teuthology.orchestra.run.smithi133.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-12-19T18:55:00.685 INFO:teuthology.orchestra.run.smithi133.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-12-19T18:55:00.686 INFO:teuthology.orchestra.run.smithi133.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-12-19T18:55:00.686 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-12-19T18:55:00.686 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-12-19T18:55:00.686 INFO:teuthology.orchestra.run.smithi133.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-12-19T18:55:00.686 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-12-19T18:55:00.686 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-12-19T18:55:00.686 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-12-19T18:55:00.686 INFO:teuthology.orchestra.run.smithi133.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-19T18:55:00.686 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-12-19T18:55:00.686 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-12-19T18:55:00.686 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-12-19T18:55:00.686 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-12-19T18:55:00.686 INFO:teuthology.orchestra.run.smithi133.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-19T18:55:00.686 INFO:teuthology.orchestra.run.smithi133.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-12-19T18:55:00.686 INFO:teuthology.orchestra.run.smithi133.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-12-19T18:55:00.687 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-12-19T18:55:00.687 INFO:teuthology.orchestra.run.smithi133.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-12-19T18:55:00.687 INFO:teuthology.orchestra.run.smithi133.stdout:Suggested packages: 2023-12-19T18:55:00.687 INFO:teuthology.orchestra.run.smithi133.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-12-19T18:55:00.687 INFO:teuthology.orchestra.run.smithi133.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-12-19T18:55:00.687 INFO:teuthology.orchestra.run.smithi133.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-12-19T18:55:00.687 INFO:teuthology.orchestra.run.smithi133.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-12-19T18:55:00.687 INFO:teuthology.orchestra.run.smithi133.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-12-19T18:55:00.687 INFO:teuthology.orchestra.run.smithi133.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-12-19T18:55:00.687 INFO:teuthology.orchestra.run.smithi133.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-12-19T18:55:00.687 INFO:teuthology.orchestra.run.smithi133.stdout:Recommended packages: 2023-12-19T18:55:00.687 INFO:teuthology.orchestra.run.smithi133.stdout: btrfs-tools 2023-12-19T18:55:00.774 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2023-12-19T18:55:00.774 INFO:teuthology.orchestra.run.smithi138.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-19T18:55:00.774 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-19T18:55:00.774 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-19T18:55:00.775 INFO:teuthology.orchestra.run.smithi138.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-12-19T18:55:00.775 INFO:teuthology.orchestra.run.smithi138.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-12-19T18:55:00.775 INFO:teuthology.orchestra.run.smithi138.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-12-19T18:55:00.775 INFO:teuthology.orchestra.run.smithi138.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-12-19T18:55:00.775 INFO:teuthology.orchestra.run.smithi138.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-12-19T18:55:00.775 INFO:teuthology.orchestra.run.smithi138.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-12-19T18:55:00.775 INFO:teuthology.orchestra.run.smithi138.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-12-19T18:55:00.775 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-12-19T18:55:00.775 INFO:teuthology.orchestra.run.smithi138.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-12-19T18:55:00.775 INFO:teuthology.orchestra.run.smithi138.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-12-19T18:55:00.775 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-12-19T18:55:00.775 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-12-19T18:55:00.775 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-12-19T18:55:00.775 INFO:teuthology.orchestra.run.smithi138.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-12-19T18:55:00.775 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-12-19T18:55:00.776 INFO:teuthology.orchestra.run.smithi138.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-12-19T18:55:00.776 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-12-19T18:55:00.776 INFO:teuthology.orchestra.run.smithi138.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-12-19T18:55:00.776 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-19T18:55:00.776 INFO:teuthology.orchestra.run.smithi138.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-19T18:55:00.776 INFO:teuthology.orchestra.run.smithi138.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-12-19T18:55:00.776 INFO:teuthology.orchestra.run.smithi138.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-12-19T18:55:00.776 INFO:teuthology.orchestra.run.smithi138.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-12-19T18:55:00.776 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-12-19T18:55:00.776 INFO:teuthology.orchestra.run.smithi138.stdout: socat unzip xmlstarlet zip 2023-12-19T18:55:00.832 INFO:teuthology.orchestra.run.smithi133.stdout:The following NEW packages will be installed: 2023-12-19T18:55:00.832 INFO:teuthology.orchestra.run.smithi133.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-19T18:55:00.833 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-19T18:55:00.833 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-19T18:55:00.834 INFO:teuthology.orchestra.run.smithi133.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-12-19T18:55:00.834 INFO:teuthology.orchestra.run.smithi133.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-12-19T18:55:00.835 INFO:teuthology.orchestra.run.smithi133.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-12-19T18:55:00.835 INFO:teuthology.orchestra.run.smithi133.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-12-19T18:55:00.835 INFO:teuthology.orchestra.run.smithi133.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-12-19T18:55:00.835 INFO:teuthology.orchestra.run.smithi133.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-12-19T18:55:00.835 INFO:teuthology.orchestra.run.smithi133.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-12-19T18:55:00.835 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-12-19T18:55:00.835 INFO:teuthology.orchestra.run.smithi133.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-12-19T18:55:00.835 INFO:teuthology.orchestra.run.smithi133.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-12-19T18:55:00.835 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-12-19T18:55:00.835 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-12-19T18:55:00.835 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-12-19T18:55:00.835 INFO:teuthology.orchestra.run.smithi133.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-12-19T18:55:00.835 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-12-19T18:55:00.835 INFO:teuthology.orchestra.run.smithi133.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-12-19T18:55:00.835 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-12-19T18:55:00.835 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-12-19T18:55:00.836 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-19T18:55:00.836 INFO:teuthology.orchestra.run.smithi133.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-19T18:55:00.836 INFO:teuthology.orchestra.run.smithi133.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-12-19T18:55:00.836 INFO:teuthology.orchestra.run.smithi133.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-12-19T18:55:00.836 INFO:teuthology.orchestra.run.smithi133.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-12-19T18:55:00.836 INFO:teuthology.orchestra.run.smithi133.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-12-19T18:55:00.836 INFO:teuthology.orchestra.run.smithi133.stdout: socat unzip xmlstarlet zip 2023-12-19T18:55:00.902 INFO:teuthology.orchestra.run.smithi133.stdout:0 upgraded, 124 newly installed, 0 to remove and 268 not upgraded. 2023-12-19T18:55:00.902 INFO:teuthology.orchestra.run.smithi133.stdout:Need to get 187 MB of archives. 2023-12-19T18:55:00.903 INFO:teuthology.orchestra.run.smithi133.stdout:After this operation, 835 MB of additional disk space will be used. 2023-12-19T18:55:00.903 INFO:teuthology.orchestra.run.smithi133.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-12-19T18:55:00.920 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-12-19T18:55:00.930 INFO:teuthology.orchestra.run.smithi133.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-12-19T18:55:00.970 INFO:teuthology.orchestra.run.smithi138.stdout:0 upgraded, 124 newly installed, 0 to remove and 268 not upgraded. 2023-12-19T18:55:00.971 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 187 MB of archives. 2023-12-19T18:55:00.971 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 835 MB of additional disk space will be used. 2023-12-19T18:55:00.971 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-12-19T18:55:00.971 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-12-19T18:55:00.993 INFO:teuthology.orchestra.run.smithi133.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-12-19T18:55:00.994 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-12-19T18:55:01.006 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-12-19T18:55:01.044 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-12-19T18:55:01.046 INFO:teuthology.orchestra.run.smithi133.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-12-19T18:55:01.053 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-12-19T18:55:01.053 INFO:teuthology.orchestra.run.smithi133.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-12-19T18:55:01.056 INFO:teuthology.orchestra.run.smithi133.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-12-19T18:55:01.057 INFO:teuthology.orchestra.run.smithi133.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-12-19T18:55:01.063 INFO:teuthology.orchestra.run.smithi133.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-12-19T18:55:01.064 INFO:teuthology.orchestra.run.smithi133.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-12-19T18:55:01.066 INFO:teuthology.orchestra.run.smithi133.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-12-19T18:55:01.068 INFO:teuthology.orchestra.run.smithi133.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-12-19T18:55:01.068 INFO:teuthology.orchestra.run.smithi133.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-12-19T18:55:01.079 INFO:teuthology.orchestra.run.smithi133.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-12-19T18:55:01.081 INFO:teuthology.orchestra.run.smithi133.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-12-19T18:55:01.083 INFO:teuthology.orchestra.run.smithi133.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-12-19T18:55:01.083 INFO:teuthology.orchestra.run.smithi133.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-12-19T18:55:01.096 INFO:teuthology.orchestra.run.smithi133.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-12-19T18:55:01.096 INFO:teuthology.orchestra.run.smithi133.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-12-19T18:55:01.097 INFO:teuthology.orchestra.run.smithi133.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-12-19T18:55:01.098 INFO:teuthology.orchestra.run.smithi133.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-12-19T18:55:01.098 INFO:teuthology.orchestra.run.smithi133.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-12-19T18:55:01.098 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-12-19T18:55:01.099 INFO:teuthology.orchestra.run.smithi133.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-12-19T18:55:01.112 INFO:teuthology.orchestra.run.smithi133.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-12-19T18:55:01.113 INFO:teuthology.orchestra.run.smithi133.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-12-19T18:55:01.114 INFO:teuthology.orchestra.run.smithi133.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-12-19T18:55:01.116 INFO:teuthology.orchestra.run.smithi133.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-12-19T18:55:01.129 INFO:teuthology.orchestra.run.smithi133.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-12-19T18:55:01.129 INFO:teuthology.orchestra.run.smithi133.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-12-19T18:55:01.130 INFO:teuthology.orchestra.run.smithi133.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-19T18:55:01.130 INFO:teuthology.orchestra.run.smithi133.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-12-19T18:55:01.131 INFO:teuthology.orchestra.run.smithi133.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-12-19T18:55:01.132 INFO:teuthology.orchestra.run.smithi133.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-12-19T18:55:01.147 INFO:teuthology.orchestra.run.smithi133.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-12-19T18:55:01.147 INFO:teuthology.orchestra.run.smithi133.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-12-19T18:55:01.151 INFO:teuthology.orchestra.run.smithi133.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-12-19T18:55:01.151 INFO:teuthology.orchestra.run.smithi133.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-12-19T18:55:01.165 INFO:teuthology.orchestra.run.smithi133.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-12-19T18:55:01.165 INFO:teuthology.orchestra.run.smithi133.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-12-19T18:55:01.165 INFO:teuthology.orchestra.run.smithi133.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-12-19T18:55:01.166 INFO:teuthology.orchestra.run.smithi133.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-12-19T18:55:01.167 INFO:teuthology.orchestra.run.smithi133.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-12-19T18:55:01.168 INFO:teuthology.orchestra.run.smithi133.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-12-19T18:55:01.179 INFO:teuthology.orchestra.run.smithi133.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-12-19T18:55:01.181 INFO:teuthology.orchestra.run.smithi133.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-12-19T18:55:01.182 INFO:teuthology.orchestra.run.smithi133.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-12-19T18:55:01.182 INFO:teuthology.orchestra.run.smithi133.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-12-19T18:55:01.196 INFO:teuthology.orchestra.run.smithi133.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-12-19T18:55:01.240 INFO:teuthology.orchestra.run.smithi133.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-12-19T18:55:01.241 INFO:teuthology.orchestra.run.smithi133.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-12-19T18:55:01.242 INFO:teuthology.orchestra.run.smithi133.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-19T18:55:01.242 INFO:teuthology.orchestra.run.smithi133.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-12-19T18:55:01.243 INFO:teuthology.orchestra.run.smithi133.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-12-19T18:55:01.262 INFO:teuthology.orchestra.run.smithi133.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-12-19T18:55:01.264 INFO:teuthology.orchestra.run.smithi133.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-12-19T18:55:01.264 INFO:teuthology.orchestra.run.smithi133.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-12-19T18:55:01.282 INFO:teuthology.orchestra.run.smithi133.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-12-19T18:55:01.282 INFO:teuthology.orchestra.run.smithi133.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-12-19T18:55:01.283 INFO:teuthology.orchestra.run.smithi133.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-12-19T18:55:01.284 INFO:teuthology.orchestra.run.smithi133.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-12-19T18:55:01.284 INFO:teuthology.orchestra.run.smithi133.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-12-19T18:55:01.285 INFO:teuthology.orchestra.run.smithi133.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-12-19T18:55:01.291 INFO:teuthology.orchestra.run.smithi133.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-12-19T18:55:01.292 INFO:teuthology.orchestra.run.smithi133.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-12-19T18:55:01.295 INFO:teuthology.orchestra.run.smithi133.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-12-19T18:55:01.300 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-12-19T18:55:01.308 INFO:teuthology.orchestra.run.smithi133.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-12-19T18:55:01.310 INFO:teuthology.orchestra.run.smithi133.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-12-19T18:55:01.310 INFO:teuthology.orchestra.run.smithi133.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-12-19T18:55:01.314 INFO:teuthology.orchestra.run.smithi133.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-12-19T18:55:01.317 INFO:teuthology.orchestra.run.smithi133.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-12-19T18:55:01.317 INFO:teuthology.orchestra.run.smithi133.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-12-19T18:55:01.318 INFO:teuthology.orchestra.run.smithi133.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-12-19T18:55:01.325 INFO:teuthology.orchestra.run.smithi133.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-12-19T18:55:01.329 INFO:teuthology.orchestra.run.smithi133.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-12-19T18:55:01.330 INFO:teuthology.orchestra.run.smithi133.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-12-19T18:55:01.334 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-202-gc7586e95-1jammy [3,460 kB] 2023-12-19T18:55:01.342 INFO:teuthology.orchestra.run.smithi133.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-12-19T18:55:01.342 INFO:teuthology.orchestra.run.smithi133.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-19T18:55:01.343 INFO:teuthology.orchestra.run.smithi133.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-12-19T18:55:01.343 INFO:teuthology.orchestra.run.smithi133.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-12-19T18:55:01.345 INFO:teuthology.orchestra.run.smithi133.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-12-19T18:55:01.346 INFO:teuthology.orchestra.run.smithi133.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-12-19T18:55:01.353 INFO:teuthology.orchestra.run.smithi133.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-12-19T18:55:01.358 INFO:teuthology.orchestra.run.smithi133.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-12-19T18:55:01.359 INFO:teuthology.orchestra.run.smithi133.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-12-19T18:55:01.361 INFO:teuthology.orchestra.run.smithi133.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-12-19T18:55:01.375 INFO:teuthology.orchestra.run.smithi133.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-12-19T18:55:01.390 INFO:teuthology.orchestra.run.smithi133.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-202-gc7586e95-1jammy [3,460 kB] 2023-12-19T18:55:01.394 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-12-19T18:55:01.407 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-12-19T18:55:01.459 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-12-19T18:55:01.633 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-12-19T18:55:01.642 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-12-19T18:55:01.669 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-12-19T18:55:01.678 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-12-19T18:55:01.842 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-12-19T18:55:02.425 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-12-19T18:55:02.440 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-12-19T18:55:02.456 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-12-19T18:55:02.465 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-12-19T18:55:02.465 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-12-19T18:55:02.482 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-12-19T18:55:02.519 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-12-19T18:55:02.532 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-12-19T18:55:02.536 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-12-19T18:55:02.537 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-12-19T18:55:02.817 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-12-19T18:55:02.884 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-202-gc7586e95-1jammy [3,109 kB] 2023-12-19T18:55:02.899 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-12-19T18:55:02.921 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-12-19T18:55:02.980 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-12-19T18:55:03.024 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-12-19T18:55:03.044 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-12-19T18:55:03.066 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-12-19T18:55:03.116 INFO:teuthology.orchestra.run.smithi133.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-202-gc7586e95-1jammy [3,109 kB] 2023-12-19T18:55:03.237 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-12-19T18:55:03.253 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-12-19T18:55:03.259 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-12-19T18:55:03.264 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-12-19T18:55:03.449 INFO:teuthology.orchestra.run.smithi138.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-19T18:55:03.531 INFO:teuthology.orchestra.run.smithi138.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-12-19T18:55:03.540 INFO:teuthology.orchestra.run.smithi138.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-202-gc7586e95-1jammy [690 kB] 2023-12-19T18:55:03.545 INFO:teuthology.orchestra.run.smithi138.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-12-19T18:55:03.697 INFO:teuthology.orchestra.run.smithi138.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-202-gc7586e95-1jammy [356 kB] 2023-12-19T18:55:03.721 INFO:teuthology.orchestra.run.smithi138.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-12-19T18:55:03.770 INFO:teuthology.orchestra.run.smithi138.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-12-19T18:55:03.776 INFO:teuthology.orchestra.run.smithi138.stdout:Get:43 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-202-gc7586e95-1jammy [32.8 kB] 2023-12-19T18:55:03.778 INFO:teuthology.orchestra.run.smithi138.stdout:Get:44 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-202-gc7586e95-1jammy [180 kB] 2023-12-19T18:55:03.783 INFO:teuthology.orchestra.run.smithi138.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-12-19T18:55:03.783 INFO:teuthology.orchestra.run.smithi138.stdout:Get:46 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-202-gc7586e95-1jammy [64.0 kB] 2023-12-19T18:55:03.784 INFO:teuthology.orchestra.run.smithi138.stdout:Get:47 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-202-gc7586e95-1jammy [330 kB] 2023-12-19T18:55:03.856 INFO:teuthology.orchestra.run.smithi133.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-202-gc7586e95-1jammy [690 kB] 2023-12-19T18:55:03.862 INFO:teuthology.orchestra.run.smithi138.stdout:Get:48 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-202-gc7586e95-1jammy [6,213 kB] 2023-12-19T18:55:03.941 INFO:teuthology.orchestra.run.smithi138.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-12-19T18:55:03.941 INFO:teuthology.orchestra.run.smithi138.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-12-19T18:55:03.946 INFO:teuthology.orchestra.run.smithi138.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-12-19T18:55:03.951 INFO:teuthology.orchestra.run.smithi138.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-12-19T18:55:03.966 INFO:teuthology.orchestra.run.smithi138.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-12-19T18:55:04.019 INFO:teuthology.orchestra.run.smithi133.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-202-gc7586e95-1jammy [356 kB] 2023-12-19T18:55:04.025 INFO:teuthology.orchestra.run.smithi133.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-202-gc7586e95-1jammy [32.8 kB] 2023-12-19T18:55:04.027 INFO:teuthology.orchestra.run.smithi133.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-202-gc7586e95-1jammy [180 kB] 2023-12-19T18:55:04.106 INFO:teuthology.orchestra.run.smithi133.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-202-gc7586e95-1jammy [64.0 kB] 2023-12-19T18:55:04.107 INFO:teuthology.orchestra.run.smithi133.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-202-gc7586e95-1jammy [330 kB] 2023-12-19T18:55:04.151 INFO:teuthology.orchestra.run.smithi138.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-12-19T18:55:04.189 INFO:teuthology.orchestra.run.smithi133.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-202-gc7586e95-1jammy [6,213 kB] 2023-12-19T18:55:04.405 INFO:teuthology.orchestra.run.smithi138.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-12-19T18:55:04.538 INFO:teuthology.orchestra.run.smithi138.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-12-19T18:55:04.582 INFO:teuthology.orchestra.run.smithi138.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-12-19T18:55:04.647 INFO:teuthology.orchestra.run.smithi138.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-202-gc7586e95-1jammy [112 kB] 2023-12-19T18:55:04.650 INFO:teuthology.orchestra.run.smithi138.stdout:Get:59 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-202-gc7586e95-1jammy [439 kB] 2023-12-19T18:55:04.673 INFO:teuthology.orchestra.run.smithi138.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-12-19T18:55:04.682 INFO:teuthology.orchestra.run.smithi138.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-12-19T18:55:04.695 INFO:teuthology.orchestra.run.smithi138.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-12-19T18:55:04.722 INFO:teuthology.orchestra.run.smithi138.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-202-gc7586e95-1jammy [22.7 MB] 2023-12-19T18:55:04.738 INFO:teuthology.orchestra.run.smithi138.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-12-19T18:55:04.976 INFO:teuthology.orchestra.run.smithi133.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-202-gc7586e95-1jammy [112 kB] 2023-12-19T18:55:05.001 INFO:teuthology.orchestra.run.smithi138.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-12-19T18:55:05.002 INFO:teuthology.orchestra.run.smithi138.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-12-19T18:55:05.004 INFO:teuthology.orchestra.run.smithi138.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-19T18:55:05.047 INFO:teuthology.orchestra.run.smithi133.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-202-gc7586e95-1jammy [439 kB] 2023-12-19T18:55:05.053 INFO:teuthology.orchestra.run.smithi133.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-202-gc7586e95-1jammy [22.7 MB] 2023-12-19T18:55:05.168 INFO:teuthology.orchestra.run.smithi138.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-12-19T18:55:05.515 INFO:teuthology.orchestra.run.smithi138.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-12-19T18:55:05.919 INFO:teuthology.orchestra.run.smithi138.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-12-19T18:55:05.928 INFO:teuthology.orchestra.run.smithi138.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-12-19T18:55:05.929 INFO:teuthology.orchestra.run.smithi138.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-12-19T18:55:05.999 INFO:teuthology.orchestra.run.smithi138.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-12-19T18:55:05.999 INFO:teuthology.orchestra.run.smithi138.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-12-19T18:55:06.000 INFO:teuthology.orchestra.run.smithi138.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-12-19T18:55:06.001 INFO:teuthology.orchestra.run.smithi138.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-12-19T18:55:06.001 INFO:teuthology.orchestra.run.smithi138.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-12-19T18:55:06.002 INFO:teuthology.orchestra.run.smithi138.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-12-19T18:55:06.166 INFO:teuthology.orchestra.run.smithi138.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-12-19T18:55:06.369 INFO:teuthology.orchestra.run.smithi138.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-12-19T18:55:06.418 INFO:teuthology.orchestra.run.smithi138.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-202-gc7586e95-1jammy [6,899 kB] 2023-12-19T18:55:06.691 INFO:teuthology.orchestra.run.smithi138.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-12-19T18:55:06.737 INFO:teuthology.orchestra.run.smithi138.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-12-19T18:55:06.761 INFO:teuthology.orchestra.run.smithi138.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-202-gc7586e95-1jammy [238 kB] 2023-12-19T18:55:06.765 INFO:teuthology.orchestra.run.smithi138.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-12-19T18:55:06.774 INFO:teuthology.orchestra.run.smithi138.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-12-19T18:55:06.794 INFO:teuthology.orchestra.run.smithi138.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-202-gc7586e95-1jammy [124 kB] 2023-12-19T18:55:06.797 INFO:teuthology.orchestra.run.smithi133.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-202-gc7586e95-1jammy [6,899 kB] 2023-12-19T18:55:06.807 INFO:teuthology.orchestra.run.smithi138.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-202-gc7586e95-1jammy [1,493 kB] 2023-12-19T18:55:06.819 INFO:teuthology.orchestra.run.smithi138.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-12-19T18:55:06.845 INFO:teuthology.orchestra.run.smithi138.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-12-19T18:55:06.846 INFO:teuthology.orchestra.run.smithi138.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-12-19T18:55:06.853 INFO:teuthology.orchestra.run.smithi138.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-12-19T18:55:06.856 INFO:teuthology.orchestra.run.smithi138.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-12-19T18:55:06.903 INFO:teuthology.orchestra.run.smithi138.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-202-gc7586e95-1jammy [9,959 kB] 2023-12-19T18:55:07.053 INFO:teuthology.orchestra.run.smithi138.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-12-19T18:55:07.306 INFO:teuthology.orchestra.run.smithi138.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-12-19T18:55:07.330 INFO:teuthology.orchestra.run.smithi133.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-202-gc7586e95-1jammy [238 kB] 2023-12-19T18:55:07.332 INFO:teuthology.orchestra.run.smithi133.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-202-gc7586e95-1jammy [124 kB] 2023-12-19T18:55:07.334 INFO:teuthology.orchestra.run.smithi133.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-202-gc7586e95-1jammy [1,493 kB] 2023-12-19T18:55:07.439 INFO:teuthology.orchestra.run.smithi133.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-202-gc7586e95-1jammy [9,959 kB] 2023-12-19T18:55:07.492 INFO:teuthology.orchestra.run.smithi138.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-202-gc7586e95-1jammy [31.9 MB] 2023-12-19T18:55:07.574 INFO:teuthology.orchestra.run.smithi138.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-12-19T18:55:07.576 INFO:teuthology.orchestra.run.smithi138.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-19T18:55:07.592 INFO:teuthology.orchestra.run.smithi138.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-12-19T18:55:07.597 INFO:teuthology.orchestra.run.smithi138.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-12-19T18:55:07.637 INFO:teuthology.orchestra.run.smithi138.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-12-19T18:55:07.652 INFO:teuthology.orchestra.run.smithi138.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-12-19T18:55:07.742 INFO:teuthology.orchestra.run.smithi138.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-12-19T18:55:07.744 INFO:teuthology.orchestra.run.smithi138.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-12-19T18:55:07.745 INFO:teuthology.orchestra.run.smithi138.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-12-19T18:55:07.925 INFO:teuthology.orchestra.run.smithi138.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-12-19T18:55:08.187 INFO:teuthology.orchestra.run.smithi133.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-202-gc7586e95-1jammy [31.9 MB] 2023-12-19T18:55:08.187 INFO:teuthology.orchestra.run.smithi138.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-12-19T18:55:09.430 INFO:teuthology.orchestra.run.smithi138.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-202-gc7586e95-1jammy [14.1 kB] 2023-12-19T18:55:09.430 INFO:teuthology.orchestra.run.smithi138.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-202-gc7586e95-1jammy [839 kB] 2023-12-19T18:55:09.481 INFO:teuthology.orchestra.run.smithi138.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-202-gc7586e95-1jammy [2,145 kB] 2023-12-19T18:55:09.619 INFO:teuthology.orchestra.run.smithi138.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-202-gc7586e95-1jammy [833 kB] 2023-12-19T18:55:09.653 INFO:teuthology.orchestra.run.smithi138.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-202-gc7586e95-1jammy [139 kB] 2023-12-19T18:55:09.671 INFO:teuthology.orchestra.run.smithi138.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-202-gc7586e95-1jammy [1,905 kB] 2023-12-19T18:55:09.784 INFO:teuthology.orchestra.run.smithi138.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-202-gc7586e95-1jammy [8,625 kB] 2023-12-19T18:55:10.316 INFO:teuthology.orchestra.run.smithi138.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-202-gc7586e95-1jammy [14.2 kB] 2023-12-19T18:55:10.316 INFO:teuthology.orchestra.run.smithi138.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-202-gc7586e95-1jammy [48.6 MB] 2023-12-19T18:55:10.476 INFO:teuthology.orchestra.run.smithi133.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-202-gc7586e95-1jammy [14.1 kB] 2023-12-19T18:55:10.476 INFO:teuthology.orchestra.run.smithi133.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-202-gc7586e95-1jammy [839 kB] 2023-12-19T18:55:10.532 INFO:teuthology.orchestra.run.smithi133.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-202-gc7586e95-1jammy [2,145 kB] 2023-12-19T18:55:10.689 INFO:teuthology.orchestra.run.smithi133.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-202-gc7586e95-1jammy [833 kB] 2023-12-19T18:55:10.757 INFO:teuthology.orchestra.run.smithi133.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-202-gc7586e95-1jammy [139 kB] 2023-12-19T18:55:10.761 INFO:teuthology.orchestra.run.smithi133.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-202-gc7586e95-1jammy [1,905 kB] 2023-12-19T18:55:10.910 INFO:teuthology.orchestra.run.smithi133.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-202-gc7586e95-1jammy [8,625 kB] 2023-12-19T18:55:11.547 INFO:teuthology.orchestra.run.smithi133.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-202-gc7586e95-1jammy [14.2 kB] 2023-12-19T18:55:11.547 INFO:teuthology.orchestra.run.smithi133.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-202-gc7586e95-1jammy [48.6 MB] 2023-12-19T18:55:13.317 INFO:teuthology.orchestra.run.smithi138.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-202-gc7586e95-1jammy [121 kB] 2023-12-19T18:55:13.318 INFO:teuthology.orchestra.run.smithi138.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-202-gc7586e95-1jammy [225 kB] 2023-12-19T18:55:13.320 INFO:teuthology.orchestra.run.smithi138.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-202-gc7586e95-1jammy [34.0 kB] 2023-12-19T18:55:13.320 INFO:teuthology.orchestra.run.smithi138.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-202-gc7586e95-1jammy [23.4 kB] 2023-12-19T18:55:13.321 INFO:teuthology.orchestra.run.smithi138.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-202-gc7586e95-1jammy [38.3 kB] 2023-12-19T18:55:13.321 INFO:teuthology.orchestra.run.smithi138.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-202-gc7586e95-1jammy [12.3 MB] 2023-12-19T18:55:14.212 INFO:teuthology.orchestra.run.smithi138.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-202-gc7586e95-1jammy [91.4 kB] 2023-12-19T18:55:14.855 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 187 MB in 13s (13.9 MB/s) 2023-12-19T18:55:14.929 INFO:teuthology.orchestra.run.smithi133.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-202-gc7586e95-1jammy [121 kB] 2023-12-19T18:55:14.930 INFO:teuthology.orchestra.run.smithi133.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-202-gc7586e95-1jammy [225 kB] 2023-12-19T18:55:14.932 INFO:teuthology.orchestra.run.smithi133.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-202-gc7586e95-1jammy [34.0 kB] 2023-12-19T18:55:14.933 INFO:teuthology.orchestra.run.smithi133.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-202-gc7586e95-1jammy [23.4 kB] 2023-12-19T18:55:14.933 INFO:teuthology.orchestra.run.smithi133.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-202-gc7586e95-1jammy [38.3 kB] 2023-12-19T18:55:14.933 INFO:teuthology.orchestra.run.smithi133.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-202-gc7586e95-1jammy [12.3 MB] 2023-12-19T18:55:15.002 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-19T18:55:15.071 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-12-19T18:55:15.075 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-12-19T18:55:15.126 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-12-19T18:55:15.437 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-19T18:55:15.450 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-12-19T18:55:15.495 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-19T18:55:15.545 INFO:teuthology.orchestra.run.smithi133.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-yuri8-testing-2023-12-15-0911/c7586e95519b7be76f3b6e3a4b333888baf46bc9/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-202-gc7586e95-1jammy [91.4 kB] 2023-12-19T18:55:15.781 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cmd2. 2023-12-19T18:55:15.795 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-12-19T18:55:15.839 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-12-19T18:55:16.176 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-12-19T18:55:16.190 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-12-19T18:55:16.197 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 187 MB in 15s (12.7 MB/s) 2023-12-19T18:55:16.268 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-19T18:55:16.376 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-19T18:55:16.446 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-12-19T18:55:16.449 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-12-19T18:55:16.500 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-12-19T18:55:16.605 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-19T18:55:16.619 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-12-19T18:55:16.663 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-19T18:55:16.869 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-19T18:55:16.883 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-12-19T18:55:16.936 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-19T18:55:16.991 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-19T18:55:17.006 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-12-19T18:55:17.049 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-19T18:55:17.355 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cmd2. 2023-12-19T18:55:17.369 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-12-19T18:55:17.414 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-12-19T18:55:17.511 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-19T18:55:17.526 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-19T18:55:17.569 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T18:55:17.800 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-12-19T18:55:17.813 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-12-19T18:55:17.900 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-19T18:55:18.189 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-19T18:55:18.204 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-19T18:55:18.247 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T18:55:18.312 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-19T18:55:18.326 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-12-19T18:55:18.379 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-19T18:55:18.617 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-19T18:55:18.632 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-19T18:55:18.675 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T18:55:18.806 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-19T18:55:18.820 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-12-19T18:55:18.873 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-19T18:55:18.995 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-12-19T18:55:19.010 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-12-19T18:55:19.045 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-19T18:55:19.340 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librados2. 2023-12-19T18:55:19.354 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../010-librados2_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:19.393 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-19T18:55:19.397 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librados2 (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:19.407 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-19T18:55:19.459 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T18:55:19.850 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librbd1. 2023-12-19T18:55:19.865 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../011-librbd1_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:19.905 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-19T18:55:19.908 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librbd1 (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:19.918 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-19T18:55:19.979 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T18:55:20.328 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcephfs2. 2023-12-19T18:55:20.342 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:20.382 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-19T18:55:20.386 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcephfs2 (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:20.396 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-19T18:55:20.449 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T18:55:20.639 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rados. 2023-12-19T18:55:20.653 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../013-python3-rados_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:20.689 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rados (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:21.017 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-19T18:55:21.031 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-202-gc7586e95-1jammy_all.deb ... 2023-12-19T18:55:21.035 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-12-19T18:55:21.049 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-12-19T18:55:21.075 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-ceph-argparse (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:21.102 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-19T18:55:21.311 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cephfs. 2023-12-19T18:55:21.326 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:21.369 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cephfs (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:21.490 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librados2. 2023-12-19T18:55:21.504 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../010-librados2_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:21.548 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librados2 (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:21.689 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-19T18:55:21.703 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-202-gc7586e95-1jammy_all.deb ... 2023-12-19T18:55:21.746 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-ceph-common (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:21.959 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librbd1. 2023-12-19T18:55:21.974 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../011-librbd1_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:22.018 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librbd1 (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:22.101 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-prettytable. 2023-12-19T18:55:22.114 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-12-19T18:55:22.158 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-12-19T18:55:22.412 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libcephfs2. 2023-12-19T18:55:22.418 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rbd. 2023-12-19T18:55:22.426 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:22.433 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:22.462 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libcephfs2 (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:22.468 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rbd (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:22.715 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rados. 2023-12-19T18:55:22.728 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../013-python3-rados_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:22.796 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-19T18:55:22.806 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rados (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:22.811 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-12-19T18:55:22.855 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-19T18:55:23.117 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-19T18:55:23.131 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-202-gc7586e95-1jammy_all.deb ... 2023-12-19T18:55:23.175 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-ceph-argparse (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:23.265 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-12-19T18:55:23.280 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-12-19T18:55:23.340 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-12-19T18:55:23.427 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cephfs. 2023-12-19T18:55:23.441 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:23.486 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cephfs (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:23.643 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-12-19T18:55:23.658 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-12-19T18:55:23.702 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-19T18:55:23.780 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-19T18:55:23.794 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-202-gc7586e95-1jammy_all.deb ... 2023-12-19T18:55:23.838 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-ceph-common (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:24.038 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua5.1. 2023-12-19T18:55:24.053 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-12-19T18:55:24.097 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-12-19T18:55:24.116 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-prettytable. 2023-12-19T18:55:24.130 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-12-19T18:55:24.186 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-12-19T18:55:24.374 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-any. 2023-12-19T18:55:24.389 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-12-19T18:55:24.419 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rbd. 2023-12-19T18:55:24.424 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-any (27ubuntu1) ... 2023-12-19T18:55:24.433 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:24.468 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rbd (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:24.677 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package zip. 2023-12-19T18:55:24.693 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-12-19T18:55:24.735 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking zip (3.0-12build2) ... 2023-12-19T18:55:24.829 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-19T18:55:24.843 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-12-19T18:55:24.888 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-19T18:55:25.055 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package unzip. 2023-12-19T18:55:25.070 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-12-19T18:55:25.113 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-12-19T18:55:25.165 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-12-19T18:55:25.179 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-12-19T18:55:25.224 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-12-19T18:55:25.500 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package luarocks. 2023-12-19T18:55:25.515 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-12-19T18:55:25.518 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-12-19T18:55:25.532 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-12-19T18:55:25.558 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-12-19T18:55:25.614 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-19T18:55:25.896 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package lua5.1. 2023-12-19T18:55:25.910 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-12-19T18:55:25.946 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-12-19T18:55:25.949 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librgw2. 2023-12-19T18:55:25.964 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../027-librgw2_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:25.999 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librgw2 (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:26.241 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package lua-any. 2023-12-19T18:55:26.255 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-12-19T18:55:26.299 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking lua-any (27ubuntu1) ... 2023-12-19T18:55:26.494 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rgw. 2023-12-19T18:55:26.508 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:26.543 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package zip. 2023-12-19T18:55:26.552 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rgw (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:26.557 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-12-19T18:55:26.601 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking zip (3.0-12build2) ... 2023-12-19T18:55:26.888 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liboath0:amd64. 2023-12-19T18:55:26.903 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-12-19T18:55:26.904 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package unzip. 2023-12-19T18:55:26.918 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-12-19T18:55:26.963 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-12-19T18:55:26.971 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-12-19T18:55:27.274 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libradosstriper1. 2023-12-19T18:55:27.290 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:27.324 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libradosstriper1 (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:27.341 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package luarocks. 2023-12-19T18:55:27.357 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-12-19T18:55:27.400 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-12-19T18:55:27.710 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-common. 2023-12-19T18:55:27.725 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../031-ceph-common_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:27.769 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-common (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:27.807 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librgw2. 2023-12-19T18:55:27.821 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../027-librgw2_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:27.865 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librgw2 (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:28.359 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rgw. 2023-12-19T18:55:28.373 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:28.457 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rgw (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:28.862 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liboath0:amd64. 2023-12-19T18:55:28.876 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-12-19T18:55:28.929 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-12-19T18:55:28.966 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-base. 2023-12-19T18:55:28.981 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../032-ceph-base_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:29.034 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-base (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:29.315 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libradosstriper1. 2023-12-19T18:55:29.329 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:29.382 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libradosstriper1 (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:29.770 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-12-19T18:55:29.785 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-12-19T18:55:29.818 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-common. 2023-12-19T18:55:29.828 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-12-19T18:55:29.831 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../031-ceph-common_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:29.901 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-common (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:30.114 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cheroot. 2023-12-19T18:55:30.129 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-12-19T18:55:30.164 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-19T18:55:30.442 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-12-19T18:55:30.507 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-12-19T18:55:30.507 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-12-19T18:55:30.812 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.text. 2023-12-19T18:55:30.827 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-12-19T18:55:30.870 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-12-19T18:55:31.156 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-12-19T18:55:31.171 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-12-19T18:55:31.214 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-12-19T18:55:31.225 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-base. 2023-12-19T18:55:31.240 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../032-ceph-base_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:31.308 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-base (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:31.500 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-tempora. 2023-12-19T18:55:31.515 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-12-19T18:55:31.550 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-12-19T18:55:31.828 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-portend. 2023-12-19T18:55:31.843 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-12-19T18:55:31.886 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-12-19T18:55:32.027 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-12-19T18:55:32.041 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-12-19T18:55:32.094 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-12-19T18:55:32.206 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-12-19T18:55:32.221 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-12-19T18:55:32.264 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-12-19T18:55:32.446 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cheroot. 2023-12-19T18:55:32.461 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-12-19T18:55:32.513 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-19T18:55:32.567 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-19T18:55:32.582 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-12-19T18:55:32.625 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-12-19T18:55:32.924 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-12-19T18:55:32.939 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-12-19T18:55:32.970 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-natsort. 2023-12-19T18:55:32.985 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-12-19T18:55:32.991 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-12-19T18:55:33.029 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-12-19T18:55:33.986 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jaraco.text. 2023-12-19T18:55:33.999 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-logutils. 2023-12-19T18:55:34.000 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-12-19T18:55:34.015 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-12-19T18:55:34.044 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-12-19T18:55:34.057 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-12-19T18:55:34.360 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-19T18:55:34.375 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-12-19T18:55:34.410 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-12-19T18:55:34.430 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-12-19T18:55:34.445 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-12-19T18:55:34.496 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-12-19T18:55:34.721 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-mako. 2023-12-19T18:55:34.736 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-12-19T18:55:34.779 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-19T18:55:34.849 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-tempora. 2023-12-19T18:55:34.864 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-12-19T18:55:34.916 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-12-19T18:55:35.108 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-19T18:55:35.123 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-19T18:55:35.165 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-19T18:55:35.285 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-portend. 2023-12-19T18:55:35.300 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-12-19T18:55:35.352 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-12-19T18:55:35.445 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-19T18:55:35.459 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-12-19T18:55:35.501 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-12-19T18:55:35.763 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-12-19T18:55:35.778 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-12-19T18:55:35.831 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-12-19T18:55:35.838 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-webob. 2023-12-19T18:55:35.856 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-12-19T18:55:35.898 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-12-19T18:55:36.158 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-19T18:55:36.173 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-12-19T18:55:36.216 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-12-19T18:55:36.241 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-waitress. 2023-12-19T18:55:36.256 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-12-19T18:55:36.302 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-19T18:55:36.602 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-natsort. 2023-12-19T18:55:36.617 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-12-19T18:55:36.618 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-tempita. 2023-12-19T18:55:36.634 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-12-19T18:55:36.669 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-12-19T18:55:36.677 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-12-19T18:55:36.979 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-paste. 2023-12-19T18:55:36.995 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-12-19T18:55:37.029 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-12-19T18:55:37.055 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-logutils. 2023-12-19T18:55:37.070 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-12-19T18:55:37.122 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-12-19T18:55:37.332 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-19T18:55:37.348 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-12-19T18:55:37.391 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-12-19T18:55:37.500 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-19T18:55:37.515 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-12-19T18:55:37.566 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-12-19T18:55:37.644 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-19T18:55:37.659 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-12-19T18:55:37.693 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-12-19T18:55:37.944 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-mako. 2023-12-19T18:55:37.959 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-12-19T18:55:38.010 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-19T18:55:38.030 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-webtest. 2023-12-19T18:55:38.045 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-12-19T18:55:38.088 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-12-19T18:55:38.399 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pecan. 2023-12-19T18:55:38.414 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-12-19T18:55:38.439 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-19T18:55:38.454 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-19T18:55:38.457 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-12-19T18:55:38.497 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-19T18:55:38.806 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-certifi. 2023-12-19T18:55:38.819 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-12-19T18:55:38.833 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-19T18:55:38.848 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-12-19T18:55:38.862 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-12-19T18:55:38.900 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-12-19T18:55:39.269 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-webob. 2023-12-19T18:55:39.284 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-12-19T18:55:39.335 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-12-19T18:55:39.423 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-idna. 2023-12-19T18:55:39.438 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-12-19T18:55:39.481 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-idna (3.3-1) ... 2023-12-19T18:55:39.688 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-waitress. 2023-12-19T18:55:39.703 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-12-19T18:55:39.749 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-19T18:55:39.759 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-urllib3. 2023-12-19T18:55:39.774 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-12-19T18:55:39.811 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-19T18:55:40.095 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-requests. 2023-12-19T18:55:40.100 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-tempita. 2023-12-19T18:55:40.109 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-12-19T18:55:40.115 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-12-19T18:55:40.145 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-19T18:55:40.158 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-12-19T18:55:40.460 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-paste. 2023-12-19T18:55:40.476 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-12-19T18:55:40.482 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-19T18:55:40.497 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-12-19T18:55:40.519 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-12-19T18:55:40.540 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-19T18:55:40.801 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-19T18:55:40.816 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-202-gc7586e95-1jammy_all.deb ... 2023-12-19T18:55:40.830 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-19T18:55:40.845 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-12-19T18:55:40.851 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-modules-core (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:40.888 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-12-19T18:55:41.192 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-19T18:55:41.206 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-12-19T18:55:41.239 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-19T18:55:41.255 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:41.257 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-12-19T18:55:41.297 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:41.592 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-19T18:55:41.607 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-12-19T18:55:41.666 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-12-19T18:55:41.702 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-webtest. 2023-12-19T18:55:41.718 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-12-19T18:55:41.752 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-12-19T18:55:41.944 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-openssl. 2023-12-19T18:55:41.960 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-12-19T18:55:42.002 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-12-19T18:55:42.097 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pecan. 2023-12-19T18:55:42.112 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-12-19T18:55:42.155 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-12-19T18:55:42.347 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr. 2023-12-19T18:55:42.363 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:42.407 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:42.509 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-certifi. 2023-12-19T18:55:42.524 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-12-19T18:55:42.567 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-12-19T18:55:42.793 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mon. 2023-12-19T18:55:42.807 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:42.883 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mon (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:42.912 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-idna. 2023-12-19T18:55:42.927 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-12-19T18:55:42.962 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-idna (3.3-1) ... 2023-12-19T18:55:43.223 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-urllib3. 2023-12-19T18:55:43.238 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-12-19T18:55:43.273 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-19T18:55:43.568 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-requests. 2023-12-19T18:55:43.583 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-12-19T18:55:43.618 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-19T18:55:43.620 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-osd. 2023-12-19T18:55:43.635 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:43.670 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-osd (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:43.887 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-19T18:55:43.902 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-12-19T18:55:43.937 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-19T18:55:44.248 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-19T18:55:44.264 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-202-gc7586e95-1jammy_all.deb ... 2023-12-19T18:55:44.298 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-modules-core (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:44.669 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-19T18:55:44.684 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:44.727 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:44.967 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph. 2023-12-19T18:55:44.983 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../068-ceph_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:45.013 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-19T18:55:45.026 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:45.028 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-12-19T18:55:45.063 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-12-19T18:55:45.328 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-fuse. 2023-12-19T18:55:45.344 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:45.349 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-openssl. 2023-12-19T18:55:45.365 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-12-19T18:55:45.378 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-fuse (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:45.408 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-12-19T18:55:45.741 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mds. 2023-12-19T18:55:45.756 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:45.761 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr. 2023-12-19T18:55:45.776 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:45.799 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mds (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:45.819 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:46.194 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package cephadm. 2023-12-19T18:55:46.197 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mon. 2023-12-19T18:55:46.209 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../071-cephadm_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:46.211 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:46.252 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking cephadm (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:46.255 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mon (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:46.539 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-19T18:55:46.554 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-12-19T18:55:46.588 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-12-19T18:55:46.917 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-babel-localedata. 2023-12-19T18:55:46.932 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-12-19T18:55:46.975 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-19T18:55:47.108 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-osd. 2023-12-19T18:55:47.123 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:47.158 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-osd (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:47.973 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-babel. 2023-12-19T18:55:47.987 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-12-19T18:55:48.022 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-12-19T18:55:48.310 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jinja2. 2023-12-19T18:55:48.325 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-12-19T18:55:48.328 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph. 2023-12-19T18:55:48.343 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../068-ceph_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:48.368 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-12-19T18:55:48.386 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:48.722 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-fuse. 2023-12-19T18:55:48.729 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-19T18:55:48.737 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:48.744 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-202-gc7586e95-1jammy_all.deb ... 2023-12-19T18:55:48.780 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-fuse (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:48.788 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-cephadm (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:49.100 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-19T18:55:49.115 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-12-19T18:55:49.166 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mds. 2023-12-19T18:55:49.181 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:49.224 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mds (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:49.353 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-19T18:55:49.552 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephadm. 2023-12-19T18:55:49.568 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../071-cephadm_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:49.610 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephadm (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:49.720 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-routes. 2023-12-19T18:55:49.736 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-12-19T18:55:49.779 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-12-19T18:55:49.922 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-19T18:55:49.937 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-12-19T18:55:49.980 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-12-19T18:55:50.124 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-19T18:55:50.138 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-202-gc7586e95-1jammy_all.deb ... 2023-12-19T18:55:50.182 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-dashboard (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:50.274 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-babel-localedata. 2023-12-19T18:55:50.289 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-12-19T18:55:50.332 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-19T18:55:50.578 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-12-19T18:55:50.592 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-12-19T18:55:50.636 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-19T18:55:51.148 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-joblib. 2023-12-19T18:55:51.162 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-12-19T18:55:51.215 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-12-19T18:55:51.287 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-babel. 2023-12-19T18:55:51.301 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-12-19T18:55:51.337 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-12-19T18:55:51.569 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-12-19T18:55:51.583 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-12-19T18:55:51.622 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jinja2. 2023-12-19T18:55:51.636 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-12-19T18:55:51.681 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-12-19T18:55:51.713 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-12-19T18:55:52.017 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-sklearn. 2023-12-19T18:55:52.031 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-12-19T18:55:52.042 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-19T18:55:52.056 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-202-gc7586e95-1jammy_all.deb ... 2023-12-19T18:55:52.075 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-19T18:55:52.100 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-cephadm (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:52.437 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-19T18:55:52.451 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-12-19T18:55:52.495 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-19T18:55:52.806 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-routes. 2023-12-19T18:55:52.820 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-12-19T18:55:52.869 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-19T18:55:52.873 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-12-19T18:55:52.884 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-202-gc7586e95-1jammy_all.deb ... 2023-12-19T18:55:52.919 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:53.367 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-19T18:55:53.381 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-202-gc7586e95-1jammy_all.deb ... 2023-12-19T18:55:53.425 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-dashboard (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:53.837 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-12-19T18:55:53.851 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-12-19T18:55:53.895 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-19T18:55:53.923 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cachetools. 2023-12-19T18:55:53.938 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-12-19T18:55:53.973 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-12-19T18:55:54.243 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-19T18:55:54.259 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-12-19T18:55:54.301 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-12-19T18:55:54.424 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-joblib. 2023-12-19T18:55:54.438 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-12-19T18:55:54.482 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-12-19T18:55:54.663 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-19T18:55:54.679 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-12-19T18:55:54.721 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-12-19T18:55:54.802 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-12-19T18:55:54.815 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-12-19T18:55:54.929 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-12-19T18:55:55.042 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rsa. 2023-12-19T18:55:55.057 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-12-19T18:55:55.100 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rsa (4.8-1) ... 2023-12-19T18:55:55.231 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-sklearn. 2023-12-19T18:55:55.245 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-12-19T18:55:55.298 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-19T18:55:55.396 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-google-auth. 2023-12-19T18:55:55.412 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-12-19T18:55:55.446 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-12-19T18:55:55.758 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-19T18:55:55.773 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-12-19T18:55:55.816 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-19T18:55:55.965 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-19T18:55:55.979 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-202-gc7586e95-1jammy_all.deb ... 2023-12-19T18:55:56.023 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:56.145 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-websocket. 2023-12-19T18:55:56.159 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-12-19T18:55:56.195 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-12-19T18:55:56.499 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-19T18:55:56.514 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-12-19T18:55:56.557 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-19T18:55:56.959 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cachetools. 2023-12-19T18:55:56.975 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-12-19T18:55:57.026 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-12-19T18:55:57.272 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-19T18:55:57.286 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-202-gc7586e95-1jammy_all.deb ... 2023-12-19T18:55:57.312 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-19T18:55:57.328 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-12-19T18:55:57.330 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:55:57.370 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-12-19T18:55:57.625 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-19T18:55:57.639 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-12-19T18:55:57.675 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-19T18:55:57.690 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-19T18:55:57.706 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-12-19T18:55:57.740 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-12-19T18:55:58.012 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-19T18:55:58.026 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-12-19T18:55:58.027 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rsa. 2023-12-19T18:55:58.041 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-12-19T18:55:58.061 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-19T18:55:58.076 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rsa (4.8-1) ... 2023-12-19T18:55:58.340 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package jq. 2023-12-19T18:55:58.355 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-12-19T18:55:58.363 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-google-auth. 2023-12-19T18:55:58.378 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-12-19T18:55:58.398 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-12-19T18:55:58.438 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-12-19T18:55:58.643 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package socat. 2023-12-19T18:55:58.658 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-12-19T18:55:58.701 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-12-19T18:55:58.766 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-19T18:55:58.780 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-12-19T18:55:58.824 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-19T18:55:59.013 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package xmlstarlet. 2023-12-19T18:55:59.029 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-12-19T18:55:59.063 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-12-19T18:55:59.135 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-websocket. 2023-12-19T18:55:59.150 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-12-19T18:55:59.194 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-12-19T18:55:59.530 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-19T18:55:59.546 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-12-19T18:55:59.580 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-19T18:55:59.626 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-test. 2023-12-19T18:55:59.642 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../099-ceph-test_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:55:59.684 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-test (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:00.237 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-19T18:56:00.252 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-202-gc7586e95-1jammy_all.deb ... 2023-12-19T18:56:00.295 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:00.615 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-19T18:56:00.629 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-12-19T18:56:00.690 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-19T18:56:00.993 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-19T18:56:01.007 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-12-19T18:56:01.051 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-19T18:56:01.337 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package jq. 2023-12-19T18:56:01.457 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-12-19T18:56:01.457 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-12-19T18:56:01.606 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-volume. 2023-12-19T18:56:01.622 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-202-gc7586e95-1jammy_all.deb ... 2023-12-19T18:56:01.631 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package socat. 2023-12-19T18:56:01.646 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-12-19T18:56:01.664 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-volume (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:01.689 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-12-19T18:56:02.044 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-19T18:56:02.060 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:56:02.123 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking cephfs-mirror (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:02.226 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package xmlstarlet. 2023-12-19T18:56:02.242 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-12-19T18:56:02.284 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-12-19T18:56:02.397 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-colorama. 2023-12-19T18:56:02.413 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-12-19T18:56:02.455 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-12-19T18:56:02.672 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-test. 2023-12-19T18:56:02.686 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../099-ceph-test_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:56:02.717 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package cephfs-shell. 2023-12-19T18:56:02.730 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-test (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:02.732 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-202-gc7586e95-1jammy_all.deb ... 2023-12-19T18:56:02.775 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking cephfs-shell (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:03.028 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package cephfs-top. 2023-12-19T18:56:03.043 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-202-gc7586e95-1jammy_all.deb ... 2023-12-19T18:56:03.086 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking cephfs-top (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:03.364 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-19T18:56:03.379 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:56:03.422 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcephfs-dev (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:03.701 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-socket:amd64. 2023-12-19T18:56:03.717 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-12-19T18:56:03.751 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-19T18:56:04.064 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-sec:amd64. 2023-12-19T18:56:04.080 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-12-19T18:56:04.122 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-12-19T18:56:04.494 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package nvme-cli. 2023-12-19T18:56:04.501 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-volume. 2023-12-19T18:56:04.509 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-12-19T18:56:04.516 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-202-gc7586e95-1jammy_all.deb ... 2023-12-19T18:56:04.551 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-volume (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:04.577 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-12-19T18:56:04.913 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-19T18:56:04.930 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:56:04.963 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephfs-mirror (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:04.991 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package pkg-config. 2023-12-19T18:56:05.007 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-12-19T18:56:05.049 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-12-19T18:56:05.207 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-colorama. 2023-12-19T18:56:05.222 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-12-19T18:56:05.257 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-12-19T18:56:05.286 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-19T18:56:05.302 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-12-19T18:56:05.344 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-12-19T18:56:05.510 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephfs-shell. 2023-12-19T18:56:05.524 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-202-gc7586e95-1jammy_all.deb ... 2023-12-19T18:56:05.568 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephfs-shell (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:05.749 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-iniconfig. 2023-12-19T18:56:05.764 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-12-19T18:56:05.814 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-12-19T18:56:05.862 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephfs-top. 2023-12-19T18:56:05.877 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-202-gc7586e95-1jammy_all.deb ... 2023-12-19T18:56:05.920 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephfs-top (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:06.101 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pastescript. 2023-12-19T18:56:06.117 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-12-19T18:56:06.159 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-19T18:56:06.173 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-19T18:56:06.188 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:56:06.231 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libcephfs-dev (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:06.480 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pluggy. 2023-12-19T18:56:06.484 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package lua-socket:amd64. 2023-12-19T18:56:06.495 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-12-19T18:56:06.499 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-12-19T18:56:06.534 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-19T18:56:06.538 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-12-19T18:56:06.830 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package lua-sec:amd64. 2023-12-19T18:56:06.832 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-psutil. 2023-12-19T18:56:06.845 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-12-19T18:56:06.848 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-12-19T18:56:06.888 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-12-19T18:56:06.891 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-12-19T18:56:07.261 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-py. 2023-12-19T18:56:07.275 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package nvme-cli. 2023-12-19T18:56:07.277 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-12-19T18:56:07.291 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-12-19T18:56:07.319 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-py (1.10.0-1) ... 2023-12-19T18:56:07.342 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-12-19T18:56:07.648 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pygments. 2023-12-19T18:56:07.664 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-12-19T18:56:07.706 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-12-19T18:56:07.738 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package pkg-config. 2023-12-19T18:56:07.753 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-12-19T18:56:07.797 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-12-19T18:56:08.050 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-19T18:56:08.064 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-12-19T18:56:08.099 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-12-19T18:56:08.153 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-19T18:56:08.168 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-12-19T18:56:08.228 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-12-19T18:56:08.497 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-toml. 2023-12-19T18:56:08.512 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-12-19T18:56:08.544 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-iniconfig. 2023-12-19T18:56:08.547 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-12-19T18:56:08.558 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-12-19T18:56:08.602 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-12-19T18:56:08.842 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pytest. 2023-12-19T18:56:08.858 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-12-19T18:56:08.880 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pastescript. 2023-12-19T18:56:08.895 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-12-19T18:56:08.909 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-12-19T18:56:08.930 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-19T18:56:09.225 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pluggy. 2023-12-19T18:56:09.239 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-12-19T18:56:09.246 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-simplejson. 2023-12-19T18:56:09.262 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-12-19T18:56:09.283 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-12-19T18:56:09.296 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-12-19T18:56:09.586 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-psutil. 2023-12-19T18:56:09.591 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-19T18:56:09.600 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-12-19T18:56:09.607 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-12-19T18:56:09.641 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-12-19T18:56:09.644 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-12-19T18:56:09.997 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-py. 2023-12-19T18:56:10.012 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-12-19T18:56:10.055 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-py (1.10.0-1) ... 2023-12-19T18:56:10.304 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package radosgw. 2023-12-19T18:56:10.318 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../122-radosgw_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:56:10.362 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking radosgw (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:10.383 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pygments. 2023-12-19T18:56:10.398 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-12-19T18:56:10.442 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-12-19T18:56:10.845 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-19T18:56:10.860 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-12-19T18:56:10.895 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-12-19T18:56:10.957 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package rbd-fuse. 2023-12-19T18:56:10.972 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:56:11.015 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking rbd-fuse (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:11.199 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-toml. 2023-12-19T18:56:11.212 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-12-19T18:56:11.256 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-12-19T18:56:11.303 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-12-19T18:56:11.580 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-19T18:56:11.584 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pytest. 2023-12-19T18:56:11.599 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-12-19T18:56:11.651 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-12-19T18:56:11.698 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-12-19T18:56:11.941 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-12-19T18:56:11.979 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-simplejson. 2023-12-19T18:56:11.994 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-12-19T18:56:12.037 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-12-19T18:56:12.306 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-19T18:56:12.322 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-12-19T18:56:12.351 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-12-19T18:56:12.364 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-12-19T18:56:12.918 INFO:teuthology.orchestra.run.smithi138.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-12-19T18:56:12.981 INFO:teuthology.orchestra.run.smithi138.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-12-19T18:56:13.024 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up cephadm (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:13.127 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package radosgw. 2023-12-19T18:56:13.141 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../122-radosgw_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:56:13.185 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking radosgw (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:13.604 INFO:teuthology.orchestra.run.smithi138.stdout:Adding system user cephadm....done 2023-12-19T18:56:13.738 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package rbd-fuse. 2023-12-19T18:56:13.753 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-202-gc7586e95-1jammy_amd64.deb ... 2023-12-19T18:56:13.756 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-19T18:56:13.788 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking rbd-fuse (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:14.017 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-12-19T18:56:14.064 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-12-19T18:56:14.278 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-12-19T18:56:14.329 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-19T18:56:14.428 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-12-19T18:56:14.452 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-12-19T18:56:14.679 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-19T18:56:14.709 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-12-19T18:56:15.093 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-12-19T18:56:15.197 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-12-19T18:56:15.315 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-py (1.10.0-1) ... 2023-12-19T18:56:15.626 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-12-19T18:56:15.708 INFO:teuthology.orchestra.run.smithi133.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-12-19T18:56:15.722 INFO:teuthology.orchestra.run.smithi133.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-12-19T18:56:15.897 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephadm (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:15.994 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-12-19T18:56:16.238 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-12-19T18:56:16.459 INFO:teuthology.orchestra.run.smithi133.stdout:Adding system user cephadm....done 2023-12-19T18:56:16.514 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-12-19T18:56:16.586 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-19T18:56:16.807 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-12-19T18:56:16.862 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-12-19T18:56:17.122 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-12-19T18:56:17.143 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-12-19T18:56:17.273 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-12-19T18:56:17.402 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-12-19T18:56:17.670 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-12-19T18:56:17.799 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-19T18:56:17.938 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-ceph-argparse (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:18.059 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-12-19T18:56:18.176 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-py (1.10.0-1) ... 2023-12-19T18:56:18.231 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-19T18:56:18.340 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-19T18:56:18.458 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-12-19T18:56:18.486 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-12-19T18:56:18.726 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-12-19T18:56:18.844 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-12-19T18:56:18.888 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-12-19T18:56:19.095 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-12-19T18:56:19.156 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-12-19T18:56:19.432 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-12-19T18:56:19.525 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-12-19T18:56:19.576 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-12-19T18:56:19.632 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-19T18:56:19.716 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-12-19T18:56:19.758 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-12-19T18:56:19.993 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-12-19T18:56:20.143 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-19T18:56:20.244 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-12-19T18:56:20.328 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-12-19T18:56:20.504 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-12-19T18:56:20.604 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-12-19T18:56:20.772 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-12-19T18:56:20.874 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-ceph-argparse (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:21.082 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up zip (3.0-12build2) ... 2023-12-19T18:56:21.156 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-19T18:56:21.191 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-12-19T18:56:21.281 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-19T18:56:21.407 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-12-19T18:56:21.693 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-12-19T18:56:21.818 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-12-19T18:56:21.885 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-12-19T18:56:22.078 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-12-19T18:56:22.137 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-12-19T18:56:22.246 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-12-19T18:56:22.373 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-19T18:56:22.499 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-12-19T18:56:22.533 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-12-19T18:56:22.597 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-19T18:56:22.690 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-12-19T18:56:22.723 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-12-19T18:56:23.083 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-12-19T18:56:23.091 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-19T18:56:23.217 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-12-19T18:56:23.345 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-12-19T18:56:23.476 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-12-19T18:56:23.713 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-19T18:56:23.754 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-12-19T18:56:23.998 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-12-19T18:56:24.087 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up zip (3.0-12build2) ... 2023-12-19T18:56:24.213 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-12-19T18:56:24.341 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-19T18:56:24.693 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-12-19T18:56:24.923 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-12-19T18:56:24.953 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-12-19T18:56:25.070 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-ceph-common (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:25.191 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-12-19T18:56:25.317 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-12-19T18:56:25.355 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-idna (3.3-1) ... 2023-12-19T18:56:25.443 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-19T18:56:25.698 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-19T18:56:25.761 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-12-19T18:56:26.162 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-12-19T18:56:26.421 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-12-19T18:56:26.826 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-19T18:56:26.922 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-12-19T18:56:27.141 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-12-19T18:56:27.165 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T18:56:27.300 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-toml (0.10.2-1) ... 2023-12-19T18:56:27.459 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-19T18:56:27.568 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-19T18:56:27.694 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-12-19T18:56:27.802 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-12-19T18:56:27.837 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-19T18:56:28.062 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-12-19T18:56:28.139 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-12-19T18:56:28.187 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-ceph-common (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:28.398 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-12-19T18:56:28.488 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-idna (3.3-1) ... 2023-12-19T18:56:28.649 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T18:56:28.775 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-12-19T18:56:28.856 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-19T18:56:29.085 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-12-19T18:56:29.345 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-12-19T18:56:29.613 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-12-19T18:56:29.881 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-19T18:56:30.087 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-12-19T18:56:30.330 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T18:56:30.357 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-12-19T18:56:30.464 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-toml (0.10.2-1) ... 2023-12-19T18:56:30.633 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-19T18:56:30.741 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-19T18:56:30.760 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-12-19T18:56:30.858 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-12-19T18:56:30.967 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-19T18:56:31.053 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-19T18:56:31.154 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-19T18:56:31.277 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-12-19T18:56:31.439 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-12-19T18:56:31.570 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-12-19T18:56:31.732 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-12-19T18:56:31.829 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T18:56:31.955 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-12-19T18:56:31.991 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-19T18:56:32.117 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-12-19T18:56:32.243 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-12-19T18:56:32.273 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-12-19T18:56:32.332 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-12-19T18:56:32.541 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-12-19T18:56:32.638 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-19T18:56:32.714 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-12-19T18:56:32.826 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-12-19T18:56:33.093 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-19T18:56:33.115 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-12-19T18:56:33.352 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-12-19T18:56:33.383 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-any (27ubuntu1) ... 2023-12-19T18:56:33.509 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-portend (3.0.0-1) ... 2023-12-19T18:56:33.629 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-19T18:56:33.754 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-12-19T18:56:33.769 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T18:56:33.920 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-12-19T18:56:34.039 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-19T18:56:34.165 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-19T18:56:34.280 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-12-19T18:56:34.508 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-12-19T18:56:34.598 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-19T18:56:34.810 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-12-19T18:56:34.882 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-12-19T18:56:35.077 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-19T18:56:35.111 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rsa (4.8-1) ... 2023-12-19T18:56:35.203 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-12-19T18:56:35.329 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-12-19T18:56:35.396 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-12-19T18:56:35.417 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-12-19T18:56:35.673 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-19T18:56:35.680 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-19T18:56:35.806 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-12-19T18:56:35.941 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-12-19T18:56:36.208 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-12-19T18:56:36.335 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-19T18:56:36.476 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up lua-any (27ubuntu1) ... 2023-12-19T18:56:36.601 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-portend (3.0.0-1) ... 2023-12-19T18:56:36.628 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-12-19T18:56:36.861 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-19T18:56:36.956 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-19T18:56:36.987 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-12-19T18:56:37.082 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librados2 (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:37.209 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libsqlite3-mod-ceph (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:37.338 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-12-19T18:56:37.351 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-12-19T18:56:37.656 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-19T18:56:37.690 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcephfs2 (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:37.815 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libradosstriper1 (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:37.941 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-12-19T18:56:37.948 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-12-19T18:56:38.160 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rsa (4.8-1) ... 2023-12-19T18:56:38.234 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librbd1 (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:38.360 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-modules-core (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:38.428 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-12-19T18:56:38.487 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-fuse (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:38.681 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-19T18:56:38.681 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-19T18:56:38.721 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-19T18:56:38.980 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-12-19T18:56:39.338 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcephfs-dev (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:39.374 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-19T18:56:39.464 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rados (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:39.598 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librgw2 (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:39.692 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-12-19T18:56:39.725 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up cephfs-top (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:39.851 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-19T18:56:40.053 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-19T18:56:40.162 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librados2 (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:40.271 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libsqlite3-mod-ceph (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:40.397 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-12-19T18:56:40.742 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libcephfs2 (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:40.868 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libradosstriper1 (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:40.994 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-12-19T18:56:41.172 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rbd (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:41.279 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librbd1 (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:41.301 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up rbd-fuse (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:41.421 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-modules-core (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:41.424 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rgw (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:41.548 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-fuse (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:41.550 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cephfs (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:41.677 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up cephfs-shell (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:41.759 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-19T18:56:41.760 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-19T18:56:41.803 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-common (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:42.299 INFO:teuthology.orchestra.run.smithi138.stdout:Adding group ceph....done 2023-12-19T18:56:42.357 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libcephfs-dev (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:42.466 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rados (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:42.593 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librgw2 (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:42.676 INFO:teuthology.orchestra.run.smithi138.stdout:Adding system user ceph....done 2023-12-19T18:56:42.752 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephfs-top (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:42.840 INFO:teuthology.orchestra.run.smithi138.stdout:Setting system user ceph properties....done 2023-12-19T18:56:42.857 INFO:teuthology.orchestra.run.smithi138.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-19T18:56:42.878 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-19T18:56:42.998 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-19T18:56:43.413 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-19T18:56:44.131 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up cephfs-mirror (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:44.189 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rbd (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:44.316 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up rbd-fuse (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:44.342 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-19T18:56:44.342 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-19T18:56:44.442 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rgw (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:44.567 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cephfs (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:44.694 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephfs-shell (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:44.811 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-common (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:44.949 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-test (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:45.075 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up radosgw (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:45.340 INFO:teuthology.orchestra.run.smithi133.stdout:Adding group ceph....done 2023-12-19T18:56:45.604 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-19T18:56:45.604 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-19T18:56:45.758 INFO:teuthology.orchestra.run.smithi133.stdout:Adding system user ceph....done 2023-12-19T18:56:45.918 INFO:teuthology.orchestra.run.smithi133.stdout:Setting system user ceph properties....done 2023-12-19T18:56:45.938 INFO:teuthology.orchestra.run.smithi133.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-19T18:56:46.079 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-19T18:56:46.244 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-base (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:46.468 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-19T18:56:46.566 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-19T18:56:47.129 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephfs-mirror (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:47.246 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mds (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:47.330 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-19T18:56:47.330 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-19T18:56:47.486 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-19T18:56:47.487 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-19T18:56:47.922 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-test (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:48.064 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up radosgw (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:48.090 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:48.302 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-19T18:56:48.303 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-19T18:56:48.933 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-osd (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:48.939 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-19T18:56:48.939 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-19T18:56:49.256 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-19T18:56:49.256 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-19T18:56:49.535 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-base (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:49.898 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-19T18:56:49.901 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-k8sevents (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:50.036 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:50.181 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mon (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:50.389 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-19T18:56:50.389 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-19T18:56:50.536 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mds (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:50.760 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-19T18:56:50.760 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-19T18:56:51.186 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-cephadm (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:51.312 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:51.396 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:51.455 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-dashboard (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:51.598 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-volume (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:51.608 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-19T18:56:51.609 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-19T18:56:51.951 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-12-19T18:56:52.085 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-19T18:56:52.222 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-osd (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:52.229 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-19T18:56:52.523 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-19T18:56:52.523 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-19T18:56:53.116 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-k8sevents (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:53.294 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:53.407 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-19T18:56:53.436 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mon (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:53.646 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-19T18:56:53.646 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-19T18:56:54.083 INFO:teuthology.orchestra.run.smithi138.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-19T18:56:54.088 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-19T18:56:54.162 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2023-12-19T18:56:54.312 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-cephadm (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:54.330 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2023-12-19T18:56:54.330 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2023-12-19T18:56:54.455 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:54.481 INFO:teuthology.orchestra.run.smithi138.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-12-19T18:56:54.481 INFO:teuthology.orchestra.run.smithi138.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-12-19T18:56:54.481 INFO:teuthology.orchestra.run.smithi138.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-12-19T18:56:54.481 INFO:teuthology.orchestra.run.smithi138.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-12-19T18:56:54.481 INFO:teuthology.orchestra.run.smithi138.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-12-19T18:56:54.481 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2023-12-19T18:56:54.481 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-19T18:56:54.481 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-19T18:56:54.481 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-19T18:56:54.481 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-19T18:56:54.482 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-19T18:56:54.482 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-19T18:56:54.482 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2023-12-19T18:56:54.482 INFO:teuthology.orchestra.run.smithi138.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-12-19T18:56:54.483 INFO:teuthology.orchestra.run.smithi138.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-12-19T18:56:54.483 INFO:teuthology.orchestra.run.smithi138.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-12-19T18:56:54.483 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-12-19T18:56:54.483 INFO:teuthology.orchestra.run.smithi138.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-19T18:56:54.484 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2023-12-19T18:56:54.484 INFO:teuthology.orchestra.run.smithi138.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-12-19T18:56:54.484 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-12-19T18:56:54.484 INFO:teuthology.orchestra.run.smithi138.stdout: libengine-pkcs11-openssl 2023-12-19T18:56:54.534 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2023-12-19T18:56:54.535 INFO:teuthology.orchestra.run.smithi138.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-12-19T18:56:54.535 INFO:teuthology.orchestra.run.smithi138.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-12-19T18:56:54.535 INFO:teuthology.orchestra.run.smithi138.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-12-19T18:56:54.536 INFO:teuthology.orchestra.run.smithi138.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-12-19T18:56:54.536 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-12-19T18:56:54.536 INFO:teuthology.orchestra.run.smithi138.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-12-19T18:56:54.536 INFO:teuthology.orchestra.run.smithi138.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-19T18:56:54.537 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages will be upgraded: 2023-12-19T18:56:54.537 INFO:teuthology.orchestra.run.smithi138.stdout: libssl3 2023-12-19T18:56:54.581 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-dashboard (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:54.598 INFO:teuthology.orchestra.run.smithi138.stdout:1 upgraded, 39 newly installed, 0 to remove and 267 not upgraded. 2023-12-19T18:56:54.598 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 54.6 MB of archives. 2023-12-19T18:56:54.598 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 202 MB of additional disk space will be used. 2023-12-19T18:56:54.598 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-12-19T18:56:54.698 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-volume (19.0.0-202-gc7586e95-1jammy) ... 2023-12-19T18:56:54.720 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-12-19T18:56:54.783 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-12-19T18:56:54.792 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-12-19T18:56:54.793 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-12-19T18:56:54.795 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-12-19T18:56:54.796 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-12-19T18:56:54.797 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2023-12-19T18:56:54.798 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-12-19T18:56:54.799 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-12-19T18:56:54.799 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-12-19T18:56:54.805 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-12-19T18:56:54.820 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-12-19T18:56:55.051 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-12-19T18:56:55.091 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-12-19T18:56:55.093 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-12-19T18:56:55.093 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-12-19T18:56:55.096 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-12-19T18:56:55.096 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-12-19T18:56:55.101 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2023-12-19T18:56:55.102 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-12-19T18:56:55.110 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-12-19T18:56:55.110 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-12-19T18:56:55.133 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-12-19T18:56:55.133 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-12-19T18:56:55.143 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-12-19T18:56:55.152 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-19T18:56:55.163 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-12-19T18:56:55.166 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-12-19T18:56:55.167 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-12-19T18:56:55.168 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-12-19T18:56:55.168 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2023-12-19T18:56:55.180 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-12-19T18:56:55.181 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2023-12-19T18:56:55.295 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-19T18:56:55.339 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-12-19T18:56:55.339 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-12-19T18:56:55.339 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-12-19T18:56:55.339 INFO:teuthology.orchestra.run.smithi138.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-12-19T18:56:55.339 INFO:teuthology.orchestra.run.smithi138.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-12-19T18:56:55.339 INFO:teuthology.orchestra.run.smithi138.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-12-19T18:56:55.353 INFO:teuthology.orchestra.run.smithi138.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-12-19T18:56:55.353 INFO:teuthology.orchestra.run.smithi138.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-12-19T18:56:55.730 INFO:teuthology.orchestra.run.smithi138.stdout:Preconfiguring packages ... 2023-12-19T18:56:55.880 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 54.6 MB in 1s (67.5 MB/s) 2023-12-19T18:56:56.022 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package flex. 2023-12-19T18:56:56.096 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140565 files and directories currently installed.) 2023-12-19T18:56:56.099 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-12-19T18:56:56.138 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking flex (2.6.4-8build2) ... 2023-12-19T18:56:56.405 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-19T18:56:56.709 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-19T18:56:56.873 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-12-19T18:56:57.125 INFO:teuthology.orchestra.run.smithi133.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-19T18:56:57.130 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-19T18:56:57.204 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2023-12-19T18:56:57.287 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-19T18:56:57.372 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2023-12-19T18:56:57.373 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2023-12-19T18:56:57.525 INFO:teuthology.orchestra.run.smithi133.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-12-19T18:56:57.525 INFO:teuthology.orchestra.run.smithi133.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-12-19T18:56:57.525 INFO:teuthology.orchestra.run.smithi133.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-12-19T18:56:57.525 INFO:teuthology.orchestra.run.smithi133.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-12-19T18:56:57.525 INFO:teuthology.orchestra.run.smithi133.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-12-19T18:56:57.525 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages were automatically installed and are no longer required: 2023-12-19T18:56:57.525 INFO:teuthology.orchestra.run.smithi133.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-19T18:56:57.525 INFO:teuthology.orchestra.run.smithi133.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-19T18:56:57.526 INFO:teuthology.orchestra.run.smithi133.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-19T18:56:57.526 INFO:teuthology.orchestra.run.smithi133.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-19T18:56:57.526 INFO:teuthology.orchestra.run.smithi133.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-19T18:56:57.526 INFO:teuthology.orchestra.run.smithi133.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-19T18:56:57.526 INFO:teuthology.orchestra.run.smithi133.stdout:The following additional packages will be installed: 2023-12-19T18:56:57.527 INFO:teuthology.orchestra.run.smithi133.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-12-19T18:56:57.527 INFO:teuthology.orchestra.run.smithi133.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-12-19T18:56:57.527 INFO:teuthology.orchestra.run.smithi133.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-12-19T18:56:57.527 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-12-19T18:56:57.527 INFO:teuthology.orchestra.run.smithi133.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-19T18:56:57.528 INFO:teuthology.orchestra.run.smithi133.stdout:Suggested packages: 2023-12-19T18:56:57.528 INFO:teuthology.orchestra.run.smithi133.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-12-19T18:56:57.528 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-12-19T18:56:57.528 INFO:teuthology.orchestra.run.smithi133.stdout: libengine-pkcs11-openssl 2023-12-19T18:56:57.579 INFO:teuthology.orchestra.run.smithi133.stdout:The following NEW packages will be installed: 2023-12-19T18:56:57.580 INFO:teuthology.orchestra.run.smithi133.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-12-19T18:56:57.580 INFO:teuthology.orchestra.run.smithi133.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-12-19T18:56:57.580 INFO:teuthology.orchestra.run.smithi133.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-12-19T18:56:57.580 INFO:teuthology.orchestra.run.smithi133.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-12-19T18:56:57.580 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-12-19T18:56:57.580 INFO:teuthology.orchestra.run.smithi133.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-12-19T18:56:57.581 INFO:teuthology.orchestra.run.smithi133.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-19T18:56:57.581 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages will be upgraded: 2023-12-19T18:56:57.582 INFO:teuthology.orchestra.run.smithi133.stdout: libssl3 2023-12-19T18:56:57.640 INFO:teuthology.orchestra.run.smithi133.stdout:1 upgraded, 39 newly installed, 0 to remove and 267 not upgraded. 2023-12-19T18:56:57.640 INFO:teuthology.orchestra.run.smithi133.stdout:Need to get 54.6 MB of archives. 2023-12-19T18:56:57.640 INFO:teuthology.orchestra.run.smithi133.stdout:After this operation, 202 MB of additional disk space will be used. 2023-12-19T18:56:57.640 INFO:teuthology.orchestra.run.smithi133.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-12-19T18:56:57.742 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-12-19T18:56:57.795 INFO:teuthology.orchestra.run.smithi133.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-12-19T18:56:57.803 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-12-19T18:56:57.804 INFO:teuthology.orchestra.run.smithi133.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-12-19T18:56:57.805 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-12-19T18:56:57.807 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-12-19T18:56:57.807 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2023-12-19T18:56:57.808 INFO:teuthology.orchestra.run.smithi133.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-12-19T18:56:57.809 INFO:teuthology.orchestra.run.smithi133.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-12-19T18:56:57.809 INFO:teuthology.orchestra.run.smithi133.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-12-19T18:56:57.814 INFO:teuthology.orchestra.run.smithi133.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-12-19T18:56:57.827 INFO:teuthology.orchestra.run.smithi133.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-12-19T18:56:57.830 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package bison. 2023-12-19T18:56:57.903 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140638 files and directories currently installed.) 2023-12-19T18:56:57.907 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-12-19T18:56:57.958 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-12-19T18:56:58.040 INFO:teuthology.orchestra.run.smithi133.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-12-19T18:56:58.042 INFO:teuthology.orchestra.run.smithi133.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-12-19T18:56:58.042 INFO:teuthology.orchestra.run.smithi133.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-12-19T18:56:58.045 INFO:teuthology.orchestra.run.smithi133.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-12-19T18:56:58.045 INFO:teuthology.orchestra.run.smithi133.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-12-19T18:56:58.050 INFO:teuthology.orchestra.run.smithi133.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2023-12-19T18:56:58.051 INFO:teuthology.orchestra.run.smithi133.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-12-19T18:56:58.058 INFO:teuthology.orchestra.run.smithi133.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-12-19T18:56:58.059 INFO:teuthology.orchestra.run.smithi133.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-12-19T18:56:58.080 INFO:teuthology.orchestra.run.smithi133.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-12-19T18:56:58.080 INFO:teuthology.orchestra.run.smithi133.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-12-19T18:56:58.090 INFO:teuthology.orchestra.run.smithi133.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-12-19T18:56:58.110 INFO:teuthology.orchestra.run.smithi133.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-12-19T18:56:58.114 INFO:teuthology.orchestra.run.smithi133.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-12-19T18:56:58.114 INFO:teuthology.orchestra.run.smithi133.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-12-19T18:56:58.115 INFO:teuthology.orchestra.run.smithi133.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-12-19T18:56:58.115 INFO:teuthology.orchestra.run.smithi133.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2023-12-19T18:56:58.127 INFO:teuthology.orchestra.run.smithi133.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-12-19T18:56:58.129 INFO:teuthology.orchestra.run.smithi133.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2023-12-19T18:56:58.273 INFO:teuthology.orchestra.run.smithi133.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-12-19T18:56:58.273 INFO:teuthology.orchestra.run.smithi133.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-12-19T18:56:58.273 INFO:teuthology.orchestra.run.smithi133.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-12-19T18:56:58.273 INFO:teuthology.orchestra.run.smithi133.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-12-19T18:56:58.274 INFO:teuthology.orchestra.run.smithi133.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-12-19T18:56:58.274 INFO:teuthology.orchestra.run.smithi133.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-12-19T18:56:58.286 INFO:teuthology.orchestra.run.smithi133.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-12-19T18:56:58.287 INFO:teuthology.orchestra.run.smithi133.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-12-19T18:56:58.384 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-19T18:56:58.398 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-12-19T18:56:58.442 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-12-19T18:56:58.683 INFO:teuthology.orchestra.run.smithi133.stdout:Preconfiguring packages ... 2023-12-19T18:56:58.796 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package dump. 2023-12-19T18:56:58.812 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-12-19T18:56:58.828 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 54.6 MB in 1s (78.3 MB/s) 2023-12-19T18:56:58.846 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking dump (0.4b47-3) ... 2023-12-19T18:56:58.970 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package flex. 2023-12-19T18:56:59.043 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140565 files and directories currently installed.) 2023-12-19T18:56:59.046 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-12-19T18:56:59.086 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking flex (2.6.4-8build2) ... 2023-12-19T18:56:59.108 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package indent. 2023-12-19T18:56:59.124 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-12-19T18:56:59.167 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-19T18:56:59.444 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-19T18:56:59.460 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-12-19T18:56:59.503 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-19T18:56:59.580 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-19T18:56:59.766 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-12-19T18:56:59.907 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-19T18:56:59.923 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2023-12-19T18:56:59.957 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-19T18:57:00.156 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-19T18:57:00.185 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-19T18:57:00.201 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-12-19T18:57:00.246 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-12-19T18:57:00.615 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libfl2:amd64. 2023-12-19T18:57:00.630 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-12-19T18:57:00.649 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package bison. 2023-12-19T18:57:00.672 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-12-19T18:57:00.722 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140638 files and directories currently installed.) 2023-12-19T18:57:00.726 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-12-19T18:57:00.768 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-12-19T18:57:00.925 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-12-19T18:57:00.941 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-12-19T18:57:00.983 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-19T18:57:01.202 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-19T18:57:01.217 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-12-19T18:57:01.236 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjson-perl. 2023-12-19T18:57:01.252 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-12-19T18:57:01.261 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-12-19T18:57:01.295 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-12-19T18:57:01.565 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libllvm14:amd64. 2023-12-19T18:57:01.580 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package dump. 2023-12-19T18:57:01.581 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-12-19T18:57:01.595 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-12-19T18:57:01.623 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-19T18:57:01.630 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking dump (0.4b47-3) ... 2023-12-19T18:57:01.892 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package indent. 2023-12-19T18:57:01.907 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-12-19T18:57:01.950 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-19T18:57:02.361 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-19T18:57:02.377 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-12-19T18:57:02.411 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-19T18:57:02.748 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-19T18:57:02.763 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2023-12-19T18:57:02.806 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-19T18:57:03.051 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-19T18:57:03.067 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T18:57:03.083 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-19T18:57:03.100 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-12-19T18:57:03.109 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T18:57:03.142 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-12-19T18:57:03.371 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-19T18:57:03.387 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T18:57:03.429 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T18:57:03.621 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libfl2:amd64. 2023-12-19T18:57:03.637 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-12-19T18:57:03.671 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-12-19T18:57:03.690 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-19T18:57:03.706 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-19T18:57:03.749 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T18:57:03.873 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-12-19T18:57:03.919 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-12-19T18:57:03.932 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-19T18:57:04.094 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-19T18:57:04.110 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-12-19T18:57:04.152 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-19T18:57:04.209 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libjson-perl. 2023-12-19T18:57:04.224 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-12-19T18:57:04.267 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-12-19T18:57:04.522 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-19T18:57:04.537 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-12-19T18:57:04.578 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libllvm14:amd64. 2023-12-19T18:57:04.580 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-19T18:57:04.594 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-12-19T18:57:04.637 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-19T18:57:04.900 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-19T18:57:04.915 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-19T18:57:04.958 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T18:57:05.295 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-19T18:57:05.311 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-19T18:57:05.362 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T18:57:05.682 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-19T18:57:05.697 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-19T18:57:05.731 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T18:57:05.959 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-19T18:57:05.964 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-19T18:57:05.974 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-19T18:57:05.981 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T18:57:06.014 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T18:57:06.017 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-19T18:57:06.233 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-19T18:57:06.249 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T18:57:06.292 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T18:57:06.505 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-19T18:57:06.520 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-12-19T18:57:06.563 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-12-19T18:57:06.627 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-19T18:57:06.642 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-19T18:57:06.686 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T18:57:06.900 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package modemmanager. 2023-12-19T18:57:06.915 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-19T18:57:06.950 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T18:57:07.030 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-19T18:57:07.046 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-12-19T18:57:07.105 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-19T18:57:07.399 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-19T18:57:07.415 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-12-19T18:57:07.449 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-19T18:57:07.565 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package network-manager. 2023-12-19T18:57:07.581 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-12-19T18:57:07.632 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-12-19T18:57:07.777 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-19T18:57:07.793 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-19T18:57:07.835 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T18:57:08.171 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-19T18:57:08.187 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-19T18:57:08.230 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T18:57:08.307 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ppp. 2023-12-19T18:57:08.323 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-12-19T18:57:08.540 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-19T18:57:08.561 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-19T18:57:08.632 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T18:57:08.679 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-12-19T18:57:08.876 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-19T18:57:08.892 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-19T18:57:08.934 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-19T18:57:09.012 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package pptp-linux. 2023-12-19T18:57:09.027 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-12-19T18:57:09.091 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-12-19T18:57:09.349 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-19T18:57:09.363 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-12-19T18:57:09.388 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-19T18:57:09.402 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-12-19T18:57:09.408 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-12-19T18:57:09.446 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-12-19T18:57:09.719 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-19T18:57:09.734 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-12-19T18:57:09.777 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-client-common (238) ... 2023-12-19T18:57:09.782 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package modemmanager. 2023-12-19T18:57:09.798 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-19T18:57:09.840 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T18:57:10.075 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-client-14. 2023-12-19T18:57:10.091 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-19T18:57:10.133 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T18:57:10.438 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package network-manager. 2023-12-19T18:57:10.454 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-12-19T18:57:10.496 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-12-19T18:57:10.746 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-common. 2023-12-19T18:57:10.762 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-12-19T18:57:10.823 INFO:teuthology.orchestra.run.smithi138.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-19T18:57:10.854 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-common (238) ... 2023-12-19T18:57:11.111 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ppp. 2023-12-19T18:57:11.127 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-12-19T18:57:11.328 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-14. 2023-12-19T18:57:11.344 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-19T18:57:11.389 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T18:57:11.471 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-12-19T18:57:11.799 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package pptp-linux. 2023-12-19T18:57:11.813 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-12-19T18:57:11.865 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-12-19T18:57:12.084 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-19T18:57:12.099 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-12-19T18:57:12.143 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-12-19T18:57:12.445 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-19T18:57:12.460 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-12-19T18:57:12.498 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql. 2023-12-19T18:57:12.504 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-client-common (238) ... 2023-12-19T18:57:12.512 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-12-19T18:57:12.565 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql (14+238) ... 2023-12-19T18:57:12.808 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-client. 2023-12-19T18:57:12.823 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-12-19T18:57:12.832 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-client-14. 2023-12-19T18:57:12.847 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-19T18:57:12.875 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-client (14+238) ... 2023-12-19T18:57:12.891 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T18:57:13.127 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-19T18:57:13.142 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-12-19T18:57:13.185 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking postgresql-contrib (14+238) ... 2023-12-19T18:57:13.437 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-common. 2023-12-19T18:57:13.452 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-12-19T18:57:13.496 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package tcl8.6. 2023-12-19T18:57:13.511 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-12-19T18:57:13.513 INFO:teuthology.orchestra.run.smithi133.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-19T18:57:13.535 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-common (238) ... 2023-12-19T18:57:13.546 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-19T18:57:13.807 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package tcl. 2023-12-19T18:57:13.823 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-12-19T18:57:13.870 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-12-19T18:57:14.154 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-14. 2023-12-19T18:57:14.169 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-19T18:57:14.240 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T18:57:14.251 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package wpasupplicant. 2023-12-19T18:57:14.267 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-12-19T18:57:14.310 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-19T18:57:14.658 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-19T18:57:14.673 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-12-19T18:57:14.714 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-12-19T18:57:15.092 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-19T18:57:15.108 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-12-19T18:57:15.159 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-19T18:57:15.206 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql. 2023-12-19T18:57:15.221 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-12-19T18:57:15.256 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql (14+238) ... 2023-12-19T18:57:15.469 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-client-common (238) ... 2023-12-19T18:57:15.483 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-client. 2023-12-19T18:57:15.497 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-12-19T18:57:15.541 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-client (14+238) ... 2023-12-19T18:57:15.681 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up flex (2.6.4-8build2) ... 2023-12-19T18:57:15.818 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-19T18:57:15.819 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-19T18:57:15.833 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-12-19T18:57:15.885 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking postgresql-contrib (14+238) ... 2023-12-19T18:57:15.942 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T18:57:16.067 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-12-19T18:57:16.193 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-19T18:57:16.204 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package tcl8.6. 2023-12-19T18:57:16.219 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-12-19T18:57:16.263 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-19T18:57:16.294 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T18:57:16.607 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package tcl. 2023-12-19T18:57:16.622 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-12-19T18:57:16.661 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-12-19T18:57:16.993 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package wpasupplicant. 2023-12-19T18:57:17.008 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-12-19T18:57:17.084 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-19T18:57:17.304 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-19T18:57:17.408 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-19T18:57:17.430 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-19T18:57:17.446 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-12-19T18:57:17.488 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-12-19T18:57:17.788 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-19T18:57:17.788 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-19T18:57:17.875 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-19T18:57:17.891 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-12-19T18:57:17.941 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-19T18:57:18.218 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-client-common (238) ... 2023-12-19T18:57:18.430 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up flex (2.6.4-8build2) ... 2023-12-19T18:57:18.503 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-12-19T18:57:18.606 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-19T18:57:18.629 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-19T18:57:18.732 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T18:57:18.755 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-12-19T18:57:18.881 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-12-19T18:57:19.040 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-12-19T18:57:19.141 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-19T18:57:19.259 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-12-19T18:57:19.318 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-12-19T18:57:19.419 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-19T18:57:19.528 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T18:57:19.981 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-19T18:57:20.098 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up dump (0.4b47-3) ... 2023-12-19T18:57:20.219 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-19T18:57:20.275 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T18:57:20.393 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-19T18:57:20.518 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up tcl (8.6.11+1build2) ... 2023-12-19T18:57:20.534 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-19T18:57:20.625 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-19T18:57:20.644 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjson-perl (4.04000-1) ... 2023-12-19T18:57:20.770 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-12-19T18:57:20.860 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-12-19T18:57:20.930 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-19T18:57:21.012 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-19T18:57:21.012 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-19T18:57:21.056 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-19T18:57:21.224 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-19T18:57:21.325 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T18:57:21.468 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-12-19T18:57:21.644 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-client (14+238) ... 2023-12-19T18:57:21.686 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-12-19T18:57:21.770 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-12-19T18:57:21.829 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-19T18:57:21.955 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-12-19T18:57:22.081 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-12-19T18:57:22.207 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-12-19T18:57:22.333 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-19T18:57:22.354 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:22.354 INFO:teuthology.orchestra.run.smithi138.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-19T18:57:22.354 INFO:teuthology.orchestra.run.smithi138.stdout:which means they are currently configured by ifupdown: 2023-12-19T18:57:22.354 INFO:teuthology.orchestra.run.smithi138.stdout:- enp3s0f1 2023-12-19T18:57:22.354 INFO:teuthology.orchestra.run.smithi138.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-19T18:57:22.354 INFO:teuthology.orchestra.run.smithi138.stdout:remove their configuration from /etc/network/interfaces. 2023-12-19T18:57:22.354 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:22.459 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-12-19T18:57:22.485 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-19T18:57:22.887 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-19T18:57:23.106 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-19T18:57:23.232 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up dump (0.4b47-3) ... 2023-12-19T18:57:23.291 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-19T18:57:23.327 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-19T18:57:23.392 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T18:57:23.526 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-19T18:57:23.652 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up tcl (8.6.11+1build2) ... 2023-12-19T18:57:23.778 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libjson-perl (4.04000-1) ... 2023-12-19T18:57:23.896 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-12-19T18:57:23.977 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-12-19T18:57:24.022 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T18:57:24.047 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-19T18:57:24.166 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-19T18:57:24.223 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-19T18:57:24.284 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-12-19T18:57:24.393 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-common (238) ... 2023-12-19T18:57:24.408 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-19T18:57:24.533 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T18:57:24.659 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-12-19T18:57:24.836 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-client (14+238) ... 2023-12-19T18:57:24.962 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-12-19T18:57:25.339 INFO:teuthology.orchestra.run.smithi138.stdout:Adding user postgres to group ssl-cert 2023-12-19T18:57:25.549 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:25.550 INFO:teuthology.orchestra.run.smithi133.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-19T18:57:25.550 INFO:teuthology.orchestra.run.smithi133.stdout:which means they are currently configured by ifupdown: 2023-12-19T18:57:25.550 INFO:teuthology.orchestra.run.smithi133.stdout:- enp3s0f1 2023-12-19T18:57:25.550 INFO:teuthology.orchestra.run.smithi133.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-19T18:57:25.550 INFO:teuthology.orchestra.run.smithi133.stdout:remove their configuration from /etc/network/interfaces. 2023-12-19T18:57:25.550 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:25.602 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:25.602 INFO:teuthology.orchestra.run.smithi138.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-19T18:57:25.684 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-19T18:57:25.883 INFO:teuthology.orchestra.run.smithi138.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-19T18:57:25.883 INFO:teuthology.orchestra.run.smithi138.stdout:Removing obsolete dictionary files: 2023-12-19T18:57:26.081 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-19T18:57:26.488 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-19T18:57:26.591 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-19T18:57:27.036 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T18:57:27.189 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-19T18:57:27.341 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-19T18:57:27.424 INFO:teuthology.orchestra.run.smithi138.stdout:Creating new PostgreSQL cluster 14/main ... 2023-12-19T18:57:27.447 INFO:teuthology.orchestra.run.smithi138.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-12-19T18:57:27.475 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-12-19T18:57:27.498 INFO:teuthology.orchestra.run.smithi138.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-19T18:57:27.498 INFO:teuthology.orchestra.run.smithi138.stdout:This user must also own the server process. 2023-12-19T18:57:27.499 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:27.499 INFO:teuthology.orchestra.run.smithi138.stdout:The database cluster will be initialized with locale "en_US". 2023-12-19T18:57:27.499 INFO:teuthology.orchestra.run.smithi138.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-19T18:57:27.499 INFO:teuthology.orchestra.run.smithi138.stdout:The default text search configuration will be set to "english". 2023-12-19T18:57:27.499 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:27.499 INFO:teuthology.orchestra.run.smithi138.stdout:Data page checksums are disabled. 2023-12-19T18:57:27.499 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:27.499 INFO:teuthology.orchestra.run.smithi138.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-12-19T18:57:27.500 INFO:teuthology.orchestra.run.smithi138.stdout:creating subdirectories ... ok 2023-12-19T18:57:27.500 INFO:teuthology.orchestra.run.smithi138.stdout:selecting dynamic shared memory implementation ... posix 2023-12-19T18:57:27.524 INFO:teuthology.orchestra.run.smithi138.stdout:selecting default max_connections ... 100 2023-12-19T18:57:27.560 INFO:teuthology.orchestra.run.smithi138.stdout:selecting default shared_buffers ... 128MB 2023-12-19T18:57:27.573 INFO:teuthology.orchestra.run.smithi138.stdout:selecting default time zone ... Etc/UTC 2023-12-19T18:57:27.574 INFO:teuthology.orchestra.run.smithi138.stdout:creating configuration files ... ok 2023-12-19T18:57:27.600 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-common (238) ... 2023-12-19T18:57:27.744 INFO:teuthology.orchestra.run.smithi138.stdout:running bootstrap script ... ok 2023-12-19T18:57:28.382 INFO:teuthology.orchestra.run.smithi138.stdout:performing post-bootstrap initialization ... ok 2023-12-19T18:57:28.515 INFO:teuthology.orchestra.run.smithi133.stdout:Adding user postgres to group ssl-cert 2023-12-19T18:57:28.765 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:28.765 INFO:teuthology.orchestra.run.smithi133.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-19T18:57:29.009 INFO:teuthology.orchestra.run.smithi138.stdout:syncing data to disk ... ok 2023-12-19T18:57:29.040 INFO:teuthology.orchestra.run.smithi133.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-19T18:57:29.040 INFO:teuthology.orchestra.run.smithi133.stdout:Removing obsolete dictionary files: 2023-12-19T18:57:29.566 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-19T18:57:29.742 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-19T18:57:30.202 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-19T18:57:30.544 INFO:teuthology.orchestra.run.smithi133.stdout:Creating new PostgreSQL cluster 14/main ... 2023-12-19T18:57:30.582 INFO:teuthology.orchestra.run.smithi133.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-12-19T18:57:30.638 INFO:teuthology.orchestra.run.smithi133.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-19T18:57:30.638 INFO:teuthology.orchestra.run.smithi133.stdout:This user must also own the server process. 2023-12-19T18:57:30.638 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:30.638 INFO:teuthology.orchestra.run.smithi133.stdout:The database cluster will be initialized with locale "en_US". 2023-12-19T18:57:30.639 INFO:teuthology.orchestra.run.smithi133.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-19T18:57:30.639 INFO:teuthology.orchestra.run.smithi133.stdout:The default text search configuration will be set to "english". 2023-12-19T18:57:30.639 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:30.639 INFO:teuthology.orchestra.run.smithi133.stdout:Data page checksums are disabled. 2023-12-19T18:57:30.639 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:30.639 INFO:teuthology.orchestra.run.smithi133.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-12-19T18:57:30.640 INFO:teuthology.orchestra.run.smithi133.stdout:creating subdirectories ... ok 2023-12-19T18:57:30.640 INFO:teuthology.orchestra.run.smithi133.stdout:selecting dynamic shared memory implementation ... posix 2023-12-19T18:57:30.664 INFO:teuthology.orchestra.run.smithi133.stdout:selecting default max_connections ... 100 2023-12-19T18:57:30.700 INFO:teuthology.orchestra.run.smithi133.stdout:selecting default shared_buffers ... 128MB 2023-12-19T18:57:30.713 INFO:teuthology.orchestra.run.smithi133.stdout:selecting default time zone ... Etc/UTC 2023-12-19T18:57:30.714 INFO:teuthology.orchestra.run.smithi133.stdout:creating configuration files ... ok 2023-12-19T18:57:30.882 INFO:teuthology.orchestra.run.smithi133.stdout:running bootstrap script ... ok 2023-12-19T18:57:31.537 INFO:teuthology.orchestra.run.smithi133.stdout:performing post-bootstrap initialization ... ok 2023-12-19T18:57:32.036 INFO:teuthology.orchestra.run.smithi133.stdout:syncing data to disk ... ok 2023-12-19T18:57:32.552 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-19T18:57:32.752 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T18:57:32.869 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql-contrib (14+238) ... 2023-12-19T18:57:32.987 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up postgresql (14+238) ... 2023-12-19T18:57:33.096 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T18:57:33.231 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T18:57:33.492 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-19T18:57:33.492 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-19T18:57:34.225 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-19T18:57:34.535 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-19T18:57:34.686 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-19T18:57:35.509 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T18:57:35.643 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql-contrib (14+238) ... 2023-12-19T18:57:35.769 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up postgresql (14+238) ... 2023-12-19T18:57:35.887 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-19T18:57:35.988 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-19T18:57:36.097 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-12-19T18:57:36.198 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-19T18:57:36.249 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-19T18:57:36.249 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-19T18:57:36.749 INFO:teuthology.orchestra.run.smithi138.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-19T18:57:36.757 DEBUG:teuthology.parallel:result is None 2023-12-19T18:57:36.982 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-19T18:57:37.284 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-19T18:57:37.446 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-19T18:57:38.848 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-12-19T18:57:38.948 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-19T18:57:39.477 INFO:teuthology.orchestra.run.smithi133.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-19T18:57:39.484 DEBUG:teuthology.parallel:result is None 2023-12-19T18:57:39.484 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-19T18:57:39.639 DEBUG:teuthology.orchestra.run.smithi133:> dpkg-query -W -f '${Version}' ceph 2023-12-19T18:57:39.662 INFO:teuthology.orchestra.run.smithi133.stdout:19.0.0-202-gc7586e95-1jammy 2023-12-19T18:57:39.663 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-202-gc7586e95-1jammy 2023-12-19T18:57:39.663 INFO:teuthology.task.install:The correct ceph version 19.0.0-202-gc7586e95-1jammy is installed. 2023-12-19T18:57:39.666 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c7586e95519b7be76f3b6e3a4b333888baf46bc9 2023-12-19T18:57:39.895 DEBUG:teuthology.orchestra.run.smithi138:> dpkg-query -W -f '${Version}' ceph 2023-12-19T18:57:39.919 INFO:teuthology.orchestra.run.smithi138.stdout:19.0.0-202-gc7586e95-1jammy 2023-12-19T18:57:39.919 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-202-gc7586e95-1jammy 2023-12-19T18:57:39.919 INFO:teuthology.task.install:The correct ceph version 19.0.0-202-gc7586e95-1jammy is installed. 2023-12-19T18:57:39.921 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-19T18:57:39.921 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:57:39.921 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-19T18:57:39.944 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:57:39.944 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-19T18:57:39.984 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-19T18:57:39.985 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:57:39.986 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/daemon-helper 2023-12-19T18:57:40.009 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-19T18:57:40.069 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:57:40.069 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/daemon-helper 2023-12-19T18:57:40.091 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-19T18:57:40.154 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-19T18:57:40.155 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:57:40.155 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-19T18:57:40.174 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-19T18:57:40.241 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:57:40.241 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-19T18:57:40.263 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-19T18:57:40.325 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-19T18:57:40.326 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:57:40.326 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/stdin-killer 2023-12-19T18:57:40.345 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-19T18:57:40.405 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:57:40.405 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/stdin-killer 2023-12-19T18:57:40.427 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-19T18:57:40.491 INFO:teuthology.run_tasks:Running task ceph... 2023-12-19T18:57:40.568 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-19T18:57:40.568 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 777 /var/log/ceph 2023-12-19T18:57:40.572 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 777 /var/log/ceph 2023-12-19T18:57:40.593 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-19T18:57:40.593 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-19T18:57:40.633 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-19T18:57:40.658 INFO:tasks.ceph:Creating extra log directories... 2023-12-19T18:57:40.658 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-19T18:57:40.693 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-19T18:57:40.729 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-19T18:57:40.730 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-19T18:57:40.730 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-19T18:57:40.730 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:57:40.730 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-19T18:57:40.762 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-19T18:57:40.852 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:57:40.852 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-19T18:57:40.861 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-19T18:57:40.962 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-19T18:57:40.962 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-19T18:57:40.963 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497300', 'branch': 'wip-yuri8-testing-2023-12-15-0911', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}', 'email': None, 'first_in_suite': False, 'job_id': '7497300', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri8-testing-2023-12-15-0911'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri8-testing-2023-12-15-0911', 'sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 2960, 'sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri8-testing-2023-12-15-0911', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi133.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOiwAvMPqBpBT7+At01rwE1NfuL/yZnpe8bVCaNZkmAa8nNUD2uKTh04rt0lDa3nJ45uG412tRYK9uCA7+yz1I8=', 'smithi138.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDxgT3ZvKLV/Q68TqGAzAD69RmTsjiuEKXKuXDAL4WWESBTXsOez31TH+mGPRA2H2xO5NiDqWA0paTMeJMW3GvQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'c7586e95519b7be76f3b6e3a4b333888baf46bc9', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_multifs_auth']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-19_15:49:15', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-19T18:57:40.963 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-19T18:57:40.967 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-19T18:57:40.977 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/run/ceph 2023-12-19T18:57:41.017 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/run/ceph 2023-12-19T18:57:41.042 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:57:41.042 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/scratch_devs of=/dev/stdout 2023-12-19T18:57:41.082 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-19T18:57:41.082 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_1 2023-12-19T18:57:41.134 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-19T18:57:41.134 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T18:57:41.134 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 898 Links: 1 2023-12-19T18:57:41.134 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T18:57:41.134 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-12-19 18:51:16.608863834 +0000 2023-12-19T18:57:41.134 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-12-19 18:51:16.228867228 +0000 2023-12-19T18:57:41.134 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-12-19 18:51:16.228867228 +0000 2023-12-19T18:57:41.134 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2023-12-19 18:51:16.228867228 +0000 2023-12-19T18:57:41.135 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-19T18:57:41.195 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-12-19T18:57:41.195 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-12-19T18:57:41.195 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000362791 s, 1.4 MB/s 2023-12-19T18:57:41.197 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-19T18:57:41.250 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_2 2023-12-19T18:57:41.302 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-19T18:57:41.302 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T18:57:41.302 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 918 Links: 1 2023-12-19T18:57:41.302 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T18:57:41.302 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-12-19 18:51:17.252858080 +0000 2023-12-19T18:57:41.302 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-12-19 18:51:16.860861583 +0000 2023-12-19T18:57:41.302 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-12-19 18:51:16.860861583 +0000 2023-12-19T18:57:41.302 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2023-12-19 18:51:16.860861583 +0000 2023-12-19T18:57:41.303 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-19T18:57:41.363 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-12-19T18:57:41.364 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-12-19T18:57:41.364 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000346383 s, 1.5 MB/s 2023-12-19T18:57:41.365 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-19T18:57:41.415 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_3 2023-12-19T18:57:41.466 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-19T18:57:41.466 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T18:57:41.466 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 935 Links: 1 2023-12-19T18:57:41.466 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T18:57:41.467 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-12-19 18:51:18.104850471 +0000 2023-12-19T18:57:41.467 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-12-19 18:51:17.708854007 +0000 2023-12-19T18:57:41.467 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-12-19 18:51:17.708854007 +0000 2023-12-19T18:57:41.467 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2023-12-19 18:51:17.708854007 +0000 2023-12-19T18:57:41.468 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-19T18:57:41.527 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-12-19T18:57:41.527 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-12-19T18:57:41.527 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000349053 s, 1.5 MB/s 2023-12-19T18:57:41.529 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-19T18:57:41.584 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_4 2023-12-19T18:57:41.634 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-19T18:57:41.634 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T18:57:41.634 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 5h/5d Inode: 950 Links: 1 2023-12-19T18:57:41.634 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T18:57:41.634 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-12-19 18:51:18.776844468 +0000 2023-12-19T18:57:41.634 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-12-19 18:51:18.368848112 +0000 2023-12-19T18:57:41.635 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-12-19 18:51:18.368848112 +0000 2023-12-19T18:57:41.635 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: 2023-12-19 18:51:18.368848112 +0000 2023-12-19T18:57:41.635 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-19T18:57:41.695 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-12-19T18:57:41.696 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-12-19T18:57:41.696 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000345349 s, 1.5 MB/s 2023-12-19T18:57:41.697 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-19T18:57:41.748 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T18:57:41.748 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:57:41.749 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/scratch_devs of=/dev/stdout 2023-12-19T18:57:41.759 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-19T18:57:41.759 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_1 2023-12-19T18:57:41.811 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-19T18:57:41.811 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T18:57:41.811 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 887 Links: 1 2023-12-19T18:57:41.811 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T18:57:41.811 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2023-12-19 18:51:16.618949956 +0000 2023-12-19T18:57:41.811 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2023-12-19 18:51:16.218953529 +0000 2023-12-19T18:57:41.811 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2023-12-19 18:51:16.218953529 +0000 2023-12-19T18:57:41.811 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2023-12-19 18:51:16.218953529 +0000 2023-12-19T18:57:41.811 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-19T18:57:41.873 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2023-12-19T18:57:41.873 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2023-12-19T18:57:41.873 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000380315 s, 1.3 MB/s 2023-12-19T18:57:41.875 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-19T18:57:41.929 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_2 2023-12-19T18:57:41.982 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-19T18:57:41.982 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T18:57:41.983 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 901 Links: 1 2023-12-19T18:57:41.983 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T18:57:41.983 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2023-12-19 18:51:17.310943775 +0000 2023-12-19T18:57:41.983 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2023-12-19 18:51:16.878947634 +0000 2023-12-19T18:57:41.983 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2023-12-19 18:51:16.878947634 +0000 2023-12-19T18:57:41.983 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2023-12-19 18:51:16.878947634 +0000 2023-12-19T18:57:41.983 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-19T18:57:42.045 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2023-12-19T18:57:42.045 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2023-12-19T18:57:42.045 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000402117 s, 1.3 MB/s 2023-12-19T18:57:42.047 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-19T18:57:42.100 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_3 2023-12-19T18:57:42.151 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-19T18:57:42.151 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T18:57:42.151 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 918 Links: 1 2023-12-19T18:57:42.151 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T18:57:42.151 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2023-12-19 18:51:17.570941453 +0000 2023-12-19T18:57:42.151 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2023-12-19 18:51:17.566941489 +0000 2023-12-19T18:57:42.151 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2023-12-19 18:51:17.566941489 +0000 2023-12-19T18:57:42.151 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2023-12-19 18:51:17.566941489 +0000 2023-12-19T18:57:42.152 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-19T18:57:42.218 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2023-12-19T18:57:42.218 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2023-12-19T18:57:42.218 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000401591 s, 1.3 MB/s 2023-12-19T18:57:42.220 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-19T18:57:42.275 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_4 2023-12-19T18:57:42.330 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-19T18:57:42.330 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T18:57:42.330 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 937 Links: 1 2023-12-19T18:57:42.330 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T18:57:42.331 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2023-12-19 18:51:18.666931663 +0000 2023-12-19T18:57:42.331 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2023-12-19 18:51:18.278935129 +0000 2023-12-19T18:57:42.331 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2023-12-19 18:51:18.278935129 +0000 2023-12-19T18:57:42.331 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: 2023-12-19 18:51:18.278935129 +0000 2023-12-19T18:57:42.331 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-19T18:57:42.393 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2023-12-19T18:57:42.393 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2023-12-19T18:57:42.394 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000399345 s, 1.3 MB/s 2023-12-19T18:57:42.395 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-19T18:57:42.448 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T18:57:42.448 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-19T18:57:42.449 INFO:tasks.ceph:Generating config... 2023-12-19T18:57:42.450 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-19T18:57:42.450 INFO:tasks.ceph:[client] debug client = 20 2023-12-19T18:57:42.450 INFO:tasks.ceph:[client] debug ms = 1 2023-12-19T18:57:42.450 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-19T18:57:42.450 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-19T18:57:42.450 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-12-19T18:57:42.450 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-19T18:57:42.450 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-19T18:57:42.450 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-19T18:57:42.450 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-19T18:57:42.450 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-19T18:57:42.451 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-19T18:57:42.451 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-19T18:57:42.451 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-19T18:57:42.451 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-19T18:57:42.451 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-19T18:57:42.451 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-19T18:57:42.451 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-19T18:57:42.451 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-19T18:57:42.451 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-19T18:57:42.451 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-19T18:57:42.451 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-19T18:57:42.451 INFO:tasks.ceph:[osd] bdev async discard = True 2023-12-19T18:57:42.451 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-12-19T18:57:42.451 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-12-19T18:57:42.451 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-19T18:57:42.451 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-19T18:57:42.452 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-12-19T18:57:42.452 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-12-19T18:57:42.452 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-19T18:57:42.452 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-19T18:57:42.452 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-12-19T18:57:42.452 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-19T18:57:42.452 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-19T18:57:42.452 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-19T18:57:42.452 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-19T18:57:42.452 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-19T18:57:42.452 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-19T18:57:42.453 INFO:tasks.ceph:Setting up mon.a... 2023-12-19T18:57:42.453 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-19T18:57:42.500 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.keyring 2023-12-19T18:57:42.518 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-19T18:57:42.609 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T18:57:42.675 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.133'), ('mon.b', '172.21.15.138'), ('mon.c', '[v2:172.21.15.138:3301,v1:172.21.15.138:6790]')] 2023-12-19T18:57:42.675 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.133,172.21.15.138,[v2:172.21.15.138:3301,v1:172.21.15.138:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-19T18:57:42.676 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:57:42.676 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-19T18:57:42.726 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.133 --add b 172.21.15.138 --addv c '[v2:172.21.15.138:3301,v1:172.21.15.138:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-19T18:57:42.816 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-19T18:57:42.816 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: generated fsid 03e63958-005e-4bf2-ae5b-291aceb6fbbf 2023-12-19T18:57:42.816 INFO:teuthology.orchestra.run.smithi133.stdout:setting min_mon_release = pacific 2023-12-19T18:57:42.816 INFO:teuthology.orchestra.run.smithi133.stdout:epoch 0 2023-12-19T18:57:42.816 INFO:teuthology.orchestra.run.smithi133.stdout:fsid 03e63958-005e-4bf2-ae5b-291aceb6fbbf 2023-12-19T18:57:42.816 INFO:teuthology.orchestra.run.smithi133.stdout:last_changed 2023-12-19T18:57:42.816829+0000 2023-12-19T18:57:42.816 INFO:teuthology.orchestra.run.smithi133.stdout:created 2023-12-19T18:57:42.816829+0000 2023-12-19T18:57:42.817 INFO:teuthology.orchestra.run.smithi133.stdout:min_mon_release 16 (pacific) 2023-12-19T18:57:42.817 INFO:teuthology.orchestra.run.smithi133.stdout:election_strategy: 1 2023-12-19T18:57:42.817 INFO:teuthology.orchestra.run.smithi133.stdout:0: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.a 2023-12-19T18:57:42.817 INFO:teuthology.orchestra.run.smithi133.stdout:1: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.b 2023-12-19T18:57:42.817 INFO:teuthology.orchestra.run.smithi133.stdout:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2023-12-19T18:57:42.817 INFO:teuthology.orchestra.run.smithi133.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-19T18:57:42.819 DEBUG:teuthology.orchestra.run.smithi133:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-19T18:57:42.827 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 03e63958-005e-4bf2-ae5b-291aceb6fbbf... 2023-12-19T18:57:42.828 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T18:57:42.880 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T18:57:42.914 INFO:teuthology.orchestra.run.smithi133.stdout:[global] 2023-12-19T18:57:42.915 INFO:teuthology.orchestra.run.smithi133.stdout: chdir = "" 2023-12-19T18:57:42.915 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T18:57:42.915 INFO:teuthology.orchestra.run.smithi133.stdout: auth supported = cephx 2023-12-19T18:57:42.915 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.915 INFO:teuthology.orchestra.run.smithi133.stdout: filestore xattr use omap = true 2023-12-19T18:57:42.915 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.915 INFO:teuthology.orchestra.run.smithi133.stdout: mon clock drift allowed = 1.000 2023-12-19T18:57:42.915 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.915 INFO:teuthology.orchestra.run.smithi133.stdout: osd crush chooseleaf type = 0 2023-12-19T18:57:42.915 INFO:teuthology.orchestra.run.smithi133.stdout: auth debug = true 2023-12-19T18:57:42.915 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.915 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on old message = true 2023-12-19T18:57:42.915 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on bug = true 2023-12-19T18:57:42.916 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.916 INFO:teuthology.orchestra.run.smithi133.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T18:57:42.916 INFO:teuthology.orchestra.run.smithi133.stdout: mon pg warn max object skew = 0 2023-12-19T18:57:42.916 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.916 INFO:teuthology.orchestra.run.smithi133.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T18:57:42.916 INFO:teuthology.orchestra.run.smithi133.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T18:57:42.916 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.916 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default size = 2 2023-12-19T18:57:42.916 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.916 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow primary affinity = true 2023-12-19T18:57:42.916 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow pg remap = true 2023-12-19T18:57:42.916 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on legacy crush tunables = false 2023-12-19T18:57:42.916 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on crush straw calc version zero = false 2023-12-19T18:57:42.916 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on no sortbitwise = false 2023-12-19T18:57:42.916 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on osd down out interval zero = false 2023-12-19T18:57:42.917 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on too few osds = false 2023-12-19T18:57:42.917 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T18:57:42.917 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T18:57:42.917 INFO:teuthology.orchestra.run.smithi133.stdout: mon_allow_pool_size_one = true 2023-12-19T18:57:42.917 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.917 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T18:57:42.917 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.917 INFO:teuthology.orchestra.run.smithi133.stdout: osd default data pool replay window = 5 2023-12-19T18:57:42.917 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.917 INFO:teuthology.orchestra.run.smithi133.stdout: mon allow pool delete = true 2023-12-19T18:57:42.917 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.917 INFO:teuthology.orchestra.run.smithi133.stdout: mon cluster log file level = debug 2023-12-19T18:57:42.917 INFO:teuthology.orchestra.run.smithi133.stdout: debug asserts on shutdown = true 2023-12-19T18:57:42.917 INFO:teuthology.orchestra.run.smithi133.stdout: mon health detail to clog = false 2023-12-19T18:57:42.918 INFO:teuthology.orchestra.run.smithi133.stdout: mon host = "172.21.15.133,172.21.15.138,[v2:172.21.15.138:3301,v1:172.21.15.138:6790]" 2023-12-19T18:57:42.918 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on skipped message = False 2023-12-19T18:57:42.918 INFO:teuthology.orchestra.run.smithi133.stdout: fsid = 03e63958-005e-4bf2-ae5b-291aceb6fbbf 2023-12-19T18:57:42.918 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.918 INFO:teuthology.orchestra.run.smithi133.stdout:[osd] 2023-12-19T18:57:42.918 INFO:teuthology.orchestra.run.smithi133.stdout: osd journal size = 100 2023-12-19T18:57:42.918 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.918 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub load threshold = 5.0 2023-12-19T18:57:42.919 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub max interval = 600 2023-12-19T18:57:42.919 INFO:teuthology.orchestra.run.smithi133.stdout: osd mclock profile = high_recovery_ops 2023-12-19T18:57:42.919 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.919 INFO:teuthology.orchestra.run.smithi133.stdout: osd recover clone overlap = true 2023-12-19T18:57:42.919 INFO:teuthology.orchestra.run.smithi133.stdout: osd recovery max chunk = 1048576 2023-12-19T18:57:42.919 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.919 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug shutdown = true 2023-12-19T18:57:42.919 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug op order = true 2023-12-19T18:57:42.919 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug verify stray on activate = true 2023-12-19T18:57:42.919 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug trim objects = true 2023-12-19T18:57:42.919 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.919 INFO:teuthology.orchestra.run.smithi133.stdout: osd open classes on start = true 2023-12-19T18:57:42.919 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug pg log writeout = true 2023-12-19T18:57:42.919 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.919 INFO:teuthology.orchestra.run.smithi133.stdout: osd deep scrub update digest min age = 30 2023-12-19T18:57:42.920 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.920 INFO:teuthology.orchestra.run.smithi133.stdout: osd map max advance = 10 2023-12-19T18:57:42.920 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.920 INFO:teuthology.orchestra.run.smithi133.stdout: journal zero on create = true 2023-12-19T18:57:42.920 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.920 INFO:teuthology.orchestra.run.smithi133.stdout: filestore ondisk finisher threads = 3 2023-12-19T18:57:42.920 INFO:teuthology.orchestra.run.smithi133.stdout: filestore apply finisher threads = 3 2023-12-19T18:57:42.920 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.920 INFO:teuthology.orchestra.run.smithi133.stdout: bdev debug aio = true 2023-12-19T18:57:42.921 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug misdirected ops = true 2023-12-19T18:57:42.921 INFO:teuthology.orchestra.run.smithi133.stdout: bdev async discard = True 2023-12-19T18:57:42.921 INFO:teuthology.orchestra.run.smithi133.stdout: bdev enable discard = True 2023-12-19T18:57:42.921 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore allocator = bitmap 2023-12-19T18:57:42.921 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore block size = 96636764160 2023-12-19T18:57:42.921 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore fsck on mount = True 2023-12-19T18:57:42.921 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluefs = 1/20 2023-12-19T18:57:42.921 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluestore = 1/20 2023-12-19T18:57:42.921 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-12-19T18:57:42.921 INFO:teuthology.orchestra.run.smithi133.stdout: debug osd = 20 2023-12-19T18:57:42.921 INFO:teuthology.orchestra.run.smithi133.stdout: debug rocksdb = 4/10 2023-12-19T18:57:42.921 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T18:57:42.922 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd full ratio = 0.9 2023-12-19T18:57:42.922 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd nearfull ratio = 0.8 2023-12-19T18:57:42.922 INFO:teuthology.orchestra.run.smithi133.stdout: osd failsafe full ratio = 0.95 2023-12-19T18:57:42.922 INFO:teuthology.orchestra.run.smithi133.stdout: osd objectstore = bluestore 2023-12-19T18:57:42.922 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2023-12-19T18:57:42.922 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.922 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr] 2023-12-19T18:57:42.922 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-12-19T18:57:42.923 INFO:teuthology.orchestra.run.smithi133.stdout: debug mgr = 20 2023-12-19T18:57:42.923 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2023-12-19T18:57:42.923 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2023-12-19T18:57:42.923 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:57:42.923 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:57:42.923 INFO:teuthology.orchestra.run.smithi133.stdout: mgr/telemetry/nag = false 2023-12-19T18:57:42.923 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.923 INFO:teuthology.orchestra.run.smithi133.stdout:[mon] 2023-12-19T18:57:42.923 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-12-19T18:57:42.923 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2023-12-19T18:57:42.923 INFO:teuthology.orchestra.run.smithi133.stdout: debug paxos = 20 2023-12-19T18:57:42.923 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2023-12-19T18:57:42.923 INFO:teuthology.orchestra.run.smithi133.stdout: mon data avail warn = 5 2023-12-19T18:57:42.924 INFO:teuthology.orchestra.run.smithi133.stdout: mon mgr mkfs grace = 240 2023-12-19T18:57:42.924 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:57:42.924 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd reporter subtree level = osd 2023-12-19T18:57:42.924 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd prime pg temp = true 2023-12-19T18:57:42.924 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:57:42.924 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.924 INFO:teuthology.orchestra.run.smithi133.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T18:57:42.925 INFO:teuthology.orchestra.run.smithi133.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T18:57:42.925 INFO:teuthology.orchestra.run.smithi133.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T18:57:42.925 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.925 INFO:teuthology.orchestra.run.smithi133.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T18:57:42.925 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T18:57:42.925 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T18:57:42.926 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.926 INFO:teuthology.orchestra.run.smithi133.stdout: # 1m isn't quite enough 2023-12-19T18:57:42.926 INFO:teuthology.orchestra.run.smithi133.stdout: mon_down_mkfs_grace = 2m 2023-12-19T18:57:42.926 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.926 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_filestore_osds = false 2023-12-19T18:57:42.926 INFO:teuthology.orchestra.run.smithi133.stdout: mon op complaint time = 120 2023-12-19T18:57:42.926 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:57:42.926 INFO:teuthology.orchestra.run.smithi133.stdout:[client] 2023-12-19T18:57:42.927 INFO:teuthology.orchestra.run.smithi133.stdout: rgw cache enabled = true 2023-12-19T18:57:42.927 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable ops log = true 2023-12-19T18:57:42.927 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable usage log = true 2023-12-19T18:57:42.927 INFO:teuthology.orchestra.run.smithi133.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T18:57:42.927 INFO:teuthology.orchestra.run.smithi133.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T18:57:42.927 INFO:teuthology.orchestra.run.smithi133.stdout: client mount timeout = 600 2023-12-19T18:57:42.927 INFO:teuthology.orchestra.run.smithi133.stdout: debug client = 20 2023-12-19T18:57:42.927 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-12-19T18:57:42.927 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 900 2023-12-19T18:57:42.928 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 900 2023-12-19T18:57:42.928 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.a] 2023-12-19T18:57:42.928 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.b] 2023-12-19T18:57:42.928 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.c] 2023-12-19T18:57:42.928 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2023-12-19T18:57:42.928 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2023-12-19T18:57:42.928 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2023-12-19T18:57:42.928 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.d] 2023-12-19T18:57:42.928 INFO:teuthology.orchestra.run.smithi133.stdout:[mds] 2023-12-19T18:57:42.929 INFO:teuthology.orchestra.run.smithi133.stdout: debug mds = 20 2023-12-19T18:57:42.929 INFO:teuthology.orchestra.run.smithi133.stdout: debug mds balancer = 20 2023-12-19T18:57:42.929 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-12-19T18:57:42.929 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug frag = True 2023-12-19T18:57:42.929 INFO:teuthology.orchestra.run.smithi133.stdout: mds debug scatterstat = True 2023-12-19T18:57:42.929 INFO:teuthology.orchestra.run.smithi133.stdout: mds op complaint time = 180 2023-12-19T18:57:42.930 INFO:teuthology.orchestra.run.smithi133.stdout: mds verify scatter = True 2023-12-19T18:57:42.930 INFO:teuthology.orchestra.run.smithi133.stdout: osd op complaint time = 180 2023-12-19T18:57:42.930 INFO:teuthology.orchestra.run.smithi133.stdout: rados mon op timeout = 900 2023-12-19T18:57:42.930 INFO:teuthology.orchestra.run.smithi133.stdout: rados osd op timeout = 900 2023-12-19T18:57:42.931 INFO:teuthology.orchestra.run.smithi138.stdout:[global] 2023-12-19T18:57:42.931 INFO:teuthology.orchestra.run.smithi138.stdout: chdir = "" 2023-12-19T18:57:42.931 INFO:teuthology.orchestra.run.smithi138.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T18:57:42.932 INFO:teuthology.orchestra.run.smithi138.stdout: auth supported = cephx 2023-12-19T18:57:42.932 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.932 INFO:teuthology.orchestra.run.smithi138.stdout: filestore xattr use omap = true 2023-12-19T18:57:42.932 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.933 INFO:teuthology.orchestra.run.smithi138.stdout: mon clock drift allowed = 1.000 2023-12-19T18:57:42.933 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.933 INFO:teuthology.orchestra.run.smithi138.stdout: osd crush chooseleaf type = 0 2023-12-19T18:57:42.933 INFO:teuthology.orchestra.run.smithi138.stdout: auth debug = true 2023-12-19T18:57:42.933 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.934 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on old message = true 2023-12-19T18:57:42.934 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on bug = true 2023-12-19T18:57:42.934 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.934 INFO:teuthology.orchestra.run.smithi138.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T18:57:42.934 INFO:teuthology.orchestra.run.smithi138.stdout: mon pg warn max object skew = 0 2023-12-19T18:57:42.934 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.934 INFO:teuthology.orchestra.run.smithi138.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T18:57:42.934 INFO:teuthology.orchestra.run.smithi138.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T18:57:42.935 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.935 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default size = 2 2023-12-19T18:57:42.935 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.935 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow primary affinity = true 2023-12-19T18:57:42.935 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow pg remap = true 2023-12-19T18:57:42.935 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on legacy crush tunables = false 2023-12-19T18:57:42.935 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on crush straw calc version zero = false 2023-12-19T18:57:42.936 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on no sortbitwise = false 2023-12-19T18:57:42.936 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on osd down out interval zero = false 2023-12-19T18:57:42.936 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on too few osds = false 2023-12-19T18:57:42.936 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T18:57:42.936 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T18:57:42.936 INFO:teuthology.orchestra.run.smithi138.stdout: mon_allow_pool_size_one = true 2023-12-19T18:57:42.936 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.937 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T18:57:42.937 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.937 INFO:teuthology.orchestra.run.smithi138.stdout: osd default data pool replay window = 5 2023-12-19T18:57:42.937 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.937 INFO:teuthology.orchestra.run.smithi138.stdout: mon allow pool delete = true 2023-12-19T18:57:42.937 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.937 INFO:teuthology.orchestra.run.smithi138.stdout: mon cluster log file level = debug 2023-12-19T18:57:42.937 INFO:teuthology.orchestra.run.smithi138.stdout: debug asserts on shutdown = true 2023-12-19T18:57:42.937 INFO:teuthology.orchestra.run.smithi138.stdout: mon health detail to clog = false 2023-12-19T18:57:42.937 INFO:teuthology.orchestra.run.smithi138.stdout: mon host = "172.21.15.133,172.21.15.138,[v2:172.21.15.138:3301,v1:172.21.15.138:6790]" 2023-12-19T18:57:42.938 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on skipped message = False 2023-12-19T18:57:42.938 INFO:teuthology.orchestra.run.smithi138.stdout: fsid = 03e63958-005e-4bf2-ae5b-291aceb6fbbf 2023-12-19T18:57:42.938 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.938 INFO:teuthology.orchestra.run.smithi138.stdout:[osd] 2023-12-19T18:57:42.938 INFO:teuthology.orchestra.run.smithi138.stdout: osd journal size = 100 2023-12-19T18:57:42.938 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.938 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub load threshold = 5.0 2023-12-19T18:57:42.938 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub max interval = 600 2023-12-19T18:57:42.939 INFO:teuthology.orchestra.run.smithi138.stdout: osd mclock profile = high_recovery_ops 2023-12-19T18:57:42.939 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.939 INFO:teuthology.orchestra.run.smithi138.stdout: osd recover clone overlap = true 2023-12-19T18:57:42.939 INFO:teuthology.orchestra.run.smithi138.stdout: osd recovery max chunk = 1048576 2023-12-19T18:57:42.939 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.939 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug shutdown = true 2023-12-19T18:57:42.939 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug op order = true 2023-12-19T18:57:42.939 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify stray on activate = true 2023-12-19T18:57:42.939 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug trim objects = true 2023-12-19T18:57:42.939 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.939 INFO:teuthology.orchestra.run.smithi138.stdout: osd open classes on start = true 2023-12-19T18:57:42.939 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug pg log writeout = true 2023-12-19T18:57:42.939 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.939 INFO:teuthology.orchestra.run.smithi138.stdout: osd deep scrub update digest min age = 30 2023-12-19T18:57:42.940 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.940 INFO:teuthology.orchestra.run.smithi138.stdout: osd map max advance = 10 2023-12-19T18:57:42.940 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.940 INFO:teuthology.orchestra.run.smithi138.stdout: journal zero on create = true 2023-12-19T18:57:42.940 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.940 INFO:teuthology.orchestra.run.smithi138.stdout: filestore ondisk finisher threads = 3 2023-12-19T18:57:42.940 INFO:teuthology.orchestra.run.smithi138.stdout: filestore apply finisher threads = 3 2023-12-19T18:57:42.940 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.940 INFO:teuthology.orchestra.run.smithi138.stdout: bdev debug aio = true 2023-12-19T18:57:42.940 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug misdirected ops = true 2023-12-19T18:57:42.940 INFO:teuthology.orchestra.run.smithi138.stdout: bdev async discard = True 2023-12-19T18:57:42.940 INFO:teuthology.orchestra.run.smithi138.stdout: bdev enable discard = True 2023-12-19T18:57:42.940 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore allocator = bitmap 2023-12-19T18:57:42.940 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore block size = 96636764160 2023-12-19T18:57:42.940 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore fsck on mount = True 2023-12-19T18:57:42.940 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluefs = 1/20 2023-12-19T18:57:42.941 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluestore = 1/20 2023-12-19T18:57:42.941 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2023-12-19T18:57:42.941 INFO:teuthology.orchestra.run.smithi138.stdout: debug osd = 20 2023-12-19T18:57:42.941 INFO:teuthology.orchestra.run.smithi138.stdout: debug rocksdb = 4/10 2023-12-19T18:57:42.941 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T18:57:42.941 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd full ratio = 0.9 2023-12-19T18:57:42.941 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd nearfull ratio = 0.8 2023-12-19T18:57:42.941 INFO:teuthology.orchestra.run.smithi138.stdout: osd failsafe full ratio = 0.95 2023-12-19T18:57:42.941 INFO:teuthology.orchestra.run.smithi138.stdout: osd objectstore = bluestore 2023-12-19T18:57:42.942 INFO:teuthology.orchestra.run.smithi138.stdout: osd op complaint time = 180 2023-12-19T18:57:42.942 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.942 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr] 2023-12-19T18:57:42.942 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2023-12-19T18:57:42.942 INFO:teuthology.orchestra.run.smithi138.stdout: debug mgr = 20 2023-12-19T18:57:42.942 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2023-12-19T18:57:42.942 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2023-12-19T18:57:42.942 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:57:42.942 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:57:42.943 INFO:teuthology.orchestra.run.smithi138.stdout: mgr/telemetry/nag = false 2023-12-19T18:57:42.943 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.944 INFO:teuthology.orchestra.run.smithi138.stdout:[mon] 2023-12-19T18:57:42.944 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2023-12-19T18:57:42.944 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2023-12-19T18:57:42.944 INFO:teuthology.orchestra.run.smithi138.stdout: debug paxos = 20 2023-12-19T18:57:42.944 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2023-12-19T18:57:42.944 INFO:teuthology.orchestra.run.smithi138.stdout: mon data avail warn = 5 2023-12-19T18:57:42.944 INFO:teuthology.orchestra.run.smithi138.stdout: mon mgr mkfs grace = 240 2023-12-19T18:57:42.945 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:57:42.945 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd reporter subtree level = osd 2023-12-19T18:57:42.945 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd prime pg temp = true 2023-12-19T18:57:42.945 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:57:42.945 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.945 INFO:teuthology.orchestra.run.smithi138.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T18:57:42.946 INFO:teuthology.orchestra.run.smithi138.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T18:57:42.946 INFO:teuthology.orchestra.run.smithi138.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T18:57:42.946 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.946 INFO:teuthology.orchestra.run.smithi138.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T18:57:42.946 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T18:57:42.946 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T18:57:42.947 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.947 INFO:teuthology.orchestra.run.smithi138.stdout: # 1m isn't quite enough 2023-12-19T18:57:42.947 INFO:teuthology.orchestra.run.smithi138.stdout: mon_down_mkfs_grace = 2m 2023-12-19T18:57:42.947 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.947 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_filestore_osds = false 2023-12-19T18:57:42.947 INFO:teuthology.orchestra.run.smithi138.stdout: mon op complaint time = 120 2023-12-19T18:57:42.947 INFO:teuthology.orchestra.run.smithi138.stdout: 2023-12-19T18:57:42.947 INFO:teuthology.orchestra.run.smithi138.stdout:[client] 2023-12-19T18:57:42.947 INFO:teuthology.orchestra.run.smithi138.stdout: rgw cache enabled = true 2023-12-19T18:57:42.947 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable ops log = true 2023-12-19T18:57:42.947 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable usage log = true 2023-12-19T18:57:42.947 INFO:teuthology.orchestra.run.smithi138.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T18:57:42.948 INFO:teuthology.orchestra.run.smithi138.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T18:57:42.948 INFO:teuthology.orchestra.run.smithi138.stdout: client mount timeout = 600 2023-12-19T18:57:42.948 INFO:teuthology.orchestra.run.smithi138.stdout: debug client = 20 2023-12-19T18:57:42.948 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2023-12-19T18:57:42.948 INFO:teuthology.orchestra.run.smithi138.stdout: rados mon op timeout = 900 2023-12-19T18:57:42.948 INFO:teuthology.orchestra.run.smithi138.stdout: rados osd op timeout = 900 2023-12-19T18:57:42.948 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.a] 2023-12-19T18:57:42.948 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.b] 2023-12-19T18:57:42.948 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.c] 2023-12-19T18:57:42.948 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.a] 2023-12-19T18:57:42.948 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.c] 2023-12-19T18:57:42.948 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.b] 2023-12-19T18:57:42.948 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.d] 2023-12-19T18:57:42.948 INFO:teuthology.orchestra.run.smithi138.stdout:[mds] 2023-12-19T18:57:42.948 INFO:teuthology.orchestra.run.smithi138.stdout: debug mds = 20 2023-12-19T18:57:42.948 INFO:teuthology.orchestra.run.smithi138.stdout: debug mds balancer = 20 2023-12-19T18:57:42.949 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2023-12-19T18:57:42.949 INFO:teuthology.orchestra.run.smithi138.stdout: mds debug frag = True 2023-12-19T18:57:42.949 INFO:teuthology.orchestra.run.smithi138.stdout: mds debug scatterstat = True 2023-12-19T18:57:42.949 INFO:teuthology.orchestra.run.smithi138.stdout: mds op complaint time = 180 2023-12-19T18:57:42.949 INFO:teuthology.orchestra.run.smithi138.stdout: mds verify scatter = True 2023-12-19T18:57:42.949 INFO:teuthology.orchestra.run.smithi138.stdout: osd op complaint time = 180 2023-12-19T18:57:42.949 INFO:teuthology.orchestra.run.smithi138.stdout: rados mon op timeout = 900 2023-12-19T18:57:42.949 INFO:teuthology.orchestra.run.smithi138.stdout: rados osd op timeout = 900 2023-12-19T18:57:42.951 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-19T18:57:42.951 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-19T18:57:43.052 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-19T18:57:43.052 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:57:43.052 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-19T18:57:43.061 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:57:43.061 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-19T18:57:43.110 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi133.front.sepia.ceph.com 2023-12-19T18:57:43.110 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:57:43.110 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-19T18:57:43.110 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T18:57:43.186 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:57:43.186 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-19T18:57:43.242 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi138.front.sepia.ceph.com 2023-12-19T18:57:43.242 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:57:43.242 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-19T18:57:43.242 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T18:57:43.278 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:57:43.279 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-19T18:57:43.334 INFO:tasks.ceph:Setting up mon nodes... 2023-12-19T18:57:43.334 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-19T18:57:43.334 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-19T18:57:43.390 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-19T18:57:43.395 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-19T18:57:43.456 INFO:teuthology.orchestra.run.smithi138.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-19T18:57:43.469 INFO:tasks.ceph:Setting up mds nodes... 2023-12-19T18:57:43.469 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-19T18:57:43.526 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-19T18:57:43.531 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-19T18:57:43.551 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-19T18:57:43.648 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-19T18:57:43.653 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-19T18:57:43.674 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-19T18:57:43.735 INFO:teuthology.orchestra.run.smithi138.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-19T18:57:43.739 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-19T18:57:43.761 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-19T18:57:43.857 INFO:teuthology.orchestra.run.smithi138.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-19T18:57:43.861 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-19T18:57:43.882 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-19T18:57:43.882 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-19T18:57:43.925 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-19T18:57:43.942 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-19T18:57:43.984 INFO:teuthology.orchestra.run.smithi138.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-19T18:57:44.001 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-19T18:57:44.002 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-19T18:57:44.002 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-19T18:57:44.021 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T18:57:44.022 INFO:tasks.ceph:role: osd.0 2023-12-19T18:57:44.022 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-19T18:57:44.022 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-19T18:57:44.093 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T18:57:44.094 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T18:57:44.094 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T18:57:44.094 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T18:57:44.094 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T18:57:44.094 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-12-19T18:57:44.094 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T18:57:44.094 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T18:57:44.094 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T18:57:44.094 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T18:57:44.571 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2023-12-19T18:57:44.573 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-12-19T18:57:44.574 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-19T18:57:44.718 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-19T18:57:44.738 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T18:57:44.738 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:57:44.739 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-19T18:57:44.802 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T18:57:44.802 INFO:tasks.ceph:role: osd.1 2023-12-19T18:57:44.802 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-19T18:57:44.803 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-19T18:57:44.878 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T18:57:44.878 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T18:57:44.878 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T18:57:44.878 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T18:57:44.878 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T18:57:44.878 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-12-19T18:57:44.878 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T18:57:44.879 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T18:57:44.879 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T18:57:44.879 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T18:57:45.331 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2023-12-19T18:57:45.333 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-12-19T18:57:45.334 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-19T18:57:45.436 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-19T18:57:45.454 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:57:45.454 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T18:57:45.455 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-19T18:57:45.523 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T18:57:45.523 INFO:tasks.ceph:role: osd.2 2023-12-19T18:57:45.523 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-19T18:57:45.523 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-19T18:57:45.594 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T18:57:45.595 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T18:57:45.595 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T18:57:45.595 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T18:57:45.595 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T18:57:45.595 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-12-19T18:57:45.595 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T18:57:45.595 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T18:57:45.595 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T18:57:45.595 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T18:57:46.049 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2023-12-19T18:57:46.052 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-12-19T18:57:46.052 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-19T18:57:46.217 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-19T18:57:46.235 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T18:57:46.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:57:46.236 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-19T18:57:46.303 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T18:57:46.303 INFO:tasks.ceph:role: osd.3 2023-12-19T18:57:46.303 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-19T18:57:46.303 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-19T18:57:46.374 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T18:57:46.375 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T18:57:46.375 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T18:57:46.375 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T18:57:46.375 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T18:57:46.375 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-12-19T18:57:46.375 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T18:57:46.375 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T18:57:46.375 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T18:57:46.375 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T18:57:46.864 INFO:teuthology.orchestra.run.smithi133.stdout:Discarding blocks...Done. 2023-12-19T18:57:46.867 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-12-19T18:57:46.867 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-19T18:57:47.000 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-19T18:57:47.019 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T18:57:47.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:57:47.020 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T18:57:47.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:47.153+0000 7f06e82ea640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-19T18:57:47.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:47.157+0000 7f06e82ea640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-19T18:57:47.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:47.157+0000 7f06e82ea640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-19T18:57:47.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:47.157+0000 7f06e82ea640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-19T18:57:47.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:47.157+0000 7f06e82ea640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-19T18:57:47.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:47.157+0000 7f06e82ea640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-19T18:57:50.158 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-19T18:57:50.185 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T18:57:50.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:50.281+0000 7f32daeda640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-19T18:57:50.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:50.281+0000 7f32daeda640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-19T18:57:50.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:50.281+0000 7f32daeda640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-19T18:57:50.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:50.281+0000 7f32daeda640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-19T18:57:50.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:50.281+0000 7f32daeda640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-19T18:57:50.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:50.285+0000 7f32daeda640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-19T18:57:53.265 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-19T18:57:53.287 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T18:57:53.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:53.385+0000 7f8e1fd6e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-19T18:57:53.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:53.385+0000 7f8e1fd6e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-19T18:57:53.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:53.385+0000 7f8e1fd6e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-19T18:57:53.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:53.385+0000 7f8e1fd6e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-19T18:57:53.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:53.385+0000 7f8e1fd6e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-19T18:57:53.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:53.389+0000 7f8e1fd6e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-19T18:57:56.389 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-19T18:57:56.410 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T18:57:56.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:56.505+0000 7ff35de2b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-19T18:57:56.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:56.505+0000 7ff35de2b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-19T18:57:56.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:56.505+0000 7ff35de2b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-19T18:57:56.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:56.505+0000 7ff35de2b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-19T18:57:56.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:56.505+0000 7ff35de2b640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-19T18:57:56.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:57:56.505+0000 7ff35de2b640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-19T18:57:59.489 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-19T18:57:59.510 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-19T18:57:59.534 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T18:57:59.534 INFO:tasks.ceph:role: osd.4 2023-12-19T18:57:59.535 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com 2023-12-19T18:57:59.535 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-19T18:57:59.607 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T18:57:59.607 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T18:57:59.607 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T18:57:59.608 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T18:57:59.608 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T18:57:59.608 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2023-12-19T18:57:59.608 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T18:57:59.608 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T18:57:59.608 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T18:57:59.608 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T18:58:00.059 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2023-12-19T18:58:00.062 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2023-12-19T18:58:00.062 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-19T18:58:00.182 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-19T18:58:00.213 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T18:58:00.214 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:58:00.214 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-19T18:58:00.285 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T18:58:00.286 INFO:tasks.ceph:role: osd.5 2023-12-19T18:58:00.286 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com 2023-12-19T18:58:00.286 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-19T18:58:00.365 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T18:58:00.366 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T18:58:00.366 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T18:58:00.366 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T18:58:00.366 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T18:58:00.366 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2023-12-19T18:58:00.366 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T18:58:00.366 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T18:58:00.366 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T18:58:00.366 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T18:58:00.838 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2023-12-19T18:58:00.841 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2023-12-19T18:58:00.841 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-19T18:58:00.993 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-19T18:58:01.010 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T18:58:01.011 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:58:01.011 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-19T18:58:01.079 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T18:58:01.079 INFO:tasks.ceph:role: osd.6 2023-12-19T18:58:01.079 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com 2023-12-19T18:58:01.079 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-19T18:58:01.151 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T18:58:01.151 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T18:58:01.151 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T18:58:01.151 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T18:58:01.152 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T18:58:01.152 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2023-12-19T18:58:01.152 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T18:58:01.152 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T18:58:01.152 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T18:58:01.152 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T18:58:01.635 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2023-12-19T18:58:01.637 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2023-12-19T18:58:01.638 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-19T18:58:01.740 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-19T18:58:01.758 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T18:58:01.758 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:58:01.759 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-19T18:58:01.826 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T18:58:01.826 INFO:tasks.ceph:role: osd.7 2023-12-19T18:58:01.826 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi138.front.sepia.ceph.com 2023-12-19T18:58:01.826 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-19T18:58:01.897 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T18:58:01.897 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T18:58:01.898 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T18:58:01.898 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-19T18:58:01.898 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T18:58:01.898 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2023-12-19T18:58:01.898 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T18:58:01.898 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T18:58:01.898 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T18:58:01.898 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T18:58:02.349 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2023-12-19T18:58:02.353 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2023-12-19T18:58:02.353 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-19T18:58:02.468 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-19T18:58:02.485 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T18:58:02.486 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:58:02.486 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T18:58:02.606 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:02.603+0000 7fbb4d35c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-19T18:58:02.611 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:02.607+0000 7fbb4d35c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-19T18:58:02.611 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:02.607+0000 7fbb4d35c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-19T18:58:02.611 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:02.607+0000 7fbb4d35c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-19T18:58:02.611 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:02.607+0000 7fbb4d35c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-19T18:58:02.614 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:02.611+0000 7fbb4d35c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-19T18:58:05.614 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-19T18:58:05.635 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T18:58:05.734 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:05.731+0000 7fd8cf6f1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-19T18:58:05.735 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:05.731+0000 7fd8cf6f1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-19T18:58:05.735 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:05.731+0000 7fd8cf6f1640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-19T18:58:05.735 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:05.731+0000 7fd8cf6f1640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-19T18:58:05.735 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:05.731+0000 7fd8cf6f1640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-19T18:58:05.736 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:05.731+0000 7fd8cf6f1640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-19T18:58:08.721 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-19T18:58:08.742 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T18:58:08.838 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:08.835+0000 7f6040c28640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-19T18:58:08.839 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:08.835+0000 7f6040c28640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-19T18:58:08.839 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:08.835+0000 7f6040c28640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-19T18:58:08.839 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:08.835+0000 7f6040c28640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-19T18:58:08.839 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:08.835+0000 7f6040c28640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-19T18:58:08.840 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:08.835+0000 7f6040c28640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-19T18:58:10.964 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:58:10.973 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:58:11.852 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-19T18:58:11.873 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T18:58:11.971 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:11.967+0000 7f067722b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-19T18:58:11.971 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:11.967+0000 7f067722b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-19T18:58:11.971 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:11.967+0000 7f067722b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-19T18:58:11.971 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:11.967+0000 7f067722b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-19T18:58:11.972 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:11.967+0000 7f067722b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-19T18:58:11.973 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:11.967+0000 7f067722b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-19T18:58:14.973 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-19T18:58:14.994 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-19T18:58:14.994 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:58:14.994 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-19T18:58:15.017 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:58:15.018 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-19T18:58:15.083 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:58:15.083 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-19T18:58:15.147 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:58:15.147 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-19T18:58:15.210 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:58:15.211 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-19T18:58:15.274 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:58:15.275 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-19T18:58:15.338 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:58:15.338 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-19T18:58:15.402 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:58:15.402 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-19T18:58:15.423 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:58:15.424 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-19T18:58:15.486 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:58:15.486 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-19T18:58:15.550 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:58:15.550 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-19T18:58:15.614 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:58:15.614 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-19T18:58:15.678 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:58:15.678 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-19T18:58:15.742 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:58:15.742 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-19T18:58:15.805 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:58:15.806 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-19T18:58:15.814 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:58:15.815 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-19T18:58:15.857 INFO:tasks.ceph:Adding keys to all mons... 2023-12-19T18:58:15.858 DEBUG:teuthology.orchestra.run.smithi133:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-19T18:58:15.861 DEBUG:teuthology.orchestra.run.smithi138:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-19T18:58:15.910 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.y] 2023-12-19T18:58:15.910 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCn54Fl9H5OFxAARCZdZbwW/Mw/x2X1zAvzqg== 2023-12-19T18:58:15.910 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2023-12-19T18:58:15.910 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCn54FlwoplHxAAVjcRzu+wQdwT5Mzra21oYw== 2023-12-19T18:58:15.911 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2023-12-19T18:58:15.911 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCn54FlWEW0JhAAMd5FSzdRUAJgoSga/f0RCw== 2023-12-19T18:58:15.911 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.0] 2023-12-19T18:58:15.911 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCr54FlMNpECRAAMTwNBHtXhYqqZ2BjCRh9MQ== 2023-12-19T18:58:15.911 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.1] 2023-12-19T18:58:15.911 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCu54FlebMLERAADuy4l18uDpuzQTlHxpa6vg== 2023-12-19T18:58:15.911 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.2] 2023-12-19T18:58:15.911 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCx54FlIGE0FxAAH1d5WYGkA6lc9/1uQ08+vw== 2023-12-19T18:58:15.912 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.3] 2023-12-19T18:58:15.912 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQC054Fl6lBFHhAAezVECb7AsJH7i7o805mKYA== 2023-12-19T18:58:15.912 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.x] 2023-12-19T18:58:15.912 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCn54FlEyVGGxAAleA1zB0F6jgR7QOYMr55Bg== 2023-12-19T18:58:15.912 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2023-12-19T18:58:15.912 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCn54Fl5g/pKxAA/I3R1pRmk8mQOBa4FoGj8g== 2023-12-19T18:58:15.912 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.d] 2023-12-19T18:58:15.913 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCn54FllCg0MxAAwWY3wtGD5Om88qWPkpzVhw== 2023-12-19T18:58:15.913 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.4] 2023-12-19T18:58:15.913 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQC654Fl2Hw1JBAAFb/W356pK2UkqTbL3k+rgg== 2023-12-19T18:58:15.913 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.5] 2023-12-19T18:58:15.913 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQC954FlDNTYKxAAOdTpUouNeNyeKWV4rSkfHA== 2023-12-19T18:58:15.913 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.6] 2023-12-19T18:58:15.914 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDA54Fl8V0WMhAAurXUfZDjwkFUcN0/0AvCRA== 2023-12-19T18:58:15.914 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.7] 2023-12-19T18:58:15.914 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQDD54FlLS76ORAAjLklJxdnUAoGK7D7NMOuQA== 2023-12-19T18:58:15.914 INFO:teuthology.orchestra.run.smithi133.stdout:[client.0] 2023-12-19T18:58:15.914 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCn54FllfQwNxAAyKIESQDxKvDHfaewx+v88w== 2023-12-19T18:58:15.914 INFO:teuthology.orchestra.run.smithi133.stdout:[client.1] 2023-12-19T18:58:15.914 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCn54Fl4bbAOhAA4WXKbT5uizIcy0OTOKIaag== 2023-12-19T18:58:15.924 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr.y] 2023-12-19T18:58:15.924 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQCn54Fl9H5OFxAARCZdZbwW/Mw/x2X1zAvzqg== 2023-12-19T18:58:15.924 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.a] 2023-12-19T18:58:15.924 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQCn54FlwoplHxAAVjcRzu+wQdwT5Mzra21oYw== 2023-12-19T18:58:15.924 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.c] 2023-12-19T18:58:15.924 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQCn54FlWEW0JhAAMd5FSzdRUAJgoSga/f0RCw== 2023-12-19T18:58:15.924 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.0] 2023-12-19T18:58:15.924 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQCr54FlMNpECRAAMTwNBHtXhYqqZ2BjCRh9MQ== 2023-12-19T18:58:15.924 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.1] 2023-12-19T18:58:15.925 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQCu54FlebMLERAADuy4l18uDpuzQTlHxpa6vg== 2023-12-19T18:58:15.925 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.2] 2023-12-19T18:58:15.925 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQCx54FlIGE0FxAAH1d5WYGkA6lc9/1uQ08+vw== 2023-12-19T18:58:15.925 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.3] 2023-12-19T18:58:15.925 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQC054Fl6lBFHhAAezVECb7AsJH7i7o805mKYA== 2023-12-19T18:58:15.925 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr.x] 2023-12-19T18:58:15.925 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQCn54FlEyVGGxAAleA1zB0F6jgR7QOYMr55Bg== 2023-12-19T18:58:15.925 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.b] 2023-12-19T18:58:15.925 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQCn54Fl5g/pKxAA/I3R1pRmk8mQOBa4FoGj8g== 2023-12-19T18:58:15.925 INFO:teuthology.orchestra.run.smithi138.stdout:[mds.d] 2023-12-19T18:58:15.926 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQCn54FllCg0MxAAwWY3wtGD5Om88qWPkpzVhw== 2023-12-19T18:58:15.926 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.4] 2023-12-19T18:58:15.926 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQC654Fl2Hw1JBAAFb/W356pK2UkqTbL3k+rgg== 2023-12-19T18:58:15.926 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.5] 2023-12-19T18:58:15.926 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQC954FlDNTYKxAAOdTpUouNeNyeKWV4rSkfHA== 2023-12-19T18:58:15.926 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.6] 2023-12-19T18:58:15.926 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDA54Fl8V0WMhAAurXUfZDjwkFUcN0/0AvCRA== 2023-12-19T18:58:15.926 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.7] 2023-12-19T18:58:15.926 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQDD54FlLS76ORAAjLklJxdnUAoGK7D7NMOuQA== 2023-12-19T18:58:15.926 INFO:teuthology.orchestra.run.smithi138.stdout:[client.0] 2023-12-19T18:58:15.926 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQCn54FllfQwNxAAyKIESQDxKvDHfaewx+v88w== 2023-12-19T18:58:15.926 INFO:teuthology.orchestra.run.smithi138.stdout:[client.1] 2023-12-19T18:58:15.926 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQCn54Fl4bbAOhAA4WXKbT5uizIcy0OTOKIaag== 2023-12-19T18:58:15.928 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T18:58:15.967 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T18:58:16.028 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T18:58:16.032 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T18:58:16.091 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T18:58:16.095 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T18:58:16.152 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T18:58:16.155 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T18:58:16.210 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T18:58:16.214 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T18:58:16.267 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T18:58:16.271 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T18:58:16.324 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T18:58:16.327 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T18:58:16.382 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T18:58:16.385 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T18:58:16.439 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T18:58:16.442 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T18:58:16.499 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T18:58:16.503 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T18:58:16.559 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T18:58:16.563 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T18:58:16.618 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T18:58:16.622 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T18:58:16.676 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T18:58:16.679 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T18:58:16.733 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T18:58:16.737 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T18:58:16.792 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T18:58:16.796 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T18:58:16.852 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T18:58:16.856 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T18:58:16.913 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-19T18:58:16.913 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-19T18:58:16.934 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T18:58:17.050 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-19T18:58:17.071 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-19T18:58:17.092 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T18:58:17.204 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-19T18:58:17.224 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-19T18:58:17.285 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T18:58:17.401 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-19T18:58:17.421 DEBUG:teuthology.orchestra.run.smithi133:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-19T18:58:17.424 DEBUG:teuthology.orchestra.run.smithi138:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-19T18:58:17.473 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-19T18:58:17.473 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-19T18:58:17.473 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-19T18:58:17.476 INFO:tasks.ceph.mon.a:Started 2023-12-19T18:58:17.477 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-19T18:58:17.477 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-19T18:58:17.516 INFO:tasks.ceph.mon.b:Started 2023-12-19T18:58:17.516 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-19T18:58:17.516 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-19T18:58:17.519 INFO:tasks.ceph.mon.c:Started 2023-12-19T18:58:17.519 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-19T18:58:17.520 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-19T18:58:17.520 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-19T18:58:17.523 INFO:tasks.ceph.mgr.y:Started 2023-12-19T18:58:17.523 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-19T18:58:17.523 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-19T18:58:17.527 INFO:tasks.ceph.mgr.x:Started 2023-12-19T18:58:17.527 INFO:tasks.ceph:Setting crush tunables to default 2023-12-19T18:58:17.527 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd crush tunables default 2023-12-19T18:58:17.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.665+0000 7f309571e640 1 Processor -- start 2023-12-19T18:58:17.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.665+0000 7f309571e640 1 -- start start 2023-12-19T18:58:17.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.665+0000 7f309571e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f30900c8360 0x7f309015fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:17.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.665+0000 7f309571e640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30901544c0 con 0x7f3090151b60 2023-12-19T18:58:17.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.665+0000 7f309571e640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30901547a0 con 0x7f30900c9880 2023-12-19T18:58:17.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.665+0000 7f309571e640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30900c0290 con 0x7f30900c8360 2023-12-19T18:58:17.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.665+0000 7f308ffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3090151b60 0x7f30900bee90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:39994/0 (socket says 172.21.15.133:39994) 2023-12-19T18:58:17.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.665+0000 7f308ffff640 1 -- 172.21.15.133:0/3907385568 learned_addr learned my addr 172.21.15.133:0/3907385568 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:17.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.665+0000 7f3094f1d640 1 --2- 172.21.15.133:0/3907385568 >> v2:172.21.15.138:3300/0 conn(0x7f30900c8360 0x7f309015fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:17.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.665+0000 7f3094f1d640 1 -- 172.21.15.133:0/3907385568 >> v2:172.21.15.138:3300/0 conn(0x7f30900c8360 msgr2=0x7f309015fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-19T18:58:17.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.665+0000 7f3094f1d640 1 -- 172.21.15.133:0/3907385568 >> v2:172.21.15.138:3300/0 conn(0x7f30900c8360 msgr2=0x7f309015fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T18:58:17.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.665+0000 7f3094f1d640 1 --2- 172.21.15.133:0/3907385568 >> v2:172.21.15.138:3300/0 conn(0x7f30900c8360 0x7f309015fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T18:58:17.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.665+0000 7f3094f1d640 1 --2- 172.21.15.133:0/3907385568 >> v2:172.21.15.138:3300/0 conn(0x7f30900c8360 0x7f309015fd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T18:58:17.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.833+0000 7f308effd640 1 -- 172.21.15.133:0/3907385568 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 706958205 0 0) 0x7f30901544c0 con 0x7f3090151b60 2023-12-19T18:58:17.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.833+0000 7f308effd640 1 -- 172.21.15.133:0/3907385568 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3078003530 con 0x7f3090151b60 2023-12-19T18:58:17.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.833+0000 7f308effd640 1 -- 172.21.15.133:0/3907385568 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2472297904 0 0) 0x7f30901547a0 con 0x7f30900c9880 2023-12-19T18:58:17.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.833+0000 7f308effd640 1 -- 172.21.15.133:0/3907385568 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30901544c0 con 0x7f30900c9880 2023-12-19T18:58:17.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.833+0000 7f308effd640 1 -- 172.21.15.133:0/3907385568 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1852109380 0 0) 0x7f3078003530 con 0x7f3090151b60 2023-12-19T18:58:17.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.833+0000 7f308effd640 1 -- 172.21.15.133:0/3907385568 >> v2:172.21.15.138:3300/0 conn(0x7f30900c8360 msgr2=0x7f309015fd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T18:58:17.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.833+0000 7f308effd640 1 --2- 172.21.15.133:0/3907385568 >> v2:172.21.15.138:3300/0 conn(0x7f30900c8360 0x7f309015fd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:17.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.833+0000 7f308effd640 1 -- 172.21.15.133:0/3907385568 >> v1:172.21.15.138:6789/0 conn(0x7f30900c9880 legacy=0x7f30900c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:17.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.833+0000 7f308effd640 1 -- 172.21.15.133:0/3907385568 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3090154a80 con 0x7f3090151b60 2023-12-19T18:58:17.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.833+0000 7f308effd640 1 -- 172.21.15.133:0/3907385568 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f3080001680 con 0x7f3090151b60 2023-12-19T18:58:17.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.833+0000 7f308effd640 1 -- 172.21.15.133:0/3907385568 >> v1:172.21.15.133:6789/0 conn(0x7f3090151b60 legacy=0x7f30900bee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:17.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.833+0000 7f308effd640 1 --2- 172.21.15.133:0/3907385568 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3078003b10 0x7f3078003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:17.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.833+0000 7f308effd640 1 --2- 172.21.15.133:0/3907385568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30780047d0 0x7f3078004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:17.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.833+0000 7f308effd640 1 --2- 172.21.15.133:0/3907385568 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30780052b0 0x7f307800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:17.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.833+0000 7f308effd640 1 -- 172.21.15.133:0/3907385568 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307800c130 con 0x7f30780047d0 2023-12-19T18:58:17.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.833+0000 7f308effd640 1 -- 172.21.15.133:0/3907385568 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307800c2a0 con 0x7f3078003b10 2023-12-19T18:58:17.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.833+0000 7f308effd640 1 -- 172.21.15.133:0/3907385568 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307800c460 con 0x7f30780052b0 2023-12-19T18:58:17.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.837+0000 7f308ffff640 1 --2- 172.21.15.133:0/3907385568 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3078003b10 0x7f3078003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:17.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.837+0000 7f3094f1d640 1 --2- 172.21.15.133:0/3907385568 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30780052b0 0x7f307800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:17.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.837+0000 7f308f7fe640 1 --2- 172.21.15.133:0/3907385568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30780047d0 0x7f3078004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:17.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.837+0000 7f308f7fe640 1 -- 172.21.15.133:0/3907385568 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30780052b0 msgr2=0x7f307800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:17.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.837+0000 7f308f7fe640 1 --2- 172.21.15.133:0/3907385568 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30780052b0 0x7f307800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:17.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.837+0000 7f308f7fe640 1 -- 172.21.15.133:0/3907385568 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3078003b10 msgr2=0x7f3078003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:17.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.837+0000 7f308f7fe640 1 --2- 172.21.15.133:0/3907385568 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3078003b10 0x7f3078003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:17.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.837+0000 7f3094f1d640 1 -- 172.21.15.133:0/3907385568 reap_dead start 2023-12-19T18:58:17.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.837+0000 7f308f7fe640 1 -- 172.21.15.133:0/3907385568 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3090154a80 con 0x7f30780047d0 2023-12-19T18:58:17.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.837+0000 7f308f7fe640 1 --2- 172.21.15.133:0/3907385568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30780047d0 0x7f3078004c50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3084007fd0 tx=0x7f308401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0206c0080a63b7f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:17.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.841+0000 7f308effd640 1 -- 172.21.15.133:0/3907385568 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3084005270 con 0x7f30780047d0 2023-12-19T18:58:17.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.841+0000 7f308effd640 1 -- 172.21.15.133:0/3907385568 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30840a7070 con 0x7f30780047d0 2023-12-19T18:58:17.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.841+0000 7f308effd640 1 -- 172.21.15.133:0/3907385568 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3084003600 con 0x7f30780047d0 2023-12-19T18:58:17.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.841+0000 7f309571e640 1 -- 172.21.15.133:0/3907385568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30780047d0 msgr2=0x7f3078004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:17.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.841+0000 7f309571e640 1 --2- 172.21.15.133:0/3907385568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30780047d0 0x7f3078004c50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3084007fd0 tx=0x7f308401c470 comp rx=0 tx=0).stop 2023-12-19T18:58:17.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.841+0000 7f309571e640 1 -- 172.21.15.133:0/3907385568 shutdown_connections 2023-12-19T18:58:17.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.841+0000 7f309571e640 1 --2- 172.21.15.133:0/3907385568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30780047d0 0x7f3078004c50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:17.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.841+0000 7f309571e640 1 -- 172.21.15.133:0/3907385568 >> 172.21.15.133:0/3907385568 conn(0x7f30900c9d50 msgr2=0x7f30900ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:17.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.841+0000 7f309571e640 1 -- 172.21.15.133:0/3907385568 shutdown_connections 2023-12-19T18:58:17.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.841+0000 7f309571e640 1 -- 172.21.15.133:0/3907385568 wait complete. 2023-12-19T18:58:17.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.841+0000 7f309571e640 1 Processor -- start 2023-12-19T18:58:17.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.841+0000 7f309571e640 1 -- start start 2023-12-19T18:58:17.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f309571e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30780047d0 0x7f30901436a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:17.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f309571e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30900c1ca0 0x7f3090150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:17.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f309571e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30900c2660 0x7f30900c2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:17.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f309571e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3090155f20 con 0x7f30780047d0 2023-12-19T18:58:17.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f309571e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30901f0c10 con 0x7f30900c1ca0 2023-12-19T18:58:17.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f309571e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30901f1140 con 0x7f30900c2660 2023-12-19T18:58:17.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f308ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30780047d0 0x7f30901436a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:17.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f308f7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30900c1ca0 0x7f3090150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:17.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f3094f1d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30900c2660 0x7f30900c2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:17.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f308f7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30900c1ca0 0x7f3090150340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:52162/0 (socket says 172.21.15.133:52162) 2023-12-19T18:58:17.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f308f7fe640 1 -- 172.21.15.133:0/2204266617 learned_addr learned my addr 172.21.15.133:0/2204266617 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:17.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f308ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30780047d0 0x7f30901436a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58758/0 (socket says 172.21.15.133:58758) 2023-12-19T18:58:17.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f308ffff640 1 -- 172.21.15.133:0/2204266617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30900c2660 msgr2=0x7f30900c2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:17.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f308ffff640 1 --2- 172.21.15.133:0/2204266617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30900c2660 0x7f30900c2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:17.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f308ffff640 1 -- 172.21.15.133:0/2204266617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30900c1ca0 msgr2=0x7f3090150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:17.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f308ffff640 1 --2- 172.21.15.133:0/2204266617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30900c1ca0 0x7f3090150340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:17.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f308ffff640 1 -- 172.21.15.133:0/2204266617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30901f0e60 con 0x7f30780047d0 2023-12-19T18:58:17.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f308ffff640 1 --2- 172.21.15.133:0/2204266617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30780047d0 0x7f30901436a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f30901543b0 tx=0x7f3080007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:17.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f308cff9640 1 -- 172.21.15.133:0/2204266617 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308000f8c0 con 0x7f30780047d0 2023-12-19T18:58:17.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f308cff9640 1 -- 172.21.15.133:0/2204266617 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308000fa20 con 0x7f30780047d0 2023-12-19T18:58:17.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f308cff9640 1 -- 172.21.15.133:0/2204266617 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308000fdb0 con 0x7f30780047d0 2023-12-19T18:58:17.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f309571e640 1 -- 172.21.15.133:0/2204266617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30901558d0 con 0x7f30780047d0 2023-12-19T18:58:17.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f308cff9640 1 -- 172.21.15.133:0/2204266617 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3080014750 con 0x7f30780047d0 2023-12-19T18:58:17.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f309571e640 1 -- 172.21.15.133:0/2204266617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3090150880 con 0x7f30780047d0 2023-12-19T18:58:17.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f308cff9640 1 -- 172.21.15.133:0/2204266617 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f3080014a00 con 0x7f30780047d0 2023-12-19T18:58:17.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.845+0000 7f309571e640 1 -- 172.21.15.133:0/2204266617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30900c22f0 con 0x7f30780047d0 2023-12-19T18:58:17.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.865+0000 7f308cff9640 1 -- 172.21.15.133:0/2204266617 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f30900c22f0 con 0x7f30780047d0 2023-12-19T18:58:17.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.925+0000 7f309571e640 1 -- 172.21.15.133:0/2204266617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f309004e850 con 0x7f30780047d0 2023-12-19T18:58:17.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.925+0000 7f308cff9640 1 -- 172.21.15.133:0/2204266617 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f3080023060 con 0x7f30780047d0 2023-12-19T18:58:17.929 INFO:teuthology.orchestra.run.smithi133.stderr:adjusted tunables profile to default 2023-12-19T18:58:17.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.929+0000 7f309571e640 1 -- 172.21.15.133:0/2204266617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30780047d0 msgr2=0x7f30901436a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:17.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.929+0000 7f309571e640 1 --2- 172.21.15.133:0/2204266617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30780047d0 0x7f30901436a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f30901543b0 tx=0x7f3080007720 comp rx=0 tx=0).stop 2023-12-19T18:58:17.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.929+0000 7f309571e640 1 -- 172.21.15.133:0/2204266617 shutdown_connections 2023-12-19T18:58:17.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.929+0000 7f309571e640 1 --2- 172.21.15.133:0/2204266617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30900c2660 0x7f30900c2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:17.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.929+0000 7f309571e640 1 --2- 172.21.15.133:0/2204266617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30900c1ca0 0x7f3090150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:17.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.929+0000 7f309571e640 1 --2- 172.21.15.133:0/2204266617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30780047d0 0x7f30901436a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:17.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.929+0000 7f309571e640 1 -- 172.21.15.133:0/2204266617 >> 172.21.15.133:0/2204266617 conn(0x7f30900c9d50 msgr2=0x7f30900c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:17.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.929+0000 7f309571e640 1 -- 172.21.15.133:0/2204266617 shutdown_connections 2023-12-19T18:58:17.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:17.929+0000 7f309571e640 1 -- 172.21.15.133:0/2204266617 wait complete. 2023-12-19T18:58:17.950 INFO:tasks.ceph:check_enable_crimson: False 2023-12-19T18:58:17.950 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-19T18:58:17.950 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:58:17.951 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-19T18:58:17.971 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:58:17.971 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-19T18:58:18.037 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:58:18.038 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-19T18:58:18.055 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-19T18:58:18.053+0000 7fb62ff5b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-19T18:58:18.057 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:18.059+0000 7fbeca8c1180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-19T18:58:18.076 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:58:18.076 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-19T18:58:18.142 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:58:18.142 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-19T18:58:18.162 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:58:18.162 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-19T18:58:18.225 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:58:18.225 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-19T18:58:18.290 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:58:18.290 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-19T18:58:18.353 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new a8c2e9cd-28d1-4571-be11-049752ec6b24 0 2023-12-19T18:58:18.529 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.527+0000 7ff813d57640 1 Processor -- start 2023-12-19T18:58:18.529 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.527+0000 7ff813d57640 1 -- start start 2023-12-19T18:58:18.530 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.531+0000 7ff813d57640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff80c151e90 0x7ff80c0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:18.530 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.531+0000 7ff813d57640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff80c06c860 con 0x7ff80c0c7ea0 2023-12-19T18:58:18.530 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.531+0000 7ff813d57640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff80c154930 con 0x7ff80c0c4e60 2023-12-19T18:58:18.530 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.531+0000 7ff813d57640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c0c8750 con 0x7ff80c151e90 2023-12-19T18:58:18.530 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.531+0000 7ff811af3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff80c151e90 0x7ff80c0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:18.530 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.531+0000 7ff8122f4640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7ff80c0c4e60 0x7ff80c15f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:38874/0 (socket says 172.21.15.138:38874) 2023-12-19T18:58:18.530 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.531+0000 7ff8122f4640 1 -- 172.21.15.138:0/81568250 learned_addr learned my addr 172.21.15.138:0/81568250 (peer_addr_for_me v1:172.21.15.138:0/0) 2023-12-19T18:58:18.531 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.531+0000 7ff811af3640 1 -- 172.21.15.138:0/81568250 >> v1:172.21.15.138:6789/0 conn(0x7ff80c0c4e60 legacy=0x7ff80c15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:18.531 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.531+0000 7ff811af3640 1 -- 172.21.15.138:0/81568250 >> v1:172.21.15.133:6789/0 conn(0x7ff80c0c7ea0 legacy=0x7ff80c06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:18.531 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.531+0000 7ff810af1640 1 -- 172.21.15.138:0/81568250 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248017173 0 0) 0x7ff80c154930 con 0x7ff80c0c4e60 2023-12-19T18:58:18.531 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.531+0000 7ff811af3640 1 -- 172.21.15.138:0/81568250 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff80c154c10 con 0x7ff80c151e90 2023-12-19T18:58:18.533 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.535+0000 7ff811af3640 1 --2- 172.21.15.138:0/81568250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff80c151e90 0x7ff80c0c4920 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff8080097f0 tx=0x7ff80801c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=642241ecf9a50477 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:18.534 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.535+0000 7ff810af1640 1 -- 172.21.15.138:0/81568250 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8080ab600 con 0x7ff80c151e90 2023-12-19T18:58:18.534 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.535+0000 7ff810af1640 1 -- 172.21.15.138:0/81568250 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8080a7050 con 0x7ff80c151e90 2023-12-19T18:58:18.534 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.535+0000 7ff810af1640 1 -- 172.21.15.138:0/81568250 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8080ab980 con 0x7ff80c151e90 2023-12-19T18:58:18.535 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.535+0000 7ff813d57640 1 -- 172.21.15.138:0/81568250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff80c151e90 msgr2=0x7ff80c0c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:18.535 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.535+0000 7ff813d57640 1 --2- 172.21.15.138:0/81568250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff80c151e90 0x7ff80c0c4920 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff8080097f0 tx=0x7ff80801c3a0 comp rx=0 tx=0).stop 2023-12-19T18:58:18.535 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.535+0000 7ff813d57640 1 -- 172.21.15.138:0/81568250 shutdown_connections 2023-12-19T18:58:18.535 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.535+0000 7ff813d57640 1 --2- 172.21.15.138:0/81568250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff80c151e90 0x7ff80c0c4920 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:18.535 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.535+0000 7ff813d57640 1 -- 172.21.15.138:0/81568250 >> 172.21.15.138:0/81568250 conn(0x7ff80c0ca170 msgr2=0x7ff80c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:18.535 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.535+0000 7ff813d57640 1 -- 172.21.15.138:0/81568250 shutdown_connections 2023-12-19T18:58:18.535 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.535+0000 7ff813d57640 1 -- 172.21.15.138:0/81568250 wait complete. 2023-12-19T18:58:18.536 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.535+0000 7ff813d57640 1 Processor -- start 2023-12-19T18:58:18.536 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.535+0000 7ff813d57640 1 -- start start 2023-12-19T18:58:18.539 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.535+0000 7ff813d57640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff80c0c4e60 0x7ff80c0ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:18.539 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.535+0000 7ff813d57640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff80c0c7ea0 0x7ff80c153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:18.539 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.535+0000 7ff813d57640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff80c151e90 0x7ff80c0ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:18.539 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.535+0000 7ff813d57640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c1552d0 con 0x7ff80c0c4e60 2023-12-19T18:58:18.539 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.535+0000 7ff813d57640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c0acd10 con 0x7ff80c0c7ea0 2023-12-19T18:58:18.539 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.535+0000 7ff813d57640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80c0ab790 con 0x7ff80c151e90 2023-12-19T18:58:18.539 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.535+0000 7ff8122f4640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff80c151e90 0x7ff80c0ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:18.539 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.535+0000 7ff8112f2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff80c0c7ea0 0x7ff80c153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:18.539 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.539+0000 7ff8122f4640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff80c151e90 0x7ff80c0ad1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:58834/0 (socket says 172.21.15.138:58834) 2023-12-19T18:58:18.540 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.539+0000 7ff8122f4640 1 -- 172.21.15.138:0/667705024 learned_addr learned my addr 172.21.15.138:0/667705024 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-12-19T18:58:18.540 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.539+0000 7ff811af3640 1 --2- 172.21.15.138:0/667705024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff80c0c4e60 0x7ff80c0ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:18.540 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.539+0000 7ff8122f4640 1 -- 172.21.15.138:0/667705024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff80c0c7ea0 msgr2=0x7ff80c153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:18.540 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.539+0000 7ff8122f4640 1 --2- 172.21.15.138:0/667705024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff80c0c7ea0 0x7ff80c153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:18.540 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.539+0000 7ff8122f4640 1 -- 172.21.15.138:0/667705024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff80c0c4e60 msgr2=0x7ff80c0ac310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:18.540 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.539+0000 7ff8122f4640 1 --2- 172.21.15.138:0/667705024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff80c0c4e60 0x7ff80c0ac310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:18.540 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.539+0000 7ff8122f4640 1 -- 172.21.15.138:0/667705024 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff808009420 con 0x7ff80c151e90 2023-12-19T18:58:18.540 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.539+0000 7ff8112f2640 1 --2- 172.21.15.138:0/667705024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff80c0c7ea0 0x7ff80c153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:58:18.540 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.539+0000 7ff8122f4640 1 --2- 172.21.15.138:0/667705024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff80c151e90 0x7ff80c0ad1a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff80400c780 tx=0x7ff80400cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:18.540 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.539+0000 7ff8027fc640 1 -- 172.21.15.138:0/667705024 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80400ce90 con 0x7ff80c151e90 2023-12-19T18:58:18.540 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.539+0000 7ff8027fc640 1 -- 172.21.15.138:0/667705024 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff80400a640 con 0x7ff80c151e90 2023-12-19T18:58:18.540 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.539+0000 7ff8027fc640 1 -- 172.21.15.138:0/667705024 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff80400a9d0 con 0x7ff80c151e90 2023-12-19T18:58:18.540 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.539+0000 7ff813d57640 1 -- 172.21.15.138:0/667705024 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff80c0aba70 con 0x7ff80c151e90 2023-12-19T18:58:18.540 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.539+0000 7ff813d57640 1 -- 172.21.15.138:0/667705024 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff80c0ac030 con 0x7ff80c151e90 2023-12-19T18:58:18.541 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.539+0000 7ff8027fc640 1 -- 172.21.15.138:0/667705024 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff8040070d0 con 0x7ff80c151e90 2023-12-19T18:58:18.541 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.539+0000 7ff8027fc640 1 -- 172.21.15.138:0/667705024 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff804012490 con 0x7ff80c151e90 2023-12-19T18:58:18.541 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.539+0000 7ff813d57640 1 -- 172.21.15.138:0/667705024 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff80c0acb60 con 0x7ff80c151e90 2023-12-19T18:58:18.548 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.547+0000 7ff8027fc640 1 -- 172.21.15.138:0/667705024 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7ff804018070 con 0x7ff80c151e90 2023-12-19T18:58:18.593 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-19T18:58:18.589+0000 7fb62ff5b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-19T18:58:18.606 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:18.607+0000 7fbeca8c1180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-19T18:58:18.614 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.615+0000 7ff813d57640 1 -- 172.21.15.138:0/667705024 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a8c2e9cd-28d1-4571-be11-049752ec6b24", "id": 0} v 0) v1 -- 0x7ff80c0adea0 con 0x7ff80c151e90 2023-12-19T18:58:18.619 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.619+0000 7ff8027fc640 1 -- 172.21.15.138:0/667705024 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a8c2e9cd-28d1-4571-be11-049752ec6b24", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff804007630 con 0x7ff80c151e90 2023-12-19T18:58:18.619 INFO:teuthology.orchestra.run.smithi138.stdout:0 2023-12-19T18:58:18.620 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.619+0000 7ff813d57640 1 -- 172.21.15.138:0/667705024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff80c151e90 msgr2=0x7ff80c0ad1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:18.620 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.619+0000 7ff813d57640 1 --2- 172.21.15.138:0/667705024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff80c151e90 0x7ff80c0ad1a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff80400c780 tx=0x7ff80400cc40 comp rx=0 tx=0).stop 2023-12-19T18:58:18.620 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.619+0000 7ff813d57640 1 -- 172.21.15.138:0/667705024 shutdown_connections 2023-12-19T18:58:18.621 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.619+0000 7ff813d57640 1 --2- 172.21.15.138:0/667705024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff80c151e90 0x7ff80c0ad1a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:18.621 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.619+0000 7ff813d57640 1 --2- 172.21.15.138:0/667705024 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff80c0c7ea0 0x7ff80c153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:18.621 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.619+0000 7ff813d57640 1 --2- 172.21.15.138:0/667705024 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff80c0c4e60 0x7ff80c0ac310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:18.621 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.619+0000 7ff813d57640 1 -- 172.21.15.138:0/667705024 >> 172.21.15.138:0/667705024 conn(0x7ff80c0ca170 msgr2=0x7ff80c1481e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:18.621 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.619+0000 7ff813d57640 1 -- 172.21.15.138:0/667705024 shutdown_connections 2023-12-19T18:58:18.621 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.619+0000 7ff813d57640 1 -- 172.21.15.138:0/667705024 wait complete. 2023-12-19T18:58:18.639 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new dd512604-37d9-45fd-80b5-6ed8cf3e768f 1 2023-12-19T18:58:18.774 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.774+0000 7fb6193d1640 1 Processor -- start 2023-12-19T18:58:18.774 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.774+0000 7fb6193d1640 1 -- start start 2023-12-19T18:58:18.776 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.774+0000 7fb6193d1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb614151e90 0x7fb6140c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:18.776 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.774+0000 7fb6193d1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6140c4e60 0x7fb61406bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:18.776 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.774+0000 7fb6193d1640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb61406c860 con 0x7fb6140c7ea0 2023-12-19T18:58:18.776 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.774+0000 7fb6193d1640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6140c8750 con 0x7fb614151e90 2023-12-19T18:58:18.777 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.774+0000 7fb6193d1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6141552d0 con 0x7fb6140c4e60 2023-12-19T18:58:18.777 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.774+0000 7fb60bfff640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fb6140c7ea0 0x7fb61406b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:38882/0 (socket says 172.21.15.138:38882) 2023-12-19T18:58:18.777 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.774+0000 7fb6137fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6140c4e60 0x7fb61406bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:18.777 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.774+0000 7fb60bfff640 1 -- 172.21.15.138:0/2238685892 learned_addr learned my addr 172.21.15.138:0/2238685892 (peer_addr_for_me v1:172.21.15.138:0/0) 2023-12-19T18:58:18.777 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.774+0000 7fb612ffd640 1 --2- 172.21.15.138:0/2238685892 >> v2:172.21.15.133:3300/0 conn(0x7fb614151e90 0x7fb6140c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:18.777 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.774+0000 7fb6127fc640 1 -- 172.21.15.138:0/2238685892 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213465112 0 0) 0x7fb61406c860 con 0x7fb6140c7ea0 2023-12-19T18:58:18.777 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.774+0000 7fb6127fc640 1 -- 172.21.15.138:0/2238685892 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb600003530 con 0x7fb6140c7ea0 2023-12-19T18:58:18.777 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.774+0000 7fb6137fe640 1 -- 172.21.15.138:0/2238685892 >> v2:172.21.15.133:3300/0 conn(0x7fb614151e90 msgr2=0x7fb6140c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:18.777 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.774+0000 7fb6137fe640 1 --2- 172.21.15.138:0/2238685892 >> v2:172.21.15.133:3300/0 conn(0x7fb614151e90 0x7fb6140c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:18.777 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.774+0000 7fb6137fe640 1 -- 172.21.15.138:0/2238685892 >> v1:172.21.15.138:6789/0 conn(0x7fb6140c7ea0 legacy=0x7fb61406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:18.777 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.774+0000 7fb6137fe640 1 -- 172.21.15.138:0/2238685892 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb614154930 con 0x7fb6140c4e60 2023-12-19T18:58:18.781 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.778+0000 7fb6137fe640 1 --2- 172.21.15.138:0/2238685892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6140c4e60 0x7fb61406bbb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009d90 tx=0x7fb60c01c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e07b1064dcf9e2f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:18.781 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.778+0000 7fb6127fc640 1 -- 172.21.15.138:0/2238685892 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c0a6700 con 0x7fb6140c4e60 2023-12-19T18:58:18.781 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.782+0000 7fb6127fc640 1 -- 172.21.15.138:0/2238685892 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60c0a6860 con 0x7fb6140c4e60 2023-12-19T18:58:18.781 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.782+0000 7fb6127fc640 1 -- 172.21.15.138:0/2238685892 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c0a6bf0 con 0x7fb6140c4e60 2023-12-19T18:58:18.782 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.782+0000 7fb6193d1640 1 -- 172.21.15.138:0/2238685892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6140c4e60 msgr2=0x7fb61406bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:18.782 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.782+0000 7fb6193d1640 1 --2- 172.21.15.138:0/2238685892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6140c4e60 0x7fb61406bbb0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb60c009d90 tx=0x7fb60c01c830 comp rx=0 tx=0).stop 2023-12-19T18:58:18.783 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.782+0000 7fb6193d1640 1 -- 172.21.15.138:0/2238685892 shutdown_connections 2023-12-19T18:58:18.783 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.782+0000 7fb6193d1640 1 --2- 172.21.15.138:0/2238685892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6140c4e60 0x7fb61406bbb0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:18.783 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.782+0000 7fb6193d1640 1 --2- 172.21.15.138:0/2238685892 >> v2:172.21.15.133:3300/0 conn(0x7fb614151e90 0x7fb6140c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:18.783 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.782+0000 7fb6193d1640 1 -- 172.21.15.138:0/2238685892 >> 172.21.15.138:0/2238685892 conn(0x7fb6140ca170 msgr2=0x7fb6140ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:18.783 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.782+0000 7fb6193d1640 1 -- 172.21.15.138:0/2238685892 shutdown_connections 2023-12-19T18:58:18.783 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.782+0000 7fb6193d1640 1 -- 172.21.15.138:0/2238685892 wait complete. 2023-12-19T18:58:18.784 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.782+0000 7fb6193d1640 1 Processor -- start 2023-12-19T18:58:18.784 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.782+0000 7fb6193d1640 1 -- start start 2023-12-19T18:58:18.786 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.782+0000 7fb6193d1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6140c4e60 0x7fb6140acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:18.786 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.782+0000 7fb6193d1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6140c7ea0 0x7fb614157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:18.786 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.782+0000 7fb6193d1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb614151e90 0x7fb61414ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:18.786 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.782+0000 7fb6193d1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61414c630 con 0x7fb6140c4e60 2023-12-19T18:58:18.786 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.782+0000 7fb6193d1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140af1e0 con 0x7fb614151e90 2023-12-19T18:58:18.786 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.782+0000 7fb6193d1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6141ecf20 con 0x7fb6140c7ea0 2023-12-19T18:58:18.786 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.782+0000 7fb60bfff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6140c7ea0 0x7fb614157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:18.786 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.782+0000 7fb6137fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb614151e90 0x7fb61414ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:18.786 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.782+0000 7fb60bfff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6140c7ea0 0x7fb614157f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:58860/0 (socket says 172.21.15.138:58860) 2023-12-19T18:58:18.786 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.782+0000 7fb60bfff640 1 -- 172.21.15.138:0/3020385970 learned_addr learned my addr 172.21.15.138:0/3020385970 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-12-19T18:58:18.786 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.782+0000 7fb612ffd640 1 --2- 172.21.15.138:0/3020385970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6140c4e60 0x7fb6140acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:18.787 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.786+0000 7fb60bfff640 1 -- 172.21.15.138:0/3020385970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb614151e90 msgr2=0x7fb61414ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:18.787 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.786+0000 7fb60bfff640 1 --2- 172.21.15.138:0/3020385970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb614151e90 0x7fb61414ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:18.787 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.786+0000 7fb60bfff640 1 -- 172.21.15.138:0/3020385970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6140c4e60 msgr2=0x7fb6140acbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:18.787 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.786+0000 7fb60bfff640 1 --2- 172.21.15.138:0/3020385970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6140c4e60 0x7fb6140acbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:18.787 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.786+0000 7fb60bfff640 1 -- 172.21.15.138:0/3020385970 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c009a70 con 0x7fb6140c7ea0 2023-12-19T18:58:18.787 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.786+0000 7fb60bfff640 1 --2- 172.21.15.138:0/3020385970 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6140c7ea0 0x7fb614157f40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00c450 tx=0x7fb5fc00c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:18.788 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.786+0000 7fb60b7fe640 1 -- 172.21.15.138:0/3020385970 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc005cf0 con 0x7fb6140c7ea0 2023-12-19T18:58:18.788 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.786+0000 7fb60b7fe640 1 -- 172.21.15.138:0/3020385970 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5fc005e50 con 0x7fb6140c7ea0 2023-12-19T18:58:18.788 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.786+0000 7fb6193d1640 1 -- 172.21.15.138:0/3020385970 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6141ecc80 con 0x7fb6140c7ea0 2023-12-19T18:58:18.788 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.786+0000 7fb60b7fe640 1 -- 172.21.15.138:0/3020385970 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5fc007270 con 0x7fb6140c7ea0 2023-12-19T18:58:18.788 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.786+0000 7fb6193d1640 1 -- 172.21.15.138:0/3020385970 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb61414c250 con 0x7fb6140c7ea0 2023-12-19T18:58:18.788 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.786+0000 7fb60b7fe640 1 -- 172.21.15.138:0/3020385970 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb5fc01c440 con 0x7fb6140c7ea0 2023-12-19T18:58:18.788 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.786+0000 7fb60b7fe640 1 -- 172.21.15.138:0/3020385970 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fb5fc0127b0 con 0x7fb6140c7ea0 2023-12-19T18:58:18.788 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.786+0000 7fb6193d1640 1 -- 172.21.15.138:0/3020385970 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61414c770 con 0x7fb6140c7ea0 2023-12-19T18:58:18.789 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.790+0000 7fb60b7fe640 1 -- 172.21.15.138:0/3020385970 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7fb61414c770 con 0x7fb6140c7ea0 2023-12-19T18:58:18.799 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-19T18:58:18.797+0000 7fb62ff5b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-19T18:58:18.816 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:18.814+0000 7fbeca8c1180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-19T18:58:18.859 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.858+0000 7fb6193d1640 1 -- 172.21.15.138:0/3020385970 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd new", "uuid": "dd512604-37d9-45fd-80b5-6ed8cf3e768f", "id": 1} v 0) v1 -- 0x7fb614068400 con 0x7fb6140c7ea0 2023-12-19T18:58:18.865 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.862+0000 7fb60b7fe640 1 -- 172.21.15.138:0/3020385970 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dd512604-37d9-45fd-80b5-6ed8cf3e768f", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb5fc021060 con 0x7fb6140c7ea0 2023-12-19T18:58:18.865 INFO:teuthology.orchestra.run.smithi138.stdout:1 2023-12-19T18:58:18.867 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.866+0000 7fb6193d1640 1 -- 172.21.15.138:0/3020385970 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6140c7ea0 msgr2=0x7fb614157f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:18.867 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.866+0000 7fb6193d1640 1 --2- 172.21.15.138:0/3020385970 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6140c7ea0 0x7fb614157f40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00c450 tx=0x7fb5fc00c910 comp rx=0 tx=0).stop 2023-12-19T18:58:18.867 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.866+0000 7fb6193d1640 1 -- 172.21.15.138:0/3020385970 shutdown_connections 2023-12-19T18:58:18.867 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.866+0000 7fb6193d1640 1 --2- 172.21.15.138:0/3020385970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb614151e90 0x7fb61414ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:18.867 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.866+0000 7fb6193d1640 1 --2- 172.21.15.138:0/3020385970 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6140c7ea0 0x7fb614157f40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:18.868 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.866+0000 7fb6193d1640 1 --2- 172.21.15.138:0/3020385970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6140c4e60 0x7fb6140acbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:18.868 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.866+0000 7fb6193d1640 1 -- 172.21.15.138:0/3020385970 >> 172.21.15.138:0/3020385970 conn(0x7fb6140ca170 msgr2=0x7fb6140ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:18.868 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.866+0000 7fb6193d1640 1 -- 172.21.15.138:0/3020385970 shutdown_connections 2023-12-19T18:58:18.868 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:18.866+0000 7fb6193d1640 1 -- 172.21.15.138:0/3020385970 wait complete. 2023-12-19T18:58:18.885 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new df52ee94-3b99-4b0f-b79f-605737675bed 2 2023-12-19T18:58:19.021 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.018+0000 7f085d365640 1 Processor -- start 2023-12-19T18:58:19.021 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.018+0000 7f085d365640 1 -- start start 2023-12-19T18:58:19.022 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.018+0000 7f085d365640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08580c5640 0x7f08580c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:19.023 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.022+0000 7f085d365640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08580c2580 con 0x7f08580c60f0 2023-12-19T18:58:19.023 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.022+0000 7f085d365640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08580c1a00 con 0x7f08580c5260 2023-12-19T18:58:19.023 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.022+0000 7f085d365640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0858153510 con 0x7f08580c5640 2023-12-19T18:58:19.023 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.022+0000 7f084ffff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08580c5640 0x7f08580c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:19.023 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.022+0000 7f0856ffd640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f08580c5260 0x7f085806d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:38888/0 (socket says 172.21.15.138:38888) 2023-12-19T18:58:19.023 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.022+0000 7f0856ffd640 1 -- 172.21.15.138:0/3855678761 learned_addr learned my addr 172.21.15.138:0/3855678761 (peer_addr_for_me v1:172.21.15.138:0/0) 2023-12-19T18:58:19.024 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.022+0000 7f08567fc640 1 -- 172.21.15.138:0/3855678761 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165263392 0 0) 0x7f08580c1a00 con 0x7f08580c5260 2023-12-19T18:58:19.024 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.022+0000 7f084ffff640 1 -- 172.21.15.138:0/3855678761 >> v1:172.21.15.138:6789/0 conn(0x7f08580c5260 legacy=0x7f085806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:19.024 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.022+0000 7f084ffff640 1 -- 172.21.15.138:0/3855678761 >> v1:172.21.15.133:6789/0 conn(0x7f08580c60f0 legacy=0x7f0858155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:19.024 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.022+0000 7f084ffff640 1 -- 172.21.15.138:0/3855678761 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08580c1ce0 con 0x7f08580c5640 2023-12-19T18:58:19.025 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.022+0000 7f084ffff640 1 --2- 172.21.15.138:0/3855678761 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08580c5640 0x7f08580c5bb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f08400097f0 tx=0x7f084001c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=500fd40cbe1709d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:19.026 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.022+0000 7f08567fc640 1 -- 172.21.15.138:0/3855678761 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08400ab600 con 0x7f08580c5640 2023-12-19T18:58:19.026 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.026+0000 7f08567fc640 1 -- 172.21.15.138:0/3855678761 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08400a7050 con 0x7f08580c5640 2023-12-19T18:58:19.026 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.026+0000 7f08567fc640 1 -- 172.21.15.138:0/3855678761 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08400ab980 con 0x7f08580c5640 2023-12-19T18:58:19.028 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.026+0000 7f085d365640 1 -- 172.21.15.138:0/3855678761 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08580c5640 msgr2=0x7f08580c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:19.028 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.026+0000 7f085d365640 1 --2- 172.21.15.138:0/3855678761 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08580c5640 0x7f08580c5bb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f08400097f0 tx=0x7f084001c430 comp rx=0 tx=0).stop 2023-12-19T18:58:19.028 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.026+0000 7f085d365640 1 -- 172.21.15.138:0/3855678761 shutdown_connections 2023-12-19T18:58:19.028 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.026+0000 7f085d365640 1 --2- 172.21.15.138:0/3855678761 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08580c5640 0x7f08580c5bb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.028 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.026+0000 7f085d365640 1 -- 172.21.15.138:0/3855678761 >> 172.21.15.138:0/3855678761 conn(0x7f085806a5b0 msgr2=0x7f085806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:19.029 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.026+0000 7f085d365640 1 -- 172.21.15.138:0/3855678761 shutdown_connections 2023-12-19T18:58:19.029 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.026+0000 7f085d365640 1 -- 172.21.15.138:0/3855678761 wait complete. 2023-12-19T18:58:19.029 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.026+0000 7f085d365640 1 Processor -- start 2023-12-19T18:58:19.029 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.026+0000 7f085d365640 1 -- start start 2023-12-19T18:58:19.031 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.026+0000 7f085d365640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08580c5260 0x7f085814eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:19.031 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.026+0000 7f085d365640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08580c5640 0x7f0858141410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:19.031 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.026+0000 7f085d365640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08580c60f0 0x7f0858141950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:19.031 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.026+0000 7f085d365640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0858070bd0 con 0x7f08580c60f0 2023-12-19T18:58:19.031 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.026+0000 7f085d365640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0858148d70 con 0x7f08580c5640 2023-12-19T18:58:19.031 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.026+0000 7f085d365640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08581498f0 con 0x7f08580c5260 2023-12-19T18:58:19.032 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.026+0000 7f0856ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08580c5260 0x7f085814eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:19.032 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.026+0000 7f084ffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08580c5640 0x7f0858141410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:19.032 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.026+0000 7f0856ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08580c5260 0x7f085814eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:58872/0 (socket says 172.21.15.138:58872) 2023-12-19T18:58:19.032 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.026+0000 7f0856ffd640 1 -- 172.21.15.138:0/326141960 learned_addr learned my addr 172.21.15.138:0/326141960 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-12-19T18:58:19.032 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.026+0000 7f08577fe640 1 --2- 172.21.15.138:0/326141960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08580c60f0 0x7f0858141950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:19.032 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.030+0000 7f0856ffd640 1 -- 172.21.15.138:0/326141960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08580c5640 msgr2=0x7f0858141410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:19.032 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.030+0000 7f0856ffd640 1 --2- 172.21.15.138:0/326141960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08580c5640 0x7f0858141410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.032 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.030+0000 7f0856ffd640 1 -- 172.21.15.138:0/326141960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08580c60f0 msgr2=0x7f0858141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:19.032 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.030+0000 7f0856ffd640 1 --2- 172.21.15.138:0/326141960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08580c60f0 0x7f0858141950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.032 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.030+0000 7f0856ffd640 1 -- 172.21.15.138:0/326141960 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0840009420 con 0x7f08580c5260 2023-12-19T18:58:19.032 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.030+0000 7f0856ffd640 1 --2- 172.21.15.138:0/326141960 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08580c5260 0x7f085814eb80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f084800c410 tx=0x7f084800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:19.032 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.030+0000 7f084f7fe640 1 -- 172.21.15.138:0/326141960 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480074e0 con 0x7f08580c5260 2023-12-19T18:58:19.032 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.030+0000 7f084f7fe640 1 -- 172.21.15.138:0/326141960 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0848007640 con 0x7f08580c5260 2023-12-19T18:58:19.032 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.030+0000 7f085d365640 1 -- 172.21.15.138:0/326141960 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0858148fc0 con 0x7f08580c5260 2023-12-19T18:58:19.033 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.030+0000 7f084f7fe640 1 -- 172.21.15.138:0/326141960 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0848004a30 con 0x7f08580c5260 2023-12-19T18:58:19.033 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.030+0000 7f085d365640 1 -- 172.21.15.138:0/326141960 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0858149580 con 0x7f08580c5260 2023-12-19T18:58:19.033 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.030+0000 7f084f7fe640 1 -- 172.21.15.138:0/326141960 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f084801d3f0 con 0x7f08580c5260 2023-12-19T18:58:19.033 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.030+0000 7f084f7fe640 1 -- 172.21.15.138:0/326141960 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f08480137e0 con 0x7f08580c5260 2023-12-19T18:58:19.033 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.030+0000 7f085d365640 1 -- 172.21.15.138:0/326141960 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0858068400 con 0x7f08580c5260 2023-12-19T18:58:19.034 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.034+0000 7f084f7fe640 1 -- 172.21.15.138:0/326141960 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f08480133c0 con 0x7f08580c5260 2023-12-19T18:58:19.099 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.098+0000 7f085d365640 1 -- 172.21.15.138:0/326141960 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd new", "uuid": "df52ee94-3b99-4b0f-b79f-605737675bed", "id": 2} v 0) v1 -- 0x7f08580c35c0 con 0x7f08580c5260 2023-12-19T18:58:19.106 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.106+0000 7f084f7fe640 1 -- 172.21.15.138:0/326141960 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "df52ee94-3b99-4b0f-b79f-605737675bed", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0848013a90 con 0x7f08580c5260 2023-12-19T18:58:19.106 INFO:teuthology.orchestra.run.smithi138.stdout:2 2023-12-19T18:58:19.107 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.106+0000 7f085d365640 1 -- 172.21.15.138:0/326141960 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08580c5260 msgr2=0x7f085814eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:19.107 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.106+0000 7f085d365640 1 --2- 172.21.15.138:0/326141960 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08580c5260 0x7f085814eb80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f084800c410 tx=0x7f084800c8d0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.107 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.106+0000 7f085d365640 1 -- 172.21.15.138:0/326141960 shutdown_connections 2023-12-19T18:58:19.107 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.106+0000 7f085d365640 1 --2- 172.21.15.138:0/326141960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f08580c60f0 0x7f0858141950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.107 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.106+0000 7f085d365640 1 --2- 172.21.15.138:0/326141960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f08580c5640 0x7f0858141410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.107 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.106+0000 7f085d365640 1 --2- 172.21.15.138:0/326141960 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f08580c5260 0x7f085814eb80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.108 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.106+0000 7f085d365640 1 -- 172.21.15.138:0/326141960 >> 172.21.15.138:0/326141960 conn(0x7f085806a5b0 msgr2=0x7f0858155de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:19.108 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.106+0000 7f085d365640 1 -- 172.21.15.138:0/326141960 shutdown_connections 2023-12-19T18:58:19.108 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.106+0000 7f085d365640 1 -- 172.21.15.138:0/326141960 wait complete. 2023-12-19T18:58:19.126 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new d6c8a62c-7fc9-475d-a9b4-b48d4bc43043 3 2023-12-19T18:58:19.262 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.258+0000 7ff23e079640 1 Processor -- start 2023-12-19T18:58:19.262 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.262+0000 7ff23e079640 1 -- start start 2023-12-19T18:58:19.263 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.262+0000 7ff23e079640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff238151e90 0x7ff2380c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:19.263 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.262+0000 7ff23e079640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff2380c7ea0 0x7ff23806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:19.263 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.262+0000 7ff23e079640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23806c860 con 0x7ff2380c4e60 2023-12-19T18:58:19.263 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.262+0000 7ff23e079640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2380c8750 con 0x7ff2380c7ea0 2023-12-19T18:58:19.263 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.262+0000 7ff23e079640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2381552d0 con 0x7ff238151e90 2023-12-19T18:58:19.263 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.262+0000 7ff2377fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff238151e90 0x7ff2380c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:19.263 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.262+0000 7ff2377fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff238151e90 0x7ff2380c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:58886/0 (socket says 172.21.15.138:58886) 2023-12-19T18:58:19.264 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.262+0000 7ff2377fe640 1 -- 172.21.15.138:0/3394488825 learned_addr learned my addr 172.21.15.138:0/3394488825 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-12-19T18:58:19.264 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.262+0000 7ff236ffd640 1 --2- 172.21.15.138:0/3394488825 >> v2:172.21.15.138:3300/0 conn(0x7ff2380c7ea0 0x7ff23806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:19.265 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.262+0000 7ff2377fe640 1 -- 172.21.15.138:0/3394488825 >> v2:172.21.15.138:3300/0 conn(0x7ff2380c7ea0 msgr2=0x7ff23806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:19.265 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.262+0000 7ff2377fe640 1 --2- 172.21.15.138:0/3394488825 >> v2:172.21.15.138:3300/0 conn(0x7ff2380c7ea0 0x7ff23806b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.265 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.262+0000 7ff2377fe640 1 -- 172.21.15.138:0/3394488825 >> v1:172.21.15.133:6789/0 conn(0x7ff2380c4e60 legacy=0x7ff23806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:19.265 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.262+0000 7ff2377fe640 1 -- 172.21.15.138:0/3394488825 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff238154930 con 0x7ff238151e90 2023-12-19T18:58:19.266 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.266+0000 7ff2377fe640 1 --2- 172.21.15.138:0/3394488825 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff238151e90 0x7ff2380c4920 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff228009870 tx=0x7ff22801c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eed2328a98a342a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:19.266 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.266+0000 7ff2367fc640 1 -- 172.21.15.138:0/3394488825 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2280ab600 con 0x7ff238151e90 2023-12-19T18:58:19.267 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.266+0000 7ff2367fc640 1 -- 172.21.15.138:0/3394488825 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2280a7050 con 0x7ff238151e90 2023-12-19T18:58:19.267 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.266+0000 7ff2367fc640 1 -- 172.21.15.138:0/3394488825 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2280ab980 con 0x7ff238151e90 2023-12-19T18:58:19.267 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.266+0000 7ff23e079640 1 -- 172.21.15.138:0/3394488825 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff238151e90 msgr2=0x7ff2380c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:19.268 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.266+0000 7ff23e079640 1 --2- 172.21.15.138:0/3394488825 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff238151e90 0x7ff2380c4920 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff228009870 tx=0x7ff22801c420 comp rx=0 tx=0).stop 2023-12-19T18:58:19.268 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.266+0000 7ff23e079640 1 -- 172.21.15.138:0/3394488825 shutdown_connections 2023-12-19T18:58:19.268 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.266+0000 7ff23e079640 1 --2- 172.21.15.138:0/3394488825 >> v2:172.21.15.138:3300/0 conn(0x7ff2380c7ea0 0x7ff23806b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.268 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.266+0000 7ff23e079640 1 --2- 172.21.15.138:0/3394488825 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff238151e90 0x7ff2380c4920 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.268 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.266+0000 7ff23e079640 1 -- 172.21.15.138:0/3394488825 >> 172.21.15.138:0/3394488825 conn(0x7ff2380ca170 msgr2=0x7ff2380ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:19.268 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.266+0000 7ff23e079640 1 -- 172.21.15.138:0/3394488825 shutdown_connections 2023-12-19T18:58:19.268 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.266+0000 7ff23e079640 1 -- 172.21.15.138:0/3394488825 wait complete. 2023-12-19T18:58:19.269 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.266+0000 7ff23e079640 1 Processor -- start 2023-12-19T18:58:19.269 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.266+0000 7ff23e079640 1 -- start start 2023-12-19T18:58:19.271 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff23e079640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2380c4e60 0x7ff2380ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:19.271 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff23e079640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2380c7ea0 0x7ff2381ed860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:19.271 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff23e079640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff238151e90 0x7ff238143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:19.271 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff23e079640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2381ed3d0 con 0x7ff2380c4e60 2023-12-19T18:58:19.271 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff23e079640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2380aeca0 con 0x7ff2380c7ea0 2023-12-19T18:58:19.271 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff23e079640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2380ae9c0 con 0x7ff238151e90 2023-12-19T18:58:19.271 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff236ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2380c7ea0 0x7ff2381ed860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:19.271 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff237fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff238151e90 0x7ff238143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:19.272 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff236ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2380c7ea0 0x7ff2381ed860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:52206/0 (socket says 172.21.15.138:52206) 2023-12-19T18:58:19.272 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff236ffd640 1 -- 172.21.15.138:0/74622480 learned_addr learned my addr 172.21.15.138:0/74622480 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-12-19T18:58:19.272 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff2377fe640 1 --2- 172.21.15.138:0/74622480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2380c4e60 0x7ff2380ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:19.272 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff236ffd640 1 -- 172.21.15.138:0/74622480 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff238151e90 msgr2=0x7ff238143d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:19.272 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff236ffd640 1 --2- 172.21.15.138:0/74622480 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff238151e90 0x7ff238143d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.272 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff236ffd640 1 -- 172.21.15.138:0/74622480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2380c4e60 msgr2=0x7ff2380ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:19.272 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff236ffd640 1 --2- 172.21.15.138:0/74622480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2380c4e60 0x7ff2380ae3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.272 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff236ffd640 1 -- 172.21.15.138:0/74622480 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2280094d0 con 0x7ff2380c7ea0 2023-12-19T18:58:19.272 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff2377fe640 1 --2- 172.21.15.138:0/74622480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2380c4e60 0x7ff2380ae3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:58:19.272 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff236ffd640 1 --2- 172.21.15.138:0/74622480 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2380c7ea0 0x7ff2381ed860 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff22c00e900 tx=0x7ff22c00edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:19.273 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff21ffff640 1 -- 172.21.15.138:0/74622480 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c009690 con 0x7ff2380c7ea0 2023-12-19T18:58:19.274 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff21ffff640 1 -- 172.21.15.138:0/74622480 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c00ca00 con 0x7ff2380c7ea0 2023-12-19T18:58:19.274 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff23e079640 1 -- 172.21.15.138:0/74622480 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2381ecd80 con 0x7ff2380c7ea0 2023-12-19T18:58:19.274 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff21ffff640 1 -- 172.21.15.138:0/74622480 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c00cd90 con 0x7ff2380c7ea0 2023-12-19T18:58:19.274 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff23e079640 1 -- 172.21.15.138:0/74622480 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff238144240 con 0x7ff2380c7ea0 2023-12-19T18:58:19.274 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff21ffff640 1 -- 172.21.15.138:0/74622480 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff22c005ca0 con 0x7ff2380c7ea0 2023-12-19T18:58:19.274 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff21ffff640 1 -- 172.21.15.138:0/74622480 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7ff22c0064b0 con 0x7ff2380c7ea0 2023-12-19T18:58:19.274 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.270+0000 7ff23e079640 1 -- 172.21.15.138:0/74622480 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2381ed540 con 0x7ff2380c7ea0 2023-12-19T18:58:19.276 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.274+0000 7ff21ffff640 1 -- 172.21.15.138:0/74622480 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7ff22c021060 con 0x7ff2380c7ea0 2023-12-19T18:58:19.341 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.342+0000 7ff23e079640 1 -- 172.21.15.138:0/74622480 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d6c8a62c-7fc9-475d-a9b4-b48d4bc43043", "id": 3} v 0) v1 -- 0x7ff238068400 con 0x7ff2380c7ea0 2023-12-19T18:58:19.348 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.346+0000 7ff21ffff640 1 -- 172.21.15.138:0/74622480 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d6c8a62c-7fc9-475d-a9b4-b48d4bc43043", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff22c029020 con 0x7ff2380c7ea0 2023-12-19T18:58:19.349 INFO:teuthology.orchestra.run.smithi138.stdout:3 2023-12-19T18:58:19.350 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.350+0000 7ff23e079640 1 -- 172.21.15.138:0/74622480 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2380c7ea0 msgr2=0x7ff2381ed860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:19.350 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.350+0000 7ff23e079640 1 --2- 172.21.15.138:0/74622480 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2380c7ea0 0x7ff2381ed860 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff22c00e900 tx=0x7ff22c00edc0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.350 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.350+0000 7ff23e079640 1 -- 172.21.15.138:0/74622480 shutdown_connections 2023-12-19T18:58:19.350 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.350+0000 7ff23e079640 1 --2- 172.21.15.138:0/74622480 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff238151e90 0x7ff238143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.351 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.350+0000 7ff23e079640 1 --2- 172.21.15.138:0/74622480 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2380c7ea0 0x7ff2381ed860 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.351 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.350+0000 7ff23e079640 1 --2- 172.21.15.138:0/74622480 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2380c4e60 0x7ff2380ae3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.351 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.350+0000 7ff23e079640 1 -- 172.21.15.138:0/74622480 >> 172.21.15.138:0/74622480 conn(0x7ff2380ca170 msgr2=0x7ff238153f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:19.351 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.350+0000 7ff23e079640 1 -- 172.21.15.138:0/74622480 shutdown_connections 2023-12-19T18:58:19.351 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.350+0000 7ff23e079640 1 -- 172.21.15.138:0/74622480 wait complete. 2023-12-19T18:58:19.370 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 3df6c9b2-a431-4825-80ad-9b46e58fed89 4 2023-12-19T18:58:19.426 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-19T18:58:19.425+0000 7fb62ff5b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-19T18:58:19.470 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:19.470+0000 7fbeca8c1180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-19T18:58:19.487 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-19T18:58:19.485+0000 7fb62ff5b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-19T18:58:19.506 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.506+0000 7f0d71209640 1 Processor -- start 2023-12-19T18:58:19.507 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.506+0000 7f0d71209640 1 -- start start 2023-12-19T18:58:19.508 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.506+0000 7f0d71209640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d6c151e90 0x7f0d6c0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:19.508 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.506+0000 7f0d71209640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0d6c0c7ea0 0x7f0d6c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:19.508 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.506+0000 7f0d71209640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d6c06c860 con 0x7f0d6c0c4e60 2023-12-19T18:58:19.509 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.506+0000 7f0d71209640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d6c0c8750 con 0x7f0d6c0c7ea0 2023-12-19T18:58:19.509 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.506+0000 7f0d71209640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c1552d0 con 0x7f0d6c151e90 2023-12-19T18:58:19.509 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.506+0000 7f0d6a59c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0d6c0c7ea0 0x7f0d6c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:19.509 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.506+0000 7f0d6ad9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d6c151e90 0x7f0d6c0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:19.509 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.506+0000 7f0d6a59c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0d6c0c7ea0 0x7f0d6c06b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:52210/0 (socket says 172.21.15.138:52210) 2023-12-19T18:58:19.509 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.506+0000 7f0d6a59c640 1 -- 172.21.15.138:0/4009122346 learned_addr learned my addr 172.21.15.138:0/4009122346 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-12-19T18:58:19.509 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.506+0000 7f0d6a59c640 1 -- 172.21.15.138:0/4009122346 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d6c151e90 msgr2=0x7f0d6c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:19.509 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.506+0000 7f0d6a59c640 1 --2- 172.21.15.138:0/4009122346 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d6c151e90 0x7f0d6c0c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.509 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.506+0000 7f0d6a59c640 1 -- 172.21.15.138:0/4009122346 >> v1:172.21.15.138:6789/0 conn(0x7f0d6c0c4e60 legacy=0x7f0d6c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:19.509 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.506+0000 7f0d6a59c640 1 -- 172.21.15.138:0/4009122346 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6c154930 con 0x7f0d6c0c7ea0 2023-12-19T18:58:19.509 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.506+0000 7f0d6ad9d640 1 --2- 172.21.15.138:0/4009122346 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d6c151e90 0x7f0d6c0c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:58:19.511 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.510+0000 7f0d6a59c640 1 --2- 172.21.15.138:0/4009122346 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d6c0c7ea0 0x7f0d6c06b4a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009870 tx=0x7f0d6001c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56721a4960709504 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:19.511 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.510+0000 7f0d69d9b640 1 -- 172.21.15.138:0/4009122346 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d600ab600 con 0x7f0d6c0c7ea0 2023-12-19T18:58:19.511 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.510+0000 7f0d69d9b640 1 -- 172.21.15.138:0/4009122346 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d600a7050 con 0x7f0d6c0c7ea0 2023-12-19T18:58:19.512 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.510+0000 7f0d69d9b640 1 -- 172.21.15.138:0/4009122346 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d600ab980 con 0x7f0d6c0c7ea0 2023-12-19T18:58:19.512 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.510+0000 7f0d71209640 1 -- 172.21.15.138:0/4009122346 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d6c0c7ea0 msgr2=0x7f0d6c06b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:19.513 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.510+0000 7f0d71209640 1 --2- 172.21.15.138:0/4009122346 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d6c0c7ea0 0x7f0d6c06b4a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0d60009870 tx=0x7f0d6001c420 comp rx=0 tx=0).stop 2023-12-19T18:58:19.513 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.510+0000 7f0d71209640 1 -- 172.21.15.138:0/4009122346 shutdown_connections 2023-12-19T18:58:19.513 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.510+0000 7f0d71209640 1 --2- 172.21.15.138:0/4009122346 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d6c0c7ea0 0x7f0d6c06b4a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.514 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.510+0000 7f0d71209640 1 --2- 172.21.15.138:0/4009122346 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d6c151e90 0x7f0d6c0c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.514 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.510+0000 7f0d71209640 1 -- 172.21.15.138:0/4009122346 >> 172.21.15.138:0/4009122346 conn(0x7f0d6c0ca170 msgr2=0x7f0d6c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:19.514 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.510+0000 7f0d71209640 1 -- 172.21.15.138:0/4009122346 shutdown_connections 2023-12-19T18:58:19.514 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.510+0000 7f0d71209640 1 -- 172.21.15.138:0/4009122346 wait complete. 2023-12-19T18:58:19.518 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d71209640 1 Processor -- start 2023-12-19T18:58:19.518 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d71209640 1 -- start start 2023-12-19T18:58:19.518 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d71209640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d6c0c4e60 0x7f0d6c0af550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:19.518 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d71209640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d6c0c7ea0 0x7f0d6c14b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:19.519 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d71209640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d6c151e90 0x7f0d6c14c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:19.519 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d71209640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c0afa90 con 0x7f0d6c0c4e60 2023-12-19T18:58:19.519 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d71209640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c0aeb00 con 0x7f0d6c151e90 2023-12-19T18:58:19.519 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d71209640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c0af0c0 con 0x7f0d6c0c7ea0 2023-12-19T18:58:19.519 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d6a59c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d6c0c7ea0 0x7f0d6c14b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:19.519 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d6b59e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d6c151e90 0x7f0d6c14c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:19.519 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d6a59c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d6c0c7ea0 0x7f0d6c14b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:58916/0 (socket says 172.21.15.138:58916) 2023-12-19T18:58:19.520 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d6a59c640 1 -- 172.21.15.138:0/2031983807 learned_addr learned my addr 172.21.15.138:0/2031983807 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-12-19T18:58:19.520 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d6ad9d640 1 --2- 172.21.15.138:0/2031983807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d6c0c4e60 0x7f0d6c0af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:19.520 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d6a59c640 1 -- 172.21.15.138:0/2031983807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d6c151e90 msgr2=0x7f0d6c14c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:19.520 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d6a59c640 1 --2- 172.21.15.138:0/2031983807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d6c151e90 0x7f0d6c14c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.520 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d6a59c640 1 -- 172.21.15.138:0/2031983807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d6c0c4e60 msgr2=0x7f0d6c0af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:19.520 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d6a59c640 1 --2- 172.21.15.138:0/2031983807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d6c0c4e60 0x7f0d6c0af550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.520 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d6a59c640 1 -- 172.21.15.138:0/2031983807 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c009420 con 0x7f0d6c0c7ea0 2023-12-19T18:58:19.520 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d6a59c640 1 --2- 172.21.15.138:0/2031983807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d6c0c7ea0 0x7f0d6c14b510 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0d6001aad0 tx=0x7f0d600191c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:19.520 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d537fe640 1 -- 172.21.15.138:0/2031983807 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d600b4420 con 0x7f0d6c0c7ea0 2023-12-19T18:58:19.520 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d537fe640 1 -- 172.21.15.138:0/2031983807 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d600b4580 con 0x7f0d6c0c7ea0 2023-12-19T18:58:19.520 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d537fe640 1 -- 172.21.15.138:0/2031983807 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d600b4930 con 0x7f0d6c0c7ea0 2023-12-19T18:58:19.520 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d71209640 1 -- 172.21.15.138:0/2031983807 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d600094d0 con 0x7f0d6c0c7ea0 2023-12-19T18:58:19.521 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d71209640 1 -- 172.21.15.138:0/2031983807 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d6c1f1680 con 0x7f0d6c0c7ea0 2023-12-19T18:58:19.521 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d537fe640 1 -- 172.21.15.138:0/2031983807 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0d600b2070 con 0x7f0d6c0c7ea0 2023-12-19T18:58:19.521 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.514+0000 7f0d537fe640 1 -- 172.21.15.138:0/2031983807 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f0d600b4d90 con 0x7f0d6c0c7ea0 2023-12-19T18:58:19.521 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.518+0000 7f0d71209640 1 -- 172.21.15.138:0/2031983807 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d6c0af230 con 0x7f0d6c0c7ea0 2023-12-19T18:58:19.521 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.518+0000 7f0d537fe640 1 -- 172.21.15.138:0/2031983807 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f0d600b0070 con 0x7f0d6c0c7ea0 2023-12-19T18:58:19.536 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:19.534+0000 7fbeca8c1180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-19T18:58:19.548 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-19T18:58:19.545+0000 7fb62ff5b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-19T18:58:19.586 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.586+0000 7f0d71209640 1 -- 172.21.15.138:0/2031983807 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3df6c9b2-a431-4825-80ad-9b46e58fed89", "id": 4} v 0) v1 -- 0x7f0d6c068400 con 0x7f0d6c0c7ea0 2023-12-19T18:58:19.593 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.590+0000 7f0d537fe640 1 -- 172.21.15.138:0/2031983807 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3df6c9b2-a431-4825-80ad-9b46e58fed89", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0d600bd400 con 0x7f0d6c0c7ea0 2023-12-19T18:58:19.593 INFO:teuthology.orchestra.run.smithi138.stdout:4 2023-12-19T18:58:19.594 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.594+0000 7f0d71209640 1 -- 172.21.15.138:0/2031983807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d6c0c7ea0 msgr2=0x7f0d6c14b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:19.594 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.594+0000 7f0d71209640 1 --2- 172.21.15.138:0/2031983807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d6c0c7ea0 0x7f0d6c14b510 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0d6001aad0 tx=0x7f0d600191c0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.594 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.594+0000 7f0d71209640 1 -- 172.21.15.138:0/2031983807 shutdown_connections 2023-12-19T18:58:19.594 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.594+0000 7f0d71209640 1 --2- 172.21.15.138:0/2031983807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0d6c151e90 0x7f0d6c14c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.594 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.594+0000 7f0d71209640 1 --2- 172.21.15.138:0/2031983807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0d6c0c7ea0 0x7f0d6c14b510 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.594 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.594+0000 7f0d71209640 1 --2- 172.21.15.138:0/2031983807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0d6c0c4e60 0x7f0d6c0af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.594 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.594+0000 7f0d71209640 1 -- 172.21.15.138:0/2031983807 >> 172.21.15.138:0/2031983807 conn(0x7f0d6c0ca170 msgr2=0x7f0d6c0ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:19.595 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.594+0000 7f0d71209640 1 -- 172.21.15.138:0/2031983807 shutdown_connections 2023-12-19T18:58:19.595 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.594+0000 7f0d71209640 1 -- 172.21.15.138:0/2031983807 wait complete. 2023-12-19T18:58:19.598 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:19.598+0000 7fbeca8c1180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-19T18:58:19.612 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 4e19068c-54e3-4daf-930c-bb0d13a64896 5 2023-12-19T18:58:19.636 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-19T18:58:19.633+0000 7fb62ff5b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-19T18:58:19.690 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:19.690+0000 7fbeca8c1180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-19T18:58:19.695 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-19T18:58:19.693+0000 7fb62ff5b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-19T18:58:19.749 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.746+0000 7f8af586b640 1 Processor -- start 2023-12-19T18:58:19.749 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.746+0000 7f8af586b640 1 -- start start 2023-12-19T18:58:19.751 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.750+0000 7f8af586b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8af0151e90 0x7f8af00c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:19.751 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.750+0000 7f8af586b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8af00c4e60 0x7f8af006bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:19.751 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.750+0000 7f8af586b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8af006c860 con 0x7f8af00c7ea0 2023-12-19T18:58:19.751 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.750+0000 7f8af586b640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8af00c8750 con 0x7f8af00c4e60 2023-12-19T18:58:19.751 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.750+0000 7f8af586b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af01552d0 con 0x7f8af0151e90 2023-12-19T18:58:19.751 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.750+0000 7f8aeeffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8af0151e90 0x7f8af00c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:19.751 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.750+0000 7f8aeeffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8af0151e90 0x7f8af00c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:58928/0 (socket says 172.21.15.138:58928) 2023-12-19T18:58:19.751 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.750+0000 7f8aeeffd640 1 -- 172.21.15.138:0/4228918904 learned_addr learned my addr 172.21.15.138:0/4228918904 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-12-19T18:58:19.752 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.750+0000 7f8aef7fe640 1 --2- 172.21.15.138:0/4228918904 >> v2:172.21.15.133:3300/0 conn(0x7f8af00c4e60 0x7f8af006bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:19.752 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.750+0000 7f8aeeffd640 1 -- 172.21.15.138:0/4228918904 >> v2:172.21.15.133:3300/0 conn(0x7f8af00c4e60 msgr2=0x7f8af006bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:19.752 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.750+0000 7f8aeeffd640 1 --2- 172.21.15.138:0/4228918904 >> v2:172.21.15.133:3300/0 conn(0x7f8af00c4e60 0x7f8af006bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.752 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.750+0000 7f8aeeffd640 1 -- 172.21.15.138:0/4228918904 >> v1:172.21.15.133:6789/0 conn(0x7f8af00c7ea0 legacy=0x7f8af006b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:19.752 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.750+0000 7f8aeeffd640 1 -- 172.21.15.138:0/4228918904 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af0154930 con 0x7f8af0151e90 2023-12-19T18:58:19.752 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:19.750+0000 7fbeca8c1180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-19T18:58:19.754 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.754+0000 7f8aeeffd640 1 --2- 172.21.15.138:0/4228918904 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8af0151e90 0x7f8af00c4920 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0009870 tx=0x7f8ae001c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed7919941d1be681 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:19.754 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.754+0000 7f8aee7fc640 1 -- 172.21.15.138:0/4228918904 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae00ab600 con 0x7f8af0151e90 2023-12-19T18:58:19.754 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.754+0000 7f8aee7fc640 1 -- 172.21.15.138:0/4228918904 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae00a7050 con 0x7f8af0151e90 2023-12-19T18:58:19.754 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.754+0000 7f8aee7fc640 1 -- 172.21.15.138:0/4228918904 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae00ab980 con 0x7f8af0151e90 2023-12-19T18:58:19.755 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.754+0000 7f8af586b640 1 -- 172.21.15.138:0/4228918904 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8af0151e90 msgr2=0x7f8af00c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:19.755 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.754+0000 7f8af586b640 1 --2- 172.21.15.138:0/4228918904 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8af0151e90 0x7f8af00c4920 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0009870 tx=0x7f8ae001c420 comp rx=0 tx=0).stop 2023-12-19T18:58:19.755 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.754+0000 7f8af586b640 1 -- 172.21.15.138:0/4228918904 shutdown_connections 2023-12-19T18:58:19.755 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.754+0000 7f8af586b640 1 --2- 172.21.15.138:0/4228918904 >> v2:172.21.15.133:3300/0 conn(0x7f8af00c4e60 0x7f8af006bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.755 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.754+0000 7f8af586b640 1 --2- 172.21.15.138:0/4228918904 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8af0151e90 0x7f8af00c4920 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.755 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.754+0000 7f8af586b640 1 -- 172.21.15.138:0/4228918904 >> 172.21.15.138:0/4228918904 conn(0x7f8af00ca170 msgr2=0x7f8af00ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:19.756 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.754+0000 7f8af586b640 1 -- 172.21.15.138:0/4228918904 shutdown_connections 2023-12-19T18:58:19.756 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.754+0000 7f8af586b640 1 -- 172.21.15.138:0/4228918904 wait complete. 2023-12-19T18:58:19.757 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.754+0000 7f8af586b640 1 Processor -- start 2023-12-19T18:58:19.757 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.754+0000 7f8af586b640 1 -- start start 2023-12-19T18:58:19.758 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8af586b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8af00c4e60 0x7f8af014b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:19.759 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8af586b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8af00c7ea0 0x7f8af01f0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:19.759 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8af586b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8af0151e90 0x7f8af01ed630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:19.759 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8af586b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af0157240 con 0x7f8af0151e90 2023-12-19T18:58:19.759 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8af586b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af01f06b0 con 0x7f8af00c4e60 2023-12-19T18:58:19.759 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8af586b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af01563b0 con 0x7f8af00c7ea0 2023-12-19T18:58:19.759 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8ae7fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8af00c7ea0 0x7f8af01f0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:19.759 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8aeeffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8af00c4e60 0x7f8af014b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:19.759 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8ae7fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8af00c7ea0 0x7f8af01f0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:58930/0 (socket says 172.21.15.138:58930) 2023-12-19T18:58:19.759 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8ae7fff640 1 -- 172.21.15.138:0/1512579117 learned_addr learned my addr 172.21.15.138:0/1512579117 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-12-19T18:58:19.759 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8aef7fe640 1 --2- 172.21.15.138:0/1512579117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8af0151e90 0x7f8af01ed630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:19.759 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8ae7fff640 1 -- 172.21.15.138:0/1512579117 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8af00c4e60 msgr2=0x7f8af014b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:19.759 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8ae7fff640 1 --2- 172.21.15.138:0/1512579117 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8af00c4e60 0x7f8af014b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.759 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8ae7fff640 1 -- 172.21.15.138:0/1512579117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8af0151e90 msgr2=0x7f8af01ed630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:19.760 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8ae7fff640 1 --2- 172.21.15.138:0/1512579117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8af0151e90 0x7f8af01ed630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.760 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8ae7fff640 1 -- 172.21.15.138:0/1512579117 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae00094d0 con 0x7f8af00c7ea0 2023-12-19T18:58:19.760 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8aeeffd640 1 --2- 172.21.15.138:0/1512579117 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8af00c4e60 0x7f8af014b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:58:19.760 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8ae7fff640 1 --2- 172.21.15.138:0/1512579117 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8af00c7ea0 0x7f8af01f0b40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800c500 tx=0x7f8ad800c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:19.761 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8aecff9640 1 -- 172.21.15.138:0/1512579117 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad80052d0 con 0x7f8af00c7ea0 2023-12-19T18:58:19.761 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8aecff9640 1 -- 172.21.15.138:0/1512579117 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad8005430 con 0x7f8af00c7ea0 2023-12-19T18:58:19.761 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8aecff9640 1 -- 172.21.15.138:0/1512579117 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8012830 con 0x7f8af00c7ea0 2023-12-19T18:58:19.761 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8af586b640 1 -- 172.21.15.138:0/1512579117 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8af0155b10 con 0x7f8af00c7ea0 2023-12-19T18:58:19.761 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8af586b640 1 -- 172.21.15.138:0/1512579117 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8af01560d0 con 0x7f8af00c7ea0 2023-12-19T18:58:19.761 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8aecff9640 1 -- 172.21.15.138:0/1512579117 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8ad8012c90 con 0x7f8af00c7ea0 2023-12-19T18:58:19.761 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8aecff9640 1 -- 172.21.15.138:0/1512579117 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f8ad8011380 con 0x7f8af00c7ea0 2023-12-19T18:58:19.761 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.758+0000 7f8af586b640 1 -- 172.21.15.138:0/1512579117 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8af01f0820 con 0x7f8af00c7ea0 2023-12-19T18:58:19.762 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.762+0000 7f8aecff9640 1 -- 172.21.15.138:0/1512579117 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f8ad8003600 con 0x7f8af00c7ea0 2023-12-19T18:58:19.783 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-19T18:58:19.781+0000 7fb62ff5b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-19T18:58:19.829 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.826+0000 7f8af586b640 1 -- 172.21.15.138:0/1512579117 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4e19068c-54e3-4daf-930c-bb0d13a64896", "id": 5} v 0) v1 -- 0x7f8af0068400 con 0x7f8af00c7ea0 2023-12-19T18:58:19.836 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.834+0000 7f8aecff9640 1 -- 172.21.15.138:0/1512579117 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4e19068c-54e3-4daf-930c-bb0d13a64896", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8ad80037a0 con 0x7f8af00c7ea0 2023-12-19T18:58:19.837 INFO:teuthology.orchestra.run.smithi138.stdout:5 2023-12-19T18:58:19.837 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.834+0000 7f8af586b640 1 -- 172.21.15.138:0/1512579117 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8af00c7ea0 msgr2=0x7f8af01f0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:19.838 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.834+0000 7f8af586b640 1 --2- 172.21.15.138:0/1512579117 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8af00c7ea0 0x7f8af01f0b40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800c500 tx=0x7f8ad800c9c0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.838 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.834+0000 7f8af586b640 1 -- 172.21.15.138:0/1512579117 shutdown_connections 2023-12-19T18:58:19.838 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.834+0000 7f8af586b640 1 --2- 172.21.15.138:0/1512579117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8af0151e90 0x7f8af01ed630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.838 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.834+0000 7f8af586b640 1 --2- 172.21.15.138:0/1512579117 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8af00c7ea0 0x7f8af01f0b40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.838 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.834+0000 7f8af586b640 1 --2- 172.21.15.138:0/1512579117 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8af00c4e60 0x7f8af014b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:19.838 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.834+0000 7f8af586b640 1 -- 172.21.15.138:0/1512579117 >> 172.21.15.138:0/1512579117 conn(0x7f8af00ca170 msgr2=0x7f8af014fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:19.838 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.838+0000 7f8af586b640 1 -- 172.21.15.138:0/1512579117 shutdown_connections 2023-12-19T18:58:19.838 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.838+0000 7f8af586b640 1 -- 172.21.15.138:0/1512579117 wait complete. 2023-12-19T18:58:19.845 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:19.842+0000 7fbeca8c1180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-19T18:58:19.847 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-19T18:58:19.845+0000 7fb62ff5b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-19T18:58:19.857 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 93fa8d4c-4d3f-4011-a527-1600d354164d 6 2023-12-19T18:58:19.911 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:19.910+0000 7fbeca8c1180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-19T18:58:19.994 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.994+0000 7fb5f21d1640 1 Processor -- start 2023-12-19T18:58:19.994 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.994+0000 7fb5f21d1640 1 -- start start 2023-12-19T18:58:19.996 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.994+0000 7fb5f21d1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5ec151e90 0x7fb5ec0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:19.996 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.994+0000 7fb5f21d1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ec06c860 con 0x7fb5ec0c4e60 2023-12-19T18:58:19.997 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.994+0000 7fb5f21d1640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5ec154930 con 0x7fb5ec0c7ea0 2023-12-19T18:58:19.997 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.994+0000 7fb5f21d1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec0c8750 con 0x7fb5ec151e90 2023-12-19T18:58:19.997 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.994+0000 7fb5eb7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5ec151e90 0x7fb5ec0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:19.997 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.994+0000 7fb5eaffd640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fb5ec0c7ea0 0x7fb5ec06b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.138:38906/0 (socket says 172.21.15.138:38906) 2023-12-19T18:58:19.997 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.994+0000 7fb5eaffd640 1 -- 172.21.15.138:0/1287972614 learned_addr learned my addr 172.21.15.138:0/1287972614 (peer_addr_for_me v1:172.21.15.138:0/0) 2023-12-19T18:58:19.998 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.994+0000 7fb5eb7fe640 1 -- 172.21.15.138:0/1287972614 >> v1:172.21.15.138:6789/0 conn(0x7fb5ec0c7ea0 legacy=0x7fb5ec06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:19.998 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.994+0000 7fb5eb7fe640 1 -- 172.21.15.138:0/1287972614 >> v1:172.21.15.133:6789/0 conn(0x7fb5ec0c4e60 legacy=0x7fb5ec15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:19.998 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.994+0000 7fb5eb7fe640 1 -- 172.21.15.138:0/1287972614 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec154c10 con 0x7fb5ec151e90 2023-12-19T18:58:19.998 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.994+0000 7fb5ea7fc640 1 -- 172.21.15.138:0/1287972614 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096864707 0 0) 0x7fb5ec154930 con 0x7fb5ec0c7ea0 2023-12-19T18:58:20.001 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.998+0000 7fb5eb7fe640 1 --2- 172.21.15.138:0/1287972614 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5ec151e90 0x7fb5ec0c4920 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0097f0 tx=0x7fb5dc01c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1eb2d1fb6124c657 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:20.001 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.998+0000 7fb5ea7fc640 1 -- 172.21.15.138:0/1287972614 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc0ab600 con 0x7fb5ec151e90 2023-12-19T18:58:20.001 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.998+0000 7fb5ea7fc640 1 -- 172.21.15.138:0/1287972614 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5dc0a7050 con 0x7fb5ec151e90 2023-12-19T18:58:20.001 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.998+0000 7fb5ea7fc640 1 -- 172.21.15.138:0/1287972614 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc0ab980 con 0x7fb5ec151e90 2023-12-19T18:58:20.002 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.998+0000 7fb5f21d1640 1 -- 172.21.15.138:0/1287972614 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5ec151e90 msgr2=0x7fb5ec0c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:20.002 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.998+0000 7fb5f21d1640 1 --2- 172.21.15.138:0/1287972614 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5ec151e90 0x7fb5ec0c4920 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0097f0 tx=0x7fb5dc01c3a0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.002 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.998+0000 7fb5f21d1640 1 -- 172.21.15.138:0/1287972614 shutdown_connections 2023-12-19T18:58:20.002 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.998+0000 7fb5f21d1640 1 --2- 172.21.15.138:0/1287972614 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5ec151e90 0x7fb5ec0c4920 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.002 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.998+0000 7fb5f21d1640 1 -- 172.21.15.138:0/1287972614 >> 172.21.15.138:0/1287972614 conn(0x7fb5ec0ca170 msgr2=0x7fb5ec0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:20.003 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.998+0000 7fb5f21d1640 1 -- 172.21.15.138:0/1287972614 shutdown_connections 2023-12-19T18:58:20.003 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:19.998+0000 7fb5f21d1640 1 -- 172.21.15.138:0/1287972614 wait complete. 2023-12-19T18:58:20.004 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-19T18:58:19.997+0000 7fb62ff5b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-19T18:58:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5f21d1640 1 Processor -- start 2023-12-19T18:58:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5f21d1640 1 -- start start 2023-12-19T18:58:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5f21d1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5ec0c4e60 0x7fb5ec1f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5f21d1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5ec0c7ea0 0x7fb5ec1f1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5f21d1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5ec151e90 0x7fb5ec1f1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5f21d1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec1552d0 con 0x7fb5ec0c4e60 2023-12-19T18:58:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5f21d1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec14aef0 con 0x7fb5ec151e90 2023-12-19T18:58:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5f21d1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ec14a650 con 0x7fb5ec0c7ea0 2023-12-19T18:58:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5eaffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5ec0c7ea0 0x7fb5ec1f1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5ebfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5ec151e90 0x7fb5ec1f1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5ebfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5ec151e90 0x7fb5ec1f1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.138:52256/0 (socket says 172.21.15.138:52256) 2023-12-19T18:58:20.007 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5eaffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5ec0c7ea0 0x7fb5ec1f1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:58938/0 (socket says 172.21.15.138:58938) 2023-12-19T18:58:20.008 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5ebfff640 1 -- 172.21.15.138:0/910094864 learned_addr learned my addr 172.21.15.138:0/910094864 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-12-19T18:58:20.008 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5eb7fe640 1 --2- 172.21.15.138:0/910094864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5ec0c4e60 0x7fb5ec1f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:20.008 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5ebfff640 1 -- 172.21.15.138:0/910094864 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5ec0c7ea0 msgr2=0x7fb5ec1f1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:20.008 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5ebfff640 1 --2- 172.21.15.138:0/910094864 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5ec0c7ea0 0x7fb5ec1f1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.008 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5ebfff640 1 -- 172.21.15.138:0/910094864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5ec0c4e60 msgr2=0x7fb5ec1f11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:20.008 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5ebfff640 1 --2- 172.21.15.138:0/910094864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5ec0c4e60 0x7fb5ec1f11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.008 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5ebfff640 1 -- 172.21.15.138:0/910094864 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc009420 con 0x7fb5ec151e90 2023-12-19T18:58:20.008 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5eaffd640 1 --2- 172.21.15.138:0/910094864 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5ec0c7ea0 0x7fb5ec1f1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:58:20.008 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5ebfff640 1 --2- 172.21.15.138:0/910094864 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5ec151e90 0x7fb5ec1f1c60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400c730 tx=0x7fb5e400cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:20.008 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5d3fff640 1 -- 172.21.15.138:0/910094864 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e4003b80 con 0x7fb5ec151e90 2023-12-19T18:58:20.008 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5d3fff640 1 -- 172.21.15.138:0/910094864 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e4003ce0 con 0x7fb5ec151e90 2023-12-19T18:58:20.008 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5f21d1640 1 -- 172.21.15.138:0/910094864 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ec14a930 con 0x7fb5ec151e90 2023-12-19T18:58:20.008 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5d3fff640 1 -- 172.21.15.138:0/910094864 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e400aa30 con 0x7fb5ec151e90 2023-12-19T18:58:20.008 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5f21d1640 1 -- 172.21.15.138:0/910094864 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ec0c2f60 con 0x7fb5ec151e90 2023-12-19T18:58:20.008 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5d3fff640 1 -- 172.21.15.138:0/910094864 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb5e40050d0 con 0x7fb5ec151e90 2023-12-19T18:58:20.009 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.002+0000 7fb5d3fff640 1 -- 172.21.15.138:0/910094864 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fb5e4012420 con 0x7fb5ec151e90 2023-12-19T18:58:20.009 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.006+0000 7fb5f21d1640 1 -- 172.21.15.138:0/910094864 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ec068400 con 0x7fb5ec151e90 2023-12-19T18:58:20.009 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.006+0000 7fb5d3fff640 1 -- 172.21.15.138:0/910094864 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7fb5e4005380 con 0x7fb5ec151e90 2023-12-19T18:58:20.068 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-19T18:58:20.065+0000 7fb62ff5b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-19T18:58:20.070 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:20.070+0000 7fbeca8c1180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-19T18:58:20.075 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.074+0000 7fb5f21d1640 1 -- 172.21.15.138:0/910094864 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd new", "uuid": "93fa8d4c-4d3f-4011-a527-1600d354164d", "id": 6} v 0) v1 -- 0x7fb5ec150b40 con 0x7fb5ec151e90 2023-12-19T18:58:20.082 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.078+0000 7fb5d3fff640 1 -- 172.21.15.138:0/910094864 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "93fa8d4c-4d3f-4011-a527-1600d354164d", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb5e4005520 con 0x7fb5ec151e90 2023-12-19T18:58:20.083 INFO:teuthology.orchestra.run.smithi138.stdout:6 2023-12-19T18:58:20.086 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.082+0000 7fb5f21d1640 1 -- 172.21.15.138:0/910094864 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5ec151e90 msgr2=0x7fb5ec1f1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:20.086 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.082+0000 7fb5f21d1640 1 --2- 172.21.15.138:0/910094864 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5ec151e90 0x7fb5ec1f1c60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400c730 tx=0x7fb5e400cbf0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.086 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.082+0000 7fb5f21d1640 1 -- 172.21.15.138:0/910094864 shutdown_connections 2023-12-19T18:58:20.087 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.082+0000 7fb5f21d1640 1 --2- 172.21.15.138:0/910094864 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5ec151e90 0x7fb5ec1f1c60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.087 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.082+0000 7fb5f21d1640 1 --2- 172.21.15.138:0/910094864 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5ec0c7ea0 0x7fb5ec1f1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.087 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.082+0000 7fb5f21d1640 1 --2- 172.21.15.138:0/910094864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5ec0c4e60 0x7fb5ec1f11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.087 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.082+0000 7fb5f21d1640 1 -- 172.21.15.138:0/910094864 >> 172.21.15.138:0/910094864 conn(0x7fb5ec0ca170 msgr2=0x7fb5ec150140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:20.087 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.082+0000 7fb5f21d1640 1 -- 172.21.15.138:0/910094864 shutdown_connections 2023-12-19T18:58:20.087 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.082+0000 7fb5f21d1640 1 -- 172.21.15.138:0/910094864 wait complete. 2023-12-19T18:58:20.102 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new b40a1b04-ffa3-4a47-9b65-db90dd8e7054 7 2023-12-19T18:58:20.143 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:20.142+0000 7fbeca8c1180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-19T18:58:20.240 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.238+0000 7f940ceaa640 1 Processor -- start 2023-12-19T18:58:20.241 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.238+0000 7f940ceaa640 1 -- start start 2023-12-19T18:58:20.242 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.242+0000 7f940ceaa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9408151e90 0x7f94080c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:20.242 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.242+0000 7f940ceaa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f94080c7ea0 0x7f940806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:20.242 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.242+0000 7f940ceaa640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f940806c860 con 0x7f94080c4e60 2023-12-19T18:58:20.242 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.242+0000 7f940ceaa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94080c8750 con 0x7f94080c7ea0 2023-12-19T18:58:20.243 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.242+0000 7f940ceaa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94081552d0 con 0x7f9408151e90 2023-12-19T18:58:20.243 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.242+0000 7f940659c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9408151e90 0x7f94080c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:20.243 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.242+0000 7f9405d9b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f94080c7ea0 0x7f940806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:20.243 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.242+0000 7f940659c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9408151e90 0x7f94080c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:58952/0 (socket says 172.21.15.138:58952) 2023-12-19T18:58:20.243 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.242+0000 7f940659c640 1 -- 172.21.15.138:0/2154820250 learned_addr learned my addr 172.21.15.138:0/2154820250 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-12-19T18:58:20.243 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.242+0000 7f940659c640 1 -- 172.21.15.138:0/2154820250 >> v2:172.21.15.138:3300/0 conn(0x7f94080c7ea0 msgr2=0x7f940806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:20.243 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.242+0000 7f940659c640 1 --2- 172.21.15.138:0/2154820250 >> v2:172.21.15.138:3300/0 conn(0x7f94080c7ea0 0x7f940806b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.243 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.242+0000 7f940659c640 1 -- 172.21.15.138:0/2154820250 >> v1:172.21.15.133:6789/0 conn(0x7f94080c4e60 legacy=0x7f940806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:20.243 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.242+0000 7f940659c640 1 -- 172.21.15.138:0/2154820250 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9408154930 con 0x7f9408151e90 2023-12-19T18:58:20.243 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.242+0000 7f9405d9b640 1 --2- 172.21.15.138:0/2154820250 >> v2:172.21.15.138:3300/0 conn(0x7f94080c7ea0 0x7f940806b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:58:20.245 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.242+0000 7f940659c640 1 --2- 172.21.15.138:0/2154820250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9408151e90 0x7f94080c4920 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f93f8009870 tx=0x7f93f801c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1071f0890f05f51f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:20.246 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.246+0000 7f940559a640 1 -- 172.21.15.138:0/2154820250 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f80ab600 con 0x7f9408151e90 2023-12-19T18:58:20.246 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.246+0000 7f940559a640 1 -- 172.21.15.138:0/2154820250 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93f80a7050 con 0x7f9408151e90 2023-12-19T18:58:20.246 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.246+0000 7f940559a640 1 -- 172.21.15.138:0/2154820250 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93f80ab980 con 0x7f9408151e90 2023-12-19T18:58:20.246 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.246+0000 7f940ceaa640 1 -- 172.21.15.138:0/2154820250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9408151e90 msgr2=0x7f94080c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:20.247 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.246+0000 7f940ceaa640 1 --2- 172.21.15.138:0/2154820250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9408151e90 0x7f94080c4920 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f93f8009870 tx=0x7f93f801c420 comp rx=0 tx=0).stop 2023-12-19T18:58:20.247 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.246+0000 7f940ceaa640 1 -- 172.21.15.138:0/2154820250 shutdown_connections 2023-12-19T18:58:20.247 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.246+0000 7f940ceaa640 1 --2- 172.21.15.138:0/2154820250 >> v2:172.21.15.138:3300/0 conn(0x7f94080c7ea0 0x7f940806b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.247 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.246+0000 7f940ceaa640 1 --2- 172.21.15.138:0/2154820250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9408151e90 0x7f94080c4920 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.247 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.246+0000 7f940ceaa640 1 -- 172.21.15.138:0/2154820250 >> 172.21.15.138:0/2154820250 conn(0x7f94080ca170 msgr2=0x7f94080ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:20.247 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.246+0000 7f940ceaa640 1 -- 172.21.15.138:0/2154820250 shutdown_connections 2023-12-19T18:58:20.247 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.246+0000 7f940ceaa640 1 -- 172.21.15.138:0/2154820250 wait complete. 2023-12-19T18:58:20.248 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.246+0000 7f940ceaa640 1 Processor -- start 2023-12-19T18:58:20.248 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.246+0000 7f940ceaa640 1 -- start start 2023-12-19T18:58:20.251 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.246+0000 7f940ceaa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94080c4e60 0x7f94080ae3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:20.251 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.246+0000 7f940ceaa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94080c7ea0 0x7f94081ed860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:20.251 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.246+0000 7f940ceaa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9408151e90 0x7f9408143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:20.251 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.246+0000 7f940ceaa640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94081ed3d0 con 0x7f94080c4e60 2023-12-19T18:58:20.251 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.246+0000 7f940ceaa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94080aeca0 con 0x7f9408151e90 2023-12-19T18:58:20.251 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.246+0000 7f940ceaa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94080ae9c0 con 0x7f94080c7ea0 2023-12-19T18:58:20.251 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.250+0000 7f9405d9b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94080c7ea0 0x7f94081ed860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:20.251 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.250+0000 7f9405d9b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94080c7ea0 0x7f94081ed860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.138:58964/0 (socket says 172.21.15.138:58964) 2023-12-19T18:58:20.251 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.250+0000 7f9405d9b640 1 -- 172.21.15.138:0/2065822374 learned_addr learned my addr 172.21.15.138:0/2065822374 (peer_addr_for_me v2:172.21.15.138:0/0) 2023-12-19T18:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.250+0000 7f9406d9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9408151e90 0x7f9408143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.250+0000 7f940659c640 1 --2- 172.21.15.138:0/2065822374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94080c4e60 0x7f94080ae3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.250+0000 7f9405d9b640 1 -- 172.21.15.138:0/2065822374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9408151e90 msgr2=0x7f9408143d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.250+0000 7f9405d9b640 1 --2- 172.21.15.138:0/2065822374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9408151e90 0x7f9408143d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.250+0000 7f9405d9b640 1 -- 172.21.15.138:0/2065822374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94080c4e60 msgr2=0x7f94080ae3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.250+0000 7f9405d9b640 1 --2- 172.21.15.138:0/2065822374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94080c4e60 0x7f94080ae3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.250+0000 7f9405d9b640 1 -- 172.21.15.138:0/2065822374 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc009420 con 0x7f94080c7ea0 2023-12-19T18:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.250+0000 7f9405d9b640 1 --2- 172.21.15.138:0/2065822374 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94080c7ea0 0x7f94081ed860 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00ebb0 tx=0x7f93fc00c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.250+0000 7f93f6ffd640 1 -- 172.21.15.138:0/2065822374 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc00eeb0 con 0x7f94080c7ea0 2023-12-19T18:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.250+0000 7f93f6ffd640 1 -- 172.21.15.138:0/2065822374 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93fc00cc30 con 0x7f94080c7ea0 2023-12-19T18:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.250+0000 7f93f6ffd640 1 -- 172.21.15.138:0/2065822374 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc013470 con 0x7f94080c7ea0 2023-12-19T18:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.250+0000 7f940ceaa640 1 -- 172.21.15.138:0/2065822374 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f80094d0 con 0x7f94080c7ea0 2023-12-19T18:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.250+0000 7f940ceaa640 1 -- 172.21.15.138:0/2065822374 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94081ed060 con 0x7f94080c7ea0 2023-12-19T18:58:20.252 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.250+0000 7f93f6ffd640 1 -- 172.21.15.138:0/2065822374 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f93fc005ca0 con 0x7f94080c7ea0 2023-12-19T18:58:20.253 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.250+0000 7f93f6ffd640 1 -- 172.21.15.138:0/2065822374 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f93fc0135d0 con 0x7f94080c7ea0 2023-12-19T18:58:20.253 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.250+0000 7f940ceaa640 1 -- 172.21.15.138:0/2065822374 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94081ed540 con 0x7f94080c7ea0 2023-12-19T18:58:20.254 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.254+0000 7f93f6ffd640 1 -- 172.21.15.138:0/2065822374 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f93fc021060 con 0x7f94080c7ea0 2023-12-19T18:58:20.320 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.318+0000 7f940ceaa640 1 -- 172.21.15.138:0/2065822374 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b40a1b04-ffa3-4a47-9b65-db90dd8e7054", "id": 7} v 0) v1 -- 0x7f9408068400 con 0x7f94080c7ea0 2023-12-19T18:58:20.324 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.322+0000 7f93f6ffd640 1 -- 172.21.15.138:0/2065822374 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b40a1b04-ffa3-4a47-9b65-db90dd8e7054", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f93fc029020 con 0x7f94080c7ea0 2023-12-19T18:58:20.324 INFO:teuthology.orchestra.run.smithi138.stdout:7 2023-12-19T18:58:20.326 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.322+0000 7f940ceaa640 1 -- 172.21.15.138:0/2065822374 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94080c7ea0 msgr2=0x7f94081ed860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:20.326 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.322+0000 7f940ceaa640 1 --2- 172.21.15.138:0/2065822374 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94080c7ea0 0x7f94081ed860 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f93fc00ebb0 tx=0x7f93fc00c520 comp rx=0 tx=0).stop 2023-12-19T18:58:20.326 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.326+0000 7f940ceaa640 1 -- 172.21.15.138:0/2065822374 shutdown_connections 2023-12-19T18:58:20.326 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.326+0000 7f940ceaa640 1 --2- 172.21.15.138:0/2065822374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9408151e90 0x7f9408143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.326 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.326+0000 7f940ceaa640 1 --2- 172.21.15.138:0/2065822374 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f94080c7ea0 0x7f94081ed860 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.326 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.326+0000 7f940ceaa640 1 --2- 172.21.15.138:0/2065822374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f94080c4e60 0x7f94080ae3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.326 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.326+0000 7f940ceaa640 1 -- 172.21.15.138:0/2065822374 >> 172.21.15.138:0/2065822374 conn(0x7f94080ca170 msgr2=0x7f9408153f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:20.326 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.326+0000 7f940ceaa640 1 -- 172.21.15.138:0/2065822374 shutdown_connections 2023-12-19T18:58:20.326 INFO:teuthology.orchestra.run.smithi138.stderr:2023-12-19T18:58:20.326+0000 7f940ceaa640 1 -- 172.21.15.138:0/2065822374 wait complete. 2023-12-19T18:58:20.343 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-19T18:58:20.344 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-19T18:58:20.347 INFO:tasks.ceph.osd.0:Started 2023-12-19T18:58:20.347 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-19T18:58:20.347 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-19T18:58:20.351 INFO:tasks.ceph.osd.1:Started 2023-12-19T18:58:20.351 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-19T18:58:20.351 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-19T18:58:20.355 INFO:tasks.ceph.osd.2:Started 2023-12-19T18:58:20.355 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-19T18:58:20.355 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-19T18:58:20.358 INFO:tasks.ceph.osd.3:Started 2023-12-19T18:58:20.358 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-19T18:58:20.358 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-19T18:58:20.388 INFO:tasks.ceph.osd.4:Started 2023-12-19T18:58:20.389 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-19T18:58:20.389 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-19T18:58:20.392 INFO:tasks.ceph.osd.5:Started 2023-12-19T18:58:20.392 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-19T18:58:20.392 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-19T18:58:20.395 INFO:tasks.ceph.osd.6:Started 2023-12-19T18:58:20.395 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-19T18:58:20.395 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-19T18:58:20.399 INFO:tasks.ceph.osd.7:Started 2023-12-19T18:58:20.399 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:58:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.589+0000 7f4c39380640 1 Processor -- start 2023-12-19T18:58:20.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.589+0000 7f4c39380640 1 -- start start 2023-12-19T18:58:20.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.589+0000 7f4c39380640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4c34151e90 0x7f4c340c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:20.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.589+0000 7f4c39380640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4c340c7ea0 0x7f4c3406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:20.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.589+0000 7f4c39380640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c340c4e60 0x7f4c3406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:20.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.589+0000 7f4c39380640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c340c8750 con 0x7f4c340c7ea0 2023-12-19T18:58:20.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.589+0000 7f4c39380640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c341552d0 con 0x7f4c34151e90 2023-12-19T18:58:20.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.589+0000 7f4c39380640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c340c5c60 con 0x7f4c340c4e60 2023-12-19T18:58:20.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.589+0000 7f4c2a7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4c340c7ea0 0x7f4c3406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:20.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.589+0000 7f4c2a7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4c340c7ea0 0x7f4c3406b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58816/0 (socket says 172.21.15.133:58816) 2023-12-19T18:58:20.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.589+0000 7f4c2a7fc640 1 -- 172.21.15.133:0/2027992171 learned_addr learned my addr 172.21.15.133:0/2027992171 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:20.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.589+0000 7f4c337fe640 1 --2- 172.21.15.133:0/2027992171 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c340c4e60 0x7f4c3406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:20.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.589+0000 7f4c32ffd640 1 --2- 172.21.15.133:0/2027992171 >> v2:172.21.15.138:3300/0 conn(0x7f4c34151e90 0x7f4c340c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:20.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.589+0000 7f4c2a7fc640 1 -- 172.21.15.133:0/2027992171 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c340c4e60 msgr2=0x7f4c3406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:20.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.589+0000 7f4c2a7fc640 1 --2- 172.21.15.133:0/2027992171 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c340c4e60 0x7f4c3406b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.589+0000 7f4c2a7fc640 1 -- 172.21.15.133:0/2027992171 >> v2:172.21.15.138:3300/0 conn(0x7f4c34151e90 msgr2=0x7f4c340c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:20.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.589+0000 7f4c2a7fc640 1 --2- 172.21.15.133:0/2027992171 >> v2:172.21.15.138:3300/0 conn(0x7f4c34151e90 0x7f4c340c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.589+0000 7f4c2a7fc640 1 -- 172.21.15.133:0/2027992171 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3406c860 con 0x7f4c340c7ea0 2023-12-19T18:58:20.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.593+0000 7f4c2a7fc640 1 --2- 172.21.15.133:0/2027992171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c340c7ea0 0x7f4c3406b4a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4c3408b410 tx=0x7f4c1c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6414eb2ba264ebfa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:20.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.593+0000 7f4c327fc640 1 -- 172.21.15.133:0/2027992171 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c0ab600 con 0x7f4c340c7ea0 2023-12-19T18:58:20.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.593+0000 7f4c327fc640 1 -- 172.21.15.133:0/2027992171 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1c0a7050 con 0x7f4c340c7ea0 2023-12-19T18:58:20.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.593+0000 7f4c327fc640 1 -- 172.21.15.133:0/2027992171 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c0ab980 con 0x7f4c340c7ea0 2023-12-19T18:58:20.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.593+0000 7f4c39380640 1 -- 172.21.15.133:0/2027992171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c340c7ea0 msgr2=0x7f4c3406b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:20.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.593+0000 7f4c39380640 1 --2- 172.21.15.133:0/2027992171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c340c7ea0 0x7f4c3406b4a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4c3408b410 tx=0x7f4c1c01c3e0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.593+0000 7f4c39380640 1 -- 172.21.15.133:0/2027992171 shutdown_connections 2023-12-19T18:58:20.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.593+0000 7f4c39380640 1 --2- 172.21.15.133:0/2027992171 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c340c4e60 0x7f4c3406b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.593+0000 7f4c39380640 1 --2- 172.21.15.133:0/2027992171 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c340c7ea0 0x7f4c3406b4a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.593+0000 7f4c39380640 1 --2- 172.21.15.133:0/2027992171 >> v2:172.21.15.138:3300/0 conn(0x7f4c34151e90 0x7f4c340c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.593+0000 7f4c39380640 1 -- 172.21.15.133:0/2027992171 >> 172.21.15.133:0/2027992171 conn(0x7f4c340ca170 msgr2=0x7f4c340ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:20.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.593+0000 7f4c39380640 1 -- 172.21.15.133:0/2027992171 shutdown_connections 2023-12-19T18:58:20.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.593+0000 7f4c39380640 1 -- 172.21.15.133:0/2027992171 wait complete. 2023-12-19T18:58:20.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c39380640 1 Processor -- start 2023-12-19T18:58:20.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c39380640 1 -- start start 2023-12-19T18:58:20.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c39380640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c340c4e60 0x7f4c3414ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:20.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c39380640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c340c7ea0 0x7f4c341ed140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:20.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c39380640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c34151e90 0x7f4c341ed680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:20.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c39380640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c341f15d0 con 0x7f4c34151e90 2023-12-19T18:58:20.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c39380640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c340ac9b0 con 0x7f4c340c4e60 2023-12-19T18:58:20.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c39380640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c341f0850 con 0x7f4c340c7ea0 2023-12-19T18:58:20.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c337fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c34151e90 0x7f4c341ed680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:20.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c337fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c34151e90 0x7f4c341ed680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58832/0 (socket says 172.21.15.133:58832) 2023-12-19T18:58:20.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c2a7fc640 1 --2- 172.21.15.133:0/3195933837 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c340c7ea0 0x7f4c341ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:20.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c337fe640 1 -- 172.21.15.133:0/3195933837 learned_addr learned my addr 172.21.15.133:0/3195933837 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:20.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c32ffd640 1 --2- 172.21.15.133:0/3195933837 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c340c4e60 0x7f4c3414ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:20.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c337fe640 1 -- 172.21.15.133:0/3195933837 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c340c7ea0 msgr2=0x7f4c341ed140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:20.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c337fe640 1 --2- 172.21.15.133:0/3195933837 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c340c7ea0 0x7f4c341ed140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c337fe640 1 -- 172.21.15.133:0/3195933837 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c340c4e60 msgr2=0x7f4c3414ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:20.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c337fe640 1 --2- 172.21.15.133:0/3195933837 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c340c4e60 0x7f4c3414ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c337fe640 1 -- 172.21.15.133:0/3195933837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0094d0 con 0x7f4c34151e90 2023-12-19T18:58:20.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c337fe640 1 --2- 172.21.15.133:0/3195933837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c34151e90 0x7f4c341ed680 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c00e820 tx=0x7f4c2c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:20.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c2bfff640 1 -- 172.21.15.133:0/3195933837 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c0094b0 con 0x7f4c34151e90 2023-12-19T18:58:20.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c2bfff640 1 -- 172.21.15.133:0/3195933837 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2c00c730 con 0x7f4c34151e90 2023-12-19T18:58:20.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c39380640 1 -- 172.21.15.133:0/3195933837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c341f0af0 con 0x7f4c34151e90 2023-12-19T18:58:20.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c2bfff640 1 -- 172.21.15.133:0/3195933837 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c00caa0 con 0x7f4c34151e90 2023-12-19T18:58:20.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c39380640 1 -- 172.21.15.133:0/3195933837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c341f10b0 con 0x7f4c34151e90 2023-12-19T18:58:20.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c2bfff640 1 -- 172.21.15.133:0/3195933837 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4c2c0059a0 con 0x7f4c34151e90 2023-12-19T18:58:20.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c2bfff640 1 -- 172.21.15.133:0/3195933837 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f4c2c006700 con 0x7f4c34151e90 2023-12-19T18:58:20.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.597+0000 7f4c39380640 1 -- 172.21.15.133:0/3195933837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c341f12a0 con 0x7f4c34151e90 2023-12-19T18:58:20.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.601+0000 7f4c2bfff640 1 -- 172.21.15.133:0/3195933837 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7f4c2c021060 con 0x7f4c34151e90 2023-12-19T18:58:20.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.657+0000 7f4c39380640 1 -- 172.21.15.133:0/3195933837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c34068400 con 0x7f4c34151e90 2023-12-19T18:58:20.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.657+0000 7f4c2bfff640 1 -- 172.21.15.133:0/3195933837 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f4c2c017070 con 0x7f4c34151e90 2023-12-19T18:58:20.660 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:20.660 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":10,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:20.321740+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:58:20.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.657+0000 7f4c39380640 1 -- 172.21.15.133:0/3195933837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c34151e90 msgr2=0x7f4c341ed680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:20.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.657+0000 7f4c39380640 1 --2- 172.21.15.133:0/3195933837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c34151e90 0x7f4c341ed680 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c00e820 tx=0x7f4c2c00ece0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.657+0000 7f4c39380640 1 -- 172.21.15.133:0/3195933837 shutdown_connections 2023-12-19T18:58:20.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.657+0000 7f4c39380640 1 --2- 172.21.15.133:0/3195933837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c34151e90 0x7f4c341ed680 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.657+0000 7f4c39380640 1 --2- 172.21.15.133:0/3195933837 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c340c7ea0 0x7f4c341ed140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.657+0000 7f4c39380640 1 --2- 172.21.15.133:0/3195933837 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c340c4e60 0x7f4c3414ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:20.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.657+0000 7f4c39380640 1 -- 172.21.15.133:0/3195933837 >> 172.21.15.133:0/3195933837 conn(0x7f4c340ca170 msgr2=0x7f4c3406b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:20.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.657+0000 7f4c39380640 1 -- 172.21.15.133:0/3195933837 shutdown_connections 2023-12-19T18:58:20.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:20.657+0000 7f4c39380640 1 -- 172.21.15.133:0/3195933837 wait complete. 2023-12-19T18:58:20.680 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-19T18:58:20.680 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-19T18:58:20.790 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-12-19T18:58:20.790 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-12-19T18:58:20.790 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2023-12-19T18:58:20.833 INFO:tasks.ceph.mgr.y.smithi133.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-12-19T18:58:20.833 INFO:tasks.ceph.mgr.y.smithi133.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-12-19T18:58:20.833 INFO:tasks.ceph.mgr.y.smithi133.stderr: from numpy import show_config as show_numpy_config 2023-12-19T18:58:20.851 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:20.850+0000 7fbeca8c1180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-19T18:58:20.875 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-19T18:58:20.873+0000 7fb62ff5b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-19T18:58:20.985 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:20.982+0000 7fbeca8c1180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-19T18:58:21.009 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-19T18:58:21.005+0000 7fb62ff5b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-19T18:58:21.011 INFO:tasks.ceph.osd.2.smithi133.stderr:2023-12-19T18:58:21.009+0000 7f5082aec640 -1 Falling back to public interface 2023-12-19T18:58:21.015 INFO:tasks.ceph.osd.3.smithi133.stderr:2023-12-19T18:58:21.013+0000 7fa15c131640 -1 Falling back to public interface 2023-12-19T18:58:21.031 INFO:tasks.ceph.osd.1.smithi133.stderr:2023-12-19T18:58:21.029+0000 7fbe0850b640 -1 Falling back to public interface 2023-12-19T18:58:21.055 INFO:tasks.ceph.osd.4.smithi138.stderr:2023-12-19T18:58:21.054+0000 7fa661bc6640 -1 Falling back to public interface 2023-12-19T18:58:21.063 INFO:tasks.ceph.osd.0.smithi133.stderr:2023-12-19T18:58:21.061+0000 7f5afdc2b640 -1 Falling back to public interface 2023-12-19T18:58:21.079 INFO:tasks.ceph.osd.5.smithi138.stderr:2023-12-19T18:58:21.078+0000 7fe4e3ef9640 -1 Falling back to public interface 2023-12-19T18:58:21.111 INFO:tasks.ceph.osd.6.smithi138.stderr:2023-12-19T18:58:21.110+0000 7f7dd06ac640 -1 Falling back to public interface 2023-12-19T18:58:21.123 INFO:tasks.ceph.osd.7.smithi138.stderr:2023-12-19T18:58:21.122+0000 7f430695a640 -1 Falling back to public interface 2023-12-19T18:58:21.160 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:21.158+0000 7fbeca8c1180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-19T18:58:21.198 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-19T18:58:21.197+0000 7fb62ff5b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-19T18:58:21.239 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:21.238+0000 7fbeca8c1180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-19T18:58:21.270 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-19T18:58:21.269+0000 7fb62ff5b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-19T18:58:21.377 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:21.374+0000 7fbeca8c1180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-19T18:58:21.409 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-19T18:58:21.405+0000 7fb62ff5b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-19T18:58:21.486 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T18:58:21.614 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.609+0000 7efc53a68640 1 Processor -- start 2023-12-19T18:58:21.614 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.613+0000 7efc53a68640 1 -- start start 2023-12-19T18:58:21.615 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.613+0000 7efc53a68640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efc4c14fbe0 0x7efc4c152520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:21.615 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.613+0000 7efc53a68640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efc4c0c06d0 0x7efc4c152a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:21.615 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.613+0000 7efc53a68640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc4c06d980 con 0x7efc4c0c5520 2023-12-19T18:58:21.615 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.613+0000 7efc53a68640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc4c06dc60 con 0x7efc4c14fbe0 2023-12-19T18:58:21.615 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.613+0000 7efc53a68640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c06df40 con 0x7efc4c0c06d0 2023-12-19T18:58:21.616 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.613+0000 7efc51003640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efc4c14fbe0 0x7efc4c152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:21.616 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.613+0000 7efc52005640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efc4c0c06d0 0x7efc4c152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:21.616 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.613+0000 7efc51804640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7efc4c0c5520 0x7efc4c14f4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:40018/0 (socket says 172.21.15.133:40018) 2023-12-19T18:58:21.616 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.613+0000 7efc51804640 1 -- 172.21.15.133:0/1817824088 learned_addr learned my addr 172.21.15.133:0/1817824088 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:21.616 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.613+0000 7efc51003640 1 -- 172.21.15.133:0/1817824088 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efc4c0c06d0 msgr2=0x7efc4c152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:21.616 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.613+0000 7efc51003640 1 --2- 172.21.15.133:0/1817824088 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efc4c0c06d0 0x7efc4c152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:21.616 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.613+0000 7efc51003640 1 -- 172.21.15.133:0/1817824088 >> v1:172.21.15.133:6789/0 conn(0x7efc4c0c5520 legacy=0x7efc4c14f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:21.616 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.613+0000 7efc51003640 1 -- 172.21.15.133:0/1817824088 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc4c06e220 con 0x7efc4c14fbe0 2023-12-19T18:58:21.619 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.617+0000 7efc51003640 1 --2- 172.21.15.133:0/1817824088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc4c14fbe0 0x7efc4c152520 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efc3c0097c0 tx=0x7efc3c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f4c0b90560b04c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:21.619 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.617+0000 7efc50802640 1 -- 172.21.15.133:0/1817824088 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c0ac640 con 0x7efc4c14fbe0 2023-12-19T18:58:21.619 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.617+0000 7efc50802640 1 -- 172.21.15.133:0/1817824088 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c0ac7a0 con 0x7efc4c14fbe0 2023-12-19T18:58:21.619 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.617+0000 7efc50802640 1 -- 172.21.15.133:0/1817824088 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c0acb30 con 0x7efc4c14fbe0 2023-12-19T18:58:21.620 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.617+0000 7efc53a68640 1 -- 172.21.15.133:0/1817824088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc4c14fbe0 msgr2=0x7efc4c152520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:21.620 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.617+0000 7efc53a68640 1 --2- 172.21.15.133:0/1817824088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc4c14fbe0 0x7efc4c152520 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7efc3c0097c0 tx=0x7efc3c01c3c0 comp rx=0 tx=0).stop 2023-12-19T18:58:21.620 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.617+0000 7efc53a68640 1 -- 172.21.15.133:0/1817824088 shutdown_connections 2023-12-19T18:58:21.620 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.617+0000 7efc53a68640 1 --2- 172.21.15.133:0/1817824088 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efc4c0c06d0 0x7efc4c152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:21.620 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.617+0000 7efc53a68640 1 --2- 172.21.15.133:0/1817824088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc4c14fbe0 0x7efc4c152520 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:21.620 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.617+0000 7efc53a68640 1 -- 172.21.15.133:0/1817824088 >> 172.21.15.133:0/1817824088 conn(0x7efc4c0c5cd0 msgr2=0x7efc4c0c60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:21.620 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.617+0000 7efc53a68640 1 -- 172.21.15.133:0/1817824088 shutdown_connections 2023-12-19T18:58:21.621 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.617+0000 7efc53a68640 1 -- 172.21.15.133:0/1817824088 wait complete. 2023-12-19T18:58:21.622 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc53a68640 1 Processor -- start 2023-12-19T18:58:21.622 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc53a68640 1 -- start start 2023-12-19T18:58:21.624 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc53a68640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efc4c0c06d0 0x7efc4c143de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:21.624 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc53a68640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc4c0c5520 0x7efc4c1ec430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:21.624 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc53a68640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efc4c14fbe0 0x7efc4c140850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:21.624 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc53a68640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c146a50 con 0x7efc4c0c5520 2023-12-19T18:58:21.624 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc53a68640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c0c30d0 con 0x7efc4c14fbe0 2023-12-19T18:58:21.624 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc53a68640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc4c146770 con 0x7efc4c0c06d0 2023-12-19T18:58:21.624 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc51003640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc4c0c5520 0x7efc4c1ec430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:21.624 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc51003640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc4c0c5520 0x7efc4c1ec430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58840/0 (socket says 172.21.15.133:58840) 2023-12-19T18:58:21.624 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc51003640 1 -- 172.21.15.133:0/3044906712 learned_addr learned my addr 172.21.15.133:0/3044906712 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:21.624 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc51804640 1 --2- 172.21.15.133:0/3044906712 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efc4c0c06d0 0x7efc4c143de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:21.625 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc52005640 1 --2- 172.21.15.133:0/3044906712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efc4c14fbe0 0x7efc4c140850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:21.625 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc51003640 1 -- 172.21.15.133:0/3044906712 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efc4c0c06d0 msgr2=0x7efc4c143de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:21.625 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc51003640 1 --2- 172.21.15.133:0/3044906712 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efc4c0c06d0 0x7efc4c143de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:21.625 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc51003640 1 -- 172.21.15.133:0/3044906712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efc4c14fbe0 msgr2=0x7efc4c140850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:21.625 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc51003640 1 --2- 172.21.15.133:0/3044906712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efc4c14fbe0 0x7efc4c140850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:21.625 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc51003640 1 -- 172.21.15.133:0/3044906712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c009420 con 0x7efc4c0c5520 2023-12-19T18:58:21.625 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc51804640 1 --2- 172.21.15.133:0/3044906712 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efc4c0c06d0 0x7efc4c143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:21.625 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc51003640 1 --2- 172.21.15.133:0/3044906712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc4c0c5520 0x7efc4c1ec430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efc3c01aa70 tx=0x7efc3c01ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:21.627 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc427fc640 1 -- 172.21.15.133:0/3044906712 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c0b7650 con 0x7efc4c0c5520 2023-12-19T18:58:21.627 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc427fc640 1 -- 172.21.15.133:0/3044906712 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3c0b77b0 con 0x7efc4c0c5520 2023-12-19T18:58:21.627 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc427fc640 1 -- 172.21.15.133:0/3044906712 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3c0b7b40 con 0x7efc4c0c5520 2023-12-19T18:58:21.627 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc53a68640 1 -- 172.21.15.133:0/3044906712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc4c1451f0 con 0x7efc4c0c5520 2023-12-19T18:58:21.627 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc53a68640 1 -- 172.21.15.133:0/3044906712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc4c1457b0 con 0x7efc4c0c5520 2023-12-19T18:58:21.627 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc427fc640 1 -- 172.21.15.133:0/3044906712 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efc3c0b3070 con 0x7efc4c0c5520 2023-12-19T18:58:21.627 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc427fc640 1 -- 172.21.15.133:0/3044906712 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7efc3c0abab0 con 0x7efc4c0c5520 2023-12-19T18:58:21.627 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.621+0000 7efc53a68640 1 -- 172.21.15.133:0/3044906712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc4c145050 con 0x7efc4c0c5520 2023-12-19T18:58:21.628 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.625+0000 7efc427fc640 1 -- 172.21.15.133:0/3044906712 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72915 (secure 0 0 0) 0x7efc4c145050 con 0x7efc4c0c5520 2023-12-19T18:58:21.685 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.681+0000 7efc53a68640 1 -- 172.21.15.133:0/3044906712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc4c072830 con 0x7efc4c0c5520 2023-12-19T18:58:21.686 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.685+0000 7efc427fc640 1 -- 172.21.15.133:0/3044906712 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7efc3c0b1070 con 0x7efc4c0c5520 2023-12-19T18:58:21.686 INFO:teuthology.misc.health.smithi133.stdout: 2023-12-19T18:58:21.686 INFO:teuthology.misc.health.smithi133.stdout:{"epoch":10,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:20.321740+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:58:21.687 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.685+0000 7efc53a68640 1 -- 172.21.15.133:0/3044906712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc4c0c5520 msgr2=0x7efc4c1ec430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:21.687 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.685+0000 7efc53a68640 1 --2- 172.21.15.133:0/3044906712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc4c0c5520 0x7efc4c1ec430 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efc3c01aa70 tx=0x7efc3c01ac00 comp rx=0 tx=0).stop 2023-12-19T18:58:21.687 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.685+0000 7efc53a68640 1 -- 172.21.15.133:0/3044906712 shutdown_connections 2023-12-19T18:58:21.687 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.685+0000 7efc53a68640 1 --2- 172.21.15.133:0/3044906712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efc4c14fbe0 0x7efc4c140850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:21.687 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.685+0000 7efc53a68640 1 --2- 172.21.15.133:0/3044906712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efc4c0c5520 0x7efc4c1ec430 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:21.687 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.685+0000 7efc53a68640 1 --2- 172.21.15.133:0/3044906712 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efc4c0c06d0 0x7efc4c143de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:21.687 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.685+0000 7efc53a68640 1 -- 172.21.15.133:0/3044906712 >> 172.21.15.133:0/3044906712 conn(0x7efc4c0c5cd0 msgr2=0x7efc4c14cf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:21.688 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.685+0000 7efc53a68640 1 -- 172.21.15.133:0/3044906712 shutdown_connections 2023-12-19T18:58:21.688 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:21.685+0000 7efc53a68640 1 -- 172.21.15.133:0/3044906712 wait complete. 2023-12-19T18:58:21.704 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-19T18:58:22.056 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:22.054+0000 7fbeca8c1180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-19T18:58:22.109 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-19T18:58:22.105+0000 7fb62ff5b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-19T18:58:22.143 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:22.142+0000 7fbeca8c1180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-19T18:58:22.194 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-19T18:58:22.193+0000 7fb62ff5b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-19T18:58:22.335 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:22.334+0000 7fbeca8c1180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-19T18:58:22.385 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-19T18:58:22.381+0000 7fb62ff5b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-19T18:58:22.419 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:22.418+0000 7fbeca8c1180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-19T18:58:22.469 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-19T18:58:22.465+0000 7fb62ff5b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-19T18:58:22.745 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:22.742+0000 7fbeca8c1180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-19T18:58:22.794 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-19T18:58:22.793+0000 7fb62ff5b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-19T18:58:22.813 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:22.810+0000 7fbeca8c1180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-19T18:58:22.868 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-12-19T18:58:22.865+0000 7fb62ff5b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-19T18:58:23.836 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:23.834+0000 7fbe72042640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-19T18:58:23.836 INFO:tasks.ceph.mgr.x.smithi138.stderr:2023-12-19T18:58:23.834+0000 7fbe72042640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-19T18:58:24.872 INFO:tasks.ceph.osd.2.smithi133.stderr:2023-12-19T18:58:24.869+0000 7f5082aec640 -1 osd.2 0 log_to_monitors true 2023-12-19T18:58:24.884 INFO:tasks.ceph.osd.3.smithi133.stderr:2023-12-19T18:58:24.881+0000 7fa15c131640 -1 osd.3 0 log_to_monitors true 2023-12-19T18:58:24.911 INFO:tasks.ceph.osd.4.smithi138.stderr:2023-12-19T18:58:24.910+0000 7fa661bc6640 -1 osd.4 0 log_to_monitors true 2023-12-19T18:58:24.967 INFO:tasks.ceph.osd.1.smithi133.stderr:2023-12-19T18:58:24.965+0000 7fbe0850b640 -1 osd.1 0 log_to_monitors true 2023-12-19T18:58:25.035 INFO:tasks.ceph.osd.7.smithi138.stderr:2023-12-19T18:58:25.034+0000 7f430695a640 -1 osd.7 0 log_to_monitors true 2023-12-19T18:58:25.051 INFO:tasks.ceph.osd.5.smithi138.stderr:2023-12-19T18:58:25.050+0000 7fe4e3ef9640 -1 osd.5 0 log_to_monitors true 2023-12-19T18:58:25.057 INFO:tasks.ceph.osd.0.smithi133.stderr:2023-12-19T18:58:25.053+0000 7f5afdc2b640 -1 osd.0 0 log_to_monitors true 2023-12-19T18:58:25.099 INFO:tasks.ceph.osd.6.smithi138.stderr:2023-12-19T18:58:25.098+0000 7f7dd06ac640 -1 osd.6 0 log_to_monitors true 2023-12-19T18:58:28.510 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T18:58:28.735 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.733+0000 7f901ae38640 1 Processor -- start 2023-12-19T18:58:28.736 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.733+0000 7f901ae38640 1 -- start start 2023-12-19T18:58:28.741 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.733+0000 7f901ae38640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9014072940 0x7f90140c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:28.741 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.737+0000 7f901ae38640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90141523b0 con 0x7f901406e4d0 2023-12-19T18:58:28.741 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.737+0000 7f901ae38640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9014153260 con 0x7f901406bbf0 2023-12-19T18:58:28.741 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.737+0000 7f901ae38640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90140c0490 con 0x7f9014072940 2023-12-19T18:58:28.741 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.737+0000 7f901a637640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f901406bbf0 0x7f901415cc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:46218/0 (socket says 172.21.15.133:46218) 2023-12-19T18:58:28.741 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.737+0000 7f901a637640 1 -- 172.21.15.133:0/1186998715 learned_addr learned my addr 172.21.15.133:0/1186998715 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:28.741 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.737+0000 7f9019e36640 1 --2- 172.21.15.133:0/1186998715 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9014072940 0x7f90140c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:28.742 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.737+0000 7f9019e36640 1 -- 172.21.15.133:0/1186998715 >> v1:172.21.15.138:6789/0 conn(0x7f901406bbf0 legacy=0x7f901415cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:28.742 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.737+0000 7f9019e36640 1 -- 172.21.15.133:0/1186998715 >> v1:172.21.15.133:6789/0 conn(0x7f901406e4d0 legacy=0x7f9014152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:28.742 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.737+0000 7f9019e36640 1 -- 172.21.15.133:0/1186998715 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90140a5080 con 0x7f9014072940 2023-12-19T18:58:28.745 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.741+0000 7f9019e36640 1 --2- 172.21.15.133:0/1186998715 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9014072940 0x7f90140c3bd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f90100097f0 tx=0x7f901001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffea6863ed31318c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:28.746 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.741+0000 7f9018e34640 1 -- 172.21.15.133:0/1186998715 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90100ab600 con 0x7f9014072940 2023-12-19T18:58:28.746 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.741+0000 7f9018e34640 1 -- 172.21.15.133:0/1186998715 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90100a7050 con 0x7f9014072940 2023-12-19T18:58:28.746 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.741+0000 7f9018e34640 1 -- 172.21.15.133:0/1186998715 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90100ab980 con 0x7f9014072940 2023-12-19T18:58:28.746 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.745+0000 7f901ae38640 1 -- 172.21.15.133:0/1186998715 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9014072940 msgr2=0x7f90140c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:28.747 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.745+0000 7f901ae38640 1 --2- 172.21.15.133:0/1186998715 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9014072940 0x7f90140c3bd0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f90100097f0 tx=0x7f901001c470 comp rx=0 tx=0).stop 2023-12-19T18:58:28.748 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.745+0000 7f901ae38640 1 -- 172.21.15.133:0/1186998715 shutdown_connections 2023-12-19T18:58:28.748 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.745+0000 7f901ae38640 1 --2- 172.21.15.133:0/1186998715 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9014072940 0x7f90140c3bd0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:28.748 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.745+0000 7f901ae38640 1 -- 172.21.15.133:0/1186998715 >> 172.21.15.133:0/1186998715 conn(0x7f90140c27d0 msgr2=0x7f90140c2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:28.749 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.745+0000 7f901ae38640 1 -- 172.21.15.133:0/1186998715 shutdown_connections 2023-12-19T18:58:28.750 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.745+0000 7f901ae38640 1 -- 172.21.15.133:0/1186998715 wait complete. 2023-12-19T18:58:28.752 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.749+0000 7f901ae38640 1 Processor -- start 2023-12-19T18:58:28.752 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.749+0000 7f901ae38640 1 -- start start 2023-12-19T18:58:28.753 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.749+0000 7f901ae38640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f901406bbf0 0x7f90140a23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:28.754 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.749+0000 7f901ae38640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f901406e4d0 0x7f90141f5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:28.754 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.749+0000 7f901ae38640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9014072940 0x7f9014155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:28.754 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.749+0000 7f901ae38640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90141564b0 con 0x7f9014072940 2023-12-19T18:58:28.754 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.749+0000 7f901ae38640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90141f13f0 con 0x7f901406e4d0 2023-12-19T18:58:28.754 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.749+0000 7f901ae38640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90141f4960 con 0x7f901406bbf0 2023-12-19T18:58:28.754 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.753+0000 7f901a637640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9014072940 0x7f9014155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:28.754 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.753+0000 7f901a637640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9014072940 0x7f9014155f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32932/0 (socket says 172.21.15.133:32932) 2023-12-19T18:58:28.754 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.753+0000 7f901a637640 1 -- 172.21.15.133:0/4206992389 learned_addr learned my addr 172.21.15.133:0/4206992389 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:28.755 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.753+0000 7f901a637640 1 -- 172.21.15.133:0/4206992389 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f901406bbf0 msgr2=0x7f90140a23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:28.755 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.753+0000 7f901a637640 1 --2- 172.21.15.133:0/4206992389 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f901406bbf0 0x7f90140a23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:28.755 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.753+0000 7f901a637640 1 -- 172.21.15.133:0/4206992389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f901406e4d0 msgr2=0x7f90141f5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:28.755 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.753+0000 7f901a637640 1 --2- 172.21.15.133:0/4206992389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f901406e4d0 0x7f90141f5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:28.755 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.753+0000 7f901a637640 1 -- 172.21.15.133:0/4206992389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9010009420 con 0x7f9014072940 2023-12-19T18:58:28.756 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.753+0000 7f901a637640 1 --2- 172.21.15.133:0/4206992389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9014072940 0x7f9014155f70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f900c00ca80 tx=0x7f900c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:28.756 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.753+0000 7f900a7fc640 1 -- 172.21.15.133:0/4206992389 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c00ac30 con 0x7f9014072940 2023-12-19T18:58:28.760 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.753+0000 7f900a7fc640 1 -- 172.21.15.133:0/4206992389 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c00ad90 con 0x7f9014072940 2023-12-19T18:58:28.760 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.753+0000 7f900a7fc640 1 -- 172.21.15.133:0/4206992389 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c00ac30 con 0x7f9014072940 2023-12-19T18:58:28.760 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.753+0000 7f901ae38640 1 -- 172.21.15.133:0/4206992389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90141537c0 con 0x7f9014072940 2023-12-19T18:58:28.760 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.757+0000 7f901ae38640 1 -- 172.21.15.133:0/4206992389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9014153d80 con 0x7f9014072940 2023-12-19T18:58:28.760 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.757+0000 7f901ae38640 1 -- 172.21.15.133:0/4206992389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90141f1540 con 0x7f9014072940 2023-12-19T18:58:28.760 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.757+0000 7f900a7fc640 1 -- 172.21.15.133:0/4206992389 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 4) v1 ==== 85798+0+0 (secure 0 0 0) 0x7f900c012400 con 0x7f9014072940 2023-12-19T18:58:28.760 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.757+0000 7f900a7fc640 1 --2- 172.21.15.133:0/4206992389 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8ff8066440 0x7f8ff8068900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:28.763 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.761+0000 7f900a7fc640 1 -- 172.21.15.133:0/4206992389 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f900c054f40 con 0x7f9014072940 2023-12-19T18:58:28.764 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.761+0000 7f9019e36640 1 --2- 172.21.15.133:0/4206992389 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8ff8066440 0x7f8ff8068900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:28.764 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.761+0000 7f9019e36640 1 --2- 172.21.15.133:0/4206992389 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8ff8066440 0x7f8ff8068900 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f90100ad000 tx=0x7f9010004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:28.767 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:28.765+0000 7f900a7fc640 1 -- 172.21.15.133:0/4206992389 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f900c051310 con 0x7f9014072940 2023-12-19T18:58:29.073 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:29.069+0000 7f901ae38640 1 -- 172.21.15.133:0/4206992389 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90141f1540 con 0x7f9014072940 2023-12-19T18:58:29.075 INFO:teuthology.misc.health.smithi133.stdout: 2023-12-19T18:58:29.076 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:29.073+0000 7f900a7fc640 1 -- 172.21.15.133:0/4206992389 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f90141f1540 con 0x7f9014072940 2023-12-19T18:58:29.077 INFO:teuthology.misc.health.smithi133.stdout:{"epoch":12,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:26.838500+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:58:29.077 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:29.073+0000 7f901ae38640 1 -- 172.21.15.133:0/4206992389 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8ff8066440 msgr2=0x7f8ff8068900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:29.078 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:29.073+0000 7f901ae38640 1 --2- 172.21.15.133:0/4206992389 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8ff8066440 0x7f8ff8068900 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f90100ad000 tx=0x7f9010004740 comp rx=0 tx=0).stop 2023-12-19T18:58:29.078 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:29.073+0000 7f901ae38640 1 -- 172.21.15.133:0/4206992389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9014072940 msgr2=0x7f9014155f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:29.078 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:29.073+0000 7f901ae38640 1 --2- 172.21.15.133:0/4206992389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9014072940 0x7f9014155f70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f900c00ca80 tx=0x7f900c00cf40 comp rx=0 tx=0).stop 2023-12-19T18:58:29.078 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:29.073+0000 7f901ae38640 1 -- 172.21.15.133:0/4206992389 shutdown_connections 2023-12-19T18:58:29.078 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:29.073+0000 7f901ae38640 1 --2- 172.21.15.133:0/4206992389 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8ff8066440 0x7f8ff8068900 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:29.078 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:29.073+0000 7f901ae38640 1 --2- 172.21.15.133:0/4206992389 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9014072940 0x7f9014155f70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:29.078 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:29.073+0000 7f901ae38640 1 --2- 172.21.15.133:0/4206992389 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f901406e4d0 0x7f90141f5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:29.078 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:29.073+0000 7f901ae38640 1 --2- 172.21.15.133:0/4206992389 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f901406bbf0 0x7f90140a23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:29.078 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:29.073+0000 7f901ae38640 1 -- 172.21.15.133:0/4206992389 >> 172.21.15.133:0/4206992389 conn(0x7f90140c27d0 msgr2=0x7f90140c4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:29.078 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:29.073+0000 7f901ae38640 1 -- 172.21.15.133:0/4206992389 shutdown_connections 2023-12-19T18:58:29.078 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:29.073+0000 7f901ae38640 1 -- 172.21.15.133:0/4206992389 wait complete. 2023-12-19T18:58:29.104 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-19T18:58:29.110 INFO:tasks.ceph.osd.7.smithi138.stderr:2023-12-19T18:58:29.110+0000 7f43020e0640 -1 osd.7 0 waiting for initial osdmap 2023-12-19T18:58:29.139 INFO:tasks.ceph.osd.7.smithi138.stderr:2023-12-19T18:58:29.138+0000 7f42fa72d640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T18:58:29.179 INFO:tasks.ceph.osd.6.smithi138.stderr:2023-12-19T18:58:29.178+0000 7f7dcbe32640 -1 osd.6 0 waiting for initial osdmap 2023-12-19T18:58:29.204 INFO:tasks.ceph.osd.6.smithi138.stderr:2023-12-19T18:58:29.202+0000 7f7dc447f640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T18:58:29.246 INFO:tasks.ceph.osd.4.smithi138.stderr:2023-12-19T18:58:29.242+0000 7fa65eb82640 -1 osd.4 0 waiting for initial osdmap 2023-12-19T18:58:29.263 INFO:tasks.ceph.osd.2.smithi133.stderr:2023-12-19T18:58:29.261+0000 7f507e272640 -1 osd.2 0 waiting for initial osdmap 2023-12-19T18:58:29.274 INFO:tasks.ceph.osd.5.smithi138.stderr:2023-12-19T18:58:29.274+0000 7fe4df67f640 -1 osd.5 0 waiting for initial osdmap 2023-12-19T18:58:29.276 INFO:tasks.ceph.osd.4.smithi138.stderr:2023-12-19T18:58:29.274+0000 7fa655999640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T18:58:29.291 INFO:tasks.ceph.osd.3.smithi133.stderr:2023-12-19T18:58:29.289+0000 7fa1578b7640 -1 osd.3 0 waiting for initial osdmap 2023-12-19T18:58:29.292 INFO:tasks.ceph.osd.2.smithi133.stderr:2023-12-19T18:58:29.289+0000 7f50768bf640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T18:58:29.309 INFO:tasks.ceph.osd.0.smithi133.stderr:2023-12-19T18:58:29.305+0000 7f5af88ac640 -1 osd.0 0 waiting for initial osdmap 2023-12-19T18:58:29.315 INFO:tasks.ceph.osd.5.smithi138.stderr:2023-12-19T18:58:29.314+0000 7fe4d7ccc640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T18:58:29.331 INFO:tasks.ceph.osd.3.smithi133.stderr:2023-12-19T18:58:29.329+0000 7fa14ff04640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T18:58:29.338 INFO:tasks.ceph.osd.1.smithi133.stderr:2023-12-19T18:58:29.337+0000 7fbe03c91640 -1 osd.1 0 waiting for initial osdmap 2023-12-19T18:58:29.343 INFO:tasks.ceph.osd.0.smithi133.stderr:2023-12-19T18:58:29.341+0000 7f5af0ef9640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T18:58:29.367 INFO:tasks.ceph.osd.1.smithi133.stderr:2023-12-19T18:58:29.365+0000 7fbdfc2de640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T18:58:35.911 DEBUG:teuthology.orchestra.run.smithi133:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T18:58:36.049 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.044+0000 7f02095d0640 1 Processor -- start 2023-12-19T18:58:36.049 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.044+0000 7f02095d0640 1 -- start start 2023-12-19T18:58:36.050 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.044+0000 7f02095d0640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0204072840 0x7f02041558b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:36.050 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.044+0000 7f02095d0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f02040c06d0 0x7f020406de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:36.050 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.044+0000 7f02095d0640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f020406bc30 0x7f020406a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:36.050 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.044+0000 7f02095d0640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02040c55b0 con 0x7f02040c06d0 2023-12-19T18:58:36.050 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.044+0000 7f02095d0640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0204072c20 con 0x7f020406bc30 2023-12-19T18:58:36.050 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.044+0000 7f02095d0640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f020406d690 con 0x7f0204072840 2023-12-19T18:58:36.051 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.044+0000 7f02037fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f02040c06d0 0x7f020406de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:36.051 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.048+0000 7f02037fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f02040c06d0 0x7f020406de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34208/0 (socket says 172.21.15.133:34208) 2023-12-19T18:58:36.051 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.048+0000 7f02037fe640 1 -- 172.21.15.133:0/144635702 learned_addr learned my addr 172.21.15.133:0/144635702 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:36.051 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.048+0000 7f0203fff640 1 --2- 172.21.15.133:0/144635702 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0204072840 0x7f02041558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:36.051 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.048+0000 7f0208dcf640 1 --2- 172.21.15.133:0/144635702 >> v2:172.21.15.138:3300/0 conn(0x7f020406bc30 0x7f020406a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:36.051 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.048+0000 7f02037fe640 1 -- 172.21.15.133:0/144635702 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0204072840 msgr2=0x7f02041558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:36.051 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.048+0000 7f02037fe640 1 --2- 172.21.15.133:0/144635702 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0204072840 0x7f02041558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.051 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.048+0000 7f02037fe640 1 -- 172.21.15.133:0/144635702 >> v2:172.21.15.138:3300/0 conn(0x7f020406bc30 msgr2=0x7f020406a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:36.051 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.048+0000 7f02037fe640 1 --2- 172.21.15.133:0/144635702 >> v2:172.21.15.138:3300/0 conn(0x7f020406bc30 0x7f020406a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.052 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.048+0000 7f02037fe640 1 -- 172.21.15.133:0/144635702 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02040c5790 con 0x7f02040c06d0 2023-12-19T18:58:36.053 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.048+0000 7f02037fe640 1 --2- 172.21.15.133:0/144635702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02040c06d0 0x7f020406de50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f02040ab180 tx=0x7f01f801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e265d9ef93783b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:36.054 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.048+0000 7f0202ffd640 1 -- 172.21.15.133:0/144635702 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f80ab600 con 0x7f02040c06d0 2023-12-19T18:58:36.054 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.048+0000 7f0202ffd640 1 -- 172.21.15.133:0/144635702 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f80a7050 con 0x7f02040c06d0 2023-12-19T18:58:36.054 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.048+0000 7f0202ffd640 1 -- 172.21.15.133:0/144635702 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f80ab980 con 0x7f02040c06d0 2023-12-19T18:58:36.055 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.052+0000 7f02095d0640 1 -- 172.21.15.133:0/144635702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02040c06d0 msgr2=0x7f020406de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:36.055 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.052+0000 7f02095d0640 1 --2- 172.21.15.133:0/144635702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02040c06d0 0x7f020406de50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f02040ab180 tx=0x7f01f801c470 comp rx=0 tx=0).stop 2023-12-19T18:58:36.055 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.052+0000 7f02095d0640 1 -- 172.21.15.133:0/144635702 shutdown_connections 2023-12-19T18:58:36.055 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.052+0000 7f02095d0640 1 --2- 172.21.15.133:0/144635702 >> v2:172.21.15.138:3300/0 conn(0x7f020406bc30 0x7f020406a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.055 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.052+0000 7f02095d0640 1 --2- 172.21.15.133:0/144635702 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02040c06d0 0x7f020406de50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.055 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.052+0000 7f02095d0640 1 --2- 172.21.15.133:0/144635702 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0204072840 0x7f02041558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.055 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.052+0000 7f02095d0640 1 -- 172.21.15.133:0/144635702 >> 172.21.15.133:0/144635702 conn(0x7f02040a7a80 msgr2=0x7f02040a7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:36.055 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.052+0000 7f02095d0640 1 -- 172.21.15.133:0/144635702 shutdown_connections 2023-12-19T18:58:36.055 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.052+0000 7f02095d0640 1 -- 172.21.15.133:0/144635702 wait complete. 2023-12-19T18:58:36.056 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.052+0000 7f02095d0640 1 Processor -- start 2023-12-19T18:58:36.056 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.052+0000 7f02095d0640 1 -- start start 2023-12-19T18:58:36.059 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.052+0000 7f02095d0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f020406bc30 0x7f0204071240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:36.059 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.052+0000 7f02095d0640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0204072840 0x7f0204147a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:36.059 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.052+0000 7f02095d0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02040c06d0 0x7f0204147f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:36.059 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.052+0000 7f02095d0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02041edf10 con 0x7f02040c06d0 2023-12-19T18:58:36.059 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.052+0000 7f02095d0640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f020415b420 con 0x7f020406bc30 2023-12-19T18:58:36.059 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.052+0000 7f02095d0640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02041ed300 con 0x7f0204072840 2023-12-19T18:58:36.059 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.052+0000 7f0208dcf640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02040c06d0 0x7f0204147f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:36.060 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.052+0000 7f0208dcf640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02040c06d0 0x7f0204147f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34210/0 (socket says 172.21.15.133:34210) 2023-12-19T18:58:36.060 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.052+0000 7f0203fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f020406bc30 0x7f0204071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:36.060 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.052+0000 7f0208dcf640 1 -- 172.21.15.133:0/1831680126 learned_addr learned my addr 172.21.15.133:0/1831680126 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:36.060 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.052+0000 7f02037fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0204072840 0x7f0204147a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:36.060 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.056+0000 7f0208dcf640 1 -- 172.21.15.133:0/1831680126 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0204072840 msgr2=0x7f0204147a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:36.060 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.056+0000 7f0208dcf640 1 --2- 172.21.15.133:0/1831680126 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0204072840 0x7f0204147a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.060 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.056+0000 7f0208dcf640 1 -- 172.21.15.133:0/1831680126 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f020406bc30 msgr2=0x7f0204071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:36.060 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.056+0000 7f0208dcf640 1 --2- 172.21.15.133:0/1831680126 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f020406bc30 0x7f0204071240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.060 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.056+0000 7f0208dcf640 1 -- 172.21.15.133:0/1831680126 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f80094d0 con 0x7f02040c06d0 2023-12-19T18:58:36.060 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.056+0000 7f02037fe640 1 --2- 172.21.15.133:0/1831680126 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0204072840 0x7f0204147a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:58:36.060 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.056+0000 7f0203fff640 1 --2- 172.21.15.133:0/1831680126 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f020406bc30 0x7f0204071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:58:36.060 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.056+0000 7f0208dcf640 1 --2- 172.21.15.133:0/1831680126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02040c06d0 0x7f0204147f90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00efc0 tx=0x7f01fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:36.060 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.056+0000 7f0200ff9640 1 -- 172.21.15.133:0/1831680126 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc014480 con 0x7f02040c06d0 2023-12-19T18:58:36.060 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.056+0000 7f0200ff9640 1 -- 172.21.15.133:0/1831680126 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01fc00f040 con 0x7f02040c06d0 2023-12-19T18:58:36.061 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.056+0000 7f02095d0640 1 -- 172.21.15.133:0/1831680126 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02041ed5e0 con 0x7f02040c06d0 2023-12-19T18:58:36.061 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.056+0000 7f0200ff9640 1 -- 172.21.15.133:0/1831680126 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01fc014820 con 0x7f02040c06d0 2023-12-19T18:58:36.061 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.056+0000 7f02095d0640 1 -- 172.21.15.133:0/1831680126 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02041edba0 con 0x7f02040c06d0 2023-12-19T18:58:36.061 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.056+0000 7f02095d0640 1 -- 172.21.15.133:0/1831680126 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f020414b540 con 0x7f02040c06d0 2023-12-19T18:58:36.061 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.056+0000 7f0200ff9640 1 -- 172.21.15.133:0/1831680126 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f01fc014980 con 0x7f02040c06d0 2023-12-19T18:58:36.062 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.056+0000 7f0200ff9640 1 --2- 172.21.15.133:0/1831680126 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f01f00664a0 0x7f01f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:36.062 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.056+0000 7f0200ff9640 1 -- 172.21.15.133:0/1831680126 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f01fc084570 con 0x7f02040c06d0 2023-12-19T18:58:36.062 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.060+0000 7f0203fff640 1 --2- 172.21.15.133:0/1831680126 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f01f00664a0 0x7f01f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:36.063 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.060+0000 7f0203fff640 1 --2- 172.21.15.133:0/1831680126 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f01f00664a0 0x7f01f0068960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009ed0 tx=0x7f01f4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:36.066 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.064+0000 7f0200ff9640 1 -- 172.21.15.133:0/1831680126 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f020414b540 con 0x7f02040c06d0 2023-12-19T18:58:36.216 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.212+0000 7f02095d0640 1 -- 172.21.15.133:0/1831680126 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f020414b540 con 0x7f02040c06d0 2023-12-19T18:58:36.217 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.212+0000 7f0200ff9640 1 -- 172.21.15.133:0/1831680126 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12886 (secure 0 0 0) 0x7f020414b540 con 0x7f02040c06d0 2023-12-19T18:58:36.217 INFO:teuthology.misc.health.smithi133.stdout: 2023-12-19T18:58:36.218 INFO:teuthology.misc.health.smithi133.stdout:{"epoch":16,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:33.139528+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:58:36.219 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.216+0000 7f02095d0640 1 -- 172.21.15.133:0/1831680126 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f01f00664a0 msgr2=0x7f01f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:36.219 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.216+0000 7f02095d0640 1 --2- 172.21.15.133:0/1831680126 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f01f00664a0 0x7f01f0068960 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009ed0 tx=0x7f01f4009190 comp rx=0 tx=0).stop 2023-12-19T18:58:36.220 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.216+0000 7f02095d0640 1 -- 172.21.15.133:0/1831680126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02040c06d0 msgr2=0x7f0204147f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:36.220 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.216+0000 7f02095d0640 1 --2- 172.21.15.133:0/1831680126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02040c06d0 0x7f0204147f90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f01fc00efc0 tx=0x7f01fc00c490 comp rx=0 tx=0).stop 2023-12-19T18:58:36.220 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.216+0000 7f02095d0640 1 -- 172.21.15.133:0/1831680126 shutdown_connections 2023-12-19T18:58:36.220 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.216+0000 7f02095d0640 1 --2- 172.21.15.133:0/1831680126 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f01f00664a0 0x7f01f0068960 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.220 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.216+0000 7f02095d0640 1 --2- 172.21.15.133:0/1831680126 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f02040c06d0 0x7f0204147f90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.220 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.216+0000 7f02095d0640 1 --2- 172.21.15.133:0/1831680126 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0204072840 0x7f0204147a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.220 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.216+0000 7f02095d0640 1 --2- 172.21.15.133:0/1831680126 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f020406bc30 0x7f0204071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.220 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.216+0000 7f02095d0640 1 -- 172.21.15.133:0/1831680126 >> 172.21.15.133:0/1831680126 conn(0x7f02040a7a80 msgr2=0x7f02040a6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:36.220 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.216+0000 7f02095d0640 1 -- 172.21.15.133:0/1831680126 shutdown_connections 2023-12-19T18:58:36.220 INFO:teuthology.misc.health.smithi133.stderr:2023-12-19T18:58:36.216+0000 7f02095d0640 1 -- 172.21.15.133:0/1831680126 wait complete. 2023-12-19T18:58:36.237 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-19T18:58:36.237 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-19T18:58:36.238 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T18:58:36.238 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T18:58:36.241 INFO:tasks.ceph.mds.a:Started 2023-12-19T18:58:36.241 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T18:58:36.241 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T18:58:36.246 INFO:tasks.ceph.mds.c:Started 2023-12-19T18:58:36.246 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T18:58:36.246 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T18:58:36.250 INFO:tasks.ceph.mds.b:Started 2023-12-19T18:58:36.250 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T18:58:36.250 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T18:58:36.254 INFO:tasks.ceph.mds.d:Started 2023-12-19T18:58:36.254 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-19T18:58:36.254 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:58:36.347 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2023-12-19T18:58:36.348 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2023-12-19T18:58:36.355 INFO:tasks.ceph.mds.b.smithi138.stdout:starting mds.b at 2023-12-19T18:58:36.355 INFO:tasks.ceph.mds.d.smithi138.stdout:starting mds.d at 2023-12-19T18:58:36.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.400+0000 7fee53780640 1 Processor -- start 2023-12-19T18:58:36.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.400+0000 7fee53780640 1 -- start start 2023-12-19T18:58:36.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.404+0000 7fee53780640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee4c151e90 0x7fee4c0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:36.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.404+0000 7fee53780640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee4c0c7ea0 0x7fee4c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:36.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.404+0000 7fee53780640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fee4c0c4e60 0x7fee4c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:36.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.404+0000 7fee53780640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee4c0c8750 con 0x7fee4c0c7ea0 2023-12-19T18:58:36.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.404+0000 7fee53780640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee4c1552d0 con 0x7fee4c0c4e60 2023-12-19T18:58:36.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.404+0000 7fee53780640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0c5c60 con 0x7fee4c151e90 2023-12-19T18:58:36.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.404+0000 7fee50d1b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee4c0c7ea0 0x7fee4c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:36.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.404+0000 7fee50d1b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fee4c0c7ea0 0x7fee4c06b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34256/0 (socket says 172.21.15.133:34256) 2023-12-19T18:58:36.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.404+0000 7fee50d1b640 1 -- 172.21.15.133:0/3539993015 learned_addr learned my addr 172.21.15.133:0/3539993015 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:36.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.404+0000 7fee51d1d640 1 --2- 172.21.15.133:0/3539993015 >> v2:172.21.15.138:3300/0 conn(0x7fee4c0c4e60 0x7fee4c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:36.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.404+0000 7fee5151c640 1 --2- 172.21.15.133:0/3539993015 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee4c151e90 0x7fee4c0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:36.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.404+0000 7fee50d1b640 1 -- 172.21.15.133:0/3539993015 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee4c151e90 msgr2=0x7fee4c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:36.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.404+0000 7fee50d1b640 1 --2- 172.21.15.133:0/3539993015 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee4c151e90 0x7fee4c0c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.404+0000 7fee50d1b640 1 -- 172.21.15.133:0/3539993015 >> v2:172.21.15.138:3300/0 conn(0x7fee4c0c4e60 msgr2=0x7fee4c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:36.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.404+0000 7fee50d1b640 1 --2- 172.21.15.133:0/3539993015 >> v2:172.21.15.138:3300/0 conn(0x7fee4c0c4e60 0x7fee4c06b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.404+0000 7fee50d1b640 1 -- 172.21.15.133:0/3539993015 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee4c06c860 con 0x7fee4c0c7ea0 2023-12-19T18:58:36.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.408+0000 7fee50d1b640 1 --2- 172.21.15.133:0/3539993015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee4c0c7ea0 0x7fee4c06b4a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fee4c0bd660 tx=0x7fee3c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230fe297438b6be9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:36.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.408+0000 7fee43fff640 1 -- 172.21.15.133:0/3539993015 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c0ab600 con 0x7fee4c0c7ea0 2023-12-19T18:58:36.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.408+0000 7fee43fff640 1 -- 172.21.15.133:0/3539993015 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee3c0a7050 con 0x7fee4c0c7ea0 2023-12-19T18:58:36.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.408+0000 7fee43fff640 1 -- 172.21.15.133:0/3539993015 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3c0ab980 con 0x7fee4c0c7ea0 2023-12-19T18:58:36.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.408+0000 7fee53780640 1 -- 172.21.15.133:0/3539993015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee4c0c7ea0 msgr2=0x7fee4c06b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:36.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.408+0000 7fee53780640 1 --2- 172.21.15.133:0/3539993015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee4c0c7ea0 0x7fee4c06b4a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fee4c0bd660 tx=0x7fee3c01c3e0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.408+0000 7fee53780640 1 -- 172.21.15.133:0/3539993015 shutdown_connections 2023-12-19T18:58:36.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.408+0000 7fee53780640 1 --2- 172.21.15.133:0/3539993015 >> v2:172.21.15.138:3300/0 conn(0x7fee4c0c4e60 0x7fee4c06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.408+0000 7fee53780640 1 --2- 172.21.15.133:0/3539993015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee4c0c7ea0 0x7fee4c06b4a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.408+0000 7fee53780640 1 --2- 172.21.15.133:0/3539993015 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee4c151e90 0x7fee4c0c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.408+0000 7fee53780640 1 -- 172.21.15.133:0/3539993015 >> 172.21.15.133:0/3539993015 conn(0x7fee4c0ca170 msgr2=0x7fee4c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:36.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.408+0000 7fee53780640 1 -- 172.21.15.133:0/3539993015 shutdown_connections 2023-12-19T18:58:36.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.408+0000 7fee53780640 1 -- 172.21.15.133:0/3539993015 wait complete. 2023-12-19T18:58:36.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.408+0000 7fee53780640 1 Processor -- start 2023-12-19T18:58:36.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.408+0000 7fee53780640 1 -- start start 2023-12-19T18:58:36.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.408+0000 7fee53780640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee4c0c4e60 0x7fee4c0be940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.408+0000 7fee53780640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee4c0c7ea0 0x7fee4c0bff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.408+0000 7fee53780640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee4c151e90 0x7fee4c149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.408+0000 7fee53780640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c1ee1c0 con 0x7fee4c0c4e60 2023-12-19T18:58:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.412+0000 7fee53780640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0bef70 con 0x7fee4c0c7ea0 2023-12-19T18:58:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.412+0000 7fee53780640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee4c0bf250 con 0x7fee4c151e90 2023-12-19T18:58:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.412+0000 7fee5151c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee4c0c4e60 0x7fee4c0be940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.412+0000 7fee5151c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee4c0c4e60 0x7fee4c0be940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34272/0 (socket says 172.21.15.133:34272) 2023-12-19T18:58:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.412+0000 7fee5151c640 1 -- 172.21.15.133:0/1853970519 learned_addr learned my addr 172.21.15.133:0/1853970519 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.412+0000 7fee50d1b640 1 --2- 172.21.15.133:0/1853970519 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee4c0c7ea0 0x7fee4c0bff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.412+0000 7fee51d1d640 1 --2- 172.21.15.133:0/1853970519 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee4c151e90 0x7fee4c149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.412+0000 7fee5151c640 1 -- 172.21.15.133:0/1853970519 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee4c151e90 msgr2=0x7fee4c149f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:36.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.412+0000 7fee5151c640 1 --2- 172.21.15.133:0/1853970519 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee4c151e90 0x7fee4c149f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.412+0000 7fee5151c640 1 -- 172.21.15.133:0/1853970519 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee4c0c7ea0 msgr2=0x7fee4c0bff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:36.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.412+0000 7fee5151c640 1 --2- 172.21.15.133:0/1853970519 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee4c0c7ea0 0x7fee4c0bff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.412+0000 7fee5151c640 1 -- 172.21.15.133:0/1853970519 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3c0094d0 con 0x7fee4c0c4e60 2023-12-19T18:58:36.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.412+0000 7fee50d1b640 1 --2- 172.21.15.133:0/1853970519 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee4c0c7ea0 0x7fee4c0bff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:36.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.412+0000 7fee5151c640 1 --2- 172.21.15.133:0/1853970519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee4c0c4e60 0x7fee4c0be940 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fee4800d800 tx=0x7fee4800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:36.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.412+0000 7fee41ffb640 1 -- 172.21.15.133:0/1853970519 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4800b6c0 con 0x7fee4c0c4e60 2023-12-19T18:58:36.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.412+0000 7fee41ffb640 1 -- 172.21.15.133:0/1853970519 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee4800b820 con 0x7fee4c0c4e60 2023-12-19T18:58:36.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.412+0000 7fee41ffb640 1 -- 172.21.15.133:0/1853970519 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4800bb90 con 0x7fee4c0c4e60 2023-12-19T18:58:36.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.412+0000 7fee53780640 1 -- 172.21.15.133:0/1853970519 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee4c1ee460 con 0x7fee4c0c4e60 2023-12-19T18:58:36.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.412+0000 7fee53780640 1 -- 172.21.15.133:0/1853970519 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee4c14f380 con 0x7fee4c0c4e60 2023-12-19T18:58:36.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.412+0000 7fee53780640 1 -- 172.21.15.133:0/1853970519 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee4c068400 con 0x7fee4c0c4e60 2023-12-19T18:58:36.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.412+0000 7fee41ffb640 1 -- 172.21.15.133:0/1853970519 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fee4800bcf0 con 0x7fee4c0c4e60 2023-12-19T18:58:36.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.412+0000 7fee41ffb640 1 --2- 172.21.15.133:0/1853970519 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fee30066470 0x7fee30068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:36.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.416+0000 7fee41ffb640 1 -- 172.21.15.133:0/1853970519 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fee480840d0 con 0x7fee4c0c4e60 2023-12-19T18:58:36.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.416+0000 7fee50d1b640 1 --2- 172.21.15.133:0/1853970519 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fee30066470 0x7fee30068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:36.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.416+0000 7fee50d1b640 1 --2- 172.21.15.133:0/1853970519 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fee30066470 0x7fee30068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fee3c0ad000 tx=0x7fee3c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:36.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.420+0000 7fee41ffb640 1 -- 172.21.15.133:0/1853970519 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fee48051890 con 0x7fee4c0c4e60 2023-12-19T18:58:36.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.568+0000 7fee53780640 1 -- 172.21.15.133:0/1853970519 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee4c06ca50 con 0x7fee4c0c4e60 2023-12-19T18:58:36.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.568+0000 7fee41ffb640 1 -- 172.21.15.133:0/1853970519 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12886 (secure 0 0 0) 0x7fee48011340 con 0x7fee4c0c4e60 2023-12-19T18:58:36.573 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:36.573 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":16,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:33.139528+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:58:36.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.572+0000 7fee53780640 1 -- 172.21.15.133:0/1853970519 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fee30066470 msgr2=0x7fee30068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:36.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.572+0000 7fee53780640 1 --2- 172.21.15.133:0/1853970519 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fee30066470 0x7fee30068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fee3c0ad000 tx=0x7fee3c0a6000 comp rx=0 tx=0).stop 2023-12-19T18:58:36.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.572+0000 7fee53780640 1 -- 172.21.15.133:0/1853970519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee4c0c4e60 msgr2=0x7fee4c0be940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:36.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.572+0000 7fee53780640 1 --2- 172.21.15.133:0/1853970519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee4c0c4e60 0x7fee4c0be940 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fee4800d800 tx=0x7fee4800dcc0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.572+0000 7fee53780640 1 -- 172.21.15.133:0/1853970519 shutdown_connections 2023-12-19T18:58:36.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.572+0000 7fee53780640 1 --2- 172.21.15.133:0/1853970519 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fee30066470 0x7fee30068930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.572+0000 7fee53780640 1 --2- 172.21.15.133:0/1853970519 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fee4c151e90 0x7fee4c149f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.572+0000 7fee53780640 1 --2- 172.21.15.133:0/1853970519 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fee4c0c7ea0 0x7fee4c0bff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.572+0000 7fee53780640 1 --2- 172.21.15.133:0/1853970519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fee4c0c4e60 0x7fee4c0be940 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.572+0000 7fee53780640 1 -- 172.21.15.133:0/1853970519 >> 172.21.15.133:0/1853970519 conn(0x7fee4c0ca170 msgr2=0x7fee4c14f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:36.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.572+0000 7fee53780640 1 -- 172.21.15.133:0/1853970519 shutdown_connections 2023-12-19T18:58:36.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.572+0000 7fee53780640 1 -- 172.21.15.133:0/1853970519 wait complete. 2023-12-19T18:58:36.594 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:58:36.594 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:58:36.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.732+0000 7f1277cd6640 1 Processor -- start 2023-12-19T18:58:36.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.732+0000 7f1277cd6640 1 -- start start 2023-12-19T18:58:36.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.732+0000 7f1277cd6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f12701560e0 0x7f127015ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:36.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.732+0000 7f1277cd6640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f12700bffc0 0x7f12700c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:36.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.732+0000 7f1277cd6640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f127015c600 con 0x7f127006d520 2023-12-19T18:58:36.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.732+0000 7f1277cd6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f127015a5c0 con 0x7f12701560e0 2023-12-19T18:58:36.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.732+0000 7f1277cd6640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12701594e0 con 0x7f12700bffc0 2023-12-19T18:58:36.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.732+0000 7f1275a72640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f12701560e0 0x7f127015ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:36.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.732+0000 7f1275a72640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f12701560e0 0x7f127015ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34276/0 (socket says 172.21.15.133:34276) 2023-12-19T18:58:36.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.732+0000 7f1275a72640 1 -- 172.21.15.133:0/2153718454 learned_addr learned my addr 172.21.15.133:0/2153718454 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:36.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.732+0000 7f1276273640 1 --2- 172.21.15.133:0/2153718454 >> v2:172.21.15.138:3300/0 conn(0x7f12700bffc0 0x7f12700c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:36.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.732+0000 7f1275a72640 1 -- 172.21.15.133:0/2153718454 >> v2:172.21.15.138:3300/0 conn(0x7f12700bffc0 msgr2=0x7f12700c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:36.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.732+0000 7f1275a72640 1 --2- 172.21.15.133:0/2153718454 >> v2:172.21.15.138:3300/0 conn(0x7f12700bffc0 0x7f12700c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.732+0000 7f1275a72640 1 -- 172.21.15.133:0/2153718454 >> v1:172.21.15.138:6789/0 conn(0x7f127006d520 legacy=0x7f1270159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:36.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.732+0000 7f1275a72640 1 -- 172.21.15.133:0/2153718454 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12701597c0 con 0x7f12701560e0 2023-12-19T18:58:36.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.736+0000 7f1275a72640 1 --2- 172.21.15.133:0/2153718454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12701560e0 0x7f127015ca90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f127006e130 tx=0x7f126c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e49c7e442a002b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:36.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.736+0000 7f1274a70640 1 -- 172.21.15.133:0/2153718454 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c0ac640 con 0x7f12701560e0 2023-12-19T18:58:36.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.736+0000 7f1274a70640 1 -- 172.21.15.133:0/2153718454 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126c0ac7a0 con 0x7f12701560e0 2023-12-19T18:58:36.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.736+0000 7f1274a70640 1 -- 172.21.15.133:0/2153718454 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c0acb30 con 0x7f12701560e0 2023-12-19T18:58:36.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.736+0000 7f1277cd6640 1 -- 172.21.15.133:0/2153718454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12701560e0 msgr2=0x7f127015ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:36.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.736+0000 7f1277cd6640 1 --2- 172.21.15.133:0/2153718454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12701560e0 0x7f127015ca90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f127006e130 tx=0x7f126c01c4d0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.736+0000 7f1277cd6640 1 -- 172.21.15.133:0/2153718454 shutdown_connections 2023-12-19T18:58:36.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.736+0000 7f1277cd6640 1 --2- 172.21.15.133:0/2153718454 >> v2:172.21.15.138:3300/0 conn(0x7f12700bffc0 0x7f12700c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.736+0000 7f1277cd6640 1 --2- 172.21.15.133:0/2153718454 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12701560e0 0x7f127015ca90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.736+0000 7f1277cd6640 1 -- 172.21.15.133:0/2153718454 >> 172.21.15.133:0/2153718454 conn(0x7f127006a5b0 msgr2=0x7f127006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:36.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.736+0000 7f1277cd6640 1 -- 172.21.15.133:0/2153718454 shutdown_connections 2023-12-19T18:58:36.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.736+0000 7f1277cd6640 1 -- 172.21.15.133:0/2153718454 wait complete. 2023-12-19T18:58:36.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1277cd6640 1 Processor -- start 2023-12-19T18:58:36.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1277cd6640 1 -- start start 2023-12-19T18:58:36.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1277cd6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f127006d520 0x7f12701f2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:36.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1277cd6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12700bffc0 0x7f12700a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:36.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1277cd6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12701560e0 0x7f1270155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:36.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1277cd6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12700c4960 con 0x7f12701560e0 2023-12-19T18:58:36.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1277cd6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12700a8d80 con 0x7f127006d520 2023-12-19T18:58:36.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1277cd6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12701f1c90 con 0x7f12700bffc0 2023-12-19T18:58:36.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1276273640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12701560e0 0x7f1270155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:36.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1275a72640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f127006d520 0x7f12701f2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:36.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1276273640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12701560e0 0x7f1270155020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34288/0 (socket says 172.21.15.133:34288) 2023-12-19T18:58:36.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1276273640 1 -- 172.21.15.133:0/3808743374 learned_addr learned my addr 172.21.15.133:0/3808743374 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:36.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1275a72640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f127006d520 0x7f12701f2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:56502/0 (socket says 172.21.15.133:56502) 2023-12-19T18:58:36.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1275271640 1 --2- 172.21.15.133:0/3808743374 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12700bffc0 0x7f12700a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:36.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1276273640 1 -- 172.21.15.133:0/3808743374 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12700bffc0 msgr2=0x7f12700a5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:36.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1276273640 1 --2- 172.21.15.133:0/3808743374 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12700bffc0 0x7f12700a5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1276273640 1 -- 172.21.15.133:0/3808743374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f127006d520 msgr2=0x7f12701f2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:36.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1276273640 1 --2- 172.21.15.133:0/3808743374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f127006d520 0x7f12701f2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1276273640 1 -- 172.21.15.133:0/3808743374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126c0094d0 con 0x7f12701560e0 2023-12-19T18:58:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1275a72640 1 --2- 172.21.15.133:0/3808743374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f127006d520 0x7f12701f2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:58:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1276273640 1 --2- 172.21.15.133:0/3808743374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12701560e0 0x7f1270155020 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1268009dd0 tx=0x7f126800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f12667fc640 1 -- 172.21.15.133:0/3808743374 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268014480 con 0x7f12701560e0 2023-12-19T18:58:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f12667fc640 1 -- 172.21.15.133:0/3808743374 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126800f040 con 0x7f12701560e0 2023-12-19T18:58:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1277cd6640 1 -- 172.21.15.133:0/3808743374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12701f1640 con 0x7f12701560e0 2023-12-19T18:58:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f12667fc640 1 -- 172.21.15.133:0/3808743374 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268014840 con 0x7f12701560e0 2023-12-19T18:58:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1277cd6640 1 -- 172.21.15.133:0/3808743374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12700a7220 con 0x7f12701560e0 2023-12-19T18:58:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.740+0000 7f1277cd6640 1 -- 172.21.15.133:0/3808743374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12701f1e20 con 0x7f12701560e0 2023-12-19T18:58:36.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.744+0000 7f12667fc640 1 -- 172.21.15.133:0/3808743374 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f12680149a0 con 0x7f12701560e0 2023-12-19T18:58:36.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.744+0000 7f12667fc640 1 --2- 172.21.15.133:0/3808743374 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f12540664a0 0x7f1254068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:36.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.744+0000 7f12667fc640 1 -- 172.21.15.133:0/3808743374 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1268084530 con 0x7f12701560e0 2023-12-19T18:58:36.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.744+0000 7f1275a72640 1 --2- 172.21.15.133:0/3808743374 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f12540664a0 0x7f1254068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:36.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.744+0000 7f1275a72640 1 --2- 172.21.15.133:0/3808743374 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f12540664a0 0x7f1254068960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f126c0ae000 tx=0x7f126c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:36.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.748+0000 7f12667fc640 1 -- 172.21.15.133:0/3808743374 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1268051da0 con 0x7f12701560e0 2023-12-19T18:58:36.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.900+0000 7f1277cd6640 1 -- 172.21.15.133:0/3808743374 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1270068400 con 0x7f12701560e0 2023-12-19T18:58:36.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.900+0000 7f12667fc640 1 -- 172.21.15.133:0/3808743374 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1268018020 con 0x7f12701560e0 2023-12-19T18:58:36.905 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T18:58:36.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.900+0000 7f1277cd6640 1 -- 172.21.15.133:0/3808743374 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f12540664a0 msgr2=0x7f1254068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:36.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.900+0000 7f1277cd6640 1 --2- 172.21.15.133:0/3808743374 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f12540664a0 0x7f1254068960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f126c0ae000 tx=0x7f126c0a7000 comp rx=0 tx=0).stop 2023-12-19T18:58:36.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.900+0000 7f1277cd6640 1 -- 172.21.15.133:0/3808743374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12701560e0 msgr2=0x7f1270155020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:36.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.900+0000 7f1277cd6640 1 --2- 172.21.15.133:0/3808743374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12701560e0 0x7f1270155020 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1268009dd0 tx=0x7f126800c490 comp rx=0 tx=0).stop 2023-12-19T18:58:36.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.900+0000 7f1277cd6640 1 -- 172.21.15.133:0/3808743374 shutdown_connections 2023-12-19T18:58:36.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.900+0000 7f1277cd6640 1 --2- 172.21.15.133:0/3808743374 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f12540664a0 0x7f1254068960 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.900+0000 7f1277cd6640 1 --2- 172.21.15.133:0/3808743374 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12701560e0 0x7f1270155020 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.900+0000 7f1277cd6640 1 --2- 172.21.15.133:0/3808743374 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12700bffc0 0x7f12700a5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.900+0000 7f1277cd6640 1 --2- 172.21.15.133:0/3808743374 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f127006d520 0x7f12701f2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:36.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.900+0000 7f1277cd6640 1 -- 172.21.15.133:0/3808743374 >> 172.21.15.133:0/3808743374 conn(0x7f127006a5b0 msgr2=0x7f12700c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:36.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.900+0000 7f1277cd6640 1 -- 172.21.15.133:0/3808743374 shutdown_connections 2023-12-19T18:58:36.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:36.900+0000 7f1277cd6640 1 -- 172.21.15.133:0/3808743374 wait complete. 2023-12-19T18:58:36.924 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:58:37.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.060+0000 7f067209a640 1 Processor -- start 2023-12-19T18:58:37.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.060+0000 7f067209a640 1 -- start start 2023-12-19T18:58:37.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.060+0000 7f067209a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f066c073a70 0x7f066c0bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:37.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.060+0000 7f067209a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f066c157c20 0x7f066c1580b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:37.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.060+0000 7f067209a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f066c06a5b0 con 0x7f066c14b010 2023-12-19T18:58:37.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.060+0000 7f067209a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f066c06b710 con 0x7f066c073a70 2023-12-19T18:58:37.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.060+0000 7f067209a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066c0c1d60 con 0x7f066c157c20 2023-12-19T18:58:37.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.060+0000 7f066b7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f066c14b010 0x7f066c06b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49954/0 (socket says 172.21.15.133:49954) 2023-12-19T18:58:37.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.060+0000 7f066b7fe640 1 -- 172.21.15.133:0/250506857 learned_addr learned my addr 172.21.15.133:0/250506857 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:37.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.060+0000 7f0663fff640 1 --2- 172.21.15.133:0/250506857 >> v2:172.21.15.138:3300/0 conn(0x7f066c073a70 0x7f066c0bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:37.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.060+0000 7f066bfff640 1 --2- 172.21.15.133:0/250506857 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f066c157c20 0x7f066c1580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:37.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.060+0000 7f066affd640 1 -- 172.21.15.133:0/250506857 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302435646 0 0) 0x7f066c06a5b0 con 0x7f066c14b010 2023-12-19T18:58:37.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.060+0000 7f066affd640 1 -- 172.21.15.133:0/250506857 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0658003530 con 0x7f066c14b010 2023-12-19T18:58:37.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.060+0000 7f0663fff640 1 -- 172.21.15.133:0/250506857 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f066c157c20 msgr2=0x7f066c1580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:37.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.060+0000 7f0663fff640 1 --2- 172.21.15.133:0/250506857 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f066c157c20 0x7f066c1580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:37.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.060+0000 7f0663fff640 1 -- 172.21.15.133:0/250506857 >> v1:172.21.15.133:6789/0 conn(0x7f066c14b010 legacy=0x7f066c06b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:37.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.060+0000 7f0663fff640 1 -- 172.21.15.133:0/250506857 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066c0c2040 con 0x7f066c073a70 2023-12-19T18:58:37.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.064+0000 7f0663fff640 1 --2- 172.21.15.133:0/250506857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f066c073a70 0x7f066c0bf9f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f06540097c0 tx=0x7f065401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19d25f061d702785 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:37.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.064+0000 7f066affd640 1 -- 172.21.15.133:0/250506857 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06540a8970 con 0x7f066c073a70 2023-12-19T18:58:37.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.064+0000 7f066affd640 1 -- 172.21.15.133:0/250506857 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06540a8ad0 con 0x7f066c073a70 2023-12-19T18:58:37.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.064+0000 7f066affd640 1 -- 172.21.15.133:0/250506857 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06540a8e40 con 0x7f066c073a70 2023-12-19T18:58:37.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.064+0000 7f067209a640 1 -- 172.21.15.133:0/250506857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f066c073a70 msgr2=0x7f066c0bf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:37.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.064+0000 7f067209a640 1 --2- 172.21.15.133:0/250506857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f066c073a70 0x7f066c0bf9f0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f06540097c0 tx=0x7f065401ec70 comp rx=0 tx=0).stop 2023-12-19T18:58:37.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.064+0000 7f067209a640 1 -- 172.21.15.133:0/250506857 shutdown_connections 2023-12-19T18:58:37.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.064+0000 7f067209a640 1 --2- 172.21.15.133:0/250506857 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f066c157c20 0x7f066c1580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:37.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.064+0000 7f067209a640 1 --2- 172.21.15.133:0/250506857 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f066c073a70 0x7f066c0bf9f0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:37.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.064+0000 7f067209a640 1 -- 172.21.15.133:0/250506857 >> 172.21.15.133:0/250506857 conn(0x7f066c0c30c0 msgr2=0x7f066c0c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:37.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.064+0000 7f067209a640 1 -- 172.21.15.133:0/250506857 shutdown_connections 2023-12-19T18:58:37.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.064+0000 7f067209a640 1 -- 172.21.15.133:0/250506857 wait complete. 2023-12-19T18:58:37.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.068+0000 7f067209a640 1 Processor -- start 2023-12-19T18:58:37.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.068+0000 7f067209a640 1 -- start start 2023-12-19T18:58:37.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.068+0000 7f067209a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f066c073a70 0x7f066c1eda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:37.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.068+0000 7f067209a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f066c14b010 0x7f066c1450f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:37.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.068+0000 7f067209a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f066c157c20 0x7f066c0ab960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:37.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.068+0000 7f067209a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066c154740 con 0x7f066c14b010 2023-12-19T18:58:37.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.068+0000 7f067209a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066c1e9b00 con 0x7f066c157c20 2023-12-19T18:58:37.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.068+0000 7f067209a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066c1527c0 con 0x7f066c073a70 2023-12-19T18:58:37.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.068+0000 7f0663fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f066c14b010 0x7f066c1450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:37.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.068+0000 7f0663fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f066c14b010 0x7f066c1450f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34300/0 (socket says 172.21.15.133:34300) 2023-12-19T18:58:37.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.068+0000 7f0663fff640 1 -- 172.21.15.133:0/1326121636 learned_addr learned my addr 172.21.15.133:0/1326121636 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:37.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.068+0000 7f0663fff640 1 -- 172.21.15.133:0/1326121636 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f066c073a70 msgr2=0x7f066c1eda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:37.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.068+0000 7f066b7fe640 1 --2- 172.21.15.133:0/1326121636 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f066c073a70 0x7f066c1eda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:37.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.068+0000 7f0663fff640 1 --2- 172.21.15.133:0/1326121636 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f066c073a70 0x7f066c1eda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:37.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.068+0000 7f066bfff640 1 --2- 172.21.15.133:0/1326121636 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f066c157c20 0x7f066c0ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:37.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.068+0000 7f0663fff640 1 -- 172.21.15.133:0/1326121636 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f066c157c20 msgr2=0x7f066c0ab960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:37.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.068+0000 7f0663fff640 1 --2- 172.21.15.133:0/1326121636 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f066c157c20 0x7f066c0ab960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:37.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.068+0000 7f0663fff640 1 -- 172.21.15.133:0/1326121636 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0654009420 con 0x7f066c14b010 2023-12-19T18:58:37.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.068+0000 7f066b7fe640 1 --2- 172.21.15.133:0/1326121636 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f066c073a70 0x7f066c1eda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:37.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.068+0000 7f066bfff640 1 --2- 172.21.15.133:0/1326121636 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f066c157c20 0x7f066c0ab960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:37.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.068+0000 7f0663fff640 1 --2- 172.21.15.133:0/1326121636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f066c14b010 0x7f066c1450f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f065401d320 tx=0x7f065401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:37.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.068+0000 7f0668ff9640 1 -- 172.21.15.133:0/1326121636 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06540b1d50 con 0x7f066c14b010 2023-12-19T18:58:37.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.072+0000 7f0668ff9640 1 -- 172.21.15.133:0/1326121636 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06540b9410 con 0x7f066c14b010 2023-12-19T18:58:37.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.072+0000 7f067209a640 1 -- 172.21.15.133:0/1326121636 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066c0c5550 con 0x7f066c14b010 2023-12-19T18:58:37.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.072+0000 7f0668ff9640 1 -- 172.21.15.133:0/1326121636 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06540b9780 con 0x7f066c14b010 2023-12-19T18:58:37.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.072+0000 7f067209a640 1 -- 172.21.15.133:0/1326121636 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066c0c5b10 con 0x7f066c14b010 2023-12-19T18:58:37.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.072+0000 7f067209a640 1 -- 172.21.15.133:0/1326121636 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f066c1e9ce0 con 0x7f066c14b010 2023-12-19T18:58:37.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.072+0000 7f0668ff9640 1 -- 172.21.15.133:0/1326121636 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f06540b7040 con 0x7f066c14b010 2023-12-19T18:58:37.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.072+0000 7f0668ff9640 1 --2- 172.21.15.133:0/1326121636 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f064c0664a0 0x7f064c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:37.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.072+0000 7f0668ff9640 1 -- 172.21.15.133:0/1326121636 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f06541216b0 con 0x7f066c14b010 2023-12-19T18:58:37.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.072+0000 7f066b7fe640 1 --2- 172.21.15.133:0/1326121636 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f064c0664a0 0x7f064c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:37.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.072+0000 7f066b7fe640 1 --2- 172.21.15.133:0/1326121636 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f064c0664a0 0x7f064c068960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f065c005890 tx=0x7f065c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:37.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.076+0000 7f0668ff9640 1 -- 172.21.15.133:0/1326121636 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f066c1e9ce0 con 0x7f066c14b010 2023-12-19T18:58:37.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.256+0000 7f067209a640 1 -- 172.21.15.133:0/1326121636 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f066c1e9ce0 con 0x7f066c14b010 2023-12-19T18:58:37.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.256+0000 7f0668ff9640 1 -- 172.21.15.133:0/1326121636 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7f066c1e9ce0 con 0x7f066c14b010 2023-12-19T18:58:37.261 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:37.261 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/1350101028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1350101028},{"type":"v1","addr":"172.21.15.133:6834","nonce":1350101028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-19T18:58:37.261 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 2 2023-12-19T18:58:37.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.256+0000 7f067209a640 1 -- 172.21.15.133:0/1326121636 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f064c0664a0 msgr2=0x7f064c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:37.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.256+0000 7f067209a640 1 --2- 172.21.15.133:0/1326121636 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f064c0664a0 0x7f064c068960 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f065c005890 tx=0x7f065c009040 comp rx=0 tx=0).stop 2023-12-19T18:58:37.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.256+0000 7f067209a640 1 -- 172.21.15.133:0/1326121636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f066c14b010 msgr2=0x7f066c1450f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:37.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.256+0000 7f067209a640 1 --2- 172.21.15.133:0/1326121636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f066c14b010 0x7f066c1450f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f065401d320 tx=0x7f065401ba10 comp rx=0 tx=0).stop 2023-12-19T18:58:37.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.260+0000 7f067209a640 1 -- 172.21.15.133:0/1326121636 shutdown_connections 2023-12-19T18:58:37.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.260+0000 7f067209a640 1 --2- 172.21.15.133:0/1326121636 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f064c0664a0 0x7f064c068960 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:37.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.260+0000 7f067209a640 1 --2- 172.21.15.133:0/1326121636 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f066c157c20 0x7f066c0ab960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:37.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.260+0000 7f067209a640 1 --2- 172.21.15.133:0/1326121636 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f066c14b010 0x7f066c1450f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:37.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.260+0000 7f067209a640 1 --2- 172.21.15.133:0/1326121636 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f066c073a70 0x7f066c1eda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:37.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.260+0000 7f067209a640 1 -- 172.21.15.133:0/1326121636 >> 172.21.15.133:0/1326121636 conn(0x7f066c0c30c0 msgr2=0x7f066c1580b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:37.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.260+0000 7f067209a640 1 -- 172.21.15.133:0/1326121636 shutdown_connections 2023-12-19T18:58:37.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:37.260+0000 7f067209a640 1 -- 172.21.15.133:0/1326121636 wait complete. 2023-12-19T18:58:39.282 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:58:39.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.428+0000 7fdf03c54640 1 Processor -- start 2023-12-19T18:58:39.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.428+0000 7fdf03c54640 1 -- start start 2023-12-19T18:58:39.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.428+0000 7fdf03c54640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdefc151e90 0x7fdefc0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:39.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.428+0000 7fdf03c54640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdefc06c860 con 0x7fdefc0c4e60 2023-12-19T18:58:39.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.428+0000 7fdf03c54640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdefc154930 con 0x7fdefc0c7ea0 2023-12-19T18:58:39.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.428+0000 7fdf03c54640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc0c8750 con 0x7fdefc151e90 2023-12-19T18:58:39.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.428+0000 7fdf021f1640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdefc0c4e60 0x7fdefc15f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49968/0 (socket says 172.21.15.133:49968) 2023-12-19T18:58:39.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.428+0000 7fdf021f1640 1 -- 172.21.15.133:0/3435538180 learned_addr learned my addr 172.21.15.133:0/3435538180 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:39.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.428+0000 7fdf019f0640 1 --2- 172.21.15.133:0/3435538180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdefc151e90 0x7fdefc0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:39.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.428+0000 7fdf009ee640 1 -- 172.21.15.133:0/3435538180 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 188897780 0 0) 0x7fdefc06c860 con 0x7fdefc0c4e60 2023-12-19T18:58:39.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.428+0000 7fdf009ee640 1 -- 172.21.15.133:0/3435538180 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdee8003530 con 0x7fdefc0c4e60 2023-12-19T18:58:39.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.428+0000 7fdf009ee640 1 -- 172.21.15.133:0/3435538180 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3680633528 0 0) 0x7fdefc154930 con 0x7fdefc0c7ea0 2023-12-19T18:58:39.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.432+0000 7fdf009ee640 1 -- 172.21.15.133:0/3435538180 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdefc06c860 con 0x7fdefc0c7ea0 2023-12-19T18:58:39.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.432+0000 7fdf019f0640 1 -- 172.21.15.133:0/3435538180 >> v1:172.21.15.138:6789/0 conn(0x7fdefc0c7ea0 legacy=0x7fdefc06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:39.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.432+0000 7fdf019f0640 1 -- 172.21.15.133:0/3435538180 >> v1:172.21.15.133:6789/0 conn(0x7fdefc0c4e60 legacy=0x7fdefc15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:39.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.432+0000 7fdf019f0640 1 -- 172.21.15.133:0/3435538180 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdefc154c10 con 0x7fdefc151e90 2023-12-19T18:58:39.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.432+0000 7fdf019f0640 1 --2- 172.21.15.133:0/3435538180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdefc151e90 0x7fdefc0c4920 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdef80097f0 tx=0x7fdef801c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3be62d5a19f3be6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:39.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.432+0000 7fdf009ee640 1 -- 172.21.15.133:0/3435538180 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef80ab600 con 0x7fdefc151e90 2023-12-19T18:58:39.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.432+0000 7fdf009ee640 1 -- 172.21.15.133:0/3435538180 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef80a7050 con 0x7fdefc151e90 2023-12-19T18:58:39.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.432+0000 7fdf009ee640 1 -- 172.21.15.133:0/3435538180 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef80ab960 con 0x7fdefc151e90 2023-12-19T18:58:39.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.432+0000 7fdf03c54640 1 -- 172.21.15.133:0/3435538180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdefc151e90 msgr2=0x7fdefc0c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:39.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.432+0000 7fdf03c54640 1 --2- 172.21.15.133:0/3435538180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdefc151e90 0x7fdefc0c4920 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdef80097f0 tx=0x7fdef801c3a0 comp rx=0 tx=0).stop 2023-12-19T18:58:39.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf03c54640 1 -- 172.21.15.133:0/3435538180 shutdown_connections 2023-12-19T18:58:39.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf03c54640 1 --2- 172.21.15.133:0/3435538180 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdefc151e90 0x7fdefc0c4920 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:39.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf03c54640 1 -- 172.21.15.133:0/3435538180 >> 172.21.15.133:0/3435538180 conn(0x7fdefc0ca170 msgr2=0x7fdefc0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:39.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf03c54640 1 -- 172.21.15.133:0/3435538180 shutdown_connections 2023-12-19T18:58:39.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf03c54640 1 -- 172.21.15.133:0/3435538180 wait complete. 2023-12-19T18:58:39.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf03c54640 1 Processor -- start 2023-12-19T18:58:39.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf03c54640 1 -- start start 2023-12-19T18:58:39.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf03c54640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdefc0c4e60 0x7fdefc14b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:39.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf03c54640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdefc0c7ea0 0x7fdefc141f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:39.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf03c54640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdefc151e90 0x7fdefc157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:39.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf03c54640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc1552d0 con 0x7fdefc0c7ea0 2023-12-19T18:58:39.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf03c54640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc14bb20 con 0x7fdefc151e90 2023-12-19T18:58:39.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf03c54640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc14be00 con 0x7fdefc0c4e60 2023-12-19T18:58:39.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf011ef640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdefc0c7ea0 0x7fdefc141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:39.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf011ef640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdefc0c7ea0 0x7fdefc141f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34312/0 (socket says 172.21.15.133:34312) 2023-12-19T18:58:39.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf011ef640 1 -- 172.21.15.133:0/740826439 learned_addr learned my addr 172.21.15.133:0/740826439 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:39.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf019f0640 1 --2- 172.21.15.133:0/740826439 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdefc0c4e60 0x7fdefc14b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:39.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf021f1640 1 --2- 172.21.15.133:0/740826439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdefc151e90 0x7fdefc157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:39.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf011ef640 1 -- 172.21.15.133:0/740826439 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdefc0c4e60 msgr2=0x7fdefc14b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:39.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf011ef640 1 --2- 172.21.15.133:0/740826439 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdefc0c4e60 0x7fdefc14b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:39.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf011ef640 1 -- 172.21.15.133:0/740826439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdefc151e90 msgr2=0x7fdefc157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:39.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf011ef640 1 --2- 172.21.15.133:0/740826439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdefc151e90 0x7fdefc157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:39.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf011ef640 1 -- 172.21.15.133:0/740826439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef8009420 con 0x7fdefc0c7ea0 2023-12-19T18:58:39.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf021f1640 1 --2- 172.21.15.133:0/740826439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdefc151e90 0x7fdefc157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:39.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdf011ef640 1 --2- 172.21.15.133:0/740826439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdefc0c7ea0 0x7fdefc141f10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdeec00c3c0 tx=0x7fdeec00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:39.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdef27fc640 1 -- 172.21.15.133:0/740826439 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec0052d0 con 0x7fdefc0c7ea0 2023-12-19T18:58:39.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdef27fc640 1 -- 172.21.15.133:0/740826439 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeec005430 con 0x7fdefc0c7ea0 2023-12-19T18:58:39.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.436+0000 7fdef27fc640 1 -- 172.21.15.133:0/740826439 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeec003840 con 0x7fdefc0c7ea0 2023-12-19T18:58:39.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.440+0000 7fdf03c54640 1 -- 172.21.15.133:0/740826439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdefc0aacb0 con 0x7fdefc0c7ea0 2023-12-19T18:58:39.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.440+0000 7fdf03c54640 1 -- 172.21.15.133:0/740826439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdefc0ab270 con 0x7fdefc0c7ea0 2023-12-19T18:58:39.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.440+0000 7fdf03c54640 1 -- 172.21.15.133:0/740826439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdefc068400 con 0x7fdefc0c7ea0 2023-12-19T18:58:39.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.440+0000 7fdef27fc640 1 -- 172.21.15.133:0/740826439 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fdeec0039a0 con 0x7fdefc0c7ea0 2023-12-19T18:58:39.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.440+0000 7fdef27fc640 1 --2- 172.21.15.133:0/740826439 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdee00664a0 0x7fdee0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:39.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.440+0000 7fdef27fc640 1 -- 172.21.15.133:0/740826439 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdeec082fb0 con 0x7fdefc0c7ea0 2023-12-19T18:58:39.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.440+0000 7fdf019f0640 1 --2- 172.21.15.133:0/740826439 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdee00664a0 0x7fdee0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:39.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.444+0000 7fdf019f0640 1 --2- 172.21.15.133:0/740826439 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdee00664a0 0x7fdee0068960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdef80ad000 tx=0x7fdef80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:39.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.444+0000 7fdef27fc640 1 -- 172.21.15.133:0/740826439 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fdeec050820 con 0x7fdefc0c7ea0 2023-12-19T18:58:39.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.624+0000 7fdf03c54640 1 -- 172.21.15.133:0/740826439 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdefc0c0de0 con 0x7fdefc0c7ea0 2023-12-19T18:58:39.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.628+0000 7fdef27fc640 1 -- 172.21.15.133:0/740826439 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3703 (secure 0 0 0) 0x7fdeec017090 con 0x7fdefc0c7ea0 2023-12-19T18:58:39.631 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:39.631 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6836/2938414361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":2938414361},{"type":"v1","addr":"172.21.15.138:6836","nonce":2938414361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/4017805684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6835","nonce":4017805684},{"type":"v1","addr":"172.21.15.138:6837","nonce":4017805684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/1350101028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1350101028},{"type":"v1","addr":"172.21.15.133:6834","nonce":1350101028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4281,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/615053717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":615053717},{"type":"v1","addr":"172.21.15.133:6835","nonce":615053717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-19T18:58:39.631 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 3 2023-12-19T18:58:39.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.628+0000 7fdf03c54640 1 -- 172.21.15.133:0/740826439 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdee00664a0 msgr2=0x7fdee0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:39.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.628+0000 7fdf03c54640 1 --2- 172.21.15.133:0/740826439 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdee00664a0 0x7fdee0068960 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdef80ad000 tx=0x7fdef80a6000 comp rx=0 tx=0).stop 2023-12-19T18:58:39.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.628+0000 7fdf03c54640 1 -- 172.21.15.133:0/740826439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdefc0c7ea0 msgr2=0x7fdefc141f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:39.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.628+0000 7fdf03c54640 1 --2- 172.21.15.133:0/740826439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdefc0c7ea0 0x7fdefc141f10 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdeec00c3c0 tx=0x7fdeec00c880 comp rx=0 tx=0).stop 2023-12-19T18:58:39.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.628+0000 7fdf03c54640 1 -- 172.21.15.133:0/740826439 shutdown_connections 2023-12-19T18:58:39.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.628+0000 7fdf03c54640 1 --2- 172.21.15.133:0/740826439 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdee00664a0 0x7fdee0068960 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:39.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.628+0000 7fdf03c54640 1 --2- 172.21.15.133:0/740826439 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdefc151e90 0x7fdefc157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:39.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.628+0000 7fdf03c54640 1 --2- 172.21.15.133:0/740826439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdefc0c7ea0 0x7fdefc141f10 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:39.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.628+0000 7fdf03c54640 1 --2- 172.21.15.133:0/740826439 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdefc0c4e60 0x7fdefc14b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:39.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.628+0000 7fdf03c54640 1 -- 172.21.15.133:0/740826439 >> 172.21.15.133:0/740826439 conn(0x7fdefc0ca170 msgr2=0x7fdefc148290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:39.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.628+0000 7fdf03c54640 1 -- 172.21.15.133:0/740826439 shutdown_connections 2023-12-19T18:58:39.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.628+0000 7fdf03c54640 1 -- 172.21.15.133:0/740826439 wait complete. 2023-12-19T18:58:39.651 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:58:39.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.784+0000 7f6143580640 1 Processor -- start 2023-12-19T18:58:39.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.784+0000 7f6143580640 1 -- start start 2023-12-19T18:58:39.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.784+0000 7f6143580640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f613c06d520 0x7f613c15ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:39.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.784+0000 7f6143580640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f613c0bffc0 0x7f613c0c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:39.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.784+0000 7f6143580640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f613c15c600 con 0x7f613c1560e0 2023-12-19T18:58:39.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.784+0000 7f6143580640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f613c15a5c0 con 0x7f613c06d520 2023-12-19T18:58:39.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.784+0000 7f6143580640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f613c1594e0 con 0x7f613c0bffc0 2023-12-19T18:58:39.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.784+0000 7f6140b1b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f613c06d520 0x7f613c15ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:39.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.784+0000 7f614131c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f613c1560e0 0x7f613c159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49980/0 (socket says 172.21.15.133:49980) 2023-12-19T18:58:39.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.784+0000 7f614131c640 1 -- 172.21.15.133:0/847641650 learned_addr learned my addr 172.21.15.133:0/847641650 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:39.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.784+0000 7f6141b1d640 1 --2- 172.21.15.133:0/847641650 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f613c0bffc0 0x7f613c0c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:39.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.784+0000 7f6140b1b640 1 -- 172.21.15.133:0/847641650 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f613c0bffc0 msgr2=0x7f613c0c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:39.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.784+0000 7f6140b1b640 1 --2- 172.21.15.133:0/847641650 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f613c0bffc0 0x7f613c0c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:39.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.784+0000 7f6140b1b640 1 -- 172.21.15.133:0/847641650 >> v1:172.21.15.133:6789/0 conn(0x7f613c1560e0 legacy=0x7f613c159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:39.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.784+0000 7f6140b1b640 1 -- 172.21.15.133:0/847641650 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f613c1597c0 con 0x7f613c06d520 2023-12-19T18:58:39.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.784+0000 7f6133fff640 1 -- 172.21.15.133:0/847641650 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022581316 0 0) 0x7f613c15c600 con 0x7f613c1560e0 2023-12-19T18:58:39.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.788+0000 7f6140b1b640 1 --2- 172.21.15.133:0/847641650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f613c06d520 0x7f613c15ca90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f612c0097c0 tx=0x7f612c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44469e35df606898 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:39.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.788+0000 7f6133fff640 1 -- 172.21.15.133:0/847641650 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c0ad660 con 0x7f613c06d520 2023-12-19T18:58:39.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.788+0000 7f6133fff640 1 -- 172.21.15.133:0/847641650 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612c0ad7c0 con 0x7f613c06d520 2023-12-19T18:58:39.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.788+0000 7f6133fff640 1 -- 172.21.15.133:0/847641650 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c0adb50 con 0x7f613c06d520 2023-12-19T18:58:39.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.788+0000 7f6143580640 1 -- 172.21.15.133:0/847641650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f613c06d520 msgr2=0x7f613c15ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.788+0000 7f6143580640 1 --2- 172.21.15.133:0/847641650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f613c06d520 0x7f613c15ca90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f612c0097c0 tx=0x7f612c01c450 comp rx=0 tx=0).stop 2023-12-19T18:58:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.788+0000 7f6143580640 1 -- 172.21.15.133:0/847641650 shutdown_connections 2023-12-19T18:58:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.788+0000 7f6143580640 1 --2- 172.21.15.133:0/847641650 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f613c0bffc0 0x7f613c0c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.788+0000 7f6143580640 1 --2- 172.21.15.133:0/847641650 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f613c06d520 0x7f613c15ca90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.788+0000 7f6143580640 1 -- 172.21.15.133:0/847641650 >> 172.21.15.133:0/847641650 conn(0x7f613c06a5b0 msgr2=0x7f613c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.788+0000 7f6143580640 1 -- 172.21.15.133:0/847641650 shutdown_connections 2023-12-19T18:58:39.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.788+0000 7f6143580640 1 -- 172.21.15.133:0/847641650 wait complete. 2023-12-19T18:58:39.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f6143580640 1 Processor -- start 2023-12-19T18:58:39.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f6143580640 1 -- start start 2023-12-19T18:58:39.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f6143580640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f613c06d520 0x7f613c158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:39.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f6143580640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f613c0bffc0 0x7f613c152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:39.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f6143580640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f613c1560e0 0x7f613c154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:39.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f6143580640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c0a4860 con 0x7f613c1560e0 2023-12-19T18:58:39.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f6143580640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c152980 con 0x7f613c06d520 2023-12-19T18:58:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f6143580640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f613c0a3be0 con 0x7f613c0bffc0 2023-12-19T18:58:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f6141b1d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f613c1560e0 0x7f613c154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f6141b1d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f613c1560e0 0x7f613c154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34326/0 (socket says 172.21.15.133:34326) 2023-12-19T18:58:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f6141b1d640 1 -- 172.21.15.133:0/1166016934 learned_addr learned my addr 172.21.15.133:0/1166016934 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f614131c640 1 --2- 172.21.15.133:0/1166016934 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f613c06d520 0x7f613c158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f6140b1b640 1 --2- 172.21.15.133:0/1166016934 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f613c0bffc0 0x7f613c152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f6141b1d640 1 -- 172.21.15.133:0/1166016934 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f613c0bffc0 msgr2=0x7f613c152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f6141b1d640 1 --2- 172.21.15.133:0/1166016934 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f613c0bffc0 0x7f613c152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f6141b1d640 1 -- 172.21.15.133:0/1166016934 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f613c06d520 msgr2=0x7f613c158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f6141b1d640 1 --2- 172.21.15.133:0/1166016934 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f613c06d520 0x7f613c158420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f6141b1d640 1 -- 172.21.15.133:0/1166016934 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c009420 con 0x7f613c1560e0 2023-12-19T18:58:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f6141b1d640 1 --2- 172.21.15.133:0/1166016934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f613c1560e0 0x7f613c154f90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6134007e40 tx=0x7f613400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f6131ffb640 1 -- 172.21.15.133:0/1166016934 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6134014620 con 0x7f613c1560e0 2023-12-19T18:58:39.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f6131ffb640 1 -- 172.21.15.133:0/1166016934 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613400ee90 con 0x7f613c1560e0 2023-12-19T18:58:39.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f6143580640 1 -- 172.21.15.133:0/1166016934 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613c0a3ec0 con 0x7f613c1560e0 2023-12-19T18:58:39.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f6131ffb640 1 -- 172.21.15.133:0/1166016934 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61340149e0 con 0x7f613c1560e0 2023-12-19T18:58:39.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.792+0000 7f6143580640 1 -- 172.21.15.133:0/1166016934 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613c0a4480 con 0x7f613c1560e0 2023-12-19T18:58:39.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.796+0000 7f6143580640 1 -- 172.21.15.133:0/1166016934 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f613c068400 con 0x7f613c1560e0 2023-12-19T18:58:39.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.796+0000 7f6131ffb640 1 -- 172.21.15.133:0/1166016934 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6134014b40 con 0x7f613c1560e0 2023-12-19T18:58:39.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.796+0000 7f6131ffb640 1 --2- 172.21.15.133:0/1166016934 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6120066470 0x7f6120068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:39.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.796+0000 7f6131ffb640 1 -- 172.21.15.133:0/1166016934 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6134084410 con 0x7f613c1560e0 2023-12-19T18:58:39.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.796+0000 7f614131c640 1 --2- 172.21.15.133:0/1166016934 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6120066470 0x7f6120068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:39.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.796+0000 7f614131c640 1 --2- 172.21.15.133:0/1166016934 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6120066470 0x7f6120068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6138000f70 tx=0x7f6138007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:39.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.800+0000 7f6131ffb640 1 -- 172.21.15.133:0/1166016934 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6134051bf0 con 0x7f613c1560e0 2023-12-19T18:58:39.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.948+0000 7f6143580640 1 -- 172.21.15.133:0/1166016934 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f613c159020 con 0x7f613c1560e0 2023-12-19T18:58:39.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.952+0000 7f6131ffb640 1 -- 172.21.15.133:0/1166016934 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12886 (secure 0 0 0) 0x7f6134055210 con 0x7f613c1560e0 2023-12-19T18:58:39.955 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:39.955 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":16,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:33.139528+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:58:39.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.952+0000 7f6143580640 1 -- 172.21.15.133:0/1166016934 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6120066470 msgr2=0x7f6120068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:39.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.952+0000 7f6143580640 1 --2- 172.21.15.133:0/1166016934 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6120066470 0x7f6120068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6138000f70 tx=0x7f6138007df0 comp rx=0 tx=0).stop 2023-12-19T18:58:39.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.952+0000 7f6143580640 1 -- 172.21.15.133:0/1166016934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f613c1560e0 msgr2=0x7f613c154f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:39.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.952+0000 7f6143580640 1 --2- 172.21.15.133:0/1166016934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f613c1560e0 0x7f613c154f90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6134007e40 tx=0x7f613400e4b0 comp rx=0 tx=0).stop 2023-12-19T18:58:39.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.952+0000 7f6143580640 1 -- 172.21.15.133:0/1166016934 shutdown_connections 2023-12-19T18:58:39.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.952+0000 7f6143580640 1 --2- 172.21.15.133:0/1166016934 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6120066470 0x7f6120068930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:39.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.952+0000 7f6143580640 1 --2- 172.21.15.133:0/1166016934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f613c1560e0 0x7f613c154f90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:39.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.952+0000 7f6143580640 1 --2- 172.21.15.133:0/1166016934 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f613c0bffc0 0x7f613c152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:39.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.952+0000 7f6143580640 1 --2- 172.21.15.133:0/1166016934 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f613c06d520 0x7f613c158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:39.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.952+0000 7f6143580640 1 -- 172.21.15.133:0/1166016934 >> 172.21.15.133:0/1166016934 conn(0x7f613c06a5b0 msgr2=0x7f613c0c2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:39.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.952+0000 7f6143580640 1 -- 172.21.15.133:0/1166016934 shutdown_connections 2023-12-19T18:58:39.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:39.952+0000 7f6143580640 1 -- 172.21.15.133:0/1166016934 wait complete. 2023-12-19T18:58:39.976 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:58:39.977 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:58:40.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.112+0000 7f6e91add640 1 Processor -- start 2023-12-19T18:58:40.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.112+0000 7f6e91add640 1 -- start start 2023-12-19T18:58:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.112+0000 7f6e91add640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c152030 0x7f6e8c0c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.112+0000 7f6e91add640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6e8c06c470 0x7f6e8c157c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.112+0000 7f6e91add640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6e8c154ff0 0x7f6e8c0c2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.112+0000 7f6e91add640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c152410 con 0x7f6e8c154ff0 2023-12-19T18:58:40.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.112+0000 7f6e91add640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c154b60 con 0x7f6e8c06c470 2023-12-19T18:58:40.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.112+0000 7f6e91add640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0c1820 con 0x7f6e8c152030 2023-12-19T18:58:40.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.116+0000 7f6e8bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6e8c154ff0 0x7f6e8c0c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:40.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.116+0000 7f6e8bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6e8c154ff0 0x7f6e8c0c2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34332/0 (socket says 172.21.15.133:34332) 2023-12-19T18:58:40.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.116+0000 7f6e8bfff640 1 -- 172.21.15.133:0/1097857551 learned_addr learned my addr 172.21.15.133:0/1097857551 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:40.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.116+0000 7f6e83fff640 1 --2- 172.21.15.133:0/1097857551 >> v2:172.21.15.138:3300/0 conn(0x7f6e8c06c470 0x7f6e8c157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:40.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.116+0000 7f6e8b7fe640 1 --2- 172.21.15.133:0/1097857551 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c152030 0x7f6e8c0c0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:40.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.116+0000 7f6e8bfff640 1 -- 172.21.15.133:0/1097857551 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c152030 msgr2=0x7f6e8c0c0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:40.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.116+0000 7f6e8bfff640 1 --2- 172.21.15.133:0/1097857551 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c152030 0x7f6e8c0c0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.116+0000 7f6e8bfff640 1 -- 172.21.15.133:0/1097857551 >> v2:172.21.15.138:3300/0 conn(0x7f6e8c06c470 msgr2=0x7f6e8c157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:40.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.116+0000 7f6e8bfff640 1 --2- 172.21.15.133:0/1097857551 >> v2:172.21.15.138:3300/0 conn(0x7f6e8c06c470 0x7f6e8c157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.116+0000 7f6e8bfff640 1 -- 172.21.15.133:0/1097857551 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c0c1260 con 0x7f6e8c154ff0 2023-12-19T18:58:40.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.116+0000 7f6e8bfff640 1 --2- 172.21.15.133:0/1097857551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c154ff0 0x7f6e8c0c2270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c067ca0 tx=0x7f6e8401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb106f541bdbdad server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:40.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.116+0000 7f6e8affd640 1 -- 172.21.15.133:0/1097857551 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e840a57c0 con 0x7f6e8c154ff0 2023-12-19T18:58:40.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.116+0000 7f6e8affd640 1 -- 172.21.15.133:0/1097857551 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e840a5920 con 0x7f6e8c154ff0 2023-12-19T18:58:40.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.116+0000 7f6e8affd640 1 -- 172.21.15.133:0/1097857551 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e840a5cb0 con 0x7f6e8c154ff0 2023-12-19T18:58:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.120+0000 7f6e91add640 1 -- 172.21.15.133:0/1097857551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c154ff0 msgr2=0x7f6e8c0c2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.120+0000 7f6e91add640 1 --2- 172.21.15.133:0/1097857551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c154ff0 0x7f6e8c0c2270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c067ca0 tx=0x7f6e8401c940 comp rx=0 tx=0).stop 2023-12-19T18:58:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.120+0000 7f6e91add640 1 -- 172.21.15.133:0/1097857551 shutdown_connections 2023-12-19T18:58:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.120+0000 7f6e91add640 1 --2- 172.21.15.133:0/1097857551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c154ff0 0x7f6e8c0c2270 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.120+0000 7f6e91add640 1 --2- 172.21.15.133:0/1097857551 >> v2:172.21.15.138:3300/0 conn(0x7f6e8c06c470 0x7f6e8c157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.120+0000 7f6e91add640 1 --2- 172.21.15.133:0/1097857551 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c152030 0x7f6e8c0c0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.120+0000 7f6e91add640 1 -- 172.21.15.133:0/1097857551 >> 172.21.15.133:0/1097857551 conn(0x7f6e8c06a5b0 msgr2=0x7f6e8c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:40.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.120+0000 7f6e91add640 1 -- 172.21.15.133:0/1097857551 shutdown_connections 2023-12-19T18:58:40.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.120+0000 7f6e91add640 1 -- 172.21.15.133:0/1097857551 wait complete. 2023-12-19T18:58:40.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.120+0000 7f6e91add640 1 Processor -- start 2023-12-19T18:58:40.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.120+0000 7f6e91add640 1 -- start start 2023-12-19T18:58:40.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.120+0000 7f6e91add640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e8c06c470 0x7f6e8c14ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:40.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.120+0000 7f6e91add640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c152030 0x7f6e8c1f0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:40.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.120+0000 7f6e91add640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c154ff0 0x7f6e8c1f0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:40.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.120+0000 7f6e91add640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c144720 con 0x7f6e8c152030 2023-12-19T18:58:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.120+0000 7f6e91add640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c144160 con 0x7f6e8c06c470 2023-12-19T18:58:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.120+0000 7f6e91add640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c144440 con 0x7f6e8c154ff0 2023-12-19T18:58:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.120+0000 7f6e83fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c152030 0x7f6e8c1f0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.120+0000 7f6e83fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c152030 0x7f6e8c1f0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34342/0 (socket says 172.21.15.133:34342) 2023-12-19T18:58:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.120+0000 7f6e83fff640 1 -- 172.21.15.133:0/3800140933 learned_addr learned my addr 172.21.15.133:0/3800140933 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.120+0000 7f6e8b7fe640 1 --2- 172.21.15.133:0/3800140933 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e8c06c470 0x7f6e8c14ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.120+0000 7f6e8bfff640 1 --2- 172.21.15.133:0/3800140933 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c154ff0 0x7f6e8c1f0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.124+0000 7f6e83fff640 1 -- 172.21.15.133:0/3800140933 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c154ff0 msgr2=0x7f6e8c1f0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.124+0000 7f6e83fff640 1 --2- 172.21.15.133:0/3800140933 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c154ff0 0x7f6e8c1f0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.124+0000 7f6e83fff640 1 -- 172.21.15.133:0/3800140933 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e8c06c470 msgr2=0x7f6e8c14ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.124+0000 7f6e83fff640 1 --2- 172.21.15.133:0/3800140933 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e8c06c470 0x7f6e8c14ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.124+0000 7f6e83fff640 1 -- 172.21.15.133:0/3800140933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e84009b30 con 0x7f6e8c152030 2023-12-19T18:58:40.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.124+0000 7f6e83fff640 1 --2- 172.21.15.133:0/3800140933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c152030 0x7f6e8c1f0610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c00e930 tx=0x7f6e7c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.124+0000 7f6e88ff9640 1 -- 172.21.15.133:0/3800140933 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c009690 con 0x7f6e8c152030 2023-12-19T18:58:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.124+0000 7f6e88ff9640 1 -- 172.21.15.133:0/3800140933 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7c00ca00 con 0x7f6e8c152030 2023-12-19T18:58:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.124+0000 7f6e88ff9640 1 -- 172.21.15.133:0/3800140933 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c00cd70 con 0x7f6e8c152030 2023-12-19T18:58:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.124+0000 7f6e91add640 1 -- 172.21.15.133:0/3800140933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e8c071530 con 0x7f6e8c152030 2023-12-19T18:58:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.124+0000 7f6e91add640 1 -- 172.21.15.133:0/3800140933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e8c14ef80 con 0x7f6e8c152030 2023-12-19T18:58:40.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.124+0000 7f6e91add640 1 -- 172.21.15.133:0/3800140933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8c071390 con 0x7f6e8c152030 2023-12-19T18:58:40.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.124+0000 7f6e88ff9640 1 -- 172.21.15.133:0/3800140933 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6e7c013470 con 0x7f6e8c152030 2023-12-19T18:58:40.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.124+0000 7f6e88ff9640 1 --2- 172.21.15.133:0/3800140933 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6e6c066470 0x7f6e6c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:40.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.124+0000 7f6e88ff9640 1 -- 172.21.15.133:0/3800140933 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6e7c083c40 con 0x7f6e8c152030 2023-12-19T18:58:40.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.124+0000 7f6e8b7fe640 1 --2- 172.21.15.133:0/3800140933 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6e6c066470 0x7f6e6c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:40.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.128+0000 7f6e8b7fe640 1 --2- 172.21.15.133:0/3800140933 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6e6c066470 0x7f6e6c068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c1547c0 tx=0x7f6e74009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:40.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.128+0000 7f6e88ff9640 1 -- 172.21.15.133:0/3800140933 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6e8c071390 con 0x7f6e8c152030 2023-12-19T18:58:40.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.280+0000 7f6e91add640 1 -- 172.21.15.133:0/3800140933 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e8c071390 con 0x7f6e8c152030 2023-12-19T18:58:40.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.280+0000 7f6e88ff9640 1 -- 172.21.15.133:0/3800140933 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e8c071390 con 0x7f6e8c152030 2023-12-19T18:58:40.284 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T18:58:40.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.280+0000 7f6e91add640 1 -- 172.21.15.133:0/3800140933 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6e6c066470 msgr2=0x7f6e6c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:40.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.280+0000 7f6e91add640 1 --2- 172.21.15.133:0/3800140933 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6e6c066470 0x7f6e6c068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c1547c0 tx=0x7f6e74009190 comp rx=0 tx=0).stop 2023-12-19T18:58:40.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.280+0000 7f6e91add640 1 -- 172.21.15.133:0/3800140933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c152030 msgr2=0x7f6e8c1f0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:40.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.280+0000 7f6e91add640 1 --2- 172.21.15.133:0/3800140933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c152030 0x7f6e8c1f0610 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c00e930 tx=0x7f6e7c00edf0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.284+0000 7f6e91add640 1 -- 172.21.15.133:0/3800140933 shutdown_connections 2023-12-19T18:58:40.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.284+0000 7f6e91add640 1 --2- 172.21.15.133:0/3800140933 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6e6c066470 0x7f6e6c068930 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.284+0000 7f6e91add640 1 --2- 172.21.15.133:0/3800140933 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c154ff0 0x7f6e8c1f0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.284+0000 7f6e91add640 1 --2- 172.21.15.133:0/3800140933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c152030 0x7f6e8c1f0610 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.284+0000 7f6e91add640 1 --2- 172.21.15.133:0/3800140933 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e8c06c470 0x7f6e8c14ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.284+0000 7f6e91add640 1 -- 172.21.15.133:0/3800140933 >> 172.21.15.133:0/3800140933 conn(0x7f6e8c06a5b0 msgr2=0x7f6e8c149710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:40.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.284+0000 7f6e91add640 1 -- 172.21.15.133:0/3800140933 shutdown_connections 2023-12-19T18:58:40.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.284+0000 7f6e91add640 1 -- 172.21.15.133:0/3800140933 wait complete. 2023-12-19T18:58:40.306 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T18:58:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.440+0000 7fc27a632640 1 Processor -- start 2023-12-19T18:58:40.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.440+0000 7fc27a632640 1 -- start start 2023-12-19T18:58:40.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.444+0000 7fc27a632640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc274073a70 0x7fc2740bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:40.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.444+0000 7fc27a632640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc274157c20 0x7fc274158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:40.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.444+0000 7fc27a632640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc27406a5b0 con 0x7fc27414b010 2023-12-19T18:58:40.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.444+0000 7fc27a632640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27406b710 con 0x7fc274073a70 2023-12-19T18:58:40.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.444+0000 7fc27a632640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2740c1d60 con 0x7fc274157c20 2023-12-19T18:58:40.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.444+0000 7fc2737fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc274073a70 0x7fc2740bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:40.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.444+0000 7fc2737fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc274073a70 0x7fc2740bf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34344/0 (socket says 172.21.15.133:34344) 2023-12-19T18:58:40.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.444+0000 7fc2737fe640 1 -- 172.21.15.133:0/2543047609 learned_addr learned my addr 172.21.15.133:0/2543047609 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:40.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.444+0000 7fc278bcf640 1 --2- 172.21.15.133:0/2543047609 >> v2:172.21.15.138:3300/0 conn(0x7fc274157c20 0x7fc274158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:40.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.444+0000 7fc2737fe640 1 -- 172.21.15.133:0/2543047609 >> v2:172.21.15.138:3300/0 conn(0x7fc274157c20 msgr2=0x7fc274158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:40.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.444+0000 7fc2737fe640 1 --2- 172.21.15.133:0/2543047609 >> v2:172.21.15.138:3300/0 conn(0x7fc274157c20 0x7fc274158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.444+0000 7fc2737fe640 1 -- 172.21.15.133:0/2543047609 >> v1:172.21.15.138:6789/0 conn(0x7fc27414b010 legacy=0x7fc27406b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:40.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.444+0000 7fc2737fe640 1 -- 172.21.15.133:0/2543047609 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2740c2040 con 0x7fc274073a70 2023-12-19T18:58:40.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.448+0000 7fc2737fe640 1 --2- 172.21.15.133:0/2543047609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc274073a70 0x7fc2740bf9f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc2741521a0 tx=0x7fc26801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21d2fd06bea47a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:40.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.448+0000 7fc272ffd640 1 -- 172.21.15.133:0/2543047609 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2680a89b0 con 0x7fc274073a70 2023-12-19T18:58:40.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.448+0000 7fc272ffd640 1 -- 172.21.15.133:0/2543047609 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2680a8b10 con 0x7fc274073a70 2023-12-19T18:58:40.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.448+0000 7fc272ffd640 1 -- 172.21.15.133:0/2543047609 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2680a8ea0 con 0x7fc274073a70 2023-12-19T18:58:40.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.448+0000 7fc27a632640 1 -- 172.21.15.133:0/2543047609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc274073a70 msgr2=0x7fc2740bf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:40.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.448+0000 7fc27a632640 1 --2- 172.21.15.133:0/2543047609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc274073a70 0x7fc2740bf9f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc2741521a0 tx=0x7fc26801ecb0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.448+0000 7fc27a632640 1 -- 172.21.15.133:0/2543047609 shutdown_connections 2023-12-19T18:58:40.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.448+0000 7fc27a632640 1 --2- 172.21.15.133:0/2543047609 >> v2:172.21.15.138:3300/0 conn(0x7fc274157c20 0x7fc274158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.448+0000 7fc27a632640 1 --2- 172.21.15.133:0/2543047609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc274073a70 0x7fc2740bf9f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.448+0000 7fc27a632640 1 -- 172.21.15.133:0/2543047609 >> 172.21.15.133:0/2543047609 conn(0x7fc2740c30c0 msgr2=0x7fc2740c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:40.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.448+0000 7fc27a632640 1 -- 172.21.15.133:0/2543047609 shutdown_connections 2023-12-19T18:58:40.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.448+0000 7fc27a632640 1 -- 172.21.15.133:0/2543047609 wait complete. 2023-12-19T18:58:40.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.448+0000 7fc27a632640 1 Processor -- start 2023-12-19T18:58:40.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.448+0000 7fc27a632640 1 -- start start 2023-12-19T18:58:40.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc27a632640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc274073a70 0x7fc274145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:40.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc27a632640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc27414b010 0x7fc274142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc27a632640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc274157c20 0x7fc2741430e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc27a632640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc274154560 con 0x7fc27414b010 2023-12-19T18:58:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc27a632640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2740723e0 con 0x7fc274073a70 2023-12-19T18:58:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc27a632640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2741ed880 con 0x7fc274157c20 2023-12-19T18:58:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc2737fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc27414b010 0x7fc274142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc2737fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc27414b010 0x7fc274142ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34350/0 (socket says 172.21.15.133:34350) 2023-12-19T18:58:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc2737fe640 1 -- 172.21.15.133:0/2957684934 learned_addr learned my addr 172.21.15.133:0/2957684934 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc273fff640 1 --2- 172.21.15.133:0/2957684934 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc274073a70 0x7fc274145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc278bcf640 1 --2- 172.21.15.133:0/2957684934 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc274157c20 0x7fc2741430e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc2737fe640 1 -- 172.21.15.133:0/2957684934 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc274157c20 msgr2=0x7fc2741430e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc2737fe640 1 --2- 172.21.15.133:0/2957684934 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc274157c20 0x7fc2741430e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc2737fe640 1 -- 172.21.15.133:0/2957684934 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc274073a70 msgr2=0x7fc274145340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:40.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc2737fe640 1 --2- 172.21.15.133:0/2957684934 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc274073a70 0x7fc274145340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc2737fe640 1 -- 172.21.15.133:0/2957684934 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2680094d0 con 0x7fc27414b010 2023-12-19T18:58:40.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc2737fe640 1 --2- 172.21.15.133:0/2957684934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc27414b010 0x7fc274142ba0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc268000c10 tx=0x7fc26801ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:40.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc270ff9640 1 -- 172.21.15.133:0/2957684934 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2680b1e90 con 0x7fc27414b010 2023-12-19T18:58:40.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc270ff9640 1 -- 172.21.15.133:0/2957684934 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2680b9410 con 0x7fc27414b010 2023-12-19T18:58:40.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc27a632640 1 -- 172.21.15.133:0/2957684934 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2741edb60 con 0x7fc27414b010 2023-12-19T18:58:40.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc270ff9640 1 -- 172.21.15.133:0/2957684934 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2680b97e0 con 0x7fc27414b010 2023-12-19T18:58:40.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc27a632640 1 -- 172.21.15.133:0/2957684934 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc274072070 con 0x7fc27414b010 2023-12-19T18:58:40.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc27a632640 1 -- 172.21.15.133:0/2957684934 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc274072590 con 0x7fc27414b010 2023-12-19T18:58:40.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.452+0000 7fc270ff9640 1 -- 172.21.15.133:0/2957684934 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc2680b7040 con 0x7fc27414b010 2023-12-19T18:58:40.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.456+0000 7fc270ff9640 1 --2- 172.21.15.133:0/2957684934 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc260066470 0x7fc260068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:40.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.456+0000 7fc270ff9640 1 -- 172.21.15.133:0/2957684934 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc268121520 con 0x7fc27414b010 2023-12-19T18:58:40.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.456+0000 7fc273fff640 1 --2- 172.21.15.133:0/2957684934 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc260066470 0x7fc260068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:40.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.456+0000 7fc273fff640 1 --2- 172.21.15.133:0/2957684934 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc260066470 0x7fc260068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc264007fd0 tx=0x7fc264007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:40.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.460+0000 7fc270ff9640 1 -- 172.21.15.133:0/2957684934 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc274072590 con 0x7fc27414b010 2023-12-19T18:58:40.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.608+0000 7fc27a632640 1 -- 172.21.15.133:0/2957684934 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc274072550 con 0x7fc27414b010 2023-12-19T18:58:40.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.608+0000 7fc270ff9640 1 -- 172.21.15.133:0/2957684934 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc2680b5090 con 0x7fc27414b010 2023-12-19T18:58:40.614 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:40.614 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2023-12-19T18:58:40.615 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:58:40.615 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2023-12-19T18:58:40.615 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": ".mgr" 2023-12-19T18:58:40.615 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:58:40.615 INFO:teuthology.orchestra.run.smithi133.stdout:] 2023-12-19T18:58:40.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.612+0000 7fc27a632640 1 -- 172.21.15.133:0/2957684934 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc260066470 msgr2=0x7fc260068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:40.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.612+0000 7fc27a632640 1 --2- 172.21.15.133:0/2957684934 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc260066470 0x7fc260068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc264007fd0 tx=0x7fc264007e40 comp rx=0 tx=0).stop 2023-12-19T18:58:40.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.612+0000 7fc27a632640 1 -- 172.21.15.133:0/2957684934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc27414b010 msgr2=0x7fc274142ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:40.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.612+0000 7fc27a632640 1 --2- 172.21.15.133:0/2957684934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc27414b010 0x7fc274142ba0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc268000c10 tx=0x7fc26801ba50 comp rx=0 tx=0).stop 2023-12-19T18:58:40.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.612+0000 7fc27a632640 1 -- 172.21.15.133:0/2957684934 shutdown_connections 2023-12-19T18:58:40.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.612+0000 7fc27a632640 1 --2- 172.21.15.133:0/2957684934 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc260066470 0x7fc260068930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.612+0000 7fc27a632640 1 --2- 172.21.15.133:0/2957684934 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc274157c20 0x7fc2741430e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.612+0000 7fc27a632640 1 --2- 172.21.15.133:0/2957684934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc27414b010 0x7fc274142ba0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.612+0000 7fc27a632640 1 --2- 172.21.15.133:0/2957684934 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc274073a70 0x7fc274145340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.612+0000 7fc27a632640 1 -- 172.21.15.133:0/2957684934 >> 172.21.15.133:0/2957684934 conn(0x7fc2740c30c0 msgr2=0x7fc274158070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:40.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.612+0000 7fc27a632640 1 -- 172.21.15.133:0/2957684934 shutdown_connections 2023-12-19T18:58:40.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.612+0000 7fc27a632640 1 -- 172.21.15.133:0/2957684934 wait complete. 2023-12-19T18:58:40.635 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T18:58:40.635 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T18:58:40.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.772+0000 7f3304df8640 1 Processor -- start 2023-12-19T18:58:40.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.772+0000 7f3304df8640 1 -- start start 2023-12-19T18:58:40.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.772+0000 7f3304df8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f33000bfb80 0x7f33001551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:40.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.772+0000 7f3304df8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33000bf670 0x7f330006a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:40.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.772+0000 7f3304df8640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33000c07e0 con 0x7f330006a5b0 2023-12-19T18:58:40.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.772+0000 7f3304df8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33000c1170 con 0x7f33000bfb80 2023-12-19T18:58:40.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.772+0000 7f3304df8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33001545d0 con 0x7f33000bf670 2023-12-19T18:58:40.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.772+0000 7f32fe59c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f330006a5b0 0x7f3300154ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49982/0 (socket says 172.21.15.133:49982) 2023-12-19T18:58:40.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.772+0000 7f32fe59c640 1 -- 172.21.15.133:0/2594484553 learned_addr learned my addr 172.21.15.133:0/2594484553 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:40.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.772+0000 7f32fd59a640 1 -- 172.21.15.133:0/2594484553 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812917888 0 0) 0x7f33000c07e0 con 0x7f330006a5b0 2023-12-19T18:58:40.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.772+0000 7f32fd59a640 1 -- 172.21.15.133:0/2594484553 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32e8003530 con 0x7f330006a5b0 2023-12-19T18:58:40.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.772+0000 7f32fed9d640 1 --2- 172.21.15.133:0/2594484553 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33000bf670 0x7f330006a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:40.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.772+0000 7f32fdd9b640 1 --2- 172.21.15.133:0/2594484553 >> v2:172.21.15.138:3300/0 conn(0x7f33000bfb80 0x7f33001551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:40.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.772+0000 7f32fd59a640 1 -- 172.21.15.133:0/2594484553 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1957718111 0 0) 0x7f32e8003530 con 0x7f330006a5b0 2023-12-19T18:58:40.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.772+0000 7f32fd59a640 1 -- 172.21.15.133:0/2594484553 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33000bf670 msgr2=0x7f330006a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:40.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.772+0000 7f32fd59a640 1 --2- 172.21.15.133:0/2594484553 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33000bf670 0x7f330006a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.772+0000 7f32fd59a640 1 -- 172.21.15.133:0/2594484553 >> v2:172.21.15.138:3300/0 conn(0x7f33000bfb80 msgr2=0x7f33001551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:40.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.772+0000 7f32fd59a640 1 --2- 172.21.15.133:0/2594484553 >> v2:172.21.15.138:3300/0 conn(0x7f33000bfb80 0x7f33001551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.772+0000 7f32fd59a640 1 -- 172.21.15.133:0/2594484553 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33000c0500 con 0x7f330006a5b0 2023-12-19T18:58:40.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.772+0000 7f32fd59a640 1 -- 172.21.15.133:0/2594484553 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f32f0001680 con 0x7f330006a5b0 2023-12-19T18:58:40.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.772+0000 7f32fd59a640 1 -- 172.21.15.133:0/2594484553 >> v1:172.21.15.133:6789/0 conn(0x7f330006a5b0 legacy=0x7f3300154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:40.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.776+0000 7f32fd59a640 1 --2- 172.21.15.133:0/2594484553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32e8003980 0x7f32e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:40.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.776+0000 7f32fd59a640 1 --2- 172.21.15.133:0/2594484553 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33000bf670 0x7f32e80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:40.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.776+0000 7f32fd59a640 1 --2- 172.21.15.133:0/2594484553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32e8004d10 0x7f32e8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:40.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.776+0000 7f32fd59a640 1 -- 172.21.15.133:0/2594484553 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33000c1170 con 0x7f32e8004d10 2023-12-19T18:58:40.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.776+0000 7f32fd59a640 1 -- 172.21.15.133:0/2594484553 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33001545d0 con 0x7f32e8003980 2023-12-19T18:58:40.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.776+0000 7f32fd59a640 1 -- 172.21.15.133:0/2594484553 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e800ba10 con 0x7f33000bf670 2023-12-19T18:58:40.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.776+0000 7f32fed9d640 1 --2- 172.21.15.133:0/2594484553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32e8004d10 0x7f32e8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:40.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.776+0000 7f32fe59c640 1 --2- 172.21.15.133:0/2594484553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32e8003980 0x7f32e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:40.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.776+0000 7f32fdd9b640 1 --2- 172.21.15.133:0/2594484553 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33000bf670 0x7f32e80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:40.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.776+0000 7f32fed9d640 1 -- 172.21.15.133:0/2594484553 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33000bf670 msgr2=0x7f32e80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:40.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.776+0000 7f32fed9d640 1 --2- 172.21.15.133:0/2594484553 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33000bf670 0x7f32e80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.776+0000 7f32fed9d640 1 -- 172.21.15.133:0/2594484553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32e8003980 msgr2=0x7f32e8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:40.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.776+0000 7f32fed9d640 1 --2- 172.21.15.133:0/2594484553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32e8003980 0x7f32e8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.776+0000 7f32fed9d640 1 -- 172.21.15.133:0/2594484553 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e8003530 con 0x7f32e8004d10 2023-12-19T18:58:40.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.776+0000 7f32fdd9b640 1 --2- 172.21.15.133:0/2594484553 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33000bf670 0x7f32e80047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:40.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.776+0000 7f32fe59c640 1 --2- 172.21.15.133:0/2594484553 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f32e8003980 0x7f32e8003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:40.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.776+0000 7f32fed9d640 1 --2- 172.21.15.133:0/2594484553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32e8004d10 0x7f32e8005190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3300070220 tx=0x7f32f801cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ebac098728a16c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:40.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.776+0000 7f32fd59a640 1 -- 172.21.15.133:0/2594484553 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f80a5c10 con 0x7f32e8004d10 2023-12-19T18:58:40.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.776+0000 7f32fd59a640 1 -- 172.21.15.133:0/2594484553 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f800f040 con 0x7f32e8004d10 2023-12-19T18:58:40.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.776+0000 7f32fd59a640 1 -- 172.21.15.133:0/2594484553 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f80ad440 con 0x7f32e8004d10 2023-12-19T18:58:40.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f3304df8640 1 -- 172.21.15.133:0/2594484553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32e8004d10 msgr2=0x7f32e8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:40.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f3304df8640 1 --2- 172.21.15.133:0/2594484553 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32e8004d10 0x7f32e8005190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3300070220 tx=0x7f32f801cc00 comp rx=0 tx=0).stop 2023-12-19T18:58:40.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f32fed9d640 1 -- 172.21.15.133:0/2594484553 reap_dead start 2023-12-19T18:58:40.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f3304df8640 1 -- 172.21.15.133:0/2594484553 shutdown_connections 2023-12-19T18:58:40.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f3304df8640 1 -- 172.21.15.133:0/2594484553 >> 172.21.15.133:0/2594484553 conn(0x7f33000a8ad0 msgr2=0x7f33000c6240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:40.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f3304df8640 1 -- 172.21.15.133:0/2594484553 shutdown_connections 2023-12-19T18:58:40.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f3304df8640 1 -- 172.21.15.133:0/2594484553 wait complete. 2023-12-19T18:58:40.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f3304df8640 1 Processor -- start 2023-12-19T18:58:40.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f3304df8640 1 -- start start 2023-12-19T18:58:40.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f3304df8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32e8004d10 0x7f3300145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:40.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f3304df8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3300144840 0x7f33001eda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:40.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f3304df8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33000a90b0 0x7f330014e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f3304df8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33001edfc0 con 0x7f32e8004d10 2023-12-19T18:58:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f3304df8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33000abbe0 con 0x7f3300144840 2023-12-19T18:58:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f3304df8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3300144eb0 con 0x7f33000a90b0 2023-12-19T18:58:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f32fe59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32e8004d10 0x7f3300145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f32fe59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32e8004d10 0x7f3300145380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34366/0 (socket says 172.21.15.133:34366) 2023-12-19T18:58:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f32fe59c640 1 -- 172.21.15.133:0/141669130 learned_addr learned my addr 172.21.15.133:0/141669130 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f32fdd9b640 1 --2- 172.21.15.133:0/141669130 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3300144840 0x7f33001eda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f32fed9d640 1 --2- 172.21.15.133:0/141669130 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33000a90b0 0x7f330014e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f32fe59c640 1 -- 172.21.15.133:0/141669130 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33000a90b0 msgr2=0x7f330014e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f32fe59c640 1 --2- 172.21.15.133:0/141669130 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33000a90b0 0x7f330014e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f32fe59c640 1 -- 172.21.15.133:0/141669130 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3300144840 msgr2=0x7f33001eda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f32fe59c640 1 --2- 172.21.15.133:0/141669130 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3300144840 0x7f33001eda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f32fe59c640 1 -- 172.21.15.133:0/141669130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33000ac090 con 0x7f32e8004d10 2023-12-19T18:58:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f32fed9d640 1 --2- 172.21.15.133:0/141669130 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33000a90b0 0x7f330014e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.780+0000 7f32fdd9b640 1 --2- 172.21.15.133:0/141669130 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3300144840 0x7f33001eda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:40.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.784+0000 7f32fe59c640 1 --2- 172.21.15.133:0/141669130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32e8004d10 0x7f3300145380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f32f0005fd0 tx=0x7f32f000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:40.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.784+0000 7f32eeffd640 1 -- 172.21.15.133:0/141669130 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f000ee60 con 0x7f32e8004d10 2023-12-19T18:58:40.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.784+0000 7f32eeffd640 1 -- 172.21.15.133:0/141669130 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f000c8d0 con 0x7f32e8004d10 2023-12-19T18:58:40.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.784+0000 7f32eeffd640 1 -- 172.21.15.133:0/141669130 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f000cc60 con 0x7f32e8004d10 2023-12-19T18:58:40.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.784+0000 7f3304df8640 1 -- 172.21.15.133:0/141669130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33000abdb0 con 0x7f32e8004d10 2023-12-19T18:58:40.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.784+0000 7f3304df8640 1 -- 172.21.15.133:0/141669130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330014ef10 con 0x7f32e8004d10 2023-12-19T18:58:40.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.784+0000 7f3304df8640 1 -- 172.21.15.133:0/141669130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3300068400 con 0x7f32e8004d10 2023-12-19T18:58:40.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.784+0000 7f32eeffd640 1 -- 172.21.15.133:0/141669130 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f32f001d460 con 0x7f32e8004d10 2023-12-19T18:58:40.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.784+0000 7f32eeffd640 1 --2- 172.21.15.133:0/141669130 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f32e0066470 0x7f32e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:40.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.784+0000 7f32eeffd640 1 -- 172.21.15.133:0/141669130 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f32f0083b00 con 0x7f32e8004d10 2023-12-19T18:58:40.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.784+0000 7f32fdd9b640 1 --2- 172.21.15.133:0/141669130 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f32e0066470 0x7f32e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:40.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.788+0000 7f32fdd9b640 1 --2- 172.21.15.133:0/141669130 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f32e0066470 0x7f32e0068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f33000c6340 tx=0x7f32f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:40.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.788+0000 7f32eeffd640 1 -- 172.21.15.133:0/141669130 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f32f0085e60 con 0x7f32e8004d10 2023-12-19T18:58:40.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:40.944+0000 7f3304df8640 1 -- 172.21.15.133:0/141669130 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f33000c6d90 con 0x7f32e8004d10 2023-12-19T18:58:41.185 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:58:41.189 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:58:41.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.388+0000 7f32eeffd640 1 -- 172.21.15.133:0/141669130 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f32f0054d50 con 0x7f32e8004d10 2023-12-19T18:58:41.392 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2023-12-19T18:58:41.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.388+0000 7f3304df8640 1 -- 172.21.15.133:0/141669130 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f32e0066470 msgr2=0x7f32e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:41.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.388+0000 7f3304df8640 1 --2- 172.21.15.133:0/141669130 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f32e0066470 0x7f32e0068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f33000c6340 tx=0x7f32f4008040 comp rx=0 tx=0).stop 2023-12-19T18:58:41.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.388+0000 7f3304df8640 1 -- 172.21.15.133:0/141669130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32e8004d10 msgr2=0x7f3300145380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:41.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.388+0000 7f3304df8640 1 --2- 172.21.15.133:0/141669130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32e8004d10 0x7f3300145380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f32f0005fd0 tx=0x7f32f000ec10 comp rx=0 tx=0).stop 2023-12-19T18:58:41.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.388+0000 7f3304df8640 1 -- 172.21.15.133:0/141669130 shutdown_connections 2023-12-19T18:58:41.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.388+0000 7f3304df8640 1 --2- 172.21.15.133:0/141669130 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f32e0066470 0x7f32e0068930 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:41.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.388+0000 7f3304df8640 1 --2- 172.21.15.133:0/141669130 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33000a90b0 0x7f330014e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:41.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.388+0000 7f3304df8640 1 --2- 172.21.15.133:0/141669130 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3300144840 0x7f33001eda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:41.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.388+0000 7f3304df8640 1 --2- 172.21.15.133:0/141669130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f32e8004d10 0x7f3300145380 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:41.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.388+0000 7f3304df8640 1 -- 172.21.15.133:0/141669130 >> 172.21.15.133:0/141669130 conn(0x7f33000a8ad0 msgr2=0x7f3300071200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:41.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.392+0000 7f3304df8640 1 -- 172.21.15.133:0/141669130 shutdown_connections 2023-12-19T18:58:41.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.392+0000 7f3304df8640 1 -- 172.21.15.133:0/141669130 wait complete. 2023-12-19T18:58:41.420 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T18:58:41.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.560+0000 7f61c35e6640 1 Processor -- start 2023-12-19T18:58:41.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.560+0000 7f61c35e6640 1 -- start start 2023-12-19T18:58:41.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.560+0000 7f61c35e6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f61bc0bffc0 0x7f61bc15ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:41.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.560+0000 7f61c35e6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61bc15c600 con 0x7f61bc1560e0 2023-12-19T18:58:41.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.560+0000 7f61c35e6640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61bc15a5c0 con 0x7f61bc06d520 2023-12-19T18:58:41.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.560+0000 7f61c35e6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61bc1594e0 con 0x7f61bc0bffc0 2023-12-19T18:58:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.560+0000 7f61c1382640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f61bc1560e0 0x7f61bc159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49984/0 (socket says 172.21.15.133:49984) 2023-12-19T18:58:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.560+0000 7f61c1382640 1 -- 172.21.15.133:0/3683084197 learned_addr learned my addr 172.21.15.133:0/3683084197 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.560+0000 7f61c1b83640 1 --2- 172.21.15.133:0/3683084197 >> v2:172.21.15.133:3300/0 conn(0x7f61bc0bffc0 0x7f61bc15ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.560+0000 7f61b3fff640 1 -- 172.21.15.133:0/3683084197 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 854218554 0 0) 0x7f61bc15c600 con 0x7f61bc1560e0 2023-12-19T18:58:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.560+0000 7f61b3fff640 1 -- 172.21.15.133:0/3683084197 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61a8003530 con 0x7f61bc1560e0 2023-12-19T18:58:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.560+0000 7f61c1b83640 1 -- 172.21.15.133:0/3683084197 >> v1:172.21.15.138:6789/0 conn(0x7f61bc06d520 legacy=0x7f61bc0c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:41.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.560+0000 7f61c1b83640 1 -- 172.21.15.133:0/3683084197 >> v1:172.21.15.133:6789/0 conn(0x7f61bc1560e0 legacy=0x7f61bc159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:41.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.560+0000 7f61c1b83640 1 -- 172.21.15.133:0/3683084197 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61bc1597c0 con 0x7f61bc0bffc0 2023-12-19T18:58:41.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.564+0000 7f61c1b83640 1 --2- 172.21.15.133:0/3683084197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61bc0bffc0 0x7f61bc15ca90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f61b4009d90 tx=0x7f61b401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164096947bb9dce7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:41.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.564+0000 7f61b3fff640 1 -- 172.21.15.133:0/3683084197 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b40a59a0 con 0x7f61bc0bffc0 2023-12-19T18:58:41.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.564+0000 7f61b3fff640 1 -- 172.21.15.133:0/3683084197 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b40a5b00 con 0x7f61bc0bffc0 2023-12-19T18:58:41.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.564+0000 7f61b3fff640 1 -- 172.21.15.133:0/3683084197 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b40a5e90 con 0x7f61bc0bffc0 2023-12-19T18:58:41.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.564+0000 7f61c35e6640 1 -- 172.21.15.133:0/3683084197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61bc0bffc0 msgr2=0x7f61bc15ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:41.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.564+0000 7f61c35e6640 1 --2- 172.21.15.133:0/3683084197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61bc0bffc0 0x7f61bc15ca90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f61b4009d90 tx=0x7f61b401c8e0 comp rx=0 tx=0).stop 2023-12-19T18:58:41.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.564+0000 7f61c35e6640 1 -- 172.21.15.133:0/3683084197 shutdown_connections 2023-12-19T18:58:41.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.564+0000 7f61c35e6640 1 --2- 172.21.15.133:0/3683084197 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61bc0bffc0 0x7f61bc15ca90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:41.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.564+0000 7f61c35e6640 1 -- 172.21.15.133:0/3683084197 >> 172.21.15.133:0/3683084197 conn(0x7f61bc06a5b0 msgr2=0x7f61bc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:41.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.564+0000 7f61c35e6640 1 -- 172.21.15.133:0/3683084197 shutdown_connections 2023-12-19T18:58:41.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.564+0000 7f61c35e6640 1 -- 172.21.15.133:0/3683084197 wait complete. 2023-12-19T18:58:41.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61c35e6640 1 Processor -- start 2023-12-19T18:58:41.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61c35e6640 1 -- start start 2023-12-19T18:58:41.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61c35e6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61bc06d520 0x7f61bc14e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:41.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61c35e6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61bc0bffc0 0x7f61bc0c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:41.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61c35e6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61bc1560e0 0x7f61bc14ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:41.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61c35e6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc0c4280 con 0x7f61bc06d520 2023-12-19T18:58:41.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61c35e6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc1f4e90 con 0x7f61bc0bffc0 2023-12-19T18:58:41.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61c35e6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61bc1f5170 con 0x7f61bc1560e0 2023-12-19T18:58:41.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61c1382640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61bc06d520 0x7f61bc14e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:41.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61c1382640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61bc06d520 0x7f61bc14e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34394/0 (socket says 172.21.15.133:34394) 2023-12-19T18:58:41.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61c1382640 1 -- 172.21.15.133:0/2316714524 learned_addr learned my addr 172.21.15.133:0/2316714524 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:41.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61c1b83640 1 --2- 172.21.15.133:0/2316714524 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61bc1560e0 0x7f61bc14ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:41.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61c0b81640 1 --2- 172.21.15.133:0/2316714524 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61bc0bffc0 0x7f61bc0c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:41.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61c1382640 1 -- 172.21.15.133:0/2316714524 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61bc1560e0 msgr2=0x7f61bc14ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:41.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61c1382640 1 --2- 172.21.15.133:0/2316714524 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61bc1560e0 0x7f61bc14ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:41.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61c1382640 1 -- 172.21.15.133:0/2316714524 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61bc0bffc0 msgr2=0x7f61bc0c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:41.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61c1382640 1 --2- 172.21.15.133:0/2316714524 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61bc0bffc0 0x7f61bc0c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:41.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61c1382640 1 -- 172.21.15.133:0/2316714524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b4009a70 con 0x7f61bc06d520 2023-12-19T18:58:41.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61c1382640 1 --2- 172.21.15.133:0/2316714524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61bc06d520 0x7f61bc14e6e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f61b800c4d0 tx=0x7f61b800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:41.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61b1ffb640 1 -- 172.21.15.133:0/2316714524 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8005cf0 con 0x7f61bc06d520 2023-12-19T18:58:41.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61b1ffb640 1 -- 172.21.15.133:0/2316714524 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61b8005e50 con 0x7f61bc06d520 2023-12-19T18:58:41.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61b1ffb640 1 -- 172.21.15.133:0/2316714524 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61b8007270 con 0x7f61bc06d520 2023-12-19T18:58:41.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61c35e6640 1 -- 172.21.15.133:0/2316714524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61bc14d740 con 0x7f61bc06d520 2023-12-19T18:58:41.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.568+0000 7f61c35e6640 1 -- 172.21.15.133:0/2316714524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61bc0c3f10 con 0x7f61bc06d520 2023-12-19T18:58:41.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.572+0000 7f61c35e6640 1 -- 172.21.15.133:0/2316714524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61bc14d960 con 0x7f61bc06d520 2023-12-19T18:58:41.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.572+0000 7f61b1ffb640 1 -- 172.21.15.133:0/2316714524 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f61b80073d0 con 0x7f61bc06d520 2023-12-19T18:58:41.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.572+0000 7f61b1ffb640 1 --2- 172.21.15.133:0/2316714524 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f61a0066470 0x7f61a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:41.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.572+0000 7f61b1ffb640 1 -- 172.21.15.133:0/2316714524 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f61b8083200 con 0x7f61bc06d520 2023-12-19T18:58:41.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.572+0000 7f61c0b81640 1 --2- 172.21.15.133:0/2316714524 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f61a0066470 0x7f61a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:41.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.572+0000 7f61c0b81640 1 --2- 172.21.15.133:0/2316714524 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f61a0066470 0x7f61a0068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0a5600 tx=0x7f61ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:41.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.576+0000 7f61b1ffb640 1 -- 172.21.15.133:0/2316714524 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f61b8050900 con 0x7f61bc06d520 2023-12-19T18:58:41.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:41.728+0000 7f61c35e6640 1 -- 172.21.15.133:0/2316714524 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f61bc068400 con 0x7f61bc06d520 2023-12-19T18:58:42.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.396+0000 7f61b1ffb640 1 -- 172.21.15.133:0/2316714524 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f61b8053f20 con 0x7f61bc06d520 2023-12-19T18:58:42.400 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2023-12-19T18:58:42.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.400+0000 7f61c35e6640 1 -- 172.21.15.133:0/2316714524 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f61a0066470 msgr2=0x7f61a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:42.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.400+0000 7f61c35e6640 1 --2- 172.21.15.133:0/2316714524 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f61a0066470 0x7f61a0068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f61bc0a5600 tx=0x7f61ac008040 comp rx=0 tx=0).stop 2023-12-19T18:58:42.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.400+0000 7f61c35e6640 1 -- 172.21.15.133:0/2316714524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61bc06d520 msgr2=0x7f61bc14e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:42.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.400+0000 7f61c35e6640 1 --2- 172.21.15.133:0/2316714524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61bc06d520 0x7f61bc14e6e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f61b800c4d0 tx=0x7f61b800c990 comp rx=0 tx=0).stop 2023-12-19T18:58:42.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.400+0000 7f61c35e6640 1 -- 172.21.15.133:0/2316714524 shutdown_connections 2023-12-19T18:58:42.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.400+0000 7f61c35e6640 1 --2- 172.21.15.133:0/2316714524 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f61a0066470 0x7f61a0068930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:42.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.400+0000 7f61c35e6640 1 --2- 172.21.15.133:0/2316714524 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61bc1560e0 0x7f61bc14ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:42.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.400+0000 7f61c35e6640 1 --2- 172.21.15.133:0/2316714524 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61bc0bffc0 0x7f61bc0c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:42.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.400+0000 7f61c35e6640 1 --2- 172.21.15.133:0/2316714524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61bc06d520 0x7f61bc14e6e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:42.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.400+0000 7f61c35e6640 1 -- 172.21.15.133:0/2316714524 >> 172.21.15.133:0/2316714524 conn(0x7f61bc06a5b0 msgr2=0x7f61bc06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:42.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.400+0000 7f61c35e6640 1 -- 172.21.15.133:0/2316714524 shutdown_connections 2023-12-19T18:58:42.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.400+0000 7f61c35e6640 1 -- 172.21.15.133:0/2316714524 wait complete. 2023-12-19T18:58:42.446 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T18:58:42.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ee30d6640 1 Processor -- start 2023-12-19T18:58:42.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ee30d6640 1 -- start start 2023-12-19T18:58:42.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ee30d6640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2edc155de0 0x7f2edc156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:42.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ee30d6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2edc0c2580 con 0x7f2edc0c5640 2023-12-19T18:58:42.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ee30d6640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2edc0c1a00 con 0x7f2edc0c5260 2023-12-19T18:58:42.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ee30d6640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2edc153510 con 0x7f2edc155de0 2023-12-19T18:58:42.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ed3fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2edc0c5640 0x7f2edc0c5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:49990/0 (socket says 172.21.15.133:49990) 2023-12-19T18:58:42.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ed3fff640 1 -- 172.21.15.133:0/271223512 learned_addr learned my addr 172.21.15.133:0/271223512 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:42.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ee1673640 1 --2- 172.21.15.133:0/271223512 >> v2:172.21.15.138:3300/0 conn(0x7f2edc155de0 0x7f2edc156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:42.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ed37fe640 1 -- 172.21.15.133:0/271223512 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639800771 0 0) 0x7f2edc0c2580 con 0x7f2edc0c5640 2023-12-19T18:58:42.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ed37fe640 1 -- 172.21.15.133:0/271223512 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ec4003530 con 0x7f2edc0c5640 2023-12-19T18:58:42.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ed37fe640 1 -- 172.21.15.133:0/271223512 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3781699698 0 0) 0x7f2ec4003530 con 0x7f2edc0c5640 2023-12-19T18:58:42.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ed37fe640 1 -- 172.21.15.133:0/271223512 >> v2:172.21.15.138:3300/0 conn(0x7f2edc155de0 msgr2=0x7f2edc156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:42.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ed37fe640 1 --2- 172.21.15.133:0/271223512 >> v2:172.21.15.138:3300/0 conn(0x7f2edc155de0 0x7f2edc156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:42.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ed37fe640 1 -- 172.21.15.133:0/271223512 >> v1:172.21.15.138:6789/0 conn(0x7f2edc0c5260 legacy=0x7f2edc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ed37fe640 1 -- 172.21.15.133:0/271223512 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2edc0c1ce0 con 0x7f2edc0c5640 2023-12-19T18:58:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ed37fe640 1 -- 172.21.15.133:0/271223512 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f2ecc001680 con 0x7f2edc0c5640 2023-12-19T18:58:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ee1673640 1 --2- 172.21.15.133:0/271223512 >> v2:172.21.15.138:3300/0 conn(0x7f2edc155de0 0x7f2edc156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:58:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ed37fe640 1 -- 172.21.15.133:0/271223512 >> v1:172.21.15.133:6789/0 conn(0x7f2edc0c5640 legacy=0x7f2edc0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ed37fe640 1 --2- 172.21.15.133:0/271223512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ec4003980 0x7f2ec4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ed37fe640 1 --2- 172.21.15.133:0/271223512 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec40047d0 0x7f2ec4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ed37fe640 1 --2- 172.21.15.133:0/271223512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec4005190 0x7f2ec400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ed37fe640 1 -- 172.21.15.133:0/271223512 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec400c100 con 0x7f2ec4003980 2023-12-19T18:58:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ed37fe640 1 -- 172.21.15.133:0/271223512 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec400c270 con 0x7f2ec40047d0 2023-12-19T18:58:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ed37fe640 1 -- 172.21.15.133:0/271223512 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec400c430 con 0x7f2ec4005190 2023-12-19T18:58:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ee0e72640 1 --2- 172.21.15.133:0/271223512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ec4003980 0x7f2ec4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ed3fff640 1 --2- 172.21.15.133:0/271223512 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec40047d0 0x7f2ec4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ee1673640 1 --2- 172.21.15.133:0/271223512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec4005190 0x7f2ec400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:42.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ee0e72640 1 -- 172.21.15.133:0/271223512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec4005190 msgr2=0x7f2ec400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:42.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ee0e72640 1 --2- 172.21.15.133:0/271223512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec4005190 0x7f2ec400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:42.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ee0e72640 1 -- 172.21.15.133:0/271223512 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec40047d0 msgr2=0x7f2ec4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:42.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ee0e72640 1 --2- 172.21.15.133:0/271223512 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec40047d0 0x7f2ec4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:42.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ee0e72640 1 -- 172.21.15.133:0/271223512 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec4003530 con 0x7f2ec4003980 2023-12-19T18:58:42.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ee1673640 1 --2- 172.21.15.133:0/271223512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec4005190 0x7f2ec400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:42.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.584+0000 7f2ee1673640 1 -- 172.21.15.133:0/271223512 reap_dead start 2023-12-19T18:58:42.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.588+0000 7f2ee0e72640 1 --2- 172.21.15.133:0/271223512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ec4003980 0x7f2ec4003da0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8001780 tx=0x7f2ed801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0fef8ec436688 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:42.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.588+0000 7f2ed37fe640 1 -- 172.21.15.133:0/271223512 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed80052d0 con 0x7f2ec4003980 2023-12-19T18:58:42.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.588+0000 7f2ed37fe640 1 -- 172.21.15.133:0/271223512 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed80a7050 con 0x7f2ec4003980 2023-12-19T18:58:42.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.588+0000 7f2ed37fe640 1 -- 172.21.15.133:0/271223512 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8003600 con 0x7f2ec4003980 2023-12-19T18:58:42.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.588+0000 7f2ee30d6640 1 -- 172.21.15.133:0/271223512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ec4003980 msgr2=0x7f2ec4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:42.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.588+0000 7f2ee30d6640 1 --2- 172.21.15.133:0/271223512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ec4003980 0x7f2ec4003da0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8001780 tx=0x7f2ed801c3e0 comp rx=0 tx=0).stop 2023-12-19T18:58:42.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.588+0000 7f2ee30d6640 1 -- 172.21.15.133:0/271223512 shutdown_connections 2023-12-19T18:58:42.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.588+0000 7f2ee30d6640 1 --2- 172.21.15.133:0/271223512 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ec4003980 0x7f2ec4003da0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:42.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.588+0000 7f2ee30d6640 1 -- 172.21.15.133:0/271223512 >> 172.21.15.133:0/271223512 conn(0x7f2edc06a5b0 msgr2=0x7f2edc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:42.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.588+0000 7f2ee30d6640 1 -- 172.21.15.133:0/271223512 shutdown_connections 2023-12-19T18:58:42.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.588+0000 7f2ee30d6640 1 -- 172.21.15.133:0/271223512 wait complete. 2023-12-19T18:58:42.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ee30d6640 1 Processor -- start 2023-12-19T18:58:42.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ee30d6640 1 -- start start 2023-12-19T18:58:42.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ee30d6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec4003980 0x7f2edc1efe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:42.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ee30d6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2edc150f00 0x7f2edc1f03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:42.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ee30d6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2edc14e000 0x7f2edc14e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:42.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ee30d6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc14e9c0 con 0x7f2edc150f00 2023-12-19T18:58:42.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ee30d6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc0a9620 con 0x7f2edc14e000 2023-12-19T18:58:42.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ee30d6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2edc1f09a0 con 0x7f2ec4003980 2023-12-19T18:58:42.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ed3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2edc150f00 0x7f2edc1f03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:42.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ed3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2edc150f00 0x7f2edc1f03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34406/0 (socket says 172.21.15.133:34406) 2023-12-19T18:58:42.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ed3fff640 1 -- 172.21.15.133:0/2992737186 learned_addr learned my addr 172.21.15.133:0/2992737186 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:42.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ee0e72640 1 --2- 172.21.15.133:0/2992737186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec4003980 0x7f2edc1efe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:42.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ee1673640 1 --2- 172.21.15.133:0/2992737186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2edc14e000 0x7f2edc14e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:42.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ed3fff640 1 -- 172.21.15.133:0/2992737186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec4003980 msgr2=0x7f2edc1efe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:42.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ed3fff640 1 --2- 172.21.15.133:0/2992737186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec4003980 0x7f2edc1efe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:42.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ed3fff640 1 -- 172.21.15.133:0/2992737186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2edc14e000 msgr2=0x7f2edc14e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:42.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ed3fff640 1 --2- 172.21.15.133:0/2992737186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2edc14e000 0x7f2edc14e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:42.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ed3fff640 1 -- 172.21.15.133:0/2992737186 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2edc150370 con 0x7f2edc150f00 2023-12-19T18:58:42.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ee1673640 1 --2- 172.21.15.133:0/2992737186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2edc14e000 0x7f2edc14e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:42.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ed3fff640 1 --2- 172.21.15.133:0/2992737186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2edc150f00 0x7f2edc1f03c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc007290 tx=0x7f2ecc007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:42.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ed17fa640 1 -- 172.21.15.133:0/2992737186 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc00f940 con 0x7f2edc150f00 2023-12-19T18:58:42.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ed17fa640 1 -- 172.21.15.133:0/2992737186 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ecc00fae0 con 0x7f2edc150f00 2023-12-19T18:58:42.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ee30d6640 1 -- 172.21.15.133:0/2992737186 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2edc150650 con 0x7f2edc150f00 2023-12-19T18:58:42.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ed17fa640 1 -- 172.21.15.133:0/2992737186 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc00fe90 con 0x7f2edc150f00 2023-12-19T18:58:42.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.592+0000 7f2ee30d6640 1 -- 172.21.15.133:0/2992737186 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2edc151500 con 0x7f2edc150f00 2023-12-19T18:58:42.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.596+0000 7f2ee30d6640 1 -- 172.21.15.133:0/2992737186 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2edc0a97d0 con 0x7f2edc150f00 2023-12-19T18:58:42.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.596+0000 7f2ed17fa640 1 -- 172.21.15.133:0/2992737186 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2ecc01d460 con 0x7f2edc150f00 2023-12-19T18:58:42.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.596+0000 7f2ed17fa640 1 --2- 172.21.15.133:0/2992737186 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2ec8066470 0x7f2ec8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:42.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.596+0000 7f2ed17fa640 1 -- 172.21.15.133:0/2992737186 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f2ecc083eb0 con 0x7f2edc150f00 2023-12-19T18:58:42.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.596+0000 7f2ee0e72640 1 --2- 172.21.15.133:0/2992737186 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2ec8066470 0x7f2ec8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:42.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.596+0000 7f2ee0e72640 1 --2- 172.21.15.133:0/2992737186 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2ec8066470 0x7f2ec8068930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8001750 tx=0x7f2ed80011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:42.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.600+0000 7f2ed17fa640 1 -- 172.21.15.133:0/2992737186 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2edc0a97d0 con 0x7f2edc150f00 2023-12-19T18:58:42.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:42.780+0000 7f2ee30d6640 1 -- 172.21.15.133:0/2992737186 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2edc0a9790 con 0x7f2edc150f00 2023-12-19T18:58:43.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.612+0000 7f2ed17fa640 1 -- 172.21.15.133:0/2992737186 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2ecc051420 con 0x7f2edc150f00 2023-12-19T18:58:43.616 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 2 and data pool 3 2023-12-19T18:58:43.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.616+0000 7f2ee30d6640 1 -- 172.21.15.133:0/2992737186 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2ec8066470 msgr2=0x7f2ec8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:43.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.616+0000 7f2ee30d6640 1 --2- 172.21.15.133:0/2992737186 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2ec8066470 0x7f2ec8068930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2ed8001750 tx=0x7f2ed80011a0 comp rx=0 tx=0).stop 2023-12-19T18:58:43.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.616+0000 7f2ee30d6640 1 -- 172.21.15.133:0/2992737186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2edc150f00 msgr2=0x7f2edc1f03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:43.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.616+0000 7f2ee30d6640 1 --2- 172.21.15.133:0/2992737186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2edc150f00 0x7f2edc1f03c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc007290 tx=0x7f2ecc007750 comp rx=0 tx=0).stop 2023-12-19T18:58:43.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.616+0000 7f2ee30d6640 1 -- 172.21.15.133:0/2992737186 shutdown_connections 2023-12-19T18:58:43.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.616+0000 7f2ee30d6640 1 --2- 172.21.15.133:0/2992737186 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2ec8066470 0x7f2ec8068930 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:43.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.616+0000 7f2ee30d6640 1 --2- 172.21.15.133:0/2992737186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2edc14e000 0x7f2edc14e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:43.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.616+0000 7f2ee30d6640 1 --2- 172.21.15.133:0/2992737186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2edc150f00 0x7f2edc1f03c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:43.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.616+0000 7f2ee30d6640 1 --2- 172.21.15.133:0/2992737186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec4003980 0x7f2edc1efe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:43.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.616+0000 7f2ee30d6640 1 -- 172.21.15.133:0/2992737186 >> 172.21.15.133:0/2992737186 conn(0x7f2edc06a5b0 msgr2=0x7f2edc0a5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:43.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.616+0000 7f2ee30d6640 1 -- 172.21.15.133:0/2992737186 shutdown_connections 2023-12-19T18:58:43.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.616+0000 7f2ee30d6640 1 -- 172.21.15.133:0/2992737186 wait complete. 2023-12-19T18:58:43.647 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:58:43.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.780+0000 7fb2d939d640 1 Processor -- start 2023-12-19T18:58:43.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.780+0000 7fb2d939d640 1 -- start start 2023-12-19T18:58:43.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.784+0000 7fb2d939d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb2d4158670 0x7fb2d4155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:43.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.784+0000 7fb2d939d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d40c53f0 con 0x7fb2d40c48d0 2023-12-19T18:58:43.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.784+0000 7fb2d939d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d4154670 con 0x7fb2d4151ba0 2023-12-19T18:58:43.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.784+0000 7fb2d939d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d4158c30 con 0x7fb2d4158670 2023-12-19T18:58:43.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.784+0000 7fb2cbfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb2d40c48d0 0x7fb2d4154b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50004/0 (socket says 172.21.15.133:50004) 2023-12-19T18:58:43.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.784+0000 7fb2cbfff640 1 -- 172.21.15.133:0/2119574248 learned_addr learned my addr 172.21.15.133:0/2119574248 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:43.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.784+0000 7fb2d37fe640 1 --2- 172.21.15.133:0/2119574248 >> v2:172.21.15.138:3300/0 conn(0x7fb2d4158670 0x7fb2d4155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:43.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.784+0000 7fb2d27fc640 1 -- 172.21.15.133:0/2119574248 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2479594635 0 0) 0x7fb2d40c53f0 con 0x7fb2d40c48d0 2023-12-19T18:58:43.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.784+0000 7fb2d27fc640 1 -- 172.21.15.133:0/2119574248 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2c0003530 con 0x7fb2d40c48d0 2023-12-19T18:58:43.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.784+0000 7fb2d27fc640 1 -- 172.21.15.133:0/2119574248 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4041063204 0 0) 0x7fb2d4154670 con 0x7fb2d4151ba0 2023-12-19T18:58:43.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.784+0000 7fb2d27fc640 1 -- 172.21.15.133:0/2119574248 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2d40c53f0 con 0x7fb2d4151ba0 2023-12-19T18:58:43.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.784+0000 7fb2d37fe640 1 -- 172.21.15.133:0/2119574248 >> v1:172.21.15.138:6789/0 conn(0x7fb2d4151ba0 legacy=0x7fb2d406afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:43.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.784+0000 7fb2d37fe640 1 -- 172.21.15.133:0/2119574248 >> v1:172.21.15.133:6789/0 conn(0x7fb2d40c48d0 legacy=0x7fb2d4154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:43.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.784+0000 7fb2d27fc640 1 -- 172.21.15.133:0/2119574248 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 405164104 0 0) 0x7fb2c0003530 con 0x7fb2d40c48d0 2023-12-19T18:58:43.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.784+0000 7fb2d37fe640 1 -- 172.21.15.133:0/2119574248 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d40c6b00 con 0x7fb2d4158670 2023-12-19T18:58:43.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2d37fe640 1 --2- 172.21.15.133:0/2119574248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2d4158670 0x7fb2d4155240 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc009d90 tx=0x7fb2cc01c720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19f0684b04dce2f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:43.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2d27fc640 1 -- 172.21.15.133:0/2119574248 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc001680 con 0x7fb2d4158670 2023-12-19T18:58:43.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2d27fc640 1 -- 172.21.15.133:0/2119574248 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2cc0a5560 con 0x7fb2d4158670 2023-12-19T18:58:43.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2d27fc640 1 -- 172.21.15.133:0/2119574248 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc0a58f0 con 0x7fb2d4158670 2023-12-19T18:58:43.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2d939d640 1 -- 172.21.15.133:0/2119574248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2d4158670 msgr2=0x7fb2d4155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:43.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2d939d640 1 --2- 172.21.15.133:0/2119574248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2d4158670 0x7fb2d4155240 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc009d90 tx=0x7fb2cc01c720 comp rx=0 tx=0).stop 2023-12-19T18:58:43.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2d939d640 1 -- 172.21.15.133:0/2119574248 shutdown_connections 2023-12-19T18:58:43.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2d939d640 1 --2- 172.21.15.133:0/2119574248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2d4158670 0x7fb2d4155240 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:43.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2d939d640 1 -- 172.21.15.133:0/2119574248 >> 172.21.15.133:0/2119574248 conn(0x7fb2d40c9f50 msgr2=0x7fb2d40ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:43.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2d939d640 1 -- 172.21.15.133:0/2119574248 shutdown_connections 2023-12-19T18:58:43.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2d939d640 1 -- 172.21.15.133:0/2119574248 wait complete. 2023-12-19T18:58:43.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2d939d640 1 Processor -- start 2023-12-19T18:58:43.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2d939d640 1 -- start start 2023-12-19T18:58:43.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2d939d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2d40c48d0 0x7fb2d40ac570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:43.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2d939d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2d4151ba0 0x7fb2d4145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:43.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2d939d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2d4158670 0x7fb2d4156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:43.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2d939d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d4157b10 con 0x7fb2d40c48d0 2023-12-19T18:58:43.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2d939d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d41460f0 con 0x7fb2d4151ba0 2023-12-19T18:58:43.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2d939d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d4148470 con 0x7fb2d4158670 2023-12-19T18:58:43.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2d2ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2d40c48d0 0x7fb2d40ac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:43.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2d2ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2d40c48d0 0x7fb2d40ac570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34418/0 (socket says 172.21.15.133:34418) 2023-12-19T18:58:43.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2d2ffd640 1 -- 172.21.15.133:0/296770906 learned_addr learned my addr 172.21.15.133:0/296770906 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:43.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2cbfff640 1 --2- 172.21.15.133:0/296770906 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2d4151ba0 0x7fb2d4145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:43.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.788+0000 7fb2d37fe640 1 --2- 172.21.15.133:0/296770906 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2d4158670 0x7fb2d4156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:43.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.792+0000 7fb2d2ffd640 1 -- 172.21.15.133:0/296770906 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2d4158670 msgr2=0x7fb2d4156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:43.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.792+0000 7fb2d2ffd640 1 --2- 172.21.15.133:0/296770906 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2d4158670 0x7fb2d4156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:43.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.792+0000 7fb2d2ffd640 1 -- 172.21.15.133:0/296770906 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2d4151ba0 msgr2=0x7fb2d4145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:43.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.792+0000 7fb2d2ffd640 1 --2- 172.21.15.133:0/296770906 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2d4151ba0 0x7fb2d4145bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:43.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.792+0000 7fb2d2ffd640 1 -- 172.21.15.133:0/296770906 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2cc009a70 con 0x7fb2d40c48d0 2023-12-19T18:58:43.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.792+0000 7fb2cbfff640 1 --2- 172.21.15.133:0/296770906 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2d4151ba0 0x7fb2d4145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:43.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.792+0000 7fb2d37fe640 1 --2- 172.21.15.133:0/296770906 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2d4158670 0x7fb2d4156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:43.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.792+0000 7fb2d2ffd640 1 --2- 172.21.15.133:0/296770906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2d40c48d0 0x7fb2d40ac570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400c460 tx=0x7fb2c400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:43.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.792+0000 7fb2cb7fe640 1 -- 172.21.15.133:0/296770906 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c40052d0 con 0x7fb2d40c48d0 2023-12-19T18:58:43.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.792+0000 7fb2cb7fe640 1 -- 172.21.15.133:0/296770906 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2c4005450 con 0x7fb2d40c48d0 2023-12-19T18:58:43.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.792+0000 7fb2cb7fe640 1 -- 172.21.15.133:0/296770906 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4012870 con 0x7fb2d40c48d0 2023-12-19T18:58:43.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.792+0000 7fb2d939d640 1 -- 172.21.15.133:0/296770906 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d4157d60 con 0x7fb2d40c48d0 2023-12-19T18:58:43.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.792+0000 7fb2d939d640 1 -- 172.21.15.133:0/296770906 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d4147eb0 con 0x7fb2d40c48d0 2023-12-19T18:58:43.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.792+0000 7fb2d939d640 1 -- 172.21.15.133:0/296770906 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2d4067a00 con 0x7fb2d40c48d0 2023-12-19T18:58:43.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.792+0000 7fb2cb7fe640 1 -- 172.21.15.133:0/296770906 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb2c40129d0 con 0x7fb2d40c48d0 2023-12-19T18:58:43.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.792+0000 7fb2cb7fe640 1 --2- 172.21.15.133:0/296770906 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb2b4066470 0x7fb2b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:43.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.792+0000 7fb2cb7fe640 1 -- 172.21.15.133:0/296770906 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2c4083a00 con 0x7fb2d40c48d0 2023-12-19T18:58:43.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.792+0000 7fb2cbfff640 1 --2- 172.21.15.133:0/296770906 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb2b4066470 0x7fb2b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:43.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.796+0000 7fb2cbfff640 1 --2- 172.21.15.133:0/296770906 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb2b4066470 0x7fb2b4068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4154640 tx=0x7fb2bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:43.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.796+0000 7fb2cb7fe640 1 -- 172.21.15.133:0/296770906 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb2c4050e70 con 0x7fb2d40c48d0 2023-12-19T18:58:43.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.948+0000 7fb2d939d640 1 -- 172.21.15.133:0/296770906 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2d4068400 con 0x7fb2d40c48d0 2023-12-19T18:58:43.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.948+0000 7fb2cb7fe640 1 -- 172.21.15.133:0/296770906 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16554 (secure 0 0 0) 0x7fb2c4054490 con 0x7fb2d40c48d0 2023-12-19T18:58:43.954 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:43.954 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":19,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:42.786352+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:58:40.991408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T18:58:41.773992+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:58:43.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.952+0000 7fb2d939d640 1 -- 172.21.15.133:0/296770906 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb2b4066470 msgr2=0x7fb2b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:43.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.952+0000 7fb2d939d640 1 --2- 172.21.15.133:0/296770906 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb2b4066470 0x7fb2b4068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4154640 tx=0x7fb2bc009040 comp rx=0 tx=0).stop 2023-12-19T18:58:43.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.952+0000 7fb2d939d640 1 -- 172.21.15.133:0/296770906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2d40c48d0 msgr2=0x7fb2d40ac570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:43.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.952+0000 7fb2d939d640 1 --2- 172.21.15.133:0/296770906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2d40c48d0 0x7fb2d40ac570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400c460 tx=0x7fb2c400c920 comp rx=0 tx=0).stop 2023-12-19T18:58:43.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.952+0000 7fb2d939d640 1 -- 172.21.15.133:0/296770906 shutdown_connections 2023-12-19T18:58:43.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.952+0000 7fb2d939d640 1 --2- 172.21.15.133:0/296770906 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb2b4066470 0x7fb2b4068930 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:43.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.952+0000 7fb2d939d640 1 --2- 172.21.15.133:0/296770906 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2d4158670 0x7fb2d4156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:43.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.952+0000 7fb2d939d640 1 --2- 172.21.15.133:0/296770906 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2d4151ba0 0x7fb2d4145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:43.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.952+0000 7fb2d939d640 1 --2- 172.21.15.133:0/296770906 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2d40c48d0 0x7fb2d40ac570 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:43.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.952+0000 7fb2d939d640 1 -- 172.21.15.133:0/296770906 >> 172.21.15.133:0/296770906 conn(0x7fb2d40c9f50 msgr2=0x7fb2d40c7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:43.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.952+0000 7fb2d939d640 1 -- 172.21.15.133:0/296770906 shutdown_connections 2023-12-19T18:58:43.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:43.952+0000 7fb2d939d640 1 -- 172.21.15.133:0/296770906 wait complete. 2023-12-19T18:58:43.975 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:58:44.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.108+0000 7fc66d217640 1 Processor -- start 2023-12-19T18:58:44.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.108+0000 7fc66d217640 1 -- start start 2023-12-19T18:58:44.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.108+0000 7fc66d217640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc6680a5370 0x7fc6680c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:44.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.108+0000 7fc66d217640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc668072090 0x7fc6681516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:44.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.108+0000 7fc66d217640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6680c2760 con 0x7fc6680c4110 2023-12-19T18:58:44.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.108+0000 7fc66d217640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6680c3070 con 0x7fc6680a5370 2023-12-19T18:58:44.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.108+0000 7fc66d217640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc668151bf0 con 0x7fc668072090 2023-12-19T18:58:44.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.108+0000 7fc65ffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc6680c4110 0x7fc668150fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50020/0 (socket says 172.21.15.133:50020) 2023-12-19T18:58:44.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.108+0000 7fc65ffff640 1 -- 172.21.15.133:0/25092057 learned_addr learned my addr 172.21.15.133:0/25092057 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:44.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.108+0000 7fc66759e640 1 --2- 172.21.15.133:0/25092057 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc668072090 0x7fc6681516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:44.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.108+0000 7fc666d9d640 1 --2- 172.21.15.133:0/25092057 >> v2:172.21.15.138:3300/0 conn(0x7fc6680a5370 0x7fc6680c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:44.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.108+0000 7fc66659c640 1 -- 172.21.15.133:0/25092057 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786112331 0 0) 0x7fc6680c2760 con 0x7fc6680c4110 2023-12-19T18:58:44.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.112+0000 7fc66659c640 1 -- 172.21.15.133:0/25092057 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc654003530 con 0x7fc6680c4110 2023-12-19T18:58:44.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.112+0000 7fc66759e640 1 -- 172.21.15.133:0/25092057 >> v2:172.21.15.138:3300/0 conn(0x7fc6680a5370 msgr2=0x7fc6680c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:44.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.112+0000 7fc66759e640 1 --2- 172.21.15.133:0/25092057 >> v2:172.21.15.138:3300/0 conn(0x7fc6680a5370 0x7fc6680c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:44.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.112+0000 7fc66759e640 1 -- 172.21.15.133:0/25092057 >> v1:172.21.15.133:6789/0 conn(0x7fc6680c4110 legacy=0x7fc668150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:44.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.112+0000 7fc66659c640 1 -- 172.21.15.133:0/25092057 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2782143016 0 0) 0x7fc654003530 con 0x7fc6680c4110 2023-12-19T18:58:44.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.112+0000 7fc66759e640 1 -- 172.21.15.133:0/25092057 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6680a5750 con 0x7fc668072090 2023-12-19T18:58:44.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.112+0000 7fc66759e640 1 --2- 172.21.15.133:0/25092057 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc668072090 0x7fc6681516b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc660009d90 tx=0x7fc66001c720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=527b511b7227dfa7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:44.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.112+0000 7fc66659c640 1 -- 172.21.15.133:0/25092057 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc650001680 con 0x7fc668072090 2023-12-19T18:58:44.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.112+0000 7fc66659c640 1 -- 172.21.15.133:0/25092057 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6600b0400 con 0x7fc668072090 2023-12-19T18:58:44.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.112+0000 7fc66659c640 1 -- 172.21.15.133:0/25092057 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6600b0770 con 0x7fc668072090 2023-12-19T18:58:44.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66d217640 1 -- 172.21.15.133:0/25092057 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc668072090 msgr2=0x7fc6681516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:44.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66d217640 1 --2- 172.21.15.133:0/25092057 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc668072090 0x7fc6681516b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc660009d90 tx=0x7fc66001c720 comp rx=0 tx=0).stop 2023-12-19T18:58:44.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66d217640 1 -- 172.21.15.133:0/25092057 shutdown_connections 2023-12-19T18:58:44.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66d217640 1 --2- 172.21.15.133:0/25092057 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc668072090 0x7fc6681516b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:44.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66d217640 1 --2- 172.21.15.133:0/25092057 >> v2:172.21.15.138:3300/0 conn(0x7fc6680a5370 0x7fc6680c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:44.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66d217640 1 -- 172.21.15.133:0/25092057 >> 172.21.15.133:0/25092057 conn(0x7fc66806a5b0 msgr2=0x7fc66806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:44.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66d217640 1 -- 172.21.15.133:0/25092057 shutdown_connections 2023-12-19T18:58:44.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66d217640 1 -- 172.21.15.133:0/25092057 wait complete. 2023-12-19T18:58:44.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66d217640 1 Processor -- start 2023-12-19T18:58:44.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66d217640 1 -- start start 2023-12-19T18:58:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66d217640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc668072090 0x7fc668151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66d217640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6680a5370 0x7fc66814bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66d217640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6680c4110 0x7fc66814c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66d217640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66815f350 con 0x7fc6680c4110 2023-12-19T18:58:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66d217640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6681ed900 con 0x7fc6680a5370 2023-12-19T18:58:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66d217640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6681edbe0 con 0x7fc668072090 2023-12-19T18:58:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66759e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6680c4110 0x7fc66814c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:44.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66759e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6680c4110 0x7fc66814c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34428/0 (socket says 172.21.15.133:34428) 2023-12-19T18:58:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66759e640 1 -- 172.21.15.133:0/2653316190 learned_addr learned my addr 172.21.15.133:0/2653316190 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc666d9d640 1 --2- 172.21.15.133:0/2653316190 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc668072090 0x7fc668151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc65ffff640 1 --2- 172.21.15.133:0/2653316190 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6680a5370 0x7fc66814bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66759e640 1 -- 172.21.15.133:0/2653316190 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc668072090 msgr2=0x7fc668151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66759e640 1 --2- 172.21.15.133:0/2653316190 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc668072090 0x7fc668151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66759e640 1 -- 172.21.15.133:0/2653316190 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6680a5370 msgr2=0x7fc66814bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66759e640 1 --2- 172.21.15.133:0/2653316190 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6680a5370 0x7fc66814bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.116+0000 7fc66759e640 1 -- 172.21.15.133:0/2653316190 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc660009a70 con 0x7fc6680c4110 2023-12-19T18:58:44.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.120+0000 7fc66759e640 1 --2- 172.21.15.133:0/2653316190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6680c4110 0x7fc66814c290 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc66001cfc0 tx=0x7fc6600194c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:44.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.120+0000 7fc65f7fe640 1 -- 172.21.15.133:0/2653316190 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc660003ea0 con 0x7fc6680c4110 2023-12-19T18:58:44.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.120+0000 7fc65f7fe640 1 -- 172.21.15.133:0/2653316190 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6600b5070 con 0x7fc6680c4110 2023-12-19T18:58:44.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.120+0000 7fc65f7fe640 1 -- 172.21.15.133:0/2653316190 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc660004440 con 0x7fc6680c4110 2023-12-19T18:58:44.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.120+0000 7fc66d217640 1 -- 172.21.15.133:0/2653316190 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66815efe0 con 0x7fc6680c4110 2023-12-19T18:58:44.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.120+0000 7fc66d217640 1 -- 172.21.15.133:0/2653316190 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc66814c850 con 0x7fc6680c4110 2023-12-19T18:58:44.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.120+0000 7fc66d217640 1 -- 172.21.15.133:0/2653316190 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc668068400 con 0x7fc6680c4110 2023-12-19T18:58:44.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.120+0000 7fc65f7fe640 1 -- 172.21.15.133:0/2653316190 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc6600045a0 con 0x7fc6680c4110 2023-12-19T18:58:44.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.120+0000 7fc65f7fe640 1 --2- 172.21.15.133:0/2653316190 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc648066470 0x7fc648068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:44.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.120+0000 7fc65f7fe640 1 -- 172.21.15.133:0/2653316190 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc66011e5c0 con 0x7fc6680c4110 2023-12-19T18:58:44.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.120+0000 7fc666d9d640 1 --2- 172.21.15.133:0/2653316190 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc648066470 0x7fc648068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:44.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.124+0000 7fc666d9d640 1 --2- 172.21.15.133:0/2653316190 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc648066470 0x7fc648068930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc658009b60 tx=0x7fc658009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:44.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.124+0000 7fc65f7fe640 1 -- 172.21.15.133:0/2653316190 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc6600ebb80 con 0x7fc6680c4110 2023-12-19T18:58:44.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.276+0000 7fc66d217640 1 -- 172.21.15.133:0/2653316190 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc66815f490 con 0x7fc6680c4110 2023-12-19T18:58:44.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.276+0000 7fc65f7fe640 1 -- 172.21.15.133:0/2653316190 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16554 (secure 0 0 0) 0x7fc6600ef1a0 con 0x7fc6680c4110 2023-12-19T18:58:44.280 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:44.280 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":19,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:42.786352+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:58:40.991408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T18:58:41.773992+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:58:44.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.276+0000 7fc66d217640 1 -- 172.21.15.133:0/2653316190 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc648066470 msgr2=0x7fc648068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:44.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.276+0000 7fc66d217640 1 --2- 172.21.15.133:0/2653316190 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc648066470 0x7fc648068930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc658009b60 tx=0x7fc658009190 comp rx=0 tx=0).stop 2023-12-19T18:58:44.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.276+0000 7fc66d217640 1 -- 172.21.15.133:0/2653316190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6680c4110 msgr2=0x7fc66814c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:44.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.276+0000 7fc66d217640 1 --2- 172.21.15.133:0/2653316190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6680c4110 0x7fc66814c290 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc66001cfc0 tx=0x7fc6600194c0 comp rx=0 tx=0).stop 2023-12-19T18:58:44.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.276+0000 7fc66d217640 1 -- 172.21.15.133:0/2653316190 shutdown_connections 2023-12-19T18:58:44.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.276+0000 7fc66d217640 1 --2- 172.21.15.133:0/2653316190 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc648066470 0x7fc648068930 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:44.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.276+0000 7fc66d217640 1 --2- 172.21.15.133:0/2653316190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6680c4110 0x7fc66814c290 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:44.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.276+0000 7fc66d217640 1 --2- 172.21.15.133:0/2653316190 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6680a5370 0x7fc66814bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:44.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.276+0000 7fc66d217640 1 --2- 172.21.15.133:0/2653316190 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc668072090 0x7fc668151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:44.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.276+0000 7fc66d217640 1 -- 172.21.15.133:0/2653316190 >> 172.21.15.133:0/2653316190 conn(0x7fc66806a5b0 msgr2=0x7fc66806ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:44.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.276+0000 7fc66d217640 1 -- 172.21.15.133:0/2653316190 shutdown_connections 2023-12-19T18:58:44.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.276+0000 7fc66d217640 1 -- 172.21.15.133:0/2653316190 wait complete. 2023-12-19T18:58:44.301 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T18:58:44.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.440+0000 7f45886dd640 1 Processor -- start 2023-12-19T18:58:44.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.440+0000 7f45886dd640 1 -- start start 2023-12-19T18:58:44.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.444+0000 7f45886dd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45801555c0 0x7f45800a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:44.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.444+0000 7f45886dd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45800c61e0 0x7f45800c6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:44.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.444+0000 7f45886dd640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45800c28e0 con 0x7f45800c6c70 2023-12-19T18:58:44.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.444+0000 7f45886dd640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45800c3680 con 0x7f45800c61e0 2023-12-19T18:58:44.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.444+0000 7f45886dd640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45800c2b80 con 0x7f45801555c0 2023-12-19T18:58:44.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.444+0000 7f4585c78640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45800c61e0 0x7f45800c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:44.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.444+0000 7f4586c7a640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f45800c6c70 0x7f45800c1270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42418/0 (socket says 172.21.15.133:42418) 2023-12-19T18:58:44.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.444+0000 7f4585c78640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45800c61e0 0x7f45800c6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54304/0 (socket says 172.21.15.133:54304) 2023-12-19T18:58:44.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.444+0000 7f4586c7a640 1 -- 172.21.15.133:0/1803300266 learned_addr learned my addr 172.21.15.133:0/1803300266 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:44.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.444+0000 7f4586479640 1 --2- 172.21.15.133:0/1803300266 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45801555c0 0x7f45800a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:44.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.444+0000 7f4585c78640 1 -- 172.21.15.133:0/1803300266 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45801555c0 msgr2=0x7f45800a6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:44.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.444+0000 7f4585c78640 1 --2- 172.21.15.133:0/1803300266 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45801555c0 0x7f45800a6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:44.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.444+0000 7f4585c78640 1 -- 172.21.15.133:0/1803300266 >> v1:172.21.15.133:6789/0 conn(0x7f45800c6c70 legacy=0x7f45800c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:44.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.444+0000 7f4585c78640 1 -- 172.21.15.133:0/1803300266 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45800c32a0 con 0x7f45800c61e0 2023-12-19T18:58:44.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.444+0000 7f4586479640 1 --2- 172.21.15.133:0/1803300266 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45801555c0 0x7f45800a6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:44.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.444+0000 7f4585477640 1 -- 172.21.15.133:0/1803300266 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834143492 0 0) 0x7f45800c28e0 con 0x7f45800c6c70 2023-12-19T18:58:44.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.448+0000 7f4585c78640 1 --2- 172.21.15.133:0/1803300266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45800c61e0 0x7f45800c6730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f45700097c0 tx=0x7f457001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f303761804723658 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:44.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.448+0000 7f4585477640 1 -- 172.21.15.133:0/1803300266 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45700ad640 con 0x7f45800c61e0 2023-12-19T18:58:44.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.448+0000 7f4585477640 1 -- 172.21.15.133:0/1803300266 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45700ad7a0 con 0x7f45800c61e0 2023-12-19T18:58:44.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.448+0000 7f4585477640 1 -- 172.21.15.133:0/1803300266 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45700adb30 con 0x7f45800c61e0 2023-12-19T18:58:44.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.448+0000 7f45886dd640 1 -- 172.21.15.133:0/1803300266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45800c61e0 msgr2=0x7f45800c6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:44.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.448+0000 7f45886dd640 1 --2- 172.21.15.133:0/1803300266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45800c61e0 0x7f45800c6730 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f45700097c0 tx=0x7f457001c480 comp rx=0 tx=0).stop 2023-12-19T18:58:44.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.448+0000 7f45886dd640 1 -- 172.21.15.133:0/1803300266 shutdown_connections 2023-12-19T18:58:44.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.448+0000 7f45886dd640 1 --2- 172.21.15.133:0/1803300266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45800c61e0 0x7f45800c6730 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:44.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.448+0000 7f45886dd640 1 --2- 172.21.15.133:0/1803300266 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45801555c0 0x7f45800a6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:44.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.448+0000 7f45886dd640 1 -- 172.21.15.133:0/1803300266 >> 172.21.15.133:0/1803300266 conn(0x7f45800c7e40 msgr2=0x7f45800c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:44.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.448+0000 7f45886dd640 1 -- 172.21.15.133:0/1803300266 shutdown_connections 2023-12-19T18:58:44.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.448+0000 7f45886dd640 1 -- 172.21.15.133:0/1803300266 wait complete. 2023-12-19T18:58:44.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.448+0000 7f45886dd640 1 Processor -- start 2023-12-19T18:58:44.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.448+0000 7f45886dd640 1 -- start start 2023-12-19T18:58:44.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.448+0000 7f45886dd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45800c61e0 0x7f458014d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:44.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.448+0000 7f45886dd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45800c6c70 0x7f4580152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:44.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.448+0000 7f45886dd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45801555c0 0x7f458014cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:44.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.448+0000 7f45886dd640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458015b330 con 0x7f45801555c0 2023-12-19T18:58:44.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.448+0000 7f45886dd640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45801ecef0 con 0x7f45800c61e0 2023-12-19T18:58:44.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.448+0000 7f45886dd640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4580153e10 con 0x7f45800c6c70 2023-12-19T18:58:44.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.452+0000 7f4586c7a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45801555c0 0x7f458014cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:44.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.452+0000 7f4586c7a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45801555c0 0x7f458014cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54314/0 (socket says 172.21.15.133:54314) 2023-12-19T18:58:44.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.452+0000 7f4586c7a640 1 -- 172.21.15.133:0/1990383662 learned_addr learned my addr 172.21.15.133:0/1990383662 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:44.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.452+0000 7f4586479640 1 --2- 172.21.15.133:0/1990383662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45800c61e0 0x7f458014d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:44.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.452+0000 7f4585c78640 1 --2- 172.21.15.133:0/1990383662 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45800c6c70 0x7f4580152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:44.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.452+0000 7f4586c7a640 1 -- 172.21.15.133:0/1990383662 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45800c6c70 msgr2=0x7f4580152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:44.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.452+0000 7f4586c7a640 1 --2- 172.21.15.133:0/1990383662 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45800c6c70 0x7f4580152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:44.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.452+0000 7f4586c7a640 1 -- 172.21.15.133:0/1990383662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45800c61e0 msgr2=0x7f458014d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:44.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.452+0000 7f4586c7a640 1 --2- 172.21.15.133:0/1990383662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45800c61e0 0x7f458014d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:44.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.452+0000 7f4586c7a640 1 -- 172.21.15.133:0/1990383662 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4570009420 con 0x7f45801555c0 2023-12-19T18:58:44.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.452+0000 7f4586c7a640 1 --2- 172.21.15.133:0/1990383662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45801555c0 0x7f458014cbf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4578001570 tx=0x7f457800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:44.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.452+0000 7f4576ffd640 1 -- 172.21.15.133:0/1990383662 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457800a640 con 0x7f45801555c0 2023-12-19T18:58:44.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.452+0000 7f4576ffd640 1 -- 172.21.15.133:0/1990383662 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457800a7c0 con 0x7f45801555c0 2023-12-19T18:58:44.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.452+0000 7f4576ffd640 1 -- 172.21.15.133:0/1990383662 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457800ab70 con 0x7f45801555c0 2023-12-19T18:58:44.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.452+0000 7f45886dd640 1 -- 172.21.15.133:0/1990383662 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45801f0880 con 0x7f45801555c0 2023-12-19T18:58:44.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.452+0000 7f45886dd640 1 -- 172.21.15.133:0/1990383662 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45801f0e40 con 0x7f45801555c0 2023-12-19T18:58:44.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.452+0000 7f45886dd640 1 -- 172.21.15.133:0/1990383662 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45801ed060 con 0x7f45801555c0 2023-12-19T18:58:44.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.452+0000 7f4576ffd640 1 -- 172.21.15.133:0/1990383662 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f457800acd0 con 0x7f45801555c0 2023-12-19T18:58:44.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.456+0000 7f4576ffd640 1 --2- 172.21.15.133:0/1990383662 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f45640664a0 0x7f4564068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:44.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.456+0000 7f4576ffd640 1 -- 172.21.15.133:0/1990383662 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45780831a0 con 0x7f45801555c0 2023-12-19T18:58:44.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.456+0000 7f4586479640 1 --2- 172.21.15.133:0/1990383662 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f45640664a0 0x7f4564068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:44.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.456+0000 7f4586479640 1 --2- 172.21.15.133:0/1990383662 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f45640664a0 0x7f4564068960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f457c0045f0 tx=0x7f457c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:44.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.456+0000 7f4576ffd640 1 -- 172.21.15.133:0/1990383662 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4578050760 con 0x7f45801555c0 2023-12-19T18:58:44.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:44.644+0000 7f45886dd640 1 -- 172.21.15.133:0/1990383662 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4580068400 con 0x7f45801555c0 2023-12-19T18:58:45.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.632+0000 7f4576ffd640 1 -- 172.21.15.133:0/1990383662 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4578053d80 con 0x7f45801555c0 2023-12-19T18:58:45.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.632+0000 7f45886dd640 1 -- 172.21.15.133:0/1990383662 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f45640664a0 msgr2=0x7f4564068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:45.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.632+0000 7f45886dd640 1 --2- 172.21.15.133:0/1990383662 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f45640664a0 0x7f4564068960 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f457c0045f0 tx=0x7f457c008040 comp rx=0 tx=0).stop 2023-12-19T18:58:45.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.632+0000 7f45886dd640 1 -- 172.21.15.133:0/1990383662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45801555c0 msgr2=0x7f458014cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:45.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.632+0000 7f45886dd640 1 --2- 172.21.15.133:0/1990383662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45801555c0 0x7f458014cbf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4578001570 tx=0x7f457800cca0 comp rx=0 tx=0).stop 2023-12-19T18:58:45.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.632+0000 7f45886dd640 1 -- 172.21.15.133:0/1990383662 shutdown_connections 2023-12-19T18:58:45.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.632+0000 7f45886dd640 1 --2- 172.21.15.133:0/1990383662 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f45640664a0 0x7f4564068960 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:45.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.632+0000 7f45886dd640 1 --2- 172.21.15.133:0/1990383662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45801555c0 0x7f458014cbf0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:45.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.632+0000 7f45886dd640 1 --2- 172.21.15.133:0/1990383662 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f45800c6c70 0x7f4580152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:45.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.632+0000 7f45886dd640 1 --2- 172.21.15.133:0/1990383662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f45800c61e0 0x7f458014d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:45.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.632+0000 7f45886dd640 1 -- 172.21.15.133:0/1990383662 >> 172.21.15.133:0/1990383662 conn(0x7f45800c7e40 msgr2=0x7f458015e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:45.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.632+0000 7f45886dd640 1 -- 172.21.15.133:0/1990383662 shutdown_connections 2023-12-19T18:58:45.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.632+0000 7f45886dd640 1 -- 172.21.15.133:0/1990383662 wait complete. 2023-12-19T18:58:45.658 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T18:58:45.659 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T18:58:45.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.796+0000 7f3f82bb8640 1 Processor -- start 2023-12-19T18:58:45.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.796+0000 7f3f82bb8640 1 -- start start 2023-12-19T18:58:45.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.796+0000 7f3f82bb8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f7c0c7ea0 0x7f3f7c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:45.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.796+0000 7f3f82bb8640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3f7c06b9e0 0x7f3f7c15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:45.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.796+0000 7f3f82bb8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f7c06c860 con 0x7f3f7c151e90 2023-12-19T18:58:45.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.796+0000 7f3f82bb8640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f7c0c8750 con 0x7f3f7c06b9e0 2023-12-19T18:58:45.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.796+0000 7f3f82bb8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c1552d0 con 0x7f3f7c0c7ea0 2023-12-19T18:58:45.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.796+0000 7f3f81155640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3f7c06b9e0 0x7f3f7c15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:45.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.796+0000 7f3f81155640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3f7c06b9e0 0x7f3f7c15f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54318/0 (socket says 172.21.15.133:54318) 2023-12-19T18:58:45.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.796+0000 7f3f81155640 1 -- 172.21.15.133:0/3632133541 learned_addr learned my addr 172.21.15.133:0/3632133541 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:45.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.796+0000 7f3f73fff640 1 --2- 172.21.15.133:0/3632133541 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f7c0c7ea0 0x7f3f7c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:45.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.796+0000 7f3f81155640 1 -- 172.21.15.133:0/3632133541 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f7c0c7ea0 msgr2=0x7f3f7c06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:45.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.796+0000 7f3f81155640 1 --2- 172.21.15.133:0/3632133541 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f7c0c7ea0 0x7f3f7c06b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:45.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.796+0000 7f3f81155640 1 -- 172.21.15.133:0/3632133541 >> v1:172.21.15.138:6789/0 conn(0x7f3f7c151e90 legacy=0x7f3f7c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:45.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.796+0000 7f3f81155640 1 -- 172.21.15.133:0/3632133541 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f7c154930 con 0x7f3f7c06b9e0 2023-12-19T18:58:45.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.800+0000 7f3f81155640 1 --2- 172.21.15.133:0/3632133541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f7c06b9e0 0x7f3f7c15f0a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3f74009e50 tx=0x7f3f7401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14300cc2ec6bcfba server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:45.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.800+0000 7f3f737fe640 1 -- 172.21.15.133:0/3632133541 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f740a55b0 con 0x7f3f7c06b9e0 2023-12-19T18:58:45.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.800+0000 7f3f737fe640 1 -- 172.21.15.133:0/3632133541 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f740a5710 con 0x7f3f7c06b9e0 2023-12-19T18:58:45.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.800+0000 7f3f737fe640 1 -- 172.21.15.133:0/3632133541 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f740a5aa0 con 0x7f3f7c06b9e0 2023-12-19T18:58:45.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.800+0000 7f3f82bb8640 1 -- 172.21.15.133:0/3632133541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f7c06b9e0 msgr2=0x7f3f7c15f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:45.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.800+0000 7f3f82bb8640 1 --2- 172.21.15.133:0/3632133541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f7c06b9e0 0x7f3f7c15f0a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3f74009e50 tx=0x7f3f7401c8f0 comp rx=0 tx=0).stop 2023-12-19T18:58:45.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.800+0000 7f3f82bb8640 1 -- 172.21.15.133:0/3632133541 shutdown_connections 2023-12-19T18:58:45.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.800+0000 7f3f82bb8640 1 --2- 172.21.15.133:0/3632133541 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f7c06b9e0 0x7f3f7c15f0a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:45.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.800+0000 7f3f82bb8640 1 --2- 172.21.15.133:0/3632133541 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f7c0c7ea0 0x7f3f7c06b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:45.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.800+0000 7f3f82bb8640 1 -- 172.21.15.133:0/3632133541 >> 172.21.15.133:0/3632133541 conn(0x7f3f7c0ca170 msgr2=0x7f3f7c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:45.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.800+0000 7f3f82bb8640 1 -- 172.21.15.133:0/3632133541 shutdown_connections 2023-12-19T18:58:45.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.800+0000 7f3f82bb8640 1 -- 172.21.15.133:0/3632133541 wait complete. 2023-12-19T18:58:45.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f82bb8640 1 Processor -- start 2023-12-19T18:58:45.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f82bb8640 1 -- start start 2023-12-19T18:58:45.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f82bb8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f7c06b9e0 0x7f3f7c1f0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:45.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f82bb8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f7c0c7ea0 0x7f3f7c0ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:45.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f82bb8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f7c151e90 0x7f3f7c0ab900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:45.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f82bb8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c0ae290 con 0x7f3f7c06b9e0 2023-12-19T18:58:45.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f82bb8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c0af860 con 0x7f3f7c151e90 2023-12-19T18:58:45.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f82bb8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7c0acfa0 con 0x7f3f7c0c7ea0 2023-12-19T18:58:45.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f80954640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f7c06b9e0 0x7f3f7c1f0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:45.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f80954640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f7c06b9e0 0x7f3f7c1f0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54328/0 (socket says 172.21.15.133:54328) 2023-12-19T18:58:45.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f73fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f7c0c7ea0 0x7f3f7c0ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:45.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f80954640 1 -- 172.21.15.133:0/458390429 learned_addr learned my addr 172.21.15.133:0/458390429 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:45.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f81155640 1 --2- 172.21.15.133:0/458390429 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f7c151e90 0x7f3f7c0ab900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:45.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f80954640 1 -- 172.21.15.133:0/458390429 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f7c0c7ea0 msgr2=0x7f3f7c0ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:45.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f80954640 1 --2- 172.21.15.133:0/458390429 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f7c0c7ea0 0x7f3f7c0ab3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:45.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f80954640 1 -- 172.21.15.133:0/458390429 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f7c151e90 msgr2=0x7f3f7c0ab900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:45.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f80954640 1 --2- 172.21.15.133:0/458390429 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f7c151e90 0x7f3f7c0ab900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:45.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f80954640 1 -- 172.21.15.133:0/458390429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f74009b30 con 0x7f3f7c06b9e0 2023-12-19T18:58:45.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f80954640 1 --2- 172.21.15.133:0/458390429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f7c06b9e0 0x7f3f7c1f0230 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800c500 tx=0x7f3f7800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:45.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f717fa640 1 -- 172.21.15.133:0/458390429 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f78005220 con 0x7f3f7c06b9e0 2023-12-19T18:58:45.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f717fa640 1 -- 172.21.15.133:0/458390429 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f78005380 con 0x7f3f7c06b9e0 2023-12-19T18:58:45.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f717fa640 1 -- 172.21.15.133:0/458390429 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f78007270 con 0x7f3f7c06b9e0 2023-12-19T18:58:45.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f82bb8640 1 -- 172.21.15.133:0/458390429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f7c1f0cf0 con 0x7f3f7c06b9e0 2023-12-19T18:58:45.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.804+0000 7f3f82bb8640 1 -- 172.21.15.133:0/458390429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f7c0acbe0 con 0x7f3f7c06b9e0 2023-12-19T18:58:45.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.808+0000 7f3f82bb8640 1 -- 172.21.15.133:0/458390429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f7c1f0f30 con 0x7f3f7c06b9e0 2023-12-19T18:58:45.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.808+0000 7f3f717fa640 1 -- 172.21.15.133:0/458390429 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3f780073d0 con 0x7f3f7c06b9e0 2023-12-19T18:58:45.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.808+0000 7f3f717fa640 1 --2- 172.21.15.133:0/458390429 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3f68066470 0x7f3f68068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:45.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.808+0000 7f3f717fa640 1 -- 172.21.15.133:0/458390429 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f780836d0 con 0x7f3f7c06b9e0 2023-12-19T18:58:45.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.808+0000 7f3f73fff640 1 --2- 172.21.15.133:0/458390429 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3f68066470 0x7f3f68068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:45.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.808+0000 7f3f73fff640 1 --2- 172.21.15.133:0/458390429 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3f68066470 0x7f3f68068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c150a90 tx=0x7f3f6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:45.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.812+0000 7f3f717fa640 1 -- 172.21.15.133:0/458390429 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f3f78050b70 con 0x7f3f7c06b9e0 2023-12-19T18:58:46.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:45.996+0000 7f3f82bb8640 1 -- 172.21.15.133:0/458390429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3f7c158cd0 con 0x7f3f7c06b9e0 2023-12-19T18:58:46.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.632+0000 7f3f717fa640 1 -- 172.21.15.133:0/458390429 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3f78054190 con 0x7f3f7c06b9e0 2023-12-19T18:58:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.636+0000 7f3f82bb8640 1 -- 172.21.15.133:0/458390429 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3f68066470 msgr2=0x7f3f68068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.636+0000 7f3f82bb8640 1 --2- 172.21.15.133:0/458390429 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3f68066470 0x7f3f68068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c150a90 tx=0x7f3f6c008040 comp rx=0 tx=0).stop 2023-12-19T18:58:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.636+0000 7f3f82bb8640 1 -- 172.21.15.133:0/458390429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f7c06b9e0 msgr2=0x7f3f7c1f0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.636+0000 7f3f82bb8640 1 --2- 172.21.15.133:0/458390429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f7c06b9e0 0x7f3f7c1f0230 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800c500 tx=0x7f3f7800c9c0 comp rx=0 tx=0).stop 2023-12-19T18:58:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.636+0000 7f3f82bb8640 1 -- 172.21.15.133:0/458390429 shutdown_connections 2023-12-19T18:58:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.636+0000 7f3f82bb8640 1 --2- 172.21.15.133:0/458390429 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3f68066470 0x7f3f68068930 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.636+0000 7f3f82bb8640 1 --2- 172.21.15.133:0/458390429 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3f7c151e90 0x7f3f7c0ab900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.636+0000 7f3f82bb8640 1 --2- 172.21.15.133:0/458390429 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3f7c0c7ea0 0x7f3f7c0ab3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.636+0000 7f3f82bb8640 1 --2- 172.21.15.133:0/458390429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3f7c06b9e0 0x7f3f7c1f0230 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:46.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.636+0000 7f3f82bb8640 1 -- 172.21.15.133:0/458390429 >> 172.21.15.133:0/458390429 conn(0x7f3f7c0ca170 msgr2=0x7f3f7c0c4820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:46.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.636+0000 7f3f82bb8640 1 -- 172.21.15.133:0/458390429 shutdown_connections 2023-12-19T18:58:46.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.636+0000 7f3f82bb8640 1 -- 172.21.15.133:0/458390429 wait complete. 2023-12-19T18:58:46.660 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T18:58:46.661 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:58:46.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.792+0000 7f5a5632a640 1 Processor -- start 2023-12-19T18:58:46.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.792+0000 7f5a5632a640 1 -- start start 2023-12-19T18:58:46.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.796+0000 7f5a5632a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5a500a5370 0x7f5a500c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:46.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.796+0000 7f5a5632a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a500c2760 con 0x7f5a50072090 2023-12-19T18:58:46.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.796+0000 7f5a5632a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a500a5750 con 0x7f5a500c4110 2023-12-19T18:58:46.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.796+0000 7f5a5632a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a500c3070 con 0x7f5a500a5370 2023-12-19T18:58:46.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.796+0000 7f5a548c7640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5a50072090 0x7f5a5015b4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42422/0 (socket says 172.21.15.133:42422) 2023-12-19T18:58:46.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.796+0000 7f5a548c7640 1 -- 172.21.15.133:0/1737210114 learned_addr learned my addr 172.21.15.133:0/1737210114 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:46.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.796+0000 7f5a4ffff640 1 --2- 172.21.15.133:0/1737210114 >> v2:172.21.15.138:3300/0 conn(0x7f5a500a5370 0x7f5a500c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:46.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.796+0000 7f5a4effd640 1 -- 172.21.15.133:0/1737210114 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1118134041 0 0) 0x7f5a500c2760 con 0x7f5a50072090 2023-12-19T18:58:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.796+0000 7f5a4effd640 1 -- 172.21.15.133:0/1737210114 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a38003530 con 0x7f5a50072090 2023-12-19T18:58:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.796+0000 7f5a4ffff640 1 -- 172.21.15.133:0/1737210114 >> v1:172.21.15.138:6789/0 conn(0x7f5a500c4110 legacy=0x7f5a50150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.796+0000 7f5a4ffff640 1 -- 172.21.15.133:0/1737210114 >> v1:172.21.15.133:6789/0 conn(0x7f5a50072090 legacy=0x7f5a5015b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:46.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.796+0000 7f5a4ffff640 1 -- 172.21.15.133:0/1737210114 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a500aad20 con 0x7f5a500a5370 2023-12-19T18:58:46.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.800+0000 7f5a4ffff640 1 --2- 172.21.15.133:0/1737210114 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a500a5370 0x7f5a500c3bd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5a400097c0 tx=0x7f5a4001e540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f763eca6a4ffad2c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:46.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.800+0000 7f5a4effd640 1 -- 172.21.15.133:0/1737210114 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a400ab610 con 0x7f5a500a5370 2023-12-19T18:58:46.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.800+0000 7f5a4effd640 1 -- 172.21.15.133:0/1737210114 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a400ab770 con 0x7f5a500a5370 2023-12-19T18:58:46.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.800+0000 7f5a4effd640 1 -- 172.21.15.133:0/1737210114 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a400abb00 con 0x7f5a500a5370 2023-12-19T18:58:46.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.800+0000 7f5a5632a640 1 -- 172.21.15.133:0/1737210114 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a500a5370 msgr2=0x7f5a500c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:46.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.800+0000 7f5a5632a640 1 --2- 172.21.15.133:0/1737210114 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a500a5370 0x7f5a500c3bd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5a400097c0 tx=0x7f5a4001e540 comp rx=0 tx=0).stop 2023-12-19T18:58:46.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.800+0000 7f5a5632a640 1 -- 172.21.15.133:0/1737210114 shutdown_connections 2023-12-19T18:58:46.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.800+0000 7f5a5632a640 1 --2- 172.21.15.133:0/1737210114 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a500a5370 0x7f5a500c3bd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:46.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.800+0000 7f5a5632a640 1 -- 172.21.15.133:0/1737210114 >> 172.21.15.133:0/1737210114 conn(0x7f5a5006a5b0 msgr2=0x7f5a5006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:46.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.800+0000 7f5a5632a640 1 -- 172.21.15.133:0/1737210114 shutdown_connections 2023-12-19T18:58:46.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.800+0000 7f5a5632a640 1 -- 172.21.15.133:0/1737210114 wait complete. 2023-12-19T18:58:46.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.800+0000 7f5a5632a640 1 Processor -- start 2023-12-19T18:58:46.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.800+0000 7f5a5632a640 1 -- start start 2023-12-19T18:58:46.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a5632a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a50072090 0x7f5a5014fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:46.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a5632a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a500a5370 0x7f5a5014b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:46.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a5632a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5a500c4110 0x7f5a501ee7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:46.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a5632a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a50150320 con 0x7f5a50072090 2023-12-19T18:58:46.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a5632a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5014e9a0 con 0x7f5a500a5370 2023-12-19T18:58:46.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a5632a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5014ef60 con 0x7f5a500c4110 2023-12-19T18:58:46.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a4ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a50072090 0x7f5a5014fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:46.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a4ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a50072090 0x7f5a5014fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54330/0 (socket says 172.21.15.133:54330) 2023-12-19T18:58:46.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a4ffff640 1 -- 172.21.15.133:0/3383061069 learned_addr learned my addr 172.21.15.133:0/3383061069 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a4f7fe640 1 --2- 172.21.15.133:0/3383061069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a500a5370 0x7f5a5014b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a548c7640 1 --2- 172.21.15.133:0/3383061069 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5a500c4110 0x7f5a501ee7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a4ffff640 1 -- 172.21.15.133:0/3383061069 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5a500c4110 msgr2=0x7f5a501ee7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a4ffff640 1 --2- 172.21.15.133:0/3383061069 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5a500c4110 0x7f5a501ee7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a4ffff640 1 -- 172.21.15.133:0/3383061069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a500a5370 msgr2=0x7f5a5014b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:46.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a4ffff640 1 --2- 172.21.15.133:0/3383061069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a500a5370 0x7f5a5014b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a4ffff640 1 -- 172.21.15.133:0/3383061069 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a40009420 con 0x7f5a50072090 2023-12-19T18:58:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a4f7fe640 1 --2- 172.21.15.133:0/3383061069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a500a5370 0x7f5a5014b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a548c7640 1 --2- 172.21.15.133:0/3383061069 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5a500c4110 0x7f5a501ee7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a4ffff640 1 --2- 172.21.15.133:0/3383061069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a50072090 0x7f5a5014fde0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5a400ad040 tx=0x7f5a4001cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a4cff9640 1 -- 172.21.15.133:0/3383061069 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a400ab610 con 0x7f5a50072090 2023-12-19T18:58:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a4cff9640 1 -- 172.21.15.133:0/3383061069 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a400b7070 con 0x7f5a50072090 2023-12-19T18:58:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a4cff9640 1 -- 172.21.15.133:0/3383061069 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a400be6c0 con 0x7f5a50072090 2023-12-19T18:58:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a5632a640 1 -- 172.21.15.133:0/3383061069 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a50149e90 con 0x7f5a50072090 2023-12-19T18:58:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a5632a640 1 -- 172.21.15.133:0/3383061069 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a5014a130 con 0x7f5a50072090 2023-12-19T18:58:46.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.804+0000 7f5a5632a640 1 -- 172.21.15.133:0/3383061069 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a50068400 con 0x7f5a50072090 2023-12-19T18:58:46.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.808+0000 7f5a4cff9640 1 -- 172.21.15.133:0/3383061069 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5a400be820 con 0x7f5a50072090 2023-12-19T18:58:46.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.808+0000 7f5a4cff9640 1 --2- 172.21.15.133:0/3383061069 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5a3c066470 0x7f5a3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:46.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.808+0000 7f5a4cff9640 1 -- 172.21.15.133:0/3383061069 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a400b9070 con 0x7f5a50072090 2023-12-19T18:58:46.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.808+0000 7f5a4f7fe640 1 --2- 172.21.15.133:0/3383061069 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5a3c066470 0x7f5a3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:46.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.808+0000 7f5a4f7fe640 1 --2- 172.21.15.133:0/3383061069 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5a3c066470 0x7f5a3c068930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5a500a7680 tx=0x7f5a44009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:46.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.812+0000 7f5a4cff9640 1 -- 172.21.15.133:0/3383061069 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5a400ebca0 con 0x7f5a50072090 2023-12-19T18:58:47.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.992+0000 7f5a5632a640 1 -- 172.21.15.133:0/3383061069 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a500c6780 con 0x7f5a50072090 2023-12-19T18:58:47.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.996+0000 7f5a4cff9640 1 -- 172.21.15.133:0/3383061069 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f5a400c3020 con 0x7f5a50072090 2023-12-19T18:58:47.000 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:47.000 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6836/2938414361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":2938414361},{"type":"v1","addr":"172.21.15.138:6836","nonce":2938414361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/4017805684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6835","nonce":4017805684},{"type":"v1","addr":"172.21.15.138:6837","nonce":4017805684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/1350101028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1350101028},{"type":"v1","addr":"172.21.15.133:6834","nonce":1350101028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:58:42.786720+0000","modified":"2023-12-19T18:58:46.003120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/615053717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":615053717},{"type":"v1","addr":"172.21.15.133:6835","nonce":615053717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T18:58:47.001 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 8 2023-12-19T18:58:47.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.996+0000 7f5a5632a640 1 -- 172.21.15.133:0/3383061069 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5a3c066470 msgr2=0x7f5a3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:47.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.996+0000 7f5a5632a640 1 --2- 172.21.15.133:0/3383061069 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5a3c066470 0x7f5a3c068930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5a500a7680 tx=0x7f5a44009040 comp rx=0 tx=0).stop 2023-12-19T18:58:47.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.996+0000 7f5a5632a640 1 -- 172.21.15.133:0/3383061069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a50072090 msgr2=0x7f5a5014fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:47.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.996+0000 7f5a5632a640 1 --2- 172.21.15.133:0/3383061069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a50072090 0x7f5a5014fde0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5a400ad040 tx=0x7f5a4001cd80 comp rx=0 tx=0).stop 2023-12-19T18:58:47.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.996+0000 7f5a5632a640 1 -- 172.21.15.133:0/3383061069 shutdown_connections 2023-12-19T18:58:47.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.996+0000 7f5a5632a640 1 --2- 172.21.15.133:0/3383061069 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5a3c066470 0x7f5a3c068930 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.996+0000 7f5a5632a640 1 --2- 172.21.15.133:0/3383061069 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5a500c4110 0x7f5a501ee7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.996+0000 7f5a5632a640 1 --2- 172.21.15.133:0/3383061069 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a500a5370 0x7f5a5014b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.996+0000 7f5a5632a640 1 --2- 172.21.15.133:0/3383061069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a50072090 0x7f5a5014fde0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.996+0000 7f5a5632a640 1 -- 172.21.15.133:0/3383061069 >> 172.21.15.133:0/3383061069 conn(0x7f5a5006a5b0 msgr2=0x7f5a50150e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:47.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.996+0000 7f5a5632a640 1 -- 172.21.15.133:0/3383061069 shutdown_connections 2023-12-19T18:58:47.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:46.996+0000 7f5a5632a640 1 -- 172.21.15.133:0/3383061069 wait complete. 2023-12-19T18:58:47.020 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:58:47.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.152+0000 7fd876de6640 1 Processor -- start 2023-12-19T18:58:47.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.152+0000 7fd876de6640 1 -- start start 2023-12-19T18:58:47.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.152+0000 7fd876de6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87014ea30 0x7fd8700abe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:47.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.152+0000 7fd876de6640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd87006bc10 0x7fd870070d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:47.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.156+0000 7fd876de6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd87006b6c0 0x7fd870071280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:47.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.156+0000 7fd876de6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd870151ed0 con 0x7fd87006b6c0 2023-12-19T18:58:47.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.156+0000 7fd876de6640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd870152400 con 0x7fd87006bc10 2023-12-19T18:58:47.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.156+0000 7fd876de6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8700738b0 con 0x7fd87014ea30 2023-12-19T18:58:47.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.156+0000 7fd875383640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd87006b6c0 0x7fd870071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:47.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.156+0000 7fd875383640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd87006b6c0 0x7fd870071280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54338/0 (socket says 172.21.15.133:54338) 2023-12-19T18:58:47.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.156+0000 7fd875383640 1 -- 172.21.15.133:0/3266259195 learned_addr learned my addr 172.21.15.133:0/3266259195 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:47.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.156+0000 7fd874b82640 1 --2- 172.21.15.133:0/3266259195 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87014ea30 0x7fd8700abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:47.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.156+0000 7fd86ffff640 1 --2- 172.21.15.133:0/3266259195 >> v2:172.21.15.138:3300/0 conn(0x7fd87006bc10 0x7fd870070d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:47.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.156+0000 7fd875383640 1 -- 172.21.15.133:0/3266259195 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87014ea30 msgr2=0x7fd8700abe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:47.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.156+0000 7fd875383640 1 --2- 172.21.15.133:0/3266259195 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87014ea30 0x7fd8700abe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.156+0000 7fd875383640 1 -- 172.21.15.133:0/3266259195 >> v2:172.21.15.138:3300/0 conn(0x7fd87006bc10 msgr2=0x7fd870070d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:47.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.156+0000 7fd875383640 1 --2- 172.21.15.133:0/3266259195 >> v2:172.21.15.138:3300/0 conn(0x7fd87006bc10 0x7fd870070d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.156+0000 7fd875383640 1 -- 172.21.15.133:0/3266259195 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd870152120 con 0x7fd87006b6c0 2023-12-19T18:58:47.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.156+0000 7fd875383640 1 --2- 172.21.15.133:0/3266259195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd87006b6c0 0x7fd870071280 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd870066d50 tx=0x7fd86801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8c63f9a1c0a3e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:47.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.156+0000 7fd86f7fe640 1 -- 172.21.15.133:0/3266259195 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8680a5710 con 0x7fd87006b6c0 2023-12-19T18:58:47.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.156+0000 7fd86f7fe640 1 -- 172.21.15.133:0/3266259195 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8680a5870 con 0x7fd87006b6c0 2023-12-19T18:58:47.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.156+0000 7fd86f7fe640 1 -- 172.21.15.133:0/3266259195 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8680a5c00 con 0x7fd87006b6c0 2023-12-19T18:58:47.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.160+0000 7fd876de6640 1 -- 172.21.15.133:0/3266259195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd87006b6c0 msgr2=0x7fd870071280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:47.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.160+0000 7fd876de6640 1 --2- 172.21.15.133:0/3266259195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd87006b6c0 0x7fd870071280 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd870066d50 tx=0x7fd86801c8b0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.160+0000 7fd876de6640 1 -- 172.21.15.133:0/3266259195 shutdown_connections 2023-12-19T18:58:47.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.160+0000 7fd876de6640 1 --2- 172.21.15.133:0/3266259195 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd87006b6c0 0x7fd870071280 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.160+0000 7fd876de6640 1 --2- 172.21.15.133:0/3266259195 >> v2:172.21.15.138:3300/0 conn(0x7fd87006bc10 0x7fd870070d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.160+0000 7fd876de6640 1 --2- 172.21.15.133:0/3266259195 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87014ea30 0x7fd8700abe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.160+0000 7fd876de6640 1 -- 172.21.15.133:0/3266259195 >> 172.21.15.133:0/3266259195 conn(0x7fd8700c30c0 msgr2=0x7fd8700c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:47.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.160+0000 7fd876de6640 1 -- 172.21.15.133:0/3266259195 shutdown_connections 2023-12-19T18:58:47.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.160+0000 7fd876de6640 1 -- 172.21.15.133:0/3266259195 wait complete. 2023-12-19T18:58:47.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.160+0000 7fd876de6640 1 Processor -- start 2023-12-19T18:58:47.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.160+0000 7fd876de6640 1 -- start start 2023-12-19T18:58:47.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.160+0000 7fd876de6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd87006b6c0 0x7fd87015c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:47.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.160+0000 7fd876de6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd87006bc10 0x7fd8700bdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:47.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.160+0000 7fd876de6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87014ea30 0x7fd8700bb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:47.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.160+0000 7fd876de6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8700be190 con 0x7fd87006bc10 2023-12-19T18:58:47.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.160+0000 7fd876de6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8701f0540 con 0x7fd87006b6c0 2023-12-19T18:58:47.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.160+0000 7fd876de6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87015be70 con 0x7fd87014ea30 2023-12-19T18:58:47.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.160+0000 7fd86ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd87006bc10 0x7fd8700bdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:47.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.160+0000 7fd86ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd87006bc10 0x7fd8700bdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54354/0 (socket says 172.21.15.133:54354) 2023-12-19T18:58:47.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.160+0000 7fd86ffff640 1 -- 172.21.15.133:0/833317242 learned_addr learned my addr 172.21.15.133:0/833317242 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:47.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.160+0000 7fd875383640 1 --2- 172.21.15.133:0/833317242 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87014ea30 0x7fd8700bb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:47.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.160+0000 7fd874b82640 1 --2- 172.21.15.133:0/833317242 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd87006b6c0 0x7fd87015c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:47.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.160+0000 7fd86ffff640 1 -- 172.21.15.133:0/833317242 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87014ea30 msgr2=0x7fd8700bb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:47.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.164+0000 7fd86ffff640 1 --2- 172.21.15.133:0/833317242 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87014ea30 0x7fd8700bb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.164+0000 7fd86ffff640 1 -- 172.21.15.133:0/833317242 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd87006b6c0 msgr2=0x7fd87015c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:47.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.164+0000 7fd86ffff640 1 --2- 172.21.15.133:0/833317242 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd87006b6c0 0x7fd87015c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.164+0000 7fd86ffff640 1 -- 172.21.15.133:0/833317242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd868009b30 con 0x7fd87006bc10 2023-12-19T18:58:47.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.164+0000 7fd874b82640 1 --2- 172.21.15.133:0/833317242 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd87006b6c0 0x7fd87015c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:47.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.164+0000 7fd875383640 1 --2- 172.21.15.133:0/833317242 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87014ea30 0x7fd8700bb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:47.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.164+0000 7fd86ffff640 1 --2- 172.21.15.133:0/833317242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd87006bc10 0x7fd8700bdc50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00e840 tx=0x7fd85c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:47.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.164+0000 7fd86d7fa640 1 -- 172.21.15.133:0/833317242 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c00c730 con 0x7fd87006bc10 2023-12-19T18:58:47.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.164+0000 7fd86d7fa640 1 -- 172.21.15.133:0/833317242 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c00c890 con 0x7fd87006bc10 2023-12-19T18:58:47.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.164+0000 7fd876de6640 1 -- 172.21.15.133:0/833317242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd87015c150 con 0x7fd87006bc10 2023-12-19T18:58:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.164+0000 7fd86d7fa640 1 -- 172.21.15.133:0/833317242 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c00cc40 con 0x7fd87006bc10 2023-12-19T18:58:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.164+0000 7fd876de6640 1 -- 172.21.15.133:0/833317242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8700bbb20 con 0x7fd87006bc10 2023-12-19T18:58:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.164+0000 7fd876de6640 1 -- 172.21.15.133:0/833317242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87015ce90 con 0x7fd87006bc10 2023-12-19T18:58:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.164+0000 7fd86d7fa640 1 -- 172.21.15.133:0/833317242 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd85c013470 con 0x7fd87006bc10 2023-12-19T18:58:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.164+0000 7fd86d7fa640 1 --2- 172.21.15.133:0/833317242 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd854066470 0x7fd854068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.164+0000 7fd86d7fa640 1 -- 172.21.15.133:0/833317242 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd85c083e60 con 0x7fd87006bc10 2023-12-19T18:58:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.164+0000 7fd874b82640 1 --2- 172.21.15.133:0/833317242 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd854066470 0x7fd854068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:47.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.168+0000 7fd874b82640 1 --2- 172.21.15.133:0/833317242 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd854066470 0x7fd854068930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd864009a40 tx=0x7fd864008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:47.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.168+0000 7fd86d7fa640 1 -- 172.21.15.133:0/833317242 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd85c0512d0 con 0x7fd87006bc10 2023-12-19T18:58:47.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.320+0000 7fd876de6640 1 -- 172.21.15.133:0/833317242 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd870068400 con 0x7fd87006bc10 2023-12-19T18:58:47.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.320+0000 7fd86d7fa640 1 -- 172.21.15.133:0/833317242 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fd85c0548f0 con 0x7fd87006bc10 2023-12-19T18:58:47.325 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:47.325 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:44.402984+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:58:40.991408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T18:58:41.773992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:58:47.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.324+0000 7fd876de6640 1 -- 172.21.15.133:0/833317242 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd854066470 msgr2=0x7fd854068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:47.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.324+0000 7fd876de6640 1 --2- 172.21.15.133:0/833317242 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd854066470 0x7fd854068930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd864009a40 tx=0x7fd864008040 comp rx=0 tx=0).stop 2023-12-19T18:58:47.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.324+0000 7fd876de6640 1 -- 172.21.15.133:0/833317242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd87006bc10 msgr2=0x7fd8700bdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:47.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.324+0000 7fd876de6640 1 --2- 172.21.15.133:0/833317242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd87006bc10 0x7fd8700bdc50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd85c00e840 tx=0x7fd85c00ed00 comp rx=0 tx=0).stop 2023-12-19T18:58:47.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.324+0000 7fd876de6640 1 -- 172.21.15.133:0/833317242 shutdown_connections 2023-12-19T18:58:47.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.324+0000 7fd876de6640 1 --2- 172.21.15.133:0/833317242 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd854066470 0x7fd854068930 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.324+0000 7fd876de6640 1 --2- 172.21.15.133:0/833317242 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd87014ea30 0x7fd8700bb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.324+0000 7fd876de6640 1 --2- 172.21.15.133:0/833317242 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd87006bc10 0x7fd8700bdc50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.324+0000 7fd876de6640 1 --2- 172.21.15.133:0/833317242 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd87006b6c0 0x7fd87015c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.324+0000 7fd876de6640 1 -- 172.21.15.133:0/833317242 >> 172.21.15.133:0/833317242 conn(0x7fd8700c30c0 msgr2=0x7fd8700c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:47.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.324+0000 7fd876de6640 1 -- 172.21.15.133:0/833317242 shutdown_connections 2023-12-19T18:58:47.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.324+0000 7fd876de6640 1 -- 172.21.15.133:0/833317242 wait complete. 2023-12-19T18:58:47.346 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T18:58:47.347 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T18:58:47.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.480+0000 7f5d12832640 1 Processor -- start 2023-12-19T18:58:47.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.480+0000 7f5d12832640 1 -- start start 2023-12-19T18:58:47.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.480+0000 7f5d12832640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5d0c0c4100 0x7f5d0c0c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:47.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.480+0000 7f5d12832640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d0c0c31c0 con 0x7f5d0c0c06d0 2023-12-19T18:58:47.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.480+0000 7f5d12832640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d0c0c34a0 con 0x7f5d0c0c63c0 2023-12-19T18:58:47.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.480+0000 7f5d12832640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d0c0c1030 con 0x7f5d0c0c4100 2023-12-19T18:58:47.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.480+0000 7f5d0b7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5d0c0c4100 0x7f5d0c0c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:47.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.480+0000 7f5d10dcf640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5d0c0c06d0 0x7f5d0c0a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42432/0 (socket says 172.21.15.133:42432) 2023-12-19T18:58:47.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.480+0000 7f5d10dcf640 1 -- 172.21.15.133:0/907598543 learned_addr learned my addr 172.21.15.133:0/907598543 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:47.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.480+0000 7f5d0affd640 1 -- 172.21.15.133:0/907598543 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1182580152 0 0) 0x7f5d0c0c31c0 con 0x7f5d0c0c06d0 2023-12-19T18:58:47.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.480+0000 7f5d0affd640 1 -- 172.21.15.133:0/907598543 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cf4003530 con 0x7f5d0c0c06d0 2023-12-19T18:58:47.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.480+0000 7f5d0b7fe640 1 -- 172.21.15.133:0/907598543 >> v1:172.21.15.138:6789/0 conn(0x7f5d0c0c63c0 legacy=0x7f5d0c0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:47.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.480+0000 7f5d0b7fe640 1 -- 172.21.15.133:0/907598543 >> v1:172.21.15.133:6789/0 conn(0x7f5d0c0c06d0 legacy=0x7f5d0c0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:47.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.480+0000 7f5d0b7fe640 1 -- 172.21.15.133:0/907598543 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0c0c1310 con 0x7f5d0c0c4100 2023-12-19T18:58:47.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.484+0000 7f5d0b7fe640 1 --2- 172.21.15.133:0/907598543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d0c0c4100 0x7f5d0c0c2bb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d000097c0 tx=0x7f5d0001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69626983d273858 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:47.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.484+0000 7f5d0affd640 1 -- 172.21.15.133:0/907598543 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d000ab600 con 0x7f5d0c0c4100 2023-12-19T18:58:47.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.484+0000 7f5d0affd640 1 -- 172.21.15.133:0/907598543 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d000a7050 con 0x7f5d0c0c4100 2023-12-19T18:58:47.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.484+0000 7f5d0affd640 1 -- 172.21.15.133:0/907598543 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d000ab980 con 0x7f5d0c0c4100 2023-12-19T18:58:47.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.484+0000 7f5d12832640 1 -- 172.21.15.133:0/907598543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d0c0c4100 msgr2=0x7f5d0c0c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:47.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.484+0000 7f5d12832640 1 --2- 172.21.15.133:0/907598543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d0c0c4100 0x7f5d0c0c2bb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5d000097c0 tx=0x7f5d0001c360 comp rx=0 tx=0).stop 2023-12-19T18:58:47.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.484+0000 7f5d12832640 1 -- 172.21.15.133:0/907598543 shutdown_connections 2023-12-19T18:58:47.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.484+0000 7f5d12832640 1 --2- 172.21.15.133:0/907598543 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d0c0c4100 0x7f5d0c0c2bb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.484+0000 7f5d12832640 1 -- 172.21.15.133:0/907598543 >> 172.21.15.133:0/907598543 conn(0x7f5d0c06a5b0 msgr2=0x7f5d0c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:47.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.484+0000 7f5d12832640 1 -- 172.21.15.133:0/907598543 shutdown_connections 2023-12-19T18:58:47.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.484+0000 7f5d12832640 1 -- 172.21.15.133:0/907598543 wait complete. 2023-12-19T18:58:47.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.488+0000 7f5d12832640 1 Processor -- start 2023-12-19T18:58:47.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.488+0000 7f5d12832640 1 -- start start 2023-12-19T18:58:47.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.488+0000 7f5d12832640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d0c0c06d0 0x7f5d0c153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:47.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.488+0000 7f5d12832640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d0c0c4100 0x7f5d0c153cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:47.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.488+0000 7f5d12832640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d0c0c63c0 0x7f5d0c0bf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:47.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.488+0000 7f5d12832640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c0a50e0 con 0x7f5d0c0c06d0 2023-12-19T18:58:47.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.488+0000 7f5d12832640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c152db0 con 0x7f5d0c0c63c0 2023-12-19T18:58:47.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.488+0000 7f5d12832640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c153840 con 0x7f5d0c0c4100 2023-12-19T18:58:47.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.488+0000 7f5d0bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d0c0c06d0 0x7f5d0c153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:47.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.488+0000 7f5d0bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d0c0c06d0 0x7f5d0c153300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54368/0 (socket says 172.21.15.133:54368) 2023-12-19T18:58:47.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.488+0000 7f5d0bfff640 1 -- 172.21.15.133:0/2090845463 learned_addr learned my addr 172.21.15.133:0/2090845463 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:47.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.488+0000 7f5d0bfff640 1 -- 172.21.15.133:0/2090845463 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d0c0c4100 msgr2=0x7f5d0c153cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:47.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.488+0000 7f5d0bfff640 1 --2- 172.21.15.133:0/2090845463 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d0c0c4100 0x7f5d0c153cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.488+0000 7f5d0bfff640 1 -- 172.21.15.133:0/2090845463 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d0c0c63c0 msgr2=0x7f5d0c0bf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:47.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.488+0000 7f5d0bfff640 1 --2- 172.21.15.133:0/2090845463 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d0c0c63c0 0x7f5d0c0bf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.488+0000 7f5d0bfff640 1 -- 172.21.15.133:0/2090845463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d00009420 con 0x7f5d0c0c06d0 2023-12-19T18:58:47.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.488+0000 7f5d0bfff640 1 --2- 172.21.15.133:0/2090845463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d0c0c06d0 0x7f5d0c153300 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc00c3f0 tx=0x7f5cfc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:47.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.488+0000 7f5d08ff9640 1 -- 172.21.15.133:0/2090845463 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc0052d0 con 0x7f5d0c0c06d0 2023-12-19T18:58:47.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.488+0000 7f5d08ff9640 1 -- 172.21.15.133:0/2090845463 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cfc005430 con 0x7f5d0c0c06d0 2023-12-19T18:58:47.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.488+0000 7f5d12832640 1 -- 172.21.15.133:0/2090845463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d0c153020 con 0x7f5d0c0c06d0 2023-12-19T18:58:47.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.488+0000 7f5d08ff9640 1 -- 172.21.15.133:0/2090845463 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc003840 con 0x7f5d0c0c06d0 2023-12-19T18:58:47.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.488+0000 7f5d12832640 1 -- 172.21.15.133:0/2090845463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d0c154230 con 0x7f5d0c0c06d0 2023-12-19T18:58:47.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.488+0000 7f5d12832640 1 -- 172.21.15.133:0/2090845463 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d0c068400 con 0x7f5d0c0c06d0 2023-12-19T18:58:47.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.492+0000 7f5d08ff9640 1 -- 172.21.15.133:0/2090845463 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5cfc0039a0 con 0x7f5d0c0c06d0 2023-12-19T18:58:47.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.492+0000 7f5d08ff9640 1 --2- 172.21.15.133:0/2090845463 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5cf80664a0 0x7f5cf8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:47.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.492+0000 7f5d08ff9640 1 -- 172.21.15.133:0/2090845463 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5cfc083400 con 0x7f5d0c0c06d0 2023-12-19T18:58:47.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.492+0000 7f5d0b7fe640 1 --2- 172.21.15.133:0/2090845463 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5cf80664a0 0x7f5cf8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:47.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.492+0000 7f5d0b7fe640 1 --2- 172.21.15.133:0/2090845463 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5cf80664a0 0x7f5cf8068960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5d000ad000 tx=0x7f5d00004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:47.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.496+0000 7f5d08ff9640 1 -- 172.21.15.133:0/2090845463 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5cfc050870 con 0x7f5d0c0c06d0 2023-12-19T18:58:47.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.644+0000 7f5d12832640 1 -- 172.21.15.133:0/2090845463 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5d0c0a7160 con 0x7f5cf80664a0 2023-12-19T18:58:47.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.652+0000 7f5d08ff9640 1 -- 172.21.15.133:0/2090845463 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264636 (secure 0 0 0) 0x7f5d0c0a7160 con 0x7f5cf80664a0 2023-12-19T18:58:47.660 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:47.662 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T18:58:47.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.656+0000 7f5d12832640 1 -- 172.21.15.133:0/2090845463 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5cf80664a0 msgr2=0x7f5cf8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:47.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.656+0000 7f5d12832640 1 --2- 172.21.15.133:0/2090845463 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5cf80664a0 0x7f5cf8068960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5d000ad000 tx=0x7f5d00004740 comp rx=0 tx=0).stop 2023-12-19T18:58:47.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.656+0000 7f5d12832640 1 -- 172.21.15.133:0/2090845463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d0c0c06d0 msgr2=0x7f5d0c153300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:47.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.656+0000 7f5d12832640 1 --2- 172.21.15.133:0/2090845463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d0c0c06d0 0x7f5d0c153300 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc00c3f0 tx=0x7f5cfc00c8b0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.656+0000 7f5d12832640 1 -- 172.21.15.133:0/2090845463 shutdown_connections 2023-12-19T18:58:47.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.656+0000 7f5d12832640 1 --2- 172.21.15.133:0/2090845463 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5cf80664a0 0x7f5cf8068960 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.656+0000 7f5d12832640 1 --2- 172.21.15.133:0/2090845463 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d0c0c63c0 0x7f5d0c0bf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.656+0000 7f5d12832640 1 --2- 172.21.15.133:0/2090845463 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d0c0c4100 0x7f5d0c153cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.656+0000 7f5d12832640 1 --2- 172.21.15.133:0/2090845463 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d0c0c06d0 0x7f5d0c153300 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.656+0000 7f5d12832640 1 -- 172.21.15.133:0/2090845463 >> 172.21.15.133:0/2090845463 conn(0x7f5d0c06a5b0 msgr2=0x7f5d0c06ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:47.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.656+0000 7f5d12832640 1 -- 172.21.15.133:0/2090845463 shutdown_connections 2023-12-19T18:58:47.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.656+0000 7f5d12832640 1 -- 172.21.15.133:0/2090845463 wait complete. 2023-12-19T18:58:47.680 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-19T18:58:46.832859+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218948,"kb_used_data":2772,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755772,"statfs":{"total":773094113280,"available":772869910528,"internally_reserved":0,"allocated":2838528,"data_stored":1726617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.438853"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421033+0000","last_change":"2023-12-19T18:58:43.434692+0000","last_active":"2023-12-19T18:58:44.421033+0000","last_peered":"2023-12-19T18:58:44.421033+0000","last_clean":"2023-12-19T18:58:44.421033+0000","last_became_active":"2023-12-19T18:58:43.434368+0000","last_became_peered":"2023-12-19T18:58:43.434368+0000","last_unstale":"2023-12-19T18:58:44.421033+0000","last_undegraded":"2023-12-19T18:58:44.421033+0000","last_fullsized":"2023-12-19T18:58:44.421033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:46.807064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.416161+0000","last_change":"2023-12-19T18:58:43.425595+0000","last_active":"2023-12-19T18:58:44.416161+0000","last_peered":"2023-12-19T18:58:44.416161+0000","last_clean":"2023-12-19T18:58:44.416161+0000","last_became_active":"2023-12-19T18:58:43.425304+0000","last_became_peered":"2023-12-19T18:58:43.425304+0000","last_unstale":"2023-12-19T18:58:44.416161+0000","last_undegraded":"2023-12-19T18:58:44.416161+0000","last_fullsized":"2023-12-19T18:58:44.416161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:55:56.534047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544103+0000","last_change":"2023-12-19T18:58:43.415732+0000","last_active":"2023-12-19T18:58:45.544103+0000","last_peered":"2023-12-19T18:58:45.544103+0000","last_clean":"2023-12-19T18:58:45.544103+0000","last_became_active":"2023-12-19T18:58:43.415405+0000","last_became_peered":"2023-12-19T18:58:43.415405+0000","last_unstale":"2023-12-19T18:58:45.544103+0000","last_undegraded":"2023-12-19T18:58:45.544103+0000","last_fullsized":"2023-12-19T18:58:45.544103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:26.526749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544521+0000","last_change":"2023-12-19T18:58:43.441973+0000","last_active":"2023-12-19T18:58:45.544521+0000","last_peered":"2023-12-19T18:58:45.544521+0000","last_clean":"2023-12-19T18:58:45.544521+0000","last_became_active":"2023-12-19T18:58:43.437056+0000","last_became_peered":"2023-12-19T18:58:43.437056+0000","last_unstale":"2023-12-19T18:58:45.544521+0000","last_undegraded":"2023-12-19T18:58:45.544521+0000","last_fullsized":"2023-12-19T18:58:45.544521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:32.378596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420316+0000","last_change":"2023-12-19T18:58:43.427263+0000","last_active":"2023-12-19T18:58:44.420316+0000","last_peered":"2023-12-19T18:58:44.420316+0000","last_clean":"2023-12-19T18:58:44.420316+0000","last_became_active":"2023-12-19T18:58:43.426417+0000","last_became_peered":"2023-12-19T18:58:43.426417+0000","last_unstale":"2023-12-19T18:58:44.420316+0000","last_undegraded":"2023-12-19T18:58:44.420316+0000","last_fullsized":"2023-12-19T18:58:44.420316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:55:56.534047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544646+0000","last_change":"2023-12-19T18:58:43.438027+0000","last_active":"2023-12-19T18:58:45.544646+0000","last_peered":"2023-12-19T18:58:45.544646+0000","last_clean":"2023-12-19T18:58:45.544646+0000","last_became_active":"2023-12-19T18:58:43.437711+0000","last_became_peered":"2023-12-19T18:58:43.437711+0000","last_unstale":"2023-12-19T18:58:45.544646+0000","last_undegraded":"2023-12-19T18:58:45.544646+0000","last_fullsized":"2023-12-19T18:58:45.544646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:59:46.730223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420590+0000","last_change":"2023-12-19T18:58:43.431331+0000","last_active":"2023-12-19T18:58:44.420590+0000","last_peered":"2023-12-19T18:58:44.420590+0000","last_clean":"2023-12-19T18:58:44.420590+0000","last_became_active":"2023-12-19T18:58:43.430968+0000","last_became_peered":"2023-12-19T18:58:43.430968+0000","last_unstale":"2023-12-19T18:58:44.420590+0000","last_undegraded":"2023-12-19T18:58:44.420590+0000","last_fullsized":"2023-12-19T18:58:44.420590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:32:14.763407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792363+0000","last_change":"2023-12-19T18:58:43.443194+0000","last_active":"2023-12-19T18:58:44.792363+0000","last_peered":"2023-12-19T18:58:44.792363+0000","last_clean":"2023-12-19T18:58:44.792363+0000","last_became_active":"2023-12-19T18:58:43.442961+0000","last_became_peered":"2023-12-19T18:58:43.442961+0000","last_unstale":"2023-12-19T18:58:44.792363+0000","last_undegraded":"2023-12-19T18:58:44.792363+0000","last_fullsized":"2023-12-19T18:58:44.792363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:30.896504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421106+0000","last_change":"2023-12-19T18:58:43.443640+0000","last_active":"2023-12-19T18:58:44.421106+0000","last_peered":"2023-12-19T18:58:44.421106+0000","last_clean":"2023-12-19T18:58:44.421106+0000","last_became_active":"2023-12-19T18:58:43.443310+0000","last_became_peered":"2023-12-19T18:58:43.443310+0000","last_unstale":"2023-12-19T18:58:44.421106+0000","last_undegraded":"2023-12-19T18:58:44.421106+0000","last_fullsized":"2023-12-19T18:58:44.421106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:43:58.809550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544614+0000","last_change":"2023-12-19T18:58:43.445525+0000","last_active":"2023-12-19T18:58:45.544614+0000","last_peered":"2023-12-19T18:58:45.544614+0000","last_clean":"2023-12-19T18:58:45.544614+0000","last_became_active":"2023-12-19T18:58:43.445220+0000","last_became_peered":"2023-12-19T18:58:43.445220+0000","last_unstale":"2023-12-19T18:58:45.544614+0000","last_undegraded":"2023-12-19T18:58:45.544614+0000","last_fullsized":"2023-12-19T18:58:45.544614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:46.373291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544393+0000","last_change":"2023-12-19T18:58:43.439159+0000","last_active":"2023-12-19T18:58:45.544393+0000","last_peered":"2023-12-19T18:58:45.544393+0000","last_clean":"2023-12-19T18:58:45.544393+0000","last_became_active":"2023-12-19T18:58:43.438873+0000","last_became_peered":"2023-12-19T18:58:43.438873+0000","last_unstale":"2023-12-19T18:58:45.544393+0000","last_undegraded":"2023-12-19T18:58:45.544393+0000","last_fullsized":"2023-12-19T18:58:45.544393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:07.498358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421186+0000","last_change":"2023-12-19T18:58:43.432338+0000","last_active":"2023-12-19T18:58:44.421186+0000","last_peered":"2023-12-19T18:58:44.421186+0000","last_clean":"2023-12-19T18:58:44.421186+0000","last_became_active":"2023-12-19T18:58:43.431137+0000","last_became_peered":"2023-12-19T18:58:43.431137+0000","last_unstale":"2023-12-19T18:58:44.421186+0000","last_undegraded":"2023-12-19T18:58:44.421186+0000","last_fullsized":"2023-12-19T18:58:44.421186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:36.989421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792689+0000","last_change":"2023-12-19T18:58:43.426477+0000","last_active":"2023-12-19T18:58:44.792689+0000","last_peered":"2023-12-19T18:58:44.792689+0000","last_clean":"2023-12-19T18:58:44.792689+0000","last_became_active":"2023-12-19T18:58:43.426194+0000","last_became_peered":"2023-12-19T18:58:43.426194+0000","last_unstale":"2023-12-19T18:58:44.792689+0000","last_undegraded":"2023-12-19T18:58:44.792689+0000","last_fullsized":"2023-12-19T18:58:44.792689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:55:56.534047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543864+0000","last_change":"2023-12-19T18:58:43.423155+0000","last_active":"2023-12-19T18:58:45.543864+0000","last_peered":"2023-12-19T18:58:45.543864+0000","last_clean":"2023-12-19T18:58:45.543864+0000","last_became_active":"2023-12-19T18:58:43.422822+0000","last_became_peered":"2023-12-19T18:58:43.422822+0000","last_unstale":"2023-12-19T18:58:45.543864+0000","last_undegraded":"2023-12-19T18:58:45.543864+0000","last_fullsized":"2023-12-19T18:58:45.543864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:24:58.295768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415715+0000","last_change":"2023-12-19T18:58:43.438543+0000","last_active":"2023-12-19T18:58:44.415715+0000","last_peered":"2023-12-19T18:58:44.415715+0000","last_clean":"2023-12-19T18:58:44.415715+0000","last_became_active":"2023-12-19T18:58:43.438178+0000","last_became_peered":"2023-12-19T18:58:43.438178+0000","last_unstale":"2023-12-19T18:58:44.415715+0000","last_undegraded":"2023-12-19T18:58:44.415715+0000","last_fullsized":"2023-12-19T18:58:44.415715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:44:04.102356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544103+0000","last_change":"2023-12-19T18:58:43.439649+0000","last_active":"2023-12-19T18:58:45.544103+0000","last_peered":"2023-12-19T18:58:45.544103+0000","last_clean":"2023-12-19T18:58:45.544103+0000","last_became_active":"2023-12-19T18:58:43.436212+0000","last_became_peered":"2023-12-19T18:58:43.436212+0000","last_unstale":"2023-12-19T18:58:45.544103+0000","last_undegraded":"2023-12-19T18:58:45.544103+0000","last_fullsized":"2023-12-19T18:58:45.544103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:07.765261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.545316+0000","last_change":"2023-12-19T18:58:43.441777+0000","last_active":"2023-12-19T18:58:45.545316+0000","last_peered":"2023-12-19T18:58:45.545316+0000","last_clean":"2023-12-19T18:58:45.545316+0000","last_became_active":"2023-12-19T18:58:43.437882+0000","last_became_peered":"2023-12-19T18:58:43.437882+0000","last_unstale":"2023-12-19T18:58:45.545316+0000","last_undegraded":"2023-12-19T18:58:45.545316+0000","last_fullsized":"2023-12-19T18:58:45.545316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:30:56.565777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543404+0000","last_change":"2023-12-19T18:58:43.430270+0000","last_active":"2023-12-19T18:58:45.543404+0000","last_peered":"2023-12-19T18:58:45.543404+0000","last_clean":"2023-12-19T18:58:45.543404+0000","last_became_active":"2023-12-19T18:58:43.429986+0000","last_became_peered":"2023-12-19T18:58:43.429986+0000","last_unstale":"2023-12-19T18:58:45.543404+0000","last_undegraded":"2023-12-19T18:58:45.543404+0000","last_fullsized":"2023-12-19T18:58:45.543404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:36.989421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420819+0000","last_change":"2023-12-19T18:58:43.427486+0000","last_active":"2023-12-19T18:58:44.420819+0000","last_peered":"2023-12-19T18:58:44.420819+0000","last_clean":"2023-12-19T18:58:44.420819+0000","last_became_active":"2023-12-19T18:58:43.427113+0000","last_became_peered":"2023-12-19T18:58:43.427113+0000","last_unstale":"2023-12-19T18:58:44.420819+0000","last_undegraded":"2023-12-19T18:58:44.420819+0000","last_fullsized":"2023-12-19T18:58:44.420819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:11:18.747856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544490+0000","last_change":"2023-12-19T18:58:43.428892+0000","last_active":"2023-12-19T18:58:45.544490+0000","last_peered":"2023-12-19T18:58:45.544490+0000","last_clean":"2023-12-19T18:58:45.544490+0000","last_became_active":"2023-12-19T18:58:43.428437+0000","last_became_peered":"2023-12-19T18:58:43.428437+0000","last_unstale":"2023-12-19T18:58:45.544490+0000","last_undegraded":"2023-12-19T18:58:45.544490+0000","last_fullsized":"2023-12-19T18:58:45.544490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:44:04.102356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544150+0000","last_change":"2023-12-19T18:58:43.426615+0000","last_active":"2023-12-19T18:58:45.544150+0000","last_peered":"2023-12-19T18:58:45.544150+0000","last_clean":"2023-12-19T18:58:45.544150+0000","last_became_active":"2023-12-19T18:58:43.426300+0000","last_became_peered":"2023-12-19T18:58:43.426300+0000","last_unstale":"2023-12-19T18:58:45.544150+0000","last_undegraded":"2023-12-19T18:58:45.544150+0000","last_fullsized":"2023-12-19T18:58:45.544150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:30.896504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544725+0000","last_change":"2023-12-19T18:58:43.436630+0000","last_active":"2023-12-19T18:58:45.544725+0000","last_peered":"2023-12-19T18:58:45.544725+0000","last_clean":"2023-12-19T18:58:45.544725+0000","last_became_active":"2023-12-19T18:58:43.436310+0000","last_became_peered":"2023-12-19T18:58:43.436310+0000","last_unstale":"2023-12-19T18:58:45.544725+0000","last_undegraded":"2023-12-19T18:58:45.544725+0000","last_fullsized":"2023-12-19T18:58:45.544725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:25:40.712335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792474+0000","last_change":"2023-12-19T18:58:43.432208+0000","last_active":"2023-12-19T18:58:44.792474+0000","last_peered":"2023-12-19T18:58:44.792474+0000","last_clean":"2023-12-19T18:58:44.792474+0000","last_became_active":"2023-12-19T18:58:43.431859+0000","last_became_peered":"2023-12-19T18:58:43.431859+0000","last_unstale":"2023-12-19T18:58:44.792474+0000","last_undegraded":"2023-12-19T18:58:44.792474+0000","last_fullsized":"2023-12-19T18:58:44.792474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:44:04.102356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544165+0000","last_change":"2023-12-19T18:58:43.439545+0000","last_active":"2023-12-19T18:58:45.544165+0000","last_peered":"2023-12-19T18:58:45.544165+0000","last_clean":"2023-12-19T18:58:45.544165+0000","last_became_active":"2023-12-19T18:58:43.436090+0000","last_became_peered":"2023-12-19T18:58:43.436090+0000","last_unstale":"2023-12-19T18:58:45.544165+0000","last_undegraded":"2023-12-19T18:58:45.544165+0000","last_fullsized":"2023-12-19T18:58:45.544165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:55:56.534047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792862+0000","last_change":"2023-12-19T18:58:43.430119+0000","last_active":"2023-12-19T18:58:44.792862+0000","last_peered":"2023-12-19T18:58:44.792862+0000","last_clean":"2023-12-19T18:58:44.792862+0000","last_became_active":"2023-12-19T18:58:43.429836+0000","last_became_peered":"2023-12-19T18:58:43.429836+0000","last_unstale":"2023-12-19T18:58:44.792862+0000","last_undegraded":"2023-12-19T18:58:44.792862+0000","last_fullsized":"2023-12-19T18:58:44.792862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:59:46.730223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544665+0000","last_change":"2023-12-19T18:58:43.427764+0000","last_active":"2023-12-19T18:58:45.544665+0000","last_peered":"2023-12-19T18:58:45.544665+0000","last_clean":"2023-12-19T18:58:45.544665+0000","last_became_active":"2023-12-19T18:58:43.427468+0000","last_became_peered":"2023-12-19T18:58:43.427468+0000","last_unstale":"2023-12-19T18:58:45.544665+0000","last_undegraded":"2023-12-19T18:58:45.544665+0000","last_fullsized":"2023-12-19T18:58:45.544665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:34.691494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415960+0000","last_change":"2023-12-19T18:58:43.426942+0000","last_active":"2023-12-19T18:58:44.415960+0000","last_peered":"2023-12-19T18:58:44.415960+0000","last_clean":"2023-12-19T18:58:44.415960+0000","last_became_active":"2023-12-19T18:58:43.425745+0000","last_became_peered":"2023-12-19T18:58:43.425745+0000","last_unstale":"2023-12-19T18:58:44.415960+0000","last_undegraded":"2023-12-19T18:58:44.415960+0000","last_fullsized":"2023-12-19T18:58:44.415960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:07.765261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792753+0000","last_change":"2023-12-19T18:58:43.429529+0000","last_active":"2023-12-19T18:58:44.792753+0000","last_peered":"2023-12-19T18:58:44.792753+0000","last_clean":"2023-12-19T18:58:44.792753+0000","last_became_active":"2023-12-19T18:58:43.429246+0000","last_became_peered":"2023-12-19T18:58:43.429246+0000","last_unstale":"2023-12-19T18:58:44.792753+0000","last_undegraded":"2023-12-19T18:58:44.792753+0000","last_fullsized":"2023-12-19T18:58:44.792753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:32.378596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544186+0000","last_change":"2023-12-19T18:58:43.418652+0000","last_active":"2023-12-19T18:58:45.544186+0000","last_peered":"2023-12-19T18:58:45.544186+0000","last_clean":"2023-12-19T18:58:45.544186+0000","last_became_active":"2023-12-19T18:58:43.418300+0000","last_became_peered":"2023-12-19T18:58:43.418300+0000","last_unstale":"2023-12-19T18:58:45.544186+0000","last_undegraded":"2023-12-19T18:58:45.544186+0000","last_fullsized":"2023-12-19T18:58:45.544186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:07.498358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544797+0000","last_change":"2023-12-19T18:58:43.442141+0000","last_active":"2023-12-19T18:58:45.544797+0000","last_peered":"2023-12-19T18:58:45.544797+0000","last_clean":"2023-12-19T18:58:45.544797+0000","last_became_active":"2023-12-19T18:58:43.437293+0000","last_became_peered":"2023-12-19T18:58:43.437293+0000","last_unstale":"2023-12-19T18:58:45.544797+0000","last_undegraded":"2023-12-19T18:58:45.544797+0000","last_fullsized":"2023-12-19T18:58:45.544797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:19:43.614230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543333+0000","last_change":"2023-12-19T18:58:43.436463+0000","last_active":"2023-12-19T18:58:45.543333+0000","last_peered":"2023-12-19T18:58:45.543333+0000","last_clean":"2023-12-19T18:58:45.543333+0000","last_became_active":"2023-12-19T18:58:43.436125+0000","last_became_peered":"2023-12-19T18:58:43.436125+0000","last_unstale":"2023-12-19T18:58:45.543333+0000","last_undegraded":"2023-12-19T18:58:45.543333+0000","last_fullsized":"2023-12-19T18:58:45.543333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:25:24.585530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544116+0000","last_change":"2023-12-19T18:58:43.426344+0000","last_active":"2023-12-19T18:58:45.544116+0000","last_peered":"2023-12-19T18:58:45.544116+0000","last_clean":"2023-12-19T18:58:45.544116+0000","last_became_active":"2023-12-19T18:58:43.425807+0000","last_became_peered":"2023-12-19T18:58:43.425807+0000","last_unstale":"2023-12-19T18:58:45.544116+0000","last_undegraded":"2023-12-19T18:58:45.544116+0000","last_fullsized":"2023-12-19T18:58:45.544116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:30.896504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420034+0000","last_change":"2023-12-19T18:58:43.426070+0000","last_active":"2023-12-19T18:58:44.420034+0000","last_peered":"2023-12-19T18:58:44.420034+0000","last_clean":"2023-12-19T18:58:44.420034+0000","last_became_active":"2023-12-19T18:58:43.425735+0000","last_became_peered":"2023-12-19T18:58:43.425735+0000","last_unstale":"2023-12-19T18:58:44.420034+0000","last_undegraded":"2023-12-19T18:58:44.420034+0000","last_fullsized":"2023-12-19T18:58:44.420034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:18:46.854237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792732+0000","last_change":"2023-12-19T18:58:42.421402+0000","last_active":"2023-12-19T18:58:44.792732+0000","last_peered":"2023-12-19T18:58:44.792732+0000","last_clean":"2023-12-19T18:58:44.792732+0000","last_became_active":"2023-12-19T18:58:42.420945+0000","last_became_peered":"2023-12-19T18:58:42.420945+0000","last_unstale":"2023-12-19T18:58:44.792732+0000","last_undegraded":"2023-12-19T18:58:44.792732+0000","last_fullsized":"2023-12-19T18:58:44.792732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:15.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544251+0000","last_change":"2023-12-19T18:58:43.422547+0000","last_active":"2023-12-19T18:58:45.544251+0000","last_peered":"2023-12-19T18:58:45.544251+0000","last_clean":"2023-12-19T18:58:45.544251+0000","last_became_active":"2023-12-19T18:58:43.422273+0000","last_became_peered":"2023-12-19T18:58:43.422273+0000","last_unstale":"2023-12-19T18:58:45.544251+0000","last_undegraded":"2023-12-19T18:58:45.544251+0000","last_fullsized":"2023-12-19T18:58:45.544251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:34.691494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544557+0000","last_change":"2023-12-19T18:58:42.417459+0000","last_active":"2023-12-19T18:58:45.544557+0000","last_peered":"2023-12-19T18:58:45.544557+0000","last_clean":"2023-12-19T18:58:45.544557+0000","last_became_active":"2023-12-19T18:58:42.416914+0000","last_became_peered":"2023-12-19T18:58:42.416914+0000","last_unstale":"2023-12-19T18:58:45.544557+0000","last_undegraded":"2023-12-19T18:58:45.544557+0000","last_fullsized":"2023-12-19T18:58:45.544557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:24:57.289171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792561+0000","last_change":"2023-12-19T18:58:42.420750+0000","last_active":"2023-12-19T18:58:44.792561+0000","last_peered":"2023-12-19T18:58:44.792561+0000","last_clean":"2023-12-19T18:58:44.792561+0000","last_became_active":"2023-12-19T18:58:42.420475+0000","last_became_peered":"2023-12-19T18:58:42.420475+0000","last_unstale":"2023-12-19T18:58:44.792561+0000","last_undegraded":"2023-12-19T18:58:44.792561+0000","last_fullsized":"2023-12-19T18:58:44.792561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:24:57.289171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792463+0000","last_change":"2023-12-19T18:58:43.424478+0000","last_active":"2023-12-19T18:58:44.792463+0000","last_peered":"2023-12-19T18:58:44.792463+0000","last_clean":"2023-12-19T18:58:44.792463+0000","last_became_active":"2023-12-19T18:58:43.424162+0000","last_became_peered":"2023-12-19T18:58:43.424162+0000","last_unstale":"2023-12-19T18:58:44.792463+0000","last_undegraded":"2023-12-19T18:58:44.792463+0000","last_fullsized":"2023-12-19T18:58:44.792463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:07.498358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544259+0000","last_change":"2023-12-19T18:58:42.435884+0000","last_active":"2023-12-19T18:58:45.544259+0000","last_peered":"2023-12-19T18:58:45.544259+0000","last_clean":"2023-12-19T18:58:45.544259+0000","last_became_active":"2023-12-19T18:58:42.435572+0000","last_became_peered":"2023-12-19T18:58:42.435572+0000","last_unstale":"2023-12-19T18:58:45.544259+0000","last_undegraded":"2023-12-19T18:58:45.544259+0000","last_fullsized":"2023-12-19T18:58:45.544259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:18:45.847639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415691+0000","last_change":"2023-12-19T18:58:43.424552+0000","last_active":"2023-12-19T18:58:44.415691+0000","last_peered":"2023-12-19T18:58:44.415691+0000","last_clean":"2023-12-19T18:58:44.415691+0000","last_became_active":"2023-12-19T18:58:43.424115+0000","last_became_peered":"2023-12-19T18:58:43.424115+0000","last_unstale":"2023-12-19T18:58:44.415691+0000","last_undegraded":"2023-12-19T18:58:44.415691+0000","last_fullsized":"2023-12-19T18:58:44.415691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:07.498358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544787+0000","last_change":"2023-12-19T18:58:42.428211+0000","last_active":"2023-12-19T18:58:45.544787+0000","last_peered":"2023-12-19T18:58:45.544787+0000","last_clean":"2023-12-19T18:58:45.544787+0000","last_became_active":"2023-12-19T18:58:42.427932+0000","last_became_peered":"2023-12-19T18:58:42.427932+0000","last_unstale":"2023-12-19T18:58:45.544787+0000","last_undegraded":"2023-12-19T18:58:45.544787+0000","last_fullsized":"2023-12-19T18:58:45.544787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:15.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.545103+0000","last_change":"2023-12-19T18:58:43.436839+0000","last_active":"2023-12-19T18:58:45.545103+0000","last_peered":"2023-12-19T18:58:45.545103+0000","last_clean":"2023-12-19T18:58:45.545103+0000","last_became_active":"2023-12-19T18:58:43.436507+0000","last_became_peered":"2023-12-19T18:58:43.436507+0000","last_unstale":"2023-12-19T18:58:45.545103+0000","last_undegraded":"2023-12-19T18:58:45.545103+0000","last_fullsized":"2023-12-19T18:58:45.545103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:11:18.747856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.545217+0000","last_change":"2023-12-19T18:58:42.435020+0000","last_active":"2023-12-19T18:58:45.545217+0000","last_peered":"2023-12-19T18:58:45.545217+0000","last_clean":"2023-12-19T18:58:45.545217+0000","last_became_active":"2023-12-19T18:58:42.434748+0000","last_became_peered":"2023-12-19T18:58:42.434748+0000","last_unstale":"2023-12-19T18:58:45.545217+0000","last_undegraded":"2023-12-19T18:58:45.545217+0000","last_fullsized":"2023-12-19T18:58:45.545217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:33.684897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544236+0000","last_change":"2023-12-19T18:58:43.440137+0000","last_active":"2023-12-19T18:58:45.544236+0000","last_peered":"2023-12-19T18:58:45.544236+0000","last_clean":"2023-12-19T18:58:45.544236+0000","last_became_active":"2023-12-19T18:58:43.439838+0000","last_became_peered":"2023-12-19T18:58:43.439838+0000","last_unstale":"2023-12-19T18:58:45.544236+0000","last_undegraded":"2023-12-19T18:58:45.544236+0000","last_fullsized":"2023-12-19T18:58:45.544236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:44:04.102356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415975+0000","last_change":"2023-12-19T18:58:42.435783+0000","last_active":"2023-12-19T18:58:44.415975+0000","last_peered":"2023-12-19T18:58:44.415975+0000","last_clean":"2023-12-19T18:58:44.415975+0000","last_became_active":"2023-12-19T18:58:42.435495+0000","last_became_peered":"2023-12-19T18:58:42.435495+0000","last_unstale":"2023-12-19T18:58:44.415975+0000","last_undegraded":"2023-12-19T18:58:44.415975+0000","last_fullsized":"2023-12-19T18:58:44.415975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:22:52.459401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421296+0000","last_change":"2023-12-19T18:58:43.430940+0000","last_active":"2023-12-19T18:58:44.421296+0000","last_peered":"2023-12-19T18:58:44.421296+0000","last_clean":"2023-12-19T18:58:44.421296+0000","last_became_active":"2023-12-19T18:58:43.430070+0000","last_became_peered":"2023-12-19T18:58:43.430070+0000","last_unstale":"2023-12-19T18:58:44.421296+0000","last_undegraded":"2023-12-19T18:58:44.421296+0000","last_fullsized":"2023-12-19T18:58:44.421296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:09:00.031482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544605+0000","last_change":"2023-12-19T18:58:42.427819+0000","last_active":"2023-12-19T18:58:45.544605+0000","last_peered":"2023-12-19T18:58:45.544605+0000","last_clean":"2023-12-19T18:58:45.544605+0000","last_became_active":"2023-12-19T18:58:42.426979+0000","last_became_peered":"2023-12-19T18:58:42.426979+0000","last_unstale":"2023-12-19T18:58:45.544605+0000","last_undegraded":"2023-12-19T18:58:45.544605+0000","last_fullsized":"2023-12-19T18:58:45.544605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:22:52.459401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420420+0000","last_change":"2023-12-19T18:58:43.430761+0000","last_active":"2023-12-19T18:58:44.420420+0000","last_peered":"2023-12-19T18:58:44.420420+0000","last_clean":"2023-12-19T18:58:44.420420+0000","last_became_active":"2023-12-19T18:58:43.430368+0000","last_became_peered":"2023-12-19T18:58:43.430368+0000","last_unstale":"2023-12-19T18:58:44.420420+0000","last_undegraded":"2023-12-19T18:58:44.420420+0000","last_fullsized":"2023-12-19T18:58:44.420420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:32.378596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544283+0000","last_change":"2023-12-19T18:58:42.420964+0000","last_active":"2023-12-19T18:58:45.544283+0000","last_peered":"2023-12-19T18:58:45.544283+0000","last_clean":"2023-12-19T18:58:45.544283+0000","last_became_active":"2023-12-19T18:58:42.420575+0000","last_became_peered":"2023-12-19T18:58:42.420575+0000","last_unstale":"2023-12-19T18:58:45.544283+0000","last_undegraded":"2023-12-19T18:58:45.544283+0000","last_fullsized":"2023-12-19T18:58:45.544283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:20:03.601498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543924+0000","last_change":"2023-12-19T18:58:43.426664+0000","last_active":"2023-12-19T18:58:45.543924+0000","last_peered":"2023-12-19T18:58:45.543924+0000","last_clean":"2023-12-19T18:58:45.543924+0000","last_became_active":"2023-12-19T18:58:43.426272+0000","last_became_peered":"2023-12-19T18:58:43.426272+0000","last_unstale":"2023-12-19T18:58:45.543924+0000","last_undegraded":"2023-12-19T18:58:45.543924+0000","last_fullsized":"2023-12-19T18:58:45.543924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:22:53.465998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544822+0000","last_change":"2023-12-19T18:58:42.430255+0000","last_active":"2023-12-19T18:58:45.544822+0000","last_peered":"2023-12-19T18:58:45.544822+0000","last_clean":"2023-12-19T18:58:45.544822+0000","last_became_active":"2023-12-19T18:58:42.429287+0000","last_became_peered":"2023-12-19T18:58:42.429287+0000","last_unstale":"2023-12-19T18:58:45.544822+0000","last_undegraded":"2023-12-19T18:58:45.544822+0000","last_fullsized":"2023-12-19T18:58:45.544822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:06.491761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420450+0000","last_change":"2023-12-19T18:58:43.432077+0000","last_active":"2023-12-19T18:58:44.420450+0000","last_peered":"2023-12-19T18:58:44.420450+0000","last_clean":"2023-12-19T18:58:44.420450+0000","last_became_active":"2023-12-19T18:58:43.431749+0000","last_became_peered":"2023-12-19T18:58:43.431749+0000","last_unstale":"2023-12-19T18:58:44.420450+0000","last_undegraded":"2023-12-19T18:58:44.420450+0000","last_fullsized":"2023-12-19T18:58:44.420450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:25:40.712335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544133+0000","last_change":"2023-12-19T18:58:42.419392+0000","last_active":"2023-12-19T18:58:45.544133+0000","last_peered":"2023-12-19T18:58:45.544133+0000","last_clean":"2023-12-19T18:58:45.544133+0000","last_became_active":"2023-12-19T18:58:42.418044+0000","last_became_peered":"2023-12-19T18:58:42.418044+0000","last_unstale":"2023-12-19T18:58:45.544133+0000","last_undegraded":"2023-12-19T18:58:45.544133+0000","last_fullsized":"2023-12-19T18:58:45.544133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:08:59.024885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544117+0000","last_change":"2023-12-19T18:58:43.426612+0000","last_active":"2023-12-19T18:58:45.544117+0000","last_peered":"2023-12-19T18:58:45.544117+0000","last_clean":"2023-12-19T18:58:45.544117+0000","last_became_active":"2023-12-19T18:58:43.426075+0000","last_became_peered":"2023-12-19T18:58:43.426075+0000","last_unstale":"2023-12-19T18:58:45.544117+0000","last_undegraded":"2023-12-19T18:58:45.544117+0000","last_fullsized":"2023-12-19T18:58:45.544117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:26.526749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543436+0000","last_change":"2023-12-19T18:58:42.427250+0000","last_active":"2023-12-19T18:58:45.543436+0000","last_peered":"2023-12-19T18:58:45.543436+0000","last_clean":"2023-12-19T18:58:45.543436+0000","last_became_active":"2023-12-19T18:58:42.426896+0000","last_became_peered":"2023-12-19T18:58:42.426896+0000","last_unstale":"2023-12-19T18:58:45.543436+0000","last_undegraded":"2023-12-19T18:58:45.543436+0000","last_fullsized":"2023-12-19T18:58:45.543436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:33:01.472458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420680+0000","last_change":"2023-12-19T18:58:43.441063+0000","last_active":"2023-12-19T18:58:44.420680+0000","last_peered":"2023-12-19T18:58:44.420680+0000","last_clean":"2023-12-19T18:58:44.420680+0000","last_became_active":"2023-12-19T18:58:43.440785+0000","last_became_peered":"2023-12-19T18:58:43.440785+0000","last_unstale":"2023-12-19T18:58:44.420680+0000","last_undegraded":"2023-12-19T18:58:44.420680+0000","last_fullsized":"2023-12-19T18:58:44.420680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:28.581319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421328+0000","last_change":"2023-12-19T18:58:42.422976+0000","last_active":"2023-12-19T18:58:44.421328+0000","last_peered":"2023-12-19T18:58:44.421328+0000","last_clean":"2023-12-19T18:58:44.421328+0000","last_became_active":"2023-12-19T18:58:42.422636+0000","last_became_peered":"2023-12-19T18:58:42.422636+0000","last_unstale":"2023-12-19T18:58:44.421328+0000","last_undegraded":"2023-12-19T18:58:44.421328+0000","last_fullsized":"2023-12-19T18:58:44.421328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:33:01.472458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420427+0000","last_change":"2023-12-19T18:58:43.440387+0000","last_active":"2023-12-19T18:58:44.420427+0000","last_peered":"2023-12-19T18:58:44.420427+0000","last_clean":"2023-12-19T18:58:44.420427+0000","last_became_active":"2023-12-19T18:58:43.440084+0000","last_became_peered":"2023-12-19T18:58:43.440084+0000","last_unstale":"2023-12-19T18:58:44.420427+0000","last_undegraded":"2023-12-19T18:58:44.420427+0000","last_fullsized":"2023-12-19T18:58:44.420427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:59:46.730223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543423+0000","last_change":"2023-12-19T18:58:42.427565+0000","last_active":"2023-12-19T18:58:45.543423+0000","last_peered":"2023-12-19T18:58:45.543423+0000","last_clean":"2023-12-19T18:58:45.543423+0000","last_became_active":"2023-12-19T18:58:42.427285+0000","last_became_peered":"2023-12-19T18:58:42.427285+0000","last_unstale":"2023-12-19T18:58:45.543423+0000","last_undegraded":"2023-12-19T18:58:45.543423+0000","last_fullsized":"2023-12-19T18:58:45.543423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:20:03.601498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421120+0000","last_change":"2023-12-19T18:58:43.434643+0000","last_active":"2023-12-19T18:58:44.421120+0000","last_peered":"2023-12-19T18:58:44.421120+0000","last_clean":"2023-12-19T18:58:44.421120+0000","last_became_active":"2023-12-19T18:58:43.434350+0000","last_became_peered":"2023-12-19T18:58:43.434350+0000","last_unstale":"2023-12-19T18:58:44.421120+0000","last_undegraded":"2023-12-19T18:58:44.421120+0000","last_fullsized":"2023-12-19T18:58:44.421120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:30:56.565777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.416075+0000","last_change":"2023-12-19T18:58:42.427501+0000","last_active":"2023-12-19T18:58:44.416075+0000","last_peered":"2023-12-19T18:58:44.416075+0000","last_clean":"2023-12-19T18:58:44.416075+0000","last_became_active":"2023-12-19T18:58:42.427005+0000","last_became_peered":"2023-12-19T18:58:42.427005+0000","last_unstale":"2023-12-19T18:58:44.416075+0000","last_undegraded":"2023-12-19T18:58:44.416075+0000","last_fullsized":"2023-12-19T18:58:44.416075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:25.520152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544894+0000","last_change":"2023-12-19T18:58:43.438327+0000","last_active":"2023-12-19T18:58:45.544894+0000","last_peered":"2023-12-19T18:58:45.544894+0000","last_clean":"2023-12-19T18:58:45.544894+0000","last_became_active":"2023-12-19T18:58:43.436427+0000","last_became_peered":"2023-12-19T18:58:43.436427+0000","last_unstale":"2023-12-19T18:58:45.544894+0000","last_undegraded":"2023-12-19T18:58:45.544894+0000","last_fullsized":"2023-12-19T18:58:45.544894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:28.581319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543362+0000","last_change":"2023-12-19T18:58:42.437129+0000","last_active":"2023-12-19T18:58:45.543362+0000","last_peered":"2023-12-19T18:58:45.543362+0000","last_clean":"2023-12-19T18:58:45.543362+0000","last_became_active":"2023-12-19T18:58:42.436883+0000","last_became_peered":"2023-12-19T18:58:42.436883+0000","last_unstale":"2023-12-19T18:58:45.543362+0000","last_undegraded":"2023-12-19T18:58:45.543362+0000","last_fullsized":"2023-12-19T18:58:45.543362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:29:22.986856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420570+0000","last_change":"2023-12-19T18:58:43.439701+0000","last_active":"2023-12-19T18:58:44.420570+0000","last_peered":"2023-12-19T18:58:44.420570+0000","last_clean":"2023-12-19T18:58:44.420570+0000","last_became_active":"2023-12-19T18:58:43.439425+0000","last_became_peered":"2023-12-19T18:58:43.439425+0000","last_unstale":"2023-12-19T18:58:44.420570+0000","last_undegraded":"2023-12-19T18:58:44.420570+0000","last_fullsized":"2023-12-19T18:58:44.420570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:19:43.614230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T18:58:43.415467+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T18:58:43.415467+0000","last_peered":"2023-12-19T18:58:43.415467+0000","last_clean":"2023-12-19T18:58:43.415467+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T18:58:43.415467+0000","last_undegraded":"2023-12-19T18:58:43.415467+0000","last_fullsized":"2023-12-19T18:58:43.415467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544357+0000","last_change":"2023-12-19T18:58:42.424370+0000","last_active":"2023-12-19T18:58:45.544357+0000","last_peered":"2023-12-19T18:58:45.544357+0000","last_clean":"2023-12-19T18:58:45.544357+0000","last_became_active":"2023-12-19T18:58:42.421937+0000","last_became_peered":"2023-12-19T18:58:42.421937+0000","last_unstale":"2023-12-19T18:58:45.544357+0000","last_undegraded":"2023-12-19T18:58:45.544357+0000","last_fullsized":"2023-12-19T18:58:45.544357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:45.366694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792573+0000","last_change":"2023-12-19T18:58:43.437901+0000","last_active":"2023-12-19T18:58:44.792573+0000","last_peered":"2023-12-19T18:58:44.792573+0000","last_clean":"2023-12-19T18:58:44.792573+0000","last_became_active":"2023-12-19T18:58:43.437671+0000","last_became_peered":"2023-12-19T18:58:43.437671+0000","last_unstale":"2023-12-19T18:58:44.792573+0000","last_undegraded":"2023-12-19T18:58:44.792573+0000","last_fullsized":"2023-12-19T18:58:44.792573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:34.691494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420255+0000","last_change":"2023-12-19T18:58:42.432721+0000","last_active":"2023-12-19T18:58:44.420255+0000","last_peered":"2023-12-19T18:58:44.420255+0000","last_clean":"2023-12-19T18:58:44.420255+0000","last_became_active":"2023-12-19T18:58:42.432424+0000","last_became_peered":"2023-12-19T18:58:42.432424+0000","last_unstale":"2023-12-19T18:58:44.420255+0000","last_undegraded":"2023-12-19T18:58:44.420255+0000","last_fullsized":"2023-12-19T18:58:44.420255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:18:45.847639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543868+0000","last_change":"2023-12-19T18:58:43.416870+0000","last_active":"2023-12-19T18:58:45.543868+0000","last_peered":"2023-12-19T18:58:45.543868+0000","last_clean":"2023-12-19T18:58:45.543868+0000","last_became_active":"2023-12-19T18:58:43.416531+0000","last_became_peered":"2023-12-19T18:58:43.416531+0000","last_unstale":"2023-12-19T18:58:45.543868+0000","last_undegraded":"2023-12-19T18:58:45.543868+0000","last_fullsized":"2023-12-19T18:58:45.543868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:09:06.965509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543476+0000","last_change":"2023-12-19T18:58:42.421802+0000","last_active":"2023-12-19T18:58:45.543476+0000","last_peered":"2023-12-19T18:58:45.543476+0000","last_clean":"2023-12-19T18:58:45.543476+0000","last_became_active":"2023-12-19T18:58:42.421453+0000","last_became_peered":"2023-12-19T18:58:42.421453+0000","last_unstale":"2023-12-19T18:58:45.543476+0000","last_undegraded":"2023-12-19T18:58:45.543476+0000","last_fullsized":"2023-12-19T18:58:45.543476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:07.210200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415759+0000","last_change":"2023-12-19T18:58:43.419130+0000","last_active":"2023-12-19T18:58:44.415759+0000","last_peered":"2023-12-19T18:58:44.415759+0000","last_clean":"2023-12-19T18:58:44.415759+0000","last_became_active":"2023-12-19T18:58:43.418765+0000","last_became_peered":"2023-12-19T18:58:43.418765+0000","last_unstale":"2023-12-19T18:58:44.415759+0000","last_undegraded":"2023-12-19T18:58:44.415759+0000","last_fullsized":"2023-12-19T18:58:44.415759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:46.373291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544926+0000","last_change":"2023-12-19T18:58:42.431000+0000","last_active":"2023-12-19T18:58:45.544926+0000","last_peered":"2023-12-19T18:58:45.544926+0000","last_clean":"2023-12-19T18:58:45.544926+0000","last_became_active":"2023-12-19T18:58:42.430652+0000","last_became_peered":"2023-12-19T18:58:42.430652+0000","last_unstale":"2023-12-19T18:58:45.544926+0000","last_undegraded":"2023-12-19T18:58:45.544926+0000","last_fullsized":"2023-12-19T18:58:45.544926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:44:03.095759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420568+0000","last_change":"2023-12-19T18:58:43.424247+0000","last_active":"2023-12-19T18:58:44.420568+0000","last_peered":"2023-12-19T18:58:44.420568+0000","last_clean":"2023-12-19T18:58:44.420568+0000","last_became_active":"2023-12-19T18:58:43.422534+0000","last_became_peered":"2023-12-19T18:58:43.422534+0000","last_unstale":"2023-12-19T18:58:44.420568+0000","last_undegraded":"2023-12-19T18:58:44.420568+0000","last_fullsized":"2023-12-19T18:58:44.420568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:25:24.585530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415907+0000","last_change":"2023-12-19T18:58:42.418032+0000","last_active":"2023-12-19T18:58:44.415907+0000","last_peered":"2023-12-19T18:58:44.415907+0000","last_clean":"2023-12-19T18:58:44.415907+0000","last_became_active":"2023-12-19T18:58:42.417765+0000","last_became_peered":"2023-12-19T18:58:42.417765+0000","last_unstale":"2023-12-19T18:58:44.415907+0000","last_undegraded":"2023-12-19T18:58:44.415907+0000","last_fullsized":"2023-12-19T18:58:44.415907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:09:05.958912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.545286+0000","last_change":"2023-12-19T18:58:43.438006+0000","last_active":"2023-12-19T18:58:45.545286+0000","last_peered":"2023-12-19T18:58:45.545286+0000","last_clean":"2023-12-19T18:58:45.545286+0000","last_became_active":"2023-12-19T18:58:43.437618+0000","last_became_peered":"2023-12-19T18:58:43.437618+0000","last_unstale":"2023-12-19T18:58:45.545286+0000","last_undegraded":"2023-12-19T18:58:45.545286+0000","last_fullsized":"2023-12-19T18:58:45.545286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:43:58.809550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420900+0000","last_change":"2023-12-19T18:58:42.433488+0000","last_active":"2023-12-19T18:58:44.420900+0000","last_peered":"2023-12-19T18:58:44.420900+0000","last_clean":"2023-12-19T18:58:44.420900+0000","last_became_active":"2023-12-19T18:58:42.433023+0000","last_became_peered":"2023-12-19T18:58:42.433023+0000","last_unstale":"2023-12-19T18:58:44.420900+0000","last_undegraded":"2023-12-19T18:58:44.420900+0000","last_fullsized":"2023-12-19T18:58:44.420900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:25.520152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415951+0000","last_change":"2023-12-19T18:58:43.419840+0000","last_active":"2023-12-19T18:58:44.415951+0000","last_peered":"2023-12-19T18:58:44.415951+0000","last_clean":"2023-12-19T18:58:44.415951+0000","last_became_active":"2023-12-19T18:58:43.419340+0000","last_became_peered":"2023-12-19T18:58:43.419340+0000","last_unstale":"2023-12-19T18:58:44.415951+0000","last_undegraded":"2023-12-19T18:58:44.415951+0000","last_fullsized":"2023-12-19T18:58:44.415951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:34.691494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.416167+0000","last_change":"2023-12-19T18:58:42.421889+0000","last_active":"2023-12-19T18:58:44.416167+0000","last_peered":"2023-12-19T18:58:44.416167+0000","last_clean":"2023-12-19T18:58:44.416167+0000","last_became_active":"2023-12-19T18:58:42.421524+0000","last_became_peered":"2023-12-19T18:58:42.421524+0000","last_unstale":"2023-12-19T18:58:44.416167+0000","last_undegraded":"2023-12-19T18:58:44.416167+0000","last_fullsized":"2023-12-19T18:58:44.416167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:24:57.289171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792880+0000","last_change":"2023-12-19T18:58:43.427768+0000","last_active":"2023-12-19T18:58:44.792880+0000","last_peered":"2023-12-19T18:58:44.792880+0000","last_clean":"2023-12-19T18:58:44.792880+0000","last_became_active":"2023-12-19T18:58:43.427358+0000","last_became_peered":"2023-12-19T18:58:43.427358+0000","last_unstale":"2023-12-19T18:58:44.792880+0000","last_undegraded":"2023-12-19T18:58:44.792880+0000","last_fullsized":"2023-12-19T18:58:44.792880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:25:40.712335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544879+0000","last_change":"2023-12-19T18:58:42.433397+0000","last_active":"2023-12-19T18:58:45.544879+0000","last_peered":"2023-12-19T18:58:45.544879+0000","last_clean":"2023-12-19T18:58:45.544879+0000","last_became_active":"2023-12-19T18:58:42.433055+0000","last_became_peered":"2023-12-19T18:58:42.433055+0000","last_unstale":"2023-12-19T18:58:45.544879+0000","last_undegraded":"2023-12-19T18:58:45.544879+0000","last_fullsized":"2023-12-19T18:58:45.544879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:09:05.958912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544244+0000","last_change":"2023-12-19T18:58:43.421411+0000","last_active":"2023-12-19T18:58:45.544244+0000","last_peered":"2023-12-19T18:58:45.544244+0000","last_clean":"2023-12-19T18:58:45.544244+0000","last_became_active":"2023-12-19T18:58:43.421095+0000","last_became_peered":"2023-12-19T18:58:43.421095+0000","last_unstale":"2023-12-19T18:58:45.544244+0000","last_undegraded":"2023-12-19T18:58:45.544244+0000","last_fullsized":"2023-12-19T18:58:45.544244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:46.373291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420158+0000","last_change":"2023-12-19T18:58:42.434661+0000","last_active":"2023-12-19T18:58:44.420158+0000","last_peered":"2023-12-19T18:58:44.420158+0000","last_clean":"2023-12-19T18:58:44.420158+0000","last_became_active":"2023-12-19T18:58:42.432945+0000","last_became_peered":"2023-12-19T18:58:42.432945+0000","last_unstale":"2023-12-19T18:58:44.420158+0000","last_undegraded":"2023-12-19T18:58:44.420158+0000","last_fullsized":"2023-12-19T18:58:44.420158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:33:01.472458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420046+0000","last_change":"2023-12-19T18:58:43.430118+0000","last_active":"2023-12-19T18:58:44.420046+0000","last_peered":"2023-12-19T18:58:44.420046+0000","last_clean":"2023-12-19T18:58:44.420046+0000","last_became_active":"2023-12-19T18:58:43.428710+0000","last_became_peered":"2023-12-19T18:58:43.428710+0000","last_unstale":"2023-12-19T18:58:44.420046+0000","last_undegraded":"2023-12-19T18:58:44.420046+0000","last_fullsized":"2023-12-19T18:58:44.420046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:20:04.608095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415775+0000","last_change":"2023-12-19T18:58:42.432562+0000","last_active":"2023-12-19T18:58:44.415775+0000","last_peered":"2023-12-19T18:58:44.415775+0000","last_clean":"2023-12-19T18:58:44.415775+0000","last_became_active":"2023-12-19T18:58:42.432307+0000","last_became_peered":"2023-12-19T18:58:42.432307+0000","last_unstale":"2023-12-19T18:58:44.415775+0000","last_undegraded":"2023-12-19T18:58:44.415775+0000","last_fullsized":"2023-12-19T18:58:44.415775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:35.982824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792510+0000","last_change":"2023-12-19T18:58:43.421115+0000","last_active":"2023-12-19T18:58:44.792510+0000","last_peered":"2023-12-19T18:58:44.792510+0000","last_clean":"2023-12-19T18:58:44.792510+0000","last_became_active":"2023-12-19T18:58:43.419370+0000","last_became_peered":"2023-12-19T18:58:43.419370+0000","last_unstale":"2023-12-19T18:58:44.792510+0000","last_undegraded":"2023-12-19T18:58:44.792510+0000","last_fullsized":"2023-12-19T18:58:44.792510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:46.373291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415921+0000","last_change":"2023-12-19T18:58:42.428553+0000","last_active":"2023-12-19T18:58:44.415921+0000","last_peered":"2023-12-19T18:58:44.415921+0000","last_clean":"2023-12-19T18:58:44.415921+0000","last_became_active":"2023-12-19T18:58:42.425181+0000","last_became_peered":"2023-12-19T18:58:42.425181+0000","last_unstale":"2023-12-19T18:58:44.415921+0000","last_undegraded":"2023-12-19T18:58:44.415921+0000","last_fullsized":"2023-12-19T18:58:44.415921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:29.889906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792641+0000","last_change":"2023-12-19T18:58:43.425659+0000","last_active":"2023-12-19T18:58:44.792641+0000","last_peered":"2023-12-19T18:58:44.792641+0000","last_clean":"2023-12-19T18:58:44.792641+0000","last_became_active":"2023-12-19T18:58:43.425393+0000","last_became_peered":"2023-12-19T18:58:43.425393+0000","last_unstale":"2023-12-19T18:58:44.792641+0000","last_undegraded":"2023-12-19T18:58:44.792641+0000","last_fullsized":"2023-12-19T18:58:44.792641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:07.765261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420547+0000","last_change":"2023-12-19T18:58:42.432966+0000","last_active":"2023-12-19T18:58:44.420547+0000","last_peered":"2023-12-19T18:58:44.420547+0000","last_clean":"2023-12-19T18:58:44.420547+0000","last_became_active":"2023-12-19T18:58:42.432661+0000","last_became_peered":"2023-12-19T18:58:42.432661+0000","last_unstale":"2023-12-19T18:58:44.420547+0000","last_undegraded":"2023-12-19T18:58:44.420547+0000","last_fullsized":"2023-12-19T18:58:44.420547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:06.758664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544675+0000","last_change":"2023-12-19T18:58:43.428930+0000","last_active":"2023-12-19T18:58:45.544675+0000","last_peered":"2023-12-19T18:58:45.544675+0000","last_clean":"2023-12-19T18:58:45.544675+0000","last_became_active":"2023-12-19T18:58:43.428623+0000","last_became_peered":"2023-12-19T18:58:43.428623+0000","last_unstale":"2023-12-19T18:58:45.544675+0000","last_undegraded":"2023-12-19T18:58:45.544675+0000","last_fullsized":"2023-12-19T18:58:45.544675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:07.765261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.545246+0000","last_change":"2023-12-19T18:58:43.438141+0000","last_active":"2023-12-19T18:58:45.545246+0000","last_peered":"2023-12-19T18:58:45.545246+0000","last_clean":"2023-12-19T18:58:45.545246+0000","last_became_active":"2023-12-19T18:58:43.437765+0000","last_became_peered":"2023-12-19T18:58:43.437765+0000","last_unstale":"2023-12-19T18:58:45.545246+0000","last_undegraded":"2023-12-19T18:58:45.545246+0000","last_fullsized":"2023-12-19T18:58:45.545246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:46.807064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420235+0000","last_change":"2023-12-19T18:58:42.436647+0000","last_active":"2023-12-19T18:58:44.420235+0000","last_peered":"2023-12-19T18:58:44.420235+0000","last_clean":"2023-12-19T18:58:44.420235+0000","last_became_active":"2023-12-19T18:58:42.436356+0000","last_became_peered":"2023-12-19T18:58:42.436356+0000","last_unstale":"2023-12-19T18:58:44.420235+0000","last_undegraded":"2023-12-19T18:58:44.420235+0000","last_fullsized":"2023-12-19T18:58:44.420235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:06.491761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544884+0000","last_change":"2023-12-19T18:58:43.438524+0000","last_active":"2023-12-19T18:58:45.544884+0000","last_peered":"2023-12-19T18:58:45.544884+0000","last_clean":"2023-12-19T18:58:45.544884+0000","last_became_active":"2023-12-19T18:58:43.436745+0000","last_became_peered":"2023-12-19T18:58:43.436745+0000","last_unstale":"2023-12-19T18:58:45.544884+0000","last_undegraded":"2023-12-19T18:58:45.544884+0000","last_fullsized":"2023-12-19T18:58:45.544884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:32:14.763407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420673+0000","last_change":"2023-12-19T18:58:42.432955+0000","last_active":"2023-12-19T18:58:44.420673+0000","last_peered":"2023-12-19T18:58:44.420673+0000","last_clean":"2023-12-19T18:58:44.420673+0000","last_became_active":"2023-12-19T18:58:42.432616+0000","last_became_peered":"2023-12-19T18:58:42.432616+0000","last_unstale":"2023-12-19T18:58:44.420673+0000","last_undegraded":"2023-12-19T18:58:44.420673+0000","last_fullsized":"2023-12-19T18:58:44.420673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:15.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544293+0000","last_change":"2023-12-19T18:58:43.440165+0000","last_active":"2023-12-19T18:58:45.544293+0000","last_peered":"2023-12-19T18:58:45.544293+0000","last_clean":"2023-12-19T18:58:45.544293+0000","last_became_active":"2023-12-19T18:58:43.439853+0000","last_became_peered":"2023-12-19T18:58:43.439853+0000","last_unstale":"2023-12-19T18:58:45.544293+0000","last_undegraded":"2023-12-19T18:58:45.544293+0000","last_fullsized":"2023-12-19T18:58:45.544293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:07.765261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792856+0000","last_change":"2023-12-19T18:58:42.423728+0000","last_active":"2023-12-19T18:58:44.792856+0000","last_peered":"2023-12-19T18:58:44.792856+0000","last_clean":"2023-12-19T18:58:44.792856+0000","last_became_active":"2023-12-19T18:58:42.423467+0000","last_became_peered":"2023-12-19T18:58:42.423467+0000","last_unstale":"2023-12-19T18:58:44.792856+0000","last_undegraded":"2023-12-19T18:58:44.792856+0000","last_fullsized":"2023-12-19T18:58:44.792856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:09:05.958912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792893+0000","last_change":"2023-12-19T18:58:43.431360+0000","last_active":"2023-12-19T18:58:44.792893+0000","last_peered":"2023-12-19T18:58:44.792893+0000","last_clean":"2023-12-19T18:58:44.792893+0000","last_became_active":"2023-12-19T18:58:43.431079+0000","last_became_peered":"2023-12-19T18:58:43.431079+0000","last_unstale":"2023-12-19T18:58:44.792893+0000","last_undegraded":"2023-12-19T18:58:44.792893+0000","last_fullsized":"2023-12-19T18:58:44.792893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:19:43.614230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544292+0000","last_change":"2023-12-19T18:58:42.428088+0000","last_active":"2023-12-19T18:58:45.544292+0000","last_peered":"2023-12-19T18:58:45.544292+0000","last_clean":"2023-12-19T18:58:45.544292+0000","last_became_active":"2023-12-19T18:58:42.427833+0000","last_became_peered":"2023-12-19T18:58:42.427833+0000","last_unstale":"2023-12-19T18:58:45.544292+0000","last_undegraded":"2023-12-19T18:58:45.544292+0000","last_fullsized":"2023-12-19T18:58:45.544292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:15.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7690000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.641}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.3040000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.097}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.0410000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":794624,"data_stored":654597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T18:58:47.685 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T18:58:47.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.856+0000 7faf95f65640 1 Processor -- start 2023-12-19T18:58:47.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.856+0000 7faf95f65640 1 -- start start 2023-12-19T18:58:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.856+0000 7faf95f65640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faf900c63c0 0x7faf900c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.856+0000 7faf95f65640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7faf900c4100 0x7faf900c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.856+0000 7faf95f65640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf900c31c0 con 0x7faf900c29e0 2023-12-19T18:58:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.856+0000 7faf95f65640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf900c34a0 con 0x7faf900c63c0 2023-12-19T18:58:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.856+0000 7faf95f65640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf900c1030 con 0x7faf900c4100 2023-12-19T18:58:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.856+0000 7faf8f7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faf900c63c0 0x7faf900c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.856+0000 7faf8f7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faf900c63c0 0x7faf900c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54376/0 (socket says 172.21.15.133:54376) 2023-12-19T18:58:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.856+0000 7faf8f7fe640 1 -- 172.21.15.133:0/3658416522 learned_addr learned my addr 172.21.15.133:0/3658416522 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.856+0000 7faf8effd640 1 --2- 172.21.15.133:0/3658416522 >> v2:172.21.15.138:3300/0 conn(0x7faf900c4100 0x7faf900c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.856+0000 7faf8f7fe640 1 -- 172.21.15.133:0/3658416522 >> v2:172.21.15.138:3300/0 conn(0x7faf900c4100 msgr2=0x7faf900c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.856+0000 7faf8f7fe640 1 --2- 172.21.15.133:0/3658416522 >> v2:172.21.15.138:3300/0 conn(0x7faf900c4100 0x7faf900c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.856+0000 7faf8f7fe640 1 -- 172.21.15.133:0/3658416522 >> v1:172.21.15.138:6789/0 conn(0x7faf900c29e0 legacy=0x7faf900a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:47.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.856+0000 7faf8f7fe640 1 -- 172.21.15.133:0/3658416522 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf900c1310 con 0x7faf900c63c0 2023-12-19T18:58:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.860+0000 7faf8f7fe640 1 --2- 172.21.15.133:0/3658416522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf900c63c0 0x7faf900c06d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faf900a8b40 tx=0x7faf8001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892c8a4a71a67149 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.860+0000 7faf8e7fc640 1 -- 172.21.15.133:0/3658416522 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf800ac630 con 0x7faf900c63c0 2023-12-19T18:58:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.860+0000 7faf8e7fc640 1 -- 172.21.15.133:0/3658416522 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf800ac790 con 0x7faf900c63c0 2023-12-19T18:58:47.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.860+0000 7faf8e7fc640 1 -- 172.21.15.133:0/3658416522 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf800acb20 con 0x7faf900c63c0 2023-12-19T18:58:47.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.860+0000 7faf95f65640 1 -- 172.21.15.133:0/3658416522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf900c63c0 msgr2=0x7faf900c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:47.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.860+0000 7faf95f65640 1 --2- 172.21.15.133:0/3658416522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf900c63c0 0x7faf900c06d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faf900a8b40 tx=0x7faf8001c3b0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.860+0000 7faf95f65640 1 -- 172.21.15.133:0/3658416522 shutdown_connections 2023-12-19T18:58:47.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.860+0000 7faf95f65640 1 --2- 172.21.15.133:0/3658416522 >> v2:172.21.15.138:3300/0 conn(0x7faf900c4100 0x7faf900c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.860+0000 7faf95f65640 1 --2- 172.21.15.133:0/3658416522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf900c63c0 0x7faf900c06d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.860+0000 7faf95f65640 1 -- 172.21.15.133:0/3658416522 >> 172.21.15.133:0/3658416522 conn(0x7faf9006a5b0 msgr2=0x7faf9006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:47.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.860+0000 7faf95f65640 1 -- 172.21.15.133:0/3658416522 shutdown_connections 2023-12-19T18:58:47.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.860+0000 7faf95f65640 1 -- 172.21.15.133:0/3658416522 wait complete. 2023-12-19T18:58:47.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf95f65640 1 Processor -- start 2023-12-19T18:58:47.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf95f65640 1 -- start start 2023-12-19T18:58:47.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf95f65640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf900c29e0 0x7faf9014ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:47.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf95f65640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf900c4100 0x7faf901f1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:47.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf95f65640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf900c63c0 0x7faf90150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:47.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf95f65640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf900a47f0 con 0x7faf900c63c0 2023-12-19T18:58:47.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf95f65640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf901f12a0 con 0x7faf900c4100 2023-12-19T18:58:47.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf95f65640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf901f0f90 con 0x7faf900c29e0 2023-12-19T18:58:47.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf8ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf900c63c0 0x7faf90150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:47.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf8f7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf900c29e0 0x7faf9014ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:47.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf8ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf900c63c0 0x7faf90150c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54392/0 (socket says 172.21.15.133:54392) 2023-12-19T18:58:47.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf8ffff640 1 -- 172.21.15.133:0/1160082725 learned_addr learned my addr 172.21.15.133:0/1160082725 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:47.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf8effd640 1 --2- 172.21.15.133:0/1160082725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf900c4100 0x7faf901f1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:47.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf8ffff640 1 -- 172.21.15.133:0/1160082725 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf900c29e0 msgr2=0x7faf9014ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:47.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf8ffff640 1 --2- 172.21.15.133:0/1160082725 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf900c29e0 0x7faf9014ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf8ffff640 1 -- 172.21.15.133:0/1160082725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf900c4100 msgr2=0x7faf901f1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:47.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf8ffff640 1 --2- 172.21.15.133:0/1160082725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf900c4100 0x7faf901f1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:47.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf8ffff640 1 -- 172.21.15.133:0/1160082725 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf800094d0 con 0x7faf900c63c0 2023-12-19T18:58:47.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf8ffff640 1 --2- 172.21.15.133:0/1160082725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf900c63c0 0x7faf90150c10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faf8800c7a0 tx=0x7faf8800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:47.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf77fff640 1 -- 172.21.15.133:0/1160082725 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf88003b80 con 0x7faf900c63c0 2023-12-19T18:58:47.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf77fff640 1 -- 172.21.15.133:0/1160082725 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf88003ce0 con 0x7faf900c63c0 2023-12-19T18:58:47.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf77fff640 1 -- 172.21.15.133:0/1160082725 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8800aa90 con 0x7faf900c63c0 2023-12-19T18:58:47.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf95f65640 1 -- 172.21.15.133:0/1160082725 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf900a3970 con 0x7faf900c63c0 2023-12-19T18:58:47.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf95f65640 1 -- 172.21.15.133:0/1160082725 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf900a50f0 con 0x7faf900c63c0 2023-12-19T18:58:47.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.864+0000 7faf95f65640 1 -- 172.21.15.133:0/1160082725 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf901f1450 con 0x7faf900c63c0 2023-12-19T18:58:47.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.868+0000 7faf77fff640 1 -- 172.21.15.133:0/1160082725 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7faf8800abf0 con 0x7faf900c63c0 2023-12-19T18:58:47.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.868+0000 7faf77fff640 1 --2- 172.21.15.133:0/1160082725 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf7c0664a0 0x7faf7c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:47.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.868+0000 7faf77fff640 1 -- 172.21.15.133:0/1160082725 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf88083b90 con 0x7faf900c63c0 2023-12-19T18:58:47.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.868+0000 7faf8f7fe640 1 --2- 172.21.15.133:0/1160082725 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf7c0664a0 0x7faf7c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:47.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.868+0000 7faf8f7fe640 1 --2- 172.21.15.133:0/1160082725 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf7c0664a0 0x7faf7c068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faf800ae000 tx=0x7faf80008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:47.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:47.872+0000 7faf77fff640 1 -- 172.21.15.133:0/1160082725 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7faf901f1450 con 0x7faf900c63c0 2023-12-19T18:58:48.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.020+0000 7faf95f65640 1 -- 172.21.15.133:0/1160082725 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf9006dc80 con 0x7faf7c0664a0 2023-12-19T18:58:48.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.028+0000 7faf77fff640 1 -- 172.21.15.133:0/1160082725 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264636 (secure 0 0 0) 0x7faf9006dc80 con 0x7faf7c0664a0 2023-12-19T18:58:48.033 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:48.035 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T18:58:48.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.028+0000 7faf95f65640 1 -- 172.21.15.133:0/1160082725 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf7c0664a0 msgr2=0x7faf7c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:48.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.028+0000 7faf95f65640 1 --2- 172.21.15.133:0/1160082725 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf7c0664a0 0x7faf7c068960 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faf800ae000 tx=0x7faf80008040 comp rx=0 tx=0).stop 2023-12-19T18:58:48.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.028+0000 7faf95f65640 1 -- 172.21.15.133:0/1160082725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf900c63c0 msgr2=0x7faf90150c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:48.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.028+0000 7faf95f65640 1 --2- 172.21.15.133:0/1160082725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf900c63c0 0x7faf90150c10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faf8800c7a0 tx=0x7faf8800cc60 comp rx=0 tx=0).stop 2023-12-19T18:58:48.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.032+0000 7faf95f65640 1 -- 172.21.15.133:0/1160082725 shutdown_connections 2023-12-19T18:58:48.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.032+0000 7faf95f65640 1 --2- 172.21.15.133:0/1160082725 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf7c0664a0 0x7faf7c068960 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.032+0000 7faf95f65640 1 --2- 172.21.15.133:0/1160082725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf900c63c0 0x7faf90150c10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.032+0000 7faf95f65640 1 --2- 172.21.15.133:0/1160082725 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf900c4100 0x7faf901f1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.032+0000 7faf95f65640 1 --2- 172.21.15.133:0/1160082725 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf900c29e0 0x7faf9014ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.032+0000 7faf95f65640 1 -- 172.21.15.133:0/1160082725 >> 172.21.15.133:0/1160082725 conn(0x7faf9006a5b0 msgr2=0x7faf90066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:48.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.032+0000 7faf95f65640 1 -- 172.21.15.133:0/1160082725 shutdown_connections 2023-12-19T18:58:48.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.032+0000 7faf95f65640 1 -- 172.21.15.133:0/1160082725 wait complete. 2023-12-19T18:58:48.054 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-19T18:58:46.832859+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218948,"kb_used_data":2772,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755772,"statfs":{"total":773094113280,"available":772869910528,"internally_reserved":0,"allocated":2838528,"data_stored":1726617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.438853"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421033+0000","last_change":"2023-12-19T18:58:43.434692+0000","last_active":"2023-12-19T18:58:44.421033+0000","last_peered":"2023-12-19T18:58:44.421033+0000","last_clean":"2023-12-19T18:58:44.421033+0000","last_became_active":"2023-12-19T18:58:43.434368+0000","last_became_peered":"2023-12-19T18:58:43.434368+0000","last_unstale":"2023-12-19T18:58:44.421033+0000","last_undegraded":"2023-12-19T18:58:44.421033+0000","last_fullsized":"2023-12-19T18:58:44.421033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:46.807064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.416161+0000","last_change":"2023-12-19T18:58:43.425595+0000","last_active":"2023-12-19T18:58:44.416161+0000","last_peered":"2023-12-19T18:58:44.416161+0000","last_clean":"2023-12-19T18:58:44.416161+0000","last_became_active":"2023-12-19T18:58:43.425304+0000","last_became_peered":"2023-12-19T18:58:43.425304+0000","last_unstale":"2023-12-19T18:58:44.416161+0000","last_undegraded":"2023-12-19T18:58:44.416161+0000","last_fullsized":"2023-12-19T18:58:44.416161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:55:56.534047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544103+0000","last_change":"2023-12-19T18:58:43.415732+0000","last_active":"2023-12-19T18:58:45.544103+0000","last_peered":"2023-12-19T18:58:45.544103+0000","last_clean":"2023-12-19T18:58:45.544103+0000","last_became_active":"2023-12-19T18:58:43.415405+0000","last_became_peered":"2023-12-19T18:58:43.415405+0000","last_unstale":"2023-12-19T18:58:45.544103+0000","last_undegraded":"2023-12-19T18:58:45.544103+0000","last_fullsized":"2023-12-19T18:58:45.544103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:26.526749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544521+0000","last_change":"2023-12-19T18:58:43.441973+0000","last_active":"2023-12-19T18:58:45.544521+0000","last_peered":"2023-12-19T18:58:45.544521+0000","last_clean":"2023-12-19T18:58:45.544521+0000","last_became_active":"2023-12-19T18:58:43.437056+0000","last_became_peered":"2023-12-19T18:58:43.437056+0000","last_unstale":"2023-12-19T18:58:45.544521+0000","last_undegraded":"2023-12-19T18:58:45.544521+0000","last_fullsized":"2023-12-19T18:58:45.544521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:32.378596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420316+0000","last_change":"2023-12-19T18:58:43.427263+0000","last_active":"2023-12-19T18:58:44.420316+0000","last_peered":"2023-12-19T18:58:44.420316+0000","last_clean":"2023-12-19T18:58:44.420316+0000","last_became_active":"2023-12-19T18:58:43.426417+0000","last_became_peered":"2023-12-19T18:58:43.426417+0000","last_unstale":"2023-12-19T18:58:44.420316+0000","last_undegraded":"2023-12-19T18:58:44.420316+0000","last_fullsized":"2023-12-19T18:58:44.420316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:55:56.534047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544646+0000","last_change":"2023-12-19T18:58:43.438027+0000","last_active":"2023-12-19T18:58:45.544646+0000","last_peered":"2023-12-19T18:58:45.544646+0000","last_clean":"2023-12-19T18:58:45.544646+0000","last_became_active":"2023-12-19T18:58:43.437711+0000","last_became_peered":"2023-12-19T18:58:43.437711+0000","last_unstale":"2023-12-19T18:58:45.544646+0000","last_undegraded":"2023-12-19T18:58:45.544646+0000","last_fullsized":"2023-12-19T18:58:45.544646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:59:46.730223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420590+0000","last_change":"2023-12-19T18:58:43.431331+0000","last_active":"2023-12-19T18:58:44.420590+0000","last_peered":"2023-12-19T18:58:44.420590+0000","last_clean":"2023-12-19T18:58:44.420590+0000","last_became_active":"2023-12-19T18:58:43.430968+0000","last_became_peered":"2023-12-19T18:58:43.430968+0000","last_unstale":"2023-12-19T18:58:44.420590+0000","last_undegraded":"2023-12-19T18:58:44.420590+0000","last_fullsized":"2023-12-19T18:58:44.420590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:32:14.763407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792363+0000","last_change":"2023-12-19T18:58:43.443194+0000","last_active":"2023-12-19T18:58:44.792363+0000","last_peered":"2023-12-19T18:58:44.792363+0000","last_clean":"2023-12-19T18:58:44.792363+0000","last_became_active":"2023-12-19T18:58:43.442961+0000","last_became_peered":"2023-12-19T18:58:43.442961+0000","last_unstale":"2023-12-19T18:58:44.792363+0000","last_undegraded":"2023-12-19T18:58:44.792363+0000","last_fullsized":"2023-12-19T18:58:44.792363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:30.896504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421106+0000","last_change":"2023-12-19T18:58:43.443640+0000","last_active":"2023-12-19T18:58:44.421106+0000","last_peered":"2023-12-19T18:58:44.421106+0000","last_clean":"2023-12-19T18:58:44.421106+0000","last_became_active":"2023-12-19T18:58:43.443310+0000","last_became_peered":"2023-12-19T18:58:43.443310+0000","last_unstale":"2023-12-19T18:58:44.421106+0000","last_undegraded":"2023-12-19T18:58:44.421106+0000","last_fullsized":"2023-12-19T18:58:44.421106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:43:58.809550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544614+0000","last_change":"2023-12-19T18:58:43.445525+0000","last_active":"2023-12-19T18:58:45.544614+0000","last_peered":"2023-12-19T18:58:45.544614+0000","last_clean":"2023-12-19T18:58:45.544614+0000","last_became_active":"2023-12-19T18:58:43.445220+0000","last_became_peered":"2023-12-19T18:58:43.445220+0000","last_unstale":"2023-12-19T18:58:45.544614+0000","last_undegraded":"2023-12-19T18:58:45.544614+0000","last_fullsized":"2023-12-19T18:58:45.544614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:46.373291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544393+0000","last_change":"2023-12-19T18:58:43.439159+0000","last_active":"2023-12-19T18:58:45.544393+0000","last_peered":"2023-12-19T18:58:45.544393+0000","last_clean":"2023-12-19T18:58:45.544393+0000","last_became_active":"2023-12-19T18:58:43.438873+0000","last_became_peered":"2023-12-19T18:58:43.438873+0000","last_unstale":"2023-12-19T18:58:45.544393+0000","last_undegraded":"2023-12-19T18:58:45.544393+0000","last_fullsized":"2023-12-19T18:58:45.544393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:07.498358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421186+0000","last_change":"2023-12-19T18:58:43.432338+0000","last_active":"2023-12-19T18:58:44.421186+0000","last_peered":"2023-12-19T18:58:44.421186+0000","last_clean":"2023-12-19T18:58:44.421186+0000","last_became_active":"2023-12-19T18:58:43.431137+0000","last_became_peered":"2023-12-19T18:58:43.431137+0000","last_unstale":"2023-12-19T18:58:44.421186+0000","last_undegraded":"2023-12-19T18:58:44.421186+0000","last_fullsized":"2023-12-19T18:58:44.421186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:36.989421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792689+0000","last_change":"2023-12-19T18:58:43.426477+0000","last_active":"2023-12-19T18:58:44.792689+0000","last_peered":"2023-12-19T18:58:44.792689+0000","last_clean":"2023-12-19T18:58:44.792689+0000","last_became_active":"2023-12-19T18:58:43.426194+0000","last_became_peered":"2023-12-19T18:58:43.426194+0000","last_unstale":"2023-12-19T18:58:44.792689+0000","last_undegraded":"2023-12-19T18:58:44.792689+0000","last_fullsized":"2023-12-19T18:58:44.792689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:55:56.534047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543864+0000","last_change":"2023-12-19T18:58:43.423155+0000","last_active":"2023-12-19T18:58:45.543864+0000","last_peered":"2023-12-19T18:58:45.543864+0000","last_clean":"2023-12-19T18:58:45.543864+0000","last_became_active":"2023-12-19T18:58:43.422822+0000","last_became_peered":"2023-12-19T18:58:43.422822+0000","last_unstale":"2023-12-19T18:58:45.543864+0000","last_undegraded":"2023-12-19T18:58:45.543864+0000","last_fullsized":"2023-12-19T18:58:45.543864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:24:58.295768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415715+0000","last_change":"2023-12-19T18:58:43.438543+0000","last_active":"2023-12-19T18:58:44.415715+0000","last_peered":"2023-12-19T18:58:44.415715+0000","last_clean":"2023-12-19T18:58:44.415715+0000","last_became_active":"2023-12-19T18:58:43.438178+0000","last_became_peered":"2023-12-19T18:58:43.438178+0000","last_unstale":"2023-12-19T18:58:44.415715+0000","last_undegraded":"2023-12-19T18:58:44.415715+0000","last_fullsized":"2023-12-19T18:58:44.415715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:44:04.102356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544103+0000","last_change":"2023-12-19T18:58:43.439649+0000","last_active":"2023-12-19T18:58:45.544103+0000","last_peered":"2023-12-19T18:58:45.544103+0000","last_clean":"2023-12-19T18:58:45.544103+0000","last_became_active":"2023-12-19T18:58:43.436212+0000","last_became_peered":"2023-12-19T18:58:43.436212+0000","last_unstale":"2023-12-19T18:58:45.544103+0000","last_undegraded":"2023-12-19T18:58:45.544103+0000","last_fullsized":"2023-12-19T18:58:45.544103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:07.765261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.545316+0000","last_change":"2023-12-19T18:58:43.441777+0000","last_active":"2023-12-19T18:58:45.545316+0000","last_peered":"2023-12-19T18:58:45.545316+0000","last_clean":"2023-12-19T18:58:45.545316+0000","last_became_active":"2023-12-19T18:58:43.437882+0000","last_became_peered":"2023-12-19T18:58:43.437882+0000","last_unstale":"2023-12-19T18:58:45.545316+0000","last_undegraded":"2023-12-19T18:58:45.545316+0000","last_fullsized":"2023-12-19T18:58:45.545316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:30:56.565777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543404+0000","last_change":"2023-12-19T18:58:43.430270+0000","last_active":"2023-12-19T18:58:45.543404+0000","last_peered":"2023-12-19T18:58:45.543404+0000","last_clean":"2023-12-19T18:58:45.543404+0000","last_became_active":"2023-12-19T18:58:43.429986+0000","last_became_peered":"2023-12-19T18:58:43.429986+0000","last_unstale":"2023-12-19T18:58:45.543404+0000","last_undegraded":"2023-12-19T18:58:45.543404+0000","last_fullsized":"2023-12-19T18:58:45.543404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:36.989421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420819+0000","last_change":"2023-12-19T18:58:43.427486+0000","last_active":"2023-12-19T18:58:44.420819+0000","last_peered":"2023-12-19T18:58:44.420819+0000","last_clean":"2023-12-19T18:58:44.420819+0000","last_became_active":"2023-12-19T18:58:43.427113+0000","last_became_peered":"2023-12-19T18:58:43.427113+0000","last_unstale":"2023-12-19T18:58:44.420819+0000","last_undegraded":"2023-12-19T18:58:44.420819+0000","last_fullsized":"2023-12-19T18:58:44.420819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:11:18.747856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544490+0000","last_change":"2023-12-19T18:58:43.428892+0000","last_active":"2023-12-19T18:58:45.544490+0000","last_peered":"2023-12-19T18:58:45.544490+0000","last_clean":"2023-12-19T18:58:45.544490+0000","last_became_active":"2023-12-19T18:58:43.428437+0000","last_became_peered":"2023-12-19T18:58:43.428437+0000","last_unstale":"2023-12-19T18:58:45.544490+0000","last_undegraded":"2023-12-19T18:58:45.544490+0000","last_fullsized":"2023-12-19T18:58:45.544490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:44:04.102356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544150+0000","last_change":"2023-12-19T18:58:43.426615+0000","last_active":"2023-12-19T18:58:45.544150+0000","last_peered":"2023-12-19T18:58:45.544150+0000","last_clean":"2023-12-19T18:58:45.544150+0000","last_became_active":"2023-12-19T18:58:43.426300+0000","last_became_peered":"2023-12-19T18:58:43.426300+0000","last_unstale":"2023-12-19T18:58:45.544150+0000","last_undegraded":"2023-12-19T18:58:45.544150+0000","last_fullsized":"2023-12-19T18:58:45.544150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:30.896504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544725+0000","last_change":"2023-12-19T18:58:43.436630+0000","last_active":"2023-12-19T18:58:45.544725+0000","last_peered":"2023-12-19T18:58:45.544725+0000","last_clean":"2023-12-19T18:58:45.544725+0000","last_became_active":"2023-12-19T18:58:43.436310+0000","last_became_peered":"2023-12-19T18:58:43.436310+0000","last_unstale":"2023-12-19T18:58:45.544725+0000","last_undegraded":"2023-12-19T18:58:45.544725+0000","last_fullsized":"2023-12-19T18:58:45.544725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:25:40.712335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792474+0000","last_change":"2023-12-19T18:58:43.432208+0000","last_active":"2023-12-19T18:58:44.792474+0000","last_peered":"2023-12-19T18:58:44.792474+0000","last_clean":"2023-12-19T18:58:44.792474+0000","last_became_active":"2023-12-19T18:58:43.431859+0000","last_became_peered":"2023-12-19T18:58:43.431859+0000","last_unstale":"2023-12-19T18:58:44.792474+0000","last_undegraded":"2023-12-19T18:58:44.792474+0000","last_fullsized":"2023-12-19T18:58:44.792474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:44:04.102356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544165+0000","last_change":"2023-12-19T18:58:43.439545+0000","last_active":"2023-12-19T18:58:45.544165+0000","last_peered":"2023-12-19T18:58:45.544165+0000","last_clean":"2023-12-19T18:58:45.544165+0000","last_became_active":"2023-12-19T18:58:43.436090+0000","last_became_peered":"2023-12-19T18:58:43.436090+0000","last_unstale":"2023-12-19T18:58:45.544165+0000","last_undegraded":"2023-12-19T18:58:45.544165+0000","last_fullsized":"2023-12-19T18:58:45.544165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:55:56.534047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792862+0000","last_change":"2023-12-19T18:58:43.430119+0000","last_active":"2023-12-19T18:58:44.792862+0000","last_peered":"2023-12-19T18:58:44.792862+0000","last_clean":"2023-12-19T18:58:44.792862+0000","last_became_active":"2023-12-19T18:58:43.429836+0000","last_became_peered":"2023-12-19T18:58:43.429836+0000","last_unstale":"2023-12-19T18:58:44.792862+0000","last_undegraded":"2023-12-19T18:58:44.792862+0000","last_fullsized":"2023-12-19T18:58:44.792862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:59:46.730223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544665+0000","last_change":"2023-12-19T18:58:43.427764+0000","last_active":"2023-12-19T18:58:45.544665+0000","last_peered":"2023-12-19T18:58:45.544665+0000","last_clean":"2023-12-19T18:58:45.544665+0000","last_became_active":"2023-12-19T18:58:43.427468+0000","last_became_peered":"2023-12-19T18:58:43.427468+0000","last_unstale":"2023-12-19T18:58:45.544665+0000","last_undegraded":"2023-12-19T18:58:45.544665+0000","last_fullsized":"2023-12-19T18:58:45.544665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:34.691494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415960+0000","last_change":"2023-12-19T18:58:43.426942+0000","last_active":"2023-12-19T18:58:44.415960+0000","last_peered":"2023-12-19T18:58:44.415960+0000","last_clean":"2023-12-19T18:58:44.415960+0000","last_became_active":"2023-12-19T18:58:43.425745+0000","last_became_peered":"2023-12-19T18:58:43.425745+0000","last_unstale":"2023-12-19T18:58:44.415960+0000","last_undegraded":"2023-12-19T18:58:44.415960+0000","last_fullsized":"2023-12-19T18:58:44.415960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:07.765261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792753+0000","last_change":"2023-12-19T18:58:43.429529+0000","last_active":"2023-12-19T18:58:44.792753+0000","last_peered":"2023-12-19T18:58:44.792753+0000","last_clean":"2023-12-19T18:58:44.792753+0000","last_became_active":"2023-12-19T18:58:43.429246+0000","last_became_peered":"2023-12-19T18:58:43.429246+0000","last_unstale":"2023-12-19T18:58:44.792753+0000","last_undegraded":"2023-12-19T18:58:44.792753+0000","last_fullsized":"2023-12-19T18:58:44.792753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:32.378596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544186+0000","last_change":"2023-12-19T18:58:43.418652+0000","last_active":"2023-12-19T18:58:45.544186+0000","last_peered":"2023-12-19T18:58:45.544186+0000","last_clean":"2023-12-19T18:58:45.544186+0000","last_became_active":"2023-12-19T18:58:43.418300+0000","last_became_peered":"2023-12-19T18:58:43.418300+0000","last_unstale":"2023-12-19T18:58:45.544186+0000","last_undegraded":"2023-12-19T18:58:45.544186+0000","last_fullsized":"2023-12-19T18:58:45.544186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:07.498358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544797+0000","last_change":"2023-12-19T18:58:43.442141+0000","last_active":"2023-12-19T18:58:45.544797+0000","last_peered":"2023-12-19T18:58:45.544797+0000","last_clean":"2023-12-19T18:58:45.544797+0000","last_became_active":"2023-12-19T18:58:43.437293+0000","last_became_peered":"2023-12-19T18:58:43.437293+0000","last_unstale":"2023-12-19T18:58:45.544797+0000","last_undegraded":"2023-12-19T18:58:45.544797+0000","last_fullsized":"2023-12-19T18:58:45.544797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:19:43.614230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543333+0000","last_change":"2023-12-19T18:58:43.436463+0000","last_active":"2023-12-19T18:58:45.543333+0000","last_peered":"2023-12-19T18:58:45.543333+0000","last_clean":"2023-12-19T18:58:45.543333+0000","last_became_active":"2023-12-19T18:58:43.436125+0000","last_became_peered":"2023-12-19T18:58:43.436125+0000","last_unstale":"2023-12-19T18:58:45.543333+0000","last_undegraded":"2023-12-19T18:58:45.543333+0000","last_fullsized":"2023-12-19T18:58:45.543333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:25:24.585530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544116+0000","last_change":"2023-12-19T18:58:43.426344+0000","last_active":"2023-12-19T18:58:45.544116+0000","last_peered":"2023-12-19T18:58:45.544116+0000","last_clean":"2023-12-19T18:58:45.544116+0000","last_became_active":"2023-12-19T18:58:43.425807+0000","last_became_peered":"2023-12-19T18:58:43.425807+0000","last_unstale":"2023-12-19T18:58:45.544116+0000","last_undegraded":"2023-12-19T18:58:45.544116+0000","last_fullsized":"2023-12-19T18:58:45.544116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:30.896504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420034+0000","last_change":"2023-12-19T18:58:43.426070+0000","last_active":"2023-12-19T18:58:44.420034+0000","last_peered":"2023-12-19T18:58:44.420034+0000","last_clean":"2023-12-19T18:58:44.420034+0000","last_became_active":"2023-12-19T18:58:43.425735+0000","last_became_peered":"2023-12-19T18:58:43.425735+0000","last_unstale":"2023-12-19T18:58:44.420034+0000","last_undegraded":"2023-12-19T18:58:44.420034+0000","last_fullsized":"2023-12-19T18:58:44.420034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:18:46.854237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792732+0000","last_change":"2023-12-19T18:58:42.421402+0000","last_active":"2023-12-19T18:58:44.792732+0000","last_peered":"2023-12-19T18:58:44.792732+0000","last_clean":"2023-12-19T18:58:44.792732+0000","last_became_active":"2023-12-19T18:58:42.420945+0000","last_became_peered":"2023-12-19T18:58:42.420945+0000","last_unstale":"2023-12-19T18:58:44.792732+0000","last_undegraded":"2023-12-19T18:58:44.792732+0000","last_fullsized":"2023-12-19T18:58:44.792732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:15.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544251+0000","last_change":"2023-12-19T18:58:43.422547+0000","last_active":"2023-12-19T18:58:45.544251+0000","last_peered":"2023-12-19T18:58:45.544251+0000","last_clean":"2023-12-19T18:58:45.544251+0000","last_became_active":"2023-12-19T18:58:43.422273+0000","last_became_peered":"2023-12-19T18:58:43.422273+0000","last_unstale":"2023-12-19T18:58:45.544251+0000","last_undegraded":"2023-12-19T18:58:45.544251+0000","last_fullsized":"2023-12-19T18:58:45.544251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:34.691494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544557+0000","last_change":"2023-12-19T18:58:42.417459+0000","last_active":"2023-12-19T18:58:45.544557+0000","last_peered":"2023-12-19T18:58:45.544557+0000","last_clean":"2023-12-19T18:58:45.544557+0000","last_became_active":"2023-12-19T18:58:42.416914+0000","last_became_peered":"2023-12-19T18:58:42.416914+0000","last_unstale":"2023-12-19T18:58:45.544557+0000","last_undegraded":"2023-12-19T18:58:45.544557+0000","last_fullsized":"2023-12-19T18:58:45.544557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:24:57.289171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792561+0000","last_change":"2023-12-19T18:58:42.420750+0000","last_active":"2023-12-19T18:58:44.792561+0000","last_peered":"2023-12-19T18:58:44.792561+0000","last_clean":"2023-12-19T18:58:44.792561+0000","last_became_active":"2023-12-19T18:58:42.420475+0000","last_became_peered":"2023-12-19T18:58:42.420475+0000","last_unstale":"2023-12-19T18:58:44.792561+0000","last_undegraded":"2023-12-19T18:58:44.792561+0000","last_fullsized":"2023-12-19T18:58:44.792561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:24:57.289171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792463+0000","last_change":"2023-12-19T18:58:43.424478+0000","last_active":"2023-12-19T18:58:44.792463+0000","last_peered":"2023-12-19T18:58:44.792463+0000","last_clean":"2023-12-19T18:58:44.792463+0000","last_became_active":"2023-12-19T18:58:43.424162+0000","last_became_peered":"2023-12-19T18:58:43.424162+0000","last_unstale":"2023-12-19T18:58:44.792463+0000","last_undegraded":"2023-12-19T18:58:44.792463+0000","last_fullsized":"2023-12-19T18:58:44.792463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:07.498358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544259+0000","last_change":"2023-12-19T18:58:42.435884+0000","last_active":"2023-12-19T18:58:45.544259+0000","last_peered":"2023-12-19T18:58:45.544259+0000","last_clean":"2023-12-19T18:58:45.544259+0000","last_became_active":"2023-12-19T18:58:42.435572+0000","last_became_peered":"2023-12-19T18:58:42.435572+0000","last_unstale":"2023-12-19T18:58:45.544259+0000","last_undegraded":"2023-12-19T18:58:45.544259+0000","last_fullsized":"2023-12-19T18:58:45.544259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:18:45.847639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415691+0000","last_change":"2023-12-19T18:58:43.424552+0000","last_active":"2023-12-19T18:58:44.415691+0000","last_peered":"2023-12-19T18:58:44.415691+0000","last_clean":"2023-12-19T18:58:44.415691+0000","last_became_active":"2023-12-19T18:58:43.424115+0000","last_became_peered":"2023-12-19T18:58:43.424115+0000","last_unstale":"2023-12-19T18:58:44.415691+0000","last_undegraded":"2023-12-19T18:58:44.415691+0000","last_fullsized":"2023-12-19T18:58:44.415691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:07.498358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544787+0000","last_change":"2023-12-19T18:58:42.428211+0000","last_active":"2023-12-19T18:58:45.544787+0000","last_peered":"2023-12-19T18:58:45.544787+0000","last_clean":"2023-12-19T18:58:45.544787+0000","last_became_active":"2023-12-19T18:58:42.427932+0000","last_became_peered":"2023-12-19T18:58:42.427932+0000","last_unstale":"2023-12-19T18:58:45.544787+0000","last_undegraded":"2023-12-19T18:58:45.544787+0000","last_fullsized":"2023-12-19T18:58:45.544787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:15.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.545103+0000","last_change":"2023-12-19T18:58:43.436839+0000","last_active":"2023-12-19T18:58:45.545103+0000","last_peered":"2023-12-19T18:58:45.545103+0000","last_clean":"2023-12-19T18:58:45.545103+0000","last_became_active":"2023-12-19T18:58:43.436507+0000","last_became_peered":"2023-12-19T18:58:43.436507+0000","last_unstale":"2023-12-19T18:58:45.545103+0000","last_undegraded":"2023-12-19T18:58:45.545103+0000","last_fullsized":"2023-12-19T18:58:45.545103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:11:18.747856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.545217+0000","last_change":"2023-12-19T18:58:42.435020+0000","last_active":"2023-12-19T18:58:45.545217+0000","last_peered":"2023-12-19T18:58:45.545217+0000","last_clean":"2023-12-19T18:58:45.545217+0000","last_became_active":"2023-12-19T18:58:42.434748+0000","last_became_peered":"2023-12-19T18:58:42.434748+0000","last_unstale":"2023-12-19T18:58:45.545217+0000","last_undegraded":"2023-12-19T18:58:45.545217+0000","last_fullsized":"2023-12-19T18:58:45.545217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:33.684897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544236+0000","last_change":"2023-12-19T18:58:43.440137+0000","last_active":"2023-12-19T18:58:45.544236+0000","last_peered":"2023-12-19T18:58:45.544236+0000","last_clean":"2023-12-19T18:58:45.544236+0000","last_became_active":"2023-12-19T18:58:43.439838+0000","last_became_peered":"2023-12-19T18:58:43.439838+0000","last_unstale":"2023-12-19T18:58:45.544236+0000","last_undegraded":"2023-12-19T18:58:45.544236+0000","last_fullsized":"2023-12-19T18:58:45.544236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:44:04.102356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415975+0000","last_change":"2023-12-19T18:58:42.435783+0000","last_active":"2023-12-19T18:58:44.415975+0000","last_peered":"2023-12-19T18:58:44.415975+0000","last_clean":"2023-12-19T18:58:44.415975+0000","last_became_active":"2023-12-19T18:58:42.435495+0000","last_became_peered":"2023-12-19T18:58:42.435495+0000","last_unstale":"2023-12-19T18:58:44.415975+0000","last_undegraded":"2023-12-19T18:58:44.415975+0000","last_fullsized":"2023-12-19T18:58:44.415975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:22:52.459401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421296+0000","last_change":"2023-12-19T18:58:43.430940+0000","last_active":"2023-12-19T18:58:44.421296+0000","last_peered":"2023-12-19T18:58:44.421296+0000","last_clean":"2023-12-19T18:58:44.421296+0000","last_became_active":"2023-12-19T18:58:43.430070+0000","last_became_peered":"2023-12-19T18:58:43.430070+0000","last_unstale":"2023-12-19T18:58:44.421296+0000","last_undegraded":"2023-12-19T18:58:44.421296+0000","last_fullsized":"2023-12-19T18:58:44.421296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:09:00.031482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544605+0000","last_change":"2023-12-19T18:58:42.427819+0000","last_active":"2023-12-19T18:58:45.544605+0000","last_peered":"2023-12-19T18:58:45.544605+0000","last_clean":"2023-12-19T18:58:45.544605+0000","last_became_active":"2023-12-19T18:58:42.426979+0000","last_became_peered":"2023-12-19T18:58:42.426979+0000","last_unstale":"2023-12-19T18:58:45.544605+0000","last_undegraded":"2023-12-19T18:58:45.544605+0000","last_fullsized":"2023-12-19T18:58:45.544605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:22:52.459401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420420+0000","last_change":"2023-12-19T18:58:43.430761+0000","last_active":"2023-12-19T18:58:44.420420+0000","last_peered":"2023-12-19T18:58:44.420420+0000","last_clean":"2023-12-19T18:58:44.420420+0000","last_became_active":"2023-12-19T18:58:43.430368+0000","last_became_peered":"2023-12-19T18:58:43.430368+0000","last_unstale":"2023-12-19T18:58:44.420420+0000","last_undegraded":"2023-12-19T18:58:44.420420+0000","last_fullsized":"2023-12-19T18:58:44.420420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:32.378596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544283+0000","last_change":"2023-12-19T18:58:42.420964+0000","last_active":"2023-12-19T18:58:45.544283+0000","last_peered":"2023-12-19T18:58:45.544283+0000","last_clean":"2023-12-19T18:58:45.544283+0000","last_became_active":"2023-12-19T18:58:42.420575+0000","last_became_peered":"2023-12-19T18:58:42.420575+0000","last_unstale":"2023-12-19T18:58:45.544283+0000","last_undegraded":"2023-12-19T18:58:45.544283+0000","last_fullsized":"2023-12-19T18:58:45.544283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:20:03.601498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543924+0000","last_change":"2023-12-19T18:58:43.426664+0000","last_active":"2023-12-19T18:58:45.543924+0000","last_peered":"2023-12-19T18:58:45.543924+0000","last_clean":"2023-12-19T18:58:45.543924+0000","last_became_active":"2023-12-19T18:58:43.426272+0000","last_became_peered":"2023-12-19T18:58:43.426272+0000","last_unstale":"2023-12-19T18:58:45.543924+0000","last_undegraded":"2023-12-19T18:58:45.543924+0000","last_fullsized":"2023-12-19T18:58:45.543924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:22:53.465998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544822+0000","last_change":"2023-12-19T18:58:42.430255+0000","last_active":"2023-12-19T18:58:45.544822+0000","last_peered":"2023-12-19T18:58:45.544822+0000","last_clean":"2023-12-19T18:58:45.544822+0000","last_became_active":"2023-12-19T18:58:42.429287+0000","last_became_peered":"2023-12-19T18:58:42.429287+0000","last_unstale":"2023-12-19T18:58:45.544822+0000","last_undegraded":"2023-12-19T18:58:45.544822+0000","last_fullsized":"2023-12-19T18:58:45.544822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:06.491761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420450+0000","last_change":"2023-12-19T18:58:43.432077+0000","last_active":"2023-12-19T18:58:44.420450+0000","last_peered":"2023-12-19T18:58:44.420450+0000","last_clean":"2023-12-19T18:58:44.420450+0000","last_became_active":"2023-12-19T18:58:43.431749+0000","last_became_peered":"2023-12-19T18:58:43.431749+0000","last_unstale":"2023-12-19T18:58:44.420450+0000","last_undegraded":"2023-12-19T18:58:44.420450+0000","last_fullsized":"2023-12-19T18:58:44.420450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:25:40.712335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544133+0000","last_change":"2023-12-19T18:58:42.419392+0000","last_active":"2023-12-19T18:58:45.544133+0000","last_peered":"2023-12-19T18:58:45.544133+0000","last_clean":"2023-12-19T18:58:45.544133+0000","last_became_active":"2023-12-19T18:58:42.418044+0000","last_became_peered":"2023-12-19T18:58:42.418044+0000","last_unstale":"2023-12-19T18:58:45.544133+0000","last_undegraded":"2023-12-19T18:58:45.544133+0000","last_fullsized":"2023-12-19T18:58:45.544133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:08:59.024885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544117+0000","last_change":"2023-12-19T18:58:43.426612+0000","last_active":"2023-12-19T18:58:45.544117+0000","last_peered":"2023-12-19T18:58:45.544117+0000","last_clean":"2023-12-19T18:58:45.544117+0000","last_became_active":"2023-12-19T18:58:43.426075+0000","last_became_peered":"2023-12-19T18:58:43.426075+0000","last_unstale":"2023-12-19T18:58:45.544117+0000","last_undegraded":"2023-12-19T18:58:45.544117+0000","last_fullsized":"2023-12-19T18:58:45.544117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:26.526749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543436+0000","last_change":"2023-12-19T18:58:42.427250+0000","last_active":"2023-12-19T18:58:45.543436+0000","last_peered":"2023-12-19T18:58:45.543436+0000","last_clean":"2023-12-19T18:58:45.543436+0000","last_became_active":"2023-12-19T18:58:42.426896+0000","last_became_peered":"2023-12-19T18:58:42.426896+0000","last_unstale":"2023-12-19T18:58:45.543436+0000","last_undegraded":"2023-12-19T18:58:45.543436+0000","last_fullsized":"2023-12-19T18:58:45.543436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:33:01.472458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420680+0000","last_change":"2023-12-19T18:58:43.441063+0000","last_active":"2023-12-19T18:58:44.420680+0000","last_peered":"2023-12-19T18:58:44.420680+0000","last_clean":"2023-12-19T18:58:44.420680+0000","last_became_active":"2023-12-19T18:58:43.440785+0000","last_became_peered":"2023-12-19T18:58:43.440785+0000","last_unstale":"2023-12-19T18:58:44.420680+0000","last_undegraded":"2023-12-19T18:58:44.420680+0000","last_fullsized":"2023-12-19T18:58:44.420680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:28.581319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421328+0000","last_change":"2023-12-19T18:58:42.422976+0000","last_active":"2023-12-19T18:58:44.421328+0000","last_peered":"2023-12-19T18:58:44.421328+0000","last_clean":"2023-12-19T18:58:44.421328+0000","last_became_active":"2023-12-19T18:58:42.422636+0000","last_became_peered":"2023-12-19T18:58:42.422636+0000","last_unstale":"2023-12-19T18:58:44.421328+0000","last_undegraded":"2023-12-19T18:58:44.421328+0000","last_fullsized":"2023-12-19T18:58:44.421328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:33:01.472458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420427+0000","last_change":"2023-12-19T18:58:43.440387+0000","last_active":"2023-12-19T18:58:44.420427+0000","last_peered":"2023-12-19T18:58:44.420427+0000","last_clean":"2023-12-19T18:58:44.420427+0000","last_became_active":"2023-12-19T18:58:43.440084+0000","last_became_peered":"2023-12-19T18:58:43.440084+0000","last_unstale":"2023-12-19T18:58:44.420427+0000","last_undegraded":"2023-12-19T18:58:44.420427+0000","last_fullsized":"2023-12-19T18:58:44.420427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:59:46.730223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543423+0000","last_change":"2023-12-19T18:58:42.427565+0000","last_active":"2023-12-19T18:58:45.543423+0000","last_peered":"2023-12-19T18:58:45.543423+0000","last_clean":"2023-12-19T18:58:45.543423+0000","last_became_active":"2023-12-19T18:58:42.427285+0000","last_became_peered":"2023-12-19T18:58:42.427285+0000","last_unstale":"2023-12-19T18:58:45.543423+0000","last_undegraded":"2023-12-19T18:58:45.543423+0000","last_fullsized":"2023-12-19T18:58:45.543423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:20:03.601498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421120+0000","last_change":"2023-12-19T18:58:43.434643+0000","last_active":"2023-12-19T18:58:44.421120+0000","last_peered":"2023-12-19T18:58:44.421120+0000","last_clean":"2023-12-19T18:58:44.421120+0000","last_became_active":"2023-12-19T18:58:43.434350+0000","last_became_peered":"2023-12-19T18:58:43.434350+0000","last_unstale":"2023-12-19T18:58:44.421120+0000","last_undegraded":"2023-12-19T18:58:44.421120+0000","last_fullsized":"2023-12-19T18:58:44.421120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:30:56.565777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.416075+0000","last_change":"2023-12-19T18:58:42.427501+0000","last_active":"2023-12-19T18:58:44.416075+0000","last_peered":"2023-12-19T18:58:44.416075+0000","last_clean":"2023-12-19T18:58:44.416075+0000","last_became_active":"2023-12-19T18:58:42.427005+0000","last_became_peered":"2023-12-19T18:58:42.427005+0000","last_unstale":"2023-12-19T18:58:44.416075+0000","last_undegraded":"2023-12-19T18:58:44.416075+0000","last_fullsized":"2023-12-19T18:58:44.416075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:25.520152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544894+0000","last_change":"2023-12-19T18:58:43.438327+0000","last_active":"2023-12-19T18:58:45.544894+0000","last_peered":"2023-12-19T18:58:45.544894+0000","last_clean":"2023-12-19T18:58:45.544894+0000","last_became_active":"2023-12-19T18:58:43.436427+0000","last_became_peered":"2023-12-19T18:58:43.436427+0000","last_unstale":"2023-12-19T18:58:45.544894+0000","last_undegraded":"2023-12-19T18:58:45.544894+0000","last_fullsized":"2023-12-19T18:58:45.544894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:28.581319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543362+0000","last_change":"2023-12-19T18:58:42.437129+0000","last_active":"2023-12-19T18:58:45.543362+0000","last_peered":"2023-12-19T18:58:45.543362+0000","last_clean":"2023-12-19T18:58:45.543362+0000","last_became_active":"2023-12-19T18:58:42.436883+0000","last_became_peered":"2023-12-19T18:58:42.436883+0000","last_unstale":"2023-12-19T18:58:45.543362+0000","last_undegraded":"2023-12-19T18:58:45.543362+0000","last_fullsized":"2023-12-19T18:58:45.543362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:29:22.986856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420570+0000","last_change":"2023-12-19T18:58:43.439701+0000","last_active":"2023-12-19T18:58:44.420570+0000","last_peered":"2023-12-19T18:58:44.420570+0000","last_clean":"2023-12-19T18:58:44.420570+0000","last_became_active":"2023-12-19T18:58:43.439425+0000","last_became_peered":"2023-12-19T18:58:43.439425+0000","last_unstale":"2023-12-19T18:58:44.420570+0000","last_undegraded":"2023-12-19T18:58:44.420570+0000","last_fullsized":"2023-12-19T18:58:44.420570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:19:43.614230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T18:58:43.415467+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T18:58:43.415467+0000","last_peered":"2023-12-19T18:58:43.415467+0000","last_clean":"2023-12-19T18:58:43.415467+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T18:58:43.415467+0000","last_undegraded":"2023-12-19T18:58:43.415467+0000","last_fullsized":"2023-12-19T18:58:43.415467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544357+0000","last_change":"2023-12-19T18:58:42.424370+0000","last_active":"2023-12-19T18:58:45.544357+0000","last_peered":"2023-12-19T18:58:45.544357+0000","last_clean":"2023-12-19T18:58:45.544357+0000","last_became_active":"2023-12-19T18:58:42.421937+0000","last_became_peered":"2023-12-19T18:58:42.421937+0000","last_unstale":"2023-12-19T18:58:45.544357+0000","last_undegraded":"2023-12-19T18:58:45.544357+0000","last_fullsized":"2023-12-19T18:58:45.544357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:45.366694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792573+0000","last_change":"2023-12-19T18:58:43.437901+0000","last_active":"2023-12-19T18:58:44.792573+0000","last_peered":"2023-12-19T18:58:44.792573+0000","last_clean":"2023-12-19T18:58:44.792573+0000","last_became_active":"2023-12-19T18:58:43.437671+0000","last_became_peered":"2023-12-19T18:58:43.437671+0000","last_unstale":"2023-12-19T18:58:44.792573+0000","last_undegraded":"2023-12-19T18:58:44.792573+0000","last_fullsized":"2023-12-19T18:58:44.792573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:34.691494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420255+0000","last_change":"2023-12-19T18:58:42.432721+0000","last_active":"2023-12-19T18:58:44.420255+0000","last_peered":"2023-12-19T18:58:44.420255+0000","last_clean":"2023-12-19T18:58:44.420255+0000","last_became_active":"2023-12-19T18:58:42.432424+0000","last_became_peered":"2023-12-19T18:58:42.432424+0000","last_unstale":"2023-12-19T18:58:44.420255+0000","last_undegraded":"2023-12-19T18:58:44.420255+0000","last_fullsized":"2023-12-19T18:58:44.420255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:18:45.847639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543868+0000","last_change":"2023-12-19T18:58:43.416870+0000","last_active":"2023-12-19T18:58:45.543868+0000","last_peered":"2023-12-19T18:58:45.543868+0000","last_clean":"2023-12-19T18:58:45.543868+0000","last_became_active":"2023-12-19T18:58:43.416531+0000","last_became_peered":"2023-12-19T18:58:43.416531+0000","last_unstale":"2023-12-19T18:58:45.543868+0000","last_undegraded":"2023-12-19T18:58:45.543868+0000","last_fullsized":"2023-12-19T18:58:45.543868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:09:06.965509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543476+0000","last_change":"2023-12-19T18:58:42.421802+0000","last_active":"2023-12-19T18:58:45.543476+0000","last_peered":"2023-12-19T18:58:45.543476+0000","last_clean":"2023-12-19T18:58:45.543476+0000","last_became_active":"2023-12-19T18:58:42.421453+0000","last_became_peered":"2023-12-19T18:58:42.421453+0000","last_unstale":"2023-12-19T18:58:45.543476+0000","last_undegraded":"2023-12-19T18:58:45.543476+0000","last_fullsized":"2023-12-19T18:58:45.543476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:07.210200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415759+0000","last_change":"2023-12-19T18:58:43.419130+0000","last_active":"2023-12-19T18:58:44.415759+0000","last_peered":"2023-12-19T18:58:44.415759+0000","last_clean":"2023-12-19T18:58:44.415759+0000","last_became_active":"2023-12-19T18:58:43.418765+0000","last_became_peered":"2023-12-19T18:58:43.418765+0000","last_unstale":"2023-12-19T18:58:44.415759+0000","last_undegraded":"2023-12-19T18:58:44.415759+0000","last_fullsized":"2023-12-19T18:58:44.415759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:46.373291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544926+0000","last_change":"2023-12-19T18:58:42.431000+0000","last_active":"2023-12-19T18:58:45.544926+0000","last_peered":"2023-12-19T18:58:45.544926+0000","last_clean":"2023-12-19T18:58:45.544926+0000","last_became_active":"2023-12-19T18:58:42.430652+0000","last_became_peered":"2023-12-19T18:58:42.430652+0000","last_unstale":"2023-12-19T18:58:45.544926+0000","last_undegraded":"2023-12-19T18:58:45.544926+0000","last_fullsized":"2023-12-19T18:58:45.544926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:44:03.095759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420568+0000","last_change":"2023-12-19T18:58:43.424247+0000","last_active":"2023-12-19T18:58:44.420568+0000","last_peered":"2023-12-19T18:58:44.420568+0000","last_clean":"2023-12-19T18:58:44.420568+0000","last_became_active":"2023-12-19T18:58:43.422534+0000","last_became_peered":"2023-12-19T18:58:43.422534+0000","last_unstale":"2023-12-19T18:58:44.420568+0000","last_undegraded":"2023-12-19T18:58:44.420568+0000","last_fullsized":"2023-12-19T18:58:44.420568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:25:24.585530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415907+0000","last_change":"2023-12-19T18:58:42.418032+0000","last_active":"2023-12-19T18:58:44.415907+0000","last_peered":"2023-12-19T18:58:44.415907+0000","last_clean":"2023-12-19T18:58:44.415907+0000","last_became_active":"2023-12-19T18:58:42.417765+0000","last_became_peered":"2023-12-19T18:58:42.417765+0000","last_unstale":"2023-12-19T18:58:44.415907+0000","last_undegraded":"2023-12-19T18:58:44.415907+0000","last_fullsized":"2023-12-19T18:58:44.415907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:09:05.958912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.545286+0000","last_change":"2023-12-19T18:58:43.438006+0000","last_active":"2023-12-19T18:58:45.545286+0000","last_peered":"2023-12-19T18:58:45.545286+0000","last_clean":"2023-12-19T18:58:45.545286+0000","last_became_active":"2023-12-19T18:58:43.437618+0000","last_became_peered":"2023-12-19T18:58:43.437618+0000","last_unstale":"2023-12-19T18:58:45.545286+0000","last_undegraded":"2023-12-19T18:58:45.545286+0000","last_fullsized":"2023-12-19T18:58:45.545286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:43:58.809550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420900+0000","last_change":"2023-12-19T18:58:42.433488+0000","last_active":"2023-12-19T18:58:44.420900+0000","last_peered":"2023-12-19T18:58:44.420900+0000","last_clean":"2023-12-19T18:58:44.420900+0000","last_became_active":"2023-12-19T18:58:42.433023+0000","last_became_peered":"2023-12-19T18:58:42.433023+0000","last_unstale":"2023-12-19T18:58:44.420900+0000","last_undegraded":"2023-12-19T18:58:44.420900+0000","last_fullsized":"2023-12-19T18:58:44.420900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:25.520152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415951+0000","last_change":"2023-12-19T18:58:43.419840+0000","last_active":"2023-12-19T18:58:44.415951+0000","last_peered":"2023-12-19T18:58:44.415951+0000","last_clean":"2023-12-19T18:58:44.415951+0000","last_became_active":"2023-12-19T18:58:43.419340+0000","last_became_peered":"2023-12-19T18:58:43.419340+0000","last_unstale":"2023-12-19T18:58:44.415951+0000","last_undegraded":"2023-12-19T18:58:44.415951+0000","last_fullsized":"2023-12-19T18:58:44.415951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:34.691494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.416167+0000","last_change":"2023-12-19T18:58:42.421889+0000","last_active":"2023-12-19T18:58:44.416167+0000","last_peered":"2023-12-19T18:58:44.416167+0000","last_clean":"2023-12-19T18:58:44.416167+0000","last_became_active":"2023-12-19T18:58:42.421524+0000","last_became_peered":"2023-12-19T18:58:42.421524+0000","last_unstale":"2023-12-19T18:58:44.416167+0000","last_undegraded":"2023-12-19T18:58:44.416167+0000","last_fullsized":"2023-12-19T18:58:44.416167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:24:57.289171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792880+0000","last_change":"2023-12-19T18:58:43.427768+0000","last_active":"2023-12-19T18:58:44.792880+0000","last_peered":"2023-12-19T18:58:44.792880+0000","last_clean":"2023-12-19T18:58:44.792880+0000","last_became_active":"2023-12-19T18:58:43.427358+0000","last_became_peered":"2023-12-19T18:58:43.427358+0000","last_unstale":"2023-12-19T18:58:44.792880+0000","last_undegraded":"2023-12-19T18:58:44.792880+0000","last_fullsized":"2023-12-19T18:58:44.792880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:25:40.712335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544879+0000","last_change":"2023-12-19T18:58:42.433397+0000","last_active":"2023-12-19T18:58:45.544879+0000","last_peered":"2023-12-19T18:58:45.544879+0000","last_clean":"2023-12-19T18:58:45.544879+0000","last_became_active":"2023-12-19T18:58:42.433055+0000","last_became_peered":"2023-12-19T18:58:42.433055+0000","last_unstale":"2023-12-19T18:58:45.544879+0000","last_undegraded":"2023-12-19T18:58:45.544879+0000","last_fullsized":"2023-12-19T18:58:45.544879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:09:05.958912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544244+0000","last_change":"2023-12-19T18:58:43.421411+0000","last_active":"2023-12-19T18:58:45.544244+0000","last_peered":"2023-12-19T18:58:45.544244+0000","last_clean":"2023-12-19T18:58:45.544244+0000","last_became_active":"2023-12-19T18:58:43.421095+0000","last_became_peered":"2023-12-19T18:58:43.421095+0000","last_unstale":"2023-12-19T18:58:45.544244+0000","last_undegraded":"2023-12-19T18:58:45.544244+0000","last_fullsized":"2023-12-19T18:58:45.544244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:46.373291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420158+0000","last_change":"2023-12-19T18:58:42.434661+0000","last_active":"2023-12-19T18:58:44.420158+0000","last_peered":"2023-12-19T18:58:44.420158+0000","last_clean":"2023-12-19T18:58:44.420158+0000","last_became_active":"2023-12-19T18:58:42.432945+0000","last_became_peered":"2023-12-19T18:58:42.432945+0000","last_unstale":"2023-12-19T18:58:44.420158+0000","last_undegraded":"2023-12-19T18:58:44.420158+0000","last_fullsized":"2023-12-19T18:58:44.420158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:33:01.472458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420046+0000","last_change":"2023-12-19T18:58:43.430118+0000","last_active":"2023-12-19T18:58:44.420046+0000","last_peered":"2023-12-19T18:58:44.420046+0000","last_clean":"2023-12-19T18:58:44.420046+0000","last_became_active":"2023-12-19T18:58:43.428710+0000","last_became_peered":"2023-12-19T18:58:43.428710+0000","last_unstale":"2023-12-19T18:58:44.420046+0000","last_undegraded":"2023-12-19T18:58:44.420046+0000","last_fullsized":"2023-12-19T18:58:44.420046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:20:04.608095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415775+0000","last_change":"2023-12-19T18:58:42.432562+0000","last_active":"2023-12-19T18:58:44.415775+0000","last_peered":"2023-12-19T18:58:44.415775+0000","last_clean":"2023-12-19T18:58:44.415775+0000","last_became_active":"2023-12-19T18:58:42.432307+0000","last_became_peered":"2023-12-19T18:58:42.432307+0000","last_unstale":"2023-12-19T18:58:44.415775+0000","last_undegraded":"2023-12-19T18:58:44.415775+0000","last_fullsized":"2023-12-19T18:58:44.415775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:35.982824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792510+0000","last_change":"2023-12-19T18:58:43.421115+0000","last_active":"2023-12-19T18:58:44.792510+0000","last_peered":"2023-12-19T18:58:44.792510+0000","last_clean":"2023-12-19T18:58:44.792510+0000","last_became_active":"2023-12-19T18:58:43.419370+0000","last_became_peered":"2023-12-19T18:58:43.419370+0000","last_unstale":"2023-12-19T18:58:44.792510+0000","last_undegraded":"2023-12-19T18:58:44.792510+0000","last_fullsized":"2023-12-19T18:58:44.792510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:46.373291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415921+0000","last_change":"2023-12-19T18:58:42.428553+0000","last_active":"2023-12-19T18:58:44.415921+0000","last_peered":"2023-12-19T18:58:44.415921+0000","last_clean":"2023-12-19T18:58:44.415921+0000","last_became_active":"2023-12-19T18:58:42.425181+0000","last_became_peered":"2023-12-19T18:58:42.425181+0000","last_unstale":"2023-12-19T18:58:44.415921+0000","last_undegraded":"2023-12-19T18:58:44.415921+0000","last_fullsized":"2023-12-19T18:58:44.415921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:29.889906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792641+0000","last_change":"2023-12-19T18:58:43.425659+0000","last_active":"2023-12-19T18:58:44.792641+0000","last_peered":"2023-12-19T18:58:44.792641+0000","last_clean":"2023-12-19T18:58:44.792641+0000","last_became_active":"2023-12-19T18:58:43.425393+0000","last_became_peered":"2023-12-19T18:58:43.425393+0000","last_unstale":"2023-12-19T18:58:44.792641+0000","last_undegraded":"2023-12-19T18:58:44.792641+0000","last_fullsized":"2023-12-19T18:58:44.792641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:07.765261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420547+0000","last_change":"2023-12-19T18:58:42.432966+0000","last_active":"2023-12-19T18:58:44.420547+0000","last_peered":"2023-12-19T18:58:44.420547+0000","last_clean":"2023-12-19T18:58:44.420547+0000","last_became_active":"2023-12-19T18:58:42.432661+0000","last_became_peered":"2023-12-19T18:58:42.432661+0000","last_unstale":"2023-12-19T18:58:44.420547+0000","last_undegraded":"2023-12-19T18:58:44.420547+0000","last_fullsized":"2023-12-19T18:58:44.420547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:06.758664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544675+0000","last_change":"2023-12-19T18:58:43.428930+0000","last_active":"2023-12-19T18:58:45.544675+0000","last_peered":"2023-12-19T18:58:45.544675+0000","last_clean":"2023-12-19T18:58:45.544675+0000","last_became_active":"2023-12-19T18:58:43.428623+0000","last_became_peered":"2023-12-19T18:58:43.428623+0000","last_unstale":"2023-12-19T18:58:45.544675+0000","last_undegraded":"2023-12-19T18:58:45.544675+0000","last_fullsized":"2023-12-19T18:58:45.544675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:07.765261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.545246+0000","last_change":"2023-12-19T18:58:43.438141+0000","last_active":"2023-12-19T18:58:45.545246+0000","last_peered":"2023-12-19T18:58:45.545246+0000","last_clean":"2023-12-19T18:58:45.545246+0000","last_became_active":"2023-12-19T18:58:43.437765+0000","last_became_peered":"2023-12-19T18:58:43.437765+0000","last_unstale":"2023-12-19T18:58:45.545246+0000","last_undegraded":"2023-12-19T18:58:45.545246+0000","last_fullsized":"2023-12-19T18:58:45.545246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:46.807064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420235+0000","last_change":"2023-12-19T18:58:42.436647+0000","last_active":"2023-12-19T18:58:44.420235+0000","last_peered":"2023-12-19T18:58:44.420235+0000","last_clean":"2023-12-19T18:58:44.420235+0000","last_became_active":"2023-12-19T18:58:42.436356+0000","last_became_peered":"2023-12-19T18:58:42.436356+0000","last_unstale":"2023-12-19T18:58:44.420235+0000","last_undegraded":"2023-12-19T18:58:44.420235+0000","last_fullsized":"2023-12-19T18:58:44.420235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:06.491761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544884+0000","last_change":"2023-12-19T18:58:43.438524+0000","last_active":"2023-12-19T18:58:45.544884+0000","last_peered":"2023-12-19T18:58:45.544884+0000","last_clean":"2023-12-19T18:58:45.544884+0000","last_became_active":"2023-12-19T18:58:43.436745+0000","last_became_peered":"2023-12-19T18:58:43.436745+0000","last_unstale":"2023-12-19T18:58:45.544884+0000","last_undegraded":"2023-12-19T18:58:45.544884+0000","last_fullsized":"2023-12-19T18:58:45.544884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:32:14.763407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420673+0000","last_change":"2023-12-19T18:58:42.432955+0000","last_active":"2023-12-19T18:58:44.420673+0000","last_peered":"2023-12-19T18:58:44.420673+0000","last_clean":"2023-12-19T18:58:44.420673+0000","last_became_active":"2023-12-19T18:58:42.432616+0000","last_became_peered":"2023-12-19T18:58:42.432616+0000","last_unstale":"2023-12-19T18:58:44.420673+0000","last_undegraded":"2023-12-19T18:58:44.420673+0000","last_fullsized":"2023-12-19T18:58:44.420673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:15.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544293+0000","last_change":"2023-12-19T18:58:43.440165+0000","last_active":"2023-12-19T18:58:45.544293+0000","last_peered":"2023-12-19T18:58:45.544293+0000","last_clean":"2023-12-19T18:58:45.544293+0000","last_became_active":"2023-12-19T18:58:43.439853+0000","last_became_peered":"2023-12-19T18:58:43.439853+0000","last_unstale":"2023-12-19T18:58:45.544293+0000","last_undegraded":"2023-12-19T18:58:45.544293+0000","last_fullsized":"2023-12-19T18:58:45.544293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:07.765261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792856+0000","last_change":"2023-12-19T18:58:42.423728+0000","last_active":"2023-12-19T18:58:44.792856+0000","last_peered":"2023-12-19T18:58:44.792856+0000","last_clean":"2023-12-19T18:58:44.792856+0000","last_became_active":"2023-12-19T18:58:42.423467+0000","last_became_peered":"2023-12-19T18:58:42.423467+0000","last_unstale":"2023-12-19T18:58:44.792856+0000","last_undegraded":"2023-12-19T18:58:44.792856+0000","last_fullsized":"2023-12-19T18:58:44.792856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:09:05.958912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792893+0000","last_change":"2023-12-19T18:58:43.431360+0000","last_active":"2023-12-19T18:58:44.792893+0000","last_peered":"2023-12-19T18:58:44.792893+0000","last_clean":"2023-12-19T18:58:44.792893+0000","last_became_active":"2023-12-19T18:58:43.431079+0000","last_became_peered":"2023-12-19T18:58:43.431079+0000","last_unstale":"2023-12-19T18:58:44.792893+0000","last_undegraded":"2023-12-19T18:58:44.792893+0000","last_fullsized":"2023-12-19T18:58:44.792893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:19:43.614230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544292+0000","last_change":"2023-12-19T18:58:42.428088+0000","last_active":"2023-12-19T18:58:45.544292+0000","last_peered":"2023-12-19T18:58:45.544292+0000","last_clean":"2023-12-19T18:58:45.544292+0000","last_became_active":"2023-12-19T18:58:42.427833+0000","last_became_peered":"2023-12-19T18:58:42.427833+0000","last_unstale":"2023-12-19T18:58:45.544292+0000","last_undegraded":"2023-12-19T18:58:45.544292+0000","last_fullsized":"2023-12-19T18:58:45.544292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:15.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7690000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.641}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.3040000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.097}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.0410000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":192512,"data_stored":64610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":794624,"data_stored":654597,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T18:58:48.059 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T18:58:48.059 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-19T18:58:48.059 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-19T18:58:48.059 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-19T18:58:48.060 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-19T18:58:48.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.236+0000 7f76ba380640 1 Processor -- start 2023-12-19T18:58:48.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.236+0000 7f76ba380640 1 -- start start 2023-12-19T18:58:48.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.236+0000 7f76ba380640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f76b40c63c0 0x7f76b40c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:48.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.236+0000 7f76ba380640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b40c31c0 con 0x7f76b40c2bb0 2023-12-19T18:58:48.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.236+0000 7f76ba380640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b40c34a0 con 0x7f76b40c4100 2023-12-19T18:58:48.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.236+0000 7f76ba380640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b40c1030 con 0x7f76b40c63c0 2023-12-19T18:58:48.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.236+0000 7f76b3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f76b40c63c0 0x7f76b40c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:48.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.236+0000 7f76b891d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f76b40c2bb0 0x7f76b40a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42438/0 (socket says 172.21.15.133:42438) 2023-12-19T18:58:48.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.236+0000 7f76b891d640 1 -- 172.21.15.133:0/715111766 learned_addr learned my addr 172.21.15.133:0/715111766 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:48.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.236+0000 7f76b3fff640 1 -- 172.21.15.133:0/715111766 >> v1:172.21.15.138:6789/0 conn(0x7f76b40c4100 legacy=0x7f76b40c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:48.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.236+0000 7f76b3fff640 1 -- 172.21.15.133:0/715111766 >> v1:172.21.15.133:6789/0 conn(0x7f76b40c2bb0 legacy=0x7f76b40a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:48.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.236+0000 7f76b2ffd640 1 -- 172.21.15.133:0/715111766 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4185917160 0 0) 0x7f76b40c31c0 con 0x7f76b40c2bb0 2023-12-19T18:58:48.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.236+0000 7f76b3fff640 1 -- 172.21.15.133:0/715111766 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b40c1310 con 0x7f76b40c63c0 2023-12-19T18:58:48.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.240+0000 7f76b3fff640 1 --2- 172.21.15.133:0/715111766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b40c63c0 0x7f76b40c06d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f76a40097c0 tx=0x7f76a401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bce03462d3a09c8c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:48.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.240+0000 7f76b2ffd640 1 -- 172.21.15.133:0/715111766 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a40ad680 con 0x7f76b40c63c0 2023-12-19T18:58:48.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.240+0000 7f76b2ffd640 1 -- 172.21.15.133:0/715111766 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a40ad7e0 con 0x7f76b40c63c0 2023-12-19T18:58:48.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.240+0000 7f76b2ffd640 1 -- 172.21.15.133:0/715111766 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a40adb70 con 0x7f76b40c63c0 2023-12-19T18:58:48.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.240+0000 7f76ba380640 1 -- 172.21.15.133:0/715111766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b40c63c0 msgr2=0x7f76b40c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:48.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.240+0000 7f76ba380640 1 --2- 172.21.15.133:0/715111766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b40c63c0 0x7f76b40c06d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f76a40097c0 tx=0x7f76a401c360 comp rx=0 tx=0).stop 2023-12-19T18:58:48.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.240+0000 7f76ba380640 1 -- 172.21.15.133:0/715111766 shutdown_connections 2023-12-19T18:58:48.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.240+0000 7f76ba380640 1 --2- 172.21.15.133:0/715111766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b40c63c0 0x7f76b40c06d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.240+0000 7f76ba380640 1 -- 172.21.15.133:0/715111766 >> 172.21.15.133:0/715111766 conn(0x7f76b406a5b0 msgr2=0x7f76b406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:48.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.240+0000 7f76ba380640 1 -- 172.21.15.133:0/715111766 shutdown_connections 2023-12-19T18:58:48.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.240+0000 7f76ba380640 1 -- 172.21.15.133:0/715111766 wait complete. 2023-12-19T18:58:48.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76ba380640 1 Processor -- start 2023-12-19T18:58:48.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76ba380640 1 -- start start 2023-12-19T18:58:48.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76ba380640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b40c2bb0 0x7f76b40c0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:48.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76ba380640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76b40c4100 0x7f76b41ed810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:48.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76ba380640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76b40c63c0 0x7f76b41edd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:48.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76ba380640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b41449f0 con 0x7f76b40c2bb0 2023-12-19T18:58:48.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76ba380640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b415b930 con 0x7f76b40c63c0 2023-12-19T18:58:48.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76ba380640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b415c120 con 0x7f76b40c4100 2023-12-19T18:58:48.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76b3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b40c2bb0 0x7f76b40c0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:48.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76b3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b40c2bb0 0x7f76b40c0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54410/0 (socket says 172.21.15.133:54410) 2023-12-19T18:58:48.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76b3fff640 1 -- 172.21.15.133:0/3384139167 learned_addr learned my addr 172.21.15.133:0/3384139167 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:48.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76b37fe640 1 --2- 172.21.15.133:0/3384139167 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76b40c4100 0x7f76b41ed810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:48.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76b891d640 1 --2- 172.21.15.133:0/3384139167 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76b40c63c0 0x7f76b41edd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:48.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76b3fff640 1 -- 172.21.15.133:0/3384139167 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76b40c4100 msgr2=0x7f76b41ed810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:48.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76b3fff640 1 --2- 172.21.15.133:0/3384139167 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76b40c4100 0x7f76b41ed810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76b3fff640 1 -- 172.21.15.133:0/3384139167 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76b40c63c0 msgr2=0x7f76b41edd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:48.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76b3fff640 1 --2- 172.21.15.133:0/3384139167 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76b40c63c0 0x7f76b41edd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76b3fff640 1 -- 172.21.15.133:0/3384139167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a4009420 con 0x7f76b40c2bb0 2023-12-19T18:58:48.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76b3fff640 1 --2- 172.21.15.133:0/3384139167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b40c2bb0 0x7f76b40c0170 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f76a4019f90 tx=0x7f76a401aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:48.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76b0ff9640 1 -- 172.21.15.133:0/3384139167 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a40adea0 con 0x7f76b40c2bb0 2023-12-19T18:58:48.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76b0ff9640 1 -- 172.21.15.133:0/3384139167 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a40b8420 con 0x7f76b40c2bb0 2023-12-19T18:58:48.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76b0ff9640 1 -- 172.21.15.133:0/3384139167 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a40b87b0 con 0x7f76b40c2bb0 2023-12-19T18:58:48.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76ba380640 1 -- 172.21.15.133:0/3384139167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b40c69b0 con 0x7f76b40c2bb0 2023-12-19T18:58:48.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76ba380640 1 -- 172.21.15.133:0/3384139167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b41ed380 con 0x7f76b40c2bb0 2023-12-19T18:58:48.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.244+0000 7f76ba380640 1 -- 172.21.15.133:0/3384139167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b4068400 con 0x7f76b40c2bb0 2023-12-19T18:58:48.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.248+0000 7f76b0ff9640 1 -- 172.21.15.133:0/3384139167 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f76a40b4040 con 0x7f76b40c2bb0 2023-12-19T18:58:48.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.248+0000 7f76b0ff9640 1 --2- 172.21.15.133:0/3384139167 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f76a0066470 0x7f76a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:48.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.248+0000 7f76b0ff9640 1 -- 172.21.15.133:0/3384139167 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76a411e2c0 con 0x7f76b40c2bb0 2023-12-19T18:58:48.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.248+0000 7f76b37fe640 1 --2- 172.21.15.133:0/3384139167 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f76a0066470 0x7f76a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:48.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.248+0000 7f76b37fe640 1 --2- 172.21.15.133:0/3384139167 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f76a0066470 0x7f76a0068930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f76b406ffb0 tx=0x7f76a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:48.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.252+0000 7f76b0ff9640 1 -- 172.21.15.133:0/3384139167 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f76a40eb7e0 con 0x7f76b40c2bb0 2023-12-19T18:58:48.381 INFO:tasks.ceph.mds.a.smithi133.stderr:2023-12-19T18:58:48.376+0000 7f2be7727640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T18:58:48.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.436+0000 7f76ba380640 1 -- 172.21.15.133:0/3384139167 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f76b41ed150 con 0x7f76b40c2bb0 2023-12-19T18:58:48.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.440+0000 7f76b0ff9640 1 -- 172.21.15.133:0/3384139167 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164438 (secure 0 0 0) 0x7f76a40eee00 con 0x7f76b40c2bb0 2023-12-19T18:58:48.446 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:48.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.444+0000 7f76ba380640 1 -- 172.21.15.133:0/3384139167 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f76a0066470 msgr2=0x7f76a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:48.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.444+0000 7f76ba380640 1 --2- 172.21.15.133:0/3384139167 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f76a0066470 0x7f76a0068930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f76b406ffb0 tx=0x7f76a8009040 comp rx=0 tx=0).stop 2023-12-19T18:58:48.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.444+0000 7f76ba380640 1 -- 172.21.15.133:0/3384139167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b40c2bb0 msgr2=0x7f76b40c0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:48.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.444+0000 7f76ba380640 1 --2- 172.21.15.133:0/3384139167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b40c2bb0 0x7f76b40c0170 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f76a4019f90 tx=0x7f76a401aba0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.444+0000 7f76ba380640 1 -- 172.21.15.133:0/3384139167 shutdown_connections 2023-12-19T18:58:48.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.444+0000 7f76ba380640 1 --2- 172.21.15.133:0/3384139167 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f76a0066470 0x7f76a0068930 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.444+0000 7f76ba380640 1 --2- 172.21.15.133:0/3384139167 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76b40c63c0 0x7f76b41edd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.444+0000 7f76ba380640 1 --2- 172.21.15.133:0/3384139167 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76b40c4100 0x7f76b41ed810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.444+0000 7f76ba380640 1 --2- 172.21.15.133:0/3384139167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76b40c2bb0 0x7f76b40c0170 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.444+0000 7f76ba380640 1 -- 172.21.15.133:0/3384139167 >> 172.21.15.133:0/3384139167 conn(0x7f76b406a5b0 msgr2=0x7f76b4070bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:48.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.444+0000 7f76ba380640 1 -- 172.21.15.133:0/3384139167 shutdown_connections 2023-12-19T18:58:48.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.444+0000 7f76ba380640 1 -- 172.21.15.133:0/3384139167 wait complete. 2023-12-19T18:58:48.466 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":185741991},{"type":"v1","addr":"172.21.15.138:6833","nonce":185741991}]},"active_addr":"172.21.15.138:6833/185741991","active_change":"2023-12-19T18:58:22.816940+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":1367237993}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":1671603665}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":1231149216}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":1255769880}]}]} 2023-12-19T18:58:48.472 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-19T18:58:48.472 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-19T18:58:48.472 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:58:48.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.608+0000 7f62b851d640 1 Processor -- start 2023-12-19T18:58:48.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.608+0000 7f62b851d640 1 -- start start 2023-12-19T18:58:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.608+0000 7f62b851d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f62b0151e90 0x7f62b00c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.608+0000 7f62b851d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f62b00c7ea0 0x7f62b006b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.608+0000 7f62b851d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b006c860 con 0x7f62b00c4e60 2023-12-19T18:58:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.608+0000 7f62b851d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b00c8750 con 0x7f62b0151e90 2023-12-19T18:58:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.608+0000 7f62b851d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b01552d0 con 0x7f62b00c7ea0 2023-12-19T18:58:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.608+0000 7f62b6aba640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f62b00c4e60 0x7f62b006b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42446/0 (socket says 172.21.15.133:42446) 2023-12-19T18:58:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.608+0000 7f62b6aba640 1 -- 172.21.15.133:0/3267964121 learned_addr learned my addr 172.21.15.133:0/3267964121 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.608+0000 7f62b62b9640 1 --2- 172.21.15.133:0/3267964121 >> v2:172.21.15.138:3300/0 conn(0x7f62b0151e90 0x7f62b00c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:48.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.608+0000 7f62b5ab8640 1 --2- 172.21.15.133:0/3267964121 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f62b00c7ea0 0x7f62b006b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:48.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.608+0000 7f62b52b7640 1 -- 172.21.15.133:0/3267964121 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2284948370 0 0) 0x7f62b006c860 con 0x7f62b00c4e60 2023-12-19T18:58:48.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.608+0000 7f62b52b7640 1 -- 172.21.15.133:0/3267964121 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f629c003530 con 0x7f62b00c4e60 2023-12-19T18:58:48.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.608+0000 7f62b62b9640 1 -- 172.21.15.133:0/3267964121 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f62b00c7ea0 msgr2=0x7f62b006b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:48.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.608+0000 7f62b62b9640 1 --2- 172.21.15.133:0/3267964121 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f62b00c7ea0 0x7f62b006b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.608+0000 7f62b62b9640 1 -- 172.21.15.133:0/3267964121 >> v1:172.21.15.133:6789/0 conn(0x7f62b00c4e60 legacy=0x7f62b006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:48.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.608+0000 7f62b62b9640 1 -- 172.21.15.133:0/3267964121 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b0154930 con 0x7f62b0151e90 2023-12-19T18:58:48.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.612+0000 7f62b62b9640 1 --2- 172.21.15.133:0/3267964121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62b0151e90 0x7f62b00c4920 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f62ac0097c0 tx=0x7f62ac01c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bc56b01ccd6876 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:48.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.612+0000 7f62b52b7640 1 -- 172.21.15.133:0/3267964121 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0ab600 con 0x7f62b0151e90 2023-12-19T18:58:48.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.612+0000 7f62b52b7640 1 -- 172.21.15.133:0/3267964121 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac0a7050 con 0x7f62b0151e90 2023-12-19T18:58:48.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.612+0000 7f62b52b7640 1 -- 172.21.15.133:0/3267964121 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0ab960 con 0x7f62b0151e90 2023-12-19T18:58:48.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.612+0000 7f62b851d640 1 -- 172.21.15.133:0/3267964121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62b0151e90 msgr2=0x7f62b00c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:48.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.612+0000 7f62b851d640 1 --2- 172.21.15.133:0/3267964121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62b0151e90 0x7f62b00c4920 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f62ac0097c0 tx=0x7f62ac01c360 comp rx=0 tx=0).stop 2023-12-19T18:58:48.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.612+0000 7f62b851d640 1 -- 172.21.15.133:0/3267964121 shutdown_connections 2023-12-19T18:58:48.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.612+0000 7f62b851d640 1 --2- 172.21.15.133:0/3267964121 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f62b00c7ea0 0x7f62b006b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.612+0000 7f62b851d640 1 --2- 172.21.15.133:0/3267964121 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62b0151e90 0x7f62b00c4920 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.612+0000 7f62b851d640 1 -- 172.21.15.133:0/3267964121 >> 172.21.15.133:0/3267964121 conn(0x7f62b00ca170 msgr2=0x7f62b00ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:48.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.612+0000 7f62b851d640 1 -- 172.21.15.133:0/3267964121 shutdown_connections 2023-12-19T18:58:48.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.612+0000 7f62b851d640 1 -- 172.21.15.133:0/3267964121 wait complete. 2023-12-19T18:58:48.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62b851d640 1 Processor -- start 2023-12-19T18:58:48.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62b851d640 1 -- start start 2023-12-19T18:58:48.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62b851d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62b00c4e60 0x7f62b01ee070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:48.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62b851d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f62b00c7ea0 0x7f62b014ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:48.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62b851d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62b0151e90 0x7f62b01443f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:48.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62b851d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b014b9d0 con 0x7f62b00c4e60 2023-12-19T18:58:48.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62b851d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b01455f0 con 0x7f62b0151e90 2023-12-19T18:58:48.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62b851d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b014c2f0 con 0x7f62b00c7ea0 2023-12-19T18:58:48.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62b62b9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62b00c4e60 0x7f62b01ee070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:48.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62b62b9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62b00c4e60 0x7f62b01ee070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54426/0 (socket says 172.21.15.133:54426) 2023-12-19T18:58:48.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62b62b9640 1 -- 172.21.15.133:0/602962517 learned_addr learned my addr 172.21.15.133:0/602962517 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:48.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62b6aba640 1 --2- 172.21.15.133:0/602962517 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62b0151e90 0x7f62b01443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:48.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62b5ab8640 1 --2- 172.21.15.133:0/602962517 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f62b00c7ea0 0x7f62b014ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:48.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62b62b9640 1 -- 172.21.15.133:0/602962517 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f62b00c7ea0 msgr2=0x7f62b014ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:48.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62b62b9640 1 --2- 172.21.15.133:0/602962517 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f62b00c7ea0 0x7f62b014ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62b62b9640 1 -- 172.21.15.133:0/602962517 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62b0151e90 msgr2=0x7f62b01443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:48.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62b62b9640 1 --2- 172.21.15.133:0/602962517 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62b0151e90 0x7f62b01443f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62b62b9640 1 -- 172.21.15.133:0/602962517 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ac009420 con 0x7f62b00c4e60 2023-12-19T18:58:48.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62b62b9640 1 --2- 172.21.15.133:0/602962517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62b00c4e60 0x7f62b01ee070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f62ac019f90 tx=0x7f62ac019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:48.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62a6ffd640 1 -- 172.21.15.133:0/602962517 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0abce0 con 0x7f62b00c4e60 2023-12-19T18:58:48.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62a6ffd640 1 -- 172.21.15.133:0/602962517 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ac0abe40 con 0x7f62b00c4e60 2023-12-19T18:58:48.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62b851d640 1 -- 172.21.15.133:0/602962517 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b0144de0 con 0x7f62b00c4e60 2023-12-19T18:58:48.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62a6ffd640 1 -- 172.21.15.133:0/602962517 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ac0b4600 con 0x7f62b00c4e60 2023-12-19T18:58:48.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62b851d640 1 -- 172.21.15.133:0/602962517 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b01ee5b0 con 0x7f62b00c4e60 2023-12-19T18:58:48.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.616+0000 7f62b851d640 1 -- 172.21.15.133:0/602962517 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b0068400 con 0x7f62b00c4e60 2023-12-19T18:58:48.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.620+0000 7f62a6ffd640 1 -- 172.21.15.133:0/602962517 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f62ac0b2040 con 0x7f62b00c4e60 2023-12-19T18:58:48.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.620+0000 7f62a6ffd640 1 --2- 172.21.15.133:0/602962517 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6294066470 0x7f6294068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:48.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.620+0000 7f62a6ffd640 1 -- 172.21.15.133:0/602962517 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62ac11db50 con 0x7f62b00c4e60 2023-12-19T18:58:48.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.620+0000 7f62b5ab8640 1 --2- 172.21.15.133:0/602962517 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6294066470 0x7f6294068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:48.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.620+0000 7f62b5ab8640 1 --2- 172.21.15.133:0/602962517 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6294066470 0x7f6294068930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f62b0151560 tx=0x7f62a0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:48.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.624+0000 7f62a6ffd640 1 -- 172.21.15.133:0/602962517 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f62ac0eb110 con 0x7f62b00c4e60 2023-12-19T18:58:48.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.772+0000 7f62b851d640 1 -- 172.21.15.133:0/602962517 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f62b015ebd0 con 0x7f62b00c4e60 2023-12-19T18:58:48.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.776+0000 7f62a6ffd640 1 -- 172.21.15.133:0/602962517 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f62ac0ee730 con 0x7f62b00c4e60 2023-12-19T18:58:48.779 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:48.779 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:44.402984+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:58:40.991408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T18:58:41.773992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:58:48.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.776+0000 7f62b851d640 1 -- 172.21.15.133:0/602962517 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6294066470 msgr2=0x7f6294068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:48.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.776+0000 7f62b851d640 1 --2- 172.21.15.133:0/602962517 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6294066470 0x7f6294068930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f62b0151560 tx=0x7f62a0009190 comp rx=0 tx=0).stop 2023-12-19T18:58:48.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.776+0000 7f62b851d640 1 -- 172.21.15.133:0/602962517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62b00c4e60 msgr2=0x7f62b01ee070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:48.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.776+0000 7f62b851d640 1 --2- 172.21.15.133:0/602962517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62b00c4e60 0x7f62b01ee070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f62ac019f90 tx=0x7f62ac019100 comp rx=0 tx=0).stop 2023-12-19T18:58:48.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.776+0000 7f62b851d640 1 -- 172.21.15.133:0/602962517 shutdown_connections 2023-12-19T18:58:48.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.776+0000 7f62b851d640 1 --2- 172.21.15.133:0/602962517 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6294066470 0x7f6294068930 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.776+0000 7f62b851d640 1 --2- 172.21.15.133:0/602962517 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f62b0151e90 0x7f62b01443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.776+0000 7f62b851d640 1 --2- 172.21.15.133:0/602962517 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f62b00c7ea0 0x7f62b014ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.776+0000 7f62b851d640 1 --2- 172.21.15.133:0/602962517 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f62b00c4e60 0x7f62b01ee070 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.776+0000 7f62b851d640 1 -- 172.21.15.133:0/602962517 >> 172.21.15.133:0/602962517 conn(0x7f62b00ca170 msgr2=0x7f62b006b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:48.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.776+0000 7f62b851d640 1 -- 172.21.15.133:0/602962517 shutdown_connections 2023-12-19T18:58:48.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.776+0000 7f62b851d640 1 -- 172.21.15.133:0/602962517 wait complete. 2023-12-19T18:58:48.800 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-19T18:58:48.800 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:58:48.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.936+0000 7fdb65a7b640 1 Processor -- start 2023-12-19T18:58:48.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.936+0000 7fdb65a7b640 1 -- start start 2023-12-19T18:58:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.936+0000 7fdb65a7b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdb60151cd0 0x7fdb600ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.936+0000 7fdb65a7b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fdb60154be0 0x7fdb6015ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.936+0000 7fdb65a7b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb600c8160 con 0x7fdb600c7c50 2023-12-19T18:58:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.936+0000 7fdb65a7b640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb60157b40 con 0x7fdb60151cd0 2023-12-19T18:58:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.936+0000 7fdb65a7b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb60157e20 con 0x7fdb60154be0 2023-12-19T18:58:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.936+0000 7fdb64a79640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdb60151cd0 0x7fdb600ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.936+0000 7fdb5ffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdb600c7c50 0x7fdb601544d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42462/0 (socket says 172.21.15.133:42462) 2023-12-19T18:58:48.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.936+0000 7fdb5ffff640 1 -- 172.21.15.133:0/1336490986 learned_addr learned my addr 172.21.15.133:0/1336490986 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:48.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.936+0000 7fdb64a79640 1 -- 172.21.15.133:0/1336490986 >> v2:172.21.15.138:3300/0 conn(0x7fdb60154be0 msgr2=0x7fdb6015ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:48.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.936+0000 7fdb6527a640 1 --2- 172.21.15.133:0/1336490986 >> v2:172.21.15.138:3300/0 conn(0x7fdb60154be0 0x7fdb6015ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:48.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.936+0000 7fdb5f7fe640 1 -- 172.21.15.133:0/1336490986 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2261786974 0 0) 0x7fdb600c8160 con 0x7fdb600c7c50 2023-12-19T18:58:48.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.936+0000 7fdb64a79640 1 --2- 172.21.15.133:0/1336490986 >> v2:172.21.15.138:3300/0 conn(0x7fdb60154be0 0x7fdb6015ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.936+0000 7fdb64a79640 1 -- 172.21.15.133:0/1336490986 >> v1:172.21.15.133:6789/0 conn(0x7fdb600c7c50 legacy=0x7fdb601544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:48.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.936+0000 7fdb64a79640 1 -- 172.21.15.133:0/1336490986 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb60158100 con 0x7fdb60151cd0 2023-12-19T18:58:48.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.936+0000 7fdb6527a640 1 --2- 172.21.15.133:0/1336490986 >> v2:172.21.15.138:3300/0 conn(0x7fdb60154be0 0x7fdb6015ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:48.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.940+0000 7fdb64a79640 1 --2- 172.21.15.133:0/1336490986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb60151cd0 0x7fdb600ca460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdb6008b2c0 tx=0x7fdb5401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a354277f46d27 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:48.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.940+0000 7fdb5f7fe640 1 -- 172.21.15.133:0/1336490986 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb540ab650 con 0x7fdb60151cd0 2023-12-19T18:58:48.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.940+0000 7fdb5f7fe640 1 -- 172.21.15.133:0/1336490986 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb540ab7b0 con 0x7fdb60151cd0 2023-12-19T18:58:48.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.940+0000 7fdb5f7fe640 1 -- 172.21.15.133:0/1336490986 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb540abb40 con 0x7fdb60151cd0 2023-12-19T18:58:48.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.940+0000 7fdb65a7b640 1 -- 172.21.15.133:0/1336490986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb60151cd0 msgr2=0x7fdb600ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:48.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.940+0000 7fdb65a7b640 1 --2- 172.21.15.133:0/1336490986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb60151cd0 0x7fdb600ca460 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fdb6008b2c0 tx=0x7fdb5401c430 comp rx=0 tx=0).stop 2023-12-19T18:58:48.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.940+0000 7fdb65a7b640 1 -- 172.21.15.133:0/1336490986 shutdown_connections 2023-12-19T18:58:48.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.940+0000 7fdb65a7b640 1 --2- 172.21.15.133:0/1336490986 >> v2:172.21.15.138:3300/0 conn(0x7fdb60154be0 0x7fdb6015ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.940+0000 7fdb65a7b640 1 --2- 172.21.15.133:0/1336490986 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb60151cd0 0x7fdb600ca460 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.940+0000 7fdb65a7b640 1 -- 172.21.15.133:0/1336490986 >> 172.21.15.133:0/1336490986 conn(0x7fdb600abee0 msgr2=0x7fdb600c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:48.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.940+0000 7fdb65a7b640 1 -- 172.21.15.133:0/1336490986 shutdown_connections 2023-12-19T18:58:48.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.940+0000 7fdb65a7b640 1 -- 172.21.15.133:0/1336490986 wait complete. 2023-12-19T18:58:48.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.940+0000 7fdb65a7b640 1 Processor -- start 2023-12-19T18:58:48.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.940+0000 7fdb65a7b640 1 -- start start 2023-12-19T18:58:48.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb65a7b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb600c7c50 0x7fdb6014a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:48.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb65a7b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb60151cd0 0x7fdb6014ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:48.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb65a7b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdb60154be0 0x7fdb601f0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:48.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb65a7b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6014bcc0 con 0x7fdb600c7c50 2023-12-19T18:58:48.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb65a7b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb60148d10 con 0x7fdb60151cd0 2023-12-19T18:58:48.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb65a7b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6014b2b0 con 0x7fdb60154be0 2023-12-19T18:58:48.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb64a79640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb600c7c50 0x7fdb6014a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:48.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb64a79640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb600c7c50 0x7fdb6014a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54430/0 (socket says 172.21.15.133:54430) 2023-12-19T18:58:48.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb64a79640 1 -- 172.21.15.133:0/1520666391 learned_addr learned my addr 172.21.15.133:0/1520666391 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:48.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb5ffff640 1 --2- 172.21.15.133:0/1520666391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb60151cd0 0x7fdb6014ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:48.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb6527a640 1 --2- 172.21.15.133:0/1520666391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdb60154be0 0x7fdb601f0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:48.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb64a79640 1 -- 172.21.15.133:0/1520666391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdb60154be0 msgr2=0x7fdb601f0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:48.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb64a79640 1 --2- 172.21.15.133:0/1520666391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdb60154be0 0x7fdb601f0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb64a79640 1 -- 172.21.15.133:0/1520666391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb60151cd0 msgr2=0x7fdb6014ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:48.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb64a79640 1 --2- 172.21.15.133:0/1520666391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb60151cd0 0x7fdb6014ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:48.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb64a79640 1 -- 172.21.15.133:0/1520666391 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb54009420 con 0x7fdb600c7c50 2023-12-19T18:58:48.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb5ffff640 1 --2- 172.21.15.133:0/1520666391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb60151cd0 0x7fdb6014ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:48.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb6527a640 1 --2- 172.21.15.133:0/1520666391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdb60154be0 0x7fdb601f0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:48.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb64a79640 1 --2- 172.21.15.133:0/1520666391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb600c7c50 0x7fdb6014a830 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdb54019040 tx=0x7fdb5401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:48.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb5d7fa640 1 -- 172.21.15.133:0/1520666391 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb54004230 con 0x7fdb600c7c50 2023-12-19T18:58:48.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb5d7fa640 1 -- 172.21.15.133:0/1520666391 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb540b9070 con 0x7fdb600c7c50 2023-12-19T18:58:48.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb65a7b640 1 -- 172.21.15.133:0/1520666391 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb60148f60 con 0x7fdb600c7c50 2023-12-19T18:58:48.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb5d7fa640 1 -- 172.21.15.133:0/1520666391 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb54003620 con 0x7fdb600c7c50 2023-12-19T18:58:48.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb65a7b640 1 -- 172.21.15.133:0/1520666391 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb601edaf0 con 0x7fdb600c7c50 2023-12-19T18:58:48.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.944+0000 7fdb65a7b640 1 -- 172.21.15.133:0/1520666391 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6004e850 con 0x7fdb600c7c50 2023-12-19T18:58:48.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.948+0000 7fdb5d7fa640 1 -- 172.21.15.133:0/1520666391 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fdb54003990 con 0x7fdb600c7c50 2023-12-19T18:58:48.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.948+0000 7fdb5d7fa640 1 --2- 172.21.15.133:0/1520666391 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdb44066470 0x7fdb44068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:48.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.948+0000 7fdb5d7fa640 1 -- 172.21.15.133:0/1520666391 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb540bb070 con 0x7fdb600c7c50 2023-12-19T18:58:48.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.948+0000 7fdb5ffff640 1 --2- 172.21.15.133:0/1520666391 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdb44066470 0x7fdb44068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:48.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.948+0000 7fdb5ffff640 1 --2- 172.21.15.133:0/1520666391 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdb44066470 0x7fdb44068930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdb601ead10 tx=0x7fdb4c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:48.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:48.952+0000 7fdb5d7fa640 1 -- 172.21.15.133:0/1520666391 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fdb540ec460 con 0x7fdb600c7c50 2023-12-19T18:58:49.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.100+0000 7fdb65a7b640 1 -- 172.21.15.133:0/1520666391 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb601558a0 con 0x7fdb600c7c50 2023-12-19T18:58:49.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.104+0000 7fdb5d7fa640 1 -- 172.21.15.133:0/1520666391 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fdb540efa80 con 0x7fdb600c7c50 2023-12-19T18:58:49.108 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:49.108 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:44.402984+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:58:40.991408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T18:58:41.773992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:58:49.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.104+0000 7fdb65a7b640 1 -- 172.21.15.133:0/1520666391 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdb44066470 msgr2=0x7fdb44068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.104+0000 7fdb65a7b640 1 --2- 172.21.15.133:0/1520666391 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdb44066470 0x7fdb44068930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdb601ead10 tx=0x7fdb4c009040 comp rx=0 tx=0).stop 2023-12-19T18:58:49.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.104+0000 7fdb65a7b640 1 -- 172.21.15.133:0/1520666391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb600c7c50 msgr2=0x7fdb6014a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.104+0000 7fdb65a7b640 1 --2- 172.21.15.133:0/1520666391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb600c7c50 0x7fdb6014a830 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdb54019040 tx=0x7fdb5401ac70 comp rx=0 tx=0).stop 2023-12-19T18:58:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.104+0000 7fdb65a7b640 1 -- 172.21.15.133:0/1520666391 shutdown_connections 2023-12-19T18:58:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.104+0000 7fdb65a7b640 1 --2- 172.21.15.133:0/1520666391 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdb44066470 0x7fdb44068930 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.104+0000 7fdb65a7b640 1 --2- 172.21.15.133:0/1520666391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdb60154be0 0x7fdb601f0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.104+0000 7fdb65a7b640 1 --2- 172.21.15.133:0/1520666391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb60151cd0 0x7fdb6014ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.104+0000 7fdb65a7b640 1 --2- 172.21.15.133:0/1520666391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb600c7c50 0x7fdb6014a830 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.104+0000 7fdb65a7b640 1 -- 172.21.15.133:0/1520666391 >> 172.21.15.133:0/1520666391 conn(0x7fdb600abee0 msgr2=0x7fdb600c91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.104+0000 7fdb65a7b640 1 -- 172.21.15.133:0/1520666391 shutdown_connections 2023-12-19T18:58:49.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.104+0000 7fdb65a7b640 1 -- 172.21.15.133:0/1520666391 wait complete. 2023-12-19T18:58:49.129 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-19T18:58:49.130 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-19T18:58:49.130 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-19T18:58:49.130 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-19T18:58:49.131 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-19T18:58:49.131 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-19T18:58:49.131 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-19T18:58:49.132 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-19T18:58:49.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.364+0000 7f388ffff640 1 Processor -- start 2023-12-19T18:58:49.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.364+0000 7f388ffff640 1 -- start start 2023-12-19T18:58:49.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.364+0000 7f388ffff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3890152ae0 0x7f38900c1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.364+0000 7f388ffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f38900c1b70 0x7f38900c3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.364+0000 7f388ffff640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3890159430 con 0x7f38900c1550 2023-12-19T18:58:49.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.364+0000 7f388ffff640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38900c45a0 con 0x7f38900c1b70 2023-12-19T18:58:49.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.364+0000 7f388ffff640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3890158840 con 0x7f3890152ae0 2023-12-19T18:58:49.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.364+0000 7f388effd640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3890152ae0 0x7f38900c1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.364+0000 7f388effd640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3890152ae0 0x7f38900c1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:47994/0 (socket says 172.21.15.133:47994) 2023-12-19T18:58:49.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.364+0000 7f388effd640 1 -- 172.21.15.133:0/3040514619 learned_addr learned my addr 172.21.15.133:0/3040514619 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:49.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.364+0000 7f388e7fc640 1 --2- 172.21.15.133:0/3040514619 >> v2:172.21.15.133:3300/0 conn(0x7f38900c1b70 0x7f38900c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.364+0000 7f388f7fe640 1 --1- 172.21.15.133:0/3040514619 >> v1:172.21.15.138:6789/0 conn(0x7f38900c1550 0x7f38900c3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:58818/0 (socket says 172.21.15.133:58818) 2023-12-19T18:58:49.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.368+0000 7f388e7fc640 1 -- 172.21.15.133:0/3040514619 >> v2:172.21.15.138:3300/0 conn(0x7f3890152ae0 msgr2=0x7f38900c1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.368+0000 7f40405aa640 1 Processor -- start 2023-12-19T18:58:49.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.368+0000 7f388e7fc640 1 --2- 172.21.15.133:0/3040514619 >> v2:172.21.15.138:3300/0 conn(0x7f3890152ae0 0x7f38900c1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.368+0000 7f388e7fc640 1 -- 172.21.15.133:0/3040514619 >> v1:172.21.15.138:6789/0 conn(0x7f38900c1550 legacy=0x7f38900c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.368+0000 7f388e7fc640 1 -- 172.21.15.133:0/3040514619 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3890158b00 con 0x7f38900c1b70 2023-12-19T18:58:49.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.368+0000 7f40405aa640 1 -- start start 2023-12-19T18:58:49.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.368+0000 7f388dffb640 1 -- 172.21.15.133:0/3040514619 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163799048 0 0) 0x7f3890159430 con 0x7f38900c1550 2023-12-19T18:58:49.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.368+0000 7f40405aa640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f403806e0f0 0x7f40380c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f403e346640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f403806e0f0 0x7f40380c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f403e346640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f403806e0f0 0x7f40380c20e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54442/0 (socket says 172.21.15.133:54442) 2023-12-19T18:58:49.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f403db45640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f4038072050 0x7f40380c0e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:58828/0 (socket says 172.21.15.133:58828) 2023-12-19T18:58:49.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f403e346640 1 -- 172.21.15.133:0/323600620 learned_addr learned my addr 172.21.15.133:0/323600620 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:49.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f388e7fc640 1 --2- 172.21.15.133:0/3040514619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38900c1b70 0x7f38900c3950 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f38900c59b0 tx=0x7f388801c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c94fe7be15d878 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f388dffb640 1 -- 172.21.15.133:0/3040514619 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38880a57a0 con 0x7f38900c1b70 2023-12-19T18:58:49.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f388dffb640 1 -- 172.21.15.133:0/3040514619 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38880a5900 con 0x7f38900c1b70 2023-12-19T18:58:49.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f388dffb640 1 -- 172.21.15.133:0/3040514619 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38880a5c90 con 0x7f38900c1b70 2023-12-19T18:58:49.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f40405aa640 1 --2- 172.21.15.133:0/323600620 >> v2:172.21.15.138:3300/0 conn(0x7f4038151350 0x7f40380c4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f40405aa640 1 -- 172.21.15.133:0/323600620 --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f403806be20 con 0x7f4038072050 2023-12-19T18:58:49.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f40405aa640 1 -- 172.21.15.133:0/323600620 --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4038151760 con 0x7f403806e0f0 2023-12-19T18:58:49.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f40405aa640 1 -- 172.21.15.133:0/323600620 --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f403806c0c0 con 0x7f4038151350 2023-12-19T18:58:49.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f388ffff640 1 -- 172.21.15.133:0/3040514619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38900c1b70 msgr2=0x7f38900c3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f388ffff640 1 --2- 172.21.15.133:0/3040514619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38900c1b70 0x7f38900c3950 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f38900c59b0 tx=0x7f388801c7f0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f403eb47640 1 --2- 172.21.15.133:0/323600620 >> v2:172.21.15.138:3300/0 conn(0x7f4038151350 0x7f40380c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f403d344640 1 -- 172.21.15.133:0/323600620 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819662384 0 0) 0x7f403806be20 con 0x7f4038072050 2023-12-19T18:58:49.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f403d344640 1 -- 172.21.15.133:0/323600620 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4024003530 con 0x7f4038072050 2023-12-19T18:58:49.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f403e346640 1 -- 172.21.15.133:0/323600620 >> v2:172.21.15.138:3300/0 conn(0x7f4038151350 msgr2=0x7f40380c4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f403e346640 1 --2- 172.21.15.133:0/323600620 >> v2:172.21.15.138:3300/0 conn(0x7f4038151350 0x7f40380c4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f403e346640 1 -- 172.21.15.133:0/323600620 >> v1:172.21.15.138:6789/0 conn(0x7f4038072050 legacy=0x7f40380c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f403e346640 1 -- 172.21.15.133:0/323600620 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403806c7c0 con 0x7f403806e0f0 2023-12-19T18:58:49.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f388ffff640 1 -- 172.21.15.133:0/3040514619 shutdown_connections 2023-12-19T18:58:49.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f388ffff640 1 --2- 172.21.15.133:0/3040514619 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38900c1b70 0x7f38900c3950 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f388ffff640 1 --2- 172.21.15.133:0/3040514619 >> v2:172.21.15.138:3300/0 conn(0x7f3890152ae0 0x7f38900c1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f388ffff640 1 -- 172.21.15.133:0/3040514619 >> 172.21.15.133:0/3040514619 conn(0x7f38900a7800 msgr2=0x7f38900a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f388ffff640 1 -- 172.21.15.133:0/3040514619 shutdown_connections 2023-12-19T18:58:49.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.372+0000 7f388ffff640 1 -- 172.21.15.133:0/3040514619 wait complete. 2023-12-19T18:58:49.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.376+0000 7f388ffff640 1 Processor -- start 2023-12-19T18:58:49.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.376+0000 7f388ffff640 1 -- start start 2023-12-19T18:58:49.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.376+0000 7f388ffff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38900c1550 0x7f38901f1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.376+0000 7f388ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3890152ae0 0x7f38900a9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.376+0000 7f388ffff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3890142540 0x7f38900a9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f388e7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3890152ae0 0x7f38900a9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f388effd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38900c1550 0x7f38901f1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f388effd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38900c1550 0x7f38901f1cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:55006/0 (socket says 172.21.15.133:55006) 2023-12-19T18:58:49.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f388effd640 1 -- 172.21.15.133:0/656662729 learned_addr learned my addr 172.21.15.133:0/656662729 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:49.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f388f7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3890142540 0x7f38900a9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f388ffff640 1 -- 172.21.15.133:0/656662729 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3890141d40 con 0x7f3890152ae0 2023-12-19T18:58:49.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f388ffff640 1 -- 172.21.15.133:0/656662729 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3890141f90 con 0x7f3890142540 2023-12-19T18:58:49.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f388ffff640 1 -- 172.21.15.133:0/656662729 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38900aa520 con 0x7f38900c1550 2023-12-19T18:58:49.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f403e346640 1 --2- 172.21.15.133:0/323600620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f403806e0f0 0x7f40380c20e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f403806b9f0 tx=0x7f403401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e006b2f72f87d854 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f403d344640 1 -- 172.21.15.133:0/323600620 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40380c52c0 con 0x7f403806e0f0 2023-12-19T18:58:49.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f403d344640 1 -- 172.21.15.133:0/323600620 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40340a7050 con 0x7f403806e0f0 2023-12-19T18:58:49.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f403d344640 1 -- 172.21.15.133:0/323600620 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40380c52c0 con 0x7f403806e0f0 2023-12-19T18:58:49.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f40405aa640 1 -- 172.21.15.133:0/323600620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f403806e0f0 msgr2=0x7f40380c20e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f40405aa640 1 --2- 172.21.15.133:0/323600620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f403806e0f0 0x7f40380c20e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f403806b9f0 tx=0x7f403401c340 comp rx=0 tx=0).stop 2023-12-19T18:58:49.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f388effd640 1 -- 172.21.15.133:0/656662729 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3890142540 msgr2=0x7f38900a9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f388effd640 1 --2- 172.21.15.133:0/656662729 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3890142540 0x7f38900a9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f388effd640 1 -- 172.21.15.133:0/656662729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3890152ae0 msgr2=0x7f38900a9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f388effd640 1 --2- 172.21.15.133:0/656662729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3890152ae0 0x7f38900a9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f388effd640 1 -- 172.21.15.133:0/656662729 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3888009a70 con 0x7f38900c1550 2023-12-19T18:58:49.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f40405aa640 1 -- 172.21.15.133:0/323600620 shutdown_connections 2023-12-19T18:58:49.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f40405aa640 1 --2- 172.21.15.133:0/323600620 >> v2:172.21.15.138:3300/0 conn(0x7f4038151350 0x7f40380c4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f40405aa640 1 --2- 172.21.15.133:0/323600620 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f403806e0f0 0x7f40380c20e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f40405aa640 1 -- 172.21.15.133:0/323600620 >> 172.21.15.133:0/323600620 conn(0x7f40380a7910 msgr2=0x7f40380a7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7fbdb029a640 1 Processor -- start 2023-12-19T18:58:49.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f35ebfff640 1 Processor -- start 2023-12-19T18:58:49.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f388e7fc640 1 --2- 172.21.15.133:0/656662729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3890152ae0 0x7f38900a9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:49.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f40405aa640 1 -- 172.21.15.133:0/323600620 shutdown_connections 2023-12-19T18:58:49.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f388effd640 1 --2- 172.21.15.133:0/656662729 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38900c1550 0x7f38901f1cc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f388000d7d0 tx=0x7f388000dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7fbdb029a640 1 -- start start 2023-12-19T18:58:49.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f38777fe640 1 -- 172.21.15.133:0/656662729 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38800096a0 con 0x7f38900c1550 2023-12-19T18:58:49.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f38777fe640 1 -- 172.21.15.133:0/656662729 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3880009800 con 0x7f38900c1550 2023-12-19T18:58:49.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f38777fe640 1 -- 172.21.15.133:0/656662729 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38800096a0 con 0x7f38900c1550 2023-12-19T18:58:49.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7fbdb029a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbda80c7ea0 0x7fbda806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f35ebfff640 1 -- start start 2023-12-19T18:58:49.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7f35ebfff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35e400fc60 0x7f35e404b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7f35ebfff640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e40ddda0 con 0x7f35e40dd950 2023-12-19T18:58:49.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7f35ebfff640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e404bf10 con 0x7f35e400f1c0 2023-12-19T18:58:49.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7f35ebfff640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e404c1f0 con 0x7f35e400fc60 2023-12-19T18:58:49.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7f388ffff640 1 -- 172.21.15.133:0/656662729 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38900aa800 con 0x7f38900c1550 2023-12-19T18:58:49.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.380+0000 7f40405aa640 1 -- 172.21.15.133:0/323600620 wait complete. 2023-12-19T18:58:49.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7f40405aa640 1 Processor -- start 2023-12-19T18:58:49.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7fbdae036640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fbda8151e90 0x7fbda80c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:58838/0 (socket says 172.21.15.133:58838) 2023-12-19T18:58:49.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7fbdae036640 1 -- 172.21.15.133:0/3412673825 learned_addr learned my addr 172.21.15.133:0/3412673825 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:49.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7fbdad835640 1 --2- 172.21.15.133:0/3412673825 >> v2:172.21.15.138:3300/0 conn(0x7fbda80c7ea0 0x7fbda806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7f35eaffd640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f35e400f1c0 0x7f35e404e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:58846/0 (socket says 172.21.15.133:58846) 2023-12-19T18:58:49.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7f35eaffd640 1 -- 172.21.15.133:0/1842997893 learned_addr learned my addr 172.21.15.133:0/1842997893 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:49.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7f35ea7fc640 1 --2- 172.21.15.133:0/1842997893 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35e400fc60 0x7f35e404b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7f388ffff640 1 -- 172.21.15.133:0/656662729 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3890144940 con 0x7f38900c1550 2023-12-19T18:58:49.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7fbdb029a640 1 -- 172.21.15.133:0/3412673825 --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda806c860 con 0x7fbda806b9e0 2023-12-19T18:58:49.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7f35e9ffb640 1 -- 172.21.15.133:0/1842997893 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50400004 0 0) 0x7f35e404bf10 con 0x7f35e400f1c0 2023-12-19T18:58:49.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7fbdb029a640 1 -- 172.21.15.133:0/3412673825 --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda8154930 con 0x7fbda8151e90 2023-12-19T18:58:49.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7f40405aa640 1 -- start start 2023-12-19T18:58:49.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7fbdb029a640 1 -- 172.21.15.133:0/3412673825 --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda80c8750 con 0x7fbda80c7ea0 2023-12-19T18:58:49.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7f35e9ffb640 1 -- 172.21.15.133:0/1842997893 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35d4003530 con 0x7f35e400f1c0 2023-12-19T18:58:49.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7f35e9ffb640 1 -- 172.21.15.133:0/1842997893 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 908188472 0 0) 0x7f35e40ddda0 con 0x7f35e40dd950 2023-12-19T18:58:49.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7f35ea7fc640 1 -- 172.21.15.133:0/1842997893 >> v1:172.21.15.138:6789/0 conn(0x7f35e400f1c0 legacy=0x7f35e404e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7f35ea7fc640 1 -- 172.21.15.133:0/1842997893 >> v1:172.21.15.133:6789/0 conn(0x7f35e40dd950 legacy=0x7f35e40d7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7f35ea7fc640 1 -- 172.21.15.133:0/1842997893 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e404c4d0 con 0x7f35e400fc60 2023-12-19T18:58:49.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7f14d80c9640 1 Processor -- start 2023-12-19T18:58:49.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7fbdad034640 1 -- 172.21.15.133:0/3412673825 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985848236 0 0) 0x7fbda8154930 con 0x7fbda8151e90 2023-12-19T18:58:49.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7fbdad034640 1 -- 172.21.15.133:0/3412673825 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd94003530 con 0x7fbda8151e90 2023-12-19T18:58:49.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7f388ffff640 1 -- 172.21.15.133:0/656662729 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3890072570 con 0x7f38900c1550 2023-12-19T18:58:49.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7fbdad034640 1 -- 172.21.15.133:0/3412673825 <== mon.1 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 305528460 0 0) 0x7fbd94003530 con 0x7fbda8151e90 2023-12-19T18:58:49.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7fbdad034640 1 -- 172.21.15.133:0/3412673825 >> v2:172.21.15.138:3300/0 conn(0x7fbda80c7ea0 msgr2=0x7fbda806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7fbdad034640 1 --2- 172.21.15.133:0/3412673825 >> v2:172.21.15.138:3300/0 conn(0x7fbda80c7ea0 0x7fbda806b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7fbdad034640 1 -- 172.21.15.133:0/3412673825 >> v1:172.21.15.133:6789/0 conn(0x7fbda806b9e0 legacy=0x7fbda815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7fbdad034640 1 -- 172.21.15.133:0/3412673825 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda8154c10 con 0x7fbda8151e90 2023-12-19T18:58:49.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7fbdad034640 1 -- 172.21.15.133:0/3412673825 <== mon.1 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7fbda0001a00 con 0x7fbda8151e90 2023-12-19T18:58:49.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7fbdad034640 1 -- 172.21.15.133:0/3412673825 >> v1:172.21.15.138:6789/0 conn(0x7fbda8151e90 legacy=0x7fbda80c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7fbdad034640 1 --2- 172.21.15.133:0/3412673825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd940039d0 0x7fbd94003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7fbdad034640 1 --2- 172.21.15.133:0/3412673825 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd940047d0 0x7fbd94004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7fbdad034640 1 --2- 172.21.15.133:0/3412673825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd940052b0 0x7fbd9400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7fbdad034640 1 -- 172.21.15.133:0/3412673825 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80c8750 con 0x7fbd940039d0 2023-12-19T18:58:49.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7fbdad034640 1 -- 172.21.15.133:0/3412673825 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9400c1b0 con 0x7fbd940052b0 2023-12-19T18:58:49.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7fbdad034640 1 -- 172.21.15.133:0/3412673825 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9400c370 con 0x7fbd940047d0 2023-12-19T18:58:49.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7fbdae036640 1 --2- 172.21.15.133:0/3412673825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd940039d0 0x7fbd94003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.384+0000 7f14d80c9640 1 -- start start 2023-12-19T18:58:49.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f38777fe640 1 -- 172.21.15.133:0/656662729 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3880009970 con 0x7f38900c1550 2023-12-19T18:58:49.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7fbdae837640 1 --2- 172.21.15.133:0/3412673825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd940052b0 0x7fbd9400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7fbdad835640 1 --2- 172.21.15.133:0/3412673825 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd940047d0 0x7fbd94004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f14d80c9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14d01513c0 0x7f14d006d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f40405aa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f403806e0f0 0x7f4038156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f38777fe640 1 --2- 172.21.15.133:0/656662729 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f387c0664d0 0x7f387c068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f38777fe640 1 -- 172.21.15.133:0/656662729 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3880084290 con 0x7f38900c1550 2023-12-19T18:58:49.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f38777fe640 1 --2- 172.21.15.133:0/656662729 >> [v2:172.21.15.133:6824/522902042,v1:172.21.15.133:6825/522902042] conn(0x7f387c06e670 0x7f387c070a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f38777fe640 1 -- 172.21.15.133:0/656662729 --> [v2:172.21.15.133:6824/522902042,v1:172.21.15.133:6825/522902042] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f387c071140 con 0x7f387c06e670 2023-12-19T18:58:49.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f38777fe640 1 -- 172.21.15.133:0/656662729 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3880086870 con 0x7f38900c1550 2023-12-19T18:58:49.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7fbdad835640 1 -- 172.21.15.133:0/3412673825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd940052b0 msgr2=0x7fbd9400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7fbdad835640 1 --2- 172.21.15.133:0/3412673825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd940052b0 0x7fbd9400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7fbdad835640 1 -- 172.21.15.133:0/3412673825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd940039d0 msgr2=0x7fbd94003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7fbdad835640 1 --2- 172.21.15.133:0/3412673825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd940039d0 0x7fbd94003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7fbdad835640 1 -- 172.21.15.133:0/3412673825 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd94003530 con 0x7fbd940047d0 2023-12-19T18:58:49.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7fbdae837640 1 -- 172.21.15.133:0/3412673825 reap_dead start 2023-12-19T18:58:49.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f35ea7fc640 1 --2- 172.21.15.133:0/1842997893 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35e400fc60 0x7f35e404b8a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f35e00097f0 tx=0x7f35e001c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=226e987f8c01f9f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f40405aa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4038072050 0x7f4038153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f14d5e65640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14d01513c0 0x7f14d006d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f14d5664640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f14d00c06d0 0x7f14d00a4e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42498/0 (socket says 172.21.15.133:42498) 2023-12-19T18:58:49.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f14d5e65640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14d01513c0 0x7f14d006d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:55032/0 (socket says 172.21.15.133:55032) 2023-12-19T18:58:49.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f14d80c9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f14d00c22c0 0x7f14d015b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f14d5664640 1 -- 172.21.15.133:0/1221708286 learned_addr learned my addr 172.21.15.133:0/1221708286 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:49.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f14d80c9640 1 -- 172.21.15.133:0/1221708286 --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14d006e490 con 0x7f14d00c06d0 2023-12-19T18:58:49.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f388e7fc640 1 --2- 172.21.15.133:0/656662729 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f387c0664d0 0x7f387c068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f40405aa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4038151350 0x7f4038148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f403e346640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f403806e0f0 0x7f4038156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f403e346640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f403806e0f0 0x7f4038156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:48038/0 (socket says 172.21.15.133:48038) 2023-12-19T18:58:49.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f35e9ffb640 1 -- 172.21.15.133:0/1842997893 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e00ab600 con 0x7f35e400fc60 2023-12-19T18:58:49.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f35e9ffb640 1 -- 172.21.15.133:0/1842997893 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e00ab760 con 0x7f35e400fc60 2023-12-19T18:58:49.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f35e9ffb640 1 -- 172.21.15.133:0/1842997893 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e00abaf0 con 0x7f35e400fc60 2023-12-19T18:58:49.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f403db45640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4038072050 0x7f4038153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f403db45640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4038072050 0x7f4038153ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:55038/0 (socket says 172.21.15.133:55038) 2023-12-19T18:58:49.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f403e346640 1 -- 172.21.15.133:0/438044974 learned_addr learned my addr 172.21.15.133:0/438044974 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:49.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f40405aa640 1 -- 172.21.15.133:0/438044974 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4038152520 con 0x7f4038151350 2023-12-19T18:58:49.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f403eb47640 1 --2- 172.21.15.133:0/438044974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4038151350 0x7f4038148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f40405aa640 1 -- 172.21.15.133:0/438044974 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4038151c30 con 0x7f403806e0f0 2023-12-19T18:58:49.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f14d80c9640 1 -- 172.21.15.133:0/1221708286 --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14d00c1290 con 0x7f14d00c22c0 2023-12-19T18:58:49.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.388+0000 7f14d80c9640 1 -- 172.21.15.133:0/1221708286 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d006e770 con 0x7f14d01513c0 2023-12-19T18:58:49.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f40405aa640 1 -- 172.21.15.133:0/438044974 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40381529b0 con 0x7f4038072050 2023-12-19T18:58:49.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f14d6666640 1 --2- 172.21.15.133:0/1221708286 >> v2:172.21.15.133:3300/0 conn(0x7f14d00c22c0 0x7f14d015b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f388f7fe640 1 --2- 172.21.15.133:0/656662729 >> [v2:172.21.15.133:6824/522902042,v1:172.21.15.133:6825/522902042] conn(0x7f387c06e670 0x7f387c070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f14d4e63640 1 -- 172.21.15.133:0/1221708286 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949455675 0 0) 0x7f14d006e490 con 0x7f14d00c06d0 2023-12-19T18:58:49.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f35ebfff640 1 -- 172.21.15.133:0/1842997893 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35e400fc60 msgr2=0x7f35e404b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f35ebfff640 1 --2- 172.21.15.133:0/1842997893 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35e400fc60 0x7f35e404b8a0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f35e00097f0 tx=0x7f35e001c400 comp rx=0 tx=0).stop 2023-12-19T18:58:49.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f14d5e65640 1 -- 172.21.15.133:0/1221708286 >> v2:172.21.15.133:3300/0 conn(0x7f14d00c22c0 msgr2=0x7f14d015b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f14d5e65640 1 --2- 172.21.15.133:0/1221708286 >> v2:172.21.15.133:3300/0 conn(0x7f14d00c22c0 0x7f14d015b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f14d5e65640 1 -- 172.21.15.133:0/1221708286 >> v1:172.21.15.133:6789/0 conn(0x7f14d00c06d0 legacy=0x7f14d00a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f14d5e65640 1 -- 172.21.15.133:0/1221708286 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d006cf70 con 0x7f14d01513c0 2023-12-19T18:58:49.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f388e7fc640 1 --2- 172.21.15.133:0/656662729 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f387c0664d0 0x7f387c068990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f38880af000 tx=0x7f38880a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f403db45640 1 -- 172.21.15.133:0/438044974 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f403806e0f0 msgr2=0x7f4038156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f403db45640 1 --2- 172.21.15.133:0/438044974 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f403806e0f0 0x7f4038156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f403db45640 1 -- 172.21.15.133:0/438044974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4038151350 msgr2=0x7f4038148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f403db45640 1 --2- 172.21.15.133:0/438044974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4038151350 0x7f4038148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f403db45640 1 -- 172.21.15.133:0/438044974 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40340094d0 con 0x7f4038072050 2023-12-19T18:58:49.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f403eb47640 1 --2- 172.21.15.133:0/438044974 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4038151350 0x7f4038148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f403e346640 1 --2- 172.21.15.133:0/438044974 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f403806e0f0 0x7f4038156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:58:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f35ebfff640 1 -- 172.21.15.133:0/1842997893 shutdown_connections 2023-12-19T18:58:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f35ebfff640 1 --2- 172.21.15.133:0/1842997893 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35e400fc60 0x7f35e404b8a0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f35ebfff640 1 -- 172.21.15.133:0/1842997893 >> 172.21.15.133:0/1842997893 conn(0x7f35e404fdb0 msgr2=0x7f35e40501c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f403db45640 1 --2- 172.21.15.133:0/438044974 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4038072050 0x7f4038153ed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f40280011f0 tx=0x7f402800cf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f402effd640 1 -- 172.21.15.133:0/438044974 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40280074e0 con 0x7f4038072050 2023-12-19T18:58:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f402effd640 1 -- 172.21.15.133:0/438044974 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4028007640 con 0x7f4038072050 2023-12-19T18:58:49.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f402effd640 1 -- 172.21.15.133:0/438044974 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4028004a10 con 0x7f4038072050 2023-12-19T18:58:49.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7fbdad835640 1 --2- 172.21.15.133:0/3412673825 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd940047d0 0x7fbd94004c50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbda4009ab0 tx=0x7fbda401ca90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb7c445528e70341 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f35ebfff640 1 -- 172.21.15.133:0/1842997893 shutdown_connections 2023-12-19T18:58:49.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f35ebfff640 1 -- 172.21.15.133:0/1842997893 wait complete. 2023-12-19T18:58:49.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f388f7fe640 1 --2- 172.21.15.133:0/656662729 >> [v2:172.21.15.133:6824/522902042,v1:172.21.15.133:6825/522902042] conn(0x7f387c06e670 0x7f387c070a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f40405aa640 1 -- 172.21.15.133:0/438044974 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4038151ed0 con 0x7f4038072050 2023-12-19T18:58:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f40405aa640 1 -- 172.21.15.133:0/438044974 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4038156cc0 con 0x7f4038072050 2023-12-19T18:58:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7f40405aa640 1 -- 172.21.15.133:0/438044974 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f403804e850 con 0x7f4038072050 2023-12-19T18:58:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7fbdad034640 1 -- 172.21.15.133:0/3412673825 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda40a8450 con 0x7fbd940047d0 2023-12-19T18:58:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7fbdad034640 1 -- 172.21.15.133:0/3412673825 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda40a85b0 con 0x7fbd940047d0 2023-12-19T18:58:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7fbdad034640 1 -- 172.21.15.133:0/3412673825 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda40a89a0 con 0x7fbd940047d0 2023-12-19T18:58:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7fbdb029a640 1 -- 172.21.15.133:0/3412673825 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd940047d0 msgr2=0x7fbd94004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.392+0000 7fbdb029a640 1 --2- 172.21.15.133:0/3412673825 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd940047d0 0x7fbd94004c50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbda4009ab0 tx=0x7fbda401ca90 comp rx=0 tx=0).stop 2023-12-19T18:58:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7fbdb029a640 1 -- 172.21.15.133:0/3412673825 shutdown_connections 2023-12-19T18:58:49.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7fbdb029a640 1 --2- 172.21.15.133:0/3412673825 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd940047d0 0x7fbd94004c50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7fbdb029a640 1 -- 172.21.15.133:0/3412673825 >> 172.21.15.133:0/3412673825 conn(0x7fbda80ca170 msgr2=0x7fbda80ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f1d371f5640 1 Processor -- start 2023-12-19T18:58:49.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f1d371f5640 1 -- start start 2023-12-19T18:58:49.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f38777fe640 1 -- 172.21.15.133:0/656662729 <== osd.0 v2:172.21.15.133:6824/522902042 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f387c071140 con 0x7f387c06e670 2023-12-19T18:58:49.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f402effd640 1 -- 172.21.15.133:0/438044974 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4028004b70 con 0x7f4038072050 2023-12-19T18:58:49.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7fbdb029a640 1 -- 172.21.15.133:0/3412673825 shutdown_connections 2023-12-19T18:58:49.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7fbdb029a640 1 -- 172.21.15.133:0/3412673825 wait complete. 2023-12-19T18:58:49.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7fbdb029a640 1 Processor -- start 2023-12-19T18:58:49.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f35ebfff640 1 Processor -- start 2023-12-19T18:58:49.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f35ebfff640 1 -- start start 2023-12-19T18:58:49.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f35ebfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35e400f1c0 0x7f35e4182950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f14d5e65640 1 --2- 172.21.15.133:0/1221708286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14d01513c0 0x7f14d006d770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f14c800f370 tx=0x7f14c8020c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=963836fa3064798b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f14d4e63640 1 -- 172.21.15.133:0/1221708286 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c80a9cb0 con 0x7f14d01513c0 2023-12-19T18:58:49.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f14d4e63640 1 -- 172.21.15.133:0/1221708286 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c80a9e10 con 0x7f14d01513c0 2023-12-19T18:58:49.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f14d4e63640 1 -- 172.21.15.133:0/1221708286 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c800d2f0 con 0x7f14d01513c0 2023-12-19T18:58:49.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f1d371f5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1d301513c0 0x7f1d3006d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f1d371f5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d300c22c0 0x7f1d3015b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f4ead5c4640 1 Processor -- start 2023-12-19T18:58:49.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f4ead5c4640 1 -- start start 2023-12-19T18:58:49.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f4ead5c4640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ea8151e90 0x7f4ea80c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f4ead5c4640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4ea80c4e60 0x7f4ea806bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f4ead5c4640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea806c860 con 0x7f4ea80c7ea0 2023-12-19T18:58:49.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f4ead5c4640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea80c8750 con 0x7f4ea80c4e60 2023-12-19T18:58:49.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f4ead5c4640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea81552d0 con 0x7f4ea8151e90 2023-12-19T18:58:49.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f35ebfff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35e400fc60 0x7f35e40dab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f35ebfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35e40dd950 0x7f35e4180be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f1d371f5640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3006e490 con 0x7f1d300c06d0 2023-12-19T18:58:49.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f1d371f5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d300c1290 con 0x7f1d301513c0 2023-12-19T18:58:49.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f1d371f5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3006e770 con 0x7f1d300c22c0 2023-12-19T18:58:49.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f35ebfff640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e40b15a0 con 0x7f35e400f1c0 2023-12-19T18:58:49.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f35ebfff640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e404a190 con 0x7f35e40dd950 2023-12-19T18:58:49.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f35ebfff640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e4180700 con 0x7f35e400fc60 2023-12-19T18:58:49.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f1d2ffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1d300c06d0 0x7f1d300a4e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42504/0 (socket says 172.21.15.133:42504) 2023-12-19T18:58:49.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f1d2ffff640 1 -- 172.21.15.133:0/4007149946 learned_addr learned my addr 172.21.15.133:0/4007149946 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:49.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f1d35792640 1 --2- 172.21.15.133:0/4007149946 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d300c22c0 0x7f1d3015b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f35f17f5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35e40dd950 0x7f35e4180be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f1d34f91640 1 --2- 172.21.15.133:0/4007149946 >> v2:172.21.15.138:3300/0 conn(0x7f1d301513c0 0x7f1d3006d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f4ea77fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4ea80c4e60 0x7f4ea806bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f402effd640 1 --2- 172.21.15.133:0/438044974 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f401c066470 0x7f401c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f402effd640 1 -- 172.21.15.133:0/438044974 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4028083730 con 0x7f4038072050 2023-12-19T18:58:49.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f402effd640 1 --2- 172.21.15.133:0/438044974 >> [v2:172.21.15.133:6816/1006296948,v1:172.21.15.133:6817/1006296948] conn(0x7f401c06e690 0x7f401c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f402effd640 1 -- 172.21.15.133:0/438044974 --> [v2:172.21.15.133:6816/1006296948,v1:172.21.15.133:6817/1006296948] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f401c071160 con 0x7f401c06e690 2023-12-19T18:58:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f402effd640 1 -- 172.21.15.133:0/438044974 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4028085d50 con 0x7f4038072050 2023-12-19T18:58:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f14d80c9640 1 -- 172.21.15.133:0/1221708286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14d01513c0 msgr2=0x7f14d006d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f14d80c9640 1 --2- 172.21.15.133:0/1221708286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14d01513c0 0x7f14d006d770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f14c800f370 tx=0x7f14c8020c00 comp rx=0 tx=0).stop 2023-12-19T18:58:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f4ea6ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ea8151e90 0x7f4ea80c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f4ea6ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ea8151e90 0x7f4ea80c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:55076/0 (socket says 172.21.15.133:55076) 2023-12-19T18:58:49.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f4ea6ffd640 1 -- 172.21.15.133:0/1866030878 learned_addr learned my addr 172.21.15.133:0/1866030878 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f403e346640 1 --2- 172.21.15.133:0/438044974 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f401c066470 0x7f401c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f35f17f5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35e40dd950 0x7f35e4180be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:48060/0 (socket says 172.21.15.133:48060) 2023-12-19T18:58:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.396+0000 7f35f17f5640 1 -- 172.21.15.133:0/2553313298 learned_addr learned my addr 172.21.15.133:0/2553313298 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f35ea7fc640 1 --2- 172.21.15.133:0/2553313298 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35e400fc60 0x7f35e40dab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f35eaffd640 1 --2- 172.21.15.133:0/2553313298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35e400f1c0 0x7f35e4182950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f35f17f5640 1 -- 172.21.15.133:0/2553313298 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35e400fc60 msgr2=0x7f35e40dab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f35f17f5640 1 --2- 172.21.15.133:0/2553313298 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35e400fc60 0x7f35e40dab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f35f17f5640 1 -- 172.21.15.133:0/2553313298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35e400f1c0 msgr2=0x7f35e4182950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f35f17f5640 1 --2- 172.21.15.133:0/2553313298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35e400f1c0 0x7f35e4182950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f35f17f5640 1 -- 172.21.15.133:0/2553313298 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e0009420 con 0x7f35e40dd950 2023-12-19T18:58:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f14d80c9640 1 -- 172.21.15.133:0/1221708286 shutdown_connections 2023-12-19T18:58:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f14d80c9640 1 --2- 172.21.15.133:0/1221708286 >> v2:172.21.15.133:3300/0 conn(0x7f14d00c22c0 0x7f14d015b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f14d80c9640 1 --2- 172.21.15.133:0/1221708286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14d01513c0 0x7f14d006d770 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f14d80c9640 1 -- 172.21.15.133:0/1221708286 >> 172.21.15.133:0/1221708286 conn(0x7f14d00c5cd0 msgr2=0x7f14d00c60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f1d34f91640 1 -- 172.21.15.133:0/4007149946 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d300c22c0 msgr2=0x7f1d3015b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f1d34f91640 1 --2- 172.21.15.133:0/4007149946 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d300c22c0 0x7f1d3015b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f1d34f91640 1 -- 172.21.15.133:0/4007149946 >> v1:172.21.15.133:6789/0 conn(0x7f1d300c06d0 legacy=0x7f1d300a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f1d34f91640 1 -- 172.21.15.133:0/4007149946 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3006cf70 con 0x7f1d301513c0 2023-12-19T18:58:49.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f14d80c9640 1 -- 172.21.15.133:0/1221708286 shutdown_connections 2023-12-19T18:58:49.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f403eb47640 1 --2- 172.21.15.133:0/438044974 >> [v2:172.21.15.133:6816/1006296948,v1:172.21.15.133:6817/1006296948] conn(0x7f401c06e690 0x7f401c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f35f17f5640 1 --2- 172.21.15.133:0/2553313298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35e40dd950 0x7f35e4180be0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f35ec04fb60 tx=0x7f35ec067fc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f35d37fe640 1 -- 172.21.15.133:0/2553313298 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec0678d0 con 0x7f35e40dd950 2023-12-19T18:58:49.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f35d37fe640 1 -- 172.21.15.133:0/2553313298 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec092400 con 0x7f35e40dd950 2023-12-19T18:58:49.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f35d37fe640 1 -- 172.21.15.133:0/2553313298 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec092830 con 0x7f35e40dd950 2023-12-19T18:58:49.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f14d80c9640 1 -- 172.21.15.133:0/1221708286 wait complete. 2023-12-19T18:58:49.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f403eb47640 1 --2- 172.21.15.133:0/438044974 >> [v2:172.21.15.133:6816/1006296948,v1:172.21.15.133:6817/1006296948] conn(0x7f401c06e690 0x7f401c070ab0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7fbdb029a640 1 -- start start 2023-12-19T18:58:49.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f4ea6ffd640 1 -- 172.21.15.133:0/1866030878 >> v2:172.21.15.138:3300/0 conn(0x7f4ea80c4e60 msgr2=0x7f4ea806bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f4ea6ffd640 1 --2- 172.21.15.133:0/1866030878 >> v2:172.21.15.138:3300/0 conn(0x7f4ea80c4e60 0x7f4ea806bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f4ea6ffd640 1 -- 172.21.15.133:0/1866030878 >> v1:172.21.15.133:6789/0 conn(0x7f4ea80c7ea0 legacy=0x7f4ea806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f4ea6ffd640 1 -- 172.21.15.133:0/1866030878 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea8154930 con 0x7f4ea8151e90 2023-12-19T18:58:49.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f35ebfff640 1 -- 172.21.15.133:0/2553313298 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e40b12c0 con 0x7f35e40dd950 2023-12-19T18:58:49.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f35ebfff640 1 -- 172.21.15.133:0/2553313298 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e4183580 con 0x7f35e40dd950 2023-12-19T18:58:49.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f403e346640 1 --2- 172.21.15.133:0/438044974 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f401c066470 0x7f401c068930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f403814a900 tx=0x7f40340a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7fbdb029a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd940047d0 0x7fbda80a9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7fbdb029a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbda80ace00 0x7fbda8146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7fbdb029a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbda81ee0d0 0x7fbda81f0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7fbdb029a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda81552d0 con 0x7fbd940047d0 2023-12-19T18:58:49.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7fbdb029a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80ae650 con 0x7fbda81ee0d0 2023-12-19T18:58:49.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7fbdb029a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda81edc40 con 0x7fbda80ace00 2023-12-19T18:58:49.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.400+0000 7f35ebfff640 1 -- 172.21.15.133:0/2553313298 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f35e400f5a0 con 0x7f35e40dd950 2023-12-19T18:58:49.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f6fa5868640 1 Processor -- start 2023-12-19T18:58:49.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7fbdae837640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbda81ee0d0 0x7fbda81f0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f402effd640 1 -- 172.21.15.133:0/438044974 <== osd.1 v2:172.21.15.133:6816/1006296948 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f401c071160 con 0x7f401c06e690 2023-12-19T18:58:49.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7fbdae837640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbda81ee0d0 0x7fbda81f0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:48064/0 (socket says 172.21.15.133:48064) 2023-12-19T18:58:49.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7fbdae837640 1 -- 172.21.15.133:0/1710350867 learned_addr learned my addr 172.21.15.133:0/1710350867 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:49.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7fbdad835640 1 --2- 172.21.15.133:0/1710350867 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbda80ace00 0x7fbda8146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f14d80c9640 1 Processor -- start 2023-12-19T18:58:49.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7fbdae837640 1 -- 172.21.15.133:0/1710350867 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbda80ace00 msgr2=0x7fbda8146980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7fbdae837640 1 --2- 172.21.15.133:0/1710350867 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbda80ace00 0x7fbda8146980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7fbdae837640 1 -- 172.21.15.133:0/1710350867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd940047d0 msgr2=0x7fbda80a9960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T18:58:49.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f14d80c9640 1 -- start start 2023-12-19T18:58:49.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f1d34f91640 1 --2- 172.21.15.133:0/4007149946 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d301513c0 0x7f1d3006d770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009d90 tx=0x7f1d2801c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffb3b32b5ea4e57f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7fbdae837640 1 --2- 172.21.15.133:0/1710350867 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd940047d0 0x7fbda80a9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7fbdae837640 1 -- 172.21.15.133:0/1710350867 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda80ad5a0 con 0x7fbda81ee0d0 2023-12-19T18:58:49.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f35d37fe640 1 -- 172.21.15.133:0/2553313298 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f35ec092990 con 0x7f35e40dd950 2023-12-19T18:58:49.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f14d80c9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14d00c22c0 0x7f14d00a3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f14d80c9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14d01513c0 0x7f14d014fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f14d80c9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14d01501a0 0x7f14d014f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f14d80c9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d00a77d0 con 0x7f14d01501a0 2023-12-19T18:58:49.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f14d80c9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d00a4620 con 0x7f14d00c22c0 2023-12-19T18:58:49.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f14d80c9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d00a8140 con 0x7f14d01513c0 2023-12-19T18:58:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f1d2f7fe640 1 -- 172.21.15.133:0/4007149946 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d280a5820 con 0x7f1d301513c0 2023-12-19T18:58:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f1d2f7fe640 1 -- 172.21.15.133:0/4007149946 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d280a5980 con 0x7f1d301513c0 2023-12-19T18:58:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f1d2f7fe640 1 -- 172.21.15.133:0/4007149946 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d280a5820 con 0x7f1d301513c0 2023-12-19T18:58:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f6fa5868640 1 -- start start 2023-12-19T18:58:49.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7fbdae837640 1 --2- 172.21.15.133:0/1710350867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbda81ee0d0 0x7fbda81f0d30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbd98007fd0 tx=0x7fbd9800f9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f6fa5868640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6fa00c7ea0 0x7f6fa006b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f6fa5868640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6fa006b9e0 0x7f6fa015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7fbd9effd640 1 -- 172.21.15.133:0/1710350867 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd98003a80 con 0x7fbda81ee0d0 2023-12-19T18:58:49.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7fbd9effd640 1 -- 172.21.15.133:0/1710350867 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd98003c00 con 0x7fbda81ee0d0 2023-12-19T18:58:49.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7fbd9effd640 1 -- 172.21.15.133:0/1710350867 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd98004030 con 0x7fbda81ee0d0 2023-12-19T18:58:49.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f14d5664640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14d01513c0 0x7f14d014fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f14d5664640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14d01513c0 0x7f14d014fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:55086/0 (socket says 172.21.15.133:55086) 2023-12-19T18:58:49.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f14d5664640 1 -- 172.21.15.133:0/3988896378 learned_addr learned my addr 172.21.15.133:0/3988896378 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:49.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f14d6666640 1 --2- 172.21.15.133:0/3988896378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14d01501a0 0x7f14d014f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f14d5e65640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14d00c22c0 0x7f14d00a3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f1d371f5640 1 -- 172.21.15.133:0/4007149946 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d301513c0 msgr2=0x7f1d3006d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f1d371f5640 1 --2- 172.21.15.133:0/4007149946 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d301513c0 0x7f1d3006d770 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009d90 tx=0x7f1d2801c7c0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f1d371f5640 1 -- 172.21.15.133:0/4007149946 shutdown_connections 2023-12-19T18:58:49.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f1d371f5640 1 --2- 172.21.15.133:0/4007149946 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d300c22c0 0x7f1d3015b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f1d371f5640 1 --2- 172.21.15.133:0/4007149946 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d301513c0 0x7f1d3006d770 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f1d371f5640 1 -- 172.21.15.133:0/4007149946 >> 172.21.15.133:0/4007149946 conn(0x7f1d300c5cd0 msgr2=0x7f1d300c60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f1d371f5640 1 -- 172.21.15.133:0/4007149946 shutdown_connections 2023-12-19T18:58:49.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f6fa5868640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fa006c860 con 0x7f6fa0151e90 2023-12-19T18:58:49.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f6f9f7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6fa006b9e0 0x7f6fa015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f6f9f7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6fa006b9e0 0x7f6fa015f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:55100/0 (socket says 172.21.15.133:55100) 2023-12-19T18:58:49.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f6f9f7fe640 1 -- 172.21.15.133:0/1934535563 learned_addr learned my addr 172.21.15.133:0/1934535563 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:49.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f6fa5868640 1 -- 172.21.15.133:0/1934535563 --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fa00c8750 con 0x7f6fa00c7ea0 2023-12-19T18:58:49.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f6fa5868640 1 -- 172.21.15.133:0/1934535563 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa01552d0 con 0x7f6fa006b9e0 2023-12-19T18:58:49.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f14d5664640 1 -- 172.21.15.133:0/3988896378 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14d00c22c0 msgr2=0x7f14d00a3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f14d5664640 1 --2- 172.21.15.133:0/3988896378 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14d00c22c0 0x7f14d00a3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f14d5664640 1 -- 172.21.15.133:0/3988896378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14d01501a0 msgr2=0x7f14d014f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f14d5664640 1 --2- 172.21.15.133:0/3988896378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14d01501a0 0x7f14d014f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f14d5664640 1 -- 172.21.15.133:0/3988896378 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c800f050 con 0x7f14d01513c0 2023-12-19T18:58:49.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7fbdb029a640 1 -- 172.21.15.133:0/1710350867 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda80af870 con 0x7fbda81ee0d0 2023-12-19T18:58:49.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7fbdb029a640 1 -- 172.21.15.133:0/1710350867 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda81ed8d0 con 0x7fbda81ee0d0 2023-12-19T18:58:49.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f6f9f7fe640 1 -- 172.21.15.133:0/1934535563 >> v2:172.21.15.133:3300/0 conn(0x7f6fa00c7ea0 msgr2=0x7f6fa006b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f6f9f7fe640 1 --2- 172.21.15.133:0/1934535563 >> v2:172.21.15.133:3300/0 conn(0x7f6fa00c7ea0 0x7f6fa006b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.404+0000 7f35d37fe640 1 --2- 172.21.15.133:0/2553313298 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f35d80664c0 0x7f35d8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f35d37fe640 1 -- 172.21.15.133:0/2553313298 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35ec0fda30 con 0x7f35e40dd950 2023-12-19T18:58:49.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f35d37fe640 1 --2- 172.21.15.133:0/2553313298 >> [v2:172.21.15.133:6808/829250353,v1:172.21.15.133:6809/829250353] conn(0x7f35d806e6e0 0x7f35d8070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f35d37fe640 1 -- 172.21.15.133:0/2553313298 --> [v2:172.21.15.133:6808/829250353,v1:172.21.15.133:6809/829250353] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f35d80711b0 con 0x7f35d806e6e0 2023-12-19T18:58:49.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f35d37fe640 1 -- 172.21.15.133:0/2553313298 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35ec0ffea0 con 0x7f35e40dd950 2023-12-19T18:58:49.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f6f9f7fe640 1 -- 172.21.15.133:0/1934535563 >> v1:172.21.15.133:6789/0 conn(0x7f6fa0151e90 legacy=0x7f6fa00c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f6f9f7fe640 1 -- 172.21.15.133:0/1934535563 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fa0154930 con 0x7f6fa006b9e0 2023-12-19T18:58:49.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f35eaffd640 1 --2- 172.21.15.133:0/2553313298 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f35d80664c0 0x7f35d8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f35ea7fc640 1 --2- 172.21.15.133:0/2553313298 >> [v2:172.21.15.133:6808/829250353,v1:172.21.15.133:6809/829250353] conn(0x7f35d806e6e0 0x7f35d8070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7fbdb029a640 1 -- 172.21.15.133:0/1710350867 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbda81ed760 con 0x7fbda81ee0d0 2023-12-19T18:58:49.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f35ea7fc640 1 --2- 172.21.15.133:0/2553313298 >> [v2:172.21.15.133:6808/829250353,v1:172.21.15.133:6809/829250353] conn(0x7f35d806e6e0 0x7f35d8070b00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f35eaffd640 1 --2- 172.21.15.133:0/2553313298 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f35d80664c0 0x7f35d8068980 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0011f0 tx=0x7f35dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f1d371f5640 1 -- 172.21.15.133:0/4007149946 wait complete. 2023-12-19T18:58:49.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f1d371f5640 1 Processor -- start 2023-12-19T18:58:49.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f4ea6ffd640 1 --2- 172.21.15.133:0/1866030878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ea8151e90 0x7f4ea80c4920 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0009e50 tx=0x7f4ea001c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61e81cb213c90e20 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f14d5664640 1 --2- 172.21.15.133:0/3988896378 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14d01513c0 0x7f14d014fc60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00c820 tx=0x7f14cc00cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f4ea5ffb640 1 -- 172.21.15.133:0/1866030878 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea00a5530 con 0x7f4ea8151e90 2023-12-19T18:58:49.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f4ea5ffb640 1 -- 172.21.15.133:0/1866030878 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea00a5690 con 0x7f4ea8151e90 2023-12-19T18:58:49.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f4ea5ffb640 1 -- 172.21.15.133:0/1866030878 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea00a5a20 con 0x7f4ea8151e90 2023-12-19T18:58:49.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f35d37fe640 1 -- 172.21.15.133:0/2553313298 <== osd.3 v2:172.21.15.133:6808/829250353 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f35d80711b0 con 0x7f35d806e6e0 2023-12-19T18:58:49.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.408+0000 7f1d371f5640 1 -- start start 2023-12-19T18:58:49.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7fbd9effd640 1 -- 172.21.15.133:0/1710350867 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fbd98004190 con 0x7fbda81ee0d0 2023-12-19T18:58:49.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f14c67fc640 1 -- 172.21.15.133:0/3988896378 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc00b040 con 0x7f14d01513c0 2023-12-19T18:58:49.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f14c67fc640 1 -- 172.21.15.133:0/3988896378 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14cc007ab0 con 0x7f14d01513c0 2023-12-19T18:58:49.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f14c67fc640 1 -- 172.21.15.133:0/3988896378 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc007e60 con 0x7f14d01513c0 2023-12-19T18:58:49.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f14d80c9640 1 -- 172.21.15.133:0/3988896378 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d00a7180 con 0x7f14d01513c0 2023-12-19T18:58:49.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f14d80c9640 1 -- 172.21.15.133:0/3988896378 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d00a3e90 con 0x7f14d01513c0 2023-12-19T18:58:49.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f1d371f5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d300c22c0 0x7f1d300aae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f1d371f5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d301513c0 0x7f1d300a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f1d371f5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d3014e9c0 0x7f1d3014ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f1d34f91640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d300c22c0 0x7f1d300aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f4ead5c4640 1 -- 172.21.15.133:0/1866030878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ea8151e90 msgr2=0x7f4ea80c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f4ead5c4640 1 --2- 172.21.15.133:0/1866030878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ea8151e90 0x7f4ea80c4920 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0009e50 tx=0x7f4ea001c8d0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f1d34f91640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d300c22c0 0x7f1d300aae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:48082/0 (socket says 172.21.15.133:48082) 2023-12-19T18:58:49.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f14d80c9640 1 -- 172.21.15.133:0/3988896378 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f14d00a7000 con 0x7f14d01513c0 2023-12-19T18:58:49.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f4ead5c4640 1 -- 172.21.15.133:0/1866030878 shutdown_connections 2023-12-19T18:58:49.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f4ead5c4640 1 --2- 172.21.15.133:0/1866030878 >> v2:172.21.15.138:3300/0 conn(0x7f4ea80c4e60 0x7f4ea806bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f4ead5c4640 1 --2- 172.21.15.133:0/1866030878 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ea8151e90 0x7f4ea80c4920 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f4ead5c4640 1 -- 172.21.15.133:0/1866030878 >> 172.21.15.133:0/1866030878 conn(0x7f4ea80ca170 msgr2=0x7f4ea80ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f4ead5c4640 1 -- 172.21.15.133:0/1866030878 shutdown_connections 2023-12-19T18:58:49.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f4ead5c4640 1 -- 172.21.15.133:0/1866030878 wait complete. 2023-12-19T18:58:49.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f6f9f7fe640 1 --2- 172.21.15.133:0/1934535563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6fa006b9e0 0x7f6fa015f0a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009e50 tx=0x7f6f9801c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f2641b774b243ec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7fbd9effd640 1 --2- 172.21.15.133:0/1710350867 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fbd8c0664c0 0x7fbd8c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7fbd9effd640 1 -- 172.21.15.133:0/1710350867 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd980838e0 con 0x7fbda81ee0d0 2023-12-19T18:58:49.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7fbd9effd640 1 --2- 172.21.15.133:0/1710350867 >> [v2:172.21.15.133:6800/2461607163,v1:172.21.15.133:6801/2461607163] conn(0x7fbd8c06e6e0 0x7fbd8c070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7fbdae036640 1 --2- 172.21.15.133:0/1710350867 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fbd8c0664c0 0x7fbd8c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7fbd9effd640 1 -- 172.21.15.133:0/1710350867 --> [v2:172.21.15.133:6800/2461607163,v1:172.21.15.133:6801/2461607163] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd8c0711b0 con 0x7fbd8c06e6e0 2023-12-19T18:58:49.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f1d2ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d301513c0 0x7f1d300a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f1d35792640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d3014e9c0 0x7f1d3014ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f1d35792640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d3014e9c0 0x7f1d3014ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:55112/0 (socket says 172.21.15.133:55112) 2023-12-19T18:58:49.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7fbd9effd640 1 -- 172.21.15.133:0/1710350867 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd980882c0 con 0x7fbda81ee0d0 2023-12-19T18:58:49.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f6f9dffb640 1 -- 172.21.15.133:0/1934535563 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f980a5530 con 0x7f6fa006b9e0 2023-12-19T18:58:49.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f6f9dffb640 1 -- 172.21.15.133:0/1934535563 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f980a5690 con 0x7f6fa006b9e0 2023-12-19T18:58:49.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f6f9dffb640 1 -- 172.21.15.133:0/1934535563 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f980a5a20 con 0x7f6fa006b9e0 2023-12-19T18:58:49.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7fbdae036640 1 --2- 172.21.15.133:0/1710350867 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fbd8c0664c0 0x7fbd8c068980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbda8147230 tx=0x7fbda0001370 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f1d34f91640 1 -- 172.21.15.133:0/3692558318 learned_addr learned my addr 172.21.15.133:0/3692558318 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:49.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f1d371f5640 1 -- 172.21.15.133:0/3692558318 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d30153540 con 0x7f1d301513c0 2023-12-19T18:58:49.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f1d371f5640 1 -- 172.21.15.133:0/3692558318 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d30152830 con 0x7f1d300c22c0 2023-12-19T18:58:49.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f1d371f5640 1 -- 172.21.15.133:0/3692558318 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d30151f10 con 0x7f1d3014e9c0 2023-12-19T18:58:49.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f1d34f91640 1 -- 172.21.15.133:0/3692558318 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d3014e9c0 msgr2=0x7f1d3014ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f1d34f91640 1 --2- 172.21.15.133:0/3692558318 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1d3014e9c0 0x7f1d3014ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f1d34f91640 1 -- 172.21.15.133:0/3692558318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d301513c0 msgr2=0x7f1d300a8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f1d34f91640 1 --2- 172.21.15.133:0/3692558318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d301513c0 0x7f1d300a8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f1d34f91640 1 -- 172.21.15.133:0/3692558318 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d28009a70 con 0x7f1d300c22c0 2023-12-19T18:58:49.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f1d2ffff640 1 --2- 172.21.15.133:0/3692558318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d301513c0 0x7f1d300a8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:49.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f6fa5868640 1 -- 172.21.15.133:0/1934535563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6fa006b9e0 msgr2=0x7f6fa015f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f6fa5868640 1 --2- 172.21.15.133:0/1934535563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6fa006b9e0 0x7f6fa015f0a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6f98009e50 tx=0x7f6f9801c8b0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f6fa5868640 1 -- 172.21.15.133:0/1934535563 shutdown_connections 2023-12-19T18:58:49.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f6fa5868640 1 --2- 172.21.15.133:0/1934535563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6fa006b9e0 0x7f6fa015f0a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f6fa5868640 1 --2- 172.21.15.133:0/1934535563 >> v2:172.21.15.133:3300/0 conn(0x7f6fa00c7ea0 0x7f6fa006b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f6fa5868640 1 -- 172.21.15.133:0/1934535563 >> 172.21.15.133:0/1934535563 conn(0x7f6fa00ca170 msgr2=0x7f6fa00ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f14c67fc640 1 -- 172.21.15.133:0/3988896378 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f14cc011470 con 0x7f14d01513c0 2023-12-19T18:58:49.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f1d34f91640 1 --2- 172.21.15.133:0/3692558318 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d300c22c0 0x7f1d300aae00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1d2801d060 tx=0x7f1d28019560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f4ead5c4640 1 Processor -- start 2023-12-19T18:58:49.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.412+0000 7f6fa5868640 1 -- 172.21.15.133:0/1934535563 shutdown_connections 2023-12-19T18:58:49.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f6fa5868640 1 -- 172.21.15.133:0/1934535563 wait complete. 2023-12-19T18:58:49.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7fbdad835640 1 --2- 172.21.15.133:0/1710350867 >> [v2:172.21.15.133:6800/2461607163,v1:172.21.15.133:6801/2461607163] conn(0x7fbd8c06e6e0 0x7fbd8c070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f4ead5c4640 1 -- start start 2023-12-19T18:58:49.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f1d2d7fa640 1 -- 172.21.15.133:0/3692558318 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d280a5820 con 0x7f1d300c22c0 2023-12-19T18:58:49.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f1d2d7fa640 1 -- 172.21.15.133:0/3692558318 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d280ae860 con 0x7f1d300c22c0 2023-12-19T18:58:49.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f1d2d7fa640 1 -- 172.21.15.133:0/3692558318 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d280aec30 con 0x7f1d300c22c0 2023-12-19T18:58:49.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f1d371f5640 1 -- 172.21.15.133:0/3692558318 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3015df90 con 0x7f1d300c22c0 2023-12-19T18:58:49.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f1d371f5640 1 -- 172.21.15.133:0/3692558318 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d301548d0 con 0x7f1d300c22c0 2023-12-19T18:58:49.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7fbdad835640 1 --2- 172.21.15.133:0/1710350867 >> [v2:172.21.15.133:6800/2461607163,v1:172.21.15.133:6801/2461607163] conn(0x7fbd8c06e6e0 0x7fbd8c070b00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f6fa5868640 1 Processor -- start 2023-12-19T18:58:49.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f14c67fc640 1 --2- 172.21.15.133:0/3988896378 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f14b40664c0 0x7f14b4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f4ead5c4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ea80c4e60 0x7f4ea81f0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f4ead5c4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ea80c7ea0 0x7f4ea80ae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f4ead5c4640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ea8151e90 0x7f4ea80ad670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f4ea67fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ea80c7ea0 0x7f4ea80ae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f1d371f5640 1 -- 172.21.15.133:0/3692558318 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1d300c43c0 con 0x7f1d300c22c0 2023-12-19T18:58:49.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f4ea67fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ea80c7ea0 0x7f4ea80ae8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:48092/0 (socket says 172.21.15.133:48092) 2023-12-19T18:58:49.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f4ea67fc640 1 -- 172.21.15.133:0/613879887 learned_addr learned my addr 172.21.15.133:0/613879887 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:49.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f4ead5c4640 1 -- 172.21.15.133:0/613879887 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea81f12f0 con 0x7f4ea80c4e60 2023-12-19T18:58:49.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f4ead5c4640 1 -- 172.21.15.133:0/613879887 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea81585c0 con 0x7f4ea80c7ea0 2023-12-19T18:58:49.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f4ead5c4640 1 -- 172.21.15.133:0/613879887 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea81588a0 con 0x7f4ea8151e90 2023-12-19T18:58:49.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f14c67fc640 1 -- 172.21.15.133:0/3988896378 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14cc083e80 con 0x7f14d01513c0 2023-12-19T18:58:49.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f4ea77fe640 1 --2- 172.21.15.133:0/613879887 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ea8151e90 0x7f4ea80ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f14c67fc640 1 --2- 172.21.15.133:0/3988896378 >> [v2:172.21.15.138:6800/3351784616,v1:172.21.15.138:6801/3351784616] conn(0x7f14b406e660 0x7f14b4070a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f14c67fc640 1 -- 172.21.15.133:0/3988896378 --> [v2:172.21.15.138:6800/3351784616,v1:172.21.15.138:6801/3351784616] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14b4071130 con 0x7f14b406e660 2023-12-19T18:58:49.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f4ea67fc640 1 -- 172.21.15.133:0/613879887 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ea8151e90 msgr2=0x7f4ea80ad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f4ea6ffd640 1 --2- 172.21.15.133:0/613879887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ea80c4e60 0x7f4ea81f0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f4ea67fc640 1 --2- 172.21.15.133:0/613879887 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ea8151e90 0x7f4ea80ad670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f4ea67fc640 1 -- 172.21.15.133:0/613879887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ea80c4e60 msgr2=0x7f4ea81f0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f4ea67fc640 1 --2- 172.21.15.133:0/613879887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ea80c4e60 0x7f4ea81f0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f4ea67fc640 1 -- 172.21.15.133:0/613879887 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea0009b30 con 0x7f4ea80c7ea0 2023-12-19T18:58:49.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f14d5e65640 1 --2- 172.21.15.133:0/3988896378 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f14b40664c0 0x7f14b4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f6fa5868640 1 -- start start 2023-12-19T18:58:49.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7fbd9effd640 1 -- 172.21.15.133:0/1710350867 <== osd.2 v2:172.21.15.133:6800/2461607163 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbd8c0711b0 con 0x7fbd8c06e6e0 2023-12-19T18:58:49.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f14c67fc640 1 -- 172.21.15.133:0/3988896378 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14cc051420 con 0x7f14d01513c0 2023-12-19T18:58:49.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.416+0000 7f4ea6ffd640 1 --2- 172.21.15.133:0/613879887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ea80c4e60 0x7f4ea81f0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:49.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f4ea67fc640 1 --2- 172.21.15.133:0/613879887 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ea80c7ea0 0x7f4ea80ae8a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800b3e0 tx=0x7f4e9800b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f14d6666640 1 --2- 172.21.15.133:0/3988896378 >> [v2:172.21.15.138:6800/3351784616,v1:172.21.15.138:6801/3351784616] conn(0x7f14b406e660 0x7f14b4070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f14d5e65640 1 --2- 172.21.15.133:0/3988896378 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f14b40664c0 0x7f14b4068980 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f14c80b2000 tx=0x7f14c80ab070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f4e8f7fe640 1 -- 172.21.15.133:0/613879887 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e98011830 con 0x7f4ea80c7ea0 2023-12-19T18:58:49.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f4e8f7fe640 1 -- 172.21.15.133:0/613879887 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e98011990 con 0x7f4ea80c7ea0 2023-12-19T18:58:49.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f4e8f7fe640 1 -- 172.21.15.133:0/613879887 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e98011d80 con 0x7f4ea80c7ea0 2023-12-19T18:58:49.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f4ead5c4640 1 -- 172.21.15.133:0/613879887 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea8158b80 con 0x7f4ea80c7ea0 2023-12-19T18:58:49.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f4ead5c4640 1 -- 172.21.15.133:0/613879887 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea80ad170 con 0x7f4ea80c7ea0 2023-12-19T18:58:49.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f6fa5868640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fa006b9e0 0x7f6fa00afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f6fa5868640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6fa00c7ea0 0x7f6fa014b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f6fa5868640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6fa0151e90 0x7f6fa0148290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f6fa5868640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa014df90 con 0x7f6fa006b9e0 2023-12-19T18:58:49.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f6fa5868640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa014d380 con 0x7f6fa0151e90 2023-12-19T18:58:49.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f6fa5868640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fa014d660 con 0x7f6fa00c7ea0 2023-12-19T18:58:49.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f1d2d7fa640 1 -- 172.21.15.133:0/3692558318 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1d280b4050 con 0x7f1d300c22c0 2023-12-19T18:58:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f6f9e7fc640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6fa00c7ea0 0x7f6fa014b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f6f9effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fa006b9e0 0x7f6fa00afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f6f9effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fa006b9e0 0x7f6fa00afaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54538/0 (socket says 172.21.15.133:54538) 2023-12-19T18:58:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f6f9effd640 1 -- 172.21.15.133:0/2387033383 learned_addr learned my addr 172.21.15.133:0/2387033383 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f6f9f7fe640 1 --2- 172.21.15.133:0/2387033383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6fa0151e90 0x7f6fa0148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f1d2d7fa640 1 --2- 172.21.15.133:0/3692558318 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1d10066540 0x7f1d10068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f6f9e7fc640 1 -- 172.21.15.133:0/2387033383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6fa0151e90 msgr2=0x7f6fa0148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f6f9e7fc640 1 --2- 172.21.15.133:0/2387033383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6fa0151e90 0x7f6fa0148290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f6f9e7fc640 1 -- 172.21.15.133:0/2387033383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fa006b9e0 msgr2=0x7f6fa00afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f6f9e7fc640 1 --2- 172.21.15.133:0/2387033383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fa006b9e0 0x7f6fa00afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f6f9e7fc640 1 -- 172.21.15.133:0/2387033383 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f98009b30 con 0x7f6fa00c7ea0 2023-12-19T18:58:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f6f9effd640 1 --2- 172.21.15.133:0/2387033383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6fa006b9e0 0x7f6fa00afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:58:49.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f1d2d7fa640 1 -- 172.21.15.133:0/3692558318 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d2811ec10 con 0x7f1d300c22c0 2023-12-19T18:58:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f1d2d7fa640 1 --2- 172.21.15.133:0/3692558318 >> [v2:172.21.15.138:6808/2638336882,v1:172.21.15.138:6809/2638336882] conn(0x7f1d1006e760 0x7f1d10070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f1d2d7fa640 1 -- 172.21.15.133:0/3692558318 --> [v2:172.21.15.138:6808/2638336882,v1:172.21.15.138:6809/2638336882] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1d10071230 con 0x7f1d1006e760 2023-12-19T18:58:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f1d2d7fa640 1 -- 172.21.15.133:0/3692558318 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d281232a0 con 0x7f1d300c22c0 2023-12-19T18:58:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f14d6666640 1 --2- 172.21.15.133:0/3988896378 >> [v2:172.21.15.138:6800/3351784616,v1:172.21.15.138:6801/3351784616] conn(0x7f14b406e660 0x7f14b4070a80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f4ead5c4640 1 -- 172.21.15.133:0/613879887 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4e88000fd0 con 0x7f4ea80c7ea0 2023-12-19T18:58:49.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f6f9e7fc640 1 --2- 172.21.15.133:0/2387033383 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6fa00c7ea0 0x7f6fa014b5a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400b410 tx=0x7f6f9400b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f1d2ffff640 1 --2- 172.21.15.133:0/3692558318 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1d10066540 0x7f1d10068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.420+0000 7f1d35792640 1 --2- 172.21.15.133:0/3692558318 >> [v2:172.21.15.138:6808/2638336882,v1:172.21.15.138:6809/2638336882] conn(0x7f1d1006e760 0x7f1d10070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f6f87fff640 1 -- 172.21.15.133:0/2387033383 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94011830 con 0x7f6fa00c7ea0 2023-12-19T18:58:49.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f6f87fff640 1 -- 172.21.15.133:0/2387033383 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f94011990 con 0x7f6fa00c7ea0 2023-12-19T18:58:49.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f6f87fff640 1 -- 172.21.15.133:0/2387033383 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f94011d40 con 0x7f6fa00c7ea0 2023-12-19T18:58:49.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f6fa5868640 1 -- 172.21.15.133:0/2387033383 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fa014d940 con 0x7f6fa00c7ea0 2023-12-19T18:58:49.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f6fa5868640 1 -- 172.21.15.133:0/2387033383 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fa014bae0 con 0x7f6fa00c7ea0 2023-12-19T18:58:49.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f14c67fc640 1 -- 172.21.15.133:0/3988896378 <== osd.4 v2:172.21.15.138:6800/3351784616 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f14b4071130 con 0x7f14b406e660 2023-12-19T18:58:49.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f388ffff640 1 -- 172.21.15.133:0/656662729 --> [v2:172.21.15.133:6824/522902042,v1:172.21.15.133:6825/522902042] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f38900aa380 con 0x7f387c06e670 2023-12-19T18:58:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f6fa5868640 1 -- 172.21.15.133:0/2387033383 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6fa01556f0 con 0x7f6fa00c7ea0 2023-12-19T18:58:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f38777fe640 1 -- 172.21.15.133:0/656662729 <== osd.0 v2:172.21.15.133:6824/522902042 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f38900aa380 con 0x7f387c06e670 2023-12-19T18:58:49.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f1d35792640 1 --2- 172.21.15.133:0/3692558318 >> [v2:172.21.15.138:6808/2638336882,v1:172.21.15.138:6809/2638336882] conn(0x7f1d1006e760 0x7f1d10070b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f4e8f7fe640 1 -- 172.21.15.133:0/613879887 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4e9801a400 con 0x7f4ea80c7ea0 2023-12-19T18:58:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f388ffff640 1 -- 172.21.15.133:0/656662729 >> [v2:172.21.15.133:6824/522902042,v1:172.21.15.133:6825/522902042] conn(0x7f387c06e670 msgr2=0x7f387c070a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f388ffff640 1 --2- 172.21.15.133:0/656662729 >> [v2:172.21.15.133:6824/522902042,v1:172.21.15.133:6825/522902042] conn(0x7f387c06e670 0x7f387c070a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f388ffff640 1 -- 172.21.15.133:0/656662729 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f387c0664d0 msgr2=0x7f387c068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f388ffff640 1 --2- 172.21.15.133:0/656662729 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f387c0664d0 0x7f387c068990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f38880af000 tx=0x7f38880a7070 comp rx=0 tx=0).stop 2023-12-19T18:58:49.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f388ffff640 1 -- 172.21.15.133:0/656662729 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38900c1550 msgr2=0x7f38901f1cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f388ffff640 1 --2- 172.21.15.133:0/656662729 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38900c1550 0x7f38901f1cc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f388000d7d0 tx=0x7f388000dc90 comp rx=0 tx=0).stop 2023-12-19T18:58:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f388f7fe640 1 -- 172.21.15.133:0/656662729 reap_dead start 2023-12-19T18:58:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f1d2d7fa640 1 -- 172.21.15.133:0/3692558318 <== osd.5 v2:172.21.15.138:6808/2638336882 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1d10071230 con 0x7f1d1006e760 2023-12-19T18:58:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f6f87fff640 1 -- 172.21.15.133:0/2387033383 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6f9401a400 con 0x7f6fa00c7ea0 2023-12-19T18:58:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f388ffff640 1 -- 172.21.15.133:0/656662729 shutdown_connections 2023-12-19T18:58:49.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f388ffff640 1 -- 172.21.15.133:0/656662729 >> 172.21.15.133:0/656662729 conn(0x7f38900a7800 msgr2=0x7f389014e930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f1d2ffff640 1 --2- 172.21.15.133:0/3692558318 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1d10066540 0x7f1d10068a00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1d18007fd0 tx=0x7f1d18009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f388ffff640 1 -- 172.21.15.133:0/656662729 shutdown_connections 2023-12-19T18:58:49.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f388ffff640 1 -- 172.21.15.133:0/656662729 wait complete. 2023-12-19T18:58:49.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f4e8f7fe640 1 --2- 172.21.15.133:0/613879887 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4e94066540 0x7f4e94068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.424+0000 7f6f87fff640 1 --2- 172.21.15.133:0/2387033383 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6f8c0664c0 0x7f6f8c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.428+0000 7f6f87fff640 1 -- 172.21.15.133:0/2387033383 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f94083f80 con 0x7f6fa00c7ea0 2023-12-19T18:58:49.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.428+0000 7f6f87fff640 1 --2- 172.21.15.133:0/2387033383 >> [v2:172.21.15.138:6824/2464037857,v1:172.21.15.138:6825/2464037857] conn(0x7f6f8c06e6e0 0x7f6f8c070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.428+0000 7f6f87fff640 1 -- 172.21.15.133:0/2387033383 --> [v2:172.21.15.138:6824/2464037857,v1:172.21.15.138:6825/2464037857] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6f8c0711b0 con 0x7f6f8c06e6e0 2023-12-19T18:58:49.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.428+0000 7f6f87fff640 1 -- 172.21.15.133:0/2387033383 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f94086560 con 0x7f6fa00c7ea0 2023-12-19T18:58:49.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.428+0000 7f4e8f7fe640 1 -- 172.21.15.133:0/613879887 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e98083e20 con 0x7f4ea80c7ea0 2023-12-19T18:58:49.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.428+0000 7f4e8f7fe640 1 --2- 172.21.15.133:0/613879887 >> [v2:172.21.15.138:6816/2860949089,v1:172.21.15.138:6817/2860949089] conn(0x7f4e9406e760 0x7f4e94070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.428+0000 7f4e8f7fe640 1 -- 172.21.15.133:0/613879887 --> [v2:172.21.15.138:6816/2860949089,v1:172.21.15.138:6817/2860949089] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4e94071230 con 0x7f4e9406e760 2023-12-19T18:58:49.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.428+0000 7f4e8f7fe640 1 -- 172.21.15.133:0/613879887 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e98086440 con 0x7f4ea80c7ea0 2023-12-19T18:58:49.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.428+0000 7f6f9f7fe640 1 --2- 172.21.15.133:0/2387033383 >> [v2:172.21.15.138:6824/2464037857,v1:172.21.15.138:6825/2464037857] conn(0x7f6f8c06e6e0 0x7f6f8c070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.428+0000 7f6f9effd640 1 --2- 172.21.15.133:0/2387033383 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6f8c0664c0 0x7f6f8c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.428+0000 7f4ea6ffd640 1 --2- 172.21.15.133:0/613879887 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4e94066540 0x7f4e94068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.428+0000 7f4ea77fe640 1 --2- 172.21.15.133:0/613879887 >> [v2:172.21.15.138:6816/2860949089,v1:172.21.15.138:6817/2860949089] conn(0x7f4e9406e760 0x7f4e94070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.428+0000 7f6f9f7fe640 1 --2- 172.21.15.133:0/2387033383 >> [v2:172.21.15.138:6824/2464037857,v1:172.21.15.138:6825/2464037857] conn(0x7f6f8c06e6e0 0x7f6f8c070b00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.428+0000 7f6f9effd640 1 --2- 172.21.15.133:0/2387033383 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6f8c0664c0 0x7f6f8c068980 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6f90004470 tx=0x7f6f90003700 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.428+0000 7f4ea77fe640 1 --2- 172.21.15.133:0/613879887 >> [v2:172.21.15.138:6816/2860949089,v1:172.21.15.138:6817/2860949089] conn(0x7f4e9406e760 0x7f4e94070b80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.428+0000 7f6f87fff640 1 -- 172.21.15.133:0/2387033383 <== osd.7 v2:172.21.15.138:6824/2464037857 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f6f8c0711b0 con 0x7f6f8c06e6e0 2023-12-19T18:58:49.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.428+0000 7f4e8f7fe640 1 -- 172.21.15.133:0/613879887 <== osd.6 v2:172.21.15.138:6816/2860949089 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4e94071230 con 0x7f4e9406e760 2023-12-19T18:58:49.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.428+0000 7f4ea6ffd640 1 --2- 172.21.15.133:0/613879887 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4e94066540 0x7f4e94068a00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00ae000 tx=0x7f4ea00a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.436+0000 7f40405aa640 1 -- 172.21.15.133:0/438044974 --> [v2:172.21.15.133:6816/1006296948,v1:172.21.15.133:6817/1006296948] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4038152690 con 0x7f401c06e690 2023-12-19T18:58:49.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.440+0000 7f402effd640 1 -- 172.21.15.133:0/438044974 <== osd.1 v2:172.21.15.133:6816/1006296948 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4038152690 con 0x7f401c06e690 2023-12-19T18:58:49.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.440+0000 7f402cff9640 1 -- 172.21.15.133:0/438044974 >> [v2:172.21.15.133:6816/1006296948,v1:172.21.15.133:6817/1006296948] conn(0x7f401c06e690 msgr2=0x7f401c070ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.440+0000 7f402cff9640 1 --2- 172.21.15.133:0/438044974 >> [v2:172.21.15.133:6816/1006296948,v1:172.21.15.133:6817/1006296948] conn(0x7f401c06e690 0x7f401c070ab0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.444+0000 7f402cff9640 1 -- 172.21.15.133:0/438044974 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f401c066470 msgr2=0x7f401c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.444+0000 7f402cff9640 1 --2- 172.21.15.133:0/438044974 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f401c066470 0x7f401c068930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f403814a900 tx=0x7f40340a6000 comp rx=0 tx=0).stop 2023-12-19T18:58:49.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.444+0000 7f402cff9640 1 -- 172.21.15.133:0/438044974 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4038072050 msgr2=0x7f4038153ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.444+0000 7f402cff9640 1 --2- 172.21.15.133:0/438044974 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4038072050 0x7f4038153ed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f40280011f0 tx=0x7f402800cf30 comp rx=0 tx=0).stop 2023-12-19T18:58:49.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.444+0000 7f403eb47640 1 -- 172.21.15.133:0/438044974 reap_dead start 2023-12-19T18:58:49.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.444+0000 7fbdb029a640 1 -- 172.21.15.133:0/1710350867 --> [v2:172.21.15.133:6800/2461607163,v1:172.21.15.133:6801/2461607163] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbda80c5a60 con 0x7fbd8c06e6e0 2023-12-19T18:58:49.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.444+0000 7f402cff9640 1 -- 172.21.15.133:0/438044974 shutdown_connections 2023-12-19T18:58:49.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.444+0000 7f402cff9640 1 -- 172.21.15.133:0/438044974 >> 172.21.15.133:0/438044974 conn(0x7f40380a7910 msgr2=0x7f40380c3960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.444+0000 7f35ebfff640 1 -- 172.21.15.133:0/2553313298 --> [v2:172.21.15.133:6808/829250353,v1:172.21.15.133:6809/829250353] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f35e41808c0 con 0x7f35d806e6e0 2023-12-19T18:58:49.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.444+0000 7f402cff9640 1 -- 172.21.15.133:0/438044974 shutdown_connections 2023-12-19T18:58:49.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.444+0000 7f402cff9640 1 -- 172.21.15.133:0/438044974 wait complete. 2023-12-19T18:58:49.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.444+0000 7fbd9effd640 1 -- 172.21.15.133:0/1710350867 <== osd.2 v2:172.21.15.133:6800/2461607163 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbda80c5a60 con 0x7fbd8c06e6e0 2023-12-19T18:58:49.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.444+0000 7fbdb029a640 1 -- 172.21.15.133:0/1710350867 >> [v2:172.21.15.133:6800/2461607163,v1:172.21.15.133:6801/2461607163] conn(0x7fbd8c06e6e0 msgr2=0x7fbd8c070b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.444+0000 7fbdb029a640 1 --2- 172.21.15.133:0/1710350867 >> [v2:172.21.15.133:6800/2461607163,v1:172.21.15.133:6801/2461607163] conn(0x7fbd8c06e6e0 0x7fbd8c070b00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.444+0000 7fbdb029a640 1 -- 172.21.15.133:0/1710350867 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fbd8c0664c0 msgr2=0x7fbd8c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.444+0000 7fbdb029a640 1 --2- 172.21.15.133:0/1710350867 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fbd8c0664c0 0x7fbd8c068980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbda8147230 tx=0x7fbda0001370 comp rx=0 tx=0).stop 2023-12-19T18:58:49.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.444+0000 7fbdb029a640 1 -- 172.21.15.133:0/1710350867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbda81ee0d0 msgr2=0x7fbda81f0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.444+0000 7fbdb029a640 1 --2- 172.21.15.133:0/1710350867 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbda81ee0d0 0x7fbda81f0d30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbd98007fd0 tx=0x7fbd9800f9d0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.444+0000 7f35d37fe640 1 -- 172.21.15.133:0/2553313298 <== osd.3 v2:172.21.15.133:6808/829250353 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f35e41808c0 con 0x7f35d806e6e0 2023-12-19T18:58:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.448+0000 7fbdae837640 1 -- 172.21.15.133:0/1710350867 reap_dead start 2023-12-19T18:58:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.448+0000 7fbdb029a640 1 -- 172.21.15.133:0/1710350867 shutdown_connections 2023-12-19T18:58:49.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.448+0000 7fbdb029a640 1 -- 172.21.15.133:0/1710350867 >> 172.21.15.133:0/1710350867 conn(0x7fbda80ca170 msgr2=0x7fbda80c0880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.448+0000 7fbdb029a640 1 -- 172.21.15.133:0/1710350867 shutdown_connections 2023-12-19T18:58:49.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.448+0000 7f35ebfff640 1 -- 172.21.15.133:0/2553313298 >> [v2:172.21.15.133:6808/829250353,v1:172.21.15.133:6809/829250353] conn(0x7f35d806e6e0 msgr2=0x7f35d8070b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.448+0000 7f35ebfff640 1 --2- 172.21.15.133:0/2553313298 >> [v2:172.21.15.133:6808/829250353,v1:172.21.15.133:6809/829250353] conn(0x7f35d806e6e0 0x7f35d8070b00 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.448+0000 7fbdb029a640 1 -- 172.21.15.133:0/1710350867 wait complete. 2023-12-19T18:58:49.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.448+0000 7f35ebfff640 1 -- 172.21.15.133:0/2553313298 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f35d80664c0 msgr2=0x7f35d8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.448+0000 7f35ebfff640 1 --2- 172.21.15.133:0/2553313298 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f35d80664c0 0x7f35d8068980 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0011f0 tx=0x7f35dc009040 comp rx=0 tx=0).stop 2023-12-19T18:58:49.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.448+0000 7f35ebfff640 1 -- 172.21.15.133:0/2553313298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35e40dd950 msgr2=0x7f35e4180be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.448+0000 7f35ebfff640 1 --2- 172.21.15.133:0/2553313298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35e40dd950 0x7f35e4180be0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f35ec04fb60 tx=0x7f35ec067fc0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.448+0000 7f35f17f5640 1 -- 172.21.15.133:0/2553313298 reap_dead start 2023-12-19T18:58:49.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.448+0000 7f35ebfff640 1 -- 172.21.15.133:0/2553313298 shutdown_connections 2023-12-19T18:58:49.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.448+0000 7f35ebfff640 1 -- 172.21.15.133:0/2553313298 >> 172.21.15.133:0/2553313298 conn(0x7f35e404fdb0 msgr2=0x7f35e40cfb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.448+0000 7f35ebfff640 1 -- 172.21.15.133:0/2553313298 shutdown_connections 2023-12-19T18:58:49.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.448+0000 7f35ebfff640 1 -- 172.21.15.133:0/2553313298 wait complete. 2023-12-19T18:58:49.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.456+0000 7f1d371f5640 1 -- 172.21.15.133:0/3692558318 --> [v2:172.21.15.138:6808/2638336882,v1:172.21.15.138:6809/2638336882] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1d30068400 con 0x7f1d1006e760 2023-12-19T18:58:49.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.456+0000 7f1d2d7fa640 1 -- 172.21.15.133:0/3692558318 <== osd.5 v2:172.21.15.138:6808/2638336882 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1d30068400 con 0x7f1d1006e760 2023-12-19T18:58:49.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.456+0000 7f14d80c9640 1 -- 172.21.15.133:0/3988896378 --> [v2:172.21.15.138:6800/3351784616,v1:172.21.15.138:6801/3351784616] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f14d00c43c0 con 0x7f14b406e660 2023-12-19T18:58:49.481 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2023-12-19T18:58:49.481 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-19T18:58:49.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.456+0000 7f6fa5868640 1 -- 172.21.15.133:0/2387033383 --> [v2:172.21.15.138:6824/2464037857,v1:172.21.15.138:6825/2464037857] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6fa014d7a0 con 0x7f6f8c06e6e0 2023-12-19T18:58:49.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.456+0000 7f1d26ffd640 1 -- 172.21.15.133:0/3692558318 >> [v2:172.21.15.138:6808/2638336882,v1:172.21.15.138:6809/2638336882] conn(0x7f1d1006e760 msgr2=0x7f1d10070b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.456+0000 7f1d26ffd640 1 --2- 172.21.15.133:0/3692558318 >> [v2:172.21.15.138:6808/2638336882,v1:172.21.15.138:6809/2638336882] conn(0x7f1d1006e760 0x7f1d10070b80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.456+0000 7f1d26ffd640 1 -- 172.21.15.133:0/3692558318 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1d10066540 msgr2=0x7f1d10068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.456+0000 7f1d26ffd640 1 --2- 172.21.15.133:0/3692558318 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1d10066540 0x7f1d10068a00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1d18007fd0 tx=0x7f1d18009040 comp rx=0 tx=0).stop 2023-12-19T18:58:49.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f14c67fc640 1 -- 172.21.15.133:0/3988896378 <== osd.4 v2:172.21.15.138:6800/3351784616 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f14c000b540 con 0x7f14b406e660 2023-12-19T18:58:49.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.456+0000 7f1d26ffd640 1 -- 172.21.15.133:0/3692558318 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d300c22c0 msgr2=0x7f1d300aae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.456+0000 7f1d26ffd640 1 --2- 172.21.15.133:0/3692558318 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1d300c22c0 0x7f1d300aae00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1d2801d060 tx=0x7f1d28019560 comp rx=0 tx=0).stop 2023-12-19T18:58:49.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.456+0000 7f1d35792640 1 -- 172.21.15.133:0/3692558318 reap_dead start 2023-12-19T18:58:49.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.456+0000 7f1d26ffd640 1 -- 172.21.15.133:0/3692558318 shutdown_connections 2023-12-19T18:58:49.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.456+0000 7f1d26ffd640 1 -- 172.21.15.133:0/3692558318 >> 172.21.15.133:0/3692558318 conn(0x7f1d300c5cd0 msgr2=0x7f1d300c60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f1d26ffd640 1 -- 172.21.15.133:0/3692558318 shutdown_connections 2023-12-19T18:58:49.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f1d26ffd640 1 -- 172.21.15.133:0/3692558318 wait complete. 2023-12-19T18:58:49.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f6f87fff640 1 -- 172.21.15.133:0/2387033383 <== osd.7 v2:172.21.15.138:6824/2464037857 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6fa014d7a0 con 0x7f6f8c06e6e0 2023-12-19T18:58:49.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f14d80c9640 1 -- 172.21.15.133:0/3988896378 >> [v2:172.21.15.138:6800/3351784616,v1:172.21.15.138:6801/3351784616] conn(0x7f14b406e660 msgr2=0x7f14b4070a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f14d80c9640 1 --2- 172.21.15.133:0/3988896378 >> [v2:172.21.15.138:6800/3351784616,v1:172.21.15.138:6801/3351784616] conn(0x7f14b406e660 0x7f14b4070a80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f6fa5868640 1 -- 172.21.15.133:0/2387033383 >> [v2:172.21.15.138:6824/2464037857,v1:172.21.15.138:6825/2464037857] conn(0x7f6f8c06e6e0 msgr2=0x7f6f8c070b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f6fa5868640 1 --2- 172.21.15.133:0/2387033383 >> [v2:172.21.15.138:6824/2464037857,v1:172.21.15.138:6825/2464037857] conn(0x7f6f8c06e6e0 0x7f6f8c070b00 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f14d80c9640 1 -- 172.21.15.133:0/3988896378 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f14b40664c0 msgr2=0x7f14b4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f14d80c9640 1 --2- 172.21.15.133:0/3988896378 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f14b40664c0 0x7f14b4068980 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f14c80b2000 tx=0x7f14c80ab070 comp rx=0 tx=0).stop 2023-12-19T18:58:49.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f14d80c9640 1 -- 172.21.15.133:0/3988896378 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14d01513c0 msgr2=0x7f14d014fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f14d80c9640 1 --2- 172.21.15.133:0/3988896378 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14d01513c0 0x7f14d014fc60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00c820 tx=0x7f14cc00cce0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f14d6666640 1 -- 172.21.15.133:0/3988896378 reap_dead start 2023-12-19T18:58:49.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f14d80c9640 1 -- 172.21.15.133:0/3988896378 shutdown_connections 2023-12-19T18:58:49.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f14d80c9640 1 -- 172.21.15.133:0/3988896378 >> 172.21.15.133:0/3988896378 conn(0x7f14d00c5cd0 msgr2=0x7f14d00c60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f6fa5868640 1 -- 172.21.15.133:0/2387033383 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6f8c0664c0 msgr2=0x7f6f8c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f6fa5868640 1 --2- 172.21.15.133:0/2387033383 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6f8c0664c0 0x7f6f8c068980 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6f90004470 tx=0x7f6f90003700 comp rx=0 tx=0).stop 2023-12-19T18:58:49.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f6fa5868640 1 -- 172.21.15.133:0/2387033383 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6fa00c7ea0 msgr2=0x7f6fa014b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f6fa5868640 1 --2- 172.21.15.133:0/2387033383 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6fa00c7ea0 0x7f6fa014b5a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400b410 tx=0x7f6f9400b810 comp rx=0 tx=0).stop 2023-12-19T18:58:49.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f6f9f7fe640 1 -- 172.21.15.133:0/2387033383 reap_dead start 2023-12-19T18:58:49.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f6fa5868640 1 -- 172.21.15.133:0/2387033383 shutdown_connections 2023-12-19T18:58:49.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f6fa5868640 1 -- 172.21.15.133:0/2387033383 >> 172.21.15.133:0/2387033383 conn(0x7f6fa00ca170 msgr2=0x7f6fa00c4820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f14d80c9640 1 -- 172.21.15.133:0/3988896378 shutdown_connections 2023-12-19T18:58:49.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f4ead5c4640 1 -- 172.21.15.133:0/613879887 --> [v2:172.21.15.138:6816/2860949089,v1:172.21.15.138:6817/2860949089] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4e88002cc0 con 0x7f4e9406e760 2023-12-19T18:58:49.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f14d80c9640 1 -- 172.21.15.133:0/3988896378 wait complete. 2023-12-19T18:58:49.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f6fa5868640 1 -- 172.21.15.133:0/2387033383 shutdown_connections 2023-12-19T18:58:49.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f6fa5868640 1 -- 172.21.15.133:0/2387033383 wait complete. 2023-12-19T18:58:49.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f4e8f7fe640 1 -- 172.21.15.133:0/613879887 <== osd.6 v2:172.21.15.138:6816/2860949089 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4e88002cc0 con 0x7f4e9406e760 2023-12-19T18:58:49.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f4ead5c4640 1 -- 172.21.15.133:0/613879887 >> [v2:172.21.15.138:6816/2860949089,v1:172.21.15.138:6817/2860949089] conn(0x7f4e9406e760 msgr2=0x7f4e94070b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f4ead5c4640 1 --2- 172.21.15.133:0/613879887 >> [v2:172.21.15.138:6816/2860949089,v1:172.21.15.138:6817/2860949089] conn(0x7f4e9406e760 0x7f4e94070b80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f4ead5c4640 1 -- 172.21.15.133:0/613879887 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4e94066540 msgr2=0x7f4e94068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f4ead5c4640 1 --2- 172.21.15.133:0/613879887 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4e94066540 0x7f4e94068a00 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00ae000 tx=0x7f4ea00a7070 comp rx=0 tx=0).stop 2023-12-19T18:58:49.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f4ead5c4640 1 -- 172.21.15.133:0/613879887 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ea80c7ea0 msgr2=0x7f4ea80ae8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f4ead5c4640 1 --2- 172.21.15.133:0/613879887 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ea80c7ea0 0x7f4ea80ae8a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4e9800b3e0 tx=0x7f4e9800b8a0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.460+0000 7f4ea77fe640 1 -- 172.21.15.133:0/613879887 reap_dead start 2023-12-19T18:58:49.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.464+0000 7f4ead5c4640 1 -- 172.21.15.133:0/613879887 shutdown_connections 2023-12-19T18:58:49.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.464+0000 7f4ead5c4640 1 -- 172.21.15.133:0/613879887 >> 172.21.15.133:0/613879887 conn(0x7f4ea80ca170 msgr2=0x7f4ea81506c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.468+0000 7f4ead5c4640 1 -- 172.21.15.133:0/613879887 shutdown_connections 2023-12-19T18:58:49.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.468+0000 7f4ead5c4640 1 -- 172.21.15.133:0/613879887 wait complete. 2023-12-19T18:58:49.491 INFO:teuthology.orchestra.run.smithi133.stdout:55834574856 2023-12-19T18:58:49.491 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-19T18:58:49.500 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2023-12-19T18:58:49.500 INFO:teuthology.orchestra.run.smithi133.stdout:55834574856 2023-12-19T18:58:49.501 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-19T18:58:49.501 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-19T18:58:49.502 INFO:teuthology.orchestra.run.smithi133.stdout:55834574855 2023-12-19T18:58:49.502 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-19T18:58:49.505 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2023-12-19T18:58:49.505 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-19T18:58:49.506 INFO:teuthology.orchestra.run.smithi133.stdout:55834574855 2023-12-19T18:58:49.506 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-19T18:58:49.508 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2023-12-19T18:58:49.509 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-19T18:58:49.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.696+0000 7fed51b1d640 1 Processor -- start 2023-12-19T18:58:49.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.696+0000 7fed51b1d640 1 -- start start 2023-12-19T18:58:49.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.700+0000 7fed51b1d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed4c0a8430 0x7fed4c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.700+0000 7fed51b1d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fed4c072080 0x7fed4c1510f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.700+0000 7fed51b1d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed4c0c3e70 con 0x7fed4c06bd80 2023-12-19T18:58:49.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.700+0000 7fed51b1d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed4c0c1120 con 0x7fed4c072080 2023-12-19T18:58:49.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.700+0000 7fed51b1d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0c1400 con 0x7fed4c0a8430 2023-12-19T18:58:49.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.700+0000 7fed4bfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fed4c06bd80 0x7fed4c0c4300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42536/0 (socket says 172.21.15.133:42536) 2023-12-19T18:58:49.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.700+0000 7fed4bfff640 1 -- 172.21.15.133:0/39129949 learned_addr learned my addr 172.21.15.133:0/39129949 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:49.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.700+0000 7fed4affd640 1 --2- 172.21.15.133:0/39129949 >> v2:172.21.15.133:3300/0 conn(0x7fed4c072080 0x7fed4c1510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.700+0000 7fed4a7fc640 1 -- 172.21.15.133:0/39129949 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4046309794 0 0) 0x7fed4c0c3e70 con 0x7fed4c06bd80 2023-12-19T18:58:49.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.700+0000 7fed4a7fc640 1 -- 172.21.15.133:0/39129949 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed34003530 con 0x7fed4c06bd80 2023-12-19T18:58:49.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.700+0000 7fed4affd640 1 -- 172.21.15.133:0/39129949 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed4c0a8430 msgr2=0x7fed4c06d1c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-19T18:58:49.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.700+0000 7fed4affd640 1 --2- 172.21.15.133:0/39129949 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed4c0a8430 0x7fed4c06d1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.700+0000 7fed4affd640 1 -- 172.21.15.133:0/39129949 >> v1:172.21.15.133:6789/0 conn(0x7fed4c06bd80 legacy=0x7fed4c0c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.700+0000 7fed4affd640 1 -- 172.21.15.133:0/39129949 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed4c0c3b00 con 0x7fed4c072080 2023-12-19T18:58:49.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.704+0000 7fed4affd640 1 --2- 172.21.15.133:0/39129949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed4c072080 0x7fed4c1510f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fed44009d90 tx=0x7fed4401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2663ebe63ac62c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.704+0000 7fca80a68640 1 Processor -- start 2023-12-19T18:58:49.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.704+0000 7fca80a68640 1 -- start start 2023-12-19T18:58:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.708+0000 7fca80a68640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fca7c0c06d0 0x7fca7c1513c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.708+0000 7fca80a68640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca7c0c22c0 0x7fca7c06d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.708+0000 7fca7ad9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fca7c0c67f0 0x7fca7c0a4e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42550/0 (socket says 172.21.15.133:42550) 2023-12-19T18:58:49.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.708+0000 7fca79d9b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca7c0c22c0 0x7fca7c06d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.708+0000 7fca79d9b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca7c0c22c0 0x7fca7c06d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:55142/0 (socket says 172.21.15.133:55142) 2023-12-19T18:58:49.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.708+0000 7fca7ad9d640 1 -- 172.21.15.133:0/3733760185 learned_addr learned my addr 172.21.15.133:0/3733760185 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:49.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.708+0000 7fca80a68640 1 -- 172.21.15.133:0/3733760185 --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7c151900 con 0x7fca7c0c67f0 2023-12-19T18:58:49.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.708+0000 7fca80a68640 1 -- 172.21.15.133:0/3733760185 --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca7c0c1290 con 0x7fca7c0c06d0 2023-12-19T18:58:49.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.708+0000 7fca80a68640 1 -- 172.21.15.133:0/3733760185 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c06e490 con 0x7fca7c0c22c0 2023-12-19T18:58:49.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.708+0000 7fca7a59c640 1 --2- 172.21.15.133:0/3733760185 >> v2:172.21.15.138:3300/0 conn(0x7fca7c0c06d0 0x7fca7c1513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.712+0000 7fca79d9b640 1 -- 172.21.15.133:0/3733760185 >> v2:172.21.15.138:3300/0 conn(0x7fca7c0c06d0 msgr2=0x7fca7c1513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.712+0000 7fca79d9b640 1 --2- 172.21.15.133:0/3733760185 >> v2:172.21.15.138:3300/0 conn(0x7fca7c0c06d0 0x7fca7c1513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.712+0000 7fca79d9b640 1 -- 172.21.15.133:0/3733760185 >> v1:172.21.15.133:6789/0 conn(0x7fca7c0c67f0 legacy=0x7fca7c0a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.712+0000 7fca7959a640 1 -- 172.21.15.133:0/3733760185 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636384679 0 0) 0x7fca7c151900 con 0x7fca7c0c67f0 2023-12-19T18:58:49.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.712+0000 7fca79d9b640 1 -- 172.21.15.133:0/3733760185 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c06e770 con 0x7fca7c0c22c0 2023-12-19T18:58:49.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.708+0000 7fed4a7fc640 1 -- 172.21.15.133:0/39129949 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed440a5830 con 0x7fed4c072080 2023-12-19T18:58:49.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.708+0000 7fed4a7fc640 1 -- 172.21.15.133:0/39129949 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed440a5990 con 0x7fed4c072080 2023-12-19T18:58:49.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.708+0000 7fed51b1d640 1 -- 172.21.15.133:0/39129949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed4c072080 msgr2=0x7fed4c1510f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.708+0000 7fed4a7fc640 1 -- 172.21.15.133:0/39129949 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed440a5830 con 0x7fed4c072080 2023-12-19T18:58:49.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.708+0000 7fed51b1d640 1 --2- 172.21.15.133:0/39129949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed4c072080 0x7fed4c1510f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fed44009d90 tx=0x7fed4401c970 comp rx=0 tx=0).stop 2023-12-19T18:58:49.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.708+0000 7fed51b1d640 1 -- 172.21.15.133:0/39129949 shutdown_connections 2023-12-19T18:58:49.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.708+0000 7fed51b1d640 1 --2- 172.21.15.133:0/39129949 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed4c072080 0x7fed4c1510f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.708+0000 7fed51b1d640 1 --2- 172.21.15.133:0/39129949 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed4c0a8430 0x7fed4c06d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.708+0000 7fed51b1d640 1 -- 172.21.15.133:0/39129949 >> 172.21.15.133:0/39129949 conn(0x7fed4c0a7910 msgr2=0x7fed4c0a7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.708+0000 7fed51b1d640 1 -- 172.21.15.133:0/39129949 shutdown_connections 2023-12-19T18:58:49.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.708+0000 7fed51b1d640 1 -- 172.21.15.133:0/39129949 wait complete. 2023-12-19T18:58:49.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.712+0000 7fed51b1d640 1 Processor -- start 2023-12-19T18:58:49.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fed51b1d640 1 -- start start 2023-12-19T18:58:49.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fca79d9b640 1 --2- 172.21.15.133:0/3733760185 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca7c0c22c0 0x7fca7c06d770 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fca70013050 tx=0x7fca70024a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1f5ec2a68f31995 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fca7959a640 1 -- 172.21.15.133:0/3733760185 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca700112d0 con 0x7fca7c0c22c0 2023-12-19T18:58:49.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fca7959a640 1 -- 172.21.15.133:0/3733760185 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca70011430 con 0x7fca7c0c22c0 2023-12-19T18:58:49.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fca7959a640 1 -- 172.21.15.133:0/3733760185 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7000f850 con 0x7fca7c0c22c0 2023-12-19T18:58:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fed51b1d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed4c06bd80 0x7fed4c14fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fed51b1d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed4c072080 0x7fed4c0aa780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fed51b1d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed4c0a8430 0x7fed4c151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fed51b1d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0a9a20 con 0x7fed4c072080 2023-12-19T18:58:49.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fed51b1d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0a9130 con 0x7fed4c06bd80 2023-12-19T18:58:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fed51b1d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed4c0aae20 con 0x7fed4c0a8430 2023-12-19T18:58:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fed4bfff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed4c0a8430 0x7fed4c151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fed4bfff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed4c0a8430 0x7fed4c151960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:55148/0 (socket says 172.21.15.133:55148) 2023-12-19T18:58:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fed4bfff640 1 -- 172.21.15.133:0/4077536802 learned_addr learned my addr 172.21.15.133:0/4077536802 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fed4affd640 1 --2- 172.21.15.133:0/4077536802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed4c072080 0x7fed4c0aa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fed4b7fe640 1 --2- 172.21.15.133:0/4077536802 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed4c06bd80 0x7fed4c14fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fca80a68640 1 -- 172.21.15.133:0/3733760185 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca7c0c22c0 msgr2=0x7fca7c06d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fca80a68640 1 --2- 172.21.15.133:0/3733760185 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca7c0c22c0 0x7fca7c06d770 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fca70013050 tx=0x7fca70024a40 comp rx=0 tx=0).stop 2023-12-19T18:58:49.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fca80a68640 1 -- 172.21.15.133:0/3733760185 shutdown_connections 2023-12-19T18:58:49.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fca80a68640 1 --2- 172.21.15.133:0/3733760185 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca7c0c22c0 0x7fca7c06d770 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fca80a68640 1 --2- 172.21.15.133:0/3733760185 >> v2:172.21.15.138:3300/0 conn(0x7fca7c0c06d0 0x7fca7c1513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fca80a68640 1 -- 172.21.15.133:0/3733760185 >> 172.21.15.133:0/3733760185 conn(0x7fca7c0c5cd0 msgr2=0x7fca7c0c60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fca80a68640 1 -- 172.21.15.133:0/3733760185 shutdown_connections 2023-12-19T18:58:49.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fed4b7fe640 1 -- 172.21.15.133:0/4077536802 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed4c0a8430 msgr2=0x7fed4c151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fed4b7fe640 1 --2- 172.21.15.133:0/4077536802 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed4c0a8430 0x7fed4c151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fed4b7fe640 1 -- 172.21.15.133:0/4077536802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed4c072080 msgr2=0x7fed4c0aa780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fed4b7fe640 1 --2- 172.21.15.133:0/4077536802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed4c072080 0x7fed4c0aa780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fed4b7fe640 1 -- 172.21.15.133:0/4077536802 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed44009a70 con 0x7fed4c06bd80 2023-12-19T18:58:49.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.716+0000 7fca80a68640 1 -- 172.21.15.133:0/3733760185 wait complete. 2023-12-19T18:58:49.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.720+0000 7fed4b7fe640 1 --2- 172.21.15.133:0/4077536802 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed4c06bd80 0x7fed4c14fc00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fed3c00b410 tx=0x7fed3c00b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.720+0000 7fed33fff640 1 -- 172.21.15.133:0/4077536802 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c011830 con 0x7fed4c06bd80 2023-12-19T18:58:49.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.720+0000 7fed33fff640 1 -- 172.21.15.133:0/4077536802 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed3c0119b0 con 0x7fed4c06bd80 2023-12-19T18:58:49.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.720+0000 7fed33fff640 1 -- 172.21.15.133:0/4077536802 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed3c011d60 con 0x7fed4c06bd80 2023-12-19T18:58:49.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.720+0000 7fed51b1d640 1 -- 172.21.15.133:0/4077536802 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed4c0a93d0 con 0x7fed4c06bd80 2023-12-19T18:58:49.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.720+0000 7fed51b1d640 1 -- 172.21.15.133:0/4077536802 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed4c1436e0 con 0x7fed4c06bd80 2023-12-19T18:58:49.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.720+0000 7fca80a68640 1 Processor -- start 2023-12-19T18:58:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.720+0000 7fca80a68640 1 -- start start 2023-12-19T18:58:49.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.720+0000 7fed51b1d640 1 -- 172.21.15.133:0/4077536802 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed4c04e850 con 0x7fed4c06bd80 2023-12-19T18:58:49.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.724+0000 7fca80a68640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca7c0c22c0 0x7fca7c147a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.724+0000 7fca80a68640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca7c0c67f0 0x7fca7c14cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.724+0000 7fca80a68640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca7c147f90 0x7fca7c1ec400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.724+0000 7fca79d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca7c0c67f0 0x7fca7c14cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.724+0000 7fca7a59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca7c0c22c0 0x7fca7c147a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.724+0000 7fed33fff640 1 -- 172.21.15.133:0/4077536802 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fed3c01a400 con 0x7fed4c06bd80 2023-12-19T18:58:49.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.724+0000 7fca7a59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca7c0c22c0 0x7fca7c147a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:48138/0 (socket says 172.21.15.133:48138) 2023-12-19T18:58:49.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.724+0000 7fca7a59c640 1 -- 172.21.15.133:0/540805187 learned_addr learned my addr 172.21.15.133:0/540805187 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:49.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.724+0000 7fca79d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca7c0c67f0 0x7fca7c14cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54552/0 (socket says 172.21.15.133:54552) 2023-12-19T18:58:49.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.724+0000 7fca80a68640 1 -- 172.21.15.133:0/540805187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c0a8670 con 0x7fca7c0c67f0 2023-12-19T18:58:49.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.724+0000 7fca80a68640 1 -- 172.21.15.133:0/540805187 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c14c710 con 0x7fca7c0c22c0 2023-12-19T18:58:49.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.724+0000 7fca80a68640 1 -- 172.21.15.133:0/540805187 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c070a50 con 0x7fca7c147f90 2023-12-19T18:58:49.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.724+0000 7fca7ad9d640 1 --2- 172.21.15.133:0/540805187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca7c147f90 0x7fca7c1ec400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.724+0000 7fca7ad9d640 1 -- 172.21.15.133:0/540805187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca7c0c22c0 msgr2=0x7fca7c147a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.724+0000 7fca7ad9d640 1 --2- 172.21.15.133:0/540805187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca7c0c22c0 0x7fca7c147a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.724+0000 7fca7ad9d640 1 -- 172.21.15.133:0/540805187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca7c0c67f0 msgr2=0x7fca7c14cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.724+0000 7fca7ad9d640 1 --2- 172.21.15.133:0/540805187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca7c0c67f0 0x7fca7c14cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.724+0000 7fca7ad9d640 1 -- 172.21.15.133:0/540805187 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca70011cc0 con 0x7fca7c147f90 2023-12-19T18:58:49.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.724+0000 7fed33fff640 1 --2- 172.21.15.133:0/4077536802 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fed38066540 0x7fed38068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.724+0000 7fed33fff640 1 -- 172.21.15.133:0/4077536802 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed3c083dd0 con 0x7fed4c06bd80 2023-12-19T18:58:49.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.728+0000 7fed4affd640 1 --2- 172.21.15.133:0/4077536802 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fed38066540 0x7fed38068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.728+0000 7fca7ad9d640 1 --2- 172.21.15.133:0/540805187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca7c147f90 0x7fca7c1ec400 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00c410 tx=0x7fca6c00c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.728+0000 7fca6affd640 1 -- 172.21.15.133:0/540805187 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c0074e0 con 0x7fca7c147f90 2023-12-19T18:58:49.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.728+0000 7fca6affd640 1 -- 172.21.15.133:0/540805187 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c007640 con 0x7fca7c147f90 2023-12-19T18:58:49.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.728+0000 7fca6affd640 1 -- 172.21.15.133:0/540805187 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c004a30 con 0x7fca7c147f90 2023-12-19T18:58:49.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.728+0000 7fca80a68640 1 -- 172.21.15.133:0/540805187 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca7c1ed280 con 0x7fca7c147f90 2023-12-19T18:58:49.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.728+0000 7fca80a68640 1 -- 172.21.15.133:0/540805187 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7c070770 con 0x7fca7c147f90 2023-12-19T18:58:49.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.728+0000 7fed4affd640 1 --2- 172.21.15.133:0/4077536802 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fed38066540 0x7fed38068a00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fed440af000 tx=0x7fed440a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.728+0000 7fca80a68640 1 -- 172.21.15.133:0/540805187 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7c14c8a0 con 0x7fca7c147f90 2023-12-19T18:58:49.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.732+0000 7fed33fff640 1 -- 172.21.15.133:0/4077536802 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fed3c087030 con 0x7fed4c06bd80 2023-12-19T18:58:49.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.732+0000 7fca6affd640 1 -- 172.21.15.133:0/540805187 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fca6c004b90 con 0x7fca7c147f90 2023-12-19T18:58:49.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.732+0000 7fca6affd640 1 --2- 172.21.15.133:0/540805187 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fca5c0664c0 0x7fca5c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.732+0000 7fca6affd640 1 -- 172.21.15.133:0/540805187 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca6c083a20 con 0x7fca7c147f90 2023-12-19T18:58:49.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.736+0000 7f7a2159d640 1 Processor -- start 2023-12-19T18:58:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.736+0000 7fca7a59c640 1 --2- 172.21.15.133:0/540805187 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fca5c0664c0 0x7fca5c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.736+0000 7f7a2159d640 1 -- start start 2023-12-19T18:58:49.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.736+0000 7fca7a59c640 1 --2- 172.21.15.133:0/540805187 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fca5c0664c0 0x7fca5c068980 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fca74009a40 tx=0x7fca7400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.736+0000 7f7a2159d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7a1c0c06d0 0x7f7a1c0a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.736+0000 7f7a1affd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7a1c1513c0 0x7f7a1c06d770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42564/0 (socket says 172.21.15.133:42564) 2023-12-19T18:58:49.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.736+0000 7f7a1affd640 1 -- 172.21.15.133:0/1509332820 learned_addr learned my addr 172.21.15.133:0/1509332820 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:49.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.736+0000 7f7a2159d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1c06e490 con 0x7f7a1c1513c0 2023-12-19T18:58:49.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.736+0000 7f7a2159d640 1 -- 172.21.15.133:0/1509332820 --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1c06e770 con 0x7f7a1c0c22c0 2023-12-19T18:58:49.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.736+0000 7f7a1a7fc640 1 --2- 172.21.15.133:0/1509332820 >> v2:172.21.15.138:3300/0 conn(0x7f7a1c0c06d0 0x7f7a1c0a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.736+0000 7f7a2159d640 1 -- 172.21.15.133:0/1509332820 --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1c0c1290 con 0x7f7a1c0c06d0 2023-12-19T18:58:49.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.740+0000 7fca6affd640 1 -- 172.21.15.133:0/540805187 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fca6c050f30 con 0x7fca7c147f90 2023-12-19T18:58:49.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.740+0000 7f211d91d640 1 Processor -- start 2023-12-19T18:58:49.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.740+0000 7f211d91d640 1 -- start start 2023-12-19T18:58:49.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.740+0000 7f211d91d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2118151e90 0x7f21180c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.740+0000 7f211d91d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21180c7ea0 0x7f211806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.740+0000 7f211d91d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211806c860 con 0x7f21180c4e60 2023-12-19T18:58:49.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.740+0000 7f211d91d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21180c8750 con 0x7f2118151e90 2023-12-19T18:58:49.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.740+0000 7f211d91d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21181552d0 con 0x7f21180c7ea0 2023-12-19T18:58:49.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.740+0000 7f7a19ffb640 1 -- 172.21.15.133:0/1509332820 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1148264743 0 0) 0x7f7a1c06e490 con 0x7f7a1c1513c0 2023-12-19T18:58:49.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.740+0000 7f7a19ffb640 1 -- 172.21.15.133:0/1509332820 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a04005740 con 0x7f7a1c1513c0 2023-12-19T18:58:49.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.744+0000 7f2116ffd640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2118151e90 0x7f21180c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.744+0000 7f21167fc640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21180c7ea0 0x7f211806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.744+0000 7f21167fc640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21180c7ea0 0x7f211806b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:55160/0 (socket says 172.21.15.133:55160) 2023-12-19T18:58:49.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.744+0000 7f21167fc640 1 -- 172.21.15.133:0/1518598408 learned_addr learned my addr 172.21.15.133:0/1518598408 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:49.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.740+0000 7f7a19ffb640 1 -- 172.21.15.133:0/1509332820 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889791219 0 0) 0x7f7a1c06e770 con 0x7f7a1c0c22c0 2023-12-19T18:58:49.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.740+0000 7f7a19ffb640 1 -- 172.21.15.133:0/1509332820 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a1c06e490 con 0x7f7a1c0c22c0 2023-12-19T18:58:49.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.740+0000 7f7a1a7fc640 1 -- 172.21.15.133:0/1509332820 >> v1:172.21.15.138:6789/0 conn(0x7f7a1c0c22c0 legacy=0x7f7a1c15b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.740+0000 7f7a1a7fc640 1 -- 172.21.15.133:0/1509332820 >> v1:172.21.15.133:6789/0 conn(0x7f7a1c1513c0 legacy=0x7f7a1c06d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.740+0000 7f7a1a7fc640 1 -- 172.21.15.133:0/1509332820 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c06cf70 con 0x7f7a1c0c06d0 2023-12-19T18:58:49.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.744+0000 7f2115ffb640 1 -- 172.21.15.133:0/1518598408 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2433008530 0 0) 0x7f211806c860 con 0x7f21180c4e60 2023-12-19T18:58:49.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.744+0000 7f2115ffb640 1 -- 172.21.15.133:0/1518598408 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2100003530 con 0x7f21180c4e60 2023-12-19T18:58:49.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.744+0000 7f21167fc640 1 -- 172.21.15.133:0/1518598408 >> v2:172.21.15.138:3300/0 conn(0x7f2118151e90 msgr2=0x7f21180c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.744+0000 7f21167fc640 1 --2- 172.21.15.133:0/1518598408 >> v2:172.21.15.138:3300/0 conn(0x7f2118151e90 0x7f21180c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.744+0000 7f21167fc640 1 -- 172.21.15.133:0/1518598408 >> v1:172.21.15.138:6789/0 conn(0x7f21180c4e60 legacy=0x7f211806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.744+0000 7f21167fc640 1 -- 172.21.15.133:0/1518598408 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2118154930 con 0x7f21180c7ea0 2023-12-19T18:58:49.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.744+0000 7f7a1a7fc640 1 --2- 172.21.15.133:0/1509332820 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7a1c0c06d0 0x7f7a1c0a4e50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0097c0 tx=0x7f7a0c024b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78c5f026b31d2467 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.748+0000 7f7a19ffb640 1 -- 172.21.15.133:0/1509332820 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c0adae0 con 0x7f7a1c0c06d0 2023-12-19T18:58:49.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.748+0000 7f7a19ffb640 1 -- 172.21.15.133:0/1509332820 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0c0adc40 con 0x7f7a1c0c06d0 2023-12-19T18:58:49.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.748+0000 7f7a19ffb640 1 -- 172.21.15.133:0/1509332820 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c0b5440 con 0x7f7a1c0c06d0 2023-12-19T18:58:49.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.748+0000 7f9375ba7640 1 Processor -- start 2023-12-19T18:58:49.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.748+0000 7f7a2159d640 1 -- 172.21.15.133:0/1509332820 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7a1c0c06d0 msgr2=0x7f7a1c0a4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.748+0000 7f7a2159d640 1 --2- 172.21.15.133:0/1509332820 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7a1c0c06d0 0x7f7a1c0a4e50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0097c0 tx=0x7f7a0c024b60 comp rx=0 tx=0).stop 2023-12-19T18:58:49.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.748+0000 7f9375ba7640 1 -- start start 2023-12-19T18:58:49.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.748+0000 7f21167fc640 1 --2- 172.21.15.133:0/1518598408 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21180c7ea0 0x7f211806b4a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f210c009870 tx=0x7f210c01c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9fc9a86e61b822c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.748+0000 7f7a2159d640 1 -- 172.21.15.133:0/1509332820 shutdown_connections 2023-12-19T18:58:49.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.748+0000 7f7a2159d640 1 --2- 172.21.15.133:0/1509332820 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7a1c0c06d0 0x7f7a1c0a4e50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.748+0000 7f7a2159d640 1 -- 172.21.15.133:0/1509332820 >> 172.21.15.133:0/1509332820 conn(0x7f7a1c0c5cd0 msgr2=0x7f7a1c0c60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.748+0000 7f2115ffb640 1 -- 172.21.15.133:0/1518598408 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c0ab600 con 0x7f21180c7ea0 2023-12-19T18:58:49.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.748+0000 7f7a2159d640 1 -- 172.21.15.133:0/1509332820 shutdown_connections 2023-12-19T18:58:49.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.748+0000 7f7a2159d640 1 -- 172.21.15.133:0/1509332820 wait complete. 2023-12-19T18:58:49.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.748+0000 7f9375ba7640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9370156060 0x7f93700ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.748+0000 7f9375ba7640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f93700ca9a0 0x7f937006c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.748+0000 7f9375ba7640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f937006c8e0 con 0x7f93700c82e0 2023-12-19T18:58:49.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.748+0000 7f9375ba7640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93700c5850 con 0x7f93700ca9a0 2023-12-19T18:58:49.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.748+0000 7f9375ba7640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9370156440 con 0x7f9370156060 2023-12-19T18:58:49.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.752+0000 7f9374ba5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9370156060 0x7f93700ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.752+0000 7f9374ba5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9370156060 0x7f93700ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:55174/0 (socket says 172.21.15.133:55174) 2023-12-19T18:58:49.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.752+0000 7f9374ba5640 1 -- 172.21.15.133:0/2983033609 learned_addr learned my addr 172.21.15.133:0/2983033609 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:49.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.752+0000 7f9374ba5640 1 -- 172.21.15.133:0/2983033609 >> v2:172.21.15.133:3300/0 conn(0x7f93700ca9a0 msgr2=0x7f937006c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.752+0000 7f93753a6640 1 --2- 172.21.15.133:0/2983033609 >> v2:172.21.15.133:3300/0 conn(0x7f93700ca9a0 0x7f937006c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.752+0000 7f9374ba5640 1 --2- 172.21.15.133:0/2983033609 >> v2:172.21.15.133:3300/0 conn(0x7f93700ca9a0 0x7f937006c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.752+0000 7f9374ba5640 1 -- 172.21.15.133:0/2983033609 >> v1:172.21.15.133:6789/0 conn(0x7f93700c82e0 legacy=0x7f937006bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.752+0000 7f9374ba5640 1 -- 172.21.15.133:0/2983033609 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937015ce50 con 0x7f9370156060 2023-12-19T18:58:49.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.752+0000 7f93753a6640 1 --2- 172.21.15.133:0/2983033609 >> v2:172.21.15.133:3300/0 conn(0x7f93700ca9a0 0x7f937006c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:49.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.752+0000 7f2115ffb640 1 -- 172.21.15.133:0/1518598408 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c0a7050 con 0x7f21180c7ea0 2023-12-19T18:58:49.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.752+0000 7f2115ffb640 1 -- 172.21.15.133:0/1518598408 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c0ab980 con 0x7f21180c7ea0 2023-12-19T18:58:49.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.752+0000 7f211d91d640 1 -- 172.21.15.133:0/1518598408 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21180c7ea0 msgr2=0x7f211806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.752+0000 7f211d91d640 1 --2- 172.21.15.133:0/1518598408 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21180c7ea0 0x7f211806b4a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f210c009870 tx=0x7f210c01c440 comp rx=0 tx=0).stop 2023-12-19T18:58:49.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.752+0000 7f211d91d640 1 -- 172.21.15.133:0/1518598408 shutdown_connections 2023-12-19T18:58:49.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.752+0000 7f211d91d640 1 --2- 172.21.15.133:0/1518598408 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21180c7ea0 0x7f211806b4a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.752+0000 7f211d91d640 1 --2- 172.21.15.133:0/1518598408 >> v2:172.21.15.138:3300/0 conn(0x7f2118151e90 0x7f21180c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.752+0000 7f211d91d640 1 -- 172.21.15.133:0/1518598408 >> 172.21.15.133:0/1518598408 conn(0x7f21180ca170 msgr2=0x7f21180ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.752+0000 7f211d91d640 1 -- 172.21.15.133:0/1518598408 shutdown_connections 2023-12-19T18:58:49.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.752+0000 7f7a2159d640 1 Processor -- start 2023-12-19T18:58:49.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.752+0000 7f7a2159d640 1 -- start start 2023-12-19T18:58:49.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.752+0000 7f211d91d640 1 -- 172.21.15.133:0/1518598408 wait complete. 2023-12-19T18:58:49.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f7a2159d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a1c0c22c0 0x7f7a1c146ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f9374ba5640 1 --2- 172.21.15.133:0/2983033609 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9370156060 0x7f93700ca460 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9360009870 tx=0x7f936001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd848498982b6ed1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f7a2159d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7a1c1513c0 0x7f7a1c0a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f7a2159d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7a1c145e10 0x7f7a1c1462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f7a2159d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0a5b00 con 0x7f7a1c0c22c0 2023-12-19T18:58:49.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f7a2159d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0a5de0 con 0x7f7a1c1513c0 2023-12-19T18:58:49.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f7a2159d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c0a60c0 con 0x7f7a1c145e10 2023-12-19T18:58:49.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f7a1affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a1c0c22c0 0x7f7a1c146ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f7a1affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a1c0c22c0 0x7f7a1c146ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54568/0 (socket says 172.21.15.133:54568) 2023-12-19T18:58:49.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f7a1affd640 1 -- 172.21.15.133:0/905289471 learned_addr learned my addr 172.21.15.133:0/905289471 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:49.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f7a1a7fc640 1 --2- 172.21.15.133:0/905289471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7a1c1513c0 0x7f7a1c0a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f7a1b7fe640 1 --2- 172.21.15.133:0/905289471 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7a1c145e10 0x7f7a1c1462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f211d91d640 1 Processor -- start 2023-12-19T18:58:49.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f936f7fe640 1 -- 172.21.15.133:0/2983033609 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93600a7070 con 0x7f9370156060 2023-12-19T18:58:49.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f936f7fe640 1 -- 172.21.15.133:0/2983033609 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93600ab430 con 0x7f9370156060 2023-12-19T18:58:49.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f936f7fe640 1 -- 172.21.15.133:0/2983033609 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93600ab7c0 con 0x7f9370156060 2023-12-19T18:58:49.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f7a1affd640 1 -- 172.21.15.133:0/905289471 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7a1c145e10 msgr2=0x7f7a1c1462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f7a1affd640 1 --2- 172.21.15.133:0/905289471 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7a1c145e10 0x7f7a1c1462c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f7a1affd640 1 -- 172.21.15.133:0/905289471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7a1c1513c0 msgr2=0x7f7a1c0a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f7a1affd640 1 --2- 172.21.15.133:0/905289471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7a1c1513c0 0x7f7a1c0a9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f7a1affd640 1 -- 172.21.15.133:0/905289471 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0c009420 con 0x7f7a1c0c22c0 2023-12-19T18:58:49.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f9375ba7640 1 -- 172.21.15.133:0/2983033609 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9370156060 msgr2=0x7f93700ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f9375ba7640 1 --2- 172.21.15.133:0/2983033609 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9370156060 0x7f93700ca460 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9360009870 tx=0x7f936001c470 comp rx=0 tx=0).stop 2023-12-19T18:58:49.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.756+0000 7f7a1affd640 1 --2- 172.21.15.133:0/905289471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a1c0c22c0 0x7f7a1c146ad0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7a1000c420 tx=0x7f7a1000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.760+0000 7f7a037fe640 1 -- 172.21.15.133:0/905289471 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a10005cf0 con 0x7f7a1c0c22c0 2023-12-19T18:58:49.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.760+0000 7f7a2159d640 1 -- 172.21.15.133:0/905289471 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1c0a63a0 con 0x7f7a1c0c22c0 2023-12-19T18:58:49.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.760+0000 7f7a2159d640 1 -- 172.21.15.133:0/905289471 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1c0aa330 con 0x7f7a1c0c22c0 2023-12-19T18:58:49.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.760+0000 7f7a037fe640 1 -- 172.21.15.133:0/905289471 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a10005e50 con 0x7f7a1c0c22c0 2023-12-19T18:58:49.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.760+0000 7f7a037fe640 1 -- 172.21.15.133:0/905289471 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a100072d0 con 0x7f7a1c0c22c0 2023-12-19T18:58:49.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.760+0000 7f211d91d640 1 -- start start 2023-12-19T18:58:49.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.760+0000 7f211d91d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21180c4e60 0x7f2118143890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.760+0000 7f211d91d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21180c7ea0 0x7f21181f4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.760+0000 7f211d91d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2118151e90 0x7f211814e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.760+0000 7f211d91d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21180ab840 con 0x7f2118151e90 2023-12-19T18:58:49.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.760+0000 7f211d91d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21180a9a90 con 0x7f21180c4e60 2023-12-19T18:58:49.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.760+0000 7f211d91d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21180710a0 con 0x7f21180c7ea0 2023-12-19T18:58:49.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.760+0000 7f2116ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21180c4e60 0x7f2118143890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.760+0000 7f21167fc640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21180c7ea0 0x7f21181f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.760+0000 7f21167fc640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21180c7ea0 0x7f21181f4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:55192/0 (socket says 172.21.15.133:55192) 2023-12-19T18:58:49.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.760+0000 7f21167fc640 1 -- 172.21.15.133:0/3925756002 learned_addr learned my addr 172.21.15.133:0/3925756002 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:49.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.760+0000 7f21177fe640 1 --2- 172.21.15.133:0/3925756002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2118151e90 0x7f211814e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.760+0000 7f9375ba7640 1 -- 172.21.15.133:0/2983033609 shutdown_connections 2023-12-19T18:58:49.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.760+0000 7f9375ba7640 1 --2- 172.21.15.133:0/2983033609 >> v2:172.21.15.133:3300/0 conn(0x7f93700ca9a0 0x7f937006c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.760+0000 7f9375ba7640 1 --2- 172.21.15.133:0/2983033609 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9370156060 0x7f93700ca460 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.760+0000 7f9375ba7640 1 -- 172.21.15.133:0/2983033609 >> 172.21.15.133:0/2983033609 conn(0x7f93700abee0 msgr2=0x7f93700c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.764+0000 7f2116ffd640 1 -- 172.21.15.133:0/3925756002 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21180c7ea0 msgr2=0x7f21181f4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.764+0000 7f2116ffd640 1 --2- 172.21.15.133:0/3925756002 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21180c7ea0 0x7f21181f4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.764+0000 7f2116ffd640 1 -- 172.21.15.133:0/3925756002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2118151e90 msgr2=0x7f211814e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.764+0000 7f2116ffd640 1 --2- 172.21.15.133:0/3925756002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2118151e90 0x7f211814e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.764+0000 7f2116ffd640 1 -- 172.21.15.133:0/3925756002 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210c0094d0 con 0x7f21180c4e60 2023-12-19T18:58:49.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.764+0000 7f9375ba7640 1 -- 172.21.15.133:0/2983033609 shutdown_connections 2023-12-19T18:58:49.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.764+0000 7f21167fc640 1 --2- 172.21.15.133:0/3925756002 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21180c7ea0 0x7f21181f4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:49.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.764+0000 7f21177fe640 1 --2- 172.21.15.133:0/3925756002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2118151e90 0x7f211814e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:58:49.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.764+0000 7f7a037fe640 1 -- 172.21.15.133:0/905289471 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7a10007430 con 0x7f7a1c0c22c0 2023-12-19T18:58:49.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.764+0000 7f7a037fe640 1 --2- 172.21.15.133:0/905289471 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7a08066470 0x7f7a08068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.764+0000 7f7a037fe640 1 -- 172.21.15.133:0/905289471 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a10083340 con 0x7f7a1c0c22c0 2023-12-19T18:58:49.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.764+0000 7f9375ba7640 1 -- 172.21.15.133:0/2983033609 wait complete. 2023-12-19T18:58:49.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.764+0000 7f9375ba7640 1 Processor -- start 2023-12-19T18:58:49.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.768+0000 7f2116ffd640 1 --2- 172.21.15.133:0/3925756002 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21180c4e60 0x7f2118143890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f210800e870 tx=0x7f210800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.768+0000 7f7a1a7fc640 1 --2- 172.21.15.133:0/905289471 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7a08066470 0x7f7a08068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.768+0000 7f20fffff640 1 -- 172.21.15.133:0/3925756002 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21080095d0 con 0x7f21180c4e60 2023-12-19T18:58:49.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.768+0000 7f20fffff640 1 -- 172.21.15.133:0/3925756002 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210800c940 con 0x7f21180c4e60 2023-12-19T18:58:49.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.768+0000 7f20fffff640 1 -- 172.21.15.133:0/3925756002 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210800ccb0 con 0x7f21180c4e60 2023-12-19T18:58:49.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.768+0000 7f7a2159d640 1 -- 172.21.15.133:0/905289471 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79fc005260 con 0x7f7a1c0c22c0 2023-12-19T18:58:49.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.768+0000 7f9375ba7640 1 -- start start 2023-12-19T18:58:49.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.768+0000 7f9375ba7640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93700c82e0 0x7f93700af4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.768+0000 7f9375ba7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93700ca9a0 0x7f93700c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.768+0000 7f9375ba7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9370156060 0x7f93700c2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.768+0000 7f9375ba7640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93700aee00 con 0x7f9370156060 2023-12-19T18:58:49.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.768+0000 7f9375ba7640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93700c0120 con 0x7f93700ca9a0 2023-12-19T18:58:49.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.768+0000 7f9375ba7640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93700c2f70 con 0x7f93700c82e0 2023-12-19T18:58:49.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.768+0000 7f9374ba5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93700c82e0 0x7f93700af4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.768+0000 7f9374ba5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93700c82e0 0x7f93700af4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:55208/0 (socket says 172.21.15.133:55208) 2023-12-19T18:58:49.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.768+0000 7f9374ba5640 1 -- 172.21.15.133:0/245121011 learned_addr learned my addr 172.21.15.133:0/245121011 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:49.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.768+0000 7f936ffff640 1 --2- 172.21.15.133:0/245121011 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93700ca9a0 0x7f93700c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.768+0000 7f7a1a7fc640 1 --2- 172.21.15.133:0/905289471 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7a08066470 0x7f7a08068930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0b7000 tx=0x7f7a0c0af070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.772+0000 7f211d91d640 1 -- 172.21.15.133:0/3925756002 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2118071850 con 0x7f21180c4e60 2023-12-19T18:58:49.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.772+0000 7f211d91d640 1 -- 172.21.15.133:0/3925756002 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2118070dc0 con 0x7f21180c4e60 2023-12-19T18:58:49.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.772+0000 7f936ffff640 1 -- 172.21.15.133:0/245121011 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93700c82e0 msgr2=0x7f93700af4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.772+0000 7f936ffff640 1 --2- 172.21.15.133:0/245121011 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93700c82e0 0x7f93700af4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.772+0000 7f211d91d640 1 -- 172.21.15.133:0/3925756002 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21180c4c30 con 0x7f21180c4e60 2023-12-19T18:58:49.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.772+0000 7f936ffff640 1 -- 172.21.15.133:0/245121011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9370156060 msgr2=0x7f93700c2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.772+0000 7f936ffff640 1 --2- 172.21.15.133:0/245121011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9370156060 0x7f93700c2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.772+0000 7f936ffff640 1 -- 172.21.15.133:0/245121011 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93600094d0 con 0x7f93700ca9a0 2023-12-19T18:58:49.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.772+0000 7f936ffff640 1 --2- 172.21.15.133:0/245121011 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93700ca9a0 0x7f93700c24f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f936800c780 tx=0x7f936800cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.772+0000 7f936d7fa640 1 -- 172.21.15.133:0/245121011 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9368003d90 con 0x7f93700ca9a0 2023-12-19T18:58:49.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.772+0000 7f936d7fa640 1 -- 172.21.15.133:0/245121011 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936800ce30 con 0x7f93700ca9a0 2023-12-19T18:58:49.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.772+0000 7f936d7fa640 1 -- 172.21.15.133:0/245121011 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9368005290 con 0x7f93700ca9a0 2023-12-19T18:58:49.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.776+0000 7f20fffff640 1 -- 172.21.15.133:0/3925756002 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2108013470 con 0x7f21180c4e60 2023-12-19T18:58:49.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.776+0000 7f9375ba7640 1 -- 172.21.15.133:0/245121011 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93700acbb0 con 0x7f93700ca9a0 2023-12-19T18:58:49.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.776+0000 7f20fffff640 1 --2- 172.21.15.133:0/3925756002 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2104066570 0x7f2104068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.776+0000 7f9375ba7640 1 -- 172.21.15.133:0/245121011 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93700bfdb0 con 0x7f93700ca9a0 2023-12-19T18:58:49.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.776+0000 7f20fffff640 1 -- 172.21.15.133:0/3925756002 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2108083ef0 con 0x7f21180c4e60 2023-12-19T18:58:49.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.776+0000 7f21167fc640 1 --2- 172.21.15.133:0/3925756002 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2104066570 0x7f2104068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.780+0000 7f7a037fe640 1 -- 172.21.15.133:0/905289471 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7a100507e0 con 0x7f7a1c0c22c0 2023-12-19T18:58:49.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.780+0000 7f21167fc640 1 --2- 172.21.15.133:0/3925756002 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2104066570 0x7f2104068a30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f210c009870 tx=0x7f210c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.780+0000 7f20fffff640 1 -- 172.21.15.133:0/3925756002 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2108051490 con 0x7f21180c4e60 2023-12-19T18:58:49.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.784+0000 7f9375ba7640 1 -- 172.21.15.133:0/245121011 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93700c02d0 con 0x7f93700ca9a0 2023-12-19T18:58:49.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.784+0000 7f936d7fa640 1 -- 172.21.15.133:0/245121011 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f93680053f0 con 0x7f93700ca9a0 2023-12-19T18:58:49.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.784+0000 7f936d7fa640 1 --2- 172.21.15.133:0/245121011 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f935c066540 0x7f935c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.784+0000 7f9374ba5640 1 --2- 172.21.15.133:0/245121011 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f935c066540 0x7f935c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.788+0000 7f936d7fa640 1 -- 172.21.15.133:0/245121011 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93680835f0 con 0x7f93700ca9a0 2023-12-19T18:58:49.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.788+0000 7f9374ba5640 1 --2- 172.21.15.133:0/245121011 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f935c066540 0x7f935c068a00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f936001c4b0 tx=0x7f9360008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.788+0000 7f936d7fa640 1 -- 172.21.15.133:0/245121011 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f93700c02d0 con 0x7f93700ca9a0 2023-12-19T18:58:49.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.804+0000 7fc74909a640 1 Processor -- start 2023-12-19T18:58:49.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.804+0000 7fc74909a640 1 -- start start 2023-12-19T18:58:49.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.804+0000 7fc74909a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc744151e90 0x7fc7440c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.804+0000 7fc74909a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc74406c860 con 0x7fc7440c7ea0 2023-12-19T18:58:49.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.804+0000 7fc74909a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc744154930 con 0x7fc7440c4e60 2023-12-19T18:58:49.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.804+0000 7fc74909a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7440c8750 con 0x7fc744151e90 2023-12-19T18:58:49.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.808+0000 7fc74359e640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fc7440c4e60 0x7fc74415f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:58860/0 (socket says 172.21.15.133:58860) 2023-12-19T18:58:49.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.808+0000 7fc74359e640 1 -- 172.21.15.133:0/4228615722 learned_addr learned my addr 172.21.15.133:0/4228615722 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:49.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.808+0000 7fc742d9d640 1 --2- 172.21.15.133:0/4228615722 >> v2:172.21.15.133:3300/0 conn(0x7fc744151e90 0x7fc7440c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.808+0000 7fc741d9b640 1 -- 172.21.15.133:0/4228615722 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 825392466 0 0) 0x7fc744154930 con 0x7fc7440c4e60 2023-12-19T18:58:49.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.808+0000 7fc741d9b640 1 -- 172.21.15.133:0/4228615722 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc72c003530 con 0x7fc7440c4e60 2023-12-19T18:58:49.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.808+0000 7fc741d9b640 1 -- 172.21.15.133:0/4228615722 <== mon.1 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3885354973 0 0) 0x7fc72c003530 con 0x7fc7440c4e60 2023-12-19T18:58:49.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.808+0000 7fc741d9b640 1 -- 172.21.15.133:0/4228615722 >> v2:172.21.15.133:3300/0 conn(0x7fc744151e90 msgr2=0x7fc7440c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.808+0000 7fc741d9b640 1 --2- 172.21.15.133:0/4228615722 >> v2:172.21.15.133:3300/0 conn(0x7fc744151e90 0x7fc7440c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.808+0000 7fc741d9b640 1 -- 172.21.15.133:0/4228615722 >> v1:172.21.15.133:6789/0 conn(0x7fc7440c7ea0 legacy=0x7fc74406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.808+0000 7fc741d9b640 1 -- 172.21.15.133:0/4228615722 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc744154c10 con 0x7fc7440c4e60 2023-12-19T18:58:49.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.808+0000 7fc741d9b640 1 -- 172.21.15.133:0/4228615722 <== mon.1 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7fc73c001a00 con 0x7fc7440c4e60 2023-12-19T18:58:49.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.808+0000 7fc741d9b640 1 -- 172.21.15.133:0/4228615722 >> v1:172.21.15.138:6789/0 conn(0x7fc7440c4e60 legacy=0x7fc74415f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.808+0000 7fc741d9b640 1 --2- 172.21.15.133:0/4228615722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc72c003980 0x7fc72c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.808+0000 7fc741d9b640 1 --2- 172.21.15.133:0/4228615722 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc72c0047d0 0x7fc72c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.808+0000 7fc741d9b640 1 --2- 172.21.15.133:0/4228615722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc72c0052b0 0x7fc72c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.808+0000 7fc741d9b640 1 -- 172.21.15.133:0/4228615722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7440c8750 con 0x7fc72c0052b0 2023-12-19T18:58:49.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.808+0000 7fc741d9b640 1 -- 172.21.15.133:0/4228615722 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c00c180 con 0x7fc72c003980 2023-12-19T18:58:49.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.808+0000 7fc741d9b640 1 -- 172.21.15.133:0/4228615722 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72c00c340 con 0x7fc72c0047d0 2023-12-19T18:58:49.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.808+0000 7fc742d9d640 1 --2- 172.21.15.133:0/4228615722 >> v2:172.21.15.133:3300/0 conn(0x7fc744151e90 0x7fc7440c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:58:49.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.808+0000 7fc74359e640 1 --2- 172.21.15.133:0/4228615722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc72c0052b0 0x7fc72c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.808+0000 7fc74259c640 1 --2- 172.21.15.133:0/4228615722 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc72c0047d0 0x7fc72c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.812+0000 7fc742d9d640 1 --2- 172.21.15.133:0/4228615722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc72c003980 0x7fc72c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.812+0000 7fc74359e640 1 -- 172.21.15.133:0/4228615722 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc72c0047d0 msgr2=0x7fc72c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.812+0000 7fc74359e640 1 --2- 172.21.15.133:0/4228615722 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc72c0047d0 0x7fc72c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.812+0000 7fc74359e640 1 -- 172.21.15.133:0/4228615722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc72c003980 msgr2=0x7fc72c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.812+0000 7fc74359e640 1 --2- 172.21.15.133:0/4228615722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc72c003980 0x7fc72c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.812+0000 7fc74359e640 1 -- 172.21.15.133:0/4228615722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc744154c10 con 0x7fc72c0052b0 2023-12-19T18:58:49.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.812+0000 7fc742d9d640 1 --2- 172.21.15.133:0/4228615722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc72c003980 0x7fc72c003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:58:49.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.812+0000 7fbd2f31d640 1 Processor -- start 2023-12-19T18:58:49.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.812+0000 7fbd2f31d640 1 -- start start 2023-12-19T18:58:49.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.816+0000 7fbd2f31d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbd281513c0 0x7fbd2806d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.816+0000 7fbd2f31d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbd280c22c0 0x7fbd2815b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.816+0000 7fbd2f31d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2806e490 con 0x7fbd280c06d0 2023-12-19T18:58:49.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.816+0000 7fbd2f31d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd280c1290 con 0x7fbd281513c0 2023-12-19T18:58:49.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.816+0000 7fbd2f31d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd2806e770 con 0x7fbd280c22c0 2023-12-19T18:58:49.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.816+0000 7fbd2c8b8640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fbd280c06d0 0x7fbd280a4e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:58866/0 (socket says 172.21.15.133:58866) 2023-12-19T18:58:49.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.816+0000 7fbd2c8b8640 1 -- 172.21.15.133:0/3137468133 learned_addr learned my addr 172.21.15.133:0/3137468133 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:49.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.816+0000 7fbd2d8ba640 1 --2- 172.21.15.133:0/3137468133 >> v2:172.21.15.138:3300/0 conn(0x7fbd280c22c0 0x7fbd2815b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.816+0000 7fc74359e640 1 -- 172.21.15.133:0/4228615722 reap_dead start 2023-12-19T18:58:49.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.816+0000 7fc74359e640 1 --2- 172.21.15.133:0/4228615722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc72c0052b0 0x7fc72c00b990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc73c0013e0 tx=0x7fc73c01d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89076119e2d4b79e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.816+0000 7fbd2d0b9640 1 --2- 172.21.15.133:0/3137468133 >> v2:172.21.15.133:3300/0 conn(0x7fbd281513c0 0x7fbd2806d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.816+0000 7fbd1ffff640 1 -- 172.21.15.133:0/3137468133 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2102331223 0 0) 0x7fbd2806e490 con 0x7fbd280c06d0 2023-12-19T18:58:49.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.816+0000 7fbd1ffff640 1 -- 172.21.15.133:0/3137468133 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd14003530 con 0x7fbd280c06d0 2023-12-19T18:58:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.816+0000 7fc741d9b640 1 -- 172.21.15.133:0/4228615722 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c0ad630 con 0x7fc72c0052b0 2023-12-19T18:58:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.816+0000 7fbd2d8ba640 1 -- 172.21.15.133:0/3137468133 >> v2:172.21.15.133:3300/0 conn(0x7fbd281513c0 msgr2=0x7fbd2806d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.816+0000 7fbd2d8ba640 1 --2- 172.21.15.133:0/3137468133 >> v2:172.21.15.133:3300/0 conn(0x7fbd281513c0 0x7fbd2806d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.816+0000 7fbd2d8ba640 1 -- 172.21.15.133:0/3137468133 >> v1:172.21.15.138:6789/0 conn(0x7fbd280c06d0 legacy=0x7fbd280a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.816+0000 7fbd2d8ba640 1 -- 172.21.15.133:0/3137468133 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2806cf70 con 0x7fbd280c22c0 2023-12-19T18:58:49.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.816+0000 7fc741d9b640 1 -- 172.21.15.133:0/4228615722 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73c0a8070 con 0x7fc72c0052b0 2023-12-19T18:58:49.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.816+0000 7fc741d9b640 1 -- 172.21.15.133:0/4228615722 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73c0ad9d0 con 0x7fc72c0052b0 2023-12-19T18:58:49.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.820+0000 7f16e649a640 1 Processor -- start 2023-12-19T18:58:49.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.820+0000 7f16e649a640 1 -- start start 2023-12-19T18:58:49.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.820+0000 7fc74909a640 1 -- 172.21.15.133:0/4228615722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc72c0052b0 msgr2=0x7fc72c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.820+0000 7fc74909a640 1 --2- 172.21.15.133:0/4228615722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc72c0052b0 0x7fc72c00b990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc73c0013e0 tx=0x7fc73c01d300 comp rx=0 tx=0).stop 2023-12-19T18:58:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.820+0000 7fc74909a640 1 -- 172.21.15.133:0/4228615722 shutdown_connections 2023-12-19T18:58:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.820+0000 7fc74909a640 1 --2- 172.21.15.133:0/4228615722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc72c0052b0 0x7fc72c00b990 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.820+0000 7fc74909a640 1 -- 172.21.15.133:0/4228615722 >> 172.21.15.133:0/4228615722 conn(0x7fc7440ca170 msgr2=0x7fc7440ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.820+0000 7f16e649a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16e00bf360 0x7f16e00a4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.820+0000 7f16e649a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f16e00c33a0 0x7f16e00a5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.820+0000 7f16e649a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e006e670 con 0x7f16e00c45e0 2023-12-19T18:58:49.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.820+0000 7f16e649a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e00c58b0 con 0x7f16e00c33a0 2023-12-19T18:58:49.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.820+0000 7f16e649a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e00bfbb0 con 0x7f16e00bf360 2023-12-19T18:58:49.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.820+0000 7f16df7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f16e00c45e0 0x7f16e0155e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42586/0 (socket says 172.21.15.133:42586) 2023-12-19T18:58:49.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.820+0000 7f16df7fe640 1 -- 172.21.15.133:0/1973695602 learned_addr learned my addr 172.21.15.133:0/1973695602 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:49.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.820+0000 7fc74909a640 1 -- 172.21.15.133:0/4228615722 shutdown_connections 2023-12-19T18:58:49.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.820+0000 7fc74909a640 1 -- 172.21.15.133:0/4228615722 wait complete. 2023-12-19T18:58:49.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.820+0000 7f16deffd640 1 -- 172.21.15.133:0/1973695602 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475956457 0 0) 0x7f16e006e670 con 0x7f16e00c45e0 2023-12-19T18:58:49.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.820+0000 7f16deffd640 1 -- 172.21.15.133:0/1973695602 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16c8003530 con 0x7f16e00c45e0 2023-12-19T18:58:49.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.820+0000 7f16deffd640 1 -- 172.21.15.133:0/1973695602 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1321329628 0 0) 0x7f16c8003530 con 0x7f16e00c45e0 2023-12-19T18:58:49.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.824+0000 7f16deffd640 1 -- 172.21.15.133:0/1973695602 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16e00bf360 msgr2=0x7f16e00a4ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-19T18:58:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.824+0000 7f16deffd640 1 --2- 172.21.15.133:0/1973695602 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16e00bf360 0x7f16e00a4ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.824+0000 7f16deffd640 1 -- 172.21.15.133:0/1973695602 >> v2:172.21.15.138:3300/0 conn(0x7f16e00c33a0 msgr2=0x7f16e00a5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.824+0000 7f16e4a37640 1 --2- 172.21.15.133:0/1973695602 >> v2:172.21.15.138:3300/0 conn(0x7f16e00c33a0 0x7f16e00a5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.824+0000 7f16deffd640 1 --2- 172.21.15.133:0/1973695602 >> v2:172.21.15.138:3300/0 conn(0x7f16e00c33a0 0x7f16e00a5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.824+0000 7f16deffd640 1 -- 172.21.15.133:0/1973695602 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e00bfe50 con 0x7f16e00c45e0 2023-12-19T18:58:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.824+0000 7f16deffd640 1 -- 172.21.15.133:0/1973695602 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f16d0001680 con 0x7f16e00c45e0 2023-12-19T18:58:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.824+0000 7f16deffd640 1 -- 172.21.15.133:0/1973695602 >> v1:172.21.15.133:6789/0 conn(0x7f16e00c45e0 legacy=0x7f16e0155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.824+0000 7f16deffd640 1 --2- 172.21.15.133:0/1973695602 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16c8003980 0x7f16c8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.824+0000 7f16deffd640 1 --2- 172.21.15.133:0/1973695602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16c80047d0 0x7f16c8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.824+0000 7f16deffd640 1 --2- 172.21.15.133:0/1973695602 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16e00bf360 0x7f16c800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.824+0000 7f16deffd640 1 -- 172.21.15.133:0/1973695602 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e00bfbb0 con 0x7f16c80047d0 2023-12-19T18:58:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.824+0000 7f16deffd640 1 -- 172.21.15.133:0/1973695602 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80055f0 con 0x7f16c8003980 2023-12-19T18:58:49.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.824+0000 7f16deffd640 1 -- 172.21.15.133:0/1973695602 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c800bed0 con 0x7f16e00bf360 2023-12-19T18:58:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.824+0000 7f16dffff640 1 --2- 172.21.15.133:0/1973695602 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16c8003980 0x7f16c8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.824+0000 7f16e4a37640 1 --2- 172.21.15.133:0/1973695602 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16e00bf360 0x7f16c800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.824+0000 7f16dffff640 1 -- 172.21.15.133:0/1973695602 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16e00bf360 msgr2=0x7f16c800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.824+0000 7f16dffff640 1 --2- 172.21.15.133:0/1973695602 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16e00bf360 0x7f16c800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.824+0000 7fc74909a640 1 Processor -- start 2023-12-19T18:58:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.824+0000 7fc74909a640 1 -- start start 2023-12-19T18:58:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.824+0000 7f16dffff640 1 -- 172.21.15.133:0/1973695602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16c80047d0 msgr2=0x7f16c8004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T18:58:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.824+0000 7f16dffff640 1 --2- 172.21.15.133:0/1973695602 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16c80047d0 0x7f16c8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.824+0000 7f16dffff640 1 -- 172.21.15.133:0/1973695602 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c8003530 con 0x7f16c8003980 2023-12-19T18:58:49.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fbd2d8ba640 1 --2- 172.21.15.133:0/3137468133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd280c22c0 0x7fbd2815b230 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbd28074080 tx=0x7fbd2001e8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d4ccca4e4ec4876 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7f16dffff640 1 --2- 172.21.15.133:0/1973695602 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16c8003980 0x7f16c8003da0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f16d40097e0 tx=0x7f16d401c270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=481fb33411deb99c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fc74909a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc72c0052b0 0x7fc74414bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fc74909a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7441f0b50 0x7fc74414e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fc74909a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7441f0f90 0x7fc74414e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fc74909a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7441552d0 con 0x7fc7441f0f90 2023-12-19T18:58:49.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fc74909a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74414de00 con 0x7fc72c0052b0 2023-12-19T18:58:49.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fc74909a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7441f1510 con 0x7fc7441f0b50 2023-12-19T18:58:49.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fc742d9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc72c0052b0 0x7fc74414bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fc742d9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc72c0052b0 0x7fc74414bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:48214/0 (socket says 172.21.15.133:48214) 2023-12-19T18:58:49.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fc742d9d640 1 -- 172.21.15.133:0/82402742 learned_addr learned my addr 172.21.15.133:0/82402742 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:49.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fc74259c640 1 --2- 172.21.15.133:0/82402742 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7441f0b50 0x7fc74414e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fc74359e640 1 --2- 172.21.15.133:0/82402742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7441f0f90 0x7fc74414e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fc742d9d640 1 -- 172.21.15.133:0/82402742 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7441f0b50 msgr2=0x7fc74414e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fc742d9d640 1 --2- 172.21.15.133:0/82402742 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7441f0b50 0x7fc74414e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fc742d9d640 1 -- 172.21.15.133:0/82402742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7441f0f90 msgr2=0x7fc74414e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fc742d9d640 1 --2- 172.21.15.133:0/82402742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7441f0f90 0x7fc74414e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fc742d9d640 1 -- 172.21.15.133:0/82402742 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc74414d4d0 con 0x7fc72c0052b0 2023-12-19T18:58:49.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fc742d9d640 1 --2- 172.21.15.133:0/82402742 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc72c0052b0 0x7fc74414bec0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc734011d00 tx=0x7fc73400f610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7f16deffd640 1 -- 172.21.15.133:0/1973695602 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d40ab600 con 0x7f16c8003980 2023-12-19T18:58:49.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7f16deffd640 1 -- 172.21.15.133:0/1973695602 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d40a7050 con 0x7f16c8003980 2023-12-19T18:58:49.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fbd1ffff640 1 -- 172.21.15.133:0/3137468133 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd200a7970 con 0x7fbd280c22c0 2023-12-19T18:58:49.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fbd1ffff640 1 -- 172.21.15.133:0/3137468133 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd200ab070 con 0x7fbd280c22c0 2023-12-19T18:58:49.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fbd1ffff640 1 -- 172.21.15.133:0/3137468133 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd200a7cf0 con 0x7fbd280c22c0 2023-12-19T18:58:49.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fc72b7fe640 1 -- 172.21.15.133:0/82402742 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc73400fed0 con 0x7fc72c0052b0 2023-12-19T18:58:49.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fc72b7fe640 1 -- 172.21.15.133:0/82402742 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc734014440 con 0x7fc72c0052b0 2023-12-19T18:58:49.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fc72b7fe640 1 -- 172.21.15.133:0/82402742 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7340147b0 con 0x7fc72c0052b0 2023-12-19T18:58:49.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fc74909a640 1 -- 172.21.15.133:0/82402742 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74414d7b0 con 0x7fc72c0052b0 2023-12-19T18:58:49.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7fc74909a640 1 -- 172.21.15.133:0/82402742 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc74414b250 con 0x7fc72c0052b0 2023-12-19T18:58:49.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7f16e649a640 1 -- 172.21.15.133:0/1973695602 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16c8003980 msgr2=0x7f16c8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.828+0000 7f16deffd640 1 -- 172.21.15.133:0/1973695602 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d40ab600 con 0x7f16c8003980 2023-12-19T18:58:49.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.832+0000 7f16e649a640 1 --2- 172.21.15.133:0/1973695602 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16c8003980 0x7f16c8003da0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f16d40097e0 tx=0x7f16d401c270 comp rx=0 tx=0).stop 2023-12-19T18:58:49.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.832+0000 7f16e4a37640 1 -- 172.21.15.133:0/1973695602 reap_dead start 2023-12-19T18:58:49.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.832+0000 7f16e649a640 1 -- 172.21.15.133:0/1973695602 shutdown_connections 2023-12-19T18:58:49.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.832+0000 7f16e649a640 1 -- 172.21.15.133:0/1973695602 >> 172.21.15.133:0/1973695602 conn(0x7f16e00c5cd0 msgr2=0x7f16e00c60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.832+0000 7f16e649a640 1 -- 172.21.15.133:0/1973695602 shutdown_connections 2023-12-19T18:58:49.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.832+0000 7fc72b7fe640 1 -- 172.21.15.133:0/82402742 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc734014910 con 0x7fc72c0052b0 2023-12-19T18:58:49.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.832+0000 7f16e649a640 1 -- 172.21.15.133:0/1973695602 wait complete. 2023-12-19T18:58:49.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.832+0000 7f16e649a640 1 Processor -- start 2023-12-19T18:58:49.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7f16e649a640 1 -- start start 2023-12-19T18:58:49.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7fc72b7fe640 1 --2- 172.21.15.133:0/82402742 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc730066570 0x7fc730068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7fc74909a640 1 -- 172.21.15.133:0/82402742 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7440c8330 con 0x7fc72c0052b0 2023-12-19T18:58:49.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7fc72b7fe640 1 -- 172.21.15.133:0/82402742 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc734084ac0 con 0x7fc72c0052b0 2023-12-19T18:58:49.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7fc74259c640 1 --2- 172.21.15.133:0/82402742 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc730066570 0x7fc730068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7fbd2f31d640 1 -- 172.21.15.133:0/3137468133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd280c22c0 msgr2=0x7fbd2815b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7fbd2f31d640 1 --2- 172.21.15.133:0/3137468133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd280c22c0 0x7fbd2815b230 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbd28074080 tx=0x7fbd2001e8c0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7fc74259c640 1 --2- 172.21.15.133:0/82402742 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc730066570 0x7fc730068a30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc738000fe0 tx=0x7fc738009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7fbd2f31d640 1 -- 172.21.15.133:0/3137468133 shutdown_connections 2023-12-19T18:58:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7fbd2f31d640 1 --2- 172.21.15.133:0/3137468133 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd280c22c0 0x7fbd2815b230 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7fbd2f31d640 1 --2- 172.21.15.133:0/3137468133 >> v2:172.21.15.133:3300/0 conn(0x7fbd281513c0 0x7fbd2806d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7fbd2f31d640 1 -- 172.21.15.133:0/3137468133 >> 172.21.15.133:0/3137468133 conn(0x7fbd280c5cd0 msgr2=0x7fbd280c60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:49.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7fbd2f31d640 1 -- 172.21.15.133:0/3137468133 shutdown_connections 2023-12-19T18:58:49.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7f16e649a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16e00711f0 0x7f16e01f09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7fbd2f31d640 1 -- 172.21.15.133:0/3137468133 wait complete. 2023-12-19T18:58:49.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7f16dffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16e00711f0 0x7f16e01f09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7f16e649a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16e015d4e0 0x7f16e01f0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7f16e649a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16e015b0e0 0x7f16e0150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7f16e649a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e015e310 con 0x7f16e00711f0 2023-12-19T18:58:49.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7f16e649a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e00a6020 con 0x7f16e015d4e0 2023-12-19T18:58:49.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7f16e649a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e015e030 con 0x7f16e015b0e0 2023-12-19T18:58:49.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7f16df7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16e015d4e0 0x7f16e01f0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7f16df7fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16e015d4e0 0x7f16e01f0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:48216/0 (socket says 172.21.15.133:48216) 2023-12-19T18:58:49.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7f16df7fe640 1 -- 172.21.15.133:0/4289199375 learned_addr learned my addr 172.21.15.133:0/4289199375 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:49.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.836+0000 7f16e4a37640 1 --2- 172.21.15.133:0/4289199375 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16e015b0e0 0x7f16e0150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.840+0000 7f16df7fe640 1 -- 172.21.15.133:0/4289199375 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16e015b0e0 msgr2=0x7f16e0150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.840+0000 7f16df7fe640 1 --2- 172.21.15.133:0/4289199375 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16e015b0e0 0x7f16e0150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.840+0000 7f16df7fe640 1 -- 172.21.15.133:0/4289199375 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16e00711f0 msgr2=0x7f16e01f09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.840+0000 7f16df7fe640 1 --2- 172.21.15.133:0/4289199375 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16e00711f0 0x7f16e01f09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.840+0000 7f16df7fe640 1 -- 172.21.15.133:0/4289199375 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e00a59d0 con 0x7f16e015d4e0 2023-12-19T18:58:49.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.840+0000 7f16df7fe640 1 --2- 172.21.15.133:0/4289199375 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16e015d4e0 0x7f16e01f0ee0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f16d000c730 tx=0x7f16d000cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.840+0000 7fbd2f31d640 1 Processor -- start 2023-12-19T18:58:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.840+0000 7fbd2f31d640 1 -- start start 2023-12-19T18:58:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.840+0000 7f16dcff9640 1 -- 172.21.15.133:0/4289199375 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d0004ab0 con 0x7f16e015d4e0 2023-12-19T18:58:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.840+0000 7f16dcff9640 1 -- 172.21.15.133:0/4289199375 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d0004c30 con 0x7f16e015d4e0 2023-12-19T18:58:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.840+0000 7f16dcff9640 1 -- 172.21.15.133:0/4289199375 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d00070d0 con 0x7f16e015d4e0 2023-12-19T18:58:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.840+0000 7fc72b7fe640 1 -- 172.21.15.133:0/82402742 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc734051fb0 con 0x7fc72c0052b0 2023-12-19T18:58:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.840+0000 7f16e649a640 1 -- 172.21.15.133:0/4289199375 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e00a5cb0 con 0x7f16e015d4e0 2023-12-19T18:58:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.840+0000 7f16e649a640 1 -- 172.21.15.133:0/4289199375 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e00715d0 con 0x7f16e015d4e0 2023-12-19T18:58:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.840+0000 7f16e649a640 1 -- 172.21.15.133:0/4289199375 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c0005260 con 0x7f16e015d4e0 2023-12-19T18:58:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.840+0000 7fbd2f31d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd280c22c0 0x7fbd28151d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.844+0000 7fbd2f31d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd281513c0 0x7fbd280a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.844+0000 7fbd2f31d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd28143930 0x7fbd280a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.844+0000 7fbd2d8ba640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd28143930 0x7fbd280a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.844+0000 7fbd2f31d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2814d200 con 0x7fbd28143930 2023-12-19T18:58:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.844+0000 7fbd2d8ba640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd28143930 0x7fbd280a93c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54632/0 (socket says 172.21.15.133:54632) 2023-12-19T18:58:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.844+0000 7fbd2d8ba640 1 -- 172.21.15.133:0/382326243 learned_addr learned my addr 172.21.15.133:0/382326243 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.844+0000 7fbd2d0b9640 1 --2- 172.21.15.133:0/382326243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd280c22c0 0x7fbd28151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.844+0000 7fbd2f31d640 1 -- 172.21.15.133:0/382326243 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd280ab290 con 0x7fbd280c22c0 2023-12-19T18:58:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.844+0000 7fbd2f31d640 1 -- 172.21.15.133:0/382326243 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2814c8d0 con 0x7fbd281513c0 2023-12-19T18:58:49.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.844+0000 7fbd2c8b8640 1 --2- 172.21.15.133:0/382326243 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd281513c0 0x7fbd280a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.844+0000 7fbd2d8ba640 1 -- 172.21.15.133:0/382326243 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd281513c0 msgr2=0x7fbd280a8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.844+0000 7fbd2d8ba640 1 --2- 172.21.15.133:0/382326243 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd281513c0 0x7fbd280a8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.844+0000 7fbd2d8ba640 1 -- 172.21.15.133:0/382326243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd280c22c0 msgr2=0x7fbd28151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:49.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.844+0000 7fbd2d8ba640 1 --2- 172.21.15.133:0/382326243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd280c22c0 0x7fbd28151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:49.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.848+0000 7fbd2d8ba640 1 -- 172.21.15.133:0/382326243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2000bb70 con 0x7fbd28143930 2023-12-19T18:58:49.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.848+0000 7fbd2d0b9640 1 --2- 172.21.15.133:0/382326243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd280c22c0 0x7fbd28151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:49.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.848+0000 7fbd2d8ba640 1 --2- 172.21.15.133:0/382326243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd28143930 0x7fbd280a93c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbd200b3040 tx=0x7fbd2001b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.848+0000 7f16dcff9640 1 -- 172.21.15.133:0/4289199375 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f16d0007440 con 0x7f16e015d4e0 2023-12-19T18:58:49.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.848+0000 7f16dcff9640 1 --2- 172.21.15.133:0/4289199375 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f16cc066570 0x7f16cc068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.848+0000 7f16dcff9640 1 -- 172.21.15.133:0/4289199375 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16d00837f0 con 0x7f16e015d4e0 2023-12-19T18:58:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.848+0000 7fbd1dffb640 1 -- 172.21.15.133:0/382326243 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd200bf070 con 0x7fbd28143930 2023-12-19T18:58:49.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.848+0000 7f16dffff640 1 --2- 172.21.15.133:0/4289199375 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f16cc066570 0x7f16cc068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.848+0000 7fbd1dffb640 1 -- 172.21.15.133:0/382326243 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd200b1610 con 0x7fbd28143930 2023-12-19T18:58:49.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.848+0000 7fbd2f31d640 1 -- 172.21.15.133:0/382326243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd2814cbb0 con 0x7fbd28143930 2023-12-19T18:58:49.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.848+0000 7fbd2f31d640 1 -- 172.21.15.133:0/382326243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2814d690 con 0x7fbd28143930 2023-12-19T18:58:49.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.848+0000 7fbd1dffb640 1 -- 172.21.15.133:0/382326243 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd200b19a0 con 0x7fbd28143930 2023-12-19T18:58:49.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.848+0000 7f16dcff9640 1 -- 172.21.15.133:0/4289199375 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f16d0050d90 con 0x7f16e015d4e0 2023-12-19T18:58:49.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.852+0000 7f16dffff640 1 --2- 172.21.15.133:0/4289199375 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f16cc066570 0x7f16cc068a30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f16d40ad000 tx=0x7f16d4004780 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.852+0000 7fbd2f31d640 1 -- 172.21.15.133:0/382326243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd08005260 con 0x7fbd28143930 2023-12-19T18:58:49.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.856+0000 7fbd1dffb640 1 -- 172.21.15.133:0/382326243 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fbd200b1b00 con 0x7fbd28143930 2023-12-19T18:58:49.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.856+0000 7fbd1dffb640 1 --2- 172.21.15.133:0/382326243 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fbd0c066470 0x7fbd0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:49.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.856+0000 7fbd1dffb640 1 -- 172.21.15.133:0/382326243 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd2011f4c0 con 0x7fbd28143930 2023-12-19T18:58:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.864+0000 7fbd2d0b9640 1 --2- 172.21.15.133:0/382326243 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fbd0c066470 0x7fbd0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:49.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.864+0000 7fbd2d0b9640 1 --2- 172.21.15.133:0/382326243 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fbd0c066470 0x7fbd0c068930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbd280a4c40 tx=0x7fbd18008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:49.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:49.864+0000 7fbd1dffb640 1 -- 172.21.15.133:0/382326243 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fbd200eca60 con 0x7fbd28143930 2023-12-19T18:58:50.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.056+0000 7fed51b1d640 1 -- 172.21.15.133:0/4077536802 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fed4c0c0f00 con 0x7fed4c06bd80 2023-12-19T18:58:50.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.060+0000 7fed33fff640 1 -- 172.21.15.133:0/4077536802 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fed3c015090 con 0x7fed4c06bd80 2023-12-19T18:58:50.062 INFO:teuthology.orchestra.run.smithi133.stdout:55834574855 2023-12-19T18:58:50.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.060+0000 7fed51b1d640 1 -- 172.21.15.133:0/4077536802 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fed38066540 msgr2=0x7fed38068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:50.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.060+0000 7fed51b1d640 1 --2- 172.21.15.133:0/4077536802 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fed38066540 0x7fed38068a00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fed440af000 tx=0x7fed440a7070 comp rx=0 tx=0).stop 2023-12-19T18:58:50.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.060+0000 7fed51b1d640 1 -- 172.21.15.133:0/4077536802 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed4c06bd80 msgr2=0x7fed4c14fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:50.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.060+0000 7fed51b1d640 1 --2- 172.21.15.133:0/4077536802 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed4c06bd80 0x7fed4c14fc00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fed3c00b410 tx=0x7fed3c00b8d0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.060+0000 7fed51b1d640 1 -- 172.21.15.133:0/4077536802 shutdown_connections 2023-12-19T18:58:50.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.064+0000 7fed51b1d640 1 --2- 172.21.15.133:0/4077536802 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fed38066540 0x7fed38068a00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.064+0000 7fed51b1d640 1 --2- 172.21.15.133:0/4077536802 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fed4c0a8430 0x7fed4c151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.064+0000 7fed51b1d640 1 --2- 172.21.15.133:0/4077536802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fed4c072080 0x7fed4c0aa780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.064+0000 7fed51b1d640 1 --2- 172.21.15.133:0/4077536802 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fed4c06bd80 0x7fed4c14fc00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.064+0000 7fed51b1d640 1 -- 172.21.15.133:0/4077536802 >> 172.21.15.133:0/4077536802 conn(0x7fed4c0a7910 msgr2=0x7fed4c0c4300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:50.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.064+0000 7fed51b1d640 1 -- 172.21.15.133:0/4077536802 shutdown_connections 2023-12-19T18:58:50.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.064+0000 7fed51b1d640 1 -- 172.21.15.133:0/4077536802 wait complete. 2023-12-19T18:58:50.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.076+0000 7fca80a68640 1 -- 172.21.15.133:0/540805187 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fca7c068400 con 0x7fca7c147f90 2023-12-19T18:58:50.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.076+0000 7fca6affd640 1 -- 172.21.15.133:0/540805187 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fca6c054550 con 0x7fca7c147f90 2023-12-19T18:58:50.085 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2023-12-19T18:58:50.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.080+0000 7fca80a68640 1 -- 172.21.15.133:0/540805187 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fca5c0664c0 msgr2=0x7fca5c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:50.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.080+0000 7fca80a68640 1 --2- 172.21.15.133:0/540805187 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fca5c0664c0 0x7fca5c068980 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fca74009a40 tx=0x7fca7400b040 comp rx=0 tx=0).stop 2023-12-19T18:58:50.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.080+0000 7fca80a68640 1 -- 172.21.15.133:0/540805187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca7c147f90 msgr2=0x7fca7c1ec400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:50.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.080+0000 7fca80a68640 1 --2- 172.21.15.133:0/540805187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca7c147f90 0x7fca7c1ec400 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00c410 tx=0x7fca6c00c8d0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.080+0000 7fca80a68640 1 -- 172.21.15.133:0/540805187 shutdown_connections 2023-12-19T18:58:50.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.080+0000 7fca80a68640 1 --2- 172.21.15.133:0/540805187 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fca5c0664c0 0x7fca5c068980 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.080+0000 7fca80a68640 1 --2- 172.21.15.133:0/540805187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fca7c147f90 0x7fca7c1ec400 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.080+0000 7fca80a68640 1 --2- 172.21.15.133:0/540805187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca7c0c67f0 0x7fca7c14cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.080+0000 7fca80a68640 1 --2- 172.21.15.133:0/540805187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fca7c0c22c0 0x7fca7c147a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.080+0000 7fca80a68640 1 -- 172.21.15.133:0/540805187 >> 172.21.15.133:0/540805187 conn(0x7fca7c0c5cd0 msgr2=0x7fca7c071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:50.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.088+0000 7fca80a68640 1 -- 172.21.15.133:0/540805187 shutdown_connections 2023-12-19T18:58:50.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.088+0000 7fca80a68640 1 -- 172.21.15.133:0/540805187 wait complete. 2023-12-19T18:58:50.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2023-12-19T18:58:50.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.104+0000 7f9375ba7640 1 -- 172.21.15.133:0/245121011 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f93700c02d0 con 0x7f93700ca9a0 2023-12-19T18:58:50.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.104+0000 7f936d7fa640 1 -- 172.21.15.133:0/245121011 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f93700c02d0 con 0x7f93700ca9a0 2023-12-19T18:58:50.109 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2023-12-19T18:58:50.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.104+0000 7f211d91d640 1 -- 172.21.15.133:0/3925756002 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2118068400 con 0x7f21180c4e60 2023-12-19T18:58:50.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.104+0000 7f20fffff640 1 -- 172.21.15.133:0/3925756002 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2108017020 con 0x7f21180c4e60 2023-12-19T18:58:50.111 INFO:teuthology.orchestra.run.smithi133.stdout:55834574855 2023-12-19T18:58:50.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.108+0000 7f9375ba7640 1 -- 172.21.15.133:0/245121011 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f935c066540 msgr2=0x7f935c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:50.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.108+0000 7f9375ba7640 1 --2- 172.21.15.133:0/245121011 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f935c066540 0x7f935c068a00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f936001c4b0 tx=0x7f9360008040 comp rx=0 tx=0).stop 2023-12-19T18:58:50.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.108+0000 7f9375ba7640 1 -- 172.21.15.133:0/245121011 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93700ca9a0 msgr2=0x7f93700c24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:50.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.108+0000 7f9375ba7640 1 --2- 172.21.15.133:0/245121011 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93700ca9a0 0x7f93700c24f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f936800c780 tx=0x7f936800cc40 comp rx=0 tx=0).stop 2023-12-19T18:58:50.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.108+0000 7f9375ba7640 1 -- 172.21.15.133:0/245121011 shutdown_connections 2023-12-19T18:58:50.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.108+0000 7f9375ba7640 1 --2- 172.21.15.133:0/245121011 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f935c066540 0x7f935c068a00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.108+0000 7f9375ba7640 1 --2- 172.21.15.133:0/245121011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9370156060 0x7f93700c2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.108+0000 7f9375ba7640 1 --2- 172.21.15.133:0/245121011 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f93700ca9a0 0x7f93700c24f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.108+0000 7f9375ba7640 1 --2- 172.21.15.133:0/245121011 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f93700c82e0 0x7f93700af4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.108+0000 7f9375ba7640 1 -- 172.21.15.133:0/245121011 >> 172.21.15.133:0/245121011 conn(0x7f93700abee0 msgr2=0x7f937015b230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:50.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.108+0000 7f9375ba7640 1 -- 172.21.15.133:0/245121011 shutdown_connections 2023-12-19T18:58:50.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-12-19T18:58:50.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.108+0000 7f9375ba7640 1 -- 172.21.15.133:0/245121011 wait complete. 2023-12-19T18:58:50.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.108+0000 7f211d91d640 1 -- 172.21.15.133:0/3925756002 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2104066570 msgr2=0x7f2104068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:50.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.108+0000 7f211d91d640 1 --2- 172.21.15.133:0/3925756002 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2104066570 0x7f2104068a30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f210c009870 tx=0x7f210c0a6000 comp rx=0 tx=0).stop 2023-12-19T18:58:50.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.108+0000 7f211d91d640 1 -- 172.21.15.133:0/3925756002 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21180c4e60 msgr2=0x7f2118143890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:50.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.108+0000 7f211d91d640 1 --2- 172.21.15.133:0/3925756002 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21180c4e60 0x7f2118143890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f210800e870 tx=0x7f210800ed30 comp rx=0 tx=0).stop 2023-12-19T18:58:50.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.112+0000 7f211d91d640 1 -- 172.21.15.133:0/3925756002 shutdown_connections 2023-12-19T18:58:50.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.112+0000 7f211d91d640 1 --2- 172.21.15.133:0/3925756002 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2104066570 0x7f2104068a30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.112+0000 7f211d91d640 1 --2- 172.21.15.133:0/3925756002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2118151e90 0x7f211814e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.112+0000 7f211d91d640 1 --2- 172.21.15.133:0/3925756002 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21180c7ea0 0x7f21181f4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.112+0000 7f211d91d640 1 --2- 172.21.15.133:0/3925756002 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21180c4e60 0x7f2118143890 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.112+0000 7f211d91d640 1 -- 172.21.15.133:0/3925756002 >> 172.21.15.133:0/3925756002 conn(0x7f21180ca170 msgr2=0x7f211806b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:50.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.112+0000 7f211d91d640 1 -- 172.21.15.133:0/3925756002 shutdown_connections 2023-12-19T18:58:50.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.112+0000 7f211d91d640 1 -- 172.21.15.133:0/3925756002 wait complete. 2023-12-19T18:58:50.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.112+0000 7f7a2159d640 1 -- 172.21.15.133:0/905289471 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f79fc005510 con 0x7f7a1c0c22c0 2023-12-19T18:58:50.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.116+0000 7f7a037fe640 1 -- 172.21.15.133:0/905289471 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7a10017090 con 0x7f7a1c0c22c0 2023-12-19T18:58:50.123 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2023-12-19T18:58:50.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.120+0000 7f7a2159d640 1 -- 172.21.15.133:0/905289471 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7a08066470 msgr2=0x7f7a08068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:50.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.120+0000 7f7a2159d640 1 --2- 172.21.15.133:0/905289471 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7a08066470 0x7f7a08068930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0b7000 tx=0x7f7a0c0af070 comp rx=0 tx=0).stop 2023-12-19T18:58:50.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.120+0000 7f7a2159d640 1 -- 172.21.15.133:0/905289471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a1c0c22c0 msgr2=0x7f7a1c146ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:50.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.120+0000 7f7a2159d640 1 --2- 172.21.15.133:0/905289471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a1c0c22c0 0x7f7a1c146ad0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7a1000c420 tx=0x7f7a1000c8e0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.124+0000 7f7a2159d640 1 -- 172.21.15.133:0/905289471 shutdown_connections 2023-12-19T18:58:50.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.124+0000 7f7a2159d640 1 --2- 172.21.15.133:0/905289471 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7a08066470 0x7f7a08068930 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.124+0000 7f7a2159d640 1 --2- 172.21.15.133:0/905289471 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7a1c145e10 0x7f7a1c1462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.124+0000 7f7a2159d640 1 --2- 172.21.15.133:0/905289471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7a1c1513c0 0x7f7a1c0a9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.124+0000 7f7a2159d640 1 --2- 172.21.15.133:0/905289471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7a1c0c22c0 0x7f7a1c146ad0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.124+0000 7f7a2159d640 1 -- 172.21.15.133:0/905289471 >> 172.21.15.133:0/905289471 conn(0x7f7a1c0c5cd0 msgr2=0x7f7a1c06d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:50.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.124+0000 7f7a2159d640 1 -- 172.21.15.133:0/905289471 shutdown_connections 2023-12-19T18:58:50.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.124+0000 7f7a2159d640 1 -- 172.21.15.133:0/905289471 wait complete. 2023-12-19T18:58:50.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-12-19T18:58:50.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2023-12-19T18:58:50.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2023-12-19T18:58:50.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.164+0000 7fc74909a640 1 -- 172.21.15.133:0/82402742 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fc744068400 con 0x7fc72c0052b0 2023-12-19T18:58:50.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7fc72b7fe640 1 -- 172.21.15.133:0/82402742 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc7340555d0 con 0x7fc72c0052b0 2023-12-19T18:58:50.171 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2023-12-19T18:58:50.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7f16e649a640 1 -- 172.21.15.133:0/4289199375 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f16c0005510 con 0x7f16e015d4e0 2023-12-19T18:58:50.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7f16dcff9640 1 -- 172.21.15.133:0/4289199375 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f16d00543b0 con 0x7f16e015d4e0 2023-12-19T18:58:50.172 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2023-12-19T18:58:50.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7fc74909a640 1 -- 172.21.15.133:0/82402742 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc730066570 msgr2=0x7fc730068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:50.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7fc74909a640 1 --2- 172.21.15.133:0/82402742 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc730066570 0x7fc730068a30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc738000fe0 tx=0x7fc738009040 comp rx=0 tx=0).stop 2023-12-19T18:58:50.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7fc74909a640 1 -- 172.21.15.133:0/82402742 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc72c0052b0 msgr2=0x7fc74414bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:50.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7fc74909a640 1 --2- 172.21.15.133:0/82402742 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc72c0052b0 0x7fc74414bec0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc734011d00 tx=0x7fc73400f610 comp rx=0 tx=0).stop 2023-12-19T18:58:50.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7fc74909a640 1 -- 172.21.15.133:0/82402742 shutdown_connections 2023-12-19T18:58:50.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7fc74909a640 1 --2- 172.21.15.133:0/82402742 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc730066570 0x7fc730068a30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7fc74909a640 1 --2- 172.21.15.133:0/82402742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7441f0f90 0x7fc74414e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7fc74909a640 1 --2- 172.21.15.133:0/82402742 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7441f0b50 0x7fc74414e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7fc74909a640 1 --2- 172.21.15.133:0/82402742 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc72c0052b0 0x7fc74414bec0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7fc74909a640 1 -- 172.21.15.133:0/82402742 >> 172.21.15.133:0/82402742 conn(0x7fc7440ca170 msgr2=0x7fc744148170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:50.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7fbd2f31d640 1 -- 172.21.15.133:0/382326243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fbd080057e0 con 0x7fbd28143930 2023-12-19T18:58:50.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7fc74909a640 1 -- 172.21.15.133:0/82402742 shutdown_connections 2023-12-19T18:58:50.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7fc74909a640 1 -- 172.21.15.133:0/82402742 wait complete. 2023-12-19T18:58:50.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7fbd1dffb640 1 -- 172.21.15.133:0/382326243 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbd200eca60 con 0x7fbd28143930 2023-12-19T18:58:50.175 INFO:teuthology.orchestra.run.smithi133.stdout:55834574853 2023-12-19T18:58:50.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7f16e649a640 1 -- 172.21.15.133:0/4289199375 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f16cc066570 msgr2=0x7f16cc068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:50.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7f16e649a640 1 --2- 172.21.15.133:0/4289199375 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f16cc066570 0x7f16cc068a30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f16d40ad000 tx=0x7f16d4004780 comp rx=0 tx=0).stop 2023-12-19T18:58:50.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7f16e649a640 1 -- 172.21.15.133:0/4289199375 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16e015d4e0 msgr2=0x7f16e01f0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:50.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7f16e649a640 1 --2- 172.21.15.133:0/4289199375 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16e015d4e0 0x7f16e01f0ee0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f16d000c730 tx=0x7f16d000cbf0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7f16e649a640 1 -- 172.21.15.133:0/4289199375 shutdown_connections 2023-12-19T18:58:50.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7f16e649a640 1 --2- 172.21.15.133:0/4289199375 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f16cc066570 0x7f16cc068a30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7f16e649a640 1 --2- 172.21.15.133:0/4289199375 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16e015b0e0 0x7f16e0150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7f16e649a640 1 --2- 172.21.15.133:0/4289199375 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16e015d4e0 0x7f16e01f0ee0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7f16e649a640 1 --2- 172.21.15.133:0/4289199375 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16e00711f0 0x7f16e01f09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7f16e649a640 1 -- 172.21.15.133:0/4289199375 >> 172.21.15.133:0/4289199375 conn(0x7f16e00c5cd0 msgr2=0x7f16e0153d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:50.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7f16e649a640 1 -- 172.21.15.133:0/4289199375 shutdown_connections 2023-12-19T18:58:50.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.168+0000 7f16e649a640 1 -- 172.21.15.133:0/4289199375 wait complete. 2023-12-19T18:58:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.172+0000 7fbd2f31d640 1 -- 172.21.15.133:0/382326243 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fbd0c066470 msgr2=0x7fbd0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.172+0000 7fbd2f31d640 1 --2- 172.21.15.133:0/382326243 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fbd0c066470 0x7fbd0c068930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbd280a4c40 tx=0x7fbd18008040 comp rx=0 tx=0).stop 2023-12-19T18:58:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.172+0000 7fbd2f31d640 1 -- 172.21.15.133:0/382326243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd28143930 msgr2=0x7fbd280a93c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.172+0000 7fbd2f31d640 1 --2- 172.21.15.133:0/382326243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd28143930 0x7fbd280a93c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbd200b3040 tx=0x7fbd2001b660 comp rx=0 tx=0).stop 2023-12-19T18:58:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.172+0000 7fbd2f31d640 1 -- 172.21.15.133:0/382326243 shutdown_connections 2023-12-19T18:58:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.172+0000 7fbd2f31d640 1 --2- 172.21.15.133:0/382326243 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fbd0c066470 0x7fbd0c068930 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.172+0000 7fbd2f31d640 1 --2- 172.21.15.133:0/382326243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbd28143930 0x7fbd280a93c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.172+0000 7fbd2f31d640 1 --2- 172.21.15.133:0/382326243 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbd281513c0 0x7fbd280a8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.172+0000 7fbd2f31d640 1 --2- 172.21.15.133:0/382326243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbd280c22c0 0x7fbd28151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:50.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.172+0000 7fbd2f31d640 1 -- 172.21.15.133:0/382326243 >> 172.21.15.133:0/382326243 conn(0x7fbd280c5cd0 msgr2=0x7fbd280c60b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:50.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.172+0000 7fbd2f31d640 1 -- 172.21.15.133:0/382326243 shutdown_connections 2023-12-19T18:58:50.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:50.172+0000 7fbd2f31d640 1 -- 172.21.15.133:0/382326243 wait complete. 2023-12-19T18:58:50.199 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-12-19T18:58:50.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-12-19T18:58:50.201 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-12-19T18:58:51.094 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-19T18:58:51.116 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-19T18:58:51.146 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-19T18:58:51.153 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-19T18:58:51.153 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-19T18:58:51.200 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-19T18:58:51.200 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-19T18:58:51.201 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-19T18:58:51.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.252+0000 7f82a9bd0640 1 Processor -- start 2023-12-19T18:58:51.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.252+0000 7f82a9bd0640 1 -- start start 2023-12-19T18:58:51.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.252+0000 7f82a9bd0640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82a40af5c0 0x7f82a40c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a9bd0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f82a40c4750 0x7f82a40c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a9bd0640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a406c660 con 0x7f82a41544c0 2023-12-19T18:58:51.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a9bd0640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a406ba50 con 0x7f82a40c4750 2023-12-19T18:58:51.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a9bd0640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a406bd30 con 0x7f82a40af5c0 2023-12-19T18:58:51.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a93cf640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f82a41544c0 0x7f82a4154950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:58878/0 (socket says 172.21.15.133:58878) 2023-12-19T18:58:51.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a93cf640 1 -- 172.21.15.133:0/3665807706 learned_addr learned my addr 172.21.15.133:0/3665807706 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:51.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a3fff640 1 --2- 172.21.15.133:0/3665807706 >> v2:172.21.15.133:3300/0 conn(0x7f82a40c4750 0x7f82a40c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a8bce640 1 --2- 172.21.15.133:0/3665807706 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82a40af5c0 0x7f82a40c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a37fe640 1 -- 172.21.15.133:0/3665807706 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 642584966 0 0) 0x7f82a406c660 con 0x7f82a41544c0 2023-12-19T18:58:51.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a37fe640 1 -- 172.21.15.133:0/3665807706 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f828c003530 con 0x7f82a41544c0 2023-12-19T18:58:51.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a37fe640 1 -- 172.21.15.133:0/3665807706 <== mon.1 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1472114889 0 0) 0x7f828c003530 con 0x7f82a41544c0 2023-12-19T18:58:51.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a37fe640 1 -- 172.21.15.133:0/3665807706 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82a40af5c0 msgr2=0x7f82a40c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:51.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a37fe640 1 --2- 172.21.15.133:0/3665807706 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82a40af5c0 0x7f82a40c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a37fe640 1 -- 172.21.15.133:0/3665807706 >> v2:172.21.15.133:3300/0 conn(0x7f82a40c4750 msgr2=0x7f82a40c4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:51.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a37fe640 1 --2- 172.21.15.133:0/3665807706 >> v2:172.21.15.133:3300/0 conn(0x7f82a40c4750 0x7f82a40c4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a37fe640 1 -- 172.21.15.133:0/3665807706 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a406c010 con 0x7f82a41544c0 2023-12-19T18:58:51.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a37fe640 1 -- 172.21.15.133:0/3665807706 <== mon.1 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f829c001a00 con 0x7f82a41544c0 2023-12-19T18:58:51.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a8bce640 1 --2- 172.21.15.133:0/3665807706 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82a40af5c0 0x7f82a40c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:58:51.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a37fe640 1 -- 172.21.15.133:0/3665807706 >> v1:172.21.15.138:6789/0 conn(0x7f82a41544c0 legacy=0x7f82a4154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a37fe640 1 --2- 172.21.15.133:0/3665807706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f828c003980 0x7f828c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a37fe640 1 --2- 172.21.15.133:0/3665807706 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82a40af5c0 0x7f828c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a37fe640 1 --2- 172.21.15.133:0/3665807706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f828c004d10 0x7f828c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a37fe640 1 -- 172.21.15.133:0/3665807706 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a406ba50 con 0x7f828c003980 2023-12-19T18:58:51.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a37fe640 1 -- 172.21.15.133:0/3665807706 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a406bd30 con 0x7f828c004d10 2023-12-19T18:58:51.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a37fe640 1 -- 172.21.15.133:0/3665807706 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c0141a0 con 0x7f82a40af5c0 2023-12-19T18:58:51.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a8bce640 1 --2- 172.21.15.133:0/3665807706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f828c003980 0x7f828c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a93cf640 1 --2- 172.21.15.133:0/3665807706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f828c004d10 0x7f828c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a8bce640 1 -- 172.21.15.133:0/3665807706 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82a40af5c0 msgr2=0x7f828c0047d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-19T18:58:51.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a8bce640 1 --2- 172.21.15.133:0/3665807706 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82a40af5c0 0x7f828c0047d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a8bce640 1 -- 172.21.15.133:0/3665807706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f828c004d10 msgr2=0x7f828c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:51.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a8bce640 1 --2- 172.21.15.133:0/3665807706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f828c004d10 0x7f828c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.256+0000 7f82a8bce640 1 -- 172.21.15.133:0/3665807706 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8294009420 con 0x7f828c003980 2023-12-19T18:58:51.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.264+0000 7f82a8bce640 1 --2- 172.21.15.133:0/3665807706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f828c003980 0x7f828c003da0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8294009cb0 tx=0x7f829401cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d5867b458a11015 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.264+0000 7f82a37fe640 1 -- 172.21.15.133:0/3665807706 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82940a5780 con 0x7f828c003980 2023-12-19T18:58:51.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.264+0000 7f82a37fe640 1 -- 172.21.15.133:0/3665807706 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82940a58e0 con 0x7f828c003980 2023-12-19T18:58:51.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.264+0000 7f82a9bd0640 1 -- 172.21.15.133:0/3665807706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f828c003980 msgr2=0x7f828c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.264+0000 7f82a9bd0640 1 --2- 172.21.15.133:0/3665807706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f828c003980 0x7f828c003da0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8294009cb0 tx=0x7f829401cc30 comp rx=0 tx=0).stop 2023-12-19T18:58:51.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.264+0000 7f82a93cf640 1 -- 172.21.15.133:0/3665807706 reap_dead start 2023-12-19T18:58:51.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.264+0000 7f82a9bd0640 1 -- 172.21.15.133:0/3665807706 shutdown_connections 2023-12-19T18:58:51.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.264+0000 7f82a9bd0640 1 -- 172.21.15.133:0/3665807706 >> 172.21.15.133:0/3665807706 conn(0x7f82a40ab960 msgr2=0x7f82a40abd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:51.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.264+0000 7f82a9bd0640 1 -- 172.21.15.133:0/3665807706 shutdown_connections 2023-12-19T18:58:51.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.264+0000 7f82a9bd0640 1 -- 172.21.15.133:0/3665807706 wait complete. 2023-12-19T18:58:51.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.268+0000 7f82a9bd0640 1 Processor -- start 2023-12-19T18:58:51.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.272+0000 7f82a9bd0640 1 -- start start 2023-12-19T18:58:51.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.272+0000 7f82a9bd0640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82a414d320 0x7f82a414afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.272+0000 7f82a9bd0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a414b510 0x7f82a414a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.272+0000 7f82a8bce640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82a414d320 0x7f82a414afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.272+0000 7f82a8bce640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82a414d320 0x7f82a414afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:55276/0 (socket says 172.21.15.133:55276) 2023-12-19T18:58:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.272+0000 7f82a3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a414b510 0x7f82a414a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.272+0000 7f82a3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a414b510 0x7f82a414a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54652/0 (socket says 172.21.15.133:54652) 2023-12-19T18:58:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.272+0000 7f82a8bce640 1 -- 172.21.15.133:0/4049264309 learned_addr learned my addr 172.21.15.133:0/4049264309 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.272+0000 7f82a9bd0640 1 --2- 172.21.15.133:0/4049264309 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82a414aa00 0x7f82a41e8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.272+0000 7f82a9bd0640 1 -- 172.21.15.133:0/4049264309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a4070720 con 0x7f82a414b510 2023-12-19T18:58:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.272+0000 7f82a9bd0640 1 -- 172.21.15.133:0/4049264309 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40adbb0 con 0x7f82a414aa00 2023-12-19T18:58:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.272+0000 7f82a9bd0640 1 -- 172.21.15.133:0/4049264309 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a41eccc0 con 0x7f82a414d320 2023-12-19T18:58:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.272+0000 7f82a3fff640 1 -- 172.21.15.133:0/4049264309 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82a414d320 msgr2=0x7f82a414afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.272+0000 7f82a3fff640 1 --2- 172.21.15.133:0/4049264309 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82a414d320 0x7f82a414afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.272+0000 7f82a3fff640 1 -- 172.21.15.133:0/4049264309 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82a414aa00 msgr2=0x7f82a41e8e10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T18:58:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.272+0000 7f82a3fff640 1 --2- 172.21.15.133:0/4049264309 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82a414aa00 0x7f82a41e8e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.272+0000 7f82a3fff640 1 -- 172.21.15.133:0/4049264309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a41ecfa0 con 0x7f82a414b510 2023-12-19T18:58:51.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.276+0000 7f82a3fff640 1 --2- 172.21.15.133:0/4049264309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a414b510 0x7f82a414a4c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f829800e800 tx=0x7f829800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.276+0000 7f82a17fa640 1 -- 172.21.15.133:0/4049264309 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82980095b0 con 0x7f82a414b510 2023-12-19T18:58:51.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.276+0000 7f82a17fa640 1 -- 172.21.15.133:0/4049264309 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829800c940 con 0x7f82a414b510 2023-12-19T18:58:51.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.276+0000 7f82a17fa640 1 -- 172.21.15.133:0/4049264309 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829800ccf0 con 0x7f82a414b510 2023-12-19T18:58:51.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.276+0000 7f82a9bd0640 1 -- 172.21.15.133:0/4049264309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a414ae10 con 0x7f82a414b510 2023-12-19T18:58:51.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.280+0000 7f82a17fa640 1 -- 172.21.15.133:0/4049264309 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8298013470 con 0x7f82a414b510 2023-12-19T18:58:51.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.280+0000 7f82a9bd0640 1 -- 172.21.15.133:0/4049264309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a40ae0e0 con 0x7f82a414b510 2023-12-19T18:58:51.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.280+0000 7f82a17fa640 1 --2- 172.21.15.133:0/4049264309 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f82900884d0 0x7f829008a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.280+0000 7f82a8bce640 1 --2- 172.21.15.133:0/4049264309 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f82900884d0 0x7f829008a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.284+0000 7f82a17fa640 1 -- 172.21.15.133:0/4049264309 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8298083320 con 0x7f82a414b510 2023-12-19T18:58:51.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.284+0000 7f82a8bce640 1 --2- 172.21.15.133:0/4049264309 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f82900884d0 0x7f829008a990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f829401ca60 tx=0x7f82940a7040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.284+0000 7f82a9bd0640 1 -- 172.21.15.133:0/4049264309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a414ae10 con 0x7f82a414b510 2023-12-19T18:58:51.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.292+0000 7f82a17fa640 1 -- 172.21.15.133:0/4049264309 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f82a414ae10 con 0x7f82a414b510 2023-12-19T18:58:51.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.328+0000 7f71042d6640 1 Processor -- start 2023-12-19T18:58:51.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.332+0000 7f71042d6640 1 -- start start 2023-12-19T18:58:51.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.332+0000 7f71042d6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70fc072080 0x7f70fc06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.332+0000 7f71042d6640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f70fc0c4300 0x7f70fc0c4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.332+0000 7f71042d6640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc0c3e70 con 0x7f70fc151350 2023-12-19T18:58:51.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.332+0000 7f7102072640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f70fc151350 0x7f70fc06bd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:58892/0 (socket says 172.21.15.133:58892) 2023-12-19T18:58:51.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.332+0000 7f7102072640 1 -- 172.21.15.133:0/1095025108 learned_addr learned my addr 172.21.15.133:0/1095025108 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:51.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.332+0000 7f7102873640 1 --2- 172.21.15.133:0/1095025108 >> v2:172.21.15.138:3300/0 conn(0x7f70fc0c4300 0x7f70fc0c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.332+0000 7f7101871640 1 --2- 172.21.15.133:0/1095025108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70fc072080 0x7f70fc06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.332+0000 7f71042d6640 1 -- 172.21.15.133:0/1095025108 --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70fc0c16e0 con 0x7f70fc0c4300 2023-12-19T18:58:51.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.332+0000 7f71042d6640 1 -- 172.21.15.133:0/1095025108 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc0c1120 con 0x7f70fc072080 2023-12-19T18:58:51.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.336+0000 7f7101070640 1 -- 172.21.15.133:0/1095025108 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086778687 0 0) 0x7f70fc0c3e70 con 0x7f70fc151350 2023-12-19T18:58:51.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.336+0000 7f7101070640 1 -- 172.21.15.133:0/1095025108 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70e8003530 con 0x7f70fc151350 2023-12-19T18:58:51.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.336+0000 7f7101070640 1 -- 172.21.15.133:0/1095025108 <== mon.1 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3640558766 0 0) 0x7f70e8003530 con 0x7f70fc151350 2023-12-19T18:58:51.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.336+0000 7f7101070640 1 -- 172.21.15.133:0/1095025108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70fc072080 msgr2=0x7f70fc06d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:51.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.336+0000 7f7101070640 1 --2- 172.21.15.133:0/1095025108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70fc072080 0x7f70fc06d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.336+0000 7f7101070640 1 -- 172.21.15.133:0/1095025108 >> v2:172.21.15.138:3300/0 conn(0x7f70fc0c4300 msgr2=0x7f70fc0c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:51.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.336+0000 7f7101070640 1 --2- 172.21.15.133:0/1095025108 >> v2:172.21.15.138:3300/0 conn(0x7f70fc0c4300 0x7f70fc0c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.336+0000 7f7101070640 1 -- 172.21.15.133:0/1095025108 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc0c1400 con 0x7f70fc151350 2023-12-19T18:58:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.336+0000 7f7101070640 1 -- 172.21.15.133:0/1095025108 <== mon.1 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f70f8000ee0 con 0x7f70fc151350 2023-12-19T18:58:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.336+0000 7f7101070640 1 -- 172.21.15.133:0/1095025108 >> v1:172.21.15.138:6789/0 conn(0x7f70fc151350 legacy=0x7f70fc06bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.336+0000 7f7101070640 1 --2- 172.21.15.133:0/1095025108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70e8003980 0x7f70e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.336+0000 7f7101070640 1 --2- 172.21.15.133:0/1095025108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70e8004370 0x7f70e8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.336+0000 7f7101070640 1 --2- 172.21.15.133:0/1095025108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70e8004f60 0x7f70e8014590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.336+0000 7f7101070640 1 -- 172.21.15.133:0/1095025108 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc0c16e0 con 0x7f70e8004f60 2023-12-19T18:58:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.336+0000 7f7101070640 1 -- 172.21.15.133:0/1095025108 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc0c1120 con 0x7f70e8004370 2023-12-19T18:58:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.336+0000 7f7101070640 1 -- 172.21.15.133:0/1095025108 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e8005410 con 0x7f70e8003980 2023-12-19T18:58:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.336+0000 7f7102072640 1 --2- 172.21.15.133:0/1095025108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70e8003980 0x7f70e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.336+0000 7f7102072640 1 -- 172.21.15.133:0/1095025108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70e8004370 msgr2=0x7f70e8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.336+0000 7f7102072640 1 --2- 172.21.15.133:0/1095025108 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70e8004370 0x7f70e8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.336+0000 7f7102072640 1 -- 172.21.15.133:0/1095025108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70e8004f60 msgr2=0x7f70e8014590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.336+0000 7f7102072640 1 --2- 172.21.15.133:0/1095025108 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70e8004f60 0x7f70e8014590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.336+0000 7f7102072640 1 -- 172.21.15.133:0/1095025108 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc0c1400 con 0x7f70e8003980 2023-12-19T18:58:51.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.340+0000 7f7102072640 1 --2- 172.21.15.133:0/1095025108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70e8003980 0x7f70e8003da0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f70f800d350 tx=0x7f70f801f950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ada56dc0d8fe3c19 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.344+0000 7f7101070640 1 -- 172.21.15.133:0/1095025108 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f80aa690 con 0x7f70e8003980 2023-12-19T18:58:51.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.344+0000 7f7101070640 1 -- 172.21.15.133:0/1095025108 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f80aa7f0 con 0x7f70e8003980 2023-12-19T18:58:51.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.344+0000 7f71042d6640 1 -- 172.21.15.133:0/1095025108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70e8003980 msgr2=0x7f70e8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.344+0000 7f7101070640 1 -- 172.21.15.133:0/1095025108 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f80aa690 con 0x7f70e8003980 2023-12-19T18:58:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.344+0000 7f71042d6640 1 --2- 172.21.15.133:0/1095025108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70e8003980 0x7f70e8003da0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f70f800d350 tx=0x7f70f801f950 comp rx=0 tx=0).stop 2023-12-19T18:58:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.344+0000 7f7102873640 1 -- 172.21.15.133:0/1095025108 reap_dead start 2023-12-19T18:58:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.344+0000 7f71042d6640 1 -- 172.21.15.133:0/1095025108 shutdown_connections 2023-12-19T18:58:51.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.344+0000 7f71042d6640 1 -- 172.21.15.133:0/1095025108 >> 172.21.15.133:0/1095025108 conn(0x7f70fc0a7910 msgr2=0x7f70fc0a7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:51.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.344+0000 7f71042d6640 1 -- 172.21.15.133:0/1095025108 shutdown_connections 2023-12-19T18:58:51.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.344+0000 7f71042d6640 1 -- 172.21.15.133:0/1095025108 wait complete. 2023-12-19T18:58:51.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.348+0000 7f71042d6640 1 Processor -- start 2023-12-19T18:58:51.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.348+0000 7f71042d6640 1 -- start start 2023-12-19T18:58:51.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.348+0000 7f71042d6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70fc1d9df0 0x7f70fc0ab1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.352+0000 7f71042d6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70fc153190 0x7f70fc1e55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.352+0000 7f71042d6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70fc1e5b20 0x7f70fc14adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.352+0000 7f7102072640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70fc1d9df0 0x7f70fc0ab1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.352+0000 7f71042d6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc0aad60 con 0x7f70fc153190 2023-12-19T18:58:51.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.352+0000 7f71042d6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc0aa4a0 con 0x7f70fc1d9df0 2023-12-19T18:58:51.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.352+0000 7f71042d6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc0a8d50 con 0x7f70fc1e5b20 2023-12-19T18:58:51.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.352+0000 7f7101871640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70fc153190 0x7f70fc1e55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.352+0000 7f7101871640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70fc153190 0x7f70fc1e55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54674/0 (socket says 172.21.15.133:54674) 2023-12-19T18:58:51.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.352+0000 7f7101871640 1 -- 172.21.15.133:0/66100434 learned_addr learned my addr 172.21.15.133:0/66100434 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:51.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.352+0000 7f7102873640 1 --2- 172.21.15.133:0/66100434 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70fc1e5b20 0x7f70fc14adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.356+0000 7f7101871640 1 -- 172.21.15.133:0/66100434 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70fc1e5b20 msgr2=0x7f70fc14adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.356+0000 7f7101871640 1 --2- 172.21.15.133:0/66100434 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70fc1e5b20 0x7f70fc14adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.356+0000 7f7101871640 1 -- 172.21.15.133:0/66100434 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70fc1d9df0 msgr2=0x7f70fc0ab1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.356+0000 7f7101871640 1 --2- 172.21.15.133:0/66100434 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70fc1d9df0 0x7f70fc0ab1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.356+0000 7f7101871640 1 -- 172.21.15.133:0/66100434 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc0a9030 con 0x7f70fc153190 2023-12-19T18:58:51.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.356+0000 7f7101871640 1 --2- 172.21.15.133:0/66100434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70fc153190 0x7f70fc1e55e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f70f400bdd0 tx=0x7f70f400e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.356+0000 7f70f2ffd640 1 -- 172.21.15.133:0/66100434 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f4010040 con 0x7f70fc153190 2023-12-19T18:58:51.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.356+0000 7f70f2ffd640 1 -- 172.21.15.133:0/66100434 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f400eb20 con 0x7f70fc153190 2023-12-19T18:58:51.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.356+0000 7f70f2ffd640 1 -- 172.21.15.133:0/66100434 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f4010040 con 0x7f70fc153190 2023-12-19T18:58:51.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.356+0000 7f71042d6640 1 -- 172.21.15.133:0/66100434 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70fc0aa9f0 con 0x7f70fc153190 2023-12-19T18:58:51.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.360+0000 7f71042d6640 1 -- 172.21.15.133:0/66100434 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70fc0a9310 con 0x7f70fc153190 2023-12-19T18:58:51.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.360+0000 7f70f2ffd640 1 -- 172.21.15.133:0/66100434 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f70f4009050 con 0x7f70fc153190 2023-12-19T18:58:51.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.364+0000 7f70f2ffd640 1 --2- 172.21.15.133:0/66100434 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f70e00664d0 0x7f70e0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.364+0000 7f71042d6640 1 -- 172.21.15.133:0/66100434 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70fc04e850 con 0x7f70fc153190 2023-12-19T18:58:51.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.364+0000 7f7102072640 1 --2- 172.21.15.133:0/66100434 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f70e00664d0 0x7f70e0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.364+0000 7f7102072640 1 --2- 172.21.15.133:0/66100434 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f70e00664d0 0x7f70e0068990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f70f80b2000 tx=0x7f70f80b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.372+0000 7f70f2ffd640 1 -- 172.21.15.133:0/66100434 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70f40559e0 con 0x7f70fc153190 2023-12-19T18:58:51.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.372+0000 7f70f2ffd640 1 -- 172.21.15.133:0/66100434 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f70f405b030 con 0x7f70fc153190 2023-12-19T18:58:51.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.396+0000 7fcb1871d640 1 Processor -- start 2023-12-19T18:58:51.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.396+0000 7fcb1871d640 1 -- start start 2023-12-19T18:58:51.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.400+0000 7fcb1871d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcb101511b0 0x7fcb1006bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.400+0000 7fcb1871d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb1006c4b0 0x7fcb100c4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.400+0000 7fcb1871d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb100c3b60 con 0x7fcb100c0cc0 2023-12-19T18:58:51.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.400+0000 7fcb1871d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb10072350 con 0x7fcb101511b0 2023-12-19T18:58:51.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.400+0000 7fcb1871d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb100c0840 con 0x7fcb1006c4b0 2023-12-19T18:58:51.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.400+0000 7fcb16cba640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb1006c4b0 0x7fcb100c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.400+0000 7fcb16cba640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb1006c4b0 0x7fcb100c4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:55302/0 (socket says 172.21.15.133:55302) 2023-12-19T18:58:51.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.400+0000 7fcb164b9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcb101511b0 0x7fcb1006bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.400+0000 7fcb164b9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcb101511b0 0x7fcb1006bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:48266/0 (socket says 172.21.15.133:48266) 2023-12-19T18:58:51.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.400+0000 7fcb164b9640 1 -- 172.21.15.133:0/4047943087 learned_addr learned my addr 172.21.15.133:0/4047943087 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:51.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.400+0000 7fcb164b9640 1 -- 172.21.15.133:0/4047943087 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb1006c4b0 msgr2=0x7fcb100c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:51.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.400+0000 7fcb164b9640 1 --2- 172.21.15.133:0/4047943087 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb1006c4b0 0x7fcb100c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.400+0000 7fcb164b9640 1 -- 172.21.15.133:0/4047943087 >> v1:172.21.15.133:6789/0 conn(0x7fcb100c0cc0 legacy=0x7fcb100c3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:51.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.400+0000 7fcb164b9640 1 -- 172.21.15.133:0/4047943087 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb100c1b10 con 0x7fcb101511b0 2023-12-19T18:58:51.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.412+0000 7fcb164b9640 1 --2- 172.21.15.133:0/4047943087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb101511b0 0x7fcb1006bf70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c008870 tx=0x7fcb0c01ea30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d470635eeb725f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.412+0000 7fcb154b7640 1 -- 172.21.15.133:0/4047943087 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c0a7ae0 con 0x7fcb101511b0 2023-12-19T18:58:51.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.412+0000 7fcb154b7640 1 -- 172.21.15.133:0/4047943087 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0c0ab070 con 0x7fcb101511b0 2023-12-19T18:58:51.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.412+0000 7fcb154b7640 1 -- 172.21.15.133:0/4047943087 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c0a7ea0 con 0x7fcb101511b0 2023-12-19T18:58:51.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.412+0000 7fcb1871d640 1 -- 172.21.15.133:0/4047943087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb101511b0 msgr2=0x7fcb1006bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.412+0000 7fcb1871d640 1 --2- 172.21.15.133:0/4047943087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb101511b0 0x7fcb1006bf70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c008870 tx=0x7fcb0c01ea30 comp rx=0 tx=0).stop 2023-12-19T18:58:51.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.416+0000 7fcb1871d640 1 -- 172.21.15.133:0/4047943087 shutdown_connections 2023-12-19T18:58:51.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.416+0000 7fcb1871d640 1 --2- 172.21.15.133:0/4047943087 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb1006c4b0 0x7fcb100c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.416+0000 7fd5c0454640 1 Processor -- start 2023-12-19T18:58:51.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.416+0000 7fcb1871d640 1 --2- 172.21.15.133:0/4047943087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb101511b0 0x7fcb1006bf70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.416+0000 7fcb1871d640 1 -- 172.21.15.133:0/4047943087 >> 172.21.15.133:0/4047943087 conn(0x7fcb100a7800 msgr2=0x7fcb100a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:51.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.420+0000 7fd5c0454640 1 -- start start 2023-12-19T18:58:51.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.420+0000 7fd5c0454640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5b81513c0 0x7fd5b806d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.420+0000 7fd5be1f0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5b81513c0 0x7fd5b806d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.420+0000 7fd5be1f0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd5b81513c0 0x7fd5b806d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54678/0 (socket says 172.21.15.133:54678) 2023-12-19T18:58:51.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.420+0000 7fd5c0454640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5b80c22c0 0x7fd5b815b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.420+0000 7fd5be1f0640 1 -- 172.21.15.133:0/435848305 learned_addr learned my addr 172.21.15.133:0/435848305 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:51.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.420+0000 7fd5be9f1640 1 --2- 172.21.15.133:0/435848305 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5b80c22c0 0x7fd5b815b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.424+0000 7fd5c0454640 1 -- 172.21.15.133:0/435848305 --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b806e490 con 0x7fd5b80c06d0 2023-12-19T18:58:51.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.424+0000 7fd5c0454640 1 -- 172.21.15.133:0/435848305 --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b80c1290 con 0x7fd5b81513c0 2023-12-19T18:58:51.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.424+0000 7fd5c0454640 1 -- 172.21.15.133:0/435848305 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b806e770 con 0x7fd5b80c22c0 2023-12-19T18:58:51.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.424+0000 7fd5be9f1640 1 -- 172.21.15.133:0/435848305 >> v2:172.21.15.133:3300/0 conn(0x7fd5b81513c0 msgr2=0x7fd5b806d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:51.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.424+0000 7fd5be9f1640 1 --2- 172.21.15.133:0/435848305 >> v2:172.21.15.133:3300/0 conn(0x7fd5b81513c0 0x7fd5b806d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.424+0000 7fd5bd1ee640 1 -- 172.21.15.133:0/435848305 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 652650665 0 0) 0x7fd5b806e490 con 0x7fd5b80c06d0 2023-12-19T18:58:51.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.424+0000 7fd5be9f1640 1 -- 172.21.15.133:0/435848305 >> v1:172.21.15.138:6789/0 conn(0x7fd5b80c06d0 legacy=0x7fd5b80a4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.424+0000 7fd5be9f1640 1 -- 172.21.15.133:0/435848305 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b806cf70 con 0x7fd5b80c22c0 2023-12-19T18:58:51.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.424+0000 7fcb1871d640 1 -- 172.21.15.133:0/4047943087 shutdown_connections 2023-12-19T18:58:51.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.424+0000 7fcb1871d640 1 -- 172.21.15.133:0/4047943087 wait complete. 2023-12-19T18:58:51.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.424+0000 7fcb1871d640 1 Processor -- start 2023-12-19T18:58:51.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.424+0000 7fcb1871d640 1 -- start start 2023-12-19T18:58:51.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.428+0000 7fcb1871d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb1006c4b0 0x7fcb100715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.424+0000 7fd5be1f0640 1 --2- 172.21.15.133:0/435848305 >> v2:172.21.15.133:3300/0 conn(0x7fd5b81513c0 0x7fd5b806d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:51.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.428+0000 7fcb1871d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb100c0cc0 0x7fcb1014dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.428+0000 7fcb164b9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb1006c4b0 0x7fcb100715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.428+0000 7fcb164b9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb1006c4b0 0x7fcb100715b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:55322/0 (socket says 172.21.15.133:55322) 2023-12-19T18:58:51.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.428+0000 7fcb15cb8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb100c0cc0 0x7fcb1014dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.428+0000 7fcb15cb8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb100c0cc0 0x7fcb1014dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:48270/0 (socket says 172.21.15.133:48270) 2023-12-19T18:58:51.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.428+0000 7fd5be9f1640 1 --2- 172.21.15.133:0/435848305 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5b80c22c0 0x7fd5b815b230 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400ba50 tx=0x7fd5b4020a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f828268c4758dacc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.428+0000 7fcb164b9640 1 -- 172.21.15.133:0/2285731035 learned_addr learned my addr 172.21.15.133:0/2285731035 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:51.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.428+0000 7fcb1871d640 1 --2- 172.21.15.133:0/2285731035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb101511b0 0x7fcb1014e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.428+0000 7fd5bd1ee640 1 -- 172.21.15.133:0/435848305 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b40a9ac0 con 0x7fd5b80c22c0 2023-12-19T18:58:51.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fd5bd1ee640 1 -- 172.21.15.133:0/435848305 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b40ad070 con 0x7fd5b80c22c0 2023-12-19T18:58:51.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fd5bd1ee640 1 -- 172.21.15.133:0/435848305 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b40a9ac0 con 0x7fd5b80c22c0 2023-12-19T18:58:51.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fcb16cba640 1 --2- 172.21.15.133:0/2285731035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb101511b0 0x7fcb1014e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fcb1871d640 1 -- 172.21.15.133:0/2285731035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb101fe450 con 0x7fcb101511b0 2023-12-19T18:58:51.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fcb1871d640 1 -- 172.21.15.133:0/2285731035 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb101fb520 con 0x7fcb100c0cc0 2023-12-19T18:58:51.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fcb1871d640 1 -- 172.21.15.133:0/2285731035 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb101fb7c0 con 0x7fcb1006c4b0 2023-12-19T18:58:51.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fd5c0454640 1 -- 172.21.15.133:0/435848305 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5b80c22c0 msgr2=0x7fd5b815b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fd5c0454640 1 --2- 172.21.15.133:0/435848305 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5b80c22c0 0x7fd5b815b230 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400ba50 tx=0x7fd5b4020a10 comp rx=0 tx=0).stop 2023-12-19T18:58:51.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fd5c0454640 1 -- 172.21.15.133:0/435848305 shutdown_connections 2023-12-19T18:58:51.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fd5c0454640 1 --2- 172.21.15.133:0/435848305 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5b80c22c0 0x7fd5b815b230 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fd5c0454640 1 --2- 172.21.15.133:0/435848305 >> v2:172.21.15.133:3300/0 conn(0x7fd5b81513c0 0x7fd5b806d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fd5c0454640 1 -- 172.21.15.133:0/435848305 >> 172.21.15.133:0/435848305 conn(0x7fd5b80c5cd0 msgr2=0x7fd5b80c60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:51.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fd5c0454640 1 -- 172.21.15.133:0/435848305 shutdown_connections 2023-12-19T18:58:51.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fd5c0454640 1 -- 172.21.15.133:0/435848305 wait complete. 2023-12-19T18:58:51.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fcb164b9640 1 -- 172.21.15.133:0/2285731035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb100c0cc0 msgr2=0x7fcb1014dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fcb164b9640 1 --2- 172.21.15.133:0/2285731035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb100c0cc0 0x7fcb1014dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fcb164b9640 1 -- 172.21.15.133:0/2285731035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb101511b0 msgr2=0x7fcb1014e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fcb164b9640 1 --2- 172.21.15.133:0/2285731035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb101511b0 0x7fcb1014e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fcb164b9640 1 -- 172.21.15.133:0/2285731035 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0c008550 con 0x7fcb1006c4b0 2023-12-19T18:58:51.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fcb164b9640 1 --2- 172.21.15.133:0/2285731035 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb1006c4b0 0x7fcb100715b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c0b3040 tx=0x7fcb0c01d270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fcb06ffd640 1 -- 172.21.15.133:0/2285731035 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c0a8c40 con 0x7fcb1006c4b0 2023-12-19T18:58:51.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fcb06ffd640 1 -- 172.21.15.133:0/2285731035 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0c0a8da0 con 0x7fcb1006c4b0 2023-12-19T18:58:51.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fcb06ffd640 1 -- 172.21.15.133:0/2285731035 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c00b390 con 0x7fcb1006c4b0 2023-12-19T18:58:51.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fcb1871d640 1 -- 172.21.15.133:0/2285731035 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb101fbaa0 con 0x7fcb1006c4b0 2023-12-19T18:58:51.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.432+0000 7fcb1871d640 1 -- 172.21.15.133:0/2285731035 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb1014e670 con 0x7fcb1006c4b0 2023-12-19T18:58:51.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.436+0000 7fd5c0454640 1 Processor -- start 2023-12-19T18:58:51.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.436+0000 7fd5c0454640 1 -- start start 2023-12-19T18:58:51.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.436+0000 7fcb06ffd640 1 -- 172.21.15.133:0/2285731035 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fcb0c00b4f0 con 0x7fcb1006c4b0 2023-12-19T18:58:51.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fd5c0454640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5b80c22c0 0x7fd5b80a7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fcb04ff9640 1 -- 172.21.15.133:0/2285731035 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaf8005260 con 0x7fcb1006c4b0 2023-12-19T18:58:51.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fcb06ffd640 1 --2- 172.21.15.133:0/2285731035 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcaf4066540 0x7fcaf4068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fcb06ffd640 1 -- 172.21.15.133:0/2285731035 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb0c11dd60 con 0x7fcb1006c4b0 2023-12-19T18:58:51.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fd5c0454640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5b81513c0 0x7fd5b80a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fd5c0454640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5b80a8530 0x7fd5b81ec1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fd5c0454640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b81536c0 con 0x7fd5b80c22c0 2023-12-19T18:58:51.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fd5c0454640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b81fa720 con 0x7fd5b80a8530 2023-12-19T18:58:51.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fd5c0454640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b81548d0 con 0x7fd5b81513c0 2023-12-19T18:58:51.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fd5be1f0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5b80c22c0 0x7fd5b80a7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fcb15cb8640 1 --2- 172.21.15.133:0/2285731035 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcaf4066540 0x7fcaf4068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fd5be9f1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5b80a8530 0x7fd5b81ec1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fd5be9f1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5b80a8530 0x7fd5b81ec1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:48282/0 (socket says 172.21.15.133:48282) 2023-12-19T18:58:51.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fd5be9f1640 1 -- 172.21.15.133:0/846220615 learned_addr learned my addr 172.21.15.133:0/846220615 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:51.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fd5bd9ef640 1 --2- 172.21.15.133:0/846220615 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5b81513c0 0x7fd5b80a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fd5be9f1640 1 -- 172.21.15.133:0/846220615 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5b81513c0 msgr2=0x7fd5b80a5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fd5be9f1640 1 --2- 172.21.15.133:0/846220615 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5b81513c0 0x7fd5b80a5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fd5be9f1640 1 -- 172.21.15.133:0/846220615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5b80c22c0 msgr2=0x7fd5b80a7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fd5be9f1640 1 --2- 172.21.15.133:0/846220615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5b80c22c0 0x7fd5b80a7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fd5be9f1640 1 -- 172.21.15.133:0/846220615 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b400b6b0 con 0x7fd5b80a8530 2023-12-19T18:58:51.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fcb15cb8640 1 --2- 172.21.15.133:0/2285731035 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcaf4066540 0x7fcaf4068a00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcb101fb090 tx=0x7fcb00009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fd5be1f0640 1 --2- 172.21.15.133:0/846220615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5b80c22c0 0x7fd5b80a7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:51.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fd5be9f1640 1 --2- 172.21.15.133:0/846220615 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5b80a8530 0x7fd5b81ec1d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40b5040 tx=0x7fd5b401d7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fd5aeffd640 1 -- 172.21.15.133:0/846220615 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b40a9ac0 con 0x7fd5b80a8530 2023-12-19T18:58:51.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fd5c0454640 1 -- 172.21.15.133:0/846220615 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b8154bb0 con 0x7fd5b80a8530 2023-12-19T18:58:51.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fd5aeffd640 1 -- 172.21.15.133:0/846220615 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b4011070 con 0x7fd5b80a8530 2023-12-19T18:58:51.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fd5aeffd640 1 -- 172.21.15.133:0/846220615 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b40b3e80 con 0x7fd5b80a8530 2023-12-19T18:58:51.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.440+0000 7fd5c0454640 1 -- 172.21.15.133:0/846220615 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b81faa00 con 0x7fd5b80a8530 2023-12-19T18:58:51.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.444+0000 7f8aea69c640 1 Processor -- start 2023-12-19T18:58:51.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.444+0000 7fd5c0454640 1 -- 172.21.15.133:0/846220615 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b80a7250 con 0x7fd5b80a8530 2023-12-19T18:58:51.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.444+0000 7f8aea69c640 1 -- start start 2023-12-19T18:58:51.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.444+0000 7fd5aeffd640 1 -- 172.21.15.133:0/846220615 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd5b40c43b0 con 0x7fd5b80a8530 2023-12-19T18:58:51.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.444+0000 7fcb06ffd640 1 -- 172.21.15.133:0/2285731035 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fcb0c0eb4d0 con 0x7fcb1006c4b0 2023-12-19T18:58:51.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.444+0000 7fd5aeffd640 1 --2- 172.21.15.133:0/846220615 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd59c066470 0x7fd59c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.444+0000 7f8aea69c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8ae4159df0 0x7f8ae415c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.448+0000 7fd5aeffd640 1 -- 172.21.15.133:0/846220615 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5b411e490 con 0x7fd5b80a8530 2023-12-19T18:58:51.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.448+0000 7f8aea69c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae40c05f0 con 0x7f8ae40c09c0 2023-12-19T18:58:51.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.448+0000 7f8aea69c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae4150f90 con 0x7f8ae40c1b40 2023-12-19T18:58:51.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.448+0000 7f8aea69c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae40c2430 con 0x7f8ae4159df0 2023-12-19T18:58:51.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.448+0000 7fd5be1f0640 1 --2- 172.21.15.133:0/846220615 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd59c066470 0x7fd59c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.448+0000 7f8ae969a640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8ae40c09c0 0x7f8ae40c0da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42608/0 (socket says 172.21.15.133:42608) 2023-12-19T18:58:51.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.448+0000 7f8ae969a640 1 -- 172.21.15.133:0/3971572519 learned_addr learned my addr 172.21.15.133:0/3971572519 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:51.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.448+0000 7f8ae9e9b640 1 --2- 172.21.15.133:0/3971572519 >> v2:172.21.15.133:3300/0 conn(0x7f8ae4159df0 0x7f8ae415c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.448+0000 7fd5be1f0640 1 --2- 172.21.15.133:0/846220615 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd59c066470 0x7fd59c068930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80a7190 tx=0x7fd5a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.448+0000 7f8ae9e9b640 1 -- 172.21.15.133:0/3971572519 >> v1:172.21.15.138:6789/0 conn(0x7f8ae40c1b40 legacy=0x7f8ae40c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.448+0000 7f8ae9e9b640 1 -- 172.21.15.133:0/3971572519 >> v1:172.21.15.133:6789/0 conn(0x7f8ae40c09c0 legacy=0x7f8ae40c0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.448+0000 7f8ae9e9b640 1 -- 172.21.15.133:0/3971572519 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae40a97a0 con 0x7f8ae4159df0 2023-12-19T18:58:51.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.448+0000 7fd5aeffd640 1 -- 172.21.15.133:0/846220615 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd5b40eba20 con 0x7fd5b80a8530 2023-12-19T18:58:51.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.452+0000 7f8ae9e9b640 1 --2- 172.21.15.133:0/3971572519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ae4159df0 0x7f8ae415c1e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8adc009d90 tx=0x7f8adc01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f038937663d40c4c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.452+0000 7f8adbfff640 1 -- 172.21.15.133:0/3971572519 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0a5980 con 0x7f8ae4159df0 2023-12-19T18:58:51.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.456+0000 7f8adbfff640 1 -- 172.21.15.133:0/3971572519 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc0a5ae0 con 0x7f8ae4159df0 2023-12-19T18:58:51.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.456+0000 7f8aea69c640 1 -- 172.21.15.133:0/3971572519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ae4159df0 msgr2=0x7f8ae415c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.456+0000 7f8aea69c640 1 --2- 172.21.15.133:0/3971572519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ae4159df0 0x7f8ae415c1e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8adc009d90 tx=0x7f8adc01c8c0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.456+0000 7f8aea69c640 1 -- 172.21.15.133:0/3971572519 shutdown_connections 2023-12-19T18:58:51.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.456+0000 7f8aea69c640 1 --2- 172.21.15.133:0/3971572519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ae4159df0 0x7f8ae415c1e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.456+0000 7f8aea69c640 1 -- 172.21.15.133:0/3971572519 >> 172.21.15.133:0/3971572519 conn(0x7f8ae40a7910 msgr2=0x7f8ae40a7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:51.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.456+0000 7f8aea69c640 1 -- 172.21.15.133:0/3971572519 shutdown_connections 2023-12-19T18:58:51.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.456+0000 7f8aea69c640 1 -- 172.21.15.133:0/3971572519 wait complete. 2023-12-19T18:58:51.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.460+0000 7f8aea69c640 1 Processor -- start 2023-12-19T18:58:51.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.460+0000 7f8aea69c640 1 -- start start 2023-12-19T18:58:51.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.464+0000 7f8aea69c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8ae40c09c0 0x7f8ae40711c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.464+0000 7f8aea69c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ae40c1b40 0x7f8ae4154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.464+0000 7f8aea69c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ae4159df0 0x7f8ae4070870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.464+0000 7f8ae9e9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ae4159df0 0x7f8ae4070870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.464+0000 7f8ae9e9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ae4159df0 0x7f8ae4070870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54714/0 (socket says 172.21.15.133:54714) 2023-12-19T18:58:51.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.464+0000 7f8ae9e9b640 1 -- 172.21.15.133:0/3233798759 learned_addr learned my addr 172.21.15.133:0/3233798759 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:51.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.464+0000 7f8ae969a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8ae40c09c0 0x7f8ae40711c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.464+0000 7f8aea69c640 1 -- 172.21.15.133:0/3233798759 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae4071700 con 0x7f8ae4159df0 2023-12-19T18:58:51.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.464+0000 7f8ae8e99640 1 --2- 172.21.15.133:0/3233798759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ae40c1b40 0x7f8ae4154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.464+0000 7f8aea69c640 1 -- 172.21.15.133:0/3233798759 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae40703e0 con 0x7f8ae40c1b40 2023-12-19T18:58:51.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.464+0000 7f8aea69c640 1 -- 172.21.15.133:0/3233798759 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae41fa450 con 0x7f8ae40c09c0 2023-12-19T18:58:51.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.468+0000 7f8ae9e9b640 1 -- 172.21.15.133:0/3233798759 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8ae40c09c0 msgr2=0x7f8ae40711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.468+0000 7f8ae9e9b640 1 --2- 172.21.15.133:0/3233798759 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8ae40c09c0 0x7f8ae40711c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.468+0000 7f8ae9e9b640 1 -- 172.21.15.133:0/3233798759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ae40c1b40 msgr2=0x7f8ae4154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.468+0000 7f8ae9e9b640 1 --2- 172.21.15.133:0/3233798759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ae40c1b40 0x7f8ae4154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.468+0000 7f8ae9e9b640 1 -- 172.21.15.133:0/3233798759 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8adc009a70 con 0x7f8ae4159df0 2023-12-19T18:58:51.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.468+0000 7f8ae8e99640 1 --2- 172.21.15.133:0/3233798759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ae40c1b40 0x7f8ae4154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:51.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.468+0000 7f8ae9e9b640 1 --2- 172.21.15.133:0/3233798759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ae4159df0 0x7f8ae4070870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8adc01cda0 tx=0x7f8adc019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.468+0000 7f8ad9ffb640 1 -- 172.21.15.133:0/3233798759 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0a5920 con 0x7f8ae4159df0 2023-12-19T18:58:51.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.468+0000 7f8aea69c640 1 -- 172.21.15.133:0/3233798759 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae41fa730 con 0x7f8ae4159df0 2023-12-19T18:58:51.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.468+0000 7f8aea69c640 1 -- 172.21.15.133:0/3233798759 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae4070070 con 0x7f8ae4159df0 2023-12-19T18:58:51.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.468+0000 7f8ad9ffb640 1 -- 172.21.15.133:0/3233798759 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc0a5c50 con 0x7f8ae4159df0 2023-12-19T18:58:51.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.468+0000 7f8ad9ffb640 1 -- 172.21.15.133:0/3233798759 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc0a5920 con 0x7f8ae4159df0 2023-12-19T18:58:51.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.472+0000 7f8ad9ffb640 1 -- 172.21.15.133:0/3233798759 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8adc0b4050 con 0x7f8ae4159df0 2023-12-19T18:58:51.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.476+0000 7f8aea69c640 1 -- 172.21.15.133:0/3233798759 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac4005260 con 0x7f8ae4159df0 2023-12-19T18:58:51.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.476+0000 7f8ad9ffb640 1 --2- 172.21.15.133:0/3233798759 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8ac80664d0 0x7f8ac8068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.476+0000 7f8ad9ffb640 1 -- 172.21.15.133:0/3233798759 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8adc11eb80 con 0x7f8ae4159df0 2023-12-19T18:58:51.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.476+0000 7f8ae969a640 1 --2- 172.21.15.133:0/3233798759 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8ac80664d0 0x7f8ac8068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.484+0000 7f8ad9ffb640 1 -- 172.21.15.133:0/3233798759 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8adc0ec090 con 0x7f8ae4159df0 2023-12-19T18:58:51.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.488+0000 7f8ae969a640 1 --2- 172.21.15.133:0/3233798759 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8ac80664d0 0x7f8ac8068990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0000f70 tx=0x7f8ae0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.496+0000 7f3008980640 1 Processor -- start 2023-12-19T18:58:51.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.500+0000 7f3008980640 1 -- start start 2023-12-19T18:58:51.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.500+0000 7f3008980640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f30040a8430 0x7f300406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.500+0000 7f3008980640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3004072080 0x7f30041510f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.500+0000 7f3008980640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30040c3e70 con 0x7f300406bd80 2023-12-19T18:58:51.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.500+0000 7f3008980640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30040c1120 con 0x7f30040a8430 2023-12-19T18:58:51.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.500+0000 7f3008980640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30040c1400 con 0x7f3004072080 2023-12-19T18:58:51.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.500+0000 7f3002d9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f300406bd80 0x7f30040c4300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42614/0 (socket says 172.21.15.133:42614) 2023-12-19T18:58:51.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.500+0000 7f3002d9d640 1 -- 172.21.15.133:0/3483996698 learned_addr learned my addr 172.21.15.133:0/3483996698 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:51.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.500+0000 7f300259c640 1 --2- 172.21.15.133:0/3483996698 >> v2:172.21.15.133:3300/0 conn(0x7f30040a8430 0x7f300406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.500+0000 7f3001d9b640 1 --2- 172.21.15.133:0/3483996698 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3004072080 0x7f30041510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.504+0000 7f300159a640 1 -- 172.21.15.133:0/3483996698 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469365557 0 0) 0x7f30040c3e70 con 0x7f300406bd80 2023-12-19T18:58:51.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.504+0000 7f300159a640 1 -- 172.21.15.133:0/3483996698 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fec003530 con 0x7f300406bd80 2023-12-19T18:58:51.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.504+0000 7f3001d9b640 1 -- 172.21.15.133:0/3483996698 >> v2:172.21.15.133:3300/0 conn(0x7f30040a8430 msgr2=0x7f300406d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:51.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.504+0000 7f3001d9b640 1 --2- 172.21.15.133:0/3483996698 >> v2:172.21.15.133:3300/0 conn(0x7f30040a8430 0x7f300406d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.504+0000 7f3001d9b640 1 -- 172.21.15.133:0/3483996698 >> v1:172.21.15.133:6789/0 conn(0x7f300406bd80 legacy=0x7f30040c4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.504+0000 7f3001d9b640 1 -- 172.21.15.133:0/3483996698 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30040c3b00 con 0x7f3004072080 2023-12-19T18:58:51.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.504+0000 7f300259c640 1 --2- 172.21.15.133:0/3483996698 >> v2:172.21.15.133:3300/0 conn(0x7f30040a8430 0x7f300406d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:51.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.508+0000 7faa0629c640 1 Processor -- start 2023-12-19T18:58:51.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.508+0000 7faa0629c640 1 -- start start 2023-12-19T18:58:51.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.508+0000 7f3001d9b640 1 --2- 172.21.15.133:0/3483996698 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3004072080 0x7f30041510f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80097c0 tx=0x7f2ff801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bc5ca38bdab94c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7f300159a640 1 -- 172.21.15.133:0/3483996698 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff80ad640 con 0x7f3004072080 2023-12-19T18:58:51.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.508+0000 7faa0629c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faa0006fd90 0x7faa000a5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.508+0000 7faa0629c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa00152230 con 0x7faa000a4d30 2023-12-19T18:58:51.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7faa0629c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa00070370 con 0x7faa00072890 2023-12-19T18:58:51.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7faa0629c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa00070650 con 0x7faa0006fd90 2023-12-19T18:58:51.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7f300159a640 1 -- 172.21.15.133:0/3483996698 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff80ad7a0 con 0x7f3004072080 2023-12-19T18:58:51.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7f300159a640 1 -- 172.21.15.133:0/3483996698 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff80adb30 con 0x7f3004072080 2023-12-19T18:58:51.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7fa9ff7fe640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7faa00072890 0x7faa000c1010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:58918/0 (socket says 172.21.15.133:58918) 2023-12-19T18:58:51.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7fa9ff7fe640 1 -- 172.21.15.133:0/3039192022 learned_addr learned my addr 172.21.15.133:0/3039192022 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:51.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7faa04839640 1 --2- 172.21.15.133:0/3039192022 >> v2:172.21.15.133:3300/0 conn(0x7faa0006fd90 0x7faa000a5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7fa9feffd640 1 -- 172.21.15.133:0/3039192022 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2950391592 0 0) 0x7faa00070370 con 0x7faa00072890 2023-12-19T18:58:51.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7fa9feffd640 1 -- 172.21.15.133:0/3039192022 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9e8003530 con 0x7faa00072890 2023-12-19T18:58:51.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7f3008980640 1 -- 172.21.15.133:0/3483996698 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3004072080 msgr2=0x7f30041510f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7f3008980640 1 --2- 172.21.15.133:0/3483996698 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3004072080 0x7f30041510f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80097c0 tx=0x7f2ff801c480 comp rx=0 tx=0).stop 2023-12-19T18:58:51.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7f3008980640 1 -- 172.21.15.133:0/3483996698 shutdown_connections 2023-12-19T18:58:51.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7f3008980640 1 --2- 172.21.15.133:0/3483996698 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3004072080 0x7f30041510f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7f3008980640 1 --2- 172.21.15.133:0/3483996698 >> v2:172.21.15.133:3300/0 conn(0x7f30040a8430 0x7f300406d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7f3008980640 1 -- 172.21.15.133:0/3483996698 >> 172.21.15.133:0/3483996698 conn(0x7f30040a7910 msgr2=0x7f30040a7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:51.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7f3008980640 1 -- 172.21.15.133:0/3483996698 shutdown_connections 2023-12-19T18:58:51.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7fa9feffd640 1 -- 172.21.15.133:0/3039192022 <== mon.1 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4265704669 0 0) 0x7fa9e8003530 con 0x7faa00072890 2023-12-19T18:58:51.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7fa9feffd640 1 -- 172.21.15.133:0/3039192022 >> v2:172.21.15.133:3300/0 conn(0x7faa0006fd90 msgr2=0x7faa000a5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:51.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7fa9feffd640 1 --2- 172.21.15.133:0/3039192022 >> v2:172.21.15.133:3300/0 conn(0x7faa0006fd90 0x7faa000a5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7f3008980640 1 -- 172.21.15.133:0/3483996698 wait complete. 2023-12-19T18:58:51.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7fa9feffd640 1 -- 172.21.15.133:0/3039192022 >> v1:172.21.15.133:6789/0 conn(0x7faa000a4d30 legacy=0x7faa00152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7fa9feffd640 1 -- 172.21.15.133:0/3039192022 --> v1:172.21.15.138:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa00152480 con 0x7faa00072890 2023-12-19T18:58:51.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7fa9feffd640 1 -- 172.21.15.133:0/3039192022 <== mon.1 v1:172.21.15.138:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7fa9f8001a00 con 0x7faa00072890 2023-12-19T18:58:51.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7fa9feffd640 1 -- 172.21.15.133:0/3039192022 >> v1:172.21.15.138:6789/0 conn(0x7faa00072890 legacy=0x7faa000c1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7fa9feffd640 1 --2- 172.21.15.133:0/3039192022 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9e8003980 0x7fa9e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7fa9feffd640 1 --2- 172.21.15.133:0/3039192022 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9e80047d0 0x7fa9e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.512+0000 7fa9feffd640 1 --2- 172.21.15.133:0/3039192022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9e80052b0 0x7fa9e800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.516+0000 7f67f9110640 1 Processor -- start 2023-12-19T18:58:51.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.516+0000 7faa04839640 1 --2- 172.21.15.133:0/3039192022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9e80052b0 0x7fa9e800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.516+0000 7fa9feffd640 1 -- 172.21.15.133:0/3039192022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa00070650 con 0x7fa9e80052b0 2023-12-19T18:58:51.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.516+0000 7fa9feffd640 1 -- 172.21.15.133:0/3039192022 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e800c180 con 0x7fa9e80047d0 2023-12-19T18:58:51.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.516+0000 7fa9feffd640 1 -- 172.21.15.133:0/3039192022 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9e800c340 con 0x7fa9e8003980 2023-12-19T18:58:51.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.516+0000 7f67f9110640 1 -- start start 2023-12-19T18:58:51.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.516+0000 7f3008980640 1 Processor -- start 2023-12-19T18:58:51.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.516+0000 7f3008980640 1 -- start start 2023-12-19T18:58:51.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.516+0000 7f67f9110640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67ec0d3a80 0x7f67ec00a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.516+0000 7f67f9110640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f67ec0072e0 0x7f67ec0da300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.516+0000 7f67f3fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67ec0d3a80 0x7f67ec00a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f67f3fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67ec0d3a80 0x7f67ec00a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:55376/0 (socket says 172.21.15.133:55376) 2023-12-19T18:58:51.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f67f37fe640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f67ec006e80 0x7f67ec0d9bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:58930/0 (socket says 172.21.15.133:58930) 2023-12-19T18:58:51.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f67f3fff640 1 -- 172.21.15.133:0/1849891659 learned_addr learned my addr 172.21.15.133:0/1849891659 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:51.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f67f9110640 1 -- 172.21.15.133:0/1849891659 --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67ec046920 con 0x7f67ec006e80 2023-12-19T18:58:51.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f67f9110640 1 -- 172.21.15.133:0/1849891659 --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67ec0473c0 con 0x7f67ec0072e0 2023-12-19T18:58:51.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f67f9110640 1 -- 172.21.15.133:0/1849891659 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec04b5b0 con 0x7f67ec0d3a80 2023-12-19T18:58:51.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f3008980640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f300406bd80 0x7f30040a9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f3008980640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3004072080 0x7f30040715f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f3008980640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30040a8430 0x7f300414f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f3008980640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30041f5dd0 con 0x7f300406bd80 2023-12-19T18:58:51.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f3008980640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30040a9770 con 0x7f30040a8430 2023-12-19T18:58:51.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f3008980640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3004158340 con 0x7f3004072080 2023-12-19T18:58:51.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f67f2ffd640 1 -- 172.21.15.133:0/1849891659 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770126948 0 0) 0x7f67ec046920 con 0x7f67ec006e80 2023-12-19T18:58:51.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f67f2ffd640 1 -- 172.21.15.133:0/1849891659 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67e4003530 con 0x7f67ec006e80 2023-12-19T18:58:51.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.516+0000 7faa04839640 1 -- 172.21.15.133:0/3039192022 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9e8003980 msgr2=0x7fa9e8003da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-19T18:58:51.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.516+0000 7faa04839640 1 --2- 172.21.15.133:0/3039192022 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9e8003980 0x7fa9e8003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.516+0000 7faa04839640 1 -- 172.21.15.133:0/3039192022 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9e80047d0 msgr2=0x7fa9e8004c50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-19T18:58:51.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.516+0000 7faa04839640 1 --2- 172.21.15.133:0/3039192022 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9e80047d0 0x7fa9e8004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.516+0000 7faa04839640 1 -- 172.21.15.133:0/3039192022 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa00152480 con 0x7fa9e80052b0 2023-12-19T18:58:51.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f67f3fff640 1 -- 172.21.15.133:0/1849891659 >> v2:172.21.15.133:3300/0 conn(0x7f67ec0072e0 msgr2=0x7f67ec0da300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:51.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f67f2ffd640 1 -- 172.21.15.133:0/1849891659 <== mon.1 v1:172.21.15.138:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4078500335 0 0) 0x7f67e4003530 con 0x7f67ec006e80 2023-12-19T18:58:51.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f67f3fff640 1 --2- 172.21.15.133:0/1849891659 >> v2:172.21.15.133:3300/0 conn(0x7f67ec0072e0 0x7f67ec0da300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f67f3fff640 1 -- 172.21.15.133:0/1849891659 >> v1:172.21.15.138:6789/0 conn(0x7f67ec006e80 legacy=0x7f67ec0d9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f67f3fff640 1 -- 172.21.15.133:0/1849891659 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ec04b2d0 con 0x7f67ec0d3a80 2023-12-19T18:58:51.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f300259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f300406bd80 0x7f30040a9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f300259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f300406bd80 0x7f30040a9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54762/0 (socket says 172.21.15.133:54762) 2023-12-19T18:58:51.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f300259c640 1 -- 172.21.15.133:0/184984293 learned_addr learned my addr 172.21.15.133:0/184984293 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:51.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f300259c640 1 -- 172.21.15.133:0/184984293 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3004072080 msgr2=0x7f30040715f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f300259c640 1 --2- 172.21.15.133:0/184984293 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3004072080 0x7f30040715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f300259c640 1 -- 172.21.15.133:0/184984293 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30040a8430 msgr2=0x7f300414f910 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-19T18:58:51.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f300259c640 1 --2- 172.21.15.133:0/184984293 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30040a8430 0x7f300414f910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f300259c640 1 -- 172.21.15.133:0/184984293 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff8009420 con 0x7f300406bd80 2023-12-19T18:58:51.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.520+0000 7f300259c640 1 --2- 172.21.15.133:0/184984293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f300406bd80 0x7f30040a9230 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009fd0 tx=0x7f2ffc00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7f67f3fff640 1 --2- 172.21.15.133:0/1849891659 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67ec0d3a80 0x7f67ec00a960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f67e0009870 tx=0x7f67e001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c851798598fd1a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7f67f2ffd640 1 -- 172.21.15.133:0/1849891659 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f404ed70 con 0x7f67ec0d3a80 2023-12-19T18:58:51.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7f2ff2ffd640 1 -- 172.21.15.133:0/184984293 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc003ba0 con 0x7f300406bd80 2023-12-19T18:58:51.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7f67f2ffd640 1 -- 172.21.15.133:0/1849891659 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e00a7050 con 0x7f67ec0d3a80 2023-12-19T18:58:51.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7f67f2ffd640 1 -- 172.21.15.133:0/1849891659 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e00ab620 con 0x7f67ec0d3a80 2023-12-19T18:58:51.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7faa04839640 1 -- 172.21.15.133:0/3039192022 reap_dead start 2023-12-19T18:58:51.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7faa04839640 1 --2- 172.21.15.133:0/3039192022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9e80052b0 0x7fa9e800b990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400b9e0 tx=0x7fa9f401c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd6bacb17aa3bb0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7f2ff2ffd640 1 -- 172.21.15.133:0/184984293 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ffc00f040 con 0x7f300406bd80 2023-12-19T18:58:51.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7f2ff2ffd640 1 -- 172.21.15.133:0/184984293 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc004030 con 0x7f300406bd80 2023-12-19T18:58:51.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7fa9feffd640 1 -- 172.21.15.133:0/3039192022 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f40af070 con 0x7fa9e80052b0 2023-12-19T18:58:51.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7f67f9110640 1 -- 172.21.15.133:0/1849891659 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67ec0d3a80 msgr2=0x7f67ec00a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7f67f9110640 1 --2- 172.21.15.133:0/1849891659 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67ec0d3a80 0x7f67ec00a960 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f67e0009870 tx=0x7f67e001c410 comp rx=0 tx=0).stop 2023-12-19T18:58:51.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7f67f9110640 1 -- 172.21.15.133:0/1849891659 shutdown_connections 2023-12-19T18:58:51.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7f67f9110640 1 --2- 172.21.15.133:0/1849891659 >> v2:172.21.15.133:3300/0 conn(0x7f67ec0072e0 0x7f67ec0da300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7f67f9110640 1 --2- 172.21.15.133:0/1849891659 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67ec0d3a80 0x7f67ec00a960 secure :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f67e0009870 tx=0x7f67e001c410 comp rx=0 tx=0).stop 2023-12-19T18:58:51.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7f67f9110640 1 -- 172.21.15.133:0/1849891659 >> 172.21.15.133:0/1849891659 conn(0x7f67ec048230 msgr2=0x7f67ec048640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:51.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7fa9feffd640 1 -- 172.21.15.133:0/3039192022 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f40ab470 con 0x7fa9e80052b0 2023-12-19T18:58:51.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7fa9feffd640 1 -- 172.21.15.133:0/3039192022 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f40ab820 con 0x7fa9e80052b0 2023-12-19T18:58:51.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7f3008980640 1 -- 172.21.15.133:0/184984293 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3004158620 con 0x7f300406bd80 2023-12-19T18:58:51.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7f3008980640 1 -- 172.21.15.133:0/184984293 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3004071b30 con 0x7f300406bd80 2023-12-19T18:58:51.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7faa0629c640 1 -- 172.21.15.133:0/3039192022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9e80052b0 msgr2=0x7fa9e800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7faa0629c640 1 --2- 172.21.15.133:0/3039192022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9e80052b0 0x7fa9e800b990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa9f400b9e0 tx=0x7fa9f401c680 comp rx=0 tx=0).stop 2023-12-19T18:58:51.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7faa0629c640 1 -- 172.21.15.133:0/3039192022 shutdown_connections 2023-12-19T18:58:51.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7faa0629c640 1 --2- 172.21.15.133:0/3039192022 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9e80052b0 0x7fa9e800b990 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7faa0629c640 1 -- 172.21.15.133:0/3039192022 >> 172.21.15.133:0/3039192022 conn(0x7faa000a7910 msgr2=0x7faa000a7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:51.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7f67f9110640 1 -- 172.21.15.133:0/1849891659 shutdown_connections 2023-12-19T18:58:51.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7faa0629c640 1 -- 172.21.15.133:0/3039192022 shutdown_connections 2023-12-19T18:58:51.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7faa0629c640 1 -- 172.21.15.133:0/3039192022 wait complete. 2023-12-19T18:58:51.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.524+0000 7f3008980640 1 -- 172.21.15.133:0/184984293 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f300414f630 con 0x7f300406bd80 2023-12-19T18:58:51.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.528+0000 7faa0629c640 1 Processor -- start 2023-12-19T18:58:51.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.528+0000 7faa0629c640 1 -- start start 2023-12-19T18:58:51.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.528+0000 7f67f9110640 1 -- 172.21.15.133:0/1849891659 wait complete. 2023-12-19T18:58:51.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.528+0000 7f67f9110640 1 Processor -- start 2023-12-19T18:58:51.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7faa0629c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9e80052b0 0x7faa001e9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7faa0629c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa00154a10 0x7faa00156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7f67f9110640 1 -- start start 2023-12-19T18:58:51.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7faa0629c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faa0014b6c0 0x7faa00141b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7faa0629c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa00154e90 con 0x7faa00154a10 2023-12-19T18:58:51.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7faa0629c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa00153970 con 0x7fa9e80052b0 2023-12-19T18:58:51.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7faa0629c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa00153c50 con 0x7faa0014b6c0 2023-12-19T18:58:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7faa04839640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faa0014b6c0 0x7faa00141b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7faa04839640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faa0014b6c0 0x7faa00141b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:55398/0 (socket says 172.21.15.133:55398) 2023-12-19T18:58:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7faa04839640 1 -- 172.21.15.133:0/1469364083 learned_addr learned my addr 172.21.15.133:0/1469364083 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7fa9fffff640 1 --2- 172.21.15.133:0/1469364083 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9e80052b0 0x7faa001e9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7faa04839640 1 -- 172.21.15.133:0/1469364083 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9e80052b0 msgr2=0x7faa001e9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7faa04839640 1 --2- 172.21.15.133:0/1469364083 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9e80052b0 0x7faa001e9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7faa04839640 1 -- 172.21.15.133:0/1469364083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa00154a10 msgr2=0x7faa00156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7faa04839640 1 --2- 172.21.15.133:0/1469364083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa00154a10 0x7faa00156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7faa04839640 1 -- 172.21.15.133:0/1469364083 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa000c2240 con 0x7faa0014b6c0 2023-12-19T18:58:51.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7f67f9110640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67ec006e80 0x7f67ec02c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7f67f9110640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67ec0072e0 0x7f67ec17c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7f67f9110640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67ec045970 0x7f67ec17cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7fa9fffff640 1 --2- 172.21.15.133:0/1469364083 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9e80052b0 0x7faa001e9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:51.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7f67f9110640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec042e40 con 0x7f67ec045970 2023-12-19T18:58:51.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7f67f9110640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec17f610 con 0x7f67ec0072e0 2023-12-19T18:58:51.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7f67f9110640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67ec17f820 con 0x7f67ec006e80 2023-12-19T18:58:51.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7faa04839640 1 --2- 172.21.15.133:0/1469364083 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faa0014b6c0 0x7faa00141b40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4098070 tx=0x7fa9f4019420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7f67f890f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67ec045970 0x7f67ec17cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7f67f890f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67ec045970 0x7f67ec17cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54776/0 (socket says 172.21.15.133:54776) 2023-12-19T18:58:51.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7f67f890f640 1 -- 172.21.15.133:0/2616715837 learned_addr learned my addr 172.21.15.133:0/2616715837 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:51.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7f67f890f640 1 -- 172.21.15.133:0/2616715837 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67ec006e80 msgr2=0x7f67ec02c500 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-19T18:58:51.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7f67f890f640 1 --2- 172.21.15.133:0/2616715837 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67ec006e80 0x7f67ec02c500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7f67f890f640 1 -- 172.21.15.133:0/2616715837 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67ec0072e0 msgr2=0x7f67ec17c800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T18:58:51.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7f67f890f640 1 --2- 172.21.15.133:0/2616715837 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67ec0072e0 0x7f67ec17c800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7f67f890f640 1 -- 172.21.15.133:0/2616715837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e00094d0 con 0x7f67ec045970 2023-12-19T18:58:51.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.536+0000 7fa9fcff9640 1 -- 172.21.15.133:0/1469364083 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f40ab7f0 con 0x7faa0014b6c0 2023-12-19T18:58:51.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.536+0000 7fa9fcff9640 1 -- 172.21.15.133:0/1469364083 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f40ab950 con 0x7faa0014b6c0 2023-12-19T18:58:51.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.536+0000 7fa9fcff9640 1 -- 172.21.15.133:0/1469364083 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f40abd00 con 0x7faa0014b6c0 2023-12-19T18:58:51.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.536+0000 7faa0629c640 1 -- 172.21.15.133:0/1469364083 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa00153f30 con 0x7faa0014b6c0 2023-12-19T18:58:51.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.536+0000 7faa0629c640 1 -- 172.21.15.133:0/1469364083 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa001544f0 con 0x7faa0014b6c0 2023-12-19T18:58:51.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.536+0000 7f67f890f640 1 --2- 172.21.15.133:0/2616715837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67ec045970 0x7f67ec17cd40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f67e800b430 tx=0x7f67e800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.532+0000 7f2ff2ffd640 1 -- 172.21.15.133:0/184984293 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2ffc004190 con 0x7f300406bd80 2023-12-19T18:58:51.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.536+0000 7f2ff2ffd640 1 --2- 172.21.15.133:0/184984293 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2fe4066540 0x7f2fe4068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.536+0000 7f2ff2ffd640 1 -- 172.21.15.133:0/184984293 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ffc0846a0 con 0x7f300406bd80 2023-12-19T18:58:51.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.536+0000 7f3001d9b640 1 --2- 172.21.15.133:0/184984293 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2fe4066540 0x7f2fe4068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.536+0000 7faa0629c640 1 -- 172.21.15.133:0/1469364083 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa001546e0 con 0x7faa0014b6c0 2023-12-19T18:58:51.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.536+0000 7f3001d9b640 1 --2- 172.21.15.133:0/184984293 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2fe4066540 0x7f2fe4068a00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80af000 tx=0x7f2ff8004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.536+0000 7fa9fcff9640 1 -- 172.21.15.133:0/1469364083 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa9f40a9440 con 0x7faa0014b6c0 2023-12-19T18:58:51.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.540+0000 7fa9fcff9640 1 --2- 172.21.15.133:0/1469364083 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa9ec0664a0 0x7fa9ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.540+0000 7fa9fcff9640 1 -- 172.21.15.133:0/1469364083 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9f4126480 con 0x7faa0014b6c0 2023-12-19T18:58:51.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.540+0000 7fa9fffff640 1 --2- 172.21.15.133:0/1469364083 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa9ec0664a0 0x7fa9ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.540+0000 7fa9fffff640 1 --2- 172.21.15.133:0/1469364083 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa9ec0664a0 0x7fa9ec068960 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00016e0 tx=0x7fa9f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.540+0000 7f67f0ff9640 1 -- 172.21.15.133:0/2616715837 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8011830 con 0x7f67ec045970 2023-12-19T18:58:51.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.544+0000 7f67f0ff9640 1 -- 172.21.15.133:0/2616715837 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e8011990 con 0x7f67ec045970 2023-12-19T18:58:51.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.544+0000 7f67f9110640 1 -- 172.21.15.133:0/2616715837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67ec17d280 con 0x7f67ec045970 2023-12-19T18:58:51.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.544+0000 7f67f0ff9640 1 -- 172.21.15.133:0/2616715837 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8011d40 con 0x7f67ec045970 2023-12-19T18:58:51.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.544+0000 7f67f9110640 1 -- 172.21.15.133:0/2616715837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67ec17fda0 con 0x7f67ec045970 2023-12-19T18:58:51.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.544+0000 7f2ff2ffd640 1 -- 172.21.15.133:0/184984293 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2ffc051c40 con 0x7f300406bd80 2023-12-19T18:58:51.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.544+0000 7fa9fcff9640 1 -- 172.21.15.133:0/1469364083 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa9f40f39a0 con 0x7faa0014b6c0 2023-12-19T18:58:51.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.548+0000 7f67f9110640 1 -- 172.21.15.133:0/2616715837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67ec005370 con 0x7f67ec045970 2023-12-19T18:58:51.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.548+0000 7f67f0ff9640 1 -- 172.21.15.133:0/2616715837 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f67e801a400 con 0x7f67ec045970 2023-12-19T18:58:51.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.548+0000 7f67f0ff9640 1 --2- 172.21.15.133:0/2616715837 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f67d8066470 0x7f67d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:51.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.556+0000 7f67f3fff640 1 --2- 172.21.15.133:0/2616715837 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f67d8066470 0x7f67d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:51.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.556+0000 7f67f0ff9640 1 -- 172.21.15.133:0/2616715837 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67e80558d0 con 0x7f67ec045970 2023-12-19T18:58:51.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.556+0000 7f67f3fff640 1 --2- 172.21.15.133:0/2616715837 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f67d8066470 0x7f67d8068930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f67e00ad000 tx=0x7f67e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:51.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.560+0000 7f67f0ff9640 1 -- 172.21.15.133:0/2616715837 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f67e8051510 con 0x7f67ec045970 2023-12-19T18:58:51.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.632+0000 7f82a9bd0640 1 -- 172.21.15.133:0/4049264309 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f82a414ae10 con 0x7f82a414b510 2023-12-19T18:58:51.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.636+0000 7f82a17fa640 1 -- 172.21.15.133:0/4049264309 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f82a414ae10 con 0x7f82a414b510 2023-12-19T18:58:51.639 INFO:teuthology.orchestra.run.smithi133.stdout:55834574855 2023-12-19T18:58:51.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.636+0000 7f82a9bd0640 1 -- 172.21.15.133:0/4049264309 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f82900884d0 msgr2=0x7f829008a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.636+0000 7f82a9bd0640 1 --2- 172.21.15.133:0/4049264309 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f82900884d0 0x7f829008a990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f829401ca60 tx=0x7f82940a7040 comp rx=0 tx=0).stop 2023-12-19T18:58:51.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.636+0000 7f82a9bd0640 1 -- 172.21.15.133:0/4049264309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a414b510 msgr2=0x7f82a414a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.636+0000 7f82a9bd0640 1 --2- 172.21.15.133:0/4049264309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a414b510 0x7f82a414a4c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f829800e800 tx=0x7f829800ecc0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.640+0000 7f82a9bd0640 1 -- 172.21.15.133:0/4049264309 shutdown_connections 2023-12-19T18:58:51.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.640+0000 7f82a9bd0640 1 --2- 172.21.15.133:0/4049264309 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f82900884d0 0x7f829008a990 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.640+0000 7f82a9bd0640 1 --2- 172.21.15.133:0/4049264309 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82a414aa00 0x7f82a41e8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.640+0000 7f82a9bd0640 1 --2- 172.21.15.133:0/4049264309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82a414b510 0x7f82a414a4c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.640+0000 7f82a9bd0640 1 --2- 172.21.15.133:0/4049264309 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82a414d320 0x7f82a414afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.640+0000 7f82a9bd0640 1 -- 172.21.15.133:0/4049264309 >> 172.21.15.133:0/4049264309 conn(0x7f82a40ab960 msgr2=0x7f82a4154950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:51.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.644+0000 7f82a9bd0640 1 -- 172.21.15.133:0/4049264309 shutdown_connections 2023-12-19T18:58:51.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.644+0000 7f82a9bd0640 1 -- 172.21.15.133:0/4049264309 wait complete. 2023-12-19T18:58:51.681 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2023-12-19T18:58:51.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.692+0000 7f71042d6640 1 -- 172.21.15.133:0/66100434 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f70fc0c0f00 con 0x7f70fc153190 2023-12-19T18:58:51.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.696+0000 7f70f2ffd640 1 -- 172.21.15.133:0/66100434 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f70f405b030 con 0x7f70fc153190 2023-12-19T18:58:51.700 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2023-12-19T18:58:51.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.696+0000 7f71042d6640 1 -- 172.21.15.133:0/66100434 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f70e00664d0 msgr2=0x7f70e0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.696+0000 7f71042d6640 1 --2- 172.21.15.133:0/66100434 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f70e00664d0 0x7f70e0068990 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f70f80b2000 tx=0x7f70f80b6040 comp rx=0 tx=0).stop 2023-12-19T18:58:51.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.696+0000 7f71042d6640 1 -- 172.21.15.133:0/66100434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70fc153190 msgr2=0x7f70fc1e55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.696+0000 7f71042d6640 1 --2- 172.21.15.133:0/66100434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70fc153190 0x7f70fc1e55e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f70f400bdd0 tx=0x7f70f400e490 comp rx=0 tx=0).stop 2023-12-19T18:58:51.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.696+0000 7f71042d6640 1 -- 172.21.15.133:0/66100434 shutdown_connections 2023-12-19T18:58:51.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.696+0000 7f71042d6640 1 --2- 172.21.15.133:0/66100434 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f70e00664d0 0x7f70e0068990 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.696+0000 7f71042d6640 1 --2- 172.21.15.133:0/66100434 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70fc1e5b20 0x7f70fc14adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.696+0000 7f71042d6640 1 --2- 172.21.15.133:0/66100434 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70fc153190 0x7f70fc1e55e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.696+0000 7f71042d6640 1 --2- 172.21.15.133:0/66100434 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70fc1d9df0 0x7f70fc0ab1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.696+0000 7f71042d6640 1 -- 172.21.15.133:0/66100434 >> 172.21.15.133:0/66100434 conn(0x7f70fc0a7910 msgr2=0x7f70fc14d020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:51.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.696+0000 7f71042d6640 1 -- 172.21.15.133:0/66100434 shutdown_connections 2023-12-19T18:58:51.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.696+0000 7f71042d6640 1 -- 172.21.15.133:0/66100434 wait complete. 2023-12-19T18:58:51.734 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-12-19T18:58:51.734 DEBUG:teuthology.parallel:result is None 2023-12-19T18:58:51.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.752+0000 7fcb04ff9640 1 -- 172.21.15.133:0/2285731035 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fcaf80050d0 con 0x7fcb1006c4b0 2023-12-19T18:58:51.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.752+0000 7fcb06ffd640 1 -- 172.21.15.133:0/2285731035 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcb0c0ad020 con 0x7fcb1006c4b0 2023-12-19T18:58:51.757 INFO:teuthology.orchestra.run.smithi133.stdout:55834574855 2023-12-19T18:58:51.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.756+0000 7fcb04ff9640 1 -- 172.21.15.133:0/2285731035 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcaf4066540 msgr2=0x7fcaf4068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.756+0000 7fcb04ff9640 1 --2- 172.21.15.133:0/2285731035 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcaf4066540 0x7fcaf4068a00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcb101fb090 tx=0x7fcb00009040 comp rx=0 tx=0).stop 2023-12-19T18:58:51.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.756+0000 7fcb04ff9640 1 -- 172.21.15.133:0/2285731035 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb1006c4b0 msgr2=0x7fcb100715b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.756+0000 7fcb04ff9640 1 --2- 172.21.15.133:0/2285731035 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb1006c4b0 0x7fcb100715b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c0b3040 tx=0x7fcb0c01d270 comp rx=0 tx=0).stop 2023-12-19T18:58:51.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.756+0000 7fcb04ff9640 1 -- 172.21.15.133:0/2285731035 shutdown_connections 2023-12-19T18:58:51.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.756+0000 7fcb04ff9640 1 --2- 172.21.15.133:0/2285731035 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcaf4066540 0x7fcaf4068a00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.756+0000 7fcb04ff9640 1 --2- 172.21.15.133:0/2285731035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb101511b0 0x7fcb1014e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.756+0000 7fcb04ff9640 1 --2- 172.21.15.133:0/2285731035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb100c0cc0 0x7fcb1014dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.756+0000 7fcb04ff9640 1 --2- 172.21.15.133:0/2285731035 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb1006c4b0 0x7fcb100715b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.756+0000 7fcb04ff9640 1 -- 172.21.15.133:0/2285731035 >> 172.21.15.133:0/2285731035 conn(0x7fcb100a7800 msgr2=0x7fcb100a5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:51.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.756+0000 7fcb04ff9640 1 -- 172.21.15.133:0/2285731035 shutdown_connections 2023-12-19T18:58:51.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.756+0000 7fcb04ff9640 1 -- 172.21.15.133:0/2285731035 wait complete. 2023-12-19T18:58:51.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.776+0000 7fd5c0454640 1 -- 172.21.15.133:0/846220615 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd5b8068400 con 0x7fd5b80a8530 2023-12-19T18:58:51.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.776+0000 7fd5aeffd640 1 -- 172.21.15.133:0/846220615 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd5b40af020 con 0x7fd5b80a8530 2023-12-19T18:58:51.780 INFO:teuthology.orchestra.run.smithi133.stdout:55834574856 2023-12-19T18:58:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.780+0000 7fd5c0454640 1 -- 172.21.15.133:0/846220615 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd59c066470 msgr2=0x7fd59c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.780+0000 7fd5c0454640 1 --2- 172.21.15.133:0/846220615 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd59c066470 0x7fd59c068930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80a7190 tx=0x7fd5a8008040 comp rx=0 tx=0).stop 2023-12-19T18:58:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.780+0000 7fd5c0454640 1 -- 172.21.15.133:0/846220615 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5b80a8530 msgr2=0x7fd5b81ec1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.780+0000 7fd5c0454640 1 --2- 172.21.15.133:0/846220615 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5b80a8530 0x7fd5b81ec1d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd5b40b5040 tx=0x7fd5b401d7b0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.780+0000 7fd5c0454640 1 -- 172.21.15.133:0/846220615 shutdown_connections 2023-12-19T18:58:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.780+0000 7fd5c0454640 1 --2- 172.21.15.133:0/846220615 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd59c066470 0x7fd59c068930 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.780+0000 7fd5c0454640 1 --2- 172.21.15.133:0/846220615 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd5b80a8530 0x7fd5b81ec1d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.780+0000 7fd5c0454640 1 --2- 172.21.15.133:0/846220615 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd5b81513c0 0x7fd5b80a5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.780+0000 7fd5c0454640 1 --2- 172.21.15.133:0/846220615 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd5b80c22c0 0x7fd5b80a7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.780+0000 7fd5c0454640 1 -- 172.21.15.133:0/846220615 >> 172.21.15.133:0/846220615 conn(0x7fd5b80c5cd0 msgr2=0x7fd5b80707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.780+0000 7fd5c0454640 1 -- 172.21.15.133:0/846220615 shutdown_connections 2023-12-19T18:58:51.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.780+0000 7fd5c0454640 1 -- 172.21.15.133:0/846220615 wait complete. 2023-12-19T18:58:51.790 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-12-19T18:58:51.791 DEBUG:teuthology.parallel:result is None 2023-12-19T18:58:51.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.796+0000 7faa0629c640 1 -- 172.21.15.133:0/1469364083 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7faa0004e850 con 0x7faa0014b6c0 2023-12-19T18:58:51.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.796+0000 7fa9fcff9640 1 -- 172.21.15.133:0/1469364083 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa9f40f6fc0 con 0x7faa0014b6c0 2023-12-19T18:58:51.802 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2023-12-19T18:58:51.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2023-12-19T18:58:51.804 DEBUG:teuthology.parallel:result is None 2023-12-19T18:58:51.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.800+0000 7faa0629c640 1 -- 172.21.15.133:0/1469364083 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa9ec0664a0 msgr2=0x7fa9ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.800+0000 7faa0629c640 1 --2- 172.21.15.133:0/1469364083 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa9ec0664a0 0x7fa9ec068960 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa9f00016e0 tx=0x7fa9f0009040 comp rx=0 tx=0).stop 2023-12-19T18:58:51.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.800+0000 7faa0629c640 1 -- 172.21.15.133:0/1469364083 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faa0014b6c0 msgr2=0x7faa00141b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.800+0000 7faa0629c640 1 --2- 172.21.15.133:0/1469364083 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faa0014b6c0 0x7faa00141b40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4098070 tx=0x7fa9f4019420 comp rx=0 tx=0).stop 2023-12-19T18:58:51.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.800+0000 7faa0629c640 1 -- 172.21.15.133:0/1469364083 shutdown_connections 2023-12-19T18:58:51.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.800+0000 7faa0629c640 1 --2- 172.21.15.133:0/1469364083 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa9ec0664a0 0x7fa9ec068960 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.800+0000 7faa0629c640 1 --2- 172.21.15.133:0/1469364083 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faa0014b6c0 0x7faa00141b40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.800+0000 7faa0629c640 1 --2- 172.21.15.133:0/1469364083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faa00154a10 0x7faa00156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.800+0000 7faa0629c640 1 --2- 172.21.15.133:0/1469364083 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9e80052b0 0x7faa001e9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.800+0000 7faa0629c640 1 -- 172.21.15.133:0/1469364083 >> 172.21.15.133:0/1469364083 conn(0x7faa000a7910 msgr2=0x7faa000a7120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:51.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.800+0000 7faa0629c640 1 -- 172.21.15.133:0/1469364083 shutdown_connections 2023-12-19T18:58:51.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.800+0000 7faa0629c640 1 -- 172.21.15.133:0/1469364083 wait complete. 2023-12-19T18:58:51.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.816+0000 7f8aea69c640 1 -- 172.21.15.133:0/3233798759 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f8ac40057e0 con 0x7f8ae4159df0 2023-12-19T18:58:51.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.816+0000 7f8ad9ffb640 1 -- 172.21.15.133:0/3233798759 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8adc0ef6b0 con 0x7f8ae4159df0 2023-12-19T18:58:51.820 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2023-12-19T18:58:51.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.820+0000 7f8aea69c640 1 -- 172.21.15.133:0/3233798759 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8ac80664d0 msgr2=0x7f8ac8068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.820+0000 7f8aea69c640 1 --2- 172.21.15.133:0/3233798759 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8ac80664d0 0x7f8ac8068990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0000f70 tx=0x7f8ae0009040 comp rx=0 tx=0).stop 2023-12-19T18:58:51.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.820+0000 7f8aea69c640 1 -- 172.21.15.133:0/3233798759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ae4159df0 msgr2=0x7f8ae4070870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.820+0000 7f8aea69c640 1 --2- 172.21.15.133:0/3233798759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ae4159df0 0x7f8ae4070870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8adc01cda0 tx=0x7f8adc019660 comp rx=0 tx=0).stop 2023-12-19T18:58:51.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.820+0000 7f8aea69c640 1 -- 172.21.15.133:0/3233798759 shutdown_connections 2023-12-19T18:58:51.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.820+0000 7f8aea69c640 1 --2- 172.21.15.133:0/3233798759 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8ac80664d0 0x7f8ac8068990 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.820+0000 7f8aea69c640 1 --2- 172.21.15.133:0/3233798759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ae4159df0 0x7f8ae4070870 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.820+0000 7f8aea69c640 1 --2- 172.21.15.133:0/3233798759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ae40c1b40 0x7f8ae4154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.820+0000 7f8aea69c640 1 --2- 172.21.15.133:0/3233798759 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8ae40c09c0 0x7f8ae40711c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.820+0000 7f8aea69c640 1 -- 172.21.15.133:0/3233798759 >> 172.21.15.133:0/3233798759 conn(0x7f8ae40a7910 msgr2=0x7f8ae40c4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:51.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.820+0000 7f8aea69c640 1 -- 172.21.15.133:0/3233798759 shutdown_connections 2023-12-19T18:58:51.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.820+0000 7f8aea69c640 1 -- 172.21.15.133:0/3233798759 wait complete. 2023-12-19T18:58:51.826 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-12-19T18:58:51.826 DEBUG:teuthology.parallel:result is None 2023-12-19T18:58:51.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.836+0000 7f67f9110640 1 -- 172.21.15.133:0/2616715837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f67ec046b40 con 0x7f67ec045970 2023-12-19T18:58:51.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.836+0000 7f67f0ff9640 1 -- 172.21.15.133:0/2616715837 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f67e8054b30 con 0x7f67ec045970 2023-12-19T18:58:51.840 INFO:teuthology.orchestra.run.smithi133.stdout:55834574854 2023-12-19T18:58:51.842 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-12-19T18:58:51.843 DEBUG:teuthology.parallel:result is None 2023-12-19T18:58:51.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.836+0000 7f67f9110640 1 -- 172.21.15.133:0/2616715837 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f67d8066470 msgr2=0x7f67d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.836+0000 7f67f9110640 1 --2- 172.21.15.133:0/2616715837 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f67d8066470 0x7f67d8068930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f67e00ad000 tx=0x7f67e0008040 comp rx=0 tx=0).stop 2023-12-19T18:58:51.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.836+0000 7f67f9110640 1 -- 172.21.15.133:0/2616715837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67ec045970 msgr2=0x7f67ec17cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.836+0000 7f67f9110640 1 --2- 172.21.15.133:0/2616715837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67ec045970 0x7f67ec17cd40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f67e800b430 tx=0x7f67e800b8f0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.836+0000 7f67f9110640 1 -- 172.21.15.133:0/2616715837 shutdown_connections 2023-12-19T18:58:51.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.836+0000 7f67f9110640 1 --2- 172.21.15.133:0/2616715837 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f67d8066470 0x7f67d8068930 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.836+0000 7f67f9110640 1 --2- 172.21.15.133:0/2616715837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67ec045970 0x7f67ec17cd40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.836+0000 7f67f9110640 1 --2- 172.21.15.133:0/2616715837 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67ec0072e0 0x7f67ec17c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.836+0000 7f67f9110640 1 --2- 172.21.15.133:0/2616715837 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67ec006e80 0x7f67ec02c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.836+0000 7f67f9110640 1 -- 172.21.15.133:0/2616715837 >> 172.21.15.133:0/2616715837 conn(0x7f67ec048230 msgr2=0x7f67ec0d9050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:51.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.836+0000 7f67f9110640 1 -- 172.21.15.133:0/2616715837 shutdown_connections 2023-12-19T18:58:51.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.836+0000 7f67f9110640 1 -- 172.21.15.133:0/2616715837 wait complete. 2023-12-19T18:58:51.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.840+0000 7f3008980640 1 -- 172.21.15.133:0/184984293 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f300414f630 con 0x7f300406bd80 2023-12-19T18:58:51.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.840+0000 7f2ff2ffd640 1 -- 172.21.15.133:0/184984293 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2ffc024020 con 0x7f300406bd80 2023-12-19T18:58:51.845 INFO:teuthology.orchestra.run.smithi133.stdout:55834574855 2023-12-19T18:58:51.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.844+0000 7f3008980640 1 -- 172.21.15.133:0/184984293 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2fe4066540 msgr2=0x7f2fe4068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.844+0000 7f3008980640 1 --2- 172.21.15.133:0/184984293 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2fe4066540 0x7f2fe4068a00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80af000 tx=0x7f2ff8004740 comp rx=0 tx=0).stop 2023-12-19T18:58:51.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.844+0000 7f3008980640 1 -- 172.21.15.133:0/184984293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f300406bd80 msgr2=0x7f30040a9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:51.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.844+0000 7f3008980640 1 --2- 172.21.15.133:0/184984293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f300406bd80 0x7f30040a9230 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009fd0 tx=0x7f2ffc00d560 comp rx=0 tx=0).stop 2023-12-19T18:58:51.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.844+0000 7f3008980640 1 -- 172.21.15.133:0/184984293 shutdown_connections 2023-12-19T18:58:51.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.844+0000 7f3008980640 1 --2- 172.21.15.133:0/184984293 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2fe4066540 0x7f2fe4068a00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.844+0000 7f3008980640 1 --2- 172.21.15.133:0/184984293 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30040a8430 0x7f300414f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.844+0000 7f3008980640 1 --2- 172.21.15.133:0/184984293 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3004072080 0x7f30040715f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.844+0000 7f3008980640 1 --2- 172.21.15.133:0/184984293 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f300406bd80 0x7f30040a9230 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:51.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.844+0000 7f3008980640 1 -- 172.21.15.133:0/184984293 >> 172.21.15.133:0/184984293 conn(0x7f30040a7910 msgr2=0x7f30040c1900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:51.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.844+0000 7f3008980640 1 -- 172.21.15.133:0/184984293 shutdown_connections 2023-12-19T18:58:51.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:51.844+0000 7f3008980640 1 -- 172.21.15.133:0/184984293 wait complete. 2023-12-19T18:58:51.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-12-19T18:58:51.865 DEBUG:teuthology.parallel:result is None 2023-12-19T18:58:51.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-12-19T18:58:51.869 DEBUG:teuthology.parallel:result is None 2023-12-19T18:58:52.682 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-19T18:58:52.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.820+0000 7fcb17ce3640 1 Processor -- start 2023-12-19T18:58:52.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.820+0000 7fcb17ce3640 1 -- start start 2023-12-19T18:58:52.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.820+0000 7fcb17ce3640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcb1006d520 0x7fcb1015ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:52.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.820+0000 7fcb17ce3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb100bffc0 0x7fcb100c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:52.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.820+0000 7fcb17ce3640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb1015c600 con 0x7fcb101560e0 2023-12-19T18:58:52.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.820+0000 7fcb17ce3640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb1015a5c0 con 0x7fcb1006d520 2023-12-19T18:58:52.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.820+0000 7fcb17ce3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb101594e0 con 0x7fcb100bffc0 2023-12-19T18:58:52.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.820+0000 7fcb15a7f640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcb101560e0 0x7fcb10159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42624/0 (socket says 172.21.15.133:42624) 2023-12-19T18:58:52.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.820+0000 7fcb15a7f640 1 -- 172.21.15.133:0/1094846466 learned_addr learned my addr 172.21.15.133:0/1094846466 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:52.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.820+0000 7fcb1527e640 1 --2- 172.21.15.133:0/1094846466 >> v2:172.21.15.138:3300/0 conn(0x7fcb1006d520 0x7fcb1015ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:52.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.820+0000 7fcb16280640 1 --2- 172.21.15.133:0/1094846466 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb100bffc0 0x7fcb100c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:52.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.824+0000 7fcb1527e640 1 -- 172.21.15.133:0/1094846466 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb100bffc0 msgr2=0x7fcb100c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:52.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.824+0000 7fcb1527e640 1 --2- 172.21.15.133:0/1094846466 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb100bffc0 0x7fcb100c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:52.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.824+0000 7fcb1527e640 1 -- 172.21.15.133:0/1094846466 >> v1:172.21.15.133:6789/0 conn(0x7fcb101560e0 legacy=0x7fcb10159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:52.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.824+0000 7fcb14a7d640 1 -- 172.21.15.133:0/1094846466 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722404593 0 0) 0x7fcb1015c600 con 0x7fcb101560e0 2023-12-19T18:58:52.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.824+0000 7fcb1527e640 1 -- 172.21.15.133:0/1094846466 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb101597c0 con 0x7fcb1006d520 2023-12-19T18:58:52.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.824+0000 7fcb1527e640 1 --2- 172.21.15.133:0/1094846466 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb1006d520 0x7fcb1015ca90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcb000097c0 tx=0x7fcb0001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ea9cde281723524 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:52.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.824+0000 7fcb14a7d640 1 -- 172.21.15.133:0/1094846466 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb000ad660 con 0x7fcb1006d520 2023-12-19T18:58:52.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.824+0000 7fcb14a7d640 1 -- 172.21.15.133:0/1094846466 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb000ad7c0 con 0x7fcb1006d520 2023-12-19T18:58:52.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.824+0000 7fcb14a7d640 1 -- 172.21.15.133:0/1094846466 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb000adb50 con 0x7fcb1006d520 2023-12-19T18:58:52.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb17ce3640 1 -- 172.21.15.133:0/1094846466 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb1006d520 msgr2=0x7fcb1015ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:52.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb17ce3640 1 --2- 172.21.15.133:0/1094846466 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb1006d520 0x7fcb1015ca90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcb000097c0 tx=0x7fcb0001c450 comp rx=0 tx=0).stop 2023-12-19T18:58:52.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb17ce3640 1 -- 172.21.15.133:0/1094846466 shutdown_connections 2023-12-19T18:58:52.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb17ce3640 1 --2- 172.21.15.133:0/1094846466 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb100bffc0 0x7fcb100c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:52.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb17ce3640 1 --2- 172.21.15.133:0/1094846466 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb1006d520 0x7fcb1015ca90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:52.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb17ce3640 1 -- 172.21.15.133:0/1094846466 >> 172.21.15.133:0/1094846466 conn(0x7fcb1006a5b0 msgr2=0x7fcb1006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:52.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb17ce3640 1 -- 172.21.15.133:0/1094846466 shutdown_connections 2023-12-19T18:58:52.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb17ce3640 1 -- 172.21.15.133:0/1094846466 wait complete. 2023-12-19T18:58:52.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb17ce3640 1 Processor -- start 2023-12-19T18:58:52.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb17ce3640 1 -- start start 2023-12-19T18:58:52.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb17ce3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb1006d520 0x7fcb10157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:52.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb17ce3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb100bffc0 0x7fcb10150790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:52.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb17ce3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb101560e0 0x7fcb10150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:52.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb17ce3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb100a27b0 con 0x7fcb101560e0 2023-12-19T18:58:52.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb17ce3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb100a2a00 con 0x7fcb100bffc0 2023-12-19T18:58:52.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb17ce3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb10158790 con 0x7fcb1006d520 2023-12-19T18:58:52.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb16280640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb101560e0 0x7fcb10150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:52.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb16280640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb101560e0 0x7fcb10150cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54792/0 (socket says 172.21.15.133:54792) 2023-12-19T18:58:52.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb16280640 1 -- 172.21.15.133:0/1530441173 learned_addr learned my addr 172.21.15.133:0/1530441173 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:52.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb15a7f640 1 --2- 172.21.15.133:0/1530441173 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb1006d520 0x7fcb10157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:52.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb1527e640 1 --2- 172.21.15.133:0/1530441173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb100bffc0 0x7fcb10150790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:52.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb16280640 1 -- 172.21.15.133:0/1530441173 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb1006d520 msgr2=0x7fcb10157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:52.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb16280640 1 --2- 172.21.15.133:0/1530441173 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb1006d520 0x7fcb10157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:52.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb16280640 1 -- 172.21.15.133:0/1530441173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb100bffc0 msgr2=0x7fcb10150790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:52.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb16280640 1 --2- 172.21.15.133:0/1530441173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb100bffc0 0x7fcb10150790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:52.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb16280640 1 -- 172.21.15.133:0/1530441173 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb00009420 con 0x7fcb101560e0 2023-12-19T18:58:52.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb1527e640 1 --2- 172.21.15.133:0/1530441173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb100bffc0 0x7fcb10150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:52.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.828+0000 7fcb16280640 1 --2- 172.21.15.133:0/1530441173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb101560e0 0x7fcb10150cd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcb0800efc0 tx=0x7fcb0800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:52.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.832+0000 7fcb067fc640 1 -- 172.21.15.133:0/1530441173 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb08014480 con 0x7fcb101560e0 2023-12-19T18:58:52.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.832+0000 7fcb067fc640 1 -- 172.21.15.133:0/1530441173 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0800f040 con 0x7fcb101560e0 2023-12-19T18:58:52.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.832+0000 7fcb17ce3640 1 -- 172.21.15.133:0/1530441173 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb100a2d10 con 0x7fcb101560e0 2023-12-19T18:58:52.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.832+0000 7fcb067fc640 1 -- 172.21.15.133:0/1530441173 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb08014820 con 0x7fcb101560e0 2023-12-19T18:58:52.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.832+0000 7fcb17ce3640 1 -- 172.21.15.133:0/1530441173 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb100ab200 con 0x7fcb101560e0 2023-12-19T18:58:52.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.832+0000 7fcb17ce3640 1 -- 172.21.15.133:0/1530441173 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb10068400 con 0x7fcb101560e0 2023-12-19T18:58:52.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.832+0000 7fcb067fc640 1 -- 172.21.15.133:0/1530441173 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fcb08014980 con 0x7fcb101560e0 2023-12-19T18:58:52.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.832+0000 7fcb067fc640 1 --2- 172.21.15.133:0/1530441173 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcaf4066470 0x7fcaf4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:52.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.832+0000 7fcb067fc640 1 -- 172.21.15.133:0/1530441173 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb08084940 con 0x7fcb101560e0 2023-12-19T18:58:52.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.832+0000 7fcb15a7f640 1 --2- 172.21.15.133:0/1530441173 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcaf4066470 0x7fcaf4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:52.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.836+0000 7fcb15a7f640 1 --2- 172.21.15.133:0/1530441173 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcaf4066470 0x7fcaf4068930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c000f70 tx=0x7fcb0c007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:52.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.836+0000 7fcb067fc640 1 -- 172.21.15.133:0/1530441173 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fcb08051db0 con 0x7fcb101560e0 2023-12-19T18:58:52.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.988+0000 7fcb17ce3640 1 -- 172.21.15.133:0/1530441173 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcb101583b0 con 0x7fcb101560e0 2023-12-19T18:58:52.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.988+0000 7fcb067fc640 1 -- 172.21.15.133:0/1530441173 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcb08018090 con 0x7fcb101560e0 2023-12-19T18:58:52.993 INFO:teuthology.orchestra.run.smithi133.stdout:55834574856 2023-12-19T18:58:52.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.992+0000 7fcb17ce3640 1 -- 172.21.15.133:0/1530441173 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcaf4066470 msgr2=0x7fcaf4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:52.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.992+0000 7fcb17ce3640 1 --2- 172.21.15.133:0/1530441173 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcaf4066470 0x7fcaf4068930 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c000f70 tx=0x7fcb0c007df0 comp rx=0 tx=0).stop 2023-12-19T18:58:52.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.992+0000 7fcb17ce3640 1 -- 172.21.15.133:0/1530441173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb101560e0 msgr2=0x7fcb10150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:52.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.992+0000 7fcb17ce3640 1 --2- 172.21.15.133:0/1530441173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb101560e0 0x7fcb10150cd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fcb0800efc0 tx=0x7fcb0800c490 comp rx=0 tx=0).stop 2023-12-19T18:58:52.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.992+0000 7fcb17ce3640 1 -- 172.21.15.133:0/1530441173 shutdown_connections 2023-12-19T18:58:52.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.992+0000 7fcb17ce3640 1 --2- 172.21.15.133:0/1530441173 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcaf4066470 0x7fcaf4068930 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:52.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.992+0000 7fcb17ce3640 1 --2- 172.21.15.133:0/1530441173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcb101560e0 0x7fcb10150cd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:52.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.992+0000 7fcb17ce3640 1 --2- 172.21.15.133:0/1530441173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcb100bffc0 0x7fcb10150790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:52.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.992+0000 7fcb17ce3640 1 --2- 172.21.15.133:0/1530441173 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcb1006d520 0x7fcb10157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:52.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.992+0000 7fcb17ce3640 1 -- 172.21.15.133:0/1530441173 >> 172.21.15.133:0/1530441173 conn(0x7fcb1006a5b0 msgr2=0x7fcb1006fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:52.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.992+0000 7fcb17ce3640 1 -- 172.21.15.133:0/1530441173 shutdown_connections 2023-12-19T18:58:52.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:52.992+0000 7fcb17ce3640 1 -- 172.21.15.133:0/1530441173 wait complete. 2023-12-19T18:58:53.014 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2023-12-19T18:58:53.014 DEBUG:teuthology.parallel:result is None 2023-12-19T18:58:53.014 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-19T18:58:53.014 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T18:58:53.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.148+0000 7f79a3468640 1 Processor -- start 2023-12-19T18:58:53.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.148+0000 7f79a3468640 1 -- start start 2023-12-19T18:58:53.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.148+0000 7f79a3468640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f799c1560e0 0x7f799c15ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:53.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.148+0000 7f79a3468640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f799c06d520 0x7f799c159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:53.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.148+0000 7f79a3468640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f799c15c600 con 0x7f799c0bffc0 2023-12-19T18:58:53.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.148+0000 7f79a3468640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799c1594e0 con 0x7f799c06d520 2023-12-19T18:58:53.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.148+0000 7f79a3468640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799c1597c0 con 0x7f799c1560e0 2023-12-19T18:58:53.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.148+0000 7f79a1a05640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f799c0bffc0 0x7f799c0c1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42640/0 (socket says 172.21.15.133:42640) 2023-12-19T18:58:53.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.148+0000 7f79a1a05640 1 -- 172.21.15.133:0/2031327172 learned_addr learned my addr 172.21.15.133:0/2031327172 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:53.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.152+0000 7f79a1204640 1 --2- 172.21.15.133:0/2031327172 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f799c1560e0 0x7f799c15ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:53.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.152+0000 7f79a0a03640 1 --2- 172.21.15.133:0/2031327172 >> v2:172.21.15.138:3300/0 conn(0x7f799c06d520 0x7f799c159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:53.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.152+0000 7f7993fff640 1 -- 172.21.15.133:0/2031327172 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799115802 0 0) 0x7f799c15c600 con 0x7f799c0bffc0 2023-12-19T18:58:53.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.152+0000 7f7993fff640 1 -- 172.21.15.133:0/2031327172 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7988003530 con 0x7f799c0bffc0 2023-12-19T18:58:53.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.152+0000 7f7993fff640 1 -- 172.21.15.133:0/2031327172 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2640550479 0 0) 0x7f7988003530 con 0x7f799c0bffc0 2023-12-19T18:58:53.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.152+0000 7f79a0a03640 1 -- 172.21.15.133:0/2031327172 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f799c1560e0 msgr2=0x7f799c15ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:53.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.152+0000 7f79a0a03640 1 --2- 172.21.15.133:0/2031327172 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f799c1560e0 0x7f799c15ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:53.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.152+0000 7f79a0a03640 1 -- 172.21.15.133:0/2031327172 >> v1:172.21.15.133:6789/0 conn(0x7f799c0bffc0 legacy=0x7f799c0c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:53.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.152+0000 7f79a0a03640 1 -- 172.21.15.133:0/2031327172 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c15bfb0 con 0x7f799c06d520 2023-12-19T18:58:53.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.152+0000 7f79a0a03640 1 --2- 172.21.15.133:0/2031327172 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f799c06d520 0x7f799c159eb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f798c0097c0 tx=0x7f798c01c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cdbb823c6be05a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:53.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.152+0000 7f7993fff640 1 -- 172.21.15.133:0/2031327172 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c1566d0 con 0x7f799c06d520 2023-12-19T18:58:53.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.152+0000 7f7993fff640 1 -- 172.21.15.133:0/2031327172 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798c0a7050 con 0x7f799c06d520 2023-12-19T18:58:53.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.152+0000 7f7993fff640 1 -- 172.21.15.133:0/2031327172 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7994001a00 con 0x7f799c06d520 2023-12-19T18:58:53.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.156+0000 7f79a3468640 1 -- 172.21.15.133:0/2031327172 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f799c06d520 msgr2=0x7f799c159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:53.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.156+0000 7f79a3468640 1 --2- 172.21.15.133:0/2031327172 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f799c06d520 0x7f799c159eb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f798c0097c0 tx=0x7f798c01c370 comp rx=0 tx=0).stop 2023-12-19T18:58:53.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.156+0000 7f79a3468640 1 -- 172.21.15.133:0/2031327172 shutdown_connections 2023-12-19T18:58:53.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.156+0000 7f79a3468640 1 --2- 172.21.15.133:0/2031327172 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f799c06d520 0x7f799c159eb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:53.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.156+0000 7f79a3468640 1 --2- 172.21.15.133:0/2031327172 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f799c1560e0 0x7f799c15ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:53.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.156+0000 7f79a3468640 1 -- 172.21.15.133:0/2031327172 >> 172.21.15.133:0/2031327172 conn(0x7f799c06a5b0 msgr2=0x7f799c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:53.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.156+0000 7f79a3468640 1 -- 172.21.15.133:0/2031327172 shutdown_connections 2023-12-19T18:58:53.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.156+0000 7f79a3468640 1 -- 172.21.15.133:0/2031327172 wait complete. 2023-12-19T18:58:53.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.156+0000 7f79a3468640 1 Processor -- start 2023-12-19T18:58:53.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.156+0000 7f79a3468640 1 -- start start 2023-12-19T18:58:53.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.156+0000 7f79a3468640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f799c06d520 0x7f799c0bd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:53.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.156+0000 7f79a3468640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f799c0bffc0 0x7f799c0bc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:53.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.156+0000 7f79a3468640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f799c1560e0 0x7f799c0aa700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:53.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.156+0000 7f79a3468640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c0bfe10 con 0x7f799c1560e0 2023-12-19T18:58:53.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.156+0000 7f79a3468640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799c0a7020 con 0x7f799c0bffc0 2023-12-19T18:58:53.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.156+0000 7f79a3468640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f799c0a7300 con 0x7f799c06d520 2023-12-19T18:58:53.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.156+0000 7f79a1a05640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f799c1560e0 0x7f799c0aa700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:53.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.156+0000 7f79a1a05640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f799c1560e0 0x7f799c0aa700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54808/0 (socket says 172.21.15.133:54808) 2023-12-19T18:58:53.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.156+0000 7f79a1a05640 1 -- 172.21.15.133:0/1656515281 learned_addr learned my addr 172.21.15.133:0/1656515281 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:53.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.160+0000 7f79a1204640 1 --2- 172.21.15.133:0/1656515281 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f799c06d520 0x7f799c0bd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:53.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.160+0000 7f79a0a03640 1 --2- 172.21.15.133:0/1656515281 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f799c0bffc0 0x7f799c0bc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:53.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.160+0000 7f79a1a05640 1 -- 172.21.15.133:0/1656515281 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f799c06d520 msgr2=0x7f799c0bd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:53.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.160+0000 7f79a1a05640 1 --2- 172.21.15.133:0/1656515281 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f799c06d520 0x7f799c0bd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:53.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.160+0000 7f79a1a05640 1 -- 172.21.15.133:0/1656515281 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f799c0bffc0 msgr2=0x7f799c0bc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:53.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.160+0000 7f79a1a05640 1 --2- 172.21.15.133:0/1656515281 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f799c0bffc0 0x7f799c0bc8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:53.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.160+0000 7f79a1a05640 1 -- 172.21.15.133:0/1656515281 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798c009420 con 0x7f799c1560e0 2023-12-19T18:58:53.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.160+0000 7f79a1204640 1 --2- 172.21.15.133:0/1656515281 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f799c06d520 0x7f799c0bd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:53.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.160+0000 7f79a0a03640 1 --2- 172.21.15.133:0/1656515281 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f799c0bffc0 0x7f799c0bc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:53.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.160+0000 7f79a1a05640 1 --2- 172.21.15.133:0/1656515281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f799c1560e0 0x7f799c0aa700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f799400cc00 tx=0x7f799400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:53.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.160+0000 7f7991ffb640 1 -- 172.21.15.133:0/1656515281 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799400ce10 con 0x7f799c1560e0 2023-12-19T18:58:53.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.160+0000 7f7991ffb640 1 -- 172.21.15.133:0/1656515281 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7994012400 con 0x7f799c1560e0 2023-12-19T18:58:53.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.160+0000 7f7991ffb640 1 -- 172.21.15.133:0/1656515281 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79940127b0 con 0x7f799c1560e0 2023-12-19T18:58:53.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.160+0000 7f79a3468640 1 -- 172.21.15.133:0/1656515281 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799c0a8470 con 0x7f799c1560e0 2023-12-19T18:58:53.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.160+0000 7f79a3468640 1 -- 172.21.15.133:0/1656515281 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799c0bce00 con 0x7f799c1560e0 2023-12-19T18:58:53.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.160+0000 7f79a3468640 1 -- 172.21.15.133:0/1656515281 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f799c0a74c0 con 0x7f799c1560e0 2023-12-19T18:58:53.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.160+0000 7f7991ffb640 1 -- 172.21.15.133:0/1656515281 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7994012910 con 0x7f799c1560e0 2023-12-19T18:58:53.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.160+0000 7f7991ffb640 1 --2- 172.21.15.133:0/1656515281 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7980066470 0x7f7980068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:53.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.160+0000 7f7991ffb640 1 -- 172.21.15.133:0/1656515281 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7994084580 con 0x7f799c1560e0 2023-12-19T18:58:53.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.160+0000 7f79a1204640 1 --2- 172.21.15.133:0/1656515281 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7980066470 0x7f7980068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:53.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.164+0000 7f79a1204640 1 --2- 172.21.15.133:0/1656515281 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7980066470 0x7f7980068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7998009ae0 tx=0x7f7998008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:53.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.164+0000 7f7991ffb640 1 -- 172.21.15.133:0/1656515281 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f79940519f0 con 0x7f799c1560e0 2023-12-19T18:58:53.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.312+0000 7f79a3468640 1 -- 172.21.15.133:0/1656515281 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f799c0bc750 con 0x7f7980066470 2023-12-19T18:58:53.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.320+0000 7f7991ffb640 1 -- 172.21.15.133:0/1656515281 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264553 (secure 0 0 0) 0x7f799c0bc750 con 0x7f7980066470 2023-12-19T18:58:53.327 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:53.328 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T18:58:53.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.324+0000 7f79a3468640 1 -- 172.21.15.133:0/1656515281 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7980066470 msgr2=0x7f7980068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:53.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.324+0000 7f79a3468640 1 --2- 172.21.15.133:0/1656515281 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7980066470 0x7f7980068930 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7998009ae0 tx=0x7f7998008040 comp rx=0 tx=0).stop 2023-12-19T18:58:53.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.324+0000 7f79a3468640 1 -- 172.21.15.133:0/1656515281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f799c1560e0 msgr2=0x7f799c0aa700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:53.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.324+0000 7f79a3468640 1 --2- 172.21.15.133:0/1656515281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f799c1560e0 0x7f799c0aa700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f799400cc00 tx=0x7f799400a430 comp rx=0 tx=0).stop 2023-12-19T18:58:53.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.324+0000 7f79a3468640 1 -- 172.21.15.133:0/1656515281 shutdown_connections 2023-12-19T18:58:53.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.324+0000 7f79a3468640 1 --2- 172.21.15.133:0/1656515281 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7980066470 0x7f7980068930 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:53.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.324+0000 7f79a3468640 1 --2- 172.21.15.133:0/1656515281 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f799c1560e0 0x7f799c0aa700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:53.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.324+0000 7f79a3468640 1 --2- 172.21.15.133:0/1656515281 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f799c0bffc0 0x7f799c0bc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:53.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.324+0000 7f79a3468640 1 --2- 172.21.15.133:0/1656515281 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f799c06d520 0x7f799c0bd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:53.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.324+0000 7f79a3468640 1 -- 172.21.15.133:0/1656515281 >> 172.21.15.133:0/1656515281 conn(0x7f799c06a5b0 msgr2=0x7f799c0716c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:53.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.324+0000 7f79a3468640 1 -- 172.21.15.133:0/1656515281 shutdown_connections 2023-12-19T18:58:53.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.324+0000 7f79a3468640 1 -- 172.21.15.133:0/1656515281 wait complete. 2023-12-19T18:58:53.347 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-12-19T18:58:52.834173+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219012,"kb_used_data":2820,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2887680,"data_stored":1751817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.426071"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421033+0000","last_change":"2023-12-19T18:58:43.434692+0000","last_active":"2023-12-19T18:58:44.421033+0000","last_peered":"2023-12-19T18:58:44.421033+0000","last_clean":"2023-12-19T18:58:44.421033+0000","last_became_active":"2023-12-19T18:58:43.434368+0000","last_became_peered":"2023-12-19T18:58:43.434368+0000","last_unstale":"2023-12-19T18:58:44.421033+0000","last_undegraded":"2023-12-19T18:58:44.421033+0000","last_fullsized":"2023-12-19T18:58:44.421033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:46.807064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.416161+0000","last_change":"2023-12-19T18:58:43.425595+0000","last_active":"2023-12-19T18:58:44.416161+0000","last_peered":"2023-12-19T18:58:44.416161+0000","last_clean":"2023-12-19T18:58:44.416161+0000","last_became_active":"2023-12-19T18:58:43.425304+0000","last_became_peered":"2023-12-19T18:58:43.425304+0000","last_unstale":"2023-12-19T18:58:44.416161+0000","last_undegraded":"2023-12-19T18:58:44.416161+0000","last_fullsized":"2023-12-19T18:58:44.416161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:55:56.534047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544103+0000","last_change":"2023-12-19T18:58:43.415732+0000","last_active":"2023-12-19T18:58:45.544103+0000","last_peered":"2023-12-19T18:58:45.544103+0000","last_clean":"2023-12-19T18:58:45.544103+0000","last_became_active":"2023-12-19T18:58:43.415405+0000","last_became_peered":"2023-12-19T18:58:43.415405+0000","last_unstale":"2023-12-19T18:58:45.544103+0000","last_undegraded":"2023-12-19T18:58:45.544103+0000","last_fullsized":"2023-12-19T18:58:45.544103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:26.526749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544521+0000","last_change":"2023-12-19T18:58:43.441973+0000","last_active":"2023-12-19T18:58:45.544521+0000","last_peered":"2023-12-19T18:58:45.544521+0000","last_clean":"2023-12-19T18:58:45.544521+0000","last_became_active":"2023-12-19T18:58:43.437056+0000","last_became_peered":"2023-12-19T18:58:43.437056+0000","last_unstale":"2023-12-19T18:58:45.544521+0000","last_undegraded":"2023-12-19T18:58:45.544521+0000","last_fullsized":"2023-12-19T18:58:45.544521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:32.378596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420316+0000","last_change":"2023-12-19T18:58:43.427263+0000","last_active":"2023-12-19T18:58:44.420316+0000","last_peered":"2023-12-19T18:58:44.420316+0000","last_clean":"2023-12-19T18:58:44.420316+0000","last_became_active":"2023-12-19T18:58:43.426417+0000","last_became_peered":"2023-12-19T18:58:43.426417+0000","last_unstale":"2023-12-19T18:58:44.420316+0000","last_undegraded":"2023-12-19T18:58:44.420316+0000","last_fullsized":"2023-12-19T18:58:44.420316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:55:56.534047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544646+0000","last_change":"2023-12-19T18:58:43.438027+0000","last_active":"2023-12-19T18:58:45.544646+0000","last_peered":"2023-12-19T18:58:45.544646+0000","last_clean":"2023-12-19T18:58:45.544646+0000","last_became_active":"2023-12-19T18:58:43.437711+0000","last_became_peered":"2023-12-19T18:58:43.437711+0000","last_unstale":"2023-12-19T18:58:45.544646+0000","last_undegraded":"2023-12-19T18:58:45.544646+0000","last_fullsized":"2023-12-19T18:58:45.544646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:59:46.730223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420590+0000","last_change":"2023-12-19T18:58:43.431331+0000","last_active":"2023-12-19T18:58:44.420590+0000","last_peered":"2023-12-19T18:58:44.420590+0000","last_clean":"2023-12-19T18:58:44.420590+0000","last_became_active":"2023-12-19T18:58:43.430968+0000","last_became_peered":"2023-12-19T18:58:43.430968+0000","last_unstale":"2023-12-19T18:58:44.420590+0000","last_undegraded":"2023-12-19T18:58:44.420590+0000","last_fullsized":"2023-12-19T18:58:44.420590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:32:14.763407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792363+0000","last_change":"2023-12-19T18:58:43.443194+0000","last_active":"2023-12-19T18:58:44.792363+0000","last_peered":"2023-12-19T18:58:44.792363+0000","last_clean":"2023-12-19T18:58:44.792363+0000","last_became_active":"2023-12-19T18:58:43.442961+0000","last_became_peered":"2023-12-19T18:58:43.442961+0000","last_unstale":"2023-12-19T18:58:44.792363+0000","last_undegraded":"2023-12-19T18:58:44.792363+0000","last_fullsized":"2023-12-19T18:58:44.792363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:30.896504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421106+0000","last_change":"2023-12-19T18:58:43.443640+0000","last_active":"2023-12-19T18:58:44.421106+0000","last_peered":"2023-12-19T18:58:44.421106+0000","last_clean":"2023-12-19T18:58:44.421106+0000","last_became_active":"2023-12-19T18:58:43.443310+0000","last_became_peered":"2023-12-19T18:58:43.443310+0000","last_unstale":"2023-12-19T18:58:44.421106+0000","last_undegraded":"2023-12-19T18:58:44.421106+0000","last_fullsized":"2023-12-19T18:58:44.421106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:43:58.809550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544614+0000","last_change":"2023-12-19T18:58:43.445525+0000","last_active":"2023-12-19T18:58:45.544614+0000","last_peered":"2023-12-19T18:58:45.544614+0000","last_clean":"2023-12-19T18:58:45.544614+0000","last_became_active":"2023-12-19T18:58:43.445220+0000","last_became_peered":"2023-12-19T18:58:43.445220+0000","last_unstale":"2023-12-19T18:58:45.544614+0000","last_undegraded":"2023-12-19T18:58:45.544614+0000","last_fullsized":"2023-12-19T18:58:45.544614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:46.373291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544393+0000","last_change":"2023-12-19T18:58:43.439159+0000","last_active":"2023-12-19T18:58:45.544393+0000","last_peered":"2023-12-19T18:58:45.544393+0000","last_clean":"2023-12-19T18:58:45.544393+0000","last_became_active":"2023-12-19T18:58:43.438873+0000","last_became_peered":"2023-12-19T18:58:43.438873+0000","last_unstale":"2023-12-19T18:58:45.544393+0000","last_undegraded":"2023-12-19T18:58:45.544393+0000","last_fullsized":"2023-12-19T18:58:45.544393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:07.498358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421186+0000","last_change":"2023-12-19T18:58:43.432338+0000","last_active":"2023-12-19T18:58:44.421186+0000","last_peered":"2023-12-19T18:58:44.421186+0000","last_clean":"2023-12-19T18:58:44.421186+0000","last_became_active":"2023-12-19T18:58:43.431137+0000","last_became_peered":"2023-12-19T18:58:43.431137+0000","last_unstale":"2023-12-19T18:58:44.421186+0000","last_undegraded":"2023-12-19T18:58:44.421186+0000","last_fullsized":"2023-12-19T18:58:44.421186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:36.989421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792689+0000","last_change":"2023-12-19T18:58:43.426477+0000","last_active":"2023-12-19T18:58:44.792689+0000","last_peered":"2023-12-19T18:58:44.792689+0000","last_clean":"2023-12-19T18:58:44.792689+0000","last_became_active":"2023-12-19T18:58:43.426194+0000","last_became_peered":"2023-12-19T18:58:43.426194+0000","last_unstale":"2023-12-19T18:58:44.792689+0000","last_undegraded":"2023-12-19T18:58:44.792689+0000","last_fullsized":"2023-12-19T18:58:44.792689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:55:56.534047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543864+0000","last_change":"2023-12-19T18:58:43.423155+0000","last_active":"2023-12-19T18:58:45.543864+0000","last_peered":"2023-12-19T18:58:45.543864+0000","last_clean":"2023-12-19T18:58:45.543864+0000","last_became_active":"2023-12-19T18:58:43.422822+0000","last_became_peered":"2023-12-19T18:58:43.422822+0000","last_unstale":"2023-12-19T18:58:45.543864+0000","last_undegraded":"2023-12-19T18:58:45.543864+0000","last_fullsized":"2023-12-19T18:58:45.543864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:24:58.295768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415715+0000","last_change":"2023-12-19T18:58:43.438543+0000","last_active":"2023-12-19T18:58:44.415715+0000","last_peered":"2023-12-19T18:58:44.415715+0000","last_clean":"2023-12-19T18:58:44.415715+0000","last_became_active":"2023-12-19T18:58:43.438178+0000","last_became_peered":"2023-12-19T18:58:43.438178+0000","last_unstale":"2023-12-19T18:58:44.415715+0000","last_undegraded":"2023-12-19T18:58:44.415715+0000","last_fullsized":"2023-12-19T18:58:44.415715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:44:04.102356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544103+0000","last_change":"2023-12-19T18:58:43.439649+0000","last_active":"2023-12-19T18:58:45.544103+0000","last_peered":"2023-12-19T18:58:45.544103+0000","last_clean":"2023-12-19T18:58:45.544103+0000","last_became_active":"2023-12-19T18:58:43.436212+0000","last_became_peered":"2023-12-19T18:58:43.436212+0000","last_unstale":"2023-12-19T18:58:45.544103+0000","last_undegraded":"2023-12-19T18:58:45.544103+0000","last_fullsized":"2023-12-19T18:58:45.544103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:07.765261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.545316+0000","last_change":"2023-12-19T18:58:43.441777+0000","last_active":"2023-12-19T18:58:45.545316+0000","last_peered":"2023-12-19T18:58:45.545316+0000","last_clean":"2023-12-19T18:58:45.545316+0000","last_became_active":"2023-12-19T18:58:43.437882+0000","last_became_peered":"2023-12-19T18:58:43.437882+0000","last_unstale":"2023-12-19T18:58:45.545316+0000","last_undegraded":"2023-12-19T18:58:45.545316+0000","last_fullsized":"2023-12-19T18:58:45.545316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:30:56.565777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543404+0000","last_change":"2023-12-19T18:58:43.430270+0000","last_active":"2023-12-19T18:58:45.543404+0000","last_peered":"2023-12-19T18:58:45.543404+0000","last_clean":"2023-12-19T18:58:45.543404+0000","last_became_active":"2023-12-19T18:58:43.429986+0000","last_became_peered":"2023-12-19T18:58:43.429986+0000","last_unstale":"2023-12-19T18:58:45.543404+0000","last_undegraded":"2023-12-19T18:58:45.543404+0000","last_fullsized":"2023-12-19T18:58:45.543404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:36.989421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420819+0000","last_change":"2023-12-19T18:58:43.427486+0000","last_active":"2023-12-19T18:58:44.420819+0000","last_peered":"2023-12-19T18:58:44.420819+0000","last_clean":"2023-12-19T18:58:44.420819+0000","last_became_active":"2023-12-19T18:58:43.427113+0000","last_became_peered":"2023-12-19T18:58:43.427113+0000","last_unstale":"2023-12-19T18:58:44.420819+0000","last_undegraded":"2023-12-19T18:58:44.420819+0000","last_fullsized":"2023-12-19T18:58:44.420819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:11:18.747856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544490+0000","last_change":"2023-12-19T18:58:43.428892+0000","last_active":"2023-12-19T18:58:45.544490+0000","last_peered":"2023-12-19T18:58:45.544490+0000","last_clean":"2023-12-19T18:58:45.544490+0000","last_became_active":"2023-12-19T18:58:43.428437+0000","last_became_peered":"2023-12-19T18:58:43.428437+0000","last_unstale":"2023-12-19T18:58:45.544490+0000","last_undegraded":"2023-12-19T18:58:45.544490+0000","last_fullsized":"2023-12-19T18:58:45.544490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:44:04.102356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544150+0000","last_change":"2023-12-19T18:58:43.426615+0000","last_active":"2023-12-19T18:58:45.544150+0000","last_peered":"2023-12-19T18:58:45.544150+0000","last_clean":"2023-12-19T18:58:45.544150+0000","last_became_active":"2023-12-19T18:58:43.426300+0000","last_became_peered":"2023-12-19T18:58:43.426300+0000","last_unstale":"2023-12-19T18:58:45.544150+0000","last_undegraded":"2023-12-19T18:58:45.544150+0000","last_fullsized":"2023-12-19T18:58:45.544150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:30.896504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544725+0000","last_change":"2023-12-19T18:58:43.436630+0000","last_active":"2023-12-19T18:58:45.544725+0000","last_peered":"2023-12-19T18:58:45.544725+0000","last_clean":"2023-12-19T18:58:45.544725+0000","last_became_active":"2023-12-19T18:58:43.436310+0000","last_became_peered":"2023-12-19T18:58:43.436310+0000","last_unstale":"2023-12-19T18:58:45.544725+0000","last_undegraded":"2023-12-19T18:58:45.544725+0000","last_fullsized":"2023-12-19T18:58:45.544725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:25:40.712335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792474+0000","last_change":"2023-12-19T18:58:43.432208+0000","last_active":"2023-12-19T18:58:44.792474+0000","last_peered":"2023-12-19T18:58:44.792474+0000","last_clean":"2023-12-19T18:58:44.792474+0000","last_became_active":"2023-12-19T18:58:43.431859+0000","last_became_peered":"2023-12-19T18:58:43.431859+0000","last_unstale":"2023-12-19T18:58:44.792474+0000","last_undegraded":"2023-12-19T18:58:44.792474+0000","last_fullsized":"2023-12-19T18:58:44.792474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:44:04.102356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544165+0000","last_change":"2023-12-19T18:58:43.439545+0000","last_active":"2023-12-19T18:58:45.544165+0000","last_peered":"2023-12-19T18:58:45.544165+0000","last_clean":"2023-12-19T18:58:45.544165+0000","last_became_active":"2023-12-19T18:58:43.436090+0000","last_became_peered":"2023-12-19T18:58:43.436090+0000","last_unstale":"2023-12-19T18:58:45.544165+0000","last_undegraded":"2023-12-19T18:58:45.544165+0000","last_fullsized":"2023-12-19T18:58:45.544165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:55:56.534047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792862+0000","last_change":"2023-12-19T18:58:43.430119+0000","last_active":"2023-12-19T18:58:44.792862+0000","last_peered":"2023-12-19T18:58:44.792862+0000","last_clean":"2023-12-19T18:58:44.792862+0000","last_became_active":"2023-12-19T18:58:43.429836+0000","last_became_peered":"2023-12-19T18:58:43.429836+0000","last_unstale":"2023-12-19T18:58:44.792862+0000","last_undegraded":"2023-12-19T18:58:44.792862+0000","last_fullsized":"2023-12-19T18:58:44.792862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:59:46.730223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544665+0000","last_change":"2023-12-19T18:58:43.427764+0000","last_active":"2023-12-19T18:58:45.544665+0000","last_peered":"2023-12-19T18:58:45.544665+0000","last_clean":"2023-12-19T18:58:45.544665+0000","last_became_active":"2023-12-19T18:58:43.427468+0000","last_became_peered":"2023-12-19T18:58:43.427468+0000","last_unstale":"2023-12-19T18:58:45.544665+0000","last_undegraded":"2023-12-19T18:58:45.544665+0000","last_fullsized":"2023-12-19T18:58:45.544665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:34.691494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415960+0000","last_change":"2023-12-19T18:58:43.426942+0000","last_active":"2023-12-19T18:58:44.415960+0000","last_peered":"2023-12-19T18:58:44.415960+0000","last_clean":"2023-12-19T18:58:44.415960+0000","last_became_active":"2023-12-19T18:58:43.425745+0000","last_became_peered":"2023-12-19T18:58:43.425745+0000","last_unstale":"2023-12-19T18:58:44.415960+0000","last_undegraded":"2023-12-19T18:58:44.415960+0000","last_fullsized":"2023-12-19T18:58:44.415960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:07.765261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792753+0000","last_change":"2023-12-19T18:58:43.429529+0000","last_active":"2023-12-19T18:58:44.792753+0000","last_peered":"2023-12-19T18:58:44.792753+0000","last_clean":"2023-12-19T18:58:44.792753+0000","last_became_active":"2023-12-19T18:58:43.429246+0000","last_became_peered":"2023-12-19T18:58:43.429246+0000","last_unstale":"2023-12-19T18:58:44.792753+0000","last_undegraded":"2023-12-19T18:58:44.792753+0000","last_fullsized":"2023-12-19T18:58:44.792753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:32.378596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544186+0000","last_change":"2023-12-19T18:58:43.418652+0000","last_active":"2023-12-19T18:58:45.544186+0000","last_peered":"2023-12-19T18:58:45.544186+0000","last_clean":"2023-12-19T18:58:45.544186+0000","last_became_active":"2023-12-19T18:58:43.418300+0000","last_became_peered":"2023-12-19T18:58:43.418300+0000","last_unstale":"2023-12-19T18:58:45.544186+0000","last_undegraded":"2023-12-19T18:58:45.544186+0000","last_fullsized":"2023-12-19T18:58:45.544186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:07.498358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544797+0000","last_change":"2023-12-19T18:58:43.442141+0000","last_active":"2023-12-19T18:58:45.544797+0000","last_peered":"2023-12-19T18:58:45.544797+0000","last_clean":"2023-12-19T18:58:45.544797+0000","last_became_active":"2023-12-19T18:58:43.437293+0000","last_became_peered":"2023-12-19T18:58:43.437293+0000","last_unstale":"2023-12-19T18:58:45.544797+0000","last_undegraded":"2023-12-19T18:58:45.544797+0000","last_fullsized":"2023-12-19T18:58:45.544797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:19:43.614230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543333+0000","last_change":"2023-12-19T18:58:43.436463+0000","last_active":"2023-12-19T18:58:45.543333+0000","last_peered":"2023-12-19T18:58:45.543333+0000","last_clean":"2023-12-19T18:58:45.543333+0000","last_became_active":"2023-12-19T18:58:43.436125+0000","last_became_peered":"2023-12-19T18:58:43.436125+0000","last_unstale":"2023-12-19T18:58:45.543333+0000","last_undegraded":"2023-12-19T18:58:45.543333+0000","last_fullsized":"2023-12-19T18:58:45.543333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:25:24.585530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544116+0000","last_change":"2023-12-19T18:58:43.426344+0000","last_active":"2023-12-19T18:58:45.544116+0000","last_peered":"2023-12-19T18:58:45.544116+0000","last_clean":"2023-12-19T18:58:45.544116+0000","last_became_active":"2023-12-19T18:58:43.425807+0000","last_became_peered":"2023-12-19T18:58:43.425807+0000","last_unstale":"2023-12-19T18:58:45.544116+0000","last_undegraded":"2023-12-19T18:58:45.544116+0000","last_fullsized":"2023-12-19T18:58:45.544116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:30.896504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420034+0000","last_change":"2023-12-19T18:58:43.426070+0000","last_active":"2023-12-19T18:58:44.420034+0000","last_peered":"2023-12-19T18:58:44.420034+0000","last_clean":"2023-12-19T18:58:44.420034+0000","last_became_active":"2023-12-19T18:58:43.425735+0000","last_became_peered":"2023-12-19T18:58:43.425735+0000","last_unstale":"2023-12-19T18:58:44.420034+0000","last_undegraded":"2023-12-19T18:58:44.420034+0000","last_fullsized":"2023-12-19T18:58:44.420034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:18:46.854237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792732+0000","last_change":"2023-12-19T18:58:42.421402+0000","last_active":"2023-12-19T18:58:44.792732+0000","last_peered":"2023-12-19T18:58:44.792732+0000","last_clean":"2023-12-19T18:58:44.792732+0000","last_became_active":"2023-12-19T18:58:42.420945+0000","last_became_peered":"2023-12-19T18:58:42.420945+0000","last_unstale":"2023-12-19T18:58:44.792732+0000","last_undegraded":"2023-12-19T18:58:44.792732+0000","last_fullsized":"2023-12-19T18:58:44.792732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:15.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544251+0000","last_change":"2023-12-19T18:58:43.422547+0000","last_active":"2023-12-19T18:58:45.544251+0000","last_peered":"2023-12-19T18:58:45.544251+0000","last_clean":"2023-12-19T18:58:45.544251+0000","last_became_active":"2023-12-19T18:58:43.422273+0000","last_became_peered":"2023-12-19T18:58:43.422273+0000","last_unstale":"2023-12-19T18:58:45.544251+0000","last_undegraded":"2023-12-19T18:58:45.544251+0000","last_fullsized":"2023-12-19T18:58:45.544251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:34.691494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544557+0000","last_change":"2023-12-19T18:58:42.417459+0000","last_active":"2023-12-19T18:58:45.544557+0000","last_peered":"2023-12-19T18:58:45.544557+0000","last_clean":"2023-12-19T18:58:45.544557+0000","last_became_active":"2023-12-19T18:58:42.416914+0000","last_became_peered":"2023-12-19T18:58:42.416914+0000","last_unstale":"2023-12-19T18:58:45.544557+0000","last_undegraded":"2023-12-19T18:58:45.544557+0000","last_fullsized":"2023-12-19T18:58:45.544557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:24:57.289171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792561+0000","last_change":"2023-12-19T18:58:42.420750+0000","last_active":"2023-12-19T18:58:44.792561+0000","last_peered":"2023-12-19T18:58:44.792561+0000","last_clean":"2023-12-19T18:58:44.792561+0000","last_became_active":"2023-12-19T18:58:42.420475+0000","last_became_peered":"2023-12-19T18:58:42.420475+0000","last_unstale":"2023-12-19T18:58:44.792561+0000","last_undegraded":"2023-12-19T18:58:44.792561+0000","last_fullsized":"2023-12-19T18:58:44.792561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:24:57.289171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792463+0000","last_change":"2023-12-19T18:58:43.424478+0000","last_active":"2023-12-19T18:58:44.792463+0000","last_peered":"2023-12-19T18:58:44.792463+0000","last_clean":"2023-12-19T18:58:44.792463+0000","last_became_active":"2023-12-19T18:58:43.424162+0000","last_became_peered":"2023-12-19T18:58:43.424162+0000","last_unstale":"2023-12-19T18:58:44.792463+0000","last_undegraded":"2023-12-19T18:58:44.792463+0000","last_fullsized":"2023-12-19T18:58:44.792463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:07.498358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544259+0000","last_change":"2023-12-19T18:58:42.435884+0000","last_active":"2023-12-19T18:58:45.544259+0000","last_peered":"2023-12-19T18:58:45.544259+0000","last_clean":"2023-12-19T18:58:45.544259+0000","last_became_active":"2023-12-19T18:58:42.435572+0000","last_became_peered":"2023-12-19T18:58:42.435572+0000","last_unstale":"2023-12-19T18:58:45.544259+0000","last_undegraded":"2023-12-19T18:58:45.544259+0000","last_fullsized":"2023-12-19T18:58:45.544259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:18:45.847639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415691+0000","last_change":"2023-12-19T18:58:43.424552+0000","last_active":"2023-12-19T18:58:44.415691+0000","last_peered":"2023-12-19T18:58:44.415691+0000","last_clean":"2023-12-19T18:58:44.415691+0000","last_became_active":"2023-12-19T18:58:43.424115+0000","last_became_peered":"2023-12-19T18:58:43.424115+0000","last_unstale":"2023-12-19T18:58:44.415691+0000","last_undegraded":"2023-12-19T18:58:44.415691+0000","last_fullsized":"2023-12-19T18:58:44.415691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:07.498358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544787+0000","last_change":"2023-12-19T18:58:42.428211+0000","last_active":"2023-12-19T18:58:45.544787+0000","last_peered":"2023-12-19T18:58:45.544787+0000","last_clean":"2023-12-19T18:58:45.544787+0000","last_became_active":"2023-12-19T18:58:42.427932+0000","last_became_peered":"2023-12-19T18:58:42.427932+0000","last_unstale":"2023-12-19T18:58:45.544787+0000","last_undegraded":"2023-12-19T18:58:45.544787+0000","last_fullsized":"2023-12-19T18:58:45.544787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:15.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.545103+0000","last_change":"2023-12-19T18:58:43.436839+0000","last_active":"2023-12-19T18:58:45.545103+0000","last_peered":"2023-12-19T18:58:45.545103+0000","last_clean":"2023-12-19T18:58:45.545103+0000","last_became_active":"2023-12-19T18:58:43.436507+0000","last_became_peered":"2023-12-19T18:58:43.436507+0000","last_unstale":"2023-12-19T18:58:45.545103+0000","last_undegraded":"2023-12-19T18:58:45.545103+0000","last_fullsized":"2023-12-19T18:58:45.545103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:11:18.747856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.545217+0000","last_change":"2023-12-19T18:58:42.435020+0000","last_active":"2023-12-19T18:58:45.545217+0000","last_peered":"2023-12-19T18:58:45.545217+0000","last_clean":"2023-12-19T18:58:45.545217+0000","last_became_active":"2023-12-19T18:58:42.434748+0000","last_became_peered":"2023-12-19T18:58:42.434748+0000","last_unstale":"2023-12-19T18:58:45.545217+0000","last_undegraded":"2023-12-19T18:58:45.545217+0000","last_fullsized":"2023-12-19T18:58:45.545217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:33.684897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544236+0000","last_change":"2023-12-19T18:58:43.440137+0000","last_active":"2023-12-19T18:58:45.544236+0000","last_peered":"2023-12-19T18:58:45.544236+0000","last_clean":"2023-12-19T18:58:45.544236+0000","last_became_active":"2023-12-19T18:58:43.439838+0000","last_became_peered":"2023-12-19T18:58:43.439838+0000","last_unstale":"2023-12-19T18:58:45.544236+0000","last_undegraded":"2023-12-19T18:58:45.544236+0000","last_fullsized":"2023-12-19T18:58:45.544236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:44:04.102356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415975+0000","last_change":"2023-12-19T18:58:42.435783+0000","last_active":"2023-12-19T18:58:44.415975+0000","last_peered":"2023-12-19T18:58:44.415975+0000","last_clean":"2023-12-19T18:58:44.415975+0000","last_became_active":"2023-12-19T18:58:42.435495+0000","last_became_peered":"2023-12-19T18:58:42.435495+0000","last_unstale":"2023-12-19T18:58:44.415975+0000","last_undegraded":"2023-12-19T18:58:44.415975+0000","last_fullsized":"2023-12-19T18:58:44.415975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:22:52.459401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421296+0000","last_change":"2023-12-19T18:58:43.430940+0000","last_active":"2023-12-19T18:58:44.421296+0000","last_peered":"2023-12-19T18:58:44.421296+0000","last_clean":"2023-12-19T18:58:44.421296+0000","last_became_active":"2023-12-19T18:58:43.430070+0000","last_became_peered":"2023-12-19T18:58:43.430070+0000","last_unstale":"2023-12-19T18:58:44.421296+0000","last_undegraded":"2023-12-19T18:58:44.421296+0000","last_fullsized":"2023-12-19T18:58:44.421296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:09:00.031482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544605+0000","last_change":"2023-12-19T18:58:42.427819+0000","last_active":"2023-12-19T18:58:45.544605+0000","last_peered":"2023-12-19T18:58:45.544605+0000","last_clean":"2023-12-19T18:58:45.544605+0000","last_became_active":"2023-12-19T18:58:42.426979+0000","last_became_peered":"2023-12-19T18:58:42.426979+0000","last_unstale":"2023-12-19T18:58:45.544605+0000","last_undegraded":"2023-12-19T18:58:45.544605+0000","last_fullsized":"2023-12-19T18:58:45.544605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:22:52.459401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420420+0000","last_change":"2023-12-19T18:58:43.430761+0000","last_active":"2023-12-19T18:58:44.420420+0000","last_peered":"2023-12-19T18:58:44.420420+0000","last_clean":"2023-12-19T18:58:44.420420+0000","last_became_active":"2023-12-19T18:58:43.430368+0000","last_became_peered":"2023-12-19T18:58:43.430368+0000","last_unstale":"2023-12-19T18:58:44.420420+0000","last_undegraded":"2023-12-19T18:58:44.420420+0000","last_fullsized":"2023-12-19T18:58:44.420420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:32.378596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544283+0000","last_change":"2023-12-19T18:58:42.420964+0000","last_active":"2023-12-19T18:58:45.544283+0000","last_peered":"2023-12-19T18:58:45.544283+0000","last_clean":"2023-12-19T18:58:45.544283+0000","last_became_active":"2023-12-19T18:58:42.420575+0000","last_became_peered":"2023-12-19T18:58:42.420575+0000","last_unstale":"2023-12-19T18:58:45.544283+0000","last_undegraded":"2023-12-19T18:58:45.544283+0000","last_fullsized":"2023-12-19T18:58:45.544283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:20:03.601498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543924+0000","last_change":"2023-12-19T18:58:43.426664+0000","last_active":"2023-12-19T18:58:45.543924+0000","last_peered":"2023-12-19T18:58:45.543924+0000","last_clean":"2023-12-19T18:58:45.543924+0000","last_became_active":"2023-12-19T18:58:43.426272+0000","last_became_peered":"2023-12-19T18:58:43.426272+0000","last_unstale":"2023-12-19T18:58:45.543924+0000","last_undegraded":"2023-12-19T18:58:45.543924+0000","last_fullsized":"2023-12-19T18:58:45.543924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:22:53.465998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544822+0000","last_change":"2023-12-19T18:58:42.430255+0000","last_active":"2023-12-19T18:58:45.544822+0000","last_peered":"2023-12-19T18:58:45.544822+0000","last_clean":"2023-12-19T18:58:45.544822+0000","last_became_active":"2023-12-19T18:58:42.429287+0000","last_became_peered":"2023-12-19T18:58:42.429287+0000","last_unstale":"2023-12-19T18:58:45.544822+0000","last_undegraded":"2023-12-19T18:58:45.544822+0000","last_fullsized":"2023-12-19T18:58:45.544822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:06.491761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420450+0000","last_change":"2023-12-19T18:58:43.432077+0000","last_active":"2023-12-19T18:58:44.420450+0000","last_peered":"2023-12-19T18:58:44.420450+0000","last_clean":"2023-12-19T18:58:44.420450+0000","last_became_active":"2023-12-19T18:58:43.431749+0000","last_became_peered":"2023-12-19T18:58:43.431749+0000","last_unstale":"2023-12-19T18:58:44.420450+0000","last_undegraded":"2023-12-19T18:58:44.420450+0000","last_fullsized":"2023-12-19T18:58:44.420450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:25:40.712335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544133+0000","last_change":"2023-12-19T18:58:42.419392+0000","last_active":"2023-12-19T18:58:45.544133+0000","last_peered":"2023-12-19T18:58:45.544133+0000","last_clean":"2023-12-19T18:58:45.544133+0000","last_became_active":"2023-12-19T18:58:42.418044+0000","last_became_peered":"2023-12-19T18:58:42.418044+0000","last_unstale":"2023-12-19T18:58:45.544133+0000","last_undegraded":"2023-12-19T18:58:45.544133+0000","last_fullsized":"2023-12-19T18:58:45.544133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:08:59.024885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544117+0000","last_change":"2023-12-19T18:58:43.426612+0000","last_active":"2023-12-19T18:58:45.544117+0000","last_peered":"2023-12-19T18:58:45.544117+0000","last_clean":"2023-12-19T18:58:45.544117+0000","last_became_active":"2023-12-19T18:58:43.426075+0000","last_became_peered":"2023-12-19T18:58:43.426075+0000","last_unstale":"2023-12-19T18:58:45.544117+0000","last_undegraded":"2023-12-19T18:58:45.544117+0000","last_fullsized":"2023-12-19T18:58:45.544117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:26.526749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543436+0000","last_change":"2023-12-19T18:58:42.427250+0000","last_active":"2023-12-19T18:58:45.543436+0000","last_peered":"2023-12-19T18:58:45.543436+0000","last_clean":"2023-12-19T18:58:45.543436+0000","last_became_active":"2023-12-19T18:58:42.426896+0000","last_became_peered":"2023-12-19T18:58:42.426896+0000","last_unstale":"2023-12-19T18:58:45.543436+0000","last_undegraded":"2023-12-19T18:58:45.543436+0000","last_fullsized":"2023-12-19T18:58:45.543436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:33:01.472458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420680+0000","last_change":"2023-12-19T18:58:43.441063+0000","last_active":"2023-12-19T18:58:44.420680+0000","last_peered":"2023-12-19T18:58:44.420680+0000","last_clean":"2023-12-19T18:58:44.420680+0000","last_became_active":"2023-12-19T18:58:43.440785+0000","last_became_peered":"2023-12-19T18:58:43.440785+0000","last_unstale":"2023-12-19T18:58:44.420680+0000","last_undegraded":"2023-12-19T18:58:44.420680+0000","last_fullsized":"2023-12-19T18:58:44.420680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:28.581319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421328+0000","last_change":"2023-12-19T18:58:42.422976+0000","last_active":"2023-12-19T18:58:44.421328+0000","last_peered":"2023-12-19T18:58:44.421328+0000","last_clean":"2023-12-19T18:58:44.421328+0000","last_became_active":"2023-12-19T18:58:42.422636+0000","last_became_peered":"2023-12-19T18:58:42.422636+0000","last_unstale":"2023-12-19T18:58:44.421328+0000","last_undegraded":"2023-12-19T18:58:44.421328+0000","last_fullsized":"2023-12-19T18:58:44.421328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:33:01.472458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420427+0000","last_change":"2023-12-19T18:58:43.440387+0000","last_active":"2023-12-19T18:58:44.420427+0000","last_peered":"2023-12-19T18:58:44.420427+0000","last_clean":"2023-12-19T18:58:44.420427+0000","last_became_active":"2023-12-19T18:58:43.440084+0000","last_became_peered":"2023-12-19T18:58:43.440084+0000","last_unstale":"2023-12-19T18:58:44.420427+0000","last_undegraded":"2023-12-19T18:58:44.420427+0000","last_fullsized":"2023-12-19T18:58:44.420427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:59:46.730223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543423+0000","last_change":"2023-12-19T18:58:42.427565+0000","last_active":"2023-12-19T18:58:45.543423+0000","last_peered":"2023-12-19T18:58:45.543423+0000","last_clean":"2023-12-19T18:58:45.543423+0000","last_became_active":"2023-12-19T18:58:42.427285+0000","last_became_peered":"2023-12-19T18:58:42.427285+0000","last_unstale":"2023-12-19T18:58:45.543423+0000","last_undegraded":"2023-12-19T18:58:45.543423+0000","last_fullsized":"2023-12-19T18:58:45.543423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:20:03.601498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421120+0000","last_change":"2023-12-19T18:58:43.434643+0000","last_active":"2023-12-19T18:58:44.421120+0000","last_peered":"2023-12-19T18:58:44.421120+0000","last_clean":"2023-12-19T18:58:44.421120+0000","last_became_active":"2023-12-19T18:58:43.434350+0000","last_became_peered":"2023-12-19T18:58:43.434350+0000","last_unstale":"2023-12-19T18:58:44.421120+0000","last_undegraded":"2023-12-19T18:58:44.421120+0000","last_fullsized":"2023-12-19T18:58:44.421120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:30:56.565777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.416075+0000","last_change":"2023-12-19T18:58:42.427501+0000","last_active":"2023-12-19T18:58:44.416075+0000","last_peered":"2023-12-19T18:58:44.416075+0000","last_clean":"2023-12-19T18:58:44.416075+0000","last_became_active":"2023-12-19T18:58:42.427005+0000","last_became_peered":"2023-12-19T18:58:42.427005+0000","last_unstale":"2023-12-19T18:58:44.416075+0000","last_undegraded":"2023-12-19T18:58:44.416075+0000","last_fullsized":"2023-12-19T18:58:44.416075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:25.520152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544894+0000","last_change":"2023-12-19T18:58:43.438327+0000","last_active":"2023-12-19T18:58:45.544894+0000","last_peered":"2023-12-19T18:58:45.544894+0000","last_clean":"2023-12-19T18:58:45.544894+0000","last_became_active":"2023-12-19T18:58:43.436427+0000","last_became_peered":"2023-12-19T18:58:43.436427+0000","last_unstale":"2023-12-19T18:58:45.544894+0000","last_undegraded":"2023-12-19T18:58:45.544894+0000","last_fullsized":"2023-12-19T18:58:45.544894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:28.581319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543362+0000","last_change":"2023-12-19T18:58:42.437129+0000","last_active":"2023-12-19T18:58:45.543362+0000","last_peered":"2023-12-19T18:58:45.543362+0000","last_clean":"2023-12-19T18:58:45.543362+0000","last_became_active":"2023-12-19T18:58:42.436883+0000","last_became_peered":"2023-12-19T18:58:42.436883+0000","last_unstale":"2023-12-19T18:58:45.543362+0000","last_undegraded":"2023-12-19T18:58:45.543362+0000","last_fullsized":"2023-12-19T18:58:45.543362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:29:22.986856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420570+0000","last_change":"2023-12-19T18:58:43.439701+0000","last_active":"2023-12-19T18:58:44.420570+0000","last_peered":"2023-12-19T18:58:44.420570+0000","last_clean":"2023-12-19T18:58:44.420570+0000","last_became_active":"2023-12-19T18:58:43.439425+0000","last_became_peered":"2023-12-19T18:58:43.439425+0000","last_unstale":"2023-12-19T18:58:44.420570+0000","last_undegraded":"2023-12-19T18:58:44.420570+0000","last_fullsized":"2023-12-19T18:58:44.420570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:19:43.614230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T18:58:43.415467+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T18:58:43.415467+0000","last_peered":"2023-12-19T18:58:43.415467+0000","last_clean":"2023-12-19T18:58:43.415467+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T18:58:43.415467+0000","last_undegraded":"2023-12-19T18:58:43.415467+0000","last_fullsized":"2023-12-19T18:58:43.415467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544357+0000","last_change":"2023-12-19T18:58:42.424370+0000","last_active":"2023-12-19T18:58:45.544357+0000","last_peered":"2023-12-19T18:58:45.544357+0000","last_clean":"2023-12-19T18:58:45.544357+0000","last_became_active":"2023-12-19T18:58:42.421937+0000","last_became_peered":"2023-12-19T18:58:42.421937+0000","last_unstale":"2023-12-19T18:58:45.544357+0000","last_undegraded":"2023-12-19T18:58:45.544357+0000","last_fullsized":"2023-12-19T18:58:45.544357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:45.366694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792573+0000","last_change":"2023-12-19T18:58:43.437901+0000","last_active":"2023-12-19T18:58:44.792573+0000","last_peered":"2023-12-19T18:58:44.792573+0000","last_clean":"2023-12-19T18:58:44.792573+0000","last_became_active":"2023-12-19T18:58:43.437671+0000","last_became_peered":"2023-12-19T18:58:43.437671+0000","last_unstale":"2023-12-19T18:58:44.792573+0000","last_undegraded":"2023-12-19T18:58:44.792573+0000","last_fullsized":"2023-12-19T18:58:44.792573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:34.691494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420255+0000","last_change":"2023-12-19T18:58:42.432721+0000","last_active":"2023-12-19T18:58:44.420255+0000","last_peered":"2023-12-19T18:58:44.420255+0000","last_clean":"2023-12-19T18:58:44.420255+0000","last_became_active":"2023-12-19T18:58:42.432424+0000","last_became_peered":"2023-12-19T18:58:42.432424+0000","last_unstale":"2023-12-19T18:58:44.420255+0000","last_undegraded":"2023-12-19T18:58:44.420255+0000","last_fullsized":"2023-12-19T18:58:44.420255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:18:45.847639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543868+0000","last_change":"2023-12-19T18:58:43.416870+0000","last_active":"2023-12-19T18:58:45.543868+0000","last_peered":"2023-12-19T18:58:45.543868+0000","last_clean":"2023-12-19T18:58:45.543868+0000","last_became_active":"2023-12-19T18:58:43.416531+0000","last_became_peered":"2023-12-19T18:58:43.416531+0000","last_unstale":"2023-12-19T18:58:45.543868+0000","last_undegraded":"2023-12-19T18:58:45.543868+0000","last_fullsized":"2023-12-19T18:58:45.543868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:09:06.965509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543476+0000","last_change":"2023-12-19T18:58:42.421802+0000","last_active":"2023-12-19T18:58:45.543476+0000","last_peered":"2023-12-19T18:58:45.543476+0000","last_clean":"2023-12-19T18:58:45.543476+0000","last_became_active":"2023-12-19T18:58:42.421453+0000","last_became_peered":"2023-12-19T18:58:42.421453+0000","last_unstale":"2023-12-19T18:58:45.543476+0000","last_undegraded":"2023-12-19T18:58:45.543476+0000","last_fullsized":"2023-12-19T18:58:45.543476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:07.210200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415759+0000","last_change":"2023-12-19T18:58:43.419130+0000","last_active":"2023-12-19T18:58:44.415759+0000","last_peered":"2023-12-19T18:58:44.415759+0000","last_clean":"2023-12-19T18:58:44.415759+0000","last_became_active":"2023-12-19T18:58:43.418765+0000","last_became_peered":"2023-12-19T18:58:43.418765+0000","last_unstale":"2023-12-19T18:58:44.415759+0000","last_undegraded":"2023-12-19T18:58:44.415759+0000","last_fullsized":"2023-12-19T18:58:44.415759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:46.373291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544926+0000","last_change":"2023-12-19T18:58:42.431000+0000","last_active":"2023-12-19T18:58:45.544926+0000","last_peered":"2023-12-19T18:58:45.544926+0000","last_clean":"2023-12-19T18:58:45.544926+0000","last_became_active":"2023-12-19T18:58:42.430652+0000","last_became_peered":"2023-12-19T18:58:42.430652+0000","last_unstale":"2023-12-19T18:58:45.544926+0000","last_undegraded":"2023-12-19T18:58:45.544926+0000","last_fullsized":"2023-12-19T18:58:45.544926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:44:03.095759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420568+0000","last_change":"2023-12-19T18:58:43.424247+0000","last_active":"2023-12-19T18:58:44.420568+0000","last_peered":"2023-12-19T18:58:44.420568+0000","last_clean":"2023-12-19T18:58:44.420568+0000","last_became_active":"2023-12-19T18:58:43.422534+0000","last_became_peered":"2023-12-19T18:58:43.422534+0000","last_unstale":"2023-12-19T18:58:44.420568+0000","last_undegraded":"2023-12-19T18:58:44.420568+0000","last_fullsized":"2023-12-19T18:58:44.420568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:25:24.585530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415907+0000","last_change":"2023-12-19T18:58:42.418032+0000","last_active":"2023-12-19T18:58:44.415907+0000","last_peered":"2023-12-19T18:58:44.415907+0000","last_clean":"2023-12-19T18:58:44.415907+0000","last_became_active":"2023-12-19T18:58:42.417765+0000","last_became_peered":"2023-12-19T18:58:42.417765+0000","last_unstale":"2023-12-19T18:58:44.415907+0000","last_undegraded":"2023-12-19T18:58:44.415907+0000","last_fullsized":"2023-12-19T18:58:44.415907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:09:05.958912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.545286+0000","last_change":"2023-12-19T18:58:43.438006+0000","last_active":"2023-12-19T18:58:45.545286+0000","last_peered":"2023-12-19T18:58:45.545286+0000","last_clean":"2023-12-19T18:58:45.545286+0000","last_became_active":"2023-12-19T18:58:43.437618+0000","last_became_peered":"2023-12-19T18:58:43.437618+0000","last_unstale":"2023-12-19T18:58:45.545286+0000","last_undegraded":"2023-12-19T18:58:45.545286+0000","last_fullsized":"2023-12-19T18:58:45.545286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:43:58.809550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420900+0000","last_change":"2023-12-19T18:58:42.433488+0000","last_active":"2023-12-19T18:58:44.420900+0000","last_peered":"2023-12-19T18:58:44.420900+0000","last_clean":"2023-12-19T18:58:44.420900+0000","last_became_active":"2023-12-19T18:58:42.433023+0000","last_became_peered":"2023-12-19T18:58:42.433023+0000","last_unstale":"2023-12-19T18:58:44.420900+0000","last_undegraded":"2023-12-19T18:58:44.420900+0000","last_fullsized":"2023-12-19T18:58:44.420900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:25.520152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415951+0000","last_change":"2023-12-19T18:58:43.419840+0000","last_active":"2023-12-19T18:58:44.415951+0000","last_peered":"2023-12-19T18:58:44.415951+0000","last_clean":"2023-12-19T18:58:44.415951+0000","last_became_active":"2023-12-19T18:58:43.419340+0000","last_became_peered":"2023-12-19T18:58:43.419340+0000","last_unstale":"2023-12-19T18:58:44.415951+0000","last_undegraded":"2023-12-19T18:58:44.415951+0000","last_fullsized":"2023-12-19T18:58:44.415951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:34.691494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.858596+0000","last_change":"2023-12-19T18:58:42.421889+0000","last_active":"2023-12-19T18:58:45.858596+0000","last_peered":"2023-12-19T18:58:45.858596+0000","last_clean":"2023-12-19T18:58:45.858596+0000","last_became_active":"2023-12-19T18:58:42.421524+0000","last_became_peered":"2023-12-19T18:58:42.421524+0000","last_unstale":"2023-12-19T18:58:45.858596+0000","last_undegraded":"2023-12-19T18:58:45.858596+0000","last_fullsized":"2023-12-19T18:58:45.858596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:24:57.289171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792880+0000","last_change":"2023-12-19T18:58:43.427768+0000","last_active":"2023-12-19T18:58:44.792880+0000","last_peered":"2023-12-19T18:58:44.792880+0000","last_clean":"2023-12-19T18:58:44.792880+0000","last_became_active":"2023-12-19T18:58:43.427358+0000","last_became_peered":"2023-12-19T18:58:43.427358+0000","last_unstale":"2023-12-19T18:58:44.792880+0000","last_undegraded":"2023-12-19T18:58:44.792880+0000","last_fullsized":"2023-12-19T18:58:44.792880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:25:40.712335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544879+0000","last_change":"2023-12-19T18:58:42.433397+0000","last_active":"2023-12-19T18:58:45.544879+0000","last_peered":"2023-12-19T18:58:45.544879+0000","last_clean":"2023-12-19T18:58:45.544879+0000","last_became_active":"2023-12-19T18:58:42.433055+0000","last_became_peered":"2023-12-19T18:58:42.433055+0000","last_unstale":"2023-12-19T18:58:45.544879+0000","last_undegraded":"2023-12-19T18:58:45.544879+0000","last_fullsized":"2023-12-19T18:58:45.544879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:09:05.958912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544244+0000","last_change":"2023-12-19T18:58:43.421411+0000","last_active":"2023-12-19T18:58:45.544244+0000","last_peered":"2023-12-19T18:58:45.544244+0000","last_clean":"2023-12-19T18:58:45.544244+0000","last_became_active":"2023-12-19T18:58:43.421095+0000","last_became_peered":"2023-12-19T18:58:43.421095+0000","last_unstale":"2023-12-19T18:58:45.544244+0000","last_undegraded":"2023-12-19T18:58:45.544244+0000","last_fullsized":"2023-12-19T18:58:45.544244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:46.373291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420158+0000","last_change":"2023-12-19T18:58:42.434661+0000","last_active":"2023-12-19T18:58:44.420158+0000","last_peered":"2023-12-19T18:58:44.420158+0000","last_clean":"2023-12-19T18:58:44.420158+0000","last_became_active":"2023-12-19T18:58:42.432945+0000","last_became_peered":"2023-12-19T18:58:42.432945+0000","last_unstale":"2023-12-19T18:58:44.420158+0000","last_undegraded":"2023-12-19T18:58:44.420158+0000","last_fullsized":"2023-12-19T18:58:44.420158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:33:01.472458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420046+0000","last_change":"2023-12-19T18:58:43.430118+0000","last_active":"2023-12-19T18:58:44.420046+0000","last_peered":"2023-12-19T18:58:44.420046+0000","last_clean":"2023-12-19T18:58:44.420046+0000","last_became_active":"2023-12-19T18:58:43.428710+0000","last_became_peered":"2023-12-19T18:58:43.428710+0000","last_unstale":"2023-12-19T18:58:44.420046+0000","last_undegraded":"2023-12-19T18:58:44.420046+0000","last_fullsized":"2023-12-19T18:58:44.420046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:20:04.608095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415775+0000","last_change":"2023-12-19T18:58:42.432562+0000","last_active":"2023-12-19T18:58:44.415775+0000","last_peered":"2023-12-19T18:58:44.415775+0000","last_clean":"2023-12-19T18:58:44.415775+0000","last_became_active":"2023-12-19T18:58:42.432307+0000","last_became_peered":"2023-12-19T18:58:42.432307+0000","last_unstale":"2023-12-19T18:58:44.415775+0000","last_undegraded":"2023-12-19T18:58:44.415775+0000","last_fullsized":"2023-12-19T18:58:44.415775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:35.982824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792510+0000","last_change":"2023-12-19T18:58:43.421115+0000","last_active":"2023-12-19T18:58:44.792510+0000","last_peered":"2023-12-19T18:58:44.792510+0000","last_clean":"2023-12-19T18:58:44.792510+0000","last_became_active":"2023-12-19T18:58:43.419370+0000","last_became_peered":"2023-12-19T18:58:43.419370+0000","last_unstale":"2023-12-19T18:58:44.792510+0000","last_undegraded":"2023-12-19T18:58:44.792510+0000","last_fullsized":"2023-12-19T18:58:44.792510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:46.373291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415921+0000","last_change":"2023-12-19T18:58:42.428553+0000","last_active":"2023-12-19T18:58:44.415921+0000","last_peered":"2023-12-19T18:58:44.415921+0000","last_clean":"2023-12-19T18:58:44.415921+0000","last_became_active":"2023-12-19T18:58:42.425181+0000","last_became_peered":"2023-12-19T18:58:42.425181+0000","last_unstale":"2023-12-19T18:58:44.415921+0000","last_undegraded":"2023-12-19T18:58:44.415921+0000","last_fullsized":"2023-12-19T18:58:44.415921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:29.889906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792641+0000","last_change":"2023-12-19T18:58:43.425659+0000","last_active":"2023-12-19T18:58:44.792641+0000","last_peered":"2023-12-19T18:58:44.792641+0000","last_clean":"2023-12-19T18:58:44.792641+0000","last_became_active":"2023-12-19T18:58:43.425393+0000","last_became_peered":"2023-12-19T18:58:43.425393+0000","last_unstale":"2023-12-19T18:58:44.792641+0000","last_undegraded":"2023-12-19T18:58:44.792641+0000","last_fullsized":"2023-12-19T18:58:44.792641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:07.765261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420547+0000","last_change":"2023-12-19T18:58:42.432966+0000","last_active":"2023-12-19T18:58:44.420547+0000","last_peered":"2023-12-19T18:58:44.420547+0000","last_clean":"2023-12-19T18:58:44.420547+0000","last_became_active":"2023-12-19T18:58:42.432661+0000","last_became_peered":"2023-12-19T18:58:42.432661+0000","last_unstale":"2023-12-19T18:58:44.420547+0000","last_undegraded":"2023-12-19T18:58:44.420547+0000","last_fullsized":"2023-12-19T18:58:44.420547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:06.758664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544675+0000","last_change":"2023-12-19T18:58:43.428930+0000","last_active":"2023-12-19T18:58:45.544675+0000","last_peered":"2023-12-19T18:58:45.544675+0000","last_clean":"2023-12-19T18:58:45.544675+0000","last_became_active":"2023-12-19T18:58:43.428623+0000","last_became_peered":"2023-12-19T18:58:43.428623+0000","last_unstale":"2023-12-19T18:58:45.544675+0000","last_undegraded":"2023-12-19T18:58:45.544675+0000","last_fullsized":"2023-12-19T18:58:45.544675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:07.765261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.545246+0000","last_change":"2023-12-19T18:58:43.438141+0000","last_active":"2023-12-19T18:58:45.545246+0000","last_peered":"2023-12-19T18:58:45.545246+0000","last_clean":"2023-12-19T18:58:45.545246+0000","last_became_active":"2023-12-19T18:58:43.437765+0000","last_became_peered":"2023-12-19T18:58:43.437765+0000","last_unstale":"2023-12-19T18:58:45.545246+0000","last_undegraded":"2023-12-19T18:58:45.545246+0000","last_fullsized":"2023-12-19T18:58:45.545246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:46.807064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420235+0000","last_change":"2023-12-19T18:58:42.436647+0000","last_active":"2023-12-19T18:58:44.420235+0000","last_peered":"2023-12-19T18:58:44.420235+0000","last_clean":"2023-12-19T18:58:44.420235+0000","last_became_active":"2023-12-19T18:58:42.436356+0000","last_became_peered":"2023-12-19T18:58:42.436356+0000","last_unstale":"2023-12-19T18:58:44.420235+0000","last_undegraded":"2023-12-19T18:58:44.420235+0000","last_fullsized":"2023-12-19T18:58:44.420235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:06.491761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544884+0000","last_change":"2023-12-19T18:58:43.438524+0000","last_active":"2023-12-19T18:58:45.544884+0000","last_peered":"2023-12-19T18:58:45.544884+0000","last_clean":"2023-12-19T18:58:45.544884+0000","last_became_active":"2023-12-19T18:58:43.436745+0000","last_became_peered":"2023-12-19T18:58:43.436745+0000","last_unstale":"2023-12-19T18:58:45.544884+0000","last_undegraded":"2023-12-19T18:58:45.544884+0000","last_fullsized":"2023-12-19T18:58:45.544884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:32:14.763407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420673+0000","last_change":"2023-12-19T18:58:42.432955+0000","last_active":"2023-12-19T18:58:44.420673+0000","last_peered":"2023-12-19T18:58:44.420673+0000","last_clean":"2023-12-19T18:58:44.420673+0000","last_became_active":"2023-12-19T18:58:42.432616+0000","last_became_peered":"2023-12-19T18:58:42.432616+0000","last_unstale":"2023-12-19T18:58:44.420673+0000","last_undegraded":"2023-12-19T18:58:44.420673+0000","last_fullsized":"2023-12-19T18:58:44.420673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:15.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544293+0000","last_change":"2023-12-19T18:58:43.440165+0000","last_active":"2023-12-19T18:58:45.544293+0000","last_peered":"2023-12-19T18:58:45.544293+0000","last_clean":"2023-12-19T18:58:45.544293+0000","last_became_active":"2023-12-19T18:58:43.439853+0000","last_became_peered":"2023-12-19T18:58:43.439853+0000","last_unstale":"2023-12-19T18:58:45.544293+0000","last_undegraded":"2023-12-19T18:58:45.544293+0000","last_fullsized":"2023-12-19T18:58:45.544293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:07.765261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792856+0000","last_change":"2023-12-19T18:58:42.423728+0000","last_active":"2023-12-19T18:58:44.792856+0000","last_peered":"2023-12-19T18:58:44.792856+0000","last_clean":"2023-12-19T18:58:44.792856+0000","last_became_active":"2023-12-19T18:58:42.423467+0000","last_became_peered":"2023-12-19T18:58:42.423467+0000","last_unstale":"2023-12-19T18:58:44.792856+0000","last_undegraded":"2023-12-19T18:58:44.792856+0000","last_fullsized":"2023-12-19T18:58:44.792856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:09:05.958912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792893+0000","last_change":"2023-12-19T18:58:43.431360+0000","last_active":"2023-12-19T18:58:44.792893+0000","last_peered":"2023-12-19T18:58:44.792893+0000","last_clean":"2023-12-19T18:58:44.792893+0000","last_became_active":"2023-12-19T18:58:43.431079+0000","last_became_peered":"2023-12-19T18:58:43.431079+0000","last_unstale":"2023-12-19T18:58:44.792893+0000","last_undegraded":"2023-12-19T18:58:44.792893+0000","last_fullsized":"2023-12-19T18:58:44.792893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:19:43.614230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544292+0000","last_change":"2023-12-19T18:58:42.428088+0000","last_active":"2023-12-19T18:58:45.544292+0000","last_peered":"2023-12-19T18:58:45.544292+0000","last_clean":"2023-12-19T18:58:45.544292+0000","last_became_active":"2023-12-19T18:58:42.427833+0000","last_became_peered":"2023-12-19T18:58:42.427833+0000","last_unstale":"2023-12-19T18:58:45.544292+0000","last_undegraded":"2023-12-19T18:58:45.544292+0000","last_fullsized":"2023-12-19T18:58:45.544292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:15.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.458}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1930000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0259999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.968}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.903}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.875}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9129999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.8399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2690000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3490000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1609999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3310000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":660897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T18:58:53.352 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T18:58:53.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.520+0000 7ff06fb2a640 1 Processor -- start 2023-12-19T18:58:53.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.524+0000 7ff06fb2a640 1 -- start start 2023-12-19T18:58:53.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.524+0000 7ff06fb2a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff068151e90 0x7ff0680c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:53.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.524+0000 7ff06fb2a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff0680c7ea0 0x7ff06806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:53.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.524+0000 7ff06fb2a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff06806c860 con 0x7ff0680c4e60 2023-12-19T18:58:53.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.524+0000 7ff06fb2a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0680c8750 con 0x7ff0680c7ea0 2023-12-19T18:58:53.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.524+0000 7ff06fb2a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0681552d0 con 0x7ff068151e90 2023-12-19T18:58:53.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.524+0000 7ff06d8c6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff068151e90 0x7ff0680c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:53.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.524+0000 7ff06d0c5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff0680c7ea0 0x7ff06806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:53.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.524+0000 7ff06d0c5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff0680c7ea0 0x7ff06806b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:48354/0 (socket says 172.21.15.133:48354) 2023-12-19T18:58:53.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.524+0000 7ff06d8c6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff068151e90 0x7ff0680c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:55452/0 (socket says 172.21.15.133:55452) 2023-12-19T18:58:53.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.524+0000 7ff06d0c5640 1 -- 172.21.15.133:0/695307009 learned_addr learned my addr 172.21.15.133:0/695307009 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:53.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.524+0000 7ff06d0c5640 1 -- 172.21.15.133:0/695307009 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff068151e90 msgr2=0x7ff0680c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:53.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.524+0000 7ff06d0c5640 1 --2- 172.21.15.133:0/695307009 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff068151e90 0x7ff0680c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:53.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.524+0000 7ff06d0c5640 1 -- 172.21.15.133:0/695307009 >> v1:172.21.15.138:6789/0 conn(0x7ff0680c4e60 legacy=0x7ff06806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:53.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.524+0000 7ff06d0c5640 1 -- 172.21.15.133:0/695307009 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff068154930 con 0x7ff0680c7ea0 2023-12-19T18:58:53.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.528+0000 7ff06d0c5640 1 --2- 172.21.15.133:0/695307009 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0680c7ea0 0x7ff06806b4a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff058009870 tx=0x7ff05801c420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe76a26ec36d983d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:53.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.528+0000 7ff06c8c4640 1 -- 172.21.15.133:0/695307009 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0580ab600 con 0x7ff0680c7ea0 2023-12-19T18:58:53.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.528+0000 7ff06c8c4640 1 -- 172.21.15.133:0/695307009 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0580a7050 con 0x7ff0680c7ea0 2023-12-19T18:58:53.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.528+0000 7ff06c8c4640 1 -- 172.21.15.133:0/695307009 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0580ab980 con 0x7ff0680c7ea0 2023-12-19T18:58:53.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.528+0000 7ff06fb2a640 1 -- 172.21.15.133:0/695307009 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0680c7ea0 msgr2=0x7ff06806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:53.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.528+0000 7ff06fb2a640 1 --2- 172.21.15.133:0/695307009 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0680c7ea0 0x7ff06806b4a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff058009870 tx=0x7ff05801c420 comp rx=0 tx=0).stop 2023-12-19T18:58:53.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.528+0000 7ff06fb2a640 1 -- 172.21.15.133:0/695307009 shutdown_connections 2023-12-19T18:58:53.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.528+0000 7ff06fb2a640 1 --2- 172.21.15.133:0/695307009 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0680c7ea0 0x7ff06806b4a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:53.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.528+0000 7ff06fb2a640 1 --2- 172.21.15.133:0/695307009 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff068151e90 0x7ff0680c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:53.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.528+0000 7ff06fb2a640 1 -- 172.21.15.133:0/695307009 >> 172.21.15.133:0/695307009 conn(0x7ff0680ca170 msgr2=0x7ff0680ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:53.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.528+0000 7ff06fb2a640 1 -- 172.21.15.133:0/695307009 shutdown_connections 2023-12-19T18:58:53.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.528+0000 7ff06fb2a640 1 -- 172.21.15.133:0/695307009 wait complete. 2023-12-19T18:58:53.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff06fb2a640 1 Processor -- start 2023-12-19T18:58:53.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff06fb2a640 1 -- start start 2023-12-19T18:58:53.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff06fb2a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0680c4e60 0x7ff0680c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:53.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff06fb2a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0680c7ea0 0x7ff068158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:53.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff06fb2a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff068151e90 0x7ff0681587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:53.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff06fb2a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0680abe90 con 0x7ff0680c4e60 2023-12-19T18:58:53.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff06fb2a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0681f04d0 con 0x7ff0680c7ea0 2023-12-19T18:58:53.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff06fb2a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0680abaf0 con 0x7ff068151e90 2023-12-19T18:58:53.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff06d8c6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0680c4e60 0x7ff0680c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:53.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff06d8c6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0680c4e60 0x7ff0680c2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54814/0 (socket says 172.21.15.133:54814) 2023-12-19T18:58:53.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff06d8c6640 1 -- 172.21.15.133:0/8282098 learned_addr learned my addr 172.21.15.133:0/8282098 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:53.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff06d0c5640 1 --2- 172.21.15.133:0/8282098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0680c7ea0 0x7ff068158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:53.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff06e0c7640 1 --2- 172.21.15.133:0/8282098 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff068151e90 0x7ff0681587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:53.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff06d8c6640 1 -- 172.21.15.133:0/8282098 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff068151e90 msgr2=0x7ff0681587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:53.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff06d8c6640 1 --2- 172.21.15.133:0/8282098 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff068151e90 0x7ff0681587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:53.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff06d8c6640 1 -- 172.21.15.133:0/8282098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0680c7ea0 msgr2=0x7ff068158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:53.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff06d8c6640 1 --2- 172.21.15.133:0/8282098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0680c7ea0 0x7ff068158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:53.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff06d8c6640 1 -- 172.21.15.133:0/8282098 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0580094d0 con 0x7ff0680c4e60 2023-12-19T18:58:53.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff06d8c6640 1 --2- 172.21.15.133:0/8282098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0680c4e60 0x7ff0680c2b70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff06400e960 tx=0x7ff06400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:53.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff05e7fc640 1 -- 172.21.15.133:0/8282098 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff064009690 con 0x7ff0680c4e60 2023-12-19T18:58:53.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff05e7fc640 1 -- 172.21.15.133:0/8282098 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06400ca00 con 0x7ff0680c4e60 2023-12-19T18:58:53.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff05e7fc640 1 -- 172.21.15.133:0/8282098 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06400cd70 con 0x7ff0680c4e60 2023-12-19T18:58:53.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff06fb2a640 1 -- 172.21.15.133:0/8282098 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0680a9d00 con 0x7ff0680c4e60 2023-12-19T18:58:53.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff06fb2a640 1 -- 172.21.15.133:0/8282098 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff06814e430 con 0x7ff0680c4e60 2023-12-19T18:58:53.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.532+0000 7ff06fb2a640 1 -- 172.21.15.133:0/8282098 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0680c4c30 con 0x7ff0680c4e60 2023-12-19T18:58:53.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.536+0000 7ff05e7fc640 1 -- 172.21.15.133:0/8282098 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff064013470 con 0x7ff0680c4e60 2023-12-19T18:58:53.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.536+0000 7ff05e7fc640 1 --2- 172.21.15.133:0/8282098 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff04c066470 0x7ff04c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:53.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.536+0000 7ff05e7fc640 1 -- 172.21.15.133:0/8282098 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0640840d0 con 0x7ff0680c4e60 2023-12-19T18:58:53.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.536+0000 7ff06d0c5640 1 --2- 172.21.15.133:0/8282098 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff04c066470 0x7ff04c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:53.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.536+0000 7ff06d0c5640 1 --2- 172.21.15.133:0/8282098 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff04c066470 0x7ff04c068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff0580ad000 tx=0x7ff058008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:53.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.540+0000 7ff05e7fc640 1 -- 172.21.15.133:0/8282098 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff064051570 con 0x7ff0680c4e60 2023-12-19T18:58:53.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.688+0000 7ff06fb2a640 1 -- 172.21.15.133:0/8282098 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff068066d80 con 0x7ff04c066470 2023-12-19T18:58:53.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.696+0000 7ff05e7fc640 1 -- 172.21.15.133:0/8282098 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264553 (secure 0 0 0) 0x7ff068066d80 con 0x7ff04c066470 2023-12-19T18:58:53.705 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:53.706 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T18:58:53.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.700+0000 7ff06fb2a640 1 -- 172.21.15.133:0/8282098 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff04c066470 msgr2=0x7ff04c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:53.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.700+0000 7ff06fb2a640 1 --2- 172.21.15.133:0/8282098 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff04c066470 0x7ff04c068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff0580ad000 tx=0x7ff058008040 comp rx=0 tx=0).stop 2023-12-19T18:58:53.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.700+0000 7ff06fb2a640 1 -- 172.21.15.133:0/8282098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0680c4e60 msgr2=0x7ff0680c2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:53.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.700+0000 7ff06fb2a640 1 --2- 172.21.15.133:0/8282098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0680c4e60 0x7ff0680c2b70 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff06400e960 tx=0x7ff06400ee20 comp rx=0 tx=0).stop 2023-12-19T18:58:53.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.700+0000 7ff06fb2a640 1 -- 172.21.15.133:0/8282098 shutdown_connections 2023-12-19T18:58:53.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.700+0000 7ff06fb2a640 1 --2- 172.21.15.133:0/8282098 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff04c066470 0x7ff04c068930 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:53.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.700+0000 7ff06fb2a640 1 --2- 172.21.15.133:0/8282098 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff068151e90 0x7ff0681587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:53.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.700+0000 7ff06fb2a640 1 --2- 172.21.15.133:0/8282098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0680c7ea0 0x7ff068158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:53.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.700+0000 7ff06fb2a640 1 --2- 172.21.15.133:0/8282098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff0680c4e60 0x7ff0680c2b70 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:53.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.700+0000 7ff06fb2a640 1 -- 172.21.15.133:0/8282098 >> 172.21.15.133:0/8282098 conn(0x7ff0680ca170 msgr2=0x7ff06814b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:53.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.700+0000 7ff06fb2a640 1 -- 172.21.15.133:0/8282098 shutdown_connections 2023-12-19T18:58:53.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.700+0000 7ff06fb2a640 1 -- 172.21.15.133:0/8282098 wait complete. 2023-12-19T18:58:53.724 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-12-19T18:58:52.834173+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219012,"kb_used_data":2820,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755708,"statfs":{"total":773094113280,"available":772869844992,"internally_reserved":0,"allocated":2887680,"data_stored":1751817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.426071"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421033+0000","last_change":"2023-12-19T18:58:43.434692+0000","last_active":"2023-12-19T18:58:44.421033+0000","last_peered":"2023-12-19T18:58:44.421033+0000","last_clean":"2023-12-19T18:58:44.421033+0000","last_became_active":"2023-12-19T18:58:43.434368+0000","last_became_peered":"2023-12-19T18:58:43.434368+0000","last_unstale":"2023-12-19T18:58:44.421033+0000","last_undegraded":"2023-12-19T18:58:44.421033+0000","last_fullsized":"2023-12-19T18:58:44.421033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:46.807064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.416161+0000","last_change":"2023-12-19T18:58:43.425595+0000","last_active":"2023-12-19T18:58:44.416161+0000","last_peered":"2023-12-19T18:58:44.416161+0000","last_clean":"2023-12-19T18:58:44.416161+0000","last_became_active":"2023-12-19T18:58:43.425304+0000","last_became_peered":"2023-12-19T18:58:43.425304+0000","last_unstale":"2023-12-19T18:58:44.416161+0000","last_undegraded":"2023-12-19T18:58:44.416161+0000","last_fullsized":"2023-12-19T18:58:44.416161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:55:56.534047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544103+0000","last_change":"2023-12-19T18:58:43.415732+0000","last_active":"2023-12-19T18:58:45.544103+0000","last_peered":"2023-12-19T18:58:45.544103+0000","last_clean":"2023-12-19T18:58:45.544103+0000","last_became_active":"2023-12-19T18:58:43.415405+0000","last_became_peered":"2023-12-19T18:58:43.415405+0000","last_unstale":"2023-12-19T18:58:45.544103+0000","last_undegraded":"2023-12-19T18:58:45.544103+0000","last_fullsized":"2023-12-19T18:58:45.544103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:26.526749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544521+0000","last_change":"2023-12-19T18:58:43.441973+0000","last_active":"2023-12-19T18:58:45.544521+0000","last_peered":"2023-12-19T18:58:45.544521+0000","last_clean":"2023-12-19T18:58:45.544521+0000","last_became_active":"2023-12-19T18:58:43.437056+0000","last_became_peered":"2023-12-19T18:58:43.437056+0000","last_unstale":"2023-12-19T18:58:45.544521+0000","last_undegraded":"2023-12-19T18:58:45.544521+0000","last_fullsized":"2023-12-19T18:58:45.544521+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:32.378596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420316+0000","last_change":"2023-12-19T18:58:43.427263+0000","last_active":"2023-12-19T18:58:44.420316+0000","last_peered":"2023-12-19T18:58:44.420316+0000","last_clean":"2023-12-19T18:58:44.420316+0000","last_became_active":"2023-12-19T18:58:43.426417+0000","last_became_peered":"2023-12-19T18:58:43.426417+0000","last_unstale":"2023-12-19T18:58:44.420316+0000","last_undegraded":"2023-12-19T18:58:44.420316+0000","last_fullsized":"2023-12-19T18:58:44.420316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:55:56.534047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544646+0000","last_change":"2023-12-19T18:58:43.438027+0000","last_active":"2023-12-19T18:58:45.544646+0000","last_peered":"2023-12-19T18:58:45.544646+0000","last_clean":"2023-12-19T18:58:45.544646+0000","last_became_active":"2023-12-19T18:58:43.437711+0000","last_became_peered":"2023-12-19T18:58:43.437711+0000","last_unstale":"2023-12-19T18:58:45.544646+0000","last_undegraded":"2023-12-19T18:58:45.544646+0000","last_fullsized":"2023-12-19T18:58:45.544646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:59:46.730223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420590+0000","last_change":"2023-12-19T18:58:43.431331+0000","last_active":"2023-12-19T18:58:44.420590+0000","last_peered":"2023-12-19T18:58:44.420590+0000","last_clean":"2023-12-19T18:58:44.420590+0000","last_became_active":"2023-12-19T18:58:43.430968+0000","last_became_peered":"2023-12-19T18:58:43.430968+0000","last_unstale":"2023-12-19T18:58:44.420590+0000","last_undegraded":"2023-12-19T18:58:44.420590+0000","last_fullsized":"2023-12-19T18:58:44.420590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:32:14.763407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792363+0000","last_change":"2023-12-19T18:58:43.443194+0000","last_active":"2023-12-19T18:58:44.792363+0000","last_peered":"2023-12-19T18:58:44.792363+0000","last_clean":"2023-12-19T18:58:44.792363+0000","last_became_active":"2023-12-19T18:58:43.442961+0000","last_became_peered":"2023-12-19T18:58:43.442961+0000","last_unstale":"2023-12-19T18:58:44.792363+0000","last_undegraded":"2023-12-19T18:58:44.792363+0000","last_fullsized":"2023-12-19T18:58:44.792363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:30.896504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421106+0000","last_change":"2023-12-19T18:58:43.443640+0000","last_active":"2023-12-19T18:58:44.421106+0000","last_peered":"2023-12-19T18:58:44.421106+0000","last_clean":"2023-12-19T18:58:44.421106+0000","last_became_active":"2023-12-19T18:58:43.443310+0000","last_became_peered":"2023-12-19T18:58:43.443310+0000","last_unstale":"2023-12-19T18:58:44.421106+0000","last_undegraded":"2023-12-19T18:58:44.421106+0000","last_fullsized":"2023-12-19T18:58:44.421106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:43:58.809550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544614+0000","last_change":"2023-12-19T18:58:43.445525+0000","last_active":"2023-12-19T18:58:45.544614+0000","last_peered":"2023-12-19T18:58:45.544614+0000","last_clean":"2023-12-19T18:58:45.544614+0000","last_became_active":"2023-12-19T18:58:43.445220+0000","last_became_peered":"2023-12-19T18:58:43.445220+0000","last_unstale":"2023-12-19T18:58:45.544614+0000","last_undegraded":"2023-12-19T18:58:45.544614+0000","last_fullsized":"2023-12-19T18:58:45.544614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:46.373291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544393+0000","last_change":"2023-12-19T18:58:43.439159+0000","last_active":"2023-12-19T18:58:45.544393+0000","last_peered":"2023-12-19T18:58:45.544393+0000","last_clean":"2023-12-19T18:58:45.544393+0000","last_became_active":"2023-12-19T18:58:43.438873+0000","last_became_peered":"2023-12-19T18:58:43.438873+0000","last_unstale":"2023-12-19T18:58:45.544393+0000","last_undegraded":"2023-12-19T18:58:45.544393+0000","last_fullsized":"2023-12-19T18:58:45.544393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:07.498358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421186+0000","last_change":"2023-12-19T18:58:43.432338+0000","last_active":"2023-12-19T18:58:44.421186+0000","last_peered":"2023-12-19T18:58:44.421186+0000","last_clean":"2023-12-19T18:58:44.421186+0000","last_became_active":"2023-12-19T18:58:43.431137+0000","last_became_peered":"2023-12-19T18:58:43.431137+0000","last_unstale":"2023-12-19T18:58:44.421186+0000","last_undegraded":"2023-12-19T18:58:44.421186+0000","last_fullsized":"2023-12-19T18:58:44.421186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:36.989421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792689+0000","last_change":"2023-12-19T18:58:43.426477+0000","last_active":"2023-12-19T18:58:44.792689+0000","last_peered":"2023-12-19T18:58:44.792689+0000","last_clean":"2023-12-19T18:58:44.792689+0000","last_became_active":"2023-12-19T18:58:43.426194+0000","last_became_peered":"2023-12-19T18:58:43.426194+0000","last_unstale":"2023-12-19T18:58:44.792689+0000","last_undegraded":"2023-12-19T18:58:44.792689+0000","last_fullsized":"2023-12-19T18:58:44.792689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:55:56.534047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543864+0000","last_change":"2023-12-19T18:58:43.423155+0000","last_active":"2023-12-19T18:58:45.543864+0000","last_peered":"2023-12-19T18:58:45.543864+0000","last_clean":"2023-12-19T18:58:45.543864+0000","last_became_active":"2023-12-19T18:58:43.422822+0000","last_became_peered":"2023-12-19T18:58:43.422822+0000","last_unstale":"2023-12-19T18:58:45.543864+0000","last_undegraded":"2023-12-19T18:58:45.543864+0000","last_fullsized":"2023-12-19T18:58:45.543864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:24:58.295768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415715+0000","last_change":"2023-12-19T18:58:43.438543+0000","last_active":"2023-12-19T18:58:44.415715+0000","last_peered":"2023-12-19T18:58:44.415715+0000","last_clean":"2023-12-19T18:58:44.415715+0000","last_became_active":"2023-12-19T18:58:43.438178+0000","last_became_peered":"2023-12-19T18:58:43.438178+0000","last_unstale":"2023-12-19T18:58:44.415715+0000","last_undegraded":"2023-12-19T18:58:44.415715+0000","last_fullsized":"2023-12-19T18:58:44.415715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:44:04.102356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544103+0000","last_change":"2023-12-19T18:58:43.439649+0000","last_active":"2023-12-19T18:58:45.544103+0000","last_peered":"2023-12-19T18:58:45.544103+0000","last_clean":"2023-12-19T18:58:45.544103+0000","last_became_active":"2023-12-19T18:58:43.436212+0000","last_became_peered":"2023-12-19T18:58:43.436212+0000","last_unstale":"2023-12-19T18:58:45.544103+0000","last_undegraded":"2023-12-19T18:58:45.544103+0000","last_fullsized":"2023-12-19T18:58:45.544103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:07.765261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.545316+0000","last_change":"2023-12-19T18:58:43.441777+0000","last_active":"2023-12-19T18:58:45.545316+0000","last_peered":"2023-12-19T18:58:45.545316+0000","last_clean":"2023-12-19T18:58:45.545316+0000","last_became_active":"2023-12-19T18:58:43.437882+0000","last_became_peered":"2023-12-19T18:58:43.437882+0000","last_unstale":"2023-12-19T18:58:45.545316+0000","last_undegraded":"2023-12-19T18:58:45.545316+0000","last_fullsized":"2023-12-19T18:58:45.545316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:30:56.565777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543404+0000","last_change":"2023-12-19T18:58:43.430270+0000","last_active":"2023-12-19T18:58:45.543404+0000","last_peered":"2023-12-19T18:58:45.543404+0000","last_clean":"2023-12-19T18:58:45.543404+0000","last_became_active":"2023-12-19T18:58:43.429986+0000","last_became_peered":"2023-12-19T18:58:43.429986+0000","last_unstale":"2023-12-19T18:58:45.543404+0000","last_undegraded":"2023-12-19T18:58:45.543404+0000","last_fullsized":"2023-12-19T18:58:45.543404+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:36.989421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420819+0000","last_change":"2023-12-19T18:58:43.427486+0000","last_active":"2023-12-19T18:58:44.420819+0000","last_peered":"2023-12-19T18:58:44.420819+0000","last_clean":"2023-12-19T18:58:44.420819+0000","last_became_active":"2023-12-19T18:58:43.427113+0000","last_became_peered":"2023-12-19T18:58:43.427113+0000","last_unstale":"2023-12-19T18:58:44.420819+0000","last_undegraded":"2023-12-19T18:58:44.420819+0000","last_fullsized":"2023-12-19T18:58:44.420819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:11:18.747856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544490+0000","last_change":"2023-12-19T18:58:43.428892+0000","last_active":"2023-12-19T18:58:45.544490+0000","last_peered":"2023-12-19T18:58:45.544490+0000","last_clean":"2023-12-19T18:58:45.544490+0000","last_became_active":"2023-12-19T18:58:43.428437+0000","last_became_peered":"2023-12-19T18:58:43.428437+0000","last_unstale":"2023-12-19T18:58:45.544490+0000","last_undegraded":"2023-12-19T18:58:45.544490+0000","last_fullsized":"2023-12-19T18:58:45.544490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:44:04.102356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544150+0000","last_change":"2023-12-19T18:58:43.426615+0000","last_active":"2023-12-19T18:58:45.544150+0000","last_peered":"2023-12-19T18:58:45.544150+0000","last_clean":"2023-12-19T18:58:45.544150+0000","last_became_active":"2023-12-19T18:58:43.426300+0000","last_became_peered":"2023-12-19T18:58:43.426300+0000","last_unstale":"2023-12-19T18:58:45.544150+0000","last_undegraded":"2023-12-19T18:58:45.544150+0000","last_fullsized":"2023-12-19T18:58:45.544150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:30.896504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544725+0000","last_change":"2023-12-19T18:58:43.436630+0000","last_active":"2023-12-19T18:58:45.544725+0000","last_peered":"2023-12-19T18:58:45.544725+0000","last_clean":"2023-12-19T18:58:45.544725+0000","last_became_active":"2023-12-19T18:58:43.436310+0000","last_became_peered":"2023-12-19T18:58:43.436310+0000","last_unstale":"2023-12-19T18:58:45.544725+0000","last_undegraded":"2023-12-19T18:58:45.544725+0000","last_fullsized":"2023-12-19T18:58:45.544725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:25:40.712335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792474+0000","last_change":"2023-12-19T18:58:43.432208+0000","last_active":"2023-12-19T18:58:44.792474+0000","last_peered":"2023-12-19T18:58:44.792474+0000","last_clean":"2023-12-19T18:58:44.792474+0000","last_became_active":"2023-12-19T18:58:43.431859+0000","last_became_peered":"2023-12-19T18:58:43.431859+0000","last_unstale":"2023-12-19T18:58:44.792474+0000","last_undegraded":"2023-12-19T18:58:44.792474+0000","last_fullsized":"2023-12-19T18:58:44.792474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:44:04.102356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544165+0000","last_change":"2023-12-19T18:58:43.439545+0000","last_active":"2023-12-19T18:58:45.544165+0000","last_peered":"2023-12-19T18:58:45.544165+0000","last_clean":"2023-12-19T18:58:45.544165+0000","last_became_active":"2023-12-19T18:58:43.436090+0000","last_became_peered":"2023-12-19T18:58:43.436090+0000","last_unstale":"2023-12-19T18:58:45.544165+0000","last_undegraded":"2023-12-19T18:58:45.544165+0000","last_fullsized":"2023-12-19T18:58:45.544165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:55:56.534047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792862+0000","last_change":"2023-12-19T18:58:43.430119+0000","last_active":"2023-12-19T18:58:44.792862+0000","last_peered":"2023-12-19T18:58:44.792862+0000","last_clean":"2023-12-19T18:58:44.792862+0000","last_became_active":"2023-12-19T18:58:43.429836+0000","last_became_peered":"2023-12-19T18:58:43.429836+0000","last_unstale":"2023-12-19T18:58:44.792862+0000","last_undegraded":"2023-12-19T18:58:44.792862+0000","last_fullsized":"2023-12-19T18:58:44.792862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:59:46.730223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544665+0000","last_change":"2023-12-19T18:58:43.427764+0000","last_active":"2023-12-19T18:58:45.544665+0000","last_peered":"2023-12-19T18:58:45.544665+0000","last_clean":"2023-12-19T18:58:45.544665+0000","last_became_active":"2023-12-19T18:58:43.427468+0000","last_became_peered":"2023-12-19T18:58:43.427468+0000","last_unstale":"2023-12-19T18:58:45.544665+0000","last_undegraded":"2023-12-19T18:58:45.544665+0000","last_fullsized":"2023-12-19T18:58:45.544665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:34.691494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415960+0000","last_change":"2023-12-19T18:58:43.426942+0000","last_active":"2023-12-19T18:58:44.415960+0000","last_peered":"2023-12-19T18:58:44.415960+0000","last_clean":"2023-12-19T18:58:44.415960+0000","last_became_active":"2023-12-19T18:58:43.425745+0000","last_became_peered":"2023-12-19T18:58:43.425745+0000","last_unstale":"2023-12-19T18:58:44.415960+0000","last_undegraded":"2023-12-19T18:58:44.415960+0000","last_fullsized":"2023-12-19T18:58:44.415960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:07.765261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792753+0000","last_change":"2023-12-19T18:58:43.429529+0000","last_active":"2023-12-19T18:58:44.792753+0000","last_peered":"2023-12-19T18:58:44.792753+0000","last_clean":"2023-12-19T18:58:44.792753+0000","last_became_active":"2023-12-19T18:58:43.429246+0000","last_became_peered":"2023-12-19T18:58:43.429246+0000","last_unstale":"2023-12-19T18:58:44.792753+0000","last_undegraded":"2023-12-19T18:58:44.792753+0000","last_fullsized":"2023-12-19T18:58:44.792753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:32.378596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544186+0000","last_change":"2023-12-19T18:58:43.418652+0000","last_active":"2023-12-19T18:58:45.544186+0000","last_peered":"2023-12-19T18:58:45.544186+0000","last_clean":"2023-12-19T18:58:45.544186+0000","last_became_active":"2023-12-19T18:58:43.418300+0000","last_became_peered":"2023-12-19T18:58:43.418300+0000","last_unstale":"2023-12-19T18:58:45.544186+0000","last_undegraded":"2023-12-19T18:58:45.544186+0000","last_fullsized":"2023-12-19T18:58:45.544186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:07.498358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544797+0000","last_change":"2023-12-19T18:58:43.442141+0000","last_active":"2023-12-19T18:58:45.544797+0000","last_peered":"2023-12-19T18:58:45.544797+0000","last_clean":"2023-12-19T18:58:45.544797+0000","last_became_active":"2023-12-19T18:58:43.437293+0000","last_became_peered":"2023-12-19T18:58:43.437293+0000","last_unstale":"2023-12-19T18:58:45.544797+0000","last_undegraded":"2023-12-19T18:58:45.544797+0000","last_fullsized":"2023-12-19T18:58:45.544797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:19:43.614230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543333+0000","last_change":"2023-12-19T18:58:43.436463+0000","last_active":"2023-12-19T18:58:45.543333+0000","last_peered":"2023-12-19T18:58:45.543333+0000","last_clean":"2023-12-19T18:58:45.543333+0000","last_became_active":"2023-12-19T18:58:43.436125+0000","last_became_peered":"2023-12-19T18:58:43.436125+0000","last_unstale":"2023-12-19T18:58:45.543333+0000","last_undegraded":"2023-12-19T18:58:45.543333+0000","last_fullsized":"2023-12-19T18:58:45.543333+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:25:24.585530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544116+0000","last_change":"2023-12-19T18:58:43.426344+0000","last_active":"2023-12-19T18:58:45.544116+0000","last_peered":"2023-12-19T18:58:45.544116+0000","last_clean":"2023-12-19T18:58:45.544116+0000","last_became_active":"2023-12-19T18:58:43.425807+0000","last_became_peered":"2023-12-19T18:58:43.425807+0000","last_unstale":"2023-12-19T18:58:45.544116+0000","last_undegraded":"2023-12-19T18:58:45.544116+0000","last_fullsized":"2023-12-19T18:58:45.544116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:30.896504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420034+0000","last_change":"2023-12-19T18:58:43.426070+0000","last_active":"2023-12-19T18:58:44.420034+0000","last_peered":"2023-12-19T18:58:44.420034+0000","last_clean":"2023-12-19T18:58:44.420034+0000","last_became_active":"2023-12-19T18:58:43.425735+0000","last_became_peered":"2023-12-19T18:58:43.425735+0000","last_unstale":"2023-12-19T18:58:44.420034+0000","last_undegraded":"2023-12-19T18:58:44.420034+0000","last_fullsized":"2023-12-19T18:58:44.420034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:18:46.854237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792732+0000","last_change":"2023-12-19T18:58:42.421402+0000","last_active":"2023-12-19T18:58:44.792732+0000","last_peered":"2023-12-19T18:58:44.792732+0000","last_clean":"2023-12-19T18:58:44.792732+0000","last_became_active":"2023-12-19T18:58:42.420945+0000","last_became_peered":"2023-12-19T18:58:42.420945+0000","last_unstale":"2023-12-19T18:58:44.792732+0000","last_undegraded":"2023-12-19T18:58:44.792732+0000","last_fullsized":"2023-12-19T18:58:44.792732+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:15.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544251+0000","last_change":"2023-12-19T18:58:43.422547+0000","last_active":"2023-12-19T18:58:45.544251+0000","last_peered":"2023-12-19T18:58:45.544251+0000","last_clean":"2023-12-19T18:58:45.544251+0000","last_became_active":"2023-12-19T18:58:43.422273+0000","last_became_peered":"2023-12-19T18:58:43.422273+0000","last_unstale":"2023-12-19T18:58:45.544251+0000","last_undegraded":"2023-12-19T18:58:45.544251+0000","last_fullsized":"2023-12-19T18:58:45.544251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:34.691494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544557+0000","last_change":"2023-12-19T18:58:42.417459+0000","last_active":"2023-12-19T18:58:45.544557+0000","last_peered":"2023-12-19T18:58:45.544557+0000","last_clean":"2023-12-19T18:58:45.544557+0000","last_became_active":"2023-12-19T18:58:42.416914+0000","last_became_peered":"2023-12-19T18:58:42.416914+0000","last_unstale":"2023-12-19T18:58:45.544557+0000","last_undegraded":"2023-12-19T18:58:45.544557+0000","last_fullsized":"2023-12-19T18:58:45.544557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:24:57.289171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792561+0000","last_change":"2023-12-19T18:58:42.420750+0000","last_active":"2023-12-19T18:58:44.792561+0000","last_peered":"2023-12-19T18:58:44.792561+0000","last_clean":"2023-12-19T18:58:44.792561+0000","last_became_active":"2023-12-19T18:58:42.420475+0000","last_became_peered":"2023-12-19T18:58:42.420475+0000","last_unstale":"2023-12-19T18:58:44.792561+0000","last_undegraded":"2023-12-19T18:58:44.792561+0000","last_fullsized":"2023-12-19T18:58:44.792561+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:24:57.289171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792463+0000","last_change":"2023-12-19T18:58:43.424478+0000","last_active":"2023-12-19T18:58:44.792463+0000","last_peered":"2023-12-19T18:58:44.792463+0000","last_clean":"2023-12-19T18:58:44.792463+0000","last_became_active":"2023-12-19T18:58:43.424162+0000","last_became_peered":"2023-12-19T18:58:43.424162+0000","last_unstale":"2023-12-19T18:58:44.792463+0000","last_undegraded":"2023-12-19T18:58:44.792463+0000","last_fullsized":"2023-12-19T18:58:44.792463+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:07.498358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544259+0000","last_change":"2023-12-19T18:58:42.435884+0000","last_active":"2023-12-19T18:58:45.544259+0000","last_peered":"2023-12-19T18:58:45.544259+0000","last_clean":"2023-12-19T18:58:45.544259+0000","last_became_active":"2023-12-19T18:58:42.435572+0000","last_became_peered":"2023-12-19T18:58:42.435572+0000","last_unstale":"2023-12-19T18:58:45.544259+0000","last_undegraded":"2023-12-19T18:58:45.544259+0000","last_fullsized":"2023-12-19T18:58:45.544259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:18:45.847639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415691+0000","last_change":"2023-12-19T18:58:43.424552+0000","last_active":"2023-12-19T18:58:44.415691+0000","last_peered":"2023-12-19T18:58:44.415691+0000","last_clean":"2023-12-19T18:58:44.415691+0000","last_became_active":"2023-12-19T18:58:43.424115+0000","last_became_peered":"2023-12-19T18:58:43.424115+0000","last_unstale":"2023-12-19T18:58:44.415691+0000","last_undegraded":"2023-12-19T18:58:44.415691+0000","last_fullsized":"2023-12-19T18:58:44.415691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:07.498358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544787+0000","last_change":"2023-12-19T18:58:42.428211+0000","last_active":"2023-12-19T18:58:45.544787+0000","last_peered":"2023-12-19T18:58:45.544787+0000","last_clean":"2023-12-19T18:58:45.544787+0000","last_became_active":"2023-12-19T18:58:42.427932+0000","last_became_peered":"2023-12-19T18:58:42.427932+0000","last_unstale":"2023-12-19T18:58:45.544787+0000","last_undegraded":"2023-12-19T18:58:45.544787+0000","last_fullsized":"2023-12-19T18:58:45.544787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:15.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.545103+0000","last_change":"2023-12-19T18:58:43.436839+0000","last_active":"2023-12-19T18:58:45.545103+0000","last_peered":"2023-12-19T18:58:45.545103+0000","last_clean":"2023-12-19T18:58:45.545103+0000","last_became_active":"2023-12-19T18:58:43.436507+0000","last_became_peered":"2023-12-19T18:58:43.436507+0000","last_unstale":"2023-12-19T18:58:45.545103+0000","last_undegraded":"2023-12-19T18:58:45.545103+0000","last_fullsized":"2023-12-19T18:58:45.545103+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:11:18.747856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.545217+0000","last_change":"2023-12-19T18:58:42.435020+0000","last_active":"2023-12-19T18:58:45.545217+0000","last_peered":"2023-12-19T18:58:45.545217+0000","last_clean":"2023-12-19T18:58:45.545217+0000","last_became_active":"2023-12-19T18:58:42.434748+0000","last_became_peered":"2023-12-19T18:58:42.434748+0000","last_unstale":"2023-12-19T18:58:45.545217+0000","last_undegraded":"2023-12-19T18:58:45.545217+0000","last_fullsized":"2023-12-19T18:58:45.545217+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:33.684897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544236+0000","last_change":"2023-12-19T18:58:43.440137+0000","last_active":"2023-12-19T18:58:45.544236+0000","last_peered":"2023-12-19T18:58:45.544236+0000","last_clean":"2023-12-19T18:58:45.544236+0000","last_became_active":"2023-12-19T18:58:43.439838+0000","last_became_peered":"2023-12-19T18:58:43.439838+0000","last_unstale":"2023-12-19T18:58:45.544236+0000","last_undegraded":"2023-12-19T18:58:45.544236+0000","last_fullsized":"2023-12-19T18:58:45.544236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:44:04.102356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415975+0000","last_change":"2023-12-19T18:58:42.435783+0000","last_active":"2023-12-19T18:58:44.415975+0000","last_peered":"2023-12-19T18:58:44.415975+0000","last_clean":"2023-12-19T18:58:44.415975+0000","last_became_active":"2023-12-19T18:58:42.435495+0000","last_became_peered":"2023-12-19T18:58:42.435495+0000","last_unstale":"2023-12-19T18:58:44.415975+0000","last_undegraded":"2023-12-19T18:58:44.415975+0000","last_fullsized":"2023-12-19T18:58:44.415975+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:22:52.459401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421296+0000","last_change":"2023-12-19T18:58:43.430940+0000","last_active":"2023-12-19T18:58:44.421296+0000","last_peered":"2023-12-19T18:58:44.421296+0000","last_clean":"2023-12-19T18:58:44.421296+0000","last_became_active":"2023-12-19T18:58:43.430070+0000","last_became_peered":"2023-12-19T18:58:43.430070+0000","last_unstale":"2023-12-19T18:58:44.421296+0000","last_undegraded":"2023-12-19T18:58:44.421296+0000","last_fullsized":"2023-12-19T18:58:44.421296+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:09:00.031482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544605+0000","last_change":"2023-12-19T18:58:42.427819+0000","last_active":"2023-12-19T18:58:45.544605+0000","last_peered":"2023-12-19T18:58:45.544605+0000","last_clean":"2023-12-19T18:58:45.544605+0000","last_became_active":"2023-12-19T18:58:42.426979+0000","last_became_peered":"2023-12-19T18:58:42.426979+0000","last_unstale":"2023-12-19T18:58:45.544605+0000","last_undegraded":"2023-12-19T18:58:45.544605+0000","last_fullsized":"2023-12-19T18:58:45.544605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:22:52.459401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420420+0000","last_change":"2023-12-19T18:58:43.430761+0000","last_active":"2023-12-19T18:58:44.420420+0000","last_peered":"2023-12-19T18:58:44.420420+0000","last_clean":"2023-12-19T18:58:44.420420+0000","last_became_active":"2023-12-19T18:58:43.430368+0000","last_became_peered":"2023-12-19T18:58:43.430368+0000","last_unstale":"2023-12-19T18:58:44.420420+0000","last_undegraded":"2023-12-19T18:58:44.420420+0000","last_fullsized":"2023-12-19T18:58:44.420420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:32.378596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544283+0000","last_change":"2023-12-19T18:58:42.420964+0000","last_active":"2023-12-19T18:58:45.544283+0000","last_peered":"2023-12-19T18:58:45.544283+0000","last_clean":"2023-12-19T18:58:45.544283+0000","last_became_active":"2023-12-19T18:58:42.420575+0000","last_became_peered":"2023-12-19T18:58:42.420575+0000","last_unstale":"2023-12-19T18:58:45.544283+0000","last_undegraded":"2023-12-19T18:58:45.544283+0000","last_fullsized":"2023-12-19T18:58:45.544283+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:20:03.601498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543924+0000","last_change":"2023-12-19T18:58:43.426664+0000","last_active":"2023-12-19T18:58:45.543924+0000","last_peered":"2023-12-19T18:58:45.543924+0000","last_clean":"2023-12-19T18:58:45.543924+0000","last_became_active":"2023-12-19T18:58:43.426272+0000","last_became_peered":"2023-12-19T18:58:43.426272+0000","last_unstale":"2023-12-19T18:58:45.543924+0000","last_undegraded":"2023-12-19T18:58:45.543924+0000","last_fullsized":"2023-12-19T18:58:45.543924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:22:53.465998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544822+0000","last_change":"2023-12-19T18:58:42.430255+0000","last_active":"2023-12-19T18:58:45.544822+0000","last_peered":"2023-12-19T18:58:45.544822+0000","last_clean":"2023-12-19T18:58:45.544822+0000","last_became_active":"2023-12-19T18:58:42.429287+0000","last_became_peered":"2023-12-19T18:58:42.429287+0000","last_unstale":"2023-12-19T18:58:45.544822+0000","last_undegraded":"2023-12-19T18:58:45.544822+0000","last_fullsized":"2023-12-19T18:58:45.544822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:06.491761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420450+0000","last_change":"2023-12-19T18:58:43.432077+0000","last_active":"2023-12-19T18:58:44.420450+0000","last_peered":"2023-12-19T18:58:44.420450+0000","last_clean":"2023-12-19T18:58:44.420450+0000","last_became_active":"2023-12-19T18:58:43.431749+0000","last_became_peered":"2023-12-19T18:58:43.431749+0000","last_unstale":"2023-12-19T18:58:44.420450+0000","last_undegraded":"2023-12-19T18:58:44.420450+0000","last_fullsized":"2023-12-19T18:58:44.420450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:25:40.712335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544133+0000","last_change":"2023-12-19T18:58:42.419392+0000","last_active":"2023-12-19T18:58:45.544133+0000","last_peered":"2023-12-19T18:58:45.544133+0000","last_clean":"2023-12-19T18:58:45.544133+0000","last_became_active":"2023-12-19T18:58:42.418044+0000","last_became_peered":"2023-12-19T18:58:42.418044+0000","last_unstale":"2023-12-19T18:58:45.544133+0000","last_undegraded":"2023-12-19T18:58:45.544133+0000","last_fullsized":"2023-12-19T18:58:45.544133+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:08:59.024885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544117+0000","last_change":"2023-12-19T18:58:43.426612+0000","last_active":"2023-12-19T18:58:45.544117+0000","last_peered":"2023-12-19T18:58:45.544117+0000","last_clean":"2023-12-19T18:58:45.544117+0000","last_became_active":"2023-12-19T18:58:43.426075+0000","last_became_peered":"2023-12-19T18:58:43.426075+0000","last_unstale":"2023-12-19T18:58:45.544117+0000","last_undegraded":"2023-12-19T18:58:45.544117+0000","last_fullsized":"2023-12-19T18:58:45.544117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:26.526749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543436+0000","last_change":"2023-12-19T18:58:42.427250+0000","last_active":"2023-12-19T18:58:45.543436+0000","last_peered":"2023-12-19T18:58:45.543436+0000","last_clean":"2023-12-19T18:58:45.543436+0000","last_became_active":"2023-12-19T18:58:42.426896+0000","last_became_peered":"2023-12-19T18:58:42.426896+0000","last_unstale":"2023-12-19T18:58:45.543436+0000","last_undegraded":"2023-12-19T18:58:45.543436+0000","last_fullsized":"2023-12-19T18:58:45.543436+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:33:01.472458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420680+0000","last_change":"2023-12-19T18:58:43.441063+0000","last_active":"2023-12-19T18:58:44.420680+0000","last_peered":"2023-12-19T18:58:44.420680+0000","last_clean":"2023-12-19T18:58:44.420680+0000","last_became_active":"2023-12-19T18:58:43.440785+0000","last_became_peered":"2023-12-19T18:58:43.440785+0000","last_unstale":"2023-12-19T18:58:44.420680+0000","last_undegraded":"2023-12-19T18:58:44.420680+0000","last_fullsized":"2023-12-19T18:58:44.420680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:28.581319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421328+0000","last_change":"2023-12-19T18:58:42.422976+0000","last_active":"2023-12-19T18:58:44.421328+0000","last_peered":"2023-12-19T18:58:44.421328+0000","last_clean":"2023-12-19T18:58:44.421328+0000","last_became_active":"2023-12-19T18:58:42.422636+0000","last_became_peered":"2023-12-19T18:58:42.422636+0000","last_unstale":"2023-12-19T18:58:44.421328+0000","last_undegraded":"2023-12-19T18:58:44.421328+0000","last_fullsized":"2023-12-19T18:58:44.421328+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:33:01.472458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420427+0000","last_change":"2023-12-19T18:58:43.440387+0000","last_active":"2023-12-19T18:58:44.420427+0000","last_peered":"2023-12-19T18:58:44.420427+0000","last_clean":"2023-12-19T18:58:44.420427+0000","last_became_active":"2023-12-19T18:58:43.440084+0000","last_became_peered":"2023-12-19T18:58:43.440084+0000","last_unstale":"2023-12-19T18:58:44.420427+0000","last_undegraded":"2023-12-19T18:58:44.420427+0000","last_fullsized":"2023-12-19T18:58:44.420427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:59:46.730223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543423+0000","last_change":"2023-12-19T18:58:42.427565+0000","last_active":"2023-12-19T18:58:45.543423+0000","last_peered":"2023-12-19T18:58:45.543423+0000","last_clean":"2023-12-19T18:58:45.543423+0000","last_became_active":"2023-12-19T18:58:42.427285+0000","last_became_peered":"2023-12-19T18:58:42.427285+0000","last_unstale":"2023-12-19T18:58:45.543423+0000","last_undegraded":"2023-12-19T18:58:45.543423+0000","last_fullsized":"2023-12-19T18:58:45.543423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:20:03.601498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.421120+0000","last_change":"2023-12-19T18:58:43.434643+0000","last_active":"2023-12-19T18:58:44.421120+0000","last_peered":"2023-12-19T18:58:44.421120+0000","last_clean":"2023-12-19T18:58:44.421120+0000","last_became_active":"2023-12-19T18:58:43.434350+0000","last_became_peered":"2023-12-19T18:58:43.434350+0000","last_unstale":"2023-12-19T18:58:44.421120+0000","last_undegraded":"2023-12-19T18:58:44.421120+0000","last_fullsized":"2023-12-19T18:58:44.421120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:30:56.565777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.416075+0000","last_change":"2023-12-19T18:58:42.427501+0000","last_active":"2023-12-19T18:58:44.416075+0000","last_peered":"2023-12-19T18:58:44.416075+0000","last_clean":"2023-12-19T18:58:44.416075+0000","last_became_active":"2023-12-19T18:58:42.427005+0000","last_became_peered":"2023-12-19T18:58:42.427005+0000","last_unstale":"2023-12-19T18:58:44.416075+0000","last_undegraded":"2023-12-19T18:58:44.416075+0000","last_fullsized":"2023-12-19T18:58:44.416075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:25.520152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544894+0000","last_change":"2023-12-19T18:58:43.438327+0000","last_active":"2023-12-19T18:58:45.544894+0000","last_peered":"2023-12-19T18:58:45.544894+0000","last_clean":"2023-12-19T18:58:45.544894+0000","last_became_active":"2023-12-19T18:58:43.436427+0000","last_became_peered":"2023-12-19T18:58:43.436427+0000","last_unstale":"2023-12-19T18:58:45.544894+0000","last_undegraded":"2023-12-19T18:58:45.544894+0000","last_fullsized":"2023-12-19T18:58:45.544894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:28.581319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543362+0000","last_change":"2023-12-19T18:58:42.437129+0000","last_active":"2023-12-19T18:58:45.543362+0000","last_peered":"2023-12-19T18:58:45.543362+0000","last_clean":"2023-12-19T18:58:45.543362+0000","last_became_active":"2023-12-19T18:58:42.436883+0000","last_became_peered":"2023-12-19T18:58:42.436883+0000","last_unstale":"2023-12-19T18:58:45.543362+0000","last_undegraded":"2023-12-19T18:58:45.543362+0000","last_fullsized":"2023-12-19T18:58:45.543362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:29:22.986856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420570+0000","last_change":"2023-12-19T18:58:43.439701+0000","last_active":"2023-12-19T18:58:44.420570+0000","last_peered":"2023-12-19T18:58:44.420570+0000","last_clean":"2023-12-19T18:58:44.420570+0000","last_became_active":"2023-12-19T18:58:43.439425+0000","last_became_peered":"2023-12-19T18:58:43.439425+0000","last_unstale":"2023-12-19T18:58:44.420570+0000","last_undegraded":"2023-12-19T18:58:44.420570+0000","last_fullsized":"2023-12-19T18:58:44.420570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:19:43.614230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-19T18:58:43.415467+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T18:58:43.415467+0000","last_peered":"2023-12-19T18:58:43.415467+0000","last_clean":"2023-12-19T18:58:43.415467+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T18:58:43.415467+0000","last_undegraded":"2023-12-19T18:58:43.415467+0000","last_fullsized":"2023-12-19T18:58:43.415467+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544357+0000","last_change":"2023-12-19T18:58:42.424370+0000","last_active":"2023-12-19T18:58:45.544357+0000","last_peered":"2023-12-19T18:58:45.544357+0000","last_clean":"2023-12-19T18:58:45.544357+0000","last_became_active":"2023-12-19T18:58:42.421937+0000","last_became_peered":"2023-12-19T18:58:42.421937+0000","last_unstale":"2023-12-19T18:58:45.544357+0000","last_undegraded":"2023-12-19T18:58:45.544357+0000","last_fullsized":"2023-12-19T18:58:45.544357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:45.366694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792573+0000","last_change":"2023-12-19T18:58:43.437901+0000","last_active":"2023-12-19T18:58:44.792573+0000","last_peered":"2023-12-19T18:58:44.792573+0000","last_clean":"2023-12-19T18:58:44.792573+0000","last_became_active":"2023-12-19T18:58:43.437671+0000","last_became_peered":"2023-12-19T18:58:43.437671+0000","last_unstale":"2023-12-19T18:58:44.792573+0000","last_undegraded":"2023-12-19T18:58:44.792573+0000","last_fullsized":"2023-12-19T18:58:44.792573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:34.691494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420255+0000","last_change":"2023-12-19T18:58:42.432721+0000","last_active":"2023-12-19T18:58:44.420255+0000","last_peered":"2023-12-19T18:58:44.420255+0000","last_clean":"2023-12-19T18:58:44.420255+0000","last_became_active":"2023-12-19T18:58:42.432424+0000","last_became_peered":"2023-12-19T18:58:42.432424+0000","last_unstale":"2023-12-19T18:58:44.420255+0000","last_undegraded":"2023-12-19T18:58:44.420255+0000","last_fullsized":"2023-12-19T18:58:44.420255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:18:45.847639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543868+0000","last_change":"2023-12-19T18:58:43.416870+0000","last_active":"2023-12-19T18:58:45.543868+0000","last_peered":"2023-12-19T18:58:45.543868+0000","last_clean":"2023-12-19T18:58:45.543868+0000","last_became_active":"2023-12-19T18:58:43.416531+0000","last_became_peered":"2023-12-19T18:58:43.416531+0000","last_unstale":"2023-12-19T18:58:45.543868+0000","last_undegraded":"2023-12-19T18:58:45.543868+0000","last_fullsized":"2023-12-19T18:58:45.543868+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:09:06.965509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.543476+0000","last_change":"2023-12-19T18:58:42.421802+0000","last_active":"2023-12-19T18:58:45.543476+0000","last_peered":"2023-12-19T18:58:45.543476+0000","last_clean":"2023-12-19T18:58:45.543476+0000","last_became_active":"2023-12-19T18:58:42.421453+0000","last_became_peered":"2023-12-19T18:58:42.421453+0000","last_unstale":"2023-12-19T18:58:45.543476+0000","last_undegraded":"2023-12-19T18:58:45.543476+0000","last_fullsized":"2023-12-19T18:58:45.543476+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:07.210200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415759+0000","last_change":"2023-12-19T18:58:43.419130+0000","last_active":"2023-12-19T18:58:44.415759+0000","last_peered":"2023-12-19T18:58:44.415759+0000","last_clean":"2023-12-19T18:58:44.415759+0000","last_became_active":"2023-12-19T18:58:43.418765+0000","last_became_peered":"2023-12-19T18:58:43.418765+0000","last_unstale":"2023-12-19T18:58:44.415759+0000","last_undegraded":"2023-12-19T18:58:44.415759+0000","last_fullsized":"2023-12-19T18:58:44.415759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:46.373291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544926+0000","last_change":"2023-12-19T18:58:42.431000+0000","last_active":"2023-12-19T18:58:45.544926+0000","last_peered":"2023-12-19T18:58:45.544926+0000","last_clean":"2023-12-19T18:58:45.544926+0000","last_became_active":"2023-12-19T18:58:42.430652+0000","last_became_peered":"2023-12-19T18:58:42.430652+0000","last_unstale":"2023-12-19T18:58:45.544926+0000","last_undegraded":"2023-12-19T18:58:45.544926+0000","last_fullsized":"2023-12-19T18:58:45.544926+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:44:03.095759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420568+0000","last_change":"2023-12-19T18:58:43.424247+0000","last_active":"2023-12-19T18:58:44.420568+0000","last_peered":"2023-12-19T18:58:44.420568+0000","last_clean":"2023-12-19T18:58:44.420568+0000","last_became_active":"2023-12-19T18:58:43.422534+0000","last_became_peered":"2023-12-19T18:58:43.422534+0000","last_unstale":"2023-12-19T18:58:44.420568+0000","last_undegraded":"2023-12-19T18:58:44.420568+0000","last_fullsized":"2023-12-19T18:58:44.420568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:25:24.585530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415907+0000","last_change":"2023-12-19T18:58:42.418032+0000","last_active":"2023-12-19T18:58:44.415907+0000","last_peered":"2023-12-19T18:58:44.415907+0000","last_clean":"2023-12-19T18:58:44.415907+0000","last_became_active":"2023-12-19T18:58:42.417765+0000","last_became_peered":"2023-12-19T18:58:42.417765+0000","last_unstale":"2023-12-19T18:58:44.415907+0000","last_undegraded":"2023-12-19T18:58:44.415907+0000","last_fullsized":"2023-12-19T18:58:44.415907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:09:05.958912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.545286+0000","last_change":"2023-12-19T18:58:43.438006+0000","last_active":"2023-12-19T18:58:45.545286+0000","last_peered":"2023-12-19T18:58:45.545286+0000","last_clean":"2023-12-19T18:58:45.545286+0000","last_became_active":"2023-12-19T18:58:43.437618+0000","last_became_peered":"2023-12-19T18:58:43.437618+0000","last_unstale":"2023-12-19T18:58:45.545286+0000","last_undegraded":"2023-12-19T18:58:45.545286+0000","last_fullsized":"2023-12-19T18:58:45.545286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:43:58.809550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420900+0000","last_change":"2023-12-19T18:58:42.433488+0000","last_active":"2023-12-19T18:58:44.420900+0000","last_peered":"2023-12-19T18:58:44.420900+0000","last_clean":"2023-12-19T18:58:44.420900+0000","last_became_active":"2023-12-19T18:58:42.433023+0000","last_became_peered":"2023-12-19T18:58:42.433023+0000","last_unstale":"2023-12-19T18:58:44.420900+0000","last_undegraded":"2023-12-19T18:58:44.420900+0000","last_fullsized":"2023-12-19T18:58:44.420900+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:25:25.520152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415951+0000","last_change":"2023-12-19T18:58:43.419840+0000","last_active":"2023-12-19T18:58:44.415951+0000","last_peered":"2023-12-19T18:58:44.415951+0000","last_clean":"2023-12-19T18:58:44.415951+0000","last_became_active":"2023-12-19T18:58:43.419340+0000","last_became_peered":"2023-12-19T18:58:43.419340+0000","last_unstale":"2023-12-19T18:58:44.415951+0000","last_undegraded":"2023-12-19T18:58:44.415951+0000","last_fullsized":"2023-12-19T18:58:44.415951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:34.691494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.858596+0000","last_change":"2023-12-19T18:58:42.421889+0000","last_active":"2023-12-19T18:58:45.858596+0000","last_peered":"2023-12-19T18:58:45.858596+0000","last_clean":"2023-12-19T18:58:45.858596+0000","last_became_active":"2023-12-19T18:58:42.421524+0000","last_became_peered":"2023-12-19T18:58:42.421524+0000","last_unstale":"2023-12-19T18:58:45.858596+0000","last_undegraded":"2023-12-19T18:58:45.858596+0000","last_fullsized":"2023-12-19T18:58:45.858596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:24:57.289171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792880+0000","last_change":"2023-12-19T18:58:43.427768+0000","last_active":"2023-12-19T18:58:44.792880+0000","last_peered":"2023-12-19T18:58:44.792880+0000","last_clean":"2023-12-19T18:58:44.792880+0000","last_became_active":"2023-12-19T18:58:43.427358+0000","last_became_peered":"2023-12-19T18:58:43.427358+0000","last_unstale":"2023-12-19T18:58:44.792880+0000","last_undegraded":"2023-12-19T18:58:44.792880+0000","last_fullsized":"2023-12-19T18:58:44.792880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:25:40.712335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544879+0000","last_change":"2023-12-19T18:58:42.433397+0000","last_active":"2023-12-19T18:58:45.544879+0000","last_peered":"2023-12-19T18:58:45.544879+0000","last_clean":"2023-12-19T18:58:45.544879+0000","last_became_active":"2023-12-19T18:58:42.433055+0000","last_became_peered":"2023-12-19T18:58:42.433055+0000","last_unstale":"2023-12-19T18:58:45.544879+0000","last_undegraded":"2023-12-19T18:58:45.544879+0000","last_fullsized":"2023-12-19T18:58:45.544879+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:09:05.958912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544244+0000","last_change":"2023-12-19T18:58:43.421411+0000","last_active":"2023-12-19T18:58:45.544244+0000","last_peered":"2023-12-19T18:58:45.544244+0000","last_clean":"2023-12-19T18:58:45.544244+0000","last_became_active":"2023-12-19T18:58:43.421095+0000","last_became_peered":"2023-12-19T18:58:43.421095+0000","last_unstale":"2023-12-19T18:58:45.544244+0000","last_undegraded":"2023-12-19T18:58:45.544244+0000","last_fullsized":"2023-12-19T18:58:45.544244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:46.373291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420158+0000","last_change":"2023-12-19T18:58:42.434661+0000","last_active":"2023-12-19T18:58:44.420158+0000","last_peered":"2023-12-19T18:58:44.420158+0000","last_clean":"2023-12-19T18:58:44.420158+0000","last_became_active":"2023-12-19T18:58:42.432945+0000","last_became_peered":"2023-12-19T18:58:42.432945+0000","last_unstale":"2023-12-19T18:58:44.420158+0000","last_undegraded":"2023-12-19T18:58:44.420158+0000","last_fullsized":"2023-12-19T18:58:44.420158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:33:01.472458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420046+0000","last_change":"2023-12-19T18:58:43.430118+0000","last_active":"2023-12-19T18:58:44.420046+0000","last_peered":"2023-12-19T18:58:44.420046+0000","last_clean":"2023-12-19T18:58:44.420046+0000","last_became_active":"2023-12-19T18:58:43.428710+0000","last_became_peered":"2023-12-19T18:58:43.428710+0000","last_unstale":"2023-12-19T18:58:44.420046+0000","last_undegraded":"2023-12-19T18:58:44.420046+0000","last_fullsized":"2023-12-19T18:58:44.420046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:20:04.608095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415775+0000","last_change":"2023-12-19T18:58:42.432562+0000","last_active":"2023-12-19T18:58:44.415775+0000","last_peered":"2023-12-19T18:58:44.415775+0000","last_clean":"2023-12-19T18:58:44.415775+0000","last_became_active":"2023-12-19T18:58:42.432307+0000","last_became_peered":"2023-12-19T18:58:42.432307+0000","last_unstale":"2023-12-19T18:58:44.415775+0000","last_undegraded":"2023-12-19T18:58:44.415775+0000","last_fullsized":"2023-12-19T18:58:44.415775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:35.982824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792510+0000","last_change":"2023-12-19T18:58:43.421115+0000","last_active":"2023-12-19T18:58:44.792510+0000","last_peered":"2023-12-19T18:58:44.792510+0000","last_clean":"2023-12-19T18:58:44.792510+0000","last_became_active":"2023-12-19T18:58:43.419370+0000","last_became_peered":"2023-12-19T18:58:43.419370+0000","last_unstale":"2023-12-19T18:58:44.792510+0000","last_undegraded":"2023-12-19T18:58:44.792510+0000","last_fullsized":"2023-12-19T18:58:44.792510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:46.373291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.415921+0000","last_change":"2023-12-19T18:58:42.428553+0000","last_active":"2023-12-19T18:58:44.415921+0000","last_peered":"2023-12-19T18:58:44.415921+0000","last_clean":"2023-12-19T18:58:44.415921+0000","last_became_active":"2023-12-19T18:58:42.425181+0000","last_became_peered":"2023-12-19T18:58:42.425181+0000","last_unstale":"2023-12-19T18:58:44.415921+0000","last_undegraded":"2023-12-19T18:58:44.415921+0000","last_fullsized":"2023-12-19T18:58:44.415921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:29.889906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792641+0000","last_change":"2023-12-19T18:58:43.425659+0000","last_active":"2023-12-19T18:58:44.792641+0000","last_peered":"2023-12-19T18:58:44.792641+0000","last_clean":"2023-12-19T18:58:44.792641+0000","last_became_active":"2023-12-19T18:58:43.425393+0000","last_became_peered":"2023-12-19T18:58:43.425393+0000","last_unstale":"2023-12-19T18:58:44.792641+0000","last_undegraded":"2023-12-19T18:58:44.792641+0000","last_fullsized":"2023-12-19T18:58:44.792641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:07.765261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420547+0000","last_change":"2023-12-19T18:58:42.432966+0000","last_active":"2023-12-19T18:58:44.420547+0000","last_peered":"2023-12-19T18:58:44.420547+0000","last_clean":"2023-12-19T18:58:44.420547+0000","last_became_active":"2023-12-19T18:58:42.432661+0000","last_became_peered":"2023-12-19T18:58:42.432661+0000","last_unstale":"2023-12-19T18:58:44.420547+0000","last_undegraded":"2023-12-19T18:58:44.420547+0000","last_fullsized":"2023-12-19T18:58:44.420547+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:06.758664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544675+0000","last_change":"2023-12-19T18:58:43.428930+0000","last_active":"2023-12-19T18:58:45.544675+0000","last_peered":"2023-12-19T18:58:45.544675+0000","last_clean":"2023-12-19T18:58:45.544675+0000","last_became_active":"2023-12-19T18:58:43.428623+0000","last_became_peered":"2023-12-19T18:58:43.428623+0000","last_unstale":"2023-12-19T18:58:45.544675+0000","last_undegraded":"2023-12-19T18:58:45.544675+0000","last_fullsized":"2023-12-19T18:58:45.544675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:07.765261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.545246+0000","last_change":"2023-12-19T18:58:43.438141+0000","last_active":"2023-12-19T18:58:45.545246+0000","last_peered":"2023-12-19T18:58:45.545246+0000","last_clean":"2023-12-19T18:58:45.545246+0000","last_became_active":"2023-12-19T18:58:43.437765+0000","last_became_peered":"2023-12-19T18:58:43.437765+0000","last_unstale":"2023-12-19T18:58:45.545246+0000","last_undegraded":"2023-12-19T18:58:45.545246+0000","last_fullsized":"2023-12-19T18:58:45.545246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:46.807064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420235+0000","last_change":"2023-12-19T18:58:42.436647+0000","last_active":"2023-12-19T18:58:44.420235+0000","last_peered":"2023-12-19T18:58:44.420235+0000","last_clean":"2023-12-19T18:58:44.420235+0000","last_became_active":"2023-12-19T18:58:42.436356+0000","last_became_peered":"2023-12-19T18:58:42.436356+0000","last_unstale":"2023-12-19T18:58:44.420235+0000","last_undegraded":"2023-12-19T18:58:44.420235+0000","last_fullsized":"2023-12-19T18:58:44.420235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:06.491761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544884+0000","last_change":"2023-12-19T18:58:43.438524+0000","last_active":"2023-12-19T18:58:45.544884+0000","last_peered":"2023-12-19T18:58:45.544884+0000","last_clean":"2023-12-19T18:58:45.544884+0000","last_became_active":"2023-12-19T18:58:43.436745+0000","last_became_peered":"2023-12-19T18:58:43.436745+0000","last_unstale":"2023-12-19T18:58:45.544884+0000","last_undegraded":"2023-12-19T18:58:45.544884+0000","last_fullsized":"2023-12-19T18:58:45.544884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:32:14.763407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.420673+0000","last_change":"2023-12-19T18:58:42.432955+0000","last_active":"2023-12-19T18:58:44.420673+0000","last_peered":"2023-12-19T18:58:44.420673+0000","last_clean":"2023-12-19T18:58:44.420673+0000","last_became_active":"2023-12-19T18:58:42.432616+0000","last_became_peered":"2023-12-19T18:58:42.432616+0000","last_unstale":"2023-12-19T18:58:44.420673+0000","last_undegraded":"2023-12-19T18:58:44.420673+0000","last_fullsized":"2023-12-19T18:58:44.420673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:15.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544293+0000","last_change":"2023-12-19T18:58:43.440165+0000","last_active":"2023-12-19T18:58:45.544293+0000","last_peered":"2023-12-19T18:58:45.544293+0000","last_clean":"2023-12-19T18:58:45.544293+0000","last_became_active":"2023-12-19T18:58:43.439853+0000","last_became_peered":"2023-12-19T18:58:43.439853+0000","last_unstale":"2023-12-19T18:58:45.544293+0000","last_undegraded":"2023-12-19T18:58:45.544293+0000","last_fullsized":"2023-12-19T18:58:45.544293+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:07.765261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792856+0000","last_change":"2023-12-19T18:58:42.423728+0000","last_active":"2023-12-19T18:58:44.792856+0000","last_peered":"2023-12-19T18:58:44.792856+0000","last_clean":"2023-12-19T18:58:44.792856+0000","last_became_active":"2023-12-19T18:58:42.423467+0000","last_became_peered":"2023-12-19T18:58:42.423467+0000","last_unstale":"2023-12-19T18:58:44.792856+0000","last_undegraded":"2023-12-19T18:58:44.792856+0000","last_fullsized":"2023-12-19T18:58:44.792856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:09:05.958912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:44.792893+0000","last_change":"2023-12-19T18:58:43.431360+0000","last_active":"2023-12-19T18:58:44.792893+0000","last_peered":"2023-12-19T18:58:44.792893+0000","last_clean":"2023-12-19T18:58:44.792893+0000","last_became_active":"2023-12-19T18:58:43.431079+0000","last_became_peered":"2023-12-19T18:58:43.431079+0000","last_unstale":"2023-12-19T18:58:44.792893+0000","last_undegraded":"2023-12-19T18:58:44.792893+0000","last_fullsized":"2023-12-19T18:58:44.792893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:42.392797+0000","last_clean_scrub_stamp":"2023-12-19T18:58:42.392797+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:19:43.614230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-19T18:58:45.544292+0000","last_change":"2023-12-19T18:58:42.428088+0000","last_active":"2023-12-19T18:58:45.544292+0000","last_peered":"2023-12-19T18:58:45.544292+0000","last_clean":"2023-12-19T18:58:45.544292+0000","last_became_active":"2023-12-19T18:58:42.427833+0000","last_became_peered":"2023-12-19T18:58:42.427833+0000","last_unstale":"2023-12-19T18:58:45.544292+0000","last_undegraded":"2023-12-19T18:58:45.544292+0000","last_fullsized":"2023-12-19T18:58:45.544292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:41.386199+0000","last_clean_scrub_stamp":"2023-12-19T18:58:41.386199+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:17:15.991381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.458}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1930000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0259999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.968}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.903}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.875}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9129999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.8399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.2690000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3490000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.1609999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.3310000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":806912,"data_stored":660897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T18:58:53.730 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-19T18:58:53.730 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-19T18:58:53.730 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-19T18:58:53.730 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-19T18:58:53.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.900+0000 7f83bacfe640 1 Processor -- start 2023-12-19T18:58:53.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.900+0000 7f83bacfe640 1 -- start start 2023-12-19T18:58:53.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.904+0000 7f83bacfe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f83b4072090 0x7f83b4150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:53.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.904+0000 7f83bacfe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f83b40725c0 0x7f83b41514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:53.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.904+0000 7f83bacfe640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b40c2760 con 0x7f83b40a5370 2023-12-19T18:58:53.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.904+0000 7f83bacfe640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b40c3070 con 0x7f83b4072090 2023-12-19T18:58:53.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.904+0000 7f83bacfe640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b40a5750 con 0x7f83b40725c0 2023-12-19T18:58:53.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.904+0000 7f83abfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f83b4072090 0x7f83b4150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:53.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.904+0000 7f83b8a9a640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f83b40a5370 0x7f83b40c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42642/0 (socket says 172.21.15.133:42642) 2023-12-19T18:58:53.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.904+0000 7f83abfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f83b4072090 0x7f83b4150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54828/0 (socket says 172.21.15.133:54828) 2023-12-19T18:58:53.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.904+0000 7f83b8a9a640 1 -- 172.21.15.133:0/342145632 learned_addr learned my addr 172.21.15.133:0/342145632 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:53.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.904+0000 7f83b929b640 1 --2- 172.21.15.133:0/342145632 >> v2:172.21.15.138:3300/0 conn(0x7f83b40725c0 0x7f83b41514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:53.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.904+0000 7f83abfff640 1 -- 172.21.15.133:0/342145632 >> v2:172.21.15.138:3300/0 conn(0x7f83b40725c0 msgr2=0x7f83b41514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:53.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.904+0000 7f83abfff640 1 --2- 172.21.15.133:0/342145632 >> v2:172.21.15.138:3300/0 conn(0x7f83b40725c0 0x7f83b41514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:53.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.904+0000 7f83abfff640 1 -- 172.21.15.133:0/342145632 >> v1:172.21.15.133:6789/0 conn(0x7f83b40a5370 legacy=0x7f83b40c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:53.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.904+0000 7f83abfff640 1 -- 172.21.15.133:0/342145632 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b40aad20 con 0x7f83b4072090 2023-12-19T18:58:53.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.904+0000 7f83ab7fe640 1 -- 172.21.15.133:0/342145632 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3476261626 0 0) 0x7f83b40c2760 con 0x7f83b40a5370 2023-12-19T18:58:53.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.908+0000 7f83abfff640 1 --2- 172.21.15.133:0/342145632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83b4072090 0x7f83b4150fa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f83b4072020 tx=0x7f83a401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a032546211afd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:53.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.908+0000 7f83ab7fe640 1 -- 172.21.15.133:0/342145632 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a40ab600 con 0x7f83b4072090 2023-12-19T18:58:53.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.908+0000 7f83ab7fe640 1 -- 172.21.15.133:0/342145632 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a40a7050 con 0x7f83b4072090 2023-12-19T18:58:53.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.908+0000 7f83ab7fe640 1 -- 172.21.15.133:0/342145632 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a40ab980 con 0x7f83b4072090 2023-12-19T18:58:53.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.908+0000 7f83bacfe640 1 -- 172.21.15.133:0/342145632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83b4072090 msgr2=0x7f83b4150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:53.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.908+0000 7f83bacfe640 1 --2- 172.21.15.133:0/342145632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83b4072090 0x7f83b4150fa0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f83b4072020 tx=0x7f83a401c310 comp rx=0 tx=0).stop 2023-12-19T18:58:53.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.908+0000 7f83bacfe640 1 -- 172.21.15.133:0/342145632 shutdown_connections 2023-12-19T18:58:53.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.908+0000 7f83bacfe640 1 --2- 172.21.15.133:0/342145632 >> v2:172.21.15.138:3300/0 conn(0x7f83b40725c0 0x7f83b41514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:53.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.908+0000 7f83bacfe640 1 --2- 172.21.15.133:0/342145632 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83b4072090 0x7f83b4150fa0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:53.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.908+0000 7f83bacfe640 1 -- 172.21.15.133:0/342145632 >> 172.21.15.133:0/342145632 conn(0x7f83b406a5b0 msgr2=0x7f83b406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:53.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.908+0000 7f83bacfe640 1 -- 172.21.15.133:0/342145632 shutdown_connections 2023-12-19T18:58:53.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.908+0000 7f83bacfe640 1 -- 172.21.15.133:0/342145632 wait complete. 2023-12-19T18:58:53.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.908+0000 7f83bacfe640 1 Processor -- start 2023-12-19T18:58:53.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.908+0000 7f83bacfe640 1 -- start start 2023-12-19T18:58:53.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.908+0000 7f83bacfe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83b4072090 0x7f83b414df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:53.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83bacfe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83b40725c0 0x7f83b4142a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:53.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83bacfe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83b40a5370 0x7f83b4142f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:53.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83bacfe640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b414c220 con 0x7f83b40a5370 2023-12-19T18:58:53.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83bacfe640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b41f0b20 con 0x7f83b4072090 2023-12-19T18:58:53.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83bacfe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b41f0e00 con 0x7f83b40725c0 2023-12-19T18:58:53.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83b929b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83b40a5370 0x7f83b4142f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:53.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83b929b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83b40a5370 0x7f83b4142f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54840/0 (socket says 172.21.15.133:54840) 2023-12-19T18:58:53.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83b929b640 1 -- 172.21.15.133:0/910339846 learned_addr learned my addr 172.21.15.133:0/910339846 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:53.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83b8a9a640 1 --2- 172.21.15.133:0/910339846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83b4072090 0x7f83b414df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:53.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83abfff640 1 --2- 172.21.15.133:0/910339846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83b40725c0 0x7f83b4142a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:53.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83b929b640 1 -- 172.21.15.133:0/910339846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83b40725c0 msgr2=0x7f83b4142a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:53.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83b929b640 1 --2- 172.21.15.133:0/910339846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83b40725c0 0x7f83b4142a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:53.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83b929b640 1 -- 172.21.15.133:0/910339846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83b4072090 msgr2=0x7f83b414df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:53.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83b929b640 1 --2- 172.21.15.133:0/910339846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83b4072090 0x7f83b414df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:53.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83b929b640 1 -- 172.21.15.133:0/910339846 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a4009420 con 0x7f83b40a5370 2023-12-19T18:58:53.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83abfff640 1 --2- 172.21.15.133:0/910339846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83b40725c0 0x7f83b4142a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:53.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83b8a9a640 1 --2- 172.21.15.133:0/910339846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83b4072090 0x7f83b414df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:53.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83b929b640 1 --2- 172.21.15.133:0/910339846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83b40a5370 0x7f83b4142f40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f83ac007e40 tx=0x7f83ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:53.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83a97fa640 1 -- 172.21.15.133:0/910339846 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac014620 con 0x7f83b40a5370 2023-12-19T18:58:53.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83a97fa640 1 -- 172.21.15.133:0/910339846 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ac00ee90 con 0x7f83b40a5370 2023-12-19T18:58:53.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83a97fa640 1 -- 172.21.15.133:0/910339846 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ac0149e0 con 0x7f83b40a5370 2023-12-19T18:58:53.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83bacfe640 1 -- 172.21.15.133:0/910339846 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b414c470 con 0x7f83b40a5370 2023-12-19T18:58:53.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83bacfe640 1 -- 172.21.15.133:0/910339846 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b414e460 con 0x7f83b40a5370 2023-12-19T18:58:53.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83bacfe640 1 -- 172.21.15.133:0/910339846 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b41f0fd0 con 0x7f83b40a5370 2023-12-19T18:58:53.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.912+0000 7f83a97fa640 1 -- 172.21.15.133:0/910339846 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f83ac014b40 con 0x7f83b40a5370 2023-12-19T18:58:53.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.916+0000 7f83a97fa640 1 --2- 172.21.15.133:0/910339846 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f83a00664a0 0x7f83a0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:53.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.916+0000 7f83a97fa640 1 -- 172.21.15.133:0/910339846 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f83ac0848c0 con 0x7f83b40a5370 2023-12-19T18:58:53.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.916+0000 7f83b8a9a640 1 --2- 172.21.15.133:0/910339846 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f83a00664a0 0x7f83a0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:53.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.916+0000 7f83b8a9a640 1 --2- 172.21.15.133:0/910339846 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f83a00664a0 0x7f83a0068960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f83b0007fd0 tx=0x7f83b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:53.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:53.920+0000 7f83a97fa640 1 -- 172.21.15.133:0/910339846 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f83ac051ca0 con 0x7f83b40a5370 2023-12-19T18:58:54.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.096+0000 7f83bacfe640 1 -- 172.21.15.133:0/910339846 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f83b414c990 con 0x7f83b40a5370 2023-12-19T18:58:54.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.100+0000 7f83a97fa640 1 -- 172.21.15.133:0/910339846 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f83b414c990 con 0x7f83b40a5370 2023-12-19T18:58:54.103 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:54.103 INFO:teuthology.orchestra.run.smithi133.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-19T18:58:54.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.100+0000 7f83bacfe640 1 -- 172.21.15.133:0/910339846 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f83a00664a0 msgr2=0x7f83a0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:54.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.100+0000 7f83bacfe640 1 --2- 172.21.15.133:0/910339846 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f83a00664a0 0x7f83a0068960 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f83b0007fd0 tx=0x7f83b0009040 comp rx=0 tx=0).stop 2023-12-19T18:58:54.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.100+0000 7f83bacfe640 1 -- 172.21.15.133:0/910339846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83b40a5370 msgr2=0x7f83b4142f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:54.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.100+0000 7f83bacfe640 1 --2- 172.21.15.133:0/910339846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83b40a5370 0x7f83b4142f40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f83ac007e40 tx=0x7f83ac00e4b0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.100+0000 7f83bacfe640 1 -- 172.21.15.133:0/910339846 shutdown_connections 2023-12-19T18:58:54.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.100+0000 7f83bacfe640 1 --2- 172.21.15.133:0/910339846 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f83a00664a0 0x7f83a0068960 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.100+0000 7f83bacfe640 1 --2- 172.21.15.133:0/910339846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f83b40a5370 0x7f83b4142f40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.100+0000 7f83bacfe640 1 --2- 172.21.15.133:0/910339846 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83b40725c0 0x7f83b4142a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.100+0000 7f83bacfe640 1 --2- 172.21.15.133:0/910339846 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f83b4072090 0x7f83b414df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.100+0000 7f83bacfe640 1 -- 172.21.15.133:0/910339846 >> 172.21.15.133:0/910339846 conn(0x7f83b406a5b0 msgr2=0x7f83b40c0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:54.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.100+0000 7f83bacfe640 1 -- 172.21.15.133:0/910339846 shutdown_connections 2023-12-19T18:58:54.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.100+0000 7f83bacfe640 1 -- 172.21.15.133:0/910339846 wait complete. 2023-12-19T18:58:54.124 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-19T18:58:54.124 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:58:54.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.256+0000 7f577febb640 1 Processor -- start 2023-12-19T18:58:54.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.256+0000 7f577febb640 1 -- start start 2023-12-19T18:58:54.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.260+0000 7f577febb640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57780a5370 0x7f57780c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:54.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.260+0000 7f577febb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5778072090 0x7f57781516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:54.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.260+0000 7f577febb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57780c2760 con 0x7f57780c4110 2023-12-19T18:58:54.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.260+0000 7f577febb640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57780c3070 con 0x7f57780a5370 2023-12-19T18:58:54.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.260+0000 7f577febb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5778151bf0 con 0x7f5778072090 2023-12-19T18:58:54.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.260+0000 7f577dc57640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57780a5370 0x7f57780c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:54.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.260+0000 7f577dc57640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57780a5370 0x7f57780c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54856/0 (socket says 172.21.15.133:54856) 2023-12-19T18:58:54.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.260+0000 7f577dc57640 1 -- 172.21.15.133:0/439700609 learned_addr learned my addr 172.21.15.133:0/439700609 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:54.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.260+0000 7f577e458640 1 --2- 172.21.15.133:0/439700609 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5778072090 0x7f57781516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:54.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.260+0000 7f577dc57640 1 -- 172.21.15.133:0/439700609 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5778072090 msgr2=0x7f57781516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.260+0000 7f577dc57640 1 --2- 172.21.15.133:0/439700609 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5778072090 0x7f57781516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.260+0000 7f577dc57640 1 -- 172.21.15.133:0/439700609 >> v1:172.21.15.138:6789/0 conn(0x7f57780c4110 legacy=0x7f5778150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:54.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.260+0000 7f577dc57640 1 -- 172.21.15.133:0/439700609 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57780a5750 con 0x7f57780a5370 2023-12-19T18:58:54.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.264+0000 7f577dc57640 1 --2- 172.21.15.133:0/439700609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57780a5370 0x7f57780c3bd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f57740098a0 tx=0x7f577401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa600aa2653cdc6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.264+0000 7f577cc55640 1 -- 172.21.15.133:0/439700609 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774004230 con 0x7f57780a5370 2023-12-19T18:58:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.264+0000 7f577cc55640 1 -- 172.21.15.133:0/439700609 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57740a7050 con 0x7f57780a5370 2023-12-19T18:58:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.264+0000 7f577cc55640 1 -- 172.21.15.133:0/439700609 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774003620 con 0x7f57780a5370 2023-12-19T18:58:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.264+0000 7f577febb640 1 -- 172.21.15.133:0/439700609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57780a5370 msgr2=0x7f57780c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:54.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.264+0000 7f577febb640 1 --2- 172.21.15.133:0/439700609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57780a5370 0x7f57780c3bd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f57740098a0 tx=0x7f577401c3d0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.264+0000 7f577febb640 1 -- 172.21.15.133:0/439700609 shutdown_connections 2023-12-19T18:58:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.264+0000 7f577febb640 1 --2- 172.21.15.133:0/439700609 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5778072090 0x7f57781516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.264+0000 7f577febb640 1 --2- 172.21.15.133:0/439700609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57780a5370 0x7f57780c3bd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.264+0000 7f577febb640 1 -- 172.21.15.133:0/439700609 >> 172.21.15.133:0/439700609 conn(0x7f577806a5b0 msgr2=0x7f577806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.264+0000 7f577febb640 1 -- 172.21.15.133:0/439700609 shutdown_connections 2023-12-19T18:58:54.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.264+0000 7f577febb640 1 -- 172.21.15.133:0/439700609 wait complete. 2023-12-19T18:58:54.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.264+0000 7f577febb640 1 Processor -- start 2023-12-19T18:58:54.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.264+0000 7f577febb640 1 -- start start 2023-12-19T18:58:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.264+0000 7f577febb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5778072090 0x7f5778148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:54.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f577febb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57780a5370 0x7f57781485a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f577febb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57780c4110 0x7f5778070530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f577febb640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f577814f100 con 0x7f5778072090 2023-12-19T18:58:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f577febb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5778149230 con 0x7f57780c4110 2023-12-19T18:58:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f577febb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5778150420 con 0x7f57780a5370 2023-12-19T18:58:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f577dc57640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5778072090 0x7f5778148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f577dc57640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5778072090 0x7f5778148060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54860/0 (socket says 172.21.15.133:54860) 2023-12-19T18:58:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f577dc57640 1 -- 172.21.15.133:0/3325968928 learned_addr learned my addr 172.21.15.133:0/3325968928 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f577e458640 1 --2- 172.21.15.133:0/3325968928 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57780c4110 0x7f5778070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f577d456640 1 --2- 172.21.15.133:0/3325968928 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57780a5370 0x7f57781485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f577dc57640 1 -- 172.21.15.133:0/3325968928 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57780a5370 msgr2=0x7f57781485a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f577dc57640 1 --2- 172.21.15.133:0/3325968928 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57780a5370 0x7f57781485a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f577dc57640 1 -- 172.21.15.133:0/3325968928 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57780c4110 msgr2=0x7f5778070530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f577dc57640 1 --2- 172.21.15.133:0/3325968928 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57780c4110 0x7f5778070530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f577dc57640 1 -- 172.21.15.133:0/3325968928 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57740094d0 con 0x7f5778072090 2023-12-19T18:58:54.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f577d456640 1 --2- 172.21.15.133:0/3325968928 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57780a5370 0x7f57781485a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:54.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f577dc57640 1 --2- 172.21.15.133:0/3325968928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5778072090 0x7f5778148060 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f577401a000 tx=0x7f5774019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:54.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f576e7fc640 1 -- 172.21.15.133:0/3325968928 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774003bb0 con 0x7f5778072090 2023-12-19T18:58:54.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f576e7fc640 1 -- 172.21.15.133:0/3325968928 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5774003d30 con 0x7f5778072090 2023-12-19T18:58:54.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f576e7fc640 1 -- 172.21.15.133:0/3325968928 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774003ea0 con 0x7f5778072090 2023-12-19T18:58:54.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f577febb640 1 -- 172.21.15.133:0/3325968928 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57781ee420 con 0x7f5778072090 2023-12-19T18:58:54.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f577febb640 1 -- 172.21.15.133:0/3325968928 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57781518b0 con 0x7f5778072090 2023-12-19T18:58:54.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f577febb640 1 -- 172.21.15.133:0/3325968928 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57781ee270 con 0x7f5778072090 2023-12-19T18:58:54.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.268+0000 7f576e7fc640 1 -- 172.21.15.133:0/3325968928 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f57740ab680 con 0x7f5778072090 2023-12-19T18:58:54.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.272+0000 7f576e7fc640 1 --2- 172.21.15.133:0/3325968928 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f575c066470 0x7f575c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:54.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.272+0000 7f576e7fc640 1 -- 172.21.15.133:0/3325968928 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f577411e770 con 0x7f5778072090 2023-12-19T18:58:54.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.272+0000 7f577d456640 1 --2- 172.21.15.133:0/3325968928 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f575c066470 0x7f575c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:54.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.272+0000 7f577d456640 1 --2- 172.21.15.133:0/3325968928 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f575c066470 0x7f575c068930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5778151850 tx=0x7f5768009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:54.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.276+0000 7f576e7fc640 1 -- 172.21.15.133:0/3325968928 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f57740ebbe0 con 0x7f5778072090 2023-12-19T18:58:54.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.424+0000 7f577febb640 1 -- 172.21.15.133:0/3325968928 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5778068400 con 0x7f5778072090 2023-12-19T18:58:54.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.424+0000 7f576e7fc640 1 -- 172.21.15.133:0/3325968928 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f57740ef200 con 0x7f5778072090 2023-12-19T18:58:54.430 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:54.430 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:44.402984+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:58:40.991408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T18:58:41.773992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:58:54.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.428+0000 7f577febb640 1 -- 172.21.15.133:0/3325968928 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f575c066470 msgr2=0x7f575c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:54.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.428+0000 7f577febb640 1 --2- 172.21.15.133:0/3325968928 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f575c066470 0x7f575c068930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5778151850 tx=0x7f5768009040 comp rx=0 tx=0).stop 2023-12-19T18:58:54.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.428+0000 7f577febb640 1 -- 172.21.15.133:0/3325968928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5778072090 msgr2=0x7f5778148060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:54.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.428+0000 7f577febb640 1 --2- 172.21.15.133:0/3325968928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5778072090 0x7f5778148060 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f577401a000 tx=0x7f5774019170 comp rx=0 tx=0).stop 2023-12-19T18:58:54.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.428+0000 7f577febb640 1 -- 172.21.15.133:0/3325968928 shutdown_connections 2023-12-19T18:58:54.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.428+0000 7f577febb640 1 --2- 172.21.15.133:0/3325968928 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f575c066470 0x7f575c068930 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.428+0000 7f577febb640 1 --2- 172.21.15.133:0/3325968928 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57780c4110 0x7f5778070530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.428+0000 7f577febb640 1 --2- 172.21.15.133:0/3325968928 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57780a5370 0x7f57781485a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.428+0000 7f577febb640 1 --2- 172.21.15.133:0/3325968928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5778072090 0x7f5778148060 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.428+0000 7f577febb640 1 -- 172.21.15.133:0/3325968928 >> 172.21.15.133:0/3325968928 conn(0x7f577806a5b0 msgr2=0x7f577815ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:54.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.428+0000 7f577febb640 1 -- 172.21.15.133:0/3325968928 shutdown_connections 2023-12-19T18:58:54.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.428+0000 7f577febb640 1 -- 172.21.15.133:0/3325968928 wait complete. 2023-12-19T18:58:54.451 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:58:40.991408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:58:41.773992+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:58:54.452 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:58:54.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f26032640 1 Processor -- start 2023-12-19T18:58:54.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f26032640 1 -- start start 2023-12-19T18:58:54.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f26032640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0f20072090 0x7f0f20150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:54.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f26032640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f200c2760 con 0x7f0f200725c0 2023-12-19T18:58:54.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f26032640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f200a5750 con 0x7f0f200a5370 2023-12-19T18:58:54.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f26032640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f200c3070 con 0x7f0f20072090 2023-12-19T18:58:54.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f1ffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0f200725c0 0x7f0f201514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41082/0 (socket says 172.21.15.133:41082) 2023-12-19T18:58:54.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f1ffff640 1 -- 172.21.15.133:0/1459839334 learned_addr learned my addr 172.21.15.133:0/1459839334 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:54.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f1effd640 1 --2- 172.21.15.133:0/1459839334 >> v2:172.21.15.138:3300/0 conn(0x7f0f20072090 0x7f0f20150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f1e7fc640 1 -- 172.21.15.133:0/1459839334 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444622374 0 0) 0x7f0f200c2760 con 0x7f0f200725c0 2023-12-19T18:58:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f1e7fc640 1 -- 172.21.15.133:0/1459839334 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f08003450 con 0x7f0f200725c0 2023-12-19T18:58:54.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f1e7fc640 1 -- 172.21.15.133:0/1459839334 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3035858598 0 0) 0x7f0f200a5750 con 0x7f0f200a5370 2023-12-19T18:58:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f1e7fc640 1 -- 172.21.15.133:0/1459839334 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f200c2760 con 0x7f0f200a5370 2023-12-19T18:58:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f1e7fc640 1 -- 172.21.15.133:0/1459839334 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2398116126 0 0) 0x7f0f08003450 con 0x7f0f200725c0 2023-12-19T18:58:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f1e7fc640 1 -- 172.21.15.133:0/1459839334 >> v2:172.21.15.138:3300/0 conn(0x7f0f20072090 msgr2=0x7f0f20150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f1e7fc640 1 --2- 172.21.15.133:0/1459839334 >> v2:172.21.15.138:3300/0 conn(0x7f0f20072090 0x7f0f20150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f1e7fc640 1 -- 172.21.15.133:0/1459839334 >> v1:172.21.15.138:6789/0 conn(0x7f0f200a5370 legacy=0x7f0f200c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f1e7fc640 1 -- 172.21.15.133:0/1459839334 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f200aad20 con 0x7f0f200725c0 2023-12-19T18:58:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f1e7fc640 1 -- 172.21.15.133:0/1459839334 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f0f18001a00 con 0x7f0f200725c0 2023-12-19T18:58:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f1e7fc640 1 -- 172.21.15.133:0/1459839334 >> v1:172.21.15.133:6789/0 conn(0x7f0f200725c0 legacy=0x7f0f201514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f1e7fc640 1 --2- 172.21.15.133:0/1459839334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f08003c00 0x7f0f08004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f1e7fc640 1 --2- 172.21.15.133:0/1459839334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0f08008a10 0x7f0f0800aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f1e7fc640 1 --2- 172.21.15.133:0/1459839334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0800b5b0 0x7f0f0800da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f1e7fc640 1 -- 172.21.15.133:0/1459839334 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f200c3070 con 0x7f0f0800b5b0 2023-12-19T18:58:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f1e7fc640 1 -- 172.21.15.133:0/1459839334 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0800e350 con 0x7f0f08003c00 2023-12-19T18:58:54.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f1e7fc640 1 -- 172.21.15.133:0/1459839334 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0800e510 con 0x7f0f08008a10 2023-12-19T18:58:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f1f7fe640 1 --2- 172.21.15.133:0/1459839334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f08003c00 0x7f0f08004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f1effd640 1 --2- 172.21.15.133:0/1459839334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0f08008a10 0x7f0f0800aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.588+0000 7f0f1ffff640 1 --2- 172.21.15.133:0/1459839334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0800b5b0 0x7f0f0800da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.592+0000 7f0f1effd640 1 -- 172.21.15.133:0/1459839334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f08003c00 msgr2=0x7f0f08004000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.592+0000 7f0f1effd640 1 --2- 172.21.15.133:0/1459839334 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f08003c00 0x7f0f08004000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.592+0000 7f0f1effd640 1 -- 172.21.15.133:0/1459839334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0800b5b0 msgr2=0x7f0f0800da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.592+0000 7f0f1effd640 1 --2- 172.21.15.133:0/1459839334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0800b5b0 0x7f0f0800da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.592+0000 7f0f1effd640 1 -- 172.21.15.133:0/1459839334 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f08003450 con 0x7f0f08008a10 2023-12-19T18:58:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.592+0000 7f0f1ffff640 1 --2- 172.21.15.133:0/1459839334 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f0800b5b0 0x7f0f0800da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:58:54.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.592+0000 7f0f1ffff640 1 -- 172.21.15.133:0/1459839334 reap_dead start 2023-12-19T18:58:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.592+0000 7f0f1effd640 1 --2- 172.21.15.133:0/1459839334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0f08008a10 0x7f0f0800aea0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0f14009ae0 tx=0x7f0f1401ca50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7736715451bcc274 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.592+0000 7f0f1e7fc640 1 -- 172.21.15.133:0/1459839334 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f140a55a0 con 0x7f0f08008a10 2023-12-19T18:58:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.592+0000 7f0f1e7fc640 1 -- 172.21.15.133:0/1459839334 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f140a5700 con 0x7f0f08008a10 2023-12-19T18:58:54.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.592+0000 7f0f1e7fc640 1 -- 172.21.15.133:0/1459839334 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f140a5ab0 con 0x7f0f08008a10 2023-12-19T18:58:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f26032640 1 -- 172.21.15.133:0/1459839334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0f08008a10 msgr2=0x7f0f0800aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f26032640 1 --2- 172.21.15.133:0/1459839334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0f08008a10 0x7f0f0800aea0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0f14009ae0 tx=0x7f0f1401ca50 comp rx=0 tx=0).stop 2023-12-19T18:58:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f26032640 1 -- 172.21.15.133:0/1459839334 shutdown_connections 2023-12-19T18:58:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f26032640 1 --2- 172.21.15.133:0/1459839334 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0f08008a10 0x7f0f0800aea0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f26032640 1 -- 172.21.15.133:0/1459839334 >> 172.21.15.133:0/1459839334 conn(0x7f0f2006a5b0 msgr2=0x7f0f2006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f26032640 1 -- 172.21.15.133:0/1459839334 shutdown_connections 2023-12-19T18:58:54.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f26032640 1 -- 172.21.15.133:0/1459839334 wait complete. 2023-12-19T18:58:54.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f26032640 1 Processor -- start 2023-12-19T18:58:54.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f26032640 1 -- start start 2023-12-19T18:58:54.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f26032640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0f08008a10 0x7f0f200a6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:54.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f26032640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f20154e10 0x7f0f20153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:54.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f26032640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f200a5e50 0x7f0f20154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:54.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f26032640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f200a71d0 con 0x7f0f200a5e50 2023-12-19T18:58:54.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f26032640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f200a5750 con 0x7f0f20154e10 2023-12-19T18:58:54.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f26032640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f200a5c80 con 0x7f0f08008a10 2023-12-19T18:58:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f1ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f200a5e50 0x7f0f20154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f1ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f200a5e50 0x7f0f20154270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33818/0 (socket says 172.21.15.133:33818) 2023-12-19T18:58:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f1ffff640 1 -- 172.21.15.133:0/1249963648 learned_addr learned my addr 172.21.15.133:0/1249963648 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f1f7fe640 1 --2- 172.21.15.133:0/1249963648 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0f08008a10 0x7f0f200a6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f1effd640 1 --2- 172.21.15.133:0/1249963648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f20154e10 0x7f0f20153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f1ffff640 1 -- 172.21.15.133:0/1249963648 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0f08008a10 msgr2=0x7f0f200a6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f1ffff640 1 --2- 172.21.15.133:0/1249963648 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0f08008a10 0x7f0f200a6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f1ffff640 1 -- 172.21.15.133:0/1249963648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f20154e10 msgr2=0x7f0f20153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f1ffff640 1 --2- 172.21.15.133:0/1249963648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f20154e10 0x7f0f20153d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.596+0000 7f0f1ffff640 1 -- 172.21.15.133:0/1249963648 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f201edbd0 con 0x7f0f200a5e50 2023-12-19T18:58:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.600+0000 7f0f1ffff640 1 --2- 172.21.15.133:0/1249963648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f200a5e50 0x7f0f20154270 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0f18002240 tx=0x7f0f1800aee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.600+0000 7f0f07fff640 1 -- 172.21.15.133:0/1249963648 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f180078f0 con 0x7f0f200a5e50 2023-12-19T18:58:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.600+0000 7f0f07fff640 1 -- 172.21.15.133:0/1249963648 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f18007a50 con 0x7f0f200a5e50 2023-12-19T18:58:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.600+0000 7f0f07fff640 1 -- 172.21.15.133:0/1249963648 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f18013630 con 0x7f0f200a5e50 2023-12-19T18:58:54.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.600+0000 7f0f26032640 1 -- 172.21.15.133:0/1249963648 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f200a59a0 con 0x7f0f200a5e50 2023-12-19T18:58:54.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.600+0000 7f0f26032640 1 -- 172.21.15.133:0/1249963648 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f200a6c50 con 0x7f0f200a5e50 2023-12-19T18:58:54.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.600+0000 7f0f26032640 1 -- 172.21.15.133:0/1249963648 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f20068400 con 0x7f0f200a5e50 2023-12-19T18:58:54.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.600+0000 7f0f07fff640 1 -- 172.21.15.133:0/1249963648 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0f18013790 con 0x7f0f200a5e50 2023-12-19T18:58:54.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.600+0000 7f0f07fff640 1 --2- 172.21.15.133:0/1249963648 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0f0c0664a0 0x7f0f0c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:54.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.600+0000 7f0f07fff640 1 -- 172.21.15.133:0/1249963648 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f18084350 con 0x7f0f200a5e50 2023-12-19T18:58:54.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.600+0000 7f0f1f7fe640 1 --2- 172.21.15.133:0/1249963648 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0f0c0664a0 0x7f0f0c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:54.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.604+0000 7f0f1f7fe640 1 --2- 172.21.15.133:0/1249963648 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0f0c0664a0 0x7f0f0c068960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0f100010f0 tx=0x7f0f10009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:54.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.604+0000 7f0f07fff640 1 -- 172.21.15.133:0/1249963648 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0f180517c0 con 0x7f0f200a5e50 2023-12-19T18:58:54.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.756+0000 7f0f26032640 1 -- 172.21.15.133:0/1249963648 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f20070150 con 0x7f0f200a5e50 2023-12-19T18:58:54.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.756+0000 7f0f07fff640 1 -- 172.21.15.133:0/1249963648 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0f18054de0 con 0x7f0f200a5e50 2023-12-19T18:58:54.760 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T18:58:54.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.756+0000 7f0f26032640 1 -- 172.21.15.133:0/1249963648 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0f0c0664a0 msgr2=0x7f0f0c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:54.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.756+0000 7f0f26032640 1 --2- 172.21.15.133:0/1249963648 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0f0c0664a0 0x7f0f0c068960 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0f100010f0 tx=0x7f0f10009040 comp rx=0 tx=0).stop 2023-12-19T18:58:54.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.756+0000 7f0f26032640 1 -- 172.21.15.133:0/1249963648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f200a5e50 msgr2=0x7f0f20154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:54.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.756+0000 7f0f26032640 1 --2- 172.21.15.133:0/1249963648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f200a5e50 0x7f0f20154270 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0f18002240 tx=0x7f0f1800aee0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.756+0000 7f0f26032640 1 -- 172.21.15.133:0/1249963648 shutdown_connections 2023-12-19T18:58:54.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.756+0000 7f0f26032640 1 --2- 172.21.15.133:0/1249963648 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0f0c0664a0 0x7f0f0c068960 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.756+0000 7f0f26032640 1 --2- 172.21.15.133:0/1249963648 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f200a5e50 0x7f0f20154270 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.756+0000 7f0f26032640 1 --2- 172.21.15.133:0/1249963648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f20154e10 0x7f0f20153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.756+0000 7f0f26032640 1 --2- 172.21.15.133:0/1249963648 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0f08008a10 0x7f0f200a6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.756+0000 7f0f26032640 1 -- 172.21.15.133:0/1249963648 >> 172.21.15.133:0/1249963648 conn(0x7f0f2006a5b0 msgr2=0x7f0f2014c060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:54.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.760+0000 7f0f26032640 1 -- 172.21.15.133:0/1249963648 shutdown_connections 2023-12-19T18:58:54.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.760+0000 7f0f26032640 1 -- 172.21.15.133:0/1249963648 wait complete. 2023-12-19T18:58:54.781 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:58:54.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.916+0000 7f22bb45a640 1 Processor -- start 2023-12-19T18:58:54.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.916+0000 7f22bb45a640 1 -- start start 2023-12-19T18:58:54.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.920+0000 7f22bb45a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f22b40c63c0 0x7f22b40c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:54.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.920+0000 7f22bb45a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22b40c2bb0 0x7f22b40a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:54.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.920+0000 7f22bb45a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b40c31c0 con 0x7f22b40c4100 2023-12-19T18:58:54.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.920+0000 7f22bb45a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b40c34a0 con 0x7f22b40c63c0 2023-12-19T18:58:54.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.920+0000 7f22bb45a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b40c1030 con 0x7f22b40c2bb0 2023-12-19T18:58:54.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.920+0000 7f22b91f6640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f22b40c63c0 0x7f22b40c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:54.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.920+0000 7f22b91f6640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f22b40c63c0 0x7f22b40c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:43618/0 (socket says 172.21.15.133:43618) 2023-12-19T18:58:54.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.920+0000 7f22b91f6640 1 -- 172.21.15.133:0/4036215701 learned_addr learned my addr 172.21.15.133:0/4036215701 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:54.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.920+0000 7f22b99f7640 1 --2- 172.21.15.133:0/4036215701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22b40c2bb0 0x7f22b40a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:54.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.920+0000 7f22b91f6640 1 -- 172.21.15.133:0/4036215701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22b40c2bb0 msgr2=0x7f22b40a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:54.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.920+0000 7f22b91f6640 1 --2- 172.21.15.133:0/4036215701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22b40c2bb0 0x7f22b40a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.920+0000 7f22b91f6640 1 -- 172.21.15.133:0/4036215701 >> v1:172.21.15.138:6789/0 conn(0x7f22b40c4100 legacy=0x7f22b40c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:54.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.920+0000 7f22b91f6640 1 -- 172.21.15.133:0/4036215701 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b40c1310 con 0x7f22b40c63c0 2023-12-19T18:58:54.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.924+0000 7f22b91f6640 1 --2- 172.21.15.133:0/4036215701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22b40c63c0 0x7f22b40c06d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f22b0009870 tx=0x7f22b001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21471828ffea9c49 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:54.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.924+0000 7f22abfff640 1 -- 172.21.15.133:0/4036215701 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b40aa3d0 con 0x7f22b40c63c0 2023-12-19T18:58:54.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.924+0000 7f22abfff640 1 -- 172.21.15.133:0/4036215701 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b00a7050 con 0x7f22b40c63c0 2023-12-19T18:58:54.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.924+0000 7f22abfff640 1 -- 172.21.15.133:0/4036215701 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b00ab820 con 0x7f22b40c63c0 2023-12-19T18:58:54.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.924+0000 7f22bb45a640 1 -- 172.21.15.133:0/4036215701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22b40c63c0 msgr2=0x7f22b40c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:54.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.924+0000 7f22bb45a640 1 --2- 172.21.15.133:0/4036215701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22b40c63c0 0x7f22b40c06d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f22b0009870 tx=0x7f22b001c3f0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.924+0000 7f22bb45a640 1 -- 172.21.15.133:0/4036215701 shutdown_connections 2023-12-19T18:58:54.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.924+0000 7f22bb45a640 1 --2- 172.21.15.133:0/4036215701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22b40c2bb0 0x7f22b40a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.924+0000 7f22bb45a640 1 --2- 172.21.15.133:0/4036215701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22b40c63c0 0x7f22b40c06d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.924+0000 7f22bb45a640 1 -- 172.21.15.133:0/4036215701 >> 172.21.15.133:0/4036215701 conn(0x7f22b406a5b0 msgr2=0x7f22b406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:54.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.924+0000 7f22bb45a640 1 -- 172.21.15.133:0/4036215701 shutdown_connections 2023-12-19T18:58:54.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.924+0000 7f22bb45a640 1 -- 172.21.15.133:0/4036215701 wait complete. 2023-12-19T18:58:54.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.924+0000 7f22bb45a640 1 Processor -- start 2023-12-19T18:58:54.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.924+0000 7f22bb45a640 1 -- start start 2023-12-19T18:58:54.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.928+0000 7f22bb45a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22b40c2bb0 0x7f22b4159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:54.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.928+0000 7f22bb45a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22b40c4100 0x7f22b41ee570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:54.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.928+0000 7f22bb45a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22b40c63c0 0x7f22b40bb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:54.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.928+0000 7f22bb45a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b41eeab0 con 0x7f22b40c63c0 2023-12-19T18:58:54.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.928+0000 7f22bb45a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b40c0500 con 0x7f22b40c4100 2023-12-19T18:58:54.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.928+0000 7f22bb45a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b41ea5f0 con 0x7f22b40c2bb0 2023-12-19T18:58:54.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.928+0000 7f22b99f7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22b40c63c0 0x7f22b40bb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:54.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.928+0000 7f22b99f7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22b40c63c0 0x7f22b40bb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33824/0 (socket says 172.21.15.133:33824) 2023-12-19T18:58:54.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.928+0000 7f22b99f7640 1 -- 172.21.15.133:0/2438452722 learned_addr learned my addr 172.21.15.133:0/2438452722 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:54.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.928+0000 7f22b91f6640 1 --2- 172.21.15.133:0/2438452722 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22b40c2bb0 0x7f22b4159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:54.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.928+0000 7f22b89f5640 1 --2- 172.21.15.133:0/2438452722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22b40c4100 0x7f22b41ee570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:54.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.928+0000 7f22b99f7640 1 -- 172.21.15.133:0/2438452722 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22b40c2bb0 msgr2=0x7f22b4159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:54.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.928+0000 7f22b99f7640 1 --2- 172.21.15.133:0/2438452722 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22b40c2bb0 0x7f22b4159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.928+0000 7f22b99f7640 1 -- 172.21.15.133:0/2438452722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22b40c4100 msgr2=0x7f22b41ee570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:54.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.928+0000 7f22b99f7640 1 --2- 172.21.15.133:0/2438452722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22b40c4100 0x7f22b41ee570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:54.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.928+0000 7f22b99f7640 1 -- 172.21.15.133:0/2438452722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b00094d0 con 0x7f22b40c63c0 2023-12-19T18:58:54.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.928+0000 7f22b99f7640 1 --2- 172.21.15.133:0/2438452722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22b40c63c0 0x7f22b40bb820 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00efc0 tx=0x7f22ac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:54.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.928+0000 7f22a9ffb640 1 -- 172.21.15.133:0/2438452722 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac014480 con 0x7f22b40c63c0 2023-12-19T18:58:54.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.928+0000 7f22a9ffb640 1 -- 172.21.15.133:0/2438452722 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ac00f040 con 0x7f22b40c63c0 2023-12-19T18:58:54.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.928+0000 7f22a9ffb640 1 -- 172.21.15.133:0/2438452722 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ac014820 con 0x7f22b40c63c0 2023-12-19T18:58:54.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.928+0000 7f22bb45a640 1 -- 172.21.15.133:0/2438452722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b40c69b0 con 0x7f22b40c63c0 2023-12-19T18:58:54.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.928+0000 7f22bb45a640 1 -- 172.21.15.133:0/2438452722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b40706d0 con 0x7f22b40c63c0 2023-12-19T18:58:54.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.928+0000 7f22bb45a640 1 -- 172.21.15.133:0/2438452722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b4068400 con 0x7f22b40c63c0 2023-12-19T18:58:54.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.932+0000 7f22a9ffb640 1 -- 172.21.15.133:0/2438452722 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f22ac014980 con 0x7f22b40c63c0 2023-12-19T18:58:54.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.932+0000 7f22a9ffb640 1 --2- 172.21.15.133:0/2438452722 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2298066470 0x7f2298068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:54.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.932+0000 7f22a9ffb640 1 -- 172.21.15.133:0/2438452722 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22ac084950 con 0x7f22b40c63c0 2023-12-19T18:58:54.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.932+0000 7f22b91f6640 1 --2- 172.21.15.133:0/2438452722 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2298066470 0x7f2298068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:54.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.932+0000 7f22b91f6640 1 --2- 172.21.15.133:0/2438452722 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2298066470 0x7f2298068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f22b00ad000 tx=0x7f22b00a4f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:54.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:54.936+0000 7f22a9ffb640 1 -- 172.21.15.133:0/2438452722 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f22ac051de0 con 0x7f22b40c63c0 2023-12-19T18:58:55.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.088+0000 7f22bb45a640 1 -- 172.21.15.133:0/2438452722 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f22b40c3e70 con 0x7f22b40c63c0 2023-12-19T18:58:55.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.088+0000 7f22a9ffb640 1 -- 172.21.15.133:0/2438452722 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f22ac018020 con 0x7f22b40c63c0 2023-12-19T18:58:55.092 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T18:58:55.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.088+0000 7f22bb45a640 1 -- 172.21.15.133:0/2438452722 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2298066470 msgr2=0x7f2298068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:55.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.088+0000 7f22bb45a640 1 --2- 172.21.15.133:0/2438452722 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2298066470 0x7f2298068930 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f22b00ad000 tx=0x7f22b00a4f90 comp rx=0 tx=0).stop 2023-12-19T18:58:55.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.088+0000 7f22bb45a640 1 -- 172.21.15.133:0/2438452722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22b40c63c0 msgr2=0x7f22b40bb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:55.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.088+0000 7f22bb45a640 1 --2- 172.21.15.133:0/2438452722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22b40c63c0 0x7f22b40bb820 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f22ac00efc0 tx=0x7f22ac00c490 comp rx=0 tx=0).stop 2023-12-19T18:58:55.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.088+0000 7f22bb45a640 1 -- 172.21.15.133:0/2438452722 shutdown_connections 2023-12-19T18:58:55.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.088+0000 7f22bb45a640 1 --2- 172.21.15.133:0/2438452722 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2298066470 0x7f2298068930 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.088+0000 7f22bb45a640 1 --2- 172.21.15.133:0/2438452722 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22b40c63c0 0x7f22b40bb820 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.088+0000 7f22bb45a640 1 --2- 172.21.15.133:0/2438452722 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22b40c4100 0x7f22b41ee570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.088+0000 7f22bb45a640 1 --2- 172.21.15.133:0/2438452722 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22b40c2bb0 0x7f22b4159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.088+0000 7f22bb45a640 1 -- 172.21.15.133:0/2438452722 >> 172.21.15.133:0/2438452722 conn(0x7f22b406a5b0 msgr2=0x7f22b40713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:55.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.088+0000 7f22bb45a640 1 -- 172.21.15.133:0/2438452722 shutdown_connections 2023-12-19T18:58:55.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.088+0000 7f22bb45a640 1 -- 172.21.15.133:0/2438452722 wait complete. 2023-12-19T18:58:55.112 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:58:55.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.248+0000 7f4d013aa640 1 Processor -- start 2023-12-19T18:58:55.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.248+0000 7f4d013aa640 1 -- start start 2023-12-19T18:58:55.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.248+0000 7f4d013aa640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4cfc151dc0 0x7f4cfc0c4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:55.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.248+0000 7f4d013aa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4cfc0c7ed0 0x7f4cfc154650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.248+0000 7f4d013aa640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cfc0ac4f0 con 0x7f4cfc0bd660 2023-12-19T18:58:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.248+0000 7f4d013aa640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cfc158780 con 0x7f4cfc151dc0 2023-12-19T18:58:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.248+0000 7f4d013aa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cfc158a60 con 0x7f4cfc0c7ed0 2023-12-19T18:58:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.248+0000 7f4cfaffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4cfc151dc0 0x7f4cfc0c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.248+0000 7f4cfb7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4cfc0bd660 0x7f4cfc154b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41084/0 (socket says 172.21.15.133:41084) 2023-12-19T18:58:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.248+0000 7f4cfb7fe640 1 -- 172.21.15.133:0/2176230878 learned_addr learned my addr 172.21.15.133:0/2176230878 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.248+0000 7f4cf3fff640 1 --2- 172.21.15.133:0/2176230878 >> v2:172.21.15.138:3300/0 conn(0x7f4cfc0c7ed0 0x7f4cfc154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.248+0000 7f4cfaffd640 1 -- 172.21.15.133:0/2176230878 >> v2:172.21.15.138:3300/0 conn(0x7f4cfc0c7ed0 msgr2=0x7f4cfc154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.248+0000 7f4cfaffd640 1 --2- 172.21.15.133:0/2176230878 >> v2:172.21.15.138:3300/0 conn(0x7f4cfc0c7ed0 0x7f4cfc154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.248+0000 7f4cfaffd640 1 -- 172.21.15.133:0/2176230878 >> v1:172.21.15.133:6789/0 conn(0x7f4cfc0bd660 legacy=0x7f4cfc154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.248+0000 7f4cfaffd640 1 -- 172.21.15.133:0/2176230878 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cfc0ac180 con 0x7f4cfc151dc0 2023-12-19T18:58:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.248+0000 7f4cfa7fc640 1 -- 172.21.15.133:0/2176230878 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911578734 0 0) 0x7f4cfc0ac4f0 con 0x7f4cfc0bd660 2023-12-19T18:58:55.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.248+0000 7f4cf3fff640 1 --2- 172.21.15.133:0/2176230878 >> v2:172.21.15.138:3300/0 conn(0x7f4cfc0c7ed0 0x7f4cfc154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:55.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.252+0000 7f4cfaffd640 1 --2- 172.21.15.133:0/2176230878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cfc151dc0 0x7f4cfc0c4950 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4cec0097c0 tx=0x7f4cec01c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546952c4cbce1921 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:55.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.252+0000 7f4cfa7fc640 1 -- 172.21.15.133:0/2176230878 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec0ab600 con 0x7f4cfc151dc0 2023-12-19T18:58:55.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.252+0000 7f4cfa7fc640 1 -- 172.21.15.133:0/2176230878 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec0a7050 con 0x7f4cfc151dc0 2023-12-19T18:58:55.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.252+0000 7f4cfa7fc640 1 -- 172.21.15.133:0/2176230878 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec0ab980 con 0x7f4cfc151dc0 2023-12-19T18:58:55.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.252+0000 7f4d013aa640 1 -- 172.21.15.133:0/2176230878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cfc151dc0 msgr2=0x7f4cfc0c4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:55.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.252+0000 7f4d013aa640 1 --2- 172.21.15.133:0/2176230878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cfc151dc0 0x7f4cfc0c4950 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4cec0097c0 tx=0x7f4cec01c320 comp rx=0 tx=0).stop 2023-12-19T18:58:55.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.252+0000 7f4d013aa640 1 -- 172.21.15.133:0/2176230878 shutdown_connections 2023-12-19T18:58:55.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.252+0000 7f4d013aa640 1 --2- 172.21.15.133:0/2176230878 >> v2:172.21.15.138:3300/0 conn(0x7f4cfc0c7ed0 0x7f4cfc154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.252+0000 7f4d013aa640 1 --2- 172.21.15.133:0/2176230878 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cfc151dc0 0x7f4cfc0c4950 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.252+0000 7f4d013aa640 1 -- 172.21.15.133:0/2176230878 >> 172.21.15.133:0/2176230878 conn(0x7f4cfc071eb0 msgr2=0x7f4cfc0722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:55.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.252+0000 7f4d013aa640 1 -- 172.21.15.133:0/2176230878 shutdown_connections 2023-12-19T18:58:55.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.252+0000 7f4d013aa640 1 -- 172.21.15.133:0/2176230878 wait complete. 2023-12-19T18:58:55.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4d013aa640 1 Processor -- start 2023-12-19T18:58:55.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4d013aa640 1 -- start start 2023-12-19T18:58:55.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4d013aa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cfc0bd660 0x7f4cfc1ed790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:55.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4d013aa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cfc0c7ed0 0x7f4cfc0be330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:55.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4d013aa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4cfc151dc0 0x7f4cfc0be870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:55.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4d013aa640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc1edcd0 con 0x7f4cfc0bd660 2023-12-19T18:58:55.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4d013aa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc0bffd0 con 0x7f4cfc0c7ed0 2023-12-19T18:58:55.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4d013aa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cfc0c09d0 con 0x7f4cfc151dc0 2023-12-19T18:58:55.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4cfaffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cfc0bd660 0x7f4cfc1ed790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:55.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4cfaffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cfc0bd660 0x7f4cfc1ed790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33850/0 (socket says 172.21.15.133:33850) 2023-12-19T18:58:55.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4cfaffd640 1 -- 172.21.15.133:0/399253347 learned_addr learned my addr 172.21.15.133:0/399253347 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:55.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4cf3fff640 1 --2- 172.21.15.133:0/399253347 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cfc0c7ed0 0x7f4cfc0be330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:55.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4cfb7fe640 1 --2- 172.21.15.133:0/399253347 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4cfc151dc0 0x7f4cfc0be870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:55.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4cfaffd640 1 -- 172.21.15.133:0/399253347 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4cfc151dc0 msgr2=0x7f4cfc0be870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:55.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4cfaffd640 1 --2- 172.21.15.133:0/399253347 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4cfc151dc0 0x7f4cfc0be870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4cfaffd640 1 -- 172.21.15.133:0/399253347 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cfc0c7ed0 msgr2=0x7f4cfc0be330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:55.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4cfaffd640 1 --2- 172.21.15.133:0/399253347 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cfc0c7ed0 0x7f4cfc0be330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4cfaffd640 1 -- 172.21.15.133:0/399253347 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec009420 con 0x7f4cfc0bd660 2023-12-19T18:58:55.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4cfaffd640 1 --2- 172.21.15.133:0/399253347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cfc0bd660 0x7f4cfc1ed790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4cec0ae040 tx=0x7f4cec01ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4cf37fe640 1 -- 172.21.15.133:0/399253347 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec0b7650 con 0x7f4cfc0bd660 2023-12-19T18:58:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4cf37fe640 1 -- 172.21.15.133:0/399253347 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec0abe90 con 0x7f4cfc0bd660 2023-12-19T18:58:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4cf37fe640 1 -- 172.21.15.133:0/399253347 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec0b7a10 con 0x7f4cfc0bd660 2023-12-19T18:58:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4d013aa640 1 -- 172.21.15.133:0/399253347 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cfc0c4150 con 0x7f4cfc0bd660 2023-12-19T18:58:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4d013aa640 1 -- 172.21.15.133:0/399253347 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cfc0c43f0 con 0x7f4cfc0bd660 2023-12-19T18:58:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.256+0000 7f4d013aa640 1 -- 172.21.15.133:0/399253347 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cfc068400 con 0x7f4cfc0bd660 2023-12-19T18:58:55.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.260+0000 7f4cf37fe640 1 -- 172.21.15.133:0/399253347 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4cec0b7b70 con 0x7f4cfc0bd660 2023-12-19T18:58:55.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.260+0000 7f4cf37fe640 1 --2- 172.21.15.133:0/399253347 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4cdc066470 0x7f4cdc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:55.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.260+0000 7f4cf37fe640 1 -- 172.21.15.133:0/399253347 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4cec0a4e40 con 0x7f4cfc0bd660 2023-12-19T18:58:55.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.260+0000 7f4cf3fff640 1 --2- 172.21.15.133:0/399253347 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4cdc066470 0x7f4cdc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:55.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.260+0000 7f4cf3fff640 1 --2- 172.21.15.133:0/399253347 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4cdc066470 0x7f4cdc068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc150c10 tx=0x7f4ce4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:55.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.264+0000 7f4cf37fe640 1 -- 172.21.15.133:0/399253347 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4cec0ebd50 con 0x7f4cfc0bd660 2023-12-19T18:58:55.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.412+0000 7f4d013aa640 1 -- 172.21.15.133:0/399253347 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4cfc0c45e0 con 0x7f4cfc0bd660 2023-12-19T18:58:55.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.412+0000 7f4cf37fe640 1 -- 172.21.15.133:0/399253347 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4cec0bb0a0 con 0x7f4cfc0bd660 2023-12-19T18:58:55.417 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T18:58:55.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.416+0000 7f4d013aa640 1 -- 172.21.15.133:0/399253347 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4cdc066470 msgr2=0x7f4cdc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:55.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.416+0000 7f4d013aa640 1 --2- 172.21.15.133:0/399253347 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4cdc066470 0x7f4cdc068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc150c10 tx=0x7f4ce4008040 comp rx=0 tx=0).stop 2023-12-19T18:58:55.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.416+0000 7f4d013aa640 1 -- 172.21.15.133:0/399253347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cfc0bd660 msgr2=0x7f4cfc1ed790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:55.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.416+0000 7f4d013aa640 1 --2- 172.21.15.133:0/399253347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cfc0bd660 0x7f4cfc1ed790 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4cec0ae040 tx=0x7f4cec01ab60 comp rx=0 tx=0).stop 2023-12-19T18:58:55.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.416+0000 7f4d013aa640 1 -- 172.21.15.133:0/399253347 shutdown_connections 2023-12-19T18:58:55.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.416+0000 7f4d013aa640 1 --2- 172.21.15.133:0/399253347 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4cdc066470 0x7f4cdc068930 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.416+0000 7f4d013aa640 1 --2- 172.21.15.133:0/399253347 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4cfc151dc0 0x7f4cfc0be870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.416+0000 7f4d013aa640 1 --2- 172.21.15.133:0/399253347 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cfc0c7ed0 0x7f4cfc0be330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.416+0000 7f4d013aa640 1 --2- 172.21.15.133:0/399253347 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cfc0bd660 0x7f4cfc1ed790 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.416+0000 7f4d013aa640 1 -- 172.21.15.133:0/399253347 >> 172.21.15.133:0/399253347 conn(0x7f4cfc071eb0 msgr2=0x7f4cfc15e550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:55.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.416+0000 7f4d013aa640 1 -- 172.21.15.133:0/399253347 shutdown_connections 2023-12-19T18:58:55.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.416+0000 7f4d013aa640 1 -- 172.21.15.133:0/399253347 wait complete. 2023-12-19T18:58:55.438 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:58:55.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.572+0000 7fdad0817640 1 Processor -- start 2023-12-19T18:58:55.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.572+0000 7fdad0817640 1 -- start start 2023-12-19T18:58:55.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.572+0000 7fdad0817640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fdacc0725c0 0x7fdacc1516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:55.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.572+0000 7fdad0817640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdacc0c2760 con 0x7fdacc072090 2023-12-19T18:58:55.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.572+0000 7fdad0817640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdacc0a5750 con 0x7fdacc0a5370 2023-12-19T18:58:55.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.572+0000 7fdad0817640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdacc0c3070 con 0x7fdacc0725c0 2023-12-19T18:58:55.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.572+0000 7fdac1d9b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdacc072090 0x7fdacc150fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41086/0 (socket says 172.21.15.133:41086) 2023-12-19T18:58:55.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.572+0000 7fdac1d9b640 1 -- 172.21.15.133:0/3296094744 learned_addr learned my addr 172.21.15.133:0/3296094744 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:55.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.572+0000 7fdacad9d640 1 --2- 172.21.15.133:0/3296094744 >> v2:172.21.15.138:3300/0 conn(0x7fdacc0725c0 0x7fdacc1516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:55.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.572+0000 7fdac9d9b640 1 -- 172.21.15.133:0/3296094744 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328762533 0 0) 0x7fdacc0c2760 con 0x7fdacc072090 2023-12-19T18:58:55.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.572+0000 7fdac9d9b640 1 -- 172.21.15.133:0/3296094744 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdab8003450 con 0x7fdacc072090 2023-12-19T18:58:55.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.572+0000 7fdacad9d640 1 -- 172.21.15.133:0/3296094744 >> v1:172.21.15.138:6789/0 conn(0x7fdacc0a5370 legacy=0x7fdacc0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:55.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.572+0000 7fdac9d9b640 1 -- 172.21.15.133:0/3296094744 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 726051795 0 0) 0x7fdab8003450 con 0x7fdacc072090 2023-12-19T18:58:55.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.572+0000 7fdacad9d640 1 -- 172.21.15.133:0/3296094744 >> v1:172.21.15.133:6789/0 conn(0x7fdacc072090 legacy=0x7fdacc150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:55.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.572+0000 7fdacad9d640 1 -- 172.21.15.133:0/3296094744 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc0aad20 con 0x7fdacc0725c0 2023-12-19T18:58:55.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.576+0000 7fdacad9d640 1 --2- 172.21.15.133:0/3296094744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdacc0725c0 0x7fdacc1516b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009d90 tx=0x7fdac401c340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a8fd56b47cb1711 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:55.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.576+0000 7fdac9d9b640 1 -- 172.21.15.133:0/3296094744 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc001680 con 0x7fdacc0725c0 2023-12-19T18:58:55.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.576+0000 7fdac9d9b640 1 -- 172.21.15.133:0/3296094744 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac40a47b0 con 0x7fdacc0725c0 2023-12-19T18:58:55.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.576+0000 7fdac9d9b640 1 -- 172.21.15.133:0/3296094744 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac40a4b20 con 0x7fdacc0725c0 2023-12-19T18:58:55.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.576+0000 7fdad0817640 1 -- 172.21.15.133:0/3296094744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdacc0725c0 msgr2=0x7fdacc1516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:55.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.576+0000 7fdad0817640 1 --2- 172.21.15.133:0/3296094744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdacc0725c0 0x7fdacc1516b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdac4009d90 tx=0x7fdac401c340 comp rx=0 tx=0).stop 2023-12-19T18:58:55.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.576+0000 7fdad0817640 1 -- 172.21.15.133:0/3296094744 shutdown_connections 2023-12-19T18:58:55.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.576+0000 7fdad0817640 1 --2- 172.21.15.133:0/3296094744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdacc0725c0 0x7fdacc1516b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.576+0000 7fdad0817640 1 -- 172.21.15.133:0/3296094744 >> 172.21.15.133:0/3296094744 conn(0x7fdacc06a5b0 msgr2=0x7fdacc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:55.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.576+0000 7fdad0817640 1 -- 172.21.15.133:0/3296094744 shutdown_connections 2023-12-19T18:58:55.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.576+0000 7fdad0817640 1 -- 172.21.15.133:0/3296094744 wait complete. 2023-12-19T18:58:55.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.580+0000 7fdad0817640 1 Processor -- start 2023-12-19T18:58:55.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.580+0000 7fdad0817640 1 -- start start 2023-12-19T18:58:55.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.580+0000 7fdad0817640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdacc072090 0x7fdacc1f1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:55.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.580+0000 7fdad0817640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdacc0725c0 0x7fdacc149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:55.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.580+0000 7fdad0817640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdacc0a5370 0x7fdacc149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:55.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.580+0000 7fdad0817640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc1f23f0 con 0x7fdacc0725c0 2023-12-19T18:58:55.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.580+0000 7fdad0817640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc0a6e90 con 0x7fdacc072090 2023-12-19T18:58:55.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.580+0000 7fdad0817640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc149ff0 con 0x7fdacc0a5370 2023-12-19T18:58:55.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.580+0000 7fdac1d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdacc0725c0 0x7fdacc149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:55.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.580+0000 7fdac1d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdacc0725c0 0x7fdacc149570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33860/0 (socket says 172.21.15.133:33860) 2023-12-19T18:58:55.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.580+0000 7fdac1d9b640 1 -- 172.21.15.133:0/3107411105 learned_addr learned my addr 172.21.15.133:0/3107411105 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:55.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.580+0000 7fdaca59c640 1 --2- 172.21.15.133:0/3107411105 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdacc072090 0x7fdacc1f1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:55.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.580+0000 7fdacad9d640 1 --2- 172.21.15.133:0/3107411105 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdacc0a5370 0x7fdacc149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:55.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.580+0000 7fdac1d9b640 1 -- 172.21.15.133:0/3107411105 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdacc0a5370 msgr2=0x7fdacc149ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:55.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.580+0000 7fdac1d9b640 1 --2- 172.21.15.133:0/3107411105 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdacc0a5370 0x7fdacc149ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.580+0000 7fdac1d9b640 1 -- 172.21.15.133:0/3107411105 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdacc072090 msgr2=0x7fdacc1f1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:55.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.580+0000 7fdac1d9b640 1 --2- 172.21.15.133:0/3107411105 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdacc072090 0x7fdacc1f1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.580+0000 7fdac1d9b640 1 -- 172.21.15.133:0/3107411105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac4009a70 con 0x7fdacc0725c0 2023-12-19T18:58:55.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.580+0000 7fdac1d9b640 1 --2- 172.21.15.133:0/3107411105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdacc0725c0 0x7fdacc149570 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdabc007fd0 tx=0x7fdabc00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:55.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.584+0000 7fdac37fe640 1 -- 172.21.15.133:0/3107411105 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc0072d0 con 0x7fdacc0725c0 2023-12-19T18:58:55.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.584+0000 7fdac37fe640 1 -- 172.21.15.133:0/3107411105 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc007430 con 0x7fdacc0725c0 2023-12-19T18:58:55.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.584+0000 7fdac37fe640 1 -- 172.21.15.133:0/3107411105 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc0047f0 con 0x7fdacc0725c0 2023-12-19T18:58:55.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.584+0000 7fdad0817640 1 -- 172.21.15.133:0/3107411105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdacc150a70 con 0x7fdacc0725c0 2023-12-19T18:58:55.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.584+0000 7fdad0817640 1 -- 172.21.15.133:0/3107411105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdacc0a6840 con 0x7fdacc0725c0 2023-12-19T18:58:55.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.584+0000 7fdad0817640 1 -- 172.21.15.133:0/3107411105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdacc068400 con 0x7fdacc0725c0 2023-12-19T18:58:55.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.584+0000 7fdac37fe640 1 -- 172.21.15.133:0/3107411105 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fdabc004950 con 0x7fdacc0725c0 2023-12-19T18:58:55.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.584+0000 7fdac37fe640 1 --2- 172.21.15.133:0/3107411105 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdaac066470 0x7fdaac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:55.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.584+0000 7fdac37fe640 1 -- 172.21.15.133:0/3107411105 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdabc0830f0 con 0x7fdacc0725c0 2023-12-19T18:58:55.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.584+0000 7fdaca59c640 1 --2- 172.21.15.133:0/3107411105 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdaac066470 0x7fdaac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:55.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.584+0000 7fdaca59c640 1 --2- 172.21.15.133:0/3107411105 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdaac066470 0x7fdaac068930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdab4007fd0 tx=0x7fdab4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:55.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.588+0000 7fdac37fe640 1 -- 172.21.15.133:0/3107411105 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fdabc050610 con 0x7fdacc0725c0 2023-12-19T18:58:55.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.776+0000 7fdad0817640 1 -- 172.21.15.133:0/3107411105 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdacc06aa30 con 0x7fdacc0725c0 2023-12-19T18:58:55.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.776+0000 7fdac37fe640 1 -- 172.21.15.133:0/3107411105 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7fdabc053c30 con 0x7fdacc0725c0 2023-12-19T18:58:55.780 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:55.780 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6836/2938414361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":2938414361},{"type":"v1","addr":"172.21.15.138:6836","nonce":2938414361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/4017805684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6835","nonce":4017805684},{"type":"v1","addr":"172.21.15.138:6837","nonce":4017805684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/1350101028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1350101028},{"type":"v1","addr":"172.21.15.133:6834","nonce":1350101028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:58:42.786720+0000","modified":"2023-12-19T18:58:46.003120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/615053717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":615053717},{"type":"v1","addr":"172.21.15.133:6835","nonce":615053717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T18:58:55.780 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 8 2023-12-19T18:58:55.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.776+0000 7fdad0817640 1 -- 172.21.15.133:0/3107411105 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdaac066470 msgr2=0x7fdaac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:55.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.776+0000 7fdad0817640 1 --2- 172.21.15.133:0/3107411105 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdaac066470 0x7fdaac068930 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdab4007fd0 tx=0x7fdab4009040 comp rx=0 tx=0).stop 2023-12-19T18:58:55.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.776+0000 7fdad0817640 1 -- 172.21.15.133:0/3107411105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdacc0725c0 msgr2=0x7fdacc149570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:55.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.776+0000 7fdad0817640 1 --2- 172.21.15.133:0/3107411105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdacc0725c0 0x7fdacc149570 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fdabc007fd0 tx=0x7fdabc00cbe0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.776+0000 7fdad0817640 1 -- 172.21.15.133:0/3107411105 shutdown_connections 2023-12-19T18:58:55.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.776+0000 7fdad0817640 1 --2- 172.21.15.133:0/3107411105 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdaac066470 0x7fdaac068930 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.776+0000 7fdad0817640 1 --2- 172.21.15.133:0/3107411105 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdacc0a5370 0x7fdacc149ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.776+0000 7fdad0817640 1 --2- 172.21.15.133:0/3107411105 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdacc0725c0 0x7fdacc149570 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.776+0000 7fdad0817640 1 --2- 172.21.15.133:0/3107411105 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdacc072090 0x7fdacc1f1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.776+0000 7fdad0817640 1 -- 172.21.15.133:0/3107411105 >> 172.21.15.133:0/3107411105 conn(0x7fdacc06a5b0 msgr2=0x7fdacc0c0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:55.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.776+0000 7fdad0817640 1 -- 172.21.15.133:0/3107411105 shutdown_connections 2023-12-19T18:58:55.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.776+0000 7fdad0817640 1 -- 172.21.15.133:0/3107411105 wait complete. 2023-12-19T18:58:55.802 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:58:55.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.936+0000 7fe067417640 1 Processor -- start 2023-12-19T18:58:55.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.936+0000 7fe067417640 1 -- start start 2023-12-19T18:58:55.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.936+0000 7fe067417640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe06006d990 0x7fe0600c5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:55.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.936+0000 7fe067417640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0601546c0 0x7fe060154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:55.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.936+0000 7fe067417640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe06006c070 0x7fe06006c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:55.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.936+0000 7fe067417640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0600c1e30 con 0x7fe0601546c0 2023-12-19T18:58:55.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.936+0000 7fe067417640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe06006dd70 con 0x7fe06006d990 2023-12-19T18:58:55.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.936+0000 7fe067417640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0600c1220 con 0x7fe06006c070 2023-12-19T18:58:55.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.936+0000 7fe065c14640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0601546c0 0x7fe060154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:55.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.936+0000 7fe065c14640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe0601546c0 0x7fe060154b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33864/0 (socket says 172.21.15.133:33864) 2023-12-19T18:58:55.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.936+0000 7fe065c14640 1 -- 172.21.15.133:0/1558729726 learned_addr learned my addr 172.21.15.133:0/1558729726 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:55.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.936+0000 7fe066415640 1 --2- 172.21.15.133:0/1558729726 >> v2:172.21.15.138:3300/0 conn(0x7fe06006d990 0x7fe0600c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:55.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.936+0000 7fe066c16640 1 --2- 172.21.15.133:0/1558729726 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe06006c070 0x7fe06006c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:55.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.936+0000 7fe065c14640 1 -- 172.21.15.133:0/1558729726 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe06006c070 msgr2=0x7fe06006c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:55.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.936+0000 7fe065c14640 1 --2- 172.21.15.133:0/1558729726 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe06006c070 0x7fe06006c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.936+0000 7fe065c14640 1 -- 172.21.15.133:0/1558729726 >> v2:172.21.15.138:3300/0 conn(0x7fe06006d990 msgr2=0x7fe0600c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:55.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.936+0000 7fe065c14640 1 --2- 172.21.15.133:0/1558729726 >> v2:172.21.15.138:3300/0 conn(0x7fe06006d990 0x7fe0600c5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.936+0000 7fe065c14640 1 -- 172.21.15.133:0/1558729726 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0600c1500 con 0x7fe0601546c0 2023-12-19T18:58:55.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.940+0000 7fe065c14640 1 --2- 172.21.15.133:0/1558729726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0601546c0 0x7fe060154b20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe060066ce0 tx=0x7fe05001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f0a058879bf61c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:55.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.940+0000 7fe065413640 1 -- 172.21.15.133:0/1558729726 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0500ac410 con 0x7fe0601546c0 2023-12-19T18:58:55.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.940+0000 7fe065413640 1 -- 172.21.15.133:0/1558729726 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0500ac570 con 0x7fe0601546c0 2023-12-19T18:58:55.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.940+0000 7fe065413640 1 -- 172.21.15.133:0/1558729726 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0500ac900 con 0x7fe0601546c0 2023-12-19T18:58:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.940+0000 7fe067417640 1 -- 172.21.15.133:0/1558729726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0601546c0 msgr2=0x7fe060154b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.940+0000 7fe067417640 1 --2- 172.21.15.133:0/1558729726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0601546c0 0x7fe060154b20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe060066ce0 tx=0x7fe05001c500 comp rx=0 tx=0).stop 2023-12-19T18:58:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.940+0000 7fe067417640 1 -- 172.21.15.133:0/1558729726 shutdown_connections 2023-12-19T18:58:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.940+0000 7fe067417640 1 --2- 172.21.15.133:0/1558729726 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe06006c070 0x7fe06006c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.940+0000 7fe067417640 1 --2- 172.21.15.133:0/1558729726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0601546c0 0x7fe060154b20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.940+0000 7fe067417640 1 --2- 172.21.15.133:0/1558729726 >> v2:172.21.15.138:3300/0 conn(0x7fe06006d990 0x7fe0600c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.940+0000 7fe067417640 1 -- 172.21.15.133:0/1558729726 >> 172.21.15.133:0/1558729726 conn(0x7fe0600a7800 msgr2=0x7fe0600a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:55.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.940+0000 7fe067417640 1 -- 172.21.15.133:0/1558729726 shutdown_connections 2023-12-19T18:58:55.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.940+0000 7fe067417640 1 -- 172.21.15.133:0/1558729726 wait complete. 2023-12-19T18:58:55.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe067417640 1 Processor -- start 2023-12-19T18:58:55.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe067417640 1 -- start start 2023-12-19T18:58:55.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe067417640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe06006c070 0x7fe0601edd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:55.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe067417640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe06006d990 0x7fe0600bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:55.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe067417640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0601546c0 0x7fe060151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:55.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe067417640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0601f1770 con 0x7fe06006c070 2023-12-19T18:58:55.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe067417640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0601f09b0 con 0x7fe0601546c0 2023-12-19T18:58:55.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe067417640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0601f0c90 con 0x7fe06006d990 2023-12-19T18:58:55.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe066415640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe06006c070 0x7fe0601edd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:55.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe066415640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe06006c070 0x7fe0601edd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33866/0 (socket says 172.21.15.133:33866) 2023-12-19T18:58:55.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe066415640 1 -- 172.21.15.133:0/2209240900 learned_addr learned my addr 172.21.15.133:0/2209240900 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:55.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe066c16640 1 --2- 172.21.15.133:0/2209240900 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0601546c0 0x7fe060151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:55.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe065c14640 1 --2- 172.21.15.133:0/2209240900 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe06006d990 0x7fe0600bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:55.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe066415640 1 -- 172.21.15.133:0/2209240900 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe06006d990 msgr2=0x7fe0600bf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:55.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe066415640 1 --2- 172.21.15.133:0/2209240900 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe06006d990 0x7fe0600bf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe066415640 1 -- 172.21.15.133:0/2209240900 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0601546c0 msgr2=0x7fe060151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:55.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe066415640 1 --2- 172.21.15.133:0/2209240900 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0601546c0 0x7fe060151620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:55.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe066415640 1 -- 172.21.15.133:0/2209240900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0500094d0 con 0x7fe06006c070 2023-12-19T18:58:55.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe066c16640 1 --2- 172.21.15.133:0/2209240900 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0601546c0 0x7fe060151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:55.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe066415640 1 --2- 172.21.15.133:0/2209240900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe06006c070 0x7fe0601edd40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00d800 tx=0x7fe05c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:55.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe056ffd640 1 -- 172.21.15.133:0/2209240900 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c00b6c0 con 0x7fe06006c070 2023-12-19T18:58:55.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe056ffd640 1 -- 172.21.15.133:0/2209240900 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05c00b820 con 0x7fe06006c070 2023-12-19T18:58:55.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe056ffd640 1 -- 172.21.15.133:0/2209240900 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c00bb90 con 0x7fe06006c070 2023-12-19T18:58:55.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe067417640 1 -- 172.21.15.133:0/2209240900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0601f0f70 con 0x7fe06006c070 2023-12-19T18:58:55.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.944+0000 7fe067417640 1 -- 172.21.15.133:0/2209240900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0600bf620 con 0x7fe06006c070 2023-12-19T18:58:55.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.948+0000 7fe067417640 1 -- 172.21.15.133:0/2209240900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe06004e850 con 0x7fe06006c070 2023-12-19T18:58:55.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.948+0000 7fe056ffd640 1 -- 172.21.15.133:0/2209240900 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe05c00bcf0 con 0x7fe06006c070 2023-12-19T18:58:55.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.948+0000 7fe056ffd640 1 --2- 172.21.15.133:0/2209240900 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe044066470 0x7fe044068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:55.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.948+0000 7fe056ffd640 1 -- 172.21.15.133:0/2209240900 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe05c084340 con 0x7fe06006c070 2023-12-19T18:58:55.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.948+0000 7fe065c14640 1 --2- 172.21.15.133:0/2209240900 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe044066470 0x7fe044068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:55.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.948+0000 7fe065c14640 1 --2- 172.21.15.133:0/2209240900 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe044066470 0x7fe044068930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe0500ae000 tx=0x7fe050009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:55.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:55.952+0000 7fe056ffd640 1 -- 172.21.15.133:0/2209240900 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fe05c0517b0 con 0x7fe06006c070 2023-12-19T18:58:56.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.100+0000 7fe067417640 1 -- 172.21.15.133:0/2209240900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0600c21b0 con 0x7fe06006c070 2023-12-19T18:58:56.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.104+0000 7fe056ffd640 1 -- 172.21.15.133:0/2209240900 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fe05c054dd0 con 0x7fe06006c070 2023-12-19T18:58:56.108 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:56.108 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:44.402984+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:58:40.991408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T18:58:41.773992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:58:56.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.104+0000 7fe067417640 1 -- 172.21.15.133:0/2209240900 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe044066470 msgr2=0x7fe044068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:56.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.104+0000 7fe067417640 1 --2- 172.21.15.133:0/2209240900 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe044066470 0x7fe044068930 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe0500ae000 tx=0x7fe050009040 comp rx=0 tx=0).stop 2023-12-19T18:58:56.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.104+0000 7fe067417640 1 -- 172.21.15.133:0/2209240900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe06006c070 msgr2=0x7fe0601edd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:56.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.104+0000 7fe067417640 1 --2- 172.21.15.133:0/2209240900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe06006c070 0x7fe0601edd40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00d800 tx=0x7fe05c00dcc0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.104+0000 7fe067417640 1 -- 172.21.15.133:0/2209240900 shutdown_connections 2023-12-19T18:58:56.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.104+0000 7fe067417640 1 --2- 172.21.15.133:0/2209240900 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe044066470 0x7fe044068930 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.104+0000 7fe067417640 1 --2- 172.21.15.133:0/2209240900 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0601546c0 0x7fe060151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.104+0000 7fe067417640 1 --2- 172.21.15.133:0/2209240900 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe06006d990 0x7fe0600bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.104+0000 7fe067417640 1 --2- 172.21.15.133:0/2209240900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe06006c070 0x7fe0601edd40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.104+0000 7fe067417640 1 -- 172.21.15.133:0/2209240900 >> 172.21.15.133:0/2209240900 conn(0x7fe0600a7800 msgr2=0x7fe0600a7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:56.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.104+0000 7fe067417640 1 -- 172.21.15.133:0/2209240900 shutdown_connections 2023-12-19T18:58:56.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.104+0000 7fe067417640 1 -- 172.21.15.133:0/2209240900 wait complete. 2023-12-19T18:58:56.129 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:58:40.991408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:58:41.773992+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:58:56.129 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:58:56.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.264+0000 7f7ad4980640 1 Processor -- start 2023-12-19T18:58:56.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.264+0000 7f7ad4980640 1 -- start start 2023-12-19T18:58:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.264+0000 7f7ad4980640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ad00a5370 0x7f7ad00c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.264+0000 7f7ad4980640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7ad00c4110 0x7f7ad0150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.264+0000 7f7ad4980640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7ad0072090 0x7f7ad01514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.264+0000 7f7ad4980640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad00c3070 con 0x7f7ad00a5370 2023-12-19T18:58:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.264+0000 7f7ad4980640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad00c2760 con 0x7f7ad0072090 2023-12-19T18:58:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.264+0000 7f7ad4980640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad00a5750 con 0x7f7ad00c4110 2023-12-19T18:58:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.268+0000 7f7ace59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ad00a5370 0x7f7ad00c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.268+0000 7f7ace59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ad00a5370 0x7f7ad00c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33880/0 (socket says 172.21.15.133:33880) 2023-12-19T18:58:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.268+0000 7f7acdd9b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7ad00c4110 0x7f7ad0150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:56.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.268+0000 7f7ace59c640 1 -- 172.21.15.133:0/4048980755 learned_addr learned my addr 172.21.15.133:0/4048980755 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.268+0000 7f7aced9d640 1 --2- 172.21.15.133:0/4048980755 >> v2:172.21.15.138:3300/0 conn(0x7f7ad0072090 0x7f7ad01514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.268+0000 7f7ace59c640 1 -- 172.21.15.133:0/4048980755 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7ad00c4110 msgr2=0x7f7ad0150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.268+0000 7f7ace59c640 1 --2- 172.21.15.133:0/4048980755 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7ad00c4110 0x7f7ad0150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.268+0000 7f7ace59c640 1 -- 172.21.15.133:0/4048980755 >> v2:172.21.15.138:3300/0 conn(0x7f7ad0072090 msgr2=0x7f7ad01514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.268+0000 7f7ace59c640 1 --2- 172.21.15.133:0/4048980755 >> v2:172.21.15.138:3300/0 conn(0x7f7ad0072090 0x7f7ad01514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.268+0000 7f7ace59c640 1 -- 172.21.15.133:0/4048980755 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad00aad20 con 0x7f7ad00a5370 2023-12-19T18:58:56.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.268+0000 7f7ace59c640 1 --2- 172.21.15.133:0/4048980755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ad00a5370 0x7f7ad00c3bd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00c4590 tx=0x7f7ac001e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195ad8d7d1399219 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:56.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.268+0000 7f7acd59a640 1 -- 172.21.15.133:0/4048980755 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac00a78a0 con 0x7f7ad00a5370 2023-12-19T18:58:56.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.268+0000 7f7acd59a640 1 -- 172.21.15.133:0/4048980755 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac00a7a00 con 0x7f7ad00a5370 2023-12-19T18:58:56.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.272+0000 7f7acd59a640 1 -- 172.21.15.133:0/4048980755 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac00a7d90 con 0x7f7ad00a5370 2023-12-19T18:58:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.272+0000 7f7ad4980640 1 -- 172.21.15.133:0/4048980755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ad00a5370 msgr2=0x7f7ad00c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.272+0000 7f7ad4980640 1 --2- 172.21.15.133:0/4048980755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ad00a5370 0x7f7ad00c3bd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00c4590 tx=0x7f7ac001e890 comp rx=0 tx=0).stop 2023-12-19T18:58:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.272+0000 7f7ad4980640 1 -- 172.21.15.133:0/4048980755 shutdown_connections 2023-12-19T18:58:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.272+0000 7f7ad4980640 1 --2- 172.21.15.133:0/4048980755 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7ad00c4110 0x7f7ad0150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.272+0000 7f7ad4980640 1 --2- 172.21.15.133:0/4048980755 >> v2:172.21.15.138:3300/0 conn(0x7f7ad0072090 0x7f7ad01514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.272+0000 7f7ad4980640 1 --2- 172.21.15.133:0/4048980755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ad00a5370 0x7f7ad00c3bd0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.272+0000 7f7ad4980640 1 -- 172.21.15.133:0/4048980755 >> 172.21.15.133:0/4048980755 conn(0x7f7ad006a5b0 msgr2=0x7f7ad006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:56.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.272+0000 7f7ad4980640 1 -- 172.21.15.133:0/4048980755 shutdown_connections 2023-12-19T18:58:56.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.272+0000 7f7ad4980640 1 -- 172.21.15.133:0/4048980755 wait complete. 2023-12-19T18:58:56.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.272+0000 7f7ad4980640 1 Processor -- start 2023-12-19T18:58:56.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.272+0000 7f7ad4980640 1 -- start start 2023-12-19T18:58:56.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.272+0000 7f7ad4980640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ad0072090 0x7f7ad01ecff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:56.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.272+0000 7f7ad4980640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ad00a5370 0x7f7ad006d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:56.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.272+0000 7f7ad4980640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7ad00c4110 0x7f7ad00a61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:56.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.272+0000 7f7ad4980640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad01ec5a0 con 0x7f7ad0072090 2023-12-19T18:58:56.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.272+0000 7f7ad4980640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad01ecb60 con 0x7f7ad00a5370 2023-12-19T18:58:56.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.272+0000 7f7ad4980640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad00a5aa0 con 0x7f7ad00c4110 2023-12-19T18:58:56.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.272+0000 7f7ace59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ad0072090 0x7f7ad01ecff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:56.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.272+0000 7f7ace59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ad0072090 0x7f7ad01ecff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33882/0 (socket says 172.21.15.133:33882) 2023-12-19T18:58:56.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.272+0000 7f7ace59c640 1 -- 172.21.15.133:0/1356362173 learned_addr learned my addr 172.21.15.133:0/1356362173 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:56.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.272+0000 7f7aced9d640 1 --2- 172.21.15.133:0/1356362173 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7ad00c4110 0x7f7ad00a61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.272+0000 7f7acdd9b640 1 --2- 172.21.15.133:0/1356362173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ad00a5370 0x7f7ad006d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.276+0000 7f7ace59c640 1 -- 172.21.15.133:0/1356362173 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7ad00c4110 msgr2=0x7f7ad00a61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.276+0000 7f7ace59c640 1 --2- 172.21.15.133:0/1356362173 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7ad00c4110 0x7f7ad00a61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.276+0000 7f7ace59c640 1 -- 172.21.15.133:0/1356362173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ad00a5370 msgr2=0x7f7ad006d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.276+0000 7f7ace59c640 1 --2- 172.21.15.133:0/1356362173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ad00a5370 0x7f7ad006d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.276+0000 7f7ace59c640 1 -- 172.21.15.133:0/1356362173 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac000a670 con 0x7f7ad0072090 2023-12-19T18:58:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.276+0000 7f7ace59c640 1 --2- 172.21.15.133:0/1356362173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ad0072090 0x7f7ad01ecff0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7ac001f130 tx=0x7f7ac001b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.276+0000 7f7abeffd640 1 -- 172.21.15.133:0/1356362173 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac00af850 con 0x7f7ad0072090 2023-12-19T18:58:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.276+0000 7f7abeffd640 1 -- 172.21.15.133:0/1356362173 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac00af9b0 con 0x7f7ad0072090 2023-12-19T18:58:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.276+0000 7f7ad4980640 1 -- 172.21.15.133:0/1356362173 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad00a5d40 con 0x7f7ad0072090 2023-12-19T18:58:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.276+0000 7f7abeffd640 1 -- 172.21.15.133:0/1356362173 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac00afd20 con 0x7f7ad0072090 2023-12-19T18:58:56.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.276+0000 7f7ad4980640 1 -- 172.21.15.133:0/1356362173 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad006dbc0 con 0x7f7ad0072090 2023-12-19T18:58:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.276+0000 7f7ad4980640 1 -- 172.21.15.133:0/1356362173 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad0068400 con 0x7f7ad0072090 2023-12-19T18:58:56.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.276+0000 7f7abeffd640 1 -- 172.21.15.133:0/1356362173 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7ac00b6040 con 0x7f7ad0072090 2023-12-19T18:58:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.276+0000 7f7abeffd640 1 --2- 172.21.15.133:0/1356362173 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7ab0066470 0x7f7ab0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.276+0000 7f7abeffd640 1 -- 172.21.15.133:0/1356362173 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ac0120430 con 0x7f7ad0072090 2023-12-19T18:58:56.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.280+0000 7f7acdd9b640 1 --2- 172.21.15.133:0/1356362173 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7ab0066470 0x7f7ab0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:56.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.280+0000 7f7acdd9b640 1 --2- 172.21.15.133:0/1356362173 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7ab0066470 0x7f7ab0068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00c0f20 tx=0x7f7ac4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:56.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.280+0000 7f7abeffd640 1 -- 172.21.15.133:0/1356362173 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7ac00edb10 con 0x7f7ad0072090 2023-12-19T18:58:56.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.432+0000 7f7ad4980640 1 -- 172.21.15.133:0/1356362173 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ad00c6780 con 0x7f7ad0072090 2023-12-19T18:58:56.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.432+0000 7f7abeffd640 1 -- 172.21.15.133:0/1356362173 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ac00f1130 con 0x7f7ad0072090 2023-12-19T18:58:56.437 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T18:58:56.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.432+0000 7f7ad4980640 1 -- 172.21.15.133:0/1356362173 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7ab0066470 msgr2=0x7f7ab0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:56.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.432+0000 7f7ad4980640 1 --2- 172.21.15.133:0/1356362173 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7ab0066470 0x7f7ab0068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00c0f20 tx=0x7f7ac4009190 comp rx=0 tx=0).stop 2023-12-19T18:58:56.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.432+0000 7f7ad4980640 1 -- 172.21.15.133:0/1356362173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ad0072090 msgr2=0x7f7ad01ecff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:56.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.432+0000 7f7ad4980640 1 --2- 172.21.15.133:0/1356362173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ad0072090 0x7f7ad01ecff0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7ac001f130 tx=0x7f7ac001b630 comp rx=0 tx=0).stop 2023-12-19T18:58:56.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.432+0000 7f7ad4980640 1 -- 172.21.15.133:0/1356362173 shutdown_connections 2023-12-19T18:58:56.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.432+0000 7f7ad4980640 1 --2- 172.21.15.133:0/1356362173 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7ab0066470 0x7f7ab0068930 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.432+0000 7f7ad4980640 1 --2- 172.21.15.133:0/1356362173 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7ad00c4110 0x7f7ad00a61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.432+0000 7f7ad4980640 1 --2- 172.21.15.133:0/1356362173 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ad00a5370 0x7f7ad006d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.432+0000 7f7ad4980640 1 --2- 172.21.15.133:0/1356362173 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ad0072090 0x7f7ad01ecff0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.432+0000 7f7ad4980640 1 -- 172.21.15.133:0/1356362173 >> 172.21.15.133:0/1356362173 conn(0x7f7ad006a5b0 msgr2=0x7f7ad006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:56.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.432+0000 7f7ad4980640 1 -- 172.21.15.133:0/1356362173 shutdown_connections 2023-12-19T18:58:56.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.436+0000 7f7ad4980640 1 -- 172.21.15.133:0/1356362173 wait complete. 2023-12-19T18:58:56.457 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:58:56.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.592+0000 7fc45ba68640 1 Processor -- start 2023-12-19T18:58:56.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.592+0000 7fc45ba68640 1 -- start start 2023-12-19T18:58:56.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.596+0000 7fc45ba68640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc4540c5640 0x7fc4540c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:56.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.596+0000 7fc45ba68640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4540c60f0 0x7fc454155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:56.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.596+0000 7fc45ba68640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4540c2580 con 0x7fc4540c5260 2023-12-19T18:58:56.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.596+0000 7fc45ba68640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc454153510 con 0x7fc4540c5640 2023-12-19T18:58:56.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.596+0000 7fc45ba68640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4540c17f0 con 0x7fc4540c60f0 2023-12-19T18:58:56.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.596+0000 7fc459804640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc4540c5260 0x7fc45406d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41098/0 (socket says 172.21.15.133:41098) 2023-12-19T18:58:56.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.596+0000 7fc45a005640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4540c60f0 0x7fc454155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:56.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.596+0000 7fc459804640 1 -- 172.21.15.133:0/729924089 learned_addr learned my addr 172.21.15.133:0/729924089 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:56.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.596+0000 7fc459003640 1 --2- 172.21.15.133:0/729924089 >> v2:172.21.15.138:3300/0 conn(0x7fc4540c5640 0x7fc4540c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:56.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.596+0000 7fc45a005640 1 -- 172.21.15.133:0/729924089 >> v2:172.21.15.138:3300/0 conn(0x7fc4540c5640 msgr2=0x7fc4540c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:56.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.596+0000 7fc45a005640 1 --2- 172.21.15.133:0/729924089 >> v2:172.21.15.138:3300/0 conn(0x7fc4540c5640 0x7fc4540c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.596+0000 7fc45a005640 1 -- 172.21.15.133:0/729924089 >> v1:172.21.15.133:6789/0 conn(0x7fc4540c5260 legacy=0x7fc45406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:56.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.596+0000 7fc458802640 1 -- 172.21.15.133:0/729924089 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3644734615 0 0) 0x7fc4540c2580 con 0x7fc4540c5260 2023-12-19T18:58:56.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.596+0000 7fc45a005640 1 -- 172.21.15.133:0/729924089 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4540c1a00 con 0x7fc4540c60f0 2023-12-19T18:58:56.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.596+0000 7fc45a005640 1 --2- 172.21.15.133:0/729924089 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4540c60f0 0x7fc454155de0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc4540c1930 tx=0x7fc44c01c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc4b97bd5c8347bc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:56.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.600+0000 7fc458802640 1 -- 172.21.15.133:0/729924089 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c0a5930 con 0x7fc4540c60f0 2023-12-19T18:58:56.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.600+0000 7fc458802640 1 -- 172.21.15.133:0/729924089 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c0a5a90 con 0x7fc4540c60f0 2023-12-19T18:58:56.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.600+0000 7fc458802640 1 -- 172.21.15.133:0/729924089 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c0a5e20 con 0x7fc4540c60f0 2023-12-19T18:58:56.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.600+0000 7fc45ba68640 1 -- 172.21.15.133:0/729924089 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4540c60f0 msgr2=0x7fc454155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:56.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.600+0000 7fc45ba68640 1 --2- 172.21.15.133:0/729924089 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4540c60f0 0x7fc454155de0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc4540c1930 tx=0x7fc44c01c870 comp rx=0 tx=0).stop 2023-12-19T18:58:56.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.600+0000 7fc45ba68640 1 -- 172.21.15.133:0/729924089 shutdown_connections 2023-12-19T18:58:56.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.600+0000 7fc45ba68640 1 --2- 172.21.15.133:0/729924089 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4540c60f0 0x7fc454155de0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.600+0000 7fc45ba68640 1 --2- 172.21.15.133:0/729924089 >> v2:172.21.15.138:3300/0 conn(0x7fc4540c5640 0x7fc4540c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.600+0000 7fc45ba68640 1 -- 172.21.15.133:0/729924089 >> 172.21.15.133:0/729924089 conn(0x7fc45406a5b0 msgr2=0x7fc45406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:56.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.600+0000 7fc45ba68640 1 -- 172.21.15.133:0/729924089 shutdown_connections 2023-12-19T18:58:56.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.600+0000 7fc45ba68640 1 -- 172.21.15.133:0/729924089 wait complete. 2023-12-19T18:58:56.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.600+0000 7fc45ba68640 1 Processor -- start 2023-12-19T18:58:56.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.600+0000 7fc45ba68640 1 -- start start 2023-12-19T18:58:56.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.600+0000 7fc45ba68640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4540c5260 0x7fc454071230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:56.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.600+0000 7fc45ba68640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4540c5640 0x7fc454153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:56.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.600+0000 7fc45ba68640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4540c60f0 0x7fc454154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:56.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.604+0000 7fc45ba68640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4541ed9c0 con 0x7fc4540c60f0 2023-12-19T18:58:56.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.604+0000 7fc45ba68640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4541edef0 con 0x7fc4540c5640 2023-12-19T18:58:56.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.604+0000 7fc45ba68640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4541edc10 con 0x7fc4540c5260 2023-12-19T18:58:56.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.604+0000 7fc45a005640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4540c60f0 0x7fc454154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:56.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.604+0000 7fc45a005640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4540c60f0 0x7fc454154190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33896/0 (socket says 172.21.15.133:33896) 2023-12-19T18:58:56.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.604+0000 7fc45a005640 1 -- 172.21.15.133:0/2799032556 learned_addr learned my addr 172.21.15.133:0/2799032556 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:56.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.604+0000 7fc459804640 1 --2- 172.21.15.133:0/2799032556 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4540c5260 0x7fc454071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:56.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.604+0000 7fc459003640 1 --2- 172.21.15.133:0/2799032556 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4540c5640 0x7fc454153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:56.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.604+0000 7fc45a005640 1 -- 172.21.15.133:0/2799032556 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4540c5260 msgr2=0x7fc454071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:56.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.604+0000 7fc45a005640 1 --2- 172.21.15.133:0/2799032556 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4540c5260 0x7fc454071230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.604+0000 7fc45a005640 1 -- 172.21.15.133:0/2799032556 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4540c5640 msgr2=0x7fc454153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:56.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.604+0000 7fc45a005640 1 --2- 172.21.15.133:0/2799032556 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4540c5640 0x7fc454153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.604+0000 7fc45a005640 1 -- 172.21.15.133:0/2799032556 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44c009a70 con 0x7fc4540c60f0 2023-12-19T18:58:56.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.604+0000 7fc459003640 1 --2- 172.21.15.133:0/2799032556 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4540c5640 0x7fc454153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:56.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.604+0000 7fc45a005640 1 --2- 172.21.15.133:0/2799032556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4540c60f0 0x7fc454154190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc44c01af20 tx=0x7fc44c019610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:56.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.604+0000 7fc44a7fc640 1 -- 172.21.15.133:0/2799032556 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c0add70 con 0x7fc4540c60f0 2023-12-19T18:58:56.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.604+0000 7fc44a7fc640 1 -- 172.21.15.133:0/2799032556 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc44c009450 con 0x7fc4540c60f0 2023-12-19T18:58:56.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.604+0000 7fc44a7fc640 1 -- 172.21.15.133:0/2799032556 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c0b9690 con 0x7fc4540c60f0 2023-12-19T18:58:56.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.604+0000 7fc45ba68640 1 -- 172.21.15.133:0/2799032556 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc454151da0 con 0x7fc4540c60f0 2023-12-19T18:58:56.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.604+0000 7fc45ba68640 1 -- 172.21.15.133:0/2799032556 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc454155810 con 0x7fc4540c60f0 2023-12-19T18:58:56.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.604+0000 7fc45ba68640 1 -- 172.21.15.133:0/2799032556 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc454068400 con 0x7fc4540c60f0 2023-12-19T18:58:56.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.604+0000 7fc44a7fc640 1 -- 172.21.15.133:0/2799032556 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc44c0b97f0 con 0x7fc4540c60f0 2023-12-19T18:58:56.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.608+0000 7fc44a7fc640 1 --2- 172.21.15.133:0/2799032556 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc4380664a0 0x7fc438068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:56.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.608+0000 7fc44a7fc640 1 -- 172.21.15.133:0/2799032556 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc44c11f340 con 0x7fc4540c60f0 2023-12-19T18:58:56.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.608+0000 7fc459804640 1 --2- 172.21.15.133:0/2799032556 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc4380664a0 0x7fc438068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:56.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.608+0000 7fc459804640 1 --2- 172.21.15.133:0/2799032556 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc4380664a0 0x7fc438068960 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc450000f70 tx=0x7fc450007c10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:56.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.612+0000 7fc44a7fc640 1 -- 172.21.15.133:0/2799032556 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc44c0ec970 con 0x7fc4540c60f0 2023-12-19T18:58:56.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.760+0000 7fc45ba68640 1 -- 172.21.15.133:0/2799032556 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc45406d390 con 0x7fc4540c60f0 2023-12-19T18:58:56.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.760+0000 7fc44a7fc640 1 -- 172.21.15.133:0/2799032556 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc44c0eff90 con 0x7fc4540c60f0 2023-12-19T18:58:56.764 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T18:58:56.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.760+0000 7fc45ba68640 1 -- 172.21.15.133:0/2799032556 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc4380664a0 msgr2=0x7fc438068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:56.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.760+0000 7fc45ba68640 1 --2- 172.21.15.133:0/2799032556 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc4380664a0 0x7fc438068960 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc450000f70 tx=0x7fc450007c10 comp rx=0 tx=0).stop 2023-12-19T18:58:56.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.760+0000 7fc45ba68640 1 -- 172.21.15.133:0/2799032556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4540c60f0 msgr2=0x7fc454154190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:56.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.760+0000 7fc45ba68640 1 --2- 172.21.15.133:0/2799032556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4540c60f0 0x7fc454154190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc44c01af20 tx=0x7fc44c019610 comp rx=0 tx=0).stop 2023-12-19T18:58:56.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.760+0000 7fc45ba68640 1 -- 172.21.15.133:0/2799032556 shutdown_connections 2023-12-19T18:58:56.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.760+0000 7fc45ba68640 1 --2- 172.21.15.133:0/2799032556 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc4380664a0 0x7fc438068960 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.760+0000 7fc45ba68640 1 --2- 172.21.15.133:0/2799032556 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4540c60f0 0x7fc454154190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.760+0000 7fc45ba68640 1 --2- 172.21.15.133:0/2799032556 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4540c5640 0x7fc454153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.760+0000 7fc45ba68640 1 --2- 172.21.15.133:0/2799032556 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4540c5260 0x7fc454071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.760+0000 7fc45ba68640 1 -- 172.21.15.133:0/2799032556 >> 172.21.15.133:0/2799032556 conn(0x7fc45406a5b0 msgr2=0x7fc45406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:56.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.760+0000 7fc45ba68640 1 -- 172.21.15.133:0/2799032556 shutdown_connections 2023-12-19T18:58:56.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.760+0000 7fc45ba68640 1 -- 172.21.15.133:0/2799032556 wait complete. 2023-12-19T18:58:56.786 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:58:56.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.924+0000 7f9e52c32640 1 Processor -- start 2023-12-19T18:58:56.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.924+0000 7f9e52c32640 1 -- start start 2023-12-19T18:58:56.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.924+0000 7f9e52c32640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9e4c06b1e0 0x7f9e4c06a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:56.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.924+0000 7f9e52c32640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e4c072500 con 0x7f9e4c06dfe0 2023-12-19T18:58:56.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.924+0000 7f9e52c32640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e4c070f60 con 0x7f9e4c06a5b0 2023-12-19T18:58:56.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.924+0000 7f9e52c32640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e4c06ef50 con 0x7f9e4c06b1e0 2023-12-19T18:58:56.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.924+0000 7f9e4bfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9e4c06dfe0 0x7f9e4c15cf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41108/0 (socket says 172.21.15.133:41108) 2023-12-19T18:58:56.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.924+0000 7f9e4bfff640 1 -- 172.21.15.133:0/3058149890 learned_addr learned my addr 172.21.15.133:0/3058149890 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:56.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.924+0000 7f9e511cf640 1 --2- 172.21.15.133:0/3058149890 >> v2:172.21.15.138:3300/0 conn(0x7f9e4c06b1e0 0x7f9e4c06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:56.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.924+0000 7f9e4b7fe640 1 -- 172.21.15.133:0/3058149890 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528696341 0 0) 0x7f9e4c072500 con 0x7f9e4c06dfe0 2023-12-19T18:58:56.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.924+0000 7f9e4b7fe640 1 -- 172.21.15.133:0/3058149890 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e3c003530 con 0x7f9e4c06dfe0 2023-12-19T18:58:56.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.924+0000 7f9e4b7fe640 1 -- 172.21.15.133:0/3058149890 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4102604618 0 0) 0x7f9e4c070f60 con 0x7f9e4c06a5b0 2023-12-19T18:58:56.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.924+0000 7f9e4b7fe640 1 -- 172.21.15.133:0/3058149890 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e4c072500 con 0x7f9e4c06a5b0 2023-12-19T18:58:56.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.924+0000 7f9e4b7fe640 1 -- 172.21.15.133:0/3058149890 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1704919185 0 0) 0x7f9e3c003530 con 0x7f9e4c06dfe0 2023-12-19T18:58:56.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.924+0000 7f9e511cf640 1 -- 172.21.15.133:0/3058149890 >> v1:172.21.15.138:6789/0 conn(0x7f9e4c06a5b0 legacy=0x7f9e4c0c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:56.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.924+0000 7f9e511cf640 1 -- 172.21.15.133:0/3058149890 >> v1:172.21.15.133:6789/0 conn(0x7f9e4c06dfe0 legacy=0x7f9e4c15cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:56.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.924+0000 7f9e511cf640 1 -- 172.21.15.133:0/3058149890 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4c14eda0 con 0x7f9e4c06b1e0 2023-12-19T18:58:56.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.928+0000 7f9e511cf640 1 --2- 172.21.15.133:0/3058149890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e4c06b1e0 0x7f9e4c06a990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009d90 tx=0x7f9e4401c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=548bb51bee12121 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:56.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.928+0000 7f9e4b7fe640 1 -- 172.21.15.133:0/3058149890 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e38001680 con 0x7f9e4c06b1e0 2023-12-19T18:58:56.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.928+0000 7f9e4b7fe640 1 -- 172.21.15.133:0/3058149890 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e440a6430 con 0x7f9e4c06b1e0 2023-12-19T18:58:56.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.928+0000 7f9e4b7fe640 1 -- 172.21.15.133:0/3058149890 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e440a67c0 con 0x7f9e4c06b1e0 2023-12-19T18:58:56.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.928+0000 7f9e52c32640 1 -- 172.21.15.133:0/3058149890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e4c06b1e0 msgr2=0x7f9e4c06a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:56.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.928+0000 7f9e52c32640 1 --2- 172.21.15.133:0/3058149890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e4c06b1e0 0x7f9e4c06a990 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9e44009d90 tx=0x7f9e4401c7e0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.928+0000 7f9e52c32640 1 -- 172.21.15.133:0/3058149890 shutdown_connections 2023-12-19T18:58:56.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.928+0000 7f9e52c32640 1 --2- 172.21.15.133:0/3058149890 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e4c06b1e0 0x7f9e4c06a990 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.928+0000 7f9e52c32640 1 -- 172.21.15.133:0/3058149890 >> 172.21.15.133:0/3058149890 conn(0x7f9e4c0c6ef0 msgr2=0x7f9e4c0c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:56.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.928+0000 7f9e52c32640 1 -- 172.21.15.133:0/3058149890 shutdown_connections 2023-12-19T18:58:56.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.928+0000 7f9e52c32640 1 -- 172.21.15.133:0/3058149890 wait complete. 2023-12-19T18:58:56.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.928+0000 7f9e52c32640 1 Processor -- start 2023-12-19T18:58:56.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e52c32640 1 -- start start 2023-12-19T18:58:56.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e52c32640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e4c06a5b0 0x7f9e4c1f1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:56.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e52c32640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e4c06b1e0 0x7f9e4c143dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:56.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e52c32640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e4c06dfe0 0x7f9e4c148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:56.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e52c32640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c136810 con 0x7f9e4c06a5b0 2023-12-19T18:58:56.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e52c32640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c1f19d0 con 0x7f9e4c06dfe0 2023-12-19T18:58:56.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e52c32640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e4c14b130 con 0x7f9e4c06b1e0 2023-12-19T18:58:56.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e509ce640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e4c06a5b0 0x7f9e4c1f1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:56.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e509ce640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e4c06a5b0 0x7f9e4c1f1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33900/0 (socket says 172.21.15.133:33900) 2023-12-19T18:58:56.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e509ce640 1 -- 172.21.15.133:0/3623533895 learned_addr learned my addr 172.21.15.133:0/3623533895 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:56.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e511cf640 1 --2- 172.21.15.133:0/3623533895 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e4c06dfe0 0x7f9e4c148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:56.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e4bfff640 1 --2- 172.21.15.133:0/3623533895 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e4c06b1e0 0x7f9e4c143dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:56.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e509ce640 1 -- 172.21.15.133:0/3623533895 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e4c06b1e0 msgr2=0x7f9e4c143dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:56.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e509ce640 1 --2- 172.21.15.133:0/3623533895 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e4c06b1e0 0x7f9e4c143dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e509ce640 1 -- 172.21.15.133:0/3623533895 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e4c06dfe0 msgr2=0x7f9e4c148e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:56.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e509ce640 1 --2- 172.21.15.133:0/3623533895 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e4c06dfe0 0x7f9e4c148e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:56.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e509ce640 1 -- 172.21.15.133:0/3623533895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e44009a70 con 0x7f9e4c06a5b0 2023-12-19T18:58:56.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e511cf640 1 --2- 172.21.15.133:0/3623533895 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e4c06dfe0 0x7f9e4c148e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:56.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e4bfff640 1 --2- 172.21.15.133:0/3623533895 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e4c06b1e0 0x7f9e4c143dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:56.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e509ce640 1 --2- 172.21.15.133:0/3623533895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e4c06a5b0 0x7f9e4c1f1490 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9e4000c430 tx=0x7f9e4000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:56.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e497fa640 1 -- 172.21.15.133:0/3623533895 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e400052d0 con 0x7f9e4c06a5b0 2023-12-19T18:58:56.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e497fa640 1 -- 172.21.15.133:0/3623533895 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e40005450 con 0x7f9e4c06a5b0 2023-12-19T18:58:56.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e497fa640 1 -- 172.21.15.133:0/3623533895 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e40003840 con 0x7f9e4c06a5b0 2023-12-19T18:58:56.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e52c32640 1 -- 172.21.15.133:0/3623533895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e4c14b410 con 0x7f9e4c06a5b0 2023-12-19T18:58:56.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e52c32640 1 -- 172.21.15.133:0/3623533895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e4c14b9d0 con 0x7f9e4c06a5b0 2023-12-19T18:58:56.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.932+0000 7f9e52c32640 1 -- 172.21.15.133:0/3623533895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e4c068400 con 0x7f9e4c06a5b0 2023-12-19T18:58:56.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.936+0000 7f9e497fa640 1 -- 172.21.15.133:0/3623533895 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9e400039a0 con 0x7f9e4c06a5b0 2023-12-19T18:58:56.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.936+0000 7f9e497fa640 1 --2- 172.21.15.133:0/3623533895 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9e30066470 0x7f9e30068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:56.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.936+0000 7f9e497fa640 1 -- 172.21.15.133:0/3623533895 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e40083470 con 0x7f9e4c06a5b0 2023-12-19T18:58:56.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.936+0000 7f9e4bfff640 1 --2- 172.21.15.133:0/3623533895 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9e30066470 0x7f9e30068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:56.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.936+0000 7f9e4bfff640 1 --2- 172.21.15.133:0/3623533895 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9e30066470 0x7f9e30068930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c1431d0 tx=0x7f9e38009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:56.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:56.940+0000 7f9e497fa640 1 -- 172.21.15.133:0/3623533895 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9e400508f0 con 0x7f9e4c06a5b0 2023-12-19T18:58:57.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.088+0000 7f9e52c32640 1 -- 172.21.15.133:0/3623533895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9e4c0c3240 con 0x7f9e4c06a5b0 2023-12-19T18:58:57.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.088+0000 7f9e497fa640 1 -- 172.21.15.133:0/3623533895 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9e40053f10 con 0x7f9e4c06a5b0 2023-12-19T18:58:57.092 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T18:58:57.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.088+0000 7f9e52c32640 1 -- 172.21.15.133:0/3623533895 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9e30066470 msgr2=0x7f9e30068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:57.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.088+0000 7f9e52c32640 1 --2- 172.21.15.133:0/3623533895 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9e30066470 0x7f9e30068930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c1431d0 tx=0x7f9e38009040 comp rx=0 tx=0).stop 2023-12-19T18:58:57.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.088+0000 7f9e52c32640 1 -- 172.21.15.133:0/3623533895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e4c06a5b0 msgr2=0x7f9e4c1f1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:57.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.088+0000 7f9e52c32640 1 --2- 172.21.15.133:0/3623533895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e4c06a5b0 0x7f9e4c1f1490 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9e4000c430 tx=0x7f9e4000c8f0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.088+0000 7f9e52c32640 1 -- 172.21.15.133:0/3623533895 shutdown_connections 2023-12-19T18:58:57.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.088+0000 7f9e52c32640 1 --2- 172.21.15.133:0/3623533895 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9e30066470 0x7f9e30068930 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.088+0000 7f9e52c32640 1 --2- 172.21.15.133:0/3623533895 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e4c06dfe0 0x7f9e4c148e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.088+0000 7f9e52c32640 1 --2- 172.21.15.133:0/3623533895 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e4c06b1e0 0x7f9e4c143dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.088+0000 7f9e52c32640 1 --2- 172.21.15.133:0/3623533895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e4c06a5b0 0x7f9e4c1f1490 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.088+0000 7f9e52c32640 1 -- 172.21.15.133:0/3623533895 >> 172.21.15.133:0/3623533895 conn(0x7f9e4c0c6ef0 msgr2=0x7f9e4c06e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.088+0000 7f9e52c32640 1 -- 172.21.15.133:0/3623533895 shutdown_connections 2023-12-19T18:58:57.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.088+0000 7f9e52c32640 1 -- 172.21.15.133:0/3623533895 wait complete. 2023-12-19T18:58:57.114 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:58:57.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.248+0000 7f17c9a79640 1 Processor -- start 2023-12-19T18:58:57.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.248+0000 7f17c9a79640 1 -- start start 2023-12-19T18:58:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.248+0000 7f17c9a79640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f17c4151e90 0x7f17c40c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.248+0000 7f17c9a79640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f17c40c7ea0 0x7f17c406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.248+0000 7f17c9a79640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17c40c4e60 0x7f17c406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.248+0000 7f17c9a79640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c40c8750 con 0x7f17c4151e90 2023-12-19T18:58:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.248+0000 7f17c9a79640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c41552d0 con 0x7f17c40c7ea0 2023-12-19T18:58:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.248+0000 7f17c9a79640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40c5c60 con 0x7f17c40c4e60 2023-12-19T18:58:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.248+0000 7f17c37fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f17c4151e90 0x7f17c40c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.248+0000 7f17c37fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f17c4151e90 0x7f17c40c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33912/0 (socket says 172.21.15.133:33912) 2023-12-19T18:58:57.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.248+0000 7f17c37fe640 1 -- 172.21.15.133:0/3259640579 learned_addr learned my addr 172.21.15.133:0/3259640579 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:57.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.248+0000 7f17c37fe640 1 -- 172.21.15.133:0/3259640579 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17c40c4e60 msgr2=0x7f17c406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:57.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.248+0000 7f17c2ffd640 1 --2- 172.21.15.133:0/3259640579 >> v2:172.21.15.138:3300/0 conn(0x7f17c40c7ea0 0x7f17c406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:57.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.248+0000 7f17c3fff640 1 --2- 172.21.15.133:0/3259640579 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17c40c4e60 0x7f17c406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:57.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.248+0000 7f17c37fe640 1 --2- 172.21.15.133:0/3259640579 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17c40c4e60 0x7f17c406b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.248+0000 7f17c37fe640 1 -- 172.21.15.133:0/3259640579 >> v2:172.21.15.138:3300/0 conn(0x7f17c40c7ea0 msgr2=0x7f17c406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:57.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.248+0000 7f17c37fe640 1 --2- 172.21.15.133:0/3259640579 >> v2:172.21.15.138:3300/0 conn(0x7f17c40c7ea0 0x7f17c406b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.248+0000 7f17c37fe640 1 -- 172.21.15.133:0/3259640579 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c406c860 con 0x7f17c4151e90 2023-12-19T18:58:57.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.248+0000 7f17c2ffd640 1 --2- 172.21.15.133:0/3259640579 >> v2:172.21.15.138:3300/0 conn(0x7f17c40c7ea0 0x7f17c406b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:57.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.248+0000 7f17c3fff640 1 --2- 172.21.15.133:0/3259640579 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17c40c4e60 0x7f17c406b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:57.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.252+0000 7f17c37fe640 1 --2- 172.21.15.133:0/3259640579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c4151e90 0x7f17c40c4920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f17c40a9a70 tx=0x7f17b401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8062fcd0c3fe1501 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.252+0000 7f17c27fc640 1 -- 172.21.15.133:0/3259640579 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b40ab600 con 0x7f17c4151e90 2023-12-19T18:58:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.252+0000 7f17c27fc640 1 -- 172.21.15.133:0/3259640579 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b40a7050 con 0x7f17c4151e90 2023-12-19T18:58:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.252+0000 7f17c27fc640 1 -- 172.21.15.133:0/3259640579 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b40ab980 con 0x7f17c4151e90 2023-12-19T18:58:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.252+0000 7f17c9a79640 1 -- 172.21.15.133:0/3259640579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c4151e90 msgr2=0x7f17c40c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.252+0000 7f17c9a79640 1 --2- 172.21.15.133:0/3259640579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c4151e90 0x7f17c40c4920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f17c40a9a70 tx=0x7f17b401c3e0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.252+0000 7f17c9a79640 1 -- 172.21.15.133:0/3259640579 shutdown_connections 2023-12-19T18:58:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.252+0000 7f17c9a79640 1 --2- 172.21.15.133:0/3259640579 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17c40c4e60 0x7f17c406b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.252+0000 7f17c9a79640 1 --2- 172.21.15.133:0/3259640579 >> v2:172.21.15.138:3300/0 conn(0x7f17c40c7ea0 0x7f17c406b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.252+0000 7f17c9a79640 1 --2- 172.21.15.133:0/3259640579 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c4151e90 0x7f17c40c4920 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.252+0000 7f17c9a79640 1 -- 172.21.15.133:0/3259640579 >> 172.21.15.133:0/3259640579 conn(0x7f17c40ca170 msgr2=0x7f17c40ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.252+0000 7f17c9a79640 1 -- 172.21.15.133:0/3259640579 shutdown_connections 2023-12-19T18:58:57.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.252+0000 7f17c9a79640 1 -- 172.21.15.133:0/3259640579 wait complete. 2023-12-19T18:58:57.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.252+0000 7f17c9a79640 1 Processor -- start 2023-12-19T18:58:57.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17c9a79640 1 -- start start 2023-12-19T18:58:57.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17c9a79640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17c40c4e60 0x7f17c4152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:57.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17c9a79640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17c40c7ea0 0x7f17c4142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:57.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17c9a79640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c4151e90 0x7f17c4142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:57.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17c9a79640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c4157ab0 con 0x7f17c4151e90 2023-12-19T18:58:57.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17c9a79640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c41432c0 con 0x7f17c40c7ea0 2023-12-19T18:58:57.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17c9a79640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c41437a0 con 0x7f17c40c4e60 2023-12-19T18:58:57.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17c3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c4151e90 0x7f17c4142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:57.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17c37fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17c40c4e60 0x7f17c4152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:57.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17c3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c4151e90 0x7f17c4142d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33928/0 (socket says 172.21.15.133:33928) 2023-12-19T18:58:57.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17c3fff640 1 -- 172.21.15.133:0/3438593395 learned_addr learned my addr 172.21.15.133:0/3438593395 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:57.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17c2ffd640 1 --2- 172.21.15.133:0/3438593395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17c40c7ea0 0x7f17c4142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:57.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17c3fff640 1 -- 172.21.15.133:0/3438593395 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17c40c4e60 msgr2=0x7f17c4152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:57.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17c3fff640 1 --2- 172.21.15.133:0/3438593395 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17c40c4e60 0x7f17c4152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17c3fff640 1 -- 172.21.15.133:0/3438593395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17c40c7ea0 msgr2=0x7f17c4142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:57.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17c3fff640 1 --2- 172.21.15.133:0/3438593395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17c40c7ea0 0x7f17c4142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17c3fff640 1 -- 172.21.15.133:0/3438593395 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b40094d0 con 0x7f17c4151e90 2023-12-19T18:58:57.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17c37fe640 1 --2- 172.21.15.133:0/3438593395 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17c40c4e60 0x7f17c4152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:58:57.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17c3fff640 1 --2- 172.21.15.133:0/3438593395 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c4151e90 0x7f17c4142d80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00cd10 tx=0x7f17bc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:57.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17abfff640 1 -- 172.21.15.133:0/3438593395 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc00f680 con 0x7f17c4151e90 2023-12-19T18:58:57.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17abfff640 1 -- 172.21.15.133:0/3438593395 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17bc00f800 con 0x7f17c4151e90 2023-12-19T18:58:57.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17abfff640 1 -- 172.21.15.133:0/3438593395 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc00fbb0 con 0x7f17c4151e90 2023-12-19T18:58:57.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17c9a79640 1 -- 172.21.15.133:0/3438593395 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c4143500 con 0x7f17c4151e90 2023-12-19T18:58:57.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17c9a79640 1 -- 172.21.15.133:0/3438593395 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c4155c60 con 0x7f17c4151e90 2023-12-19T18:58:57.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.256+0000 7f17c9a79640 1 -- 172.21.15.133:0/3438593395 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c4155ac0 con 0x7f17c4151e90 2023-12-19T18:58:57.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.260+0000 7f17abfff640 1 -- 172.21.15.133:0/3438593395 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f17bc00b040 con 0x7f17c4151e90 2023-12-19T18:58:57.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.260+0000 7f17abfff640 1 --2- 172.21.15.133:0/3438593395 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f17b00664a0 0x7f17b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:57.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.260+0000 7f17abfff640 1 -- 172.21.15.133:0/3438593395 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17bc0845c0 con 0x7f17c4151e90 2023-12-19T18:58:57.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.260+0000 7f17c37fe640 1 --2- 172.21.15.133:0/3438593395 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f17b00664a0 0x7f17b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:57.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.260+0000 7f17c37fe640 1 --2- 172.21.15.133:0/3438593395 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f17b00664a0 0x7f17b0068960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f17b40ad000 tx=0x7f17b40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:57.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.264+0000 7f17abfff640 1 -- 172.21.15.133:0/3438593395 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f17c4155ac0 con 0x7f17c4151e90 2023-12-19T18:58:57.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.444+0000 7f17c9a79640 1 -- 172.21.15.133:0/3438593395 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17c4155ac0 con 0x7f17c4151e90 2023-12-19T18:58:57.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.444+0000 7f17abfff640 1 -- 172.21.15.133:0/3438593395 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f17c4155ac0 con 0x7f17c4151e90 2023-12-19T18:58:57.449 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:57.449 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6836/2938414361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":2938414361},{"type":"v1","addr":"172.21.15.138:6836","nonce":2938414361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/4017805684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6835","nonce":4017805684},{"type":"v1","addr":"172.21.15.138:6837","nonce":4017805684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/1350101028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1350101028},{"type":"v1","addr":"172.21.15.133:6834","nonce":1350101028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:58:42.786720+0000","modified":"2023-12-19T18:58:46.003120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/615053717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":615053717},{"type":"v1","addr":"172.21.15.133:6835","nonce":615053717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T18:58:57.449 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 8 2023-12-19T18:58:57.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.444+0000 7f17c9a79640 1 -- 172.21.15.133:0/3438593395 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f17b00664a0 msgr2=0x7f17b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:57.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.444+0000 7f17c9a79640 1 --2- 172.21.15.133:0/3438593395 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f17b00664a0 0x7f17b0068960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f17b40ad000 tx=0x7f17b40a6000 comp rx=0 tx=0).stop 2023-12-19T18:58:57.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.444+0000 7f17c9a79640 1 -- 172.21.15.133:0/3438593395 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c4151e90 msgr2=0x7f17c4142d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:57.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.444+0000 7f17c9a79640 1 --2- 172.21.15.133:0/3438593395 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c4151e90 0x7f17c4142d80 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f17bc00cd10 tx=0x7f17bc00a650 comp rx=0 tx=0).stop 2023-12-19T18:58:57.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.444+0000 7f17c9a79640 1 -- 172.21.15.133:0/3438593395 shutdown_connections 2023-12-19T18:58:57.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.444+0000 7f17c9a79640 1 --2- 172.21.15.133:0/3438593395 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f17b00664a0 0x7f17b0068960 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.444+0000 7f17c9a79640 1 --2- 172.21.15.133:0/3438593395 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c4151e90 0x7f17c4142d80 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.444+0000 7f17c9a79640 1 --2- 172.21.15.133:0/3438593395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17c40c7ea0 0x7f17c4142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.444+0000 7f17c9a79640 1 --2- 172.21.15.133:0/3438593395 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17c40c4e60 0x7f17c4152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.444+0000 7f17c9a79640 1 -- 172.21.15.133:0/3438593395 >> 172.21.15.133:0/3438593395 conn(0x7f17c40ca170 msgr2=0x7f17c4150670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:57.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.448+0000 7f17c9a79640 1 -- 172.21.15.133:0/3438593395 shutdown_connections 2023-12-19T18:58:57.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.448+0000 7f17c9a79640 1 -- 172.21.15.133:0/3438593395 wait complete. 2023-12-19T18:58:57.471 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:58:57.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.604+0000 7f50303c1640 1 Processor -- start 2023-12-19T18:58:57.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.604+0000 7f50303c1640 1 -- start start 2023-12-19T18:58:57.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.604+0000 7f50303c1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50280c4100 0x7f50280c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:57.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.604+0000 7f50303c1640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f50280c06d0 0x7f50280a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:57.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.604+0000 7f50303c1640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50280c31c0 con 0x7f50280c63c0 2023-12-19T18:58:57.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.604+0000 7f50303c1640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50280c34a0 con 0x7f50280c06d0 2023-12-19T18:58:57.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.604+0000 7f50303c1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50280c1030 con 0x7f50280c4100 2023-12-19T18:58:57.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.604+0000 7f502e95e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f50280c06d0 0x7f50280a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:57.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.604+0000 7f502d95c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50280c4100 0x7f50280c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:57.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.604+0000 7f502e95e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f50280c06d0 0x7f50280a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:43792/0 (socket says 172.21.15.133:43792) 2023-12-19T18:58:57.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.604+0000 7f502e95e640 1 -- 172.21.15.133:0/1262692332 learned_addr learned my addr 172.21.15.133:0/1262692332 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:57.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.604+0000 7f502e15d640 1 --1- 172.21.15.133:0/1262692332 >> v1:172.21.15.138:6789/0 conn(0x7f50280c63c0 0x7f50280c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:57152/0 (socket says 172.21.15.133:57152) 2023-12-19T18:58:57.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.604+0000 7f502d95c640 1 -- 172.21.15.133:0/1262692332 >> v2:172.21.15.138:3300/0 conn(0x7f50280c06d0 msgr2=0x7f50280a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:57.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.604+0000 7f502d95c640 1 --2- 172.21.15.133:0/1262692332 >> v2:172.21.15.138:3300/0 conn(0x7f50280c06d0 0x7f50280a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.604+0000 7f502d95c640 1 -- 172.21.15.133:0/1262692332 >> v1:172.21.15.138:6789/0 conn(0x7f50280c63c0 legacy=0x7f50280c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:57.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.604+0000 7f502d95c640 1 -- 172.21.15.133:0/1262692332 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50280c1310 con 0x7f50280c4100 2023-12-19T18:58:57.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.608+0000 7f502d95c640 1 --2- 172.21.15.133:0/1262692332 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50280c4100 0x7f50280c2bb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f50180097c0 tx=0x7f501801c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de361663e91b1954 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:57.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.612+0000 7f502d15b640 1 -- 172.21.15.133:0/1262692332 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50280aa3d0 con 0x7f50280c4100 2023-12-19T18:58:57.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.612+0000 7f502d15b640 1 -- 172.21.15.133:0/1262692332 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50180a7050 con 0x7f50280c4100 2023-12-19T18:58:57.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.612+0000 7f502d15b640 1 -- 172.21.15.133:0/1262692332 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50180ab820 con 0x7f50280c4100 2023-12-19T18:58:57.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.612+0000 7f50303c1640 1 -- 172.21.15.133:0/1262692332 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50280c4100 msgr2=0x7f50280c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:57.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.612+0000 7f50303c1640 1 --2- 172.21.15.133:0/1262692332 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50280c4100 0x7f50280c2bb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f50180097c0 tx=0x7f501801c360 comp rx=0 tx=0).stop 2023-12-19T18:58:57.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.612+0000 7f50303c1640 1 -- 172.21.15.133:0/1262692332 shutdown_connections 2023-12-19T18:58:57.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.612+0000 7f50303c1640 1 --2- 172.21.15.133:0/1262692332 >> v2:172.21.15.138:3300/0 conn(0x7f50280c06d0 0x7f50280a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.612+0000 7f50303c1640 1 --2- 172.21.15.133:0/1262692332 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50280c4100 0x7f50280c2bb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.612+0000 7f50303c1640 1 -- 172.21.15.133:0/1262692332 >> 172.21.15.133:0/1262692332 conn(0x7f502806a5b0 msgr2=0x7f502806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:57.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.612+0000 7f50303c1640 1 -- 172.21.15.133:0/1262692332 shutdown_connections 2023-12-19T18:58:57.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.612+0000 7f50303c1640 1 -- 172.21.15.133:0/1262692332 wait complete. 2023-12-19T18:58:57.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.612+0000 7f50303c1640 1 Processor -- start 2023-12-19T18:58:57.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.612+0000 7f50303c1640 1 -- start start 2023-12-19T18:58:57.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f50303c1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50280c06d0 0x7f50281ebfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:57.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f50303c1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50280c4100 0x7f50281ec510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:57.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f50303c1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50280c63c0 0x7f5028153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:57.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f50303c1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502814e870 con 0x7f50280c4100 2023-12-19T18:58:57.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f50303c1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5028156630 con 0x7f50280c63c0 2023-12-19T18:58:57.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f50303c1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502814d9a0 con 0x7f50280c06d0 2023-12-19T18:58:57.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f502d95c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50280c4100 0x7f50281ec510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:57.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f502d95c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50280c4100 0x7f50281ec510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33940/0 (socket says 172.21.15.133:33940) 2023-12-19T18:58:57.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f502d95c640 1 -- 172.21.15.133:0/1713701927 learned_addr learned my addr 172.21.15.133:0/1713701927 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:57.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f502e15d640 1 --2- 172.21.15.133:0/1713701927 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50280c06d0 0x7f50281ebfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:57.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f502e95e640 1 --2- 172.21.15.133:0/1713701927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50280c63c0 0x7f5028153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:57.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f502d95c640 1 -- 172.21.15.133:0/1713701927 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50280c06d0 msgr2=0x7f50281ebfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:57.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f502d95c640 1 --2- 172.21.15.133:0/1713701927 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50280c06d0 0x7f50281ebfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f502d95c640 1 -- 172.21.15.133:0/1713701927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50280c63c0 msgr2=0x7f5028153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:57.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f502d95c640 1 --2- 172.21.15.133:0/1713701927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50280c63c0 0x7f5028153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f502d95c640 1 -- 172.21.15.133:0/1713701927 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5018009420 con 0x7f50280c4100 2023-12-19T18:58:57.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f502d95c640 1 --2- 172.21.15.133:0/1713701927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50280c4100 0x7f50281ec510 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f50180097c0 tx=0x7f501801aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:57.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f501effd640 1 -- 172.21.15.133:0/1713701927 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50180b7450 con 0x7f50280c4100 2023-12-19T18:58:57.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f501effd640 1 -- 172.21.15.133:0/1713701927 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50180b75b0 con 0x7f50280c4100 2023-12-19T18:58:57.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f501effd640 1 -- 172.21.15.133:0/1713701927 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50180b7960 con 0x7f50280c4100 2023-12-19T18:58:57.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f50303c1640 1 -- 172.21.15.133:0/1713701927 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50281ecaf0 con 0x7f50280c4100 2023-12-19T18:58:57.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f50303c1640 1 -- 172.21.15.133:0/1713701927 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f502814eda0 con 0x7f50280c4100 2023-12-19T18:58:57.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f50303c1640 1 -- 172.21.15.133:0/1713701927 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5028068400 con 0x7f50280c4100 2023-12-19T18:58:57.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.616+0000 7f501effd640 1 -- 172.21.15.133:0/1713701927 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f50180b7ac0 con 0x7f50280c4100 2023-12-19T18:58:57.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.620+0000 7f501effd640 1 --2- 172.21.15.133:0/1713701927 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f500c066470 0x7f500c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:57.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.620+0000 7f501effd640 1 -- 172.21.15.133:0/1713701927 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f501811e5b0 con 0x7f50280c4100 2023-12-19T18:58:57.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.620+0000 7f502e15d640 1 --2- 172.21.15.133:0/1713701927 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f500c066470 0x7f500c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:57.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.620+0000 7f502e15d640 1 --2- 172.21.15.133:0/1713701927 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f500c066470 0x7f500c068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5024000f70 tx=0x7f5024007e50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:57.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.624+0000 7f501effd640 1 -- 172.21.15.133:0/1713701927 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f50180ebbf0 con 0x7f50280c4100 2023-12-19T18:58:57.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.772+0000 7f50303c1640 1 -- 172.21.15.133:0/1713701927 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f502814db30 con 0x7f50280c4100 2023-12-19T18:58:57.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.776+0000 7f501effd640 1 -- 172.21.15.133:0/1713701927 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f501811ce60 con 0x7f50280c4100 2023-12-19T18:58:57.780 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:57.780 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:44.402984+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:58:40.991408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T18:58:41.773992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:58:57.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.776+0000 7f50303c1640 1 -- 172.21.15.133:0/1713701927 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f500c066470 msgr2=0x7f500c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:57.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.776+0000 7f50303c1640 1 --2- 172.21.15.133:0/1713701927 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f500c066470 0x7f500c068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5024000f70 tx=0x7f5024007e50 comp rx=0 tx=0).stop 2023-12-19T18:58:57.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.776+0000 7f50303c1640 1 -- 172.21.15.133:0/1713701927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50280c4100 msgr2=0x7f50281ec510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:57.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.776+0000 7f50303c1640 1 --2- 172.21.15.133:0/1713701927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50280c4100 0x7f50281ec510 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f50180097c0 tx=0x7f501801aba0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.776+0000 7f50303c1640 1 -- 172.21.15.133:0/1713701927 shutdown_connections 2023-12-19T18:58:57.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.776+0000 7f50303c1640 1 --2- 172.21.15.133:0/1713701927 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f500c066470 0x7f500c068930 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.776+0000 7f50303c1640 1 --2- 172.21.15.133:0/1713701927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f50280c63c0 0x7f5028153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.776+0000 7f50303c1640 1 --2- 172.21.15.133:0/1713701927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f50280c4100 0x7f50281ec510 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.776+0000 7f50303c1640 1 --2- 172.21.15.133:0/1713701927 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f50280c06d0 0x7f50281ebfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.776+0000 7f50303c1640 1 -- 172.21.15.133:0/1713701927 >> 172.21.15.133:0/1713701927 conn(0x7f502806a5b0 msgr2=0x7f50280a6f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:57.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.776+0000 7f50303c1640 1 -- 172.21.15.133:0/1713701927 shutdown_connections 2023-12-19T18:58:57.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.776+0000 7f50303c1640 1 -- 172.21.15.133:0/1713701927 wait complete. 2023-12-19T18:58:57.800 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:58:57.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.932+0000 7ff62a0fe640 1 Processor -- start 2023-12-19T18:58:57.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.932+0000 7ff62a0fe640 1 -- start start 2023-12-19T18:58:57.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff62a0fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff6240c5c60 0x7ff6240c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:57.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff62a0fe640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6240c3bd0 con 0x7ff6241561f0 2023-12-19T18:58:57.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff62a0fe640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6240bf1e0 con 0x7ff6240a5240 2023-12-19T18:58:57.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff62a0fe640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6240c3e20 con 0x7ff6240c5c60 2023-12-19T18:58:57.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff623fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff6241561f0 0x7ff624156640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41124/0 (socket says 172.21.15.133:41124) 2023-12-19T18:58:57.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff623fff640 1 -- 172.21.15.133:0/2528819037 learned_addr learned my addr 172.21.15.133:0/2528819037 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:58:57.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff622ffd640 1 --2- 172.21.15.133:0/2528819037 >> v2:172.21.15.138:3300/0 conn(0x7ff6240c5c60 0x7ff6240c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:57.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff6227fc640 1 -- 172.21.15.133:0/2528819037 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471997754 0 0) 0x7ff6240c3bd0 con 0x7ff6241561f0 2023-12-19T18:58:57.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff6227fc640 1 -- 172.21.15.133:0/2528819037 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff60c003530 con 0x7ff6241561f0 2023-12-19T18:58:57.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff6227fc640 1 -- 172.21.15.133:0/2528819037 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1213877754 0 0) 0x7ff60c003530 con 0x7ff6241561f0 2023-12-19T18:58:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff6227fc640 1 -- 172.21.15.133:0/2528819037 >> v2:172.21.15.138:3300/0 conn(0x7ff6240c5c60 msgr2=0x7ff6240c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff6227fc640 1 --2- 172.21.15.133:0/2528819037 >> v2:172.21.15.138:3300/0 conn(0x7ff6240c5c60 0x7ff6240c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff6227fc640 1 -- 172.21.15.133:0/2528819037 >> v1:172.21.15.138:6789/0 conn(0x7ff6240a5240 legacy=0x7ff6240bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff6227fc640 1 -- 172.21.15.133:0/2528819037 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6240c4100 con 0x7ff6241561f0 2023-12-19T18:58:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff6227fc640 1 -- 172.21.15.133:0/2528819037 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7ff61c001a00 con 0x7ff6241561f0 2023-12-19T18:58:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff6227fc640 1 -- 172.21.15.133:0/2528819037 >> v1:172.21.15.133:6789/0 conn(0x7ff6241561f0 legacy=0x7ff624156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff6227fc640 1 --2- 172.21.15.133:0/2528819037 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff60c003980 0x7ff60c003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff6227fc640 1 --2- 172.21.15.133:0/2528819037 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c004380 0x7ff60c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff6227fc640 1 --2- 172.21.15.133:0/2528819037 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff60c0050f0 0x7ff60c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff6227fc640 1 -- 172.21.15.133:0/2528819037 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6240c3e20 con 0x7ff60c004380 2023-12-19T18:58:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff6227fc640 1 -- 172.21.15.133:0/2528819037 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c00c030 con 0x7ff60c0050f0 2023-12-19T18:58:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff6227fc640 1 -- 172.21.15.133:0/2528819037 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c00c1f0 con 0x7ff60c003980 2023-12-19T18:58:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff622ffd640 1 --2- 172.21.15.133:0/2528819037 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c004380 0x7ff60c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:57.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff6237fe640 1 --2- 172.21.15.133:0/2528819037 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff60c003980 0x7ff60c003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:57.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff623fff640 1 --2- 172.21.15.133:0/2528819037 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff60c0050f0 0x7ff60c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:57.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff622ffd640 1 -- 172.21.15.133:0/2528819037 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff60c003980 msgr2=0x7ff60c003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:57.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff622ffd640 1 --2- 172.21.15.133:0/2528819037 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff60c003980 0x7ff60c003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff622ffd640 1 -- 172.21.15.133:0/2528819037 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff60c0050f0 msgr2=0x7ff60c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:57.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff622ffd640 1 --2- 172.21.15.133:0/2528819037 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff60c0050f0 0x7ff60c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff622ffd640 1 -- 172.21.15.133:0/2528819037 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c003530 con 0x7ff60c004380 2023-12-19T18:58:57.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff623fff640 1 --2- 172.21.15.133:0/2528819037 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff60c0050f0 0x7ff60c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:57.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.936+0000 7ff623fff640 1 -- 172.21.15.133:0/2528819037 reap_dead start 2023-12-19T18:58:57.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.940+0000 7ff622ffd640 1 --2- 172.21.15.133:0/2528819037 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c004380 0x7ff60c004850 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff618009ae0 tx=0x7ff61801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afb40e1ded4c4a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:57.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.940+0000 7ff6227fc640 1 -- 172.21.15.133:0/2528819037 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6180a5640 con 0x7ff60c004380 2023-12-19T18:58:57.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.940+0000 7ff6227fc640 1 -- 172.21.15.133:0/2528819037 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6180a57a0 con 0x7ff60c004380 2023-12-19T18:58:57.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.940+0000 7ff6227fc640 1 -- 172.21.15.133:0/2528819037 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6180a5b50 con 0x7ff60c004380 2023-12-19T18:58:57.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.940+0000 7ff62a0fe640 1 -- 172.21.15.133:0/2528819037 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c004380 msgr2=0x7ff60c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.940+0000 7ff62a0fe640 1 --2- 172.21.15.133:0/2528819037 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c004380 0x7ff60c004850 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff618009ae0 tx=0x7ff61801ca50 comp rx=0 tx=0).stop 2023-12-19T18:58:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.940+0000 7ff62a0fe640 1 -- 172.21.15.133:0/2528819037 shutdown_connections 2023-12-19T18:58:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.940+0000 7ff62a0fe640 1 --2- 172.21.15.133:0/2528819037 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c004380 0x7ff60c004850 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.940+0000 7ff62a0fe640 1 -- 172.21.15.133:0/2528819037 >> 172.21.15.133:0/2528819037 conn(0x7ff62406a5b0 msgr2=0x7ff62406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.940+0000 7ff62a0fe640 1 -- 172.21.15.133:0/2528819037 shutdown_connections 2023-12-19T18:58:57.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.940+0000 7ff62a0fe640 1 -- 172.21.15.133:0/2528819037 wait complete. 2023-12-19T18:58:57.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.940+0000 7ff62a0fe640 1 Processor -- start 2023-12-19T18:58:57.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.940+0000 7ff62a0fe640 1 -- start start 2023-12-19T18:58:57.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.944+0000 7ff62a0fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c004380 0x7ff62409a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:57.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.944+0000 7ff62a0fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff624099a70 0x7ff6240c1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:57.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.944+0000 7ff62a0fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6241ed6d0 0x7ff6241edb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:57.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.944+0000 7ff62a0fe640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6240c11e0 con 0x7ff60c004380 2023-12-19T18:58:57.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.944+0000 7ff62a0fe640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6241ee160 con 0x7ff624099a70 2023-12-19T18:58:57.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.944+0000 7ff62a0fe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6240c3050 con 0x7ff6241ed6d0 2023-12-19T18:58:57.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.944+0000 7ff6237fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c004380 0x7ff62409a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:57.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.944+0000 7ff6237fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c004380 0x7ff62409a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33946/0 (socket says 172.21.15.133:33946) 2023-12-19T18:58:57.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.944+0000 7ff6237fe640 1 -- 172.21.15.133:0/1533535274 learned_addr learned my addr 172.21.15.133:0/1533535274 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:57.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.944+0000 7ff6237fe640 1 -- 172.21.15.133:0/1533535274 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6241ed6d0 msgr2=0x7ff6241edb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:57.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.944+0000 7ff6237fe640 1 --2- 172.21.15.133:0/1533535274 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6241ed6d0 0x7ff6241edb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.944+0000 7ff6237fe640 1 -- 172.21.15.133:0/1533535274 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff624099a70 msgr2=0x7ff6240c1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:57.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.944+0000 7ff6237fe640 1 --2- 172.21.15.133:0/1533535274 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff624099a70 0x7ff6240c1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:57.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.944+0000 7ff6237fe640 1 -- 172.21.15.133:0/1533535274 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6240c3330 con 0x7ff60c004380 2023-12-19T18:58:57.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.944+0000 7ff6237fe640 1 --2- 172.21.15.133:0/1533535274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c004380 0x7ff62409a590 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff6140115b0 tx=0x7ff614011a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.944+0000 7ff60bfff640 1 -- 172.21.15.133:0/1533535274 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614015820 con 0x7ff60c004380 2023-12-19T18:58:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.944+0000 7ff60bfff640 1 -- 172.21.15.133:0/1533535274 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff614015980 con 0x7ff60c004380 2023-12-19T18:58:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.944+0000 7ff60bfff640 1 -- 172.21.15.133:0/1533535274 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614015d30 con 0x7ff60c004380 2023-12-19T18:58:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.944+0000 7ff62a0fe640 1 -- 172.21.15.133:0/1533535274 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6240c1430 con 0x7ff60c004380 2023-12-19T18:58:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.944+0000 7ff62a0fe640 1 -- 172.21.15.133:0/1533535274 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6240c2320 con 0x7ff60c004380 2023-12-19T18:58:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.944+0000 7ff62a0fe640 1 -- 172.21.15.133:0/1533535274 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6240c3570 con 0x7ff60c004380 2023-12-19T18:58:57.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.944+0000 7ff60bfff640 1 -- 172.21.15.133:0/1533535274 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff614013390 con 0x7ff60c004380 2023-12-19T18:58:57.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.948+0000 7ff60bfff640 1 --2- 172.21.15.133:0/1533535274 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff6100664f0 0x7ff6100689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:57.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.948+0000 7ff60bfff640 1 -- 172.21.15.133:0/1533535274 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff614086c00 con 0x7ff60c004380 2023-12-19T18:58:57.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.948+0000 7ff622ffd640 1 --2- 172.21.15.133:0/1533535274 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff6100664f0 0x7ff6100689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:57.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.948+0000 7ff622ffd640 1 --2- 172.21.15.133:0/1533535274 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff6100664f0 0x7ff6100689b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff6180af000 tx=0x7ff618008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:57.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:57.952+0000 7ff60bfff640 1 -- 172.21.15.133:0/1533535274 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff6140540f0 con 0x7ff60c004380 2023-12-19T18:58:58.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.132+0000 7ff62a0fe640 1 -- 172.21.15.133:0/1533535274 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff624068400 con 0x7ff60c004380 2023-12-19T18:58:58.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.132+0000 7ff60bfff640 1 -- 172.21.15.133:0/1533535274 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7ff614057710 con 0x7ff60c004380 2023-12-19T18:58:58.135 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:58:58.136 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6836/2938414361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":2938414361},{"type":"v1","addr":"172.21.15.138:6836","nonce":2938414361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/4017805684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6835","nonce":4017805684},{"type":"v1","addr":"172.21.15.138:6837","nonce":4017805684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/1350101028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1350101028},{"type":"v1","addr":"172.21.15.133:6834","nonce":1350101028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:58:42.786720+0000","modified":"2023-12-19T18:58:46.003120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/615053717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":615053717},{"type":"v1","addr":"172.21.15.133:6835","nonce":615053717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T18:58:58.136 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 8 2023-12-19T18:58:58.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.132+0000 7ff62a0fe640 1 -- 172.21.15.133:0/1533535274 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff6100664f0 msgr2=0x7ff6100689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:58.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.132+0000 7ff62a0fe640 1 --2- 172.21.15.133:0/1533535274 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff6100664f0 0x7ff6100689b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff6180af000 tx=0x7ff618008040 comp rx=0 tx=0).stop 2023-12-19T18:58:58.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.132+0000 7ff62a0fe640 1 -- 172.21.15.133:0/1533535274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c004380 msgr2=0x7ff62409a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:58.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.132+0000 7ff62a0fe640 1 --2- 172.21.15.133:0/1533535274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c004380 0x7ff62409a590 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff6140115b0 tx=0x7ff614011a70 comp rx=0 tx=0).stop 2023-12-19T18:58:58.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.132+0000 7ff62a0fe640 1 -- 172.21.15.133:0/1533535274 shutdown_connections 2023-12-19T18:58:58.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.132+0000 7ff62a0fe640 1 --2- 172.21.15.133:0/1533535274 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff6100664f0 0x7ff6100689b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.132+0000 7ff62a0fe640 1 --2- 172.21.15.133:0/1533535274 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6241ed6d0 0x7ff6241edb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.132+0000 7ff62a0fe640 1 --2- 172.21.15.133:0/1533535274 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff624099a70 0x7ff6240c1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.132+0000 7ff62a0fe640 1 --2- 172.21.15.133:0/1533535274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff60c004380 0x7ff62409a590 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.132+0000 7ff62a0fe640 1 -- 172.21.15.133:0/1533535274 >> 172.21.15.133:0/1533535274 conn(0x7ff62406a5b0 msgr2=0x7ff624071e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:58.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.132+0000 7ff62a0fe640 1 -- 172.21.15.133:0/1533535274 shutdown_connections 2023-12-19T18:58:58.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.132+0000 7ff62a0fe640 1 -- 172.21.15.133:0/1533535274 wait complete. 2023-12-19T18:58:58.559 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T18:58:42.786720+0000', 'modified': '2023-12-19T18:58:46.003120+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6835/615053717', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6833', 'nonce': 615053717}, {'type': 'v1', 'addr': '172.21.15.133:6835', 'nonce': 615053717}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T18:58:58.559 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T18:58:58.559 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-19T18:58:58.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.696+0000 7f9be731e640 1 Processor -- start 2023-12-19T18:58:58.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.696+0000 7f9be731e640 1 -- start start 2023-12-19T18:58:58.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.696+0000 7f9be731e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9be0151cd0 0x7f9be00ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:58.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.696+0000 7f9be731e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9be0154be0 0x7f9be015ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:58.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.696+0000 7f9be731e640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be00c8160 con 0x7f9be00c7c50 2023-12-19T18:58:58.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.696+0000 7f9be731e640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be0157b40 con 0x7f9be0154be0 2023-12-19T18:58:58.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.696+0000 7f9be731e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be0157e20 con 0x7f9be0151cd0 2023-12-19T18:58:58.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.696+0000 7f9be6b1d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9be0154be0 0x7f9be015ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:58.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.696+0000 7f9be6b1d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9be0154be0 0x7f9be015ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33960/0 (socket says 172.21.15.133:33960) 2023-12-19T18:58:58.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.696+0000 7f9be6b1d640 1 -- 172.21.15.133:0/2737167977 learned_addr learned my addr 172.21.15.133:0/2737167977 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:58.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.696+0000 7f9be631c640 1 --2- 172.21.15.133:0/2737167977 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9be0151cd0 0x7f9be00ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:58.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.696+0000 7f9be6b1d640 1 -- 172.21.15.133:0/2737167977 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9be0151cd0 msgr2=0x7f9be00ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:58.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.696+0000 7f9be6b1d640 1 --2- 172.21.15.133:0/2737167977 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9be0151cd0 0x7f9be00ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.696+0000 7f9be6b1d640 1 -- 172.21.15.133:0/2737167977 >> v1:172.21.15.138:6789/0 conn(0x7f9be00c7c50 legacy=0x7f9be01544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:58.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.696+0000 7f9be6b1d640 1 -- 172.21.15.133:0/2737167977 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be0158100 con 0x7f9be0154be0 2023-12-19T18:58:58.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.696+0000 7f9be631c640 1 --2- 172.21.15.133:0/2737167977 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9be0151cd0 0x7f9be00ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:58.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.700+0000 7f9be6b1d640 1 --2- 172.21.15.133:0/2737167977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9be0154be0 0x7f9be015ee30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8009e50 tx=0x7f9bd801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53fe98e98fd90cc0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:58.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.700+0000 7f9be531a640 1 -- 172.21.15.133:0/2737167977 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd80a58d0 con 0x7f9be0154be0 2023-12-19T18:58:58.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.700+0000 7f9be531a640 1 -- 172.21.15.133:0/2737167977 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd80a5a30 con 0x7f9be0154be0 2023-12-19T18:58:58.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.700+0000 7f9be531a640 1 -- 172.21.15.133:0/2737167977 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd80a5dc0 con 0x7f9be0154be0 2023-12-19T18:58:58.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.700+0000 7f9be731e640 1 -- 172.21.15.133:0/2737167977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9be0154be0 msgr2=0x7f9be015ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:58.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.700+0000 7f9be731e640 1 --2- 172.21.15.133:0/2737167977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9be0154be0 0x7f9be015ee30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8009e50 tx=0x7f9bd801c9e0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.700+0000 7f9be731e640 1 -- 172.21.15.133:0/2737167977 shutdown_connections 2023-12-19T18:58:58.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.700+0000 7f9be731e640 1 --2- 172.21.15.133:0/2737167977 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9be0154be0 0x7f9be015ee30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.700+0000 7f9be731e640 1 --2- 172.21.15.133:0/2737167977 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9be0151cd0 0x7f9be00ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.700+0000 7f9be731e640 1 -- 172.21.15.133:0/2737167977 >> 172.21.15.133:0/2737167977 conn(0x7f9be00abee0 msgr2=0x7f9be00c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:58.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.700+0000 7f9be731e640 1 -- 172.21.15.133:0/2737167977 shutdown_connections 2023-12-19T18:58:58.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.700+0000 7f9be731e640 1 -- 172.21.15.133:0/2737167977 wait complete. 2023-12-19T18:58:58.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9be731e640 1 Processor -- start 2023-12-19T18:58:58.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9be731e640 1 -- start start 2023-12-19T18:58:58.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9be731e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9be00c7c50 0x7f9be0146570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:58.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9be731e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9be0151cd0 0x7f9be0156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:58.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9be731e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9be0154be0 0x7f9be0154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:58.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9be731e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be00aa9f0 con 0x7f9be00c7c50 2023-12-19T18:58:58.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9be731e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be0152650 con 0x7f9be0151cd0 2023-12-19T18:58:58.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9be731e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be0143e70 con 0x7f9be0154be0 2023-12-19T18:58:58.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9be631c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9be00c7c50 0x7f9be0146570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:58.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9be631c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9be00c7c50 0x7f9be0146570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33968/0 (socket says 172.21.15.133:33968) 2023-12-19T18:58:58.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9be631c640 1 -- 172.21.15.133:0/1828268266 learned_addr learned my addr 172.21.15.133:0/1828268266 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:58.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9be631c640 1 -- 172.21.15.133:0/1828268266 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9be0154be0 msgr2=0x7f9be0154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:58.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9be631c640 1 --2- 172.21.15.133:0/1828268266 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9be0154be0 0x7f9be0154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9be5b1b640 1 --2- 172.21.15.133:0/1828268266 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9be0151cd0 0x7f9be0156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:58.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9be631c640 1 -- 172.21.15.133:0/1828268266 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9be0151cd0 msgr2=0x7f9be0156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:58.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9be631c640 1 --2- 172.21.15.133:0/1828268266 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9be0151cd0 0x7f9be0156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9be631c640 1 -- 172.21.15.133:0/1828268266 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd8009b30 con 0x7f9be00c7c50 2023-12-19T18:58:58.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9be5b1b640 1 --2- 172.21.15.133:0/1828268266 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9be0151cd0 0x7f9be0156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:58.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9be631c640 1 --2- 172.21.15.133:0/1828268266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9be00c7c50 0x7f9be0146570 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00e840 tx=0x7f9bdc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:58.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9bd6ffd640 1 -- 172.21.15.133:0/1828268266 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc00c8d0 con 0x7f9be00c7c50 2023-12-19T18:58:58.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9bd6ffd640 1 -- 172.21.15.133:0/1828268266 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc00ca30 con 0x7f9be00c7c50 2023-12-19T18:58:58.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9bd6ffd640 1 -- 172.21.15.133:0/1828268266 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc00cdc0 con 0x7f9be00c7c50 2023-12-19T18:58:58.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9be731e640 1 -- 172.21.15.133:0/1828268266 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be00aa3c0 con 0x7f9be00c7c50 2023-12-19T18:58:58.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.704+0000 7f9be731e640 1 -- 172.21.15.133:0/1828268266 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be01eda80 con 0x7f9be00c7c50 2023-12-19T18:58:58.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.708+0000 7f9bd6ffd640 1 -- 172.21.15.133:0/1828268266 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9bdc013410 con 0x7f9be00c7c50 2023-12-19T18:58:58.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.708+0000 7f9bd6ffd640 1 --2- 172.21.15.133:0/1828268266 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9bc40664a0 0x7f9bc4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:58.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.708+0000 7f9beb8e4000 1 Processor -- start 2023-12-19T18:58:58.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.708+0000 7f9bd6ffd640 1 -- 172.21.15.133:0/1828268266 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9bdc055470 con 0x7f9be00c7c50 2023-12-19T18:58:58.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.708+0000 7f9be5b1b640 1 --2- 172.21.15.133:0/1828268266 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9bc40664a0 0x7f9bc4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:58.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.708+0000 7f9beb8e4000 1 -- start start 2023-12-19T18:58:58.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.708+0000 7f9be5b1b640 1 --2- 172.21.15.133:0/1828268266 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9bc40664a0 0x7f9bc4068960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9be0146ab0 tx=0x7f9bd0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:58.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.708+0000 7f9beb8e4000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1650 0x55b432fc1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:58.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.708+0000 7f9beb8e4000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b432fc1f70 0x55b432fc2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:58.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.708+0000 7f9beb8e4000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b432fc2890 0x55b43300bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:58.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.708+0000 7f9beb8e4000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432e8bf00 con 0x55b432fc1650 2023-12-19T18:58:58.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.708+0000 7f9beb8e4000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432e1bdd0 con 0x55b432fc2890 2023-12-19T18:58:58.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.708+0000 7f9beb8e4000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b432e19300 con 0x55b432fc1f70 2023-12-19T18:58:58.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.708+0000 7f9be631c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1650 0x55b432fc1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:58.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.708+0000 7f9be631c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1650 0x55b432fc1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33982/0 (socket says 172.21.15.133:33982) 2023-12-19T18:58:58.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.708+0000 7f9be631c640 1 -- 172.21.15.133:0/1628377125 learned_addr learned my addr 172.21.15.133:0/1628377125 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:58.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.708+0000 7f9be5b1b640 1 --2- 172.21.15.133:0/1628377125 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b432fc1f70 0x55b432fc2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:58.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.708+0000 7f9be6b1d640 1 --2- 172.21.15.133:0/1628377125 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b432fc2890 0x55b43300bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:58.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9be631c640 1 -- 172.21.15.133:0/1628377125 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b432fc1f70 msgr2=0x55b432fc2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:58.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9be631c640 1 --2- 172.21.15.133:0/1628377125 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b432fc1f70 0x55b432fc2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9be631c640 1 -- 172.21.15.133:0/1628377125 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b432fc2890 msgr2=0x55b43300bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:58.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9be631c640 1 --2- 172.21.15.133:0/1628377125 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b432fc2890 0x55b43300bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9be631c640 1 -- 172.21.15.133:0/1628377125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b432b0c890 con 0x55b432fc1650 2023-12-19T18:58:58.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9be631c640 1 --2- 172.21.15.133:0/1628377125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1650 0x55b432fc1a30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc014e20 tx=0x7f9bdc054d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87e501c1784da3d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:58.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9bc3fff640 1 -- 172.21.15.133:0/1628377125 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc05d070 con 0x55b432fc1650 2023-12-19T18:58:58.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9bc3fff640 1 -- 172.21.15.133:0/1628377125 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc058030 con 0x55b432fc1650 2023-12-19T18:58:58.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9bc3fff640 1 -- 172.21.15.133:0/1628377125 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc051480 con 0x55b432fc1650 2023-12-19T18:58:58.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9beb8e4000 1 -- 172.21.15.133:0/1628377125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1650 msgr2=0x55b432fc1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:58.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9beb8e4000 1 --2- 172.21.15.133:0/1628377125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1650 0x55b432fc1a30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc014e20 tx=0x7f9bdc054d70 comp rx=0 tx=0).stop 2023-12-19T18:58:58.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9beb8e4000 1 -- 172.21.15.133:0/1628377125 shutdown_connections 2023-12-19T18:58:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9beb8e4000 1 --2- 172.21.15.133:0/1628377125 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b432fc2890 0x55b43300bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9beb8e4000 1 --2- 172.21.15.133:0/1628377125 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b432fc1f70 0x55b432fc2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9beb8e4000 1 --2- 172.21.15.133:0/1628377125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1650 0x55b432fc1a30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9beb8e4000 1 -- 172.21.15.133:0/1628377125 >> 172.21.15.133:0/1628377125 conn(0x55b432fca2f0 msgr2=0x55b433001b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9beb8e4000 1 -- 172.21.15.133:0/1628377125 shutdown_connections 2023-12-19T18:58:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9beb8e4000 1 -- 172.21.15.133:0/1628377125 wait complete. 2023-12-19T18:58:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9beb8e4000 1 -- start start 2023-12-19T18:58:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9beb8e4000 1 Processor -- start 2023-12-19T18:58:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9beb8e4000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b432fc1650 0x55b432fc6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:58.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9beb8e4000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1f70 0x55b432fc6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:58.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9beb8e4000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b432fc2890 0x55b432fc6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:58.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9beb8e4000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432e14bf0 con 0x55b432fc1f70 2023-12-19T18:58:58.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9beb8e4000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432dccc60 con 0x55b432fc1650 2023-12-19T18:58:58.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9beb8e4000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b432dd2b00 con 0x55b432fc2890 2023-12-19T18:58:58.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9beb8e4000 10 client.0 _ll_register_callbacks cb 0x55b432faf710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:58:58.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9be5b1b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1f70 0x55b432fc6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:58.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9be5b1b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1f70 0x55b432fc6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33984/0 (socket says 172.21.15.133:33984) 2023-12-19T18:58:58.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9be631c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b432fc1650 0x55b432fc6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:58.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9be5b1b640 1 -- 172.21.15.133:0/3606561901 learned_addr learned my addr 172.21.15.133:0/3606561901 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:58.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.712+0000 7f9be6b1d640 1 --2- 172.21.15.133:0/3606561901 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b432fc2890 0x55b432fc6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:58.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9be5b1b640 1 -- 172.21.15.133:0/3606561901 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b432fc2890 msgr2=0x55b432fc6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:58.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9be5b1b640 1 --2- 172.21.15.133:0/3606561901 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b432fc2890 0x55b432fc6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9be5b1b640 1 -- 172.21.15.133:0/3606561901 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b432fc1650 msgr2=0x55b432fc6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:58.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9be5b1b640 1 --2- 172.21.15.133:0/3606561901 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b432fc1650 0x55b432fc6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9be5b1b640 1 -- 172.21.15.133:0/3606561901 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be01eda80 con 0x55b432fc1f70 2023-12-19T18:58:58.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9be5b1b640 1 --2- 172.21.15.133:0/3606561901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1f70 0x55b432fc6940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9bd000dd50 tx=0x7f9bd0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12c5c543211ca346 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:58.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9bc17fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-19T18:58:58.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9bc17fa640 1 -- 172.21.15.133:0/3606561901 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0007030 con 0x55b432fc1f70 2023-12-19T18:58:58.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9bc17fa640 1 -- 172.21.15.133:0/3606561901 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9bd0007190 con 0x55b432fc1f70 2023-12-19T18:58:58.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9beb8e4000 1 -- 172.21.15.133:0/3606561901 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b432dd2490 con 0x55b432fc1f70 2023-12-19T18:58:58.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9bc17fa640 1 -- 172.21.15.133:0/3606561901 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bd0007350 con 0x55b432fc1f70 2023-12-19T18:58:58.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9beb8e4000 10 client.4647 fetch_fsmap learned FSMap version 8 2023-12-19T18:58:58.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9beb8e4000 1 -- 172.21.15.133:0/3606561901 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55b432dd5200 con 0x55b432fc1f70 2023-12-19T18:58:58.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9bc17fa640 1 -- 172.21.15.133:0/3606561901 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b432dd2490 con 0x55b432fc1f70 2023-12-19T18:58:58.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9bc17fa640 1 -- 172.21.15.133:0/3606561901 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9bd00074b0 con 0x55b432fc1f70 2023-12-19T18:58:58.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9beb8e4000 10 client.4647 fetch_fsmap finished waiting for FSMap version 8 2023-12-19T18:58:58.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9beb8e4000 10 client.4647 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T18:58:58.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9beb8e4000 20 client.4647 populate_metadata read hostname 'smithi133' 2023-12-19T18:58:58.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9beb8e4000 1 --2- 172.21.15.133:0/3606561901 >> [v2:172.21.15.133:6833/615053717,v1:172.21.15.133:6835/615053717] conn(0x55b433014140 0x55b433016530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:58.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9beb8e4000 4 client.4647 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-19T18:58:58.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9beb8e4000 1 -- 172.21.15.133:0/3606561901 --> [v2:172.21.15.133:6833/615053717,v1:172.21.15.133:6835/615053717] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b432e13540 con 0x55b433014140 2023-12-19T18:58:58.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9be631c640 1 --2- 172.21.15.133:0/3606561901 >> [v2:172.21.15.133:6833/615053717,v1:172.21.15.133:6835/615053717] conn(0x55b433014140 0x55b433016530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:58.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9bc17fa640 10 client.4647 ms_handle_connect on v2:172.21.15.133:6833/615053717 2023-12-19T18:58:58.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9be631c640 1 --2- 172.21.15.133:0/3606561901 >> [v2:172.21.15.133:6833/615053717,v1:172.21.15.133:6835/615053717] conn(0x55b433014140 0x55b433016530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b9711e6c7d6ccea server_cookie=f79af9c2e09ecb7c in_seq=0 out_seq=0 2023-12-19T18:58:58.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9bc17fa640 1 -- 172.21.15.133:0/3606561901 <== mds.0 v2:172.21.15.133:6833/615053717 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55b432e13540 con 0x55b433014140 2023-12-19T18:58:58.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9bc17fa640 10 client.4647 handle_command_reply: tid=0 2023-12-19T18:58:58.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9beb8e4000 1 client.4647 shutdown 2023-12-19T18:58:58.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9beb8e4000 1 -- 172.21.15.133:0/3606561901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1f70 msgr2=0x55b432fc6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:58.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9beb8e4000 1 --2- 172.21.15.133:0/3606561901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1f70 0x55b432fc6940 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9bd000dd50 tx=0x7f9bd0000ee0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9beb8e4000 1 -- 172.21.15.133:0/3606561901 shutdown_connections 2023-12-19T18:58:58.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9beb8e4000 1 --2- 172.21.15.133:0/3606561901 >> [v2:172.21.15.133:6833/615053717,v1:172.21.15.133:6835/615053717] conn(0x55b433014140 0x55b433016530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9beb8e4000 1 --2- 172.21.15.133:0/3606561901 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b432fc2890 0x55b432fc6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9beb8e4000 1 --2- 172.21.15.133:0/3606561901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1f70 0x55b432fc6940 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9beb8e4000 1 --2- 172.21.15.133:0/3606561901 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b432fc1650 0x55b432fc6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9beb8e4000 1 -- 172.21.15.133:0/3606561901 >> 172.21.15.133:0/3606561901 conn(0x55b432fca2f0 msgr2=0x55b432fc0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:58.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9bc17fa640 0 client.4647 ms_handle_reset on v2:172.21.15.133:6833/615053717 2023-12-19T18:58:58.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9beb8e4000 1 -- 172.21.15.133:0/3606561901 shutdown_connections 2023-12-19T18:58:58.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9beb8e4000 1 -- 172.21.15.133:0/3606561901 wait complete. 2023-12-19T18:58:58.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.716+0000 7f9beb8e4000 20 client.4647 trim_cache size 0 max 16384 2023-12-19T18:58:58.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.732+0000 7f9beb8e4000 1 Processor -- start 2023-12-19T18:58:58.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.732+0000 7f9beb8e4000 1 -- start start 2023-12-19T18:58:58.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.732+0000 7f9beb8e4000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b432fc1650 0x55b43305e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:58.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.732+0000 7f9beb8e4000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1f70 0x55b43305e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:58.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.732+0000 7f9beb8e4000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b432fc2890 0x55b43305edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:58.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.732+0000 7f9beb8e4000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432acd940 con 0x55b432fc1f70 2023-12-19T18:58:58.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.732+0000 7f9beb8e4000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432e13a80 con 0x55b432fc1650 2023-12-19T18:58:58.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.732+0000 7f9beb8e4000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b432e0eef0 con 0x55b432fc2890 2023-12-19T18:58:58.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.732+0000 7f9be5b1b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1f70 0x55b43305e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:58.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.732+0000 7f9be5b1b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1f70 0x55b43305e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33992/0 (socket says 172.21.15.133:33992) 2023-12-19T18:58:58.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.732+0000 7f9be5b1b640 1 -- 172.21.15.133:0/4053067656 learned_addr learned my addr 172.21.15.133:0/4053067656 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:58.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9be6b1d640 1 --2- 172.21.15.133:0/4053067656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b432fc2890 0x55b43305edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:58.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9be631c640 1 --2- 172.21.15.133:0/4053067656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b432fc1650 0x55b43305e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:58.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9be5b1b640 1 -- 172.21.15.133:0/4053067656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b432fc2890 msgr2=0x55b43305edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:58.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9be5b1b640 1 --2- 172.21.15.133:0/4053067656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b432fc2890 0x55b43305edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9be5b1b640 1 -- 172.21.15.133:0/4053067656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b432fc1650 msgr2=0x55b43305e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:58.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9be5b1b640 1 --2- 172.21.15.133:0/4053067656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b432fc1650 0x55b43305e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9be5b1b640 1 -- 172.21.15.133:0/4053067656 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b432dbb500 con 0x55b432fc1f70 2023-12-19T18:58:58.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9be5b1b640 1 --2- 172.21.15.133:0/4053067656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1f70 0x55b43305e890 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9bd000d5f0 tx=0x7f9bd001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a2edc398c3f7ed1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:58.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9bd4ff9640 1 -- 172.21.15.133:0/4053067656 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0037630 con 0x55b432fc1f70 2023-12-19T18:58:58.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9bd4ff9640 1 -- 172.21.15.133:0/4053067656 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd0037790 con 0x55b432fc1f70 2023-12-19T18:58:58.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9bd4ff9640 1 -- 172.21.15.133:0/4053067656 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0037b00 con 0x55b432fc1f70 2023-12-19T18:58:58.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9beb8e4000 1 -- 172.21.15.133:0/4053067656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1f70 msgr2=0x55b43305e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:58.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9beb8e4000 1 --2- 172.21.15.133:0/4053067656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1f70 0x55b43305e890 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9bd000d5f0 tx=0x7f9bd001e000 comp rx=0 tx=0).stop 2023-12-19T18:58:58.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9beb8e4000 1 -- 172.21.15.133:0/4053067656 shutdown_connections 2023-12-19T18:58:58.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9beb8e4000 1 --2- 172.21.15.133:0/4053067656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b432fc2890 0x55b43305edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9beb8e4000 1 --2- 172.21.15.133:0/4053067656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1f70 0x55b43305e890 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9beb8e4000 1 --2- 172.21.15.133:0/4053067656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b432fc1650 0x55b43305e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9beb8e4000 1 -- 172.21.15.133:0/4053067656 >> 172.21.15.133:0/4053067656 conn(0x55b432fca2f0 msgr2=0x55b432ffd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:58.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9beb8e4000 1 -- 172.21.15.133:0/4053067656 shutdown_connections 2023-12-19T18:58:58.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9beb8e4000 1 -- 172.21.15.133:0/4053067656 wait complete. 2023-12-19T18:58:58.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9beb8e4000 1 -- start start 2023-12-19T18:58:58.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9beb8e4000 1 Processor -- start 2023-12-19T18:58:58.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9beb8e4000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1650 0x55b4330627f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:58.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9beb8e4000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b432fc1f70 0x55b433062d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:58.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9beb8e4000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b432fc2890 0x55b433063830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:58.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9beb8e4000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432e10560 con 0x55b432fc1650 2023-12-19T18:58:58.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9beb8e4000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432ffeda0 con 0x55b432fc1f70 2023-12-19T18:58:58.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9beb8e4000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b432deacd0 con 0x55b432fc2890 2023-12-19T18:58:58.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9beb8e4000 10 client.0 _ll_register_callbacks cb 0x55b432f8ff60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:58:58.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9be631c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1650 0x55b4330627f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:58.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9be631c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1650 0x55b4330627f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34002/0 (socket says 172.21.15.133:34002) 2023-12-19T18:58:58.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9be631c640 1 -- 172.21.15.133:0/2148477822 learned_addr learned my addr 172.21.15.133:0/2148477822 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:58.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9be6b1d640 1 --2- 172.21.15.133:0/2148477822 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b432fc2890 0x55b433063830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:58.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9be5b1b640 1 --2- 172.21.15.133:0/2148477822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b432fc1f70 0x55b433062d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:58.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9be631c640 1 -- 172.21.15.133:0/2148477822 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b432fc2890 msgr2=0x55b433063830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:58.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9be631c640 1 --2- 172.21.15.133:0/2148477822 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b432fc2890 0x55b433063830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9be631c640 1 -- 172.21.15.133:0/2148477822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b432fc1f70 msgr2=0x55b433062d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:58.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.736+0000 7f9be631c640 1 --2- 172.21.15.133:0/2148477822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b432fc1f70 0x55b433062d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9be631c640 1 -- 172.21.15.133:0/2148477822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b432dd5200 con 0x55b432fc1650 2023-12-19T18:58:58.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9be5b1b640 1 --2- 172.21.15.133:0/2148477822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b432fc1f70 0x55b433062d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:58:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9be631c640 1 --2- 172.21.15.133:0/2148477822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1650 0x55b4330627f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc059080 tx=0x7f9bdc0046b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d81123cb3ac9e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9bc17fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-19T18:58:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9bc17fa640 1 -- 172.21.15.133:0/2148477822 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc054b80 con 0x55b432fc1650 2023-12-19T18:58:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9bc17fa640 1 -- 172.21.15.133:0/2148477822 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9bdc071070 con 0x55b432fc1650 2023-12-19T18:58:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9beb8e4000 1 -- 172.21.15.133:0/2148477822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b432d9ba50 con 0x55b432fc1650 2023-12-19T18:58:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9bc17fa640 1 -- 172.21.15.133:0/2148477822 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bdc051480 con 0x55b432fc1650 2023-12-19T18:58:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9beb8e4000 10 client.4653 fetch_fsmap learned FSMap version 8 2023-12-19T18:58:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9beb8e4000 1 -- 172.21.15.133:0/2148477822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55b432b0ccc0 con 0x55b432fc1650 2023-12-19T18:58:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9bc17fa640 1 -- 172.21.15.133:0/2148477822 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b432d9ba50 con 0x55b432fc1650 2023-12-19T18:58:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9bc17fa640 1 -- 172.21.15.133:0/2148477822 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9bdc0820d0 con 0x55b432fc1650 2023-12-19T18:58:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9beb8e4000 10 client.4653 fetch_fsmap finished waiting for FSMap version 8 2023-12-19T18:58:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9beb8e4000 10 client.4653 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T18:58:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9beb8e4000 20 client.4653 populate_metadata read hostname 'smithi133' 2023-12-19T18:58:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9beb8e4000 1 --2- 172.21.15.133:0/2148477822 >> [v2:172.21.15.133:6833/615053717,v1:172.21.15.133:6835/615053717] conn(0x55b433063d70 0x55b433064150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:58.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9beb8e4000 4 client.4653 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-19T18:58:58.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9beb8e4000 1 -- 172.21.15.133:0/2148477822 --> [v2:172.21.15.133:6833/615053717,v1:172.21.15.133:6835/615053717] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b432e42f30 con 0x55b433063d70 2023-12-19T18:58:58.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9be5b1b640 1 --2- 172.21.15.133:0/2148477822 >> [v2:172.21.15.133:6833/615053717,v1:172.21.15.133:6835/615053717] conn(0x55b433063d70 0x55b433064150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:58.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9be5b1b640 1 --2- 172.21.15.133:0/2148477822 >> [v2:172.21.15.133:6833/615053717,v1:172.21.15.133:6835/615053717] conn(0x55b433063d70 0x55b433064150 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31cd101554825d19 server_cookie=fb9b7a31ca7cbcad in_seq=0 out_seq=0 2023-12-19T18:58:58.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9bc17fa640 10 client.4653 ms_handle_connect on v2:172.21.15.133:6833/615053717 2023-12-19T18:58:58.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9bc17fa640 1 -- 172.21.15.133:0/2148477822 <== mds.0 v2:172.21.15.133:6833/615053717 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55b432e42f30 con 0x55b433063d70 2023-12-19T18:58:58.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9bc17fa640 10 client.4653 handle_command_reply: tid=0 2023-12-19T18:58:58.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9beb8e4000 1 client.4653 shutdown 2023-12-19T18:58:58.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9beb8e4000 1 -- 172.21.15.133:0/2148477822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1650 msgr2=0x55b4330627f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:58.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9beb8e4000 1 --2- 172.21.15.133:0/2148477822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1650 0x55b4330627f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc059080 tx=0x7f9bdc0046b0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9beb8e4000 1 -- 172.21.15.133:0/2148477822 shutdown_connections 2023-12-19T18:58:58.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9beb8e4000 1 --2- 172.21.15.133:0/2148477822 >> [v2:172.21.15.133:6833/615053717,v1:172.21.15.133:6835/615053717] conn(0x55b433063d70 0x55b433064150 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9beb8e4000 1 --2- 172.21.15.133:0/2148477822 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55b432fc2890 0x55b433063830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9beb8e4000 1 --2- 172.21.15.133:0/2148477822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55b432fc1f70 0x55b433062d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9bc17fa640 0 client.4653 ms_handle_reset on v2:172.21.15.133:6833/615053717 2023-12-19T18:58:58.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9beb8e4000 1 --2- 172.21.15.133:0/2148477822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55b432fc1650 0x55b4330627f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9beb8e4000 1 -- 172.21.15.133:0/2148477822 >> 172.21.15.133:0/2148477822 conn(0x55b432fca2f0 msgr2=0x55b432ffcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:58.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9beb8e4000 1 -- 172.21.15.133:0/2148477822 shutdown_connections 2023-12-19T18:58:58.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9beb8e4000 1 -- 172.21.15.133:0/2148477822 wait complete. 2023-12-19T18:58:58.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9beb8e4000 20 client.4653 trim_cache size 0 max 16384 2023-12-19T18:58:58.751 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-19T18:58:58.751 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "03e63958-005e-4bf2-ae5b-291aceb6fbbf", 2023-12-19T18:58:58.751 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2023-12-19T18:58:58.751 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 4281, 2023-12-19T18:58:58.751 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-19T18:58:58.751 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-19T18:58:58.751 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-19T18:58:58.751 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 15.128025008, 2023-12-19T18:58:58.751 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 8, 2023-12-19T18:58:58.751 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 20, 2023-12-19T18:58:58.751 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 20, 2023-12-19T18:58:58.751 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 22.392849176999999 2023-12-19T18:58:58.751 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-19T18:58:58.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9be731e640 1 -- 172.21.15.133:0/1828268266 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9bc40664a0 msgr2=0x7f9bc4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:58.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9be731e640 1 --2- 172.21.15.133:0/1828268266 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9bc40664a0 0x7f9bc4068960 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9be0146ab0 tx=0x7f9bd0009040 comp rx=0 tx=0).stop 2023-12-19T18:58:58.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9be731e640 1 -- 172.21.15.133:0/1828268266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9be00c7c50 msgr2=0x7f9be0146570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:58.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9be731e640 1 --2- 172.21.15.133:0/1828268266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9be00c7c50 0x7f9be0146570 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc00e840 tx=0x7f9bdc00ed00 comp rx=0 tx=0).stop 2023-12-19T18:58:58.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9be731e640 1 -- 172.21.15.133:0/1828268266 shutdown_connections 2023-12-19T18:58:58.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9be731e640 1 --2- 172.21.15.133:0/1828268266 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9bc40664a0 0x7f9bc4068960 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9be731e640 1 --2- 172.21.15.133:0/1828268266 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9be0154be0 0x7f9be0154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9be731e640 1 --2- 172.21.15.133:0/1828268266 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9be0151cd0 0x7f9be0156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9be731e640 1 --2- 172.21.15.133:0/1828268266 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9be00c7c50 0x7f9be0146570 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:58.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9be731e640 1 -- 172.21.15.133:0/1828268266 >> 172.21.15.133:0/1828268266 conn(0x7f9be00abee0 msgr2=0x7f9be014f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:58.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9be731e640 1 -- 172.21.15.133:0/1828268266 shutdown_connections 2023-12-19T18:58:58.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:58.740+0000 7f9be731e640 1 -- 172.21.15.133:0/1828268266 wait complete. 2023-12-19T18:58:58.765 INFO:teuthology.run_tasks:Running task kclient... 2023-12-19T18:58:58.812 INFO:tasks.kclient:Mounting kernel clients... 2023-12-19T18:58:58.812 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2023-12-19T18:58:58.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:58:58.812 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-19T18:58:58.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:58:58.823 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2023-12-19T18:58:58.889 INFO:teuthology.orchestra.run.smithi133.stderr:Cannot find device "ceph-brx" 2023-12-19T18:58:58.891 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:58:58.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:58:58.891 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2023-12-19T18:58:58.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:58:58.902 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link delete ceph-brx 2023-12-19T18:58:58.972 INFO:teuthology.orchestra.run.smithi138.stderr:Cannot find device "ceph-brx" 2023-12-19T18:58:58.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:58:58.974 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-12-19T18:58:58.974 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T18:58:58.974 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T18:58:58.974 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T18:58:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.108+0000 7f3458ddf640 1 Processor -- start 2023-12-19T18:58:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.108+0000 7f3458ddf640 1 -- start start 2023-12-19T18:58:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.108+0000 7f3458ddf640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3454151e90 0x7f34540c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.108+0000 7f3458ddf640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f34540c4e60 0x7f345406bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.108+0000 7f3458ddf640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f345406c860 con 0x7f34540c7ea0 2023-12-19T18:58:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.108+0000 7f3458ddf640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34540c8750 con 0x7f34540c4e60 2023-12-19T18:58:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.108+0000 7f3458ddf640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34541552d0 con 0x7f3454151e90 2023-12-19T18:58:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.108+0000 7f3452d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f34540c4e60 0x7f345406bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.108+0000 7f3452d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f34540c4e60 0x7f345406bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34006/0 (socket says 172.21.15.133:34006) 2023-12-19T18:58:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.108+0000 7f3452d9d640 1 -- 172.21.15.133:0/4269519524 learned_addr learned my addr 172.21.15.133:0/4269519524 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.108+0000 7f345259c640 1 --2- 172.21.15.133:0/4269519524 >> v2:172.21.15.138:3300/0 conn(0x7f3454151e90 0x7f34540c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.108+0000 7f3452d9d640 1 -- 172.21.15.133:0/4269519524 >> v2:172.21.15.138:3300/0 conn(0x7f3454151e90 msgr2=0x7f34540c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:58:59.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.108+0000 7f3452d9d640 1 --2- 172.21.15.133:0/4269519524 >> v2:172.21.15.138:3300/0 conn(0x7f3454151e90 0x7f34540c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:59.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.108+0000 7f3452d9d640 1 -- 172.21.15.133:0/4269519524 >> v1:172.21.15.138:6789/0 conn(0x7f34540c7ea0 legacy=0x7f345406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:59.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.108+0000 7f3452d9d640 1 -- 172.21.15.133:0/4269519524 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3454154930 con 0x7f34540c4e60 2023-12-19T18:58:59.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.112+0000 7f3452d9d640 1 --2- 172.21.15.133:0/4269519524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34540c4e60 0x7f345406bbb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f345408b410 tx=0x7f344c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab91b0a02581ab6d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:59.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.112+0000 7f345159a640 1 -- 172.21.15.133:0/4269519524 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c0a5570 con 0x7f34540c4e60 2023-12-19T18:58:59.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.112+0000 7f345159a640 1 -- 172.21.15.133:0/4269519524 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f344c0a56d0 con 0x7f34540c4e60 2023-12-19T18:58:59.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.112+0000 7f345159a640 1 -- 172.21.15.133:0/4269519524 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f344c0a5a60 con 0x7f34540c4e60 2023-12-19T18:58:59.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.112+0000 7f3458ddf640 1 -- 172.21.15.133:0/4269519524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34540c4e60 msgr2=0x7f345406bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:59.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.112+0000 7f3458ddf640 1 --2- 172.21.15.133:0/4269519524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34540c4e60 0x7f345406bbb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f345408b410 tx=0x7f344c01c8b0 comp rx=0 tx=0).stop 2023-12-19T18:58:59.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.112+0000 7f3458ddf640 1 -- 172.21.15.133:0/4269519524 shutdown_connections 2023-12-19T18:58:59.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.112+0000 7f3458ddf640 1 --2- 172.21.15.133:0/4269519524 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34540c4e60 0x7f345406bbb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:59.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.112+0000 7f3458ddf640 1 --2- 172.21.15.133:0/4269519524 >> v2:172.21.15.138:3300/0 conn(0x7f3454151e90 0x7f34540c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:59.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.112+0000 7f3458ddf640 1 -- 172.21.15.133:0/4269519524 >> 172.21.15.133:0/4269519524 conn(0x7f34540ca170 msgr2=0x7f34540ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:59.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.112+0000 7f3458ddf640 1 -- 172.21.15.133:0/4269519524 shutdown_connections 2023-12-19T18:58:59.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.112+0000 7f3458ddf640 1 -- 172.21.15.133:0/4269519524 wait complete. 2023-12-19T18:58:59.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3458ddf640 1 Processor -- start 2023-12-19T18:58:59.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3458ddf640 1 -- start start 2023-12-19T18:58:59.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3458ddf640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34540c4e60 0x7f34541efef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:59.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3458ddf640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34540c7ea0 0x7f3454153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:59.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3458ddf640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3454151e90 0x7f34541ecfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:59.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3458ddf640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f345414ebf0 con 0x7f34540c7ea0 2023-12-19T18:58:59.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3458ddf640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34541f0500 con 0x7f3454151e90 2023-12-19T18:58:59.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3458ddf640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34541f07e0 con 0x7f34540c4e60 2023-12-19T18:58:59.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3451d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34540c7ea0 0x7f3454153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:59.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3451d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34540c7ea0 0x7f3454153570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34008/0 (socket says 172.21.15.133:34008) 2023-12-19T18:58:59.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3451d9b640 1 -- 172.21.15.133:0/613539597 learned_addr learned my addr 172.21.15.133:0/613539597 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:58:59.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3452d9d640 1 --2- 172.21.15.133:0/613539597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3454151e90 0x7f34541ecfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:59.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f345259c640 1 --2- 172.21.15.133:0/613539597 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34540c4e60 0x7f34541efef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:59.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3451d9b640 1 -- 172.21.15.133:0/613539597 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34540c4e60 msgr2=0x7f34541efef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:59.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3451d9b640 1 --2- 172.21.15.133:0/613539597 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34540c4e60 0x7f34541efef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:59.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3451d9b640 1 -- 172.21.15.133:0/613539597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3454151e90 msgr2=0x7f34541ecfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:59.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3451d9b640 1 --2- 172.21.15.133:0/613539597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3454151e90 0x7f34541ecfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:59.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3451d9b640 1 -- 172.21.15.133:0/613539597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344c009b30 con 0x7f34540c7ea0 2023-12-19T18:58:59.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f345259c640 1 --2- 172.21.15.133:0/613539597 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34540c4e60 0x7f34541efef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:58:59.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3451d9b640 1 --2- 172.21.15.133:0/613539597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34540c7ea0 0x7f3454153570 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f344800c3c0 tx=0x7f344800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:59.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3442ffd640 1 -- 172.21.15.133:0/613539597 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34480052d0 con 0x7f34540c7ea0 2023-12-19T18:58:59.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3442ffd640 1 -- 172.21.15.133:0/613539597 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3448005430 con 0x7f34540c7ea0 2023-12-19T18:58:59.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3458ddf640 1 -- 172.21.15.133:0/613539597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34541f0ac0 con 0x7f34540c7ea0 2023-12-19T18:58:59.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3442ffd640 1 -- 172.21.15.133:0/613539597 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3448003840 con 0x7f34540c7ea0 2023-12-19T18:58:59.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3458ddf640 1 -- 172.21.15.133:0/613539597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34541ecac0 con 0x7f34540c7ea0 2023-12-19T18:58:59.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.116+0000 7f3458ddf640 1 -- 172.21.15.133:0/613539597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34541ecce0 con 0x7f34540c7ea0 2023-12-19T18:58:59.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.120+0000 7f3442ffd640 1 -- 172.21.15.133:0/613539597 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f34480039a0 con 0x7f34540c7ea0 2023-12-19T18:58:59.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.120+0000 7f3442ffd640 1 --2- 172.21.15.133:0/613539597 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f34340664a0 0x7f3434068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:58:59.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.120+0000 7f3442ffd640 1 -- 172.21.15.133:0/613539597 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3448083380 con 0x7f34540c7ea0 2023-12-19T18:58:59.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.120+0000 7f345259c640 1 --2- 172.21.15.133:0/613539597 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f34340664a0 0x7f3434068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:58:59.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.120+0000 7f345259c640 1 --2- 172.21.15.133:0/613539597 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f34340664a0 0x7f3434068960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3444009840 tx=0x7f3444008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:58:59.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.124+0000 7f3442ffd640 1 -- 172.21.15.133:0/613539597 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f34480507f0 con 0x7f34540c7ea0 2023-12-19T18:58:59.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.304+0000 7f3458ddf640 1 -- 172.21.15.133:0/613539597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3454068400 con 0x7f34540c7ea0 2023-12-19T18:58:59.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.304+0000 7f3442ffd640 1 -- 172.21.15.133:0/613539597 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3448053e10 con 0x7f34540c7ea0 2023-12-19T18:58:59.310 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T18:58:59.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.308+0000 7f3458ddf640 1 -- 172.21.15.133:0/613539597 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f34340664a0 msgr2=0x7f3434068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:59.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.308+0000 7f3458ddf640 1 --2- 172.21.15.133:0/613539597 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f34340664a0 0x7f3434068960 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3444009840 tx=0x7f3444008040 comp rx=0 tx=0).stop 2023-12-19T18:58:59.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.308+0000 7f3458ddf640 1 -- 172.21.15.133:0/613539597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34540c7ea0 msgr2=0x7f3454153570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:58:59.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.308+0000 7f3458ddf640 1 --2- 172.21.15.133:0/613539597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34540c7ea0 0x7f3454153570 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f344800c3c0 tx=0x7f344800c880 comp rx=0 tx=0).stop 2023-12-19T18:58:59.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.308+0000 7f3458ddf640 1 -- 172.21.15.133:0/613539597 shutdown_connections 2023-12-19T18:58:59.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.308+0000 7f3458ddf640 1 --2- 172.21.15.133:0/613539597 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f34340664a0 0x7f3434068960 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:59.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.308+0000 7f3458ddf640 1 --2- 172.21.15.133:0/613539597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3454151e90 0x7f34541ecfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:59.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.308+0000 7f3458ddf640 1 --2- 172.21.15.133:0/613539597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34540c7ea0 0x7f3454153570 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:59.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.308+0000 7f3458ddf640 1 --2- 172.21.15.133:0/613539597 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34540c4e60 0x7f34541efef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:58:59.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.308+0000 7f3458ddf640 1 -- 172.21.15.133:0/613539597 >> 172.21.15.133:0/613539597 conn(0x7f34540ca170 msgr2=0x7f3454151110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:58:59.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.308+0000 7f3458ddf640 1 -- 172.21.15.133:0/613539597 shutdown_connections 2023-12-19T18:58:59.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:58:59.308+0000 7f3458ddf640 1 -- 172.21.15.133:0/613539597 wait complete. 2023-12-19T18:58:59.330 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T18:58:59.330 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T18:58:59.330 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-19T18:58:59.330 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T18:58:59.330 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T18:58:59.331 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T18:58:59.331 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T18:58:59.331 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T18:58:59.331 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:58:59.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:58:59.331 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-19T18:58:59.340 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T18:58:59.340 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T18:58:59.340 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T18:58:59.340 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:58:59.340 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-19T18:58:59.340 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:58:59.341 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:58:59.341 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:58:59.341 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-19T18:58:59.341 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:58:59.341 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:58:59.341 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-19T18:58:59.341 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:58:59.341 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:58:59.341 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T18:58:59.341 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:58:59.342 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T18:58:59.342 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42421sec preferred_lft 42421sec 2023-12-19T18:58:59.342 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-12-19T18:58:59.342 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:58:59.342 INFO:teuthology.orchestra.run.smithi133.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T18:58:59.342 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 02:42:26:2c:b4:18 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:58:59.342 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T18:58:59.342 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:58:59.344 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-19T18:58:59.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:58:59.344 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-19T18:58:59.344 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-19T18:58:59.344 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add name ceph-brx type bridge 2023-12-19T18:58:59.344 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr flush dev ceph-brx 2023-12-19T18:58:59.344 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set ceph-brx up 2023-12-19T18:58:59.344 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-19T18:58:59.345 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-19T18:58:59.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:58:59.466 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T18:58:59.486 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-19T18:58:59.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:58:59.488 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-19T18:58:59.563 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-19T18:58:59.564 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T18:58:59.564 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T18:58:59.564 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T18:58:59.564 INFO:teuthology.orchestra.run.smithi133.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T18:58:59.564 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T18:58:59.564 INFO:teuthology.orchestra.run.smithi133.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T18:58:59.564 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T18:58:59.565 INFO:teuthology.orchestra.run.smithi133.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T18:58:59.565 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T18:58:59.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:58:59.566 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-19T18:58:59.566 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-19T18:58:59.566 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T18:58:59.566 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T18:58:59.566 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T18:58:59.566 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-19T18:58:59.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:58:59.662 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-19T18:58:59.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:58:59.672 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list-id 2023-12-19T18:58:59.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:58:59.727 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-19T18:58:59.727 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-19T18:58:59.728 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T18:58:59.728 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-19T18:58:59.728 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-19T18:58:59.815 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-19T18:58:59.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:58:59.815 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-19T18:58:59.816 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-19T18:58:59.816 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-19T18:58:59.816 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-19T18:58:59.816 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-19T18:58:59.816 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-19T18:58:59.816 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-19T18:58:59.816 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-19T18:59:00.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:00.000 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-19T18:59:00.001 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-19T18:59:00.001 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-19T18:59:00.001 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set dev brx.0 master ceph-brx 2023-12-19T18:59:00.001 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-19T18:59:00.043 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:59:00.043 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T18:59:00.095 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:59:00.095 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:59:00.095 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T18:59:00.146 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T18:59:00.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:00.147 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T18:59:00.253 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T18:59:00.253 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T18:59:00.362 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T18:59:00.362 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T18:59:00.362 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-12-19T18:59:00.362 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 0@03e63958-005e-4bf2-ae5b-291aceb6fbbf.cephfs=/ 2023-12-19T18:59:00.362 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.133:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-12-19T18:59:00.366 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T18:59:00.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:00.366 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T18:59:00.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:00.388 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T18:59:00.463 INFO:teuthology.orchestra.run.smithi133.stdout:client4630 2023-12-19T18:59:00.464 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:59:00.464 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:59:00.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:00.515 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T18:59:00.577 INFO:teuthology.orchestra.run.smithi133.stdout:client4630 2023-12-19T18:59:00.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:00.578 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T18:59:00.637 INFO:teuthology.orchestra.run.smithi133.stdout:client4630 2023-12-19T18:59:00.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:00.638 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/03e63958-005e-4bf2-ae5b-291aceb6fbbf.client4630/status') 2023-12-19T18:59:00.702 INFO:teuthology.orchestra.run.smithi133.stdout:instance: client.4630 (3)172.21.15.133:0/1591976161 2023-12-19T18:59:00.702 INFO:teuthology.orchestra.run.smithi133.stdout:blocklisted: false 2023-12-19T18:59:00.702 INFO:teuthology.orchestra.run.smithi133.stderr:0+1 records in 2023-12-19T18:59:00.703 INFO:teuthology.orchestra.run.smithi133.stderr:0+1 records out 2023-12-19T18:59:00.703 INFO:teuthology.orchestra.run.smithi133.stderr:71 bytes copied, 7.3313e-05 s, 968 kB/s 2023-12-19T18:59:00.704 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-12-19T18:59:00.704 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T18:59:00.704 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T18:59:00.704 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T18:59:00.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.884+0000 7fd2cb268640 1 Processor -- start 2023-12-19T18:59:00.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.884+0000 7fd2cb268640 1 -- start start 2023-12-19T18:59:00.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.884+0000 7fd2cb268640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd2c4151e90 0x7fd2c40c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:00.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.884+0000 7fd2cb268640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd2c40c4e60 0x7fd2c406bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:00.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.884+0000 7fd2cb268640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2c406c860 con 0x7fd2c40c7ea0 2023-12-19T18:59:00.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.884+0000 7fd2cb268640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c40c8750 con 0x7fd2c40c4e60 2023-12-19T18:59:00.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.884+0000 7fd2cb268640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2c41552d0 con 0x7fd2c4151e90 2023-12-19T18:59:00.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.884+0000 7fd2c9805640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd2c40c4e60 0x7fd2c406bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:00.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.884+0000 7fd2c9805640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd2c40c4e60 0x7fd2c406bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34020/0 (socket says 172.21.15.133:34020) 2023-12-19T18:59:00.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.884+0000 7fd2c9805640 1 -- 172.21.15.133:0/55650439 learned_addr learned my addr 172.21.15.133:0/55650439 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:00.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.884+0000 7fd2c9004640 1 --2- 172.21.15.133:0/55650439 >> v2:172.21.15.138:3300/0 conn(0x7fd2c4151e90 0x7fd2c40c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:00.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.884+0000 7fd2c9805640 1 -- 172.21.15.133:0/55650439 >> v2:172.21.15.138:3300/0 conn(0x7fd2c4151e90 msgr2=0x7fd2c40c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:00.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.884+0000 7fd2c9805640 1 --2- 172.21.15.133:0/55650439 >> v2:172.21.15.138:3300/0 conn(0x7fd2c4151e90 0x7fd2c40c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:00.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.884+0000 7fd2c9805640 1 -- 172.21.15.133:0/55650439 >> v1:172.21.15.133:6789/0 conn(0x7fd2c40c7ea0 legacy=0x7fd2c406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:00.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.884+0000 7fd2c9805640 1 -- 172.21.15.133:0/55650439 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c4154930 con 0x7fd2c40c4e60 2023-12-19T18:59:00.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.888+0000 7fd2c9805640 1 --2- 172.21.15.133:0/55650439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2c40c4e60 0x7fd2c406bbb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd2c408b410 tx=0x7fd2bc01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9955b82b30086b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:00.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.888+0000 7fd2bbfff640 1 -- 172.21.15.133:0/55650439 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc0a5570 con 0x7fd2c40c4e60 2023-12-19T18:59:00.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.888+0000 7fd2bbfff640 1 -- 172.21.15.133:0/55650439 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2bc0a56d0 con 0x7fd2c40c4e60 2023-12-19T18:59:00.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.888+0000 7fd2bbfff640 1 -- 172.21.15.133:0/55650439 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc0a5a60 con 0x7fd2c40c4e60 2023-12-19T18:59:00.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.888+0000 7fd2cb268640 1 -- 172.21.15.133:0/55650439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2c40c4e60 msgr2=0x7fd2c406bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:00.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.888+0000 7fd2cb268640 1 --2- 172.21.15.133:0/55650439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2c40c4e60 0x7fd2c406bbb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd2c408b410 tx=0x7fd2bc01c8b0 comp rx=0 tx=0).stop 2023-12-19T18:59:00.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.888+0000 7fd2cb268640 1 -- 172.21.15.133:0/55650439 shutdown_connections 2023-12-19T18:59:00.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.888+0000 7fd2cb268640 1 --2- 172.21.15.133:0/55650439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2c40c4e60 0x7fd2c406bbb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:00.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.888+0000 7fd2cb268640 1 --2- 172.21.15.133:0/55650439 >> v2:172.21.15.138:3300/0 conn(0x7fd2c4151e90 0x7fd2c40c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:00.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.888+0000 7fd2cb268640 1 -- 172.21.15.133:0/55650439 >> 172.21.15.133:0/55650439 conn(0x7fd2c40ca170 msgr2=0x7fd2c40ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:00.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.888+0000 7fd2cb268640 1 -- 172.21.15.133:0/55650439 shutdown_connections 2023-12-19T18:59:00.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.888+0000 7fd2cb268640 1 -- 172.21.15.133:0/55650439 wait complete. 2023-12-19T18:59:00.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2cb268640 1 Processor -- start 2023-12-19T18:59:00.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2cb268640 1 -- start start 2023-12-19T18:59:00.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2cb268640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2c40c4e60 0x7fd2c4153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:00.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2cb268640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2c40c7ea0 0x7fd2c414dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:00.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2cb268640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2c4151e90 0x7fd2c40bcb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:00.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2cb268640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c414dc80 con 0x7fd2c40c7ea0 2023-12-19T18:59:00.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2cb268640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c414c140 con 0x7fd2c4151e90 2023-12-19T18:59:00.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2cb268640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c41f5200 con 0x7fd2c40c4e60 2023-12-19T18:59:00.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2c8803640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2c40c7ea0 0x7fd2c414dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:00.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2c8803640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2c40c7ea0 0x7fd2c414dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34030/0 (socket says 172.21.15.133:34030) 2023-12-19T18:59:00.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2c8803640 1 -- 172.21.15.133:0/2818390900 learned_addr learned my addr 172.21.15.133:0/2818390900 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:00.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2c9004640 1 --2- 172.21.15.133:0/2818390900 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2c40c4e60 0x7fd2c4153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:00.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2c9805640 1 --2- 172.21.15.133:0/2818390900 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2c4151e90 0x7fd2c40bcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:00.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2c8803640 1 -- 172.21.15.133:0/2818390900 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2c40c4e60 msgr2=0x7fd2c4153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:00.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2c8803640 1 --2- 172.21.15.133:0/2818390900 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2c40c4e60 0x7fd2c4153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:00.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2c8803640 1 -- 172.21.15.133:0/2818390900 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2c4151e90 msgr2=0x7fd2c40bcb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:00.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2c8803640 1 --2- 172.21.15.133:0/2818390900 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2c4151e90 0x7fd2c40bcb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:00.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2c8803640 1 -- 172.21.15.133:0/2818390900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc009b30 con 0x7fd2c40c7ea0 2023-12-19T18:59:00.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2c8803640 1 --2- 172.21.15.133:0/2818390900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2c40c7ea0 0x7fd2c414dfd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd2b400c3f0 tx=0x7fd2b400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:00.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2b9ffb640 1 -- 172.21.15.133:0/2818390900 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b40052d0 con 0x7fd2c40c7ea0 2023-12-19T18:59:00.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2b9ffb640 1 -- 172.21.15.133:0/2818390900 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2b4005430 con 0x7fd2c40c7ea0 2023-12-19T18:59:00.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2b9ffb640 1 -- 172.21.15.133:0/2818390900 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2b4003840 con 0x7fd2c40c7ea0 2023-12-19T18:59:00.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2cb268640 1 -- 172.21.15.133:0/2818390900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c41f4680 con 0x7fd2c40c7ea0 2023-12-19T18:59:00.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.892+0000 7fd2cb268640 1 -- 172.21.15.133:0/2818390900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c41f4c40 con 0x7fd2c40c7ea0 2023-12-19T18:59:00.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.896+0000 7fd2cb268640 1 -- 172.21.15.133:0/2818390900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2c4068400 con 0x7fd2c40c7ea0 2023-12-19T18:59:00.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.896+0000 7fd2b9ffb640 1 -- 172.21.15.133:0/2818390900 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd2b40039a0 con 0x7fd2c40c7ea0 2023-12-19T18:59:00.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.896+0000 7fd2b9ffb640 1 --2- 172.21.15.133:0/2818390900 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd2a80664a0 0x7fd2a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:00.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.896+0000 7fd2b9ffb640 1 -- 172.21.15.133:0/2818390900 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2b4083280 con 0x7fd2c40c7ea0 2023-12-19T18:59:00.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.896+0000 7fd2c9004640 1 --2- 172.21.15.133:0/2818390900 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd2a80664a0 0x7fd2a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:00.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.896+0000 7fd2c9004640 1 --2- 172.21.15.133:0/2818390900 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd2a80664a0 0x7fd2a8068960 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0007a60 tx=0x7fd2c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:00.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:00.900+0000 7fd2b9ffb640 1 -- 172.21.15.133:0/2818390900 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd2b4050840 con 0x7fd2c40c7ea0 2023-12-19T18:59:01.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:01.084+0000 7fd2cb268640 1 -- 172.21.15.133:0/2818390900 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd2c4066ff0 con 0x7fd2c40c7ea0 2023-12-19T18:59:01.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:01.084+0000 7fd2b9ffb640 1 -- 172.21.15.133:0/2818390900 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd2b4053e60 con 0x7fd2c40c7ea0 2023-12-19T18:59:01.088 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T18:59:01.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:01.084+0000 7fd2cb268640 1 -- 172.21.15.133:0/2818390900 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd2a80664a0 msgr2=0x7fd2a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:01.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:01.084+0000 7fd2cb268640 1 --2- 172.21.15.133:0/2818390900 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd2a80664a0 0x7fd2a8068960 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0007a60 tx=0x7fd2c0008040 comp rx=0 tx=0).stop 2023-12-19T18:59:01.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:01.084+0000 7fd2cb268640 1 -- 172.21.15.133:0/2818390900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2c40c7ea0 msgr2=0x7fd2c414dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:01.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:01.084+0000 7fd2cb268640 1 --2- 172.21.15.133:0/2818390900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2c40c7ea0 0x7fd2c414dfd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd2b400c3f0 tx=0x7fd2b400c8b0 comp rx=0 tx=0).stop 2023-12-19T18:59:01.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:01.084+0000 7fd2cb268640 1 -- 172.21.15.133:0/2818390900 shutdown_connections 2023-12-19T18:59:01.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:01.084+0000 7fd2cb268640 1 --2- 172.21.15.133:0/2818390900 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd2a80664a0 0x7fd2a8068960 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:01.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:01.084+0000 7fd2cb268640 1 --2- 172.21.15.133:0/2818390900 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2c4151e90 0x7fd2c40bcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:01.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:01.084+0000 7fd2cb268640 1 --2- 172.21.15.133:0/2818390900 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2c40c7ea0 0x7fd2c414dfd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:01.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:01.084+0000 7fd2cb268640 1 --2- 172.21.15.133:0/2818390900 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2c40c4e60 0x7fd2c4153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:01.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:01.084+0000 7fd2cb268640 1 -- 172.21.15.133:0/2818390900 >> 172.21.15.133:0/2818390900 conn(0x7fd2c40ca170 msgr2=0x7fd2c4151110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:01.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:01.088+0000 7fd2cb268640 1 -- 172.21.15.133:0/2818390900 shutdown_connections 2023-12-19T18:59:01.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:01.088+0000 7fd2cb268640 1 -- 172.21.15.133:0/2818390900 wait complete. 2023-12-19T18:59:01.109 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T18:59:01.109 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T18:59:01.109 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi138.front.sepia.ceph.com 2023-12-19T18:59:01.110 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T18:59:01.110 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T18:59:01.110 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T18:59:01.110 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T18:59:01.110 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T18:59:01.110 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T18:59:01.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:01.110 DEBUG:teuthology.orchestra.run.smithi138:> ip addr 2023-12-19T18:59:01.120 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T18:59:01.120 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T18:59:01.120 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T18:59:01.121 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:01.121 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2023-12-19T18:59:01.121 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:01.121 INFO:teuthology.orchestra.run.smithi138.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:59:01.121 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7a brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:01.121 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f0 2023-12-19T18:59:01.121 INFO:teuthology.orchestra.run.smithi138.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:59:01.121 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7b brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:01.121 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f1 2023-12-19T18:59:01.121 INFO:teuthology.orchestra.run.smithi138.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:59:01.121 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:70 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:01.121 INFO:teuthology.orchestra.run.smithi138.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T18:59:01.121 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:71 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:01.121 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.21.15.138/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T18:59:01.122 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft 42412sec preferred_lft 42412sec 2023-12-19T18:59:01.122 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::ec4:7aff:fe88:6f71/64 scope link 2023-12-19T18:59:01.122 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:01.122 INFO:teuthology.orchestra.run.smithi138.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T18:59:01.122 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 02:42:5b:f5:51:87 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:01.122 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T18:59:01.122 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:01.123 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-19T18:59:01.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:01.123 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-12-19T18:59:01.123 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-12-19T18:59:01.123 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link add name ceph-brx type bridge 2023-12-19T18:59:01.123 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip addr flush dev ceph-brx 2023-12-19T18:59:01.123 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set ceph-brx up 2023-12-19T18:59:01.123 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-19T18:59:01.123 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-12-19T18:59:01.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:01.248 DEBUG:teuthology.orchestra.run.smithi138:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T18:59:01.268 INFO:teuthology.orchestra.run.smithi138.stdout:1 2023-12-19T18:59:01.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:01.270 DEBUG:teuthology.orchestra.run.smithi138:> route 2023-12-19T18:59:01.350 INFO:teuthology.orchestra.run.smithi138.stdout:Kernel IP routing table 2023-12-19T18:59:01.350 INFO:teuthology.orchestra.run.smithi138.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T18:59:01.350 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T18:59:01.351 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T18:59:01.351 INFO:teuthology.orchestra.run.smithi138.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T18:59:01.351 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T18:59:01.351 INFO:teuthology.orchestra.run.smithi138.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T18:59:01.351 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T18:59:01.351 INFO:teuthology.orchestra.run.smithi138.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T18:59:01.351 INFO:teuthology.orchestra.run.smithi138.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T18:59:01.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:01.351 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-12-19T18:59:01.352 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-12-19T18:59:01.352 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T18:59:01.352 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T18:59:01.352 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T18:59:01.352 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-12-19T18:59:01.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:01.446 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2023-12-19T18:59:01.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:01.456 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list-id 2023-12-19T18:59:01.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:01.512 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-12-19T18:59:01.512 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-12-19T18:59:01.512 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T18:59:01.512 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-19T18:59:01.512 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-12-19T18:59:01.599 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-19T18:59:01.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:01.599 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-12-19T18:59:01.599 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-12-19T18:59:01.599 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-19T18:59:01.599 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-19T18:59:01.599 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-19T18:59:01.599 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-19T18:59:01.599 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-19T18:59:01.600 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-12-19T18:59:01.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:01.762 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-12-19T18:59:01.762 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-12-19T18:59:01.762 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set brx.0 up 2023-12-19T18:59:01.762 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set dev brx.0 master ceph-brx 2023-12-19T18:59:01.762 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-12-19T18:59:01.802 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:59:01.802 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T18:59:01.855 INFO:teuthology.orchestra.run.smithi138.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T18:59:01.855 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:59:01.855 DEBUG:teuthology.orchestra.run.smithi138:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T18:59:01.906 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T18:59:01.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:01.906 DEBUG:teuthology.orchestra.run.smithi138:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T18:59:02.002 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T18:59:02.002 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T18:59:02.132 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T18:59:02.132 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T18:59:02.133 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-12-19T18:59:02.133 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: trying mount with new device syntax: 1@03e63958-005e-4bf2-ae5b-291aceb6fbbf.cephfs=/ 2023-12-19T18:59:02.133 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.133:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-12-19T18:59:02.136 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T18:59:02.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:02.137 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T18:59:02.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:02.157 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T18:59:02.225 INFO:teuthology.orchestra.run.smithi138.stdout:client4639 2023-12-19T18:59:02.225 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:59:02.225 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:59:02.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:02.279 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T18:59:02.338 INFO:teuthology.orchestra.run.smithi138.stdout:client4639 2023-12-19T18:59:02.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:02.338 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T18:59:02.393 INFO:teuthology.orchestra.run.smithi138.stdout:client4639 2023-12-19T18:59:02.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:02.394 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/03e63958-005e-4bf2-ae5b-291aceb6fbbf.client4639/status') 2023-12-19T18:59:02.458 INFO:teuthology.orchestra.run.smithi138.stdout:instance: client.4639 (3)192.168.0.1:0/1780596500 2023-12-19T18:59:02.458 INFO:teuthology.orchestra.run.smithi138.stdout:blocklisted: false 2023-12-19T18:59:02.458 INFO:teuthology.orchestra.run.smithi138.stderr:0+1 records in 2023-12-19T18:59:02.458 INFO:teuthology.orchestra.run.smithi138.stderr:0+1 records out 2023-12-19T18:59:02.458 INFO:teuthology.orchestra.run.smithi138.stderr:69 bytes copied, 6.1837e-05 s, 1.1 MB/s 2023-12-19T18:59:02.460 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-19T18:59:02.476 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:59:02.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.620+0000 7f40c89e5640 1 Processor -- start 2023-12-19T18:59:02.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.620+0000 7f40c89e5640 1 -- start start 2023-12-19T18:59:02.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.620+0000 7f40c89e5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f40c4151bb0 0x7f40c406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:02.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.620+0000 7f40c89e5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f40c40c7c30 0x7f40c415ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:02.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.620+0000 7f40c89e5640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c40c8400 con 0x7f40c40bd3c0 2023-12-19T18:59:02.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.620+0000 7f40c89e5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c40c86e0 con 0x7f40c40c7c30 2023-12-19T18:59:02.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.620+0000 7f40c89e5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c41543e0 con 0x7f40c4151bb0 2023-12-19T18:59:02.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.624+0000 7f40c2d9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f40c4151bb0 0x7f40c406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:02.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.624+0000 7f40c359e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f40c40c7c30 0x7f40c415ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:02.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.624+0000 7f40c259c640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f40c40bd3c0 0x7f40c40c46b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:57180/0 (socket says 172.21.15.133:57180) 2023-12-19T18:59:02.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.624+0000 7f40c259c640 1 -- 172.21.15.133:0/1452578938 learned_addr learned my addr 172.21.15.133:0/1452578938 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:02.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.624+0000 7f40c1d9b640 1 -- 172.21.15.133:0/1452578938 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1126814306 0 0) 0x7f40c40c8400 con 0x7f40c40bd3c0 2023-12-19T18:59:02.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.624+0000 7f40c2d9d640 1 -- 172.21.15.133:0/1452578938 >> v2:172.21.15.138:3300/0 conn(0x7f40c40c7c30 msgr2=0x7f40c415ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:02.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.624+0000 7f40c2d9d640 1 --2- 172.21.15.133:0/1452578938 >> v2:172.21.15.138:3300/0 conn(0x7f40c40c7c30 0x7f40c415ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:02.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.624+0000 7f40c2d9d640 1 -- 172.21.15.133:0/1452578938 >> v1:172.21.15.138:6789/0 conn(0x7f40c40bd3c0 legacy=0x7f40c40c46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:02.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.624+0000 7f40c2d9d640 1 -- 172.21.15.133:0/1452578938 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c41545f0 con 0x7f40c4151bb0 2023-12-19T18:59:02.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.624+0000 7f40c359e640 1 --2- 172.21.15.133:0/1452578938 >> v2:172.21.15.138:3300/0 conn(0x7f40c40c7c30 0x7f40c415ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:59:02.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.624+0000 7f40c2d9d640 1 --2- 172.21.15.133:0/1452578938 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f40c4151bb0 0x7f40c406ba40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f40b40097c0 tx=0x7f40b401c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef20e858766c3a81 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:02.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.624+0000 7f40c1d9b640 1 -- 172.21.15.133:0/1452578938 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b40ab600 con 0x7f40c4151bb0 2023-12-19T18:59:02.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.624+0000 7f40c1d9b640 1 -- 172.21.15.133:0/1452578938 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b40a7050 con 0x7f40c4151bb0 2023-12-19T18:59:02.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.624+0000 7f40c1d9b640 1 -- 172.21.15.133:0/1452578938 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b40ab980 con 0x7f40c4151bb0 2023-12-19T18:59:02.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.628+0000 7f40c89e5640 1 -- 172.21.15.133:0/1452578938 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f40c4151bb0 msgr2=0x7f40c406ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:02.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.628+0000 7f40c89e5640 1 --2- 172.21.15.133:0/1452578938 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f40c4151bb0 0x7f40c406ba40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f40b40097c0 tx=0x7f40b401c330 comp rx=0 tx=0).stop 2023-12-19T18:59:02.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.628+0000 7f40c89e5640 1 -- 172.21.15.133:0/1452578938 shutdown_connections 2023-12-19T18:59:02.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.628+0000 7f40c89e5640 1 --2- 172.21.15.133:0/1452578938 >> v2:172.21.15.138:3300/0 conn(0x7f40c40c7c30 0x7f40c415ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:02.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.628+0000 7f40c89e5640 1 --2- 172.21.15.133:0/1452578938 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f40c4151bb0 0x7f40c406ba40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:02.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.628+0000 7f40c89e5640 1 -- 172.21.15.133:0/1452578938 >> 172.21.15.133:0/1452578938 conn(0x7f40c40abcc0 msgr2=0x7f40c40ac0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:02.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.628+0000 7f40c89e5640 1 -- 172.21.15.133:0/1452578938 shutdown_connections 2023-12-19T18:59:02.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.628+0000 7f40c89e5640 1 -- 172.21.15.133:0/1452578938 wait complete. 2023-12-19T18:59:02.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.628+0000 7f40c89e5640 1 Processor -- start 2023-12-19T18:59:02.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.628+0000 7f40c89e5640 1 -- start start 2023-12-19T18:59:02.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.628+0000 7f40c89e5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f40c40bd3c0 0x7f40c40c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:02.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.628+0000 7f40c89e5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c40c7c30 0x7f40c4155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:02.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.628+0000 7f40c89e5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f40c4151bb0 0x7f40c414f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:02.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.628+0000 7f40c89e5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c40c22a0 con 0x7f40c40c7c30 2023-12-19T18:59:02.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.628+0000 7f40c89e5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c414ead0 con 0x7f40c40bd3c0 2023-12-19T18:59:02.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.628+0000 7f40c89e5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c40c30f0 con 0x7f40c4151bb0 2023-12-19T18:59:02.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.628+0000 7f40c259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c40c7c30 0x7f40c4155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:02.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.628+0000 7f40c2d9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f40c40bd3c0 0x7f40c40c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:02.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.628+0000 7f40c259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c40c7c30 0x7f40c4155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34042/0 (socket says 172.21.15.133:34042) 2023-12-19T18:59:02.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.628+0000 7f40c2d9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f40c40bd3c0 0x7f40c40c0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:43898/0 (socket says 172.21.15.133:43898) 2023-12-19T18:59:02.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.628+0000 7f40c259c640 1 -- 172.21.15.133:0/417456291 learned_addr learned my addr 172.21.15.133:0/417456291 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:02.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.628+0000 7f40c359e640 1 --2- 172.21.15.133:0/417456291 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f40c4151bb0 0x7f40c414f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:02.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.632+0000 7f40c259c640 1 -- 172.21.15.133:0/417456291 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f40c4151bb0 msgr2=0x7f40c414f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:02.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.632+0000 7f40c259c640 1 --2- 172.21.15.133:0/417456291 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f40c4151bb0 0x7f40c414f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:02.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.632+0000 7f40c259c640 1 -- 172.21.15.133:0/417456291 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f40c40bd3c0 msgr2=0x7f40c40c0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:02.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.632+0000 7f40c259c640 1 --2- 172.21.15.133:0/417456291 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f40c40bd3c0 0x7f40c40c0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:02.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.632+0000 7f40c259c640 1 -- 172.21.15.133:0/417456291 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc009a70 con 0x7f40c40c7c30 2023-12-19T18:59:02.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.632+0000 7f40c259c640 1 --2- 172.21.15.133:0/417456291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c40c7c30 0x7f40c4155cd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f40b800c4b0 tx=0x7f40b800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:02.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.632+0000 7f40ab7fe640 1 -- 172.21.15.133:0/417456291 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b80074e0 con 0x7f40c40c7c30 2023-12-19T18:59:02.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.632+0000 7f40ab7fe640 1 -- 172.21.15.133:0/417456291 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b8007660 con 0x7f40c40c7c30 2023-12-19T18:59:02.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.632+0000 7f40ab7fe640 1 -- 172.21.15.133:0/417456291 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b8004a30 con 0x7f40c40c7c30 2023-12-19T18:59:02.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.632+0000 7f40c89e5640 1 -- 172.21.15.133:0/417456291 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b4009420 con 0x7f40c40c7c30 2023-12-19T18:59:02.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.632+0000 7f40c89e5640 1 -- 172.21.15.133:0/417456291 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c40c3990 con 0x7f40c40c7c30 2023-12-19T18:59:02.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.632+0000 7f40c89e5640 1 -- 172.21.15.133:0/417456291 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c4067e90 con 0x7f40c40c7c30 2023-12-19T18:59:02.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.632+0000 7f40ab7fe640 1 -- 172.21.15.133:0/417456291 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f40b8004b90 con 0x7f40c40c7c30 2023-12-19T18:59:02.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.632+0000 7f40ab7fe640 1 --2- 172.21.15.133:0/417456291 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f40b00664a0 0x7f40b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:02.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.632+0000 7f40ab7fe640 1 -- 172.21.15.133:0/417456291 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40b8083b30 con 0x7f40c40c7c30 2023-12-19T18:59:02.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.636+0000 7f40c2d9d640 1 --2- 172.21.15.133:0/417456291 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f40b00664a0 0x7f40b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:02.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.636+0000 7f40c2d9d640 1 --2- 172.21.15.133:0/417456291 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f40b00664a0 0x7f40b0068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f40b40ad000 tx=0x7f40b4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:02.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.636+0000 7f40ab7fe640 1 -- 172.21.15.133:0/417456291 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f40b8050fa0 con 0x7f40c40c7c30 2023-12-19T18:59:02.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.788+0000 7f40c89e5640 1 -- 172.21.15.133:0/417456291 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40c404e850 con 0x7f40c40c7c30 2023-12-19T18:59:02.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.788+0000 7f40ab7fe640 1 -- 172.21.15.133:0/417456291 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f40b80545c0 con 0x7f40c40c7c30 2023-12-19T18:59:02.793 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:02.793 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:44.402984+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:58:40.991408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T18:58:41.773992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:59:02.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.792+0000 7f40c89e5640 1 -- 172.21.15.133:0/417456291 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f40b00664a0 msgr2=0x7f40b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:02.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.792+0000 7f40c89e5640 1 --2- 172.21.15.133:0/417456291 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f40b00664a0 0x7f40b0068960 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f40b40ad000 tx=0x7f40b4008040 comp rx=0 tx=0).stop 2023-12-19T18:59:02.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.792+0000 7f40c89e5640 1 -- 172.21.15.133:0/417456291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c40c7c30 msgr2=0x7f40c4155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:02.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.792+0000 7f40c89e5640 1 --2- 172.21.15.133:0/417456291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c40c7c30 0x7f40c4155cd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f40b800c4b0 tx=0x7f40b800c8b0 comp rx=0 tx=0).stop 2023-12-19T18:59:02.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.792+0000 7f40c89e5640 1 -- 172.21.15.133:0/417456291 shutdown_connections 2023-12-19T18:59:02.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.792+0000 7f40c89e5640 1 --2- 172.21.15.133:0/417456291 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f40b00664a0 0x7f40b0068960 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:02.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.792+0000 7f40c89e5640 1 --2- 172.21.15.133:0/417456291 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f40c4151bb0 0x7f40c414f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:02.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.792+0000 7f40c89e5640 1 --2- 172.21.15.133:0/417456291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40c40c7c30 0x7f40c4155cd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:02.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.792+0000 7f40c89e5640 1 --2- 172.21.15.133:0/417456291 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f40c40bd3c0 0x7f40c40c0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:02.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.792+0000 7f40c89e5640 1 -- 172.21.15.133:0/417456291 >> 172.21.15.133:0/417456291 conn(0x7f40c40abcc0 msgr2=0x7f40c4145bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:02.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.792+0000 7f40c89e5640 1 -- 172.21.15.133:0/417456291 shutdown_connections 2023-12-19T18:59:02.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.792+0000 7f40c89e5640 1 -- 172.21.15.133:0/417456291 wait complete. 2023-12-19T18:59:02.814 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:58:40.991408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:58:41.773992+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:59:02.815 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:59:02.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.952+0000 7f200c9f4640 1 Processor -- start 2023-12-19T18:59:02.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.952+0000 7f200c9f4640 1 -- start start 2023-12-19T18:59:02.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.956+0000 7f200c9f4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2008151bb0 0x7f200806ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:02.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.956+0000 7f200c9f4640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20080bd3c0 0x7f20080c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:02.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.956+0000 7f200c9f4640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20080c8400 con 0x7f20080c7c30 2023-12-19T18:59:02.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.956+0000 7f200c9f4640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20080c86e0 con 0x7f2008151bb0 2023-12-19T18:59:02.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.956+0000 7f200c9f4640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20081543e0 con 0x7f20080bd3c0 2023-12-19T18:59:02.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.956+0000 7f2006d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2008151bb0 0x7f200806ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:02.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.956+0000 7f200759e640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f20080c7c30 0x7f20081579d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41146/0 (socket says 172.21.15.133:41146) 2023-12-19T18:59:02.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.956+0000 7f200759e640 1 -- 172.21.15.133:0/887141469 learned_addr learned my addr 172.21.15.133:0/887141469 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:02.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.956+0000 7f1ffffff640 1 --2- 172.21.15.133:0/887141469 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20080bd3c0 0x7f20080c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:02.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.956+0000 7f2006d9d640 1 -- 172.21.15.133:0/887141469 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20080bd3c0 msgr2=0x7f20080c46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:02.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.956+0000 7f2006d9d640 1 --2- 172.21.15.133:0/887141469 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20080bd3c0 0x7f20080c46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:02.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.956+0000 7f2006d9d640 1 -- 172.21.15.133:0/887141469 >> v1:172.21.15.133:6789/0 conn(0x7f20080c7c30 legacy=0x7f20081579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:02.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.956+0000 7f2006d9d640 1 -- 172.21.15.133:0/887141469 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20081545f0 con 0x7f2008151bb0 2023-12-19T18:59:02.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.956+0000 7f200659c640 1 -- 172.21.15.133:0/887141469 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150222268 0 0) 0x7f20080c8400 con 0x7f20080c7c30 2023-12-19T18:59:02.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f2006d9d640 1 --2- 172.21.15.133:0/887141469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2008151bb0 0x7f200806ba40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1ff80097c0 tx=0x7f1ff801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16373933ae3c7d79 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:02.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f200659c640 1 -- 172.21.15.133:0/887141469 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff80ab600 con 0x7f2008151bb0 2023-12-19T18:59:02.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f200659c640 1 -- 172.21.15.133:0/887141469 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff80a7050 con 0x7f2008151bb0 2023-12-19T18:59:02.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f200659c640 1 -- 172.21.15.133:0/887141469 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff80ab980 con 0x7f2008151bb0 2023-12-19T18:59:02.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f200c9f4640 1 -- 172.21.15.133:0/887141469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2008151bb0 msgr2=0x7f200806ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:02.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f200c9f4640 1 --2- 172.21.15.133:0/887141469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2008151bb0 0x7f200806ba40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1ff80097c0 tx=0x7f1ff801c330 comp rx=0 tx=0).stop 2023-12-19T18:59:02.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f200c9f4640 1 -- 172.21.15.133:0/887141469 shutdown_connections 2023-12-19T18:59:02.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f200c9f4640 1 --2- 172.21.15.133:0/887141469 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20080bd3c0 0x7f20080c46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:02.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f200c9f4640 1 --2- 172.21.15.133:0/887141469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2008151bb0 0x7f200806ba40 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:02.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f200c9f4640 1 -- 172.21.15.133:0/887141469 >> 172.21.15.133:0/887141469 conn(0x7f20080abcc0 msgr2=0x7f20080ac0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:02.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f200c9f4640 1 -- 172.21.15.133:0/887141469 shutdown_connections 2023-12-19T18:59:02.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f200c9f4640 1 -- 172.21.15.133:0/887141469 wait complete. 2023-12-19T18:59:02.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f200c9f4640 1 Processor -- start 2023-12-19T18:59:02.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f200c9f4640 1 -- start start 2023-12-19T18:59:02.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f200c9f4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20080bd3c0 0x7f2008157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:02.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f200c9f4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20080c7c30 0x7f2008145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:02.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f200c9f4640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2008151bb0 0x7f2008146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:02.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f200c9f4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20080c3900 con 0x7f20080c7c30 2023-12-19T18:59:02.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f200c9f4640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2008146980 con 0x7f20080bd3c0 2023-12-19T18:59:02.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f200c9f4640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20080c12e0 con 0x7f2008151bb0 2023-12-19T18:59:02.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f1ffffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20080c7c30 0x7f2008145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:02.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f1ffffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20080c7c30 0x7f2008145f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34058/0 (socket says 172.21.15.133:34058) 2023-12-19T18:59:02.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f1ffffff640 1 -- 172.21.15.133:0/4209641033 learned_addr learned my addr 172.21.15.133:0/4209641033 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:02.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.960+0000 7f2006d9d640 1 --2- 172.21.15.133:0/4209641033 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20080bd3c0 0x7f2008157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:02.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.964+0000 7f200759e640 1 --2- 172.21.15.133:0/4209641033 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2008151bb0 0x7f2008146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:02.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.964+0000 7f1ffffff640 1 -- 172.21.15.133:0/4209641033 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2008151bb0 msgr2=0x7f2008146440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:02.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.964+0000 7f1ffffff640 1 --2- 172.21.15.133:0/4209641033 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2008151bb0 0x7f2008146440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:02.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.964+0000 7f1ffffff640 1 -- 172.21.15.133:0/4209641033 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20080bd3c0 msgr2=0x7f2008157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:02.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.964+0000 7f1ffffff640 1 --2- 172.21.15.133:0/4209641033 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20080bd3c0 0x7f2008157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:02.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.964+0000 7f1ffffff640 1 -- 172.21.15.133:0/4209641033 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff8009420 con 0x7f20080c7c30 2023-12-19T18:59:02.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.964+0000 7f1ffffff640 1 --2- 172.21.15.133:0/4209641033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20080c7c30 0x7f2008145f00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000e870 tx=0x7f1ff000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:02.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.964+0000 7f1fff7fe640 1 -- 172.21.15.133:0/4209641033 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0009510 con 0x7f20080c7c30 2023-12-19T18:59:02.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.964+0000 7f1fff7fe640 1 -- 172.21.15.133:0/4209641033 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff000eec0 con 0x7f20080c7c30 2023-12-19T18:59:02.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.964+0000 7f200c9f4640 1 -- 172.21.15.133:0/4209641033 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20080c3ae0 con 0x7f20080c7c30 2023-12-19T18:59:02.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.964+0000 7f1fff7fe640 1 -- 172.21.15.133:0/4209641033 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff000cb40 con 0x7f20080c7c30 2023-12-19T18:59:02.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.964+0000 7f200c9f4640 1 -- 172.21.15.133:0/4209641033 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2008157790 con 0x7f20080c7c30 2023-12-19T18:59:02.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.964+0000 7f200c9f4640 1 -- 172.21.15.133:0/4209641033 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2008067e90 con 0x7f20080c7c30 2023-12-19T18:59:02.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.964+0000 7f1fff7fe640 1 -- 172.21.15.133:0/4209641033 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1ff000cca0 con 0x7f20080c7c30 2023-12-19T18:59:02.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.964+0000 7f1fff7fe640 1 --2- 172.21.15.133:0/4209641033 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fe80664a0 0x7f1fe8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:02.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.964+0000 7f1fff7fe640 1 -- 172.21.15.133:0/4209641033 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ff0083eb0 con 0x7f20080c7c30 2023-12-19T18:59:02.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.964+0000 7f2006d9d640 1 --2- 172.21.15.133:0/4209641033 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fe80664a0 0x7f1fe8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:02.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.968+0000 7f2006d9d640 1 --2- 172.21.15.133:0/4209641033 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fe80664a0 0x7f1fe8068960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1ff80ad000 tx=0x7f1ff80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:02.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:02.968+0000 7f1fff7fe640 1 -- 172.21.15.133:0/4209641033 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1ff00513d0 con 0x7f20080c7c30 2023-12-19T18:59:03.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.120+0000 7f200c9f4640 1 -- 172.21.15.133:0/4209641033 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f20081f0860 con 0x7f20080c7c30 2023-12-19T18:59:03.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.120+0000 7f1fff7fe640 1 -- 172.21.15.133:0/4209641033 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f20081f0860 con 0x7f20080c7c30 2023-12-19T18:59:03.126 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T18:59:03.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.124+0000 7f200c9f4640 1 -- 172.21.15.133:0/4209641033 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fe80664a0 msgr2=0x7f1fe8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:03.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.124+0000 7f200c9f4640 1 --2- 172.21.15.133:0/4209641033 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fe80664a0 0x7f1fe8068960 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1ff80ad000 tx=0x7f1ff80a6000 comp rx=0 tx=0).stop 2023-12-19T18:59:03.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.124+0000 7f200c9f4640 1 -- 172.21.15.133:0/4209641033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20080c7c30 msgr2=0x7f2008145f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:03.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.124+0000 7f200c9f4640 1 --2- 172.21.15.133:0/4209641033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20080c7c30 0x7f2008145f00 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1ff000e870 tx=0x7f1ff000ec70 comp rx=0 tx=0).stop 2023-12-19T18:59:03.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.124+0000 7f200c9f4640 1 -- 172.21.15.133:0/4209641033 shutdown_connections 2023-12-19T18:59:03.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.124+0000 7f200c9f4640 1 --2- 172.21.15.133:0/4209641033 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fe80664a0 0x7f1fe8068960 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.124+0000 7f200c9f4640 1 --2- 172.21.15.133:0/4209641033 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2008151bb0 0x7f2008146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.124+0000 7f200c9f4640 1 --2- 172.21.15.133:0/4209641033 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20080c7c30 0x7f2008145f00 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.124+0000 7f200c9f4640 1 --2- 172.21.15.133:0/4209641033 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20080bd3c0 0x7f2008157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.124+0000 7f200c9f4640 1 -- 172.21.15.133:0/4209641033 >> 172.21.15.133:0/4209641033 conn(0x7f20080abcc0 msgr2=0x7f200806c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:03.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.124+0000 7f200c9f4640 1 -- 172.21.15.133:0/4209641033 shutdown_connections 2023-12-19T18:59:03.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.124+0000 7f200c9f4640 1 -- 172.21.15.133:0/4209641033 wait complete. 2023-12-19T18:59:03.147 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:59:03.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.284+0000 7fa884580640 1 Processor -- start 2023-12-19T18:59:03.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.284+0000 7fa884580640 1 -- start start 2023-12-19T18:59:03.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.284+0000 7fa884580640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa87c0c63c0 0x7fa87c0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:03.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.284+0000 7fa884580640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa87c0c4100 0x7fa87c0c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:03.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.284+0000 7fa884580640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87c0c31c0 con 0x7fa87c0c29e0 2023-12-19T18:59:03.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.284+0000 7fa884580640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87c0c34a0 con 0x7fa87c0c63c0 2023-12-19T18:59:03.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.284+0000 7fa884580640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c0c1030 con 0x7fa87c0c4100 2023-12-19T18:59:03.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.284+0000 7fa88231c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa87c0c63c0 0x7fa87c0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:03.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.284+0000 7fa88231c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa87c0c63c0 0x7fa87c0c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34068/0 (socket says 172.21.15.133:34068) 2023-12-19T18:59:03.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.284+0000 7fa88231c640 1 -- 172.21.15.133:0/2338505007 learned_addr learned my addr 172.21.15.133:0/2338505007 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:03.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.284+0000 7fa881b1b640 1 --2- 172.21.15.133:0/2338505007 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa87c0c4100 0x7fa87c0c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:03.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.288+0000 7fa88231c640 1 -- 172.21.15.133:0/2338505007 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa87c0c4100 msgr2=0x7fa87c0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:03.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.288+0000 7fa88231c640 1 --2- 172.21.15.133:0/2338505007 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa87c0c4100 0x7fa87c0c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.288+0000 7fa88231c640 1 -- 172.21.15.133:0/2338505007 >> v1:172.21.15.138:6789/0 conn(0x7fa87c0c29e0 legacy=0x7fa87c0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:03.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.288+0000 7fa88231c640 1 -- 172.21.15.133:0/2338505007 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c0c1310 con 0x7fa87c0c63c0 2023-12-19T18:59:03.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.288+0000 7fa881b1b640 1 --2- 172.21.15.133:0/2338505007 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa87c0c4100 0x7fa87c0c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:03.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.288+0000 7fa88231c640 1 --2- 172.21.15.133:0/2338505007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87c0c63c0 0x7fa87c0c06d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa878009870 tx=0x7fa87801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=878c5aa980f94814 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:03.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.288+0000 7fa88131a640 1 -- 172.21.15.133:0/2338505007 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8780ab610 con 0x7fa87c0c63c0 2023-12-19T18:59:03.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.288+0000 7fa88131a640 1 -- 172.21.15.133:0/2338505007 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8780ab770 con 0x7fa87c0c63c0 2023-12-19T18:59:03.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.288+0000 7fa88131a640 1 -- 172.21.15.133:0/2338505007 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8780abb00 con 0x7fa87c0c63c0 2023-12-19T18:59:03.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.288+0000 7fa884580640 1 -- 172.21.15.133:0/2338505007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87c0c63c0 msgr2=0x7fa87c0c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:03.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.288+0000 7fa884580640 1 --2- 172.21.15.133:0/2338505007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87c0c63c0 0x7fa87c0c06d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa878009870 tx=0x7fa87801c3f0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa884580640 1 -- 172.21.15.133:0/2338505007 shutdown_connections 2023-12-19T18:59:03.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa884580640 1 --2- 172.21.15.133:0/2338505007 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa87c0c4100 0x7fa87c0c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa884580640 1 --2- 172.21.15.133:0/2338505007 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87c0c63c0 0x7fa87c0c06d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa884580640 1 -- 172.21.15.133:0/2338505007 >> 172.21.15.133:0/2338505007 conn(0x7fa87c06a5b0 msgr2=0x7fa87c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:03.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa884580640 1 -- 172.21.15.133:0/2338505007 shutdown_connections 2023-12-19T18:59:03.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa884580640 1 -- 172.21.15.133:0/2338505007 wait complete. 2023-12-19T18:59:03.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa884580640 1 Processor -- start 2023-12-19T18:59:03.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa884580640 1 -- start start 2023-12-19T18:59:03.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa884580640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa87c0c29e0 0x7fa87c0be0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:03.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa884580640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87c0c4100 0x7fa87c15b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:03.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa884580640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa87c0c63c0 0x7fa87c154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:03.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa884580640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c15aac0 con 0x7fa87c0c4100 2023-12-19T18:59:03.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa884580640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c0be620 con 0x7fa87c0c29e0 2023-12-19T18:59:03.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa884580640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c0721b0 con 0x7fa87c0c63c0 2023-12-19T18:59:03.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa881b1b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87c0c4100 0x7fa87c15b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:03.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa881b1b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87c0c4100 0x7fa87c15b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34078/0 (socket says 172.21.15.133:34078) 2023-12-19T18:59:03.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa881b1b640 1 -- 172.21.15.133:0/4203215822 learned_addr learned my addr 172.21.15.133:0/4203215822 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:03.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa88231c640 1 --2- 172.21.15.133:0/4203215822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa87c0c29e0 0x7fa87c0be0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:03.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa882b1d640 1 --2- 172.21.15.133:0/4203215822 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa87c0c63c0 0x7fa87c154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:03.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa881b1b640 1 -- 172.21.15.133:0/4203215822 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa87c0c63c0 msgr2=0x7fa87c154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:03.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa881b1b640 1 --2- 172.21.15.133:0/4203215822 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa87c0c63c0 0x7fa87c154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa881b1b640 1 -- 172.21.15.133:0/4203215822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa87c0c29e0 msgr2=0x7fa87c0be0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:03.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa881b1b640 1 --2- 172.21.15.133:0/4203215822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa87c0c29e0 0x7fa87c0be0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa881b1b640 1 -- 172.21.15.133:0/4203215822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8780094d0 con 0x7fa87c0c4100 2023-12-19T18:59:03.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.292+0000 7fa881b1b640 1 --2- 172.21.15.133:0/4203215822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87c0c4100 0x7fa87c15b270 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa86c00e840 tx=0x7fa86c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:03.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.296+0000 7fa872ffd640 1 -- 172.21.15.133:0/4203215822 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c00c8d0 con 0x7fa87c0c4100 2023-12-19T18:59:03.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.296+0000 7fa872ffd640 1 -- 172.21.15.133:0/4203215822 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86c00ca30 con 0x7fa87c0c4100 2023-12-19T18:59:03.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.296+0000 7fa872ffd640 1 -- 172.21.15.133:0/4203215822 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c00cdc0 con 0x7fa87c0c4100 2023-12-19T18:59:03.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.296+0000 7fa884580640 1 -- 172.21.15.133:0/4203215822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87c15a820 con 0x7fa87c0c4100 2023-12-19T18:59:03.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.296+0000 7fa884580640 1 -- 172.21.15.133:0/4203215822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87c0bf830 con 0x7fa87c0c4100 2023-12-19T18:59:03.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.296+0000 7fa884580640 1 -- 172.21.15.133:0/4203215822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa87c1ec240 con 0x7fa87c0c4100 2023-12-19T18:59:03.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.296+0000 7fa872ffd640 1 -- 172.21.15.133:0/4203215822 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa86c013410 con 0x7fa87c0c4100 2023-12-19T18:59:03.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.296+0000 7fa872ffd640 1 --2- 172.21.15.133:0/4203215822 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa8600664a0 0x7fa860068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:03.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.296+0000 7fa872ffd640 1 -- 172.21.15.133:0/4203215822 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa86c083af0 con 0x7fa87c0c4100 2023-12-19T18:59:03.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.296+0000 7fa88231c640 1 --2- 172.21.15.133:0/4203215822 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa8600664a0 0x7fa860068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:03.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.300+0000 7fa88231c640 1 --2- 172.21.15.133:0/4203215822 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa8600664a0 0x7fa860068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa8780af000 tx=0x7fa8780b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:03.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.300+0000 7fa872ffd640 1 -- 172.21.15.133:0/4203215822 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa86c0510b0 con 0x7fa87c0c4100 2023-12-19T18:59:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.448+0000 7fa884580640 1 -- 172.21.15.133:0/4203215822 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa87c068400 con 0x7fa87c0c4100 2023-12-19T18:59:03.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.448+0000 7fa872ffd640 1 -- 172.21.15.133:0/4203215822 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa86c009480 con 0x7fa87c0c4100 2023-12-19T18:59:03.455 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T18:59:03.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.452+0000 7fa884580640 1 -- 172.21.15.133:0/4203215822 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa8600664a0 msgr2=0x7fa860068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:03.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.452+0000 7fa884580640 1 --2- 172.21.15.133:0/4203215822 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa8600664a0 0x7fa860068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa8780af000 tx=0x7fa8780b6040 comp rx=0 tx=0).stop 2023-12-19T18:59:03.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.452+0000 7fa884580640 1 -- 172.21.15.133:0/4203215822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87c0c4100 msgr2=0x7fa87c15b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.452+0000 7fa884580640 1 --2- 172.21.15.133:0/4203215822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87c0c4100 0x7fa87c15b270 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa86c00e840 tx=0x7fa86c00ed00 comp rx=0 tx=0).stop 2023-12-19T18:59:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.452+0000 7fa884580640 1 -- 172.21.15.133:0/4203215822 shutdown_connections 2023-12-19T18:59:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.452+0000 7fa884580640 1 --2- 172.21.15.133:0/4203215822 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa8600664a0 0x7fa860068960 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.452+0000 7fa884580640 1 --2- 172.21.15.133:0/4203215822 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa87c0c63c0 0x7fa87c154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.452+0000 7fa884580640 1 --2- 172.21.15.133:0/4203215822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa87c0c4100 0x7fa87c15b270 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.452+0000 7fa884580640 1 --2- 172.21.15.133:0/4203215822 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa87c0c29e0 0x7fa87c0be0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.452+0000 7fa884580640 1 -- 172.21.15.133:0/4203215822 >> 172.21.15.133:0/4203215822 conn(0x7fa87c06a5b0 msgr2=0x7fa87c0a72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.452+0000 7fa884580640 1 -- 172.21.15.133:0/4203215822 shutdown_connections 2023-12-19T18:59:03.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.452+0000 7fa884580640 1 -- 172.21.15.133:0/4203215822 wait complete. 2023-12-19T18:59:03.475 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:59:03.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.608+0000 7f057849a640 1 Processor -- start 2023-12-19T18:59:03.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.608+0000 7f057849a640 1 -- start start 2023-12-19T18:59:03.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.612+0000 7f057849a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f057014b010 0x7f05700bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:03.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.612+0000 7f057849a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0570073a70 0x7f057006b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:03.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.612+0000 7f057849a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f057006b540 0x7f0570157c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:03.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.612+0000 7f057849a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057006a5b0 con 0x7f0570073a70 2023-12-19T18:59:03.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.612+0000 7f057849a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05700c1d60 con 0x7f057006b540 2023-12-19T18:59:03.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.612+0000 7f057849a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05700c2040 con 0x7f057014b010 2023-12-19T18:59:03.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.612+0000 7f0575a35640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0570073a70 0x7f057006b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:03.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.612+0000 7f0575a35640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0570073a70 0x7f057006b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34088/0 (socket says 172.21.15.133:34088) 2023-12-19T18:59:03.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.612+0000 7f0575a35640 1 -- 172.21.15.133:0/260426984 learned_addr learned my addr 172.21.15.133:0/260426984 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:03.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.612+0000 7f0576236640 1 --2- 172.21.15.133:0/260426984 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f057014b010 0x7f05700bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:03.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.612+0000 7f0576a37640 1 --2- 172.21.15.133:0/260426984 >> v2:172.21.15.138:3300/0 conn(0x7f057006b540 0x7f0570157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:03.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.612+0000 7f0575a35640 1 -- 172.21.15.133:0/260426984 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f057014b010 msgr2=0x7f05700bf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:03.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.612+0000 7f0575a35640 1 --2- 172.21.15.133:0/260426984 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f057014b010 0x7f05700bf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.612+0000 7f0575a35640 1 -- 172.21.15.133:0/260426984 >> v2:172.21.15.138:3300/0 conn(0x7f057006b540 msgr2=0x7f0570157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:03.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.612+0000 7f0575a35640 1 --2- 172.21.15.133:0/260426984 >> v2:172.21.15.138:3300/0 conn(0x7f057006b540 0x7f0570157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.612+0000 7f0575a35640 1 -- 172.21.15.133:0/260426984 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057006a800 con 0x7f0570073a70 2023-12-19T18:59:03.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.616+0000 7f0575a35640 1 --2- 172.21.15.133:0/260426984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0570073a70 0x7f057006b000 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f05700704f0 tx=0x7f056001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186df1fc529c8333 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:03.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.616+0000 7f0575234640 1 -- 172.21.15.133:0/260426984 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05600a89b0 con 0x7f0570073a70 2023-12-19T18:59:03.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.616+0000 7f0575234640 1 -- 172.21.15.133:0/260426984 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05600a8b10 con 0x7f0570073a70 2023-12-19T18:59:03.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.616+0000 7f0575234640 1 -- 172.21.15.133:0/260426984 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05600a8ea0 con 0x7f0570073a70 2023-12-19T18:59:03.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.616+0000 7f057849a640 1 -- 172.21.15.133:0/260426984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0570073a70 msgr2=0x7f057006b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:03.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.616+0000 7f057849a640 1 --2- 172.21.15.133:0/260426984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0570073a70 0x7f057006b000 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f05700704f0 tx=0x7f056001ecf0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.616+0000 7f057849a640 1 -- 172.21.15.133:0/260426984 shutdown_connections 2023-12-19T18:59:03.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.616+0000 7f057849a640 1 --2- 172.21.15.133:0/260426984 >> v2:172.21.15.138:3300/0 conn(0x7f057006b540 0x7f0570157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.616+0000 7f057849a640 1 --2- 172.21.15.133:0/260426984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0570073a70 0x7f057006b000 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.616+0000 7f057849a640 1 --2- 172.21.15.133:0/260426984 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f057014b010 0x7f05700bf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.616+0000 7f057849a640 1 -- 172.21.15.133:0/260426984 >> 172.21.15.133:0/260426984 conn(0x7f05700c30c0 msgr2=0x7f05700c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:03.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.616+0000 7f057849a640 1 -- 172.21.15.133:0/260426984 shutdown_connections 2023-12-19T18:59:03.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.616+0000 7f057849a640 1 -- 172.21.15.133:0/260426984 wait complete. 2023-12-19T18:59:03.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.616+0000 7f057849a640 1 Processor -- start 2023-12-19T18:59:03.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.616+0000 7f057849a640 1 -- start start 2023-12-19T18:59:03.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f057849a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0570073a70 0x7f0570147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:03.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f057849a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f057014b010 0x7f05701ea000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:03.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f057849a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05701e14f0 0x7f05700abf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:03.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f057849a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05701def70 con 0x7f0570073a70 2023-12-19T18:59:03.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f057849a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0570148520 con 0x7f057014b010 2023-12-19T18:59:03.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f057849a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05701ea540 con 0x7f05701e14f0 2023-12-19T18:59:03.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f0576236640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0570073a70 0x7f0570147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:03.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f0576236640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0570073a70 0x7f0570147fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34094/0 (socket says 172.21.15.133:34094) 2023-12-19T18:59:03.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f0576236640 1 -- 172.21.15.133:0/1235074228 learned_addr learned my addr 172.21.15.133:0/1235074228 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:03.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f0575a35640 1 --2- 172.21.15.133:0/1235074228 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f057014b010 0x7f05701ea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:03.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f0576a37640 1 --2- 172.21.15.133:0/1235074228 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05701e14f0 0x7f05700abf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:03.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f0576236640 1 -- 172.21.15.133:0/1235074228 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05701e14f0 msgr2=0x7f05700abf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:03.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f0576236640 1 --2- 172.21.15.133:0/1235074228 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05701e14f0 0x7f05700abf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f0576236640 1 -- 172.21.15.133:0/1235074228 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f057014b010 msgr2=0x7f05701ea000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:03.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f0576236640 1 --2- 172.21.15.133:0/1235074228 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f057014b010 0x7f05701ea000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f0576236640 1 -- 172.21.15.133:0/1235074228 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05600094d0 con 0x7f0570073a70 2023-12-19T18:59:03.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f0576236640 1 --2- 172.21.15.133:0/1235074228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0570073a70 0x7f0570147fe0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f056c00e8a0 tx=0x7f056c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:03.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f0566ffd640 1 -- 172.21.15.133:0/1235074228 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c009510 con 0x7f0570073a70 2023-12-19T18:59:03.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f0566ffd640 1 -- 172.21.15.133:0/1235074228 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f056c00c940 con 0x7f0570073a70 2023-12-19T18:59:03.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f057849a640 1 -- 172.21.15.133:0/1235074228 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05701ea7c0 con 0x7f0570073a70 2023-12-19T18:59:03.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f0566ffd640 1 -- 172.21.15.133:0/1235074228 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056c00ccb0 con 0x7f0570073a70 2023-12-19T18:59:03.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f057849a640 1 -- 172.21.15.133:0/1235074228 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05701ead80 con 0x7f0570073a70 2023-12-19T18:59:03.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f057849a640 1 -- 172.21.15.133:0/1235074228 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05701eaf70 con 0x7f0570073a70 2023-12-19T18:59:03.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.620+0000 7f0566ffd640 1 -- 172.21.15.133:0/1235074228 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f056c013470 con 0x7f0570073a70 2023-12-19T18:59:03.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.624+0000 7f0566ffd640 1 --2- 172.21.15.133:0/1235074228 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0554066470 0x7f0554068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:03.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.624+0000 7f0566ffd640 1 -- 172.21.15.133:0/1235074228 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f056c0848b0 con 0x7f0570073a70 2023-12-19T18:59:03.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.624+0000 7f0575a35640 1 --2- 172.21.15.133:0/1235074228 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0554066470 0x7f0554068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:03.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.624+0000 7f0575a35640 1 --2- 172.21.15.133:0/1235074228 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0554066470 0x7f0554068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f05600b2000 tx=0x7f0560009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:03.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.628+0000 7f0566ffd640 1 -- 172.21.15.133:0/1235074228 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f056c0513b0 con 0x7f0570073a70 2023-12-19T18:59:03.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.776+0000 7f057849a640 1 -- 172.21.15.133:0/1235074228 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0570068400 con 0x7f0570073a70 2023-12-19T18:59:03.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.776+0000 7f0566ffd640 1 -- 172.21.15.133:0/1235074228 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f056c0549d0 con 0x7f0570073a70 2023-12-19T18:59:03.782 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T18:59:03.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.780+0000 7f057849a640 1 -- 172.21.15.133:0/1235074228 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0554066470 msgr2=0x7f0554068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:03.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.780+0000 7f057849a640 1 --2- 172.21.15.133:0/1235074228 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0554066470 0x7f0554068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f05600b2000 tx=0x7f0560009040 comp rx=0 tx=0).stop 2023-12-19T18:59:03.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.780+0000 7f057849a640 1 -- 172.21.15.133:0/1235074228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0570073a70 msgr2=0x7f0570147fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:03.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.780+0000 7f057849a640 1 --2- 172.21.15.133:0/1235074228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0570073a70 0x7f0570147fe0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f056c00e8a0 tx=0x7f056c00eca0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.780+0000 7f057849a640 1 -- 172.21.15.133:0/1235074228 shutdown_connections 2023-12-19T18:59:03.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.780+0000 7f057849a640 1 --2- 172.21.15.133:0/1235074228 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0554066470 0x7f0554068930 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.780+0000 7f057849a640 1 --2- 172.21.15.133:0/1235074228 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05701e14f0 0x7f05700abf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.780+0000 7f057849a640 1 --2- 172.21.15.133:0/1235074228 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f057014b010 0x7f05701ea000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.780+0000 7f057849a640 1 --2- 172.21.15.133:0/1235074228 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0570073a70 0x7f0570147fe0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.780+0000 7f057849a640 1 -- 172.21.15.133:0/1235074228 >> 172.21.15.133:0/1235074228 conn(0x7f05700c30c0 msgr2=0x7f0570148c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:03.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.780+0000 7f057849a640 1 -- 172.21.15.133:0/1235074228 shutdown_connections 2023-12-19T18:59:03.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.780+0000 7f057849a640 1 -- 172.21.15.133:0/1235074228 wait complete. 2023-12-19T18:59:03.803 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:59:03.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.936+0000 7fa33b92a640 1 Processor -- start 2023-12-19T18:59:03.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.936+0000 7fa33b92a640 1 -- start start 2023-12-19T18:59:03.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.936+0000 7fa33b92a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3340c5260 0x7fa33406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:03.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.936+0000 7fa33b92a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa334156960 con 0x7fa334155de0 2023-12-19T18:59:03.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.936+0000 7fa33b92a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3340c2580 con 0x7fa3340c5640 2023-12-19T18:59:03.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.936+0000 7fa33b92a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa334153510 con 0x7fa3340c5260 2023-12-19T18:59:03.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.936+0000 7fa339ec7640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa334155de0 0x7fa334156250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41160/0 (socket says 172.21.15.133:41160) 2023-12-19T18:59:03.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.936+0000 7fa339ec7640 1 -- 172.21.15.133:0/996192849 learned_addr learned my addr 172.21.15.133:0/996192849 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.936+0000 7fa3396c6640 1 --2- 172.21.15.133:0/996192849 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3340c5260 0x7fa33406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa32bfff640 1 -- 172.21.15.133:0/996192849 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4136858315 0 0) 0x7fa32c0014a0 con 0x7fa334155de0 2023-12-19T18:59:03.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa32bfff640 1 -- 172.21.15.133:0/996192849 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa320003530 con 0x7fa334155de0 2023-12-19T18:59:03.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa32bfff640 1 -- 172.21.15.133:0/996192849 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876796318 0 0) 0x7fa3340c2580 con 0x7fa3340c5640 2023-12-19T18:59:03.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa32bfff640 1 -- 172.21.15.133:0/996192849 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa32c0014a0 con 0x7fa3340c5640 2023-12-19T18:59:03.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa32bfff640 1 -- 172.21.15.133:0/996192849 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3925515879 0 0) 0x7fa320003530 con 0x7fa334155de0 2023-12-19T18:59:03.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa32bfff640 1 -- 172.21.15.133:0/996192849 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3340c5260 msgr2=0x7fa33406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:03.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa32bfff640 1 --2- 172.21.15.133:0/996192849 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3340c5260 0x7fa33406d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa32bfff640 1 -- 172.21.15.133:0/996192849 >> v1:172.21.15.138:6789/0 conn(0x7fa3340c5640 legacy=0x7fa3340c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:03.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa32bfff640 1 -- 172.21.15.133:0/996192849 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3340c1a00 con 0x7fa334155de0 2023-12-19T18:59:03.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa32bfff640 1 -- 172.21.15.133:0/996192849 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7fa32c001bb0 con 0x7fa334155de0 2023-12-19T18:59:03.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa32bfff640 1 -- 172.21.15.133:0/996192849 >> v1:172.21.15.133:6789/0 conn(0x7fa334155de0 legacy=0x7fa334156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:03.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa32bfff640 1 --2- 172.21.15.133:0/996192849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa320003b40 0x7fa320003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:03.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa32bfff640 1 --2- 172.21.15.133:0/996192849 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3340c5260 0x7fa3200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:03.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa32bfff640 1 --2- 172.21.15.133:0/996192849 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa320004d10 0x7fa320005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:03.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa32bfff640 1 -- 172.21.15.133:0/996192849 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32000ba60 con 0x7fa320003b40 2023-12-19T18:59:03.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa32bfff640 1 -- 172.21.15.133:0/996192849 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32000bbd0 con 0x7fa320004d10 2023-12-19T18:59:03.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa32bfff640 1 -- 172.21.15.133:0/996192849 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32000bd90 con 0x7fa3340c5260 2023-12-19T18:59:03.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa3396c6640 1 --2- 172.21.15.133:0/996192849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa320003b40 0x7fa320003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:03.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa339ec7640 1 --2- 172.21.15.133:0/996192849 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa320004d10 0x7fa320005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:03.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa338ec5640 1 --2- 172.21.15.133:0/996192849 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3340c5260 0x7fa3200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:03.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa3396c6640 1 -- 172.21.15.133:0/996192849 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3340c5260 msgr2=0x7fa3200047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:03.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa3396c6640 1 --2- 172.21.15.133:0/996192849 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3340c5260 0x7fa3200047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa3396c6640 1 -- 172.21.15.133:0/996192849 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa320004d10 msgr2=0x7fa320005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:03.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa3396c6640 1 --2- 172.21.15.133:0/996192849 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa320004d10 0x7fa320005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa3396c6640 1 -- 172.21.15.133:0/996192849 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa320003530 con 0x7fa320003b40 2023-12-19T18:59:03.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.940+0000 7fa3396c6640 1 --2- 172.21.15.133:0/996192849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa320003b40 0x7fa320003f40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa330009ae0 tx=0x7fa33001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b32d18e9e2318f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:03.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.944+0000 7fa32bfff640 1 -- 172.21.15.133:0/996192849 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3300a5510 con 0x7fa320003b40 2023-12-19T18:59:03.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.944+0000 7fa32bfff640 1 -- 172.21.15.133:0/996192849 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3300a5670 con 0x7fa320003b40 2023-12-19T18:59:03.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.944+0000 7fa32bfff640 1 -- 172.21.15.133:0/996192849 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3300a5a20 con 0x7fa320003b40 2023-12-19T18:59:03.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.944+0000 7fa33b92a640 1 -- 172.21.15.133:0/996192849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa320003b40 msgr2=0x7fa320003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:03.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.944+0000 7fa33b92a640 1 --2- 172.21.15.133:0/996192849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa320003b40 0x7fa320003f40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa330009ae0 tx=0x7fa33001ca50 comp rx=0 tx=0).stop 2023-12-19T18:59:03.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.944+0000 7fa339ec7640 1 -- 172.21.15.133:0/996192849 reap_dead start 2023-12-19T18:59:03.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.944+0000 7fa33b92a640 1 -- 172.21.15.133:0/996192849 shutdown_connections 2023-12-19T18:59:03.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.944+0000 7fa33b92a640 1 -- 172.21.15.133:0/996192849 >> 172.21.15.133:0/996192849 conn(0x7fa33406a5b0 msgr2=0x7fa33406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:03.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.944+0000 7fa33b92a640 1 -- 172.21.15.133:0/996192849 shutdown_connections 2023-12-19T18:59:03.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.944+0000 7fa33b92a640 1 -- 172.21.15.133:0/996192849 wait complete. 2023-12-19T18:59:03.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.944+0000 7fa33b92a640 1 Processor -- start 2023-12-19T18:59:03.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.944+0000 7fa33b92a640 1 -- start start 2023-12-19T18:59:03.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.944+0000 7fa33b92a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa320003b40 0x7fa3340bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:03.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.944+0000 7fa33b92a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3341ed480 0x7fa3340a9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:03.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.944+0000 7fa33b92a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3340a5060 0x7fa3340a96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:03.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.944+0000 7fa33b92a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3341ed940 con 0x7fa3340a5060 2023-12-19T18:59:03.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.944+0000 7fa33b92a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3340aa0c0 con 0x7fa320003b40 2023-12-19T18:59:03.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.944+0000 7fa33b92a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3340aa3a0 con 0x7fa3341ed480 2023-12-19T18:59:03.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.944+0000 7fa339ec7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3340a5060 0x7fa3340a96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:03.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.944+0000 7fa339ec7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3340a5060 0x7fa3340a96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34108/0 (socket says 172.21.15.133:34108) 2023-12-19T18:59:03.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.944+0000 7fa339ec7640 1 -- 172.21.15.133:0/2784391021 learned_addr learned my addr 172.21.15.133:0/2784391021 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:03.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.948+0000 7fa338ec5640 1 --2- 172.21.15.133:0/2784391021 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3341ed480 0x7fa3340a9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:03.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.948+0000 7fa3396c6640 1 --2- 172.21.15.133:0/2784391021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa320003b40 0x7fa3340bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:03.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.948+0000 7fa339ec7640 1 -- 172.21.15.133:0/2784391021 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3341ed480 msgr2=0x7fa3340a9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:03.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.948+0000 7fa339ec7640 1 --2- 172.21.15.133:0/2784391021 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3341ed480 0x7fa3340a9160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.948+0000 7fa339ec7640 1 -- 172.21.15.133:0/2784391021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa320003b40 msgr2=0x7fa3340bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:03.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.948+0000 7fa339ec7640 1 --2- 172.21.15.133:0/2784391021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa320003b40 0x7fa3340bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:03.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.948+0000 7fa339ec7640 1 -- 172.21.15.133:0/2784391021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3340aa680 con 0x7fa3340a5060 2023-12-19T18:59:03.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.948+0000 7fa3396c6640 1 --2- 172.21.15.133:0/2784391021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa320003b40 0x7fa3340bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:03.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.948+0000 7fa339ec7640 1 --2- 172.21.15.133:0/2784391021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3340a5060 0x7fa3340a96a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa3340c6b10 tx=0x7fa32c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:03.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.948+0000 7fa329ffb640 1 -- 172.21.15.133:0/2784391021 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c00ee20 con 0x7fa3340a5060 2023-12-19T18:59:03.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.948+0000 7fa329ffb640 1 -- 172.21.15.133:0/2784391021 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32c013420 con 0x7fa3340a5060 2023-12-19T18:59:03.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.948+0000 7fa33b92a640 1 -- 172.21.15.133:0/2784391021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3340bf8a0 con 0x7fa3340a5060 2023-12-19T18:59:03.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.948+0000 7fa329ffb640 1 -- 172.21.15.133:0/2784391021 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c0137d0 con 0x7fa3340a5060 2023-12-19T18:59:03.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.948+0000 7fa33b92a640 1 -- 172.21.15.133:0/2784391021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3340a9be0 con 0x7fa3340a5060 2023-12-19T18:59:03.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.948+0000 7fa33b92a640 1 -- 172.21.15.133:0/2784391021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3340a8e80 con 0x7fa3340a5060 2023-12-19T18:59:03.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.948+0000 7fa329ffb640 1 -- 172.21.15.133:0/2784391021 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa32c013930 con 0x7fa3340a5060 2023-12-19T18:59:03.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.952+0000 7fa329ffb640 1 --2- 172.21.15.133:0/2784391021 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa318066470 0x7fa318068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:03.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.952+0000 7fa329ffb640 1 -- 172.21.15.133:0/2784391021 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa32c084300 con 0x7fa3340a5060 2023-12-19T18:59:03.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.952+0000 7fa3396c6640 1 --2- 172.21.15.133:0/2784391021 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa318066470 0x7fa318068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:03.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.952+0000 7fa3396c6640 1 --2- 172.21.15.133:0/2784391021 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa318066470 0x7fa318068930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa3300af000 tx=0x7fa3300046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:03.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:03.956+0000 7fa329ffb640 1 -- 172.21.15.133:0/2784391021 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa3340a8e80 con 0x7fa3340a5060 2023-12-19T18:59:04.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.108+0000 7fa33b92a640 1 -- 172.21.15.133:0/2784391021 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa334156960 con 0x7fa3340a5060 2023-12-19T18:59:04.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.108+0000 7fa329ffb640 1 -- 172.21.15.133:0/2784391021 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fa334156960 con 0x7fa3340a5060 2023-12-19T18:59:04.113 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:04.113 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:44.402984+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:58:40.991408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T18:58:41.773992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:59:04.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.112+0000 7fa33b92a640 1 -- 172.21.15.133:0/2784391021 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa318066470 msgr2=0x7fa318068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:04.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.112+0000 7fa33b92a640 1 --2- 172.21.15.133:0/2784391021 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa318066470 0x7fa318068930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa3300af000 tx=0x7fa3300046d0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.112+0000 7fa33b92a640 1 -- 172.21.15.133:0/2784391021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3340a5060 msgr2=0x7fa3340a96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:04.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.112+0000 7fa33b92a640 1 --2- 172.21.15.133:0/2784391021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3340a5060 0x7fa3340a96a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa3340c6b10 tx=0x7fa32c00e530 comp rx=0 tx=0).stop 2023-12-19T18:59:04.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.112+0000 7fa33b92a640 1 -- 172.21.15.133:0/2784391021 shutdown_connections 2023-12-19T18:59:04.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.112+0000 7fa33b92a640 1 --2- 172.21.15.133:0/2784391021 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa318066470 0x7fa318068930 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.112+0000 7fa33b92a640 1 --2- 172.21.15.133:0/2784391021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3340a5060 0x7fa3340a96a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.112+0000 7fa33b92a640 1 --2- 172.21.15.133:0/2784391021 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa3341ed480 0x7fa3340a9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.112+0000 7fa33b92a640 1 --2- 172.21.15.133:0/2784391021 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa320003b40 0x7fa3340bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.112+0000 7fa33b92a640 1 -- 172.21.15.133:0/2784391021 >> 172.21.15.133:0/2784391021 conn(0x7fa33406a5b0 msgr2=0x7fa33406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:04.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.112+0000 7fa33b92a640 1 -- 172.21.15.133:0/2784391021 shutdown_connections 2023-12-19T18:59:04.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.112+0000 7fa33b92a640 1 -- 172.21.15.133:0/2784391021 wait complete. 2023-12-19T18:59:04.134 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:58:40.991408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:58:41.773992+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:59:04.135 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:59:04.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.272+0000 7fdb9de32640 1 Processor -- start 2023-12-19T18:59:04.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.272+0000 7fdb9de32640 1 -- start start 2023-12-19T18:59:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.272+0000 7fdb9de32640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdb980c63c0 0x7fdb980c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.272+0000 7fdb9de32640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdb980c2bb0 0x7fdb980a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.272+0000 7fdb9de32640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb980c31c0 con 0x7fdb980c4100 2023-12-19T18:59:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.272+0000 7fdb9de32640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb980c34a0 con 0x7fdb980c63c0 2023-12-19T18:59:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.272+0000 7fdb9de32640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb980c1030 con 0x7fdb980c2bb0 2023-12-19T18:59:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.272+0000 7fdb977fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdb980c63c0 0x7fdb980c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.272+0000 7fdb977fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdb980c63c0 0x7fdb980c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34124/0 (socket says 172.21.15.133:34124) 2023-12-19T18:59:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.272+0000 7fdb977fe640 1 -- 172.21.15.133:0/1499992002 learned_addr learned my addr 172.21.15.133:0/1499992002 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.272+0000 7fdb96ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdb980c4100 0x7fdb980c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41162/0 (socket says 172.21.15.133:41162) 2023-12-19T18:59:04.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.272+0000 7fdb97fff640 1 --2- 172.21.15.133:0/1499992002 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdb980c2bb0 0x7fdb980a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:04.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.272+0000 7fdb977fe640 1 -- 172.21.15.133:0/1499992002 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdb980c2bb0 msgr2=0x7fdb980a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:04.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.272+0000 7fdb977fe640 1 --2- 172.21.15.133:0/1499992002 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdb980c2bb0 0x7fdb980a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.272+0000 7fdb977fe640 1 -- 172.21.15.133:0/1499992002 >> v1:172.21.15.133:6789/0 conn(0x7fdb980c4100 legacy=0x7fdb980c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:04.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.272+0000 7fdb967fc640 1 -- 172.21.15.133:0/1499992002 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4254483903 0 0) 0x7fdb980c31c0 con 0x7fdb980c4100 2023-12-19T18:59:04.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.272+0000 7fdb977fe640 1 -- 172.21.15.133:0/1499992002 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb980c1310 con 0x7fdb980c63c0 2023-12-19T18:59:04.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.276+0000 7fdb977fe640 1 --2- 172.21.15.133:0/1499992002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb980c63c0 0x7fdb980c06d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdb880098a0 tx=0x7fdb8801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49cac57317a83e88 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:04.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.276+0000 7fdb967fc640 1 -- 172.21.15.133:0/1499992002 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb980aa3d0 con 0x7fdb980c63c0 2023-12-19T18:59:04.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.276+0000 7fdb967fc640 1 -- 172.21.15.133:0/1499992002 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb880a7050 con 0x7fdb980c63c0 2023-12-19T18:59:04.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.276+0000 7fdb967fc640 1 -- 172.21.15.133:0/1499992002 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb880ab820 con 0x7fdb980c63c0 2023-12-19T18:59:04.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.276+0000 7fdb9de32640 1 -- 172.21.15.133:0/1499992002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb980c63c0 msgr2=0x7fdb980c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:04.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.276+0000 7fdb9de32640 1 --2- 172.21.15.133:0/1499992002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb980c63c0 0x7fdb980c06d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fdb880098a0 tx=0x7fdb8801c3d0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.276+0000 7fdb9de32640 1 -- 172.21.15.133:0/1499992002 shutdown_connections 2023-12-19T18:59:04.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.276+0000 7fdb9de32640 1 --2- 172.21.15.133:0/1499992002 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdb980c2bb0 0x7fdb980a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.276+0000 7fdb9de32640 1 --2- 172.21.15.133:0/1499992002 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb980c63c0 0x7fdb980c06d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.276+0000 7fdb9de32640 1 -- 172.21.15.133:0/1499992002 >> 172.21.15.133:0/1499992002 conn(0x7fdb9806a5b0 msgr2=0x7fdb9806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:04.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.276+0000 7fdb9de32640 1 -- 172.21.15.133:0/1499992002 shutdown_connections 2023-12-19T18:59:04.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.276+0000 7fdb9de32640 1 -- 172.21.15.133:0/1499992002 wait complete. 2023-12-19T18:59:04.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.276+0000 7fdb9de32640 1 Processor -- start 2023-12-19T18:59:04.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb9de32640 1 -- start start 2023-12-19T18:59:04.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb9de32640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdb980c2bb0 0x7fdb98070430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:04.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb9de32640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb980c4100 0x7fdb9815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:04.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb9de32640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb980c63c0 0x7fdb9815ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:04.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb9de32640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9815cdf0 con 0x7fdb980c4100 2023-12-19T18:59:04.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb9de32640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9806ffa0 con 0x7fdb980c63c0 2023-12-19T18:59:04.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb9de32640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9806dde0 con 0x7fdb980c2bb0 2023-12-19T18:59:04.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb96ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb980c4100 0x7fdb9815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:04.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb96ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb980c4100 0x7fdb9815a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34138/0 (socket says 172.21.15.133:34138) 2023-12-19T18:59:04.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb96ffd640 1 -- 172.21.15.133:0/3638625349 learned_addr learned my addr 172.21.15.133:0/3638625349 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:04.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb96ffd640 1 -- 172.21.15.133:0/3638625349 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdb980c2bb0 msgr2=0x7fdb98070430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:04.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb96ffd640 1 --2- 172.21.15.133:0/3638625349 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdb980c2bb0 0x7fdb98070430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb96ffd640 1 -- 172.21.15.133:0/3638625349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb980c63c0 msgr2=0x7fdb9815ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:04.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb97fff640 1 --2- 172.21.15.133:0/3638625349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb980c63c0 0x7fdb9815ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:04.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb96ffd640 1 --2- 172.21.15.133:0/3638625349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb980c63c0 0x7fdb9815ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb96ffd640 1 -- 172.21.15.133:0/3638625349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb880094d0 con 0x7fdb980c4100 2023-12-19T18:59:04.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb97fff640 1 --2- 172.21.15.133:0/3638625349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb980c63c0 0x7fdb9815ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:04.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb96ffd640 1 --2- 172.21.15.133:0/3638625349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb980c4100 0x7fdb9815a420 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0011f0 tx=0x7fdb8c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:04.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb7ffff640 1 -- 172.21.15.133:0/3638625349 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c0074e0 con 0x7fdb980c4100 2023-12-19T18:59:04.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb7ffff640 1 -- 172.21.15.133:0/3638625349 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8c007640 con 0x7fdb980c4100 2023-12-19T18:59:04.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb7ffff640 1 -- 172.21.15.133:0/3638625349 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c004a10 con 0x7fdb980c4100 2023-12-19T18:59:04.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb9de32640 1 -- 172.21.15.133:0/3638625349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb981f0970 con 0x7fdb980c4100 2023-12-19T18:59:04.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb9de32640 1 -- 172.21.15.133:0/3638625349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb9815d320 con 0x7fdb980c4100 2023-12-19T18:59:04.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.280+0000 7fdb9de32640 1 -- 172.21.15.133:0/3638625349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb98068400 con 0x7fdb980c4100 2023-12-19T18:59:04.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.284+0000 7fdb7ffff640 1 -- 172.21.15.133:0/3638625349 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fdb8c004b70 con 0x7fdb980c4100 2023-12-19T18:59:04.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.284+0000 7fdb7ffff640 1 --2- 172.21.15.133:0/3638625349 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdb84066470 0x7fdb84068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:04.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.284+0000 7fdb7ffff640 1 -- 172.21.15.133:0/3638625349 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb8c083190 con 0x7fdb980c4100 2023-12-19T18:59:04.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.284+0000 7fdb977fe640 1 --2- 172.21.15.133:0/3638625349 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdb84066470 0x7fdb84068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:04.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.284+0000 7fdb977fe640 1 --2- 172.21.15.133:0/3638625349 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdb84066470 0x7fdb84068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdb880ad000 tx=0x7fdb88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:04.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.288+0000 7fdb7ffff640 1 -- 172.21.15.133:0/3638625349 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fdb8c050600 con 0x7fdb980c4100 2023-12-19T18:59:04.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.440+0000 7fdb9de32640 1 -- 172.21.15.133:0/3638625349 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdb980a9720 con 0x7fdb980c4100 2023-12-19T18:59:04.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.440+0000 7fdb7ffff640 1 -- 172.21.15.133:0/3638625349 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdb8c0180a0 con 0x7fdb980c4100 2023-12-19T18:59:04.443 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T18:59:04.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.440+0000 7fdb9de32640 1 -- 172.21.15.133:0/3638625349 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdb84066470 msgr2=0x7fdb84068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:04.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.440+0000 7fdb9de32640 1 --2- 172.21.15.133:0/3638625349 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdb84066470 0x7fdb84068930 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdb880ad000 tx=0x7fdb88008040 comp rx=0 tx=0).stop 2023-12-19T18:59:04.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.440+0000 7fdb9de32640 1 -- 172.21.15.133:0/3638625349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb980c4100 msgr2=0x7fdb9815a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:04.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.440+0000 7fdb9de32640 1 --2- 172.21.15.133:0/3638625349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb980c4100 0x7fdb9815a420 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fdb8c0011f0 tx=0x7fdb8c00c9b0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.440+0000 7fdb9de32640 1 -- 172.21.15.133:0/3638625349 shutdown_connections 2023-12-19T18:59:04.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.440+0000 7fdb9de32640 1 --2- 172.21.15.133:0/3638625349 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdb84066470 0x7fdb84068930 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.440+0000 7fdb9de32640 1 --2- 172.21.15.133:0/3638625349 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdb980c63c0 0x7fdb9815ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.440+0000 7fdb9de32640 1 --2- 172.21.15.133:0/3638625349 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb980c4100 0x7fdb9815a420 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.440+0000 7fdb9de32640 1 --2- 172.21.15.133:0/3638625349 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdb980c2bb0 0x7fdb98070430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.440+0000 7fdb9de32640 1 -- 172.21.15.133:0/3638625349 >> 172.21.15.133:0/3638625349 conn(0x7fdb9806a5b0 msgr2=0x7fdb9806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:04.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.440+0000 7fdb9de32640 1 -- 172.21.15.133:0/3638625349 shutdown_connections 2023-12-19T18:59:04.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.440+0000 7fdb9de32640 1 -- 172.21.15.133:0/3638625349 wait complete. 2023-12-19T18:59:04.464 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:59:04.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.600+0000 7f5cd5a9c640 1 Processor -- start 2023-12-19T18:59:04.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.600+0000 7f5cd5a9c640 1 -- start start 2023-12-19T18:59:04.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.604+0000 7f5cd5a9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cd0151cd0 0x7f5cd00ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:04.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.604+0000 7f5cd5a9c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5cd00c7c50 0x7f5cd01544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:04.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.604+0000 7f5cd5a9c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5cd00ca9a0 0x7f5cd0154a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:04.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.604+0000 7f5cd5a9c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd0154f50 con 0x7f5cd00c7c50 2023-12-19T18:59:04.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.604+0000 7f5cd5a9c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd00c8160 con 0x7f5cd00ca9a0 2023-12-19T18:59:04.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.604+0000 7f5cd5a9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd0157b40 con 0x7f5cd0151cd0 2023-12-19T18:59:04.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.604+0000 7f5cc7fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5cd00c7c50 0x7f5cd01544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.604+0000 7f5cc7fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5cd00c7c50 0x7f5cd01544d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55632/0 (socket says 172.21.15.133:55632) 2023-12-19T18:59:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.604+0000 7f5cc7fff640 1 -- 172.21.15.133:0/1535874177 learned_addr learned my addr 172.21.15.133:0/1535874177 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.604+0000 7f5cd529b640 1 --2- 172.21.15.133:0/1535874177 >> v2:172.21.15.138:3300/0 conn(0x7f5cd00ca9a0 0x7f5cd0154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.604+0000 7f5cd4a9a640 1 --2- 172.21.15.133:0/1535874177 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cd0151cd0 0x7f5cd00ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.604+0000 7f5cc7fff640 1 -- 172.21.15.133:0/1535874177 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cd0151cd0 msgr2=0x7f5cd00ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.604+0000 7f5cc7fff640 1 --2- 172.21.15.133:0/1535874177 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cd0151cd0 0x7f5cd00ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.604+0000 7f5cc7fff640 1 -- 172.21.15.133:0/1535874177 >> v2:172.21.15.138:3300/0 conn(0x7f5cd00ca9a0 msgr2=0x7f5cd0154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.604+0000 7f5cc7fff640 1 --2- 172.21.15.133:0/1535874177 >> v2:172.21.15.138:3300/0 conn(0x7f5cd00ca9a0 0x7f5cd0154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.604+0000 7f5cc7fff640 1 -- 172.21.15.133:0/1535874177 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd0157e20 con 0x7f5cd00c7c50 2023-12-19T18:59:04.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.608+0000 7f5cc7fff640 1 --2- 172.21.15.133:0/1535874177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cd00c7c50 0x7f5cd01544d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5cd006ce90 tx=0x7f5cc001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d1be133ae8b652 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:04.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.608+0000 7f5cc77fe640 1 -- 172.21.15.133:0/1535874177 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc00aa5f0 con 0x7f5cd00c7c50 2023-12-19T18:59:04.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.608+0000 7f5cc77fe640 1 -- 172.21.15.133:0/1535874177 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc00aa750 con 0x7f5cd00c7c50 2023-12-19T18:59:04.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.608+0000 7f5cc77fe640 1 -- 172.21.15.133:0/1535874177 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc00aaae0 con 0x7f5cd00c7c50 2023-12-19T18:59:04.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.608+0000 7f5cd5a9c640 1 -- 172.21.15.133:0/1535874177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cd00c7c50 msgr2=0x7f5cd01544d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:04.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.608+0000 7f5cd5a9c640 1 --2- 172.21.15.133:0/1535874177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cd00c7c50 0x7f5cd01544d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5cd006ce90 tx=0x7f5cc001c4d0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.608+0000 7f5cd5a9c640 1 -- 172.21.15.133:0/1535874177 shutdown_connections 2023-12-19T18:59:04.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.608+0000 7f5cd5a9c640 1 --2- 172.21.15.133:0/1535874177 >> v2:172.21.15.138:3300/0 conn(0x7f5cd00ca9a0 0x7f5cd0154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.608+0000 7f5cd5a9c640 1 --2- 172.21.15.133:0/1535874177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cd00c7c50 0x7f5cd01544d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.608+0000 7f5cd5a9c640 1 --2- 172.21.15.133:0/1535874177 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cd0151cd0 0x7f5cd00ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.608+0000 7f5cd5a9c640 1 -- 172.21.15.133:0/1535874177 >> 172.21.15.133:0/1535874177 conn(0x7f5cd00abee0 msgr2=0x7f5cd00c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:04.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.608+0000 7f5cd5a9c640 1 -- 172.21.15.133:0/1535874177 shutdown_connections 2023-12-19T18:59:04.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.608+0000 7f5cd5a9c640 1 -- 172.21.15.133:0/1535874177 wait complete. 2023-12-19T18:59:04.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.608+0000 7f5cd5a9c640 1 Processor -- start 2023-12-19T18:59:04.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.608+0000 7f5cd5a9c640 1 -- start start 2023-12-19T18:59:04.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.608+0000 7f5cd5a9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cd00c7c50 0x7f5cd00c02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:04.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.608+0000 7f5cd5a9c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cd00ca9a0 0x7f5cd00be220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:04.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.608+0000 7f5cd5a9c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cd0151cd0 0x7f5cd014ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:04.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.608+0000 7f5cd5a9c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd01ecf60 con 0x7f5cd00ca9a0 2023-12-19T18:59:04.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.608+0000 7f5cd5a9c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd01ed490 con 0x7f5cd0151cd0 2023-12-19T18:59:04.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.608+0000 7f5cd5a9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd00bdf50 con 0x7f5cd00c7c50 2023-12-19T18:59:04.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.608+0000 7f5cc7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cd00ca9a0 0x7f5cd00be220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:04.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.612+0000 7f5cc7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cd00ca9a0 0x7f5cd00be220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55638/0 (socket says 172.21.15.133:55638) 2023-12-19T18:59:04.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.612+0000 7f5cc7fff640 1 -- 172.21.15.133:0/1685005829 learned_addr learned my addr 172.21.15.133:0/1685005829 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:04.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.612+0000 7f5cd4a9a640 1 --2- 172.21.15.133:0/1685005829 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cd00c7c50 0x7f5cd00c02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:04.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.612+0000 7f5cd529b640 1 --2- 172.21.15.133:0/1685005829 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cd0151cd0 0x7f5cd014ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:04.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.612+0000 7f5cc7fff640 1 -- 172.21.15.133:0/1685005829 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cd00c7c50 msgr2=0x7f5cd00c02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:04.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.612+0000 7f5cc7fff640 1 --2- 172.21.15.133:0/1685005829 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cd00c7c50 0x7f5cd00c02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.612+0000 7f5cc7fff640 1 -- 172.21.15.133:0/1685005829 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cd0151cd0 msgr2=0x7f5cd014ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:04.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.612+0000 7f5cc7fff640 1 --2- 172.21.15.133:0/1685005829 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cd0151cd0 0x7f5cd014ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.612+0000 7f5cc7fff640 1 -- 172.21.15.133:0/1685005829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc00094d0 con 0x7f5cd00ca9a0 2023-12-19T18:59:04.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.612+0000 7f5cc7fff640 1 --2- 172.21.15.133:0/1685005829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cd00ca9a0 0x7f5cd00be220 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5cc00ac040 tx=0x7f5cc001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:04.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.612+0000 7f5cc57fa640 1 -- 172.21.15.133:0/1685005829 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc00bd5f0 con 0x7f5cd00ca9a0 2023-12-19T18:59:04.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.612+0000 7f5cc57fa640 1 -- 172.21.15.133:0/1685005829 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc00bd750 con 0x7f5cd00ca9a0 2023-12-19T18:59:04.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.612+0000 7f5cc57fa640 1 -- 172.21.15.133:0/1685005829 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc00bdb00 con 0x7f5cd00ca9a0 2023-12-19T18:59:04.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.612+0000 7f5cd5a9c640 1 -- 172.21.15.133:0/1685005829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd01ed1b0 con 0x7f5cd00ca9a0 2023-12-19T18:59:04.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.612+0000 7f5cd5a9c640 1 -- 172.21.15.133:0/1685005829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd00bdc70 con 0x7f5cd00ca9a0 2023-12-19T18:59:04.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.612+0000 7f5cd5a9c640 1 -- 172.21.15.133:0/1685005829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd004e850 con 0x7f5cd00ca9a0 2023-12-19T18:59:04.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.612+0000 7f5cc57fa640 1 -- 172.21.15.133:0/1685005829 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5cc00b33f0 con 0x7f5cd00ca9a0 2023-12-19T18:59:04.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.612+0000 7f5cc57fa640 1 --2- 172.21.15.133:0/1685005829 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5cbc066470 0x7f5cbc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:04.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.612+0000 7f5cc57fa640 1 -- 172.21.15.133:0/1685005829 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5cc00a7070 con 0x7f5cd00ca9a0 2023-12-19T18:59:04.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.616+0000 7f5cd4a9a640 1 --2- 172.21.15.133:0/1685005829 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5cbc066470 0x7f5cbc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:04.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.616+0000 7f5cd4a9a640 1 --2- 172.21.15.133:0/1685005829 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5cbc066470 0x7f5cbc068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009ac0 tx=0x7f5ccc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:04.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.616+0000 7f5cc57fa640 1 -- 172.21.15.133:0/1685005829 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5cc00ec0c0 con 0x7f5cd00ca9a0 2023-12-19T18:59:04.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.768+0000 7f5cd5a9c640 1 -- 172.21.15.133:0/1685005829 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5cd006d180 con 0x7f5cd00ca9a0 2023-12-19T18:59:04.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.768+0000 7f5cc57fa640 1 -- 172.21.15.133:0/1685005829 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5cc00ef6e0 con 0x7f5cd00ca9a0 2023-12-19T18:59:04.772 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T18:59:04.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.768+0000 7f5cd5a9c640 1 -- 172.21.15.133:0/1685005829 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5cbc066470 msgr2=0x7f5cbc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:04.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.768+0000 7f5cd5a9c640 1 --2- 172.21.15.133:0/1685005829 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5cbc066470 0x7f5cbc068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009ac0 tx=0x7f5ccc009190 comp rx=0 tx=0).stop 2023-12-19T18:59:04.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.768+0000 7f5cd5a9c640 1 -- 172.21.15.133:0/1685005829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cd00ca9a0 msgr2=0x7f5cd00be220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:04.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.768+0000 7f5cd5a9c640 1 --2- 172.21.15.133:0/1685005829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cd00ca9a0 0x7f5cd00be220 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5cc00ac040 tx=0x7f5cc001ad10 comp rx=0 tx=0).stop 2023-12-19T18:59:04.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.768+0000 7f5cd5a9c640 1 -- 172.21.15.133:0/1685005829 shutdown_connections 2023-12-19T18:59:04.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.768+0000 7f5cd5a9c640 1 --2- 172.21.15.133:0/1685005829 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5cbc066470 0x7f5cbc068930 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.768+0000 7f5cd5a9c640 1 --2- 172.21.15.133:0/1685005829 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cd0151cd0 0x7f5cd014ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.768+0000 7f5cd5a9c640 1 --2- 172.21.15.133:0/1685005829 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cd00ca9a0 0x7f5cd00be220 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.768+0000 7f5cd5a9c640 1 --2- 172.21.15.133:0/1685005829 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cd00c7c50 0x7f5cd00c02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.768+0000 7f5cd5a9c640 1 -- 172.21.15.133:0/1685005829 >> 172.21.15.133:0/1685005829 conn(0x7f5cd00abee0 msgr2=0x7f5cd0150e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:04.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.768+0000 7f5cd5a9c640 1 -- 172.21.15.133:0/1685005829 shutdown_connections 2023-12-19T18:59:04.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.768+0000 7f5cd5a9c640 1 -- 172.21.15.133:0/1685005829 wait complete. 2023-12-19T18:59:04.793 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:59:04.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.928+0000 7f0538dd8640 1 Processor -- start 2023-12-19T18:59:04.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.928+0000 7f0538dd8640 1 -- start start 2023-12-19T18:59:04.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.932+0000 7f0538dd8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05340a5370 0x7f05340c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:04.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.932+0000 7f0538dd8640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f05340c4110 0x7f0534150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:04.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.932+0000 7f0538dd8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05340c2760 con 0x7f0534072090 2023-12-19T18:59:04.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.932+0000 7f0538dd8640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05340c3070 con 0x7f05340c4110 2023-12-19T18:59:04.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.932+0000 7f0538dd8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0534151bf0 con 0x7f05340a5370 2023-12-19T18:59:04.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.932+0000 7f0529d9b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f05340c4110 0x7f0534150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:04.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.932+0000 7f0529d9b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f05340c4110 0x7f0534150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55650/0 (socket says 172.21.15.133:55650) 2023-12-19T18:59:04.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.932+0000 7f0529d9b640 1 -- 172.21.15.133:0/109684614 learned_addr learned my addr 172.21.15.133:0/109684614 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:04.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.932+0000 7f053259c640 1 --2- 172.21.15.133:0/109684614 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05340a5370 0x7f05340c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:04.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.932+0000 7f0529d9b640 1 -- 172.21.15.133:0/109684614 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05340a5370 msgr2=0x7f05340c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:04.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.932+0000 7f0529d9b640 1 --2- 172.21.15.133:0/109684614 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05340a5370 0x7f05340c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.932+0000 7f0529d9b640 1 -- 172.21.15.133:0/109684614 >> v1:172.21.15.138:6789/0 conn(0x7f0534072090 legacy=0x7f05341514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:04.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.932+0000 7f0529d9b640 1 -- 172.21.15.133:0/109684614 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05340a5750 con 0x7f05340c4110 2023-12-19T18:59:04.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.932+0000 7f053259c640 1 --2- 172.21.15.133:0/109684614 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05340a5370 0x7f05340c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:04.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.936+0000 7f0529d9b640 1 --2- 172.21.15.133:0/109684614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05340c4110 0x7f0534150fa0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f051c0098a0 tx=0x7f051c01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ae13ea40869388 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:04.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.936+0000 7f0531d9b640 1 -- 172.21.15.133:0/109684614 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c004230 con 0x7f05340c4110 2023-12-19T18:59:04.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.936+0000 7f0531d9b640 1 -- 172.21.15.133:0/109684614 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051c0a7050 con 0x7f05340c4110 2023-12-19T18:59:04.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.936+0000 7f0531d9b640 1 -- 172.21.15.133:0/109684614 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c003620 con 0x7f05340c4110 2023-12-19T18:59:04.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.936+0000 7f0538dd8640 1 -- 172.21.15.133:0/109684614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05340c4110 msgr2=0x7f0534150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:04.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.936+0000 7f0538dd8640 1 --2- 172.21.15.133:0/109684614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05340c4110 0x7f0534150fa0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f051c0098a0 tx=0x7f051c01c390 comp rx=0 tx=0).stop 2023-12-19T18:59:04.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.936+0000 7f0538dd8640 1 -- 172.21.15.133:0/109684614 shutdown_connections 2023-12-19T18:59:04.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.936+0000 7f0538dd8640 1 --2- 172.21.15.133:0/109684614 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05340c4110 0x7f0534150fa0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.936+0000 7f0538dd8640 1 --2- 172.21.15.133:0/109684614 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05340a5370 0x7f05340c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.936+0000 7f0538dd8640 1 -- 172.21.15.133:0/109684614 >> 172.21.15.133:0/109684614 conn(0x7f053406a5b0 msgr2=0x7f053406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:04.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.936+0000 7f0538dd8640 1 -- 172.21.15.133:0/109684614 shutdown_connections 2023-12-19T18:59:04.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.936+0000 7f0538dd8640 1 -- 172.21.15.133:0/109684614 wait complete. 2023-12-19T18:59:04.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.936+0000 7f0538dd8640 1 Processor -- start 2023-12-19T18:59:04.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.936+0000 7f0538dd8640 1 -- start start 2023-12-19T18:59:04.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f0538dd8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0534072090 0x7f0534146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:04.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f0538dd8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05340a5370 0x7f05340bf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:04.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f0538dd8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05340c4110 0x7f05341f0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:04.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f0538dd8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0534147350 con 0x7f05340a5370 2023-12-19T18:59:04.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f0538dd8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05341edd70 con 0x7f0534072090 2023-12-19T18:59:04.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f0538dd8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05341ecdd0 con 0x7f05340c4110 2023-12-19T18:59:04.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f0529d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05340a5370 0x7f05340bf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:04.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f0529d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05340a5370 0x7f05340bf100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55666/0 (socket says 172.21.15.133:55666) 2023-12-19T18:59:04.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f0529d9b640 1 -- 172.21.15.133:0/742390532 learned_addr learned my addr 172.21.15.133:0/742390532 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:04.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f053259c640 1 --2- 172.21.15.133:0/742390532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0534072090 0x7f0534146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:04.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f0532d9d640 1 --2- 172.21.15.133:0/742390532 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05340c4110 0x7f05341f0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:04.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f0529d9b640 1 -- 172.21.15.133:0/742390532 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05340c4110 msgr2=0x7f05341f0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:04.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f0529d9b640 1 --2- 172.21.15.133:0/742390532 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05340c4110 0x7f05341f0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f0529d9b640 1 -- 172.21.15.133:0/742390532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0534072090 msgr2=0x7f0534146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:04.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f0529d9b640 1 --2- 172.21.15.133:0/742390532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0534072090 0x7f0534146a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:04.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f0529d9b640 1 -- 172.21.15.133:0/742390532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051c0094d0 con 0x7f05340a5370 2023-12-19T18:59:04.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f0532d9d640 1 --2- 172.21.15.133:0/742390532 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05340c4110 0x7f05341f0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:04.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f0529d9b640 1 --2- 172.21.15.133:0/742390532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05340a5370 0x7f05340bf100 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f051c0ae040 tx=0x7f051c019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:04.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f052b7fe640 1 -- 172.21.15.133:0/742390532 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c003d60 con 0x7f05340a5370 2023-12-19T18:59:04.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f052b7fe640 1 -- 172.21.15.133:0/742390532 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051c0ab440 con 0x7f05340a5370 2023-12-19T18:59:04.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f0538dd8640 1 -- 172.21.15.133:0/742390532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05341475a0 con 0x7f05340a5370 2023-12-19T18:59:04.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f052b7fe640 1 -- 172.21.15.133:0/742390532 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c0ab7f0 con 0x7f05340a5370 2023-12-19T18:59:04.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f0538dd8640 1 -- 172.21.15.133:0/742390532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05340a6e60 con 0x7f05340a5370 2023-12-19T18:59:04.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f0538dd8640 1 -- 172.21.15.133:0/742390532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0534068400 con 0x7f05340a5370 2023-12-19T18:59:04.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.940+0000 7f052b7fe640 1 -- 172.21.15.133:0/742390532 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f051c0ab950 con 0x7f05340a5370 2023-12-19T18:59:04.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.944+0000 7f052b7fe640 1 --2- 172.21.15.133:0/742390532 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0514066470 0x7f0514068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:04.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.944+0000 7f052b7fe640 1 -- 172.21.15.133:0/742390532 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f051c11e720 con 0x7f05340a5370 2023-12-19T18:59:04.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.944+0000 7f053259c640 1 --2- 172.21.15.133:0/742390532 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0514066470 0x7f0514068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:04.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.944+0000 7f053259c640 1 --2- 172.21.15.133:0/742390532 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0514066470 0x7f0514068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f052400d620 tx=0x7f0524007810 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:04.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:04.948+0000 7f052b7fe640 1 -- 172.21.15.133:0/742390532 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f051c0ebc40 con 0x7f05340a5370 2023-12-19T18:59:05.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.096+0000 7f0538dd8640 1 -- 172.21.15.133:0/742390532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f05340c6780 con 0x7f05340a5370 2023-12-19T18:59:05.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.100+0000 7f052b7fe640 1 -- 172.21.15.133:0/742390532 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f051c0ef260 con 0x7f05340a5370 2023-12-19T18:59:05.103 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T18:59:05.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.100+0000 7f0538dd8640 1 -- 172.21.15.133:0/742390532 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0514066470 msgr2=0x7f0514068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:05.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.100+0000 7f0538dd8640 1 --2- 172.21.15.133:0/742390532 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0514066470 0x7f0514068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f052400d620 tx=0x7f0524007810 comp rx=0 tx=0).stop 2023-12-19T18:59:05.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.100+0000 7f0538dd8640 1 -- 172.21.15.133:0/742390532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05340a5370 msgr2=0x7f05340bf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:05.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.100+0000 7f0538dd8640 1 --2- 172.21.15.133:0/742390532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05340a5370 0x7f05340bf100 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f051c0ae040 tx=0x7f051c019130 comp rx=0 tx=0).stop 2023-12-19T18:59:05.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.100+0000 7f0538dd8640 1 -- 172.21.15.133:0/742390532 shutdown_connections 2023-12-19T18:59:05.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.100+0000 7f0538dd8640 1 --2- 172.21.15.133:0/742390532 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0514066470 0x7f0514068930 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.100+0000 7f0538dd8640 1 --2- 172.21.15.133:0/742390532 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05340c4110 0x7f05341f0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.100+0000 7f0538dd8640 1 --2- 172.21.15.133:0/742390532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05340a5370 0x7f05340bf100 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.100+0000 7f0538dd8640 1 --2- 172.21.15.133:0/742390532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0534072090 0x7f0534146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.100+0000 7f0538dd8640 1 -- 172.21.15.133:0/742390532 >> 172.21.15.133:0/742390532 conn(0x7f053406a5b0 msgr2=0x7f053406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:05.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.100+0000 7f0538dd8640 1 -- 172.21.15.133:0/742390532 shutdown_connections 2023-12-19T18:59:05.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.100+0000 7f0538dd8640 1 -- 172.21.15.133:0/742390532 wait complete. 2023-12-19T18:59:05.124 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:59:05.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.256+0000 7ff09d2bb640 1 Processor -- start 2023-12-19T18:59:05.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.256+0000 7ff09d2bb640 1 -- start start 2023-12-19T18:59:05.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.260+0000 7ff09d2bb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff098151df0 0x7ff0980c4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:05.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.260+0000 7ff09d2bb640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff0980bd570 0x7ff098154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:05.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.260+0000 7ff09d2bb640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0981587e0 con 0x7ff0980c7f30 2023-12-19T18:59:05.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.260+0000 7ff09d2bb640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0980c58c0 con 0x7ff0980bd570 2023-12-19T18:59:05.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.260+0000 7ff09d2bb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff098155230 con 0x7ff098151df0 2023-12-19T18:59:05.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.260+0000 7ff08e7fc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff0980c7f30 0x7ff0981545e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59028/0 (socket says 172.21.15.133:59028) 2023-12-19T18:59:05.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.260+0000 7ff096ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff098151df0 0x7ff0980c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:05.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.260+0000 7ff08e7fc640 1 -- 172.21.15.133:0/3371643131 learned_addr learned my addr 172.21.15.133:0/3371643131 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:05.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.260+0000 7ff0977fe640 1 --2- 172.21.15.133:0/3371643131 >> v2:172.21.15.138:3300/0 conn(0x7ff0980bd570 0x7ff098154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:05.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.260+0000 7ff0967fc640 1 -- 172.21.15.133:0/3371643131 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260447822 0 0) 0x7ff0981587e0 con 0x7ff0980c7f30 2023-12-19T18:59:05.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.260+0000 7ff0967fc640 1 -- 172.21.15.133:0/3371643131 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff084003530 con 0x7ff0980c7f30 2023-12-19T18:59:05.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.260+0000 7ff096ffd640 1 -- 172.21.15.133:0/3371643131 >> v2:172.21.15.138:3300/0 conn(0x7ff0980bd570 msgr2=0x7ff098154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:05.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.260+0000 7ff096ffd640 1 --2- 172.21.15.133:0/3371643131 >> v2:172.21.15.138:3300/0 conn(0x7ff0980bd570 0x7ff098154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.260+0000 7ff096ffd640 1 -- 172.21.15.133:0/3371643131 >> v1:172.21.15.133:6789/0 conn(0x7ff0980c7f30 legacy=0x7ff0981545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:05.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.260+0000 7ff096ffd640 1 -- 172.21.15.133:0/3371643131 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff098157bd0 con 0x7ff098151df0 2023-12-19T18:59:05.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.260+0000 7ff0977fe640 1 --2- 172.21.15.133:0/3371643131 >> v2:172.21.15.138:3300/0 conn(0x7ff0980bd570 0x7ff098154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:59:05.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.264+0000 7ff096ffd640 1 --2- 172.21.15.133:0/3371643131 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff098151df0 0x7ff0980c4860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff0880097c0 tx=0x7ff08801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e6efec0d87430b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:05.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.264+0000 7ff0967fc640 1 -- 172.21.15.133:0/3371643131 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0880ab5f0 con 0x7ff098151df0 2023-12-19T18:59:05.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.264+0000 7ff0967fc640 1 -- 172.21.15.133:0/3371643131 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0880ab750 con 0x7ff098151df0 2023-12-19T18:59:05.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.264+0000 7ff0967fc640 1 -- 172.21.15.133:0/3371643131 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0880abae0 con 0x7ff098151df0 2023-12-19T18:59:05.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.264+0000 7ff09d2bb640 1 -- 172.21.15.133:0/3371643131 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff098151df0 msgr2=0x7ff0980c4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:05.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.264+0000 7ff09d2bb640 1 --2- 172.21.15.133:0/3371643131 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff098151df0 0x7ff0980c4860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff0880097c0 tx=0x7ff08801c3f0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.264+0000 7ff09d2bb640 1 -- 172.21.15.133:0/3371643131 shutdown_connections 2023-12-19T18:59:05.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.264+0000 7ff09d2bb640 1 --2- 172.21.15.133:0/3371643131 >> v2:172.21.15.138:3300/0 conn(0x7ff0980bd570 0x7ff098154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.264+0000 7ff09d2bb640 1 --2- 172.21.15.133:0/3371643131 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff098151df0 0x7ff0980c4860 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.264+0000 7ff09d2bb640 1 -- 172.21.15.133:0/3371643131 >> 172.21.15.133:0/3371643131 conn(0x7ff0980720e0 msgr2=0x7ff0980724f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:05.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.264+0000 7ff09d2bb640 1 -- 172.21.15.133:0/3371643131 shutdown_connections 2023-12-19T18:59:05.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.264+0000 7ff09d2bb640 1 -- 172.21.15.133:0/3371643131 wait complete. 2023-12-19T18:59:05.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.264+0000 7ff09d2bb640 1 Processor -- start 2023-12-19T18:59:05.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.264+0000 7ff09d2bb640 1 -- start start 2023-12-19T18:59:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff09d2bb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0980bd570 0x7ff0981f09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff09d2bb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff0980c7f30 0x7ff09815e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff09d2bb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff098151df0 0x7ff09815e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff09d2bb640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09814b320 con 0x7ff098151df0 2023-12-19T18:59:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff09d2bb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0980a9d60 con 0x7ff0980bd570 2023-12-19T18:59:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff09d2bb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0980a9a80 con 0x7ff0980c7f30 2023-12-19T18:59:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff0977fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff098151df0 0x7ff09815e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff0977fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff098151df0 0x7ff09815e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55674/0 (socket says 172.21.15.133:55674) 2023-12-19T18:59:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff0977fe640 1 -- 172.21.15.133:0/2226271327 learned_addr learned my addr 172.21.15.133:0/2226271327 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff08e7fc640 1 --2- 172.21.15.133:0/2226271327 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff0980c7f30 0x7ff09815e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff096ffd640 1 --2- 172.21.15.133:0/2226271327 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0980bd570 0x7ff0981f09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:05.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff0977fe640 1 -- 172.21.15.133:0/2226271327 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff0980c7f30 msgr2=0x7ff09815e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:05.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff0977fe640 1 --2- 172.21.15.133:0/2226271327 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff0980c7f30 0x7ff09815e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff0977fe640 1 -- 172.21.15.133:0/2226271327 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0980bd570 msgr2=0x7ff0981f09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:05.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff0977fe640 1 --2- 172.21.15.133:0/2226271327 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0980bd570 0x7ff0981f09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff0977fe640 1 -- 172.21.15.133:0/2226271327 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff090009a70 con 0x7ff098151df0 2023-12-19T18:59:05.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff0977fe640 1 --2- 172.21.15.133:0/2226271327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff098151df0 0x7ff09815e9b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff09000efb0 tx=0x7ff09000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:05.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff08ffff640 1 -- 172.21.15.133:0/2226271327 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff090014480 con 0x7ff098151df0 2023-12-19T18:59:05.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff08ffff640 1 -- 172.21.15.133:0/2226271327 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff09000f040 con 0x7ff098151df0 2023-12-19T18:59:05.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff09d2bb640 1 -- 172.21.15.133:0/2226271327 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff088009420 con 0x7ff098151df0 2023-12-19T18:59:05.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff08ffff640 1 -- 172.21.15.133:0/2226271327 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff090014800 con 0x7ff098151df0 2023-12-19T18:59:05.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff09d2bb640 1 -- 172.21.15.133:0/2226271327 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0981f1600 con 0x7ff098151df0 2023-12-19T18:59:05.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff09d2bb640 1 -- 172.21.15.133:0/2226271327 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff098066df0 con 0x7ff098151df0 2023-12-19T18:59:05.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.268+0000 7ff08ffff640 1 -- 172.21.15.133:0/2226271327 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff090014960 con 0x7ff098151df0 2023-12-19T18:59:05.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.272+0000 7ff08ffff640 1 --2- 172.21.15.133:0/2226271327 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff078066470 0x7ff078068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:05.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.272+0000 7ff08ffff640 1 -- 172.21.15.133:0/2226271327 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff090084d10 con 0x7ff098151df0 2023-12-19T18:59:05.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.272+0000 7ff096ffd640 1 --2- 172.21.15.133:0/2226271327 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff078066470 0x7ff078068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:05.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.272+0000 7ff096ffd640 1 --2- 172.21.15.133:0/2226271327 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff078066470 0x7ff078068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff0880af000 tx=0x7ff0880b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:05.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.276+0000 7ff08ffff640 1 -- 172.21.15.133:0/2226271327 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff09008a020 con 0x7ff098151df0 2023-12-19T18:59:05.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.424+0000 7ff09d2bb640 1 -- 172.21.15.133:0/2226271327 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0980adca0 con 0x7ff098151df0 2023-12-19T18:59:05.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.424+0000 7ff08ffff640 1 -- 172.21.15.133:0/2226271327 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7ff090018090 con 0x7ff098151df0 2023-12-19T18:59:05.430 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:05.430 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:44.402984+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:58:40.991408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T18:58:41.773992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:59:05.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.428+0000 7ff09d2bb640 1 -- 172.21.15.133:0/2226271327 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff078066470 msgr2=0x7ff078068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:05.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.428+0000 7ff09d2bb640 1 --2- 172.21.15.133:0/2226271327 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff078066470 0x7ff078068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff0880af000 tx=0x7ff0880b6040 comp rx=0 tx=0).stop 2023-12-19T18:59:05.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.428+0000 7ff09d2bb640 1 -- 172.21.15.133:0/2226271327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff098151df0 msgr2=0x7ff09815e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:05.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.428+0000 7ff09d2bb640 1 --2- 172.21.15.133:0/2226271327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff098151df0 0x7ff09815e9b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff09000efb0 tx=0x7ff09000c490 comp rx=0 tx=0).stop 2023-12-19T18:59:05.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.428+0000 7ff09d2bb640 1 -- 172.21.15.133:0/2226271327 shutdown_connections 2023-12-19T18:59:05.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.428+0000 7ff09d2bb640 1 --2- 172.21.15.133:0/2226271327 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff078066470 0x7ff078068930 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.428+0000 7ff09d2bb640 1 --2- 172.21.15.133:0/2226271327 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff098151df0 0x7ff09815e9b0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.428+0000 7ff09d2bb640 1 --2- 172.21.15.133:0/2226271327 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff0980c7f30 0x7ff09815e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.428+0000 7ff09d2bb640 1 --2- 172.21.15.133:0/2226271327 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff0980bd570 0x7ff0981f09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.428+0000 7ff09d2bb640 1 -- 172.21.15.133:0/2226271327 >> 172.21.15.133:0/2226271327 conn(0x7ff0980720e0 msgr2=0x7ff0980c8530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:05.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.428+0000 7ff09d2bb640 1 -- 172.21.15.133:0/2226271327 shutdown_connections 2023-12-19T18:59:05.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.428+0000 7ff09d2bb640 1 -- 172.21.15.133:0/2226271327 wait complete. 2023-12-19T18:59:05.452 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:58:40.991408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:58:41.773992+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:59:05.452 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:59:05.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.588+0000 7f520fd72640 1 Processor -- start 2023-12-19T18:59:05.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.588+0000 7f520fd72640 1 -- start start 2023-12-19T18:59:05.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.588+0000 7f520fd72640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f52080c63c0 0x7f52080c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:05.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.588+0000 7f520fd72640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f52080c2bb0 0x7f52080a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:05.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.588+0000 7f520fd72640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52080c31c0 con 0x7f52080c4100 2023-12-19T18:59:05.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.588+0000 7f520fd72640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52080c34a0 con 0x7f52080c63c0 2023-12-19T18:59:05.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.588+0000 7f520fd72640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52080c1030 con 0x7f52080c2bb0 2023-12-19T18:59:05.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.588+0000 7f520db0e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f52080c63c0 0x7f52080c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:05.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.588+0000 7f520db0e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f52080c63c0 0x7f52080c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55684/0 (socket says 172.21.15.133:55684) 2023-12-19T18:59:05.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.588+0000 7f520db0e640 1 -- 172.21.15.133:0/1560553633 learned_addr learned my addr 172.21.15.133:0/1560553633 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:05.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.588+0000 7f520db0e640 1 -- 172.21.15.133:0/1560553633 >> v2:172.21.15.138:3300/0 conn(0x7f52080c2bb0 msgr2=0x7f52080a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:05.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.588+0000 7f520e30f640 1 --2- 172.21.15.133:0/1560553633 >> v2:172.21.15.138:3300/0 conn(0x7f52080c2bb0 0x7f52080a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:05.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.588+0000 7f520db0e640 1 --2- 172.21.15.133:0/1560553633 >> v2:172.21.15.138:3300/0 conn(0x7f52080c2bb0 0x7f52080a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.588+0000 7f520db0e640 1 -- 172.21.15.133:0/1560553633 >> v1:172.21.15.138:6789/0 conn(0x7f52080c4100 legacy=0x7f52080c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:05.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.588+0000 7f520db0e640 1 -- 172.21.15.133:0/1560553633 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52080c1310 con 0x7f52080c63c0 2023-12-19T18:59:05.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.588+0000 7f520e30f640 1 --2- 172.21.15.133:0/1560553633 >> v2:172.21.15.138:3300/0 conn(0x7f52080c2bb0 0x7f52080a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.592+0000 7f520db0e640 1 --2- 172.21.15.133:0/1560553633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52080c63c0 0x7f52080c06d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f52080c4550 tx=0x7f520401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d349f9edeea84e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.592+0000 7f520cb0c640 1 -- 172.21.15.133:0/1560553633 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52080aa3d0 con 0x7f52080c63c0 2023-12-19T18:59:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.592+0000 7f520cb0c640 1 -- 172.21.15.133:0/1560553633 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52040ac620 con 0x7f52080c63c0 2023-12-19T18:59:05.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.592+0000 7f520cb0c640 1 -- 172.21.15.133:0/1560553633 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52040ac9b0 con 0x7f52080c63c0 2023-12-19T18:59:05.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.592+0000 7f520fd72640 1 -- 172.21.15.133:0/1560553633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52080c63c0 msgr2=0x7f52080c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:05.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.592+0000 7f520fd72640 1 --2- 172.21.15.133:0/1560553633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52080c63c0 0x7f52080c06d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f52080c4550 tx=0x7f520401c3a0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.592+0000 7f520fd72640 1 -- 172.21.15.133:0/1560553633 shutdown_connections 2023-12-19T18:59:05.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.592+0000 7f520fd72640 1 --2- 172.21.15.133:0/1560553633 >> v2:172.21.15.138:3300/0 conn(0x7f52080c2bb0 0x7f52080a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.592+0000 7f520fd72640 1 --2- 172.21.15.133:0/1560553633 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52080c63c0 0x7f52080c06d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.592+0000 7f520fd72640 1 -- 172.21.15.133:0/1560553633 >> 172.21.15.133:0/1560553633 conn(0x7f520806a5b0 msgr2=0x7f520806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:05.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.592+0000 7f520fd72640 1 -- 172.21.15.133:0/1560553633 shutdown_connections 2023-12-19T18:59:05.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.592+0000 7f520fd72640 1 -- 172.21.15.133:0/1560553633 wait complete. 2023-12-19T18:59:05.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f520fd72640 1 Processor -- start 2023-12-19T18:59:05.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f520fd72640 1 -- start start 2023-12-19T18:59:05.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f520fd72640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52080c2bb0 0x7f520815b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:05.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f520fd72640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f52080c4100 0x7f52081598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:05.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f520fd72640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52080c63c0 0x7f5208159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:05.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f520fd72640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52081574f0 con 0x7f52080c63c0 2023-12-19T18:59:05.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f520fd72640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52081eefd0 con 0x7f52080c2bb0 2023-12-19T18:59:05.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f520fd72640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520815a320 con 0x7f52080c4100 2023-12-19T18:59:05.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f520e30f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52080c63c0 0x7f5208159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:05.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f520e30f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52080c63c0 0x7f5208159de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55700/0 (socket says 172.21.15.133:55700) 2023-12-19T18:59:05.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f520e30f640 1 -- 172.21.15.133:0/2859406278 learned_addr learned my addr 172.21.15.133:0/2859406278 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:05.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f520db0e640 1 --2- 172.21.15.133:0/2859406278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52080c2bb0 0x7f520815b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:05.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f520d30d640 1 --2- 172.21.15.133:0/2859406278 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f52080c4100 0x7f52081598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:05.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f520e30f640 1 -- 172.21.15.133:0/2859406278 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f52080c4100 msgr2=0x7f52081598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:05.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f520e30f640 1 --2- 172.21.15.133:0/2859406278 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f52080c4100 0x7f52081598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f520e30f640 1 -- 172.21.15.133:0/2859406278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52080c2bb0 msgr2=0x7f520815b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:05.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f520e30f640 1 --2- 172.21.15.133:0/2859406278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52080c2bb0 0x7f520815b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f520e30f640 1 -- 172.21.15.133:0/2859406278 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52040094d0 con 0x7f52080c63c0 2023-12-19T18:59:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f520e30f640 1 --2- 172.21.15.133:0/2859406278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52080c63c0 0x7f5208159de0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f520000cef0 tx=0x7f520000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f51fe7fc640 1 -- 172.21.15.133:0/2859406278 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520000d840 con 0x7f52080c63c0 2023-12-19T18:59:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f51fe7fc640 1 -- 172.21.15.133:0/2859406278 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520000d9c0 con 0x7f52080c63c0 2023-12-19T18:59:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f51fe7fc640 1 -- 172.21.15.133:0/2859406278 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520000dd70 con 0x7f52080c63c0 2023-12-19T18:59:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f520fd72640 1 -- 172.21.15.133:0/2859406278 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52081eabd0 con 0x7f52080c63c0 2023-12-19T18:59:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f520fd72640 1 -- 172.21.15.133:0/2859406278 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52081eb190 con 0x7f52080c63c0 2023-12-19T18:59:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.596+0000 7f520fd72640 1 -- 172.21.15.133:0/2859406278 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5208068400 con 0x7f52080c63c0 2023-12-19T18:59:05.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.600+0000 7f51fe7fc640 1 -- 172.21.15.133:0/2859406278 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f520001e3b0 con 0x7f52080c63c0 2023-12-19T18:59:05.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.600+0000 7f51fe7fc640 1 --2- 172.21.15.133:0/2859406278 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f51ec066470 0x7f51ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:05.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.600+0000 7f51fe7fc640 1 -- 172.21.15.133:0/2859406278 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52000847b0 con 0x7f52080c63c0 2023-12-19T18:59:05.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.600+0000 7f520db0e640 1 --2- 172.21.15.133:0/2859406278 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f51ec066470 0x7f51ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:05.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.600+0000 7f520db0e640 1 --2- 172.21.15.133:0/2859406278 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f51ec066470 0x7f51ec068930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f52040ae000 tx=0x7f5204008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:05.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.604+0000 7f51fe7fc640 1 -- 172.21.15.133:0/2859406278 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5200051e30 con 0x7f52080c63c0 2023-12-19T18:59:05.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.756+0000 7f520fd72640 1 -- 172.21.15.133:0/2859406278 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52080a5100 con 0x7f52080c63c0 2023-12-19T18:59:05.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.756+0000 7f51fe7fc640 1 -- 172.21.15.133:0/2859406278 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f520001a0a0 con 0x7f52080c63c0 2023-12-19T18:59:05.761 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T18:59:05.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.760+0000 7f520fd72640 1 -- 172.21.15.133:0/2859406278 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f51ec066470 msgr2=0x7f51ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:05.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.760+0000 7f520fd72640 1 --2- 172.21.15.133:0/2859406278 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f51ec066470 0x7f51ec068930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f52040ae000 tx=0x7f5204008040 comp rx=0 tx=0).stop 2023-12-19T18:59:05.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.760+0000 7f520fd72640 1 -- 172.21.15.133:0/2859406278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52080c63c0 msgr2=0x7f5208159de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:05.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.760+0000 7f520fd72640 1 --2- 172.21.15.133:0/2859406278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52080c63c0 0x7f5208159de0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f520000cef0 tx=0x7f520000a710 comp rx=0 tx=0).stop 2023-12-19T18:59:05.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.760+0000 7f520fd72640 1 -- 172.21.15.133:0/2859406278 shutdown_connections 2023-12-19T18:59:05.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.760+0000 7f520fd72640 1 --2- 172.21.15.133:0/2859406278 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f51ec066470 0x7f51ec068930 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.760+0000 7f520fd72640 1 --2- 172.21.15.133:0/2859406278 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52080c63c0 0x7f5208159de0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.760+0000 7f520fd72640 1 --2- 172.21.15.133:0/2859406278 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f52080c4100 0x7f52081598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.760+0000 7f520fd72640 1 --2- 172.21.15.133:0/2859406278 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52080c2bb0 0x7f520815b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.760+0000 7f520fd72640 1 -- 172.21.15.133:0/2859406278 >> 172.21.15.133:0/2859406278 conn(0x7f520806a5b0 msgr2=0x7f52081553a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:05.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.760+0000 7f520fd72640 1 -- 172.21.15.133:0/2859406278 shutdown_connections 2023-12-19T18:59:05.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.760+0000 7f520fd72640 1 -- 172.21.15.133:0/2859406278 wait complete. 2023-12-19T18:59:05.782 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:59:05.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.920+0000 7fb4bbe17640 1 Processor -- start 2023-12-19T18:59:05.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.920+0000 7fb4bbe17640 1 -- start start 2023-12-19T18:59:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.920+0000 7fb4bbe17640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4b41560e0 0x7fb4b415ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.920+0000 7fb4bbe17640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4b40bffc0 0x7fb4b40c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.920+0000 7fb4bbe17640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4b415c600 con 0x7fb4b406d520 2023-12-19T18:59:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.920+0000 7fb4bbe17640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4b415a5c0 con 0x7fb4b41560e0 2023-12-19T18:59:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.920+0000 7fb4bbe17640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b41594e0 con 0x7fb4b40bffc0 2023-12-19T18:59:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.920+0000 7fb4b9bb3640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4b41560e0 0x7fb4b415ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.920+0000 7fb4b93b2640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb4b406d520 0x7fb4b4159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59034/0 (socket says 172.21.15.133:59034) 2023-12-19T18:59:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.920+0000 7fb4b93b2640 1 -- 172.21.15.133:0/864537355 learned_addr learned my addr 172.21.15.133:0/864537355 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.920+0000 7fb4ba3b4640 1 --2- 172.21.15.133:0/864537355 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4b40bffc0 0x7fb4b40c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:05.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.920+0000 7fb4b9bb3640 1 -- 172.21.15.133:0/864537355 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4b40bffc0 msgr2=0x7fb4b40c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:05.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.920+0000 7fb4b9bb3640 1 --2- 172.21.15.133:0/864537355 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4b40bffc0 0x7fb4b40c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.920+0000 7fb4b9bb3640 1 -- 172.21.15.133:0/864537355 >> v1:172.21.15.133:6789/0 conn(0x7fb4b406d520 legacy=0x7fb4b4159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:05.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.920+0000 7fb4b9bb3640 1 -- 172.21.15.133:0/864537355 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b41597c0 con 0x7fb4b41560e0 2023-12-19T18:59:05.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.924+0000 7fb4b9bb3640 1 --2- 172.21.15.133:0/864537355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4b41560e0 0x7fb4b415ca90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb4b00097c0 tx=0x7fb4b001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a18a93dc9bd1959 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:05.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.924+0000 7fb4b8bb1640 1 -- 172.21.15.133:0/864537355 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b00ad660 con 0x7fb4b41560e0 2023-12-19T18:59:05.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.924+0000 7fb4b8bb1640 1 -- 172.21.15.133:0/864537355 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b00ad7c0 con 0x7fb4b41560e0 2023-12-19T18:59:05.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.924+0000 7fb4b8bb1640 1 -- 172.21.15.133:0/864537355 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b00adb50 con 0x7fb4b41560e0 2023-12-19T18:59:05.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.924+0000 7fb4bbe17640 1 -- 172.21.15.133:0/864537355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4b41560e0 msgr2=0x7fb4b415ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:05.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.924+0000 7fb4bbe17640 1 --2- 172.21.15.133:0/864537355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4b41560e0 0x7fb4b415ca90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb4b00097c0 tx=0x7fb4b001c450 comp rx=0 tx=0).stop 2023-12-19T18:59:05.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.924+0000 7fb4bbe17640 1 -- 172.21.15.133:0/864537355 shutdown_connections 2023-12-19T18:59:05.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.924+0000 7fb4bbe17640 1 --2- 172.21.15.133:0/864537355 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4b40bffc0 0x7fb4b40c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.924+0000 7fb4bbe17640 1 --2- 172.21.15.133:0/864537355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4b41560e0 0x7fb4b415ca90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.924+0000 7fb4bbe17640 1 -- 172.21.15.133:0/864537355 >> 172.21.15.133:0/864537355 conn(0x7fb4b406a5b0 msgr2=0x7fb4b406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:05.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.924+0000 7fb4bbe17640 1 -- 172.21.15.133:0/864537355 shutdown_connections 2023-12-19T18:59:05.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.924+0000 7fb4bbe17640 1 -- 172.21.15.133:0/864537355 wait complete. 2023-12-19T18:59:05.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.924+0000 7fb4bbe17640 1 Processor -- start 2023-12-19T18:59:05.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4bbe17640 1 -- start start 2023-12-19T18:59:05.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4bbe17640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4b406d520 0x7fb4b40a9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:05.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4bbe17640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb4b40bffc0 0x7fb4b41f5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:05.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4bbe17640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4b41560e0 0x7fb4b41551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:05.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4bbe17640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b41f5d70 con 0x7fb4b406d520 2023-12-19T18:59:05.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4bbe17640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b40a7060 con 0x7fb4b40bffc0 2023-12-19T18:59:05.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4bbe17640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4b40a7340 con 0x7fb4b41560e0 2023-12-19T18:59:05.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4b9bb3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4b406d520 0x7fb4b40a9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:05.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4b9bb3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4b406d520 0x7fb4b40a9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55712/0 (socket says 172.21.15.133:55712) 2023-12-19T18:59:05.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4b9bb3640 1 -- 172.21.15.133:0/2974650475 learned_addr learned my addr 172.21.15.133:0/2974650475 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:05.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4b93b2640 1 --2- 172.21.15.133:0/2974650475 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb4b40bffc0 0x7fb4b41f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:05.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4b9bb3640 1 -- 172.21.15.133:0/2974650475 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4b41560e0 msgr2=0x7fb4b41551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:05.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4ba3b4640 1 --2- 172.21.15.133:0/2974650475 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4b41560e0 0x7fb4b41551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:05.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4b9bb3640 1 --2- 172.21.15.133:0/2974650475 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4b41560e0 0x7fb4b41551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4b9bb3640 1 -- 172.21.15.133:0/2974650475 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb4b40bffc0 msgr2=0x7fb4b41f5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:05.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4b9bb3640 1 --2- 172.21.15.133:0/2974650475 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb4b40bffc0 0x7fb4b41f5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:05.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4b9bb3640 1 -- 172.21.15.133:0/2974650475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4b0009420 con 0x7fb4b406d520 2023-12-19T18:59:05.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4b93b2640 1 --2- 172.21.15.133:0/2974650475 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb4b40bffc0 0x7fb4b41f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:05.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4ba3b4640 1 --2- 172.21.15.133:0/2974650475 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4b41560e0 0x7fb4b41551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:05.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4b9bb3640 1 --2- 172.21.15.133:0/2974650475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4b406d520 0x7fb4b40a9260 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb4b00b0040 tx=0x7fb4b00191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:05.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4aa7fc640 1 -- 172.21.15.133:0/2974650475 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b00b6610 con 0x7fb4b406d520 2023-12-19T18:59:05.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4aa7fc640 1 -- 172.21.15.133:0/2974650475 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4b00b6770 con 0x7fb4b406d520 2023-12-19T18:59:05.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4aa7fc640 1 -- 172.21.15.133:0/2974650475 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4b00b6b20 con 0x7fb4b406d520 2023-12-19T18:59:05.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4bbe17640 1 -- 172.21.15.133:0/2974650475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4b40a7620 con 0x7fb4b406d520 2023-12-19T18:59:05.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4bbe17640 1 -- 172.21.15.133:0/2974650475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4b41f1ca0 con 0x7fb4b406d520 2023-12-19T18:59:05.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4bbe17640 1 -- 172.21.15.133:0/2974650475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b4068400 con 0x7fb4b406d520 2023-12-19T18:59:05.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.928+0000 7fb4aa7fc640 1 -- 172.21.15.133:0/2974650475 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb4b00b4040 con 0x7fb4b406d520 2023-12-19T18:59:05.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.932+0000 7fb4aa7fc640 1 --2- 172.21.15.133:0/2974650475 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb498066470 0x7fb498068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:05.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.932+0000 7fb4aa7fc640 1 -- 172.21.15.133:0/2974650475 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4b011e2a0 con 0x7fb4b406d520 2023-12-19T18:59:05.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.932+0000 7fb4b93b2640 1 --2- 172.21.15.133:0/2974650475 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb498066470 0x7fb498068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:05.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.932+0000 7fb4b93b2640 1 --2- 172.21.15.133:0/2974650475 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb498066470 0x7fb498068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb4b41504a0 tx=0x7fb4a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:05.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:05.936+0000 7fb4aa7fc640 1 -- 172.21.15.133:0/2974650475 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb4b00eb710 con 0x7fb4b406d520 2023-12-19T18:59:06.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.084+0000 7fb4bbe17640 1 -- 172.21.15.133:0/2974650475 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4b40bfd40 con 0x7fb4b406d520 2023-12-19T18:59:06.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.084+0000 7fb4aa7fc640 1 -- 172.21.15.133:0/2974650475 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb4b00eed30 con 0x7fb4b406d520 2023-12-19T18:59:06.089 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T18:59:06.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.084+0000 7fb4bbe17640 1 -- 172.21.15.133:0/2974650475 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb498066470 msgr2=0x7fb498068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:06.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.084+0000 7fb4bbe17640 1 --2- 172.21.15.133:0/2974650475 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb498066470 0x7fb498068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb4b41504a0 tx=0x7fb4a4009040 comp rx=0 tx=0).stop 2023-12-19T18:59:06.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.084+0000 7fb4bbe17640 1 -- 172.21.15.133:0/2974650475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4b406d520 msgr2=0x7fb4b40a9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:06.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.084+0000 7fb4bbe17640 1 --2- 172.21.15.133:0/2974650475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4b406d520 0x7fb4b40a9260 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb4b00b0040 tx=0x7fb4b00191f0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.088+0000 7fb4bbe17640 1 -- 172.21.15.133:0/2974650475 shutdown_connections 2023-12-19T18:59:06.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.088+0000 7fb4bbe17640 1 --2- 172.21.15.133:0/2974650475 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb498066470 0x7fb498068930 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.088+0000 7fb4bbe17640 1 --2- 172.21.15.133:0/2974650475 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4b41560e0 0x7fb4b41551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.088+0000 7fb4bbe17640 1 --2- 172.21.15.133:0/2974650475 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb4b40bffc0 0x7fb4b41f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.088+0000 7fb4bbe17640 1 --2- 172.21.15.133:0/2974650475 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4b406d520 0x7fb4b40a9260 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.088+0000 7fb4bbe17640 1 -- 172.21.15.133:0/2974650475 >> 172.21.15.133:0/2974650475 conn(0x7fb4b406a5b0 msgr2=0x7fb4b406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:06.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.088+0000 7fb4bbe17640 1 -- 172.21.15.133:0/2974650475 shutdown_connections 2023-12-19T18:59:06.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.088+0000 7fb4bbe17640 1 -- 172.21.15.133:0/2974650475 wait complete. 2023-12-19T18:59:06.109 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:59:06.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.244+0000 7ff94c557640 1 Processor -- start 2023-12-19T18:59:06.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.244+0000 7ff94c557640 1 -- start start 2023-12-19T18:59:06.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.244+0000 7ff94c557640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff944151e90 0x7ff9440c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:06.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.244+0000 7ff94c557640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9440c4e60 0x7ff94406bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:06.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.244+0000 7ff94c557640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94406c860 con 0x7ff9440c7ea0 2023-12-19T18:59:06.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.244+0000 7ff94c557640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9440c8750 con 0x7ff9440c4e60 2023-12-19T18:59:06.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.244+0000 7ff94c557640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9441552d0 con 0x7ff944151e90 2023-12-19T18:59:06.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.248+0000 7ff94aaf4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff9440c4e60 0x7ff94406bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:06.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.248+0000 7ff949af2640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7ff9440c7ea0 0x7ff94406b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:57488/0 (socket says 172.21.15.133:57488) 2023-12-19T18:59:06.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.248+0000 7ff949af2640 1 -- 172.21.15.133:0/3540523348 learned_addr learned my addr 172.21.15.133:0/3540523348 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:06.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.248+0000 7ff94a2f3640 1 --2- 172.21.15.133:0/3540523348 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff944151e90 0x7ff9440c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:06.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.248+0000 7ff94aaf4640 1 -- 172.21.15.133:0/3540523348 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff944151e90 msgr2=0x7ff9440c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:06.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.248+0000 7ff94aaf4640 1 --2- 172.21.15.133:0/3540523348 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff944151e90 0x7ff9440c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.248+0000 7ff94aaf4640 1 -- 172.21.15.133:0/3540523348 >> v1:172.21.15.138:6789/0 conn(0x7ff9440c7ea0 legacy=0x7ff94406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:06.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.248+0000 7ff94aaf4640 1 -- 172.21.15.133:0/3540523348 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff944154930 con 0x7ff9440c4e60 2023-12-19T18:59:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.248+0000 7ff94aaf4640 1 --2- 172.21.15.133:0/3540523348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9440c4e60 0x7ff94406bbb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009d90 tx=0x7ff93c01c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cab31c7e3f61adf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.248+0000 7ff9492f1640 1 -- 172.21.15.133:0/3540523348 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c0a6700 con 0x7ff9440c4e60 2023-12-19T18:59:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.248+0000 7ff9492f1640 1 -- 172.21.15.133:0/3540523348 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93c0a6860 con 0x7ff9440c4e60 2023-12-19T18:59:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.248+0000 7ff9492f1640 1 -- 172.21.15.133:0/3540523348 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c0a6bf0 con 0x7ff9440c4e60 2023-12-19T18:59:06.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff94c557640 1 -- 172.21.15.133:0/3540523348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9440c4e60 msgr2=0x7ff94406bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:06.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff94c557640 1 --2- 172.21.15.133:0/3540523348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9440c4e60 0x7ff94406bbb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009d90 tx=0x7ff93c01c830 comp rx=0 tx=0).stop 2023-12-19T18:59:06.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff94c557640 1 -- 172.21.15.133:0/3540523348 shutdown_connections 2023-12-19T18:59:06.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff94c557640 1 --2- 172.21.15.133:0/3540523348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9440c4e60 0x7ff94406bbb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff94c557640 1 --2- 172.21.15.133:0/3540523348 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff944151e90 0x7ff9440c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff94c557640 1 -- 172.21.15.133:0/3540523348 >> 172.21.15.133:0/3540523348 conn(0x7ff9440ca170 msgr2=0x7ff9440ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:06.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff94c557640 1 -- 172.21.15.133:0/3540523348 shutdown_connections 2023-12-19T18:59:06.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff94c557640 1 -- 172.21.15.133:0/3540523348 wait complete. 2023-12-19T18:59:06.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff94c557640 1 Processor -- start 2023-12-19T18:59:06.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff94c557640 1 -- start start 2023-12-19T18:59:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff94c557640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9440c4e60 0x7ff944152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff94c557640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9440c7ea0 0x7ff9441ef830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff94c557640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff944151e90 0x7ff9441efd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff94c557640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440c2430 con 0x7ff9440c7ea0 2023-12-19T18:59:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff94c557640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440c2710 con 0x7ff944151e90 2023-12-19T18:59:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff94c557640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440c29f0 con 0x7ff9440c4e60 2023-12-19T18:59:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff949af2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9440c7ea0 0x7ff9441ef830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff949af2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9440c7ea0 0x7ff9441ef830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55736/0 (socket says 172.21.15.133:55736) 2023-12-19T18:59:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff949af2640 1 -- 172.21.15.133:0/1750930395 learned_addr learned my addr 172.21.15.133:0/1750930395 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff94aaf4640 1 --2- 172.21.15.133:0/1750930395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff944151e90 0x7ff9441efd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff94a2f3640 1 --2- 172.21.15.133:0/1750930395 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9440c4e60 0x7ff944152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff949af2640 1 -- 172.21.15.133:0/1750930395 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9440c4e60 msgr2=0x7ff944152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff949af2640 1 --2- 172.21.15.133:0/1750930395 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9440c4e60 0x7ff944152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff949af2640 1 -- 172.21.15.133:0/1750930395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff944151e90 msgr2=0x7ff9441efd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:06.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff949af2640 1 --2- 172.21.15.133:0/1750930395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff944151e90 0x7ff9441efd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff949af2640 1 -- 172.21.15.133:0/1750930395 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff93c009a70 con 0x7ff9440c7ea0 2023-12-19T18:59:06.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.252+0000 7ff94a2f3640 1 --2- 172.21.15.133:0/1750930395 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9440c4e60 0x7ff944152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:06.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.256+0000 7ff949af2640 1 --2- 172.21.15.133:0/1750930395 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9440c7ea0 0x7ff9441ef830 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff93400c4d0 tx=0x7ff93400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:06.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.256+0000 7ff93affd640 1 -- 172.21.15.133:0/1750930395 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934005cf0 con 0x7ff9440c7ea0 2023-12-19T18:59:06.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.256+0000 7ff93affd640 1 -- 172.21.15.133:0/1750930395 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff934005e50 con 0x7ff9440c7ea0 2023-12-19T18:59:06.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.256+0000 7ff94c557640 1 -- 172.21.15.133:0/1750930395 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9440c2cd0 con 0x7ff9440c7ea0 2023-12-19T18:59:06.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.256+0000 7ff93affd640 1 -- 172.21.15.133:0/1750930395 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934007270 con 0x7ff9440c7ea0 2023-12-19T18:59:06.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.256+0000 7ff94c557640 1 -- 172.21.15.133:0/1750930395 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9440c36f0 con 0x7ff9440c7ea0 2023-12-19T18:59:06.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.256+0000 7ff94c557640 1 -- 172.21.15.133:0/1750930395 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9441ee2f0 con 0x7ff9440c7ea0 2023-12-19T18:59:06.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.256+0000 7ff93affd640 1 -- 172.21.15.133:0/1750930395 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff9340073d0 con 0x7ff9440c7ea0 2023-12-19T18:59:06.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.256+0000 7ff93affd640 1 --2- 172.21.15.133:0/1750930395 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff928066470 0x7ff928068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:06.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.256+0000 7ff93affd640 1 -- 172.21.15.133:0/1750930395 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff934083290 con 0x7ff9440c7ea0 2023-12-19T18:59:06.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.256+0000 7ff94a2f3640 1 --2- 172.21.15.133:0/1750930395 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff928066470 0x7ff928068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:06.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.260+0000 7ff94a2f3640 1 --2- 172.21.15.133:0/1750930395 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff928066470 0x7ff928068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff940009bb0 tx=0x7ff940008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:06.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.260+0000 7ff93affd640 1 -- 172.21.15.133:0/1750930395 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff9340507b0 con 0x7ff9440c7ea0 2023-12-19T18:59:06.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.412+0000 7ff94c557640 1 -- 172.21.15.133:0/1750930395 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff944068400 con 0x7ff9440c7ea0 2023-12-19T18:59:06.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.412+0000 7ff93affd640 1 -- 172.21.15.133:0/1750930395 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff934053dd0 con 0x7ff9440c7ea0 2023-12-19T18:59:06.417 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T18:59:06.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.412+0000 7ff94c557640 1 -- 172.21.15.133:0/1750930395 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff928066470 msgr2=0x7ff928068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:06.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.412+0000 7ff94c557640 1 --2- 172.21.15.133:0/1750930395 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff928066470 0x7ff928068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff940009bb0 tx=0x7ff940008040 comp rx=0 tx=0).stop 2023-12-19T18:59:06.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.412+0000 7ff94c557640 1 -- 172.21.15.133:0/1750930395 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9440c7ea0 msgr2=0x7ff9441ef830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:06.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.412+0000 7ff94c557640 1 --2- 172.21.15.133:0/1750930395 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9440c7ea0 0x7ff9441ef830 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff93400c4d0 tx=0x7ff93400c990 comp rx=0 tx=0).stop 2023-12-19T18:59:06.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.412+0000 7ff94c557640 1 -- 172.21.15.133:0/1750930395 shutdown_connections 2023-12-19T18:59:06.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.412+0000 7ff94c557640 1 --2- 172.21.15.133:0/1750930395 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff928066470 0x7ff928068930 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.412+0000 7ff94c557640 1 --2- 172.21.15.133:0/1750930395 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff944151e90 0x7ff9441efd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.412+0000 7ff94c557640 1 --2- 172.21.15.133:0/1750930395 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9440c7ea0 0x7ff9441ef830 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.412+0000 7ff94c557640 1 --2- 172.21.15.133:0/1750930395 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9440c4e60 0x7ff944152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.412+0000 7ff94c557640 1 -- 172.21.15.133:0/1750930395 >> 172.21.15.133:0/1750930395 conn(0x7ff9440ca170 msgr2=0x7ff9440c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:06.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.416+0000 7ff94c557640 1 -- 172.21.15.133:0/1750930395 shutdown_connections 2023-12-19T18:59:06.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.416+0000 7ff94c557640 1 -- 172.21.15.133:0/1750930395 wait complete. 2023-12-19T18:59:06.439 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:59:06.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.572+0000 7f0ef88dd640 1 Processor -- start 2023-12-19T18:59:06.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.572+0000 7f0ef88dd640 1 -- start start 2023-12-19T18:59:06.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.572+0000 7f0ef88dd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ef4151e90 0x7f0ef40c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:06.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.572+0000 7f0ef88dd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0ef40c7ea0 0x7f0ef406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:06.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.572+0000 7f0ef88dd640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef406c860 con 0x7f0ef40c4e60 2023-12-19T18:59:06.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.572+0000 7f0ef88dd640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef40c8750 con 0x7f0ef40c7ea0 2023-12-19T18:59:06.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.572+0000 7f0ef88dd640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef41552d0 con 0x7f0ef4151e90 2023-12-19T18:59:06.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.572+0000 7f0eebfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0ef40c7ea0 0x7f0ef406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:06.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.572+0000 7f0eebfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0ef40c7ea0 0x7f0ef406b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55748/0 (socket says 172.21.15.133:55748) 2023-12-19T18:59:06.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.572+0000 7f0eebfff640 1 -- 172.21.15.133:0/1371021834 learned_addr learned my addr 172.21.15.133:0/1371021834 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:06.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.572+0000 7f0ef259c640 1 --2- 172.21.15.133:0/1371021834 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ef4151e90 0x7f0ef40c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:06.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.572+0000 7f0eebfff640 1 -- 172.21.15.133:0/1371021834 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ef4151e90 msgr2=0x7f0ef40c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:06.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.572+0000 7f0eebfff640 1 --2- 172.21.15.133:0/1371021834 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ef4151e90 0x7f0ef40c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.572+0000 7f0eebfff640 1 -- 172.21.15.133:0/1371021834 >> v1:172.21.15.138:6789/0 conn(0x7f0ef40c4e60 legacy=0x7f0ef406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:06.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.572+0000 7f0eebfff640 1 -- 172.21.15.133:0/1371021834 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef4154930 con 0x7f0ef40c7ea0 2023-12-19T18:59:06.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.576+0000 7f0eebfff640 1 --2- 172.21.15.133:0/1371021834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ef40c7ea0 0x7f0ef406b4a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009870 tx=0x7f0edc01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ef167a9b9d8502 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:06.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.576+0000 7f0ef1d9b640 1 -- 172.21.15.133:0/1371021834 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc0ab600 con 0x7f0ef40c7ea0 2023-12-19T18:59:06.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.576+0000 7f0ef1d9b640 1 -- 172.21.15.133:0/1371021834 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc0a7050 con 0x7f0ef40c7ea0 2023-12-19T18:59:06.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.576+0000 7f0ef1d9b640 1 -- 172.21.15.133:0/1371021834 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc0ab980 con 0x7f0ef40c7ea0 2023-12-19T18:59:06.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.576+0000 7f0ef88dd640 1 -- 172.21.15.133:0/1371021834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ef40c7ea0 msgr2=0x7f0ef406b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:06.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.576+0000 7f0ef88dd640 1 --2- 172.21.15.133:0/1371021834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ef40c7ea0 0x7f0ef406b4a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0edc009870 tx=0x7f0edc01c420 comp rx=0 tx=0).stop 2023-12-19T18:59:06.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.576+0000 7f0ef88dd640 1 -- 172.21.15.133:0/1371021834 shutdown_connections 2023-12-19T18:59:06.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.576+0000 7f0ef88dd640 1 --2- 172.21.15.133:0/1371021834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ef40c7ea0 0x7f0ef406b4a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.576+0000 7f0ef88dd640 1 --2- 172.21.15.133:0/1371021834 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ef4151e90 0x7f0ef40c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.576+0000 7f0ef88dd640 1 -- 172.21.15.133:0/1371021834 >> 172.21.15.133:0/1371021834 conn(0x7f0ef40ca170 msgr2=0x7f0ef40ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:06.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.576+0000 7f0ef88dd640 1 -- 172.21.15.133:0/1371021834 shutdown_connections 2023-12-19T18:59:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.576+0000 7f0ef88dd640 1 -- 172.21.15.133:0/1371021834 wait complete. 2023-12-19T18:59:06.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0ef88dd640 1 Processor -- start 2023-12-19T18:59:06.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0ef88dd640 1 -- start start 2023-12-19T18:59:06.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0ef88dd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ef40c4e60 0x7f0ef40c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:06.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0ef88dd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ef40c7ea0 0x7f0ef4158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:06.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0ef88dd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ef4151e90 0x7f0ef41587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:06.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0ef88dd640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef40abe90 con 0x7f0ef40c4e60 2023-12-19T18:59:06.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0ef88dd640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef41f04d0 con 0x7f0ef4151e90 2023-12-19T18:59:06.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0ef88dd640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef40abaf0 con 0x7f0ef40c7ea0 2023-12-19T18:59:06.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0ef259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ef40c4e60 0x7f0ef40c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:06.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0ef259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ef40c4e60 0x7f0ef40c2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55756/0 (socket says 172.21.15.133:55756) 2023-12-19T18:59:06.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0ef259c640 1 -- 172.21.15.133:0/1016198586 learned_addr learned my addr 172.21.15.133:0/1016198586 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:06.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0eebfff640 1 --2- 172.21.15.133:0/1016198586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ef40c7ea0 0x7f0ef4158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:06.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0ef2d9d640 1 --2- 172.21.15.133:0/1016198586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ef4151e90 0x7f0ef41587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:06.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0ef259c640 1 -- 172.21.15.133:0/1016198586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ef40c7ea0 msgr2=0x7f0ef4158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:06.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0ef259c640 1 --2- 172.21.15.133:0/1016198586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ef40c7ea0 0x7f0ef4158290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0ef259c640 1 -- 172.21.15.133:0/1016198586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ef4151e90 msgr2=0x7f0ef41587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:06.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0ef259c640 1 --2- 172.21.15.133:0/1016198586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ef4151e90 0x7f0ef41587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0ef259c640 1 -- 172.21.15.133:0/1016198586 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0edc0094d0 con 0x7f0ef40c4e60 2023-12-19T18:59:06.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0ef2d9d640 1 --2- 172.21.15.133:0/1016198586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ef4151e90 0x7f0ef41587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:06.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0ef259c640 1 --2- 172.21.15.133:0/1016198586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ef40c4e60 0x7f0ef40c2b70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400d830 tx=0x7f0ee400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:06.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0eeaffd640 1 -- 172.21.15.133:0/1016198586 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee400b6c0 con 0x7f0ef40c4e60 2023-12-19T18:59:06.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0eeaffd640 1 -- 172.21.15.133:0/1016198586 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee400b820 con 0x7f0ef40c4e60 2023-12-19T18:59:06.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0eeaffd640 1 -- 172.21.15.133:0/1016198586 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee400bb90 con 0x7f0ef40c4e60 2023-12-19T18:59:06.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0ef88dd640 1 -- 172.21.15.133:0/1016198586 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef40a9d00 con 0x7f0ef40c4e60 2023-12-19T18:59:06.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.580+0000 7f0ef88dd640 1 -- 172.21.15.133:0/1016198586 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef414e430 con 0x7f0ef40c4e60 2023-12-19T18:59:06.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.584+0000 7f0ef88dd640 1 -- 172.21.15.133:0/1016198586 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef40c4c30 con 0x7f0ef40c4e60 2023-12-19T18:59:06.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.584+0000 7f0eeaffd640 1 -- 172.21.15.133:0/1016198586 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0ee401e460 con 0x7f0ef40c4e60 2023-12-19T18:59:06.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.584+0000 7f0eeaffd640 1 --2- 172.21.15.133:0/1016198586 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0ed4066470 0x7f0ed4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:06.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.584+0000 7f0eeaffd640 1 -- 172.21.15.133:0/1016198586 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ee40845d0 con 0x7f0ef40c4e60 2023-12-19T18:59:06.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.584+0000 7f0eebfff640 1 --2- 172.21.15.133:0/1016198586 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0ed4066470 0x7f0ed4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:06.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.584+0000 7f0eebfff640 1 --2- 172.21.15.133:0/1016198586 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0ed4066470 0x7f0ed4068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0edc0ad000 tx=0x7f0edc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:06.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.588+0000 7f0eeaffd640 1 -- 172.21.15.133:0/1016198586 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0ee4051a40 con 0x7f0ef40c4e60 2023-12-19T18:59:06.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.740+0000 7f0ef88dd640 1 -- 172.21.15.133:0/1016198586 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ef4068400 con 0x7f0ef40c4e60 2023-12-19T18:59:06.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.744+0000 7f0eeaffd640 1 -- 172.21.15.133:0/1016198586 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f0ee4055060 con 0x7f0ef40c4e60 2023-12-19T18:59:06.747 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:06.747 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:44.402984+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:58:40.991408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T18:58:41.773992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:59:06.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.744+0000 7f0ef88dd640 1 -- 172.21.15.133:0/1016198586 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0ed4066470 msgr2=0x7f0ed4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:06.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.744+0000 7f0ef88dd640 1 --2- 172.21.15.133:0/1016198586 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0ed4066470 0x7f0ed4068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0edc0ad000 tx=0x7f0edc008040 comp rx=0 tx=0).stop 2023-12-19T18:59:06.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.744+0000 7f0ef88dd640 1 -- 172.21.15.133:0/1016198586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ef40c4e60 msgr2=0x7f0ef40c2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:06.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.744+0000 7f0ef88dd640 1 --2- 172.21.15.133:0/1016198586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ef40c4e60 0x7f0ef40c2b70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400d830 tx=0x7f0ee400dcf0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.744+0000 7f0ef88dd640 1 -- 172.21.15.133:0/1016198586 shutdown_connections 2023-12-19T18:59:06.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.744+0000 7f0ef88dd640 1 --2- 172.21.15.133:0/1016198586 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0ed4066470 0x7f0ed4068930 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.744+0000 7f0ef88dd640 1 --2- 172.21.15.133:0/1016198586 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ef4151e90 0x7f0ef41587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.744+0000 7f0ef88dd640 1 --2- 172.21.15.133:0/1016198586 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ef40c7ea0 0x7f0ef4158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.744+0000 7f0ef88dd640 1 --2- 172.21.15.133:0/1016198586 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ef40c4e60 0x7f0ef40c2b70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.744+0000 7f0ef88dd640 1 -- 172.21.15.133:0/1016198586 >> 172.21.15.133:0/1016198586 conn(0x7f0ef40ca170 msgr2=0x7f0ef414b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:06.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.744+0000 7f0ef88dd640 1 -- 172.21.15.133:0/1016198586 shutdown_connections 2023-12-19T18:59:06.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.744+0000 7f0ef88dd640 1 -- 172.21.15.133:0/1016198586 wait complete. 2023-12-19T18:59:06.768 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:58:40.991408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:58:41.773992+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:59:06.769 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:59:06.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a5eafe640 1 Processor -- start 2023-12-19T18:59:06.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a5eafe640 1 -- start start 2023-12-19T18:59:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a5eafe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6a58152030 0x7f6a580c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a5eafe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a5806c470 0x7f6a58157c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a5eafe640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a58154b60 con 0x7f6a58154ff0 2023-12-19T18:59:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a5eafe640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a58152410 con 0x7f6a58152030 2023-12-19T18:59:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a5eafe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a580c1820 con 0x7f6a5806c470 2023-12-19T18:59:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a5d09b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6a58154ff0 0x7f6a580c2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59042/0 (socket says 172.21.15.133:59042) 2023-12-19T18:59:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a5d09b640 1 -- 172.21.15.133:0/734792548 learned_addr learned my addr 172.21.15.133:0/734792548 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a5c89a640 1 --2- 172.21.15.133:0/734792548 >> v2:172.21.15.138:3300/0 conn(0x7f6a58152030 0x7f6a580c0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a57fff640 1 --2- 172.21.15.133:0/734792548 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a5806c470 0x7f6a58157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a577fe640 1 -- 172.21.15.133:0/734792548 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730860646 0 0) 0x7f6a58154b60 con 0x7f6a58154ff0 2023-12-19T18:59:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a577fe640 1 -- 172.21.15.133:0/734792548 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a48003530 con 0x7f6a58154ff0 2023-12-19T18:59:06.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a577fe640 1 -- 172.21.15.133:0/734792548 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1589865591 0 0) 0x7f6a48003530 con 0x7f6a58154ff0 2023-12-19T18:59:06.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a577fe640 1 -- 172.21.15.133:0/734792548 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a5806c470 msgr2=0x7f6a58157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:06.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a577fe640 1 --2- 172.21.15.133:0/734792548 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a5806c470 0x7f6a58157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a577fe640 1 -- 172.21.15.133:0/734792548 >> v2:172.21.15.138:3300/0 conn(0x7f6a58152030 msgr2=0x7f6a580c0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:06.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a577fe640 1 --2- 172.21.15.133:0/734792548 >> v2:172.21.15.138:3300/0 conn(0x7f6a58152030 0x7f6a580c0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a577fe640 1 -- 172.21.15.133:0/734792548 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a580c1260 con 0x7f6a58154ff0 2023-12-19T18:59:06.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a577fe640 1 -- 172.21.15.133:0/734792548 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f6a50001a00 con 0x7f6a58154ff0 2023-12-19T18:59:06.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a577fe640 1 -- 172.21.15.133:0/734792548 >> v1:172.21.15.133:6789/0 conn(0x7f6a58154ff0 legacy=0x7f6a580c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:06.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a577fe640 1 --2- 172.21.15.133:0/734792548 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a5806c470 0x7f6a48003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:06.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a577fe640 1 --2- 172.21.15.133:0/734792548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a48003f00 0x7f6a480047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:06.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a577fe640 1 --2- 172.21.15.133:0/734792548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a48004d10 0x7f6a48005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:06.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a577fe640 1 -- 172.21.15.133:0/734792548 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a58152410 con 0x7f6a48003f00 2023-12-19T18:59:06.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a577fe640 1 -- 172.21.15.133:0/734792548 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a580c1820 con 0x7f6a48004d10 2023-12-19T18:59:06.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a577fe640 1 -- 172.21.15.133:0/734792548 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4800b9e0 con 0x7f6a5806c470 2023-12-19T18:59:06.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a57fff640 1 --2- 172.21.15.133:0/734792548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a48003f00 0x7f6a480047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:06.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a5c89a640 1 --2- 172.21.15.133:0/734792548 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a5806c470 0x7f6a48003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:06.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a5d09b640 1 --2- 172.21.15.133:0/734792548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a48004d10 0x7f6a48005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:06.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a57fff640 1 -- 172.21.15.133:0/734792548 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a5806c470 msgr2=0x7f6a48003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:06.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a57fff640 1 --2- 172.21.15.133:0/734792548 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a5806c470 0x7f6a48003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a57fff640 1 -- 172.21.15.133:0/734792548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a48004d10 msgr2=0x7f6a48005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:06.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a57fff640 1 --2- 172.21.15.133:0/734792548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a48004d10 0x7f6a48005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a57fff640 1 -- 172.21.15.133:0/734792548 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a48003530 con 0x7f6a48003f00 2023-12-19T18:59:06.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.908+0000 7f6a5d09b640 1 --2- 172.21.15.133:0/734792548 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a48004d10 0x7f6a48005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.912+0000 7f6a57fff640 1 --2- 172.21.15.133:0/734792548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a48003f00 0x7f6a480047d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6a44009b10 tx=0x7f6a4401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f68c397505fc439 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.912+0000 7f6a577fe640 1 -- 172.21.15.133:0/734792548 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a440a55f0 con 0x7f6a48003f00 2023-12-19T18:59:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.912+0000 7f6a577fe640 1 -- 172.21.15.133:0/734792548 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a440a5750 con 0x7f6a48003f00 2023-12-19T18:59:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.912+0000 7f6a577fe640 1 -- 172.21.15.133:0/734792548 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a440a5b00 con 0x7f6a48003f00 2023-12-19T18:59:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.912+0000 7f6a5eafe640 1 -- 172.21.15.133:0/734792548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a48003f00 msgr2=0x7f6a480047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.912+0000 7f6a5eafe640 1 --2- 172.21.15.133:0/734792548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a48003f00 0x7f6a480047d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6a44009b10 tx=0x7f6a4401ca20 comp rx=0 tx=0).stop 2023-12-19T18:59:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.912+0000 7f6a5d09b640 1 -- 172.21.15.133:0/734792548 reap_dead start 2023-12-19T18:59:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.912+0000 7f6a5eafe640 1 -- 172.21.15.133:0/734792548 shutdown_connections 2023-12-19T18:59:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.912+0000 7f6a5eafe640 1 -- 172.21.15.133:0/734792548 >> 172.21.15.133:0/734792548 conn(0x7f6a5806a5b0 msgr2=0x7f6a5806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.912+0000 7f6a5eafe640 1 -- 172.21.15.133:0/734792548 shutdown_connections 2023-12-19T18:59:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.912+0000 7f6a5eafe640 1 -- 172.21.15.133:0/734792548 wait complete. 2023-12-19T18:59:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a5eafe640 1 Processor -- start 2023-12-19T18:59:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a5eafe640 1 -- start start 2023-12-19T18:59:06.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a5eafe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a48003f00 0x7f6a58071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:06.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a5eafe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a58153800 0x7f6a5815a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:06.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a5eafe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a5815ab10 0x7f6a58070350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:06.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a5eafe640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a581f1190 con 0x7f6a58153800 2023-12-19T18:59:06.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a5eafe640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a58072010 con 0x7f6a48003f00 2023-12-19T18:59:06.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a5eafe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a58072290 con 0x7f6a5815ab10 2023-12-19T18:59:06.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a57fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a58153800 0x7f6a5815a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:06.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a57fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a58153800 0x7f6a5815a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55784/0 (socket says 172.21.15.133:55784) 2023-12-19T18:59:06.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a57fff640 1 -- 172.21.15.133:0/954379284 learned_addr learned my addr 172.21.15.133:0/954379284 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:06.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a5c89a640 1 --2- 172.21.15.133:0/954379284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a48003f00 0x7f6a58071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:06.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a5d09b640 1 --2- 172.21.15.133:0/954379284 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a5815ab10 0x7f6a58070350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:06.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a57fff640 1 -- 172.21.15.133:0/954379284 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a5815ab10 msgr2=0x7f6a58070350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:06.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a57fff640 1 --2- 172.21.15.133:0/954379284 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a5815ab10 0x7f6a58070350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a57fff640 1 -- 172.21.15.133:0/954379284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a48003f00 msgr2=0x7f6a58071ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:06.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a57fff640 1 --2- 172.21.15.133:0/954379284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a48003f00 0x7f6a58071ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:06.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a57fff640 1 -- 172.21.15.133:0/954379284 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a581f0860 con 0x7f6a58153800 2023-12-19T18:59:06.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a57fff640 1 --2- 172.21.15.133:0/954379284 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a58153800 0x7f6a5815a5d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6a4401c850 tx=0x7f6a48005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:06.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a557fa640 1 -- 172.21.15.133:0/954379284 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a440a55f0 con 0x7f6a58153800 2023-12-19T18:59:06.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a557fa640 1 -- 172.21.15.133:0/954379284 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a44004020 con 0x7f6a58153800 2023-12-19T18:59:06.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a557fa640 1 -- 172.21.15.133:0/954379284 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a440043f0 con 0x7f6a58153800 2023-12-19T18:59:06.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a5eafe640 1 -- 172.21.15.133:0/954379284 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a581f0b40 con 0x7f6a58153800 2023-12-19T18:59:06.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.916+0000 7f6a5eafe640 1 -- 172.21.15.133:0/954379284 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a581f1620 con 0x7f6a58153800 2023-12-19T18:59:06.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.920+0000 7f6a5eafe640 1 -- 172.21.15.133:0/954379284 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a58068400 con 0x7f6a58153800 2023-12-19T18:59:06.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.920+0000 7f6a557fa640 1 -- 172.21.15.133:0/954379284 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6a440b4040 con 0x7f6a58153800 2023-12-19T18:59:06.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.920+0000 7f6a557fa640 1 --2- 172.21.15.133:0/954379284 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6a3c0664a0 0x7f6a3c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:06.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.920+0000 7f6a557fa640 1 -- 172.21.15.133:0/954379284 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a4411dfa0 con 0x7f6a58153800 2023-12-19T18:59:06.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.920+0000 7f6a5c89a640 1 --2- 172.21.15.133:0/954379284 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6a3c0664a0 0x7f6a3c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:06.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.920+0000 7f6a5c89a640 1 --2- 172.21.15.133:0/954379284 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6a3c0664a0 0x7f6a3c068960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6a581eb090 tx=0x7f6a4c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:06.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:06.924+0000 7f6a557fa640 1 -- 172.21.15.133:0/954379284 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6a4414f290 con 0x7f6a58153800 2023-12-19T18:59:07.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.072+0000 7f6a5eafe640 1 -- 172.21.15.133:0/954379284 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a58158b70 con 0x7f6a58153800 2023-12-19T18:59:07.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.072+0000 7f6a557fa640 1 -- 172.21.15.133:0/954379284 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a440eb680 con 0x7f6a58153800 2023-12-19T18:59:07.077 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T18:59:07.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.072+0000 7f6a5eafe640 1 -- 172.21.15.133:0/954379284 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6a3c0664a0 msgr2=0x7f6a3c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:07.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.072+0000 7f6a5eafe640 1 --2- 172.21.15.133:0/954379284 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6a3c0664a0 0x7f6a3c068960 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6a581eb090 tx=0x7f6a4c009190 comp rx=0 tx=0).stop 2023-12-19T18:59:07.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.072+0000 7f6a5eafe640 1 -- 172.21.15.133:0/954379284 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a58153800 msgr2=0x7f6a5815a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:07.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.072+0000 7f6a5eafe640 1 --2- 172.21.15.133:0/954379284 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a58153800 0x7f6a5815a5d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6a4401c850 tx=0x7f6a48005800 comp rx=0 tx=0).stop 2023-12-19T18:59:07.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.076+0000 7f6a5eafe640 1 -- 172.21.15.133:0/954379284 shutdown_connections 2023-12-19T18:59:07.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.076+0000 7f6a5eafe640 1 --2- 172.21.15.133:0/954379284 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6a3c0664a0 0x7f6a3c068960 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.076+0000 7f6a5eafe640 1 --2- 172.21.15.133:0/954379284 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a5815ab10 0x7f6a58070350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.076+0000 7f6a5eafe640 1 --2- 172.21.15.133:0/954379284 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a58153800 0x7f6a5815a5d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.076+0000 7f6a5eafe640 1 --2- 172.21.15.133:0/954379284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a48003f00 0x7f6a58071ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.076+0000 7f6a5eafe640 1 -- 172.21.15.133:0/954379284 >> 172.21.15.133:0/954379284 conn(0x7f6a5806a5b0 msgr2=0x7f6a58150da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:07.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.076+0000 7f6a5eafe640 1 -- 172.21.15.133:0/954379284 shutdown_connections 2023-12-19T18:59:07.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.076+0000 7f6a5eafe640 1 -- 172.21.15.133:0/954379284 wait complete. 2023-12-19T18:59:07.098 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:59:07.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.236+0000 7f2d94be6640 1 Processor -- start 2023-12-19T18:59:07.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.236+0000 7f2d94be6640 1 -- start start 2023-12-19T18:59:07.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.236+0000 7f2d94be6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2d900a5370 0x7f2d900c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:07.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.236+0000 7f2d94be6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d900c4110 0x7f2d90150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:07.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.236+0000 7f2d94be6640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d900c2760 con 0x7f2d90072090 2023-12-19T18:59:07.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.236+0000 7f2d94be6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d900c3070 con 0x7f2d900a5370 2023-12-19T18:59:07.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.236+0000 7f2d94be6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d90151bf0 con 0x7f2d900c4110 2023-12-19T18:59:07.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.236+0000 7f2d8e59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2d900a5370 0x7f2d900c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:07.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.236+0000 7f2d8e59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2d900a5370 0x7f2d900c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55794/0 (socket says 172.21.15.133:55794) 2023-12-19T18:59:07.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.236+0000 7f2d8e59c640 1 -- 172.21.15.133:0/2100206680 learned_addr learned my addr 172.21.15.133:0/2100206680 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:07.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.236+0000 7f2d8dd9b640 1 --2- 172.21.15.133:0/2100206680 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d900c4110 0x7f2d90150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:07.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.236+0000 7f2d8e59c640 1 -- 172.21.15.133:0/2100206680 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d900c4110 msgr2=0x7f2d90150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:07.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.236+0000 7f2d8e59c640 1 --2- 172.21.15.133:0/2100206680 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d900c4110 0x7f2d90150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.236+0000 7f2d8e59c640 1 -- 172.21.15.133:0/2100206680 >> v1:172.21.15.138:6789/0 conn(0x7f2d90072090 legacy=0x7f2d901514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:07.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.236+0000 7f2d8e59c640 1 -- 172.21.15.133:0/2100206680 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d900a5750 con 0x7f2d900a5370 2023-12-19T18:59:07.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.236+0000 7f2d8dd9b640 1 --2- 172.21.15.133:0/2100206680 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d900c4110 0x7f2d90150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:07.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.240+0000 7f2d8e59c640 1 --2- 172.21.15.133:0/2100206680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d900a5370 0x7f2d900c3bd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009e80 tx=0x7f2d8001c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c678b9fe2616197e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:07.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.240+0000 7f2d8d59a640 1 -- 172.21.15.133:0/2100206680 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d800a5660 con 0x7f2d900a5370 2023-12-19T18:59:07.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.240+0000 7f2d8d59a640 1 -- 172.21.15.133:0/2100206680 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d800a57c0 con 0x7f2d900a5370 2023-12-19T18:59:07.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.240+0000 7f2d8d59a640 1 -- 172.21.15.133:0/2100206680 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d800a5b50 con 0x7f2d900a5370 2023-12-19T18:59:07.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.240+0000 7f2d94be6640 1 -- 172.21.15.133:0/2100206680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d900a5370 msgr2=0x7f2d900c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:07.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.240+0000 7f2d94be6640 1 --2- 172.21.15.133:0/2100206680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d900a5370 0x7f2d900c3bd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2d80009e80 tx=0x7f2d8001c860 comp rx=0 tx=0).stop 2023-12-19T18:59:07.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.240+0000 7f2d94be6640 1 -- 172.21.15.133:0/2100206680 shutdown_connections 2023-12-19T18:59:07.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.240+0000 7f2d94be6640 1 --2- 172.21.15.133:0/2100206680 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d900c4110 0x7f2d90150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.240+0000 7f2d94be6640 1 --2- 172.21.15.133:0/2100206680 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d900a5370 0x7f2d900c3bd0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.240+0000 7f2d94be6640 1 -- 172.21.15.133:0/2100206680 >> 172.21.15.133:0/2100206680 conn(0x7f2d9006a5b0 msgr2=0x7f2d9006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:07.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.240+0000 7f2d94be6640 1 -- 172.21.15.133:0/2100206680 shutdown_connections 2023-12-19T18:59:07.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.240+0000 7f2d94be6640 1 -- 172.21.15.133:0/2100206680 wait complete. 2023-12-19T18:59:07.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d94be6640 1 Processor -- start 2023-12-19T18:59:07.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d94be6640 1 -- start start 2023-12-19T18:59:07.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d94be6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d90072090 0x7f2d90071810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:07.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d94be6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d900a5370 0x7f2d9014c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:07.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d94be6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d900c4110 0x7f2d9014c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:07.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d94be6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d900711e0 con 0x7f2d900a5370 2023-12-19T18:59:07.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d94be6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9014f520 con 0x7f2d90072090 2023-12-19T18:59:07.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d94be6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9014e740 con 0x7f2d900c4110 2023-12-19T18:59:07.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d8dd9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d900a5370 0x7f2d9014c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d8dd9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d900a5370 0x7f2d9014c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55802/0 (socket says 172.21.15.133:55802) 2023-12-19T18:59:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d8dd9b640 1 -- 172.21.15.133:0/1778811806 learned_addr learned my addr 172.21.15.133:0/1778811806 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d8ed9d640 1 --2- 172.21.15.133:0/1778811806 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d900c4110 0x7f2d9014c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d8e59c640 1 --2- 172.21.15.133:0/1778811806 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d90072090 0x7f2d90071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d8dd9b640 1 -- 172.21.15.133:0/1778811806 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d900c4110 msgr2=0x7f2d9014c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d8dd9b640 1 --2- 172.21.15.133:0/1778811806 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d900c4110 0x7f2d9014c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d8dd9b640 1 -- 172.21.15.133:0/1778811806 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d90072090 msgr2=0x7f2d90071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d8dd9b640 1 --2- 172.21.15.133:0/1778811806 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d90072090 0x7f2d90071810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d8dd9b640 1 -- 172.21.15.133:0/1778811806 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d80009b30 con 0x7f2d900a5370 2023-12-19T18:59:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d8dd9b640 1 --2- 172.21.15.133:0/1778811806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d900a5370 0x7f2d9014c210 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400c7f0 tx=0x7f2d8400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d7effd640 1 -- 172.21.15.133:0/1778811806 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d84007820 con 0x7f2d900a5370 2023-12-19T18:59:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d7effd640 1 -- 172.21.15.133:0/1778811806 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d84007980 con 0x7f2d900a5370 2023-12-19T18:59:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d7effd640 1 -- 172.21.15.133:0/1778811806 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d84007d30 con 0x7f2d900a5370 2023-12-19T18:59:07.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d94be6640 1 -- 172.21.15.133:0/1778811806 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d9014ef60 con 0x7f2d900a5370 2023-12-19T18:59:07.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d94be6640 1 -- 172.21.15.133:0/1778811806 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d900709e0 con 0x7f2d900a5370 2023-12-19T18:59:07.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.244+0000 7f2d94be6640 1 -- 172.21.15.133:0/1778811806 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d90068400 con 0x7f2d900a5370 2023-12-19T18:59:07.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.248+0000 7f2d7effd640 1 -- 172.21.15.133:0/1778811806 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2d840113f0 con 0x7f2d900a5370 2023-12-19T18:59:07.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.248+0000 7f2d7effd640 1 --2- 172.21.15.133:0/1778811806 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2d700664a0 0x7f2d70068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:07.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.248+0000 7f2d7effd640 1 -- 172.21.15.133:0/1778811806 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d840840f0 con 0x7f2d900a5370 2023-12-19T18:59:07.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.248+0000 7f2d8e59c640 1 --2- 172.21.15.133:0/1778811806 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2d700664a0 0x7f2d70068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:07.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.248+0000 7f2d8e59c640 1 --2- 172.21.15.133:0/1778811806 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2d700664a0 0x7f2d70068960 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2d800ae000 tx=0x7f2d800a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:07.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.252+0000 7f2d7effd640 1 -- 172.21.15.133:0/1778811806 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2d84051610 con 0x7f2d900a5370 2023-12-19T18:59:07.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.400+0000 7f2d94be6640 1 -- 172.21.15.133:0/1778811806 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2d900c6780 con 0x7f2d900a5370 2023-12-19T18:59:07.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.404+0000 7f2d7effd640 1 -- 172.21.15.133:0/1778811806 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2d84054c30 con 0x7f2d900a5370 2023-12-19T18:59:07.407 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T18:59:07.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.404+0000 7f2d94be6640 1 -- 172.21.15.133:0/1778811806 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2d700664a0 msgr2=0x7f2d70068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:07.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.404+0000 7f2d94be6640 1 --2- 172.21.15.133:0/1778811806 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2d700664a0 0x7f2d70068960 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2d800ae000 tx=0x7f2d800a7070 comp rx=0 tx=0).stop 2023-12-19T18:59:07.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.404+0000 7f2d94be6640 1 -- 172.21.15.133:0/1778811806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d900a5370 msgr2=0x7f2d9014c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:07.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.404+0000 7f2d94be6640 1 --2- 172.21.15.133:0/1778811806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d900a5370 0x7f2d9014c210 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2d8400c7f0 tx=0x7f2d8400ccb0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.404+0000 7f2d94be6640 1 -- 172.21.15.133:0/1778811806 shutdown_connections 2023-12-19T18:59:07.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.404+0000 7f2d94be6640 1 --2- 172.21.15.133:0/1778811806 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2d700664a0 0x7f2d70068960 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.404+0000 7f2d94be6640 1 --2- 172.21.15.133:0/1778811806 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2d900c4110 0x7f2d9014c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.404+0000 7f2d94be6640 1 --2- 172.21.15.133:0/1778811806 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2d900a5370 0x7f2d9014c210 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.404+0000 7f2d94be6640 1 --2- 172.21.15.133:0/1778811806 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2d90072090 0x7f2d90071810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.404+0000 7f2d94be6640 1 -- 172.21.15.133:0/1778811806 >> 172.21.15.133:0/1778811806 conn(0x7f2d9006a5b0 msgr2=0x7f2d9006d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:07.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.404+0000 7f2d94be6640 1 -- 172.21.15.133:0/1778811806 shutdown_connections 2023-12-19T18:59:07.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.404+0000 7f2d94be6640 1 -- 172.21.15.133:0/1778811806 wait complete. 2023-12-19T18:59:07.430 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:59:07.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.568+0000 7f06483aa640 1 Processor -- start 2023-12-19T18:59:07.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.568+0000 7f06483aa640 1 -- start start 2023-12-19T18:59:07.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.568+0000 7f06483aa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f06400c63c0 0x7f06400c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:07.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.568+0000 7f06483aa640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f06400c2bb0 0x7f06400a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:07.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.568+0000 7f06483aa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06400c31c0 con 0x7f06400c4100 2023-12-19T18:59:07.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.568+0000 7f06483aa640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06400c34a0 con 0x7f06400c2bb0 2023-12-19T18:59:07.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.568+0000 7f06483aa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06400c1030 con 0x7f06400c63c0 2023-12-19T18:59:07.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.568+0000 7f0646947640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f06400c2bb0 0x7f06400a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:07.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.568+0000 7f0646947640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f06400c2bb0 0x7f06400a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55812/0 (socket says 172.21.15.133:55812) 2023-12-19T18:59:07.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.568+0000 7f0646947640 1 -- 172.21.15.133:0/639017939 learned_addr learned my addr 172.21.15.133:0/639017939 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:07.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.568+0000 7f0646146640 1 --2- 172.21.15.133:0/639017939 >> v2:172.21.15.138:3300/0 conn(0x7f06400c63c0 0x7f06400c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:07.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.568+0000 7f0646947640 1 -- 172.21.15.133:0/639017939 >> v2:172.21.15.138:3300/0 conn(0x7f06400c63c0 msgr2=0x7f06400c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:07.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.568+0000 7f0646947640 1 --2- 172.21.15.133:0/639017939 >> v2:172.21.15.138:3300/0 conn(0x7f06400c63c0 0x7f06400c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.568+0000 7f0646947640 1 -- 172.21.15.133:0/639017939 >> v1:172.21.15.138:6789/0 conn(0x7f06400c4100 legacy=0x7f06400c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:07.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.568+0000 7f0646947640 1 -- 172.21.15.133:0/639017939 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06400c1310 con 0x7f06400c2bb0 2023-12-19T18:59:07.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.572+0000 7f0646947640 1 --2- 172.21.15.133:0/639017939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06400c2bb0 0x7f06400a9680 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f064006e000 tx=0x7f063801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e96e3b90e2727bf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:07.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.572+0000 7f0645144640 1 -- 172.21.15.133:0/639017939 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06400aa3d0 con 0x7f06400c2bb0 2023-12-19T18:59:07.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.572+0000 7f0645144640 1 -- 172.21.15.133:0/639017939 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06380a5790 con 0x7f06400c2bb0 2023-12-19T18:59:07.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.572+0000 7f0645144640 1 -- 172.21.15.133:0/639017939 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06380a5b20 con 0x7f06400c2bb0 2023-12-19T18:59:07.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.572+0000 7f06483aa640 1 -- 172.21.15.133:0/639017939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06400c2bb0 msgr2=0x7f06400a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:07.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.572+0000 7f06483aa640 1 --2- 172.21.15.133:0/639017939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06400c2bb0 0x7f06400a9680 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f064006e000 tx=0x7f063801c8b0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.572+0000 7f06483aa640 1 -- 172.21.15.133:0/639017939 shutdown_connections 2023-12-19T18:59:07.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.572+0000 7f06483aa640 1 --2- 172.21.15.133:0/639017939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06400c2bb0 0x7f06400a9680 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.572+0000 7f06483aa640 1 --2- 172.21.15.133:0/639017939 >> v2:172.21.15.138:3300/0 conn(0x7f06400c63c0 0x7f06400c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.572+0000 7f06483aa640 1 -- 172.21.15.133:0/639017939 >> 172.21.15.133:0/639017939 conn(0x7f064006a5b0 msgr2=0x7f064006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:07.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.572+0000 7f06483aa640 1 -- 172.21.15.133:0/639017939 shutdown_connections 2023-12-19T18:59:07.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.572+0000 7f06483aa640 1 -- 172.21.15.133:0/639017939 wait complete. 2023-12-19T18:59:07.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f06483aa640 1 Processor -- start 2023-12-19T18:59:07.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f06483aa640 1 -- start start 2023-12-19T18:59:07.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f06483aa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06400c2bb0 0x7f064014c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:07.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f06483aa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06400c4100 0x7f0640153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:07.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f06483aa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06400c63c0 0x7f064014e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:07.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f06483aa640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06401ee420 con 0x7f06400c2bb0 2023-12-19T18:59:07.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f06483aa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06400c05b0 con 0x7f06400c63c0 2023-12-19T18:59:07.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f06483aa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0640154120 con 0x7f06400c4100 2023-12-19T18:59:07.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f0646146640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06400c2bb0 0x7f064014c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:07.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f0646146640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06400c2bb0 0x7f064014c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55824/0 (socket says 172.21.15.133:55824) 2023-12-19T18:59:07.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f0646146640 1 -- 172.21.15.133:0/1482141028 learned_addr learned my addr 172.21.15.133:0/1482141028 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:07.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f0646947640 1 --2- 172.21.15.133:0/1482141028 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06400c63c0 0x7f064014e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:07.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f0645945640 1 --2- 172.21.15.133:0/1482141028 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06400c4100 0x7f0640153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:07.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f0646146640 1 -- 172.21.15.133:0/1482141028 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06400c4100 msgr2=0x7f0640153be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:07.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f0646146640 1 --2- 172.21.15.133:0/1482141028 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06400c4100 0x7f0640153be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f0646146640 1 -- 172.21.15.133:0/1482141028 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06400c63c0 msgr2=0x7f064014e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:07.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f0646146640 1 --2- 172.21.15.133:0/1482141028 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06400c63c0 0x7f064014e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f0646146640 1 -- 172.21.15.133:0/1482141028 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0638009b30 con 0x7f06400c2bb0 2023-12-19T18:59:07.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f0646146640 1 --2- 172.21.15.133:0/1482141028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06400c2bb0 0x7f064014c070 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f063c00d620 tx=0x7f063c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:07.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f0636ffd640 1 -- 172.21.15.133:0/1482141028 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c0125f0 con 0x7f06400c2bb0 2023-12-19T18:59:07.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f0636ffd640 1 -- 172.21.15.133:0/1482141028 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063c012750 con 0x7f06400c2bb0 2023-12-19T18:59:07.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f0636ffd640 1 -- 172.21.15.133:0/1482141028 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c012ae0 con 0x7f06400c2bb0 2023-12-19T18:59:07.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f06483aa640 1 -- 172.21.15.133:0/1482141028 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06400bfff0 con 0x7f06400c2bb0 2023-12-19T18:59:07.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f06483aa640 1 -- 172.21.15.133:0/1482141028 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06401ee040 con 0x7f06400c2bb0 2023-12-19T18:59:07.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.576+0000 7f06483aa640 1 -- 172.21.15.133:0/1482141028 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0640068400 con 0x7f06400c2bb0 2023-12-19T18:59:07.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.580+0000 7f0636ffd640 1 -- 172.21.15.133:0/1482141028 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f063c012c40 con 0x7f06400c2bb0 2023-12-19T18:59:07.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.580+0000 7f0636ffd640 1 --2- 172.21.15.133:0/1482141028 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0624066470 0x7f0624068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:07.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.580+0000 7f0636ffd640 1 -- 172.21.15.133:0/1482141028 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f063c084310 con 0x7f06400c2bb0 2023-12-19T18:59:07.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.580+0000 7f0645945640 1 --2- 172.21.15.133:0/1482141028 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0624066470 0x7f0624068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:07.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.580+0000 7f0645945640 1 --2- 172.21.15.133:0/1482141028 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0624066470 0x7f0624068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f064014f0e0 tx=0x7f0630009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:07.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.584+0000 7f0636ffd640 1 -- 172.21.15.133:0/1482141028 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f063c051780 con 0x7f06400c2bb0 2023-12-19T18:59:07.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.740+0000 7f06483aa640 1 -- 172.21.15.133:0/1482141028 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f06401ee690 con 0x7f06400c2bb0 2023-12-19T18:59:07.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.740+0000 7f0636ffd640 1 -- 172.21.15.133:0/1482141028 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f063c007380 con 0x7f06400c2bb0 2023-12-19T18:59:07.745 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T18:59:07.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.740+0000 7f06483aa640 1 -- 172.21.15.133:0/1482141028 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0624066470 msgr2=0x7f0624068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:07.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.740+0000 7f06483aa640 1 --2- 172.21.15.133:0/1482141028 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0624066470 0x7f0624068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f064014f0e0 tx=0x7f0630009040 comp rx=0 tx=0).stop 2023-12-19T18:59:07.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.744+0000 7f06483aa640 1 -- 172.21.15.133:0/1482141028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06400c2bb0 msgr2=0x7f064014c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:07.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.744+0000 7f06483aa640 1 --2- 172.21.15.133:0/1482141028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06400c2bb0 0x7f064014c070 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f063c00d620 tx=0x7f063c00dae0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.744+0000 7f06483aa640 1 -- 172.21.15.133:0/1482141028 shutdown_connections 2023-12-19T18:59:07.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.744+0000 7f06483aa640 1 --2- 172.21.15.133:0/1482141028 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0624066470 0x7f0624068930 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.744+0000 7f06483aa640 1 --2- 172.21.15.133:0/1482141028 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06400c63c0 0x7f064014e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.744+0000 7f06483aa640 1 --2- 172.21.15.133:0/1482141028 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06400c4100 0x7f0640153be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.744+0000 7f06483aa640 1 --2- 172.21.15.133:0/1482141028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06400c2bb0 0x7f064014c070 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.744+0000 7f06483aa640 1 -- 172.21.15.133:0/1482141028 >> 172.21.15.133:0/1482141028 conn(0x7f064006a5b0 msgr2=0x7f064015b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:07.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.744+0000 7f06483aa640 1 -- 172.21.15.133:0/1482141028 shutdown_connections 2023-12-19T18:59:07.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.744+0000 7f06483aa640 1 -- 172.21.15.133:0/1482141028 wait complete. 2023-12-19T18:59:07.814 INFO:tasks.cephfs_test_runner:Starting test: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-12-19T18:59:07.815 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:59:07.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.948+0000 7f306506b640 1 Processor -- start 2023-12-19T18:59:07.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.948+0000 7f306506b640 1 -- start start 2023-12-19T18:59:07.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.948+0000 7f306506b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f30600c63c0 0x7f30600c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:07.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.948+0000 7f306506b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30600c2bb0 0x7f30600a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:07.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.948+0000 7f306506b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30600c31c0 con 0x7f30600c4100 2023-12-19T18:59:07.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.948+0000 7f306506b640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30600c34a0 con 0x7f30600c63c0 2023-12-19T18:59:07.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.948+0000 7f306506b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30600c1030 con 0x7f30600c2bb0 2023-12-19T18:59:07.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.952+0000 7f305ed9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f30600c63c0 0x7f30600c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:07.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.952+0000 7f305ed9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f30600c63c0 0x7f30600c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55838/0 (socket says 172.21.15.133:55838) 2023-12-19T18:59:07.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.952+0000 7f305659c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f30600c4100 0x7f30600c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59054/0 (socket says 172.21.15.133:59054) 2023-12-19T18:59:07.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.952+0000 7f305ed9d640 1 -- 172.21.15.133:0/1003556021 learned_addr learned my addr 172.21.15.133:0/1003556021 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:07.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.952+0000 7f305f59e640 1 --2- 172.21.15.133:0/1003556021 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30600c2bb0 0x7f30600a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:07.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.952+0000 7f305ed9d640 1 -- 172.21.15.133:0/1003556021 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30600c2bb0 msgr2=0x7f30600a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:07.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.952+0000 7f305ed9d640 1 --2- 172.21.15.133:0/1003556021 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30600c2bb0 0x7f30600a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.952+0000 7f305ed9d640 1 -- 172.21.15.133:0/1003556021 >> v1:172.21.15.133:6789/0 conn(0x7f30600c4100 legacy=0x7f30600c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:07.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.952+0000 7f305ed9d640 1 -- 172.21.15.133:0/1003556021 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30600c1310 con 0x7f30600c63c0 2023-12-19T18:59:07.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.952+0000 7f305e59c640 1 -- 172.21.15.133:0/1003556021 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161535567 0 0) 0x7f30600c31c0 con 0x7f30600c4100 2023-12-19T18:59:07.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.952+0000 7f305ed9d640 1 --2- 172.21.15.133:0/1003556021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30600c63c0 0x7f30600c06d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3050009870 tx=0x7f305001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5bf77f3c3bdf446 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:07.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.952+0000 7f305e59c640 1 -- 172.21.15.133:0/1003556021 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30600aa3d0 con 0x7f30600c63c0 2023-12-19T18:59:07.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.952+0000 7f305e59c640 1 -- 172.21.15.133:0/1003556021 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30500a7050 con 0x7f30600c63c0 2023-12-19T18:59:07.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.952+0000 7f305e59c640 1 -- 172.21.15.133:0/1003556021 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30500ab820 con 0x7f30600c63c0 2023-12-19T18:59:07.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f306506b640 1 -- 172.21.15.133:0/1003556021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30600c63c0 msgr2=0x7f30600c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:07.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f306506b640 1 --2- 172.21.15.133:0/1003556021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30600c63c0 0x7f30600c06d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3050009870 tx=0x7f305001c3f0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f306506b640 1 -- 172.21.15.133:0/1003556021 shutdown_connections 2023-12-19T18:59:07.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f306506b640 1 --2- 172.21.15.133:0/1003556021 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30600c2bb0 0x7f30600a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f306506b640 1 --2- 172.21.15.133:0/1003556021 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30600c63c0 0x7f30600c06d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f306506b640 1 -- 172.21.15.133:0/1003556021 >> 172.21.15.133:0/1003556021 conn(0x7f306006a5b0 msgr2=0x7f306006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:07.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f306506b640 1 -- 172.21.15.133:0/1003556021 shutdown_connections 2023-12-19T18:59:07.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f306506b640 1 -- 172.21.15.133:0/1003556021 wait complete. 2023-12-19T18:59:07.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f306506b640 1 Processor -- start 2023-12-19T18:59:07.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f306506b640 1 -- start start 2023-12-19T18:59:07.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f306506b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30600c2bb0 0x7f30600bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:07.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f306506b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30600c4100 0x7f30601f04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:07.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f306506b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30600c63c0 0x7f30601f0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:07.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f306506b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3060156430 con 0x7f30600c2bb0 2023-12-19T18:59:07.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f306506b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30601532f0 con 0x7f30600c4100 2023-12-19T18:59:07.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f306506b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30601535d0 con 0x7f30600c63c0 2023-12-19T18:59:07.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f305ed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30600c2bb0 0x7f30600bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:07.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f305ed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30600c2bb0 0x7f30600bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55840/0 (socket says 172.21.15.133:55840) 2023-12-19T18:59:07.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f305ed9d640 1 -- 172.21.15.133:0/2168949940 learned_addr learned my addr 172.21.15.133:0/2168949940 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:07.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f305ed9d640 1 -- 172.21.15.133:0/2168949940 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30600c63c0 msgr2=0x7f30601f0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:07.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f305ed9d640 1 --2- 172.21.15.133:0/2168949940 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30600c63c0 0x7f30601f0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f305ed9d640 1 -- 172.21.15.133:0/2168949940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30600c4100 msgr2=0x7f30601f04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:07.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f305ed9d640 1 --2- 172.21.15.133:0/2168949940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30600c4100 0x7f30601f04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:07.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.956+0000 7f305ed9d640 1 -- 172.21.15.133:0/2168949940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30500094d0 con 0x7f30600c2bb0 2023-12-19T18:59:07.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.960+0000 7f305ed9d640 1 --2- 172.21.15.133:0/2168949940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30600c2bb0 0x7f30600bf360 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f30500ae040 tx=0x7f305001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:07.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.960+0000 7f3057fff640 1 -- 172.21.15.133:0/2168949940 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30500b6620 con 0x7f30600c2bb0 2023-12-19T18:59:07.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.960+0000 7f3057fff640 1 -- 172.21.15.133:0/2168949940 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30500abe90 con 0x7f30600c2bb0 2023-12-19T18:59:07.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.960+0000 7f3057fff640 1 -- 172.21.15.133:0/2168949940 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30500b69e0 con 0x7f30600c2bb0 2023-12-19T18:59:07.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.960+0000 7f306506b640 1 -- 172.21.15.133:0/2168949940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30600c69b0 con 0x7f30600c2bb0 2023-12-19T18:59:07.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.960+0000 7f306506b640 1 -- 172.21.15.133:0/2168949940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3060153b90 con 0x7f30600c2bb0 2023-12-19T18:59:07.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.960+0000 7f306506b640 1 -- 172.21.15.133:0/2168949940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3060153d80 con 0x7f30600c2bb0 2023-12-19T18:59:07.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.960+0000 7f3057fff640 1 -- 172.21.15.133:0/2168949940 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f30500b2040 con 0x7f30600c2bb0 2023-12-19T18:59:07.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.960+0000 7f3057fff640 1 --2- 172.21.15.133:0/2168949940 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f30400664a0 0x7f3040068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:07.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.960+0000 7f3057fff640 1 -- 172.21.15.133:0/2168949940 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f305011e210 con 0x7f30600c2bb0 2023-12-19T18:59:07.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.960+0000 7f305659c640 1 --2- 172.21.15.133:0/2168949940 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f30400664a0 0x7f3040068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:07.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.964+0000 7f305659c640 1 --2- 172.21.15.133:0/2168949940 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f30400664a0 0x7f3040068960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3048001570 tx=0x7f3048007cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:07.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:07.964+0000 7f3057fff640 1 -- 172.21.15.133:0/2168949940 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f30500eb680 con 0x7f30600c2bb0 2023-12-19T18:59:08.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.116+0000 7f306506b640 1 -- 172.21.15.133:0/2168949940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3060068400 con 0x7f30600c2bb0 2023-12-19T18:59:08.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.116+0000 7f3057fff640 1 -- 172.21.15.133:0/2168949940 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f30500eeca0 con 0x7f30600c2bb0 2023-12-19T18:59:08.122 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:08.122 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:44.402984+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:58:40.991408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T18:58:41.773992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:59:08.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.120+0000 7f306506b640 1 -- 172.21.15.133:0/2168949940 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f30400664a0 msgr2=0x7f3040068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:08.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.120+0000 7f306506b640 1 --2- 172.21.15.133:0/2168949940 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f30400664a0 0x7f3040068960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3048001570 tx=0x7f3048007cb0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.120+0000 7f306506b640 1 -- 172.21.15.133:0/2168949940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30600c2bb0 msgr2=0x7f30600bf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:08.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.120+0000 7f306506b640 1 --2- 172.21.15.133:0/2168949940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30600c2bb0 0x7f30600bf360 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f30500ae040 tx=0x7f305001ac30 comp rx=0 tx=0).stop 2023-12-19T18:59:08.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.120+0000 7f306506b640 1 -- 172.21.15.133:0/2168949940 shutdown_connections 2023-12-19T18:59:08.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.120+0000 7f306506b640 1 --2- 172.21.15.133:0/2168949940 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f30400664a0 0x7f3040068960 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.120+0000 7f306506b640 1 --2- 172.21.15.133:0/2168949940 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30600c63c0 0x7f30601f0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.120+0000 7f306506b640 1 --2- 172.21.15.133:0/2168949940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30600c4100 0x7f30601f04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.120+0000 7f306506b640 1 --2- 172.21.15.133:0/2168949940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30600c2bb0 0x7f30600bf360 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.120+0000 7f306506b640 1 -- 172.21.15.133:0/2168949940 >> 172.21.15.133:0/2168949940 conn(0x7f306006a5b0 msgr2=0x7f30600c03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:08.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.120+0000 7f306506b640 1 -- 172.21.15.133:0/2168949940 shutdown_connections 2023-12-19T18:59:08.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.120+0000 7f306506b640 1 -- 172.21.15.133:0/2168949940 wait complete. 2023-12-19T18:59:08.145 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:58:40.991408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:58:41.773992+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:59:08.146 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:59:08.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.284+0000 7f119619d640 1 Processor -- start 2023-12-19T18:59:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.284+0000 7f119619d640 1 -- start start 2023-12-19T18:59:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.284+0000 7f119619d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f11900c63c0 0x7f11900c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.284+0000 7f119619d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11900c4100 0x7f11900c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.284+0000 7f119619d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11900c31c0 con 0x7f11900c29e0 2023-12-19T18:59:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.284+0000 7f119619d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11900c34a0 con 0x7f11900c63c0 2023-12-19T18:59:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.284+0000 7f119619d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11900c1030 con 0x7f11900c4100 2023-12-19T18:59:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.288+0000 7f118f7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f11900c63c0 0x7f11900c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.288+0000 7f118f7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f11900c63c0 0x7f11900c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55846/0 (socket says 172.21.15.133:55846) 2023-12-19T18:59:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.288+0000 7f118f7fe640 1 -- 172.21.15.133:0/1769239205 learned_addr learned my addr 172.21.15.133:0/1769239205 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.288+0000 7f118ffff640 1 --1- 172.21.15.133:0/1769239205 >> v1:172.21.15.133:6789/0 conn(0x7f11900c29e0 0x7f11900a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59068/0 (socket says 172.21.15.133:59068) 2023-12-19T18:59:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.288+0000 7f1187fff640 1 --2- 172.21.15.133:0/1769239205 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11900c4100 0x7f11900c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.288+0000 7f118f7fe640 1 -- 172.21.15.133:0/1769239205 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11900c4100 msgr2=0x7f11900c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.288+0000 7f118f7fe640 1 --2- 172.21.15.133:0/1769239205 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11900c4100 0x7f11900c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.288+0000 7f118f7fe640 1 -- 172.21.15.133:0/1769239205 >> v1:172.21.15.133:6789/0 conn(0x7f11900c29e0 legacy=0x7f11900a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:08.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.288+0000 7f118f7fe640 1 -- 172.21.15.133:0/1769239205 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11900c1310 con 0x7f11900c63c0 2023-12-19T18:59:08.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.288+0000 7f118effd640 1 -- 172.21.15.133:0/1769239205 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2970697618 0 0) 0x7f11900c31c0 con 0x7f11900c29e0 2023-12-19T18:59:08.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.288+0000 7f118f7fe640 1 --2- 172.21.15.133:0/1769239205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11900c63c0 0x7f11900c06d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f118000bb10 tx=0x7f118001eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c39cbbfbbf8841b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:08.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.288+0000 7f118effd640 1 -- 172.21.15.133:0/1769239205 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11800a7ab0 con 0x7f11900c63c0 2023-12-19T18:59:08.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.288+0000 7f118effd640 1 -- 172.21.15.133:0/1769239205 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11800a7c10 con 0x7f11900c63c0 2023-12-19T18:59:08.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.288+0000 7f118effd640 1 -- 172.21.15.133:0/1769239205 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11800af440 con 0x7f11900c63c0 2023-12-19T18:59:08.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f119619d640 1 -- 172.21.15.133:0/1769239205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11900c63c0 msgr2=0x7f11900c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:08.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f119619d640 1 --2- 172.21.15.133:0/1769239205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11900c63c0 0x7f11900c06d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f118000bb10 tx=0x7f118001eac0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f119619d640 1 -- 172.21.15.133:0/1769239205 shutdown_connections 2023-12-19T18:59:08.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f119619d640 1 --2- 172.21.15.133:0/1769239205 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11900c4100 0x7f11900c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f119619d640 1 --2- 172.21.15.133:0/1769239205 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11900c63c0 0x7f11900c06d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f119619d640 1 -- 172.21.15.133:0/1769239205 >> 172.21.15.133:0/1769239205 conn(0x7f119006a5b0 msgr2=0x7f119006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:08.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f119619d640 1 -- 172.21.15.133:0/1769239205 shutdown_connections 2023-12-19T18:59:08.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f119619d640 1 -- 172.21.15.133:0/1769239205 wait complete. 2023-12-19T18:59:08.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f119619d640 1 Processor -- start 2023-12-19T18:59:08.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f119619d640 1 -- start start 2023-12-19T18:59:08.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f119619d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11900c29e0 0x7f11900a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:08.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f119619d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11900c4100 0x7f119014ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:08.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f119619d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11900c63c0 0x7f119014b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:08.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f119619d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119014c1e0 con 0x7f11900c63c0 2023-12-19T18:59:08.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f119619d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1190153a50 con 0x7f11900c4100 2023-12-19T18:59:08.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f119619d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1190153d30 con 0x7f11900c29e0 2023-12-19T18:59:08.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f118ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11900c63c0 0x7f119014b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:08.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f118ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11900c63c0 0x7f119014b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55852/0 (socket says 172.21.15.133:55852) 2023-12-19T18:59:08.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f118ffff640 1 -- 172.21.15.133:0/2721492030 learned_addr learned my addr 172.21.15.133:0/2721492030 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:08.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f118f7fe640 1 --2- 172.21.15.133:0/2721492030 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11900c29e0 0x7f11900a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:08.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f1187fff640 1 --2- 172.21.15.133:0/2721492030 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11900c4100 0x7f119014ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:08.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f118ffff640 1 -- 172.21.15.133:0/2721492030 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11900c29e0 msgr2=0x7f11900a59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:08.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f118ffff640 1 --2- 172.21.15.133:0/2721492030 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11900c29e0 0x7f11900a59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f118ffff640 1 -- 172.21.15.133:0/2721492030 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11900c4100 msgr2=0x7f119014ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:08.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f118ffff640 1 --2- 172.21.15.133:0/2721492030 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11900c4100 0x7f119014ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f118ffff640 1 -- 172.21.15.133:0/2721492030 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118000b770 con 0x7f11900c63c0 2023-12-19T18:59:08.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f1187fff640 1 --2- 172.21.15.133:0/2721492030 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11900c4100 0x7f119014ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:08.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.292+0000 7f118ffff640 1 --2- 172.21.15.133:0/2721492030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11900c63c0 0x7f119014b320 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1188001570 tx=0x7f118800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:08.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.296+0000 7f118cff9640 1 -- 172.21.15.133:0/2721492030 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118800a640 con 0x7f11900c63c0 2023-12-19T18:59:08.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.296+0000 7f118cff9640 1 -- 172.21.15.133:0/2721492030 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118800a7c0 con 0x7f11900c63c0 2023-12-19T18:59:08.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.296+0000 7f118cff9640 1 -- 172.21.15.133:0/2721492030 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118800ab70 con 0x7f11900c63c0 2023-12-19T18:59:08.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.296+0000 7f119619d640 1 -- 172.21.15.133:0/2721492030 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1190154010 con 0x7f11900c63c0 2023-12-19T18:59:08.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.296+0000 7f119619d640 1 -- 172.21.15.133:0/2721492030 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1190072130 con 0x7f11900c63c0 2023-12-19T18:59:08.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.296+0000 7f119619d640 1 -- 172.21.15.133:0/2721492030 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1190154530 con 0x7f11900c63c0 2023-12-19T18:59:08.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.296+0000 7f118cff9640 1 -- 172.21.15.133:0/2721492030 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f118800acd0 con 0x7f11900c63c0 2023-12-19T18:59:08.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.296+0000 7f118cff9640 1 --2- 172.21.15.133:0/2721492030 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1170066470 0x7f1170068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:08.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.296+0000 7f118cff9640 1 -- 172.21.15.133:0/2721492030 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1188083310 con 0x7f11900c63c0 2023-12-19T18:59:08.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.296+0000 7f118f7fe640 1 --2- 172.21.15.133:0/2721492030 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1170066470 0x7f1170068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:08.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.300+0000 7f118f7fe640 1 --2- 172.21.15.133:0/2721492030 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1170066470 0x7f1170068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f11800b1000 tx=0x7f11800a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:08.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.300+0000 7f118cff9640 1 -- 172.21.15.133:0/2721492030 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1190154530 con 0x7f11900c63c0 2023-12-19T18:59:08.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.452+0000 7f119619d640 1 -- 172.21.15.133:0/2721492030 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1190154530 con 0x7f11900c63c0 2023-12-19T18:59:08.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.452+0000 7f118cff9640 1 -- 172.21.15.133:0/2721492030 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1190154530 con 0x7f11900c63c0 2023-12-19T18:59:08.456 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T18:59:08.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.452+0000 7f119619d640 1 -- 172.21.15.133:0/2721492030 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1170066470 msgr2=0x7f1170068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:08.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.452+0000 7f119619d640 1 --2- 172.21.15.133:0/2721492030 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1170066470 0x7f1170068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f11800b1000 tx=0x7f11800a9070 comp rx=0 tx=0).stop 2023-12-19T18:59:08.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.452+0000 7f119619d640 1 -- 172.21.15.133:0/2721492030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11900c63c0 msgr2=0x7f119014b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:08.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.452+0000 7f119619d640 1 --2- 172.21.15.133:0/2721492030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11900c63c0 0x7f119014b320 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1188001570 tx=0x7f118800cca0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.452+0000 7f119619d640 1 -- 172.21.15.133:0/2721492030 shutdown_connections 2023-12-19T18:59:08.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.452+0000 7f119619d640 1 --2- 172.21.15.133:0/2721492030 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1170066470 0x7f1170068930 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.452+0000 7f119619d640 1 --2- 172.21.15.133:0/2721492030 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11900c63c0 0x7f119014b320 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.452+0000 7f119619d640 1 --2- 172.21.15.133:0/2721492030 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11900c4100 0x7f119014ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.452+0000 7f119619d640 1 --2- 172.21.15.133:0/2721492030 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11900c29e0 0x7f11900a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.452+0000 7f119619d640 1 -- 172.21.15.133:0/2721492030 >> 172.21.15.133:0/2721492030 conn(0x7f119006a5b0 msgr2=0x7f11900a6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:08.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.452+0000 7f119619d640 1 -- 172.21.15.133:0/2721492030 shutdown_connections 2023-12-19T18:59:08.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.452+0000 7f119619d640 1 -- 172.21.15.133:0/2721492030 wait complete. 2023-12-19T18:59:08.477 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:59:08.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.612+0000 7fb50e232640 1 Processor -- start 2023-12-19T18:59:08.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.612+0000 7fb50e232640 1 -- start start 2023-12-19T18:59:08.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.616+0000 7fb50e232640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5080725c0 0x7fb5081516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:08.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.616+0000 7fb50e232640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5080c2760 con 0x7fb5080a5370 2023-12-19T18:59:08.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.616+0000 7fb50e232640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5080a5750 con 0x7fb508072090 2023-12-19T18:59:08.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.616+0000 7fb50e232640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5080c3070 con 0x7fb5080725c0 2023-12-19T18:59:08.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.616+0000 7fb5077fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb5080a5370 0x7fb5080c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59076/0 (socket says 172.21.15.133:59076) 2023-12-19T18:59:08.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.616+0000 7fb5077fe640 1 -- 172.21.15.133:0/2114745667 learned_addr learned my addr 172.21.15.133:0/2114745667 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:08.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.616+0000 7fb507fff640 1 --2- 172.21.15.133:0/2114745667 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5080725c0 0x7fb5081516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:08.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.616+0000 7fb5067fc640 1 -- 172.21.15.133:0/2114745667 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507428137 0 0) 0x7fb5080c2760 con 0x7fb5080a5370 2023-12-19T18:59:08.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.616+0000 7fb5067fc640 1 -- 172.21.15.133:0/2114745667 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4f0003530 con 0x7fb5080a5370 2023-12-19T18:59:08.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.616+0000 7fb5067fc640 1 -- 172.21.15.133:0/2114745667 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531939496 0 0) 0x7fb5080a5750 con 0x7fb508072090 2023-12-19T18:59:08.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.616+0000 7fb5067fc640 1 -- 172.21.15.133:0/2114745667 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5080c2760 con 0x7fb508072090 2023-12-19T18:59:08.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.616+0000 7fb507fff640 1 -- 172.21.15.133:0/2114745667 >> v1:172.21.15.138:6789/0 conn(0x7fb508072090 legacy=0x7fb508150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:08.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.616+0000 7fb507fff640 1 -- 172.21.15.133:0/2114745667 >> v1:172.21.15.133:6789/0 conn(0x7fb5080a5370 legacy=0x7fb5080c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:08.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.616+0000 7fb507fff640 1 -- 172.21.15.133:0/2114745667 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5080aad20 con 0x7fb5080725c0 2023-12-19T18:59:08.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.616+0000 7fb507fff640 1 --2- 172.21.15.133:0/2114745667 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5080725c0 0x7fb5081516b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb500009cb0 tx=0x7fb50001c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d0b881a6bfc9f42 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:08.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.620+0000 7fb5067fc640 1 -- 172.21.15.133:0/2114745667 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5000a5790 con 0x7fb5080725c0 2023-12-19T18:59:08.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.620+0000 7fb5067fc640 1 -- 172.21.15.133:0/2114745667 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5000a58f0 con 0x7fb5080725c0 2023-12-19T18:59:08.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.620+0000 7fb5067fc640 1 -- 172.21.15.133:0/2114745667 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5000a5c80 con 0x7fb5080725c0 2023-12-19T18:59:08.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.620+0000 7fb50e232640 1 -- 172.21.15.133:0/2114745667 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5080725c0 msgr2=0x7fb5081516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:08.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.620+0000 7fb50e232640 1 --2- 172.21.15.133:0/2114745667 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5080725c0 0x7fb5081516b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb500009cb0 tx=0x7fb50001c860 comp rx=0 tx=0).stop 2023-12-19T18:59:08.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.620+0000 7fb50e232640 1 -- 172.21.15.133:0/2114745667 shutdown_connections 2023-12-19T18:59:08.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.620+0000 7fb50e232640 1 --2- 172.21.15.133:0/2114745667 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5080725c0 0x7fb5081516b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.620+0000 7fb50e232640 1 -- 172.21.15.133:0/2114745667 >> 172.21.15.133:0/2114745667 conn(0x7fb50806a5b0 msgr2=0x7fb50806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:08.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.620+0000 7fb50e232640 1 -- 172.21.15.133:0/2114745667 shutdown_connections 2023-12-19T18:59:08.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.620+0000 7fb50e232640 1 -- 172.21.15.133:0/2114745667 wait complete. 2023-12-19T18:59:08.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.620+0000 7fb50e232640 1 Processor -- start 2023-12-19T18:59:08.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.620+0000 7fb50e232640 1 -- start start 2023-12-19T18:59:08.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.620+0000 7fb50e232640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb508072090 0x7fb5080a8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:08.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.620+0000 7fb50e232640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5080725c0 0x7fb508145010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:08.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.620+0000 7fb50e232640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5080a5370 0x7fb508145550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:08.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.620+0000 7fb50e232640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb508145a90 con 0x7fb508072090 2023-12-19T18:59:08.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.620+0000 7fb50e232640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5081f05f0 con 0x7fb5080725c0 2023-12-19T18:59:08.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.620+0000 7fb50e232640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5081f08d0 con 0x7fb5080a5370 2023-12-19T18:59:08.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.620+0000 7fb5077fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb508072090 0x7fb5080a8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:08.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.624+0000 7fb5077fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb508072090 0x7fb5080a8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55860/0 (socket says 172.21.15.133:55860) 2023-12-19T18:59:08.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.624+0000 7fb5077fe640 1 -- 172.21.15.133:0/3308098740 learned_addr learned my addr 172.21.15.133:0/3308098740 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:08.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.624+0000 7fb5077fe640 1 -- 172.21.15.133:0/3308098740 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5080a5370 msgr2=0x7fb508145550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:08.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.624+0000 7fb5077fe640 1 --2- 172.21.15.133:0/3308098740 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5080a5370 0x7fb508145550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.624+0000 7fb506ffd640 1 --2- 172.21.15.133:0/3308098740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5080725c0 0x7fb508145010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:08.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.624+0000 7fb5077fe640 1 -- 172.21.15.133:0/3308098740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5080725c0 msgr2=0x7fb508145010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:08.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.624+0000 7fb5077fe640 1 --2- 172.21.15.133:0/3308098740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5080725c0 0x7fb508145010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.624+0000 7fb5077fe640 1 -- 172.21.15.133:0/3308098740 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50000d040 con 0x7fb508072090 2023-12-19T18:59:08.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.624+0000 7fb506ffd640 1 --2- 172.21.15.133:0/3308098740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5080725c0 0x7fb508145010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:08.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.624+0000 7fb5077fe640 1 --2- 172.21.15.133:0/3308098740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb508072090 0x7fb5080a8dd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800c4d0 tx=0x7fb4f800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:08.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.624+0000 7fb4effff640 1 -- 172.21.15.133:0/3308098740 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8005cf0 con 0x7fb508072090 2023-12-19T18:59:08.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.624+0000 7fb4effff640 1 -- 172.21.15.133:0/3308098740 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f8005e50 con 0x7fb508072090 2023-12-19T18:59:08.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.624+0000 7fb4effff640 1 -- 172.21.15.133:0/3308098740 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8007290 con 0x7fb508072090 2023-12-19T18:59:08.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.624+0000 7fb50e232640 1 -- 172.21.15.133:0/3308098740 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5081f0bb0 con 0x7fb508072090 2023-12-19T18:59:08.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.624+0000 7fb50e232640 1 -- 172.21.15.133:0/3308098740 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5080a9310 con 0x7fb508072090 2023-12-19T18:59:08.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.624+0000 7fb50e232640 1 -- 172.21.15.133:0/3308098740 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb508068400 con 0x7fb508072090 2023-12-19T18:59:08.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.624+0000 7fb4effff640 1 -- 172.21.15.133:0/3308098740 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb4f80073f0 con 0x7fb508072090 2023-12-19T18:59:08.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.628+0000 7fb4effff640 1 --2- 172.21.15.133:0/3308098740 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb4f4066470 0x7fb4f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:08.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.628+0000 7fb4effff640 1 -- 172.21.15.133:0/3308098740 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4f80833f0 con 0x7fb508072090 2023-12-19T18:59:08.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.628+0000 7fb506ffd640 1 --2- 172.21.15.133:0/3308098740 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb4f4066470 0x7fb4f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:08.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.628+0000 7fb506ffd640 1 --2- 172.21.15.133:0/3308098740 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb4f4066470 0x7fb4f4068930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb5081eae20 tx=0x7fb4fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:08.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.632+0000 7fb4effff640 1 -- 172.21.15.133:0/3308098740 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb4f8050900 con 0x7fb508072090 2023-12-19T18:59:08.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.780+0000 7fb50e232640 1 -- 172.21.15.133:0/3308098740 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb5080c6780 con 0x7fb508072090 2023-12-19T18:59:08.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.780+0000 7fb4effff640 1 -- 172.21.15.133:0/3308098740 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb4f8053f20 con 0x7fb508072090 2023-12-19T18:59:08.785 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T18:59:08.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.784+0000 7fb50e232640 1 -- 172.21.15.133:0/3308098740 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb4f4066470 msgr2=0x7fb4f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:08.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.784+0000 7fb50e232640 1 --2- 172.21.15.133:0/3308098740 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb4f4066470 0x7fb4f4068930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb5081eae20 tx=0x7fb4fc009040 comp rx=0 tx=0).stop 2023-12-19T18:59:08.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.784+0000 7fb50e232640 1 -- 172.21.15.133:0/3308098740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb508072090 msgr2=0x7fb5080a8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:08.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.784+0000 7fb50e232640 1 --2- 172.21.15.133:0/3308098740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb508072090 0x7fb5080a8dd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800c4d0 tx=0x7fb4f800c990 comp rx=0 tx=0).stop 2023-12-19T18:59:08.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.784+0000 7fb50e232640 1 -- 172.21.15.133:0/3308098740 shutdown_connections 2023-12-19T18:59:08.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.784+0000 7fb50e232640 1 --2- 172.21.15.133:0/3308098740 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb4f4066470 0x7fb4f4068930 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.784+0000 7fb50e232640 1 --2- 172.21.15.133:0/3308098740 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5080a5370 0x7fb508145550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.784+0000 7fb50e232640 1 --2- 172.21.15.133:0/3308098740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5080725c0 0x7fb508145010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.784+0000 7fb50e232640 1 --2- 172.21.15.133:0/3308098740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb508072090 0x7fb5080a8dd0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.784+0000 7fb50e232640 1 -- 172.21.15.133:0/3308098740 >> 172.21.15.133:0/3308098740 conn(0x7fb50806a5b0 msgr2=0x7fb5080c3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:08.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.784+0000 7fb50e232640 1 -- 172.21.15.133:0/3308098740 shutdown_connections 2023-12-19T18:59:08.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.784+0000 7fb50e232640 1 -- 172.21.15.133:0/3308098740 wait complete. 2023-12-19T18:59:08.806 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:59:08.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.940+0000 7f3a85f9d640 1 Processor -- start 2023-12-19T18:59:08.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.940+0000 7f3a85f9d640 1 -- start start 2023-12-19T18:59:08.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.944+0000 7f3a85f9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3a80152030 0x7f3a800c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:08.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.944+0000 7f3a85f9d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3a80157c90 0x7f3a800c2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:08.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.944+0000 7f3a85f9d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a80154b60 con 0x7f3a8006c470 2023-12-19T18:59:08.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.944+0000 7f3a85f9d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a80152410 con 0x7f3a80157c90 2023-12-19T18:59:08.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.944+0000 7f3a85f9d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a80155700 con 0x7f3a80152030 2023-12-19T18:59:08.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.944+0000 7f3a7f7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3a80152030 0x7f3a800c0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:08.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.944+0000 7f3a7f7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3a80152030 0x7f3a800c0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:52180/0 (socket says 172.21.15.133:52180) 2023-12-19T18:59:08.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.944+0000 7f3a7f7fe640 1 -- 172.21.15.133:0/3035128627 learned_addr learned my addr 172.21.15.133:0/3035128627 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:08.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.944+0000 7f3a7ffff640 1 --2- 172.21.15.133:0/3035128627 >> v2:172.21.15.138:3300/0 conn(0x7f3a80157c90 0x7f3a800c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:08.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.944+0000 7f3a7f7fe640 1 -- 172.21.15.133:0/3035128627 >> v2:172.21.15.138:3300/0 conn(0x7f3a80157c90 msgr2=0x7f3a800c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:08.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.944+0000 7f3a7f7fe640 1 --2- 172.21.15.133:0/3035128627 >> v2:172.21.15.138:3300/0 conn(0x7f3a80157c90 0x7f3a800c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.944+0000 7f3a7f7fe640 1 -- 172.21.15.133:0/3035128627 >> v1:172.21.15.138:6789/0 conn(0x7f3a8006c470 legacy=0x7f3a80154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:08.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.944+0000 7f3a7f7fe640 1 -- 172.21.15.133:0/3035128627 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a80158120 con 0x7f3a80152030 2023-12-19T18:59:08.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.948+0000 7f3a7f7fe640 1 --2- 172.21.15.133:0/3035128627 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3a80152030 0x7f3a800c0c40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3a70009870 tx=0x7f3a7001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c868ac257e76bb3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:08.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.948+0000 7f3a7e7fc640 1 -- 172.21.15.133:0/3035128627 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a700aa610 con 0x7f3a80152030 2023-12-19T18:59:08.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.948+0000 7f3a7e7fc640 1 -- 172.21.15.133:0/3035128627 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a700a6040 con 0x7f3a80152030 2023-12-19T18:59:08.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.948+0000 7f3a7e7fc640 1 -- 172.21.15.133:0/3035128627 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a700aa990 con 0x7f3a80152030 2023-12-19T18:59:08.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.948+0000 7f3a85f9d640 1 -- 172.21.15.133:0/3035128627 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3a80152030 msgr2=0x7f3a800c0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:08.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.948+0000 7f3a85f9d640 1 --2- 172.21.15.133:0/3035128627 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3a80152030 0x7f3a800c0c40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3a70009870 tx=0x7f3a7001c4b0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.948+0000 7f3a85f9d640 1 -- 172.21.15.133:0/3035128627 shutdown_connections 2023-12-19T18:59:08.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.948+0000 7f3a85f9d640 1 --2- 172.21.15.133:0/3035128627 >> v2:172.21.15.138:3300/0 conn(0x7f3a80157c90 0x7f3a800c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.948+0000 7f3a85f9d640 1 --2- 172.21.15.133:0/3035128627 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3a80152030 0x7f3a800c0c40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.948+0000 7f3a85f9d640 1 -- 172.21.15.133:0/3035128627 >> 172.21.15.133:0/3035128627 conn(0x7f3a8006a5b0 msgr2=0x7f3a8006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:08.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.948+0000 7f3a85f9d640 1 -- 172.21.15.133:0/3035128627 shutdown_connections 2023-12-19T18:59:08.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.948+0000 7f3a85f9d640 1 -- 172.21.15.133:0/3035128627 wait complete. 2023-12-19T18:59:08.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.948+0000 7f3a85f9d640 1 Processor -- start 2023-12-19T18:59:08.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.948+0000 7f3a85f9d640 1 -- start start 2023-12-19T18:59:08.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a85f9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3a8006c470 0x7f3a800a93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:08.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a85f9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a80152030 0x7f3a800710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:08.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a85f9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a80157c90 0x7f3a801f0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:08.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a85f9d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a801f0870 con 0x7f3a80152030 2023-12-19T18:59:08.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a85f9d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a801f0540 con 0x7f3a80157c90 2023-12-19T18:59:08.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a85f9d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a800c4700 con 0x7f3a8006c470 2023-12-19T18:59:08.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a7effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a80152030 0x7f3a800710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:08.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a7effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a80152030 0x7f3a800710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55872/0 (socket says 172.21.15.133:55872) 2023-12-19T18:59:08.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a7effd640 1 -- 172.21.15.133:0/1757643577 learned_addr learned my addr 172.21.15.133:0/1757643577 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:08.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a7f7fe640 1 --2- 172.21.15.133:0/1757643577 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3a8006c470 0x7f3a800a93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:08.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a7ffff640 1 --2- 172.21.15.133:0/1757643577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a80157c90 0x7f3a801f0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:08.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a7effd640 1 -- 172.21.15.133:0/1757643577 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3a8006c470 msgr2=0x7f3a800a93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:08.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a7effd640 1 --2- 172.21.15.133:0/1757643577 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3a8006c470 0x7f3a800a93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a7effd640 1 -- 172.21.15.133:0/1757643577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a80157c90 msgr2=0x7f3a801f0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:08.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a7effd640 1 --2- 172.21.15.133:0/1757643577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a80157c90 0x7f3a801f0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:08.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a7effd640 1 -- 172.21.15.133:0/1757643577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a700094d0 con 0x7f3a80152030 2023-12-19T18:59:08.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a7effd640 1 --2- 172.21.15.133:0/1757643577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a80152030 0x7f3a800710e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3a7400c500 tx=0x7f3a7400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:08.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a67fff640 1 -- 172.21.15.133:0/1757643577 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a74005220 con 0x7f3a80152030 2023-12-19T18:59:08.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a67fff640 1 -- 172.21.15.133:0/1757643577 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a74005380 con 0x7f3a80152030 2023-12-19T18:59:08.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a67fff640 1 -- 172.21.15.133:0/1757643577 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a74007270 con 0x7f3a80152030 2023-12-19T18:59:08.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a85f9d640 1 -- 172.21.15.133:0/1757643577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a800c49c0 con 0x7f3a80152030 2023-12-19T18:59:08.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a85f9d640 1 -- 172.21.15.133:0/1757643577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a800c3bd0 con 0x7f3a80152030 2023-12-19T18:59:08.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a85f9d640 1 -- 172.21.15.133:0/1757643577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a8006d540 con 0x7f3a80152030 2023-12-19T18:59:08.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.952+0000 7f3a67fff640 1 -- 172.21.15.133:0/1757643577 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3a740073d0 con 0x7f3a80152030 2023-12-19T18:59:08.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.956+0000 7f3a67fff640 1 --2- 172.21.15.133:0/1757643577 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3a6c066470 0x7f3a6c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:08.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.956+0000 7f3a67fff640 1 -- 172.21.15.133:0/1757643577 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a74083750 con 0x7f3a80152030 2023-12-19T18:59:08.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.956+0000 7f3a7f7fe640 1 --2- 172.21.15.133:0/1757643577 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3a6c066470 0x7f3a6c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:08.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.956+0000 7f3a7f7fe640 1 --2- 172.21.15.133:0/1757643577 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3a6c066470 0x7f3a6c068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3a700ae000 tx=0x7f3a700b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:08.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:08.960+0000 7f3a67fff640 1 -- 172.21.15.133:0/1757643577 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f3a74050bc0 con 0x7f3a80152030 2023-12-19T18:59:09.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.108+0000 7f3a85f9d640 1 -- 172.21.15.133:0/1757643577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3a80068400 con 0x7f3a80152030 2023-12-19T18:59:09.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.108+0000 7f3a67fff640 1 -- 172.21.15.133:0/1757643577 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3a740541e0 con 0x7f3a80152030 2023-12-19T18:59:09.114 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T18:59:09.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.112+0000 7f3a85f9d640 1 -- 172.21.15.133:0/1757643577 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3a6c066470 msgr2=0x7f3a6c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:09.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.112+0000 7f3a85f9d640 1 --2- 172.21.15.133:0/1757643577 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3a6c066470 0x7f3a6c068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3a700ae000 tx=0x7f3a700b5040 comp rx=0 tx=0).stop 2023-12-19T18:59:09.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.112+0000 7f3a85f9d640 1 -- 172.21.15.133:0/1757643577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a80152030 msgr2=0x7f3a800710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:09.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.112+0000 7f3a85f9d640 1 --2- 172.21.15.133:0/1757643577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a80152030 0x7f3a800710e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3a7400c500 tx=0x7f3a7400c9c0 comp rx=0 tx=0).stop 2023-12-19T18:59:09.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.112+0000 7f3a85f9d640 1 -- 172.21.15.133:0/1757643577 shutdown_connections 2023-12-19T18:59:09.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.112+0000 7f3a85f9d640 1 --2- 172.21.15.133:0/1757643577 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3a6c066470 0x7f3a6c068930 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:09.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.112+0000 7f3a85f9d640 1 --2- 172.21.15.133:0/1757643577 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3a80157c90 0x7f3a801f0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:09.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.112+0000 7f3a85f9d640 1 --2- 172.21.15.133:0/1757643577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3a80152030 0x7f3a800710e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:09.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.112+0000 7f3a85f9d640 1 --2- 172.21.15.133:0/1757643577 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3a8006c470 0x7f3a800a93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:09.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.112+0000 7f3a85f9d640 1 -- 172.21.15.133:0/1757643577 >> 172.21.15.133:0/1757643577 conn(0x7f3a8006a5b0 msgr2=0x7f3a80152e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:09.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.112+0000 7f3a85f9d640 1 -- 172.21.15.133:0/1757643577 shutdown_connections 2023-12-19T18:59:09.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.112+0000 7f3a85f9d640 1 -- 172.21.15.133:0/1757643577 wait complete. 2023-12-19T18:59:09.136 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-12-19T18:59:09.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.268+0000 7f9f62e79640 1 Processor -- start 2023-12-19T18:59:09.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.268+0000 7f9f62e79640 1 -- start start 2023-12-19T18:59:09.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.272+0000 7f9f62e79640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f5c14b010 0x7f9f5c0bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:09.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.272+0000 7f9f62e79640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f5c06a5b0 con 0x7f9f5c073a70 2023-12-19T18:59:09.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.272+0000 7f9f62e79640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f5c06b710 con 0x7f9f5c157c20 2023-12-19T18:59:09.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.272+0000 7f9f62e79640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c0c1d60 con 0x7f9f5c14b010 2023-12-19T18:59:09.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.272+0000 7f9f5bfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9f5c073a70 0x7f9f5c06b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59092/0 (socket says 172.21.15.133:59092) 2023-12-19T18:59:09.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.272+0000 7f9f5bfff640 1 -- 172.21.15.133:0/3808234510 learned_addr learned my addr 172.21.15.133:0/3808234510 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:09.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.272+0000 7f9f60c15640 1 --2- 172.21.15.133:0/3808234510 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f5c14b010 0x7f9f5c0bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:09.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.272+0000 7f9f5b7fe640 1 -- 172.21.15.133:0/3808234510 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485315984 0 0) 0x7f9f5c06a5b0 con 0x7f9f5c073a70 2023-12-19T18:59:09.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.272+0000 7f9f5b7fe640 1 -- 172.21.15.133:0/3808234510 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f4c003530 con 0x7f9f5c073a70 2023-12-19T18:59:09.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.272+0000 7f9f5b7fe640 1 -- 172.21.15.133:0/3808234510 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188995842 0 0) 0x7f9f5c06b710 con 0x7f9f5c157c20 2023-12-19T18:59:09.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.272+0000 7f9f60c15640 1 -- 172.21.15.133:0/3808234510 >> v1:172.21.15.138:6789/0 conn(0x7f9f5c157c20 legacy=0x7f9f5c1580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:09.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.272+0000 7f9f60c15640 1 -- 172.21.15.133:0/3808234510 >> v1:172.21.15.133:6789/0 conn(0x7f9f5c073a70 legacy=0x7f9f5c06b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:09.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.272+0000 7f9f60c15640 1 -- 172.21.15.133:0/3808234510 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c0c2040 con 0x7f9f5c14b010 2023-12-19T18:59:09.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.276+0000 7f9f60c15640 1 --2- 172.21.15.133:0/3808234510 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f5c14b010 0x7f9f5c0bf9f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9f500097f0 tx=0x7f9f5001ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d0d7492c88b4af2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:09.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.276+0000 7f9f5b7fe640 1 -- 172.21.15.133:0/3808234510 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f500a89b0 con 0x7f9f5c14b010 2023-12-19T18:59:09.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.276+0000 7f9f5b7fe640 1 -- 172.21.15.133:0/3808234510 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f500a8b10 con 0x7f9f5c14b010 2023-12-19T18:59:09.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.276+0000 7f9f5b7fe640 1 -- 172.21.15.133:0/3808234510 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f500a8ea0 con 0x7f9f5c14b010 2023-12-19T18:59:09.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.276+0000 7f9f62e79640 1 -- 172.21.15.133:0/3808234510 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f5c14b010 msgr2=0x7f9f5c0bf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:09.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.276+0000 7f9f62e79640 1 --2- 172.21.15.133:0/3808234510 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f5c14b010 0x7f9f5c0bf9f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9f500097f0 tx=0x7f9f5001ecb0 comp rx=0 tx=0).stop 2023-12-19T18:59:09.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.276+0000 7f9f62e79640 1 -- 172.21.15.133:0/3808234510 shutdown_connections 2023-12-19T18:59:09.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.276+0000 7f9f62e79640 1 --2- 172.21.15.133:0/3808234510 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f5c14b010 0x7f9f5c0bf9f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:09.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.276+0000 7f9f62e79640 1 -- 172.21.15.133:0/3808234510 >> 172.21.15.133:0/3808234510 conn(0x7f9f5c0c30c0 msgr2=0x7f9f5c0c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:09.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.276+0000 7f9f62e79640 1 -- 172.21.15.133:0/3808234510 shutdown_connections 2023-12-19T18:59:09.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.276+0000 7f9f62e79640 1 -- 172.21.15.133:0/3808234510 wait complete. 2023-12-19T18:59:09.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.276+0000 7f9f62e79640 1 Processor -- start 2023-12-19T18:59:09.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.276+0000 7f9f62e79640 1 -- start start 2023-12-19T18:59:09.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f62e79640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f5c073a70 0x7f9f5c1e9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:09.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f62e79640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f5c14b010 0x7f9f5c1537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:09.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f62e79640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f5c157c20 0x7f9f5c0a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:09.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f62e79640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c146d70 con 0x7f9f5c157c20 2023-12-19T18:59:09.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f62e79640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c1524d0 con 0x7f9f5c073a70 2023-12-19T18:59:09.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f62e79640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c153330 con 0x7f9f5c14b010 2023-12-19T18:59:09.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f61416640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f5c157c20 0x7f9f5c0a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:09.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f61416640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f5c157c20 0x7f9f5c0a9d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55880/0 (socket says 172.21.15.133:55880) 2023-12-19T18:59:09.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f61416640 1 -- 172.21.15.133:0/1360553795 learned_addr learned my addr 172.21.15.133:0/1360553795 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:09.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f5bfff640 1 --2- 172.21.15.133:0/1360553795 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f5c14b010 0x7f9f5c1537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:09.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f60c15640 1 --2- 172.21.15.133:0/1360553795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f5c073a70 0x7f9f5c1e9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:09.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f61416640 1 -- 172.21.15.133:0/1360553795 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f5c14b010 msgr2=0x7f9f5c1537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:09.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f61416640 1 --2- 172.21.15.133:0/1360553795 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f5c14b010 0x7f9f5c1537c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:09.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f61416640 1 -- 172.21.15.133:0/1360553795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f5c073a70 msgr2=0x7f9f5c1e9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:09.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f61416640 1 --2- 172.21.15.133:0/1360553795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f5c073a70 0x7f9f5c1e9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:09.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f61416640 1 -- 172.21.15.133:0/1360553795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f50009420 con 0x7f9f5c157c20 2023-12-19T18:59:09.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f61416640 1 --2- 172.21.15.133:0/1360553795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f5c157c20 0x7f9f5c0a9d30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9f54002240 tx=0x7f9f5400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:09.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f597fa640 1 -- 172.21.15.133:0/1360553795 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f54003db0 con 0x7f9f5c157c20 2023-12-19T18:59:09.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f597fa640 1 -- 172.21.15.133:0/1360553795 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f5400ce30 con 0x7f9f5c157c20 2023-12-19T18:59:09.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f597fa640 1 -- 172.21.15.133:0/1360553795 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f54005270 con 0x7f9f5c157c20 2023-12-19T18:59:09.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f62e79640 1 -- 172.21.15.133:0/1360553795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f5c153d00 con 0x7f9f5c157c20 2023-12-19T18:59:09.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f62e79640 1 -- 172.21.15.133:0/1360553795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5c152a00 con 0x7f9f5c157c20 2023-12-19T18:59:09.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f62e79640 1 -- 172.21.15.133:0/1360553795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5c1534e0 con 0x7f9f5c157c20 2023-12-19T18:59:09.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.280+0000 7f9f597fa640 1 -- 172.21.15.133:0/1360553795 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9f540053d0 con 0x7f9f5c157c20 2023-12-19T18:59:09.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.284+0000 7f9f597fa640 1 --2- 172.21.15.133:0/1360553795 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9f40066470 0x7f9f40068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:09.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.284+0000 7f9f597fa640 1 -- 172.21.15.133:0/1360553795 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f54083500 con 0x7f9f5c157c20 2023-12-19T18:59:09.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.284+0000 7f9f60c15640 1 --2- 172.21.15.133:0/1360553795 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9f40066470 0x7f9f40068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:09.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.284+0000 7f9f60c15640 1 --2- 172.21.15.133:0/1360553795 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9f40066470 0x7f9f40068930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9f500b2000 tx=0x7f9f500aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:09.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.288+0000 7f9f597fa640 1 -- 172.21.15.133:0/1360553795 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9f5c1534e0 con 0x7f9f5c157c20 2023-12-19T18:59:09.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.488+0000 7f9f62e79640 1 -- 172.21.15.133:0/1360553795 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f9f5c1534a0 con 0x7f9f5c157c20 2023-12-19T18:59:09.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.648+0000 7f9f597fa640 1 -- 172.21.15.133:0/1360553795 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v51) v1 ==== 162+0+0 (secure 0 0 0) 0x7f9f540170e0 con 0x7f9f5c157c20 2023-12-19T18:59:09.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.648+0000 7f9f62e79640 1 -- 172.21.15.133:0/1360553795 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9f40066470 msgr2=0x7f9f40068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:09.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.648+0000 7f9f62e79640 1 --2- 172.21.15.133:0/1360553795 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9f40066470 0x7f9f40068930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9f500b2000 tx=0x7f9f500aa070 comp rx=0 tx=0).stop 2023-12-19T18:59:09.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.648+0000 7f9f62e79640 1 -- 172.21.15.133:0/1360553795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f5c157c20 msgr2=0x7f9f5c0a9d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:09.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.648+0000 7f9f62e79640 1 --2- 172.21.15.133:0/1360553795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f5c157c20 0x7f9f5c0a9d30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9f54002240 tx=0x7f9f5400cbe0 comp rx=0 tx=0).stop 2023-12-19T18:59:09.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.648+0000 7f9f62e79640 1 -- 172.21.15.133:0/1360553795 shutdown_connections 2023-12-19T18:59:09.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.648+0000 7f9f62e79640 1 --2- 172.21.15.133:0/1360553795 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9f40066470 0x7f9f40068930 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:09.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.648+0000 7f9f62e79640 1 --2- 172.21.15.133:0/1360553795 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f5c157c20 0x7f9f5c0a9d30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:09.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.648+0000 7f9f62e79640 1 --2- 172.21.15.133:0/1360553795 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f5c14b010 0x7f9f5c1537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:09.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.648+0000 7f9f62e79640 1 --2- 172.21.15.133:0/1360553795 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f5c073a70 0x7f9f5c1e9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:09.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.648+0000 7f9f62e79640 1 -- 172.21.15.133:0/1360553795 >> 172.21.15.133:0/1360553795 conn(0x7f9f5c0c30c0 msgr2=0x7f9f5c14a260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:09.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.648+0000 7f9f62e79640 1 -- 172.21.15.133:0/1360553795 shutdown_connections 2023-12-19T18:59:09.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.648+0000 7f9f62e79640 1 -- 172.21.15.133:0/1360553795 wait complete. 2023-12-19T18:59:09.674 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T18:59:09.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.808+0000 7fc87c609640 1 Processor -- start 2023-12-19T18:59:09.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.808+0000 7fc87c609640 1 -- start start 2023-12-19T18:59:09.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.808+0000 7fc87c609640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc874151e90 0x7fc8740c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:09.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.808+0000 7fc87c609640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc87406c860 con 0x7fc8740c7ea0 2023-12-19T18:59:09.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.808+0000 7fc87c609640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc874154930 con 0x7fc8740c4e60 2023-12-19T18:59:09.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.808+0000 7fc87c609640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8740c8750 con 0x7fc874151e90 2023-12-19T18:59:09.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.812+0000 7fc879ba4640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc8740c7ea0 0x7fc87406b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59104/0 (socket says 172.21.15.133:59104) 2023-12-19T18:59:09.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.812+0000 7fc879ba4640 1 -- 172.21.15.133:0/1147637801 learned_addr learned my addr 172.21.15.133:0/1147637801 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:09.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.812+0000 7fc87a3a5640 1 --2- 172.21.15.133:0/1147637801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc874151e90 0x7fc8740c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:09.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.812+0000 7fc8793a3640 1 -- 172.21.15.133:0/1147637801 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2767291439 0 0) 0x7fc87406c860 con 0x7fc8740c7ea0 2023-12-19T18:59:09.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.812+0000 7fc8793a3640 1 -- 172.21.15.133:0/1147637801 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc860003530 con 0x7fc8740c7ea0 2023-12-19T18:59:09.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.812+0000 7fc8793a3640 1 -- 172.21.15.133:0/1147637801 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3023801770 0 0) 0x7fc874154930 con 0x7fc8740c4e60 2023-12-19T18:59:09.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.812+0000 7fc8793a3640 1 -- 172.21.15.133:0/1147637801 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc87406c860 con 0x7fc8740c4e60 2023-12-19T18:59:09.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.812+0000 7fc87a3a5640 1 -- 172.21.15.133:0/1147637801 >> v1:172.21.15.138:6789/0 conn(0x7fc8740c4e60 legacy=0x7fc87415f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:09.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.812+0000 7fc87a3a5640 1 -- 172.21.15.133:0/1147637801 >> v1:172.21.15.133:6789/0 conn(0x7fc8740c7ea0 legacy=0x7fc87406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:09.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.812+0000 7fc8793a3640 1 -- 172.21.15.133:0/1147637801 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1284339569 0 0) 0x7fc860003530 con 0x7fc8740c7ea0 2023-12-19T18:59:09.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.812+0000 7fc87a3a5640 1 -- 172.21.15.133:0/1147637801 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc874154c10 con 0x7fc874151e90 2023-12-19T18:59:09.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.816+0000 7fc87a3a5640 1 --2- 172.21.15.133:0/1147637801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc874151e90 0x7fc8740c4920 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc8700097f0 tx=0x7fc87001c2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=491cf5acf417dc9a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:09.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.816+0000 7fc8793a3640 1 -- 172.21.15.133:0/1147637801 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc864001680 con 0x7fc874151e90 2023-12-19T18:59:09.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.816+0000 7fc8793a3640 1 -- 172.21.15.133:0/1147637801 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8700a7050 con 0x7fc874151e90 2023-12-19T18:59:09.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.816+0000 7fc8793a3640 1 -- 172.21.15.133:0/1147637801 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8700ab620 con 0x7fc874151e90 2023-12-19T18:59:09.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.816+0000 7fc87c609640 1 -- 172.21.15.133:0/1147637801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc874151e90 msgr2=0x7fc8740c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:09.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.816+0000 7fc87c609640 1 --2- 172.21.15.133:0/1147637801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc874151e90 0x7fc8740c4920 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc8700097f0 tx=0x7fc87001c2c0 comp rx=0 tx=0).stop 2023-12-19T18:59:09.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.816+0000 7fc87c609640 1 -- 172.21.15.133:0/1147637801 shutdown_connections 2023-12-19T18:59:09.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.816+0000 7fc87c609640 1 --2- 172.21.15.133:0/1147637801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc874151e90 0x7fc8740c4920 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:09.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.816+0000 7fc87c609640 1 -- 172.21.15.133:0/1147637801 >> 172.21.15.133:0/1147637801 conn(0x7fc8740ca170 msgr2=0x7fc8740ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:09.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.816+0000 7fc87c609640 1 -- 172.21.15.133:0/1147637801 shutdown_connections 2023-12-19T18:59:09.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.816+0000 7fc87c609640 1 -- 172.21.15.133:0/1147637801 wait complete. 2023-12-19T18:59:09.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.816+0000 7fc87c609640 1 Processor -- start 2023-12-19T18:59:09.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.816+0000 7fc87c609640 1 -- start start 2023-12-19T18:59:09.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.816+0000 7fc87c609640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8740c4e60 0x7fc87414c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:09.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.816+0000 7fc87c609640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8740c7ea0 0x7fc87414dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:09.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.816+0000 7fc87c609640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc874151e90 0x7fc8740abba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:09.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.816+0000 7fc87c609640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8741552d0 con 0x7fc8740c4e60 2023-12-19T18:59:09.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.816+0000 7fc87c609640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87414cba0 con 0x7fc874151e90 2023-12-19T18:59:09.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.816+0000 7fc87c609640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87414b230 con 0x7fc8740c7ea0 2023-12-19T18:59:09.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.816+0000 7fc87a3a5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8740c4e60 0x7fc87414c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:09.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.816+0000 7fc87a3a5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8740c4e60 0x7fc87414c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55894/0 (socket says 172.21.15.133:55894) 2023-12-19T18:59:09.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.816+0000 7fc87a3a5640 1 -- 172.21.15.133:0/2415297692 learned_addr learned my addr 172.21.15.133:0/2415297692 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:09.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.820+0000 7fc879ba4640 1 --2- 172.21.15.133:0/2415297692 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8740c7ea0 0x7fc87414dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:09.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.820+0000 7fc87aba6640 1 --2- 172.21.15.133:0/2415297692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc874151e90 0x7fc8740abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:09.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.820+0000 7fc87a3a5640 1 -- 172.21.15.133:0/2415297692 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8740c7ea0 msgr2=0x7fc87414dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:09.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.820+0000 7fc87a3a5640 1 --2- 172.21.15.133:0/2415297692 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8740c7ea0 0x7fc87414dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:09.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.820+0000 7fc87a3a5640 1 -- 172.21.15.133:0/2415297692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc874151e90 msgr2=0x7fc8740abba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:09.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.820+0000 7fc87a3a5640 1 --2- 172.21.15.133:0/2415297692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc874151e90 0x7fc8740abba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:09.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.820+0000 7fc87a3a5640 1 -- 172.21.15.133:0/2415297692 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc870009420 con 0x7fc8740c4e60 2023-12-19T18:59:09.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.820+0000 7fc879ba4640 1 --2- 172.21.15.133:0/2415297692 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8740c7ea0 0x7fc87414dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:09.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.820+0000 7fc87aba6640 1 --2- 172.21.15.133:0/2415297692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc874151e90 0x7fc8740abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:09.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.820+0000 7fc87a3a5640 1 --2- 172.21.15.133:0/2415297692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8740c4e60 0x7fc87414c100 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc870009740 tx=0x7fc870019060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:09.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.820+0000 7fc86affd640 1 -- 172.21.15.133:0/2415297692 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8700abd10 con 0x7fc8740c4e60 2023-12-19T18:59:09.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.820+0000 7fc86affd640 1 -- 172.21.15.133:0/2415297692 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8700abe70 con 0x7fc8740c4e60 2023-12-19T18:59:09.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.820+0000 7fc87c609640 1 -- 172.21.15.133:0/2415297692 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8741f06a0 con 0x7fc8740c4e60 2023-12-19T18:59:09.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.820+0000 7fc86affd640 1 -- 172.21.15.133:0/2415297692 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc870004220 con 0x7fc8740c4e60 2023-12-19T18:59:09.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.820+0000 7fc87c609640 1 -- 172.21.15.133:0/2415297692 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8741f1500 con 0x7fc8740c4e60 2023-12-19T18:59:09.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.820+0000 7fc87c609640 1 -- 172.21.15.133:0/2415297692 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc874068400 con 0x7fc8740c4e60 2023-12-19T18:59:09.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.820+0000 7fc86affd640 1 -- 172.21.15.133:0/2415297692 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc8700b2040 con 0x7fc8740c4e60 2023-12-19T18:59:09.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.820+0000 7fc86affd640 1 --2- 172.21.15.133:0/2415297692 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc858066470 0x7fc858068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:09.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.820+0000 7fc86affd640 1 -- 172.21.15.133:0/2415297692 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc87011e130 con 0x7fc8740c4e60 2023-12-19T18:59:09.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.824+0000 7fc879ba4640 1 --2- 172.21.15.133:0/2415297692 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc858066470 0x7fc858068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:09.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.824+0000 7fc879ba4640 1 --2- 172.21.15.133:0/2415297692 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc858066470 0x7fc858068930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc864001350 tx=0x7fc864009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:09.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.824+0000 7fc86affd640 1 -- 172.21.15.133:0/2415297692 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc8700eb640 con 0x7fc8740c4e60 2023-12-19T18:59:09.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.976+0000 7fc87c609640 1 -- 172.21.15.133:0/2415297692 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc8740ca5f0 con 0x7fc8740c4e60 2023-12-19T18:59:09.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.980+0000 7fc86affd640 1 -- 172.21.15.133:0/2415297692 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc8700eec60 con 0x7fc8740c4e60 2023-12-19T18:59:09.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.984+0000 7fc87c609640 1 -- 172.21.15.133:0/2415297692 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc858066470 msgr2=0x7fc858068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:09.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.984+0000 7fc87c609640 1 --2- 172.21.15.133:0/2415297692 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc858066470 0x7fc858068930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc864001350 tx=0x7fc864009040 comp rx=0 tx=0).stop 2023-12-19T18:59:09.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.984+0000 7fc87c609640 1 -- 172.21.15.133:0/2415297692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8740c4e60 msgr2=0x7fc87414c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:09.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.984+0000 7fc87c609640 1 --2- 172.21.15.133:0/2415297692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8740c4e60 0x7fc87414c100 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc870009740 tx=0x7fc870019060 comp rx=0 tx=0).stop 2023-12-19T18:59:09.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.984+0000 7fc87c609640 1 -- 172.21.15.133:0/2415297692 shutdown_connections 2023-12-19T18:59:09.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.984+0000 7fc87c609640 1 --2- 172.21.15.133:0/2415297692 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc858066470 0x7fc858068930 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:09.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.984+0000 7fc87c609640 1 --2- 172.21.15.133:0/2415297692 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc874151e90 0x7fc8740abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:09.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.984+0000 7fc87c609640 1 --2- 172.21.15.133:0/2415297692 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc8740c7ea0 0x7fc87414dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:09.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.984+0000 7fc87c609640 1 --2- 172.21.15.133:0/2415297692 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc8740c4e60 0x7fc87414c100 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:09.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.984+0000 7fc87c609640 1 -- 172.21.15.133:0/2415297692 >> 172.21.15.133:0/2415297692 conn(0x7fc8740ca170 msgr2=0x7fc874150260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:09.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.984+0000 7fc87c609640 1 -- 172.21.15.133:0/2415297692 shutdown_connections 2023-12-19T18:59:09.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:09.984+0000 7fc87c609640 1 -- 172.21.15.133:0/2415297692 wait complete. 2023-12-19T18:59:10.006 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T18:59:10.007 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T18:59:10.089 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T18:59:10.146 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T18:59:10.147 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:59:10.147 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:59:10.156 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:59:10.156 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:59:10.206 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:59:10.206 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:59:10.262 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:59:10.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.444+0000 7f17c8e48640 1 Processor -- start 2023-12-19T18:59:10.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.444+0000 7f17c8e48640 1 -- start start 2023-12-19T18:59:10.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.444+0000 7f17c8e48640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f17c40c4750 0x7f17c40c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:10.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.444+0000 7f17c8e48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17c41544c0 0x7f17c4154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:10.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.444+0000 7f17c8e48640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c406c660 con 0x7f17c40af5c0 2023-12-19T18:59:10.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.444+0000 7f17c8e48640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c406ba50 con 0x7f17c40c4750 2023-12-19T18:59:10.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.444+0000 7f17c8e48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c406bd30 con 0x7f17c41544c0 2023-12-19T18:59:10.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.444+0000 7f17c37fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f17c40af5c0 0x7f17c40c7d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59116/0 (socket says 172.21.15.133:59116) 2023-12-19T18:59:10.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.444+0000 7f17c37fe640 1 -- 172.21.15.133:0/3141504196 learned_addr learned my addr 172.21.15.133:0/3141504196 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:10.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.444+0000 7f17c2ffd640 1 --2- 172.21.15.133:0/3141504196 >> v2:172.21.15.133:3300/0 conn(0x7f17c40c4750 0x7f17c40c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:10.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.444+0000 7f17c27fc640 1 -- 172.21.15.133:0/3141504196 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085374310 0 0) 0x7f17c406c660 con 0x7f17c40af5c0 2023-12-19T18:59:10.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.444+0000 7f17c27fc640 1 -- 172.21.15.133:0/3141504196 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17ac003530 con 0x7f17c40af5c0 2023-12-19T18:59:10.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.444+0000 7f17c2ffd640 1 -- 172.21.15.133:0/3141504196 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17c41544c0 msgr2=0x7f17c4154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:10.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.444+0000 7f17c2ffd640 1 --2- 172.21.15.133:0/3141504196 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17c41544c0 0x7f17c4154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:10.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.444+0000 7f17c2ffd640 1 -- 172.21.15.133:0/3141504196 >> v1:172.21.15.133:6789/0 conn(0x7f17c40af5c0 legacy=0x7f17c40c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:10.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.444+0000 7f17c2ffd640 1 -- 172.21.15.133:0/3141504196 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c406c010 con 0x7f17c40c4750 2023-12-19T18:59:10.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.448+0000 7f17c2ffd640 1 --2- 172.21.15.133:0/3141504196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c40c4750 0x7f17c40c4bc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f17b80097c0 tx=0x7f17b801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911f3ca6ef135dad server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:10.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.448+0000 7f17c27fc640 1 -- 172.21.15.133:0/3141504196 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b80ad640 con 0x7f17c40c4750 2023-12-19T18:59:10.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.448+0000 7f17c27fc640 1 -- 172.21.15.133:0/3141504196 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b80ad7a0 con 0x7f17c40c4750 2023-12-19T18:59:10.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.448+0000 7f17c27fc640 1 -- 172.21.15.133:0/3141504196 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b80adb30 con 0x7f17c40c4750 2023-12-19T18:59:10.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.448+0000 7f17c8e48640 1 -- 172.21.15.133:0/3141504196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c40c4750 msgr2=0x7f17c40c4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:10.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.448+0000 7f17c8e48640 1 --2- 172.21.15.133:0/3141504196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c40c4750 0x7f17c40c4bc0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f17b80097c0 tx=0x7f17b801c480 comp rx=0 tx=0).stop 2023-12-19T18:59:10.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.448+0000 7f17c8e48640 1 -- 172.21.15.133:0/3141504196 shutdown_connections 2023-12-19T18:59:10.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.448+0000 7f17c8e48640 1 --2- 172.21.15.133:0/3141504196 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17c41544c0 0x7f17c4154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:10.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.448+0000 7f17c8e48640 1 --2- 172.21.15.133:0/3141504196 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c40c4750 0x7f17c40c4bc0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:10.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.448+0000 7f17c8e48640 1 -- 172.21.15.133:0/3141504196 >> 172.21.15.133:0/3141504196 conn(0x7f17c40ab960 msgr2=0x7f17c40abd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:10.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.448+0000 7f17c8e48640 1 -- 172.21.15.133:0/3141504196 shutdown_connections 2023-12-19T18:59:10.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.448+0000 7f17c8e48640 1 -- 172.21.15.133:0/3141504196 wait complete. 2023-12-19T18:59:10.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.448+0000 7f17c8e48640 1 Processor -- start 2023-12-19T18:59:10.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17c8e48640 1 -- start start 2023-12-19T18:59:10.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17c8e48640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17c40af5c0 0x7f17c414a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17c8e48640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c40c4750 0x7f17c4152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17c8e48640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17c41544c0 0x7f17c4149060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17c8e48640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c414b820 con 0x7f17c40c4750 2023-12-19T18:59:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17c8e48640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40af030 con 0x7f17c41544c0 2023-12-19T18:59:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17c8e48640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c414ad30 con 0x7f17c40af5c0 2023-12-19T18:59:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17c2ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c40c4750 0x7f17c4152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17c2ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c40c4750 0x7f17c4152570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55912/0 (socket says 172.21.15.133:55912) 2023-12-19T18:59:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17c2ffd640 1 -- 172.21.15.133:0/3997645998 learned_addr learned my addr 172.21.15.133:0/3997645998 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17c37fe640 1 --2- 172.21.15.133:0/3997645998 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17c40af5c0 0x7f17c414a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17c2ffd640 1 -- 172.21.15.133:0/3997645998 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17c40af5c0 msgr2=0x7f17c414a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17c2ffd640 1 --2- 172.21.15.133:0/3997645998 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17c40af5c0 0x7f17c414a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17c2ffd640 1 -- 172.21.15.133:0/3997645998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17c41544c0 msgr2=0x7f17c4149060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17c3fff640 1 --2- 172.21.15.133:0/3997645998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17c41544c0 0x7f17c4149060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:10.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17c2ffd640 1 --2- 172.21.15.133:0/3997645998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17c41544c0 0x7f17c4149060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:10.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17c2ffd640 1 -- 172.21.15.133:0/3997645998 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b8009420 con 0x7f17c40c4750 2023-12-19T18:59:10.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17c37fe640 1 --2- 172.21.15.133:0/3997645998 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17c40af5c0 0x7f17c414a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:10.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17c3fff640 1 --2- 172.21.15.133:0/3997645998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17c41544c0 0x7f17c4149060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:10.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17c2ffd640 1 --2- 172.21.15.133:0/3997645998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c40c4750 0x7f17c4152570 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f17b80b0040 tx=0x7f17b8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:10.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17abfff640 1 -- 172.21.15.133:0/3997645998 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b80b6610 con 0x7f17c40c4750 2023-12-19T18:59:10.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17abfff640 1 -- 172.21.15.133:0/3997645998 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b80a6040 con 0x7f17c40c4750 2023-12-19T18:59:10.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17abfff640 1 -- 172.21.15.133:0/3997645998 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b80b69b0 con 0x7f17c40c4750 2023-12-19T18:59:10.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17c8e48640 1 -- 172.21.15.133:0/3997645998 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c414b010 con 0x7f17c40c4750 2023-12-19T18:59:10.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17c8e48640 1 -- 172.21.15.133:0/3997645998 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c414d590 con 0x7f17c40c4750 2023-12-19T18:59:10.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.452+0000 7f17c8e48640 1 -- 172.21.15.133:0/3997645998 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c414d780 con 0x7f17c40c4750 2023-12-19T18:59:10.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.456+0000 7f17abfff640 1 -- 172.21.15.133:0/3997645998 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f17b80b4040 con 0x7f17c40c4750 2023-12-19T18:59:10.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.456+0000 7f17abfff640 1 --2- 172.21.15.133:0/3997645998 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f17b0066470 0x7f17b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:10.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.456+0000 7f17abfff640 1 -- 172.21.15.133:0/3997645998 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17b811e120 con 0x7f17c40c4750 2023-12-19T18:59:10.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.456+0000 7f17c37fe640 1 --2- 172.21.15.133:0/3997645998 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f17b0066470 0x7f17b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:10.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.456+0000 7f17c37fe640 1 --2- 172.21.15.133:0/3997645998 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f17b0066470 0x7f17b0068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f17b40011f0 tx=0x7f17b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:10.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.460+0000 7f17abfff640 1 -- 172.21.15.133:0/3997645998 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f17b80eb590 con 0x7f17c40c4750 2023-12-19T18:59:10.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.608+0000 7f17c8e48640 1 -- 172.21.15.133:0/3997645998 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17c404e850 con 0x7f17c40c4750 2023-12-19T18:59:10.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.608+0000 7f17abfff640 1 -- 172.21.15.133:0/3997645998 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f17b80eebb0 con 0x7f17c40c4750 2023-12-19T18:59:10.614 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:10.615 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:44.402984+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:58:40.991408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T18:58:41.773992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:59:10.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.612+0000 7f17c8e48640 1 -- 172.21.15.133:0/3997645998 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f17b0066470 msgr2=0x7f17b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:10.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.612+0000 7f17c8e48640 1 --2- 172.21.15.133:0/3997645998 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f17b0066470 0x7f17b0068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f17b40011f0 tx=0x7f17b4009040 comp rx=0 tx=0).stop 2023-12-19T18:59:10.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.612+0000 7f17c8e48640 1 -- 172.21.15.133:0/3997645998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c40c4750 msgr2=0x7f17c4152570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:10.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.612+0000 7f17c8e48640 1 --2- 172.21.15.133:0/3997645998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c40c4750 0x7f17c4152570 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f17b80b0040 tx=0x7f17b8019220 comp rx=0 tx=0).stop 2023-12-19T18:59:10.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.612+0000 7f17c8e48640 1 -- 172.21.15.133:0/3997645998 shutdown_connections 2023-12-19T18:59:10.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.612+0000 7f17c8e48640 1 --2- 172.21.15.133:0/3997645998 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f17b0066470 0x7f17b0068930 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:10.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.612+0000 7f17c8e48640 1 --2- 172.21.15.133:0/3997645998 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17c41544c0 0x7f17c4149060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:10.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.612+0000 7f17c8e48640 1 --2- 172.21.15.133:0/3997645998 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17c40c4750 0x7f17c4152570 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:10.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.612+0000 7f17c8e48640 1 --2- 172.21.15.133:0/3997645998 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17c40af5c0 0x7f17c414a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:10.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.612+0000 7f17c8e48640 1 -- 172.21.15.133:0/3997645998 >> 172.21.15.133:0/3997645998 conn(0x7f17c40ab960 msgr2=0x7f17c40c85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:10.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.612+0000 7f17c8e48640 1 -- 172.21.15.133:0/3997645998 shutdown_connections 2023-12-19T18:59:10.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.612+0000 7f17c8e48640 1 -- 172.21.15.133:0/3997645998 wait complete. 2023-12-19T18:59:10.636 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:58:40.991408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:58:41.773992+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:59:10.636 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:59:10.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.772+0000 7f04e906b640 1 Processor -- start 2023-12-19T18:59:10.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.772+0000 7f04e906b640 1 -- start start 2023-12-19T18:59:10.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.776+0000 7f04e906b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f04e414b010 0x7f04e40bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:10.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.776+0000 7f04e906b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e406a5b0 con 0x7f04e4073a70 2023-12-19T18:59:10.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.776+0000 7f04e906b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e406b710 con 0x7f04e4157c20 2023-12-19T18:59:10.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.776+0000 7f04e906b640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e40c1d60 con 0x7f04e414b010 2023-12-19T18:59:10.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.776+0000 7f04e2d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f04e414b010 0x7f04e40bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:10.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.776+0000 7f04e2d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f04e414b010 0x7f04e40bf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55914/0 (socket says 172.21.15.133:55914) 2023-12-19T18:59:10.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.776+0000 7f04e2d9d640 1 -- 172.21.15.133:0/2581158190 learned_addr learned my addr 172.21.15.133:0/2581158190 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:10.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.776+0000 7f04da59c640 1 --1- 172.21.15.133:0/2581158190 >> v1:172.21.15.133:6789/0 conn(0x7f04e4073a70 0x7f04e406b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59122/0 (socket says 172.21.15.133:59122) 2023-12-19T18:59:10.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.776+0000 7f04e2d9d640 1 -- 172.21.15.133:0/2581158190 >> v1:172.21.15.138:6789/0 conn(0x7f04e4157c20 legacy=0x7f04e4158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:10.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.776+0000 7f04e2d9d640 1 -- 172.21.15.133:0/2581158190 >> v1:172.21.15.133:6789/0 conn(0x7f04e4073a70 legacy=0x7f04e406b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:10.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.776+0000 7f04e2d9d640 1 -- 172.21.15.133:0/2581158190 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e40c2040 con 0x7f04e414b010 2023-12-19T18:59:10.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.780+0000 7f04e2d9d640 1 --2- 172.21.15.133:0/2581158190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04e414b010 0x7f04e40bf9f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009870 tx=0x7f04cc01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96feef0c1a06a3e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:10.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.780+0000 7f04e259c640 1 -- 172.21.15.133:0/2581158190 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc0a89f0 con 0x7f04e414b010 2023-12-19T18:59:10.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.780+0000 7f04e259c640 1 -- 172.21.15.133:0/2581158190 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04cc0a8b50 con 0x7f04e414b010 2023-12-19T18:59:10.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.780+0000 7f04e259c640 1 -- 172.21.15.133:0/2581158190 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc0b0440 con 0x7f04e414b010 2023-12-19T18:59:10.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.780+0000 7f04e906b640 1 -- 172.21.15.133:0/2581158190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04e414b010 msgr2=0x7f04e40bf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:10.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.780+0000 7f04e906b640 1 --2- 172.21.15.133:0/2581158190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04e414b010 0x7f04e40bf9f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009870 tx=0x7f04cc01ecf0 comp rx=0 tx=0).stop 2023-12-19T18:59:10.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.780+0000 7f04e906b640 1 -- 172.21.15.133:0/2581158190 shutdown_connections 2023-12-19T18:59:10.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.780+0000 7f04e906b640 1 --2- 172.21.15.133:0/2581158190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04e414b010 0x7f04e40bf9f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:10.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.780+0000 7f04e906b640 1 -- 172.21.15.133:0/2581158190 >> 172.21.15.133:0/2581158190 conn(0x7f04e40c30c0 msgr2=0x7f04e40c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:10.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.780+0000 7f04e906b640 1 -- 172.21.15.133:0/2581158190 shutdown_connections 2023-12-19T18:59:10.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.780+0000 7f04e906b640 1 -- 172.21.15.133:0/2581158190 wait complete. 2023-12-19T18:59:10.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.780+0000 7f04e906b640 1 Processor -- start 2023-12-19T18:59:10.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.780+0000 7f04e906b640 1 -- start start 2023-12-19T18:59:10.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04e906b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04e4073a70 0x7f04e414dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:10.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04e906b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04e414b010 0x7f04e414e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:10.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04e906b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04e4157c20 0x7f04e41eb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:10.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04e906b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e414c100 con 0x7f04e4073a70 2023-12-19T18:59:10.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04e906b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e414cf60 con 0x7f04e414b010 2023-12-19T18:59:10.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04e906b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e414c350 con 0x7f04e4157c20 2023-12-19T18:59:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04e2d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04e4073a70 0x7f04e414dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04e2d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04e4073a70 0x7f04e414dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55926/0 (socket says 172.21.15.133:55926) 2023-12-19T18:59:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04e2d9d640 1 -- 172.21.15.133:0/3177503239 learned_addr learned my addr 172.21.15.133:0/3177503239 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04da59c640 1 --2- 172.21.15.133:0/3177503239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04e414b010 0x7f04e414e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04e359e640 1 --2- 172.21.15.133:0/3177503239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04e4157c20 0x7f04e41eb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04e2d9d640 1 -- 172.21.15.133:0/3177503239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04e4157c20 msgr2=0x7f04e41eb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04e2d9d640 1 --2- 172.21.15.133:0/3177503239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04e4157c20 0x7f04e41eb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04e2d9d640 1 -- 172.21.15.133:0/3177503239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04e414b010 msgr2=0x7f04e414e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04e2d9d640 1 --2- 172.21.15.133:0/3177503239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04e414b010 0x7f04e414e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04e2d9d640 1 -- 172.21.15.133:0/3177503239 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc0094d0 con 0x7f04e4073a70 2023-12-19T18:59:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04da59c640 1 --2- 172.21.15.133:0/3177503239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04e414b010 0x7f04e414e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04e2d9d640 1 --2- 172.21.15.133:0/3177503239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04e4073a70 0x7f04e414dfe0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f04cc01b900 tx=0x7f04cc01ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04dbfff640 1 -- 172.21.15.133:0/3177503239 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc0ba600 con 0x7f04e4073a70 2023-12-19T18:59:10.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04dbfff640 1 -- 172.21.15.133:0/3177503239 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04cc0ba780 con 0x7f04e4073a70 2023-12-19T18:59:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04dbfff640 1 -- 172.21.15.133:0/3177503239 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04cc0bab30 con 0x7f04e4073a70 2023-12-19T18:59:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04e906b640 1 -- 172.21.15.133:0/3177503239 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e414c630 con 0x7f04e4073a70 2023-12-19T18:59:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04e906b640 1 -- 172.21.15.133:0/3177503239 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e414cbf0 con 0x7f04e4073a70 2023-12-19T18:59:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04e906b640 1 -- 172.21.15.133:0/3177503239 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e4068400 con 0x7f04e4073a70 2023-12-19T18:59:10.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.784+0000 7f04dbfff640 1 -- 172.21.15.133:0/3177503239 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f04cc0bac90 con 0x7f04e4073a70 2023-12-19T18:59:10.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.788+0000 7f04dbfff640 1 --2- 172.21.15.133:0/3177503239 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f04c40664c0 0x7f04c4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:10.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.788+0000 7f04dbfff640 1 -- 172.21.15.133:0/3177503239 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04cc1224a0 con 0x7f04e4073a70 2023-12-19T18:59:10.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.788+0000 7f04da59c640 1 --2- 172.21.15.133:0/3177503239 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f04c40664c0 0x7f04c4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:10.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.788+0000 7f04da59c640 1 --2- 172.21.15.133:0/3177503239 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f04c40664c0 0x7f04c4068980 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f04e4066bc0 tx=0x7f04d4007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:10.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.792+0000 7f04dbfff640 1 -- 172.21.15.133:0/3177503239 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f04cc0ef990 con 0x7f04e4073a70 2023-12-19T18:59:10.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.944+0000 7f04e906b640 1 -- 172.21.15.133:0/3177503239 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f04e4068400 con 0x7f04e4073a70 2023-12-19T18:59:10.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.944+0000 7f04dbfff640 1 -- 172.21.15.133:0/3177503239 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f04cc0f2fb0 con 0x7f04e4073a70 2023-12-19T18:59:10.949 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T18:59:10.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.944+0000 7f04e906b640 1 -- 172.21.15.133:0/3177503239 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f04c40664c0 msgr2=0x7f04c4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:10.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.944+0000 7f04e906b640 1 --2- 172.21.15.133:0/3177503239 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f04c40664c0 0x7f04c4068980 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f04e4066bc0 tx=0x7f04d4007d50 comp rx=0 tx=0).stop 2023-12-19T18:59:10.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.944+0000 7f04e906b640 1 -- 172.21.15.133:0/3177503239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04e4073a70 msgr2=0x7f04e414dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:10.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.944+0000 7f04e906b640 1 --2- 172.21.15.133:0/3177503239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04e4073a70 0x7f04e414dfe0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f04cc01b900 tx=0x7f04cc01ba90 comp rx=0 tx=0).stop 2023-12-19T18:59:10.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.944+0000 7f04e906b640 1 -- 172.21.15.133:0/3177503239 shutdown_connections 2023-12-19T18:59:10.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.944+0000 7f04e906b640 1 --2- 172.21.15.133:0/3177503239 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f04c40664c0 0x7f04c4068980 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:10.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.944+0000 7f04e906b640 1 --2- 172.21.15.133:0/3177503239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f04e4157c20 0x7f04e41eb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:10.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.944+0000 7f04e906b640 1 --2- 172.21.15.133:0/3177503239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f04e414b010 0x7f04e414e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:10.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.944+0000 7f04e906b640 1 --2- 172.21.15.133:0/3177503239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f04e4073a70 0x7f04e414dfe0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:10.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.944+0000 7f04e906b640 1 -- 172.21.15.133:0/3177503239 >> 172.21.15.133:0/3177503239 conn(0x7f04e40c30c0 msgr2=0x7f04e40bfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:10.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.948+0000 7f04e906b640 1 -- 172.21.15.133:0/3177503239 shutdown_connections 2023-12-19T18:59:10.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:10.948+0000 7f04e906b640 1 -- 172.21.15.133:0/3177503239 wait complete. 2023-12-19T18:59:10.970 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:59:11.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.104+0000 7f9baa7aa640 1 Processor -- start 2023-12-19T18:59:11.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.104+0000 7f9baa7aa640 1 -- start start 2023-12-19T18:59:11.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.108+0000 7f9baa7aa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9ba40a5240 0x7f9ba40bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:11.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.108+0000 7f9baa7aa640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9ba41561f0 0x7f9ba4156640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:11.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.108+0000 7f9baa7aa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba40c3bd0 con 0x7f9ba40c01c0 2023-12-19T18:59:11.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.108+0000 7f9baa7aa640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ba40bf1e0 con 0x7f9ba41561f0 2023-12-19T18:59:11.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.108+0000 7f9baa7aa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ba40c3e20 con 0x7f9ba40a5240 2023-12-19T18:59:11.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.108+0000 7f9ba8d47640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9ba41561f0 0x7f9ba4156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:11.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.108+0000 7f9ba8d47640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9ba41561f0 0x7f9ba4156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55940/0 (socket says 172.21.15.133:55940) 2023-12-19T18:59:11.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.108+0000 7f9ba8d47640 1 -- 172.21.15.133:0/2469417547 learned_addr learned my addr 172.21.15.133:0/2469417547 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:11.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.108+0000 7f9ba3fff640 1 --2- 172.21.15.133:0/2469417547 >> v2:172.21.15.138:3300/0 conn(0x7f9ba40a5240 0x7f9ba40bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:11.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.108+0000 7f9ba8d47640 1 -- 172.21.15.133:0/2469417547 >> v2:172.21.15.138:3300/0 conn(0x7f9ba40a5240 msgr2=0x7f9ba40bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:11.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.108+0000 7f9ba8d47640 1 --2- 172.21.15.133:0/2469417547 >> v2:172.21.15.138:3300/0 conn(0x7f9ba40a5240 0x7f9ba40bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.108+0000 7f9ba8d47640 1 -- 172.21.15.133:0/2469417547 >> v1:172.21.15.138:6789/0 conn(0x7f9ba40c01c0 legacy=0x7f9ba40c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:11.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.108+0000 7f9ba8d47640 1 -- 172.21.15.133:0/2469417547 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba40c4100 con 0x7f9ba41561f0 2023-12-19T18:59:11.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.108+0000 7f9ba3fff640 1 --2- 172.21.15.133:0/2469417547 >> v2:172.21.15.138:3300/0 conn(0x7f9ba40a5240 0x7f9ba40bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:11.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.112+0000 7f9ba8d47640 1 --2- 172.21.15.133:0/2469417547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ba41561f0 0x7f9ba4156640 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9ba40bf530 tx=0x7f9b9c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a09788f5f70b187 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:11.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.112+0000 7f9ba2ffd640 1 -- 172.21.15.133:0/2469417547 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c0a56a0 con 0x7f9ba41561f0 2023-12-19T18:59:11.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.112+0000 7f9ba2ffd640 1 -- 172.21.15.133:0/2469417547 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b9c0a5800 con 0x7f9ba41561f0 2023-12-19T18:59:11.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.112+0000 7f9ba2ffd640 1 -- 172.21.15.133:0/2469417547 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c0a5b90 con 0x7f9ba41561f0 2023-12-19T18:59:11.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.112+0000 7f9baa7aa640 1 -- 172.21.15.133:0/2469417547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ba41561f0 msgr2=0x7f9ba4156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:11.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.112+0000 7f9baa7aa640 1 --2- 172.21.15.133:0/2469417547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ba41561f0 0x7f9ba4156640 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9ba40bf530 tx=0x7f9b9c01c8d0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.112+0000 7f9baa7aa640 1 -- 172.21.15.133:0/2469417547 shutdown_connections 2023-12-19T18:59:11.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.112+0000 7f9baa7aa640 1 --2- 172.21.15.133:0/2469417547 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ba41561f0 0x7f9ba4156640 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.112+0000 7f9baa7aa640 1 --2- 172.21.15.133:0/2469417547 >> v2:172.21.15.138:3300/0 conn(0x7f9ba40a5240 0x7f9ba40bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.112+0000 7f9baa7aa640 1 -- 172.21.15.133:0/2469417547 >> 172.21.15.133:0/2469417547 conn(0x7f9ba406a5b0 msgr2=0x7f9ba406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:11.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.112+0000 7f9baa7aa640 1 -- 172.21.15.133:0/2469417547 shutdown_connections 2023-12-19T18:59:11.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.112+0000 7f9baa7aa640 1 -- 172.21.15.133:0/2469417547 wait complete. 2023-12-19T18:59:11.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.112+0000 7f9baa7aa640 1 Processor -- start 2023-12-19T18:59:11.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.112+0000 7f9baa7aa640 1 -- start start 2023-12-19T18:59:11.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9baa7aa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ba40a5240 0x7f9ba414e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:11.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9baa7aa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ba40c01c0 0x7f9ba4070070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:11.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9baa7aa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ba41561f0 0x7f9ba40705b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:11.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9baa7aa640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba4071d60 con 0x7f9ba40c01c0 2023-12-19T18:59:11.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9baa7aa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba41ed2f0 con 0x7f9ba41561f0 2023-12-19T18:59:11.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9baa7aa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba41ed5d0 con 0x7f9ba40a5240 2023-12-19T18:59:11.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9ba37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ba40c01c0 0x7f9ba4070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:11.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9ba37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ba40c01c0 0x7f9ba4070070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55950/0 (socket says 172.21.15.133:55950) 2023-12-19T18:59:11.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9ba37fe640 1 -- 172.21.15.133:0/3308879286 learned_addr learned my addr 172.21.15.133:0/3308879286 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:11.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9ba3fff640 1 --2- 172.21.15.133:0/3308879286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ba40a5240 0x7f9ba414e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:11.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9ba8d47640 1 --2- 172.21.15.133:0/3308879286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ba41561f0 0x7f9ba40705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:11.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9ba37fe640 1 -- 172.21.15.133:0/3308879286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ba40a5240 msgr2=0x7f9ba414e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:11.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9ba37fe640 1 --2- 172.21.15.133:0/3308879286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ba40a5240 0x7f9ba414e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9ba37fe640 1 -- 172.21.15.133:0/3308879286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ba41561f0 msgr2=0x7f9ba40705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:11.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9ba37fe640 1 --2- 172.21.15.133:0/3308879286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ba41561f0 0x7f9ba40705b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9ba37fe640 1 -- 172.21.15.133:0/3308879286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9c009b30 con 0x7f9ba40c01c0 2023-12-19T18:59:11.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9ba37fe640 1 --2- 172.21.15.133:0/3308879286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ba40c01c0 0x7f9ba4070070 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800b3e0 tx=0x7f9b9800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:11.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9ba0ff9640 1 -- 172.21.15.133:0/3308879286 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b98011830 con 0x7f9ba40c01c0 2023-12-19T18:59:11.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9ba0ff9640 1 -- 172.21.15.133:0/3308879286 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b98011990 con 0x7f9ba40c01c0 2023-12-19T18:59:11.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9ba0ff9640 1 -- 172.21.15.133:0/3308879286 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b98011d80 con 0x7f9ba40c01c0 2023-12-19T18:59:11.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9baa7aa640 1 -- 172.21.15.133:0/3308879286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba41ed8b0 con 0x7f9ba40c01c0 2023-12-19T18:59:11.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9baa7aa640 1 -- 172.21.15.133:0/3308879286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba41ede70 con 0x7f9ba40c01c0 2023-12-19T18:59:11.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9baa7aa640 1 -- 172.21.15.133:0/3308879286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ba40c52e0 con 0x7f9ba40c01c0 2023-12-19T18:59:11.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.116+0000 7f9ba0ff9640 1 -- 172.21.15.133:0/3308879286 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9b98004020 con 0x7f9ba40c01c0 2023-12-19T18:59:11.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.120+0000 7f9ba0ff9640 1 --2- 172.21.15.133:0/3308879286 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9b90066470 0x7f9b90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:11.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.120+0000 7f9ba0ff9640 1 -- 172.21.15.133:0/3308879286 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b98083ad0 con 0x7f9ba40c01c0 2023-12-19T18:59:11.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.120+0000 7f9ba3fff640 1 --2- 172.21.15.133:0/3308879286 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9b90066470 0x7f9b90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:11.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.120+0000 7f9ba3fff640 1 --2- 172.21.15.133:0/3308879286 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9b90066470 0x7f9b90068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4152740 tx=0x7f9b94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:11.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.124+0000 7f9ba0ff9640 1 -- 172.21.15.133:0/3308879286 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9b98050ff0 con 0x7f9ba40c01c0 2023-12-19T18:59:11.241 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:59:11.244 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:59:11.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.276+0000 7f9baa7aa640 1 -- 172.21.15.133:0/3308879286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9ba40ac0e0 con 0x7f9ba40c01c0 2023-12-19T18:59:11.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.276+0000 7f9ba0ff9640 1 -- 172.21.15.133:0/3308879286 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9ba40ac0e0 con 0x7f9ba40c01c0 2023-12-19T18:59:11.280 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T18:59:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.276+0000 7f9baa7aa640 1 -- 172.21.15.133:0/3308879286 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9b90066470 msgr2=0x7f9b90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.276+0000 7f9baa7aa640 1 --2- 172.21.15.133:0/3308879286 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9b90066470 0x7f9b90068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4152740 tx=0x7f9b94008040 comp rx=0 tx=0).stop 2023-12-19T18:59:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.276+0000 7f9baa7aa640 1 -- 172.21.15.133:0/3308879286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ba40c01c0 msgr2=0x7f9ba4070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.276+0000 7f9baa7aa640 1 --2- 172.21.15.133:0/3308879286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ba40c01c0 0x7f9ba4070070 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f9b9800b3e0 tx=0x7f9b9800b8a0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.276+0000 7f9baa7aa640 1 -- 172.21.15.133:0/3308879286 shutdown_connections 2023-12-19T18:59:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.276+0000 7f9baa7aa640 1 --2- 172.21.15.133:0/3308879286 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9b90066470 0x7f9b90068930 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.276+0000 7f9baa7aa640 1 --2- 172.21.15.133:0/3308879286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ba41561f0 0x7f9ba40705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.276+0000 7f9baa7aa640 1 --2- 172.21.15.133:0/3308879286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ba40c01c0 0x7f9ba4070070 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.276+0000 7f9baa7aa640 1 --2- 172.21.15.133:0/3308879286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ba40a5240 0x7f9ba414e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.276+0000 7f9baa7aa640 1 -- 172.21.15.133:0/3308879286 >> 172.21.15.133:0/3308879286 conn(0x7f9ba406a5b0 msgr2=0x7f9ba40a59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:11.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.276+0000 7f9baa7aa640 1 -- 172.21.15.133:0/3308879286 shutdown_connections 2023-12-19T18:59:11.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.276+0000 7f9baa7aa640 1 -- 172.21.15.133:0/3308879286 wait complete. 2023-12-19T18:59:11.301 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:59:11.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.476+0000 7f33b3288640 1 Processor -- start 2023-12-19T18:59:11.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.476+0000 7f33b3288640 1 -- start start 2023-12-19T18:59:11.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b3288640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33ac06d990 0x7f33ac0c5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:11.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b3288640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ac0c1e30 con 0x7f33ac1546c0 2023-12-19T18:59:11.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b3288640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ac06dd70 con 0x7f33ac154b20 2023-12-19T18:59:11.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b3288640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0c1220 con 0x7f33ac06d990 2023-12-19T18:59:11.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b1a85640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f33ac1546c0 0x7f33ac06c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59136/0 (socket says 172.21.15.133:59136) 2023-12-19T18:59:11.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b1a85640 1 -- 172.21.15.133:0/1850613519 learned_addr learned my addr 172.21.15.133:0/1850613519 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:11.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b2286640 1 --2- 172.21.15.133:0/1850613519 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33ac06d990 0x7f33ac0c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:11.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b1284640 1 -- 172.21.15.133:0/1850613519 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590602056 0 0) 0x7f33ac0c1e30 con 0x7f33ac1546c0 2023-12-19T18:59:11.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b1284640 1 -- 172.21.15.133:0/1850613519 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3398005740 con 0x7f33ac1546c0 2023-12-19T18:59:11.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b1284640 1 -- 172.21.15.133:0/1850613519 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 96525303 0 0) 0x7f3398005740 con 0x7f33ac1546c0 2023-12-19T18:59:11.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b1284640 1 -- 172.21.15.133:0/1850613519 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33ac06d990 msgr2=0x7f33ac0c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:11.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b1284640 1 --2- 172.21.15.133:0/1850613519 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33ac06d990 0x7f33ac0c5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b1284640 1 -- 172.21.15.133:0/1850613519 >> v1:172.21.15.138:6789/0 conn(0x7f33ac154b20 legacy=0x7f33ac06c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:11.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b1284640 1 -- 172.21.15.133:0/1850613519 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac0c1500 con 0x7f33ac1546c0 2023-12-19T18:59:11.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b1284640 1 -- 172.21.15.133:0/1850613519 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f339c001680 con 0x7f33ac1546c0 2023-12-19T18:59:11.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b1284640 1 -- 172.21.15.133:0/1850613519 >> v1:172.21.15.133:6789/0 conn(0x7f33ac1546c0 legacy=0x7f33ac06c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:11.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b1284640 1 --2- 172.21.15.133:0/1850613519 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3398005bc0 0x7f3398005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:11.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b1284640 1 --2- 172.21.15.133:0/1850613519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33980069e0 0x7f3398006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:11.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b1284640 1 --2- 172.21.15.133:0/1850613519 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33ac06d990 0x7f33980073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:11.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b1284640 1 -- 172.21.15.133:0/1850613519 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0c1220 con 0x7f33980069e0 2023-12-19T18:59:11.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b1284640 1 -- 172.21.15.133:0/1850613519 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339800dcd0 con 0x7f3398005bc0 2023-12-19T18:59:11.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b1284640 1 -- 172.21.15.133:0/1850613519 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339800de90 con 0x7f33ac06d990 2023-12-19T18:59:11.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b1a85640 1 --2- 172.21.15.133:0/1850613519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33980069e0 0x7f3398006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:11.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b2286640 1 --2- 172.21.15.133:0/1850613519 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3398005bc0 0x7f3398005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:11.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b2a87640 1 --2- 172.21.15.133:0/1850613519 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33ac06d990 0x7f33980073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:11.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b1a85640 1 -- 172.21.15.133:0/1850613519 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33ac06d990 msgr2=0x7f33980073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:11.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b1a85640 1 --2- 172.21.15.133:0/1850613519 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33ac06d990 0x7f33980073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b1a85640 1 -- 172.21.15.133:0/1850613519 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3398005bc0 msgr2=0x7f3398005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:11.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b1a85640 1 --2- 172.21.15.133:0/1850613519 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3398005bc0 0x7f3398005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.480+0000 7f33b1a85640 1 -- 172.21.15.133:0/1850613519 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3398005740 con 0x7f33980069e0 2023-12-19T18:59:11.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.484+0000 7f33b1a85640 1 --2- 172.21.15.133:0/1850613519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33980069e0 0x7f3398006e60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f339c00c240 tx=0x7f339c01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c873aaef21fe918 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:11.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.484+0000 7f33b1284640 1 -- 172.21.15.133:0/1850613519 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c0a5b20 con 0x7f33980069e0 2023-12-19T18:59:11.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.484+0000 7f33b1284640 1 -- 172.21.15.133:0/1850613519 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339c0a5c80 con 0x7f33980069e0 2023-12-19T18:59:11.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.484+0000 7f33b1284640 1 -- 172.21.15.133:0/1850613519 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c005b20 con 0x7f33980069e0 2023-12-19T18:59:11.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.484+0000 7f33b3288640 1 -- 172.21.15.133:0/1850613519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33980069e0 msgr2=0x7f3398006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:11.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.484+0000 7f33b3288640 1 --2- 172.21.15.133:0/1850613519 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33980069e0 0x7f3398006e60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f339c00c240 tx=0x7f339c01cc40 comp rx=0 tx=0).stop 2023-12-19T18:59:11.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.484+0000 7f33b2a87640 1 -- 172.21.15.133:0/1850613519 reap_dead start 2023-12-19T18:59:11.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.484+0000 7f33b3288640 1 -- 172.21.15.133:0/1850613519 shutdown_connections 2023-12-19T18:59:11.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.484+0000 7f33b3288640 1 -- 172.21.15.133:0/1850613519 >> 172.21.15.133:0/1850613519 conn(0x7f33ac0a7800 msgr2=0x7f33ac0a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:11.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.484+0000 7f33b3288640 1 -- 172.21.15.133:0/1850613519 shutdown_connections 2023-12-19T18:59:11.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.484+0000 7f33b3288640 1 -- 172.21.15.133:0/1850613519 wait complete. 2023-12-19T18:59:11.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.484+0000 7f33b3288640 1 Processor -- start 2023-12-19T18:59:11.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.484+0000 7f33b3288640 1 -- start start 2023-12-19T18:59:11.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33b3288640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33980069e0 0x7f33ac0bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:11.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33b3288640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33ac0a8800 0x7f33ac1e9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:11.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33b3288640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33ac1ea0a0 0x7f33ac1f0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:11.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33b3288640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac14bb60 con 0x7f33ac1ea0a0 2023-12-19T18:59:11.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33b3288640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac1f0120 con 0x7f33ac0a8800 2023-12-19T18:59:11.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33b3288640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0a7350 con 0x7f33980069e0 2023-12-19T18:59:11.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33b2a87640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33ac1ea0a0 0x7f33ac1f0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:11.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33b2a87640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33ac1ea0a0 0x7f33ac1f0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55974/0 (socket says 172.21.15.133:55974) 2023-12-19T18:59:11.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33b2a87640 1 -- 172.21.15.133:0/2132970932 learned_addr learned my addr 172.21.15.133:0/2132970932 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:11.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33b2286640 1 --2- 172.21.15.133:0/2132970932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33980069e0 0x7f33ac0bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:11.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33b1a85640 1 --2- 172.21.15.133:0/2132970932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33ac0a8800 0x7f33ac1e9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:11.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33b2a87640 1 -- 172.21.15.133:0/2132970932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33980069e0 msgr2=0x7f33ac0bf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:11.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33b2a87640 1 --2- 172.21.15.133:0/2132970932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33980069e0 0x7f33ac0bf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33b2a87640 1 -- 172.21.15.133:0/2132970932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33ac0a8800 msgr2=0x7f33ac1e9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:11.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33b2a87640 1 --2- 172.21.15.133:0/2132970932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33ac0a8800 0x7f33ac1e9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33b2a87640 1 -- 172.21.15.133:0/2132970932 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac14cb20 con 0x7f33ac1ea0a0 2023-12-19T18:59:11.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33b2a87640 1 --2- 172.21.15.133:0/2132970932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33ac1ea0a0 0x7f33ac1f0570 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f33ac067940 tx=0x7f33a400fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:11.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33a2ffd640 1 -- 172.21.15.133:0/2132970932 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a400fe60 con 0x7f33ac1ea0a0 2023-12-19T18:59:11.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33a2ffd640 1 -- 172.21.15.133:0/2132970932 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a4006d70 con 0x7f33ac1ea0a0 2023-12-19T18:59:11.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33b3288640 1 -- 172.21.15.133:0/2132970932 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ac1ea520 con 0x7f33ac1ea0a0 2023-12-19T18:59:11.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33a2ffd640 1 -- 172.21.15.133:0/2132970932 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4003bc0 con 0x7f33ac1ea0a0 2023-12-19T18:59:11.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33b3288640 1 -- 172.21.15.133:0/2132970932 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ac14bd70 con 0x7f33ac1ea0a0 2023-12-19T18:59:11.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33b3288640 1 -- 172.21.15.133:0/2132970932 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ac1f0290 con 0x7f33ac1ea0a0 2023-12-19T18:59:11.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.488+0000 7f33a2ffd640 1 -- 172.21.15.133:0/2132970932 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f33a4003d20 con 0x7f33ac1ea0a0 2023-12-19T18:59:11.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.492+0000 7f33a2ffd640 1 --2- 172.21.15.133:0/2132970932 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f33900664a0 0x7f3390068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:11.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.492+0000 7f33a2ffd640 1 -- 172.21.15.133:0/2132970932 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33a4083220 con 0x7f33ac1ea0a0 2023-12-19T18:59:11.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.492+0000 7f33b2286640 1 --2- 172.21.15.133:0/2132970932 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f33900664a0 0x7f3390068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:11.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.492+0000 7f33b2286640 1 --2- 172.21.15.133:0/2132970932 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f33900664a0 0x7f3390068960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0bf9e0 tx=0x7f33a8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:11.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.496+0000 7f33a2ffd640 1 -- 172.21.15.133:0/2132970932 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f33ac1f0290 con 0x7f33ac1ea0a0 2023-12-19T18:59:11.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.644+0000 7f33b3288640 1 -- 172.21.15.133:0/2132970932 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f33ac1f0290 con 0x7f33ac1ea0a0 2023-12-19T18:59:11.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.644+0000 7f33a2ffd640 1 -- 172.21.15.133:0/2132970932 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f33ac1f0290 con 0x7f33ac1ea0a0 2023-12-19T18:59:11.648 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T18:59:11.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.644+0000 7f33b3288640 1 -- 172.21.15.133:0/2132970932 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f33900664a0 msgr2=0x7f3390068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:11.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.644+0000 7f33b3288640 1 --2- 172.21.15.133:0/2132970932 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f33900664a0 0x7f3390068960 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f33ac0bf9e0 tx=0x7f33a8009190 comp rx=0 tx=0).stop 2023-12-19T18:59:11.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.644+0000 7f33b3288640 1 -- 172.21.15.133:0/2132970932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33ac1ea0a0 msgr2=0x7f33ac1f0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:11.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.644+0000 7f33b3288640 1 --2- 172.21.15.133:0/2132970932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33ac1ea0a0 0x7f33ac1f0570 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f33ac067940 tx=0x7f33a400fc10 comp rx=0 tx=0).stop 2023-12-19T18:59:11.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.644+0000 7f33b3288640 1 -- 172.21.15.133:0/2132970932 shutdown_connections 2023-12-19T18:59:11.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.644+0000 7f33b3288640 1 --2- 172.21.15.133:0/2132970932 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f33900664a0 0x7f3390068960 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.644+0000 7f33b3288640 1 --2- 172.21.15.133:0/2132970932 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f33ac1ea0a0 0x7f33ac1f0570 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.644+0000 7f33b3288640 1 --2- 172.21.15.133:0/2132970932 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33ac0a8800 0x7f33ac1e9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.644+0000 7f33b3288640 1 --2- 172.21.15.133:0/2132970932 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33980069e0 0x7f33ac0bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.644+0000 7f33b3288640 1 -- 172.21.15.133:0/2132970932 >> 172.21.15.133:0/2132970932 conn(0x7f33ac0a7800 msgr2=0x7f33ac153f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:11.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.644+0000 7f33b3288640 1 -- 172.21.15.133:0/2132970932 shutdown_connections 2023-12-19T18:59:11.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.644+0000 7f33b3288640 1 -- 172.21.15.133:0/2132970932 wait complete. 2023-12-19T18:59:11.671 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T18:59:11.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.804+0000 7f9f7da17640 1 Processor -- start 2023-12-19T18:59:11.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.804+0000 7f9f7da17640 1 -- start start 2023-12-19T18:59:11.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.804+0000 7f9f7da17640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f780c4100 0x7f9f780c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:11.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.804+0000 7f9f7da17640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f780c31c0 con 0x7f9f780c63c0 2023-12-19T18:59:11.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.808+0000 7f9f7da17640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f780c34a0 con 0x7f9f780c06d0 2023-12-19T18:59:11.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.808+0000 7f9f7da17640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f780c1030 con 0x7f9f780c4100 2023-12-19T18:59:11.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.808+0000 7f9f76ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9f780c63c0 0x7f9f780c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59140/0 (socket says 172.21.15.133:59140) 2023-12-19T18:59:11.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.808+0000 7f9f76ffd640 1 -- 172.21.15.133:0/3292314583 learned_addr learned my addr 172.21.15.133:0/3292314583 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:11.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.808+0000 7f9f6e7fc640 1 --2- 172.21.15.133:0/3292314583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f780c4100 0x7f9f780c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:11.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.808+0000 7f9f767fc640 1 -- 172.21.15.133:0/3292314583 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1005980638 0 0) 0x7f9f780c31c0 con 0x7f9f780c63c0 2023-12-19T18:59:11.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.808+0000 7f9f767fc640 1 -- 172.21.15.133:0/3292314583 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f64003530 con 0x7f9f780c63c0 2023-12-19T18:59:11.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.808+0000 7f9f6e7fc640 1 -- 172.21.15.133:0/3292314583 >> v1:172.21.15.138:6789/0 conn(0x7f9f780c06d0 legacy=0x7f9f780a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:11.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.808+0000 7f9f767fc640 1 -- 172.21.15.133:0/3292314583 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3046835062 0 0) 0x7f9f780c34a0 con 0x7f9f780c06d0 2023-12-19T18:59:11.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.808+0000 7f9f6e7fc640 1 -- 172.21.15.133:0/3292314583 >> v1:172.21.15.133:6789/0 conn(0x7f9f780c63c0 legacy=0x7f9f780c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:11.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.808+0000 7f9f6e7fc640 1 -- 172.21.15.133:0/3292314583 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f780c1310 con 0x7f9f780c4100 2023-12-19T18:59:11.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.808+0000 7f9f6e7fc640 1 --2- 172.21.15.133:0/3292314583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f780c4100 0x7f9f780c2bb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9f600097f0 tx=0x7f9f6001c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af1bab4cc6aaac11 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:11.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.812+0000 7f9f767fc640 1 -- 172.21.15.133:0/3292314583 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f600ab600 con 0x7f9f780c4100 2023-12-19T18:59:11.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.812+0000 7f9f767fc640 1 -- 172.21.15.133:0/3292314583 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f600a7050 con 0x7f9f780c4100 2023-12-19T18:59:11.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.812+0000 7f9f767fc640 1 -- 172.21.15.133:0/3292314583 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f600ab980 con 0x7f9f780c4100 2023-12-19T18:59:11.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.812+0000 7f9f7da17640 1 -- 172.21.15.133:0/3292314583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f780c4100 msgr2=0x7f9f780c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:11.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.812+0000 7f9f7da17640 1 --2- 172.21.15.133:0/3292314583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f780c4100 0x7f9f780c2bb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9f600097f0 tx=0x7f9f6001c3a0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.812+0000 7f9f7da17640 1 -- 172.21.15.133:0/3292314583 shutdown_connections 2023-12-19T18:59:11.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.812+0000 7f9f7da17640 1 --2- 172.21.15.133:0/3292314583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f780c4100 0x7f9f780c2bb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.812+0000 7f9f7da17640 1 -- 172.21.15.133:0/3292314583 >> 172.21.15.133:0/3292314583 conn(0x7f9f7806a5b0 msgr2=0x7f9f7806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:11.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.812+0000 7f9f7da17640 1 -- 172.21.15.133:0/3292314583 shutdown_connections 2023-12-19T18:59:11.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.812+0000 7f9f7da17640 1 -- 172.21.15.133:0/3292314583 wait complete. 2023-12-19T18:59:11.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.812+0000 7f9f7da17640 1 Processor -- start 2023-12-19T18:59:11.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.812+0000 7f9f7da17640 1 -- start start 2023-12-19T18:59:11.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.812+0000 7f9f7da17640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f780c06d0 0x7f9f7814cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:11.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.812+0000 7f9f7da17640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f780c4100 0x7f9f78071a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:11.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.812+0000 7f9f7da17640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f780c63c0 0x7f9f78153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:11.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.812+0000 7f9f7da17640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f78153690 con 0x7f9f780c4100 2023-12-19T18:59:11.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.812+0000 7f9f7da17640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f7814d270 con 0x7f9f780c06d0 2023-12-19T18:59:11.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.812+0000 7f9f7da17640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f780bbbb0 con 0x7f9f780c63c0 2023-12-19T18:59:11.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.812+0000 7f9f6e7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f780c4100 0x7f9f78071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:11.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.812+0000 7f9f6e7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f780c4100 0x7f9f78071a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55978/0 (socket says 172.21.15.133:55978) 2023-12-19T18:59:11.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.812+0000 7f9f6e7fc640 1 -- 172.21.15.133:0/3648721280 learned_addr learned my addr 172.21.15.133:0/3648721280 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:11.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.812+0000 7f9f76ffd640 1 --2- 172.21.15.133:0/3648721280 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f780c06d0 0x7f9f7814cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:11.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.812+0000 7f9f777fe640 1 --2- 172.21.15.133:0/3648721280 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f780c63c0 0x7f9f78153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:11.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.816+0000 7f9f6e7fc640 1 -- 172.21.15.133:0/3648721280 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f780c63c0 msgr2=0x7f9f78153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:11.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.816+0000 7f9f6e7fc640 1 --2- 172.21.15.133:0/3648721280 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f780c63c0 0x7f9f78153d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.816+0000 7f9f6e7fc640 1 -- 172.21.15.133:0/3648721280 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f780c06d0 msgr2=0x7f9f7814cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:11.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.816+0000 7f9f6e7fc640 1 --2- 172.21.15.133:0/3648721280 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f780c06d0 0x7f9f7814cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.816+0000 7f9f6e7fc640 1 -- 172.21.15.133:0/3648721280 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f60009420 con 0x7f9f780c4100 2023-12-19T18:59:11.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.816+0000 7f9f6e7fc640 1 --2- 172.21.15.133:0/3648721280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f780c4100 0x7f9f78071a70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9f600097f0 tx=0x7f9f6001abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:11.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.816+0000 7f9f74ff9640 1 -- 172.21.15.133:0/3648721280 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f600abda0 con 0x7f9f780c4100 2023-12-19T18:59:11.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.816+0000 7f9f74ff9640 1 -- 172.21.15.133:0/3648721280 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f60004020 con 0x7f9f780c4100 2023-12-19T18:59:11.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.816+0000 7f9f7da17640 1 -- 172.21.15.133:0/3648721280 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f780c69b0 con 0x7f9f780c4100 2023-12-19T18:59:11.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.816+0000 7f9f74ff9640 1 -- 172.21.15.133:0/3648721280 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f60004390 con 0x7f9f780c4100 2023-12-19T18:59:11.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.816+0000 7f9f7da17640 1 -- 172.21.15.133:0/3648721280 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f780bb5f0 con 0x7f9f780c4100 2023-12-19T18:59:11.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.816+0000 7f9f7da17640 1 -- 172.21.15.133:0/3648721280 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f78068400 con 0x7f9f780c4100 2023-12-19T18:59:11.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.816+0000 7f9f74ff9640 1 -- 172.21.15.133:0/3648721280 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9f60003620 con 0x7f9f780c4100 2023-12-19T18:59:11.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.816+0000 7f9f74ff9640 1 --2- 172.21.15.133:0/3648721280 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9f58066470 0x7f9f58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:11.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.816+0000 7f9f74ff9640 1 -- 172.21.15.133:0/3648721280 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f6011dfe0 con 0x7f9f780c4100 2023-12-19T18:59:11.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.820+0000 7f9f76ffd640 1 --2- 172.21.15.133:0/3648721280 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9f58066470 0x7f9f58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:11.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.820+0000 7f9f76ffd640 1 --2- 172.21.15.133:0/3648721280 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9f58066470 0x7f9f58068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9f68007fd0 tx=0x7f9f68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:11.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.820+0000 7f9f74ff9640 1 -- 172.21.15.133:0/3648721280 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9f600eb5a0 con 0x7f9f780c4100 2023-12-19T18:59:11.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.984+0000 7f9f7da17640 1 -- 172.21.15.133:0/3648721280 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9f780728b0 con 0x7f9f780c4100 2023-12-19T18:59:11.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.984+0000 7f9f74ff9640 1 -- 172.21.15.133:0/3648721280 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9f600b0080 con 0x7f9f780c4100 2023-12-19T18:59:11.988 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-19T18:59:11.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.984+0000 7f9f7da17640 1 -- 172.21.15.133:0/3648721280 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9f58066470 msgr2=0x7f9f58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:11.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.984+0000 7f9f7da17640 1 --2- 172.21.15.133:0/3648721280 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9f58066470 0x7f9f58068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9f68007fd0 tx=0x7f9f68009040 comp rx=0 tx=0).stop 2023-12-19T18:59:11.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.984+0000 7f9f7da17640 1 -- 172.21.15.133:0/3648721280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f780c4100 msgr2=0x7f9f78071a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:11.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.984+0000 7f9f7da17640 1 --2- 172.21.15.133:0/3648721280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f780c4100 0x7f9f78071a70 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9f600097f0 tx=0x7f9f6001abe0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.984+0000 7f9f7da17640 1 -- 172.21.15.133:0/3648721280 shutdown_connections 2023-12-19T18:59:11.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.984+0000 7f9f7da17640 1 --2- 172.21.15.133:0/3648721280 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9f58066470 0x7f9f58068930 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.984+0000 7f9f7da17640 1 --2- 172.21.15.133:0/3648721280 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f780c63c0 0x7f9f78153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.984+0000 7f9f7da17640 1 --2- 172.21.15.133:0/3648721280 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f780c4100 0x7f9f78071a70 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.984+0000 7f9f7da17640 1 --2- 172.21.15.133:0/3648721280 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f780c06d0 0x7f9f7814cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:11.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.984+0000 7f9f7da17640 1 -- 172.21.15.133:0/3648721280 >> 172.21.15.133:0/3648721280 conn(0x7f9f7806a5b0 msgr2=0x7f9f7806fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:11.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.984+0000 7f9f7da17640 1 -- 172.21.15.133:0/3648721280 shutdown_connections 2023-12-19T18:59:11.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:11.984+0000 7f9f7da17640 1 -- 172.21.15.133:0/3648721280 wait complete. 2023-12-19T18:59:12.008 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T18:59:12.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:12.008 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-19T18:59:12.040 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-19T18:59:12.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:12.040 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T18:59:12.101 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:59:12.101 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:59:12.111 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:59:12.111 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:59:12.167 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:59:12.167 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:59:12.220 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:59:12.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.352+0000 7f2b451d0640 1 Processor -- start 2023-12-19T18:59:12.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.352+0000 7f2b451d0640 1 -- start start 2023-12-19T18:59:12.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.352+0000 7f2b451d0640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2b4006d990 0x7f2b400c5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:12.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.352+0000 7f2b451d0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2b401546c0 0x7f2b40154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:12.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.352+0000 7f2b451d0640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b400c1e30 con 0x7f2b4006c070 2023-12-19T18:59:12.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.352+0000 7f2b451d0640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4006dd70 con 0x7f2b401546c0 2023-12-19T18:59:12.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.352+0000 7f2b451d0640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b400c1220 con 0x7f2b4006d990 2023-12-19T18:59:12.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.352+0000 7f2b3f7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2b401546c0 0x7f2b40154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:12.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.356+0000 7f2b3f7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2b401546c0 0x7f2b40154b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55982/0 (socket says 172.21.15.133:55982) 2023-12-19T18:59:12.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.356+0000 7f2b3f7fe640 1 -- 172.21.15.133:0/2228118376 learned_addr learned my addr 172.21.15.133:0/2228118376 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:12.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.356+0000 7f2b3ffff640 1 --2- 172.21.15.133:0/2228118376 >> v2:172.21.15.138:3300/0 conn(0x7f2b4006d990 0x7f2b400c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:12.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.356+0000 7f2b3f7fe640 1 -- 172.21.15.133:0/2228118376 >> v2:172.21.15.138:3300/0 conn(0x7f2b4006d990 msgr2=0x7f2b400c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:12.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.356+0000 7f2b3f7fe640 1 --2- 172.21.15.133:0/2228118376 >> v2:172.21.15.138:3300/0 conn(0x7f2b4006d990 0x7f2b400c5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:12.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.356+0000 7f2b3f7fe640 1 -- 172.21.15.133:0/2228118376 >> v1:172.21.15.138:6789/0 conn(0x7f2b4006c070 legacy=0x7f2b4006c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:12.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.356+0000 7f2b3f7fe640 1 -- 172.21.15.133:0/2228118376 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b400c1500 con 0x7f2b401546c0 2023-12-19T18:59:12.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.356+0000 7f2b3ffff640 1 --2- 172.21.15.133:0/2228118376 >> v2:172.21.15.138:3300/0 conn(0x7f2b4006d990 0x7f2b400c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:12.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.356+0000 7f2b3f7fe640 1 --2- 172.21.15.133:0/2228118376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b401546c0 0x7f2b40154b20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2b40066ce0 tx=0x7f2b3401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669e27ff9830ffdc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:12.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.356+0000 7f2b3effd640 1 -- 172.21.15.133:0/2228118376 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b340ac410 con 0x7f2b401546c0 2023-12-19T18:59:12.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.356+0000 7f2b3effd640 1 -- 172.21.15.133:0/2228118376 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b340ac570 con 0x7f2b401546c0 2023-12-19T18:59:12.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.356+0000 7f2b3effd640 1 -- 172.21.15.133:0/2228118376 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b340ac900 con 0x7f2b401546c0 2023-12-19T18:59:12.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b451d0640 1 -- 172.21.15.133:0/2228118376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b401546c0 msgr2=0x7f2b40154b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:12.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b451d0640 1 --2- 172.21.15.133:0/2228118376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b401546c0 0x7f2b40154b20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f2b40066ce0 tx=0x7f2b3401c4c0 comp rx=0 tx=0).stop 2023-12-19T18:59:12.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b451d0640 1 -- 172.21.15.133:0/2228118376 shutdown_connections 2023-12-19T18:59:12.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b451d0640 1 --2- 172.21.15.133:0/2228118376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b401546c0 0x7f2b40154b20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:12.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b451d0640 1 --2- 172.21.15.133:0/2228118376 >> v2:172.21.15.138:3300/0 conn(0x7f2b4006d990 0x7f2b400c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:12.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b451d0640 1 -- 172.21.15.133:0/2228118376 >> 172.21.15.133:0/2228118376 conn(0x7f2b400a7800 msgr2=0x7f2b400a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:12.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b451d0640 1 -- 172.21.15.133:0/2228118376 shutdown_connections 2023-12-19T18:59:12.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b451d0640 1 -- 172.21.15.133:0/2228118376 wait complete. 2023-12-19T18:59:12.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b451d0640 1 Processor -- start 2023-12-19T18:59:12.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b451d0640 1 -- start start 2023-12-19T18:59:12.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b451d0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b4006c070 0x7f2b400bf680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:12.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b451d0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b4006d990 0x7f2b4014c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:12.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b451d0640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2b401546c0 0x7f2b4014cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:12.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b451d0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4014c270 con 0x7f2b4006c070 2023-12-19T18:59:12.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b451d0640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4014c510 con 0x7f2b4006d990 2023-12-19T18:59:12.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b451d0640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b400a8800 con 0x7f2b401546c0 2023-12-19T18:59:12.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b3ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b4006c070 0x7f2b400bf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:12.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b3ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b4006c070 0x7f2b400bf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:55984/0 (socket says 172.21.15.133:55984) 2023-12-19T18:59:12.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b3ffff640 1 -- 172.21.15.133:0/3180716533 learned_addr learned my addr 172.21.15.133:0/3180716533 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:12.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b3f7fe640 1 --2- 172.21.15.133:0/3180716533 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b4006d990 0x7f2b4014c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:12.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b449cf640 1 --2- 172.21.15.133:0/3180716533 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2b401546c0 0x7f2b4014cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:12.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b3ffff640 1 -- 172.21.15.133:0/3180716533 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2b401546c0 msgr2=0x7f2b4014cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:12.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b3ffff640 1 --2- 172.21.15.133:0/3180716533 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2b401546c0 0x7f2b4014cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:12.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b3ffff640 1 -- 172.21.15.133:0/3180716533 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b4006d990 msgr2=0x7f2b4014c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:12.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b3ffff640 1 --2- 172.21.15.133:0/3180716533 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b4006d990 0x7f2b4014c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:12.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b3ffff640 1 -- 172.21.15.133:0/3180716533 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b340094d0 con 0x7f2b4006c070 2023-12-19T18:59:12.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.360+0000 7f2b449cf640 1 --2- 172.21.15.133:0/3180716533 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2b401546c0 0x7f2b4014cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:12.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.364+0000 7f2b3ffff640 1 --2- 172.21.15.133:0/3180716533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b4006c070 0x7f2b400bf680 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000e810 tx=0x7f2b3000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:12.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.364+0000 7f2b3cff9640 1 -- 172.21.15.133:0/3180716533 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3000c8d0 con 0x7f2b4006c070 2023-12-19T18:59:12.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.364+0000 7f2b3cff9640 1 -- 172.21.15.133:0/3180716533 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3000ca30 con 0x7f2b4006c070 2023-12-19T18:59:12.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.364+0000 7f2b3cff9640 1 -- 172.21.15.133:0/3180716533 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3000cdc0 con 0x7f2b4006c070 2023-12-19T18:59:12.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.364+0000 7f2b451d0640 1 -- 172.21.15.133:0/3180716533 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b400a8ae0 con 0x7f2b4006c070 2023-12-19T18:59:12.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.364+0000 7f2b451d0640 1 -- 172.21.15.133:0/3180716533 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b401f0c10 con 0x7f2b4006c070 2023-12-19T18:59:12.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.364+0000 7f2b451d0640 1 -- 172.21.15.133:0/3180716533 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b401f0e00 con 0x7f2b4006c070 2023-12-19T18:59:12.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.364+0000 7f2b3cff9640 1 -- 172.21.15.133:0/3180716533 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2b30013410 con 0x7f2b4006c070 2023-12-19T18:59:12.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.364+0000 7f2b3cff9640 1 --2- 172.21.15.133:0/3180716533 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2b2c066470 0x7f2b2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:12.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.364+0000 7f2b3cff9640 1 -- 172.21.15.133:0/3180716533 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b30083cf0 con 0x7f2b4006c070 2023-12-19T18:59:12.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.368+0000 7f2b3f7fe640 1 --2- 172.21.15.133:0/3180716533 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2b2c066470 0x7f2b2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:12.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.368+0000 7f2b3f7fe640 1 --2- 172.21.15.133:0/3180716533 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2b2c066470 0x7f2b2c068930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2b340ae000 tx=0x7f2b34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:12.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.368+0000 7f2b3cff9640 1 -- 172.21.15.133:0/3180716533 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2b30088070 con 0x7f2b4006c070 2023-12-19T18:59:12.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.520+0000 7f2b451d0640 1 -- 172.21.15.133:0/3180716533 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b4004e850 con 0x7f2b4006c070 2023-12-19T18:59:12.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.520+0000 7f2b3cff9640 1 -- 172.21.15.133:0/3180716533 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f2b30051170 con 0x7f2b4006c070 2023-12-19T18:59:12.525 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:12.525 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:44.402984+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:58:40.991408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T18:58:41.773992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:59:12.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.524+0000 7f2b451d0640 1 -- 172.21.15.133:0/3180716533 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2b2c066470 msgr2=0x7f2b2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:12.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.524+0000 7f2b451d0640 1 --2- 172.21.15.133:0/3180716533 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2b2c066470 0x7f2b2c068930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2b340ae000 tx=0x7f2b34008040 comp rx=0 tx=0).stop 2023-12-19T18:59:12.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.524+0000 7f2b451d0640 1 -- 172.21.15.133:0/3180716533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b4006c070 msgr2=0x7f2b400bf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:12.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.524+0000 7f2b451d0640 1 --2- 172.21.15.133:0/3180716533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b4006c070 0x7f2b400bf680 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2b3000e810 tx=0x7f2b3000ecd0 comp rx=0 tx=0).stop 2023-12-19T18:59:12.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.524+0000 7f2b451d0640 1 -- 172.21.15.133:0/3180716533 shutdown_connections 2023-12-19T18:59:12.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.524+0000 7f2b451d0640 1 --2- 172.21.15.133:0/3180716533 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2b2c066470 0x7f2b2c068930 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:12.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.524+0000 7f2b451d0640 1 --2- 172.21.15.133:0/3180716533 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2b401546c0 0x7f2b4014cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:12.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.524+0000 7f2b451d0640 1 --2- 172.21.15.133:0/3180716533 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2b4006d990 0x7f2b4014c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:12.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.524+0000 7f2b451d0640 1 --2- 172.21.15.133:0/3180716533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2b4006c070 0x7f2b400bf680 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:12.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.524+0000 7f2b451d0640 1 -- 172.21.15.133:0/3180716533 >> 172.21.15.133:0/3180716533 conn(0x7f2b400a7800 msgr2=0x7f2b40071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:12.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.524+0000 7f2b451d0640 1 -- 172.21.15.133:0/3180716533 shutdown_connections 2023-12-19T18:59:12.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.524+0000 7f2b451d0640 1 -- 172.21.15.133:0/3180716533 wait complete. 2023-12-19T18:59:12.546 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:58:40.991408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:58:41.773992+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:59:12.547 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:59:12.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.683+0000 7f71779d1640 1 Processor -- start 2023-12-19T18:59:12.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.683+0000 7f71779d1640 1 -- start start 2023-12-19T18:59:12.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.683+0000 7f71779d1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f71701560e0 0x7f717015ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:12.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.683+0000 7f71779d1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f717006d520 0x7f7170159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:12.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.683+0000 7f71779d1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717015c600 con 0x7f71700bffc0 2023-12-19T18:59:12.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.683+0000 7f71779d1640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71701594e0 con 0x7f717006d520 2023-12-19T18:59:12.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.683+0000 7f71779d1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71701597c0 con 0x7f71701560e0 2023-12-19T18:59:12.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.683+0000 7f7175f6e640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f71700bffc0 0x7f71700c1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59148/0 (socket says 172.21.15.133:59148) 2023-12-19T18:59:12.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.683+0000 7f7175f6e640 1 -- 172.21.15.133:0/4047527121 learned_addr learned my addr 172.21.15.133:0/4047527121 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:12.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.683+0000 7f7174f6c640 1 --2- 172.21.15.133:0/4047527121 >> v2:172.21.15.133:3300/0 conn(0x7f717006d520 0x7f7170159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:12.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.683+0000 7f717576d640 1 --2- 172.21.15.133:0/4047527121 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f71701560e0 0x7f717015ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:12.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.683+0000 7f7163fff640 1 -- 172.21.15.133:0/4047527121 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 757243031 0 0) 0x7f717015c600 con 0x7f71700bffc0 2023-12-19T18:59:12.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.683+0000 7f7163fff640 1 -- 172.21.15.133:0/4047527121 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f715c003530 con 0x7f71700bffc0 2023-12-19T18:59:12.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.687+0000 7f7174f6c640 1 -- 172.21.15.133:0/4047527121 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f71701560e0 msgr2=0x7f717015ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:12.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.687+0000 7f7174f6c640 1 --2- 172.21.15.133:0/4047527121 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f71701560e0 0x7f717015ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:12.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.687+0000 7f7174f6c640 1 -- 172.21.15.133:0/4047527121 >> v1:172.21.15.133:6789/0 conn(0x7f71700bffc0 legacy=0x7f71700c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:12.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.687+0000 7f7163fff640 1 -- 172.21.15.133:0/4047527121 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2081839222 0 0) 0x7f715c003530 con 0x7f71700bffc0 2023-12-19T18:59:12.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.687+0000 7f7174f6c640 1 -- 172.21.15.133:0/4047527121 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717015bfb0 con 0x7f717006d520 2023-12-19T18:59:12.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.687+0000 7f7174f6c640 1 --2- 172.21.15.133:0/4047527121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f717006d520 0x7f7170159eb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f716c0097c0 tx=0x7f716c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44d2d029c5b16f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:12.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.687+0000 7f7163fff640 1 -- 172.21.15.133:0/4047527121 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71701566d0 con 0x7f717006d520 2023-12-19T18:59:12.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.687+0000 7f7163fff640 1 -- 172.21.15.133:0/4047527121 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c0ab670 con 0x7f717006d520 2023-12-19T18:59:12.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.687+0000 7f7163fff640 1 -- 172.21.15.133:0/4047527121 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c0aba00 con 0x7f717006d520 2023-12-19T18:59:12.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.687+0000 7f71779d1640 1 -- 172.21.15.133:0/4047527121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f717006d520 msgr2=0x7f7170159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:12.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.687+0000 7f71779d1640 1 --2- 172.21.15.133:0/4047527121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f717006d520 0x7f7170159eb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f716c0097c0 tx=0x7f716c01c450 comp rx=0 tx=0).stop 2023-12-19T18:59:12.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.687+0000 7f71779d1640 1 -- 172.21.15.133:0/4047527121 shutdown_connections 2023-12-19T18:59:12.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.687+0000 7f71779d1640 1 --2- 172.21.15.133:0/4047527121 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f717006d520 0x7f7170159eb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:12.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.687+0000 7f71779d1640 1 --2- 172.21.15.133:0/4047527121 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f71701560e0 0x7f717015ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:12.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.687+0000 7f71779d1640 1 -- 172.21.15.133:0/4047527121 >> 172.21.15.133:0/4047527121 conn(0x7f717006a5b0 msgr2=0x7f717006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:12.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.687+0000 7f71779d1640 1 -- 172.21.15.133:0/4047527121 shutdown_connections 2023-12-19T18:59:12.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.687+0000 7f71779d1640 1 -- 172.21.15.133:0/4047527121 wait complete. 2023-12-19T18:59:12.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.691+0000 7f71779d1640 1 Processor -- start 2023-12-19T18:59:12.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.691+0000 7f71779d1640 1 -- start start 2023-12-19T18:59:12.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.691+0000 7f71779d1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f717006d520 0x7f717014c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:12.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.691+0000 7f71779d1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71700bffc0 0x7f7170156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:12.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.691+0000 7f71779d1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f71701560e0 0x7f71701f12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:12.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.691+0000 7f71779d1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7170153ea0 con 0x7f71700bffc0 2023-12-19T18:59:12.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.691+0000 7f71779d1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7170154440 con 0x7f71701560e0 2023-12-19T18:59:12.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.691+0000 7f71779d1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7170153c00 con 0x7f717006d520 2023-12-19T18:59:12.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.691+0000 7f7174f6c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71700bffc0 0x7f7170156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:12.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.691+0000 7f7174f6c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71700bffc0 0x7f7170156e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56002/0 (socket says 172.21.15.133:56002) 2023-12-19T18:59:12.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.691+0000 7f7174f6c640 1 -- 172.21.15.133:0/2164017271 learned_addr learned my addr 172.21.15.133:0/2164017271 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:12.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.691+0000 7f7175f6e640 1 --2- 172.21.15.133:0/2164017271 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f71701560e0 0x7f71701f12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:12.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.691+0000 7f717576d640 1 --2- 172.21.15.133:0/2164017271 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f717006d520 0x7f717014c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:12.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.691+0000 7f7174f6c640 1 -- 172.21.15.133:0/2164017271 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f717006d520 msgr2=0x7f717014c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:12.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.691+0000 7f7174f6c640 1 --2- 172.21.15.133:0/2164017271 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f717006d520 0x7f717014c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:12.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.691+0000 7f7174f6c640 1 -- 172.21.15.133:0/2164017271 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f71701560e0 msgr2=0x7f71701f12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:12.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.691+0000 7f7174f6c640 1 --2- 172.21.15.133:0/2164017271 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f71701560e0 0x7f71701f12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:12.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.691+0000 7f7174f6c640 1 -- 172.21.15.133:0/2164017271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c009420 con 0x7f71700bffc0 2023-12-19T18:59:12.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.691+0000 7f7174f6c640 1 --2- 172.21.15.133:0/2164017271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71700bffc0 0x7f7170156e50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f716c0ad040 tx=0x7f716c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:12.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.691+0000 7f7161ffb640 1 -- 172.21.15.133:0/2164017271 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c0b5610 con 0x7f71700bffc0 2023-12-19T18:59:12.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.691+0000 7f7161ffb640 1 -- 172.21.15.133:0/2164017271 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c0b57b0 con 0x7f71700bffc0 2023-12-19T18:59:12.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.691+0000 7f7161ffb640 1 -- 172.21.15.133:0/2164017271 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c0b5b60 con 0x7f71700bffc0 2023-12-19T18:59:12.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.691+0000 7f71779d1640 1 -- 172.21.15.133:0/2164017271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71701f49f0 con 0x7f71700bffc0 2023-12-19T18:59:12.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.695+0000 7f71779d1640 1 -- 172.21.15.133:0/2164017271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71701f4fb0 con 0x7f71700bffc0 2023-12-19T18:59:12.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.695+0000 7f71779d1640 1 -- 172.21.15.133:0/2164017271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71701f4850 con 0x7f71700bffc0 2023-12-19T18:59:12.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.695+0000 7f7161ffb640 1 -- 172.21.15.133:0/2164017271 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f716c0b5cc0 con 0x7f71700bffc0 2023-12-19T18:59:12.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.695+0000 7f7161ffb640 1 --2- 172.21.15.133:0/2164017271 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7154066470 0x7f7154068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:12.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.695+0000 7f7161ffb640 1 -- 172.21.15.133:0/2164017271 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f716c11e710 con 0x7f71700bffc0 2023-12-19T18:59:12.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.695+0000 7f717576d640 1 --2- 172.21.15.133:0/2164017271 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7154066470 0x7f7154068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:12.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.695+0000 7f717576d640 1 --2- 172.21.15.133:0/2164017271 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7154066470 0x7f7154068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7164009ac0 tx=0x7f7164009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:12.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.699+0000 7f7161ffb640 1 -- 172.21.15.133:0/2164017271 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f71701f4850 con 0x7f71700bffc0 2023-12-19T18:59:12.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.847+0000 7f71779d1640 1 -- 172.21.15.133:0/2164017271 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f71701f4850 con 0x7f71700bffc0 2023-12-19T18:59:12.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.847+0000 7f7161ffb640 1 -- 172.21.15.133:0/2164017271 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f71701f4850 con 0x7f71700bffc0 2023-12-19T18:59:12.854 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T18:59:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.851+0000 7f71779d1640 1 -- 172.21.15.133:0/2164017271 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7154066470 msgr2=0x7f7154068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.851+0000 7f71779d1640 1 --2- 172.21.15.133:0/2164017271 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7154066470 0x7f7154068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7164009ac0 tx=0x7f7164009190 comp rx=0 tx=0).stop 2023-12-19T18:59:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.851+0000 7f71779d1640 1 -- 172.21.15.133:0/2164017271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71700bffc0 msgr2=0x7f7170156e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.851+0000 7f71779d1640 1 --2- 172.21.15.133:0/2164017271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71700bffc0 0x7f7170156e50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f716c0ad040 tx=0x7f716c01ac90 comp rx=0 tx=0).stop 2023-12-19T18:59:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.851+0000 7f71779d1640 1 -- 172.21.15.133:0/2164017271 shutdown_connections 2023-12-19T18:59:12.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.851+0000 7f71779d1640 1 --2- 172.21.15.133:0/2164017271 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7154066470 0x7f7154068930 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:12.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.851+0000 7f71779d1640 1 --2- 172.21.15.133:0/2164017271 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f71701560e0 0x7f71701f12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:12.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.851+0000 7f71779d1640 1 --2- 172.21.15.133:0/2164017271 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71700bffc0 0x7f7170156e50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:12.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.851+0000 7f71779d1640 1 --2- 172.21.15.133:0/2164017271 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f717006d520 0x7f717014c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:12.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.851+0000 7f71779d1640 1 -- 172.21.15.133:0/2164017271 >> 172.21.15.133:0/2164017271 conn(0x7f717006a5b0 msgr2=0x7f7170072680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:12.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.851+0000 7f71779d1640 1 -- 172.21.15.133:0/2164017271 shutdown_connections 2023-12-19T18:59:12.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:12.851+0000 7f71779d1640 1 -- 172.21.15.133:0/2164017271 wait complete. 2023-12-19T18:59:12.875 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:59:13.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.007+0000 7f120b9f5640 1 Processor -- start 2023-12-19T18:59:13.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f120b9f5640 1 -- start start 2023-12-19T18:59:13.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f120b9f5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f12040c5640 0x7f12040c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:13.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f120b9f5640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12040c2580 con 0x7f12040c5260 2023-12-19T18:59:13.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f120b9f5640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12040c1a00 con 0x7f12040c60f0 2023-12-19T18:59:13.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f120b9f5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1204153510 con 0x7f12040c5640 2023-12-19T18:59:13.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f1209791640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f12040c5260 0x7f120406d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59156/0 (socket says 172.21.15.133:59156) 2023-12-19T18:59:13.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f1209791640 1 -- 172.21.15.133:0/2576066837 learned_addr learned my addr 172.21.15.133:0/2576066837 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:13.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f1208f90640 1 --2- 172.21.15.133:0/2576066837 >> v2:172.21.15.138:3300/0 conn(0x7f12040c5640 0x7f12040c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:13.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f11fbfff640 1 -- 172.21.15.133:0/2576066837 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416284318 0 0) 0x7f12040c2580 con 0x7f12040c5260 2023-12-19T18:59:13.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f11fbfff640 1 -- 172.21.15.133:0/2576066837 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11f0003530 con 0x7f12040c5260 2023-12-19T18:59:13.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f11fbfff640 1 -- 172.21.15.133:0/2576066837 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2771604959 0 0) 0x7f11f0003530 con 0x7f12040c5260 2023-12-19T18:59:13.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f11fbfff640 1 -- 172.21.15.133:0/2576066837 >> v2:172.21.15.138:3300/0 conn(0x7f12040c5640 msgr2=0x7f12040c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:13.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f11fbfff640 1 --2- 172.21.15.133:0/2576066837 >> v2:172.21.15.138:3300/0 conn(0x7f12040c5640 0x7f12040c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f11fbfff640 1 -- 172.21.15.133:0/2576066837 >> v1:172.21.15.138:6789/0 conn(0x7f12040c60f0 legacy=0x7f1204155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:13.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f11fbfff640 1 -- 172.21.15.133:0/2576066837 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12040c1ce0 con 0x7f12040c5260 2023-12-19T18:59:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f11fbfff640 1 -- 172.21.15.133:0/2576066837 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f1200001680 con 0x7f12040c5260 2023-12-19T18:59:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f11fbfff640 1 -- 172.21.15.133:0/2576066837 >> v1:172.21.15.133:6789/0 conn(0x7f12040c5260 legacy=0x7f120406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f11fbfff640 1 --2- 172.21.15.133:0/2576066837 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11f0003980 0x7f11f0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f11fbfff640 1 --2- 172.21.15.133:0/2576066837 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11f00047d0 0x7f11f0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f11fbfff640 1 --2- 172.21.15.133:0/2576066837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11f0005190 0x7f11f000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f11fbfff640 1 -- 172.21.15.133:0/2576066837 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f000c100 con 0x7f11f0005190 2023-12-19T18:59:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f11fbfff640 1 -- 172.21.15.133:0/2576066837 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f000c270 con 0x7f11f0003980 2023-12-19T18:59:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f11fbfff640 1 -- 172.21.15.133:0/2576066837 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f000c430 con 0x7f11f00047d0 2023-12-19T18:59:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f1209791640 1 --2- 172.21.15.133:0/2576066837 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11f0003980 0x7f11f0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f1209f92640 1 --2- 172.21.15.133:0/2576066837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11f0005190 0x7f11f000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f1208f90640 1 --2- 172.21.15.133:0/2576066837 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11f00047d0 0x7f11f0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f1209791640 1 -- 172.21.15.133:0/2576066837 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11f00047d0 msgr2=0x7f11f0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f1209791640 1 --2- 172.21.15.133:0/2576066837 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11f00047d0 0x7f11f0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f1209791640 1 -- 172.21.15.133:0/2576066837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11f0005190 msgr2=0x7f11f000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:13.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f1209791640 1 --2- 172.21.15.133:0/2576066837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11f0005190 0x7f11f000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f1209791640 1 -- 172.21.15.133:0/2576066837 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f0003530 con 0x7f11f0003980 2023-12-19T18:59:13.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f1209f92640 1 --2- 172.21.15.133:0/2576066837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11f0005190 0x7f11f000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:59:13.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.011+0000 7f1209f92640 1 -- 172.21.15.133:0/2576066837 reap_dead start 2023-12-19T18:59:13.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.015+0000 7f1209791640 1 --2- 172.21.15.133:0/2576066837 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11f0003980 0x7f11f0003da0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f120000c1c0 tx=0x7f120001f390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc41eaf0c64a5d06 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.015+0000 7f11fbfff640 1 -- 172.21.15.133:0/2576066837 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200005ae0 con 0x7f11f0003980 2023-12-19T18:59:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.015+0000 7f11fbfff640 1 -- 172.21.15.133:0/2576066837 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12000ab070 con 0x7f11f0003980 2023-12-19T18:59:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.015+0000 7f11fbfff640 1 -- 172.21.15.133:0/2576066837 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200007070 con 0x7f11f0003980 2023-12-19T18:59:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.015+0000 7f120b9f5640 1 -- 172.21.15.133:0/2576066837 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11f0003980 msgr2=0x7f11f0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.015+0000 7f120b9f5640 1 --2- 172.21.15.133:0/2576066837 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11f0003980 0x7f11f0003da0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f120000c1c0 tx=0x7f120001f390 comp rx=0 tx=0).stop 2023-12-19T18:59:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.015+0000 7f120b9f5640 1 -- 172.21.15.133:0/2576066837 shutdown_connections 2023-12-19T18:59:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.015+0000 7f120b9f5640 1 --2- 172.21.15.133:0/2576066837 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11f0003980 0x7f11f0003da0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.015+0000 7f120b9f5640 1 -- 172.21.15.133:0/2576066837 >> 172.21.15.133:0/2576066837 conn(0x7f120406a5b0 msgr2=0x7f120406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.015+0000 7f120b9f5640 1 -- 172.21.15.133:0/2576066837 shutdown_connections 2023-12-19T18:59:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.015+0000 7f120b9f5640 1 -- 172.21.15.133:0/2576066837 wait complete. 2023-12-19T18:59:13.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f120b9f5640 1 Processor -- start 2023-12-19T18:59:13.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f120b9f5640 1 -- start start 2023-12-19T18:59:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f120b9f5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11f0003980 0x7f12040bfb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f120b9f5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12041541f0 0x7f12041e9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f120b9f5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12041535c0 0x7f12041ea300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f120b9f5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12041e9930 con 0x7f12041535c0 2023-12-19T18:59:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f120b9f5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12041554c0 con 0x7f11f0003980 2023-12-19T18:59:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f120b9f5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12041ed930 con 0x7f12041541f0 2023-12-19T18:59:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f1209f92640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12041535c0 0x7f12041ea300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f1209f92640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12041535c0 0x7f12041ea300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56014/0 (socket says 172.21.15.133:56014) 2023-12-19T18:59:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f1209f92640 1 -- 172.21.15.133:0/71393765 learned_addr learned my addr 172.21.15.133:0/71393765 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f1209791640 1 --2- 172.21.15.133:0/71393765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11f0003980 0x7f12040bfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f1208f90640 1 --2- 172.21.15.133:0/71393765 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12041541f0 0x7f12041e9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f1209f92640 1 -- 172.21.15.133:0/71393765 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12041541f0 msgr2=0x7f12041e9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f1209f92640 1 --2- 172.21.15.133:0/71393765 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12041541f0 0x7f12041e9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f1209f92640 1 -- 172.21.15.133:0/71393765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11f0003980 msgr2=0x7f12040bfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:13.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f1209f92640 1 --2- 172.21.15.133:0/71393765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11f0003980 0x7f12040bfb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f1209f92640 1 -- 172.21.15.133:0/71393765 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12040c0060 con 0x7f12041535c0 2023-12-19T18:59:13.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f1209f92640 1 --2- 172.21.15.133:0/71393765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12041535c0 0x7f12041ea300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f12040c68d0 tx=0x7f11fc00feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:13.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f11f9ffb640 1 -- 172.21.15.133:0/71393765 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc006d70 con 0x7f12041535c0 2023-12-19T18:59:13.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f11f9ffb640 1 -- 172.21.15.133:0/71393765 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11fc003980 con 0x7f12041535c0 2023-12-19T18:59:13.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f120b9f5640 1 -- 172.21.15.133:0/71393765 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12041548b0 con 0x7f12041535c0 2023-12-19T18:59:13.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f11f9ffb640 1 -- 172.21.15.133:0/71393765 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc003d30 con 0x7f12041535c0 2023-12-19T18:59:13.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.019+0000 7f120b9f5640 1 -- 172.21.15.133:0/71393765 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12041edc10 con 0x7f12041535c0 2023-12-19T18:59:13.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.023+0000 7f120b9f5640 1 -- 172.21.15.133:0/71393765 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12041ed790 con 0x7f12041535c0 2023-12-19T18:59:13.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.023+0000 7f11f9ffb640 1 -- 172.21.15.133:0/71393765 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f11fc005070 con 0x7f12041535c0 2023-12-19T18:59:13.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.023+0000 7f11f9ffb640 1 --2- 172.21.15.133:0/71393765 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f11e8066470 0x7f11e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:13.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.023+0000 7f11f9ffb640 1 -- 172.21.15.133:0/71393765 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f11fc083470 con 0x7f12041535c0 2023-12-19T18:59:13.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.023+0000 7f1209791640 1 --2- 172.21.15.133:0/71393765 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f11e8066470 0x7f11e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:13.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.023+0000 7f1209791640 1 --2- 172.21.15.133:0/71393765 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f11e8066470 0x7f11e8068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f12000af000 tx=0x7f12000aa000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:13.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.027+0000 7f11f9ffb640 1 -- 172.21.15.133:0/71393765 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f12041ed790 con 0x7f12041535c0 2023-12-19T18:59:13.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.175+0000 7f120b9f5640 1 -- 172.21.15.133:0/71393765 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f12041e9ae0 con 0x7f12041535c0 2023-12-19T18:59:13.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.175+0000 7f11f9ffb640 1 -- 172.21.15.133:0/71393765 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f12041e9ae0 con 0x7f12041535c0 2023-12-19T18:59:13.182 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T18:59:13.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.179+0000 7f120b9f5640 1 -- 172.21.15.133:0/71393765 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f11e8066470 msgr2=0x7f11e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:13.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.179+0000 7f120b9f5640 1 --2- 172.21.15.133:0/71393765 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f11e8066470 0x7f11e8068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f12000af000 tx=0x7f12000aa000 comp rx=0 tx=0).stop 2023-12-19T18:59:13.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.179+0000 7f120b9f5640 1 -- 172.21.15.133:0/71393765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12041535c0 msgr2=0x7f12041ea300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:13.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.179+0000 7f120b9f5640 1 --2- 172.21.15.133:0/71393765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12041535c0 0x7f12041ea300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f12040c68d0 tx=0x7f11fc00feb0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.179+0000 7f120b9f5640 1 -- 172.21.15.133:0/71393765 shutdown_connections 2023-12-19T18:59:13.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.179+0000 7f120b9f5640 1 --2- 172.21.15.133:0/71393765 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f11e8066470 0x7f11e8068930 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.179+0000 7f120b9f5640 1 --2- 172.21.15.133:0/71393765 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f12041535c0 0x7f12041ea300 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.179+0000 7f120b9f5640 1 --2- 172.21.15.133:0/71393765 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12041541f0 0x7f12041e9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.179+0000 7f120b9f5640 1 --2- 172.21.15.133:0/71393765 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11f0003980 0x7f12040bfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.179+0000 7f120b9f5640 1 -- 172.21.15.133:0/71393765 >> 172.21.15.133:0/71393765 conn(0x7f120406a5b0 msgr2=0x7f12040a79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:13.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.179+0000 7f120b9f5640 1 -- 172.21.15.133:0/71393765 shutdown_connections 2023-12-19T18:59:13.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.179+0000 7f120b9f5640 1 -- 172.21.15.133:0/71393765 wait complete. 2023-12-19T18:59:13.203 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:59:13.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.339+0000 7f982f365640 1 Processor -- start 2023-12-19T18:59:13.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.339+0000 7f982f365640 1 -- start start 2023-12-19T18:59:13.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.339+0000 7f982f365640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f98280c5640 0x7f98280c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:13.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.339+0000 7f982f365640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98280c60f0 0x7f9828155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:13.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.339+0000 7f982f365640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98280c2580 con 0x7f98280c5260 2023-12-19T18:59:13.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.339+0000 7f982f365640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9828153510 con 0x7f98280c5640 2023-12-19T18:59:13.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.339+0000 7f982f365640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98280c17f0 con 0x7f98280c60f0 2023-12-19T18:59:13.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.339+0000 7f982d101640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f98280c5260 0x7f982806d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59172/0 (socket says 172.21.15.133:59172) 2023-12-19T18:59:13.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.339+0000 7f982d101640 1 -- 172.21.15.133:0/3366838794 learned_addr learned my addr 172.21.15.133:0/3366838794 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:13.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.339+0000 7f982c900640 1 --2- 172.21.15.133:0/3366838794 >> v2:172.21.15.138:3300/0 conn(0x7f98280c5640 0x7f98280c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:13.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.339+0000 7f982d902640 1 --2- 172.21.15.133:0/3366838794 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98280c60f0 0x7f9828155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:13.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.339+0000 7f981ffff640 1 -- 172.21.15.133:0/3366838794 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2522756200 0 0) 0x7f98280c2580 con 0x7f98280c5260 2023-12-19T18:59:13.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.339+0000 7f981ffff640 1 -- 172.21.15.133:0/3366838794 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9814003530 con 0x7f98280c5260 2023-12-19T18:59:13.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.339+0000 7f982c900640 1 -- 172.21.15.133:0/3366838794 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98280c60f0 msgr2=0x7f9828155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:13.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.339+0000 7f982c900640 1 --2- 172.21.15.133:0/3366838794 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98280c60f0 0x7f9828155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.339+0000 7f982c900640 1 -- 172.21.15.133:0/3366838794 >> v1:172.21.15.133:6789/0 conn(0x7f98280c5260 legacy=0x7f982806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:13.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.339+0000 7f981ffff640 1 -- 172.21.15.133:0/3366838794 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 606014230 0 0) 0x7f9814003530 con 0x7f98280c5260 2023-12-19T18:59:13.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.339+0000 7f982c900640 1 -- 172.21.15.133:0/3366838794 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98280c1a00 con 0x7f98280c5640 2023-12-19T18:59:13.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.343+0000 7f982c900640 1 --2- 172.21.15.133:0/3366838794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98280c5640 0x7f98280c5bb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f98280c1930 tx=0x7f981801c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c2ef60b5d7b22d68 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:13.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.343+0000 7f981ffff640 1 -- 172.21.15.133:0/3366838794 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9824001680 con 0x7f98280c5640 2023-12-19T18:59:13.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.343+0000 7f981ffff640 1 -- 172.21.15.133:0/3366838794 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98180a7050 con 0x7f98280c5640 2023-12-19T18:59:13.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.343+0000 7f981ffff640 1 -- 172.21.15.133:0/3366838794 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98180ab620 con 0x7f98280c5640 2023-12-19T18:59:13.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.343+0000 7f982f365640 1 -- 172.21.15.133:0/3366838794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98280c5640 msgr2=0x7f98280c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:13.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.343+0000 7f982f365640 1 --2- 172.21.15.133:0/3366838794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98280c5640 0x7f98280c5bb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f98280c1930 tx=0x7f981801c2e0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.343+0000 7f982f365640 1 -- 172.21.15.133:0/3366838794 shutdown_connections 2023-12-19T18:59:13.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.343+0000 7f982f365640 1 --2- 172.21.15.133:0/3366838794 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98280c60f0 0x7f9828155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.343+0000 7f982f365640 1 --2- 172.21.15.133:0/3366838794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98280c5640 0x7f98280c5bb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.343+0000 7f982f365640 1 -- 172.21.15.133:0/3366838794 >> 172.21.15.133:0/3366838794 conn(0x7f982806a5b0 msgr2=0x7f982806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:13.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.343+0000 7f982f365640 1 -- 172.21.15.133:0/3366838794 shutdown_connections 2023-12-19T18:59:13.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.343+0000 7f982f365640 1 -- 172.21.15.133:0/3366838794 wait complete. 2023-12-19T18:59:13.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f982f365640 1 Processor -- start 2023-12-19T18:59:13.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f982f365640 1 -- start start 2023-12-19T18:59:13.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f982f365640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98280c5260 0x7f98280c2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:13.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f982f365640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98280c5640 0x7f98281ed4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:13.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f982f365640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98280c60f0 0x7f98281eda20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:13.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f982f365640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98281edf60 con 0x7f98280c5260 2023-12-19T18:59:13.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f982f365640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98281f13f0 con 0x7f98280c5640 2023-12-19T18:59:13.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f982f365640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98281ecfe0 con 0x7f98280c60f0 2023-12-19T18:59:13.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f982d101640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98280c5260 0x7f98280c2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:13.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f982d101640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98280c5260 0x7f98280c2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56028/0 (socket says 172.21.15.133:56028) 2023-12-19T18:59:13.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f982d101640 1 -- 172.21.15.133:0/3118771478 learned_addr learned my addr 172.21.15.133:0/3118771478 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:13.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f982d902640 1 --2- 172.21.15.133:0/3118771478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98280c60f0 0x7f98281eda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:13.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f982c900640 1 --2- 172.21.15.133:0/3118771478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98280c5640 0x7f98281ed4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:13.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f982d101640 1 -- 172.21.15.133:0/3118771478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98280c60f0 msgr2=0x7f98281eda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f982d101640 1 --2- 172.21.15.133:0/3118771478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98280c60f0 0x7f98281eda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f982d101640 1 -- 172.21.15.133:0/3118771478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98280c5640 msgr2=0x7f98281ed4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f982d101640 1 --2- 172.21.15.133:0/3118771478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98280c5640 0x7f98281ed4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f982d101640 1 -- 172.21.15.133:0/3118771478 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9818009420 con 0x7f98280c5260 2023-12-19T18:59:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f982c900640 1 --2- 172.21.15.133:0/3118771478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98280c5640 0x7f98281ed4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f982d101640 1 --2- 172.21.15.133:0/3118771478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98280c5260 0x7f98280c2ce0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f982400c750 tx=0x7f982400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f981dffb640 1 -- 172.21.15.133:0/3118771478 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9824005ae0 con 0x7f98280c5260 2023-12-19T18:59:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f981dffb640 1 -- 172.21.15.133:0/3118771478 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9824005c40 con 0x7f98280c5260 2023-12-19T18:59:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f981dffb640 1 -- 172.21.15.133:0/3118771478 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9824007070 con 0x7f98280c5260 2023-12-19T18:59:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f982f365640 1 -- 172.21.15.133:0/3118771478 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98280a9fa0 con 0x7f98280c5260 2023-12-19T18:59:13.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f982f365640 1 -- 172.21.15.133:0/3118771478 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98280aa560 con 0x7f98280c5260 2023-12-19T18:59:13.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.347+0000 7f982f365640 1 -- 172.21.15.133:0/3118771478 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98280c0440 con 0x7f98280c5260 2023-12-19T18:59:13.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.351+0000 7f981dffb640 1 -- 172.21.15.133:0/3118771478 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f98240071f0 con 0x7f98280c5260 2023-12-19T18:59:13.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.351+0000 7f981dffb640 1 --2- 172.21.15.133:0/3118771478 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f980c066470 0x7f980c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:13.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.351+0000 7f981dffb640 1 -- 172.21.15.133:0/3118771478 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9824083cd0 con 0x7f98280c5260 2023-12-19T18:59:13.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.351+0000 7f982c900640 1 --2- 172.21.15.133:0/3118771478 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f980c066470 0x7f980c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:13.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.351+0000 7f982c900640 1 --2- 172.21.15.133:0/3118771478 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f980c066470 0x7f980c068930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f98180ad000 tx=0x7f9818008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:13.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.355+0000 7f981dffb640 1 -- 172.21.15.133:0/3118771478 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9824051140 con 0x7f98280c5260 2023-12-19T18:59:13.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.503+0000 7f982f365640 1 -- 172.21.15.133:0/3118771478 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f98281ed1a0 con 0x7f98280c5260 2023-12-19T18:59:13.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.503+0000 7f981dffb640 1 -- 172.21.15.133:0/3118771478 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9824054760 con 0x7f98280c5260 2023-12-19T18:59:13.508 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T18:59:13.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.503+0000 7f982f365640 1 -- 172.21.15.133:0/3118771478 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f980c066470 msgr2=0x7f980c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:13.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.503+0000 7f982f365640 1 --2- 172.21.15.133:0/3118771478 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f980c066470 0x7f980c068930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f98180ad000 tx=0x7f9818008040 comp rx=0 tx=0).stop 2023-12-19T18:59:13.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.503+0000 7f982f365640 1 -- 172.21.15.133:0/3118771478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98280c5260 msgr2=0x7f98280c2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:13.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.503+0000 7f982f365640 1 --2- 172.21.15.133:0/3118771478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98280c5260 0x7f98280c2ce0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f982400c750 tx=0x7f982400cc10 comp rx=0 tx=0).stop 2023-12-19T18:59:13.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.503+0000 7f982f365640 1 -- 172.21.15.133:0/3118771478 shutdown_connections 2023-12-19T18:59:13.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.503+0000 7f982f365640 1 --2- 172.21.15.133:0/3118771478 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f980c066470 0x7f980c068930 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.503+0000 7f982f365640 1 --2- 172.21.15.133:0/3118771478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98280c60f0 0x7f98281eda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.503+0000 7f982f365640 1 --2- 172.21.15.133:0/3118771478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98280c5640 0x7f98281ed4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.503+0000 7f982f365640 1 --2- 172.21.15.133:0/3118771478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98280c5260 0x7f98280c2ce0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.503+0000 7f982f365640 1 -- 172.21.15.133:0/3118771478 >> 172.21.15.133:0/3118771478 conn(0x7f982806a5b0 msgr2=0x7f98280a7120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:13.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.503+0000 7f982f365640 1 -- 172.21.15.133:0/3118771478 shutdown_connections 2023-12-19T18:59:13.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.503+0000 7f982f365640 1 -- 172.21.15.133:0/3118771478 wait complete. 2023-12-19T18:59:13.529 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T18:59:13.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.663+0000 7ff4e7c9a640 1 Processor -- start 2023-12-19T18:59:13.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.663+0000 7ff4e7c9a640 1 -- start start 2023-12-19T18:59:13.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.663+0000 7ff4e7c9a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff4e00a6c60 0x7ff4e00c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:13.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.663+0000 7ff4e7c9a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4e00c2840 0x7ff4e00c17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:13.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.663+0000 7ff4e7c9a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4e0157cd0 con 0x7ff4e01578f0 2023-12-19T18:59:13.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.663+0000 7ff4e7c9a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e00c2e00 con 0x7ff4e00a6c60 2023-12-19T18:59:13.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.663+0000 7ff4e7c9a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e0158850 con 0x7ff4e00c2840 2023-12-19T18:59:13.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.663+0000 7ff4e5235640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff4e00a6c60 0x7ff4e00c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:13.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.663+0000 7ff4e5a36640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff4e01578f0 0x7ff4e00c30e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59174/0 (socket says 172.21.15.133:59174) 2023-12-19T18:59:13.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.663+0000 7ff4e5a36640 1 -- 172.21.15.133:0/1902787802 learned_addr learned my addr 172.21.15.133:0/1902787802 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:13.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.663+0000 7ff4e6237640 1 --2- 172.21.15.133:0/1902787802 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4e00c2840 0x7ff4e00c17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:13.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.663+0000 7ff4e5235640 1 -- 172.21.15.133:0/1902787802 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4e00c2840 msgr2=0x7ff4e00c17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:13.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.663+0000 7ff4e5235640 1 --2- 172.21.15.133:0/1902787802 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4e00c2840 0x7ff4e00c17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.663+0000 7ff4e5235640 1 -- 172.21.15.133:0/1902787802 >> v1:172.21.15.133:6789/0 conn(0x7ff4e01578f0 legacy=0x7ff4e00c30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:13.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.663+0000 7ff4e5235640 1 -- 172.21.15.133:0/1902787802 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e0157f20 con 0x7ff4e00a6c60 2023-12-19T18:59:13.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.667+0000 7ff4e5235640 1 --2- 172.21.15.133:0/1902787802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4e00a6c60 0x7ff4e00c1270 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00097c0 tx=0x7ff4d001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24972447eb6c8f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:13.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.667+0000 7ff4e4a34640 1 -- 172.21.15.133:0/1902787802 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d00ab600 con 0x7ff4e00a6c60 2023-12-19T18:59:13.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.667+0000 7ff4e4a34640 1 -- 172.21.15.133:0/1902787802 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d00a7050 con 0x7ff4e00a6c60 2023-12-19T18:59:13.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.667+0000 7ff4e4a34640 1 -- 172.21.15.133:0/1902787802 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d00ab980 con 0x7ff4e00a6c60 2023-12-19T18:59:13.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.667+0000 7ff4e7c9a640 1 -- 172.21.15.133:0/1902787802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4e00a6c60 msgr2=0x7ff4e00c1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:13.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.667+0000 7ff4e7c9a640 1 --2- 172.21.15.133:0/1902787802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4e00a6c60 0x7ff4e00c1270 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff4d00097c0 tx=0x7ff4d001c3f0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.667+0000 7ff4e7c9a640 1 -- 172.21.15.133:0/1902787802 shutdown_connections 2023-12-19T18:59:13.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.667+0000 7ff4e7c9a640 1 --2- 172.21.15.133:0/1902787802 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4e00c2840 0x7ff4e00c17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.667+0000 7ff4e7c9a640 1 --2- 172.21.15.133:0/1902787802 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4e00a6c60 0x7ff4e00c1270 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.667+0000 7ff4e7c9a640 1 -- 172.21.15.133:0/1902787802 >> 172.21.15.133:0/1902787802 conn(0x7ff4e00c7e40 msgr2=0x7ff4e00c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:13.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4e7c9a640 1 -- 172.21.15.133:0/1902787802 shutdown_connections 2023-12-19T18:59:13.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4e7c9a640 1 -- 172.21.15.133:0/1902787802 wait complete. 2023-12-19T18:59:13.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4e7c9a640 1 Processor -- start 2023-12-19T18:59:13.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4e7c9a640 1 -- start start 2023-12-19T18:59:13.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4e7c9a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4e00a6c60 0x7ff4e01f0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:13.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4e7c9a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4e00c2840 0x7ff4e00ac740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:13.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4e7c9a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4e01578f0 0x7ff4e00acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:13.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4e7c9a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e0151280 con 0x7ff4e01578f0 2023-12-19T18:59:13.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4e7c9a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e0151560 con 0x7ff4e00a6c60 2023-12-19T18:59:13.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4e7c9a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e00ad1c0 con 0x7ff4e00c2840 2023-12-19T18:59:13.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4e6237640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4e01578f0 0x7ff4e00acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:13.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4e6237640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4e01578f0 0x7ff4e00acc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56056/0 (socket says 172.21.15.133:56056) 2023-12-19T18:59:13.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4e6237640 1 -- 172.21.15.133:0/1332544922 learned_addr learned my addr 172.21.15.133:0/1332544922 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:13.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4e5235640 1 --2- 172.21.15.133:0/1332544922 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4e00c2840 0x7ff4e00ac740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:13.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4e5a36640 1 --2- 172.21.15.133:0/1332544922 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4e00a6c60 0x7ff4e01f0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:13.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4e6237640 1 -- 172.21.15.133:0/1332544922 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4e00c2840 msgr2=0x7ff4e00ac740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:13.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4e6237640 1 --2- 172.21.15.133:0/1332544922 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4e00c2840 0x7ff4e00ac740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4e6237640 1 -- 172.21.15.133:0/1332544922 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4e00a6c60 msgr2=0x7ff4e01f0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:13.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4e6237640 1 --2- 172.21.15.133:0/1332544922 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4e00a6c60 0x7ff4e01f0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4e6237640 1 -- 172.21.15.133:0/1332544922 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d0009420 con 0x7ff4e01578f0 2023-12-19T18:59:13.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4e5a36640 1 --2- 172.21.15.133:0/1332544922 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4e00a6c60 0x7ff4e01f0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:13.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4e6237640 1 --2- 172.21.15.133:0/1332544922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4e01578f0 0x7ff4e00acc80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8007e70 tx=0x7ff4d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:13.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4d67fc640 1 -- 172.21.15.133:0/1332544922 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8014620 con 0x7ff4e01578f0 2023-12-19T18:59:13.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4d67fc640 1 -- 172.21.15.133:0/1332544922 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d80147a0 con 0x7ff4e01578f0 2023-12-19T18:59:13.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4d67fc640 1 -- 172.21.15.133:0/1332544922 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d8014b50 con 0x7ff4e01578f0 2023-12-19T18:59:13.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.671+0000 7ff4e7c9a640 1 -- 172.21.15.133:0/1332544922 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e0154860 con 0x7ff4e01578f0 2023-12-19T18:59:13.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.675+0000 7ff4e7c9a640 1 -- 172.21.15.133:0/1332544922 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e01501e0 con 0x7ff4e01578f0 2023-12-19T18:59:13.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.675+0000 7ff4e7c9a640 1 -- 172.21.15.133:0/1332544922 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e00c7c10 con 0x7ff4e01578f0 2023-12-19T18:59:13.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.675+0000 7ff4d67fc640 1 -- 172.21.15.133:0/1332544922 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff4d8014cb0 con 0x7ff4e01578f0 2023-12-19T18:59:13.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.675+0000 7ff4d67fc640 1 --2- 172.21.15.133:0/1332544922 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff4c4066470 0x7ff4c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:13.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.675+0000 7ff4d67fc640 1 -- 172.21.15.133:0/1332544922 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4d80847d0 con 0x7ff4e01578f0 2023-12-19T18:59:13.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.675+0000 7ff4e5a36640 1 --2- 172.21.15.133:0/1332544922 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff4c4066470 0x7ff4c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:13.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.675+0000 7ff4e5a36640 1 --2- 172.21.15.133:0/1332544922 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff4c4066470 0x7ff4c4068930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc005890 tx=0x7ff4dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:13.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.679+0000 7ff4d67fc640 1 -- 172.21.15.133:0/1332544922 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff4d8051c40 con 0x7ff4e01578f0 2023-12-19T18:59:13.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.839+0000 7ff4e7c9a640 1 -- 172.21.15.133:0/1332544922 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff4e0068400 con 0x7ff4e01578f0 2023-12-19T18:59:13.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.839+0000 7ff4d67fc640 1 -- 172.21.15.133:0/1332544922 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff4d8055260 con 0x7ff4e01578f0 2023-12-19T18:59:13.845 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-19T18:59:13.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.843+0000 7ff4e7c9a640 1 -- 172.21.15.133:0/1332544922 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff4c4066470 msgr2=0x7ff4c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:13.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.843+0000 7ff4e7c9a640 1 --2- 172.21.15.133:0/1332544922 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff4c4066470 0x7ff4c4068930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc005890 tx=0x7ff4dc009040 comp rx=0 tx=0).stop 2023-12-19T18:59:13.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.843+0000 7ff4e7c9a640 1 -- 172.21.15.133:0/1332544922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4e01578f0 msgr2=0x7ff4e00acc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:13.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.843+0000 7ff4e7c9a640 1 --2- 172.21.15.133:0/1332544922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4e01578f0 0x7ff4e00acc80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8007e70 tx=0x7ff4d800e4b0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.843+0000 7ff4e7c9a640 1 -- 172.21.15.133:0/1332544922 shutdown_connections 2023-12-19T18:59:13.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.843+0000 7ff4e7c9a640 1 --2- 172.21.15.133:0/1332544922 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff4c4066470 0x7ff4c4068930 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.843+0000 7ff4e7c9a640 1 --2- 172.21.15.133:0/1332544922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4e01578f0 0x7ff4e00acc80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.843+0000 7ff4e7c9a640 1 --2- 172.21.15.133:0/1332544922 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4e00c2840 0x7ff4e00ac740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.843+0000 7ff4e7c9a640 1 --2- 172.21.15.133:0/1332544922 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4e00a6c60 0x7ff4e01f0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:13.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.843+0000 7ff4e7c9a640 1 -- 172.21.15.133:0/1332544922 >> 172.21.15.133:0/1332544922 conn(0x7ff4e00c7e40 msgr2=0x7ff4e01559e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:13.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.843+0000 7ff4e7c9a640 1 -- 172.21.15.133:0/1332544922 shutdown_connections 2023-12-19T18:59:13.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:13.843+0000 7ff4e7c9a640 1 -- 172.21.15.133:0/1332544922 wait complete. 2023-12-19T18:59:13.866 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T18:59:13.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:13.866 DEBUG:teuthology.orchestra.run.smithi138:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-12-19T18:59:13.905 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi138.front.sepia.ceph.com 2023-12-19T18:59:13.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:13.906 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T18:59:13.959 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-12-19T18:59:13.959 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:59:14.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.091+0000 7f99ec89f640 1 Processor -- start 2023-12-19T18:59:14.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.091+0000 7f99ec89f640 1 -- start start 2023-12-19T18:59:14.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.091+0000 7f99ec89f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f99e80c7c50 0x7f99e81544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:14.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.091+0000 7f99ec89f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f99e8154a10 0x7f99e815ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:14.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.091+0000 7f99ec89f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e80c8160 con 0x7f99e8151cd0 2023-12-19T18:59:14.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.091+0000 7f99ec89f640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e8157b40 con 0x7f99e8154a10 2023-12-19T18:59:14.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.091+0000 7f99ec89f640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e8157e20 con 0x7f99e80c7c50 2023-12-19T18:59:14.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.091+0000 7f99e7fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f99e8154a10 0x7f99e815ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:14.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.091+0000 7f99e77fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f99e8151cd0 0x7f99e80ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59186/0 (socket says 172.21.15.133:59186) 2023-12-19T18:59:14.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.091+0000 7f99e77fe640 1 -- 172.21.15.133:0/3163474315 learned_addr learned my addr 172.21.15.133:0/3163474315 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:14.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.091+0000 7f99e6ffd640 1 --2- 172.21.15.133:0/3163474315 >> v2:172.21.15.138:3300/0 conn(0x7f99e80c7c50 0x7f99e81544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:14.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.095+0000 7f99e7fff640 1 -- 172.21.15.133:0/3163474315 >> v2:172.21.15.138:3300/0 conn(0x7f99e80c7c50 msgr2=0x7f99e81544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:14.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.095+0000 7f99e7fff640 1 --2- 172.21.15.133:0/3163474315 >> v2:172.21.15.138:3300/0 conn(0x7f99e80c7c50 0x7f99e81544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.095+0000 7f99e7fff640 1 -- 172.21.15.133:0/3163474315 >> v1:172.21.15.133:6789/0 conn(0x7f99e8151cd0 legacy=0x7f99e80ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:14.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.095+0000 7f99e7fff640 1 -- 172.21.15.133:0/3163474315 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e8158100 con 0x7f99e8154a10 2023-12-19T18:59:14.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.095+0000 7f99e67fc640 1 -- 172.21.15.133:0/3163474315 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1782222477 0 0) 0x7f99e80c8160 con 0x7f99e8151cd0 2023-12-19T18:59:14.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.095+0000 7f99e7fff640 1 --2- 172.21.15.133:0/3163474315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99e8154a10 0x7f99e815ee30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f99e80ac7a0 tx=0x7f99e001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3406b9d27ea07d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:14.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.095+0000 7f99e67fc640 1 -- 172.21.15.133:0/3163474315 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e00a59c0 con 0x7f99e8154a10 2023-12-19T18:59:14.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.095+0000 7f99e67fc640 1 -- 172.21.15.133:0/3163474315 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e00a5b20 con 0x7f99e8154a10 2023-12-19T18:59:14.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.095+0000 7f99e67fc640 1 -- 172.21.15.133:0/3163474315 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e00ad440 con 0x7f99e8154a10 2023-12-19T18:59:14.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.095+0000 7f99ec89f640 1 -- 172.21.15.133:0/3163474315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99e8154a10 msgr2=0x7f99e815ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:14.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.095+0000 7f99ec89f640 1 --2- 172.21.15.133:0/3163474315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99e8154a10 0x7f99e815ee30 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f99e80ac7a0 tx=0x7f99e001c8e0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.095+0000 7f99ec89f640 1 -- 172.21.15.133:0/3163474315 shutdown_connections 2023-12-19T18:59:14.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.095+0000 7f99ec89f640 1 --2- 172.21.15.133:0/3163474315 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99e8154a10 0x7f99e815ee30 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.095+0000 7f99ec89f640 1 --2- 172.21.15.133:0/3163474315 >> v2:172.21.15.138:3300/0 conn(0x7f99e80c7c50 0x7f99e81544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.095+0000 7f99ec89f640 1 -- 172.21.15.133:0/3163474315 >> 172.21.15.133:0/3163474315 conn(0x7f99e80abee0 msgr2=0x7f99e80c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:14.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99ec89f640 1 -- 172.21.15.133:0/3163474315 shutdown_connections 2023-12-19T18:59:14.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99ec89f640 1 -- 172.21.15.133:0/3163474315 wait complete. 2023-12-19T18:59:14.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99ec89f640 1 Processor -- start 2023-12-19T18:59:14.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99ec89f640 1 -- start start 2023-12-19T18:59:14.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99ec89f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99e80c7c50 0x7f99e81420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:14.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99ec89f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99e8151cd0 0x7f99e8157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:14.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99ec89f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99e8154a10 0x7f99e8143630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:14.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99ec89f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e8142e70 con 0x7f99e80c7c50 2023-12-19T18:59:14.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99ec89f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e8148260 con 0x7f99e8154a10 2023-12-19T18:59:14.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99ec89f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e81444e0 con 0x7f99e8151cd0 2023-12-19T18:59:14.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99e77fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99e80c7c50 0x7f99e81420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:14.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99e77fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99e80c7c50 0x7f99e81420e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:56084/0 (socket says 172.21.15.133:56084) 2023-12-19T18:59:14.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99e77fe640 1 -- 172.21.15.133:0/4191033125 learned_addr learned my addr 172.21.15.133:0/4191033125 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:14.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99e7fff640 1 --2- 172.21.15.133:0/4191033125 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99e8154a10 0x7f99e8143630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:14.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99e6ffd640 1 --2- 172.21.15.133:0/4191033125 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99e8151cd0 0x7f99e8157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:14.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99e77fe640 1 -- 172.21.15.133:0/4191033125 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99e8151cd0 msgr2=0x7f99e8157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:14.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99e77fe640 1 --2- 172.21.15.133:0/4191033125 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99e8151cd0 0x7f99e8157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99e77fe640 1 -- 172.21.15.133:0/4191033125 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99e8154a10 msgr2=0x7f99e8143630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:14.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99e77fe640 1 --2- 172.21.15.133:0/4191033125 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99e8154a10 0x7f99e8143630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99e77fe640 1 -- 172.21.15.133:0/4191033125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e0009a70 con 0x7f99e80c7c50 2023-12-19T18:59:14.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99e7fff640 1 --2- 172.21.15.133:0/4191033125 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99e8154a10 0x7f99e8143630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:14.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99e77fe640 1 --2- 172.21.15.133:0/4191033125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99e80c7c50 0x7f99e81420e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f99d80011f0 tx=0x7f99d800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:14.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99cffff640 1 -- 172.21.15.133:0/4191033125 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d80074e0 con 0x7f99e80c7c50 2023-12-19T18:59:14.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99cffff640 1 -- 172.21.15.133:0/4191033125 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d8007640 con 0x7f99e80c7c50 2023-12-19T18:59:14.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99cffff640 1 -- 172.21.15.133:0/4191033125 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8004a10 con 0x7f99e80c7c50 2023-12-19T18:59:14.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.099+0000 7f99ec89f640 1 -- 172.21.15.133:0/4191033125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e81447c0 con 0x7f99e80c7c50 2023-12-19T18:59:14.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.103+0000 7f99ec89f640 1 -- 172.21.15.133:0/4191033125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e8157770 con 0x7f99e80c7c50 2023-12-19T18:59:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.103+0000 7f99ec89f640 1 -- 172.21.15.133:0/4191033125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e804e850 con 0x7f99e80c7c50 2023-12-19T18:59:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.103+0000 7f99cffff640 1 -- 172.21.15.133:0/4191033125 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f99d8004b70 con 0x7f99e80c7c50 2023-12-19T18:59:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.103+0000 7f99cffff640 1 --2- 172.21.15.133:0/4191033125 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f99d4066470 0x7f99d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.103+0000 7f99cffff640 1 -- 172.21.15.133:0/4191033125 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99d8083220 con 0x7f99e80c7c50 2023-12-19T18:59:14.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.103+0000 7f99e6ffd640 1 --2- 172.21.15.133:0/4191033125 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f99d4066470 0x7f99d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:14.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.103+0000 7f99e6ffd640 1 --2- 172.21.15.133:0/4191033125 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f99d4066470 0x7f99d4068930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f99e8142b80 tx=0x7f99dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:14.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.107+0000 7f99cffff640 1 -- 172.21.15.133:0/4191033125 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f99d8050600 con 0x7f99e80c7c50 2023-12-19T18:59:14.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.287+0000 7f99ec89f640 1 -- 172.21.15.133:0/4191033125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99e806d180 con 0x7f99e80c7c50 2023-12-19T18:59:14.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.287+0000 7f99cffff640 1 -- 172.21.15.133:0/4191033125 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f99d8018090 con 0x7f99e80c7c50 2023-12-19T18:59:14.295 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:14.295 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6836/2938414361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":2938414361},{"type":"v1","addr":"172.21.15.138:6836","nonce":2938414361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/4017805684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6835","nonce":4017805684},{"type":"v1","addr":"172.21.15.138:6837","nonce":4017805684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/1350101028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1350101028},{"type":"v1","addr":"172.21.15.133:6834","nonce":1350101028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:58:42.786720+0000","modified":"2023-12-19T18:58:46.003120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/615053717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":615053717},{"type":"v1","addr":"172.21.15.133:6835","nonce":615053717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T18:59:14.295 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 8 2023-12-19T18:59:14.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.291+0000 7f99ec89f640 1 -- 172.21.15.133:0/4191033125 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f99d4066470 msgr2=0x7f99d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:14.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.291+0000 7f99ec89f640 1 --2- 172.21.15.133:0/4191033125 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f99d4066470 0x7f99d4068930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f99e8142b80 tx=0x7f99dc008040 comp rx=0 tx=0).stop 2023-12-19T18:59:14.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.291+0000 7f99ec89f640 1 -- 172.21.15.133:0/4191033125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99e80c7c50 msgr2=0x7f99e81420e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:14.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.291+0000 7f99ec89f640 1 --2- 172.21.15.133:0/4191033125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99e80c7c50 0x7f99e81420e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f99d80011f0 tx=0x7f99d800c9b0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.291+0000 7f99ec89f640 1 -- 172.21.15.133:0/4191033125 shutdown_connections 2023-12-19T18:59:14.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.291+0000 7f99ec89f640 1 --2- 172.21.15.133:0/4191033125 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f99d4066470 0x7f99d4068930 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.291+0000 7f99ec89f640 1 --2- 172.21.15.133:0/4191033125 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99e8154a10 0x7f99e8143630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.291+0000 7f99ec89f640 1 --2- 172.21.15.133:0/4191033125 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99e8151cd0 0x7f99e8157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.291+0000 7f99ec89f640 1 --2- 172.21.15.133:0/4191033125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99e80c7c50 0x7f99e81420e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.291+0000 7f99ec89f640 1 -- 172.21.15.133:0/4191033125 >> 172.21.15.133:0/4191033125 conn(0x7f99e80abee0 msgr2=0x7f99e80c8940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:14.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.291+0000 7f99ec89f640 1 -- 172.21.15.133:0/4191033125 shutdown_connections 2023-12-19T18:59:14.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.291+0000 7f99ec89f640 1 -- 172.21.15.133:0/4191033125 wait complete. 2023-12-19T18:59:14.316 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:59:14.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.451+0000 7fd00a832640 1 Processor -- start 2023-12-19T18:59:14.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.451+0000 7fd00a832640 1 -- start start 2023-12-19T18:59:14.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.451+0000 7fd00a832640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0040c5260 0x7fd00406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:14.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.451+0000 7fd00a832640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd0040c5640 0x7fd0040c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:14.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.451+0000 7fd00a832640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0040c2580 con 0x7fd0040c60f0 2023-12-19T18:59:14.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.451+0000 7fd00a832640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd004153510 con 0x7fd0040c5640 2023-12-19T18:59:14.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.451+0000 7fd00a832640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0040c17f0 con 0x7fd0040c5260 2023-12-19T18:59:14.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.451+0000 7fd008dcf640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fd0040c60f0 0x7fd004155de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:38676/0 (socket says 172.21.15.133:38676) 2023-12-19T18:59:14.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.451+0000 7fd008dcf640 1 -- 172.21.15.133:0/4288647950 learned_addr learned my addr 172.21.15.133:0/4288647950 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:14.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.451+0000 7fd003fff640 1 --2- 172.21.15.133:0/4288647950 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0040c5260 0x7fd00406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:14.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.451+0000 7fd0037fe640 1 --2- 172.21.15.133:0/4288647950 >> v2:172.21.15.138:3300/0 conn(0x7fd0040c5640 0x7fd0040c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:14.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.451+0000 7fd002ffd640 1 -- 172.21.15.133:0/4288647950 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1137781703 0 0) 0x7fd0040c2580 con 0x7fd0040c60f0 2023-12-19T18:59:14.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.451+0000 7fd002ffd640 1 -- 172.21.15.133:0/4288647950 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfec003530 con 0x7fd0040c60f0 2023-12-19T18:59:14.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.451+0000 7fd0037fe640 1 -- 172.21.15.133:0/4288647950 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0040c5260 msgr2=0x7fd00406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:14.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.451+0000 7fd0037fe640 1 --2- 172.21.15.133:0/4288647950 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0040c5260 0x7fd00406d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.451+0000 7fd0037fe640 1 -- 172.21.15.133:0/4288647950 >> v1:172.21.15.138:6789/0 conn(0x7fd0040c60f0 legacy=0x7fd004155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:14.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.451+0000 7fd0037fe640 1 -- 172.21.15.133:0/4288647950 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0040c1a00 con 0x7fd0040c5640 2023-12-19T18:59:14.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.451+0000 7fd003fff640 1 --2- 172.21.15.133:0/4288647950 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0040c5260 0x7fd00406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:59:14.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.455+0000 7fd0037fe640 1 --2- 172.21.15.133:0/4288647950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0040c5640 0x7fd0040c5bb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd0040c1930 tx=0x7fcff801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3079d35c5a602343 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:14.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.455+0000 7fd002ffd640 1 -- 172.21.15.133:0/4288647950 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff80ab600 con 0x7fd0040c5640 2023-12-19T18:59:14.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.455+0000 7fd002ffd640 1 -- 172.21.15.133:0/4288647950 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff80a7050 con 0x7fd0040c5640 2023-12-19T18:59:14.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.455+0000 7fd002ffd640 1 -- 172.21.15.133:0/4288647950 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff80ab960 con 0x7fd0040c5640 2023-12-19T18:59:14.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.455+0000 7fd00a832640 1 -- 172.21.15.133:0/4288647950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0040c5640 msgr2=0x7fd0040c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:14.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.455+0000 7fd00a832640 1 --2- 172.21.15.133:0/4288647950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0040c5640 0x7fd0040c5bb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd0040c1930 tx=0x7fcff801c3c0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.455+0000 7fd00a832640 1 -- 172.21.15.133:0/4288647950 shutdown_connections 2023-12-19T18:59:14.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.455+0000 7fd00a832640 1 --2- 172.21.15.133:0/4288647950 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0040c5640 0x7fd0040c5bb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.455+0000 7fd00a832640 1 --2- 172.21.15.133:0/4288647950 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0040c5260 0x7fd00406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.455+0000 7fd00a832640 1 -- 172.21.15.133:0/4288647950 >> 172.21.15.133:0/4288647950 conn(0x7fd00406a5b0 msgr2=0x7fd00406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:14.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.455+0000 7fd00a832640 1 -- 172.21.15.133:0/4288647950 shutdown_connections 2023-12-19T18:59:14.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.455+0000 7fd00a832640 1 -- 172.21.15.133:0/4288647950 wait complete. 2023-12-19T18:59:14.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd00a832640 1 Processor -- start 2023-12-19T18:59:14.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd00a832640 1 -- start start 2023-12-19T18:59:14.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd00a832640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0040c5260 0x7fd00414f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd00a832640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0040c5640 0x7fd004156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd00a832640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0040c60f0 0x7fd0040bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd00a832640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00414f110 con 0x7fd0040c5260 2023-12-19T18:59:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd00a832640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0041584b0 con 0x7fd0040c5640 2023-12-19T18:59:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd00a832640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0040aaec0 con 0x7fd0040c60f0 2023-12-19T18:59:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd003fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0040c5260 0x7fd00414f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd003fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0040c5260 0x7fd00414f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37848/0 (socket says 172.21.15.133:37848) 2023-12-19T18:59:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd003fff640 1 -- 172.21.15.133:0/4190027504 learned_addr learned my addr 172.21.15.133:0/4190027504 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd008dcf640 1 --2- 172.21.15.133:0/4190027504 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0040c60f0 0x7fd0040bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd0037fe640 1 --2- 172.21.15.133:0/4190027504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0040c5640 0x7fd004156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd003fff640 1 -- 172.21.15.133:0/4190027504 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0040c60f0 msgr2=0x7fd0040bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd003fff640 1 --2- 172.21.15.133:0/4190027504 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0040c60f0 0x7fd0040bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd003fff640 1 -- 172.21.15.133:0/4190027504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0040c5640 msgr2=0x7fd004156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:14.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd003fff640 1 --2- 172.21.15.133:0/4190027504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0040c5640 0x7fd004156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd003fff640 1 -- 172.21.15.133:0/4190027504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff4009420 con 0x7fd0040c5260 2023-12-19T18:59:14.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd003fff640 1 --2- 172.21.15.133:0/4190027504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0040c5260 0x7fd00414f280 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcff400e9b0 tx=0x7fcff400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:14.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd000ff9640 1 -- 172.21.15.133:0/4190027504 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff400ca00 con 0x7fd0040c5260 2023-12-19T18:59:14.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd000ff9640 1 -- 172.21.15.133:0/4190027504 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff400cb60 con 0x7fd0040c5260 2023-12-19T18:59:14.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd00a832640 1 -- 172.21.15.133:0/4190027504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff8009420 con 0x7fd0040c5260 2023-12-19T18:59:14.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd000ff9640 1 -- 172.21.15.133:0/4190027504 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff4013470 con 0x7fd0040c5260 2023-12-19T18:59:14.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.459+0000 7fd00a832640 1 -- 172.21.15.133:0/4190027504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0041ed6e0 con 0x7fd0040c5260 2023-12-19T18:59:14.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.463+0000 7fd00a832640 1 -- 172.21.15.133:0/4190027504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0040aaa40 con 0x7fd0040c5260 2023-12-19T18:59:14.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.463+0000 7fd000ff9640 1 -- 172.21.15.133:0/4190027504 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fcff40135d0 con 0x7fd0040c5260 2023-12-19T18:59:14.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.463+0000 7fd000ff9640 1 --2- 172.21.15.133:0/4190027504 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcff0066470 0x7fcff0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:14.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.463+0000 7fd000ff9640 1 -- 172.21.15.133:0/4190027504 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcff4084070 con 0x7fd0040c5260 2023-12-19T18:59:14.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.463+0000 7fd0037fe640 1 --2- 172.21.15.133:0/4190027504 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcff0066470 0x7fcff0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:14.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.463+0000 7fd0037fe640 1 --2- 172.21.15.133:0/4190027504 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcff0066470 0x7fcff0068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcff80ad000 tx=0x7fcff80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:14.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.467+0000 7fd000ff9640 1 -- 172.21.15.133:0/4190027504 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fcff40b5290 con 0x7fd0040c5260 2023-12-19T18:59:14.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.619+0000 7fd00a832640 1 -- 172.21.15.133:0/4190027504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd004068400 con 0x7fd0040c5260 2023-12-19T18:59:14.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.623+0000 7fd000ff9640 1 -- 172.21.15.133:0/4190027504 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fd0040aaa40 con 0x7fd0040c5260 2023-12-19T18:59:14.628 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:14.628 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:44.402984+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:58:40.991408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T18:58:41.773992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:59:14.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.623+0000 7fd00a832640 1 -- 172.21.15.133:0/4190027504 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcff0066470 msgr2=0x7fcff0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:14.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.623+0000 7fd00a832640 1 --2- 172.21.15.133:0/4190027504 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcff0066470 0x7fcff0068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcff80ad000 tx=0x7fcff80a6000 comp rx=0 tx=0).stop 2023-12-19T18:59:14.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.623+0000 7fd00a832640 1 -- 172.21.15.133:0/4190027504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0040c5260 msgr2=0x7fd00414f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:14.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.623+0000 7fd00a832640 1 --2- 172.21.15.133:0/4190027504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0040c5260 0x7fd00414f280 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcff400e9b0 tx=0x7fcff400ee70 comp rx=0 tx=0).stop 2023-12-19T18:59:14.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.623+0000 7fd00a832640 1 -- 172.21.15.133:0/4190027504 shutdown_connections 2023-12-19T18:59:14.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.623+0000 7fd00a832640 1 --2- 172.21.15.133:0/4190027504 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcff0066470 0x7fcff0068930 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.623+0000 7fd00a832640 1 --2- 172.21.15.133:0/4190027504 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0040c60f0 0x7fd0040bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.623+0000 7fd00a832640 1 --2- 172.21.15.133:0/4190027504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0040c5640 0x7fd004156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.623+0000 7fd00a832640 1 --2- 172.21.15.133:0/4190027504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0040c5260 0x7fd00414f280 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.623+0000 7fd00a832640 1 -- 172.21.15.133:0/4190027504 >> 172.21.15.133:0/4190027504 conn(0x7fd00406a5b0 msgr2=0x7fd00406dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.623+0000 7fd00a832640 1 -- 172.21.15.133:0/4190027504 shutdown_connections 2023-12-19T18:59:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.623+0000 7fd00a832640 1 -- 172.21.15.133:0/4190027504 wait complete. 2023-12-19T18:59:14.649 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:58:40.991408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:58:41.773992+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:59:14.650 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:59:14.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.787+0000 7fa432b9d640 1 Processor -- start 2023-12-19T18:59:14.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.787+0000 7fa432b9d640 1 -- start start 2023-12-19T18:59:14.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.787+0000 7fa432b9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa42c0a5240 0x7fa42c0bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:14.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.787+0000 7fa432b9d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa42c0c01c0 0x7fa42c0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:14.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.787+0000 7fa432b9d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c0c3bd0 con 0x7fa42c0c61a0 2023-12-19T18:59:14.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.787+0000 7fa432b9d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c0bf1e0 con 0x7fa42c0a5240 2023-12-19T18:59:14.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.787+0000 7fa432b9d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42c0c3e20 con 0x7fa42c0c01c0 2023-12-19T18:59:14.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.787+0000 7fa430939640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa42c0a5240 0x7fa42c0bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:14.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.787+0000 7fa430939640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa42c0a5240 0x7fa42c0bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37862/0 (socket says 172.21.15.133:37862) 2023-12-19T18:59:14.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.787+0000 7fa430939640 1 -- 172.21.15.133:0/3659619062 learned_addr learned my addr 172.21.15.133:0/3659619062 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:14.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.787+0000 7fa42bfff640 1 --2- 172.21.15.133:0/3659619062 >> v2:172.21.15.138:3300/0 conn(0x7fa42c0c01c0 0x7fa42c0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:14.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.787+0000 7fa430939640 1 -- 172.21.15.133:0/3659619062 >> v2:172.21.15.138:3300/0 conn(0x7fa42c0c01c0 msgr2=0x7fa42c0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:14.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.787+0000 7fa430939640 1 --2- 172.21.15.133:0/3659619062 >> v2:172.21.15.138:3300/0 conn(0x7fa42c0c01c0 0x7fa42c0c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.787+0000 7fa430939640 1 -- 172.21.15.133:0/3659619062 >> v1:172.21.15.138:6789/0 conn(0x7fa42c0c61a0 legacy=0x7fa42c1561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:14.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.787+0000 7fa430939640 1 -- 172.21.15.133:0/3659619062 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c0c4100 con 0x7fa42c0a5240 2023-12-19T18:59:14.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.787+0000 7fa42bfff640 1 --2- 172.21.15.133:0/3659619062 >> v2:172.21.15.138:3300/0 conn(0x7fa42c0c01c0 0x7fa42c0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:14.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.791+0000 7fa430939640 1 --2- 172.21.15.133:0/3659619062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa42c0a5240 0x7fa42c0bfc80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa42c06b390 tx=0x7fa42001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e96b970b87837c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:14.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.791+0000 7fa42b7fe640 1 -- 172.21.15.133:0/3659619062 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4200ab640 con 0x7fa42c0a5240 2023-12-19T18:59:14.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.791+0000 7fa42b7fe640 1 -- 172.21.15.133:0/3659619062 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4200a7070 con 0x7fa42c0a5240 2023-12-19T18:59:14.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.791+0000 7fa42b7fe640 1 -- 172.21.15.133:0/3659619062 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4200ab9c0 con 0x7fa42c0a5240 2023-12-19T18:59:14.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.791+0000 7fa432b9d640 1 -- 172.21.15.133:0/3659619062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa42c0a5240 msgr2=0x7fa42c0bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:14.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.791+0000 7fa432b9d640 1 --2- 172.21.15.133:0/3659619062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa42c0a5240 0x7fa42c0bfc80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa42c06b390 tx=0x7fa42001c440 comp rx=0 tx=0).stop 2023-12-19T18:59:14.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.791+0000 7fa432b9d640 1 -- 172.21.15.133:0/3659619062 shutdown_connections 2023-12-19T18:59:14.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.791+0000 7fa432b9d640 1 --2- 172.21.15.133:0/3659619062 >> v2:172.21.15.138:3300/0 conn(0x7fa42c0c01c0 0x7fa42c0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.791+0000 7fa432b9d640 1 --2- 172.21.15.133:0/3659619062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa42c0a5240 0x7fa42c0bfc80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.791+0000 7fa432b9d640 1 -- 172.21.15.133:0/3659619062 >> 172.21.15.133:0/3659619062 conn(0x7fa42c06a5b0 msgr2=0x7fa42c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:14.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.791+0000 7fa432b9d640 1 -- 172.21.15.133:0/3659619062 shutdown_connections 2023-12-19T18:59:14.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.791+0000 7fa432b9d640 1 -- 172.21.15.133:0/3659619062 wait complete. 2023-12-19T18:59:14.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.791+0000 7fa432b9d640 1 Processor -- start 2023-12-19T18:59:14.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa432b9d640 1 -- start start 2023-12-19T18:59:14.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa432b9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa42c0a5240 0x7fa42c1534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:14.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa432b9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa42c0c01c0 0x7fa42c0c0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:14.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa432b9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa42c0c61a0 0x7fa42c1ed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:14.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa432b9d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c15ba50 con 0x7fa42c0c01c0 2023-12-19T18:59:14.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa432b9d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c155ab0 con 0x7fa42c0c61a0 2023-12-19T18:59:14.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa432b9d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c1ed100 con 0x7fa42c0a5240 2023-12-19T18:59:14.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa42bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa42c0c01c0 0x7fa42c0c0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:14.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa42bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa42c0c01c0 0x7fa42c0c0a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37866/0 (socket says 172.21.15.133:37866) 2023-12-19T18:59:14.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa42bfff640 1 -- 172.21.15.133:0/4171239245 learned_addr learned my addr 172.21.15.133:0/4171239245 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:14.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa430939640 1 --2- 172.21.15.133:0/4171239245 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa42c0a5240 0x7fa42c1534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:14.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa43113a640 1 --2- 172.21.15.133:0/4171239245 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa42c0c61a0 0x7fa42c1ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:14.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa42bfff640 1 -- 172.21.15.133:0/4171239245 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa42c0a5240 msgr2=0x7fa42c1534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:14.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa42bfff640 1 --2- 172.21.15.133:0/4171239245 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa42c0a5240 0x7fa42c1534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa42bfff640 1 -- 172.21.15.133:0/4171239245 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa42c0c61a0 msgr2=0x7fa42c1ed600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:14.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa42bfff640 1 --2- 172.21.15.133:0/4171239245 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa42c0c61a0 0x7fa42c1ed600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa42bfff640 1 -- 172.21.15.133:0/4171239245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4200094d0 con 0x7fa42c0c01c0 2023-12-19T18:59:14.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa42bfff640 1 --2- 172.21.15.133:0/4171239245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa42c0c01c0 0x7fa42c0c0a30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa41800e810 tx=0x7fa41800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:14.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa4297fa640 1 -- 172.21.15.133:0/4171239245 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41800c6d0 con 0x7fa42c0c01c0 2023-12-19T18:59:14.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa4297fa640 1 -- 172.21.15.133:0/4171239245 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41800c830 con 0x7fa42c0c01c0 2023-12-19T18:59:14.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa4297fa640 1 -- 172.21.15.133:0/4171239245 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41800cbe0 con 0x7fa42c0c01c0 2023-12-19T18:59:14.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa432b9d640 1 -- 172.21.15.133:0/4171239245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42c0aae80 con 0x7fa42c0c01c0 2023-12-19T18:59:14.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa432b9d640 1 -- 172.21.15.133:0/4171239245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42c1f1120 con 0x7fa42c0c01c0 2023-12-19T18:59:14.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.795+0000 7fa432b9d640 1 -- 172.21.15.133:0/4171239245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42c0c52e0 con 0x7fa42c0c01c0 2023-12-19T18:59:14.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.799+0000 7fa4297fa640 1 -- 172.21.15.133:0/4171239245 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa41800cd40 con 0x7fa42c0c01c0 2023-12-19T18:59:14.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.799+0000 7fa4297fa640 1 --2- 172.21.15.133:0/4171239245 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa410066470 0x7fa410068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:14.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.799+0000 7fa4297fa640 1 -- 172.21.15.133:0/4171239245 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa418083b20 con 0x7fa42c0c01c0 2023-12-19T18:59:14.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.799+0000 7fa430939640 1 --2- 172.21.15.133:0/4171239245 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa410066470 0x7fa410068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:14.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.799+0000 7fa430939640 1 --2- 172.21.15.133:0/4171239245 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa410066470 0x7fa410068930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa4200af000 tx=0x7fa4200b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:14.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.803+0000 7fa4297fa640 1 -- 172.21.15.133:0/4171239245 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa4180510e0 con 0x7fa42c0c01c0 2023-12-19T18:59:14.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.955+0000 7fa432b9d640 1 -- 172.21.15.133:0/4171239245 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa42c068400 con 0x7fa42c0c01c0 2023-12-19T18:59:14.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.955+0000 7fa4297fa640 1 -- 172.21.15.133:0/4171239245 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa418054700 con 0x7fa42c0c01c0 2023-12-19T18:59:14.960 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T18:59:14.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.955+0000 7fa432b9d640 1 -- 172.21.15.133:0/4171239245 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa410066470 msgr2=0x7fa410068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:14.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.955+0000 7fa432b9d640 1 --2- 172.21.15.133:0/4171239245 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa410066470 0x7fa410068930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa4200af000 tx=0x7fa4200b6040 comp rx=0 tx=0).stop 2023-12-19T18:59:14.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.955+0000 7fa432b9d640 1 -- 172.21.15.133:0/4171239245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa42c0c01c0 msgr2=0x7fa42c0c0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:14.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.955+0000 7fa432b9d640 1 --2- 172.21.15.133:0/4171239245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa42c0c01c0 0x7fa42c0c0a30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa41800e810 tx=0x7fa41800ecd0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.955+0000 7fa432b9d640 1 -- 172.21.15.133:0/4171239245 shutdown_connections 2023-12-19T18:59:14.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.955+0000 7fa432b9d640 1 --2- 172.21.15.133:0/4171239245 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa410066470 0x7fa410068930 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.955+0000 7fa432b9d640 1 --2- 172.21.15.133:0/4171239245 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa42c0c61a0 0x7fa42c1ed600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.955+0000 7fa432b9d640 1 --2- 172.21.15.133:0/4171239245 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa42c0c01c0 0x7fa42c0c0a30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.955+0000 7fa432b9d640 1 --2- 172.21.15.133:0/4171239245 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa42c0a5240 0x7fa42c1534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:14.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.955+0000 7fa432b9d640 1 -- 172.21.15.133:0/4171239245 >> 172.21.15.133:0/4171239245 conn(0x7fa42c06a5b0 msgr2=0x7fa42c0a5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:14.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.955+0000 7fa432b9d640 1 -- 172.21.15.133:0/4171239245 shutdown_connections 2023-12-19T18:59:14.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:14.955+0000 7fa432b9d640 1 -- 172.21.15.133:0/4171239245 wait complete. 2023-12-19T18:59:14.981 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:59:15.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.115+0000 7fae0c6c9640 1 Processor -- start 2023-12-19T18:59:15.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.115+0000 7fae0c6c9640 1 -- start start 2023-12-19T18:59:15.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.115+0000 7fae0c6c9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fae040a5370 0x7fae040c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:15.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.115+0000 7fae0c6c9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae040c4110 0x7fae04150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:15.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.115+0000 7fae0c6c9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fae04072090 0x7fae041514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:15.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.115+0000 7fae0c6c9640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae040c3070 con 0x7fae040a5370 2023-12-19T18:59:15.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.115+0000 7fae0c6c9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae040c2760 con 0x7fae04072090 2023-12-19T18:59:15.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.115+0000 7fae0c6c9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae040a5750 con 0x7fae040c4110 2023-12-19T18:59:15.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.119+0000 7fae0a465640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fae040a5370 0x7fae040c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:15.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.119+0000 7fae0a465640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fae040a5370 0x7fae040c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37876/0 (socket says 172.21.15.133:37876) 2023-12-19T18:59:15.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.119+0000 7fae0a465640 1 -- 172.21.15.133:0/764490733 learned_addr learned my addr 172.21.15.133:0/764490733 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:15.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.119+0000 7fae0a465640 1 -- 172.21.15.133:0/764490733 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae040c4110 msgr2=0x7fae04150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:15.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.119+0000 7fae0ac66640 1 --2- 172.21.15.133:0/764490733 >> v2:172.21.15.138:3300/0 conn(0x7fae04072090 0x7fae041514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:15.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.119+0000 7fae09c64640 1 --2- 172.21.15.133:0/764490733 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae040c4110 0x7fae04150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:15.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.119+0000 7fae0a465640 1 --2- 172.21.15.133:0/764490733 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae040c4110 0x7fae04150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.119+0000 7fae0a465640 1 -- 172.21.15.133:0/764490733 >> v2:172.21.15.138:3300/0 conn(0x7fae04072090 msgr2=0x7fae041514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:15.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.119+0000 7fae0a465640 1 --2- 172.21.15.133:0/764490733 >> v2:172.21.15.138:3300/0 conn(0x7fae04072090 0x7fae041514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.119+0000 7fae0a465640 1 -- 172.21.15.133:0/764490733 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae040aad20 con 0x7fae040a5370 2023-12-19T18:59:15.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.119+0000 7fae0ac66640 1 --2- 172.21.15.133:0/764490733 >> v2:172.21.15.138:3300/0 conn(0x7fae04072090 0x7fae041514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:15.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.119+0000 7fae09c64640 1 --2- 172.21.15.133:0/764490733 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae040c4110 0x7fae04150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.119+0000 7fae0a465640 1 --2- 172.21.15.133:0/764490733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae040a5370 0x7fae040c3bd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fae040c4590 tx=0x7fae0001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f0e769540f3eb9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.119+0000 7fae09463640 1 -- 172.21.15.133:0/764490733 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae000ab600 con 0x7fae040a5370 2023-12-19T18:59:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.119+0000 7fae09463640 1 -- 172.21.15.133:0/764490733 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae000a7050 con 0x7fae040a5370 2023-12-19T18:59:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.119+0000 7fae09463640 1 -- 172.21.15.133:0/764490733 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae000ab980 con 0x7fae040a5370 2023-12-19T18:59:15.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae0c6c9640 1 -- 172.21.15.133:0/764490733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae040a5370 msgr2=0x7fae040c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:15.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae0c6c9640 1 --2- 172.21.15.133:0/764490733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae040a5370 0x7fae040c3bd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fae040c4590 tx=0x7fae0001c3b0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae0c6c9640 1 -- 172.21.15.133:0/764490733 shutdown_connections 2023-12-19T18:59:15.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae0c6c9640 1 --2- 172.21.15.133:0/764490733 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae040c4110 0x7fae04150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae0c6c9640 1 --2- 172.21.15.133:0/764490733 >> v2:172.21.15.138:3300/0 conn(0x7fae04072090 0x7fae041514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae0c6c9640 1 --2- 172.21.15.133:0/764490733 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae040a5370 0x7fae040c3bd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae0c6c9640 1 -- 172.21.15.133:0/764490733 >> 172.21.15.133:0/764490733 conn(0x7fae0406a5b0 msgr2=0x7fae0406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:15.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae0c6c9640 1 -- 172.21.15.133:0/764490733 shutdown_connections 2023-12-19T18:59:15.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae0c6c9640 1 -- 172.21.15.133:0/764490733 wait complete. 2023-12-19T18:59:15.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae0c6c9640 1 Processor -- start 2023-12-19T18:59:15.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae0c6c9640 1 -- start start 2023-12-19T18:59:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae0c6c9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae04072090 0x7fae040719b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae0c6c9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae040a5370 0x7fae0406fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae0c6c9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae040c4110 0x7fae0414ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae0c6c9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae04070bb0 con 0x7fae040a5370 2023-12-19T18:59:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae0c6c9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae041ed900 con 0x7fae040c4110 2023-12-19T18:59:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae0c6c9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae040704e0 con 0x7fae04072090 2023-12-19T18:59:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae09c64640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae040a5370 0x7fae0406fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae09c64640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae040a5370 0x7fae0406fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37880/0 (socket says 172.21.15.133:37880) 2023-12-19T18:59:15.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae09c64640 1 -- 172.21.15.133:0/96867856 learned_addr learned my addr 172.21.15.133:0/96867856 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:15.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae0ac66640 1 --2- 172.21.15.133:0/96867856 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae040c4110 0x7fae0414ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:15.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae0a465640 1 --2- 172.21.15.133:0/96867856 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae04072090 0x7fae040719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:15.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae09c64640 1 -- 172.21.15.133:0/96867856 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae04072090 msgr2=0x7fae040719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:15.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae09c64640 1 --2- 172.21.15.133:0/96867856 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae04072090 0x7fae040719b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae09c64640 1 -- 172.21.15.133:0/96867856 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae040c4110 msgr2=0x7fae0414ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:15.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae09c64640 1 --2- 172.21.15.133:0/96867856 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae040c4110 0x7fae0414ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae09c64640 1 -- 172.21.15.133:0/96867856 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae000094d0 con 0x7fae040a5370 2023-12-19T18:59:15.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae0ac66640 1 --2- 172.21.15.133:0/96867856 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae040c4110 0x7fae0414ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:15.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.123+0000 7fae0a465640 1 --2- 172.21.15.133:0/96867856 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae04072090 0x7fae040719b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:15.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.127+0000 7fae09c64640 1 --2- 172.21.15.133:0/96867856 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae040a5370 0x7fae0406fe50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fadf400c7f0 tx=0x7fadf400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:15.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.127+0000 7fadfaffd640 1 -- 172.21.15.133:0/96867856 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf4007820 con 0x7fae040a5370 2023-12-19T18:59:15.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.127+0000 7fadfaffd640 1 -- 172.21.15.133:0/96867856 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf4007980 con 0x7fae040a5370 2023-12-19T18:59:15.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.127+0000 7fae0c6c9640 1 -- 172.21.15.133:0/96867856 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae041edd20 con 0x7fae040a5370 2023-12-19T18:59:15.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.127+0000 7fadfaffd640 1 -- 172.21.15.133:0/96867856 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf4007d30 con 0x7fae040a5370 2023-12-19T18:59:15.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.127+0000 7fae0c6c9640 1 -- 172.21.15.133:0/96867856 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae041ecf60 con 0x7fae040a5370 2023-12-19T18:59:15.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.127+0000 7fae0c6c9640 1 -- 172.21.15.133:0/96867856 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae04068400 con 0x7fae040a5370 2023-12-19T18:59:15.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.127+0000 7fadfaffd640 1 -- 172.21.15.133:0/96867856 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fadf40113f0 con 0x7fae040a5370 2023-12-19T18:59:15.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.127+0000 7fadfaffd640 1 --2- 172.21.15.133:0/96867856 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fade80664a0 0x7fade8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:15.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.127+0000 7fadfaffd640 1 -- 172.21.15.133:0/96867856 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fadf40841f0 con 0x7fae040a5370 2023-12-19T18:59:15.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.127+0000 7fae0a465640 1 --2- 172.21.15.133:0/96867856 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fade80664a0 0x7fade8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:15.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.131+0000 7fae0a465640 1 --2- 172.21.15.133:0/96867856 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fade80664a0 0x7fade8068960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fae000ad000 tx=0x7fae000a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:15.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.131+0000 7fadfaffd640 1 -- 172.21.15.133:0/96867856 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fadf40515d0 con 0x7fae040a5370 2023-12-19T18:59:15.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.283+0000 7fae0c6c9640 1 -- 172.21.15.133:0/96867856 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fae040c6780 con 0x7fae040a5370 2023-12-19T18:59:15.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.283+0000 7fadfaffd640 1 -- 172.21.15.133:0/96867856 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fadf4054bf0 con 0x7fae040a5370 2023-12-19T18:59:15.289 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T18:59:15.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.287+0000 7fae0c6c9640 1 -- 172.21.15.133:0/96867856 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fade80664a0 msgr2=0x7fade8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:15.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.287+0000 7fae0c6c9640 1 --2- 172.21.15.133:0/96867856 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fade80664a0 0x7fade8068960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fae000ad000 tx=0x7fae000a6000 comp rx=0 tx=0).stop 2023-12-19T18:59:15.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.287+0000 7fae0c6c9640 1 -- 172.21.15.133:0/96867856 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae040a5370 msgr2=0x7fae0406fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:15.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.287+0000 7fae0c6c9640 1 --2- 172.21.15.133:0/96867856 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae040a5370 0x7fae0406fe50 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fadf400c7f0 tx=0x7fadf400ccb0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.287+0000 7fae0c6c9640 1 -- 172.21.15.133:0/96867856 shutdown_connections 2023-12-19T18:59:15.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.287+0000 7fae0c6c9640 1 --2- 172.21.15.133:0/96867856 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fade80664a0 0x7fade8068960 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.287+0000 7fae0c6c9640 1 --2- 172.21.15.133:0/96867856 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae040c4110 0x7fae0414ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.287+0000 7fae0c6c9640 1 --2- 172.21.15.133:0/96867856 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae040a5370 0x7fae0406fe50 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.287+0000 7fae0c6c9640 1 --2- 172.21.15.133:0/96867856 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae04072090 0x7fae040719b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.287+0000 7fae0c6c9640 1 -- 172.21.15.133:0/96867856 >> 172.21.15.133:0/96867856 conn(0x7fae0406a5b0 msgr2=0x7fae0414f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:15.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.287+0000 7fae0c6c9640 1 -- 172.21.15.133:0/96867856 shutdown_connections 2023-12-19T18:59:15.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.287+0000 7fae0c6c9640 1 -- 172.21.15.133:0/96867856 wait complete. 2023-12-19T18:59:15.311 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:59:15.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.447+0000 7f014f632640 1 Processor -- start 2023-12-19T18:59:15.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.447+0000 7f014f632640 1 -- start start 2023-12-19T18:59:15.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f014f632640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f01480c4100 0x7f01480c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:15.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f014f632640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01480c06d0 0x7f01480a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f014f632640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01480c31c0 con 0x7f01480c63c0 2023-12-19T18:59:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f014f632640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01480c34a0 con 0x7f01480c4100 2023-12-19T18:59:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f014f632640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01480c1030 con 0x7f01480c06d0 2023-12-19T18:59:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f014d3ce640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f01480c63c0 0x7f01480c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33744/0 (socket says 172.21.15.133:33744) 2023-12-19T18:59:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f014d3ce640 1 -- 172.21.15.133:0/164248726 learned_addr learned my addr 172.21.15.133:0/164248726 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:15.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f014cbcd640 1 --2- 172.21.15.133:0/164248726 >> v2:172.21.15.138:3300/0 conn(0x7f01480c4100 0x7f01480c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:15.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f014dbcf640 1 --2- 172.21.15.133:0/164248726 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01480c06d0 0x7f01480a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:15.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f013ffff640 1 -- 172.21.15.133:0/164248726 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 551002153 0 0) 0x7f01480c31c0 con 0x7f01480c63c0 2023-12-19T18:59:15.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f013ffff640 1 -- 172.21.15.133:0/164248726 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0134003530 con 0x7f01480c63c0 2023-12-19T18:59:15.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f013ffff640 1 -- 172.21.15.133:0/164248726 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2404476863 0 0) 0x7f0134003530 con 0x7f01480c63c0 2023-12-19T18:59:15.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f013ffff640 1 -- 172.21.15.133:0/164248726 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01480c06d0 msgr2=0x7f01480a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:15.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f013ffff640 1 --2- 172.21.15.133:0/164248726 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01480c06d0 0x7f01480a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f013ffff640 1 -- 172.21.15.133:0/164248726 >> v2:172.21.15.138:3300/0 conn(0x7f01480c4100 msgr2=0x7f01480c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:15.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f013ffff640 1 --2- 172.21.15.133:0/164248726 >> v2:172.21.15.138:3300/0 conn(0x7f01480c4100 0x7f01480c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f013ffff640 1 -- 172.21.15.133:0/164248726 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01480c1310 con 0x7f01480c63c0 2023-12-19T18:59:15.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f013ffff640 1 -- 172.21.15.133:0/164248726 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f0144001680 con 0x7f01480c63c0 2023-12-19T18:59:15.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f013ffff640 1 -- 172.21.15.133:0/164248726 >> v1:172.21.15.133:6789/0 conn(0x7f01480c63c0 legacy=0x7f01480c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:15.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f013ffff640 1 --2- 172.21.15.133:0/164248726 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01480c06d0 0x7f0134003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:15.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f013ffff640 1 --2- 172.21.15.133:0/164248726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0134003f50 0x7f01340047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:15.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f013ffff640 1 --2- 172.21.15.133:0/164248726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0134004d10 0x7f0134005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:15.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f013ffff640 1 -- 172.21.15.133:0/164248726 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01480c34a0 con 0x7f0134004d10 2023-12-19T18:59:15.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f013ffff640 1 -- 172.21.15.133:0/164248726 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01480c1030 con 0x7f0134003f50 2023-12-19T18:59:15.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f013ffff640 1 -- 172.21.15.133:0/164248726 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013400dcd0 con 0x7f01480c06d0 2023-12-19T18:59:15.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f014dbcf640 1 --2- 172.21.15.133:0/164248726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0134004d10 0x7f0134005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:15.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f014d3ce640 1 --2- 172.21.15.133:0/164248726 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01480c06d0 0x7f0134003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:15.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f014cbcd640 1 --2- 172.21.15.133:0/164248726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0134003f50 0x7f01340047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:15.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f014dbcf640 1 -- 172.21.15.133:0/164248726 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01480c06d0 msgr2=0x7f0134003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:15.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f014dbcf640 1 --2- 172.21.15.133:0/164248726 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01480c06d0 0x7f0134003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f014dbcf640 1 -- 172.21.15.133:0/164248726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0134003f50 msgr2=0x7f01340047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:15.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f014dbcf640 1 --2- 172.21.15.133:0/164248726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0134003f50 0x7f01340047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f014dbcf640 1 -- 172.21.15.133:0/164248726 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0134003530 con 0x7f0134004d10 2023-12-19T18:59:15.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f014cbcd640 1 --2- 172.21.15.133:0/164248726 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0134003f50 0x7f01340047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:15.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.451+0000 7f014d3ce640 1 --2- 172.21.15.133:0/164248726 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01480c06d0 0x7f0134003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:15.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.455+0000 7f014dbcf640 1 --2- 172.21.15.133:0/164248726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0134004d10 0x7f0134005190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0140009fc0 tx=0x7f014001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c004c58df2b610 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:15.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.455+0000 7f013ffff640 1 -- 172.21.15.133:0/164248726 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01400a5b60 con 0x7f0134004d10 2023-12-19T18:59:15.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.455+0000 7f013ffff640 1 -- 172.21.15.133:0/164248726 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014000f040 con 0x7f0134004d10 2023-12-19T18:59:15.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.455+0000 7f013ffff640 1 -- 172.21.15.133:0/164248726 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01400ad440 con 0x7f0134004d10 2023-12-19T18:59:15.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.455+0000 7f014f632640 1 -- 172.21.15.133:0/164248726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0134004d10 msgr2=0x7f0134005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:15.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.455+0000 7f014f632640 1 --2- 172.21.15.133:0/164248726 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0134004d10 0x7f0134005190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0140009fc0 tx=0x7f014001cc60 comp rx=0 tx=0).stop 2023-12-19T18:59:15.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.455+0000 7f014dbcf640 1 -- 172.21.15.133:0/164248726 reap_dead start 2023-12-19T18:59:15.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.455+0000 7f014f632640 1 -- 172.21.15.133:0/164248726 shutdown_connections 2023-12-19T18:59:15.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.455+0000 7f014f632640 1 -- 172.21.15.133:0/164248726 >> 172.21.15.133:0/164248726 conn(0x7f014806a5b0 msgr2=0x7f014806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:15.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.455+0000 7f014f632640 1 -- 172.21.15.133:0/164248726 shutdown_connections 2023-12-19T18:59:15.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.455+0000 7f014f632640 1 -- 172.21.15.133:0/164248726 wait complete. 2023-12-19T18:59:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.459+0000 7f014f632640 1 Processor -- start 2023-12-19T18:59:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.459+0000 7f014f632640 1 -- start start 2023-12-19T18:59:15.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.459+0000 7f014f632640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01480a7c30 0x7f01481ec470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:15.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.459+0000 7f014f632640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01480bacf0 0x7f01481ec9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:15.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.459+0000 7f014f632640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f014814f4f0 0x7f014814f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:15.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.459+0000 7f014f632640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0148157220 con 0x7f01480a7c30 2023-12-19T18:59:15.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.459+0000 7f014f632640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0148157a30 con 0x7f01480bacf0 2023-12-19T18:59:15.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.459+0000 7f014f632640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0148157470 con 0x7f014814f4f0 2023-12-19T18:59:15.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.459+0000 7f014d3ce640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01480a7c30 0x7f01481ec470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:15.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.459+0000 7f014d3ce640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01480a7c30 0x7f01481ec470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37898/0 (socket says 172.21.15.133:37898) 2023-12-19T18:59:15.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.459+0000 7f014d3ce640 1 -- 172.21.15.133:0/2090146941 learned_addr learned my addr 172.21.15.133:0/2090146941 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:15.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.459+0000 7f014d3ce640 1 -- 172.21.15.133:0/2090146941 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f014814f4f0 msgr2=0x7f014814f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:15.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.459+0000 7f014d3ce640 1 --2- 172.21.15.133:0/2090146941 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f014814f4f0 0x7f014814f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.459+0000 7f014d3ce640 1 -- 172.21.15.133:0/2090146941 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01480bacf0 msgr2=0x7f01481ec9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:15.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.459+0000 7f014d3ce640 1 --2- 172.21.15.133:0/2090146941 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01480bacf0 0x7f01481ec9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.459+0000 7f014d3ce640 1 -- 172.21.15.133:0/2090146941 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01480aa3a0 con 0x7f01480a7c30 2023-12-19T18:59:15.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.459+0000 7f014d3ce640 1 --2- 172.21.15.133:0/2090146941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01480a7c30 0x7f01481ec470 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f014400e870 tx=0x7f014400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:15.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.459+0000 7f013dffb640 1 -- 172.21.15.133:0/2090146941 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014400c850 con 0x7f01480a7c30 2023-12-19T18:59:15.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.459+0000 7f013dffb640 1 -- 172.21.15.133:0/2090146941 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014400c9b0 con 0x7f01480a7c30 2023-12-19T18:59:15.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.459+0000 7f013dffb640 1 -- 172.21.15.133:0/2090146941 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014400cd40 con 0x7f01480a7c30 2023-12-19T18:59:15.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.459+0000 7f014f632640 1 -- 172.21.15.133:0/2090146941 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0148157750 con 0x7f01480a7c30 2023-12-19T18:59:15.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.459+0000 7f014f632640 1 -- 172.21.15.133:0/2090146941 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014814fee0 con 0x7f01480a7c30 2023-12-19T18:59:15.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.459+0000 7f014f632640 1 -- 172.21.15.133:0/2090146941 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0148068400 con 0x7f01480a7c30 2023-12-19T18:59:15.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.463+0000 7f013dffb640 1 -- 172.21.15.133:0/2090146941 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f014401d460 con 0x7f01480a7c30 2023-12-19T18:59:15.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.463+0000 7f013dffb640 1 --2- 172.21.15.133:0/2090146941 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f012c066470 0x7f012c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:15.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.463+0000 7f013dffb640 1 -- 172.21.15.133:0/2090146941 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0144083e70 con 0x7f01480a7c30 2023-12-19T18:59:15.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.463+0000 7f014cbcd640 1 --2- 172.21.15.133:0/2090146941 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f012c066470 0x7f012c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:15.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.463+0000 7f014cbcd640 1 --2- 172.21.15.133:0/2090146941 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f012c066470 0x7f012c068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f01480bb0d0 tx=0x7f0138008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:15.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.467+0000 7f013dffb640 1 -- 172.21.15.133:0/2090146941 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f01440512e0 con 0x7f01480a7c30 2023-12-19T18:59:15.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.615+0000 7f014f632640 1 -- 172.21.15.133:0/2090146941 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f01481ec120 con 0x7f01480a7c30 2023-12-19T18:59:15.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.615+0000 7f013dffb640 1 -- 172.21.15.133:0/2090146941 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0144001550 con 0x7f01480a7c30 2023-12-19T18:59:15.622 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T18:59:15.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.619+0000 7f014f632640 1 -- 172.21.15.133:0/2090146941 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f012c066470 msgr2=0x7f012c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:15.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.619+0000 7f014f632640 1 --2- 172.21.15.133:0/2090146941 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f012c066470 0x7f012c068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f01480bb0d0 tx=0x7f0138008040 comp rx=0 tx=0).stop 2023-12-19T18:59:15.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.619+0000 7f014f632640 1 -- 172.21.15.133:0/2090146941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01480a7c30 msgr2=0x7f01481ec470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:15.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.619+0000 7f014f632640 1 --2- 172.21.15.133:0/2090146941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01480a7c30 0x7f01481ec470 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f014400e870 tx=0x7f014400ed30 comp rx=0 tx=0).stop 2023-12-19T18:59:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.619+0000 7f014f632640 1 -- 172.21.15.133:0/2090146941 shutdown_connections 2023-12-19T18:59:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.619+0000 7f014f632640 1 --2- 172.21.15.133:0/2090146941 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f012c066470 0x7f012c068930 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.619+0000 7f014f632640 1 --2- 172.21.15.133:0/2090146941 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f014814f4f0 0x7f014814f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.619+0000 7f014f632640 1 --2- 172.21.15.133:0/2090146941 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01480bacf0 0x7f01481ec9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.619+0000 7f014f632640 1 --2- 172.21.15.133:0/2090146941 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01480a7c30 0x7f01481ec470 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.619+0000 7f014f632640 1 -- 172.21.15.133:0/2090146941 >> 172.21.15.133:0/2090146941 conn(0x7f014806a5b0 msgr2=0x7f01480a67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.619+0000 7f014f632640 1 -- 172.21.15.133:0/2090146941 shutdown_connections 2023-12-19T18:59:15.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.619+0000 7f014f632640 1 -- 172.21.15.133:0/2090146941 wait complete. 2023-12-19T18:59:15.643 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:59:15.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.775+0000 7f908fb96640 1 Processor -- start 2023-12-19T18:59:15.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.775+0000 7f908fb96640 1 -- start start 2023-12-19T18:59:15.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.779+0000 7f908fb96640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f90880c5260 0x7f908806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:15.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.779+0000 7f908fb96640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f90880c5640 0x7f90880c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:15.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.779+0000 7f908fb96640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90880c2580 con 0x7f90880c60f0 2023-12-19T18:59:15.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.779+0000 7f908fb96640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9088153510 con 0x7f90880c5260 2023-12-19T18:59:15.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.779+0000 7f908fb96640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90880c17f0 con 0x7f90880c5640 2023-12-19T18:59:15.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.779+0000 7f908d932640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f90880c5260 0x7f908806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:15.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.779+0000 7f908d932640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f90880c5260 0x7f908806d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37912/0 (socket says 172.21.15.133:37912) 2023-12-19T18:59:15.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.779+0000 7f908d932640 1 -- 172.21.15.133:0/3057876237 learned_addr learned my addr 172.21.15.133:0/3057876237 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:15.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.779+0000 7f908d131640 1 --2- 172.21.15.133:0/3057876237 >> v2:172.21.15.138:3300/0 conn(0x7f90880c5640 0x7f90880c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:15.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.779+0000 7f908d932640 1 -- 172.21.15.133:0/3057876237 >> v2:172.21.15.138:3300/0 conn(0x7f90880c5640 msgr2=0x7f90880c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:15.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.779+0000 7f908d932640 1 --2- 172.21.15.133:0/3057876237 >> v2:172.21.15.138:3300/0 conn(0x7f90880c5640 0x7f90880c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.779+0000 7f908d932640 1 -- 172.21.15.133:0/3057876237 >> v1:172.21.15.133:6789/0 conn(0x7f90880c60f0 legacy=0x7f9088155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:15.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.779+0000 7f908d932640 1 -- 172.21.15.133:0/3057876237 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90880c1a00 con 0x7f90880c5260 2023-12-19T18:59:15.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.779+0000 7f908c930640 1 -- 172.21.15.133:0/3057876237 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1230827531 0 0) 0x7f90880c2580 con 0x7f90880c60f0 2023-12-19T18:59:15.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.783+0000 7f908d932640 1 --2- 172.21.15.133:0/3057876237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90880c5260 0x7f908806d5b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f908806b390 tx=0x7f908401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0985c10032a958d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:15.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.783+0000 7f908c930640 1 -- 172.21.15.133:0/3057876237 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9084004230 con 0x7f90880c5260 2023-12-19T18:59:15.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.783+0000 7f908c930640 1 -- 172.21.15.133:0/3057876237 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90840a7050 con 0x7f90880c5260 2023-12-19T18:59:15.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.783+0000 7f908c930640 1 -- 172.21.15.133:0/3057876237 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9084003620 con 0x7f90880c5260 2023-12-19T18:59:15.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.783+0000 7f908fb96640 1 -- 172.21.15.133:0/3057876237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90880c5260 msgr2=0x7f908806d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:15.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.783+0000 7f908fb96640 1 --2- 172.21.15.133:0/3057876237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90880c5260 0x7f908806d5b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f908806b390 tx=0x7f908401c440 comp rx=0 tx=0).stop 2023-12-19T18:59:15.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.783+0000 7f908fb96640 1 -- 172.21.15.133:0/3057876237 shutdown_connections 2023-12-19T18:59:15.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.783+0000 7f908fb96640 1 --2- 172.21.15.133:0/3057876237 >> v2:172.21.15.138:3300/0 conn(0x7f90880c5640 0x7f90880c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.783+0000 7f908fb96640 1 --2- 172.21.15.133:0/3057876237 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90880c5260 0x7f908806d5b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.783+0000 7f908fb96640 1 -- 172.21.15.133:0/3057876237 >> 172.21.15.133:0/3057876237 conn(0x7f908806a5b0 msgr2=0x7f908806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:15.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.783+0000 7f908fb96640 1 -- 172.21.15.133:0/3057876237 shutdown_connections 2023-12-19T18:59:15.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.783+0000 7f908fb96640 1 -- 172.21.15.133:0/3057876237 wait complete. 2023-12-19T18:59:15.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.783+0000 7f908fb96640 1 Processor -- start 2023-12-19T18:59:15.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.783+0000 7f908fb96640 1 -- start start 2023-12-19T18:59:15.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.783+0000 7f908fb96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90880c5260 0x7f90880a7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:15.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f908fb96640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90880c5640 0x7f90880a6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:15.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f908fb96640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90880c60f0 0x7f90880a6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:15.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f908fb96640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90881ee0f0 con 0x7f90880c60f0 2023-12-19T18:59:15.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f908fb96640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90881edb70 con 0x7f90880c5640 2023-12-19T18:59:15.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f908fb96640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90881ede10 con 0x7f90880c5260 2023-12-19T18:59:15.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f908e133640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90880c60f0 0x7f90880a6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:15.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f908e133640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90880c60f0 0x7f90880a6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37922/0 (socket says 172.21.15.133:37922) 2023-12-19T18:59:15.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f908e133640 1 -- 172.21.15.133:0/3725599732 learned_addr learned my addr 172.21.15.133:0/3725599732 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:15.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f908d131640 1 --2- 172.21.15.133:0/3725599732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90880c5640 0x7f90880a6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:15.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f908d932640 1 --2- 172.21.15.133:0/3725599732 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90880c5260 0x7f90880a7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:15.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f908e133640 1 -- 172.21.15.133:0/3725599732 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90880c5260 msgr2=0x7f90880a7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:15.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f908e133640 1 --2- 172.21.15.133:0/3725599732 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90880c5260 0x7f90880a7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f908e133640 1 -- 172.21.15.133:0/3725599732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90880c5640 msgr2=0x7f90880a6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:15.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f908e133640 1 --2- 172.21.15.133:0/3725599732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90880c5640 0x7f90880a6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f908e133640 1 -- 172.21.15.133:0/3725599732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90840094d0 con 0x7f90880c60f0 2023-12-19T18:59:15.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f908d131640 1 --2- 172.21.15.133:0/3725599732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90880c5640 0x7f90880a6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:15.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f908e133640 1 --2- 172.21.15.133:0/3725599732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90880c60f0 0x7f90880a6a90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9080002240 tx=0x7f908000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:15.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f907e7fc640 1 -- 172.21.15.133:0/3725599732 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9080003db0 con 0x7f90880c60f0 2023-12-19T18:59:15.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f907e7fc640 1 -- 172.21.15.133:0/3725599732 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f908000ce30 con 0x7f90880c60f0 2023-12-19T18:59:15.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f908fb96640 1 -- 172.21.15.133:0/3725599732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90880a5a70 con 0x7f90880c60f0 2023-12-19T18:59:15.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f907e7fc640 1 -- 172.21.15.133:0/3725599732 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9080005270 con 0x7f90880c60f0 2023-12-19T18:59:15.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f908fb96640 1 -- 172.21.15.133:0/3725599732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90880a6030 con 0x7f90880c60f0 2023-12-19T18:59:15.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f908fb96640 1 -- 172.21.15.133:0/3725599732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90880a6220 con 0x7f90880c60f0 2023-12-19T18:59:15.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.787+0000 7f907e7fc640 1 -- 172.21.15.133:0/3725599732 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f90800053d0 con 0x7f90880c60f0 2023-12-19T18:59:15.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.791+0000 7f907e7fc640 1 --2- 172.21.15.133:0/3725599732 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f906c066470 0x7f906c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:15.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.791+0000 7f907e7fc640 1 -- 172.21.15.133:0/3725599732 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9080083580 con 0x7f90880c60f0 2023-12-19T18:59:15.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.791+0000 7f908d932640 1 --2- 172.21.15.133:0/3725599732 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f906c066470 0x7f906c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:15.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.791+0000 7f908d932640 1 --2- 172.21.15.133:0/3725599732 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f906c066470 0x7f906c068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f90840ad000 tx=0x7f90840a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:15.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.791+0000 7f907e7fc640 1 -- 172.21.15.133:0/3725599732 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9080050aa0 con 0x7f90880c60f0 2023-12-19T18:59:15.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.975+0000 7f908fb96640 1 -- 172.21.15.133:0/3725599732 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9088068400 con 0x7f90880c60f0 2023-12-19T18:59:15.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.975+0000 7f907e7fc640 1 -- 172.21.15.133:0/3725599732 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f9080017090 con 0x7f90880c60f0 2023-12-19T18:59:15.982 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:15.982 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6836/2938414361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":2938414361},{"type":"v1","addr":"172.21.15.138:6836","nonce":2938414361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/4017805684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6835","nonce":4017805684},{"type":"v1","addr":"172.21.15.138:6837","nonce":4017805684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/1350101028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1350101028},{"type":"v1","addr":"172.21.15.133:6834","nonce":1350101028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:58:42.786720+0000","modified":"2023-12-19T18:58:46.003120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/615053717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":615053717},{"type":"v1","addr":"172.21.15.133:6835","nonce":615053717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T18:59:15.982 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 8 2023-12-19T18:59:15.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.979+0000 7f908fb96640 1 -- 172.21.15.133:0/3725599732 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f906c066470 msgr2=0x7f906c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:15.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.979+0000 7f908fb96640 1 --2- 172.21.15.133:0/3725599732 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f906c066470 0x7f906c068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f90840ad000 tx=0x7f90840a6000 comp rx=0 tx=0).stop 2023-12-19T18:59:15.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.979+0000 7f908fb96640 1 -- 172.21.15.133:0/3725599732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90880c60f0 msgr2=0x7f90880a6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:15.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.979+0000 7f908fb96640 1 --2- 172.21.15.133:0/3725599732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90880c60f0 0x7f90880a6a90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9080002240 tx=0x7f908000cbe0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.979+0000 7f908fb96640 1 -- 172.21.15.133:0/3725599732 shutdown_connections 2023-12-19T18:59:15.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.979+0000 7f908fb96640 1 --2- 172.21.15.133:0/3725599732 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f906c066470 0x7f906c068930 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.979+0000 7f908fb96640 1 --2- 172.21.15.133:0/3725599732 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90880c60f0 0x7f90880a6a90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.979+0000 7f908fb96640 1 --2- 172.21.15.133:0/3725599732 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90880c5640 0x7f90880a6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.979+0000 7f908fb96640 1 --2- 172.21.15.133:0/3725599732 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90880c5260 0x7f90880a7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:15.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.979+0000 7f908fb96640 1 -- 172.21.15.133:0/3725599732 >> 172.21.15.133:0/3725599732 conn(0x7f908806a5b0 msgr2=0x7f9088155de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:15.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.979+0000 7f908fb96640 1 -- 172.21.15.133:0/3725599732 shutdown_connections 2023-12-19T18:59:15.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:15.979+0000 7f908fb96640 1 -- 172.21.15.133:0/3725599732 wait complete. 2023-12-19T18:59:16.003 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:59:16.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.135+0000 7fbf65a79640 1 Processor -- start 2023-12-19T18:59:16.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.135+0000 7fbf65a79640 1 -- start start 2023-12-19T18:59:16.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.135+0000 7fbf65a79640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf600c63c0 0x7fbf600c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:16.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.135+0000 7fbf65a79640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fbf600c4100 0x7fbf600c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:16.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.135+0000 7fbf65a79640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf600c31c0 con 0x7fbf600c29e0 2023-12-19T18:59:16.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.135+0000 7fbf65a79640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf600c34a0 con 0x7fbf600c4100 2023-12-19T18:59:16.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.135+0000 7fbf65a79640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf600c1030 con 0x7fbf600c63c0 2023-12-19T18:59:16.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.135+0000 7fbf5ffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fbf600c29e0 0x7fbf600a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33764/0 (socket says 172.21.15.133:33764) 2023-12-19T18:59:16.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.135+0000 7fbf5ffff640 1 -- 172.21.15.133:0/2453050802 learned_addr learned my addr 172.21.15.133:0/2453050802 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:16.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.135+0000 7fbf5effd640 1 --2- 172.21.15.133:0/2453050802 >> v2:172.21.15.138:3300/0 conn(0x7fbf600c4100 0x7fbf600c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:16.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.135+0000 7fbf5f7fe640 1 --2- 172.21.15.133:0/2453050802 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf600c63c0 0x7fbf600c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:16.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.135+0000 7fbf5e7fc640 1 -- 172.21.15.133:0/2453050802 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134847247 0 0) 0x7fbf600c31c0 con 0x7fbf600c29e0 2023-12-19T18:59:16.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.135+0000 7fbf5e7fc640 1 -- 172.21.15.133:0/2453050802 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf48003530 con 0x7fbf600c29e0 2023-12-19T18:59:16.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.139+0000 7fbf5e7fc640 1 -- 172.21.15.133:0/2453050802 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1287002815 0 0) 0x7fbf48003530 con 0x7fbf600c29e0 2023-12-19T18:59:16.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.139+0000 7fbf5effd640 1 -- 172.21.15.133:0/2453050802 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf600c63c0 msgr2=0x7fbf600c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:16.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.139+0000 7fbf5effd640 1 --2- 172.21.15.133:0/2453050802 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf600c63c0 0x7fbf600c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:16.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.139+0000 7fbf5effd640 1 -- 172.21.15.133:0/2453050802 >> v1:172.21.15.133:6789/0 conn(0x7fbf600c29e0 legacy=0x7fbf600a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:16.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.139+0000 7fbf5effd640 1 -- 172.21.15.133:0/2453050802 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf600c1310 con 0x7fbf600c4100 2023-12-19T18:59:16.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.139+0000 7fbf5effd640 1 --2- 172.21.15.133:0/2453050802 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf600c4100 0x7fbf600c24a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbf540097c0 tx=0x7fbf5401c250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68e08c97b8dbde1d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:16.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.139+0000 7fbf5e7fc640 1 -- 172.21.15.133:0/2453050802 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf58001a00 con 0x7fbf600c4100 2023-12-19T18:59:16.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.139+0000 7fbf5e7fc640 1 -- 172.21.15.133:0/2453050802 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf540a7050 con 0x7fbf600c4100 2023-12-19T18:59:16.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.139+0000 7fbf5e7fc640 1 -- 172.21.15.133:0/2453050802 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf540ab600 con 0x7fbf600c4100 2023-12-19T18:59:16.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.139+0000 7fbf65a79640 1 -- 172.21.15.133:0/2453050802 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf600c4100 msgr2=0x7fbf600c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:16.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.139+0000 7fbf65a79640 1 --2- 172.21.15.133:0/2453050802 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf600c4100 0x7fbf600c24a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbf540097c0 tx=0x7fbf5401c250 comp rx=0 tx=0).stop 2023-12-19T18:59:16.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf65a79640 1 -- 172.21.15.133:0/2453050802 shutdown_connections 2023-12-19T18:59:16.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf65a79640 1 --2- 172.21.15.133:0/2453050802 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf600c4100 0x7fbf600c24a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:16.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf65a79640 1 --2- 172.21.15.133:0/2453050802 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf600c63c0 0x7fbf600c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:16.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf65a79640 1 -- 172.21.15.133:0/2453050802 >> 172.21.15.133:0/2453050802 conn(0x7fbf6006a5b0 msgr2=0x7fbf6006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:16.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf65a79640 1 -- 172.21.15.133:0/2453050802 shutdown_connections 2023-12-19T18:59:16.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf65a79640 1 -- 172.21.15.133:0/2453050802 wait complete. 2023-12-19T18:59:16.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf65a79640 1 Processor -- start 2023-12-19T18:59:16.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf65a79640 1 -- start start 2023-12-19T18:59:16.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf65a79640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf600c29e0 0x7fbf600a4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:16.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf65a79640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf600c4100 0x7fbf60099a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:16.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf65a79640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf600c63c0 0x7fbf60153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:16.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf65a79640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf600bce40 con 0x7fbf600c4100 2023-12-19T18:59:16.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf65a79640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf600be0c0 con 0x7fbf600c29e0 2023-12-19T18:59:16.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf65a79640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf600bd820 con 0x7fbf600c63c0 2023-12-19T18:59:16.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf5effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf600c4100 0x7fbf60099a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:16.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf5effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf600c4100 0x7fbf60099a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37934/0 (socket says 172.21.15.133:37934) 2023-12-19T18:59:16.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf5effd640 1 -- 172.21.15.133:0/728380708 learned_addr learned my addr 172.21.15.133:0/728380708 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:16.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf5effd640 1 -- 172.21.15.133:0/728380708 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf600c63c0 msgr2=0x7fbf60153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:16.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf5effd640 1 --2- 172.21.15.133:0/728380708 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf600c63c0 0x7fbf60153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:16.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf5effd640 1 -- 172.21.15.133:0/728380708 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf600c29e0 msgr2=0x7fbf600a4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:16.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf5effd640 1 --2- 172.21.15.133:0/728380708 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf600c29e0 0x7fbf600a4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:16.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf5effd640 1 -- 172.21.15.133:0/728380708 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf54009420 con 0x7fbf600c4100 2023-12-19T18:59:16.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf5effd640 1 --2- 172.21.15.133:0/728380708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf600c4100 0x7fbf60099a70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbf5401a900 tx=0x7fbf54018ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:16.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.143+0000 7fbf47fff640 1 -- 172.21.15.133:0/728380708 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf540b4400 con 0x7fbf600c4100 2023-12-19T18:59:16.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.147+0000 7fbf47fff640 1 -- 172.21.15.133:0/728380708 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf540b4560 con 0x7fbf600c4100 2023-12-19T18:59:16.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.147+0000 7fbf47fff640 1 -- 172.21.15.133:0/728380708 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf540b48f0 con 0x7fbf600c4100 2023-12-19T18:59:16.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.147+0000 7fbf65a79640 1 -- 172.21.15.133:0/728380708 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf600bdb00 con 0x7fbf600c4100 2023-12-19T18:59:16.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.147+0000 7fbf65a79640 1 -- 172.21.15.133:0/728380708 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf601eaec0 con 0x7fbf600c4100 2023-12-19T18:59:16.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.147+0000 7fbf65a79640 1 -- 172.21.15.133:0/728380708 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf601ead20 con 0x7fbf600c4100 2023-12-19T18:59:16.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.147+0000 7fbf47fff640 1 -- 172.21.15.133:0/728380708 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fbf540b2040 con 0x7fbf600c4100 2023-12-19T18:59:16.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.147+0000 7fbf47fff640 1 --2- 172.21.15.133:0/728380708 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fbf4c0664a0 0x7fbf4c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:16.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.147+0000 7fbf47fff640 1 -- 172.21.15.133:0/728380708 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbf540a4e40 con 0x7fbf600c4100 2023-12-19T18:59:16.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.147+0000 7fbf5f7fe640 1 --2- 172.21.15.133:0/728380708 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fbf4c0664a0 0x7fbf4c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:16.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.151+0000 7fbf5f7fe640 1 --2- 172.21.15.133:0/728380708 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fbf4c0664a0 0x7fbf4c068960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbf50006aa0 tx=0x7fbf50006a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:16.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.151+0000 7fbf47fff640 1 -- 172.21.15.133:0/728380708 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fbf601ead20 con 0x7fbf600c4100 2023-12-19T18:59:16.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.303+0000 7fbf65a79640 1 -- 172.21.15.133:0/728380708 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf601ead20 con 0x7fbf600c4100 2023-12-19T18:59:16.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.303+0000 7fbf47fff640 1 -- 172.21.15.133:0/728380708 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7fbf601ead20 con 0x7fbf600c4100 2023-12-19T18:59:16.310 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:16.310 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:44.402984+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:58:40.991408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T18:58:41.773992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:59:16.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.307+0000 7fbf65a79640 1 -- 172.21.15.133:0/728380708 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fbf4c0664a0 msgr2=0x7fbf4c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:16.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.307+0000 7fbf65a79640 1 --2- 172.21.15.133:0/728380708 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fbf4c0664a0 0x7fbf4c068960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbf50006aa0 tx=0x7fbf50006a30 comp rx=0 tx=0).stop 2023-12-19T18:59:16.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.307+0000 7fbf65a79640 1 -- 172.21.15.133:0/728380708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf600c4100 msgr2=0x7fbf60099a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:16.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.307+0000 7fbf65a79640 1 --2- 172.21.15.133:0/728380708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf600c4100 0x7fbf60099a70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbf5401a900 tx=0x7fbf54018ff0 comp rx=0 tx=0).stop 2023-12-19T18:59:16.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.307+0000 7fbf65a79640 1 -- 172.21.15.133:0/728380708 shutdown_connections 2023-12-19T18:59:16.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.307+0000 7fbf65a79640 1 --2- 172.21.15.133:0/728380708 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fbf4c0664a0 0x7fbf4c068960 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:16.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.307+0000 7fbf65a79640 1 --2- 172.21.15.133:0/728380708 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbf600c63c0 0x7fbf60153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:16.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.307+0000 7fbf65a79640 1 --2- 172.21.15.133:0/728380708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf600c4100 0x7fbf60099a70 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:16.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.307+0000 7fbf65a79640 1 --2- 172.21.15.133:0/728380708 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbf600c29e0 0x7fbf600a4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:16.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.307+0000 7fbf65a79640 1 -- 172.21.15.133:0/728380708 >> 172.21.15.133:0/728380708 conn(0x7fbf6006a5b0 msgr2=0x7fbf6006fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:16.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.307+0000 7fbf65a79640 1 -- 172.21.15.133:0/728380708 shutdown_connections 2023-12-19T18:59:16.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.307+0000 7fbf65a79640 1 -- 172.21.15.133:0/728380708 wait complete. 2023-12-19T18:59:16.332 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T18:59:16.332 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:59:16.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.463+0000 7fdfec89a640 1 Processor -- start 2023-12-19T18:59:16.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.463+0000 7fdfec89a640 1 -- start start 2023-12-19T18:59:16.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.467+0000 7fdfec89a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fdfe8072090 0x7fdfe8150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:16.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.467+0000 7fdfec89a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfe80c2760 con 0x7fdfe80725c0 2023-12-19T18:59:16.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.467+0000 7fdfec89a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfe80a5750 con 0x7fdfe80a5370 2023-12-19T18:59:16.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.467+0000 7fdfec89a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfe80c3070 con 0x7fdfe8072090 2023-12-19T18:59:16.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.467+0000 7fdfe6d9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdfe80725c0 0x7fdfe81514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33774/0 (socket says 172.21.15.133:33774) 2023-12-19T18:59:16.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.467+0000 7fdfe6d9d640 1 -- 172.21.15.133:0/2615776201 learned_addr learned my addr 172.21.15.133:0/2615776201 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:16.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.467+0000 7fdfddd9b640 1 --2- 172.21.15.133:0/2615776201 >> v2:172.21.15.138:3300/0 conn(0x7fdfe8072090 0x7fdfe8150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:16.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.467+0000 7fdfe5d9b640 1 -- 172.21.15.133:0/2615776201 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3652000779 0 0) 0x7fdfe80c2760 con 0x7fdfe80725c0 2023-12-19T18:59:16.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.467+0000 7fdfe5d9b640 1 -- 172.21.15.133:0/2615776201 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfd4004640 con 0x7fdfe80725c0 2023-12-19T18:59:16.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.467+0000 7fdfddd9b640 1 -- 172.21.15.133:0/2615776201 >> v1:172.21.15.138:6789/0 conn(0x7fdfe80a5370 legacy=0x7fdfe80c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:16.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.467+0000 7fdfddd9b640 1 -- 172.21.15.133:0/2615776201 >> v1:172.21.15.133:6789/0 conn(0x7fdfe80725c0 legacy=0x7fdfe81514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:16.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.467+0000 7fdfddd9b640 1 -- 172.21.15.133:0/2615776201 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe80aad20 con 0x7fdfe8072090 2023-12-19T18:59:16.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.471+0000 7fdfddd9b640 1 --2- 172.21.15.133:0/2615776201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfe8072090 0x7fdfe8150fa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdfd00097c0 tx=0x7fdfd001c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=681598fba3889e35 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:16.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.471+0000 7fdfe5d9b640 1 -- 172.21.15.133:0/2615776201 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd00ab600 con 0x7fdfe8072090 2023-12-19T18:59:16.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.471+0000 7fdfe5d9b640 1 -- 172.21.15.133:0/2615776201 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd00a7050 con 0x7fdfe8072090 2023-12-19T18:59:16.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.471+0000 7fdfe5d9b640 1 -- 172.21.15.133:0/2615776201 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd00ab980 con 0x7fdfe8072090 2023-12-19T18:59:16.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.471+0000 7fdfec89a640 1 -- 172.21.15.133:0/2615776201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfe8072090 msgr2=0x7fdfe8150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:16.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.471+0000 7fdfec89a640 1 --2- 172.21.15.133:0/2615776201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfe8072090 0x7fdfe8150fa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdfd00097c0 tx=0x7fdfd001c360 comp rx=0 tx=0).stop 2023-12-19T18:59:16.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.471+0000 7fdfec89a640 1 -- 172.21.15.133:0/2615776201 shutdown_connections 2023-12-19T18:59:16.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.471+0000 7fdfec89a640 1 --2- 172.21.15.133:0/2615776201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfe8072090 0x7fdfe8150fa0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:16.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.471+0000 7fdfec89a640 1 -- 172.21.15.133:0/2615776201 >> 172.21.15.133:0/2615776201 conn(0x7fdfe806a5b0 msgr2=0x7fdfe806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:16.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.471+0000 7fdfec89a640 1 -- 172.21.15.133:0/2615776201 shutdown_connections 2023-12-19T18:59:16.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.471+0000 7fdfec89a640 1 -- 172.21.15.133:0/2615776201 wait complete. 2023-12-19T18:59:16.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.471+0000 7fdfec89a640 1 Processor -- start 2023-12-19T18:59:16.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.471+0000 7fdfec89a640 1 -- start start 2023-12-19T18:59:16.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfec89a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfe8072090 0x7fdfe81527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:16.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfec89a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfe80725c0 0x7fdfe81f0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:16.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfec89a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe80a5370 0x7fdfe814d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:16.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfec89a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe81f10d0 con 0x7fdfe80a5370 2023-12-19T18:59:16.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfec89a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe8150a00 con 0x7fdfe80725c0 2023-12-19T18:59:16.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfec89a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe8150440 con 0x7fdfe8072090 2023-12-19T18:59:16.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfe6d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe80a5370 0x7fdfe814d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:16.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfe6d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe80a5370 0x7fdfe814d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37942/0 (socket says 172.21.15.133:37942) 2023-12-19T18:59:16.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfe6d9d640 1 -- 172.21.15.133:0/2165920573 learned_addr learned my addr 172.21.15.133:0/2165920573 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:16.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfddd9b640 1 --2- 172.21.15.133:0/2165920573 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfe80725c0 0x7fdfe81f0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:16.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfe659c640 1 --2- 172.21.15.133:0/2165920573 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfe8072090 0x7fdfe81527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:16.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfe6d9d640 1 -- 172.21.15.133:0/2165920573 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfe8072090 msgr2=0x7fdfe81527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:16.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfe6d9d640 1 --2- 172.21.15.133:0/2165920573 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfe8072090 0x7fdfe81527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:16.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfe6d9d640 1 -- 172.21.15.133:0/2165920573 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfe80725c0 msgr2=0x7fdfe81f0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:16.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfe6d9d640 1 --2- 172.21.15.133:0/2165920573 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfe80725c0 0x7fdfe81f0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:16.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfe6d9d640 1 -- 172.21.15.133:0/2165920573 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd0009420 con 0x7fdfe80a5370 2023-12-19T18:59:16.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfe6d9d640 1 --2- 172.21.15.133:0/2165920573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe80a5370 0x7fdfe814d3a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000cb40 tx=0x7fdfe000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:16.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfdf7fe640 1 -- 172.21.15.133:0/2165920573 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe000aca0 con 0x7fdfe80a5370 2023-12-19T18:59:16.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfdf7fe640 1 -- 172.21.15.133:0/2165920573 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe000ae00 con 0x7fdfe80a5370 2023-12-19T18:59:16.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfdf7fe640 1 -- 172.21.15.133:0/2165920573 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe0012620 con 0x7fdfe80a5370 2023-12-19T18:59:16.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfec89a640 1 -- 172.21.15.133:0/2165920573 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe8150720 con 0x7fdfe80a5370 2023-12-19T18:59:16.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfec89a640 1 -- 172.21.15.133:0/2165920573 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe81ed000 con 0x7fdfe80a5370 2023-12-19T18:59:16.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfec89a640 1 -- 172.21.15.133:0/2165920573 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfe8068400 con 0x7fdfe80a5370 2023-12-19T18:59:16.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.475+0000 7fdfdf7fe640 1 -- 172.21.15.133:0/2165920573 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fdfe0007070 con 0x7fdfe80a5370 2023-12-19T18:59:16.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.479+0000 7fdfdf7fe640 1 --2- 172.21.15.133:0/2165920573 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdfc8066470 0x7fdfc8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:16.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.479+0000 7fdfdf7fe640 1 -- 172.21.15.133:0/2165920573 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfe0083e60 con 0x7fdfe80a5370 2023-12-19T18:59:16.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.479+0000 7fdfe659c640 1 --2- 172.21.15.133:0/2165920573 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdfc8066470 0x7fdfc8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:16.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.479+0000 7fdfe659c640 1 --2- 172.21.15.133:0/2165920573 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdfc8066470 0x7fdfc8068930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8007fd0 tx=0x7fdfd8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:16.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.483+0000 7fdfdf7fe640 1 -- 172.21.15.133:0/2165920573 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fdfe0051380 con 0x7fdfe80a5370 2023-12-19T18:59:16.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.663+0000 7fdfec89a640 1 -- 172.21.15.133:0/2165920573 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfe81ed1f0 con 0x7fdfe80a5370 2023-12-19T18:59:16.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.667+0000 7fdfdf7fe640 1 -- 172.21.15.133:0/2165920573 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7fdfe0017090 con 0x7fdfe80a5370 2023-12-19T18:59:16.671 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:16.671 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6836/2938414361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":2938414361},{"type":"v1","addr":"172.21.15.138:6836","nonce":2938414361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/4017805684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6835","nonce":4017805684},{"type":"v1","addr":"172.21.15.138:6837","nonce":4017805684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/1350101028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1350101028},{"type":"v1","addr":"172.21.15.133:6834","nonce":1350101028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:58:42.786720+0000","modified":"2023-12-19T18:58:46.003120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/615053717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":615053717},{"type":"v1","addr":"172.21.15.133:6835","nonce":615053717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T18:59:16.671 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 8 2023-12-19T18:59:16.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.667+0000 7fdfec89a640 1 -- 172.21.15.133:0/2165920573 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdfc8066470 msgr2=0x7fdfc8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:16.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.667+0000 7fdfec89a640 1 --2- 172.21.15.133:0/2165920573 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdfc8066470 0x7fdfc8068930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdfd8007fd0 tx=0x7fdfd8009040 comp rx=0 tx=0).stop 2023-12-19T18:59:16.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.667+0000 7fdfec89a640 1 -- 172.21.15.133:0/2165920573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe80a5370 msgr2=0x7fdfe814d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:16.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.667+0000 7fdfec89a640 1 --2- 172.21.15.133:0/2165920573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe80a5370 0x7fdfe814d3a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdfe000cb40 tx=0x7fdfe000a060 comp rx=0 tx=0).stop 2023-12-19T18:59:16.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.667+0000 7fdfec89a640 1 -- 172.21.15.133:0/2165920573 shutdown_connections 2023-12-19T18:59:16.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.667+0000 7fdfec89a640 1 --2- 172.21.15.133:0/2165920573 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdfc8066470 0x7fdfc8068930 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:16.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.667+0000 7fdfec89a640 1 --2- 172.21.15.133:0/2165920573 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfe80a5370 0x7fdfe814d3a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:16.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.667+0000 7fdfec89a640 1 --2- 172.21.15.133:0/2165920573 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfe80725c0 0x7fdfe81f0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:16.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.667+0000 7fdfec89a640 1 --2- 172.21.15.133:0/2165920573 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfe8072090 0x7fdfe81527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:16.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.667+0000 7fdfec89a640 1 -- 172.21.15.133:0/2165920573 >> 172.21.15.133:0/2165920573 conn(0x7fdfe806a5b0 msgr2=0x7fdfe80c3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:16.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.667+0000 7fdfec89a640 1 -- 172.21.15.133:0/2165920573 shutdown_connections 2023-12-19T18:59:16.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.667+0000 7fdfec89a640 1 -- 172.21.15.133:0/2165920573 wait complete. 2023-12-19T18:59:16.693 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:59:16.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.823+0000 7f0ee5d62640 1 Processor -- start 2023-12-19T18:59:16.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.823+0000 7f0ee5d62640 1 -- start start 2023-12-19T18:59:16.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.827+0000 7f0ee5d62640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0ee0151cd0 0x7f0ee00ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:16.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.827+0000 7f0ee5d62640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0ee0154be0 0x7f0ee015ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:16.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.827+0000 7f0ee5d62640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ee00c8160 con 0x7f0ee00c7c50 2023-12-19T18:59:16.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.827+0000 7f0ee5d62640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee0157b40 con 0x7f0ee0154be0 2023-12-19T18:59:16.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.827+0000 7f0ee5d62640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ee0157e20 con 0x7f0ee0151cd0 2023-12-19T18:59:16.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.827+0000 7f0ee5561640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0ee0154be0 0x7f0ee015ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:16.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.827+0000 7f0ee5561640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0ee0154be0 0x7f0ee015ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37956/0 (socket says 172.21.15.133:37956) 2023-12-19T18:59:16.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.827+0000 7f0ee5561640 1 -- 172.21.15.133:0/1786671380 learned_addr learned my addr 172.21.15.133:0/1786671380 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.827+0000 7f0ee4d60640 1 --2- 172.21.15.133:0/1786671380 >> v2:172.21.15.138:3300/0 conn(0x7f0ee0151cd0 0x7f0ee00ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.827+0000 7f0ee5561640 1 -- 172.21.15.133:0/1786671380 >> v2:172.21.15.138:3300/0 conn(0x7f0ee0151cd0 msgr2=0x7f0ee00ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.827+0000 7f0ee5561640 1 --2- 172.21.15.133:0/1786671380 >> v2:172.21.15.138:3300/0 conn(0x7f0ee0151cd0 0x7f0ee00ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.827+0000 7f0ee5561640 1 -- 172.21.15.133:0/1786671380 >> v1:172.21.15.138:6789/0 conn(0x7f0ee00c7c50 legacy=0x7f0ee01544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.827+0000 7f0ee5561640 1 -- 172.21.15.133:0/1786671380 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee0158100 con 0x7f0ee0154be0 2023-12-19T18:59:16.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.827+0000 7f0ee5561640 1 --2- 172.21.15.133:0/1786671380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee0154be0 0x7f0ee015ee30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0ee008b9c0 tx=0x7f0ed801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0335d27b7bece server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:16.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.831+0000 7f0edf7fe640 1 -- 172.21.15.133:0/1786671380 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed80a5880 con 0x7f0ee0154be0 2023-12-19T18:59:16.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.831+0000 7f0edf7fe640 1 -- 172.21.15.133:0/1786671380 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed80a59e0 con 0x7f0ee0154be0 2023-12-19T18:59:16.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.831+0000 7f0edf7fe640 1 -- 172.21.15.133:0/1786671380 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed80a5d70 con 0x7f0ee0154be0 2023-12-19T18:59:16.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.831+0000 7f0ee5d62640 1 -- 172.21.15.133:0/1786671380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee0154be0 msgr2=0x7f0ee015ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:16.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.831+0000 7f0ee5d62640 1 --2- 172.21.15.133:0/1786671380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee0154be0 0x7f0ee015ee30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0ee008b9c0 tx=0x7f0ed801c9a0 comp rx=0 tx=0).stop 2023-12-19T18:59:16.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.831+0000 7f0ee5d62640 1 -- 172.21.15.133:0/1786671380 shutdown_connections 2023-12-19T18:59:16.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.831+0000 7f0ee5d62640 1 --2- 172.21.15.133:0/1786671380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee0154be0 0x7f0ee015ee30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:16.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.831+0000 7f0ee5d62640 1 --2- 172.21.15.133:0/1786671380 >> v2:172.21.15.138:3300/0 conn(0x7f0ee0151cd0 0x7f0ee00ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:16.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.831+0000 7f0ee5d62640 1 -- 172.21.15.133:0/1786671380 >> 172.21.15.133:0/1786671380 conn(0x7f0ee00abee0 msgr2=0x7f0ee00c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:16.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.831+0000 7f0ee5d62640 1 -- 172.21.15.133:0/1786671380 shutdown_connections 2023-12-19T18:59:16.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.831+0000 7f0ee5d62640 1 -- 172.21.15.133:0/1786671380 wait complete. 2023-12-19T18:59:16.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.831+0000 7f0ee5d62640 1 Processor -- start 2023-12-19T18:59:16.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.831+0000 7f0ee5d62640 1 -- start start 2023-12-19T18:59:16.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.831+0000 7f0ee5d62640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ee00c7c50 0x7f0ee0154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:16.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.831+0000 7f0ee5d62640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ee0151cd0 0x7f0ee0145ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.831+0000 7f0ee5d62640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee0154be0 0x7f0ee00aa990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.831+0000 7f0ee5d62640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee0153c70 con 0x7f0ee0154be0 2023-12-19T18:59:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.831+0000 7f0ee5d62640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee01ed9e0 con 0x7f0ee0151cd0 2023-12-19T18:59:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.831+0000 7f0ee5d62640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee01535b0 con 0x7f0ee00c7c50 2023-12-19T18:59:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.831+0000 7f0ee5561640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee0154be0 0x7f0ee00aa990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.831+0000 7f0ee5561640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee0154be0 0x7f0ee00aa990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37958/0 (socket says 172.21.15.133:37958) 2023-12-19T18:59:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.831+0000 7f0ee5561640 1 -- 172.21.15.133:0/3118806386 learned_addr learned my addr 172.21.15.133:0/3118806386 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.835+0000 7f0edffff640 1 --2- 172.21.15.133:0/3118806386 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ee0151cd0 0x7f0ee0145ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.835+0000 7f0ee4d60640 1 --2- 172.21.15.133:0/3118806386 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ee00c7c50 0x7f0ee0154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.835+0000 7f0ee5561640 1 -- 172.21.15.133:0/3118806386 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ee00c7c50 msgr2=0x7f0ee0154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.835+0000 7f0ee5561640 1 --2- 172.21.15.133:0/3118806386 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ee00c7c50 0x7f0ee0154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.835+0000 7f0ee5561640 1 -- 172.21.15.133:0/3118806386 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ee0151cd0 msgr2=0x7f0ee0145ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.835+0000 7f0ee5561640 1 --2- 172.21.15.133:0/3118806386 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ee0151cd0 0x7f0ee0145ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:16.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.835+0000 7f0ee5561640 1 -- 172.21.15.133:0/3118806386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed8009b30 con 0x7f0ee0154be0 2023-12-19T18:59:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.835+0000 7f0ee5561640 1 --2- 172.21.15.133:0/3118806386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee0154be0 0x7f0ee00aa990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80af040 tx=0x7f0ed8019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.835+0000 7f0edd7fa640 1 -- 172.21.15.133:0/3118806386 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed80b8670 con 0x7f0ee0154be0 2023-12-19T18:59:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.835+0000 7f0edd7fa640 1 -- 172.21.15.133:0/3118806386 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed80b8810 con 0x7f0ee0154be0 2023-12-19T18:59:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.835+0000 7f0edd7fa640 1 -- 172.21.15.133:0/3118806386 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed80b8bc0 con 0x7f0ee0154be0 2023-12-19T18:59:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.835+0000 7f0ee5d62640 1 -- 172.21.15.133:0/3118806386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee0153890 con 0x7f0ee0154be0 2023-12-19T18:59:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.835+0000 7f0ee5d62640 1 -- 172.21.15.133:0/3118806386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee01ed600 con 0x7f0ee0154be0 2023-12-19T18:59:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.835+0000 7f0ee5d62640 1 -- 172.21.15.133:0/3118806386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ee0153db0 con 0x7f0ee0154be0 2023-12-19T18:59:16.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.835+0000 7f0edd7fa640 1 -- 172.21.15.133:0/3118806386 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0ed80b8d20 con 0x7f0ee0154be0 2023-12-19T18:59:16.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.839+0000 7f0edd7fa640 1 --2- 172.21.15.133:0/3118806386 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0ec40664a0 0x7f0ec4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:16.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.839+0000 7f0edd7fa640 1 -- 172.21.15.133:0/3118806386 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ed811f350 con 0x7f0ee0154be0 2023-12-19T18:59:16.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.839+0000 7f0ee4d60640 1 --2- 172.21.15.133:0/3118806386 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0ec40664a0 0x7f0ec4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:16.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.839+0000 7f0ee4d60640 1 --2- 172.21.15.133:0/3118806386 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0ec40664a0 0x7f0ec4068960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009b60 tx=0x7f0ed4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:16.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:16.843+0000 7f0edd7fa640 1 -- 172.21.15.133:0/3118806386 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0ee0153db0 con 0x7f0ee0154be0 2023-12-19T18:59:17.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.019+0000 7f0ee5d62640 1 -- 172.21.15.133:0/3118806386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ee0153db0 con 0x7f0ee0154be0 2023-12-19T18:59:17.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.023+0000 7f0edd7fa640 1 -- 172.21.15.133:0/3118806386 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f0ee0153db0 con 0x7f0ee0154be0 2023-12-19T18:59:17.027 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:17.027 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4261,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6836/2938414361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":2938414361},{"type":"v1","addr":"172.21.15.138:6836","nonce":2938414361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/4017805684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6835","nonce":4017805684},{"type":"v1","addr":"172.21.15.138:6837","nonce":4017805684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4278,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/1350101028","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":1350101028},{"type":"v1","addr":"172.21.15.133:6834","nonce":1350101028}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:58:42.786720+0000","modified":"2023-12-19T18:58:46.003120+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/615053717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":615053717},{"type":"v1","addr":"172.21.15.133:6835","nonce":615053717}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T18:59:17.028 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 8 2023-12-19T18:59:17.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.023+0000 7f0ee5d62640 1 -- 172.21.15.133:0/3118806386 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0ec40664a0 msgr2=0x7f0ec4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:17.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.023+0000 7f0ee5d62640 1 --2- 172.21.15.133:0/3118806386 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0ec40664a0 0x7f0ec4068960 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009b60 tx=0x7f0ed4009190 comp rx=0 tx=0).stop 2023-12-19T18:59:17.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.023+0000 7f0ee5d62640 1 -- 172.21.15.133:0/3118806386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee0154be0 msgr2=0x7f0ee00aa990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:17.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.023+0000 7f0ee5d62640 1 --2- 172.21.15.133:0/3118806386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee0154be0 0x7f0ee00aa990 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0ed80af040 tx=0x7f0ed8019740 comp rx=0 tx=0).stop 2023-12-19T18:59:17.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.023+0000 7f0ee5d62640 1 -- 172.21.15.133:0/3118806386 shutdown_connections 2023-12-19T18:59:17.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.023+0000 7f0ee5d62640 1 --2- 172.21.15.133:0/3118806386 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0ec40664a0 0x7f0ec4068960 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.023+0000 7f0ee5d62640 1 --2- 172.21.15.133:0/3118806386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ee0154be0 0x7f0ee00aa990 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.023+0000 7f0ee5d62640 1 --2- 172.21.15.133:0/3118806386 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ee0151cd0 0x7f0ee0145ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.023+0000 7f0ee5d62640 1 --2- 172.21.15.133:0/3118806386 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ee00c7c50 0x7f0ee0154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.023+0000 7f0ee5d62640 1 -- 172.21.15.133:0/3118806386 >> 172.21.15.133:0/3118806386 conn(0x7f0ee00abee0 msgr2=0x7f0ee00c92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:17.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.023+0000 7f0ee5d62640 1 -- 172.21.15.133:0/3118806386 shutdown_connections 2023-12-19T18:59:17.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.023+0000 7f0ee5d62640 1 -- 172.21.15.133:0/3118806386 wait complete. 2023-12-19T18:59:17.048 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:59:17.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.179+0000 7f4cf392a640 1 Processor -- start 2023-12-19T18:59:17.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.179+0000 7f4cf392a640 1 -- start start 2023-12-19T18:59:17.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.183+0000 7f4cf392a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4cec154030 0x7f4cec154410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:17.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.183+0000 7f4cf392a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4cec0c1390 0x7f4cec154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:17.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.183+0000 7f4cf392a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cec0c2870 con 0x7f4cec06a5b0 2023-12-19T18:59:17.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.183+0000 7f4cf392a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cec06be70 con 0x7f4cec154030 2023-12-19T18:59:17.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.183+0000 7f4cf392a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec14ae80 con 0x7f4cec0c1390 2023-12-19T18:59:17.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.183+0000 7f4cf16c6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4cec154030 0x7f4cec154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:17.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.183+0000 7f4cf16c6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4cec154030 0x7f4cec154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37966/0 (socket says 172.21.15.133:37966) 2023-12-19T18:59:17.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.183+0000 7f4cf16c6640 1 -- 172.21.15.133:0/1373170945 learned_addr learned my addr 172.21.15.133:0/1373170945 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:17.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.183+0000 7f4cf0ec5640 1 --2- 172.21.15.133:0/1373170945 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4cec0c1390 0x7f4cec154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:17.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.183+0000 7f4cf16c6640 1 -- 172.21.15.133:0/1373170945 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4cec0c1390 msgr2=0x7f4cec154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:17.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.183+0000 7f4cf16c6640 1 --2- 172.21.15.133:0/1373170945 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4cec0c1390 0x7f4cec154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.183+0000 7f4cf16c6640 1 -- 172.21.15.133:0/1373170945 >> v1:172.21.15.138:6789/0 conn(0x7f4cec06a5b0 legacy=0x7f4cec150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:17.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.183+0000 7f4cf16c6640 1 -- 172.21.15.133:0/1373170945 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec070ec0 con 0x7f4cec154030 2023-12-19T18:59:17.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.183+0000 7f4cf16c6640 1 --2- 172.21.15.133:0/1373170945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cec154030 0x7f4cec154410 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8006fd0 tx=0x7f4ce801e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d6d8571ccf3b1db server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:17.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4ce3fff640 1 -- 172.21.15.133:0/1373170945 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8004230 con 0x7f4cec154030 2023-12-19T18:59:17.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4ce3fff640 1 -- 172.21.15.133:0/1373170945 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce80ab070 con 0x7f4cec154030 2023-12-19T18:59:17.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4ce3fff640 1 -- 172.21.15.133:0/1373170945 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce80a76e0 con 0x7f4cec154030 2023-12-19T18:59:17.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4cf392a640 1 -- 172.21.15.133:0/1373170945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cec154030 msgr2=0x7f4cec154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:17.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4cf392a640 1 --2- 172.21.15.133:0/1373170945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cec154030 0x7f4cec154410 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8006fd0 tx=0x7f4ce801e8d0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4cf392a640 1 -- 172.21.15.133:0/1373170945 shutdown_connections 2023-12-19T18:59:17.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4cf392a640 1 --2- 172.21.15.133:0/1373170945 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4cec0c1390 0x7f4cec154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4cf392a640 1 --2- 172.21.15.133:0/1373170945 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cec154030 0x7f4cec154410 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4cf392a640 1 -- 172.21.15.133:0/1373170945 >> 172.21.15.133:0/1373170945 conn(0x7f4cec0c30c0 msgr2=0x7f4cec0c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:17.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4cf392a640 1 -- 172.21.15.133:0/1373170945 shutdown_connections 2023-12-19T18:59:17.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4cf392a640 1 -- 172.21.15.133:0/1373170945 wait complete. 2023-12-19T18:59:17.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4cf392a640 1 Processor -- start 2023-12-19T18:59:17.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4cf392a640 1 -- start start 2023-12-19T18:59:17.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4cf392a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cec06a5b0 0x7f4cec152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:17.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4cf392a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4cec0c1390 0x7f4cec1ecf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:17.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4cf392a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cec154030 0x7f4cec149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:17.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4cf392a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec1f06f0 con 0x7f4cec154030 2023-12-19T18:59:17.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4cf392a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec1ed590 con 0x7f4cec06a5b0 2023-12-19T18:59:17.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4cf392a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec1ed870 con 0x7f4cec0c1390 2023-12-19T18:59:17.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4cf1ec7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cec154030 0x7f4cec149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:17.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4cf1ec7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cec154030 0x7f4cec149350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37974/0 (socket says 172.21.15.133:37974) 2023-12-19T18:59:17.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4cf1ec7640 1 -- 172.21.15.133:0/3227053885 learned_addr learned my addr 172.21.15.133:0/3227053885 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:17.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4cf16c6640 1 --2- 172.21.15.133:0/3227053885 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cec06a5b0 0x7f4cec152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:17.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.187+0000 7f4cf0ec5640 1 --2- 172.21.15.133:0/3227053885 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4cec0c1390 0x7f4cec1ecf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:17.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.191+0000 7f4cf1ec7640 1 -- 172.21.15.133:0/3227053885 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4cec0c1390 msgr2=0x7f4cec1ecf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:17.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.191+0000 7f4cf1ec7640 1 --2- 172.21.15.133:0/3227053885 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4cec0c1390 0x7f4cec1ecf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.191+0000 7f4cf1ec7640 1 -- 172.21.15.133:0/3227053885 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cec06a5b0 msgr2=0x7f4cec152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:17.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.191+0000 7f4cf1ec7640 1 --2- 172.21.15.133:0/3227053885 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cec06a5b0 0x7f4cec152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.191+0000 7f4cf1ec7640 1 -- 172.21.15.133:0/3227053885 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce800b780 con 0x7f4cec154030 2023-12-19T18:59:17.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.191+0000 7f4cf1ec7640 1 --2- 172.21.15.133:0/3227053885 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cec154030 0x7f4cec149350 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400b970 tx=0x7f4ce400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:17.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.191+0000 7f4ce1ffb640 1 -- 172.21.15.133:0/3227053885 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce400cb40 con 0x7f4cec154030 2023-12-19T18:59:17.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.191+0000 7f4ce1ffb640 1 -- 172.21.15.133:0/3227053885 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce400cca0 con 0x7f4cec154030 2023-12-19T18:59:17.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.191+0000 7f4ce1ffb640 1 -- 172.21.15.133:0/3227053885 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4014680 con 0x7f4cec154030 2023-12-19T18:59:17.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.191+0000 7f4cf392a640 1 -- 172.21.15.133:0/3227053885 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cec1edb50 con 0x7f4cec154030 2023-12-19T18:59:17.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.191+0000 7f4cf392a640 1 -- 172.21.15.133:0/3227053885 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cec0a9cd0 con 0x7f4cec154030 2023-12-19T18:59:17.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.191+0000 7f4cf392a640 1 -- 172.21.15.133:0/3227053885 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cec0c2ce0 con 0x7f4cec154030 2023-12-19T18:59:17.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.191+0000 7f4ce1ffb640 1 -- 172.21.15.133:0/3227053885 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4ce401d3b0 con 0x7f4cec154030 2023-12-19T18:59:17.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.191+0000 7f4ce1ffb640 1 --2- 172.21.15.133:0/3227053885 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4cd0066470 0x7f4cd0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:17.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.191+0000 7f4ce1ffb640 1 -- 172.21.15.133:0/3227053885 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ce4083c90 con 0x7f4cec154030 2023-12-19T18:59:17.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.191+0000 7f4cf16c6640 1 --2- 172.21.15.133:0/3227053885 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4cd0066470 0x7f4cd0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:17.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.195+0000 7f4cf16c6640 1 --2- 172.21.15.133:0/3227053885 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4cd0066470 0x7f4cd0068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80b1000 tx=0x7f4ce80a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:17.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.195+0000 7f4ce1ffb640 1 -- 172.21.15.133:0/3227053885 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4cec0c2ce0 con 0x7f4cec154030 2023-12-19T18:59:17.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.347+0000 7f4cf392a640 1 -- 172.21.15.133:0/3227053885 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4cec1f0830 con 0x7f4cec154030 2023-12-19T18:59:17.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.347+0000 7f4ce1ffb640 1 -- 172.21.15.133:0/3227053885 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16541 (secure 0 0 0) 0x7f4cec1f0830 con 0x7f4cec154030 2023-12-19T18:59:17.354 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:17.354 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":20,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:58:44.402984+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:58:40.991408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T18:58:41.773992+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:59:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.351+0000 7f4cf392a640 1 -- 172.21.15.133:0/3227053885 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4cd0066470 msgr2=0x7f4cd0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.351+0000 7f4cf392a640 1 --2- 172.21.15.133:0/3227053885 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4cd0066470 0x7f4cd0068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80b1000 tx=0x7f4ce80a9070 comp rx=0 tx=0).stop 2023-12-19T18:59:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.351+0000 7f4cf392a640 1 -- 172.21.15.133:0/3227053885 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cec154030 msgr2=0x7f4cec149350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.351+0000 7f4cf392a640 1 --2- 172.21.15.133:0/3227053885 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cec154030 0x7f4cec149350 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400b970 tx=0x7f4ce400be30 comp rx=0 tx=0).stop 2023-12-19T18:59:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.351+0000 7f4cf392a640 1 -- 172.21.15.133:0/3227053885 shutdown_connections 2023-12-19T18:59:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.351+0000 7f4cf392a640 1 --2- 172.21.15.133:0/3227053885 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4cd0066470 0x7f4cd0068930 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.351+0000 7f4cf392a640 1 --2- 172.21.15.133:0/3227053885 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4cec154030 0x7f4cec149350 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.351+0000 7f4cf392a640 1 --2- 172.21.15.133:0/3227053885 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4cec0c1390 0x7f4cec1ecf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.351+0000 7f4cf392a640 1 --2- 172.21.15.133:0/3227053885 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4cec06a5b0 0x7f4cec152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.351+0000 7f4cf392a640 1 -- 172.21.15.133:0/3227053885 >> 172.21.15.133:0/3227053885 conn(0x7f4cec0c30c0 msgr2=0x7f4cec0c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:17.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.351+0000 7f4cf392a640 1 -- 172.21.15.133:0/3227053885 shutdown_connections 2023-12-19T18:59:17.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.351+0000 7f4cf392a640 1 -- 172.21.15.133:0/3227053885 wait complete. 2023-12-19T18:59:17.375 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T18:59:17.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.507+0000 7faf8e079640 1 Processor -- start 2023-12-19T18:59:17.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.507+0000 7faf8e079640 1 -- start start 2023-12-19T18:59:17.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.507+0000 7faf8e079640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7faf880725c0 0x7faf880a5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:17.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.507+0000 7faf8e079640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faf880c3bd0 0x7faf880c4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:17.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.507+0000 7faf8e079640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf880c2760 con 0x7faf88072090 2023-12-19T18:59:17.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.507+0000 7faf8e079640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf880c3070 con 0x7faf880c3bd0 2023-12-19T18:59:17.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.507+0000 7faf8e079640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf880c63e0 con 0x7faf880725c0 2023-12-19T18:59:17.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.507+0000 7faf87fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faf880c3bd0 0x7faf880c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:17.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.507+0000 7faf877fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7faf88072090 0x7faf880c5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33782/0 (socket says 172.21.15.133:33782) 2023-12-19T18:59:17.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.507+0000 7faf877fe640 1 -- 172.21.15.133:0/2595803493 learned_addr learned my addr 172.21.15.133:0/2595803493 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:17.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.507+0000 7faf87fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faf880c3bd0 0x7faf880c4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37976/0 (socket says 172.21.15.133:37976) 2023-12-19T18:59:17.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.507+0000 7faf86ffd640 1 --2- 172.21.15.133:0/2595803493 >> v2:172.21.15.138:3300/0 conn(0x7faf880725c0 0x7faf880a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:17.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.507+0000 7faf87fff640 1 -- 172.21.15.133:0/2595803493 >> v2:172.21.15.138:3300/0 conn(0x7faf880725c0 msgr2=0x7faf880a5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:17.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.507+0000 7faf87fff640 1 --2- 172.21.15.133:0/2595803493 >> v2:172.21.15.138:3300/0 conn(0x7faf880725c0 0x7faf880a5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.507+0000 7faf87fff640 1 -- 172.21.15.133:0/2595803493 >> v1:172.21.15.133:6789/0 conn(0x7faf88072090 legacy=0x7faf880c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:17.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.511+0000 7faf87fff640 1 -- 172.21.15.133:0/2595803493 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf880aad20 con 0x7faf880c3bd0 2023-12-19T18:59:17.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.511+0000 7faf867fc640 1 -- 172.21.15.133:0/2595803493 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4209055921 0 0) 0x7faf880c2760 con 0x7faf88072090 2023-12-19T18:59:17.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.511+0000 7faf87fff640 1 --2- 172.21.15.133:0/2595803493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf880c3bd0 0x7faf880c4020 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faf8806b360 tx=0x7faf8001c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69bbc73127375bdd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:17.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.511+0000 7faf867fc640 1 -- 172.21.15.133:0/2595803493 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf800a58d0 con 0x7faf880c3bd0 2023-12-19T18:59:17.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.511+0000 7faf867fc640 1 -- 172.21.15.133:0/2595803493 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf800a5a30 con 0x7faf880c3bd0 2023-12-19T18:59:17.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.511+0000 7faf867fc640 1 -- 172.21.15.133:0/2595803493 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf800a5dc0 con 0x7faf880c3bd0 2023-12-19T18:59:17.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.511+0000 7faf8e079640 1 -- 172.21.15.133:0/2595803493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf880c3bd0 msgr2=0x7faf880c4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:17.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.511+0000 7faf8e079640 1 --2- 172.21.15.133:0/2595803493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf880c3bd0 0x7faf880c4020 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7faf8806b360 tx=0x7faf8001c7f0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.511+0000 7faf8e079640 1 -- 172.21.15.133:0/2595803493 shutdown_connections 2023-12-19T18:59:17.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.511+0000 7faf8e079640 1 --2- 172.21.15.133:0/2595803493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf880c3bd0 0x7faf880c4020 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.511+0000 7faf8e079640 1 --2- 172.21.15.133:0/2595803493 >> v2:172.21.15.138:3300/0 conn(0x7faf880725c0 0x7faf880a5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.511+0000 7faf8e079640 1 -- 172.21.15.133:0/2595803493 >> 172.21.15.133:0/2595803493 conn(0x7faf8806a5b0 msgr2=0x7faf8806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:17.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.511+0000 7faf8e079640 1 -- 172.21.15.133:0/2595803493 shutdown_connections 2023-12-19T18:59:17.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.511+0000 7faf8e079640 1 -- 172.21.15.133:0/2595803493 wait complete. 2023-12-19T18:59:17.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.515+0000 7faf8e079640 1 Processor -- start 2023-12-19T18:59:17.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.515+0000 7faf8e079640 1 -- start start 2023-12-19T18:59:17.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.515+0000 7faf8e079640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf88072090 0x7faf88146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:17.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.515+0000 7faf8e079640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf880725c0 0x7faf881492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:17.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.515+0000 7faf8e079640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf880c3bd0 0x7faf880a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:17.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.515+0000 7faf8e079640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf88148ea0 con 0x7faf880725c0 2023-12-19T18:59:17.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.515+0000 7faf8e079640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf88149830 con 0x7faf880c3bd0 2023-12-19T18:59:17.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.515+0000 7faf8e079640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf880a5e80 con 0x7faf88072090 2023-12-19T18:59:17.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.515+0000 7faf86ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf880725c0 0x7faf881492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:17.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.515+0000 7faf86ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf880725c0 0x7faf881492f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37990/0 (socket says 172.21.15.133:37990) 2023-12-19T18:59:17.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.515+0000 7faf86ffd640 1 -- 172.21.15.133:0/846152429 learned_addr learned my addr 172.21.15.133:0/846152429 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:17.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.515+0000 7faf87fff640 1 --2- 172.21.15.133:0/846152429 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf880c3bd0 0x7faf880a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:17.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.515+0000 7faf877fe640 1 --2- 172.21.15.133:0/846152429 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf88072090 0x7faf88146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:17.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.515+0000 7faf86ffd640 1 -- 172.21.15.133:0/846152429 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf88072090 msgr2=0x7faf88146bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:17.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.515+0000 7faf86ffd640 1 --2- 172.21.15.133:0/846152429 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf88072090 0x7faf88146bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.515+0000 7faf86ffd640 1 -- 172.21.15.133:0/846152429 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf880c3bd0 msgr2=0x7faf880a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:17.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.515+0000 7faf86ffd640 1 --2- 172.21.15.133:0/846152429 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf880c3bd0 0x7faf880a5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.515+0000 7faf86ffd640 1 -- 172.21.15.133:0/846152429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf80009a70 con 0x7faf880725c0 2023-12-19T18:59:17.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.515+0000 7faf87fff640 1 --2- 172.21.15.133:0/846152429 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf880c3bd0 0x7faf880a5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:17.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.515+0000 7faf877fe640 1 --2- 172.21.15.133:0/846152429 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf88072090 0x7faf88146bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:17.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.515+0000 7faf86ffd640 1 --2- 172.21.15.133:0/846152429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf880725c0 0x7faf881492f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00d800 tx=0x7faf7c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:17.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.515+0000 7faf6ffff640 1 -- 172.21.15.133:0/846152429 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c00b6c0 con 0x7faf880725c0 2023-12-19T18:59:17.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.519+0000 7faf6ffff640 1 -- 172.21.15.133:0/846152429 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7c00b820 con 0x7faf880725c0 2023-12-19T18:59:17.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.519+0000 7faf6ffff640 1 -- 172.21.15.133:0/846152429 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7c00bb90 con 0x7faf880725c0 2023-12-19T18:59:17.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.519+0000 7faf8e079640 1 -- 172.21.15.133:0/846152429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf8814a010 con 0x7faf880725c0 2023-12-19T18:59:17.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.519+0000 7faf8e079640 1 -- 172.21.15.133:0/846152429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf881f10a0 con 0x7faf880725c0 2023-12-19T18:59:17.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.519+0000 7faf8e079640 1 -- 172.21.15.133:0/846152429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf88149010 con 0x7faf880725c0 2023-12-19T18:59:17.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.519+0000 7faf6ffff640 1 -- 172.21.15.133:0/846152429 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7faf7c00bcf0 con 0x7faf880725c0 2023-12-19T18:59:17.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.519+0000 7faf6ffff640 1 --2- 172.21.15.133:0/846152429 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf74066470 0x7faf74068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:17.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.519+0000 7faf6ffff640 1 -- 172.21.15.133:0/846152429 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf7c084420 con 0x7faf880725c0 2023-12-19T18:59:17.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.519+0000 7faf877fe640 1 --2- 172.21.15.133:0/846152429 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf74066470 0x7faf74068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:17.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.519+0000 7faf877fe640 1 --2- 172.21.15.133:0/846152429 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf74066470 0x7faf74068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faf78007fd0 tx=0x7faf78009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:17.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.523+0000 7faf6ffff640 1 -- 172.21.15.133:0/846152429 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7faf7c051890 con 0x7faf880725c0 2023-12-19T18:59:17.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.707+0000 7faf8e079640 1 -- 172.21.15.133:0/846152429 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7faf88068400 con 0x7faf880725c0 2023-12-19T18:59:17.713 INFO:tasks.ceph.mon.a.smithi133.stderr:2023-12-19T18:59:17.707+0000 7f5189f85640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T18:59:17.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.711+0000 7faf6ffff640 1 -- 172.21.15.133:0/846152429 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7faf7c011340 con 0x7faf880725c0 2023-12-19T18:59:17.716 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T18:59:17.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.711+0000 7faf8e079640 1 -- 172.21.15.133:0/846152429 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf74066470 msgr2=0x7faf74068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:17.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.711+0000 7faf8e079640 1 --2- 172.21.15.133:0/846152429 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf74066470 0x7faf74068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faf78007fd0 tx=0x7faf78009040 comp rx=0 tx=0).stop 2023-12-19T18:59:17.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.711+0000 7faf8e079640 1 -- 172.21.15.133:0/846152429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf880725c0 msgr2=0x7faf881492f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:17.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.711+0000 7faf8e079640 1 --2- 172.21.15.133:0/846152429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf880725c0 0x7faf881492f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7faf7c00d800 tx=0x7faf7c00dcc0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.711+0000 7faf8e079640 1 -- 172.21.15.133:0/846152429 shutdown_connections 2023-12-19T18:59:17.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.711+0000 7faf8e079640 1 --2- 172.21.15.133:0/846152429 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf74066470 0x7faf74068930 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.711+0000 7faf8e079640 1 --2- 172.21.15.133:0/846152429 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf880c3bd0 0x7faf880a5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.711+0000 7faf8e079640 1 --2- 172.21.15.133:0/846152429 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf880725c0 0x7faf881492f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.711+0000 7faf8e079640 1 --2- 172.21.15.133:0/846152429 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf88072090 0x7faf88146bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.711+0000 7faf8e079640 1 -- 172.21.15.133:0/846152429 >> 172.21.15.133:0/846152429 conn(0x7faf8806a5b0 msgr2=0x7faf8806ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:17.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.711+0000 7faf8e079640 1 -- 172.21.15.133:0/846152429 shutdown_connections 2023-12-19T18:59:17.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.711+0000 7faf8e079640 1 -- 172.21.15.133:0/846152429 wait complete. 2023-12-19T18:59:17.728 INFO:tasks.ceph.mds.a.smithi133.stderr: -5355> 2023-12-19T18:58:48.376+0000 7f2be7727640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T18:59:17.739 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T18:59:17.779 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2023-12-19T18:59:17.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.879+0000 7f150db2a640 1 Processor -- start 2023-12-19T18:59:17.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.879+0000 7f150db2a640 1 -- start start 2023-12-19T18:59:17.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.879+0000 7f150db2a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15080c7ea0 0x7f150806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:17.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.879+0000 7f150db2a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f150806b9e0 0x7f150815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:17.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.879+0000 7f150db2a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f150806c860 con 0x7f1508151e90 2023-12-19T18:59:17.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.879+0000 7f150db2a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15080c8750 con 0x7f150806b9e0 2023-12-19T18:59:17.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.879+0000 7f150db2a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15081552d0 con 0x7f15080c7ea0 2023-12-19T18:59:17.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.879+0000 7f1507fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f150806b9e0 0x7f150815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:17.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.879+0000 7f1507fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f150806b9e0 0x7f150815f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38016/0 (socket says 172.21.15.133:38016) 2023-12-19T18:59:17.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.879+0000 7f1507fff640 1 -- 172.21.15.133:0/1472484964 learned_addr learned my addr 172.21.15.133:0/1472484964 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:17.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.879+0000 7f1506ffd640 1 --2- 172.21.15.133:0/1472484964 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15080c7ea0 0x7f150806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:17.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.879+0000 7f1507fff640 1 -- 172.21.15.133:0/1472484964 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15080c7ea0 msgr2=0x7f150806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:17.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.879+0000 7f1507fff640 1 --2- 172.21.15.133:0/1472484964 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15080c7ea0 0x7f150806b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.879+0000 7f1507fff640 1 -- 172.21.15.133:0/1472484964 >> v1:172.21.15.138:6789/0 conn(0x7f1508151e90 legacy=0x7f15080c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:17.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.879+0000 7f1507fff640 1 -- 172.21.15.133:0/1472484964 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1508154930 con 0x7f150806b9e0 2023-12-19T18:59:17.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.879+0000 7f1506ffd640 1 --2- 172.21.15.133:0/1472484964 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15080c7ea0 0x7f150806b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:17.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.883+0000 7f1507fff640 1 --2- 172.21.15.133:0/1472484964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f150806b9e0 0x7f150815f0a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1500009e50 tx=0x7f150001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631c2d03112f39c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:17.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.883+0000 7f15067fc640 1 -- 172.21.15.133:0/1472484964 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15000a55b0 con 0x7f150806b9e0 2023-12-19T18:59:17.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.883+0000 7f15067fc640 1 -- 172.21.15.133:0/1472484964 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15000a5710 con 0x7f150806b9e0 2023-12-19T18:59:17.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.883+0000 7f15067fc640 1 -- 172.21.15.133:0/1472484964 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15000a5aa0 con 0x7f150806b9e0 2023-12-19T18:59:17.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.883+0000 7f150db2a640 1 -- 172.21.15.133:0/1472484964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f150806b9e0 msgr2=0x7f150815f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:17.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.883+0000 7f150db2a640 1 --2- 172.21.15.133:0/1472484964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f150806b9e0 0x7f150815f0a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1500009e50 tx=0x7f150001c8f0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.883+0000 7f150db2a640 1 -- 172.21.15.133:0/1472484964 shutdown_connections 2023-12-19T18:59:17.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.883+0000 7f150db2a640 1 --2- 172.21.15.133:0/1472484964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f150806b9e0 0x7f150815f0a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.883+0000 7f150db2a640 1 --2- 172.21.15.133:0/1472484964 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15080c7ea0 0x7f150806b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.883+0000 7f150db2a640 1 -- 172.21.15.133:0/1472484964 >> 172.21.15.133:0/1472484964 conn(0x7f15080ca170 msgr2=0x7f15080ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:17.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.883+0000 7f150db2a640 1 -- 172.21.15.133:0/1472484964 shutdown_connections 2023-12-19T18:59:17.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.883+0000 7f150db2a640 1 -- 172.21.15.133:0/1472484964 wait complete. 2023-12-19T18:59:17.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f150db2a640 1 Processor -- start 2023-12-19T18:59:17.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f150db2a640 1 -- start start 2023-12-19T18:59:17.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f150db2a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f150806b9e0 0x7f15080bdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:17.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f150db2a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15080c7ea0 0x7f15081ed420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:17.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f150db2a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1508151e90 0x7f15081ed960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:17.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f150db2a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15081ed000 con 0x7f1508151e90 2023-12-19T18:59:17.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f150db2a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15081f0920 con 0x7f150806b9e0 2023-12-19T18:59:17.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f150db2a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15081f0c00 con 0x7f15080c7ea0 2023-12-19T18:59:17.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f1507fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1508151e90 0x7f15081ed960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:17.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f1507fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1508151e90 0x7f15081ed960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38032/0 (socket says 172.21.15.133:38032) 2023-12-19T18:59:17.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f1507fff640 1 -- 172.21.15.133:0/2446738206 learned_addr learned my addr 172.21.15.133:0/2446738206 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:17.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f1506ffd640 1 --2- 172.21.15.133:0/2446738206 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15080c7ea0 0x7f15081ed420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:17.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f15077fe640 1 --2- 172.21.15.133:0/2446738206 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f150806b9e0 0x7f15080bdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:17.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f1507fff640 1 -- 172.21.15.133:0/2446738206 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15080c7ea0 msgr2=0x7f15081ed420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:17.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f1507fff640 1 --2- 172.21.15.133:0/2446738206 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15080c7ea0 0x7f15081ed420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f1507fff640 1 -- 172.21.15.133:0/2446738206 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f150806b9e0 msgr2=0x7f15080bdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:17.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f1507fff640 1 --2- 172.21.15.133:0/2446738206 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f150806b9e0 0x7f15080bdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:17.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f1507fff640 1 -- 172.21.15.133:0/2446738206 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1500009b30 con 0x7f1508151e90 2023-12-19T18:59:17.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f1507fff640 1 --2- 172.21.15.133:0/2446738206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1508151e90 0x7f15081ed960 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f15000af040 tx=0x7f1500019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:17.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f14effff640 1 -- 172.21.15.133:0/2446738206 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15000b8670 con 0x7f1508151e90 2023-12-19T18:59:17.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f14effff640 1 -- 172.21.15.133:0/2446738206 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15000b87d0 con 0x7f1508151e90 2023-12-19T18:59:17.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f150db2a640 1 -- 172.21.15.133:0/2446738206 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15081f0ee0 con 0x7f1508151e90 2023-12-19T18:59:17.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f14effff640 1 -- 172.21.15.133:0/2446738206 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15000b8b80 con 0x7f1508151e90 2023-12-19T18:59:17.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f150db2a640 1 -- 172.21.15.133:0/2446738206 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f150815f350 con 0x7f1508151e90 2023-12-19T18:59:17.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.887+0000 7f150db2a640 1 -- 172.21.15.133:0/2446738206 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1508068400 con 0x7f1508151e90 2023-12-19T18:59:17.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.891+0000 7f14effff640 1 -- 172.21.15.133:0/2446738206 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f15000b8ce0 con 0x7f1508151e90 2023-12-19T18:59:17.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.891+0000 7f14effff640 1 --2- 172.21.15.133:0/2446738206 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f14f4066470 0x7f14f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:17.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.891+0000 7f14effff640 1 -- 172.21.15.133:0/2446738206 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f150011f1b0 con 0x7f1508151e90 2023-12-19T18:59:17.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.891+0000 7f15077fe640 1 --2- 172.21.15.133:0/2446738206 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f14f4066470 0x7f14f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:17.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.891+0000 7f15077fe640 1 --2- 172.21.15.133:0/2446738206 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f14f4066470 0x7f14f4068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f15081522e0 tx=0x7f14f8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:17.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:17.895+0000 7f14effff640 1 -- 172.21.15.133:0/2446738206 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f15000ec670 con 0x7f1508151e90 2023-12-19T18:59:18.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.079+0000 7f150db2a640 1 -- 172.21.15.133:0/2446738206 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f150814f4a0 con 0x7f1508151e90 2023-12-19T18:59:18.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.711+0000 7f14effff640 1 -- 172.21.15.133:0/2446738206 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1500009510 con 0x7f1508151e90 2023-12-19T18:59:18.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.715+0000 7f150db2a640 1 -- 172.21.15.133:0/2446738206 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f14f4066470 msgr2=0x7f14f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:18.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.715+0000 7f150db2a640 1 --2- 172.21.15.133:0/2446738206 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f14f4066470 0x7f14f4068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f15081522e0 tx=0x7f14f8009040 comp rx=0 tx=0).stop 2023-12-19T18:59:18.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.715+0000 7f150db2a640 1 -- 172.21.15.133:0/2446738206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1508151e90 msgr2=0x7f15081ed960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:18.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.715+0000 7f150db2a640 1 --2- 172.21.15.133:0/2446738206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1508151e90 0x7f15081ed960 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f15000af040 tx=0x7f1500019690 comp rx=0 tx=0).stop 2023-12-19T18:59:18.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.715+0000 7f150db2a640 1 -- 172.21.15.133:0/2446738206 shutdown_connections 2023-12-19T18:59:18.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.715+0000 7f150db2a640 1 --2- 172.21.15.133:0/2446738206 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f14f4066470 0x7f14f4068930 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:18.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.715+0000 7f150db2a640 1 --2- 172.21.15.133:0/2446738206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1508151e90 0x7f15081ed960 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:18.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.715+0000 7f150db2a640 1 --2- 172.21.15.133:0/2446738206 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15080c7ea0 0x7f15081ed420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:18.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.715+0000 7f150db2a640 1 --2- 172.21.15.133:0/2446738206 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f150806b9e0 0x7f15080bdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:18.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.715+0000 7f150db2a640 1 -- 172.21.15.133:0/2446738206 >> 172.21.15.133:0/2446738206 conn(0x7f15080ca170 msgr2=0x7f15081537e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:18.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.715+0000 7f150db2a640 1 -- 172.21.15.133:0/2446738206 shutdown_connections 2023-12-19T18:59:18.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.715+0000 7f150db2a640 1 -- 172.21.15.133:0/2446738206 wait complete. 2023-12-19T18:59:18.741 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T18:59:18.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.923+0000 7ff5c7f9d640 1 Processor -- start 2023-12-19T18:59:18.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.923+0000 7ff5c7f9d640 1 -- start start 2023-12-19T18:59:18.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.923+0000 7ff5c7f9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5c00c1250 0x7ff5c00c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:18.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.923+0000 7ff5c7f9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5c006fec0 0x7ff5c00c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:18.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.923+0000 7ff5c7f9d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5c0072800 con 0x7ff5c00c0aa0 2023-12-19T18:59:18.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.923+0000 7ff5c7f9d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c00a9fc0 con 0x7ff5c00c1250 2023-12-19T18:59:18.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.923+0000 7ff5c7f9d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c0072ae0 con 0x7ff5c006fec0 2023-12-19T18:59:18.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.923+0000 7ff5c5d39640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5c00c1250 0x7ff5c00c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:18.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.923+0000 7ff5c5d39640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5c00c1250 0x7ff5c00c1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38038/0 (socket says 172.21.15.133:38038) 2023-12-19T18:59:18.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.923+0000 7ff5c5d39640 1 -- 172.21.15.133:0/172270204 learned_addr learned my addr 172.21.15.133:0/172270204 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:18.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.923+0000 7ff5c653a640 1 --1- 172.21.15.133:0/172270204 >> v1:172.21.15.133:6789/0 conn(0x7ff5c00c0aa0 0x7ff5c00c4180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33788/0 (socket says 172.21.15.133:33788) 2023-12-19T18:59:18.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.923+0000 7ff5c5538640 1 --2- 172.21.15.133:0/172270204 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5c006fec0 0x7ff5c00c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:18.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.927+0000 7ff5c5d39640 1 -- 172.21.15.133:0/172270204 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5c006fec0 msgr2=0x7ff5c00c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:18.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.927+0000 7ff5c4d37640 1 -- 172.21.15.133:0/172270204 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3687336875 0 0) 0x7ff5c0072800 con 0x7ff5c00c0aa0 2023-12-19T18:59:18.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.927+0000 7ff5c5d39640 1 --2- 172.21.15.133:0/172270204 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5c006fec0 0x7ff5c00c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:18.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.927+0000 7ff5c5d39640 1 -- 172.21.15.133:0/172270204 >> v1:172.21.15.133:6789/0 conn(0x7ff5c00c0aa0 legacy=0x7ff5c00c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:18.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.927+0000 7ff5c5d39640 1 -- 172.21.15.133:0/172270204 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c00a9900 con 0x7ff5c00c1250 2023-12-19T18:59:18.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.927+0000 7ff5c5538640 1 --2- 172.21.15.133:0/172270204 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5c006fec0 0x7ff5c00c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:18.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.927+0000 7ff5c5d39640 1 --2- 172.21.15.133:0/172270204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5c00c1250 0x7ff5c00c1de0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009870 tx=0x7ff5bc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96773426fe276e28 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:18.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.927+0000 7ff5c4d37640 1 -- 172.21.15.133:0/172270204 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc0ab600 con 0x7ff5c00c1250 2023-12-19T18:59:18.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.927+0000 7ff5c4d37640 1 -- 172.21.15.133:0/172270204 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc0a7050 con 0x7ff5c00c1250 2023-12-19T18:59:18.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.927+0000 7ff5c4d37640 1 -- 172.21.15.133:0/172270204 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc0ab980 con 0x7ff5c00c1250 2023-12-19T18:59:18.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.927+0000 7ff5c7f9d640 1 -- 172.21.15.133:0/172270204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5c00c1250 msgr2=0x7ff5c00c1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:18.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.927+0000 7ff5c7f9d640 1 --2- 172.21.15.133:0/172270204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5c00c1250 0x7ff5c00c1de0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009870 tx=0x7ff5bc01c3f0 comp rx=0 tx=0).stop 2023-12-19T18:59:18.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.927+0000 7ff5c7f9d640 1 -- 172.21.15.133:0/172270204 shutdown_connections 2023-12-19T18:59:18.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.927+0000 7ff5c7f9d640 1 --2- 172.21.15.133:0/172270204 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5c006fec0 0x7ff5c00c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:18.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.927+0000 7ff5c7f9d640 1 --2- 172.21.15.133:0/172270204 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5c00c1250 0x7ff5c00c1de0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:18.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.927+0000 7ff5c7f9d640 1 -- 172.21.15.133:0/172270204 >> 172.21.15.133:0/172270204 conn(0x7ff5c00c5d40 msgr2=0x7ff5c00c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:18.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c7f9d640 1 -- 172.21.15.133:0/172270204 shutdown_connections 2023-12-19T18:59:18.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c7f9d640 1 -- 172.21.15.133:0/172270204 wait complete. 2023-12-19T18:59:18.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c7f9d640 1 Processor -- start 2023-12-19T18:59:18.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c7f9d640 1 -- start start 2023-12-19T18:59:18.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c7f9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5c006fec0 0x7ff5c00a3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:18.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c7f9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5c00c0aa0 0x7ff5c00a3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:18.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c7f9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5c00c1250 0x7ff5c01f0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:18.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c7f9d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c00a4990 con 0x7ff5c006fec0 2023-12-19T18:59:18.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c7f9d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c00a5e10 con 0x7ff5c00c0aa0 2023-12-19T18:59:18.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c7f9d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c00a4360 con 0x7ff5c00c1250 2023-12-19T18:59:18.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c5d39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5c006fec0 0x7ff5c00a3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:18.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c5d39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5c006fec0 0x7ff5c00a3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38046/0 (socket says 172.21.15.133:38046) 2023-12-19T18:59:18.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c5d39640 1 -- 172.21.15.133:0/949125239 learned_addr learned my addr 172.21.15.133:0/949125239 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:18.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c653a640 1 --2- 172.21.15.133:0/949125239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5c00c1250 0x7ff5c01f0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:18.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c5d39640 1 -- 172.21.15.133:0/949125239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5c00c1250 msgr2=0x7ff5c01f0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:18.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c5538640 1 --2- 172.21.15.133:0/949125239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5c00c0aa0 0x7ff5c00a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:18.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c5d39640 1 --2- 172.21.15.133:0/949125239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5c00c1250 0x7ff5c01f0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:18.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c5d39640 1 -- 172.21.15.133:0/949125239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5c00c0aa0 msgr2=0x7ff5c00a3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:18.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c5d39640 1 --2- 172.21.15.133:0/949125239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5c00c0aa0 0x7ff5c00a3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:18.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c5d39640 1 -- 172.21.15.133:0/949125239 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc0094d0 con 0x7ff5c006fec0 2023-12-19T18:59:18.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c653a640 1 --2- 172.21.15.133:0/949125239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5c00c1250 0x7ff5c01f0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:18.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c5538640 1 --2- 172.21.15.133:0/949125239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5c00c0aa0 0x7ff5c00a3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:18.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c5d39640 1 --2- 172.21.15.133:0/949125239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5c006fec0 0x7ff5c00a3240 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0ae040 tx=0x7ff5bc01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:18.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5b67fc640 1 -- 172.21.15.133:0/949125239 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc0b6420 con 0x7ff5c006fec0 2023-12-19T18:59:18.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5b67fc640 1 -- 172.21.15.133:0/949125239 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc0b6580 con 0x7ff5c006fec0 2023-12-19T18:59:18.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5b67fc640 1 -- 172.21.15.133:0/949125239 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc0b6930 con 0x7ff5c006fec0 2023-12-19T18:59:18.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c7f9d640 1 -- 172.21.15.133:0/949125239 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c00a3cc0 con 0x7ff5c006fec0 2023-12-19T18:59:18.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.931+0000 7ff5c7f9d640 1 -- 172.21.15.133:0/949125239 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c006de30 con 0x7ff5c006fec0 2023-12-19T18:59:18.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.935+0000 7ff5c7f9d640 1 -- 172.21.15.133:0/949125239 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c0068400 con 0x7ff5c006fec0 2023-12-19T18:59:18.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.935+0000 7ff5b67fc640 1 -- 172.21.15.133:0/949125239 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff5bc0b2040 con 0x7ff5c006fec0 2023-12-19T18:59:18.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.935+0000 7ff5b67fc640 1 --2- 172.21.15.133:0/949125239 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5a4066470 0x7ff5a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:18.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.935+0000 7ff5b67fc640 1 -- 172.21.15.133:0/949125239 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff5bc11e290 con 0x7ff5c006fec0 2023-12-19T18:59:18.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.935+0000 7ff5c5538640 1 --2- 172.21.15.133:0/949125239 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5a4066470 0x7ff5a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:18.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.935+0000 7ff5c5538640 1 --2- 172.21.15.133:0/949125239 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5a4066470 0x7ff5a4068930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff5c015f650 tx=0x7ff5b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:18.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:18.939+0000 7ff5b67fc640 1 -- 172.21.15.133:0/949125239 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff5bc0eb6a0 con 0x7ff5c006fec0 2023-12-19T18:59:19.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.091+0000 7ff5c7f9d640 1 -- 172.21.15.133:0/949125239 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff5c00a9220 con 0x7ff5c006fec0 2023-12-19T18:59:19.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.719+0000 7ff5b67fc640 1 -- 172.21.15.133:0/949125239 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff5bc0eecc0 con 0x7ff5c006fec0 2023-12-19T18:59:19.723 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2023-12-19T18:59:19.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.719+0000 7ff5c7f9d640 1 -- 172.21.15.133:0/949125239 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5a4066470 msgr2=0x7ff5a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:19.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.719+0000 7ff5c7f9d640 1 --2- 172.21.15.133:0/949125239 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5a4066470 0x7ff5a4068930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff5c015f650 tx=0x7ff5b0008040 comp rx=0 tx=0).stop 2023-12-19T18:59:19.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.719+0000 7ff5c7f9d640 1 -- 172.21.15.133:0/949125239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5c006fec0 msgr2=0x7ff5c00a3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:19.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.719+0000 7ff5c7f9d640 1 --2- 172.21.15.133:0/949125239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5c006fec0 0x7ff5c00a3240 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc0ae040 tx=0x7ff5bc01ac30 comp rx=0 tx=0).stop 2023-12-19T18:59:19.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.719+0000 7ff5c7f9d640 1 -- 172.21.15.133:0/949125239 shutdown_connections 2023-12-19T18:59:19.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.719+0000 7ff5c7f9d640 1 --2- 172.21.15.133:0/949125239 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5a4066470 0x7ff5a4068930 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:19.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.719+0000 7ff5c7f9d640 1 --2- 172.21.15.133:0/949125239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5c00c1250 0x7ff5c01f0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:19.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.719+0000 7ff5c7f9d640 1 --2- 172.21.15.133:0/949125239 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5c00c0aa0 0x7ff5c00a3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:19.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.719+0000 7ff5c7f9d640 1 --2- 172.21.15.133:0/949125239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5c006fec0 0x7ff5c00a3240 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:19.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.719+0000 7ff5c7f9d640 1 -- 172.21.15.133:0/949125239 >> 172.21.15.133:0/949125239 conn(0x7ff5c00c5d40 msgr2=0x7ff5c0157430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:19.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.719+0000 7ff5c7f9d640 1 -- 172.21.15.133:0/949125239 shutdown_connections 2023-12-19T18:59:19.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.719+0000 7ff5c7f9d640 1 -- 172.21.15.133:0/949125239 wait complete. 2023-12-19T18:59:19.747 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T18:59:19.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.891+0000 7f2287fff640 1 Processor -- start 2023-12-19T18:59:19.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.891+0000 7f2287fff640 1 -- start start 2023-12-19T18:59:19.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.895+0000 7f2287fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22880c0560 0x7f22880c0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:19.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.895+0000 7f2287fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f22880c54d0 0x7f22880c1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:19.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.895+0000 7f2287fff640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22880bf3a0 con 0x7f2288071fd0 2023-12-19T18:59:19.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.895+0000 7f2287fff640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22880c4e10 con 0x7f22880c54d0 2023-12-19T18:59:19.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.895+0000 7f2287fff640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22880bf030 con 0x7f22880c0560 2023-12-19T18:59:19.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.895+0000 7f2286ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22880c0560 0x7f22880c0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:19.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.895+0000 7f2286ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22880c0560 0x7f22880c0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:41930/0 (socket says 172.21.15.133:41930) 2023-12-19T18:59:19.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.895+0000 7f2286ffd640 1 -- 172.21.15.133:0/1058396595 learned_addr learned my addr 172.21.15.133:0/1058396595 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:19.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.899+0000 7f22867fc640 1 --2- 172.21.15.133:0/1058396595 >> v2:172.21.15.133:3300/0 conn(0x7f22880c54d0 0x7f22880c1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:19.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.899+0000 7f2285ffb640 1 -- 172.21.15.133:0/1058396595 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2496758906 0 0) 0x7f22880bf3a0 con 0x7f2288071fd0 2023-12-19T18:59:19.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.899+0000 7f2285ffb640 1 -- 172.21.15.133:0/1058396595 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2270003530 con 0x7f2288071fd0 2023-12-19T18:59:19.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.899+0000 7f22867fc640 1 -- 172.21.15.133:0/1058396595 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22880c0560 msgr2=0x7f22880c0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:19.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.899+0000 7f22867fc640 1 --2- 172.21.15.133:0/1058396595 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22880c0560 0x7f22880c0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:19.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.899+0000 7f22867fc640 1 -- 172.21.15.133:0/1058396595 >> v1:172.21.15.133:6789/0 conn(0x7f2288071fd0 legacy=0x7f22880c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:19.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.899+0000 7f22867fc640 1 -- 172.21.15.133:0/1058396595 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22880c50f0 con 0x7f22880c54d0 2023-12-19T18:59:19.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.907+0000 7f22867fc640 1 --2- 172.21.15.133:0/1058396595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22880c54d0 0x7f22880c1020 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f227c0097c0 tx=0x7f227c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e980658034b97e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:19.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.907+0000 7f2285ffb640 1 -- 172.21.15.133:0/1058396595 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c0ab600 con 0x7f22880c54d0 2023-12-19T18:59:19.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.907+0000 7f2285ffb640 1 -- 172.21.15.133:0/1058396595 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227c0a7050 con 0x7f22880c54d0 2023-12-19T18:59:19.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.907+0000 7f2285ffb640 1 -- 172.21.15.133:0/1058396595 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c0ab980 con 0x7f22880c54d0 2023-12-19T18:59:19.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.907+0000 7f2287fff640 1 -- 172.21.15.133:0/1058396595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22880c54d0 msgr2=0x7f22880c1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:19.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.907+0000 7f2287fff640 1 --2- 172.21.15.133:0/1058396595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22880c54d0 0x7f22880c1020 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f227c0097c0 tx=0x7f227c01c3f0 comp rx=0 tx=0).stop 2023-12-19T18:59:19.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.907+0000 7f2287fff640 1 -- 172.21.15.133:0/1058396595 shutdown_connections 2023-12-19T18:59:19.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.907+0000 7f2287fff640 1 --2- 172.21.15.133:0/1058396595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22880c54d0 0x7f22880c1020 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:19.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.907+0000 7f2287fff640 1 --2- 172.21.15.133:0/1058396595 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f22880c0560 0x7f22880c0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:19.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.907+0000 7f2287fff640 1 -- 172.21.15.133:0/1058396595 >> 172.21.15.133:0/1058396595 conn(0x7f22880c2660 msgr2=0x7f22880c2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:19.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.907+0000 7f2287fff640 1 -- 172.21.15.133:0/1058396595 shutdown_connections 2023-12-19T18:59:19.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.907+0000 7f2287fff640 1 -- 172.21.15.133:0/1058396595 wait complete. 2023-12-19T18:59:19.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.911+0000 7f2287fff640 1 Processor -- start 2023-12-19T18:59:19.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.911+0000 7f2287fff640 1 -- start start 2023-12-19T18:59:19.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.911+0000 7f2287fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2288071fd0 0x7f2288147650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:19.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.911+0000 7f2287fff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22880c0560 0x7f2288157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:19.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.911+0000 7f2287fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22880c54d0 0x7f2288158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:19.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.911+0000 7f2287fff640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228814bce0 con 0x7f22880c54d0 2023-12-19T18:59:19.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.911+0000 7f2287fff640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228814a900 con 0x7f22880c0560 2023-12-19T18:59:19.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.911+0000 7f2287fff640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f228814bf30 con 0x7f2288071fd0 2023-12-19T18:59:19.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.911+0000 7f2286ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2288071fd0 0x7f2288147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:19.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.911+0000 7f22867fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22880c0560 0x7f2288157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:19.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.911+0000 7f2286ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2288071fd0 0x7f2288147650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:41938/0 (socket says 172.21.15.133:41938) 2023-12-19T18:59:19.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.911+0000 7f22867fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22880c0560 0x7f2288157d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:38562/0 (socket says 172.21.15.133:38562) 2023-12-19T18:59:19.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.911+0000 7f2286ffd640 1 -- 172.21.15.133:0/3601167172 learned_addr learned my addr 172.21.15.133:0/3601167172 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:19.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.911+0000 7f2286ffd640 1 -- 172.21.15.133:0/3601167172 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22880c0560 msgr2=0x7f2288157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:19.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.911+0000 7f2286ffd640 1 --2- 172.21.15.133:0/3601167172 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22880c0560 0x7f2288157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:19.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.911+0000 7f2286ffd640 1 -- 172.21.15.133:0/3601167172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22880c54d0 msgr2=0x7f2288158270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T18:59:19.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.911+0000 7f2286ffd640 1 --2- 172.21.15.133:0/3601167172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22880c54d0 0x7f2288158270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:19.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.911+0000 7f2286ffd640 1 -- 172.21.15.133:0/3601167172 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c009420 con 0x7f2288071fd0 2023-12-19T18:59:19.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.911+0000 7f22867fc640 1 --2- 172.21.15.133:0/3601167172 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22880c0560 0x7f2288157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:59:19.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.911+0000 7f2286ffd640 1 --2- 172.21.15.133:0/3601167172 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2288071fd0 0x7f2288147650 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f227800e890 tx=0x7f227800ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:19.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.915+0000 7f226f7fe640 1 -- 172.21.15.133:0/3601167172 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2278009620 con 0x7f2288071fd0 2023-12-19T18:59:19.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.915+0000 7f226f7fe640 1 -- 172.21.15.133:0/3601167172 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227800c940 con 0x7f2288071fd0 2023-12-19T18:59:19.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.915+0000 7f2287fff640 1 -- 172.21.15.133:0/3601167172 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2288155830 con 0x7f2288071fd0 2023-12-19T18:59:19.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.915+0000 7f226f7fe640 1 -- 172.21.15.133:0/3601167172 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227800ccb0 con 0x7f2288071fd0 2023-12-19T18:59:19.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.915+0000 7f2287fff640 1 -- 172.21.15.133:0/3601167172 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2288147b90 con 0x7f2288071fd0 2023-12-19T18:59:19.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.915+0000 7f2287fff640 1 -- 172.21.15.133:0/3601167172 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f228804e850 con 0x7f2288071fd0 2023-12-19T18:59:19.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.919+0000 7f226f7fe640 1 -- 172.21.15.133:0/3601167172 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2278013470 con 0x7f2288071fd0 2023-12-19T18:59:19.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.919+0000 7f226f7fe640 1 --2- 172.21.15.133:0/3601167172 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f22740664c0 0x7f2274068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:19.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.919+0000 7f226f7fe640 1 -- 172.21.15.133:0/3601167172 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f2278083d80 con 0x7f2288071fd0 2023-12-19T18:59:19.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.919+0000 7f22867fc640 1 --2- 172.21.15.133:0/3601167172 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f22740664c0 0x7f2274068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:19.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.919+0000 7f22867fc640 1 --2- 172.21.15.133:0/3601167172 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f22740664c0 0x7f2274068980 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f227c0ad000 tx=0x7f227c0a4f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:19.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:19.923+0000 7f226f7fe640 1 -- 172.21.15.133:0/3601167172 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2278051480 con 0x7f2288071fd0 2023-12-19T18:59:20.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.079+0000 7f2287fff640 1 -- 172.21.15.133:0/3601167172 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2288071db0 con 0x7f2288071fd0 2023-12-19T18:59:20.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.727+0000 7f226f7fe640 1 -- 172.21.15.133:0/3601167172 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2278054aa0 con 0x7f2288071fd0 2023-12-19T18:59:20.735 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2023-12-19T18:59:20.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.731+0000 7f2287fff640 1 -- 172.21.15.133:0/3601167172 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f22740664c0 msgr2=0x7f2274068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:20.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.731+0000 7f2287fff640 1 --2- 172.21.15.133:0/3601167172 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f22740664c0 0x7f2274068980 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f227c0ad000 tx=0x7f227c0a4f90 comp rx=0 tx=0).stop 2023-12-19T18:59:20.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.731+0000 7f2287fff640 1 -- 172.21.15.133:0/3601167172 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2288071fd0 msgr2=0x7f2288147650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:20.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.731+0000 7f2287fff640 1 --2- 172.21.15.133:0/3601167172 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2288071fd0 0x7f2288147650 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f227800e890 tx=0x7f227800ed50 comp rx=0 tx=0).stop 2023-12-19T18:59:20.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.731+0000 7f2287fff640 1 -- 172.21.15.133:0/3601167172 shutdown_connections 2023-12-19T18:59:20.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.731+0000 7f2287fff640 1 --2- 172.21.15.133:0/3601167172 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f22740664c0 0x7f2274068980 secure :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f227c0ad000 tx=0x7f227c0a4f90 comp rx=0 tx=0).stop 2023-12-19T18:59:20.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.731+0000 7f2287fff640 1 --2- 172.21.15.133:0/3601167172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f22880c54d0 0x7f2288158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:20.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.731+0000 7f2287fff640 1 --2- 172.21.15.133:0/3601167172 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f22880c0560 0x7f2288157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:20.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.735+0000 7f2287fff640 1 --2- 172.21.15.133:0/3601167172 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2288071fd0 0x7f2288147650 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:20.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.735+0000 7f2287fff640 1 -- 172.21.15.133:0/3601167172 >> 172.21.15.133:0/3601167172 conn(0x7f22880c2660 msgr2=0x7f2288150e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:20.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.735+0000 7f2287fff640 1 -- 172.21.15.133:0/3601167172 shutdown_connections 2023-12-19T18:59:20.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.739+0000 7f2287fff640 1 -- 172.21.15.133:0/3601167172 wait complete. 2023-12-19T18:59:20.770 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T18:59:20.771 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T18:59:20.771 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T18:59:20.771 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:59:20.771 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T18:59:20.771 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T18:59:20.771 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T18:59:20.771 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:59:20.772 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T18:59:20.772 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T18:59:20.772 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T18:59:20.772 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:59:20.772 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T18:59:20.772 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T18:59:20.772 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T18:59:20.772 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:59:20.787 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T18:59:20.787 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T18:59:20.788 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T18:59:20.788 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T18:59:20.790 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T18:59:20.790 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T18:59:20.794 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T18:59:20.795 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T18:59:20.838 INFO:tasks.ceph.mds.c:Started 2023-12-19T18:59:20.838 DEBUG:teuthology.parallel:result is None 2023-12-19T18:59:20.840 INFO:tasks.ceph.mds.a:Started 2023-12-19T18:59:20.840 DEBUG:teuthology.parallel:result is None 2023-12-19T18:59:20.845 INFO:tasks.ceph.mds.b:Started 2023-12-19T18:59:20.845 DEBUG:teuthology.parallel:result is None 2023-12-19T18:59:20.848 INFO:tasks.ceph.mds.d:Started 2023-12-19T18:59:20.848 DEBUG:teuthology.parallel:result is None 2023-12-19T18:59:20.848 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T18:59:20.932 INFO:tasks.ceph.mds.d.smithi138.stdout:starting mds.d at 2023-12-19T18:59:20.933 INFO:tasks.ceph.mds.b.smithi138.stdout:starting mds.b at 2023-12-19T18:59:20.934 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2023-12-19T18:59:20.935 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2023-12-19T18:59:21.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.995+0000 7f54816e3640 1 Processor -- start 2023-12-19T18:59:21.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.995+0000 7f54816e3640 1 -- start start 2023-12-19T18:59:21.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.995+0000 7f54816e3640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f547c0c7ea0 0x7f547c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:21.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.995+0000 7f54816e3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f547c06b9e0 0x7f547c15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:21.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.995+0000 7f54816e3640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f547c06c860 con 0x7f547c151e90 2023-12-19T18:59:21.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.995+0000 7f54816e3640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f547c0c8750 con 0x7f547c0c7ea0 2023-12-19T18:59:21.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.995+0000 7f54816e3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547c1552d0 con 0x7f547c06b9e0 2023-12-19T18:59:21.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.995+0000 7f547affd640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f547c151e90 0x7f547c0c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:38766/0 (socket says 172.21.15.133:38766) 2023-12-19T18:59:21.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.995+0000 7f547b7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f547c06b9e0 0x7f547c15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:21.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.995+0000 7f54727fc640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f547c0c7ea0 0x7f547c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:21.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.995+0000 7f547affd640 1 -- 172.21.15.133:0/129820648 learned_addr learned my addr 172.21.15.133:0/129820648 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:21.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.999+0000 7f547a7fc640 1 -- 172.21.15.133:0/129820648 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 483196092 0 0) 0x7f547c06c860 con 0x7f547c151e90 2023-12-19T18:59:21.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.999+0000 7f54727fc640 1 -- 172.21.15.133:0/129820648 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f547c06b9e0 msgr2=0x7f547c15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:21.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.999+0000 7f54727fc640 1 --2- 172.21.15.133:0/129820648 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f547c06b9e0 0x7f547c15f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:21.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.999+0000 7f54727fc640 1 -- 172.21.15.133:0/129820648 >> v1:172.21.15.138:6789/0 conn(0x7f547c151e90 legacy=0x7f547c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:21.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.999+0000 7f54727fc640 1 -- 172.21.15.133:0/129820648 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f547c154930 con 0x7f547c0c7ea0 2023-12-19T18:59:21.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.999+0000 7f54727fc640 1 --2- 172.21.15.133:0/129820648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f547c0c7ea0 0x7f547c06b4a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f546c0097c0 tx=0x7f546c01c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a127854bcec0d08 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:21.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.999+0000 7f547a7fc640 1 -- 172.21.15.133:0/129820648 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c0ab600 con 0x7f547c0c7ea0 2023-12-19T18:59:21.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.999+0000 7f547a7fc640 1 -- 172.21.15.133:0/129820648 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546c0a7050 con 0x7f547c0c7ea0 2023-12-19T18:59:21.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:20.999+0000 7f547a7fc640 1 -- 172.21.15.133:0/129820648 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546c0ab980 con 0x7f547c0c7ea0 2023-12-19T18:59:21.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.003+0000 7f54816e3640 1 -- 172.21.15.133:0/129820648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f547c0c7ea0 msgr2=0x7f547c06b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:21.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.003+0000 7f54816e3640 1 --2- 172.21.15.133:0/129820648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f547c0c7ea0 0x7f547c06b4a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f546c0097c0 tx=0x7f546c01c360 comp rx=0 tx=0).stop 2023-12-19T18:59:21.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.003+0000 7f54816e3640 1 -- 172.21.15.133:0/129820648 shutdown_connections 2023-12-19T18:59:21.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.003+0000 7f54816e3640 1 --2- 172.21.15.133:0/129820648 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f547c06b9e0 0x7f547c15f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:21.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.003+0000 7f54816e3640 1 --2- 172.21.15.133:0/129820648 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f547c0c7ea0 0x7f547c06b4a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:21.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.003+0000 7f54816e3640 1 -- 172.21.15.133:0/129820648 >> 172.21.15.133:0/129820648 conn(0x7f547c0ca170 msgr2=0x7f547c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:21.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.003+0000 7f54816e3640 1 -- 172.21.15.133:0/129820648 shutdown_connections 2023-12-19T18:59:21.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.003+0000 7f54816e3640 1 -- 172.21.15.133:0/129820648 wait complete. 2023-12-19T18:59:21.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.003+0000 7f54816e3640 1 Processor -- start 2023-12-19T18:59:21.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.003+0000 7f54816e3640 1 -- start start 2023-12-19T18:59:21.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.003+0000 7f54816e3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f547c06b9e0 0x7f547c157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:21.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.003+0000 7f54816e3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f547c0c7ea0 0x7f547c149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:21.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.003+0000 7f54816e3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f547c151e90 0x7f547c149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:21.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.003+0000 7f54816e3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0ada70 con 0x7f547c06b9e0 2023-12-19T18:59:21.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.003+0000 7f54816e3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0c36d0 con 0x7f547c0c7ea0 2023-12-19T18:59:21.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.003+0000 7f54816e3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f547c0c2990 con 0x7f547c151e90 2023-12-19T18:59:21.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.003+0000 7f547affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f547c06b9e0 0x7f547c157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:21.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.003+0000 7f547b7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f547c151e90 0x7f547c149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:21.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.003+0000 7f54727fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f547c0c7ea0 0x7f547c149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:21.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.003+0000 7f547b7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f547c151e90 0x7f547c149750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:41980/0 (socket says 172.21.15.133:41980) 2023-12-19T18:59:21.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.003+0000 7f547b7fe640 1 -- 172.21.15.133:0/1678433250 learned_addr learned my addr 172.21.15.133:0/1678433250 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:21.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.003+0000 7f547affd640 1 --2- 172.21.15.133:0/1678433250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f547c06b9e0 0x7f547c157f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38098/0 (socket says 172.21.15.133:38098) 2023-12-19T18:59:21.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.007+0000 7f547affd640 1 -- 172.21.15.133:0/1678433250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f547c151e90 msgr2=0x7f547c149750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:21.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.007+0000 7f547affd640 1 --2- 172.21.15.133:0/1678433250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f547c151e90 0x7f547c149750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:21.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.007+0000 7f547affd640 1 -- 172.21.15.133:0/1678433250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f547c0c7ea0 msgr2=0x7f547c149210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:21.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.007+0000 7f547affd640 1 --2- 172.21.15.133:0/1678433250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f547c0c7ea0 0x7f547c149210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:21.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.007+0000 7f547affd640 1 -- 172.21.15.133:0/1678433250 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546c009420 con 0x7f547c06b9e0 2023-12-19T18:59:21.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.007+0000 7f547b7fe640 1 --2- 172.21.15.133:0/1678433250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f547c151e90 0x7f547c149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:59:21.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.007+0000 7f54727fc640 1 --2- 172.21.15.133:0/1678433250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f547c0c7ea0 0x7f547c149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:59:21.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.007+0000 7f547affd640 1 --2- 172.21.15.133:0/1678433250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f547c06b9e0 0x7f547c157f40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f546400c460 tx=0x7f546400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:21.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.007+0000 7f5473fff640 1 -- 172.21.15.133:0/1678433250 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54640074e0 con 0x7f547c06b9e0 2023-12-19T18:59:21.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.007+0000 7f5473fff640 1 -- 172.21.15.133:0/1678433250 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5464007660 con 0x7f547c06b9e0 2023-12-19T18:59:21.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.007+0000 7f54816e3640 1 -- 172.21.15.133:0/1678433250 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547c0c2be0 con 0x7f547c06b9e0 2023-12-19T18:59:21.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.007+0000 7f5473fff640 1 -- 172.21.15.133:0/1678433250 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5464004a30 con 0x7f547c06b9e0 2023-12-19T18:59:21.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.007+0000 7f54816e3640 1 -- 172.21.15.133:0/1678433250 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f547c0c3bc0 con 0x7f547c06b9e0 2023-12-19T18:59:21.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.007+0000 7f54816e3640 1 -- 172.21.15.133:0/1678433250 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f547c0c5d70 con 0x7f547c06b9e0 2023-12-19T18:59:21.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.007+0000 7f5473fff640 1 -- 172.21.15.133:0/1678433250 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5464004b90 con 0x7f547c06b9e0 2023-12-19T18:59:21.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.007+0000 7f5473fff640 1 --2- 172.21.15.133:0/1678433250 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f545c066470 0x7f545c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:21.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.007+0000 7f5473fff640 1 -- 172.21.15.133:0/1678433250 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5464082ca0 con 0x7f547c06b9e0 2023-12-19T18:59:21.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.011+0000 7f54727fc640 1 --2- 172.21.15.133:0/1678433250 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f545c066470 0x7f545c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:21.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.011+0000 7f54727fc640 1 --2- 172.21.15.133:0/1678433250 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f545c066470 0x7f545c068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f546c0ad000 tx=0x7f546c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:21.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.011+0000 7f5473fff640 1 -- 172.21.15.133:0/1678433250 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5464050600 con 0x7f547c06b9e0 2023-12-19T18:59:21.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.175+0000 7f54816e3640 1 -- 172.21.15.133:0/1678433250 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f547c068400 con 0x7f547c06b9e0 2023-12-19T18:59:21.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.739+0000 7f5473fff640 1 -- 172.21.15.133:0/1678433250 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5464018070 con 0x7f547c06b9e0 2023-12-19T18:59:21.743 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blocklist entries 2023-12-19T18:59:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.743+0000 7f54816e3640 1 -- 172.21.15.133:0/1678433250 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f545c066470 msgr2=0x7f545c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.743+0000 7f54816e3640 1 --2- 172.21.15.133:0/1678433250 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f545c066470 0x7f545c068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f546c0ad000 tx=0x7f546c0a6000 comp rx=0 tx=0).stop 2023-12-19T18:59:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.743+0000 7f54816e3640 1 -- 172.21.15.133:0/1678433250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f547c06b9e0 msgr2=0x7f547c157f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:21.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.743+0000 7f54816e3640 1 --2- 172.21.15.133:0/1678433250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f547c06b9e0 0x7f547c157f40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f546400c460 tx=0x7f546400c920 comp rx=0 tx=0).stop 2023-12-19T18:59:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.743+0000 7f54816e3640 1 -- 172.21.15.133:0/1678433250 shutdown_connections 2023-12-19T18:59:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.743+0000 7f54816e3640 1 --2- 172.21.15.133:0/1678433250 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f545c066470 0x7f545c068930 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.743+0000 7f54816e3640 1 --2- 172.21.15.133:0/1678433250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f547c151e90 0x7f547c149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.743+0000 7f54816e3640 1 --2- 172.21.15.133:0/1678433250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f547c0c7ea0 0x7f547c149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.743+0000 7f54816e3640 1 --2- 172.21.15.133:0/1678433250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f547c06b9e0 0x7f547c157f40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.743+0000 7f54816e3640 1 -- 172.21.15.133:0/1678433250 >> 172.21.15.133:0/1678433250 conn(0x7f547c0ca170 msgr2=0x7f547c0c4820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.743+0000 7f54816e3640 1 -- 172.21.15.133:0/1678433250 shutdown_connections 2023-12-19T18:59:21.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.743+0000 7f54816e3640 1 -- 172.21.15.133:0/1678433250 wait complete. 2023-12-19T18:59:21.773 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T18:59:21.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.911+0000 7ff4302c9640 1 Processor -- start 2023-12-19T18:59:21.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.911+0000 7ff4302c9640 1 -- start start 2023-12-19T18:59:21.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.911+0000 7ff4302c9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff4280c5640 0x7ff4280c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:21.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.911+0000 7ff4302c9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4280c60f0 0x7ff428155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:21.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.911+0000 7ff4302c9640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4280c2580 con 0x7ff4280c5260 2023-12-19T18:59:21.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.911+0000 7ff4302c9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff428153510 con 0x7ff4280c5640 2023-12-19T18:59:21.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.911+0000 7ff4302c9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4280c17f0 con 0x7ff4280c60f0 2023-12-19T18:59:21.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.911+0000 7ff42e866640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4280c60f0 0x7ff428155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:21.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.911+0000 7ff42d864640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff4280c5640 0x7ff4280c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:21.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.911+0000 7ff42e866640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4280c60f0 0x7ff428155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:41982/0 (socket says 172.21.15.133:41982) 2023-12-19T18:59:21.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.911+0000 7ff42e866640 1 -- 172.21.15.133:0/4107517100 learned_addr learned my addr 172.21.15.133:0/4107517100 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:21.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.911+0000 7ff42d864640 1 -- 172.21.15.133:0/4107517100 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4280c60f0 msgr2=0x7ff428155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:21.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.911+0000 7ff42d864640 1 --2- 172.21.15.133:0/4107517100 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4280c60f0 0x7ff428155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:21.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.911+0000 7ff42d864640 1 -- 172.21.15.133:0/4107517100 >> v1:172.21.15.138:6789/0 conn(0x7ff4280c5260 legacy=0x7ff42806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:21.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.911+0000 7ff42d063640 1 -- 172.21.15.133:0/4107517100 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2647078520 0 0) 0x7ff4280c2580 con 0x7ff4280c5260 2023-12-19T18:59:21.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.911+0000 7ff42d864640 1 -- 172.21.15.133:0/4107517100 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4280c1a00 con 0x7ff4280c5640 2023-12-19T18:59:21.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.911+0000 7ff42e866640 1 --2- 172.21.15.133:0/4107517100 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4280c60f0 0x7ff428155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:59:21.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.915+0000 7ff42d864640 1 --2- 172.21.15.133:0/4107517100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4280c5640 0x7ff4280c5bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff4280c1930 tx=0x7ff41801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdcf2a4e808bc9ca server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:21.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.915+0000 7ff42d063640 1 -- 172.21.15.133:0/4107517100 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4180ab600 con 0x7ff4280c5640 2023-12-19T18:59:21.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.915+0000 7ff42d063640 1 -- 172.21.15.133:0/4107517100 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4180a7050 con 0x7ff4280c5640 2023-12-19T18:59:21.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.915+0000 7ff42d063640 1 -- 172.21.15.133:0/4107517100 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4180ab980 con 0x7ff4280c5640 2023-12-19T18:59:21.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.915+0000 7ff4302c9640 1 -- 172.21.15.133:0/4107517100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4280c5640 msgr2=0x7ff4280c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:21.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.915+0000 7ff4302c9640 1 --2- 172.21.15.133:0/4107517100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4280c5640 0x7ff4280c5bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff4280c1930 tx=0x7ff41801c3c0 comp rx=0 tx=0).stop 2023-12-19T18:59:21.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.915+0000 7ff4302c9640 1 -- 172.21.15.133:0/4107517100 shutdown_connections 2023-12-19T18:59:21.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.915+0000 7ff4302c9640 1 --2- 172.21.15.133:0/4107517100 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4280c60f0 0x7ff428155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:21.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.915+0000 7ff4302c9640 1 --2- 172.21.15.133:0/4107517100 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4280c5640 0x7ff4280c5bb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:21.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.915+0000 7ff4302c9640 1 -- 172.21.15.133:0/4107517100 >> 172.21.15.133:0/4107517100 conn(0x7ff42806a5b0 msgr2=0x7ff42806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:21.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.915+0000 7ff4302c9640 1 -- 172.21.15.133:0/4107517100 shutdown_connections 2023-12-19T18:59:21.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.915+0000 7ff4302c9640 1 -- 172.21.15.133:0/4107517100 wait complete. 2023-12-19T18:59:21.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff4302c9640 1 Processor -- start 2023-12-19T18:59:21.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff4302c9640 1 -- start start 2023-12-19T18:59:21.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff4302c9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4280c5260 0x7ff428151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:21.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff4302c9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4280c5640 0x7ff42814ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:21.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff4302c9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4280c60f0 0x7ff42814f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:21.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff4302c9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff428157290 con 0x7ff4280c5260 2023-12-19T18:59:21.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff4302c9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff428156e00 con 0x7ff4280c5640 2023-12-19T18:59:21.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff4302c9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4280aa050 con 0x7ff4280c60f0 2023-12-19T18:59:21.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff42e065640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4280c5260 0x7ff428151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:21.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff42e065640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4280c5260 0x7ff428151750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38104/0 (socket says 172.21.15.133:38104) 2023-12-19T18:59:21.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff42e065640 1 -- 172.21.15.133:0/1454755595 learned_addr learned my addr 172.21.15.133:0/1454755595 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:21.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff42d864640 1 --2- 172.21.15.133:0/1454755595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4280c5640 0x7ff42814ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:21.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff42e866640 1 --2- 172.21.15.133:0/1454755595 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4280c60f0 0x7ff42814f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:21.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff42e065640 1 -- 172.21.15.133:0/1454755595 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4280c60f0 msgr2=0x7ff42814f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:21.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff42e065640 1 --2- 172.21.15.133:0/1454755595 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4280c60f0 0x7ff42814f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:21.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff42e065640 1 -- 172.21.15.133:0/1454755595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4280c5640 msgr2=0x7ff42814ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:21.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff42e065640 1 --2- 172.21.15.133:0/1454755595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4280c5640 0x7ff42814ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:21.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff42e065640 1 -- 172.21.15.133:0/1454755595 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff420009b30 con 0x7ff4280c5260 2023-12-19T18:59:21.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff42d864640 1 --2- 172.21.15.133:0/1454755595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4280c5640 0x7ff42814ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:59:21.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff42e065640 1 --2- 172.21.15.133:0/1454755595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4280c5260 0x7ff428151750 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff424001ec0 tx=0x7ff42400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:21.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff41effd640 1 -- 172.21.15.133:0/1454755595 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4240054e0 con 0x7ff4280c5260 2023-12-19T18:59:21.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff41effd640 1 -- 172.21.15.133:0/1454755595 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff424003600 con 0x7ff4280c5260 2023-12-19T18:59:21.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff41effd640 1 -- 172.21.15.133:0/1454755595 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4240039b0 con 0x7ff4280c5260 2023-12-19T18:59:21.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff4302c9640 1 -- 172.21.15.133:0/1454755595 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff418009420 con 0x7ff4280c5260 2023-12-19T18:59:21.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.919+0000 7ff4302c9640 1 -- 172.21.15.133:0/1454755595 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4280aaaa0 con 0x7ff4280c5260 2023-12-19T18:59:21.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.923+0000 7ff4302c9640 1 -- 172.21.15.133:0/1454755595 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff428068400 con 0x7ff4280c5260 2023-12-19T18:59:21.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.923+0000 7ff41effd640 1 -- 172.21.15.133:0/1454755595 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff424003b10 con 0x7ff4280c5260 2023-12-19T18:59:21.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.923+0000 7ff41effd640 1 --2- 172.21.15.133:0/1454755595 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff40c0664a0 0x7ff40c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:21.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.923+0000 7ff41effd640 1 -- 172.21.15.133:0/1454755595 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff424082ff0 con 0x7ff4280c5260 2023-12-19T18:59:21.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.923+0000 7ff42d864640 1 --2- 172.21.15.133:0/1454755595 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff40c0664a0 0x7ff40c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:21.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.923+0000 7ff42d864640 1 --2- 172.21.15.133:0/1454755595 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff40c0664a0 0x7ff40c068960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff4180ad000 tx=0x7ff418008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:21.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:21.927+0000 7ff41effd640 1 -- 172.21.15.133:0/1454755595 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff4240b4290 con 0x7ff4280c5260 2023-12-19T18:59:22.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.127+0000 7ff4302c9640 1 -- 172.21.15.133:0/1454755595 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff4280c0a80 con 0x7ff4280c5260 2023-12-19T18:59:22.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.127+0000 7ff41effd640 1 -- 172.21.15.133:0/1454755595 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6065 (secure 0 0 0) 0x7ff424017070 con 0x7ff4280c5260 2023-12-19T18:59:22.134 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:22.134 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-19T18:59:22.134 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2023-12-19T18:59:22.134 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:22.135 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2023-12-19T18:59:22.135 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54FlwoplHxAAVjcRzu+wQdwT5Mzra21oYw==", 2023-12-19T18:59:22.135 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T18:59:22.135 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-19T18:59:22.135 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-19T18:59:22.135 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-19T18:59:22.135 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T18:59:22.135 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.135 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:22.135 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:22.135 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2023-12-19T18:59:22.136 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54Fl5g/pKxAA/I3R1pRmk8mQOBa4FoGj8g==", 2023-12-19T18:59:22.136 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T18:59:22.136 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-19T18:59:22.136 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-19T18:59:22.136 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-19T18:59:22.136 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T18:59:22.136 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.136 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:22.136 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:22.136 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2023-12-19T18:59:22.136 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54FlWEW0JhAAMd5FSzdRUAJgoSga/f0RCw==", 2023-12-19T18:59:22.137 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T18:59:22.137 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-19T18:59:22.137 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-19T18:59:22.137 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-19T18:59:22.137 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T18:59:22.137 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.137 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:22.137 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:22.137 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.d", 2023-12-19T18:59:22.137 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54FllCg0MxAAwWY3wtGD5Om88qWPkpzVhw==", 2023-12-19T18:59:22.137 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T18:59:22.137 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-19T18:59:22.138 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-19T18:59:22.138 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-19T18:59:22.138 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T18:59:22.138 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.138 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:22.138 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:22.138 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2023-12-19T18:59:22.138 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCr54FlMNpECRAAMTwNBHtXhYqqZ2BjCRh9MQ==", 2023-12-19T18:59:22.138 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T18:59:22.138 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T18:59:22.138 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T18:59:22.138 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T18:59:22.139 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.139 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:22.139 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:22.139 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2023-12-19T18:59:22.139 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCu54FlebMLERAADuy4l18uDpuzQTlHxpa6vg==", 2023-12-19T18:59:22.139 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T18:59:22.139 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T18:59:22.139 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T18:59:22.139 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T18:59:22.139 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:22.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:22.140 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2023-12-19T18:59:22.140 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCx54FlIGE0FxAAH1d5WYGkA6lc9/1uQ08+vw==", 2023-12-19T18:59:22.140 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T18:59:22.140 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T18:59:22.140 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T18:59:22.140 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T18:59:22.140 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.140 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:22.140 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:22.140 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2023-12-19T18:59:22.140 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQC054Fl6lBFHhAAezVECb7AsJH7i7o805mKYA==", 2023-12-19T18:59:22.141 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T18:59:22.141 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T18:59:22.141 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T18:59:22.141 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T18:59:22.141 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.141 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:22.141 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:22.141 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2023-12-19T18:59:22.141 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQC654Fl2Hw1JBAAFb/W356pK2UkqTbL3k+rgg==", 2023-12-19T18:59:22.141 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T18:59:22.141 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T18:59:22.142 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T18:59:22.142 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T18:59:22.142 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.142 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:22.142 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:22.142 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2023-12-19T18:59:22.142 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQC954FlDNTYKxAAOdTpUouNeNyeKWV4rSkfHA==", 2023-12-19T18:59:22.142 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T18:59:22.142 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T18:59:22.142 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T18:59:22.142 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T18:59:22.142 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.143 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:22.143 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:22.143 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2023-12-19T18:59:22.143 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDA54Fl8V0WMhAAurXUfZDjwkFUcN0/0AvCRA==", 2023-12-19T18:59:22.143 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T18:59:22.143 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T18:59:22.143 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T18:59:22.143 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T18:59:22.143 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:22.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:22.144 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2023-12-19T18:59:22.144 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDD54FlLS76ORAAjLklJxdnUAoGK7D7NMOuQA==", 2023-12-19T18:59:22.144 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T18:59:22.144 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T18:59:22.144 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T18:59:22.144 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T18:59:22.144 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.144 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:22.144 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:22.144 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2023-12-19T18:59:22.145 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54FllfQwNxAAyKIESQDxKvDHfaewx+v88w==", 2023-12-19T18:59:22.145 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T18:59:22.145 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-19T18:59:22.145 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2023-12-19T18:59:22.145 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2023-12-19T18:59:22.145 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2023-12-19T18:59:22.145 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.145 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:22.145 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:22.145 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2023-12-19T18:59:22.145 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54Fl4bbAOhAA4WXKbT5uizIcy0OTOKIaag==", 2023-12-19T18:59:22.145 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T18:59:22.146 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-19T18:59:22.146 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow r", 2023-12-19T18:59:22.146 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw", 2023-12-19T18:59:22.146 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rwx" 2023-12-19T18:59:22.146 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.146 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:22.146 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:22.146 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2023-12-19T18:59:22.146 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54FlrcDgAhAARPWdoItsNLlu+aiRPCG6Tg==", 2023-12-19T18:59:22.146 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T18:59:22.146 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-19T18:59:22.146 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-19T18:59:22.147 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-19T18:59:22.147 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T18:59:22.147 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:22.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:22.147 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-mds", 2023-12-19T18:59:22.147 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDJ54FldQaSMBAANYAc1sfyuA26J0CvzzjxRA==", 2023-12-19T18:59:22.147 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T18:59:22.147 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-mds" 2023-12-19T18:59:22.147 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.147 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:22.147 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:22.148 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-mgr", 2023-12-19T18:59:22.148 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDJ54FlwBCSMBAA+mDWuAus2d8tvk4M9Rq78Q==", 2023-12-19T18:59:22.148 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T18:59:22.148 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-19T18:59:22.148 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.148 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:22.148 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:22.148 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-osd", 2023-12-19T18:59:22.148 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDJ54Fl5RmSMBAAVN7QQq/PSI+BIgvHA+giww==", 2023-12-19T18:59:22.148 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T18:59:22.148 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-osd" 2023-12-19T18:59:22.148 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:22.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:22.149 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-rbd", 2023-12-19T18:59:22.149 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDJ54FlAySSMBAAbfXP4hQpkv60YLQrWH82fA==", 2023-12-19T18:59:22.149 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T18:59:22.149 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-19T18:59:22.149 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.149 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:22.149 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:22.149 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-19T18:59:22.149 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDJ54FlvCySMBAANzi6sTNYLBRdOcCsW/xK4g==", 2023-12-19T18:59:22.149 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T18:59:22.150 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-19T18:59:22.150 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:22.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:22.150 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.bootstrap-rgw", 2023-12-19T18:59:22.150 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDJ54FljTWSMBAAZF4VdRqUD/eTQen50kXaQg==", 2023-12-19T18:59:22.150 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T18:59:22.150 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-19T18:59:22.150 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.150 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:22.150 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:22.150 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2023-12-19T18:59:22.151 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54FlEyVGGxAAleA1zB0F6jgR7QOYMr55Bg==", 2023-12-19T18:59:22.151 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T18:59:22.151 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-19T18:59:22.151 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2023-12-19T18:59:22.151 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T18:59:22.151 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.151 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:22.151 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:22.151 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2023-12-19T18:59:22.151 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54Fl9H5OFxAARCZdZbwW/Mw/x2X1zAvzqg==", 2023-12-19T18:59:22.151 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T18:59:22.151 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-19T18:59:22.151 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2023-12-19T18:59:22.152 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T18:59:22.152 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.152 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:22.152 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2023-12-19T18:59:22.152 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-19T18:59:22.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.131+0000 7ff4302c9640 1 -- 172.21.15.133:0/1454755595 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff40c0664a0 msgr2=0x7ff40c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:22.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.131+0000 7ff4302c9640 1 --2- 172.21.15.133:0/1454755595 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff40c0664a0 0x7ff40c068960 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff4180ad000 tx=0x7ff418008040 comp rx=0 tx=0).stop 2023-12-19T18:59:22.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.131+0000 7ff4302c9640 1 -- 172.21.15.133:0/1454755595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4280c5260 msgr2=0x7ff428151750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:22.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.131+0000 7ff4302c9640 1 --2- 172.21.15.133:0/1454755595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4280c5260 0x7ff428151750 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff424001ec0 tx=0x7ff42400c8e0 comp rx=0 tx=0).stop 2023-12-19T18:59:22.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.131+0000 7ff4302c9640 1 -- 172.21.15.133:0/1454755595 shutdown_connections 2023-12-19T18:59:22.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.131+0000 7ff4302c9640 1 --2- 172.21.15.133:0/1454755595 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff40c0664a0 0x7ff40c068960 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:22.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.131+0000 7ff4302c9640 1 --2- 172.21.15.133:0/1454755595 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff4280c60f0 0x7ff42814f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:22.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.131+0000 7ff4302c9640 1 --2- 172.21.15.133:0/1454755595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4280c5640 0x7ff42814ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:22.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.131+0000 7ff4302c9640 1 --2- 172.21.15.133:0/1454755595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4280c5260 0x7ff428151750 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:22.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.131+0000 7ff4302c9640 1 -- 172.21.15.133:0/1454755595 >> 172.21.15.133:0/1454755595 conn(0x7ff42806a5b0 msgr2=0x7ff42806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:22.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.131+0000 7ff4302c9640 1 -- 172.21.15.133:0/1454755595 shutdown_connections 2023-12-19T18:59:22.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.131+0000 7ff4302c9640 1 -- 172.21.15.133:0/1454755595 wait complete. 2023-12-19T18:59:22.155 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-19T18:59:22.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.287+0000 7ff5e291d640 1 Processor -- start 2023-12-19T18:59:22.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.287+0000 7ff5e291d640 1 -- start start 2023-12-19T18:59:22.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.287+0000 7ff5e291d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5dc073a70 0x7ff5dc0bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:22.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.287+0000 7ff5e291d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff5dc157c20 0x7ff5dc158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:22.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.287+0000 7ff5e291d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5dc06a5b0 con 0x7ff5dc14b010 2023-12-19T18:59:22.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.287+0000 7ff5e291d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5dc06b710 con 0x7ff5dc073a70 2023-12-19T18:59:22.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.287+0000 7ff5e291d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5dc0c1d60 con 0x7ff5dc157c20 2023-12-19T18:59:22.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.287+0000 7ff5dbfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff5dc14b010 0x7ff5dc06b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33816/0 (socket says 172.21.15.133:33816) 2023-12-19T18:59:22.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.287+0000 7ff5dbfff640 1 -- 172.21.15.133:0/3578058851 learned_addr learned my addr 172.21.15.133:0/3578058851 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:22.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.287+0000 7ff5db7fe640 1 --2- 172.21.15.133:0/3578058851 >> v2:172.21.15.133:3300/0 conn(0x7ff5dc073a70 0x7ff5dc0bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:22.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.287+0000 7ff5e0eba640 1 --2- 172.21.15.133:0/3578058851 >> v2:172.21.15.138:3300/0 conn(0x7ff5dc157c20 0x7ff5dc158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:22.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.291+0000 7ff5daffd640 1 -- 172.21.15.133:0/3578058851 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076889835 0 0) 0x7ff5dc06a5b0 con 0x7ff5dc14b010 2023-12-19T18:59:22.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.291+0000 7ff5daffd640 1 -- 172.21.15.133:0/3578058851 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5c4003530 con 0x7ff5dc14b010 2023-12-19T18:59:22.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.291+0000 7ff5db7fe640 1 -- 172.21.15.133:0/3578058851 >> v2:172.21.15.138:3300/0 conn(0x7ff5dc157c20 msgr2=0x7ff5dc158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:22.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.291+0000 7ff5db7fe640 1 --2- 172.21.15.133:0/3578058851 >> v2:172.21.15.138:3300/0 conn(0x7ff5dc157c20 0x7ff5dc158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:22.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.291+0000 7ff5db7fe640 1 -- 172.21.15.133:0/3578058851 >> v1:172.21.15.133:6789/0 conn(0x7ff5dc14b010 legacy=0x7ff5dc06b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:22.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.291+0000 7ff5db7fe640 1 -- 172.21.15.133:0/3578058851 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc0c2040 con 0x7ff5dc073a70 2023-12-19T18:59:22.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.291+0000 7ff5db7fe640 1 --2- 172.21.15.133:0/3578058851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5dc073a70 0x7ff5dc0bf9f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc1521a0 tx=0x7ff5d001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46d8ade75bd6a34 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:22.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.291+0000 7ff5daffd640 1 -- 172.21.15.133:0/3578058851 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d00a8950 con 0x7ff5dc073a70 2023-12-19T18:59:22.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.291+0000 7ff5daffd640 1 -- 172.21.15.133:0/3578058851 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d00a8ab0 con 0x7ff5dc073a70 2023-12-19T18:59:22.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.291+0000 7ff5daffd640 1 -- 172.21.15.133:0/3578058851 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d00a8e20 con 0x7ff5dc073a70 2023-12-19T18:59:22.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.291+0000 7ff5e291d640 1 -- 172.21.15.133:0/3578058851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5dc073a70 msgr2=0x7ff5dc0bf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:22.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.291+0000 7ff5e291d640 1 --2- 172.21.15.133:0/3578058851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5dc073a70 0x7ff5dc0bf9f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc1521a0 tx=0x7ff5d001ec50 comp rx=0 tx=0).stop 2023-12-19T18:59:22.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.291+0000 7ff5e291d640 1 -- 172.21.15.133:0/3578058851 shutdown_connections 2023-12-19T18:59:22.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.291+0000 7ff5e291d640 1 --2- 172.21.15.133:0/3578058851 >> v2:172.21.15.138:3300/0 conn(0x7ff5dc157c20 0x7ff5dc158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:22.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.291+0000 7ff5e291d640 1 --2- 172.21.15.133:0/3578058851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5dc073a70 0x7ff5dc0bf9f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:22.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.291+0000 7ff5e291d640 1 -- 172.21.15.133:0/3578058851 >> 172.21.15.133:0/3578058851 conn(0x7ff5dc0c30c0 msgr2=0x7ff5dc0c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:22.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.291+0000 7ff5e291d640 1 -- 172.21.15.133:0/3578058851 shutdown_connections 2023-12-19T18:59:22.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.291+0000 7ff5e291d640 1 -- 172.21.15.133:0/3578058851 wait complete. 2023-12-19T18:59:22.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5e291d640 1 Processor -- start 2023-12-19T18:59:22.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5e291d640 1 -- start start 2023-12-19T18:59:22.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5e291d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5dc073a70 0x7ff5dc147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:22.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5e291d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5dc14b010 0x7ff5dc142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:22.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5e291d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5dc157c20 0x7ff5dc1430e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:22.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5e291d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc143620 con 0x7ff5dc073a70 2023-12-19T18:59:22.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5e291d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc1ea7d0 con 0x7ff5dc14b010 2023-12-19T18:59:22.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5e291d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5dc0c62d0 con 0x7ff5dc157c20 2023-12-19T18:59:22.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5dbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5dc073a70 0x7ff5dc147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:22.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5dbfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5dc073a70 0x7ff5dc147b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38126/0 (socket says 172.21.15.133:38126) 2023-12-19T18:59:22.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5dbfff640 1 -- 172.21.15.133:0/4123649865 learned_addr learned my addr 172.21.15.133:0/4123649865 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:22.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5db7fe640 1 --2- 172.21.15.133:0/4123649865 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5dc14b010 0x7ff5dc142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:22.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5e0eba640 1 --2- 172.21.15.133:0/4123649865 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5dc157c20 0x7ff5dc1430e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:22.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5dbfff640 1 -- 172.21.15.133:0/4123649865 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5dc157c20 msgr2=0x7ff5dc1430e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:22.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5dbfff640 1 --2- 172.21.15.133:0/4123649865 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5dc157c20 0x7ff5dc1430e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:22.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5dbfff640 1 -- 172.21.15.133:0/4123649865 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5dc14b010 msgr2=0x7ff5dc142ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:22.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5dbfff640 1 --2- 172.21.15.133:0/4123649865 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5dc14b010 0x7ff5dc142ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:22.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5dbfff640 1 -- 172.21.15.133:0/4123649865 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d0009420 con 0x7ff5dc073a70 2023-12-19T18:59:22.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5e0eba640 1 --2- 172.21.15.133:0/4123649865 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5dc157c20 0x7ff5dc1430e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:22.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5db7fe640 1 --2- 172.21.15.133:0/4123649865 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5dc14b010 0x7ff5dc142ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:59:22.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5dbfff640 1 --2- 172.21.15.133:0/4123649865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5dc073a70 0x7ff5dc147b00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc00c480 tx=0x7ff5cc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:22.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5d8ff9640 1 -- 172.21.15.133:0/4123649865 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc005cf0 con 0x7ff5dc073a70 2023-12-19T18:59:22.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5d8ff9640 1 -- 172.21.15.133:0/4123649865 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc005e50 con 0x7ff5dc073a70 2023-12-19T18:59:22.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5d8ff9640 1 -- 172.21.15.133:0/4123649865 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc007290 con 0x7ff5dc073a70 2023-12-19T18:59:22.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.295+0000 7ff5e291d640 1 -- 172.21.15.133:0/4123649865 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5dc1e9be0 con 0x7ff5dc073a70 2023-12-19T18:59:22.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.299+0000 7ff5e291d640 1 -- 172.21.15.133:0/4123649865 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5dc1ea180 con 0x7ff5dc073a70 2023-12-19T18:59:22.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.299+0000 7ff5e291d640 1 -- 172.21.15.133:0/4123649865 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5dc158900 con 0x7ff5dc073a70 2023-12-19T18:59:22.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.299+0000 7ff5d8ff9640 1 -- 172.21.15.133:0/4123649865 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff5cc0073f0 con 0x7ff5dc073a70 2023-12-19T18:59:22.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.299+0000 7ff5d8ff9640 1 --2- 172.21.15.133:0/4123649865 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5c80664a0 0x7ff5c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:22.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.299+0000 7ff5d8ff9640 1 -- 172.21.15.133:0/4123649865 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff5cc083100 con 0x7ff5dc073a70 2023-12-19T18:59:22.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.299+0000 7ff5db7fe640 1 --2- 172.21.15.133:0/4123649865 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5c80664a0 0x7ff5c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:22.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.303+0000 7ff5db7fe640 1 --2- 172.21.15.133:0/4123649865 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5c80664a0 0x7ff5c8068960 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00b2000 tx=0x7ff5d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:22.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.303+0000 7ff5d8ff9640 1 -- 172.21.15.133:0/4123649865 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff5cc050970 con 0x7ff5dc073a70 2023-12-19T18:59:22.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.503+0000 7ff5e291d640 1 -- 172.21.15.133:0/4123649865 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7ff5dc068400 con 0x7ff5dc073a70 2023-12-19T18:59:22.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.507+0000 7ff5d8ff9640 1 -- 172.21.15.133:0/4123649865 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff5cc0170a0 con 0x7ff5dc073a70 2023-12-19T18:59:22.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.507+0000 7ff5e291d640 1 -- 172.21.15.133:0/4123649865 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5c80664a0 msgr2=0x7ff5c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:22.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.507+0000 7ff5e291d640 1 --2- 172.21.15.133:0/4123649865 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5c80664a0 0x7ff5c8068960 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00b2000 tx=0x7ff5d0008040 comp rx=0 tx=0).stop 2023-12-19T18:59:22.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.507+0000 7ff5e291d640 1 -- 172.21.15.133:0/4123649865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5dc073a70 msgr2=0x7ff5dc147b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:22.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.507+0000 7ff5e291d640 1 --2- 172.21.15.133:0/4123649865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5dc073a70 0x7ff5dc147b00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc00c480 tx=0x7ff5cc00c940 comp rx=0 tx=0).stop 2023-12-19T18:59:22.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.507+0000 7ff5e291d640 1 -- 172.21.15.133:0/4123649865 shutdown_connections 2023-12-19T18:59:22.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.507+0000 7ff5e291d640 1 --2- 172.21.15.133:0/4123649865 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5c80664a0 0x7ff5c8068960 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:22.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.507+0000 7ff5e291d640 1 --2- 172.21.15.133:0/4123649865 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5dc157c20 0x7ff5dc1430e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:22.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.507+0000 7ff5e291d640 1 --2- 172.21.15.133:0/4123649865 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5dc14b010 0x7ff5dc142ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:22.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.507+0000 7ff5e291d640 1 --2- 172.21.15.133:0/4123649865 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5dc073a70 0x7ff5dc147b00 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:22.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.507+0000 7ff5e291d640 1 -- 172.21.15.133:0/4123649865 >> 172.21.15.133:0/4123649865 conn(0x7ff5dc0c30c0 msgr2=0x7ff5dc0c0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:22.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.511+0000 7ff5e291d640 1 -- 172.21.15.133:0/4123649865 shutdown_connections 2023-12-19T18:59:22.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.511+0000 7ff5e291d640 1 -- 172.21.15.133:0/4123649865 wait complete. 2023-12-19T18:59:22.533 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-19T18:59:22.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.667+0000 7f69bf8bb640 1 Processor -- start 2023-12-19T18:59:22.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.667+0000 7f69bf8bb640 1 -- start start 2023-12-19T18:59:22.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.667+0000 7f69bf8bb640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f69b8072090 0x7f69b8150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:22.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.667+0000 7f69bf8bb640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69b80c2760 con 0x7f69b80a5370 2023-12-19T18:59:22.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.667+0000 7f69bf8bb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69b80a5750 con 0x7f69b80725c0 2023-12-19T18:59:22.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.667+0000 7f69bf8bb640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b80c3070 con 0x7f69b8072090 2023-12-19T18:59:22.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.667+0000 7f69bce56640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f69b8072090 0x7f69b8150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:22.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.667+0000 7f69bd657640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f69b80a5370 0x7f69b80c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33832/0 (socket says 172.21.15.133:33832) 2023-12-19T18:59:22.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.667+0000 7f69bd657640 1 -- 172.21.15.133:0/3875677473 learned_addr learned my addr 172.21.15.133:0/3875677473 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:22.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.667+0000 7f69bce56640 1 -- 172.21.15.133:0/3875677473 >> v1:172.21.15.138:6789/0 conn(0x7f69b80725c0 legacy=0x7f69b81514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:22.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.667+0000 7f69bce56640 1 -- 172.21.15.133:0/3875677473 >> v1:172.21.15.133:6789/0 conn(0x7f69b80a5370 legacy=0x7f69b80c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:22.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.667+0000 7f69bce56640 1 -- 172.21.15.133:0/3875677473 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b80aad20 con 0x7f69b8072090 2023-12-19T18:59:22.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.667+0000 7f69affff640 1 -- 172.21.15.133:0/3875677473 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 269043491 0 0) 0x7f69b80c2760 con 0x7f69b80a5370 2023-12-19T18:59:22.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.671+0000 7f69bce56640 1 --2- 172.21.15.133:0/3875677473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69b8072090 0x7f69b8150fa0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f69a80097c0 tx=0x7f69a801c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90ce88f18c037ef server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:22.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.671+0000 7f69affff640 1 -- 172.21.15.133:0/3875677473 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a80ab600 con 0x7f69b8072090 2023-12-19T18:59:22.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.671+0000 7f69affff640 1 -- 172.21.15.133:0/3875677473 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a80a7050 con 0x7f69b8072090 2023-12-19T18:59:22.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.671+0000 7f69affff640 1 -- 172.21.15.133:0/3875677473 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a80ab980 con 0x7f69b8072090 2023-12-19T18:59:22.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.671+0000 7f69bf8bb640 1 -- 172.21.15.133:0/3875677473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69b8072090 msgr2=0x7f69b8150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:22.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.671+0000 7f69bf8bb640 1 --2- 172.21.15.133:0/3875677473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69b8072090 0x7f69b8150fa0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f69a80097c0 tx=0x7f69a801c320 comp rx=0 tx=0).stop 2023-12-19T18:59:22.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.671+0000 7f69bf8bb640 1 -- 172.21.15.133:0/3875677473 shutdown_connections 2023-12-19T18:59:22.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.671+0000 7f69bf8bb640 1 --2- 172.21.15.133:0/3875677473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69b8072090 0x7f69b8150fa0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:22.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.671+0000 7f69bf8bb640 1 -- 172.21.15.133:0/3875677473 >> 172.21.15.133:0/3875677473 conn(0x7f69b806a5b0 msgr2=0x7f69b806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:22.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.671+0000 7f69bf8bb640 1 -- 172.21.15.133:0/3875677473 shutdown_connections 2023-12-19T18:59:22.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.671+0000 7f69bf8bb640 1 -- 172.21.15.133:0/3875677473 wait complete. 2023-12-19T18:59:22.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69bf8bb640 1 Processor -- start 2023-12-19T18:59:22.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69bf8bb640 1 -- start start 2023-12-19T18:59:22.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69bf8bb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69b8072090 0x7f69b8152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:22.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69bf8bb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69b80725c0 0x7f69b80a8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:22.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69bf8bb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69b80a5370 0x7f69b8150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:22.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69bf8bb640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b814fe60 con 0x7f69b8072090 2023-12-19T18:59:22.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69bf8bb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b81f0f30 con 0x7f69b80a5370 2023-12-19T18:59:22.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69bf8bb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b814f4c0 con 0x7f69b80725c0 2023-12-19T18:59:22.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69bd657640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69b8072090 0x7f69b8152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:22.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69bd657640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69b8072090 0x7f69b8152660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38156/0 (socket says 172.21.15.133:38156) 2023-12-19T18:59:22.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69bd657640 1 -- 172.21.15.133:0/3286396139 learned_addr learned my addr 172.21.15.133:0/3286396139 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:22.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69bde58640 1 --2- 172.21.15.133:0/3286396139 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69b80a5370 0x7f69b8150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:22.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69bce56640 1 --2- 172.21.15.133:0/3286396139 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69b80725c0 0x7f69b80a8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:22.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69bd657640 1 -- 172.21.15.133:0/3286396139 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69b80725c0 msgr2=0x7f69b80a8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:22.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69bd657640 1 --2- 172.21.15.133:0/3286396139 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69b80725c0 0x7f69b80a8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:22.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69bd657640 1 -- 172.21.15.133:0/3286396139 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69b80a5370 msgr2=0x7f69b8150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:22.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69bd657640 1 --2- 172.21.15.133:0/3286396139 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69b80a5370 0x7f69b8150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:22.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69bd657640 1 -- 172.21.15.133:0/3286396139 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a8009420 con 0x7f69b8072090 2023-12-19T18:59:22.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69bde58640 1 --2- 172.21.15.133:0/3286396139 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69b80a5370 0x7f69b8150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:22.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69bd657640 1 --2- 172.21.15.133:0/3286396139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69b8072090 0x7f69b8152660 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f69b400c480 tx=0x7f69b400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:22.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69adffb640 1 -- 172.21.15.133:0/3286396139 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b40074e0 con 0x7f69b8072090 2023-12-19T18:59:22.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69adffb640 1 -- 172.21.15.133:0/3286396139 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b4007660 con 0x7f69b8072090 2023-12-19T18:59:22.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69adffb640 1 -- 172.21.15.133:0/3286396139 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b4004a30 con 0x7f69b8072090 2023-12-19T18:59:22.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.675+0000 7f69bf8bb640 1 -- 172.21.15.133:0/3286396139 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b814f7a0 con 0x7f69b8072090 2023-12-19T18:59:22.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.679+0000 7f69bf8bb640 1 -- 172.21.15.133:0/3286396139 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b8154bb0 con 0x7f69b8072090 2023-12-19T18:59:22.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.679+0000 7f69bf8bb640 1 -- 172.21.15.133:0/3286396139 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b814ffa0 con 0x7f69b8072090 2023-12-19T18:59:22.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.679+0000 7f69adffb640 1 -- 172.21.15.133:0/3286396139 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f69b4004b90 con 0x7f69b8072090 2023-12-19T18:59:22.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.679+0000 7f69adffb640 1 --2- 172.21.15.133:0/3286396139 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f699c0664a0 0x7f699c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:22.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.679+0000 7f69adffb640 1 -- 172.21.15.133:0/3286396139 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f69b4082c20 con 0x7f69b8072090 2023-12-19T18:59:22.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.679+0000 7f69bce56640 1 --2- 172.21.15.133:0/3286396139 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f699c0664a0 0x7f699c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:22.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.683+0000 7f69bce56640 1 --2- 172.21.15.133:0/3286396139 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f699c0664a0 0x7f699c068960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f69a80ad000 tx=0x7f69a8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:22.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.683+0000 7f69adffb640 1 -- 172.21.15.133:0/3286396139 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f69b814ffa0 con 0x7f69b8072090 2023-12-19T18:59:22.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.891+0000 7f69bf8bb640 1 -- 172.21.15.133:0/3286396139 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f69b814ffa0 con 0x7f69b8072090 2023-12-19T18:59:22.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.895+0000 7f69adffb640 1 -- 172.21.15.133:0/3286396139 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f69b814ffa0 con 0x7f69b8072090 2023-12-19T18:59:22.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.899+0000 7f69bf8bb640 1 -- 172.21.15.133:0/3286396139 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f699c0664a0 msgr2=0x7f699c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:22.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.899+0000 7f69bf8bb640 1 --2- 172.21.15.133:0/3286396139 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f699c0664a0 0x7f699c068960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f69a80ad000 tx=0x7f69a8008040 comp rx=0 tx=0).stop 2023-12-19T18:59:22.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.899+0000 7f69bf8bb640 1 -- 172.21.15.133:0/3286396139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69b8072090 msgr2=0x7f69b8152660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:22.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.899+0000 7f69bf8bb640 1 --2- 172.21.15.133:0/3286396139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69b8072090 0x7f69b8152660 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f69b400c480 tx=0x7f69b400c940 comp rx=0 tx=0).stop 2023-12-19T18:59:22.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.899+0000 7f69bf8bb640 1 -- 172.21.15.133:0/3286396139 shutdown_connections 2023-12-19T18:59:22.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.899+0000 7f69bf8bb640 1 --2- 172.21.15.133:0/3286396139 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f699c0664a0 0x7f699c068960 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:22.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.899+0000 7f69bf8bb640 1 --2- 172.21.15.133:0/3286396139 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f69b80a5370 0x7f69b8150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:22.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.899+0000 7f69bf8bb640 1 --2- 172.21.15.133:0/3286396139 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f69b80725c0 0x7f69b80a8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:22.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.899+0000 7f69bf8bb640 1 --2- 172.21.15.133:0/3286396139 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69b8072090 0x7f69b8152660 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:22.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.899+0000 7f69bf8bb640 1 -- 172.21.15.133:0/3286396139 >> 172.21.15.133:0/3286396139 conn(0x7f69b806a5b0 msgr2=0x7f69b80c0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:22.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.899+0000 7f69bf8bb640 1 -- 172.21.15.133:0/3286396139 shutdown_connections 2023-12-19T18:59:22.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:22.899+0000 7f69bf8bb640 1 -- 172.21.15.133:0/3286396139 wait complete. 2023-12-19T18:59:22.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-19T18:59:23.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.055+0000 7f3bfbb72640 1 Processor -- start 2023-12-19T18:59:23.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.055+0000 7f3bfbb72640 1 -- start start 2023-12-19T18:59:23.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.055+0000 7f3bfbb72640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3bf40a7450 0x7f3bf406dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:23.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.055+0000 7f3bfbb72640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3bf40c76a0 0x7f3bf406f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:23.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.055+0000 7f3bfbb72640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf4156820 con 0x7f3bf406fcb0 2023-12-19T18:59:23.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.055+0000 7f3bfbb72640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf406ec40 con 0x7f3bf40a7450 2023-12-19T18:59:23.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.055+0000 7f3bfbb72640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf40a7830 con 0x7f3bf40c76a0 2023-12-19T18:59:23.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.055+0000 7f3bf990e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3bf40a7450 0x7f3bf406dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:23.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.055+0000 7f3bf990e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3bf40a7450 0x7f3bf406dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38158/0 (socket says 172.21.15.133:38158) 2023-12-19T18:59:23.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.055+0000 7f3bf990e640 1 -- 172.21.15.133:0/2381265379 learned_addr learned my addr 172.21.15.133:0/2381265379 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:23.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.055+0000 7f3bf910d640 1 --2- 172.21.15.133:0/2381265379 >> v2:172.21.15.138:3300/0 conn(0x7f3bf40c76a0 0x7f3bf406f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:23.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.055+0000 7f3bf990e640 1 -- 172.21.15.133:0/2381265379 >> v2:172.21.15.138:3300/0 conn(0x7f3bf40c76a0 msgr2=0x7f3bf406f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:23.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.055+0000 7f3bf990e640 1 --2- 172.21.15.133:0/2381265379 >> v2:172.21.15.138:3300/0 conn(0x7f3bf40c76a0 0x7f3bf406f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.055+0000 7f3bf990e640 1 -- 172.21.15.133:0/2381265379 >> v1:172.21.15.138:6789/0 conn(0x7f3bf406fcb0 legacy=0x7f3bf41526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:23.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.055+0000 7f3bf990e640 1 -- 172.21.15.133:0/2381265379 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf406e1b0 con 0x7f3bf40a7450 2023-12-19T18:59:23.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.059+0000 7f3bf990e640 1 --2- 172.21.15.133:0/2381265379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf40a7450 0x7f3bf406dc70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3bf40c59e0 tx=0x7f3bf001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b867ee0a7cdcf8e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:23.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.059+0000 7f3bf890c640 1 -- 172.21.15.133:0/2381265379 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0004230 con 0x7f3bf40a7450 2023-12-19T18:59:23.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.059+0000 7f3bf890c640 1 -- 172.21.15.133:0/2381265379 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf00a7050 con 0x7f3bf40a7450 2023-12-19T18:59:23.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.059+0000 7f3bf890c640 1 -- 172.21.15.133:0/2381265379 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0003620 con 0x7f3bf40a7450 2023-12-19T18:59:23.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.059+0000 7f3bfbb72640 1 -- 172.21.15.133:0/2381265379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf40a7450 msgr2=0x7f3bf406dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:23.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.059+0000 7f3bfbb72640 1 --2- 172.21.15.133:0/2381265379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf40a7450 0x7f3bf406dc70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3bf40c59e0 tx=0x7f3bf001c440 comp rx=0 tx=0).stop 2023-12-19T18:59:23.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.059+0000 7f3bfbb72640 1 -- 172.21.15.133:0/2381265379 shutdown_connections 2023-12-19T18:59:23.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.059+0000 7f3bfbb72640 1 --2- 172.21.15.133:0/2381265379 >> v2:172.21.15.138:3300/0 conn(0x7f3bf40c76a0 0x7f3bf406f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.059+0000 7f3bfbb72640 1 --2- 172.21.15.133:0/2381265379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf40a7450 0x7f3bf406dc70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.059+0000 7f3bfbb72640 1 -- 172.21.15.133:0/2381265379 >> 172.21.15.133:0/2381265379 conn(0x7f3bf40c7e40 msgr2=0x7f3bf40c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:23.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.059+0000 7f3bfbb72640 1 -- 172.21.15.133:0/2381265379 shutdown_connections 2023-12-19T18:59:23.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.059+0000 7f3bfbb72640 1 -- 172.21.15.133:0/2381265379 wait complete. 2023-12-19T18:59:23.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bfbb72640 1 Processor -- start 2023-12-19T18:59:23.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bfbb72640 1 -- start start 2023-12-19T18:59:23.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bfbb72640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3bf406fcb0 0x7f3bf40a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:23.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bfbb72640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf40a7450 0x7f3bf40c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:23.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bfbb72640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3bf40c76a0 0x7f3bf40a99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:23.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bfbb72640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf41494e0 con 0x7f3bf40a7450 2023-12-19T18:59:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bfbb72640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf41ef760 con 0x7f3bf40c76a0 2023-12-19T18:59:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bfbb72640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf41ef1e0 con 0x7f3bf406fcb0 2023-12-19T18:59:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bf910d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf40a7450 0x7f3bf40c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bf910d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf40a7450 0x7f3bf40c3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38170/0 (socket says 172.21.15.133:38170) 2023-12-19T18:59:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bf910d640 1 -- 172.21.15.133:0/824640527 learned_addr learned my addr 172.21.15.133:0/824640527 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bf990e640 1 --2- 172.21.15.133:0/824640527 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3bf406fcb0 0x7f3bf40a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bfa10f640 1 --2- 172.21.15.133:0/824640527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3bf40c76a0 0x7f3bf40a99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bf910d640 1 -- 172.21.15.133:0/824640527 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3bf406fcb0 msgr2=0x7f3bf40a7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bf910d640 1 --2- 172.21.15.133:0/824640527 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3bf406fcb0 0x7f3bf40a7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bf910d640 1 -- 172.21.15.133:0/824640527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3bf40c76a0 msgr2=0x7f3bf40a99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bf910d640 1 --2- 172.21.15.133:0/824640527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3bf40c76a0 0x7f3bf40a99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bf910d640 1 -- 172.21.15.133:0/824640527 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf00094d0 con 0x7f3bf40a7450 2023-12-19T18:59:23.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bf910d640 1 --2- 172.21.15.133:0/824640527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf40a7450 0x7f3bf40c3f70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3be400d800 tx=0x7f3be400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:23.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bea7fc640 1 -- 172.21.15.133:0/824640527 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be400b6c0 con 0x7f3bf40a7450 2023-12-19T18:59:23.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bea7fc640 1 -- 172.21.15.133:0/824640527 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be400b820 con 0x7f3bf40a7450 2023-12-19T18:59:23.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bfbb72640 1 -- 172.21.15.133:0/824640527 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf40a8500 con 0x7f3bf40a7450 2023-12-19T18:59:23.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bea7fc640 1 -- 172.21.15.133:0/824640527 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be400bb90 con 0x7f3bf40a7450 2023-12-19T18:59:23.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.063+0000 7f3bfbb72640 1 -- 172.21.15.133:0/824640527 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf41ef3f0 con 0x7f3bf40a7450 2023-12-19T18:59:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.067+0000 7f3bfbb72640 1 -- 172.21.15.133:0/824640527 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf4068400 con 0x7f3bf40a7450 2023-12-19T18:59:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.067+0000 7f3bea7fc640 1 -- 172.21.15.133:0/824640527 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3be400bcf0 con 0x7f3bf40a7450 2023-12-19T18:59:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.067+0000 7f3bea7fc640 1 --2- 172.21.15.133:0/824640527 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3bd8066470 0x7f3bd8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.067+0000 7f3bea7fc640 1 -- 172.21.15.133:0/824640527 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3be4083f40 con 0x7f3bf40a7450 2023-12-19T18:59:23.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.067+0000 7f3bf990e640 1 --2- 172.21.15.133:0/824640527 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3bd8066470 0x7f3bd8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:23.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.067+0000 7f3bf990e640 1 --2- 172.21.15.133:0/824640527 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3bd8066470 0x7f3bd8068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00ad000 tx=0x7f3bf00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:23.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.071+0000 7f3bea7fc640 1 -- 172.21.15.133:0/824640527 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f3be40517b0 con 0x7f3bf40a7450 2023-12-19T18:59:23.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.275+0000 7f3bfbb72640 1 -- 172.21.15.133:0/824640527 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f3bf40a7d20 con 0x7f3bf40a7450 2023-12-19T18:59:23.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.279+0000 7f3bea7fc640 1 -- 172.21.15.133:0/824640527 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f3be4054dd0 con 0x7f3bf40a7450 2023-12-19T18:59:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.279+0000 7f3bfbb72640 1 -- 172.21.15.133:0/824640527 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3bd8066470 msgr2=0x7f3bd8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.279+0000 7f3bfbb72640 1 --2- 172.21.15.133:0/824640527 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3bd8066470 0x7f3bd8068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00ad000 tx=0x7f3bf00a6000 comp rx=0 tx=0).stop 2023-12-19T18:59:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.279+0000 7f3bfbb72640 1 -- 172.21.15.133:0/824640527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf40a7450 msgr2=0x7f3bf40c3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.279+0000 7f3bfbb72640 1 --2- 172.21.15.133:0/824640527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf40a7450 0x7f3bf40c3f70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3be400d800 tx=0x7f3be400dcc0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.279+0000 7f3bfbb72640 1 -- 172.21.15.133:0/824640527 shutdown_connections 2023-12-19T18:59:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.279+0000 7f3bfbb72640 1 --2- 172.21.15.133:0/824640527 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3bd8066470 0x7f3bd8068930 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.279+0000 7f3bfbb72640 1 --2- 172.21.15.133:0/824640527 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3bf40c76a0 0x7f3bf40a99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.279+0000 7f3bfbb72640 1 --2- 172.21.15.133:0/824640527 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3bf40a7450 0x7f3bf40c3f70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.279+0000 7f3bfbb72640 1 --2- 172.21.15.133:0/824640527 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3bf406fcb0 0x7f3bf40a7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.279+0000 7f3bfbb72640 1 -- 172.21.15.133:0/824640527 >> 172.21.15.133:0/824640527 conn(0x7f3bf40c7e40 msgr2=0x7f3bf41538e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.279+0000 7f3bfbb72640 1 -- 172.21.15.133:0/824640527 shutdown_connections 2023-12-19T18:59:23.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.279+0000 7f3bfbb72640 1 -- 172.21.15.133:0/824640527 wait complete. 2023-12-19T18:59:23.304 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-19T18:59:23.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.439+0000 7f13737e6640 1 Processor -- start 2023-12-19T18:59:23.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.439+0000 7f13737e6640 1 -- start start 2023-12-19T18:59:23.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.439+0000 7f13737e6640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f136c072090 0x7f136c0a5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:23.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.439+0000 7f13737e6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f136c0c3bd0 0x7f136c0c4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:23.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.439+0000 7f13737e6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136c0c2760 con 0x7f136c0725c0 2023-12-19T18:59:23.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.439+0000 7f13737e6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136c0c3070 con 0x7f136c0c3bd0 2023-12-19T18:59:23.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.439+0000 7f13737e6640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136c0c63e0 con 0x7f136c072090 2023-12-19T18:59:23.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.439+0000 7f1371d83640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f136c0c3bd0 0x7f136c0c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:23.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.439+0000 7f1370d81640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f136c0725c0 0x7f136c0c5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33846/0 (socket says 172.21.15.133:33846) 2023-12-19T18:59:23.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.439+0000 7f1371d83640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f136c0c3bd0 0x7f136c0c4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38184/0 (socket says 172.21.15.133:38184) 2023-12-19T18:59:23.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.439+0000 7f1370d81640 1 -- 172.21.15.133:0/3284031705 learned_addr learned my addr 172.21.15.133:0/3284031705 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:23.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.439+0000 7f1371582640 1 --2- 172.21.15.133:0/3284031705 >> v2:172.21.15.138:3300/0 conn(0x7f136c072090 0x7f136c0a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:23.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.443+0000 7f1371d83640 1 -- 172.21.15.133:0/3284031705 >> v2:172.21.15.138:3300/0 conn(0x7f136c072090 msgr2=0x7f136c0a5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:23.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.443+0000 7f1371d83640 1 --2- 172.21.15.133:0/3284031705 >> v2:172.21.15.138:3300/0 conn(0x7f136c072090 0x7f136c0a5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.443+0000 7f1371d83640 1 -- 172.21.15.133:0/3284031705 >> v1:172.21.15.133:6789/0 conn(0x7f136c0725c0 legacy=0x7f136c0c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:23.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.443+0000 7f1363fff640 1 -- 172.21.15.133:0/3284031705 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560134398 0 0) 0x7f136c0c2760 con 0x7f136c0725c0 2023-12-19T18:59:23.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.443+0000 7f1371d83640 1 -- 172.21.15.133:0/3284031705 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c0aad20 con 0x7f136c0c3bd0 2023-12-19T18:59:23.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.443+0000 7f1371582640 1 --2- 172.21.15.133:0/3284031705 >> v2:172.21.15.138:3300/0 conn(0x7f136c072090 0x7f136c0a5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:59:23.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.443+0000 7f1371d83640 1 --2- 172.21.15.133:0/3284031705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f136c0c3bd0 0x7f136c0c4020 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f136c0a8af0 tx=0x7f136401c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad111197c31cab0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:23.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.443+0000 7f1363fff640 1 -- 172.21.15.133:0/3284031705 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13640a58b0 con 0x7f136c0c3bd0 2023-12-19T18:59:23.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.443+0000 7f1363fff640 1 -- 172.21.15.133:0/3284031705 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13640a5a10 con 0x7f136c0c3bd0 2023-12-19T18:59:23.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.443+0000 7f1363fff640 1 -- 172.21.15.133:0/3284031705 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13640a5da0 con 0x7f136c0c3bd0 2023-12-19T18:59:23.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.443+0000 7f13737e6640 1 -- 172.21.15.133:0/3284031705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f136c0c3bd0 msgr2=0x7f136c0c4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:23.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.443+0000 7f13737e6640 1 --2- 172.21.15.133:0/3284031705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f136c0c3bd0 0x7f136c0c4020 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f136c0a8af0 tx=0x7f136401c7f0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.443+0000 7f13737e6640 1 -- 172.21.15.133:0/3284031705 shutdown_connections 2023-12-19T18:59:23.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.443+0000 7f13737e6640 1 --2- 172.21.15.133:0/3284031705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f136c0c3bd0 0x7f136c0c4020 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.443+0000 7f13737e6640 1 --2- 172.21.15.133:0/3284031705 >> v2:172.21.15.138:3300/0 conn(0x7f136c072090 0x7f136c0a5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.443+0000 7f13737e6640 1 -- 172.21.15.133:0/3284031705 >> 172.21.15.133:0/3284031705 conn(0x7f136c06a5b0 msgr2=0x7f136c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:23.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f13737e6640 1 -- 172.21.15.133:0/3284031705 shutdown_connections 2023-12-19T18:59:23.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f13737e6640 1 -- 172.21.15.133:0/3284031705 wait complete. 2023-12-19T18:59:23.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f13737e6640 1 Processor -- start 2023-12-19T18:59:23.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f13737e6640 1 -- start start 2023-12-19T18:59:23.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f13737e6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f136c072090 0x7f136c1e88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:23.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f13737e6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f136c0725c0 0x7f136c145970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:23.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f13737e6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f136c0c3bd0 0x7f136c0a7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:23.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f13737e6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c14ba60 con 0x7f136c0725c0 2023-12-19T18:59:23.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f13737e6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c14ae50 con 0x7f136c0c3bd0 2023-12-19T18:59:23.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f13737e6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c14b130 con 0x7f136c072090 2023-12-19T18:59:23.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f1370d81640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f136c0725c0 0x7f136c145970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:23.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f1370d81640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f136c0725c0 0x7f136c145970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38186/0 (socket says 172.21.15.133:38186) 2023-12-19T18:59:23.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f1370d81640 1 -- 172.21.15.133:0/1685104606 learned_addr learned my addr 172.21.15.133:0/1685104606 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:23.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f1371d83640 1 --2- 172.21.15.133:0/1685104606 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f136c0c3bd0 0x7f136c0a7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:23.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f1371582640 1 --2- 172.21.15.133:0/1685104606 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f136c072090 0x7f136c1e88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:23.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f1370d81640 1 -- 172.21.15.133:0/1685104606 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f136c072090 msgr2=0x7f136c1e88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:23.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f1370d81640 1 --2- 172.21.15.133:0/1685104606 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f136c072090 0x7f136c1e88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f1370d81640 1 -- 172.21.15.133:0/1685104606 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f136c0c3bd0 msgr2=0x7f136c0a7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:23.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f1370d81640 1 --2- 172.21.15.133:0/1685104606 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f136c0c3bd0 0x7f136c0a7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f1370d81640 1 -- 172.21.15.133:0/1685104606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1368009420 con 0x7f136c0725c0 2023-12-19T18:59:23.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f1370d81640 1 --2- 172.21.15.133:0/1685104606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f136c0725c0 0x7f136c145970 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f135c0011f0 tx=0x7f135c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:23.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f1361ffb640 1 -- 172.21.15.133:0/1685104606 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c0074e0 con 0x7f136c0725c0 2023-12-19T18:59:23.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f1361ffb640 1 -- 172.21.15.133:0/1685104606 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c007640 con 0x7f136c0725c0 2023-12-19T18:59:23.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f13737e6640 1 -- 172.21.15.133:0/1685104606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1364009a70 con 0x7f136c0725c0 2023-12-19T18:59:23.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.447+0000 7f1361ffb640 1 -- 172.21.15.133:0/1685104606 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c004a10 con 0x7f136c0725c0 2023-12-19T18:59:23.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.451+0000 7f13737e6640 1 -- 172.21.15.133:0/1685104606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136c14b6f0 con 0x7f136c0725c0 2023-12-19T18:59:23.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.451+0000 7f13737e6640 1 -- 172.21.15.133:0/1685104606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136c143df0 con 0x7f136c0725c0 2023-12-19T18:59:23.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.451+0000 7f1361ffb640 1 -- 172.21.15.133:0/1685104606 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f135c004b70 con 0x7f136c0725c0 2023-12-19T18:59:23.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.451+0000 7f1361ffb640 1 --2- 172.21.15.133:0/1685104606 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1350066470 0x7f1350068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:23.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.451+0000 7f1361ffb640 1 -- 172.21.15.133:0/1685104606 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f135c082f80 con 0x7f136c0725c0 2023-12-19T18:59:23.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.451+0000 7f1371582640 1 --2- 172.21.15.133:0/1685104606 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1350066470 0x7f1350068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:23.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.451+0000 7f1371582640 1 --2- 172.21.15.133:0/1685104606 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1350066470 0x7f1350068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1368009c50 tx=0x7f1368009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:23.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.455+0000 7f1361ffb640 1 -- 172.21.15.133:0/1685104606 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f135c0b4290 con 0x7f136c0725c0 2023-12-19T18:59:23.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.655+0000 7f13737e6640 1 -- 172.21.15.133:0/1685104606 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f136c068400 con 0x7f136c0725c0 2023-12-19T18:59:23.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.659+0000 7f1361ffb640 1 -- 172.21.15.133:0/1685104606 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f135c018020 con 0x7f136c0725c0 2023-12-19T18:59:23.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.663+0000 7f13737e6640 1 -- 172.21.15.133:0/1685104606 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1350066470 msgr2=0x7f1350068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:23.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.663+0000 7f13737e6640 1 --2- 172.21.15.133:0/1685104606 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1350066470 0x7f1350068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1368009c50 tx=0x7f1368009190 comp rx=0 tx=0).stop 2023-12-19T18:59:23.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.663+0000 7f13737e6640 1 -- 172.21.15.133:0/1685104606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f136c0725c0 msgr2=0x7f136c145970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:23.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.663+0000 7f13737e6640 1 --2- 172.21.15.133:0/1685104606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f136c0725c0 0x7f136c145970 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f135c0011f0 tx=0x7f135c00c9b0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.663+0000 7f13737e6640 1 -- 172.21.15.133:0/1685104606 shutdown_connections 2023-12-19T18:59:23.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.663+0000 7f13737e6640 1 --2- 172.21.15.133:0/1685104606 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1350066470 0x7f1350068930 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.663+0000 7f13737e6640 1 --2- 172.21.15.133:0/1685104606 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f136c0c3bd0 0x7f136c0a7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.663+0000 7f13737e6640 1 --2- 172.21.15.133:0/1685104606 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f136c0725c0 0x7f136c145970 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.663+0000 7f13737e6640 1 --2- 172.21.15.133:0/1685104606 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f136c072090 0x7f136c1e88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.663+0000 7f13737e6640 1 -- 172.21.15.133:0/1685104606 >> 172.21.15.133:0/1685104606 conn(0x7f136c06a5b0 msgr2=0x7f136c146c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:23.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.663+0000 7f13737e6640 1 -- 172.21.15.133:0/1685104606 shutdown_connections 2023-12-19T18:59:23.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.663+0000 7f13737e6640 1 -- 172.21.15.133:0/1685104606 wait complete. 2023-12-19T18:59:23.686 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-19T18:59:23.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6e749c640 1 Processor -- start 2023-12-19T18:59:23.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6e749c640 1 -- start start 2023-12-19T18:59:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6e749c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6e00c5640 0x7fc6e00c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6e749c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e00c2580 con 0x7fc6e00c5260 2023-12-19T18:59:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6e749c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e00c1a00 con 0x7fc6e00c60f0 2023-12-19T18:59:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6e749c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e0153510 con 0x7fc6e00c5640 2023-12-19T18:59:23.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6e5238640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc6e00c5260 0x7fc6e006d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33850/0 (socket says 172.21.15.133:33850) 2023-12-19T18:59:23.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6e5238640 1 -- 172.21.15.133:0/1475801138 learned_addr learned my addr 172.21.15.133:0/1475801138 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:23.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6d7fff640 1 -- 172.21.15.133:0/1475801138 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876662864 0 0) 0x7fc6e00c2580 con 0x7fc6e00c5260 2023-12-19T18:59:23.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6e4a37640 1 --2- 172.21.15.133:0/1475801138 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6e00c5640 0x7fc6e00c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:23.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6d7fff640 1 -- 172.21.15.133:0/1475801138 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6cc003530 con 0x7fc6e00c5260 2023-12-19T18:59:23.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6d7fff640 1 -- 172.21.15.133:0/1475801138 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2918913302 0 0) 0x7fc6cc003530 con 0x7fc6e00c5260 2023-12-19T18:59:23.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6d7fff640 1 -- 172.21.15.133:0/1475801138 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6e00c5640 msgr2=0x7fc6e00c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:23.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6d7fff640 1 --2- 172.21.15.133:0/1475801138 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6e00c5640 0x7fc6e00c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6d7fff640 1 -- 172.21.15.133:0/1475801138 >> v1:172.21.15.138:6789/0 conn(0x7fc6e00c60f0 legacy=0x7fc6e0155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:23.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6d7fff640 1 -- 172.21.15.133:0/1475801138 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e00c1ce0 con 0x7fc6e00c5260 2023-12-19T18:59:23.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6d7fff640 1 -- 172.21.15.133:0/1475801138 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7fc6dc001680 con 0x7fc6e00c5260 2023-12-19T18:59:23.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6d7fff640 1 -- 172.21.15.133:0/1475801138 >> v1:172.21.15.133:6789/0 conn(0x7fc6e00c5260 legacy=0x7fc6e006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:23.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6d7fff640 1 --2- 172.21.15.133:0/1475801138 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6e00c5640 0x7fc6cc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:23.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6d7fff640 1 --2- 172.21.15.133:0/1475801138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6cc003f30 0x7fc6cc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:23.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6d7fff640 1 --2- 172.21.15.133:0/1475801138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6cc004d10 0x7fc6cc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:23.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6d7fff640 1 -- 172.21.15.133:0/1475801138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc00bb20 con 0x7fc6cc004d10 2023-12-19T18:59:23.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6d7fff640 1 -- 172.21.15.133:0/1475801138 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc00bc60 con 0x7fc6cc003f30 2023-12-19T18:59:23.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6d7fff640 1 -- 172.21.15.133:0/1475801138 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc00be20 con 0x7fc6e00c5640 2023-12-19T18:59:23.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6e5a39640 1 --2- 172.21.15.133:0/1475801138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6cc004d10 0x7fc6cc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:23.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6e5238640 1 --2- 172.21.15.133:0/1475801138 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6e00c5640 0x7fc6cc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:23.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6e4a37640 1 --2- 172.21.15.133:0/1475801138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6cc003f30 0x7fc6cc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:23.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6e5a39640 1 -- 172.21.15.133:0/1475801138 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6e00c5640 msgr2=0x7fc6cc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:23.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6e5a39640 1 --2- 172.21.15.133:0/1475801138 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6e00c5640 0x7fc6cc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6e5a39640 1 -- 172.21.15.133:0/1475801138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6cc003f30 msgr2=0x7fc6cc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:23.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6e5a39640 1 --2- 172.21.15.133:0/1475801138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6cc003f30 0x7fc6cc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.823+0000 7fc6e5a39640 1 -- 172.21.15.133:0/1475801138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc003530 con 0x7fc6cc004d10 2023-12-19T18:59:23.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.827+0000 7fc6e5a39640 1 --2- 172.21.15.133:0/1475801138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6cc004d10 0x7fc6cc005190 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8001e70 tx=0x7fc6d801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdbcb1fe87a41297 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:23.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.827+0000 7fc6d7fff640 1 -- 172.21.15.133:0/1475801138 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8003b80 con 0x7fc6cc004d10 2023-12-19T18:59:23.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.827+0000 7fc6d7fff640 1 -- 172.21.15.133:0/1475801138 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d8003ce0 con 0x7fc6cc004d10 2023-12-19T18:59:23.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.827+0000 7fc6d7fff640 1 -- 172.21.15.133:0/1475801138 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d80052c0 con 0x7fc6cc004d10 2023-12-19T18:59:23.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.827+0000 7fc6e749c640 1 -- 172.21.15.133:0/1475801138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6cc004d10 msgr2=0x7fc6cc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:23.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.827+0000 7fc6e749c640 1 --2- 172.21.15.133:0/1475801138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6cc004d10 0x7fc6cc005190 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8001e70 tx=0x7fc6d801c760 comp rx=0 tx=0).stop 2023-12-19T18:59:23.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.827+0000 7fc6e5a39640 1 -- 172.21.15.133:0/1475801138 reap_dead start 2023-12-19T18:59:23.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.827+0000 7fc6e749c640 1 -- 172.21.15.133:0/1475801138 shutdown_connections 2023-12-19T18:59:23.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.827+0000 7fc6e749c640 1 -- 172.21.15.133:0/1475801138 >> 172.21.15.133:0/1475801138 conn(0x7fc6e006a5b0 msgr2=0x7fc6e006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:23.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.827+0000 7fc6e749c640 1 -- 172.21.15.133:0/1475801138 shutdown_connections 2023-12-19T18:59:23.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.827+0000 7fc6e749c640 1 -- 172.21.15.133:0/1475801138 wait complete. 2023-12-19T18:59:23.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6e749c640 1 Processor -- start 2023-12-19T18:59:23.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6e749c640 1 -- start start 2023-12-19T18:59:23.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6e749c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6cc004d10 0x7fc6e00bf930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:23.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6e749c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6e01ea290 0x7fc6e00a4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:23.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6e749c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e00aa430 0x7fc6e01ecad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:23.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6e749c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e0151f40 con 0x7fc6e00aa430 2023-12-19T18:59:23.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6e749c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e01e9560 con 0x7fc6cc004d10 2023-12-19T18:59:23.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6e749c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e00a8e90 con 0x7fc6e01ea290 2023-12-19T18:59:23.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6e5a39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e00aa430 0x7fc6e01ecad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:23.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6e5a39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e00aa430 0x7fc6e01ecad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38204/0 (socket says 172.21.15.133:38204) 2023-12-19T18:59:23.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6e5a39640 1 -- 172.21.15.133:0/2330125930 learned_addr learned my addr 172.21.15.133:0/2330125930 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:23.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6e4a37640 1 --2- 172.21.15.133:0/2330125930 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6e01ea290 0x7fc6e00a4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:23.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6e5238640 1 --2- 172.21.15.133:0/2330125930 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6cc004d10 0x7fc6e00bf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6e5a39640 1 -- 172.21.15.133:0/2330125930 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6e01ea290 msgr2=0x7fc6e00a4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6e5a39640 1 --2- 172.21.15.133:0/2330125930 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6e01ea290 0x7fc6e00a4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6e5a39640 1 -- 172.21.15.133:0/2330125930 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6cc004d10 msgr2=0x7fc6e00bf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6e5a39640 1 --2- 172.21.15.133:0/2330125930 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6cc004d10 0x7fc6e00bf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6e5a39640 1 -- 172.21.15.133:0/2330125930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e00c0030 con 0x7fc6e00aa430 2023-12-19T18:59:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6e4a37640 1 --2- 172.21.15.133:0/2330125930 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6e01ea290 0x7fc6e00a4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6e5a39640 1 --2- 172.21.15.133:0/2330125930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e00aa430 0x7fc6e01ecad0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc6d801cc40 tx=0x7fc6cc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6d5ffb640 1 -- 172.21.15.133:0/2330125930 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8005030 con 0x7fc6e00aa430 2023-12-19T18:59:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6d5ffb640 1 -- 172.21.15.133:0/2330125930 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d8005190 con 0x7fc6e00aa430 2023-12-19T18:59:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6d5ffb640 1 -- 172.21.15.133:0/2330125930 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8005520 con 0x7fc6e00aa430 2023-12-19T18:59:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6e749c640 1 -- 172.21.15.133:0/2330125930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e01e97b0 con 0x7fc6e00aa430 2023-12-19T18:59:23.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.831+0000 7fc6e749c640 1 -- 172.21.15.133:0/2330125930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e01e9d70 con 0x7fc6e00aa430 2023-12-19T18:59:23.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.835+0000 7fc6e749c640 1 -- 172.21.15.133:0/2330125930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e01e9f90 con 0x7fc6e00aa430 2023-12-19T18:59:23.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.835+0000 7fc6d5ffb640 1 -- 172.21.15.133:0/2330125930 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc6d8005680 con 0x7fc6e00aa430 2023-12-19T18:59:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.835+0000 7fc6d5ffb640 1 --2- 172.21.15.133:0/2330125930 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc6c40664a0 0x7fc6c4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.835+0000 7fc6d5ffb640 1 -- 172.21.15.133:0/2330125930 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc6d811d6f0 con 0x7fc6e00aa430 2023-12-19T18:59:23.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.835+0000 7fc6e5238640 1 --2- 172.21.15.133:0/2330125930 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc6c40664a0 0x7fc6c4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:23.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.835+0000 7fc6e5238640 1 --2- 172.21.15.133:0/2330125930 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc6c40664a0 0x7fc6c4068960 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc001b50 tx=0x7fc6dc000ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:23.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:23.839+0000 7fc6d5ffb640 1 -- 172.21.15.133:0/2330125930 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc6d80eaed0 con 0x7fc6e00aa430 2023-12-19T18:59:24.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.043+0000 7fc6e749c640 1 -- 172.21.15.133:0/2330125930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fc6e0068400 con 0x7fc6e00aa430 2023-12-19T18:59:24.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.047+0000 7fc6d5ffb640 1 -- 172.21.15.133:0/2330125930 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc6d80bd020 con 0x7fc6e00aa430 2023-12-19T18:59:24.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.047+0000 7fc6e749c640 1 -- 172.21.15.133:0/2330125930 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc6c40664a0 msgr2=0x7fc6c4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:24.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.047+0000 7fc6e749c640 1 --2- 172.21.15.133:0/2330125930 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc6c40664a0 0x7fc6c4068960 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc001b50 tx=0x7fc6dc000ee0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.047+0000 7fc6e749c640 1 -- 172.21.15.133:0/2330125930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e00aa430 msgr2=0x7fc6e01ecad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:24.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.047+0000 7fc6e749c640 1 --2- 172.21.15.133:0/2330125930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e00aa430 0x7fc6e01ecad0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fc6d801cc40 tx=0x7fc6cc005800 comp rx=0 tx=0).stop 2023-12-19T18:59:24.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.047+0000 7fc6e749c640 1 -- 172.21.15.133:0/2330125930 shutdown_connections 2023-12-19T18:59:24.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.047+0000 7fc6e749c640 1 --2- 172.21.15.133:0/2330125930 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc6c40664a0 0x7fc6c4068960 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.047+0000 7fc6e749c640 1 --2- 172.21.15.133:0/2330125930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6e00aa430 0x7fc6e01ecad0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.047+0000 7fc6e749c640 1 --2- 172.21.15.133:0/2330125930 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc6e01ea290 0x7fc6e00a4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.047+0000 7fc6e749c640 1 --2- 172.21.15.133:0/2330125930 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc6cc004d10 0x7fc6e00bf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.047+0000 7fc6e749c640 1 -- 172.21.15.133:0/2330125930 >> 172.21.15.133:0/2330125930 conn(0x7fc6e006a5b0 msgr2=0x7fc6e00c2730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:24.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.047+0000 7fc6e749c640 1 -- 172.21.15.133:0/2330125930 shutdown_connections 2023-12-19T18:59:24.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.047+0000 7fc6e749c640 1 -- 172.21.15.133:0/2330125930 wait complete. 2023-12-19T18:59:24.073 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-19T18:59:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0563bb8640 1 Processor -- start 2023-12-19T18:59:24.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0563bb8640 1 -- start start 2023-12-19T18:59:24.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0563bb8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f055c0a5370 0x7f055c0c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:24.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0563bb8640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055c0c2760 con 0x7f055c0c4110 2023-12-19T18:59:24.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0563bb8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055c0a5750 con 0x7f055c072090 2023-12-19T18:59:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0563bb8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055c0c3070 con 0x7f055c0a5370 2023-12-19T18:59:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0561153640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f055c0c4110 0x7f055c150fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33852/0 (socket says 172.21.15.133:33852) 2023-12-19T18:59:24.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0561153640 1 -- 172.21.15.133:0/2692256164 learned_addr learned my addr 172.21.15.133:0/2692256164 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0561954640 1 --2- 172.21.15.133:0/2692256164 >> v2:172.21.15.138:3300/0 conn(0x7f055c0a5370 0x7f055c0c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:24.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0560952640 1 -- 172.21.15.133:0/2692256164 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920362781 0 0) 0x7f055c0c2760 con 0x7f055c0c4110 2023-12-19T18:59:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0560952640 1 -- 172.21.15.133:0/2692256164 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0548005740 con 0x7f055c0c4110 2023-12-19T18:59:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0560952640 1 -- 172.21.15.133:0/2692256164 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 87041769 0 0) 0x7f0548005740 con 0x7f055c0c4110 2023-12-19T18:59:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0560952640 1 -- 172.21.15.133:0/2692256164 >> v2:172.21.15.138:3300/0 conn(0x7f055c0a5370 msgr2=0x7f055c0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0560952640 1 --2- 172.21.15.133:0/2692256164 >> v2:172.21.15.138:3300/0 conn(0x7f055c0a5370 0x7f055c0c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0560952640 1 -- 172.21.15.133:0/2692256164 >> v1:172.21.15.138:6789/0 conn(0x7f055c072090 legacy=0x7f055c15b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0560952640 1 -- 172.21.15.133:0/2692256164 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c0aad20 con 0x7f055c0c4110 2023-12-19T18:59:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0560952640 1 -- 172.21.15.133:0/2692256164 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f054c001680 con 0x7f055c0c4110 2023-12-19T18:59:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0560952640 1 -- 172.21.15.133:0/2692256164 >> v1:172.21.15.133:6789/0 conn(0x7f055c0c4110 legacy=0x7f055c150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0560952640 1 --2- 172.21.15.133:0/2692256164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0548005b90 0x7f0548005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0560952640 1 --2- 172.21.15.133:0/2692256164 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05480069e0 0x7f0548006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0560952640 1 --2- 172.21.15.133:0/2692256164 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05480074c0 0x7f054800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0560952640 1 -- 172.21.15.133:0/2692256164 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c0c3070 con 0x7f0548005b90 2023-12-19T18:59:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0560952640 1 -- 172.21.15.133:0/2692256164 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054800e390 con 0x7f05480074c0 2023-12-19T18:59:24.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0560952640 1 -- 172.21.15.133:0/2692256164 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054800e550 con 0x7f05480069e0 2023-12-19T18:59:24.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0561954640 1 --2- 172.21.15.133:0/2692256164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0548005b90 0x7f0548005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:24.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0561153640 1 --2- 172.21.15.133:0/2692256164 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05480069e0 0x7f0548006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:24.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0562155640 1 --2- 172.21.15.133:0/2692256164 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05480074c0 0x7f054800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:24.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0561954640 1 -- 172.21.15.133:0/2692256164 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05480069e0 msgr2=0x7f0548006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:24.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0561954640 1 --2- 172.21.15.133:0/2692256164 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05480069e0 0x7f0548006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0561954640 1 -- 172.21.15.133:0/2692256164 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05480074c0 msgr2=0x7f054800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:24.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0561954640 1 --2- 172.21.15.133:0/2692256164 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05480074c0 0x7f054800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0561954640 1 -- 172.21.15.133:0/2692256164 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0548005740 con 0x7f0548005b90 2023-12-19T18:59:24.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.207+0000 7f0562155640 1 -- 172.21.15.133:0/2692256164 reap_dead start 2023-12-19T18:59:24.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.211+0000 7f0561954640 1 --2- 172.21.15.133:0/2692256164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0548005b90 0x7f0548005fb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0558009ab0 tx=0x7f055801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a724a2340fa05f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:24.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.211+0000 7f0560952640 1 -- 172.21.15.133:0/2692256164 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05580a55f0 con 0x7f0548005b90 2023-12-19T18:59:24.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.211+0000 7f0560952640 1 -- 172.21.15.133:0/2692256164 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05580a5750 con 0x7f0548005b90 2023-12-19T18:59:24.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.211+0000 7f0560952640 1 -- 172.21.15.133:0/2692256164 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05580a5b00 con 0x7f0548005b90 2023-12-19T18:59:24.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.211+0000 7f0563bb8640 1 -- 172.21.15.133:0/2692256164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0548005b90 msgr2=0x7f0548005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:24.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.211+0000 7f0563bb8640 1 --2- 172.21.15.133:0/2692256164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0548005b90 0x7f0548005fb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0558009ab0 tx=0x7f055801ca00 comp rx=0 tx=0).stop 2023-12-19T18:59:24.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.211+0000 7f0563bb8640 1 -- 172.21.15.133:0/2692256164 shutdown_connections 2023-12-19T18:59:24.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.211+0000 7f0563bb8640 1 --2- 172.21.15.133:0/2692256164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0548005b90 0x7f0548005fb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.211+0000 7f0563bb8640 1 -- 172.21.15.133:0/2692256164 >> 172.21.15.133:0/2692256164 conn(0x7f055c06a5b0 msgr2=0x7f055c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:24.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.211+0000 7f0563bb8640 1 -- 172.21.15.133:0/2692256164 shutdown_connections 2023-12-19T18:59:24.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.211+0000 7f0563bb8640 1 -- 172.21.15.133:0/2692256164 wait complete. 2023-12-19T18:59:24.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f0563bb8640 1 Processor -- start 2023-12-19T18:59:24.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f0563bb8640 1 -- start start 2023-12-19T18:59:24.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f0563bb8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0548005b90 0x7f055c0a5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:24.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f0563bb8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f055c1eda80 0x7f055c0bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:24.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f0563bb8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f055c154210 0x7f055c14cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:24.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f0563bb8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c142bb0 con 0x7f055c154210 2023-12-19T18:59:24.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f0563bb8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c154e60 con 0x7f055c1eda80 2023-12-19T18:59:24.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f0563bb8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c153450 con 0x7f0548005b90 2023-12-19T18:59:24.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f0562155640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f055c154210 0x7f055c14cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:24.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f0562155640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f055c154210 0x7f055c14cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38216/0 (socket says 172.21.15.133:38216) 2023-12-19T18:59:24.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f0562155640 1 -- 172.21.15.133:0/1973807365 learned_addr learned my addr 172.21.15.133:0/1973807365 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:24.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f0561954640 1 --2- 172.21.15.133:0/1973807365 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0548005b90 0x7f055c0a5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:24.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f0561153640 1 --2- 172.21.15.133:0/1973807365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f055c1eda80 0x7f055c0bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:24.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f0562155640 1 -- 172.21.15.133:0/1973807365 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0548005b90 msgr2=0x7f055c0a5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:24.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f0562155640 1 --2- 172.21.15.133:0/1973807365 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0548005b90 0x7f055c0a5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f0562155640 1 -- 172.21.15.133:0/1973807365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f055c1eda80 msgr2=0x7f055c0bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:24.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f0562155640 1 --2- 172.21.15.133:0/1973807365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f055c1eda80 0x7f055c0bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f0562155640 1 -- 172.21.15.133:0/1973807365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c153730 con 0x7f055c154210 2023-12-19T18:59:24.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f0562155640 1 --2- 172.21.15.133:0/1973807365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f055c154210 0x7f055c14cde0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f055c0c2230 tx=0x7f055400fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:24.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f05527fc640 1 -- 172.21.15.133:0/1973807365 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554006d70 con 0x7f055c154210 2023-12-19T18:59:24.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f05527fc640 1 -- 172.21.15.133:0/1973807365 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0554003980 con 0x7f055c154210 2023-12-19T18:59:24.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f0563bb8640 1 -- 172.21.15.133:0/1973807365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055c153a10 con 0x7f055c154210 2023-12-19T18:59:24.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f05527fc640 1 -- 172.21.15.133:0/1973807365 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554003d30 con 0x7f055c154210 2023-12-19T18:59:24.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.215+0000 7f0563bb8640 1 -- 172.21.15.133:0/1973807365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055c1edf00 con 0x7f055c154210 2023-12-19T18:59:24.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.219+0000 7f0563bb8640 1 -- 172.21.15.133:0/1973807365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055c153f30 con 0x7f055c154210 2023-12-19T18:59:24.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.219+0000 7f05527fc640 1 -- 172.21.15.133:0/1973807365 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0554005070 con 0x7f055c154210 2023-12-19T18:59:24.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.219+0000 7f05527fc640 1 --2- 172.21.15.133:0/1973807365 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f05400664a0 0x7f0540068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:24.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.219+0000 7f05527fc640 1 -- 172.21.15.133:0/1973807365 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f05540830f0 con 0x7f055c154210 2023-12-19T18:59:24.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.219+0000 7f0561954640 1 --2- 172.21.15.133:0/1973807365 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f05400664a0 0x7f0540068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:24.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.223+0000 7f0561954640 1 --2- 172.21.15.133:0/1973807365 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f05400664a0 0x7f0540068960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f05580af000 tx=0x7f05580046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:24.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.223+0000 7f05527fc640 1 -- 172.21.15.133:0/1973807365 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f055c153f30 con 0x7f055c154210 2023-12-19T18:59:24.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.427+0000 7f0563bb8640 1 -- 172.21.15.133:0/1973807365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f055c153f30 con 0x7f055c154210 2023-12-19T18:59:24.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.431+0000 7f05527fc640 1 -- 172.21.15.133:0/1973807365 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f055c153f30 con 0x7f055c154210 2023-12-19T18:59:24.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.431+0000 7f0563bb8640 1 -- 172.21.15.133:0/1973807365 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f05400664a0 msgr2=0x7f0540068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:24.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.431+0000 7f0563bb8640 1 --2- 172.21.15.133:0/1973807365 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f05400664a0 0x7f0540068960 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f05580af000 tx=0x7f05580046d0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.431+0000 7f0563bb8640 1 -- 172.21.15.133:0/1973807365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f055c154210 msgr2=0x7f055c14cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:24.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.431+0000 7f0563bb8640 1 --2- 172.21.15.133:0/1973807365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f055c154210 0x7f055c14cde0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f055c0c2230 tx=0x7f055400fc00 comp rx=0 tx=0).stop 2023-12-19T18:59:24.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.431+0000 7f0563bb8640 1 -- 172.21.15.133:0/1973807365 shutdown_connections 2023-12-19T18:59:24.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.431+0000 7f0563bb8640 1 --2- 172.21.15.133:0/1973807365 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f05400664a0 0x7f0540068960 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.431+0000 7f0563bb8640 1 --2- 172.21.15.133:0/1973807365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f055c154210 0x7f055c14cde0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.431+0000 7f0563bb8640 1 --2- 172.21.15.133:0/1973807365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f055c1eda80 0x7f055c0bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.431+0000 7f0563bb8640 1 --2- 172.21.15.133:0/1973807365 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0548005b90 0x7f055c0a5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.431+0000 7f0563bb8640 1 -- 172.21.15.133:0/1973807365 >> 172.21.15.133:0/1973807365 conn(0x7f055c06a5b0 msgr2=0x7f055c14e310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:24.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.431+0000 7f0563bb8640 1 -- 172.21.15.133:0/1973807365 shutdown_connections 2023-12-19T18:59:24.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.431+0000 7f0563bb8640 1 -- 172.21.15.133:0/1973807365 wait complete. 2023-12-19T18:59:24.456 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:59:24.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.587+0000 7f8357417640 1 Processor -- start 2023-12-19T18:59:24.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f8357417640 1 -- start start 2023-12-19T18:59:24.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f8357417640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f83500c5640 0x7f83500c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:24.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f8357417640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83500c2580 con 0x7f83500c60f0 2023-12-19T18:59:24.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f8357417640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83500c1a00 con 0x7f83500c5260 2023-12-19T18:59:24.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f8357417640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8350153510 con 0x7f83500c5640 2023-12-19T18:59:24.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f83559b4640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f83500c60f0 0x7f8350155de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37338/0 (socket says 172.21.15.133:37338) 2023-12-19T18:59:24.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f83559b4640 1 -- 172.21.15.133:0/1924624807 learned_addr learned my addr 172.21.15.133:0/1924624807 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:24.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f83549b2640 1 --2- 172.21.15.133:0/1924624807 >> v2:172.21.15.138:3300/0 conn(0x7f83500c5640 0x7f83500c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:24.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f8347fff640 1 -- 172.21.15.133:0/1924624807 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3177051742 0 0) 0x7f83500c2580 con 0x7f83500c60f0 2023-12-19T18:59:24.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f8347fff640 1 -- 172.21.15.133:0/1924624807 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f833c003530 con 0x7f83500c60f0 2023-12-19T18:59:24.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f8347fff640 1 -- 172.21.15.133:0/1924624807 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4138945610 0 0) 0x7f833c003530 con 0x7f83500c60f0 2023-12-19T18:59:24.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f8347fff640 1 -- 172.21.15.133:0/1924624807 >> v2:172.21.15.138:3300/0 conn(0x7f83500c5640 msgr2=0x7f83500c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:24.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f8347fff640 1 --2- 172.21.15.133:0/1924624807 >> v2:172.21.15.138:3300/0 conn(0x7f83500c5640 0x7f83500c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f8347fff640 1 -- 172.21.15.133:0/1924624807 >> v1:172.21.15.138:6789/0 conn(0x7f83500c5260 legacy=0x7f835006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:24.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f8347fff640 1 -- 172.21.15.133:0/1924624807 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83500c1ce0 con 0x7f83500c60f0 2023-12-19T18:59:24.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f8347fff640 1 -- 172.21.15.133:0/1924624807 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f8348001a00 con 0x7f83500c60f0 2023-12-19T18:59:24.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f8347fff640 1 -- 172.21.15.133:0/1924624807 >> v1:172.21.15.133:6789/0 conn(0x7f83500c60f0 legacy=0x7f8350155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:24.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f8347fff640 1 --2- 172.21.15.133:0/1924624807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f833c003980 0x7f833c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:24.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f8347fff640 1 --2- 172.21.15.133:0/1924624807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c0047d0 0x7f833c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:24.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f8347fff640 1 --2- 172.21.15.133:0/1924624807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f833c005190 0x7f833c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:24.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f8347fff640 1 -- 172.21.15.133:0/1924624807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c00c100 con 0x7f833c0047d0 2023-12-19T18:59:24.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f8347fff640 1 -- 172.21.15.133:0/1924624807 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f833c00c270 con 0x7f833c003980 2023-12-19T18:59:24.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f8347fff640 1 -- 172.21.15.133:0/1924624807 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833c00c430 con 0x7f833c005190 2023-12-19T18:59:24.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f83549b2640 1 --2- 172.21.15.133:0/1924624807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c0047d0 0x7f833c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:24.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f83551b3640 1 --2- 172.21.15.133:0/1924624807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f833c003980 0x7f833c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:24.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f83559b4640 1 --2- 172.21.15.133:0/1924624807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f833c005190 0x7f833c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:24.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f83549b2640 1 -- 172.21.15.133:0/1924624807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f833c005190 msgr2=0x7f833c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:24.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f83549b2640 1 --2- 172.21.15.133:0/1924624807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f833c005190 0x7f833c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f83549b2640 1 -- 172.21.15.133:0/1924624807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f833c003980 msgr2=0x7f833c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:24.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f83549b2640 1 --2- 172.21.15.133:0/1924624807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f833c003980 0x7f833c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f83549b2640 1 -- 172.21.15.133:0/1924624807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c003530 con 0x7f833c0047d0 2023-12-19T18:59:24.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f83559b4640 1 --2- 172.21.15.133:0/1924624807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f833c005190 0x7f833c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:24.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.591+0000 7f83559b4640 1 -- 172.21.15.133:0/1924624807 reap_dead start 2023-12-19T18:59:24.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.595+0000 7f83549b2640 1 --2- 172.21.15.133:0/1924624807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c0047d0 0x7f833c004c50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8340009ab0 tx=0x7f834001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d0f35d32f2a9a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:24.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.595+0000 7f8347fff640 1 -- 172.21.15.133:0/1924624807 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83400a6410 con 0x7f833c0047d0 2023-12-19T18:59:24.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.595+0000 7f8347fff640 1 -- 172.21.15.133:0/1924624807 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83400a6570 con 0x7f833c0047d0 2023-12-19T18:59:24.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.595+0000 7f8347fff640 1 -- 172.21.15.133:0/1924624807 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83400a6920 con 0x7f833c0047d0 2023-12-19T18:59:24.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.595+0000 7f8357417640 1 -- 172.21.15.133:0/1924624807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c0047d0 msgr2=0x7f833c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:24.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.595+0000 7f8357417640 1 --2- 172.21.15.133:0/1924624807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c0047d0 0x7f833c004c50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8340009ab0 tx=0x7f834001ca30 comp rx=0 tx=0).stop 2023-12-19T18:59:24.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.595+0000 7f8357417640 1 -- 172.21.15.133:0/1924624807 shutdown_connections 2023-12-19T18:59:24.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.595+0000 7f8357417640 1 --2- 172.21.15.133:0/1924624807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c0047d0 0x7f833c004c50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.595+0000 7f8357417640 1 -- 172.21.15.133:0/1924624807 >> 172.21.15.133:0/1924624807 conn(0x7f835006a5b0 msgr2=0x7f835006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:24.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.595+0000 7f8357417640 1 -- 172.21.15.133:0/1924624807 shutdown_connections 2023-12-19T18:59:24.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.595+0000 7f8357417640 1 -- 172.21.15.133:0/1924624807 wait complete. 2023-12-19T18:59:24.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f8357417640 1 Processor -- start 2023-12-19T18:59:24.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f8357417640 1 -- start start 2023-12-19T18:59:24.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f8357417640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c0047d0 0x7f83501f0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:24.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f8357417640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8350150370 0x7f83500aa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:24.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f8357417640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83500aa600 0x7f835014ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:24.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f8357417640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8350154d70 con 0x7f833c0047d0 2023-12-19T18:59:24.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f8357417640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8350154a90 con 0x7f8350150370 2023-12-19T18:59:24.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f8357417640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83501f0f40 con 0x7f83500aa600 2023-12-19T18:59:24.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f83551b3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c0047d0 0x7f83501f0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:24.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f83551b3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c0047d0 0x7f83501f0660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42058/0 (socket says 172.21.15.133:42058) 2023-12-19T18:59:24.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f83551b3640 1 -- 172.21.15.133:0/2475290572 learned_addr learned my addr 172.21.15.133:0/2475290572 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:24.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f83549b2640 1 --2- 172.21.15.133:0/2475290572 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8350150370 0x7f83500aa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:24.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f83559b4640 1 --2- 172.21.15.133:0/2475290572 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83500aa600 0x7f835014ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:24.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f83551b3640 1 -- 172.21.15.133:0/2475290572 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83500aa600 msgr2=0x7f835014ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:24.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f83551b3640 1 --2- 172.21.15.133:0/2475290572 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83500aa600 0x7f835014ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f83551b3640 1 -- 172.21.15.133:0/2475290572 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8350150370 msgr2=0x7f83500aa0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:24.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f83551b3640 1 --2- 172.21.15.133:0/2475290572 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8350150370 0x7f83500aa0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f83551b3640 1 -- 172.21.15.133:0/2475290572 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83500a9ba0 con 0x7f833c0047d0 2023-12-19T18:59:24.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f83551b3640 1 --2- 172.21.15.133:0/2475290572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c0047d0 0x7f83501f0660 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f834c00f820 tx=0x7f834c00fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:24.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f8345ffb640 1 -- 172.21.15.133:0/2475290572 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c001cf0 con 0x7f833c0047d0 2023-12-19T18:59:24.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f8345ffb640 1 -- 172.21.15.133:0/2475290572 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f834c0052e0 con 0x7f833c0047d0 2023-12-19T18:59:24.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f8345ffb640 1 -- 172.21.15.133:0/2475290572 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f834c00d950 con 0x7f833c0047d0 2023-12-19T18:59:24.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f8357417640 1 -- 172.21.15.133:0/2475290572 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8350153940 con 0x7f833c0047d0 2023-12-19T18:59:24.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f8357417640 1 -- 172.21.15.133:0/2475290572 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83501f0ba0 con 0x7f833c0047d0 2023-12-19T18:59:24.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.599+0000 7f8357417640 1 -- 172.21.15.133:0/2475290572 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83501f0d90 con 0x7f833c0047d0 2023-12-19T18:59:24.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.603+0000 7f8345ffb640 1 -- 172.21.15.133:0/2475290572 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f834c00dab0 con 0x7f833c0047d0 2023-12-19T18:59:24.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.603+0000 7f8345ffb640 1 --2- 172.21.15.133:0/2475290572 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8334066470 0x7f8334068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:24.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.603+0000 7f8345ffb640 1 -- 172.21.15.133:0/2475290572 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f834c083a30 con 0x7f833c0047d0 2023-12-19T18:59:24.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.603+0000 7f83549b2640 1 --2- 172.21.15.133:0/2475290572 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8334066470 0x7f8334068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:24.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.603+0000 7f83549b2640 1 --2- 172.21.15.133:0/2475290572 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8334066470 0x7f8334068930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f83400ad000 tx=0x7f83400b2040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:24.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.607+0000 7f8345ffb640 1 -- 172.21.15.133:0/2475290572 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f834c051200 con 0x7f833c0047d0 2023-12-19T18:59:24.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.759+0000 7f8357417640 1 -- 172.21.15.133:0/2475290572 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83500a9d30 con 0x7f833c0047d0 2023-12-19T18:59:24.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.759+0000 7f8345ffb640 1 -- 172.21.15.133:0/2475290572 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+12893 (secure 0 0 0) 0x7f834c054820 con 0x7f833c0047d0 2023-12-19T18:59:24.765 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:24.765 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":27,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:59:21.753075+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:59:24.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.763+0000 7f8357417640 1 -- 172.21.15.133:0/2475290572 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8334066470 msgr2=0x7f8334068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:24.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.763+0000 7f8357417640 1 --2- 172.21.15.133:0/2475290572 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8334066470 0x7f8334068930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f83400ad000 tx=0x7f83400b2040 comp rx=0 tx=0).stop 2023-12-19T18:59:24.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.763+0000 7f8357417640 1 -- 172.21.15.133:0/2475290572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c0047d0 msgr2=0x7f83501f0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:24.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.763+0000 7f8357417640 1 --2- 172.21.15.133:0/2475290572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c0047d0 0x7f83501f0660 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f834c00f820 tx=0x7f834c00fce0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.763+0000 7f8357417640 1 -- 172.21.15.133:0/2475290572 shutdown_connections 2023-12-19T18:59:24.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.763+0000 7f8357417640 1 --2- 172.21.15.133:0/2475290572 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8334066470 0x7f8334068930 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.763+0000 7f8357417640 1 --2- 172.21.15.133:0/2475290572 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83500aa600 0x7f835014ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.763+0000 7f8357417640 1 --2- 172.21.15.133:0/2475290572 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8350150370 0x7f83500aa0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.763+0000 7f8357417640 1 --2- 172.21.15.133:0/2475290572 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f833c0047d0 0x7f83501f0660 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.763+0000 7f8357417640 1 -- 172.21.15.133:0/2475290572 >> 172.21.15.133:0/2475290572 conn(0x7f835006a5b0 msgr2=0x7f83500c4250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:24.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.763+0000 7f8357417640 1 -- 172.21.15.133:0/2475290572 shutdown_connections 2023-12-19T18:59:24.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.763+0000 7f8357417640 1 -- 172.21.15.133:0/2475290572 wait complete. 2023-12-19T18:59:24.787 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:59:24.788 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:59:24.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.923+0000 7f2ce311d640 1 Processor -- start 2023-12-19T18:59:24.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.923+0000 7f2ce311d640 1 -- start start 2023-12-19T18:59:24.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.923+0000 7f2ce311d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cdc0c5260 0x7f2cdc06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:24.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.923+0000 7f2ce311d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2cdc0c5640 0x7f2cdc0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:24.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.923+0000 7f2ce311d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2cdc0c60f0 0x7f2cdc155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:24.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.923+0000 7f2ce311d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cdc0c17f0 con 0x7f2cdc0c60f0 2023-12-19T18:59:24.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.927+0000 7f2ce311d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cdc0c2580 con 0x7f2cdc0c5640 2023-12-19T18:59:24.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.927+0000 7f2ce311d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc0c1a00 con 0x7f2cdc0c5260 2023-12-19T18:59:24.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.927+0000 7f2ce16ba640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2cdc0c60f0 0x7f2cdc155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:24.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.927+0000 7f2ce16ba640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2cdc0c60f0 0x7f2cdc155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42068/0 (socket says 172.21.15.133:42068) 2023-12-19T18:59:24.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.927+0000 7f2ce16ba640 1 -- 172.21.15.133:0/3668297638 learned_addr learned my addr 172.21.15.133:0/3668297638 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:24.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.927+0000 7f2cd3fff640 1 --2- 172.21.15.133:0/3668297638 >> v2:172.21.15.138:3300/0 conn(0x7f2cdc0c5640 0x7f2cdc0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:24.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.927+0000 7f2ce16ba640 1 -- 172.21.15.133:0/3668297638 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cdc0c5260 msgr2=0x7f2cdc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:24.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.927+0000 7f2ce0eb9640 1 --2- 172.21.15.133:0/3668297638 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cdc0c5260 0x7f2cdc06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:24.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.927+0000 7f2ce16ba640 1 --2- 172.21.15.133:0/3668297638 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cdc0c5260 0x7f2cdc06d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.927+0000 7f2ce16ba640 1 -- 172.21.15.133:0/3668297638 >> v2:172.21.15.138:3300/0 conn(0x7f2cdc0c5640 msgr2=0x7f2cdc0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:24.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.927+0000 7f2ce16ba640 1 --2- 172.21.15.133:0/3668297638 >> v2:172.21.15.138:3300/0 conn(0x7f2cdc0c5640 0x7f2cdc0c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.927+0000 7f2ce16ba640 1 -- 172.21.15.133:0/3668297638 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cdc0c1ce0 con 0x7f2cdc0c60f0 2023-12-19T18:59:24.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.927+0000 7f2cd3fff640 1 --2- 172.21.15.133:0/3668297638 >> v2:172.21.15.138:3300/0 conn(0x7f2cdc0c5640 0x7f2cdc0c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:24.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.927+0000 7f2ce0eb9640 1 --2- 172.21.15.133:0/3668297638 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cdc0c5260 0x7f2cdc06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:24.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.927+0000 7f2ce16ba640 1 --2- 172.21.15.133:0/3668297638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cdc0c60f0 0x7f2cdc155de0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc0c3870 tx=0x7f2cd401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c611d31d6032390a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:24.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.927+0000 7f2cd37fe640 1 -- 172.21.15.133:0/3668297638 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd40a5790 con 0x7f2cdc0c60f0 2023-12-19T18:59:24.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.927+0000 7f2cd37fe640 1 -- 172.21.15.133:0/3668297638 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd40a58f0 con 0x7f2cdc0c60f0 2023-12-19T18:59:24.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.927+0000 7f2cd37fe640 1 -- 172.21.15.133:0/3668297638 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd40a5c80 con 0x7f2cdc0c60f0 2023-12-19T18:59:24.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.931+0000 7f2ce311d640 1 -- 172.21.15.133:0/3668297638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cdc0c60f0 msgr2=0x7f2cdc155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:24.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.931+0000 7f2ce311d640 1 --2- 172.21.15.133:0/3668297638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cdc0c60f0 0x7f2cdc155de0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc0c3870 tx=0x7f2cd401c910 comp rx=0 tx=0).stop 2023-12-19T18:59:24.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.931+0000 7f2ce311d640 1 -- 172.21.15.133:0/3668297638 shutdown_connections 2023-12-19T18:59:24.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.931+0000 7f2ce311d640 1 --2- 172.21.15.133:0/3668297638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cdc0c60f0 0x7f2cdc155de0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.931+0000 7f2ce311d640 1 --2- 172.21.15.133:0/3668297638 >> v2:172.21.15.138:3300/0 conn(0x7f2cdc0c5640 0x7f2cdc0c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.931+0000 7f2ce311d640 1 --2- 172.21.15.133:0/3668297638 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cdc0c5260 0x7f2cdc06d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.931+0000 7f2ce311d640 1 -- 172.21.15.133:0/3668297638 >> 172.21.15.133:0/3668297638 conn(0x7f2cdc06a5b0 msgr2=0x7f2cdc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:24.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.931+0000 7f2ce311d640 1 -- 172.21.15.133:0/3668297638 shutdown_connections 2023-12-19T18:59:24.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.931+0000 7f2ce311d640 1 -- 172.21.15.133:0/3668297638 wait complete. 2023-12-19T18:59:24.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.931+0000 7f2ce311d640 1 Processor -- start 2023-12-19T18:59:24.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.931+0000 7f2ce311d640 1 -- start start 2023-12-19T18:59:24.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.931+0000 7f2ce311d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cdc0c5260 0x7f2cdc1ee1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:24.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.931+0000 7f2ce311d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cdc0c5640 0x7f2cdc0bacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:24.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.931+0000 7f2ce311d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cdc0c60f0 0x7f2cdc0bb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:24.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.931+0000 7f2ce311d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc14f4b0 con 0x7f2cdc0c5640 2023-12-19T18:59:24.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.931+0000 7f2ce311d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc0bd090 con 0x7f2cdc0c60f0 2023-12-19T18:59:24.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.931+0000 7f2ce311d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc0bb770 con 0x7f2cdc0c5260 2023-12-19T18:59:24.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.931+0000 7f2cd3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cdc0c5640 0x7f2cdc0bacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:24.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.931+0000 7f2cd3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cdc0c5640 0x7f2cdc0bacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42076/0 (socket says 172.21.15.133:42076) 2023-12-19T18:59:24.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.931+0000 7f2cd3fff640 1 -- 172.21.15.133:0/2865150208 learned_addr learned my addr 172.21.15.133:0/2865150208 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:24.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.931+0000 7f2ce0eb9640 1 --2- 172.21.15.133:0/2865150208 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cdc0c5260 0x7f2cdc1ee1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:24.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.931+0000 7f2ce16ba640 1 --2- 172.21.15.133:0/2865150208 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cdc0c60f0 0x7f2cdc0bb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:24.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.935+0000 7f2cd3fff640 1 -- 172.21.15.133:0/2865150208 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cdc0c5260 msgr2=0x7f2cdc1ee1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:24.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.935+0000 7f2cd3fff640 1 --2- 172.21.15.133:0/2865150208 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cdc0c5260 0x7f2cdc1ee1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.935+0000 7f2cd3fff640 1 -- 172.21.15.133:0/2865150208 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cdc0c60f0 msgr2=0x7f2cdc0bb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:24.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.935+0000 7f2cd3fff640 1 --2- 172.21.15.133:0/2865150208 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cdc0c60f0 0x7f2cdc0bb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:24.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.935+0000 7f2cd3fff640 1 -- 172.21.15.133:0/2865150208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd4009b30 con 0x7f2cdc0c5640 2023-12-19T18:59:24.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.935+0000 7f2cd3fff640 1 --2- 172.21.15.133:0/2865150208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cdc0c5640 0x7f2cdc0bacf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc00c820 tx=0x7f2ccc00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:24.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.935+0000 7f2cd17fa640 1 -- 172.21.15.133:0/2865150208 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc004220 con 0x7f2cdc0c5640 2023-12-19T18:59:24.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.935+0000 7f2cd17fa640 1 -- 172.21.15.133:0/2865150208 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ccc004380 con 0x7f2cdc0c5640 2023-12-19T18:59:24.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.935+0000 7f2ce311d640 1 -- 172.21.15.133:0/2865150208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cdc071780 con 0x7f2cdc0c5640 2023-12-19T18:59:24.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.935+0000 7f2cd17fa640 1 -- 172.21.15.133:0/2865150208 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc007a50 con 0x7f2cdc0c5640 2023-12-19T18:59:24.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.935+0000 7f2ce311d640 1 -- 172.21.15.133:0/2865150208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cdc0bd2a0 con 0x7f2cdc0c5640 2023-12-19T18:59:24.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.935+0000 7f2ce311d640 1 -- 172.21.15.133:0/2865150208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cdc06fe30 con 0x7f2cdc0c5640 2023-12-19T18:59:24.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.935+0000 7f2cd17fa640 1 -- 172.21.15.133:0/2865150208 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2ccc007bb0 con 0x7f2cdc0c5640 2023-12-19T18:59:24.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.935+0000 7f2cd17fa640 1 --2- 172.21.15.133:0/2865150208 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2cc80664a0 0x7f2cc8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:24.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.935+0000 7f2cd17fa640 1 -- 172.21.15.133:0/2865150208 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2ccc083750 con 0x7f2cdc0c5640 2023-12-19T18:59:24.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.935+0000 7f2ce0eb9640 1 --2- 172.21.15.133:0/2865150208 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2cc80664a0 0x7f2cc8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:24.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.939+0000 7f2ce0eb9640 1 --2- 172.21.15.133:0/2865150208 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2cc80664a0 0x7f2cc8068960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800aaf0 tx=0x7f2cd8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:24.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:24.939+0000 7f2cd17fa640 1 -- 172.21.15.133:0/2865150208 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2ccc050fc0 con 0x7f2cdc0c5640 2023-12-19T18:59:25.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.091+0000 7f2ce311d640 1 -- 172.21.15.133:0/2865150208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2cdc068400 con 0x7f2cdc0c5640 2023-12-19T18:59:25.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.091+0000 7f2cd17fa640 1 -- 172.21.15.133:0/2865150208 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2ccc01e020 con 0x7f2cdc0c5640 2023-12-19T18:59:25.098 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T18:59:25.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.095+0000 7f2ce311d640 1 -- 172.21.15.133:0/2865150208 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2cc80664a0 msgr2=0x7f2cc8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:25.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.095+0000 7f2ce311d640 1 --2- 172.21.15.133:0/2865150208 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2cc80664a0 0x7f2cc8068960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800aaf0 tx=0x7f2cd8008040 comp rx=0 tx=0).stop 2023-12-19T18:59:25.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.095+0000 7f2ce311d640 1 -- 172.21.15.133:0/2865150208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cdc0c5640 msgr2=0x7f2cdc0bacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:25.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.095+0000 7f2ce311d640 1 --2- 172.21.15.133:0/2865150208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cdc0c5640 0x7f2cdc0bacf0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc00c820 tx=0x7f2ccc00cce0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.095+0000 7f2ce311d640 1 -- 172.21.15.133:0/2865150208 shutdown_connections 2023-12-19T18:59:25.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.095+0000 7f2ce311d640 1 --2- 172.21.15.133:0/2865150208 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2cc80664a0 0x7f2cc8068960 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.095+0000 7f2ce311d640 1 --2- 172.21.15.133:0/2865150208 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cdc0c60f0 0x7f2cdc0bb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.095+0000 7f2ce311d640 1 --2- 172.21.15.133:0/2865150208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cdc0c5640 0x7f2cdc0bacf0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.095+0000 7f2ce311d640 1 --2- 172.21.15.133:0/2865150208 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cdc0c5260 0x7f2cdc1ee1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.095+0000 7f2ce311d640 1 -- 172.21.15.133:0/2865150208 >> 172.21.15.133:0/2865150208 conn(0x7f2cdc06a5b0 msgr2=0x7f2cdc06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:25.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.095+0000 7f2ce311d640 1 -- 172.21.15.133:0/2865150208 shutdown_connections 2023-12-19T18:59:25.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.095+0000 7f2ce311d640 1 -- 172.21.15.133:0/2865150208 wait complete. 2023-12-19T18:59:25.120 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T18:59:25.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.251+0000 7f85745e6640 1 Processor -- start 2023-12-19T18:59:25.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.251+0000 7f85745e6640 1 -- start start 2023-12-19T18:59:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.255+0000 7f85745e6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f856c0a5370 0x7f856c0c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.255+0000 7f85745e6640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f856c0c4110 0x7f856c150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.255+0000 7f85745e6640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f856c0c2760 con 0x7f856c072090 2023-12-19T18:59:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.255+0000 7f85745e6640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856c0c3070 con 0x7f856c0c4110 2023-12-19T18:59:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.255+0000 7f85745e6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856c151bf0 con 0x7f856c0a5370 2023-12-19T18:59:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.255+0000 7f8572382640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f856c0a5370 0x7f856c0c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:25.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.255+0000 7f8572b83640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f856c072090 0x7f856c1514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:53236/0 (socket says 172.21.15.133:53236) 2023-12-19T18:59:25.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.255+0000 7f8572b83640 1 -- 172.21.15.133:0/755896779 learned_addr learned my addr 172.21.15.133:0/755896779 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:25.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.255+0000 7f8571b81640 1 --2- 172.21.15.133:0/755896779 >> v2:172.21.15.138:3300/0 conn(0x7f856c0c4110 0x7f856c150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:25.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.255+0000 7f8571380640 1 -- 172.21.15.133:0/755896779 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045664649 0 0) 0x7f856c0c2760 con 0x7f856c072090 2023-12-19T18:59:25.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.255+0000 7f8571380640 1 -- 172.21.15.133:0/755896779 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8558003530 con 0x7f856c072090 2023-12-19T18:59:25.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.255+0000 7f8571b81640 1 -- 172.21.15.133:0/755896779 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f856c0a5370 msgr2=0x7f856c0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:25.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.255+0000 7f8571b81640 1 --2- 172.21.15.133:0/755896779 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f856c0a5370 0x7f856c0c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.255+0000 7f8571b81640 1 -- 172.21.15.133:0/755896779 >> v1:172.21.15.138:6789/0 conn(0x7f856c072090 legacy=0x7f856c1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:25.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.255+0000 7f8571b81640 1 -- 172.21.15.133:0/755896779 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c0a5750 con 0x7f856c0c4110 2023-12-19T18:59:25.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.255+0000 7f8572382640 1 --2- 172.21.15.133:0/755896779 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f856c0a5370 0x7f856c0c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:59:25.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.259+0000 7f8571b81640 1 --2- 172.21.15.133:0/755896779 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f856c0c4110 0x7f856c150fa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f855c0097f0 tx=0x7f855c01c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb8299b2886a9938 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.259+0000 7f8571380640 1 -- 172.21.15.133:0/755896779 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c0ab600 con 0x7f856c0c4110 2023-12-19T18:59:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.259+0000 7f8571380640 1 -- 172.21.15.133:0/755896779 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855c0a7050 con 0x7f856c0c4110 2023-12-19T18:59:25.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.259+0000 7f8571380640 1 -- 172.21.15.133:0/755896779 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c0ab980 con 0x7f856c0c4110 2023-12-19T18:59:25.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.259+0000 7f85745e6640 1 -- 172.21.15.133:0/755896779 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f856c0c4110 msgr2=0x7f856c150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:25.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.259+0000 7f85745e6640 1 --2- 172.21.15.133:0/755896779 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f856c0c4110 0x7f856c150fa0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f855c0097f0 tx=0x7f855c01c330 comp rx=0 tx=0).stop 2023-12-19T18:59:25.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.259+0000 7f85745e6640 1 -- 172.21.15.133:0/755896779 shutdown_connections 2023-12-19T18:59:25.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.259+0000 7f85745e6640 1 --2- 172.21.15.133:0/755896779 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f856c0c4110 0x7f856c150fa0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.259+0000 7f85745e6640 1 --2- 172.21.15.133:0/755896779 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f856c0a5370 0x7f856c0c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.259+0000 7f85745e6640 1 -- 172.21.15.133:0/755896779 >> 172.21.15.133:0/755896779 conn(0x7f856c06a5b0 msgr2=0x7f856c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:25.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.259+0000 7f85745e6640 1 -- 172.21.15.133:0/755896779 shutdown_connections 2023-12-19T18:59:25.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.259+0000 7f85745e6640 1 -- 172.21.15.133:0/755896779 wait complete. 2023-12-19T18:59:25.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.259+0000 7f85745e6640 1 Processor -- start 2023-12-19T18:59:25.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.259+0000 7f85745e6640 1 -- start start 2023-12-19T18:59:25.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f85745e6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f856c072090 0x7f856c071230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:25.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f85745e6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f856c0a5370 0x7f856c0a7030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:25.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f85745e6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f856c0c4110 0x7f856c149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f85745e6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c14ef70 con 0x7f856c072090 2023-12-19T18:59:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f85745e6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c1546b0 con 0x7f856c0c4110 2023-12-19T18:59:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f85745e6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856c14e6f0 con 0x7f856c0a5370 2023-12-19T18:59:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f8572382640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f856c072090 0x7f856c071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f8572382640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f856c072090 0x7f856c071230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42088/0 (socket says 172.21.15.133:42088) 2023-12-19T18:59:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f8572382640 1 -- 172.21.15.133:0/997412140 learned_addr learned my addr 172.21.15.133:0/997412140 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f8571b81640 1 --2- 172.21.15.133:0/997412140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f856c0a5370 0x7f856c0a7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f8572b83640 1 --2- 172.21.15.133:0/997412140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f856c0c4110 0x7f856c149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f8572382640 1 -- 172.21.15.133:0/997412140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f856c0a5370 msgr2=0x7f856c0a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f8572382640 1 --2- 172.21.15.133:0/997412140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f856c0a5370 0x7f856c0a7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f8572382640 1 -- 172.21.15.133:0/997412140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f856c0c4110 msgr2=0x7f856c149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f8572382640 1 --2- 172.21.15.133:0/997412140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f856c0c4110 0x7f856c149dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f8572382640 1 -- 172.21.15.133:0/997412140 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8568009420 con 0x7f856c072090 2023-12-19T18:59:25.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f8572382640 1 --2- 172.21.15.133:0/997412140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f856c072090 0x7f856c071230 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f856800ec10 tx=0x7f856800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f8562ffd640 1 -- 172.21.15.133:0/997412140 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856800cc30 con 0x7f856c072090 2023-12-19T18:59:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f8562ffd640 1 -- 172.21.15.133:0/997412140 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856800cd90 con 0x7f856c072090 2023-12-19T18:59:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f8562ffd640 1 -- 172.21.15.133:0/997412140 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8568013690 con 0x7f856c072090 2023-12-19T18:59:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f85745e6640 1 -- 172.21.15.133:0/997412140 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855c009420 con 0x7f856c072090 2023-12-19T18:59:25.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f85745e6640 1 -- 172.21.15.133:0/997412140 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856c154900 con 0x7f856c072090 2023-12-19T18:59:25.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f85745e6640 1 -- 172.21.15.133:0/997412140 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856c068400 con 0x7f856c072090 2023-12-19T18:59:25.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.263+0000 7f8562ffd640 1 -- 172.21.15.133:0/997412140 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f85680137f0 con 0x7f856c072090 2023-12-19T18:59:25.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.267+0000 7f8562ffd640 1 --2- 172.21.15.133:0/997412140 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f85500664a0 0x7f8550068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:25.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.267+0000 7f8562ffd640 1 -- 172.21.15.133:0/997412140 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8568084140 con 0x7f856c072090 2023-12-19T18:59:25.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.267+0000 7f8571b81640 1 --2- 172.21.15.133:0/997412140 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f85500664a0 0x7f8550068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:25.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.267+0000 7f8571b81640 1 --2- 172.21.15.133:0/997412140 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f85500664a0 0x7f8550068960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f855c0ad000 tx=0x7f855c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:25.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.271+0000 7f8562ffd640 1 -- 172.21.15.133:0/997412140 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f85680519c0 con 0x7f856c072090 2023-12-19T18:59:25.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.419+0000 7f85745e6640 1 -- 172.21.15.133:0/997412140 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f856c0c6780 con 0x7f856c072090 2023-12-19T18:59:25.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.423+0000 7f8562ffd640 1 -- 172.21.15.133:0/997412140 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8568054fe0 con 0x7f856c072090 2023-12-19T18:59:25.427 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:25.427 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2023-12-19T18:59:25.428 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:25.428 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2023-12-19T18:59:25.428 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": ".mgr" 2023-12-19T18:59:25.428 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:25.428 INFO:teuthology.orchestra.run.smithi133.stdout:] 2023-12-19T18:59:25.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.423+0000 7f85745e6640 1 -- 172.21.15.133:0/997412140 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f85500664a0 msgr2=0x7f8550068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.423+0000 7f85745e6640 1 --2- 172.21.15.133:0/997412140 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f85500664a0 0x7f8550068960 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f855c0ad000 tx=0x7f855c0a6000 comp rx=0 tx=0).stop 2023-12-19T18:59:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.423+0000 7f85745e6640 1 -- 172.21.15.133:0/997412140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f856c072090 msgr2=0x7f856c071230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.423+0000 7f85745e6640 1 --2- 172.21.15.133:0/997412140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f856c072090 0x7f856c071230 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f856800ec10 tx=0x7f856800c520 comp rx=0 tx=0).stop 2023-12-19T18:59:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.423+0000 7f85745e6640 1 -- 172.21.15.133:0/997412140 shutdown_connections 2023-12-19T18:59:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.423+0000 7f85745e6640 1 --2- 172.21.15.133:0/997412140 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f85500664a0 0x7f8550068960 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.423+0000 7f85745e6640 1 --2- 172.21.15.133:0/997412140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f856c0c4110 0x7f856c149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.423+0000 7f85745e6640 1 --2- 172.21.15.133:0/997412140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f856c0a5370 0x7f856c0a7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.423+0000 7f85745e6640 1 --2- 172.21.15.133:0/997412140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f856c072090 0x7f856c071230 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.423+0000 7f85745e6640 1 -- 172.21.15.133:0/997412140 >> 172.21.15.133:0/997412140 conn(0x7f856c06a5b0 msgr2=0x7f856c0bf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.423+0000 7f85745e6640 1 -- 172.21.15.133:0/997412140 shutdown_connections 2023-12-19T18:59:25.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.423+0000 7f85745e6640 1 -- 172.21.15.133:0/997412140 wait complete. 2023-12-19T18:59:25.448 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T18:59:25.448 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T18:59:25.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.583+0000 7f11053f5640 1 Processor -- start 2023-12-19T18:59:25.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.583+0000 7f11053f5640 1 -- start start 2023-12-19T18:59:25.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.583+0000 7f11053f5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11000c4940 0x7f11000c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:25.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.583+0000 7f11053f5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f11000c9850 0x7f11000c4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:25.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.583+0000 7f11053f5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1100155210 0x7f11000a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:25.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.583+0000 7f11053f5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11000c5650 con 0x7f11000c9850 2023-12-19T18:59:25.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.583+0000 7f11053f5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11000c8b20 con 0x7f1100155210 2023-12-19T18:59:25.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.583+0000 7f11053f5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11000c9c90 con 0x7f11000c4940 2023-12-19T18:59:25.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.583+0000 7f10f67fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f11000c9850 0x7f11000c4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:25.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.583+0000 7f10f67fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f11000c9850 0x7f11000c4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42090/0 (socket says 172.21.15.133:42090) 2023-12-19T18:59:25.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.583+0000 7f10f67fc640 1 -- 172.21.15.133:0/59497262 learned_addr learned my addr 172.21.15.133:0/59497262 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:25.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.583+0000 7f10ff7fe640 1 --2- 172.21.15.133:0/59497262 >> v2:172.21.15.138:3300/0 conn(0x7f1100155210 0x7f11000a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:25.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.583+0000 7f10feffd640 1 --2- 172.21.15.133:0/59497262 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11000c4940 0x7f11000c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:25.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.583+0000 7f10f67fc640 1 -- 172.21.15.133:0/59497262 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11000c4940 msgr2=0x7f11000c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:25.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.583+0000 7f10f67fc640 1 --2- 172.21.15.133:0/59497262 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11000c4940 0x7f11000c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.583+0000 7f10f67fc640 1 -- 172.21.15.133:0/59497262 >> v2:172.21.15.138:3300/0 conn(0x7f1100155210 msgr2=0x7f11000a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:25.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.583+0000 7f10f67fc640 1 --2- 172.21.15.133:0/59497262 >> v2:172.21.15.138:3300/0 conn(0x7f1100155210 0x7f11000a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.587+0000 7f10f67fc640 1 -- 172.21.15.133:0/59497262 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11000c85a0 con 0x7f11000c9850 2023-12-19T18:59:25.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.587+0000 7f10f67fc640 1 --2- 172.21.15.133:0/59497262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11000c9850 0x7f11000c4d20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f110006ad70 tx=0x7f10e801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a876786551fd85f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:25.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.587+0000 7f10fe7fc640 1 -- 172.21.15.133:0/59497262 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e80ac410 con 0x7f11000c9850 2023-12-19T18:59:25.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.587+0000 7f10fe7fc640 1 -- 172.21.15.133:0/59497262 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10e80ac570 con 0x7f11000c9850 2023-12-19T18:59:25.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.587+0000 7f10fe7fc640 1 -- 172.21.15.133:0/59497262 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10e80ac900 con 0x7f11000c9850 2023-12-19T18:59:25.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.587+0000 7f11053f5640 1 -- 172.21.15.133:0/59497262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11000c9850 msgr2=0x7f11000c4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:25.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.587+0000 7f11053f5640 1 --2- 172.21.15.133:0/59497262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11000c9850 0x7f11000c4d20 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f110006ad70 tx=0x7f10e801c500 comp rx=0 tx=0).stop 2023-12-19T18:59:25.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.587+0000 7f11053f5640 1 -- 172.21.15.133:0/59497262 shutdown_connections 2023-12-19T18:59:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.587+0000 7f11053f5640 1 --2- 172.21.15.133:0/59497262 >> v2:172.21.15.138:3300/0 conn(0x7f1100155210 0x7f11000a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.587+0000 7f11053f5640 1 --2- 172.21.15.133:0/59497262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11000c9850 0x7f11000c4d20 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.587+0000 7f11053f5640 1 --2- 172.21.15.133:0/59497262 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11000c4940 0x7f11000c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.587+0000 7f11053f5640 1 -- 172.21.15.133:0/59497262 >> 172.21.15.133:0/59497262 conn(0x7f11000abb70 msgr2=0x7f11000abf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.587+0000 7f11053f5640 1 -- 172.21.15.133:0/59497262 shutdown_connections 2023-12-19T18:59:25.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.587+0000 7f11053f5640 1 -- 172.21.15.133:0/59497262 wait complete. 2023-12-19T18:59:25.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.591+0000 7f11053f5640 1 Processor -- start 2023-12-19T18:59:25.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.591+0000 7f11053f5640 1 -- start start 2023-12-19T18:59:25.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.591+0000 7f11053f5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11000c4940 0x7f110015e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:25.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.591+0000 7f11053f5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11000c9850 0x7f11001500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:25.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.591+0000 7f11053f5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1100155210 0x7f11001505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:25.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.591+0000 7f11053f5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11000c1710 con 0x7f1100155210 2023-12-19T18:59:25.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.591+0000 7f11053f5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1100150b20 con 0x7f11000c9850 2023-12-19T18:59:25.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.591+0000 7f11053f5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11001ece30 con 0x7f11000c4940 2023-12-19T18:59:25.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.591+0000 7f10ff7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1100155210 0x7f11001505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:25.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.591+0000 7f10ff7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1100155210 0x7f11001505e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42098/0 (socket says 172.21.15.133:42098) 2023-12-19T18:59:25.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.591+0000 7f10ff7fe640 1 -- 172.21.15.133:0/2292711501 learned_addr learned my addr 172.21.15.133:0/2292711501 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:25.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.591+0000 7f10ff7fe640 1 -- 172.21.15.133:0/2292711501 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11000c4940 msgr2=0x7f110015e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:25.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.591+0000 7f10ff7fe640 1 --2- 172.21.15.133:0/2292711501 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11000c4940 0x7f110015e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.591+0000 7f10ff7fe640 1 -- 172.21.15.133:0/2292711501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11000c9850 msgr2=0x7f11001500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:25.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.591+0000 7f10f67fc640 1 --2- 172.21.15.133:0/2292711501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11000c9850 0x7f11001500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:25.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.591+0000 7f10ff7fe640 1 --2- 172.21.15.133:0/2292711501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11000c9850 0x7f11001500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.591+0000 7f10ff7fe640 1 -- 172.21.15.133:0/2292711501 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e80094d0 con 0x7f1100155210 2023-12-19T18:59:25.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.591+0000 7f10ff7fe640 1 --2- 172.21.15.133:0/2292711501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1100155210 0x7f11001505e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f10f800e7f0 tx=0x7f10f800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:25.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.591+0000 7f10f7fff640 1 -- 172.21.15.133:0/2292711501 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f8009530 con 0x7f1100155210 2023-12-19T18:59:25.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.591+0000 7f10f7fff640 1 -- 172.21.15.133:0/2292711501 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f800eea0 con 0x7f1100155210 2023-12-19T18:59:25.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.591+0000 7f11053f5640 1 -- 172.21.15.133:0/2292711501 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11000c3e80 con 0x7f1100155210 2023-12-19T18:59:25.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.591+0000 7f10f7fff640 1 -- 172.21.15.133:0/2292711501 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f800cb60 con 0x7f1100155210 2023-12-19T18:59:25.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.591+0000 7f11053f5640 1 -- 172.21.15.133:0/2292711501 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11000c1960 con 0x7f1100155210 2023-12-19T18:59:25.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.595+0000 7f11053f5640 1 -- 172.21.15.133:0/2292711501 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1100068400 con 0x7f1100155210 2023-12-19T18:59:25.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.595+0000 7f10f7fff640 1 -- 172.21.15.133:0/2292711501 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f10f800ccc0 con 0x7f1100155210 2023-12-19T18:59:25.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.595+0000 7f10f7fff640 1 --2- 172.21.15.133:0/2292711501 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f10e0066470 0x7f10e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:25.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.595+0000 7f10f7fff640 1 -- 172.21.15.133:0/2292711501 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f10f8083cb0 con 0x7f1100155210 2023-12-19T18:59:25.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.595+0000 7f10feffd640 1 --2- 172.21.15.133:0/2292711501 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f10e0066470 0x7f10e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:25.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.595+0000 7f10feffd640 1 --2- 172.21.15.133:0/2292711501 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f10e0066470 0x7f10e0068930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f10f000e110 tx=0x7f10f000d040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:25.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.599+0000 7f10f7fff640 1 -- 172.21.15.133:0/2292711501 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f10f8051470 con 0x7f1100155210 2023-12-19T18:59:25.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.751+0000 7f11053f5640 1 -- 172.21.15.133:0/2292711501 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f11000ab950 con 0x7f1100155210 2023-12-19T18:59:25.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.847+0000 7f10f7fff640 1 -- 172.21.15.133:0/2292711501 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7f10f8054a90 con 0x7f1100155210 2023-12-19T18:59:25.851 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2023-12-19T18:59:25.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.847+0000 7f11053f5640 1 -- 172.21.15.133:0/2292711501 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f10e0066470 msgr2=0x7f10e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:25.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.847+0000 7f11053f5640 1 --2- 172.21.15.133:0/2292711501 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f10e0066470 0x7f10e0068930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f10f000e110 tx=0x7f10f000d040 comp rx=0 tx=0).stop 2023-12-19T18:59:25.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.847+0000 7f11053f5640 1 -- 172.21.15.133:0/2292711501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1100155210 msgr2=0x7f11001505e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:25.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.847+0000 7f11053f5640 1 --2- 172.21.15.133:0/2292711501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1100155210 0x7f11001505e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f10f800e7f0 tx=0x7f10f800ecb0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.847+0000 7f11053f5640 1 -- 172.21.15.133:0/2292711501 shutdown_connections 2023-12-19T18:59:25.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.847+0000 7f11053f5640 1 --2- 172.21.15.133:0/2292711501 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f10e0066470 0x7f10e0068930 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.847+0000 7f11053f5640 1 --2- 172.21.15.133:0/2292711501 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1100155210 0x7f11001505e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.847+0000 7f11053f5640 1 --2- 172.21.15.133:0/2292711501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11000c9850 0x7f11001500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.847+0000 7f11053f5640 1 --2- 172.21.15.133:0/2292711501 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f11000c4940 0x7f110015e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:25.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.847+0000 7f11053f5640 1 -- 172.21.15.133:0/2292711501 >> 172.21.15.133:0/2292711501 conn(0x7f11000abb70 msgr2=0x7f110006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:25.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.847+0000 7f11053f5640 1 -- 172.21.15.133:0/2292711501 shutdown_connections 2023-12-19T18:59:25.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:25.847+0000 7f11053f5640 1 -- 172.21.15.133:0/2292711501 wait complete. 2023-12-19T18:59:25.878 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T18:59:26.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac3866b640 1 Processor -- start 2023-12-19T18:59:26.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac3866b640 1 -- start start 2023-12-19T18:59:26.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac3866b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fac300c4100 0x7fac300c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:26.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac3866b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac300c31c0 con 0x7fac300c63c0 2023-12-19T18:59:26.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac3866b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac300c34a0 con 0x7fac300c06d0 2023-12-19T18:59:26.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac3866b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac300c1030 con 0x7fac300c4100 2023-12-19T18:59:26.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac36407640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fac300c63c0 0x7fac300c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37346/0 (socket says 172.21.15.133:37346) 2023-12-19T18:59:26.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac36407640 1 -- 172.21.15.133:0/1294976055 learned_addr learned my addr 172.21.15.133:0/1294976055 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:26.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac35c06640 1 --2- 172.21.15.133:0/1294976055 >> v2:172.21.15.138:3300/0 conn(0x7fac300c4100 0x7fac300c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:26.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac35405640 1 -- 172.21.15.133:0/1294976055 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187754621 0 0) 0x7fac300c31c0 con 0x7fac300c63c0 2023-12-19T18:59:26.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac35405640 1 -- 172.21.15.133:0/1294976055 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac1c005740 con 0x7fac300c63c0 2023-12-19T18:59:26.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac35405640 1 -- 172.21.15.133:0/1294976055 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1353461312 0 0) 0x7fac1c005740 con 0x7fac300c63c0 2023-12-19T18:59:26.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac35405640 1 -- 172.21.15.133:0/1294976055 >> v2:172.21.15.138:3300/0 conn(0x7fac300c4100 msgr2=0x7fac300c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:26.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac35405640 1 --2- 172.21.15.133:0/1294976055 >> v2:172.21.15.138:3300/0 conn(0x7fac300c4100 0x7fac300c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:26.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac35405640 1 -- 172.21.15.133:0/1294976055 >> v1:172.21.15.138:6789/0 conn(0x7fac300c06d0 legacy=0x7fac300a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:26.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac35405640 1 -- 172.21.15.133:0/1294976055 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac300c1310 con 0x7fac300c63c0 2023-12-19T18:59:26.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac35405640 1 -- 172.21.15.133:0/1294976055 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7fac2c0016a0 con 0x7fac300c63c0 2023-12-19T18:59:26.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac35405640 1 -- 172.21.15.133:0/1294976055 >> v1:172.21.15.133:6789/0 conn(0x7fac300c63c0 legacy=0x7fac300c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:26.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac35405640 1 --2- 172.21.15.133:0/1294976055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac1c005b90 0x7fac1c005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:26.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac35405640 1 --2- 172.21.15.133:0/1294976055 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac1c0069e0 0x7fac1c006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:26.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac35405640 1 --2- 172.21.15.133:0/1294976055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac1c0074c0 0x7fac1c00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:26.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac35405640 1 -- 172.21.15.133:0/1294976055 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac300c1030 con 0x7fac1c0074c0 2023-12-19T18:59:26.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac35405640 1 -- 172.21.15.133:0/1294976055 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c00e390 con 0x7fac1c005b90 2023-12-19T18:59:26.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac35405640 1 -- 172.21.15.133:0/1294976055 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c00e550 con 0x7fac1c0069e0 2023-12-19T18:59:26.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac36407640 1 --2- 172.21.15.133:0/1294976055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac1c005b90 0x7fac1c005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:26.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac36c08640 1 --2- 172.21.15.133:0/1294976055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac1c0074c0 0x7fac1c00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:26.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac35c06640 1 --2- 172.21.15.133:0/1294976055 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac1c0069e0 0x7fac1c006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:26.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac36c08640 1 -- 172.21.15.133:0/1294976055 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac1c0069e0 msgr2=0x7fac1c006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:26.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac36c08640 1 --2- 172.21.15.133:0/1294976055 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac1c0069e0 0x7fac1c006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:26.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac36c08640 1 -- 172.21.15.133:0/1294976055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac1c005b90 msgr2=0x7fac1c005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:26.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac36c08640 1 --2- 172.21.15.133:0/1294976055 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac1c005b90 0x7fac1c005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:26.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.019+0000 7fac36c08640 1 -- 172.21.15.133:0/1294976055 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1c005740 con 0x7fac1c0074c0 2023-12-19T18:59:26.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.023+0000 7fac36c08640 1 -- 172.21.15.133:0/1294976055 reap_dead start 2023-12-19T18:59:26.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.023+0000 7fac36c08640 1 --2- 172.21.15.133:0/1294976055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac1c0074c0 0x7fac1c00dba0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fac28001e40 tx=0x7fac2801c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7bdd0ae9ecdfc6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:26.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.023+0000 7fac35405640 1 -- 172.21.15.133:0/1294976055 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac28003b80 con 0x7fac1c0074c0 2023-12-19T18:59:26.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.023+0000 7fac35405640 1 -- 172.21.15.133:0/1294976055 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac28003ce0 con 0x7fac1c0074c0 2023-12-19T18:59:26.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.023+0000 7fac35405640 1 -- 172.21.15.133:0/1294976055 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac28005310 con 0x7fac1c0074c0 2023-12-19T18:59:26.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.023+0000 7fac3866b640 1 -- 172.21.15.133:0/1294976055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac1c0074c0 msgr2=0x7fac1c00dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:26.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.023+0000 7fac3866b640 1 --2- 172.21.15.133:0/1294976055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac1c0074c0 0x7fac1c00dba0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fac28001e40 tx=0x7fac2801c740 comp rx=0 tx=0).stop 2023-12-19T18:59:26.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.023+0000 7fac3866b640 1 -- 172.21.15.133:0/1294976055 shutdown_connections 2023-12-19T18:59:26.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.023+0000 7fac3866b640 1 --2- 172.21.15.133:0/1294976055 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac1c0074c0 0x7fac1c00dba0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:26.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.023+0000 7fac3866b640 1 -- 172.21.15.133:0/1294976055 >> 172.21.15.133:0/1294976055 conn(0x7fac3006a5b0 msgr2=0x7fac3006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:26.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.023+0000 7fac3866b640 1 -- 172.21.15.133:0/1294976055 shutdown_connections 2023-12-19T18:59:26.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.023+0000 7fac3866b640 1 -- 172.21.15.133:0/1294976055 wait complete. 2023-12-19T18:59:26.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac3866b640 1 Processor -- start 2023-12-19T18:59:26.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac3866b640 1 -- start start 2023-12-19T18:59:26.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac3866b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac1c0074c0 0x7fac301534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:26.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac3866b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac30152c60 0x7fac301ec250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:26.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac3866b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac30153a50 0x7fac30147450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:26.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac3866b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3014b900 con 0x7fac30152c60 2023-12-19T18:59:26.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac3866b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac300bb8a0 con 0x7fac1c0074c0 2023-12-19T18:59:26.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac3866b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac30071fc0 con 0x7fac30153a50 2023-12-19T18:59:26.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac35c06640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac30152c60 0x7fac301ec250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:26.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac35c06640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac30152c60 0x7fac301ec250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42104/0 (socket says 172.21.15.133:42104) 2023-12-19T18:59:26.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac35c06640 1 -- 172.21.15.133:0/3639240814 learned_addr learned my addr 172.21.15.133:0/3639240814 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:26.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac36407640 1 --2- 172.21.15.133:0/3639240814 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac1c0074c0 0x7fac301534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:26.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac36c08640 1 --2- 172.21.15.133:0/3639240814 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac30153a50 0x7fac30147450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:26.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac35c06640 1 -- 172.21.15.133:0/3639240814 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac30153a50 msgr2=0x7fac30147450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:26.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac35c06640 1 --2- 172.21.15.133:0/3639240814 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac30153a50 0x7fac30147450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:26.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac35c06640 1 -- 172.21.15.133:0/3639240814 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac1c0074c0 msgr2=0x7fac301534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:26.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac35c06640 1 --2- 172.21.15.133:0/3639240814 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac1c0074c0 0x7fac301534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:26.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac35c06640 1 -- 172.21.15.133:0/3639240814 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac300c69b0 con 0x7fac30152c60 2023-12-19T18:59:26.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac36c08640 1 --2- 172.21.15.133:0/3639240814 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac30153a50 0x7fac30147450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:26.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac35c06640 1 --2- 172.21.15.133:0/3639240814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac30152c60 0x7fac301ec250 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fac200118b0 tx=0x7fac20011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:26.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac26ffd640 1 -- 172.21.15.133:0/3639240814 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2000fa30 con 0x7fac30152c60 2023-12-19T18:59:26.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac26ffd640 1 -- 172.21.15.133:0/3639240814 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2000fb90 con 0x7fac30152c60 2023-12-19T18:59:26.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac3866b640 1 -- 172.21.15.133:0/3639240814 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac300722a0 con 0x7fac30152c60 2023-12-19T18:59:26.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac26ffd640 1 -- 172.21.15.133:0/3639240814 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20014440 con 0x7fac30152c60 2023-12-19T18:59:26.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.027+0000 7fac3866b640 1 -- 172.21.15.133:0/3639240814 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac301ec790 con 0x7fac30152c60 2023-12-19T18:59:26.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.031+0000 7fac3866b640 1 -- 172.21.15.133:0/3639240814 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac30068400 con 0x7fac30152c60 2023-12-19T18:59:26.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.031+0000 7fac26ffd640 1 -- 172.21.15.133:0/3639240814 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fac2001d400 con 0x7fac30152c60 2023-12-19T18:59:26.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.031+0000 7fac26ffd640 1 --2- 172.21.15.133:0/3639240814 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fac14066470 0x7fac14068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:26.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.031+0000 7fac26ffd640 1 -- 172.21.15.133:0/3639240814 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fac20084930 con 0x7fac30152c60 2023-12-19T18:59:26.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.031+0000 7fac36407640 1 --2- 172.21.15.133:0/3639240814 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fac14066470 0x7fac14068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:26.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.035+0000 7fac36407640 1 --2- 172.21.15.133:0/3639240814 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fac14066470 0x7fac14068930 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0010f0 tx=0x7fac2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:26.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.035+0000 7fac26ffd640 1 -- 172.21.15.133:0/3639240814 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fac20052000 con 0x7fac30152c60 2023-12-19T18:59:26.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.187+0000 7fac3866b640 1 -- 172.21.15.133:0/3639240814 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fac300c3e70 con 0x7fac30152c60 2023-12-19T18:59:26.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.851+0000 7fac26ffd640 1 -- 172.21.15.133:0/3639240814 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7fac20055620 con 0x7fac30152c60 2023-12-19T18:59:26.855 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2023-12-19T18:59:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.851+0000 7fac3866b640 1 -- 172.21.15.133:0/3639240814 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fac14066470 msgr2=0x7fac14068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.851+0000 7fac3866b640 1 --2- 172.21.15.133:0/3639240814 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fac14066470 0x7fac14068930 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fac2c0010f0 tx=0x7fac2c009040 comp rx=0 tx=0).stop 2023-12-19T18:59:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.851+0000 7fac3866b640 1 -- 172.21.15.133:0/3639240814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac30152c60 msgr2=0x7fac301ec250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.851+0000 7fac3866b640 1 --2- 172.21.15.133:0/3639240814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac30152c60 0x7fac301ec250 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fac200118b0 tx=0x7fac20011d70 comp rx=0 tx=0).stop 2023-12-19T18:59:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.851+0000 7fac3866b640 1 -- 172.21.15.133:0/3639240814 shutdown_connections 2023-12-19T18:59:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.851+0000 7fac3866b640 1 --2- 172.21.15.133:0/3639240814 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fac14066470 0x7fac14068930 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.851+0000 7fac3866b640 1 --2- 172.21.15.133:0/3639240814 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac30153a50 0x7fac30147450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.851+0000 7fac3866b640 1 --2- 172.21.15.133:0/3639240814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac30152c60 0x7fac301ec250 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:26.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.851+0000 7fac3866b640 1 --2- 172.21.15.133:0/3639240814 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac1c0074c0 0x7fac301534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:26.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.851+0000 7fac3866b640 1 -- 172.21.15.133:0/3639240814 >> 172.21.15.133:0/3639240814 conn(0x7fac3006a5b0 msgr2=0x7fac300c22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:26.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.851+0000 7fac3866b640 1 -- 172.21.15.133:0/3639240814 shutdown_connections 2023-12-19T18:59:26.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:26.851+0000 7fac3866b640 1 -- 172.21.15.133:0/3639240814 wait complete. 2023-12-19T18:59:26.895 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T18:59:27.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.031+0000 7f43f9965640 1 Processor -- start 2023-12-19T18:59:27.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.031+0000 7f43f9965640 1 -- start start 2023-12-19T18:59:27.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.031+0000 7f43f9965640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f43f4072090 0x7f43f40a5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:27.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.031+0000 7f43f9965640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f43f40725c0 0x7f43f40c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:27.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.031+0000 7f43f9965640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43f40c2760 con 0x7f43f40c3bd0 2023-12-19T18:59:27.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.031+0000 7f43f9965640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43f40c3070 con 0x7f43f40725c0 2023-12-19T18:59:27.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.031+0000 7f43f9965640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f40aad20 con 0x7f43f4072090 2023-12-19T18:59:27.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.031+0000 7f43ea7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f43f40725c0 0x7f43f40c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:27.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.031+0000 7f43ea7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f43f40725c0 0x7f43f40c5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42114/0 (socket says 172.21.15.133:42114) 2023-12-19T18:59:27.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.031+0000 7f43ea7fc640 1 -- 172.21.15.133:0/532515728 learned_addr learned my addr 172.21.15.133:0/532515728 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:27.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.031+0000 7f43f2ffd640 1 --2- 172.21.15.133:0/532515728 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f43f4072090 0x7f43f40a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:27.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.031+0000 7f43ea7fc640 1 -- 172.21.15.133:0/532515728 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f43f4072090 msgr2=0x7f43f40a5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:27.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.031+0000 7f43ea7fc640 1 --2- 172.21.15.133:0/532515728 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f43f4072090 0x7f43f40a5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:27.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.031+0000 7f43ea7fc640 1 -- 172.21.15.133:0/532515728 >> v1:172.21.15.138:6789/0 conn(0x7f43f40c3bd0 legacy=0x7f43f4150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:27.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.031+0000 7f43ea7fc640 1 -- 172.21.15.133:0/532515728 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43f40ab000 con 0x7f43f40725c0 2023-12-19T18:59:27.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.035+0000 7f43ea7fc640 1 --2- 172.21.15.133:0/532515728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f40725c0 0x7f43f40c5cd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f43e400bb10 tx=0x7f43e401eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee21d1c82445dd8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:27.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.035+0000 7f43f27fc640 1 -- 172.21.15.133:0/532515728 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e40a79d0 con 0x7f43f40725c0 2023-12-19T18:59:27.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.035+0000 7f43f27fc640 1 -- 172.21.15.133:0/532515728 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e40a7b30 con 0x7f43f40725c0 2023-12-19T18:59:27.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.035+0000 7f43f27fc640 1 -- 172.21.15.133:0/532515728 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e40af440 con 0x7f43f40725c0 2023-12-19T18:59:27.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.035+0000 7f43f9965640 1 -- 172.21.15.133:0/532515728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f40725c0 msgr2=0x7f43f40c5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:27.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.035+0000 7f43f9965640 1 --2- 172.21.15.133:0/532515728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f40725c0 0x7f43f40c5cd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f43e400bb10 tx=0x7f43e401eaf0 comp rx=0 tx=0).stop 2023-12-19T18:59:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.035+0000 7f43f9965640 1 -- 172.21.15.133:0/532515728 shutdown_connections 2023-12-19T18:59:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.035+0000 7f43f9965640 1 --2- 172.21.15.133:0/532515728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f40725c0 0x7f43f40c5cd0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.035+0000 7f43f9965640 1 --2- 172.21.15.133:0/532515728 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f43f4072090 0x7f43f40a5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.035+0000 7f43f9965640 1 -- 172.21.15.133:0/532515728 >> 172.21.15.133:0/532515728 conn(0x7f43f406a5b0 msgr2=0x7f43f406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.035+0000 7f43f9965640 1 -- 172.21.15.133:0/532515728 shutdown_connections 2023-12-19T18:59:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.035+0000 7f43f9965640 1 -- 172.21.15.133:0/532515728 wait complete. 2023-12-19T18:59:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43f9965640 1 Processor -- start 2023-12-19T18:59:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43f9965640 1 -- start start 2023-12-19T18:59:27.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43f9965640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f43f4072090 0x7f43f41471b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43f9965640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f40725c0 0x7f43f4153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43f9965640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f43f40c3bd0 0x7f43f4153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43f9965640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f4153200 con 0x7f43f40725c0 2023-12-19T18:59:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43f9965640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f41523f0 con 0x7f43f40c3bd0 2023-12-19T18:59:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43f9965640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43f41edfb0 con 0x7f43f4072090 2023-12-19T18:59:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43ea7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f40725c0 0x7f43f4153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43ea7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f40725c0 0x7f43f4153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42128/0 (socket says 172.21.15.133:42128) 2023-12-19T18:59:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43ea7fc640 1 -- 172.21.15.133:0/3641554053 learned_addr learned my addr 172.21.15.133:0/3641554053 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43f37fe640 1 --2- 172.21.15.133:0/3641554053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f43f40c3bd0 0x7f43f4153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43f2ffd640 1 --2- 172.21.15.133:0/3641554053 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f43f4072090 0x7f43f41471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43ea7fc640 1 -- 172.21.15.133:0/3641554053 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f43f4072090 msgr2=0x7f43f41471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43ea7fc640 1 --2- 172.21.15.133:0/3641554053 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f43f4072090 0x7f43f41471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:27.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43ea7fc640 1 -- 172.21.15.133:0/3641554053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f43f40c3bd0 msgr2=0x7f43f4153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:27.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43ea7fc640 1 --2- 172.21.15.133:0/3641554053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f43f40c3bd0 0x7f43f4153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:27.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43ea7fc640 1 -- 172.21.15.133:0/3641554053 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e400b770 con 0x7f43f40725c0 2023-12-19T18:59:27.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43ea7fc640 1 --2- 172.21.15.133:0/3641554053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f40725c0 0x7f43f4153620 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f43e400b2c0 tx=0x7f43e401d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:27.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43f0ff9640 1 -- 172.21.15.133:0/3641554053 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e40a79d0 con 0x7f43f40725c0 2023-12-19T18:59:27.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43f0ff9640 1 -- 172.21.15.133:0/3641554053 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43e40ba480 con 0x7f43f40725c0 2023-12-19T18:59:27.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43f9965640 1 -- 172.21.15.133:0/3641554053 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f41ee4e0 con 0x7f43f40725c0 2023-12-19T18:59:27.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43f0ff9640 1 -- 172.21.15.133:0/3641554053 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43e40ba850 con 0x7f43f40725c0 2023-12-19T18:59:27.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.039+0000 7f43f9965640 1 -- 172.21.15.133:0/3641554053 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f4152e20 con 0x7f43f40725c0 2023-12-19T18:59:27.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.043+0000 7f43f9965640 1 -- 172.21.15.133:0/3641554053 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f4153340 con 0x7f43f40725c0 2023-12-19T18:59:27.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.043+0000 7f43f0ff9640 1 -- 172.21.15.133:0/3641554053 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f43e40ba9b0 con 0x7f43f40725c0 2023-12-19T18:59:27.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.043+0000 7f43f0ff9640 1 --2- 172.21.15.133:0/3641554053 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f43d4066470 0x7f43d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:27.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.043+0000 7f43f0ff9640 1 -- 172.21.15.133:0/3641554053 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f43e411f310 con 0x7f43f40725c0 2023-12-19T18:59:27.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.043+0000 7f43f2ffd640 1 --2- 172.21.15.133:0/3641554053 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f43d4066470 0x7f43d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:27.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.043+0000 7f43f2ffd640 1 --2- 172.21.15.133:0/3641554053 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f43d4066470 0x7f43d4068930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f43f415b800 tx=0x7f43dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:27.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.047+0000 7f43f0ff9640 1 -- 172.21.15.133:0/3641554053 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f43f4153340 con 0x7f43f40725c0 2023-12-19T18:59:27.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.227+0000 7f43f9965640 1 -- 172.21.15.133:0/3641554053 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f43f4153340 con 0x7f43f40725c0 2023-12-19T18:59:27.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.851+0000 7f43f0ff9640 1 -- 172.21.15.133:0/3641554053 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f43f4153340 con 0x7f43f40725c0 2023-12-19T18:59:27.858 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 4 and data pool 5 2023-12-19T18:59:27.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.855+0000 7f43f9965640 1 -- 172.21.15.133:0/3641554053 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f43d4066470 msgr2=0x7f43d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:27.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.855+0000 7f43f9965640 1 --2- 172.21.15.133:0/3641554053 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f43d4066470 0x7f43d4068930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f43f415b800 tx=0x7f43dc008040 comp rx=0 tx=0).stop 2023-12-19T18:59:27.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.855+0000 7f43f9965640 1 -- 172.21.15.133:0/3641554053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f40725c0 msgr2=0x7f43f4153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:27.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.855+0000 7f43f9965640 1 --2- 172.21.15.133:0/3641554053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f40725c0 0x7f43f4153620 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f43e400b2c0 tx=0x7f43e401d330 comp rx=0 tx=0).stop 2023-12-19T18:59:27.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.855+0000 7f43f9965640 1 -- 172.21.15.133:0/3641554053 shutdown_connections 2023-12-19T18:59:27.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.855+0000 7f43f9965640 1 --2- 172.21.15.133:0/3641554053 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f43d4066470 0x7f43d4068930 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:27.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.855+0000 7f43f9965640 1 --2- 172.21.15.133:0/3641554053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f43f40c3bd0 0x7f43f4153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:27.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.855+0000 7f43f9965640 1 --2- 172.21.15.133:0/3641554053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f43f40725c0 0x7f43f4153620 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:27.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.855+0000 7f43f9965640 1 --2- 172.21.15.133:0/3641554053 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f43f4072090 0x7f43f41471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:27.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.855+0000 7f43f9965640 1 -- 172.21.15.133:0/3641554053 >> 172.21.15.133:0/3641554053 conn(0x7f43f406a5b0 msgr2=0x7f43f40c05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:27.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.855+0000 7f43f9965640 1 -- 172.21.15.133:0/3641554053 shutdown_connections 2023-12-19T18:59:27.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:27.855+0000 7f43f9965640 1 -- 172.21.15.133:0/3641554053 wait complete. 2023-12-19T18:59:27.890 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:59:28.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.023+0000 7f3cfe1c1640 1 Processor -- start 2023-12-19T18:59:28.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.023+0000 7f3cfe1c1640 1 -- start start 2023-12-19T18:59:28.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.023+0000 7f3cfe1c1640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3cf80c63c0 0x7f3cf80c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:28.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.023+0000 7f3cfe1c1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3cf80c4100 0x7f3cf80c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:28.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.023+0000 7f3cfe1c1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3cf80c29e0 0x7f3cf80a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:28.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.023+0000 7f3cfe1c1640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf80c31c0 con 0x7f3cf80c4100 2023-12-19T18:59:28.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.023+0000 7f3cfe1c1640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cf80c34a0 con 0x7f3cf80c63c0 2023-12-19T18:59:28.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.023+0000 7f3cfe1c1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf80c1030 con 0x7f3cf80c29e0 2023-12-19T18:59:28.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.027+0000 7f3ceffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3cf80c4100 0x7f3cf80c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:28.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.027+0000 7f3ceffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3cf80c4100 0x7f3cf80c24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42130/0 (socket says 172.21.15.133:42130) 2023-12-19T18:59:28.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.027+0000 7f3ceffff640 1 -- 172.21.15.133:0/1805229234 learned_addr learned my addr 172.21.15.133:0/1805229234 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:28.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.027+0000 7f3cf77fe640 1 --2- 172.21.15.133:0/1805229234 >> v2:172.21.15.138:3300/0 conn(0x7f3cf80c63c0 0x7f3cf80c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:28.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.027+0000 7f3ceffff640 1 -- 172.21.15.133:0/1805229234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3cf80c29e0 msgr2=0x7f3cf80a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:28.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.027+0000 7f3ceffff640 1 --2- 172.21.15.133:0/1805229234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3cf80c29e0 0x7f3cf80a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.027+0000 7f3ceffff640 1 -- 172.21.15.133:0/1805229234 >> v2:172.21.15.138:3300/0 conn(0x7f3cf80c63c0 msgr2=0x7f3cf80c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:28.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.027+0000 7f3ceffff640 1 --2- 172.21.15.133:0/1805229234 >> v2:172.21.15.138:3300/0 conn(0x7f3cf80c63c0 0x7f3cf80c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.027+0000 7f3ceffff640 1 -- 172.21.15.133:0/1805229234 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf80c1310 con 0x7f3cf80c4100 2023-12-19T18:59:28.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.027+0000 7f3cf77fe640 1 --2- 172.21.15.133:0/1805229234 >> v2:172.21.15.138:3300/0 conn(0x7f3cf80c63c0 0x7f3cf80c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:28.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.027+0000 7f3ceffff640 1 --2- 172.21.15.133:0/1805229234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cf80c4100 0x7f3cf80c24a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3cf806e000 tx=0x7f3ce001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc44c5ec1d8442 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:28.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.027+0000 7f3cf6ffd640 1 -- 172.21.15.133:0/1805229234 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf80aa3d0 con 0x7f3cf80c4100 2023-12-19T18:59:28.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.027+0000 7f3cf6ffd640 1 -- 172.21.15.133:0/1805229234 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce00a7050 con 0x7f3cf80c4100 2023-12-19T18:59:28.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.027+0000 7f3cf6ffd640 1 -- 172.21.15.133:0/1805229234 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce00ab820 con 0x7f3cf80c4100 2023-12-19T18:59:28.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cfe1c1640 1 -- 172.21.15.133:0/1805229234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cf80c4100 msgr2=0x7f3cf80c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:28.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cfe1c1640 1 --2- 172.21.15.133:0/1805229234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cf80c4100 0x7f3cf80c24a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3cf806e000 tx=0x7f3ce001c3b0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cfe1c1640 1 -- 172.21.15.133:0/1805229234 shutdown_connections 2023-12-19T18:59:28.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cfe1c1640 1 --2- 172.21.15.133:0/1805229234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3cf80c29e0 0x7f3cf80a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cfe1c1640 1 --2- 172.21.15.133:0/1805229234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cf80c4100 0x7f3cf80c24a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cfe1c1640 1 --2- 172.21.15.133:0/1805229234 >> v2:172.21.15.138:3300/0 conn(0x7f3cf80c63c0 0x7f3cf80c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cfe1c1640 1 -- 172.21.15.133:0/1805229234 >> 172.21.15.133:0/1805229234 conn(0x7f3cf806a5b0 msgr2=0x7f3cf806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:28.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cfe1c1640 1 -- 172.21.15.133:0/1805229234 shutdown_connections 2023-12-19T18:59:28.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cfe1c1640 1 -- 172.21.15.133:0/1805229234 wait complete. 2023-12-19T18:59:28.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cfe1c1640 1 Processor -- start 2023-12-19T18:59:28.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cfe1c1640 1 -- start start 2023-12-19T18:59:28.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cfe1c1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cf80c29e0 0x7f3cf80bd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:28.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cfe1c1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3cf80c4100 0x7f3cf81ea4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:28.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cfe1c1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cf80c63c0 0x7f3cf8150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:28.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cfe1c1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf81eda10 con 0x7f3cf80c63c0 2023-12-19T18:59:28.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cfe1c1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf81edcf0 con 0x7f3cf80c29e0 2023-12-19T18:59:28.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cfe1c1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf8151020 con 0x7f3cf80c4100 2023-12-19T18:59:28.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cf7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cf80c63c0 0x7f3cf8150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:28.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cf7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cf80c63c0 0x7f3cf8150ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42144/0 (socket says 172.21.15.133:42144) 2023-12-19T18:59:28.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cf7fff640 1 -- 172.21.15.133:0/2500735528 learned_addr learned my addr 172.21.15.133:0/2500735528 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:28.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3ceffff640 1 --2- 172.21.15.133:0/2500735528 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3cf80c4100 0x7f3cf81ea4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:28.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cf77fe640 1 --2- 172.21.15.133:0/2500735528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cf80c29e0 0x7f3cf80bd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:28.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cf7fff640 1 -- 172.21.15.133:0/2500735528 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3cf80c4100 msgr2=0x7f3cf81ea4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:28.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cf7fff640 1 --2- 172.21.15.133:0/2500735528 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3cf80c4100 0x7f3cf81ea4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cf7fff640 1 -- 172.21.15.133:0/2500735528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cf80c29e0 msgr2=0x7f3cf80bd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:28.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cf7fff640 1 --2- 172.21.15.133:0/2500735528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cf80c29e0 0x7f3cf80bd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cf7fff640 1 -- 172.21.15.133:0/2500735528 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce00094d0 con 0x7f3cf80c63c0 2023-12-19T18:59:28.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.031+0000 7f3cf7fff640 1 --2- 172.21.15.133:0/2500735528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cf80c63c0 0x7f3cf8150ae0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000b970 tx=0x7f3cf000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:28.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.035+0000 7f3cf4ff9640 1 -- 172.21.15.133:0/2500735528 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf000cb40 con 0x7f3cf80c63c0 2023-12-19T18:59:28.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.035+0000 7f3cf4ff9640 1 -- 172.21.15.133:0/2500735528 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf000ccc0 con 0x7f3cf80c63c0 2023-12-19T18:59:28.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.035+0000 7f3cf4ff9640 1 -- 172.21.15.133:0/2500735528 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf0014680 con 0x7f3cf80c63c0 2023-12-19T18:59:28.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.035+0000 7f3cfe1c1640 1 -- 172.21.15.133:0/2500735528 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf80c69b0 con 0x7f3cf80c63c0 2023-12-19T18:59:28.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.035+0000 7f3cfe1c1640 1 -- 172.21.15.133:0/2500735528 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf80bde90 con 0x7f3cf80c63c0 2023-12-19T18:59:28.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.035+0000 7f3cfe1c1640 1 -- 172.21.15.133:0/2500735528 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf81ee920 con 0x7f3cf80c63c0 2023-12-19T18:59:28.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.035+0000 7f3cf4ff9640 1 -- 172.21.15.133:0/2500735528 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3cf0007370 con 0x7f3cf80c63c0 2023-12-19T18:59:28.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.035+0000 7f3cf4ff9640 1 --2- 172.21.15.133:0/2500735528 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3cd8066470 0x7f3cd8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:28.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.035+0000 7f3cf4ff9640 1 -- 172.21.15.133:0/2500735528 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3cf0083d70 con 0x7f3cf80c63c0 2023-12-19T18:59:28.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.035+0000 7f3cf77fe640 1 --2- 172.21.15.133:0/2500735528 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3cd8066470 0x7f3cd8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:28.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.035+0000 7f3cf77fe640 1 --2- 172.21.15.133:0/2500735528 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3cd8066470 0x7f3cd8068930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3cf81e82e0 tx=0x7f3ce8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:28.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.039+0000 7f3cf4ff9640 1 -- 172.21.15.133:0/2500735528 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f3cf0051290 con 0x7f3cf80c63c0 2023-12-19T18:59:28.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.191+0000 7f3cfe1c1640 1 -- 172.21.15.133:0/2500735528 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3cf81ede60 con 0x7f3cf80c63c0 2023-12-19T18:59:28.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.191+0000 7f3cf4ff9640 1 -- 172.21.15.133:0/2500735528 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16618 (secure 0 0 0) 0x7f3cf0019090 con 0x7f3cf80c63c0 2023-12-19T18:59:28.197 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:28.197 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":30,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:59:27.233174+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:59:25.798150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T18:59:26.236078+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:59:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.191+0000 7f3cfe1c1640 1 -- 172.21.15.133:0/2500735528 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3cd8066470 msgr2=0x7f3cd8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.191+0000 7f3cfe1c1640 1 --2- 172.21.15.133:0/2500735528 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3cd8066470 0x7f3cd8068930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3cf81e82e0 tx=0x7f3ce8008040 comp rx=0 tx=0).stop 2023-12-19T18:59:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.191+0000 7f3cfe1c1640 1 -- 172.21.15.133:0/2500735528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cf80c63c0 msgr2=0x7f3cf8150ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.191+0000 7f3cfe1c1640 1 --2- 172.21.15.133:0/2500735528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cf80c63c0 0x7f3cf8150ae0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3cf000b970 tx=0x7f3cf000be30 comp rx=0 tx=0).stop 2023-12-19T18:59:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.191+0000 7f3cfe1c1640 1 -- 172.21.15.133:0/2500735528 shutdown_connections 2023-12-19T18:59:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.191+0000 7f3cfe1c1640 1 --2- 172.21.15.133:0/2500735528 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3cd8066470 0x7f3cd8068930 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.191+0000 7f3cfe1c1640 1 --2- 172.21.15.133:0/2500735528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3cf80c63c0 0x7f3cf8150ae0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.191+0000 7f3cfe1c1640 1 --2- 172.21.15.133:0/2500735528 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3cf80c4100 0x7f3cf81ea4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.191+0000 7f3cfe1c1640 1 --2- 172.21.15.133:0/2500735528 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3cf80c29e0 0x7f3cf80bd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.195+0000 7f3cfe1c1640 1 -- 172.21.15.133:0/2500735528 >> 172.21.15.133:0/2500735528 conn(0x7f3cf806a5b0 msgr2=0x7f3cf806d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.195+0000 7f3cfe1c1640 1 -- 172.21.15.133:0/2500735528 shutdown_connections 2023-12-19T18:59:28.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.195+0000 7f3cfe1c1640 1 -- 172.21.15.133:0/2500735528 wait complete. 2023-12-19T18:59:28.218 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:59:28.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.351+0000 7fc2d1c17640 1 Processor -- start 2023-12-19T18:59:28.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.351+0000 7fc2d1c17640 1 -- start start 2023-12-19T18:59:28.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.351+0000 7fc2d1c17640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc2cc151e90 0x7fc2cc0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:28.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.351+0000 7fc2d1c17640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2cc0c4e60 0x7fc2cc06bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:28.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.351+0000 7fc2d1c17640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2cc06c860 con 0x7fc2cc0c7ea0 2023-12-19T18:59:28.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.351+0000 7fc2d1c17640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2cc0c8750 con 0x7fc2cc151e90 2023-12-19T18:59:28.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.351+0000 7fc2d1c17640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc1552d0 con 0x7fc2cc0c4e60 2023-12-19T18:59:28.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.351+0000 7fc2cb7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc2cc151e90 0x7fc2cc0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:28.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.351+0000 7fc2cb7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc2cc151e90 0x7fc2cc0c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42160/0 (socket says 172.21.15.133:42160) 2023-12-19T18:59:28.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.351+0000 7fc2cb7fe640 1 -- 172.21.15.133:0/4263389096 learned_addr learned my addr 172.21.15.133:0/4263389096 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:28.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.351+0000 7fc2caffd640 1 --1- 172.21.15.133:0/4263389096 >> v1:172.21.15.133:6789/0 conn(0x7fc2cc0c7ea0 0x7fc2cc06b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37356/0 (socket says 172.21.15.133:37356) 2023-12-19T18:59:28.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.351+0000 7fc2cbfff640 1 --2- 172.21.15.133:0/4263389096 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2cc0c4e60 0x7fc2cc06bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:28.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.351+0000 7fc2cb7fe640 1 -- 172.21.15.133:0/4263389096 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2cc0c4e60 msgr2=0x7fc2cc06bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:28.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.351+0000 7fc2cb7fe640 1 --2- 172.21.15.133:0/4263389096 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2cc0c4e60 0x7fc2cc06bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.351+0000 7fc2cb7fe640 1 -- 172.21.15.133:0/4263389096 >> v1:172.21.15.133:6789/0 conn(0x7fc2cc0c7ea0 legacy=0x7fc2cc06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:28.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.351+0000 7fc2cb7fe640 1 -- 172.21.15.133:0/4263389096 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc154930 con 0x7fc2cc151e90 2023-12-19T18:59:28.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.355+0000 7fc2cb7fe640 1 --2- 172.21.15.133:0/4263389096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2cc151e90 0x7fc2cc0c4920 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc009870 tx=0x7fc2bc01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2d76df9cfa745d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:28.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.355+0000 7fc2ca7fc640 1 -- 172.21.15.133:0/4263389096 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc0ab600 con 0x7fc2cc151e90 2023-12-19T18:59:28.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.355+0000 7fc2ca7fc640 1 -- 172.21.15.133:0/4263389096 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2bc0a7050 con 0x7fc2cc151e90 2023-12-19T18:59:28.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.355+0000 7fc2ca7fc640 1 -- 172.21.15.133:0/4263389096 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc0ab980 con 0x7fc2cc151e90 2023-12-19T18:59:28.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.355+0000 7fc2d1c17640 1 -- 172.21.15.133:0/4263389096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2cc151e90 msgr2=0x7fc2cc0c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.355+0000 7fc2d1c17640 1 --2- 172.21.15.133:0/4263389096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2cc151e90 0x7fc2cc0c4920 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc009870 tx=0x7fc2bc01c420 comp rx=0 tx=0).stop 2023-12-19T18:59:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.355+0000 7fc2d1c17640 1 -- 172.21.15.133:0/4263389096 shutdown_connections 2023-12-19T18:59:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.355+0000 7fc2d1c17640 1 --2- 172.21.15.133:0/4263389096 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2cc0c4e60 0x7fc2cc06bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.355+0000 7fc2d1c17640 1 --2- 172.21.15.133:0/4263389096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2cc151e90 0x7fc2cc0c4920 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.355+0000 7fc2d1c17640 1 -- 172.21.15.133:0/4263389096 >> 172.21.15.133:0/4263389096 conn(0x7fc2cc0ca170 msgr2=0x7fc2cc0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:28.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.355+0000 7fc2d1c17640 1 -- 172.21.15.133:0/4263389096 shutdown_connections 2023-12-19T18:59:28.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.355+0000 7fc2d1c17640 1 -- 172.21.15.133:0/4263389096 wait complete. 2023-12-19T18:59:28.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2d1c17640 1 Processor -- start 2023-12-19T18:59:28.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2d1c17640 1 -- start start 2023-12-19T18:59:28.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2d1c17640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2cc0c4e60 0x7fc2cc0aa900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:28.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2d1c17640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2cc0c7ea0 0x7fc2cc0ac030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:28.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2d1c17640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2cc151e90 0x7fc2cc14b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:28.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2d1c17640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc1587f0 con 0x7fc2cc0c4e60 2023-12-19T18:59:28.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2d1c17640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0ac6a0 con 0x7fc2cc151e90 2023-12-19T18:59:28.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2d1c17640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0a9b40 con 0x7fc2cc0c7ea0 2023-12-19T18:59:28.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2cb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2cc0c4e60 0x7fc2cc0aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:28.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2cb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2cc0c4e60 0x7fc2cc0aa900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42168/0 (socket says 172.21.15.133:42168) 2023-12-19T18:59:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2cb7fe640 1 -- 172.21.15.133:0/411869358 learned_addr learned my addr 172.21.15.133:0/411869358 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2cbfff640 1 --2- 172.21.15.133:0/411869358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2cc151e90 0x7fc2cc14b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2caffd640 1 --2- 172.21.15.133:0/411869358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2cc0c7ea0 0x7fc2cc0ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2cb7fe640 1 -- 172.21.15.133:0/411869358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2cc0c7ea0 msgr2=0x7fc2cc0ac030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2cb7fe640 1 --2- 172.21.15.133:0/411869358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2cc0c7ea0 0x7fc2cc0ac030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2cb7fe640 1 -- 172.21.15.133:0/411869358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2cc151e90 msgr2=0x7fc2cc14b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2cb7fe640 1 --2- 172.21.15.133:0/411869358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2cc151e90 0x7fc2cc14b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2cb7fe640 1 -- 172.21.15.133:0/411869358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2bc0094d0 con 0x7fc2cc0c4e60 2023-12-19T18:59:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2cbfff640 1 --2- 172.21.15.133:0/411869358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2cc151e90 0x7fc2cc14b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2caffd640 1 --2- 172.21.15.133:0/411869358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2cc0c7ea0 0x7fc2cc0ac030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2cb7fe640 1 --2- 172.21.15.133:0/411869358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2cc0c4e60 0x7fc2cc0aa900 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0ae040 tx=0x7fc2bc01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2b3fff640 1 -- 172.21.15.133:0/411869358 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc0b6620 con 0x7fc2cc0c4e60 2023-12-19T18:59:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2b3fff640 1 -- 172.21.15.133:0/411869358 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2bc0abe90 con 0x7fc2cc0c4e60 2023-12-19T18:59:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2b3fff640 1 -- 172.21.15.133:0/411869358 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc0b69e0 con 0x7fc2cc0c4e60 2023-12-19T18:59:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2d1c17640 1 -- 172.21.15.133:0/411869358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2cc0a9e20 con 0x7fc2cc0c4e60 2023-12-19T18:59:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.359+0000 7fc2d1c17640 1 -- 172.21.15.133:0/411869358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2cc0aa3e0 con 0x7fc2cc0c4e60 2023-12-19T18:59:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.363+0000 7fc2d1c17640 1 -- 172.21.15.133:0/411869358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2cc068400 con 0x7fc2cc0c4e60 2023-12-19T18:59:28.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.363+0000 7fc2b3fff640 1 -- 172.21.15.133:0/411869358 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc2bc0b2040 con 0x7fc2cc0c4e60 2023-12-19T18:59:28.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.363+0000 7fc2b3fff640 1 --2- 172.21.15.133:0/411869358 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2b8066470 0x7fc2b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:28.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.363+0000 7fc2b3fff640 1 -- 172.21.15.133:0/411869358 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2bc11e480 con 0x7fc2cc0c4e60 2023-12-19T18:59:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.363+0000 7fc2caffd640 1 --2- 172.21.15.133:0/411869358 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2b8066470 0x7fc2b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.367+0000 7fc2caffd640 1 --2- 172.21.15.133:0/411869358 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2b8066470 0x7fc2b8068930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0c5830 tx=0x7fc2c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:28.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.367+0000 7fc2b3fff640 1 -- 172.21.15.133:0/411869358 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc2bc0eb7e0 con 0x7fc2cc0c4e60 2023-12-19T18:59:28.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.519+0000 7fc2d1c17640 1 -- 172.21.15.133:0/411869358 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2cc14f660 con 0x7fc2cc0c4e60 2023-12-19T18:59:28.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.523+0000 7fc2b3fff640 1 -- 172.21.15.133:0/411869358 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16618 (secure 0 0 0) 0x7fc2bc0eee00 con 0x7fc2cc0c4e60 2023-12-19T18:59:28.527 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:28.527 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":30,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:59:27.233174+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:59:25.798150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T18:59:26.236078+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:59:28.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.523+0000 7fc2d1c17640 1 -- 172.21.15.133:0/411869358 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2b8066470 msgr2=0x7fc2b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:28.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.523+0000 7fc2d1c17640 1 --2- 172.21.15.133:0/411869358 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2b8066470 0x7fc2b8068930 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0c5830 tx=0x7fc2c0009040 comp rx=0 tx=0).stop 2023-12-19T18:59:28.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.523+0000 7fc2d1c17640 1 -- 172.21.15.133:0/411869358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2cc0c4e60 msgr2=0x7fc2cc0aa900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:28.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.523+0000 7fc2d1c17640 1 --2- 172.21.15.133:0/411869358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2cc0c4e60 0x7fc2cc0aa900 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0ae040 tx=0x7fc2bc01ac60 comp rx=0 tx=0).stop 2023-12-19T18:59:28.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.523+0000 7fc2d1c17640 1 -- 172.21.15.133:0/411869358 shutdown_connections 2023-12-19T18:59:28.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.523+0000 7fc2d1c17640 1 --2- 172.21.15.133:0/411869358 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2b8066470 0x7fc2b8068930 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.523+0000 7fc2d1c17640 1 --2- 172.21.15.133:0/411869358 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2cc151e90 0x7fc2cc14b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.523+0000 7fc2d1c17640 1 --2- 172.21.15.133:0/411869358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2cc0c7ea0 0x7fc2cc0ac030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.523+0000 7fc2d1c17640 1 --2- 172.21.15.133:0/411869358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2cc0c4e60 0x7fc2cc0aa900 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.523+0000 7fc2d1c17640 1 -- 172.21.15.133:0/411869358 >> 172.21.15.133:0/411869358 conn(0x7fc2cc0ca170 msgr2=0x7fc2cc15e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.523+0000 7fc2d1c17640 1 -- 172.21.15.133:0/411869358 shutdown_connections 2023-12-19T18:59:28.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.523+0000 7fc2d1c17640 1 -- 172.21.15.133:0/411869358 wait complete. 2023-12-19T18:59:28.550 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T18:59:28.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.687+0000 7fe4cddaa640 1 Processor -- start 2023-12-19T18:59:28.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.687+0000 7fe4cddaa640 1 -- start start 2023-12-19T18:59:28.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.687+0000 7fe4cddaa640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe4c80c7ea0 0x7fe4c806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:28.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.687+0000 7fe4cddaa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe4c806b9e0 0x7fe4c815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:28.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.687+0000 7fe4cddaa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c806c860 con 0x7fe4c8151e90 2023-12-19T18:59:28.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.687+0000 7fe4cddaa640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4c80c8750 con 0x7fe4c80c7ea0 2023-12-19T18:59:28.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.687+0000 7fe4cddaa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4c81552d0 con 0x7fe4c806b9e0 2023-12-19T18:59:28.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.687+0000 7fe4c6ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe4c80c7ea0 0x7fe4c806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:28.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.687+0000 7fe4c6ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe4c80c7ea0 0x7fe4c806b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42182/0 (socket says 172.21.15.133:42182) 2023-12-19T18:59:28.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.687+0000 7fe4c6ffd640 1 -- 172.21.15.133:0/3458665792 learned_addr learned my addr 172.21.15.133:0/3458665792 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:28.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.687+0000 7fe4c7fff640 1 --2- 172.21.15.133:0/3458665792 >> v2:172.21.15.138:3300/0 conn(0x7fe4c806b9e0 0x7fe4c815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:28.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.687+0000 7fe4c6ffd640 1 -- 172.21.15.133:0/3458665792 >> v2:172.21.15.138:3300/0 conn(0x7fe4c806b9e0 msgr2=0x7fe4c815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:28.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.687+0000 7fe4c6ffd640 1 --2- 172.21.15.133:0/3458665792 >> v2:172.21.15.138:3300/0 conn(0x7fe4c806b9e0 0x7fe4c815f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.687+0000 7fe4c6ffd640 1 -- 172.21.15.133:0/3458665792 >> v1:172.21.15.138:6789/0 conn(0x7fe4c8151e90 legacy=0x7fe4c80c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:28.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.687+0000 7fe4c6ffd640 1 -- 172.21.15.133:0/3458665792 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c8154930 con 0x7fe4c80c7ea0 2023-12-19T18:59:28.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.691+0000 7fe4c6ffd640 1 --2- 172.21.15.133:0/3458665792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4c80c7ea0 0x7fe4c806b4a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe4c808c190 tx=0x7fe4bc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2429596b9cb683f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:28.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.691+0000 7fe4c67fc640 1 -- 172.21.15.133:0/3458665792 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0ab600 con 0x7fe4c80c7ea0 2023-12-19T18:59:28.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.691+0000 7fe4c67fc640 1 -- 172.21.15.133:0/3458665792 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc0a7050 con 0x7fe4c80c7ea0 2023-12-19T18:59:28.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.691+0000 7fe4c67fc640 1 -- 172.21.15.133:0/3458665792 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0ab980 con 0x7fe4c80c7ea0 2023-12-19T18:59:28.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.691+0000 7fe4cddaa640 1 -- 172.21.15.133:0/3458665792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4c80c7ea0 msgr2=0x7fe4c806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:28.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.691+0000 7fe4cddaa640 1 --2- 172.21.15.133:0/3458665792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4c80c7ea0 0x7fe4c806b4a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe4c808c190 tx=0x7fe4bc01c3e0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.691+0000 7fe4cddaa640 1 -- 172.21.15.133:0/3458665792 shutdown_connections 2023-12-19T18:59:28.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.691+0000 7fe4cddaa640 1 --2- 172.21.15.133:0/3458665792 >> v2:172.21.15.138:3300/0 conn(0x7fe4c806b9e0 0x7fe4c815f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.691+0000 7fe4cddaa640 1 --2- 172.21.15.133:0/3458665792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4c80c7ea0 0x7fe4c806b4a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.691+0000 7fe4cddaa640 1 -- 172.21.15.133:0/3458665792 >> 172.21.15.133:0/3458665792 conn(0x7fe4c80ca170 msgr2=0x7fe4c80ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:28.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.691+0000 7fe4cddaa640 1 -- 172.21.15.133:0/3458665792 shutdown_connections 2023-12-19T18:59:28.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.691+0000 7fe4cddaa640 1 -- 172.21.15.133:0/3458665792 wait complete. 2023-12-19T18:59:28.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4cddaa640 1 Processor -- start 2023-12-19T18:59:28.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4cddaa640 1 -- start start 2023-12-19T18:59:28.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4cddaa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4c806b9e0 0x7fe4c814b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:28.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4cddaa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4c80c7ea0 0x7fe4c80c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:28.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4cddaa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4c8151e90 0x7fe4c81edf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:28.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4cddaa640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c80c1c00 con 0x7fe4c8151e90 2023-12-19T18:59:28.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4cddaa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c80c3940 con 0x7fe4c806b9e0 2023-12-19T18:59:28.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4cddaa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c8150e10 con 0x7fe4c80c7ea0 2023-12-19T18:59:28.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4c7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4c8151e90 0x7fe4c81edf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:28.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4c7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4c8151e90 0x7fe4c81edf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42184/0 (socket says 172.21.15.133:42184) 2023-12-19T18:59:28.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4c7fff640 1 -- 172.21.15.133:0/4023685117 learned_addr learned my addr 172.21.15.133:0/4023685117 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:28.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4c77fe640 1 --2- 172.21.15.133:0/4023685117 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4c806b9e0 0x7fe4c814b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:28.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4c6ffd640 1 --2- 172.21.15.133:0/4023685117 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4c80c7ea0 0x7fe4c80c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:28.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4c7fff640 1 -- 172.21.15.133:0/4023685117 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4c80c7ea0 msgr2=0x7fe4c80c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:28.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4c7fff640 1 --2- 172.21.15.133:0/4023685117 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4c80c7ea0 0x7fe4c80c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4c7fff640 1 -- 172.21.15.133:0/4023685117 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4c806b9e0 msgr2=0x7fe4c814b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4c7fff640 1 --2- 172.21.15.133:0/4023685117 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4c806b9e0 0x7fe4c814b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4c7fff640 1 -- 172.21.15.133:0/4023685117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc0094d0 con 0x7fe4c8151e90 2023-12-19T18:59:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4c7fff640 1 --2- 172.21.15.133:0/4023685117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4c8151e90 0x7fe4c81edf70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe4c000efc0 tx=0x7fe4c000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4affff640 1 -- 172.21.15.133:0/4023685117 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0009ba0 con 0x7fe4c8151e90 2023-12-19T18:59:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4affff640 1 -- 172.21.15.133:0/4023685117 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c000f040 con 0x7fe4c8151e90 2023-12-19T18:59:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4affff640 1 -- 172.21.15.133:0/4023685117 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c00146c0 con 0x7fe4c8151e90 2023-12-19T18:59:28.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4cddaa640 1 -- 172.21.15.133:0/4023685117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c814bce0 con 0x7fe4c8151e90 2023-12-19T18:59:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.695+0000 7fe4cddaa640 1 -- 172.21.15.133:0/4023685117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c80c11a0 con 0x7fe4c8151e90 2023-12-19T18:59:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.699+0000 7fe4cddaa640 1 -- 172.21.15.133:0/4023685117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c8068400 con 0x7fe4c8151e90 2023-12-19T18:59:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.699+0000 7fe4affff640 1 -- 172.21.15.133:0/4023685117 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe4c0014820 con 0x7fe4c8151e90 2023-12-19T18:59:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.699+0000 7fe4affff640 1 --2- 172.21.15.133:0/4023685117 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe4b4066470 0x7fe4b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:28.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.699+0000 7fe4affff640 1 -- 172.21.15.133:0/4023685117 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4c0084b30 con 0x7fe4c8151e90 2023-12-19T18:59:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.699+0000 7fe4c77fe640 1 --2- 172.21.15.133:0/4023685117 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe4b4066470 0x7fe4b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:28.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.699+0000 7fe4c77fe640 1 --2- 172.21.15.133:0/4023685117 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe4b4066470 0x7fe4b4068930 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8007fd0 tx=0x7fe4b8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:28.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.703+0000 7fe4affff640 1 -- 172.21.15.133:0/4023685117 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fe4c0052050 con 0x7fe4c8151e90 2023-12-19T18:59:28.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:28.887+0000 7fe4cddaa640 1 -- 172.21.15.133:0/4023685117 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe4c806ca50 con 0x7fe4c8151e90 2023-12-19T18:59:29.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:29.871+0000 7fe4affff640 1 -- 172.21.15.133:0/4023685117 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe4c00180b0 con 0x7fe4c8151e90 2023-12-19T18:59:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:29.871+0000 7fe4cddaa640 1 -- 172.21.15.133:0/4023685117 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe4b4066470 msgr2=0x7fe4b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:29.871+0000 7fe4cddaa640 1 --2- 172.21.15.133:0/4023685117 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe4b4066470 0x7fe4b4068930 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8007fd0 tx=0x7fe4b8009040 comp rx=0 tx=0).stop 2023-12-19T18:59:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:29.871+0000 7fe4cddaa640 1 -- 172.21.15.133:0/4023685117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4c8151e90 msgr2=0x7fe4c81edf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:29.871+0000 7fe4cddaa640 1 --2- 172.21.15.133:0/4023685117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4c8151e90 0x7fe4c81edf70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe4c000efc0 tx=0x7fe4c000c490 comp rx=0 tx=0).stop 2023-12-19T18:59:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:29.871+0000 7fe4cddaa640 1 -- 172.21.15.133:0/4023685117 shutdown_connections 2023-12-19T18:59:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:29.871+0000 7fe4cddaa640 1 --2- 172.21.15.133:0/4023685117 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe4b4066470 0x7fe4b4068930 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:29.871+0000 7fe4cddaa640 1 --2- 172.21.15.133:0/4023685117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe4c8151e90 0x7fe4c81edf70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:29.871+0000 7fe4cddaa640 1 --2- 172.21.15.133:0/4023685117 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe4c80c7ea0 0x7fe4c80c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:29.871+0000 7fe4cddaa640 1 --2- 172.21.15.133:0/4023685117 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe4c806b9e0 0x7fe4c814b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:29.871+0000 7fe4cddaa640 1 -- 172.21.15.133:0/4023685117 >> 172.21.15.133:0/4023685117 conn(0x7fe4c80ca170 msgr2=0x7fe4c80ab970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:29.875+0000 7fe4cddaa640 1 -- 172.21.15.133:0/4023685117 shutdown_connections 2023-12-19T18:59:29.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:29.875+0000 7fe4cddaa640 1 -- 172.21.15.133:0/4023685117 wait complete. 2023-12-19T18:59:29.902 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T18:59:29.902 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T18:59:30.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.039+0000 7fdc201df640 1 Processor -- start 2023-12-19T18:59:30.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.043+0000 7fdc201df640 1 -- start start 2023-12-19T18:59:30.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.043+0000 7fdc201df640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fdc180c4100 0x7fdc180c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:30.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.043+0000 7fdc201df640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdc180c06d0 0x7fdc180a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.043+0000 7fdc201df640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc180c31c0 con 0x7fdc180c63c0 2023-12-19T18:59:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.043+0000 7fdc201df640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc180c34a0 con 0x7fdc180c06d0 2023-12-19T18:59:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.043+0000 7fdc201df640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc180c1030 con 0x7fdc180c4100 2023-12-19T18:59:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.043+0000 7fdc1e77c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdc180c06d0 0x7fdc180a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.043+0000 7fdc1df7b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdc180c63c0 0x7fdc180c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37370/0 (socket says 172.21.15.133:37370) 2023-12-19T18:59:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.043+0000 7fdc1df7b640 1 -- 172.21.15.133:0/276016191 learned_addr learned my addr 172.21.15.133:0/276016191 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.043+0000 7fdc1d77a640 1 --2- 172.21.15.133:0/276016191 >> v2:172.21.15.138:3300/0 conn(0x7fdc180c4100 0x7fdc180c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.043+0000 7fdc1e77c640 1 -- 172.21.15.133:0/276016191 >> v2:172.21.15.138:3300/0 conn(0x7fdc180c4100 msgr2=0x7fdc180c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.043+0000 7fdc1e77c640 1 --2- 172.21.15.133:0/276016191 >> v2:172.21.15.138:3300/0 conn(0x7fdc180c4100 0x7fdc180c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.043+0000 7fdc1e77c640 1 -- 172.21.15.133:0/276016191 >> v1:172.21.15.133:6789/0 conn(0x7fdc180c63c0 legacy=0x7fdc180c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.043+0000 7fdc1e77c640 1 -- 172.21.15.133:0/276016191 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc180c1310 con 0x7fdc180c06d0 2023-12-19T18:59:30.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.043+0000 7fdc1cf79640 1 -- 172.21.15.133:0/276016191 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103615202 0 0) 0x7fdc180c31c0 con 0x7fdc180c63c0 2023-12-19T18:59:30.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.047+0000 7fdc1e77c640 1 --2- 172.21.15.133:0/276016191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc180c06d0 0x7fdc180a9680 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdc180a8b40 tx=0x7fdc1001e550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12aa9e7434677e54 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:30.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.047+0000 7fdc1cf79640 1 -- 172.21.15.133:0/276016191 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc180aa3d0 con 0x7fdc180c06d0 2023-12-19T18:59:30.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.047+0000 7fdc1cf79640 1 -- 172.21.15.133:0/276016191 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc100ad670 con 0x7fdc180c06d0 2023-12-19T18:59:30.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.047+0000 7fdc1cf79640 1 -- 172.21.15.133:0/276016191 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc100ada00 con 0x7fdc180c06d0 2023-12-19T18:59:30.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.047+0000 7fdc201df640 1 -- 172.21.15.133:0/276016191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc180c06d0 msgr2=0x7fdc180a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:30.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.047+0000 7fdc201df640 1 --2- 172.21.15.133:0/276016191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc180c06d0 0x7fdc180a9680 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fdc180a8b40 tx=0x7fdc1001e550 comp rx=0 tx=0).stop 2023-12-19T18:59:30.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.047+0000 7fdc201df640 1 -- 172.21.15.133:0/276016191 shutdown_connections 2023-12-19T18:59:30.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.047+0000 7fdc201df640 1 --2- 172.21.15.133:0/276016191 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc180c06d0 0x7fdc180a9680 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:30.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.047+0000 7fdc201df640 1 --2- 172.21.15.133:0/276016191 >> v2:172.21.15.138:3300/0 conn(0x7fdc180c4100 0x7fdc180c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:30.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.047+0000 7fdc201df640 1 -- 172.21.15.133:0/276016191 >> 172.21.15.133:0/276016191 conn(0x7fdc1806a5b0 msgr2=0x7fdc1806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:30.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.047+0000 7fdc201df640 1 -- 172.21.15.133:0/276016191 shutdown_connections 2023-12-19T18:59:30.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.047+0000 7fdc201df640 1 -- 172.21.15.133:0/276016191 wait complete. 2023-12-19T18:59:30.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.047+0000 7fdc201df640 1 Processor -- start 2023-12-19T18:59:30.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.047+0000 7fdc201df640 1 -- start start 2023-12-19T18:59:30.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.051+0000 7fdc201df640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc180c06d0 0x7fdc1814ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:30.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.051+0000 7fdc201df640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc180c4100 0x7fdc180c22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:30.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.051+0000 7fdc201df640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc180c63c0 0x7fdc181527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:30.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.051+0000 7fdc201df640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc181f0d80 con 0x7fdc180c06d0 2023-12-19T18:59:30.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.051+0000 7fdc201df640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc181568f0 con 0x7fdc180c63c0 2023-12-19T18:59:30.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.051+0000 7fdc201df640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc181f07c0 con 0x7fdc180c4100 2023-12-19T18:59:30.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.051+0000 7fdc1df7b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc180c06d0 0x7fdc1814ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:30.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.051+0000 7fdc1df7b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc180c06d0 0x7fdc1814ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42204/0 (socket says 172.21.15.133:42204) 2023-12-19T18:59:30.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.051+0000 7fdc1df7b640 1 -- 172.21.15.133:0/281648780 learned_addr learned my addr 172.21.15.133:0/281648780 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:30.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.051+0000 7fdc1df7b640 1 -- 172.21.15.133:0/281648780 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc180c4100 msgr2=0x7fdc180c22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:30.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.051+0000 7fdc1df7b640 1 --2- 172.21.15.133:0/281648780 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc180c4100 0x7fdc180c22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:30.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.051+0000 7fdc1df7b640 1 -- 172.21.15.133:0/281648780 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc180c63c0 msgr2=0x7fdc181527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:30.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.051+0000 7fdc1df7b640 1 --2- 172.21.15.133:0/281648780 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc180c63c0 0x7fdc181527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:30.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.051+0000 7fdc1df7b640 1 -- 172.21.15.133:0/281648780 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc10009420 con 0x7fdc180c06d0 2023-12-19T18:59:30.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.051+0000 7fdc1df7b640 1 --2- 172.21.15.133:0/281648780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc180c06d0 0x7fdc1814ace0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400cb10 tx=0x7fdc1400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:30.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.051+0000 7fdc0e7fc640 1 -- 172.21.15.133:0/281648780 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc1400ac70 con 0x7fdc180c06d0 2023-12-19T18:59:30.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.051+0000 7fdc0e7fc640 1 -- 172.21.15.133:0/281648780 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc1400add0 con 0x7fdc180c06d0 2023-12-19T18:59:30.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.051+0000 7fdc201df640 1 -- 172.21.15.133:0/281648780 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc181f0aa0 con 0x7fdc180c06d0 2023-12-19T18:59:30.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.051+0000 7fdc0e7fc640 1 -- 172.21.15.133:0/281648780 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc14012620 con 0x7fdc180c06d0 2023-12-19T18:59:30.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.051+0000 7fdc201df640 1 -- 172.21.15.133:0/281648780 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc1814e960 con 0x7fdc180c06d0 2023-12-19T18:59:30.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.051+0000 7fdc201df640 1 -- 172.21.15.133:0/281648780 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc1814e4e0 con 0x7fdc180c06d0 2023-12-19T18:59:30.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.055+0000 7fdc0e7fc640 1 -- 172.21.15.133:0/281648780 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fdc14007070 con 0x7fdc180c06d0 2023-12-19T18:59:30.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.055+0000 7fdc0e7fc640 1 --2- 172.21.15.133:0/281648780 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdbfc066470 0x7fdbfc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:30.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.055+0000 7fdc0e7fc640 1 -- 172.21.15.133:0/281648780 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc14083eb0 con 0x7fdc180c06d0 2023-12-19T18:59:30.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.055+0000 7fdc1d77a640 1 --2- 172.21.15.133:0/281648780 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdbfc066470 0x7fdbfc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:30.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.055+0000 7fdc1d77a640 1 --2- 172.21.15.133:0/281648780 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdbfc066470 0x7fdbfc068930 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdc181ed970 tx=0x7fdc08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:30.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.059+0000 7fdc0e7fc640 1 -- 172.21.15.133:0/281648780 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fdc1814e4e0 con 0x7fdc180c06d0 2023-12-19T18:59:30.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.247+0000 7fdc201df640 1 -- 172.21.15.133:0/281648780 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fdc1814e4e0 con 0x7fdc180c06d0 2023-12-19T18:59:30.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.879+0000 7fdc0e7fc640 1 -- 172.21.15.133:0/281648780 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdc1814e4e0 con 0x7fdc180c06d0 2023-12-19T18:59:30.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.879+0000 7fdc201df640 1 -- 172.21.15.133:0/281648780 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdbfc066470 msgr2=0x7fdbfc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:30.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.879+0000 7fdc201df640 1 --2- 172.21.15.133:0/281648780 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdbfc066470 0x7fdbfc068930 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdc181ed970 tx=0x7fdc08008040 comp rx=0 tx=0).stop 2023-12-19T18:59:30.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.879+0000 7fdc201df640 1 -- 172.21.15.133:0/281648780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc180c06d0 msgr2=0x7fdc1814ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:30.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.879+0000 7fdc201df640 1 --2- 172.21.15.133:0/281648780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc180c06d0 0x7fdc1814ace0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdc1400cb10 tx=0x7fdc1400a060 comp rx=0 tx=0).stop 2023-12-19T18:59:30.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.879+0000 7fdc201df640 1 -- 172.21.15.133:0/281648780 shutdown_connections 2023-12-19T18:59:30.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.879+0000 7fdc201df640 1 --2- 172.21.15.133:0/281648780 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdbfc066470 0x7fdbfc068930 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:30.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.879+0000 7fdc201df640 1 --2- 172.21.15.133:0/281648780 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdc180c63c0 0x7fdc181527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:30.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.879+0000 7fdc201df640 1 --2- 172.21.15.133:0/281648780 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdc180c4100 0x7fdc180c22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:30.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.879+0000 7fdc201df640 1 --2- 172.21.15.133:0/281648780 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc180c06d0 0x7fdc1814ace0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:30.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.879+0000 7fdc201df640 1 -- 172.21.15.133:0/281648780 >> 172.21.15.133:0/281648780 conn(0x7fdc1806a5b0 msgr2=0x7fdc1806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:30.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.879+0000 7fdc201df640 1 -- 172.21.15.133:0/281648780 shutdown_connections 2023-12-19T18:59:30.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:30.879+0000 7fdc201df640 1 -- 172.21.15.133:0/281648780 wait complete. 2023-12-19T18:59:30.907 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T18:59:30.907 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:59:31.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.039+0000 7f6b3486b640 1 Processor -- start 2023-12-19T18:59:31.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.043+0000 7f6b3486b640 1 -- start start 2023-12-19T18:59:31.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.043+0000 7f6b3486b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b300c63c0 0x7f6b300c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:31.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.043+0000 7f6b3486b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6b300c4100 0x7f6b300c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:31.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.043+0000 7f6b3486b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b300c31c0 con 0x7f6b300c29e0 2023-12-19T18:59:31.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.043+0000 7f6b3486b640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b300c34a0 con 0x7f6b300c4100 2023-12-19T18:59:31.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.043+0000 7f6b3486b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b300c1030 con 0x7f6b300c63c0 2023-12-19T18:59:31.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.043+0000 7f6b25d9b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6b300c4100 0x7f6b300c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:31.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.043+0000 7f6b2ed9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6b300c29e0 0x7f6b300a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37376/0 (socket says 172.21.15.133:37376) 2023-12-19T18:59:31.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.043+0000 7f6b2ed9d640 1 -- 172.21.15.133:0/558360742 learned_addr learned my addr 172.21.15.133:0/558360742 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:31.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.043+0000 7f6b25d9b640 1 -- 172.21.15.133:0/558360742 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b300c63c0 msgr2=0x7f6b300c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:31.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.043+0000 7f6b25d9b640 1 --2- 172.21.15.133:0/558360742 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b300c63c0 0x7f6b300c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.043+0000 7f6b25d9b640 1 -- 172.21.15.133:0/558360742 >> v1:172.21.15.133:6789/0 conn(0x7f6b300c29e0 legacy=0x7f6b300a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:31.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.043+0000 7f6b25d9b640 1 -- 172.21.15.133:0/558360742 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b300c1310 con 0x7f6b300c4100 2023-12-19T18:59:31.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.043+0000 7f6b2dd9b640 1 -- 172.21.15.133:0/558360742 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248031852 0 0) 0x7f6b300c31c0 con 0x7f6b300c29e0 2023-12-19T18:59:31.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.047+0000 7f6b25d9b640 1 --2- 172.21.15.133:0/558360742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b300c4100 0x7f6b300c24a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6b200097c0 tx=0x7f6b2001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ae83be85dfede1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:31.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.047+0000 7f6b2dd9b640 1 -- 172.21.15.133:0/558360742 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b20004230 con 0x7f6b300c4100 2023-12-19T18:59:31.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.047+0000 7f6b2dd9b640 1 -- 172.21.15.133:0/558360742 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b200a7050 con 0x7f6b300c4100 2023-12-19T18:59:31.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.047+0000 7f6b2dd9b640 1 -- 172.21.15.133:0/558360742 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b20003620 con 0x7f6b300c4100 2023-12-19T18:59:31.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.047+0000 7f6b3486b640 1 -- 172.21.15.133:0/558360742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b300c4100 msgr2=0x7f6b300c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:31.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.047+0000 7f6b3486b640 1 --2- 172.21.15.133:0/558360742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b300c4100 0x7f6b300c24a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6b200097c0 tx=0x7f6b2001c330 comp rx=0 tx=0).stop 2023-12-19T18:59:31.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.047+0000 7f6b3486b640 1 -- 172.21.15.133:0/558360742 shutdown_connections 2023-12-19T18:59:31.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.047+0000 7f6b3486b640 1 --2- 172.21.15.133:0/558360742 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b300c4100 0x7f6b300c24a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.047+0000 7f6b3486b640 1 --2- 172.21.15.133:0/558360742 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b300c63c0 0x7f6b300c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.047+0000 7f6b3486b640 1 -- 172.21.15.133:0/558360742 >> 172.21.15.133:0/558360742 conn(0x7f6b3006a5b0 msgr2=0x7f6b3006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:31.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.047+0000 7f6b3486b640 1 -- 172.21.15.133:0/558360742 shutdown_connections 2023-12-19T18:59:31.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.047+0000 7f6b3486b640 1 -- 172.21.15.133:0/558360742 wait complete. 2023-12-19T18:59:31.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.047+0000 7f6b3486b640 1 Processor -- start 2023-12-19T18:59:31.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.047+0000 7f6b3486b640 1 -- start start 2023-12-19T18:59:31.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b3486b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b300c29e0 0x7f6b3014b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:31.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b3486b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b300c4100 0x7f6b3015a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:31.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b3486b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b300c63c0 0x7f6b3014d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:31.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b3486b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b301f0dd0 con 0x7f6b300c29e0 2023-12-19T18:59:31.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b3486b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b301f10b0 con 0x7f6b300c4100 2023-12-19T18:59:31.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b3486b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3015dd80 con 0x7f6b300c63c0 2023-12-19T18:59:31.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b2e59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b300c29e0 0x7f6b3014b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:31.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b2e59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b300c29e0 0x7f6b3014b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42220/0 (socket says 172.21.15.133:42220) 2023-12-19T18:59:31.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b2e59c640 1 -- 172.21.15.133:0/1153410546 learned_addr learned my addr 172.21.15.133:0/1153410546 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:31.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b25d9b640 1 --2- 172.21.15.133:0/1153410546 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b300c4100 0x7f6b3015a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:31.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b2ed9d640 1 --2- 172.21.15.133:0/1153410546 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b300c63c0 0x7f6b3014d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:31.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b2e59c640 1 -- 172.21.15.133:0/1153410546 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b300c63c0 msgr2=0x7f6b3014d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:31.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b2e59c640 1 --2- 172.21.15.133:0/1153410546 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b300c63c0 0x7f6b3014d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b2e59c640 1 -- 172.21.15.133:0/1153410546 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b300c4100 msgr2=0x7f6b3015a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:31.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b2e59c640 1 --2- 172.21.15.133:0/1153410546 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b300c4100 0x7f6b3015a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b2e59c640 1 -- 172.21.15.133:0/1153410546 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b20009420 con 0x7f6b300c29e0 2023-12-19T18:59:31.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b2e59c640 1 --2- 172.21.15.133:0/1153410546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b300c29e0 0x7f6b3014b130 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6b1800b410 tx=0x7f6b1800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:31.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b277fe640 1 -- 172.21.15.133:0/1153410546 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b18011830 con 0x7f6b300c29e0 2023-12-19T18:59:31.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b277fe640 1 -- 172.21.15.133:0/1153410546 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b18011990 con 0x7f6b300c29e0 2023-12-19T18:59:31.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b277fe640 1 -- 172.21.15.133:0/1153410546 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b18011d40 con 0x7f6b300c29e0 2023-12-19T18:59:31.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b3486b640 1 -- 172.21.15.133:0/1153410546 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b3015e060 con 0x7f6b300c29e0 2023-12-19T18:59:31.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b3486b640 1 -- 172.21.15.133:0/1153410546 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3014b670 con 0x7f6b300c29e0 2023-12-19T18:59:31.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b3486b640 1 -- 172.21.15.133:0/1153410546 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b30068400 con 0x7f6b300c29e0 2023-12-19T18:59:31.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.051+0000 7f6b277fe640 1 -- 172.21.15.133:0/1153410546 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6b1801a400 con 0x7f6b300c29e0 2023-12-19T18:59:31.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.055+0000 7f6b277fe640 1 --2- 172.21.15.133:0/1153410546 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6b10066470 0x7f6b10068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:31.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.055+0000 7f6b277fe640 1 -- 172.21.15.133:0/1153410546 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b18083e90 con 0x7f6b300c29e0 2023-12-19T18:59:31.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.055+0000 7f6b25d9b640 1 --2- 172.21.15.133:0/1153410546 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6b10066470 0x7f6b10068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:31.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.055+0000 7f6b25d9b640 1 --2- 172.21.15.133:0/1153410546 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6b10066470 0x7f6b10068930 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6b200ad000 tx=0x7f6b200a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:31.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.059+0000 7f6b277fe640 1 -- 172.21.15.133:0/1153410546 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6b180513b0 con 0x7f6b300c29e0 2023-12-19T18:59:31.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.235+0000 7f6b3486b640 1 -- 172.21.15.133:0/1153410546 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b300a5a50 con 0x7f6b300c29e0 2023-12-19T18:59:31.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.235+0000 7f6b277fe640 1 -- 172.21.15.133:0/1153410546 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f6b18015090 con 0x7f6b300c29e0 2023-12-19T18:59:31.242 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:31.242 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/2717901150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6835","nonce":2717901150},{"type":"v1","addr":"172.21.15.138:6837","nonce":2717901150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4986,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6836/3989181473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":3989181473},{"type":"v1","addr":"172.21.15.138:6836","nonce":3989181473}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/3180094953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":3180094953},{"type":"v1","addr":"172.21.15.133:6834","nonce":3180094953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:59:27.233483+0000","modified":"2023-12-19T18:59:30.251421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4995},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4995":{"gid":4995,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/862459875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":862459875},{"type":"v1","addr":"172.21.15.133:6835","nonce":862459875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T18:59:31.242 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 17 2023-12-19T18:59:31.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.239+0000 7f6b3486b640 1 -- 172.21.15.133:0/1153410546 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6b10066470 msgr2=0x7f6b10068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:31.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.239+0000 7f6b3486b640 1 --2- 172.21.15.133:0/1153410546 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6b10066470 0x7f6b10068930 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6b200ad000 tx=0x7f6b200a6000 comp rx=0 tx=0).stop 2023-12-19T18:59:31.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.239+0000 7f6b3486b640 1 -- 172.21.15.133:0/1153410546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b300c29e0 msgr2=0x7f6b3014b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:31.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.239+0000 7f6b3486b640 1 --2- 172.21.15.133:0/1153410546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b300c29e0 0x7f6b3014b130 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6b1800b410 tx=0x7f6b1800b8d0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.239+0000 7f6b3486b640 1 -- 172.21.15.133:0/1153410546 shutdown_connections 2023-12-19T18:59:31.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.239+0000 7f6b3486b640 1 --2- 172.21.15.133:0/1153410546 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6b10066470 0x7f6b10068930 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.239+0000 7f6b3486b640 1 --2- 172.21.15.133:0/1153410546 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6b300c63c0 0x7f6b3014d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.239+0000 7f6b3486b640 1 --2- 172.21.15.133:0/1153410546 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6b300c4100 0x7f6b3015a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.239+0000 7f6b3486b640 1 --2- 172.21.15.133:0/1153410546 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6b300c29e0 0x7f6b3014b130 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.239+0000 7f6b3486b640 1 -- 172.21.15.133:0/1153410546 >> 172.21.15.133:0/1153410546 conn(0x7f6b3006a5b0 msgr2=0x7f6b300a9680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:31.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.239+0000 7f6b3486b640 1 -- 172.21.15.133:0/1153410546 shutdown_connections 2023-12-19T18:59:31.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.239+0000 7f6b3486b640 1 -- 172.21.15.133:0/1153410546 wait complete. 2023-12-19T18:59:31.263 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:59:31.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.395+0000 7f92c5609640 1 Processor -- start 2023-12-19T18:59:31.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.395+0000 7f92c5609640 1 -- start start 2023-12-19T18:59:31.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.395+0000 7f92c5609640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f92c0072090 0x7f92c0150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:31.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.395+0000 7f92c5609640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f92c00725c0 0x7f92c01514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:31.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.395+0000 7f92c5609640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c00c2760 con 0x7f92c00a5370 2023-12-19T18:59:31.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.395+0000 7f92c5609640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c00c3070 con 0x7f92c0072090 2023-12-19T18:59:31.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.395+0000 7f92c5609640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c00a5750 con 0x7f92c00725c0 2023-12-19T18:59:31.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.395+0000 7f92b67fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f92c0072090 0x7f92c0150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:31.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.395+0000 7f92b67fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f92c0072090 0x7f92c0150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42226/0 (socket says 172.21.15.133:42226) 2023-12-19T18:59:31.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.395+0000 7f92b67fc640 1 -- 172.21.15.133:0/878919052 learned_addr learned my addr 172.21.15.133:0/878919052 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:31.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.395+0000 7f92beffd640 1 --1- 172.21.15.133:0/878919052 >> v1:172.21.15.138:6789/0 conn(0x7f92c00a5370 0x7f92c00c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:53268/0 (socket says 172.21.15.133:53268) 2023-12-19T18:59:31.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.395+0000 7f92bf7fe640 1 --2- 172.21.15.133:0/878919052 >> v2:172.21.15.138:3300/0 conn(0x7f92c00725c0 0x7f92c01514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:31.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.395+0000 7f92b67fc640 1 -- 172.21.15.133:0/878919052 >> v2:172.21.15.138:3300/0 conn(0x7f92c00725c0 msgr2=0x7f92c01514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:31.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.395+0000 7f92b67fc640 1 --2- 172.21.15.133:0/878919052 >> v2:172.21.15.138:3300/0 conn(0x7f92c00725c0 0x7f92c01514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.395+0000 7f92b67fc640 1 -- 172.21.15.133:0/878919052 >> v1:172.21.15.138:6789/0 conn(0x7f92c00a5370 legacy=0x7f92c00c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:31.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.395+0000 7f92b67fc640 1 -- 172.21.15.133:0/878919052 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c00aad20 con 0x7f92c0072090 2023-12-19T18:59:31.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.399+0000 7f92b67fc640 1 --2- 172.21.15.133:0/878919052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92c0072090 0x7f92c0150fa0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f92c0072020 tx=0x7f92a801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ed389d1c8c7283 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:31.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.399+0000 7f92be7fc640 1 -- 172.21.15.133:0/878919052 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a80ab600 con 0x7f92c0072090 2023-12-19T18:59:31.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.399+0000 7f92be7fc640 1 -- 172.21.15.133:0/878919052 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a80a7050 con 0x7f92c0072090 2023-12-19T18:59:31.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.399+0000 7f92be7fc640 1 -- 172.21.15.133:0/878919052 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a80ab980 con 0x7f92c0072090 2023-12-19T18:59:31.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.399+0000 7f92c5609640 1 -- 172.21.15.133:0/878919052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92c0072090 msgr2=0x7f92c0150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:31.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.399+0000 7f92c5609640 1 --2- 172.21.15.133:0/878919052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92c0072090 0x7f92c0150fa0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f92c0072020 tx=0x7f92a801c3b0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.399+0000 7f92c5609640 1 -- 172.21.15.133:0/878919052 shutdown_connections 2023-12-19T18:59:31.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.399+0000 7f92c5609640 1 --2- 172.21.15.133:0/878919052 >> v2:172.21.15.138:3300/0 conn(0x7f92c00725c0 0x7f92c01514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.399+0000 7f92c5609640 1 --2- 172.21.15.133:0/878919052 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92c0072090 0x7f92c0150fa0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.399+0000 7f92c5609640 1 -- 172.21.15.133:0/878919052 >> 172.21.15.133:0/878919052 conn(0x7f92c006a5b0 msgr2=0x7f92c006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:31.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.399+0000 7f92c5609640 1 -- 172.21.15.133:0/878919052 shutdown_connections 2023-12-19T18:59:31.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.399+0000 7f92c5609640 1 -- 172.21.15.133:0/878919052 wait complete. 2023-12-19T18:59:31.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.403+0000 7f92c5609640 1 Processor -- start 2023-12-19T18:59:31.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.403+0000 7f92c5609640 1 -- start start 2023-12-19T18:59:31.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.403+0000 7f92c5609640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92c0072090 0x7f92c0146ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:31.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.403+0000 7f92c5609640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92c00725c0 0x7f92c01476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:31.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.403+0000 7f92c5609640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c00a5370 0x7f92c01ed660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:31.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.403+0000 7f92c5609640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c01ecc90 con 0x7f92c00725c0 2023-12-19T18:59:31.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.403+0000 7f92c5609640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c015f6a0 con 0x7f92c0072090 2023-12-19T18:59:31.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.403+0000 7f92c5609640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c00a7800 con 0x7f92c00a5370 2023-12-19T18:59:31.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.403+0000 7f92b67fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92c00725c0 0x7f92c01476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:31.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.403+0000 7f92b67fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92c00725c0 0x7f92c01476a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42228/0 (socket says 172.21.15.133:42228) 2023-12-19T18:59:31.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.403+0000 7f92b67fc640 1 -- 172.21.15.133:0/4109768185 learned_addr learned my addr 172.21.15.133:0/4109768185 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:31.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.403+0000 7f92b67fc640 1 -- 172.21.15.133:0/4109768185 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c00a5370 msgr2=0x7f92c01ed660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:31.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.403+0000 7f92b67fc640 1 --2- 172.21.15.133:0/4109768185 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c00a5370 0x7f92c01ed660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.403+0000 7f92b67fc640 1 -- 172.21.15.133:0/4109768185 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92c0072090 msgr2=0x7f92c0146ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:31.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.403+0000 7f92b67fc640 1 --2- 172.21.15.133:0/4109768185 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92c0072090 0x7f92c0146ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.403+0000 7f92b67fc640 1 -- 172.21.15.133:0/4109768185 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a80094d0 con 0x7f92c00725c0 2023-12-19T18:59:31.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.403+0000 7f92b67fc640 1 --2- 172.21.15.133:0/4109768185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92c00725c0 0x7f92c01476a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f92a80ae040 tx=0x7f92a8019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:31.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.403+0000 7f92b7fff640 1 -- 172.21.15.133:0/4109768185 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a80b4420 con 0x7f92c00725c0 2023-12-19T18:59:31.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.403+0000 7f92b7fff640 1 -- 172.21.15.133:0/4109768185 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a80b4580 con 0x7f92c00725c0 2023-12-19T18:59:31.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.403+0000 7f92b7fff640 1 -- 172.21.15.133:0/4109768185 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a80b48f0 con 0x7f92c00725c0 2023-12-19T18:59:31.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.403+0000 7f92c5609640 1 -- 172.21.15.133:0/4109768185 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c01ecea0 con 0x7f92c00725c0 2023-12-19T18:59:31.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.403+0000 7f92c5609640 1 -- 172.21.15.133:0/4109768185 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c015f0e0 con 0x7f92c00725c0 2023-12-19T18:59:31.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.403+0000 7f92c5609640 1 -- 172.21.15.133:0/4109768185 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c0068400 con 0x7f92c00725c0 2023-12-19T18:59:31.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.407+0000 7f92b7fff640 1 -- 172.21.15.133:0/4109768185 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f92a80b2070 con 0x7f92c00725c0 2023-12-19T18:59:31.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.407+0000 7f92b7fff640 1 --2- 172.21.15.133:0/4109768185 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f92a0066470 0x7f92a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:31.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.407+0000 7f92b7fff640 1 -- 172.21.15.133:0/4109768185 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92a811dad0 con 0x7f92c00725c0 2023-12-19T18:59:31.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.407+0000 7f92beffd640 1 --2- 172.21.15.133:0/4109768185 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f92a0066470 0x7f92a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:31.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.407+0000 7f92beffd640 1 --2- 172.21.15.133:0/4109768185 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f92a0066470 0x7f92a0068930 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f92c006dac0 tx=0x7f92b00079d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:31.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.411+0000 7f92b7fff640 1 -- 172.21.15.133:0/4109768185 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f92a80eaeb0 con 0x7f92c00725c0 2023-12-19T18:59:31.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.559+0000 7f92c5609640 1 -- 172.21.15.133:0/4109768185 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92c0155090 con 0x7f92c00725c0 2023-12-19T18:59:31.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.563+0000 7f92b7fff640 1 -- 172.21.15.133:0/4109768185 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16605 (secure 0 0 0) 0x7f92a80ee4d0 con 0x7f92c00725c0 2023-12-19T18:59:31.567 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:31.567 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":31,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:59:28.620155+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:59:25.798150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T18:59:26.236078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:59:31.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.563+0000 7f92c5609640 1 -- 172.21.15.133:0/4109768185 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f92a0066470 msgr2=0x7f92a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:31.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.563+0000 7f92c5609640 1 --2- 172.21.15.133:0/4109768185 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f92a0066470 0x7f92a0068930 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f92c006dac0 tx=0x7f92b00079d0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.563+0000 7f92c5609640 1 -- 172.21.15.133:0/4109768185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92c00725c0 msgr2=0x7f92c01476a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:31.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.563+0000 7f92c5609640 1 --2- 172.21.15.133:0/4109768185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92c00725c0 0x7f92c01476a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f92a80ae040 tx=0x7f92a8019150 comp rx=0 tx=0).stop 2023-12-19T18:59:31.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.563+0000 7f92c5609640 1 -- 172.21.15.133:0/4109768185 shutdown_connections 2023-12-19T18:59:31.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.563+0000 7f92c5609640 1 --2- 172.21.15.133:0/4109768185 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f92a0066470 0x7f92a0068930 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.563+0000 7f92c5609640 1 --2- 172.21.15.133:0/4109768185 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c00a5370 0x7f92c01ed660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.563+0000 7f92c5609640 1 --2- 172.21.15.133:0/4109768185 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92c00725c0 0x7f92c01476a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.563+0000 7f92c5609640 1 --2- 172.21.15.133:0/4109768185 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92c0072090 0x7f92c0146ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.563+0000 7f92c5609640 1 -- 172.21.15.133:0/4109768185 >> 172.21.15.133:0/4109768185 conn(0x7f92c006a5b0 msgr2=0x7f92c00c0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:31.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.563+0000 7f92c5609640 1 -- 172.21.15.133:0/4109768185 shutdown_connections 2023-12-19T18:59:31.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.563+0000 7f92c5609640 1 -- 172.21.15.133:0/4109768185 wait complete. 2023-12-19T18:59:31.588 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T18:59:31.589 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T18:59:31.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.719+0000 7fdf464fe640 1 Processor -- start 2023-12-19T18:59:31.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.719+0000 7fdf464fe640 1 -- start start 2023-12-19T18:59:31.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.719+0000 7fdf464fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf400a5370 0x7fdf400c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:31.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.719+0000 7fdf464fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdf400c4110 0x7fdf40150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:31.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.719+0000 7fdf464fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fdf40072090 0x7fdf401514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:31.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.719+0000 7fdf464fe640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf400c3070 con 0x7fdf400c4110 2023-12-19T18:59:31.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.719+0000 7fdf464fe640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf400c2760 con 0x7fdf40072090 2023-12-19T18:59:31.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.719+0000 7fdf464fe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf400a5750 con 0x7fdf400a5370 2023-12-19T18:59:31.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.719+0000 7fdf3f7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdf400c4110 0x7fdf40150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:31.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.719+0000 7fdf3f7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdf400c4110 0x7fdf40150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42242/0 (socket says 172.21.15.133:42242) 2023-12-19T18:59:31.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.719+0000 7fdf3f7fe640 1 -- 172.21.15.133:0/1704135841 learned_addr learned my addr 172.21.15.133:0/1704135841 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:31.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.719+0000 7fdf44a9b640 1 --2- 172.21.15.133:0/1704135841 >> v2:172.21.15.138:3300/0 conn(0x7fdf40072090 0x7fdf401514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:31.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.719+0000 7fdf3ffff640 1 --2- 172.21.15.133:0/1704135841 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf400a5370 0x7fdf400c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:31.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.719+0000 7fdf3f7fe640 1 -- 172.21.15.133:0/1704135841 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf400a5370 msgr2=0x7fdf400c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:31.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.719+0000 7fdf3f7fe640 1 --2- 172.21.15.133:0/1704135841 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf400a5370 0x7fdf400c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.719+0000 7fdf3f7fe640 1 -- 172.21.15.133:0/1704135841 >> v2:172.21.15.138:3300/0 conn(0x7fdf40072090 msgr2=0x7fdf401514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:31.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.719+0000 7fdf3f7fe640 1 --2- 172.21.15.133:0/1704135841 >> v2:172.21.15.138:3300/0 conn(0x7fdf40072090 0x7fdf401514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.719+0000 7fdf3f7fe640 1 -- 172.21.15.133:0/1704135841 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf400aad20 con 0x7fdf400c4110 2023-12-19T18:59:31.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.719+0000 7fdf3ffff640 1 --2- 172.21.15.133:0/1704135841 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf400a5370 0x7fdf400c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:31.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.723+0000 7fdf3f7fe640 1 --2- 172.21.15.133:0/1704135841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf400c4110 0x7fdf40150fa0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdf400c4590 tx=0x7fdf3401e860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a6f14d51bc6b9fd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:31.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.723+0000 7fdf3effd640 1 -- 172.21.15.133:0/1704135841 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf34004230 con 0x7fdf400c4110 2023-12-19T18:59:31.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.723+0000 7fdf3effd640 1 -- 172.21.15.133:0/1704135841 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf340ab070 con 0x7fdf400c4110 2023-12-19T18:59:31.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.723+0000 7fdf3effd640 1 -- 172.21.15.133:0/1704135841 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf340a7670 con 0x7fdf400c4110 2023-12-19T18:59:31.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.723+0000 7fdf464fe640 1 -- 172.21.15.133:0/1704135841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf400c4110 msgr2=0x7fdf40150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:31.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.723+0000 7fdf464fe640 1 --2- 172.21.15.133:0/1704135841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf400c4110 0x7fdf40150fa0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdf400c4590 tx=0x7fdf3401e860 comp rx=0 tx=0).stop 2023-12-19T18:59:31.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.723+0000 7fdf464fe640 1 -- 172.21.15.133:0/1704135841 shutdown_connections 2023-12-19T18:59:31.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.723+0000 7fdf464fe640 1 --2- 172.21.15.133:0/1704135841 >> v2:172.21.15.138:3300/0 conn(0x7fdf40072090 0x7fdf401514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.723+0000 7fdf464fe640 1 --2- 172.21.15.133:0/1704135841 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf400c4110 0x7fdf40150fa0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.723+0000 7fdf464fe640 1 --2- 172.21.15.133:0/1704135841 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf400a5370 0x7fdf400c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.723+0000 7fdf464fe640 1 -- 172.21.15.133:0/1704135841 >> 172.21.15.133:0/1704135841 conn(0x7fdf4006a5b0 msgr2=0x7fdf4006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:31.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.723+0000 7fdf464fe640 1 -- 172.21.15.133:0/1704135841 shutdown_connections 2023-12-19T18:59:31.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.723+0000 7fdf464fe640 1 -- 172.21.15.133:0/1704135841 wait complete. 2023-12-19T18:59:31.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf464fe640 1 Processor -- start 2023-12-19T18:59:31.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf464fe640 1 -- start start 2023-12-19T18:59:31.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf464fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf40072090 0x7fdf400a7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:31.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf464fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf400a5370 0x7fdf400a81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:31.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf464fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf400c4110 0x7fdf40152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:31.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf464fe640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf40152840 con 0x7fdf400c4110 2023-12-19T18:59:31.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf464fe640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf40152510 con 0x7fdf40072090 2023-12-19T18:59:31.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf464fe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4014ee60 con 0x7fdf400a5370 2023-12-19T18:59:31.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf44a9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf400c4110 0x7fdf40152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:31.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf44a9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf400c4110 0x7fdf40152cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42258/0 (socket says 172.21.15.133:42258) 2023-12-19T18:59:31.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf44a9b640 1 -- 172.21.15.133:0/315141913 learned_addr learned my addr 172.21.15.133:0/315141913 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:31.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf3ffff640 1 --2- 172.21.15.133:0/315141913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf40072090 0x7fdf400a7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:31.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf3f7fe640 1 --2- 172.21.15.133:0/315141913 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf400a5370 0x7fdf400a81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:31.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf44a9b640 1 -- 172.21.15.133:0/315141913 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf400a5370 msgr2=0x7fdf400a81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:31.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf44a9b640 1 --2- 172.21.15.133:0/315141913 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf400a5370 0x7fdf400a81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf44a9b640 1 -- 172.21.15.133:0/315141913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf40072090 msgr2=0x7fdf400a7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:31.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf44a9b640 1 --2- 172.21.15.133:0/315141913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf40072090 0x7fdf400a7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf44a9b640 1 -- 172.21.15.133:0/315141913 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3400b780 con 0x7fdf400c4110 2023-12-19T18:59:31.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf3ffff640 1 --2- 172.21.15.133:0/315141913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf40072090 0x7fdf400a7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:31.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf44a9b640 1 --2- 172.21.15.133:0/315141913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf400c4110 0x7fdf40152cd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800eed0 tx=0x7fdf3800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:31.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf3cff9640 1 -- 172.21.15.133:0/315141913 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf38010040 con 0x7fdf400c4110 2023-12-19T18:59:31.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf3cff9640 1 -- 172.21.15.133:0/315141913 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf38014400 con 0x7fdf400c4110 2023-12-19T18:59:31.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf3cff9640 1 -- 172.21.15.133:0/315141913 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf38009ea0 con 0x7fdf400c4110 2023-12-19T18:59:31.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf464fe640 1 -- 172.21.15.133:0/315141913 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf4014f140 con 0x7fdf400c4110 2023-12-19T18:59:31.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.727+0000 7fdf464fe640 1 -- 172.21.15.133:0/315141913 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf4014f420 con 0x7fdf400c4110 2023-12-19T18:59:31.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.731+0000 7fdf464fe640 1 -- 172.21.15.133:0/315141913 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf401529b0 con 0x7fdf400c4110 2023-12-19T18:59:31.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.731+0000 7fdf3cff9640 1 -- 172.21.15.133:0/315141913 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fdf380147b0 con 0x7fdf400c4110 2023-12-19T18:59:31.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.731+0000 7fdf3cff9640 1 --2- 172.21.15.133:0/315141913 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdf2c0664a0 0x7fdf2c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:31.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.731+0000 7fdf3cff9640 1 -- 172.21.15.133:0/315141913 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf38084530 con 0x7fdf400c4110 2023-12-19T18:59:31.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.731+0000 7fdf3ffff640 1 --2- 172.21.15.133:0/315141913 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdf2c0664a0 0x7fdf2c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:31.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.731+0000 7fdf3ffff640 1 --2- 172.21.15.133:0/315141913 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdf2c0664a0 0x7fdf2c068960 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdf30009970 tx=0x7fdf30008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:31.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.735+0000 7fdf3cff9640 1 -- 172.21.15.133:0/315141913 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fdf38051a20 con 0x7fdf400c4110 2023-12-19T18:59:31.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.883+0000 7fdf464fe640 1 -- 172.21.15.133:0/315141913 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdf40068400 con 0x7fdf2c0664a0 2023-12-19T18:59:31.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.895+0000 7fdf3cff9640 1 -- 172.21.15.133:0/315141913 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252545 (secure 0 0 0) 0x7fdf40068400 con 0x7fdf2c0664a0 2023-12-19T18:59:31.901 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:31.903 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T18:59:31.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.895+0000 7fdf464fe640 1 -- 172.21.15.133:0/315141913 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdf2c0664a0 msgr2=0x7fdf2c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:31.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.895+0000 7fdf464fe640 1 --2- 172.21.15.133:0/315141913 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdf2c0664a0 0x7fdf2c068960 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdf30009970 tx=0x7fdf30008040 comp rx=0 tx=0).stop 2023-12-19T18:59:31.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.895+0000 7fdf464fe640 1 -- 172.21.15.133:0/315141913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf400c4110 msgr2=0x7fdf40152cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:31.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.895+0000 7fdf464fe640 1 --2- 172.21.15.133:0/315141913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf400c4110 0x7fdf40152cd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800eed0 tx=0x7fdf3800b480 comp rx=0 tx=0).stop 2023-12-19T18:59:31.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.895+0000 7fdf464fe640 1 -- 172.21.15.133:0/315141913 shutdown_connections 2023-12-19T18:59:31.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.895+0000 7fdf464fe640 1 --2- 172.21.15.133:0/315141913 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdf2c0664a0 0x7fdf2c068960 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.895+0000 7fdf464fe640 1 --2- 172.21.15.133:0/315141913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf400c4110 0x7fdf40152cd0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.895+0000 7fdf464fe640 1 --2- 172.21.15.133:0/315141913 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf400a5370 0x7fdf400a81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.895+0000 7fdf464fe640 1 --2- 172.21.15.133:0/315141913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf40072090 0x7fdf400a7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:31.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.895+0000 7fdf464fe640 1 -- 172.21.15.133:0/315141913 >> 172.21.15.133:0/315141913 conn(0x7fdf4006a5b0 msgr2=0x7fdf401544c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:31.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.895+0000 7fdf464fe640 1 -- 172.21.15.133:0/315141913 shutdown_connections 2023-12-19T18:59:31.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:31.895+0000 7fdf464fe640 1 -- 172.21.15.133:0/315141913 wait complete. 2023-12-19T18:59:31.922 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-12-19T18:59:30.842433+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219696,"kb_used_data":3492,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755024,"statfs":{"total":773094113280,"available":772869144576,"internally_reserved":0,"allocated":3575808,"data_stored":2051261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.989805"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.859248+0000","last_change":"2023-12-19T18:59:25.859248+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.859248+0000","last_undegraded":"2023-12-19T18:59:25.859248+0000","last_fullsized":"2023-12-19T18:59:25.859248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855787+0000","last_change":"2023-12-19T18:59:25.855787+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855787+0000","last_undegraded":"2023-12-19T18:59:25.855787+0000","last_fullsized":"2023-12-19T18:59:25.855787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.859188+0000","last_change":"2023-12-19T18:59:25.859188+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.859188+0000","last_undegraded":"2023-12-19T18:59:25.859188+0000","last_fullsized":"2023-12-19T18:59:25.859188+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.860388+0000","last_change":"2023-12-19T18:59:25.860388+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.860388+0000","last_undegraded":"2023-12-19T18:59:25.860388+0000","last_fullsized":"2023-12-19T18:59:25.860388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.856586+0000","last_change":"2023-12-19T18:59:25.856586+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.856586+0000","last_undegraded":"2023-12-19T18:59:25.856586+0000","last_fullsized":"2023-12-19T18:59:25.856586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855898+0000","last_change":"2023-12-19T18:59:25.855898+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855898+0000","last_undegraded":"2023-12-19T18:59:25.855898+0000","last_fullsized":"2023-12-19T18:59:25.855898+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.858252+0000","last_change":"2023-12-19T18:59:25.858252+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.858252+0000","last_undegraded":"2023-12-19T18:59:25.858252+0000","last_fullsized":"2023-12-19T18:59:25.858252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855397+0000","last_change":"2023-12-19T18:59:25.855397+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855397+0000","last_undegraded":"2023-12-19T18:59:25.855397+0000","last_fullsized":"2023-12-19T18:59:25.855397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.859706+0000","last_change":"2023-12-19T18:59:25.859706+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.859706+0000","last_undegraded":"2023-12-19T18:59:25.859706+0000","last_fullsized":"2023-12-19T18:59:25.859706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855292+0000","last_change":"2023-12-19T18:59:25.855292+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855292+0000","last_undegraded":"2023-12-19T18:59:25.855292+0000","last_fullsized":"2023-12-19T18:59:25.855292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.858352+0000","last_change":"2023-12-19T18:59:25.858352+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.858352+0000","last_undegraded":"2023-12-19T18:59:25.858352+0000","last_fullsized":"2023-12-19T18:59:25.858352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.858845+0000","last_change":"2023-12-19T18:59:25.858845+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.858845+0000","last_undegraded":"2023-12-19T18:59:25.858845+0000","last_fullsized":"2023-12-19T18:59:25.858845+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855286+0000","last_change":"2023-12-19T18:59:25.855286+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855286+0000","last_undegraded":"2023-12-19T18:59:25.855286+0000","last_fullsized":"2023-12-19T18:59:25.855286+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.857855+0000","last_change":"2023-12-19T18:59:25.857855+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.857855+0000","last_undegraded":"2023-12-19T18:59:25.857855+0000","last_fullsized":"2023-12-19T18:59:25.857855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.859628+0000","last_change":"2023-12-19T18:59:25.859628+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.859628+0000","last_undegraded":"2023-12-19T18:59:25.859628+0000","last_fullsized":"2023-12-19T18:59:25.859628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.858235+0000","last_change":"2023-12-19T18:59:25.858235+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.858235+0000","last_undegraded":"2023-12-19T18:59:25.858235+0000","last_fullsized":"2023-12-19T18:59:25.858235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.857813+0000","last_change":"2023-12-19T18:59:25.857813+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.857813+0000","last_undegraded":"2023-12-19T18:59:25.857813+0000","last_fullsized":"2023-12-19T18:59:25.857813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855565+0000","last_change":"2023-12-19T18:59:25.855565+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855565+0000","last_undegraded":"2023-12-19T18:59:25.855565+0000","last_fullsized":"2023-12-19T18:59:25.855565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855386+0000","last_change":"2023-12-19T18:59:25.855386+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855386+0000","last_undegraded":"2023-12-19T18:59:25.855386+0000","last_fullsized":"2023-12-19T18:59:25.855386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855708+0000","last_change":"2023-12-19T18:59:25.855708+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855708+0000","last_undegraded":"2023-12-19T18:59:25.855708+0000","last_fullsized":"2023-12-19T18:59:25.855708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855265+0000","last_change":"2023-12-19T18:59:25.855265+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855265+0000","last_undegraded":"2023-12-19T18:59:25.855265+0000","last_fullsized":"2023-12-19T18:59:25.855265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.858830+0000","last_change":"2023-12-19T18:59:25.858830+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.858830+0000","last_undegraded":"2023-12-19T18:59:25.858830+0000","last_fullsized":"2023-12-19T18:59:25.858830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.856146+0000","last_change":"2023-12-19T18:59:25.856146+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.856146+0000","last_undegraded":"2023-12-19T18:59:25.856146+0000","last_fullsized":"2023-12-19T18:59:25.856146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.858314+0000","last_change":"2023-12-19T18:59:25.858314+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.858314+0000","last_undegraded":"2023-12-19T18:59:25.858314+0000","last_fullsized":"2023-12-19T18:59:25.858314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.857217+0000","last_change":"2023-12-19T18:59:25.857217+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.857217+0000","last_undegraded":"2023-12-19T18:59:25.857217+0000","last_fullsized":"2023-12-19T18:59:25.857217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.854623+0000","last_change":"2023-12-19T18:59:25.854623+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.854623+0000","last_undegraded":"2023-12-19T18:59:25.854623+0000","last_fullsized":"2023-12-19T18:59:25.854623+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.857248+0000","last_change":"2023-12-19T18:59:25.857248+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.857248+0000","last_undegraded":"2023-12-19T18:59:25.857248+0000","last_fullsized":"2023-12-19T18:59:25.857248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.854640+0000","last_change":"2023-12-19T18:59:25.854640+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.854640+0000","last_undegraded":"2023-12-19T18:59:25.854640+0000","last_fullsized":"2023-12-19T18:59:25.854640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.857430+0000","last_change":"2023-12-19T18:59:25.857430+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.857430+0000","last_undegraded":"2023-12-19T18:59:25.857430+0000","last_fullsized":"2023-12-19T18:59:25.857430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855253+0000","last_change":"2023-12-19T18:59:25.855253+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855253+0000","last_undegraded":"2023-12-19T18:59:25.855253+0000","last_fullsized":"2023-12-19T18:59:25.855253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.858722+0000","last_change":"2023-12-19T18:59:25.858722+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.858722+0000","last_undegraded":"2023-12-19T18:59:25.858722+0000","last_fullsized":"2023-12-19T18:59:25.858722+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.859771+0000","last_change":"2023-12-19T18:59:25.859771+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.859771+0000","last_undegraded":"2023-12-19T18:59:25.859771+0000","last_fullsized":"2023-12-19T18:59:25.859771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-19T18:59:21.758920+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T18:59:21.758920+0000","last_peered":"2023-12-19T18:59:21.758920+0000","last_clean":"2023-12-19T18:59:21.758920+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T18:59:21.758920+0000","last_undegraded":"2023-12-19T18:59:21.758920+0000","last_fullsized":"2023-12-19T18:59:21.758920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":892928,"data_stored":699311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":698292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T18:59:31.927 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T18:59:32.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfd0d57640 1 Processor -- start 2023-12-19T18:59:32.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfd0d57640 1 -- start start 2023-12-19T18:59:32.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfd0d57640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfcc072090 0x7fcfcc150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:32.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfd0d57640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfcc0c2760 con 0x7fcfcc0a5370 2023-12-19T18:59:32.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfd0d57640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfcc0a5750 con 0x7fcfcc0725c0 2023-12-19T18:59:32.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfd0d57640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc0c3070 con 0x7fcfcc072090 2023-12-19T18:59:32.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfca59c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcfcc0a5370 0x7fcfcc0c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37382/0 (socket says 172.21.15.133:37382) 2023-12-19T18:59:32.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfca59c640 1 -- 172.21.15.133:0/4037760583 learned_addr learned my addr 172.21.15.133:0/4037760583 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:32.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfc9d9b640 1 --2- 172.21.15.133:0/4037760583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfcc072090 0x7fcfcc150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:32.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfc959a640 1 -- 172.21.15.133:0/4037760583 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529018363 0 0) 0x7fcfcc0c2760 con 0x7fcfcc0a5370 2023-12-19T18:59:32.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfc959a640 1 -- 172.21.15.133:0/4037760583 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfb4003530 con 0x7fcfcc0a5370 2023-12-19T18:59:32.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfc959a640 1 -- 172.21.15.133:0/4037760583 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2439261431 0 0) 0x7fcfcc0a5750 con 0x7fcfcc0725c0 2023-12-19T18:59:32.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfc959a640 1 -- 172.21.15.133:0/4037760583 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfcc0c2760 con 0x7fcfcc0725c0 2023-12-19T18:59:32.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfc959a640 1 -- 172.21.15.133:0/4037760583 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3148473245 0 0) 0x7fcfb4003530 con 0x7fcfcc0a5370 2023-12-19T18:59:32.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfc959a640 1 -- 172.21.15.133:0/4037760583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfcc072090 msgr2=0x7fcfcc150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:32.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfc959a640 1 --2- 172.21.15.133:0/4037760583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfcc072090 0x7fcfcc150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfc959a640 1 -- 172.21.15.133:0/4037760583 >> v1:172.21.15.138:6789/0 conn(0x7fcfcc0725c0 legacy=0x7fcfcc1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:32.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfc959a640 1 -- 172.21.15.133:0/4037760583 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc0aad20 con 0x7fcfcc0a5370 2023-12-19T18:59:32.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfc959a640 1 -- 172.21.15.133:0/4037760583 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7fcfbc001680 con 0x7fcfcc0a5370 2023-12-19T18:59:32.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfc959a640 1 -- 172.21.15.133:0/4037760583 >> v1:172.21.15.133:6789/0 conn(0x7fcfcc0a5370 legacy=0x7fcfcc0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:32.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfc959a640 1 --2- 172.21.15.133:0/4037760583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfb4003b40 0x7fcfb4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:32.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfc959a640 1 --2- 172.21.15.133:0/4037760583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfcc072090 0x7fcfb40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:32.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfc959a640 1 --2- 172.21.15.133:0/4037760583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb4004d10 0x7fcfb4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:32.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfc959a640 1 -- 172.21.15.133:0/4037760583 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc0c3070 con 0x7fcfb4003b40 2023-12-19T18:59:32.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfc959a640 1 -- 172.21.15.133:0/4037760583 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb400bba0 con 0x7fcfb4004d10 2023-12-19T18:59:32.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfc959a640 1 -- 172.21.15.133:0/4037760583 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb400df70 con 0x7fcfcc072090 2023-12-19T18:59:32.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfca59c640 1 --2- 172.21.15.133:0/4037760583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfb4003b40 0x7fcfb4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:32.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfc9d9b640 1 --2- 172.21.15.133:0/4037760583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfcc072090 0x7fcfb40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:32.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfcad9d640 1 --2- 172.21.15.133:0/4037760583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb4004d10 0x7fcfb4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:32.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfca59c640 1 -- 172.21.15.133:0/4037760583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfcc072090 msgr2=0x7fcfb40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:32.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfca59c640 1 --2- 172.21.15.133:0/4037760583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfcc072090 0x7fcfb40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfca59c640 1 -- 172.21.15.133:0/4037760583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb4004d10 msgr2=0x7fcfb4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:32.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfca59c640 1 --2- 172.21.15.133:0/4037760583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb4004d10 0x7fcfb4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfca59c640 1 -- 172.21.15.133:0/4037760583 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb4003530 con 0x7fcfb4003b40 2023-12-19T18:59:32.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.099+0000 7fcfc9d9b640 1 --2- 172.21.15.133:0/4037760583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfcc072090 0x7fcfb40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:59:32.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.103+0000 7fcfca59c640 1 --2- 172.21.15.133:0/4037760583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfb4003b40 0x7fcfb4003f40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc007f90 tx=0x7fcfbc01cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf8534f126d470b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:32.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.103+0000 7fcfc959a640 1 -- 172.21.15.133:0/4037760583 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc005ba0 con 0x7fcfb4003b40 2023-12-19T18:59:32.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.103+0000 7fcfc959a640 1 -- 172.21.15.133:0/4037760583 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfbc005d20 con 0x7fcfb4003b40 2023-12-19T18:59:32.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.103+0000 7fcfc959a640 1 -- 172.21.15.133:0/4037760583 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc0072b0 con 0x7fcfb4003b40 2023-12-19T18:59:32.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.103+0000 7fcfd0d57640 1 -- 172.21.15.133:0/4037760583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfb4003b40 msgr2=0x7fcfb4003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:32.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.103+0000 7fcfd0d57640 1 --2- 172.21.15.133:0/4037760583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfb4003b40 0x7fcfb4003f40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc007f90 tx=0x7fcfbc01cb00 comp rx=0 tx=0).stop 2023-12-19T18:59:32.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.103+0000 7fcfcad9d640 1 -- 172.21.15.133:0/4037760583 reap_dead start 2023-12-19T18:59:32.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.103+0000 7fcfd0d57640 1 -- 172.21.15.133:0/4037760583 shutdown_connections 2023-12-19T18:59:32.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.103+0000 7fcfd0d57640 1 -- 172.21.15.133:0/4037760583 >> 172.21.15.133:0/4037760583 conn(0x7fcfcc06a5b0 msgr2=0x7fcfcc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:32.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.103+0000 7fcfd0d57640 1 -- 172.21.15.133:0/4037760583 shutdown_connections 2023-12-19T18:59:32.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.103+0000 7fcfd0d57640 1 -- 172.21.15.133:0/4037760583 wait complete. 2023-12-19T18:59:32.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfd0d57640 1 Processor -- start 2023-12-19T18:59:32.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfd0d57640 1 -- start start 2023-12-19T18:59:32.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfd0d57640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb4003b40 0x7fcfcc1523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:32.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfd0d57640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfcc1e8940 0x7fcfcc14bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:32.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfd0d57640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfcc0a8e40 0x7fcfcc14c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:32.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfd0d57640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc06fe50 con 0x7fcfcc1e8940 2023-12-19T18:59:32.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfd0d57640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc14c740 con 0x7fcfb4003b40 2023-12-19T18:59:32.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfd0d57640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc1e8eb0 con 0x7fcfcc0a8e40 2023-12-19T18:59:32.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfc9d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfcc1e8940 0x7fcfcc14bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:32.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfc9d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfcc1e8940 0x7fcfcc14bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42280/0 (socket says 172.21.15.133:42280) 2023-12-19T18:59:32.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfc9d9b640 1 -- 172.21.15.133:0/519044471 learned_addr learned my addr 172.21.15.133:0/519044471 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:32.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfca59c640 1 --2- 172.21.15.133:0/519044471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb4003b40 0x7fcfcc1523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:32.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfcad9d640 1 --2- 172.21.15.133:0/519044471 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfcc0a8e40 0x7fcfcc14c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:32.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfc9d9b640 1 -- 172.21.15.133:0/519044471 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfcc0a8e40 msgr2=0x7fcfcc14c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:32.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfc9d9b640 1 --2- 172.21.15.133:0/519044471 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfcc0a8e40 0x7fcfcc14c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfc9d9b640 1 -- 172.21.15.133:0/519044471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb4003b40 msgr2=0x7fcfcc1523c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:32.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfc9d9b640 1 --2- 172.21.15.133:0/519044471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb4003b40 0x7fcfcc1523c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfc9d9b640 1 -- 172.21.15.133:0/519044471 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc1e9190 con 0x7fcfcc1e8940 2023-12-19T18:59:32.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfc9d9b640 1 --2- 172.21.15.133:0/519044471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfcc1e8940 0x7fcfcc14bcc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0011ca0 tx=0x7fcfc000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:32.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfbaffd640 1 -- 172.21.15.133:0/519044471 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc000fd20 con 0x7fcfcc1e8940 2023-12-19T18:59:32.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfbaffd640 1 -- 172.21.15.133:0/519044471 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfc000fe80 con 0x7fcfcc1e8940 2023-12-19T18:59:32.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfbaffd640 1 -- 172.21.15.133:0/519044471 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfc0004260 con 0x7fcfcc1e8940 2023-12-19T18:59:32.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfd0d57640 1 -- 172.21.15.133:0/519044471 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfcc1e9470 con 0x7fcfcc1e8940 2023-12-19T18:59:32.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.107+0000 7fcfd0d57640 1 -- 172.21.15.133:0/519044471 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfcc152900 con 0x7fcfcc1e8940 2023-12-19T18:59:32.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.111+0000 7fcfd0d57640 1 -- 172.21.15.133:0/519044471 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfcc068400 con 0x7fcfcc1e8940 2023-12-19T18:59:32.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.111+0000 7fcfbaffd640 1 -- 172.21.15.133:0/519044471 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fcfc00043c0 con 0x7fcfcc1e8940 2023-12-19T18:59:32.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.111+0000 7fcfbaffd640 1 --2- 172.21.15.133:0/519044471 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcfac0664a0 0x7fcfac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:32.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.111+0000 7fcfbaffd640 1 -- 172.21.15.133:0/519044471 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfc0084480 con 0x7fcfcc1e8940 2023-12-19T18:59:32.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.111+0000 7fcfca59c640 1 --2- 172.21.15.133:0/519044471 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcfac0664a0 0x7fcfac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:32.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.111+0000 7fcfca59c640 1 --2- 172.21.15.133:0/519044471 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcfac0664a0 0x7fcfac068960 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0ab000 tx=0x7fcfbc0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:32.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.115+0000 7fcfbaffd640 1 -- 172.21.15.133:0/519044471 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fcfc0051a40 con 0x7fcfcc1e8940 2023-12-19T18:59:32.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.263+0000 7fcfd0d57640 1 -- 172.21.15.133:0/519044471 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcfcc15c500 con 0x7fcfac0664a0 2023-12-19T18:59:32.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.275+0000 7fcfbaffd640 1 -- 172.21.15.133:0/519044471 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252545 (secure 0 0 0) 0x7fcfbc0b5040 con 0x7fcfac0664a0 2023-12-19T18:59:32.279 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:32.281 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T18:59:32.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.275+0000 7fcfd0d57640 1 -- 172.21.15.133:0/519044471 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcfac0664a0 msgr2=0x7fcfac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:32.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.275+0000 7fcfd0d57640 1 --2- 172.21.15.133:0/519044471 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcfac0664a0 0x7fcfac068960 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0ab000 tx=0x7fcfbc0a7070 comp rx=0 tx=0).stop 2023-12-19T18:59:32.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.275+0000 7fcfd0d57640 1 -- 172.21.15.133:0/519044471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfcc1e8940 msgr2=0x7fcfcc14bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:32.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.275+0000 7fcfd0d57640 1 --2- 172.21.15.133:0/519044471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfcc1e8940 0x7fcfcc14bcc0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcfc0011ca0 tx=0x7fcfc000f610 comp rx=0 tx=0).stop 2023-12-19T18:59:32.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.275+0000 7fcfd0d57640 1 -- 172.21.15.133:0/519044471 shutdown_connections 2023-12-19T18:59:32.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.275+0000 7fcfd0d57640 1 --2- 172.21.15.133:0/519044471 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcfac0664a0 0x7fcfac068960 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.275+0000 7fcfd0d57640 1 --2- 172.21.15.133:0/519044471 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfcc0a8e40 0x7fcfcc14c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.275+0000 7fcfd0d57640 1 --2- 172.21.15.133:0/519044471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfcc1e8940 0x7fcfcc14bcc0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.275+0000 7fcfd0d57640 1 --2- 172.21.15.133:0/519044471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb4003b40 0x7fcfcc1523c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.275+0000 7fcfd0d57640 1 -- 172.21.15.133:0/519044471 >> 172.21.15.133:0/519044471 conn(0x7fcfcc06a5b0 msgr2=0x7fcfcc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:32.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.275+0000 7fcfd0d57640 1 -- 172.21.15.133:0/519044471 shutdown_connections 2023-12-19T18:59:32.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.275+0000 7fcfd0d57640 1 -- 172.21.15.133:0/519044471 wait complete. 2023-12-19T18:59:32.299 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-12-19T18:59:30.842433+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219696,"kb_used_data":3492,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755024,"statfs":{"total":773094113280,"available":772869144576,"internally_reserved":0,"allocated":3575808,"data_stored":2051261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.989805"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.859248+0000","last_change":"2023-12-19T18:59:25.859248+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.859248+0000","last_undegraded":"2023-12-19T18:59:25.859248+0000","last_fullsized":"2023-12-19T18:59:25.859248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855787+0000","last_change":"2023-12-19T18:59:25.855787+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855787+0000","last_undegraded":"2023-12-19T18:59:25.855787+0000","last_fullsized":"2023-12-19T18:59:25.855787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.859188+0000","last_change":"2023-12-19T18:59:25.859188+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.859188+0000","last_undegraded":"2023-12-19T18:59:25.859188+0000","last_fullsized":"2023-12-19T18:59:25.859188+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.860388+0000","last_change":"2023-12-19T18:59:25.860388+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.860388+0000","last_undegraded":"2023-12-19T18:59:25.860388+0000","last_fullsized":"2023-12-19T18:59:25.860388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.856586+0000","last_change":"2023-12-19T18:59:25.856586+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.856586+0000","last_undegraded":"2023-12-19T18:59:25.856586+0000","last_fullsized":"2023-12-19T18:59:25.856586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855898+0000","last_change":"2023-12-19T18:59:25.855898+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855898+0000","last_undegraded":"2023-12-19T18:59:25.855898+0000","last_fullsized":"2023-12-19T18:59:25.855898+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.858252+0000","last_change":"2023-12-19T18:59:25.858252+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.858252+0000","last_undegraded":"2023-12-19T18:59:25.858252+0000","last_fullsized":"2023-12-19T18:59:25.858252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855397+0000","last_change":"2023-12-19T18:59:25.855397+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855397+0000","last_undegraded":"2023-12-19T18:59:25.855397+0000","last_fullsized":"2023-12-19T18:59:25.855397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.859706+0000","last_change":"2023-12-19T18:59:25.859706+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.859706+0000","last_undegraded":"2023-12-19T18:59:25.859706+0000","last_fullsized":"2023-12-19T18:59:25.859706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855292+0000","last_change":"2023-12-19T18:59:25.855292+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855292+0000","last_undegraded":"2023-12-19T18:59:25.855292+0000","last_fullsized":"2023-12-19T18:59:25.855292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.858352+0000","last_change":"2023-12-19T18:59:25.858352+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.858352+0000","last_undegraded":"2023-12-19T18:59:25.858352+0000","last_fullsized":"2023-12-19T18:59:25.858352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.858845+0000","last_change":"2023-12-19T18:59:25.858845+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.858845+0000","last_undegraded":"2023-12-19T18:59:25.858845+0000","last_fullsized":"2023-12-19T18:59:25.858845+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855286+0000","last_change":"2023-12-19T18:59:25.855286+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855286+0000","last_undegraded":"2023-12-19T18:59:25.855286+0000","last_fullsized":"2023-12-19T18:59:25.855286+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.857855+0000","last_change":"2023-12-19T18:59:25.857855+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.857855+0000","last_undegraded":"2023-12-19T18:59:25.857855+0000","last_fullsized":"2023-12-19T18:59:25.857855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.859628+0000","last_change":"2023-12-19T18:59:25.859628+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.859628+0000","last_undegraded":"2023-12-19T18:59:25.859628+0000","last_fullsized":"2023-12-19T18:59:25.859628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.858235+0000","last_change":"2023-12-19T18:59:25.858235+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.858235+0000","last_undegraded":"2023-12-19T18:59:25.858235+0000","last_fullsized":"2023-12-19T18:59:25.858235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.857813+0000","last_change":"2023-12-19T18:59:25.857813+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.857813+0000","last_undegraded":"2023-12-19T18:59:25.857813+0000","last_fullsized":"2023-12-19T18:59:25.857813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855565+0000","last_change":"2023-12-19T18:59:25.855565+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855565+0000","last_undegraded":"2023-12-19T18:59:25.855565+0000","last_fullsized":"2023-12-19T18:59:25.855565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855386+0000","last_change":"2023-12-19T18:59:25.855386+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855386+0000","last_undegraded":"2023-12-19T18:59:25.855386+0000","last_fullsized":"2023-12-19T18:59:25.855386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855708+0000","last_change":"2023-12-19T18:59:25.855708+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855708+0000","last_undegraded":"2023-12-19T18:59:25.855708+0000","last_fullsized":"2023-12-19T18:59:25.855708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855265+0000","last_change":"2023-12-19T18:59:25.855265+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855265+0000","last_undegraded":"2023-12-19T18:59:25.855265+0000","last_fullsized":"2023-12-19T18:59:25.855265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.858830+0000","last_change":"2023-12-19T18:59:25.858830+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.858830+0000","last_undegraded":"2023-12-19T18:59:25.858830+0000","last_fullsized":"2023-12-19T18:59:25.858830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.856146+0000","last_change":"2023-12-19T18:59:25.856146+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.856146+0000","last_undegraded":"2023-12-19T18:59:25.856146+0000","last_fullsized":"2023-12-19T18:59:25.856146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.858314+0000","last_change":"2023-12-19T18:59:25.858314+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.858314+0000","last_undegraded":"2023-12-19T18:59:25.858314+0000","last_fullsized":"2023-12-19T18:59:25.858314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.857217+0000","last_change":"2023-12-19T18:59:25.857217+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.857217+0000","last_undegraded":"2023-12-19T18:59:25.857217+0000","last_fullsized":"2023-12-19T18:59:25.857217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.854623+0000","last_change":"2023-12-19T18:59:25.854623+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.854623+0000","last_undegraded":"2023-12-19T18:59:25.854623+0000","last_fullsized":"2023-12-19T18:59:25.854623+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.857248+0000","last_change":"2023-12-19T18:59:25.857248+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.857248+0000","last_undegraded":"2023-12-19T18:59:25.857248+0000","last_fullsized":"2023-12-19T18:59:25.857248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.854640+0000","last_change":"2023-12-19T18:59:25.854640+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.854640+0000","last_undegraded":"2023-12-19T18:59:25.854640+0000","last_fullsized":"2023-12-19T18:59:25.854640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.857430+0000","last_change":"2023-12-19T18:59:25.857430+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.857430+0000","last_undegraded":"2023-12-19T18:59:25.857430+0000","last_fullsized":"2023-12-19T18:59:25.857430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855253+0000","last_change":"2023-12-19T18:59:25.855253+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855253+0000","last_undegraded":"2023-12-19T18:59:25.855253+0000","last_fullsized":"2023-12-19T18:59:25.855253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.858722+0000","last_change":"2023-12-19T18:59:25.858722+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.858722+0000","last_undegraded":"2023-12-19T18:59:25.858722+0000","last_fullsized":"2023-12-19T18:59:25.858722+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.859771+0000","last_change":"2023-12-19T18:59:25.859771+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.859771+0000","last_undegraded":"2023-12-19T18:59:25.859771+0000","last_fullsized":"2023-12-19T18:59:25.859771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-19T18:59:21.758920+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T18:59:21.758920+0000","last_peered":"2023-12-19T18:59:21.758920+0000","last_clean":"2023-12-19T18:59:21.758920+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T18:59:21.758920+0000","last_undegraded":"2023-12-19T18:59:21.758920+0000","last_fullsized":"2023-12-19T18:59:21.758920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":892928,"data_stored":699311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":698292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T18:59:32.303 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T18:59:32.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.475+0000 7f8d3a72a640 1 Processor -- start 2023-12-19T18:59:32.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.475+0000 7f8d3a72a640 1 -- start start 2023-12-19T18:59:32.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.475+0000 7f8d3a72a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d340c7ea0 0x7f8d3406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:32.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.475+0000 7f8d3a72a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8d3406b9e0 0x7f8d3415f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:32.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.475+0000 7f8d3a72a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d3406c860 con 0x7f8d34151e90 2023-12-19T18:59:32.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.475+0000 7f8d3a72a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d340c8750 con 0x7f8d3406b9e0 2023-12-19T18:59:32.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.475+0000 7f8d3a72a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d341552d0 con 0x7f8d340c7ea0 2023-12-19T18:59:32.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.475+0000 7f8d38cc7640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8d3406b9e0 0x7f8d3415f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:32.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.475+0000 7f8d33fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8d34151e90 0x7f8d340c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:37392/0 (socket says 172.21.15.133:37392) 2023-12-19T18:59:32.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.475+0000 7f8d33fff640 1 -- 172.21.15.133:0/3852495975 learned_addr learned my addr 172.21.15.133:0/3852495975 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:32.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.475+0000 7f8d337fe640 1 --2- 172.21.15.133:0/3852495975 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d340c7ea0 0x7f8d3406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:32.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.475+0000 7f8d38cc7640 1 -- 172.21.15.133:0/3852495975 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d340c7ea0 msgr2=0x7f8d3406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:32.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.475+0000 7f8d38cc7640 1 --2- 172.21.15.133:0/3852495975 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d340c7ea0 0x7f8d3406b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.475+0000 7f8d38cc7640 1 -- 172.21.15.133:0/3852495975 >> v1:172.21.15.133:6789/0 conn(0x7f8d34151e90 legacy=0x7f8d340c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:32.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.475+0000 7f8d38cc7640 1 -- 172.21.15.133:0/3852495975 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d34154930 con 0x7f8d3406b9e0 2023-12-19T18:59:32.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.475+0000 7f8d32ffd640 1 -- 172.21.15.133:0/3852495975 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3301791460 0 0) 0x7f8d3406c860 con 0x7f8d34151e90 2023-12-19T18:59:32.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.479+0000 7f8d38cc7640 1 --2- 172.21.15.133:0/3852495975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d3406b9e0 0x7f8d3415f0a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c009d90 tx=0x7f8d2c01c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc00685b2d9eaf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:32.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.479+0000 7f8d32ffd640 1 -- 172.21.15.133:0/3852495975 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c0a6700 con 0x7f8d3406b9e0 2023-12-19T18:59:32.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.479+0000 7f8d32ffd640 1 -- 172.21.15.133:0/3852495975 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d2c0a6860 con 0x7f8d3406b9e0 2023-12-19T18:59:32.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.479+0000 7f8d32ffd640 1 -- 172.21.15.133:0/3852495975 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c0a6bf0 con 0x7f8d3406b9e0 2023-12-19T18:59:32.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.479+0000 7f8d3a72a640 1 -- 172.21.15.133:0/3852495975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d3406b9e0 msgr2=0x7f8d3415f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:32.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.479+0000 7f8d3a72a640 1 --2- 172.21.15.133:0/3852495975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d3406b9e0 0x7f8d3415f0a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c009d90 tx=0x7f8d2c01c830 comp rx=0 tx=0).stop 2023-12-19T18:59:32.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.479+0000 7f8d3a72a640 1 -- 172.21.15.133:0/3852495975 shutdown_connections 2023-12-19T18:59:32.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.479+0000 7f8d3a72a640 1 --2- 172.21.15.133:0/3852495975 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d3406b9e0 0x7f8d3415f0a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.479+0000 7f8d3a72a640 1 --2- 172.21.15.133:0/3852495975 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d340c7ea0 0x7f8d3406b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.479+0000 7f8d3a72a640 1 -- 172.21.15.133:0/3852495975 >> 172.21.15.133:0/3852495975 conn(0x7f8d340ca170 msgr2=0x7f8d340ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:32.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.479+0000 7f8d3a72a640 1 -- 172.21.15.133:0/3852495975 shutdown_connections 2023-12-19T18:59:32.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.479+0000 7f8d3a72a640 1 -- 172.21.15.133:0/3852495975 wait complete. 2023-12-19T18:59:32.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.479+0000 7f8d3a72a640 1 Processor -- start 2023-12-19T18:59:32.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.479+0000 7f8d3a72a640 1 -- start start 2023-12-19T18:59:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d3a72a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d3406b9e0 0x7f8d3414c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d3a72a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d340c7ea0 0x7f8d34143300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d3a72a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d34151e90 0x7f8d34143840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d3a72a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d341f0f90 con 0x7f8d3406b9e0 2023-12-19T18:59:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d3a72a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3414c160 con 0x7f8d34151e90 2023-12-19T18:59:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d3a72a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d341f0380 con 0x7f8d340c7ea0 2023-12-19T18:59:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d33fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d3406b9e0 0x7f8d3414c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d33fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d3406b9e0 0x7f8d3414c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42298/0 (socket says 172.21.15.133:42298) 2023-12-19T18:59:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d33fff640 1 -- 172.21.15.133:0/2433711283 learned_addr learned my addr 172.21.15.133:0/2433711283 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d337fe640 1 --2- 172.21.15.133:0/2433711283 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d340c7ea0 0x7f8d34143300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d33fff640 1 -- 172.21.15.133:0/2433711283 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d340c7ea0 msgr2=0x7f8d34143300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d38cc7640 1 --2- 172.21.15.133:0/2433711283 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d34151e90 0x7f8d34143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:32.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d33fff640 1 --2- 172.21.15.133:0/2433711283 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d340c7ea0 0x7f8d34143300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d33fff640 1 -- 172.21.15.133:0/2433711283 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d34151e90 msgr2=0x7f8d34143840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:32.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d33fff640 1 --2- 172.21.15.133:0/2433711283 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d34151e90 0x7f8d34143840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d33fff640 1 -- 172.21.15.133:0/2433711283 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2c009a70 con 0x7f8d3406b9e0 2023-12-19T18:59:32.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d38cc7640 1 --2- 172.21.15.133:0/2433711283 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d34151e90 0x7f8d34143840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:32.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d33fff640 1 --2- 172.21.15.133:0/2433711283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d3406b9e0 0x7f8d3414c5f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8d240011f0 tx=0x7f8d2400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:32.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d30ff9640 1 -- 172.21.15.133:0/2433711283 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d240074e0 con 0x7f8d3406b9e0 2023-12-19T18:59:32.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d30ff9640 1 -- 172.21.15.133:0/2433711283 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d24007640 con 0x7f8d3406b9e0 2023-12-19T18:59:32.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d30ff9640 1 -- 172.21.15.133:0/2433711283 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d24004a10 con 0x7f8d3406b9e0 2023-12-19T18:59:32.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d3a72a640 1 -- 172.21.15.133:0/2433711283 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d341f0660 con 0x7f8d3406b9e0 2023-12-19T18:59:32.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d3a72a640 1 -- 172.21.15.133:0/2433711283 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d341f0c20 con 0x7f8d3406b9e0 2023-12-19T18:59:32.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.483+0000 7f8d3a72a640 1 -- 172.21.15.133:0/2433711283 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d34068400 con 0x7f8d3406b9e0 2023-12-19T18:59:32.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.487+0000 7f8d30ff9640 1 -- 172.21.15.133:0/2433711283 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8d24004b70 con 0x7f8d3406b9e0 2023-12-19T18:59:32.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.487+0000 7f8d30ff9640 1 --2- 172.21.15.133:0/2433711283 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8d20066470 0x7f8d20068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:32.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.487+0000 7f8d30ff9640 1 -- 172.21.15.133:0/2433711283 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d24083150 con 0x7f8d3406b9e0 2023-12-19T18:59:32.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.487+0000 7f8d337fe640 1 --2- 172.21.15.133:0/2433711283 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8d20066470 0x7f8d20068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:32.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.487+0000 7f8d337fe640 1 --2- 172.21.15.133:0/2433711283 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8d20066470 0x7f8d20068930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8d340acaf0 tx=0x7f8d28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:32.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.491+0000 7f8d30ff9640 1 -- 172.21.15.133:0/2433711283 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8d240505c0 con 0x7f8d3406b9e0 2023-12-19T18:59:32.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.639+0000 7f8d3a72a640 1 -- 172.21.15.133:0/2433711283 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8d341556f0 con 0x7f8d20066470 2023-12-19T18:59:32.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.647+0000 7f8d30ff9640 1 -- 172.21.15.133:0/2433711283 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252545 (secure 0 0 0) 0x7f8d28009600 con 0x7f8d20066470 2023-12-19T18:59:32.653 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:32.654 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T18:59:32.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.647+0000 7f8d3a72a640 1 -- 172.21.15.133:0/2433711283 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8d20066470 msgr2=0x7f8d20068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:32.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.647+0000 7f8d3a72a640 1 --2- 172.21.15.133:0/2433711283 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8d20066470 0x7f8d20068930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8d340acaf0 tx=0x7f8d28008040 comp rx=0 tx=0).stop 2023-12-19T18:59:32.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.647+0000 7f8d3a72a640 1 -- 172.21.15.133:0/2433711283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d3406b9e0 msgr2=0x7f8d3414c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:32.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.647+0000 7f8d3a72a640 1 --2- 172.21.15.133:0/2433711283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d3406b9e0 0x7f8d3414c5f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8d240011f0 tx=0x7f8d2400c9b0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.647+0000 7f8d3a72a640 1 -- 172.21.15.133:0/2433711283 shutdown_connections 2023-12-19T18:59:32.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.647+0000 7f8d3a72a640 1 --2- 172.21.15.133:0/2433711283 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8d20066470 0x7f8d20068930 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.647+0000 7f8d3a72a640 1 --2- 172.21.15.133:0/2433711283 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d34151e90 0x7f8d34143840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.647+0000 7f8d3a72a640 1 --2- 172.21.15.133:0/2433711283 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d340c7ea0 0x7f8d34143300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.647+0000 7f8d3a72a640 1 --2- 172.21.15.133:0/2433711283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d3406b9e0 0x7f8d3414c5f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.647+0000 7f8d3a72a640 1 -- 172.21.15.133:0/2433711283 >> 172.21.15.133:0/2433711283 conn(0x7f8d340ca170 msgr2=0x7f8d340c69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:32.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.651+0000 7f8d3a72a640 1 -- 172.21.15.133:0/2433711283 shutdown_connections 2023-12-19T18:59:32.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.651+0000 7f8d3a72a640 1 -- 172.21.15.133:0/2433711283 wait complete. 2023-12-19T18:59:32.673 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2023-12-19T18:59:30.842433+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219696,"kb_used_data":3492,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755024,"statfs":{"total":773094113280,"available":772869144576,"internally_reserved":0,"allocated":3575808,"data_stored":2051261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.989805"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.859248+0000","last_change":"2023-12-19T18:59:25.859248+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.859248+0000","last_undegraded":"2023-12-19T18:59:25.859248+0000","last_fullsized":"2023-12-19T18:59:25.859248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855787+0000","last_change":"2023-12-19T18:59:25.855787+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855787+0000","last_undegraded":"2023-12-19T18:59:25.855787+0000","last_fullsized":"2023-12-19T18:59:25.855787+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.859188+0000","last_change":"2023-12-19T18:59:25.859188+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.859188+0000","last_undegraded":"2023-12-19T18:59:25.859188+0000","last_fullsized":"2023-12-19T18:59:25.859188+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.860388+0000","last_change":"2023-12-19T18:59:25.860388+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.860388+0000","last_undegraded":"2023-12-19T18:59:25.860388+0000","last_fullsized":"2023-12-19T18:59:25.860388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.856586+0000","last_change":"2023-12-19T18:59:25.856586+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.856586+0000","last_undegraded":"2023-12-19T18:59:25.856586+0000","last_fullsized":"2023-12-19T18:59:25.856586+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855898+0000","last_change":"2023-12-19T18:59:25.855898+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855898+0000","last_undegraded":"2023-12-19T18:59:25.855898+0000","last_fullsized":"2023-12-19T18:59:25.855898+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.858252+0000","last_change":"2023-12-19T18:59:25.858252+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.858252+0000","last_undegraded":"2023-12-19T18:59:25.858252+0000","last_fullsized":"2023-12-19T18:59:25.858252+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855397+0000","last_change":"2023-12-19T18:59:25.855397+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855397+0000","last_undegraded":"2023-12-19T18:59:25.855397+0000","last_fullsized":"2023-12-19T18:59:25.855397+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.859706+0000","last_change":"2023-12-19T18:59:25.859706+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.859706+0000","last_undegraded":"2023-12-19T18:59:25.859706+0000","last_fullsized":"2023-12-19T18:59:25.859706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855292+0000","last_change":"2023-12-19T18:59:25.855292+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855292+0000","last_undegraded":"2023-12-19T18:59:25.855292+0000","last_fullsized":"2023-12-19T18:59:25.855292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.858352+0000","last_change":"2023-12-19T18:59:25.858352+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.858352+0000","last_undegraded":"2023-12-19T18:59:25.858352+0000","last_fullsized":"2023-12-19T18:59:25.858352+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.858845+0000","last_change":"2023-12-19T18:59:25.858845+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.858845+0000","last_undegraded":"2023-12-19T18:59:25.858845+0000","last_fullsized":"2023-12-19T18:59:25.858845+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855286+0000","last_change":"2023-12-19T18:59:25.855286+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855286+0000","last_undegraded":"2023-12-19T18:59:25.855286+0000","last_fullsized":"2023-12-19T18:59:25.855286+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.857855+0000","last_change":"2023-12-19T18:59:25.857855+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.857855+0000","last_undegraded":"2023-12-19T18:59:25.857855+0000","last_fullsized":"2023-12-19T18:59:25.857855+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.859628+0000","last_change":"2023-12-19T18:59:25.859628+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.859628+0000","last_undegraded":"2023-12-19T18:59:25.859628+0000","last_fullsized":"2023-12-19T18:59:25.859628+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.858235+0000","last_change":"2023-12-19T18:59:25.858235+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.858235+0000","last_undegraded":"2023-12-19T18:59:25.858235+0000","last_fullsized":"2023-12-19T18:59:25.858235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.857813+0000","last_change":"2023-12-19T18:59:25.857813+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.857813+0000","last_undegraded":"2023-12-19T18:59:25.857813+0000","last_fullsized":"2023-12-19T18:59:25.857813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855565+0000","last_change":"2023-12-19T18:59:25.855565+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855565+0000","last_undegraded":"2023-12-19T18:59:25.855565+0000","last_fullsized":"2023-12-19T18:59:25.855565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855386+0000","last_change":"2023-12-19T18:59:25.855386+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855386+0000","last_undegraded":"2023-12-19T18:59:25.855386+0000","last_fullsized":"2023-12-19T18:59:25.855386+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855708+0000","last_change":"2023-12-19T18:59:25.855708+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855708+0000","last_undegraded":"2023-12-19T18:59:25.855708+0000","last_fullsized":"2023-12-19T18:59:25.855708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855265+0000","last_change":"2023-12-19T18:59:25.855265+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855265+0000","last_undegraded":"2023-12-19T18:59:25.855265+0000","last_fullsized":"2023-12-19T18:59:25.855265+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.858830+0000","last_change":"2023-12-19T18:59:25.858830+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.858830+0000","last_undegraded":"2023-12-19T18:59:25.858830+0000","last_fullsized":"2023-12-19T18:59:25.858830+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.856146+0000","last_change":"2023-12-19T18:59:25.856146+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.856146+0000","last_undegraded":"2023-12-19T18:59:25.856146+0000","last_fullsized":"2023-12-19T18:59:25.856146+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.858314+0000","last_change":"2023-12-19T18:59:25.858314+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.858314+0000","last_undegraded":"2023-12-19T18:59:25.858314+0000","last_fullsized":"2023-12-19T18:59:25.858314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.857217+0000","last_change":"2023-12-19T18:59:25.857217+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.857217+0000","last_undegraded":"2023-12-19T18:59:25.857217+0000","last_fullsized":"2023-12-19T18:59:25.857217+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.854623+0000","last_change":"2023-12-19T18:59:25.854623+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.854623+0000","last_undegraded":"2023-12-19T18:59:25.854623+0000","last_fullsized":"2023-12-19T18:59:25.854623+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.857248+0000","last_change":"2023-12-19T18:59:25.857248+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.857248+0000","last_undegraded":"2023-12-19T18:59:25.857248+0000","last_fullsized":"2023-12-19T18:59:25.857248+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.854640+0000","last_change":"2023-12-19T18:59:25.854640+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.854640+0000","last_undegraded":"2023-12-19T18:59:25.854640+0000","last_fullsized":"2023-12-19T18:59:25.854640+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.857430+0000","last_change":"2023-12-19T18:59:25.857430+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.857430+0000","last_undegraded":"2023-12-19T18:59:25.857430+0000","last_fullsized":"2023-12-19T18:59:25.857430+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.855253+0000","last_change":"2023-12-19T18:59:25.855253+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.855253+0000","last_undegraded":"2023-12-19T18:59:25.855253+0000","last_fullsized":"2023-12-19T18:59:25.855253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.858722+0000","last_change":"2023-12-19T18:59:25.858722+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.858722+0000","last_undegraded":"2023-12-19T18:59:25.858722+0000","last_fullsized":"2023-12-19T18:59:25.858722+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T18:59:26.851183+0000","last_change":"2023-12-19T18:59:26.851183+0000","last_active":"2023-12-19T18:59:26.851183+0000","last_peered":"2023-12-19T18:59:26.851183+0000","last_clean":"2023-12-19T18:59:26.851183+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:26.851183+0000","last_undegraded":"2023-12-19T18:59:26.851183+0000","last_fullsized":"2023-12-19T18:59:26.851183+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":28,"state":"creating+peering","last_fresh":"2023-12-19T18:59:25.859771+0000","last_change":"2023-12-19T18:59:25.859771+0000","last_active":"2023-12-19T18:59:25.848407+0000","last_peered":"2023-12-19T18:59:25.848407+0000","last_clean":"2023-12-19T18:59:25.848407+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:59:25.859771+0000","last_undegraded":"2023-12-19T18:59:25.859771+0000","last_fullsized":"2023-12-19T18:59:25.859771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":173,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-19T18:59:21.758920+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T18:59:21.758920+0000","last_peered":"2023-12-19T18:59:21.758920+0000","last_clean":"2023-12-19T18:59:21.758920+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T18:59:21.758920+0000","last_undegraded":"2023-12-19T18:59:21.758920+0000","last_fullsized":"2023-12-19T18:59:21.758920+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27912,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343928,"statfs":{"total":96636764160,"available":96608182272,"internally_reserved":0,"allocated":892928,"data_stored":699311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27324,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344516,"statfs":{"total":96636764160,"available":96608784384,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":299008,"data_stored":108943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":698292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T18:59:32.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-12-19T18:59:32.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-12-19T18:59:32.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-12-19T18:59:32.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-12-19T18:59:32.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-12-19T18:59:32.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-12-19T18:59:32.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-12-19T18:59:32.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-12-19T18:59:32.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-12-19T18:59:32.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-12-19T18:59:32.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-12-19T18:59:32.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-12-19T18:59:32.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-12-19T18:59:32.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-12-19T18:59:32.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-12-19T18:59:32.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-12-19T18:59:32.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-12-19T18:59:32.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-12-19T18:59:32.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-12-19T18:59:32.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-12-19T18:59:32.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-12-19T18:59:32.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-12-19T18:59:32.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-12-19T18:59:32.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-12-19T18:59:32.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-12-19T18:59:32.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-12-19T18:59:32.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-12-19T18:59:32.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-12-19T18:59:32.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-12-19T18:59:32.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-12-19T18:59:32.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-12-19T18:59:32.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-12-19T18:59:32.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-12-19T18:59:32.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-12-19T18:59:32.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.859248+0000', 'last_change': '2023-12-19T18:59:25.859248+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.859248+0000', 'last_undegraded': '2023-12-19T18:59:25.859248+0000', 'last_fullsized': '2023-12-19T18:59:25.859248+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T18:59:32.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-12-19T18:59:32.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-12-19T18:59:32.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.855787+0000', 'last_change': '2023-12-19T18:59:25.855787+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.855787+0000', 'last_undegraded': '2023-12-19T18:59:25.855787+0000', 'last_fullsized': '2023-12-19T18:59:25.855787+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T18:59:32.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-12-19T18:59:32.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-12-19T18:59:32.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.859188+0000', 'last_change': '2023-12-19T18:59:25.859188+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.859188+0000', 'last_undegraded': '2023-12-19T18:59:25.859188+0000', 'last_fullsized': '2023-12-19T18:59:25.859188+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T18:59:32.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-12-19T18:59:32.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-12-19T18:59:32.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.860388+0000', 'last_change': '2023-12-19T18:59:25.860388+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.860388+0000', 'last_undegraded': '2023-12-19T18:59:25.860388+0000', 'last_fullsized': '2023-12-19T18:59:25.860388+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T18:59:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-12-19T18:59:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-12-19T18:59:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.856586+0000', 'last_change': '2023-12-19T18:59:25.856586+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.856586+0000', 'last_undegraded': '2023-12-19T18:59:25.856586+0000', 'last_fullsized': '2023-12-19T18:59:25.856586+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T18:59:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-12-19T18:59:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-12-19T18:59:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.855898+0000', 'last_change': '2023-12-19T18:59:25.855898+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.855898+0000', 'last_undegraded': '2023-12-19T18:59:25.855898+0000', 'last_fullsized': '2023-12-19T18:59:25.855898+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T18:59:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-12-19T18:59:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-12-19T18:59:32.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.858252+0000', 'last_change': '2023-12-19T18:59:25.858252+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.858252+0000', 'last_undegraded': '2023-12-19T18:59:25.858252+0000', 'last_fullsized': '2023-12-19T18:59:25.858252+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T18:59:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-12-19T18:59:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-12-19T18:59:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.855397+0000', 'last_change': '2023-12-19T18:59:25.855397+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.855397+0000', 'last_undegraded': '2023-12-19T18:59:25.855397+0000', 'last_fullsized': '2023-12-19T18:59:25.855397+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T18:59:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-12-19T18:59:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-12-19T18:59:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.859706+0000', 'last_change': '2023-12-19T18:59:25.859706+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.859706+0000', 'last_undegraded': '2023-12-19T18:59:25.859706+0000', 'last_fullsized': '2023-12-19T18:59:25.859706+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T18:59:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-12-19T18:59:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-12-19T18:59:32.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.855292+0000', 'last_change': '2023-12-19T18:59:25.855292+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.855292+0000', 'last_undegraded': '2023-12-19T18:59:25.855292+0000', 'last_fullsized': '2023-12-19T18:59:25.855292+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T18:59:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-12-19T18:59:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-12-19T18:59:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.858352+0000', 'last_change': '2023-12-19T18:59:25.858352+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.858352+0000', 'last_undegraded': '2023-12-19T18:59:25.858352+0000', 'last_fullsized': '2023-12-19T18:59:25.858352+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T18:59:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-12-19T18:59:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-12-19T18:59:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.858845+0000', 'last_change': '2023-12-19T18:59:25.858845+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.858845+0000', 'last_undegraded': '2023-12-19T18:59:25.858845+0000', 'last_fullsized': '2023-12-19T18:59:25.858845+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T18:59:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-12-19T18:59:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-12-19T18:59:32.687 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.855286+0000', 'last_change': '2023-12-19T18:59:25.855286+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.855286+0000', 'last_undegraded': '2023-12-19T18:59:25.855286+0000', 'last_fullsized': '2023-12-19T18:59:25.855286+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T18:59:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-12-19T18:59:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-12-19T18:59:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.857855+0000', 'last_change': '2023-12-19T18:59:25.857855+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.857855+0000', 'last_undegraded': '2023-12-19T18:59:25.857855+0000', 'last_fullsized': '2023-12-19T18:59:25.857855+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T18:59:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-12-19T18:59:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-12-19T18:59:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.859628+0000', 'last_change': '2023-12-19T18:59:25.859628+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.859628+0000', 'last_undegraded': '2023-12-19T18:59:25.859628+0000', 'last_fullsized': '2023-12-19T18:59:25.859628+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T18:59:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-12-19T18:59:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-12-19T18:59:32.688 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.858235+0000', 'last_change': '2023-12-19T18:59:25.858235+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.858235+0000', 'last_undegraded': '2023-12-19T18:59:25.858235+0000', 'last_fullsized': '2023-12-19T18:59:25.858235+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T18:59:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-12-19T18:59:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-12-19T18:59:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.857813+0000', 'last_change': '2023-12-19T18:59:25.857813+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.857813+0000', 'last_undegraded': '2023-12-19T18:59:25.857813+0000', 'last_fullsized': '2023-12-19T18:59:25.857813+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T18:59:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-12-19T18:59:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-12-19T18:59:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.855565+0000', 'last_change': '2023-12-19T18:59:25.855565+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.855565+0000', 'last_undegraded': '2023-12-19T18:59:25.855565+0000', 'last_fullsized': '2023-12-19T18:59:25.855565+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T18:59:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-12-19T18:59:32.689 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-12-19T18:59:32.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.855386+0000', 'last_change': '2023-12-19T18:59:25.855386+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.855386+0000', 'last_undegraded': '2023-12-19T18:59:25.855386+0000', 'last_fullsized': '2023-12-19T18:59:25.855386+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T18:59:32.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-12-19T18:59:32.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-12-19T18:59:32.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.855708+0000', 'last_change': '2023-12-19T18:59:25.855708+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.855708+0000', 'last_undegraded': '2023-12-19T18:59:25.855708+0000', 'last_fullsized': '2023-12-19T18:59:25.855708+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T18:59:32.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-12-19T18:59:32.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-12-19T18:59:32.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.855265+0000', 'last_change': '2023-12-19T18:59:25.855265+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.855265+0000', 'last_undegraded': '2023-12-19T18:59:25.855265+0000', 'last_fullsized': '2023-12-19T18:59:25.855265+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T18:59:32.690 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-12-19T18:59:32.690 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-12-19T18:59:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.858830+0000', 'last_change': '2023-12-19T18:59:25.858830+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.858830+0000', 'last_undegraded': '2023-12-19T18:59:25.858830+0000', 'last_fullsized': '2023-12-19T18:59:25.858830+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T18:59:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-12-19T18:59:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-12-19T18:59:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.856146+0000', 'last_change': '2023-12-19T18:59:25.856146+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.856146+0000', 'last_undegraded': '2023-12-19T18:59:25.856146+0000', 'last_fullsized': '2023-12-19T18:59:25.856146+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T18:59:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-12-19T18:59:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-12-19T18:59:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.858314+0000', 'last_change': '2023-12-19T18:59:25.858314+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.858314+0000', 'last_undegraded': '2023-12-19T18:59:25.858314+0000', 'last_fullsized': '2023-12-19T18:59:25.858314+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T18:59:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-12-19T18:59:32.691 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-12-19T18:59:32.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.857217+0000', 'last_change': '2023-12-19T18:59:25.857217+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.857217+0000', 'last_undegraded': '2023-12-19T18:59:25.857217+0000', 'last_fullsized': '2023-12-19T18:59:25.857217+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T18:59:32.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-12-19T18:59:32.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-12-19T18:59:32.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.854623+0000', 'last_change': '2023-12-19T18:59:25.854623+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.854623+0000', 'last_undegraded': '2023-12-19T18:59:25.854623+0000', 'last_fullsized': '2023-12-19T18:59:25.854623+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T18:59:32.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-12-19T18:59:32.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-12-19T18:59:32.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.857248+0000', 'last_change': '2023-12-19T18:59:25.857248+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.857248+0000', 'last_undegraded': '2023-12-19T18:59:25.857248+0000', 'last_fullsized': '2023-12-19T18:59:25.857248+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T18:59:32.692 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-12-19T18:59:32.692 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-12-19T18:59:32.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.854640+0000', 'last_change': '2023-12-19T18:59:25.854640+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.854640+0000', 'last_undegraded': '2023-12-19T18:59:25.854640+0000', 'last_fullsized': '2023-12-19T18:59:25.854640+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T18:59:32.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-12-19T18:59:32.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-12-19T18:59:32.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.857430+0000', 'last_change': '2023-12-19T18:59:25.857430+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.857430+0000', 'last_undegraded': '2023-12-19T18:59:25.857430+0000', 'last_fullsized': '2023-12-19T18:59:25.857430+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T18:59:32.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-12-19T18:59:32.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-12-19T18:59:32.693 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.855253+0000', 'last_change': '2023-12-19T18:59:25.855253+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.855253+0000', 'last_undegraded': '2023-12-19T18:59:25.855253+0000', 'last_fullsized': '2023-12-19T18:59:25.855253+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T18:59:32.693 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-12-19T18:59:32.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-12-19T18:59:32.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.858722+0000', 'last_change': '2023-12-19T18:59:25.858722+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.858722+0000', 'last_undegraded': '2023-12-19T18:59:25.858722+0000', 'last_fullsized': '2023-12-19T18:59:25.858722+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T18:59:32.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-12-19T18:59:32.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T18:59:26.851183+0000', 'last_change': '2023-12-19T18:59:26.851183+0000', 'last_active': '2023-12-19T18:59:26.851183+0000', 'last_peered': '2023-12-19T18:59:26.851183+0000', 'last_clean': '2023-12-19T18:59:26.851183+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:26.851183+0000', 'last_undegraded': '2023-12-19T18:59:26.851183+0000', 'last_fullsized': '2023-12-19T18:59:26.851183+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:26.851183+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T18:59:32.694 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-12-19T18:59:32.694 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 28, 'state': 'creating+peering', 'last_fresh': '2023-12-19T18:59:25.859771+0000', 'last_change': '2023-12-19T18:59:25.859771+0000', 'last_active': '2023-12-19T18:59:25.848407+0000', 'last_peered': '2023-12-19T18:59:25.848407+0000', 'last_clean': '2023-12-19T18:59:25.848407+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T18:59:25.859771+0000', 'last_undegraded': '2023-12-19T18:59:25.859771+0000', 'last_fullsized': '2023-12-19T18:59:25.859771+0000', 'mapping_epoch': 28, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 28, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'last_clean_scrub_stamp': '2023-12-19T18:59:25.848407+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T18:59:32.695 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-19T18:59:32.753 INFO:tasks.ceph.mds.c.smithi133.stderr:2023-12-19T18:59:32.747+0000 7ff262483640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T18:59:32.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.847+0000 7fdac3a79640 1 Processor -- start 2023-12-19T18:59:32.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.847+0000 7fdac3a79640 1 -- start start 2023-12-19T18:59:32.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.847+0000 7fdac3a79640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdabc151e90 0x7fdabc0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:32.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.847+0000 7fdac3a79640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdabc0c7ea0 0x7fdabc06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:32.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.847+0000 7fdac3a79640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdabc06c860 con 0x7fdabc0c4e60 2023-12-19T18:59:32.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.847+0000 7fdac3a79640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdabc0c8750 con 0x7fdabc0c7ea0 2023-12-19T18:59:32.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.847+0000 7fdac3a79640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc1552d0 con 0x7fdabc151e90 2023-12-19T18:59:32.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.847+0000 7fdac1014640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdabc0c7ea0 0x7fdabc06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:32.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.847+0000 7fdac1014640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdabc0c7ea0 0x7fdabc06b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42310/0 (socket says 172.21.15.133:42310) 2023-12-19T18:59:32.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.847+0000 7fdac1014640 1 -- 172.21.15.133:0/3743535396 learned_addr learned my addr 172.21.15.133:0/3743535396 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:32.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.847+0000 7fdac1815640 1 --2- 172.21.15.133:0/3743535396 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdabc151e90 0x7fdabc0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:32.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.847+0000 7fdac1014640 1 -- 172.21.15.133:0/3743535396 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdabc151e90 msgr2=0x7fdabc0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:32.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.847+0000 7fdac1014640 1 --2- 172.21.15.133:0/3743535396 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdabc151e90 0x7fdabc0c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.847+0000 7fdac1014640 1 -- 172.21.15.133:0/3743535396 >> v1:172.21.15.138:6789/0 conn(0x7fdabc0c4e60 legacy=0x7fdabc06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:32.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.847+0000 7fdac1014640 1 -- 172.21.15.133:0/3743535396 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc154930 con 0x7fdabc0c7ea0 2023-12-19T18:59:32.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.851+0000 7fdac1014640 1 --2- 172.21.15.133:0/3743535396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdabc0c7ea0 0x7fdabc06b4a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009870 tx=0x7fdaac01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6955fa3b72ce41 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:32.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.851+0000 7fdac0813640 1 -- 172.21.15.133:0/3743535396 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac0ab600 con 0x7fdabc0c7ea0 2023-12-19T18:59:32.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.851+0000 7fdac0813640 1 -- 172.21.15.133:0/3743535396 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaac0a7050 con 0x7fdabc0c7ea0 2023-12-19T18:59:32.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.851+0000 7fdac0813640 1 -- 172.21.15.133:0/3743535396 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac0ab980 con 0x7fdabc0c7ea0 2023-12-19T18:59:32.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.851+0000 7fdac3a79640 1 -- 172.21.15.133:0/3743535396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdabc0c7ea0 msgr2=0x7fdabc06b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:32.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.851+0000 7fdac3a79640 1 --2- 172.21.15.133:0/3743535396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdabc0c7ea0 0x7fdabc06b4a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009870 tx=0x7fdaac01c420 comp rx=0 tx=0).stop 2023-12-19T18:59:32.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.851+0000 7fdac3a79640 1 -- 172.21.15.133:0/3743535396 shutdown_connections 2023-12-19T18:59:32.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.851+0000 7fdac3a79640 1 --2- 172.21.15.133:0/3743535396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdabc0c7ea0 0x7fdabc06b4a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.851+0000 7fdac3a79640 1 --2- 172.21.15.133:0/3743535396 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdabc151e90 0x7fdabc0c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.851+0000 7fdac3a79640 1 -- 172.21.15.133:0/3743535396 >> 172.21.15.133:0/3743535396 conn(0x7fdabc0ca170 msgr2=0x7fdabc0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:32.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.851+0000 7fdac3a79640 1 -- 172.21.15.133:0/3743535396 shutdown_connections 2023-12-19T18:59:32.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.851+0000 7fdac3a79640 1 -- 172.21.15.133:0/3743535396 wait complete. 2023-12-19T18:59:32.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdac3a79640 1 Processor -- start 2023-12-19T18:59:32.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdac3a79640 1 -- start start 2023-12-19T18:59:32.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdac3a79640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdabc0c4e60 0x7fdabc0af550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:32.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdac3a79640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdabc0c7ea0 0x7fdabc14b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:32.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdac3a79640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdabc151e90 0x7fdabc14c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:32.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdac3a79640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc0afa90 con 0x7fdabc0c7ea0 2023-12-19T18:59:32.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdac3a79640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc0aeb00 con 0x7fdabc0c4e60 2023-12-19T18:59:32.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdac3a79640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc0af0c0 con 0x7fdabc151e90 2023-12-19T18:59:32.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdac1014640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdabc0c7ea0 0x7fdabc14b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:32.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdac1014640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdabc0c7ea0 0x7fdabc14b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42312/0 (socket says 172.21.15.133:42312) 2023-12-19T18:59:32.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdac1014640 1 -- 172.21.15.133:0/2143722821 learned_addr learned my addr 172.21.15.133:0/2143722821 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:32.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdac1815640 1 --2- 172.21.15.133:0/2143722821 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdabc0c4e60 0x7fdabc0af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:32.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdac2016640 1 --2- 172.21.15.133:0/2143722821 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdabc151e90 0x7fdabc14c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:32.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdac1014640 1 -- 172.21.15.133:0/2143722821 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdabc151e90 msgr2=0x7fdabc14c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:32.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdac1014640 1 --2- 172.21.15.133:0/2143722821 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdabc151e90 0x7fdabc14c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdac1014640 1 -- 172.21.15.133:0/2143722821 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdabc0c4e60 msgr2=0x7fdabc0af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:32.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdac1014640 1 --2- 172.21.15.133:0/2143722821 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdabc0c4e60 0x7fdabc0af550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:32.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdac1014640 1 -- 172.21.15.133:0/2143722821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac0094d0 con 0x7fdabc0c7ea0 2023-12-19T18:59:32.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdac2016640 1 --2- 172.21.15.133:0/2143722821 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdabc151e90 0x7fdabc14c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:32.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdac1014640 1 --2- 172.21.15.133:0/2143722821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdabc0c7ea0 0x7fdabc14b510 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0ae040 tx=0x7fdaac0191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:32.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdab27fc640 1 -- 172.21.15.133:0/2143722821 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac0b4420 con 0x7fdabc0c7ea0 2023-12-19T18:59:32.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdab27fc640 1 -- 172.21.15.133:0/2143722821 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaac0b4580 con 0x7fdabc0c7ea0 2023-12-19T18:59:32.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdac3a79640 1 -- 172.21.15.133:0/2143722821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdabc1f13a0 con 0x7fdabc0c7ea0 2023-12-19T18:59:32.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdab27fc640 1 -- 172.21.15.133:0/2143722821 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac0b4930 con 0x7fdabc0c7ea0 2023-12-19T18:59:32.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdac3a79640 1 -- 172.21.15.133:0/2143722821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdabc0aed50 con 0x7fdabc0c7ea0 2023-12-19T18:59:32.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.855+0000 7fdac3a79640 1 -- 172.21.15.133:0/2143722821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdabc1f1850 con 0x7fdabc0c7ea0 2023-12-19T18:59:32.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.859+0000 7fdab27fc640 1 -- 172.21.15.133:0/2143722821 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fdaac0b2070 con 0x7fdabc0c7ea0 2023-12-19T18:59:32.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.859+0000 7fdab27fc640 1 --2- 172.21.15.133:0/2143722821 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdaa00664a0 0x7fdaa0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:32.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.859+0000 7fdab27fc640 1 -- 172.21.15.133:0/2143722821 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdaac11d990 con 0x7fdabc0c7ea0 2023-12-19T18:59:32.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.859+0000 7fdac1815640 1 --2- 172.21.15.133:0/2143722821 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdaa00664a0 0x7fdaa0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:32.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.859+0000 7fdac1815640 1 --2- 172.21.15.133:0/2143722821 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdaa00664a0 0x7fdaa0068960 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdab8007a60 tx=0x7fdab8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:32.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:32.863+0000 7fdab27fc640 1 -- 172.21.15.133:0/2143722821 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fdaac0eaea0 con 0x7fdabc0c7ea0 2023-12-19T18:59:33.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.063+0000 7fdac3a79640 1 -- 172.21.15.133:0/2143722821 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fdabc068400 con 0x7fdabc0c7ea0 2023-12-19T18:59:33.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.063+0000 7fdab27fc640 1 -- 172.21.15.133:0/2143722821 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2720 (secure 0 0 0) 0x7fdaac0b0ab0 con 0x7fdabc0c7ea0 2023-12-19T18:59:33.070 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:33.070 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":75,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":31,"num_osds":8,"num_up_osds":8,"osd_up_since":1703012310,"num_in_osds":8,"osd_in_since":1703012300,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":224968704,"bytes_avail":772869144576,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4995}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2023-12-19T18:59:24.841210+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-19T18:59:33.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.067+0000 7fdac3a79640 1 -- 172.21.15.133:0/2143722821 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdaa00664a0 msgr2=0x7fdaa0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:33.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.067+0000 7fdac3a79640 1 --2- 172.21.15.133:0/2143722821 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdaa00664a0 0x7fdaa0068960 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdab8007a60 tx=0x7fdab8008040 comp rx=0 tx=0).stop 2023-12-19T18:59:33.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.067+0000 7fdac3a79640 1 -- 172.21.15.133:0/2143722821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdabc0c7ea0 msgr2=0x7fdabc14b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:33.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.067+0000 7fdac3a79640 1 --2- 172.21.15.133:0/2143722821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdabc0c7ea0 0x7fdabc14b510 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0ae040 tx=0x7fdaac0191c0 comp rx=0 tx=0).stop 2023-12-19T18:59:33.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.067+0000 7fdac3a79640 1 -- 172.21.15.133:0/2143722821 shutdown_connections 2023-12-19T18:59:33.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.067+0000 7fdac3a79640 1 --2- 172.21.15.133:0/2143722821 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdaa00664a0 0x7fdaa0068960 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:33.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.067+0000 7fdac3a79640 1 --2- 172.21.15.133:0/2143722821 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdabc151e90 0x7fdabc14c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:33.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.067+0000 7fdac3a79640 1 --2- 172.21.15.133:0/2143722821 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdabc0c7ea0 0x7fdabc14b510 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:33.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.067+0000 7fdac3a79640 1 --2- 172.21.15.133:0/2143722821 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdabc0c4e60 0x7fdabc0af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:33.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.067+0000 7fdac3a79640 1 -- 172.21.15.133:0/2143722821 >> 172.21.15.133:0/2143722821 conn(0x7fdabc0ca170 msgr2=0x7fdabc0ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:33.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.067+0000 7fdac3a79640 1 -- 172.21.15.133:0/2143722821 shutdown_connections 2023-12-19T18:59:33.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.067+0000 7fdac3a79640 1 -- 172.21.15.133:0/2143722821 wait complete. 2023-12-19T18:59:33.090 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-19T18:59:33.090 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T18:59:33.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.271+0000 7fbc9fd2a640 1 Processor -- start 2023-12-19T18:59:33.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.271+0000 7fbc9fd2a640 1 -- start start 2023-12-19T18:59:33.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.271+0000 7fbc9fd2a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc980c5260 0x7fbc9806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:33.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.271+0000 7fbc9fd2a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbc98155de0 0x7fbc98156250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:33.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.271+0000 7fbc9fd2a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc980c2580 con 0x7fbc980c5640 2023-12-19T18:59:33.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.271+0000 7fbc9fd2a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc98153510 con 0x7fbc98155de0 2023-12-19T18:59:33.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.271+0000 7fbc9fd2a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc980c17f0 con 0x7fbc980c5260 2023-12-19T18:59:33.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.271+0000 7fbc9e2c7640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbc98155de0 0x7fbc98156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:33.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.271+0000 7fbc9e2c7640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbc98155de0 0x7fbc98156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42322/0 (socket says 172.21.15.133:42322) 2023-12-19T18:59:33.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.271+0000 7fbc9e2c7640 1 -- 172.21.15.133:0/1438868069 learned_addr learned my addr 172.21.15.133:0/1438868069 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:33.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.271+0000 7fbc9dac6640 1 --2- 172.21.15.133:0/1438868069 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc980c5260 0x7fbc9806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:33.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.271+0000 7fbc9e2c7640 1 -- 172.21.15.133:0/1438868069 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc980c5260 msgr2=0x7fbc9806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:33.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.271+0000 7fbc9e2c7640 1 --2- 172.21.15.133:0/1438868069 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc980c5260 0x7fbc9806d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:33.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.271+0000 7fbc9e2c7640 1 -- 172.21.15.133:0/1438868069 >> v1:172.21.15.138:6789/0 conn(0x7fbc980c5640 legacy=0x7fbc980c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:33.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.271+0000 7fbc9e2c7640 1 -- 172.21.15.133:0/1438868069 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc980c1a00 con 0x7fbc98155de0 2023-12-19T18:59:33.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.275+0000 7fbc9e2c7640 1 --2- 172.21.15.133:0/1438868069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc98155de0 0x7fbc98156250 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbc980c1930 tx=0x7fbc9001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7435d31f2299a368 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:33.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.275+0000 7fbc9cac4640 1 -- 172.21.15.133:0/1438868069 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc900a57f0 con 0x7fbc98155de0 2023-12-19T18:59:33.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.275+0000 7fbc9cac4640 1 -- 172.21.15.133:0/1438868069 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc900a5950 con 0x7fbc98155de0 2023-12-19T18:59:33.280 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.275+0000 7fbc9cac4640 1 -- 172.21.15.133:0/1438868069 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc900a5ce0 con 0x7fbc98155de0 2023-12-19T18:59:33.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.275+0000 7fbc9fd2a640 1 -- 172.21.15.133:0/1438868069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc98155de0 msgr2=0x7fbc98156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:33.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.275+0000 7fbc9fd2a640 1 --2- 172.21.15.133:0/1438868069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc98155de0 0x7fbc98156250 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbc980c1930 tx=0x7fbc9001c930 comp rx=0 tx=0).stop 2023-12-19T18:59:33.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.275+0000 7fbc9fd2a640 1 -- 172.21.15.133:0/1438868069 shutdown_connections 2023-12-19T18:59:33.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.275+0000 7fbc9fd2a640 1 --2- 172.21.15.133:0/1438868069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc98155de0 0x7fbc98156250 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:33.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.275+0000 7fbc9fd2a640 1 --2- 172.21.15.133:0/1438868069 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc980c5260 0x7fbc9806d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:33.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.275+0000 7fbc9fd2a640 1 -- 172.21.15.133:0/1438868069 >> 172.21.15.133:0/1438868069 conn(0x7fbc9806a5b0 msgr2=0x7fbc9806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:33.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.275+0000 7fbc9fd2a640 1 -- 172.21.15.133:0/1438868069 shutdown_connections 2023-12-19T18:59:33.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.275+0000 7fbc9fd2a640 1 -- 172.21.15.133:0/1438868069 wait complete. 2023-12-19T18:59:33.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.275+0000 7fbc9fd2a640 1 Processor -- start 2023-12-19T18:59:33.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.275+0000 7fbc9fd2a640 1 -- start start 2023-12-19T18:59:33.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.279+0000 7fbc9fd2a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc980c5260 0x7fbc981ea300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:33.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.279+0000 7fbc9fd2a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc980c5640 0x7fbc9815c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:33.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.279+0000 7fbc9fd2a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc98155de0 0x7fbc9814ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:33.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.279+0000 7fbc9fd2a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc98070f30 con 0x7fbc980c5260 2023-12-19T18:59:33.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.279+0000 7fbc9fd2a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc980bacf0 con 0x7fbc980c5640 2023-12-19T18:59:33.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.279+0000 7fbc9fd2a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc981ea8e0 con 0x7fbc98155de0 2023-12-19T18:59:33.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.279+0000 7fbc9dac6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc980c5260 0x7fbc981ea300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:33.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.279+0000 7fbc9dac6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc980c5260 0x7fbc981ea300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42336/0 (socket says 172.21.15.133:42336) 2023-12-19T18:59:33.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.279+0000 7fbc9dac6640 1 -- 172.21.15.133:0/4134140226 learned_addr learned my addr 172.21.15.133:0/4134140226 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:33.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.279+0000 7fbc9d2c5640 1 --2- 172.21.15.133:0/4134140226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc980c5640 0x7fbc9815c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:33.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.279+0000 7fbc9e2c7640 1 --2- 172.21.15.133:0/4134140226 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc98155de0 0x7fbc9814ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:33.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.279+0000 7fbc9dac6640 1 -- 172.21.15.133:0/4134140226 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc98155de0 msgr2=0x7fbc9814ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:33.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.279+0000 7fbc9dac6640 1 --2- 172.21.15.133:0/4134140226 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc98155de0 0x7fbc9814ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:33.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.279+0000 7fbc9dac6640 1 -- 172.21.15.133:0/4134140226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc980c5640 msgr2=0x7fbc9815c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:33.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.279+0000 7fbc9dac6640 1 --2- 172.21.15.133:0/4134140226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc980c5640 0x7fbc9815c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:33.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.279+0000 7fbc9dac6640 1 -- 172.21.15.133:0/4134140226 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc90009b30 con 0x7fbc980c5260 2023-12-19T18:59:33.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.279+0000 7fbc9dac6640 1 --2- 172.21.15.133:0/4134140226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc980c5260 0x7fbc981ea300 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400e870 tx=0x7fbc9400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:33.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.279+0000 7fbc8e7fc640 1 -- 172.21.15.133:0/4134140226 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc94009510 con 0x7fbc980c5260 2023-12-19T18:59:33.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.279+0000 7fbc8e7fc640 1 -- 172.21.15.133:0/4134140226 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9400eec0 con 0x7fbc980c5260 2023-12-19T18:59:33.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.279+0000 7fbc8e7fc640 1 -- 172.21.15.133:0/4134140226 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9400cb40 con 0x7fbc980c5260 2023-12-19T18:59:33.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.279+0000 7fbc9fd2a640 1 -- 172.21.15.133:0/4134140226 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc981eabc0 con 0x7fbc980c5260 2023-12-19T18:59:33.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.279+0000 7fbc9fd2a640 1 -- 172.21.15.133:0/4134140226 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc981eb180 con 0x7fbc980c5260 2023-12-19T18:59:33.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.279+0000 7fbc9fd2a640 1 -- 172.21.15.133:0/4134140226 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc98068400 con 0x7fbc980c5260 2023-12-19T18:59:33.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.283+0000 7fbc8e7fc640 1 -- 172.21.15.133:0/4134140226 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fbc9400cca0 con 0x7fbc980c5260 2023-12-19T18:59:33.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.283+0000 7fbc8e7fc640 1 --2- 172.21.15.133:0/4134140226 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fbc7c066470 0x7fbc7c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:33.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.283+0000 7fbc8e7fc640 1 -- 172.21.15.133:0/4134140226 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc94083fa0 con 0x7fbc980c5260 2023-12-19T18:59:33.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.283+0000 7fbc9d2c5640 1 --2- 172.21.15.133:0/4134140226 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fbc7c066470 0x7fbc7c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:33.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.283+0000 7fbc9d2c5640 1 --2- 172.21.15.133:0/4134140226 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fbc7c066470 0x7fbc7c068930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbc9815c040 tx=0x7fbc88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:33.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.287+0000 7fbc8e7fc640 1 -- 172.21.15.133:0/4134140226 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fbc94051430 con 0x7fbc980c5260 2023-12-19T18:59:33.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.435+0000 7fbc9fd2a640 1 -- 172.21.15.133:0/4134140226 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbc9806daf0 con 0x7fbc7c066470 2023-12-19T18:59:33.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.443+0000 7fbc8e7fc640 1 -- 172.21.15.133:0/4134140226 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271138 (secure 0 0 0) 0x7fbc880014f0 con 0x7fbc7c066470 2023-12-19T18:59:33.452 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:33.454 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T18:59:33.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.447+0000 7fbc9fd2a640 1 -- 172.21.15.133:0/4134140226 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fbc7c066470 msgr2=0x7fbc7c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:33.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.447+0000 7fbc9fd2a640 1 --2- 172.21.15.133:0/4134140226 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fbc7c066470 0x7fbc7c068930 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbc9815c040 tx=0x7fbc88009040 comp rx=0 tx=0).stop 2023-12-19T18:59:33.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.447+0000 7fbc9fd2a640 1 -- 172.21.15.133:0/4134140226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc980c5260 msgr2=0x7fbc981ea300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:33.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.447+0000 7fbc9fd2a640 1 --2- 172.21.15.133:0/4134140226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc980c5260 0x7fbc981ea300 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400e870 tx=0x7fbc9400ec70 comp rx=0 tx=0).stop 2023-12-19T18:59:33.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.447+0000 7fbc9fd2a640 1 -- 172.21.15.133:0/4134140226 shutdown_connections 2023-12-19T18:59:33.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.447+0000 7fbc9fd2a640 1 --2- 172.21.15.133:0/4134140226 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fbc7c066470 0x7fbc7c068930 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:33.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.447+0000 7fbc9fd2a640 1 --2- 172.21.15.133:0/4134140226 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fbc98155de0 0x7fbc9814ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:33.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.447+0000 7fbc9fd2a640 1 --2- 172.21.15.133:0/4134140226 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fbc980c5640 0x7fbc9815c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:33.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.447+0000 7fbc9fd2a640 1 --2- 172.21.15.133:0/4134140226 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc980c5260 0x7fbc981ea300 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:33.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.447+0000 7fbc9fd2a640 1 -- 172.21.15.133:0/4134140226 >> 172.21.15.133:0/4134140226 conn(0x7fbc9806a5b0 msgr2=0x7fbc9806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:33.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.447+0000 7fbc9fd2a640 1 -- 172.21.15.133:0/4134140226 shutdown_connections 2023-12-19T18:59:33.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:33.447+0000 7fbc9fd2a640 1 -- 172.21.15.133:0/4134140226 wait complete. 2023-12-19T18:59:33.472 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-12-19T18:59:32.842792+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220100,"kb_used_data":3940,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754620,"statfs":{"total":773094113280,"available":772868730880,"internally_reserved":0,"allocated":4034560,"data_stored":2257353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001203"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252167+0000","last_change":"2023-12-19T18:59:27.658988+0000","last_active":"2023-12-19T18:59:29.252167+0000","last_peered":"2023-12-19T18:59:29.252167+0000","last_clean":"2023-12-19T18:59:29.252167+0000","last_became_active":"2023-12-19T18:59:27.658688+0000","last_became_peered":"2023-12-19T18:59:27.658688+0000","last_unstale":"2023-12-19T18:59:29.252167+0000","last_undegraded":"2023-12-19T18:59:29.252167+0000","last_fullsized":"2023-12-19T18:59:29.252167+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:58:40.962863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.253209+0000","last_change":"2023-12-19T18:59:27.643020+0000","last_active":"2023-12-19T18:59:29.253209+0000","last_peered":"2023-12-19T18:59:29.253209+0000","last_clean":"2023-12-19T18:59:29.253209+0000","last_became_active":"2023-12-19T18:59:27.640017+0000","last_became_peered":"2023-12-19T18:59:27.640017+0000","last_unstale":"2023-12-19T18:59:29.253209+0000","last_undegraded":"2023-12-19T18:59:29.253209+0000","last_fullsized":"2023-12-19T18:59:29.253209+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:35.855173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251977+0000","last_change":"2023-12-19T18:59:27.652238+0000","last_active":"2023-12-19T18:59:29.251977+0000","last_peered":"2023-12-19T18:59:29.251977+0000","last_clean":"2023-12-19T18:59:29.251977+0000","last_became_active":"2023-12-19T18:59:27.650827+0000","last_became_peered":"2023-12-19T18:59:27.650827+0000","last_unstale":"2023-12-19T18:59:29.251977+0000","last_undegraded":"2023-12-19T18:59:29.251977+0000","last_fullsized":"2023-12-19T18:59:29.251977+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:39.959895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252155+0000","last_change":"2023-12-19T18:59:27.646579+0000","last_active":"2023-12-19T18:59:29.252155+0000","last_peered":"2023-12-19T18:59:29.252155+0000","last_clean":"2023-12-19T18:59:29.252155+0000","last_became_active":"2023-12-19T18:59:27.646163+0000","last_became_peered":"2023-12-19T18:59:27.646163+0000","last_unstale":"2023-12-19T18:59:29.252155+0000","last_undegraded":"2023-12-19T18:59:29.252155+0000","last_fullsized":"2023-12-19T18:59:29.252155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:43.043365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251623+0000","last_change":"2023-12-19T18:59:27.647319+0000","last_active":"2023-12-19T18:59:29.251623+0000","last_peered":"2023-12-19T18:59:29.251623+0000","last_clean":"2023-12-19T18:59:29.251623+0000","last_became_active":"2023-12-19T18:59:27.646986+0000","last_became_peered":"2023-12-19T18:59:27.646986+0000","last_unstale":"2023-12-19T18:59:29.251623+0000","last_undegraded":"2023-12-19T18:59:29.251623+0000","last_fullsized":"2023-12-19T18:59:29.251623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:11.488595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252397+0000","last_change":"2023-12-19T18:59:27.646289+0000","last_active":"2023-12-19T18:59:29.252397+0000","last_peered":"2023-12-19T18:59:29.252397+0000","last_clean":"2023-12-19T18:59:29.252397+0000","last_became_active":"2023-12-19T18:59:27.645922+0000","last_became_peered":"2023-12-19T18:59:27.645922+0000","last_unstale":"2023-12-19T18:59:29.252397+0000","last_undegraded":"2023-12-19T18:59:29.252397+0000","last_fullsized":"2023-12-19T18:59:29.252397+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:39.959895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.626501+0000","last_change":"2023-12-19T18:59:27.644547+0000","last_active":"2023-12-19T18:59:28.626501+0000","last_peered":"2023-12-19T18:59:28.626501+0000","last_clean":"2023-12-19T18:59:28.626501+0000","last_became_active":"2023-12-19T18:59:27.643524+0000","last_became_peered":"2023-12-19T18:59:27.643524+0000","last_unstale":"2023-12-19T18:59:28.626501+0000","last_undegraded":"2023-12-19T18:59:28.626501+0000","last_fullsized":"2023-12-19T18:59:28.626501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:34:10.155305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.626180+0000","last_change":"2023-12-19T18:59:27.636005+0000","last_active":"2023-12-19T18:59:28.626180+0000","last_peered":"2023-12-19T18:59:28.626180+0000","last_clean":"2023-12-19T18:59:28.626180+0000","last_became_active":"2023-12-19T18:59:27.635717+0000","last_became_peered":"2023-12-19T18:59:27.635717+0000","last_unstale":"2023-12-19T18:59:28.626180+0000","last_undegraded":"2023-12-19T18:59:28.626180+0000","last_fullsized":"2023-12-19T18:59:28.626180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:09.434914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.627562+0000","last_change":"2023-12-19T18:59:27.644087+0000","last_active":"2023-12-19T18:59:28.627562+0000","last_peered":"2023-12-19T18:59:28.627562+0000","last_clean":"2023-12-19T18:59:28.627562+0000","last_became_active":"2023-12-19T18:59:27.643699+0000","last_became_peered":"2023-12-19T18:59:27.643699+0000","last_unstale":"2023-12-19T18:59:28.627562+0000","last_undegraded":"2023-12-19T18:59:28.627562+0000","last_fullsized":"2023-12-19T18:59:28.627562+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:09.434914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252473+0000","last_change":"2023-12-19T18:59:27.652530+0000","last_active":"2023-12-19T18:59:29.252473+0000","last_peered":"2023-12-19T18:59:29.252473+0000","last_clean":"2023-12-19T18:59:29.252473+0000","last_became_active":"2023-12-19T18:59:27.652274+0000","last_became_peered":"2023-12-19T18:59:27.652274+0000","last_unstale":"2023-12-19T18:59:29.252473+0000","last_undegraded":"2023-12-19T18:59:29.252473+0000","last_fullsized":"2023-12-19T18:59:29.252473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:45.789974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.627491+0000","last_change":"2023-12-19T18:59:27.641187+0000","last_active":"2023-12-19T18:59:28.627491+0000","last_peered":"2023-12-19T18:59:28.627491+0000","last_clean":"2023-12-19T18:59:28.627491+0000","last_became_active":"2023-12-19T18:59:27.640792+0000","last_became_peered":"2023-12-19T18:59:27.640792+0000","last_unstale":"2023-12-19T18:59:28.627491+0000","last_undegraded":"2023-12-19T18:59:28.627491+0000","last_fullsized":"2023-12-19T18:59:28.627491+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:39.959895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251702+0000","last_change":"2023-12-19T18:59:27.654938+0000","last_active":"2023-12-19T18:59:29.251702+0000","last_peered":"2023-12-19T18:59:29.251702+0000","last_clean":"2023-12-19T18:59:29.251702+0000","last_became_active":"2023-12-19T18:59:27.651744+0000","last_became_peered":"2023-12-19T18:59:27.651744+0000","last_unstale":"2023-12-19T18:59:29.251702+0000","last_undegraded":"2023-12-19T18:59:29.251702+0000","last_fullsized":"2023-12-19T18:59:29.251702+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:51:59.962934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251676+0000","last_change":"2023-12-19T18:59:27.639769+0000","last_active":"2023-12-19T18:59:29.251676+0000","last_peered":"2023-12-19T18:59:29.251676+0000","last_clean":"2023-12-19T18:59:29.251676+0000","last_became_active":"2023-12-19T18:59:27.639419+0000","last_became_peered":"2023-12-19T18:59:27.639419+0000","last_unstale":"2023-12-19T18:59:29.251676+0000","last_undegraded":"2023-12-19T18:59:29.251676+0000","last_fullsized":"2023-12-19T18:59:29.251676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:05:06.848164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252462+0000","last_change":"2023-12-19T18:59:27.634853+0000","last_active":"2023-12-19T18:59:29.252462+0000","last_peered":"2023-12-19T18:59:29.252462+0000","last_clean":"2023-12-19T18:59:29.252462+0000","last_became_active":"2023-12-19T18:59:27.634599+0000","last_became_peered":"2023-12-19T18:59:27.634599+0000","last_unstale":"2023-12-19T18:59:29.252462+0000","last_undegraded":"2023-12-19T18:59:29.252462+0000","last_fullsized":"2023-12-19T18:59:29.252462+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:39.573719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251524+0000","last_change":"2023-12-19T18:59:27.657564+0000","last_active":"2023-12-19T18:59:29.251524+0000","last_peered":"2023-12-19T18:59:29.251524+0000","last_clean":"2023-12-19T18:59:29.251524+0000","last_became_active":"2023-12-19T18:59:27.657243+0000","last_became_peered":"2023-12-19T18:59:27.657243+0000","last_unstale":"2023-12-19T18:59:29.251524+0000","last_undegraded":"2023-12-19T18:59:29.251524+0000","last_fullsized":"2023-12-19T18:59:29.251524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:47.457632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.626441+0000","last_change":"2023-12-19T18:59:27.642841+0000","last_active":"2023-12-19T18:59:28.626441+0000","last_peered":"2023-12-19T18:59:28.626441+0000","last_clean":"2023-12-19T18:59:28.626441+0000","last_became_active":"2023-12-19T18:59:27.642539+0000","last_became_peered":"2023-12-19T18:59:27.642539+0000","last_unstale":"2023-12-19T18:59:28.626441+0000","last_undegraded":"2023-12-19T18:59:28.626441+0000","last_fullsized":"2023-12-19T18:59:28.626441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:47.457632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.627834+0000","last_change":"2023-12-19T18:59:27.656306+0000","last_active":"2023-12-19T18:59:28.627834+0000","last_peered":"2023-12-19T18:59:28.627834+0000","last_clean":"2023-12-19T18:59:28.627834+0000","last_became_active":"2023-12-19T18:59:27.652701+0000","last_became_peered":"2023-12-19T18:59:27.652701+0000","last_unstale":"2023-12-19T18:59:28.627834+0000","last_undegraded":"2023-12-19T18:59:28.627834+0000","last_fullsized":"2023-12-19T18:59:28.627834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:39.573719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252983+0000","last_change":"2023-12-19T18:59:27.643312+0000","last_active":"2023-12-19T18:59:29.252983+0000","last_peered":"2023-12-19T18:59:29.252983+0000","last_clean":"2023-12-19T18:59:29.252983+0000","last_became_active":"2023-12-19T18:59:27.642580+0000","last_became_peered":"2023-12-19T18:59:27.642580+0000","last_unstale":"2023-12-19T18:59:29.252983+0000","last_undegraded":"2023-12-19T18:59:29.252983+0000","last_fullsized":"2023-12-19T18:59:29.252983+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:26:27.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252737+0000","last_change":"2023-12-19T18:59:27.641655+0000","last_active":"2023-12-19T18:59:29.252737+0000","last_peered":"2023-12-19T18:59:29.252737+0000","last_clean":"2023-12-19T18:59:29.252737+0000","last_became_active":"2023-12-19T18:59:27.641399+0000","last_became_peered":"2023-12-19T18:59:27.641399+0000","last_unstale":"2023-12-19T18:59:29.252737+0000","last_undegraded":"2023-12-19T18:59:29.252737+0000","last_fullsized":"2023-12-19T18:59:29.252737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:24:42.172134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.253054+0000","last_change":"2023-12-19T18:59:27.651935+0000","last_active":"2023-12-19T18:59:29.253054+0000","last_peered":"2023-12-19T18:59:29.253054+0000","last_clean":"2023-12-19T18:59:29.253054+0000","last_became_active":"2023-12-19T18:59:27.650665+0000","last_became_peered":"2023-12-19T18:59:27.650665+0000","last_unstale":"2023-12-19T18:59:29.253054+0000","last_undegraded":"2023-12-19T18:59:29.253054+0000","last_fullsized":"2023-12-19T18:59:29.253054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:26:29.063442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.626913+0000","last_change":"2023-12-19T18:59:27.649677+0000","last_active":"2023-12-19T18:59:28.626913+0000","last_peered":"2023-12-19T18:59:28.626913+0000","last_clean":"2023-12-19T18:59:28.626913+0000","last_became_active":"2023-12-19T18:59:27.647243+0000","last_became_peered":"2023-12-19T18:59:27.647243+0000","last_unstale":"2023-12-19T18:59:28.626913+0000","last_undegraded":"2023-12-19T18:59:28.626913+0000","last_fullsized":"2023-12-19T18:59:28.626913+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:06.335328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.627452+0000","last_change":"2023-12-19T18:59:27.648386+0000","last_active":"2023-12-19T18:59:28.627452+0000","last_peered":"2023-12-19T18:59:28.627452+0000","last_clean":"2023-12-19T18:59:28.627452+0000","last_became_active":"2023-12-19T18:59:27.647869+0000","last_became_peered":"2023-12-19T18:59:27.647869+0000","last_unstale":"2023-12-19T18:59:28.627452+0000","last_undegraded":"2023-12-19T18:59:28.627452+0000","last_fullsized":"2023-12-19T18:59:28.627452+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:10.672775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.624925+0000","last_change":"2023-12-19T18:59:27.631457+0000","last_active":"2023-12-19T18:59:28.624925+0000","last_peered":"2023-12-19T18:59:28.624925+0000","last_clean":"2023-12-19T18:59:28.624925+0000","last_became_active":"2023-12-19T18:59:27.631174+0000","last_became_peered":"2023-12-19T18:59:27.631174+0000","last_unstale":"2023-12-19T18:59:28.624925+0000","last_undegraded":"2023-12-19T18:59:28.624925+0000","last_fullsized":"2023-12-19T18:59:28.624925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:55.089240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251386+0000","last_change":"2023-12-19T18:59:27.657160+0000","last_active":"2023-12-19T18:59:29.251386+0000","last_peered":"2023-12-19T18:59:29.251386+0000","last_clean":"2023-12-19T18:59:29.251386+0000","last_became_active":"2023-12-19T18:59:27.656870+0000","last_became_peered":"2023-12-19T18:59:27.656870+0000","last_unstale":"2023-12-19T18:59:29.251386+0000","last_undegraded":"2023-12-19T18:59:29.251386+0000","last_fullsized":"2023-12-19T18:59:29.251386+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:45.789974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252740+0000","last_change":"2023-12-19T18:59:27.643752+0000","last_active":"2023-12-19T18:59:29.252740+0000","last_peered":"2023-12-19T18:59:29.252740+0000","last_clean":"2023-12-19T18:59:29.252740+0000","last_became_active":"2023-12-19T18:59:27.643478+0000","last_became_peered":"2023-12-19T18:59:27.643478+0000","last_unstale":"2023-12-19T18:59:29.252740+0000","last_undegraded":"2023-12-19T18:59:29.252740+0000","last_fullsized":"2023-12-19T18:59:29.252740+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:34:10.155305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.253107+0000","last_change":"2023-12-19T18:59:27.643887+0000","last_active":"2023-12-19T18:59:29.253107+0000","last_peered":"2023-12-19T18:59:29.253107+0000","last_clean":"2023-12-19T18:59:29.253107+0000","last_became_active":"2023-12-19T18:59:27.643624+0000","last_became_peered":"2023-12-19T18:59:27.643624+0000","last_unstale":"2023-12-19T18:59:29.253107+0000","last_undegraded":"2023-12-19T18:59:29.253107+0000","last_fullsized":"2023-12-19T18:59:29.253107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:02:02.023078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252657+0000","last_change":"2023-12-19T18:59:27.645163+0000","last_active":"2023-12-19T18:59:29.252657+0000","last_peered":"2023-12-19T18:59:29.252657+0000","last_clean":"2023-12-19T18:59:29.252657+0000","last_became_active":"2023-12-19T18:59:27.644866+0000","last_became_peered":"2023-12-19T18:59:27.644866+0000","last_unstale":"2023-12-19T18:59:29.252657+0000","last_undegraded":"2023-12-19T18:59:29.252657+0000","last_fullsized":"2023-12-19T18:59:29.252657+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:47.457632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251856+0000","last_change":"2023-12-19T18:59:27.638276+0000","last_active":"2023-12-19T18:59:29.251856+0000","last_peered":"2023-12-19T18:59:29.251856+0000","last_clean":"2023-12-19T18:59:29.251856+0000","last_became_active":"2023-12-19T18:59:27.637964+0000","last_became_peered":"2023-12-19T18:59:27.637964+0000","last_unstale":"2023-12-19T18:59:29.251856+0000","last_undegraded":"2023-12-19T18:59:29.251856+0000","last_fullsized":"2023-12-19T18:59:29.251856+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:31:54.792697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.627456+0000","last_change":"2023-12-19T18:59:27.640187+0000","last_active":"2023-12-19T18:59:28.627456+0000","last_peered":"2023-12-19T18:59:28.627456+0000","last_clean":"2023-12-19T18:59:28.627456+0000","last_became_active":"2023-12-19T18:59:27.639872+0000","last_became_peered":"2023-12-19T18:59:27.639872+0000","last_unstale":"2023-12-19T18:59:28.627456+0000","last_undegraded":"2023-12-19T18:59:28.627456+0000","last_fullsized":"2023-12-19T18:59:28.627456+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:30:07.550029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.626511+0000","last_change":"2023-12-19T18:59:27.652827+0000","last_active":"2023-12-19T18:59:28.626511+0000","last_peered":"2023-12-19T18:59:28.626511+0000","last_clean":"2023-12-19T18:59:28.626511+0000","last_became_active":"2023-12-19T18:59:27.652064+0000","last_became_peered":"2023-12-19T18:59:27.652064+0000","last_unstale":"2023-12-19T18:59:28.626511+0000","last_undegraded":"2023-12-19T18:59:28.626511+0000","last_fullsized":"2023-12-19T18:59:28.626511+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:51:59.962934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252030+0000","last_change":"2023-12-19T18:59:27.652420+0000","last_active":"2023-12-19T18:59:29.252030+0000","last_peered":"2023-12-19T18:59:29.252030+0000","last_clean":"2023-12-19T18:59:29.252030+0000","last_became_active":"2023-12-19T18:59:27.651860+0000","last_became_peered":"2023-12-19T18:59:27.651860+0000","last_unstale":"2023-12-19T18:59:29.252030+0000","last_undegraded":"2023-12-19T18:59:29.252030+0000","last_fullsized":"2023-12-19T18:59:29.252030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:51.108766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.626268+0000","last_change":"2023-12-19T18:59:27.641444+0000","last_active":"2023-12-19T18:59:28.626268+0000","last_peered":"2023-12-19T18:59:28.626268+0000","last_clean":"2023-12-19T18:59:28.626268+0000","last_became_active":"2023-12-19T18:59:27.641087+0000","last_became_peered":"2023-12-19T18:59:27.641087+0000","last_unstale":"2023-12-19T18:59:28.626268+0000","last_undegraded":"2023-12-19T18:59:28.626268+0000","last_fullsized":"2023-12-19T18:59:28.626268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:43.043365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.625385+0000","last_change":"2023-12-19T18:59:27.641456+0000","last_active":"2023-12-19T18:59:28.625385+0000","last_peered":"2023-12-19T18:59:28.625385+0000","last_clean":"2023-12-19T18:59:28.625385+0000","last_became_active":"2023-12-19T18:59:27.641199+0000","last_became_peered":"2023-12-19T18:59:27.641199+0000","last_unstale":"2023-12-19T18:59:28.625385+0000","last_undegraded":"2023-12-19T18:59:28.625385+0000","last_fullsized":"2023-12-19T18:59:28.625385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:06.335328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.870753+0000","last_change":"2023-12-19T18:59:26.890655+0000","last_active":"2023-12-19T18:59:27.870753+0000","last_peered":"2023-12-19T18:59:27.870753+0000","last_clean":"2023-12-19T18:59:27.870753+0000","last_became_active":"2023-12-19T18:59:26.890346+0000","last_became_peered":"2023-12-19T18:59:26.890346+0000","last_unstale":"2023-12-19T18:59:27.870753+0000","last_undegraded":"2023-12-19T18:59:27.870753+0000","last_fullsized":"2023-12-19T18:59:27.870753+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:13:18.250528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252173+0000","last_change":"2023-12-19T18:59:27.652815+0000","last_active":"2023-12-19T18:59:29.252173+0000","last_peered":"2023-12-19T18:59:29.252173+0000","last_clean":"2023-12-19T18:59:29.252173+0000","last_became_active":"2023-12-19T18:59:27.650397+0000","last_became_peered":"2023-12-19T18:59:27.650397+0000","last_unstale":"2023-12-19T18:59:29.252173+0000","last_undegraded":"2023-12-19T18:59:29.252173+0000","last_fullsized":"2023-12-19T18:59:29.252173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:55.089240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.870740+0000","last_change":"2023-12-19T18:59:26.882004+0000","last_active":"2023-12-19T18:59:27.870740+0000","last_peered":"2023-12-19T18:59:27.870740+0000","last_clean":"2023-12-19T18:59:27.870740+0000","last_became_active":"2023-12-19T18:59:26.881700+0000","last_became_peered":"2023-12-19T18:59:26.881700+0000","last_unstale":"2023-12-19T18:59:27.870740+0000","last_undegraded":"2023-12-19T18:59:27.870740+0000","last_fullsized":"2023-12-19T18:59:27.870740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:58:48.747485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.627113+0000","last_change":"2023-12-19T18:59:27.647256+0000","last_active":"2023-12-19T18:59:28.627113+0000","last_peered":"2023-12-19T18:59:28.627113+0000","last_clean":"2023-12-19T18:59:28.627113+0000","last_became_active":"2023-12-19T18:59:27.646852+0000","last_became_peered":"2023-12-19T18:59:27.646852+0000","last_unstale":"2023-12-19T18:59:28.627113+0000","last_undegraded":"2023-12-19T18:59:28.627113+0000","last_fullsized":"2023-12-19T18:59:28.627113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:46:08.213481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.873274+0000","last_change":"2023-12-19T18:59:26.886101+0000","last_active":"2023-12-19T18:59:27.873274+0000","last_peered":"2023-12-19T18:59:27.873274+0000","last_clean":"2023-12-19T18:59:27.873274+0000","last_became_active":"2023-12-19T18:59:26.885879+0000","last_became_peered":"2023-12-19T18:59:26.885879+0000","last_unstale":"2023-12-19T18:59:27.873274+0000","last_undegraded":"2023-12-19T18:59:27.873274+0000","last_fullsized":"2023-12-19T18:59:27.873274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:33:32.469781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252769+0000","last_change":"2023-12-19T18:59:27.644566+0000","last_active":"2023-12-19T18:59:29.252769+0000","last_peered":"2023-12-19T18:59:29.252769+0000","last_clean":"2023-12-19T18:59:29.252769+0000","last_became_active":"2023-12-19T18:59:27.644305+0000","last_became_peered":"2023-12-19T18:59:27.644305+0000","last_unstale":"2023-12-19T18:59:29.252769+0000","last_undegraded":"2023-12-19T18:59:29.252769+0000","last_fullsized":"2023-12-19T18:59:29.252769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:51:59.962934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.872611+0000","last_change":"2023-12-19T18:59:26.886614+0000","last_active":"2023-12-19T18:59:27.872611+0000","last_peered":"2023-12-19T18:59:27.872611+0000","last_clean":"2023-12-19T18:59:27.872611+0000","last_became_active":"2023-12-19T18:59:26.885790+0000","last_became_peered":"2023-12-19T18:59:26.885790+0000","last_unstale":"2023-12-19T18:59:27.872611+0000","last_undegraded":"2023-12-19T18:59:27.872611+0000","last_fullsized":"2023-12-19T18:59:27.872611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:08:30.262675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.626602+0000","last_change":"2023-12-19T18:59:27.644158+0000","last_active":"2023-12-19T18:59:28.626602+0000","last_peered":"2023-12-19T18:59:28.626602+0000","last_clean":"2023-12-19T18:59:28.626602+0000","last_became_active":"2023-12-19T18:59:27.643817+0000","last_became_peered":"2023-12-19T18:59:27.643817+0000","last_unstale":"2023-12-19T18:59:28.626602+0000","last_undegraded":"2023-12-19T18:59:28.626602+0000","last_fullsized":"2023-12-19T18:59:28.626602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:33:33.472556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.873560+0000","last_change":"2023-12-19T18:59:26.877767+0000","last_active":"2023-12-19T18:59:27.873560+0000","last_peered":"2023-12-19T18:59:27.873560+0000","last_clean":"2023-12-19T18:59:27.873560+0000","last_became_active":"2023-12-19T18:59:26.877475+0000","last_became_peered":"2023-12-19T18:59:26.877475+0000","last_unstale":"2023-12-19T18:59:27.873560+0000","last_undegraded":"2023-12-19T18:59:27.873560+0000","last_fullsized":"2023-12-19T18:59:27.873560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:01.602303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251649+0000","last_change":"2023-12-19T18:59:27.651327+0000","last_active":"2023-12-19T18:59:29.251649+0000","last_peered":"2023-12-19T18:59:29.251649+0000","last_clean":"2023-12-19T18:59:29.251649+0000","last_became_active":"2023-12-19T18:59:27.650744+0000","last_became_peered":"2023-12-19T18:59:27.650744+0000","last_unstale":"2023-12-19T18:59:29.251649+0000","last_undegraded":"2023-12-19T18:59:29.251649+0000","last_fullsized":"2023-12-19T18:59:29.251649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:34:10.155305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.873597+0000","last_change":"2023-12-19T18:59:26.879513+0000","last_active":"2023-12-19T18:59:27.873597+0000","last_peered":"2023-12-19T18:59:27.873597+0000","last_clean":"2023-12-19T18:59:27.873597+0000","last_became_active":"2023-12-19T18:59:26.879190+0000","last_became_peered":"2023-12-19T18:59:26.879190+0000","last_unstale":"2023-12-19T18:59:27.873597+0000","last_undegraded":"2023-12-19T18:59:27.873597+0000","last_fullsized":"2023-12-19T18:59:27.873597+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:46:34.116596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.626716+0000","last_change":"2023-12-19T18:59:27.656486+0000","last_active":"2023-12-19T18:59:28.626716+0000","last_peered":"2023-12-19T18:59:28.626716+0000","last_clean":"2023-12-19T18:59:28.626716+0000","last_became_active":"2023-12-19T18:59:27.656254+0000","last_became_peered":"2023-12-19T18:59:27.656254+0000","last_unstale":"2023-12-19T18:59:28.626716+0000","last_undegraded":"2023-12-19T18:59:28.626716+0000","last_fullsized":"2023-12-19T18:59:28.626716+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:55.089240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.630479+0000","last_change":"2023-12-19T18:59:26.877227+0000","last_active":"2023-12-19T18:59:27.630479+0000","last_peered":"2023-12-19T18:59:27.630479+0000","last_clean":"2023-12-19T18:59:27.630479+0000","last_became_active":"2023-12-19T18:59:26.876903+0000","last_became_peered":"2023-12-19T18:59:26.876903+0000","last_unstale":"2023-12-19T18:59:27.630479+0000","last_undegraded":"2023-12-19T18:59:27.630479+0000","last_fullsized":"2023-12-19T18:59:27.630479+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:46.454857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251949+0000","last_change":"2023-12-19T18:59:27.651168+0000","last_active":"2023-12-19T18:59:29.251949+0000","last_peered":"2023-12-19T18:59:29.251949+0000","last_clean":"2023-12-19T18:59:29.251949+0000","last_became_active":"2023-12-19T18:59:27.650866+0000","last_became_peered":"2023-12-19T18:59:27.650866+0000","last_unstale":"2023-12-19T18:59:29.251949+0000","last_undegraded":"2023-12-19T18:59:29.251949+0000","last_fullsized":"2023-12-19T18:59:29.251949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:09.434914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.626288+0000","last_change":"2023-12-19T18:59:26.876597+0000","last_active":"2023-12-19T18:59:27.626288+0000","last_peered":"2023-12-19T18:59:27.626288+0000","last_clean":"2023-12-19T18:59:27.626288+0000","last_became_active":"2023-12-19T18:59:26.876270+0000","last_became_peered":"2023-12-19T18:59:26.876270+0000","last_unstale":"2023-12-19T18:59:27.626288+0000","last_undegraded":"2023-12-19T18:59:27.626288+0000","last_fullsized":"2023-12-19T18:59:27.626288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:14.142304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252407+0000","last_change":"2023-12-19T18:59:27.653287+0000","last_active":"2023-12-19T18:59:29.252407+0000","last_peered":"2023-12-19T18:59:29.252407+0000","last_clean":"2023-12-19T18:59:29.252407+0000","last_became_active":"2023-12-19T18:59:27.651740+0000","last_became_peered":"2023-12-19T18:59:27.651740+0000","last_unstale":"2023-12-19T18:59:29.252407+0000","last_undegraded":"2023-12-19T18:59:29.252407+0000","last_fullsized":"2023-12-19T18:59:29.252407+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:39.573719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.631546+0000","last_change":"2023-12-19T18:59:26.878383+0000","last_active":"2023-12-19T18:59:27.631546+0000","last_peered":"2023-12-19T18:59:27.631546+0000","last_clean":"2023-12-19T18:59:27.631546+0000","last_became_active":"2023-12-19T18:59:26.877891+0000","last_became_peered":"2023-12-19T18:59:26.877891+0000","last_unstale":"2023-12-19T18:59:27.631546+0000","last_undegraded":"2023-12-19T18:59:27.631546+0000","last_fullsized":"2023-12-19T18:59:27.631546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:34:09.152530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252846+0000","last_change":"2023-12-19T18:59:27.640667+0000","last_active":"2023-12-19T18:59:29.252846+0000","last_peered":"2023-12-19T18:59:29.252846+0000","last_clean":"2023-12-19T18:59:29.252846+0000","last_became_active":"2023-12-19T18:59:27.640256+0000","last_became_peered":"2023-12-19T18:59:27.640256+0000","last_unstale":"2023-12-19T18:59:29.252846+0000","last_undegraded":"2023-12-19T18:59:29.252846+0000","last_fullsized":"2023-12-19T18:59:29.252846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:28:27.867595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.623123+0000","last_change":"2023-12-19T18:59:26.879898+0000","last_active":"2023-12-19T18:59:27.623123+0000","last_peered":"2023-12-19T18:59:27.623123+0000","last_clean":"2023-12-19T18:59:27.623123+0000","last_became_active":"2023-12-19T18:59:26.879150+0000","last_became_peered":"2023-12-19T18:59:26.879150+0000","last_unstale":"2023-12-19T18:59:27.623123+0000","last_undegraded":"2023-12-19T18:59:27.623123+0000","last_fullsized":"2023-12-19T18:59:27.623123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:22:59.820667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.253120+0000","last_change":"2023-12-19T18:59:27.643508+0000","last_active":"2023-12-19T18:59:29.253120+0000","last_peered":"2023-12-19T18:59:29.253120+0000","last_clean":"2023-12-19T18:59:29.253120+0000","last_became_active":"2023-12-19T18:59:27.643200+0000","last_became_peered":"2023-12-19T18:59:27.643200+0000","last_unstale":"2023-12-19T18:59:29.253120+0000","last_undegraded":"2023-12-19T18:59:29.253120+0000","last_fullsized":"2023-12-19T18:59:29.253120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:50.766673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.871816+0000","last_change":"2023-12-19T18:59:26.880783+0000","last_active":"2023-12-19T18:59:27.871816+0000","last_peered":"2023-12-19T18:59:27.871816+0000","last_clean":"2023-12-19T18:59:27.871816+0000","last_became_active":"2023-12-19T18:59:26.880598+0000","last_became_peered":"2023-12-19T18:59:26.880598+0000","last_unstale":"2023-12-19T18:59:27.871816+0000","last_undegraded":"2023-12-19T18:59:27.871816+0000","last_fullsized":"2023-12-19T18:59:27.871816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:48:52.735756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251775+0000","last_change":"2023-12-19T18:59:27.655885+0000","last_active":"2023-12-19T18:59:29.251775+0000","last_peered":"2023-12-19T18:59:29.251775+0000","last_clean":"2023-12-19T18:59:29.251775+0000","last_became_active":"2023-12-19T18:59:27.650924+0000","last_became_peered":"2023-12-19T18:59:27.650924+0000","last_unstale":"2023-12-19T18:59:29.251775+0000","last_undegraded":"2023-12-19T18:59:29.251775+0000","last_fullsized":"2023-12-19T18:59:29.251775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:33:33.472556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.876829+0000","last_change":"2023-12-19T18:59:26.884311+0000","last_active":"2023-12-19T18:59:27.876829+0000","last_peered":"2023-12-19T18:59:27.876829+0000","last_clean":"2023-12-19T18:59:27.876829+0000","last_became_active":"2023-12-19T18:59:26.883965+0000","last_became_peered":"2023-12-19T18:59:26.883965+0000","last_unstale":"2023-12-19T18:59:27.876829+0000","last_undegraded":"2023-12-19T18:59:27.876829+0000","last_fullsized":"2023-12-19T18:59:27.876829+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:51:58.960159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251684+0000","last_change":"2023-12-19T18:59:27.651050+0000","last_active":"2023-12-19T18:59:29.251684+0000","last_peered":"2023-12-19T18:59:29.251684+0000","last_clean":"2023-12-19T18:59:29.251684+0000","last_became_active":"2023-12-19T18:59:27.650758+0000","last_became_peered":"2023-12-19T18:59:27.650758+0000","last_unstale":"2023-12-19T18:59:29.251684+0000","last_undegraded":"2023-12-19T18:59:29.251684+0000","last_fullsized":"2023-12-19T18:59:29.251684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:30:07.550029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.869388+0000","last_change":"2023-12-19T18:59:26.878624+0000","last_active":"2023-12-19T18:59:27.869388+0000","last_peered":"2023-12-19T18:59:27.869388+0000","last_clean":"2023-12-19T18:59:27.869388+0000","last_became_active":"2023-12-19T18:59:26.878292+0000","last_became_peered":"2023-12-19T18:59:26.878292+0000","last_unstale":"2023-12-19T18:59:27.869388+0000","last_undegraded":"2023-12-19T18:59:27.869388+0000","last_fullsized":"2023-12-19T18:59:27.869388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:22:59.820667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252540+0000","last_change":"2023-12-19T18:59:27.639693+0000","last_active":"2023-12-19T18:59:29.252540+0000","last_peered":"2023-12-19T18:59:29.252540+0000","last_clean":"2023-12-19T18:59:29.252540+0000","last_became_active":"2023-12-19T18:59:27.639369+0000","last_became_peered":"2023-12-19T18:59:27.639369+0000","last_unstale":"2023-12-19T18:59:29.252540+0000","last_undegraded":"2023-12-19T18:59:29.252540+0000","last_fullsized":"2023-12-19T18:59:29.252540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:43.891549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.634471+0000","last_change":"2023-12-19T18:59:26.885753+0000","last_active":"2023-12-19T18:59:27.634471+0000","last_peered":"2023-12-19T18:59:27.634471+0000","last_clean":"2023-12-19T18:59:27.634471+0000","last_became_active":"2023-12-19T18:59:26.885304+0000","last_became_peered":"2023-12-19T18:59:26.885304+0000","last_unstale":"2023-12-19T18:59:27.634471+0000","last_undegraded":"2023-12-19T18:59:27.634471+0000","last_fullsized":"2023-12-19T18:59:27.634471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:17.224906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.626339+0000","last_change":"2023-12-19T18:59:27.644252+0000","last_active":"2023-12-19T18:59:28.626339+0000","last_peered":"2023-12-19T18:59:28.626339+0000","last_clean":"2023-12-19T18:59:28.626339+0000","last_became_active":"2023-12-19T18:59:27.643954+0000","last_became_peered":"2023-12-19T18:59:27.643954+0000","last_unstale":"2023-12-19T18:59:28.626339+0000","last_undegraded":"2023-12-19T18:59:28.626339+0000","last_fullsized":"2023-12-19T18:59:28.626339+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:48:53.738532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.630384+0000","last_change":"2023-12-19T18:59:26.874018+0000","last_active":"2023-12-19T18:59:27.630384+0000","last_peered":"2023-12-19T18:59:27.630384+0000","last_clean":"2023-12-19T18:59:27.630384+0000","last_became_active":"2023-12-19T18:59:26.873769+0000","last_became_peered":"2023-12-19T18:59:26.873769+0000","last_unstale":"2023-12-19T18:59:27.630384+0000","last_undegraded":"2023-12-19T18:59:27.630384+0000","last_fullsized":"2023-12-19T18:59:27.630384+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:44.787198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252176+0000","last_change":"2023-12-19T18:59:27.651314+0000","last_active":"2023-12-19T18:59:29.252176+0000","last_peered":"2023-12-19T18:59:29.252176+0000","last_clean":"2023-12-19T18:59:29.252176+0000","last_became_active":"2023-12-19T18:59:27.650926+0000","last_became_peered":"2023-12-19T18:59:27.650926+0000","last_unstale":"2023-12-19T18:59:29.252176+0000","last_undegraded":"2023-12-19T18:59:29.252176+0000","last_fullsized":"2023-12-19T18:59:29.252176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:18.227682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.875408+0000","last_change":"2023-12-19T18:59:26.885293+0000","last_active":"2023-12-19T18:59:27.875408+0000","last_peered":"2023-12-19T18:59:27.875408+0000","last_clean":"2023-12-19T18:59:27.875408+0000","last_became_active":"2023-12-19T18:59:26.885020+0000","last_became_peered":"2023-12-19T18:59:26.885020+0000","last_unstale":"2023-12-19T18:59:27.875408+0000","last_undegraded":"2023-12-19T18:59:27.875408+0000","last_fullsized":"2023-12-19T18:59:27.875408+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:42.040589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.627044+0000","last_change":"2023-12-19T18:59:27.638748+0000","last_active":"2023-12-19T18:59:28.627044+0000","last_peered":"2023-12-19T18:59:28.627044+0000","last_clean":"2023-12-19T18:59:28.627044+0000","last_became_active":"2023-12-19T18:59:27.637898+0000","last_became_peered":"2023-12-19T18:59:27.637898+0000","last_unstale":"2023-12-19T18:59:28.627044+0000","last_undegraded":"2023-12-19T18:59:28.627044+0000","last_fullsized":"2023-12-19T18:59:28.627044+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:09.230491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.873431+0000","last_change":"2023-12-19T18:59:26.891254+0000","last_active":"2023-12-19T18:59:27.873431+0000","last_peered":"2023-12-19T18:59:27.873431+0000","last_clean":"2023-12-19T18:59:27.873431+0000","last_became_active":"2023-12-19T18:59:26.890803+0000","last_became_peered":"2023-12-19T18:59:26.890803+0000","last_unstale":"2023-12-19T18:59:27.873431+0000","last_undegraded":"2023-12-19T18:59:27.873431+0000","last_fullsized":"2023-12-19T18:59:27.873431+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:46:07.210705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252509+0000","last_change":"2023-12-19T18:59:27.655732+0000","last_active":"2023-12-19T18:59:29.252509+0000","last_peered":"2023-12-19T18:59:29.252509+0000","last_clean":"2023-12-19T18:59:29.252509+0000","last_became_active":"2023-12-19T18:59:27.655473+0000","last_became_peered":"2023-12-19T18:59:27.655473+0000","last_unstale":"2023-12-19T18:59:29.252509+0000","last_undegraded":"2023-12-19T18:59:29.252509+0000","last_fullsized":"2023-12-19T18:59:29.252509+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:24:42.172134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.869136+0000","last_change":"2023-12-19T18:59:26.877734+0000","last_active":"2023-12-19T18:59:27.869136+0000","last_peered":"2023-12-19T18:59:27.869136+0000","last_clean":"2023-12-19T18:59:27.869136+0000","last_became_active":"2023-12-19T18:59:26.876141+0000","last_became_peered":"2023-12-19T18:59:26.876141+0000","last_unstale":"2023-12-19T18:59:27.869136+0000","last_undegraded":"2023-12-19T18:59:27.869136+0000","last_fullsized":"2023-12-19T18:59:27.869136+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:50.105990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252294+0000","last_change":"2023-12-19T18:59:27.646416+0000","last_active":"2023-12-19T18:59:29.252294+0000","last_peered":"2023-12-19T18:59:29.252294+0000","last_clean":"2023-12-19T18:59:29.252294+0000","last_became_active":"2023-12-19T18:59:27.645875+0000","last_became_peered":"2023-12-19T18:59:27.645875+0000","last_unstale":"2023-12-19T18:59:29.252294+0000","last_undegraded":"2023-12-19T18:59:29.252294+0000","last_fullsized":"2023-12-19T18:59:29.252294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:48:53.738532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.871818+0000","last_change":"2023-12-19T18:59:26.882228+0000","last_active":"2023-12-19T18:59:27.871818+0000","last_peered":"2023-12-19T18:59:27.871818+0000","last_clean":"2023-12-19T18:59:27.871818+0000","last_became_active":"2023-12-19T18:59:26.881940+0000","last_became_peered":"2023-12-19T18:59:26.881940+0000","last_unstale":"2023-12-19T18:59:27.871818+0000","last_undegraded":"2023-12-19T18:59:27.871818+0000","last_fullsized":"2023-12-19T18:59:27.871818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:16:24.926229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.253086+0000","last_change":"2023-12-19T18:59:27.641900+0000","last_active":"2023-12-19T18:59:29.253086+0000","last_peered":"2023-12-19T18:59:29.253086+0000","last_clean":"2023-12-19T18:59:29.253086+0000","last_became_active":"2023-12-19T18:59:27.641620+0000","last_became_peered":"2023-12-19T18:59:27.641620+0000","last_unstale":"2023-12-19T18:59:29.253086+0000","last_undegraded":"2023-12-19T18:59:29.253086+0000","last_fullsized":"2023-12-19T18:59:29.253086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:15.145079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.629326+0000","last_change":"2023-12-19T18:59:26.883881+0000","last_active":"2023-12-19T18:59:27.629326+0000","last_peered":"2023-12-19T18:59:27.629326+0000","last_clean":"2023-12-19T18:59:27.629326+0000","last_became_active":"2023-12-19T18:59:26.883612+0000","last_became_peered":"2023-12-19T18:59:26.883612+0000","last_unstale":"2023-12-19T18:59:27.629326+0000","last_undegraded":"2023-12-19T18:59:27.629326+0000","last_fullsized":"2023-12-19T18:59:27.629326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:13:18.250528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252055+0000","last_change":"2023-12-19T18:59:27.645569+0000","last_active":"2023-12-19T18:59:29.252055+0000","last_peered":"2023-12-19T18:59:29.252055+0000","last_clean":"2023-12-19T18:59:29.252055+0000","last_became_active":"2023-12-19T18:59:27.645356+0000","last_became_peered":"2023-12-19T18:59:27.645356+0000","last_unstale":"2023-12-19T18:59:29.252055+0000","last_undegraded":"2023-12-19T18:59:29.252055+0000","last_fullsized":"2023-12-19T18:59:29.252055+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:17:15.950035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.874022+0000","last_change":"2023-12-19T18:59:26.887588+0000","last_active":"2023-12-19T18:59:27.874022+0000","last_peered":"2023-12-19T18:59:27.874022+0000","last_clean":"2023-12-19T18:59:27.874022+0000","last_became_active":"2023-12-19T18:59:26.887245+0000","last_became_peered":"2023-12-19T18:59:26.887245+0000","last_unstale":"2023-12-19T18:59:27.874022+0000","last_undegraded":"2023-12-19T18:59:27.874022+0000","last_fullsized":"2023-12-19T18:59:27.874022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:36:45.699332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251739+0000","last_change":"2023-12-19T18:59:27.637097+0000","last_active":"2023-12-19T18:59:29.251739+0000","last_peered":"2023-12-19T18:59:29.251739+0000","last_clean":"2023-12-19T18:59:29.251739+0000","last_became_active":"2023-12-19T18:59:27.636689+0000","last_became_peered":"2023-12-19T18:59:27.636689+0000","last_unstale":"2023-12-19T18:59:29.251739+0000","last_undegraded":"2023-12-19T18:59:29.251739+0000","last_fullsized":"2023-12-19T18:59:29.251739+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:13:32.952346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.637308+0000","last_change":"2023-12-19T18:59:26.885971+0000","last_active":"2023-12-19T18:59:27.637308+0000","last_peered":"2023-12-19T18:59:27.637308+0000","last_clean":"2023-12-19T18:59:27.637308+0000","last_became_active":"2023-12-19T18:59:26.885633+0000","last_became_peered":"2023-12-19T18:59:26.885633+0000","last_unstale":"2023-12-19T18:59:27.637308+0000","last_undegraded":"2023-12-19T18:59:27.637308+0000","last_fullsized":"2023-12-19T18:59:27.637308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:22:59.820667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251601+0000","last_change":"2023-12-19T18:59:27.637111+0000","last_active":"2023-12-19T18:59:29.251601+0000","last_peered":"2023-12-19T18:59:29.251601+0000","last_clean":"2023-12-19T18:59:29.251601+0000","last_became_active":"2023-12-19T18:59:27.636672+0000","last_became_peered":"2023-12-19T18:59:27.636672+0000","last_unstale":"2023-12-19T18:59:29.251601+0000","last_undegraded":"2023-12-19T18:59:29.251601+0000","last_fullsized":"2023-12-19T18:59:29.251601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:39:12.866107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.627644+0000","last_change":"2023-12-19T18:59:26.884674+0000","last_active":"2023-12-19T18:59:27.627644+0000","last_peered":"2023-12-19T18:59:27.627644+0000","last_clean":"2023-12-19T18:59:27.627644+0000","last_became_active":"2023-12-19T18:59:26.884402+0000","last_became_peered":"2023-12-19T18:59:26.884402+0000","last_unstale":"2023-12-19T18:59:27.627644+0000","last_undegraded":"2023-12-19T18:59:27.627644+0000","last_fullsized":"2023-12-19T18:59:27.627644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:36:45.699332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.626392+0000","last_change":"2023-12-19T18:59:27.644532+0000","last_active":"2023-12-19T18:59:28.626392+0000","last_peered":"2023-12-19T18:59:28.626392+0000","last_clean":"2023-12-19T18:59:28.626392+0000","last_became_active":"2023-12-19T18:59:27.642863+0000","last_became_peered":"2023-12-19T18:59:27.642863+0000","last_unstale":"2023-12-19T18:59:28.626392+0000","last_undegraded":"2023-12-19T18:59:28.626392+0000","last_fullsized":"2023-12-19T18:59:28.626392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:45.789974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.631580+0000","last_change":"2023-12-19T18:59:26.881655+0000","last_active":"2023-12-19T18:59:27.631580+0000","last_peered":"2023-12-19T18:59:27.631580+0000","last_clean":"2023-12-19T18:59:27.631580+0000","last_became_active":"2023-12-19T18:59:26.881378+0000","last_became_peered":"2023-12-19T18:59:26.881378+0000","last_unstale":"2023-12-19T18:59:27.631580+0000","last_undegraded":"2023-12-19T18:59:27.631580+0000","last_fullsized":"2023-12-19T18:59:27.631580+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:17.224906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.253178+0000","last_change":"2023-12-19T18:59:27.651053+0000","last_active":"2023-12-19T18:59:29.253178+0000","last_peered":"2023-12-19T18:59:29.253178+0000","last_clean":"2023-12-19T18:59:29.253178+0000","last_became_active":"2023-12-19T18:59:27.650721+0000","last_became_peered":"2023-12-19T18:59:27.650721+0000","last_unstale":"2023-12-19T18:59:29.253178+0000","last_undegraded":"2023-12-19T18:59:29.253178+0000","last_fullsized":"2023-12-19T18:59:29.253178+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:36:10.546639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.871729+0000","last_change":"2023-12-19T18:59:26.879375+0000","last_active":"2023-12-19T18:59:27.871729+0000","last_peered":"2023-12-19T18:59:27.871729+0000","last_clean":"2023-12-19T18:59:27.871729+0000","last_became_active":"2023-12-19T18:59:26.879043+0000","last_became_peered":"2023-12-19T18:59:26.879043+0000","last_unstale":"2023-12-19T18:59:27.871729+0000","last_undegraded":"2023-12-19T18:59:27.871729+0000","last_fullsized":"2023-12-19T18:59:27.871729+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:09.669999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252479+0000","last_change":"2023-12-19T18:59:27.655676+0000","last_active":"2023-12-19T18:59:29.252479+0000","last_peered":"2023-12-19T18:59:29.252479+0000","last_clean":"2023-12-19T18:59:29.252479+0000","last_became_active":"2023-12-19T18:59:27.655392+0000","last_became_peered":"2023-12-19T18:59:27.655392+0000","last_unstale":"2023-12-19T18:59:29.252479+0000","last_undegraded":"2023-12-19T18:59:29.252479+0000","last_fullsized":"2023-12-19T18:59:29.252479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:43.891549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.623263+0000","last_change":"2023-12-19T18:59:26.887521+0000","last_active":"2023-12-19T18:59:27.623263+0000","last_peered":"2023-12-19T18:59:27.623263+0000","last_clean":"2023-12-19T18:59:27.623263+0000","last_became_active":"2023-12-19T18:59:26.887126+0000","last_became_peered":"2023-12-19T18:59:26.887126+0000","last_unstale":"2023-12-19T18:59:27.623263+0000","last_undegraded":"2023-12-19T18:59:27.623263+0000","last_fullsized":"2023-12-19T18:59:27.623263+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:50.105990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.625410+0000","last_change":"2023-12-19T18:59:27.641166+0000","last_active":"2023-12-19T18:59:28.625410+0000","last_peered":"2023-12-19T18:59:28.625410+0000","last_clean":"2023-12-19T18:59:28.625410+0000","last_became_active":"2023-12-19T18:59:27.640863+0000","last_became_peered":"2023-12-19T18:59:27.640863+0000","last_unstale":"2023-12-19T18:59:28.625410+0000","last_undegraded":"2023-12-19T18:59:28.625410+0000","last_fullsized":"2023-12-19T18:59:28.625410+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:09.230491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.635004+0000","last_change":"2023-12-19T18:59:26.889176+0000","last_active":"2023-12-19T18:59:27.635004+0000","last_peered":"2023-12-19T18:59:27.635004+0000","last_clean":"2023-12-19T18:59:27.635004+0000","last_became_active":"2023-12-19T18:59:26.887785+0000","last_became_peered":"2023-12-19T18:59:26.887785+0000","last_unstale":"2023-12-19T18:59:27.635004+0000","last_undegraded":"2023-12-19T18:59:27.635004+0000","last_fullsized":"2023-12-19T18:59:27.635004+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:08.227715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252056+0000","last_change":"2023-12-19T18:59:27.646888+0000","last_active":"2023-12-19T18:59:29.252056+0000","last_peered":"2023-12-19T18:59:29.252056+0000","last_clean":"2023-12-19T18:59:29.252056+0000","last_became_active":"2023-12-19T18:59:27.646582+0000","last_became_peered":"2023-12-19T18:59:27.646582+0000","last_unstale":"2023-12-19T18:59:29.252056+0000","last_undegraded":"2023-12-19T18:59:29.252056+0000","last_fullsized":"2023-12-19T18:59:29.252056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:16:25.929004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.623064+0000","last_change":"2023-12-19T18:59:26.879579+0000","last_active":"2023-12-19T18:59:27.623064+0000","last_peered":"2023-12-19T18:59:27.623064+0000","last_clean":"2023-12-19T18:59:27.623064+0000","last_became_active":"2023-12-19T18:59:26.879235+0000","last_became_peered":"2023-12-19T18:59:26.879235+0000","last_unstale":"2023-12-19T18:59:27.623064+0000","last_undegraded":"2023-12-19T18:59:27.623064+0000","last_fullsized":"2023-12-19T18:59:27.623064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:46:34.116596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.625152+0000","last_change":"2023-12-19T18:59:27.647349+0000","last_active":"2023-12-19T18:59:28.625152+0000","last_peered":"2023-12-19T18:59:28.625152+0000","last_clean":"2023-12-19T18:59:28.625152+0000","last_became_active":"2023-12-19T18:59:27.646832+0000","last_became_peered":"2023-12-19T18:59:27.646832+0000","last_unstale":"2023-12-19T18:59:28.625152+0000","last_undegraded":"2023-12-19T18:59:28.625152+0000","last_fullsized":"2023-12-19T18:59:28.625152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:18.227682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.634605+0000","last_change":"2023-12-19T18:59:26.889247+0000","last_active":"2023-12-19T18:59:27.634605+0000","last_peered":"2023-12-19T18:59:27.634605+0000","last_clean":"2023-12-19T18:59:27.634605+0000","last_became_active":"2023-12-19T18:59:26.888058+0000","last_became_peered":"2023-12-19T18:59:26.888058+0000","last_unstale":"2023-12-19T18:59:27.634605+0000","last_undegraded":"2023-12-19T18:59:27.634605+0000","last_fullsized":"2023-12-19T18:59:27.634605+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:05.332552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251764+0000","last_change":"2023-12-19T18:59:27.640476+0000","last_active":"2023-12-19T18:59:29.251764+0000","last_peered":"2023-12-19T18:59:29.251764+0000","last_clean":"2023-12-19T18:59:29.251764+0000","last_became_active":"2023-12-19T18:59:27.639994+0000","last_became_peered":"2023-12-19T18:59:27.639994+0000","last_unstale":"2023-12-19T18:59:29.251764+0000","last_undegraded":"2023-12-19T18:59:29.251764+0000","last_fullsized":"2023-12-19T18:59:29.251764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:31:54.792697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.627781+0000","last_change":"2023-12-19T18:59:26.875167+0000","last_active":"2023-12-19T18:59:27.627781+0000","last_peered":"2023-12-19T18:59:27.627781+0000","last_clean":"2023-12-19T18:59:27.627781+0000","last_became_active":"2023-12-19T18:59:26.874253+0000","last_became_peered":"2023-12-19T18:59:26.874253+0000","last_unstale":"2023-12-19T18:59:27.627781+0000","last_undegraded":"2023-12-19T18:59:27.627781+0000","last_fullsized":"2023-12-19T18:59:27.627781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:58:48.747485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.626841+0000","last_change":"2023-12-19T18:59:27.636584+0000","last_active":"2023-12-19T18:59:28.626841+0000","last_peered":"2023-12-19T18:59:28.626841+0000","last_clean":"2023-12-19T18:59:28.626841+0000","last_became_active":"2023-12-19T18:59:27.636367+0000","last_became_peered":"2023-12-19T18:59:27.636367+0000","last_unstale":"2023-12-19T18:59:28.626841+0000","last_undegraded":"2023-12-19T18:59:28.626841+0000","last_fullsized":"2023-12-19T18:59:28.626841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:18.227682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.628819+0000","last_change":"2023-12-19T18:59:26.874040+0000","last_active":"2023-12-19T18:59:27.628819+0000","last_peered":"2023-12-19T18:59:27.628819+0000","last_clean":"2023-12-19T18:59:27.628819+0000","last_became_active":"2023-12-19T18:59:26.873816+0000","last_became_peered":"2023-12-19T18:59:26.873816+0000","last_unstale":"2023-12-19T18:59:27.628819+0000","last_undegraded":"2023-12-19T18:59:27.628819+0000","last_fullsized":"2023-12-19T18:59:27.628819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:08.432139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.627147+0000","last_change":"2023-12-19T18:59:27.638695+0000","last_active":"2023-12-19T18:59:28.627147+0000","last_peered":"2023-12-19T18:59:28.627147+0000","last_clean":"2023-12-19T18:59:28.627147+0000","last_became_active":"2023-12-19T18:59:27.638392+0000","last_became_peered":"2023-12-19T18:59:27.638392+0000","last_unstale":"2023-12-19T18:59:28.627147+0000","last_undegraded":"2023-12-19T18:59:28.627147+0000","last_fullsized":"2023-12-19T18:59:28.627147+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:31:54.792697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.637132+0000","last_change":"2023-12-19T18:59:26.886139+0000","last_active":"2023-12-19T18:59:27.637132+0000","last_peered":"2023-12-19T18:59:27.637132+0000","last_clean":"2023-12-19T18:59:27.637132+0000","last_became_active":"2023-12-19T18:59:26.885752+0000","last_became_peered":"2023-12-19T18:59:26.885752+0000","last_unstale":"2023-12-19T18:59:27.637132+0000","last_undegraded":"2023-12-19T18:59:27.637132+0000","last_fullsized":"2023-12-19T18:59:27.637132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:01.602303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":176,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.628325+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T18:59:27.628325+0000","last_peered":"2023-12-19T18:59:27.628325+0000","last_clean":"2023-12-19T18:59:27.628325+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T18:59:27.628325+0000","last_undegraded":"2023-12-19T18:59:27.628325+0000","last_fullsized":"2023-12-19T18:59:27.628325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":946176,"data_stored":724560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":135736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":134172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":135736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":4.2000000000000002,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":7.7320000000000002,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.31}]},{"osd":2,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.9129999999999998,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.4720000000000004,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.36199999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":7.8399999999999999,"5min":7.8399999999999999,"15min":7.8399999999999999},"last":0.433},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":7.7949999999999999,"5min":7.7949999999999999,"15min":7.7949999999999999},"last":0.39700000000000002}]},{"osd":4,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":4.2690000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":4.2910000000000004,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.51500000000000001}]},{"osd":5,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":4.3490000000000002,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":4.2480000000000002,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.61099999999999999}]},{"osd":6,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":4.1609999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.3099999999999996,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.52700000000000002}]},{"osd":7,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":4.3310000000000004,"5min":4.3310000000000004,"15min":4.3310000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":4.226,"5min":4.226,"15min":4.226},"last":0.499}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":937984,"data_stored":723451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.57999999999999996}]},{"osd":2,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.54700000000000004}]},{"osd":3,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.63800000000000001}]},{"osd":4,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.93700000000000006}]},{"osd":5,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.752},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.91700000000000004}]},{"osd":6,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.81100000000000005}]},{"osd":7,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.98099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T18:59:36.477 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T18:59:36.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.619+0000 7f16f1017640 1 Processor -- start 2023-12-19T18:59:36.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.619+0000 7f16f1017640 1 -- start start 2023-12-19T18:59:36.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.619+0000 7f16f1017640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16ec0c4100 0x7f16ec0c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:36.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.619+0000 7f16f1017640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f16ec0c06d0 0x7f16ec0a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:36.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.619+0000 7f16f1017640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ec0c31c0 con 0x7f16ec0c63c0 2023-12-19T18:59:36.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.619+0000 7f16f1017640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ec0c34a0 con 0x7f16ec0c06d0 2023-12-19T18:59:36.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.619+0000 7f16f1017640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec0c1030 con 0x7f16ec0c4100 2023-12-19T18:59:36.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.619+0000 7f16eb59e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f16ec0c06d0 0x7f16ec0a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:36.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.619+0000 7f16e3fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16ec0c4100 0x7f16ec0c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:36.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.619+0000 7f16ead9d640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f16ec0c63c0 0x7f16ec0c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:49152/0 (socket says 172.21.15.133:49152) 2023-12-19T18:59:36.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.619+0000 7f16ead9d640 1 -- 172.21.15.133:0/1546090190 learned_addr learned my addr 172.21.15.133:0/1546090190 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:36.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.623+0000 7f16eb59e640 1 -- 172.21.15.133:0/1546090190 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16ec0c4100 msgr2=0x7f16ec0c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:36.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.623+0000 7f16eb59e640 1 --2- 172.21.15.133:0/1546090190 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16ec0c4100 0x7f16ec0c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:36.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.623+0000 7f16eb59e640 1 -- 172.21.15.133:0/1546090190 >> v1:172.21.15.138:6789/0 conn(0x7f16ec0c63c0 legacy=0x7f16ec0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:36.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.623+0000 7f16eb59e640 1 -- 172.21.15.133:0/1546090190 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec0c1310 con 0x7f16ec0c06d0 2023-12-19T18:59:36.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.623+0000 7f16eb59e640 1 --2- 172.21.15.133:0/1546090190 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16ec0c06d0 0x7f16ec0a9680 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009d90 tx=0x7f16e401c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac983909c9331779 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:36.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.623+0000 7f16ea59c640 1 -- 172.21.15.133:0/1546090190 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16ec0aa3d0 con 0x7f16ec0c06d0 2023-12-19T18:59:36.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.623+0000 7f16ea59c640 1 -- 172.21.15.133:0/1546090190 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e40a5800 con 0x7f16ec0c06d0 2023-12-19T18:59:36.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.623+0000 7f16ea59c640 1 -- 172.21.15.133:0/1546090190 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e40a5b90 con 0x7f16ec0c06d0 2023-12-19T18:59:36.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.623+0000 7f16f1017640 1 -- 172.21.15.133:0/1546090190 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16ec0c06d0 msgr2=0x7f16ec0a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:36.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.623+0000 7f16f1017640 1 --2- 172.21.15.133:0/1546090190 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16ec0c06d0 0x7f16ec0a9680 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f16e4009d90 tx=0x7f16e401c830 comp rx=0 tx=0).stop 2023-12-19T18:59:36.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16f1017640 1 -- 172.21.15.133:0/1546090190 shutdown_connections 2023-12-19T18:59:36.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16f1017640 1 --2- 172.21.15.133:0/1546090190 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16ec0c06d0 0x7f16ec0a9680 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:36.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16f1017640 1 --2- 172.21.15.133:0/1546090190 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16ec0c4100 0x7f16ec0c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:36.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16f1017640 1 -- 172.21.15.133:0/1546090190 >> 172.21.15.133:0/1546090190 conn(0x7f16ec06a5b0 msgr2=0x7f16ec06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:36.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16f1017640 1 -- 172.21.15.133:0/1546090190 shutdown_connections 2023-12-19T18:59:36.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16f1017640 1 -- 172.21.15.133:0/1546090190 wait complete. 2023-12-19T18:59:36.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16f1017640 1 Processor -- start 2023-12-19T18:59:36.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16f1017640 1 -- start start 2023-12-19T18:59:36.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16f1017640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16ec0c06d0 0x7f16ec0a41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:36.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16f1017640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec0c4100 0x7f16ec0bb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:36.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16f1017640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16ec0c63c0 0x7f16ec0bf310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:36.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16f1017640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec1ee100 con 0x7f16ec0c4100 2023-12-19T18:59:36.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16f1017640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec1ee9a0 con 0x7f16ec0c06d0 2023-12-19T18:59:36.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16f1017640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec0beef0 con 0x7f16ec0c63c0 2023-12-19T18:59:36.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16e3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec0c4100 0x7f16ec0bb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:36.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16e3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec0c4100 0x7f16ec0bb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38374/0 (socket says 172.21.15.133:38374) 2023-12-19T18:59:36.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16e3fff640 1 -- 172.21.15.133:0/3535444199 learned_addr learned my addr 172.21.15.133:0/3535444199 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:36.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16eb59e640 1 --2- 172.21.15.133:0/3535444199 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16ec0c63c0 0x7f16ec0bf310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:36.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16ead9d640 1 --2- 172.21.15.133:0/3535444199 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16ec0c06d0 0x7f16ec0a41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:36.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16e3fff640 1 -- 172.21.15.133:0/3535444199 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16ec0c63c0 msgr2=0x7f16ec0bf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:36.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16e3fff640 1 --2- 172.21.15.133:0/3535444199 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16ec0c63c0 0x7f16ec0bf310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:36.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16e3fff640 1 -- 172.21.15.133:0/3535444199 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16ec0c06d0 msgr2=0x7f16ec0a41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:36.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16e3fff640 1 --2- 172.21.15.133:0/3535444199 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16ec0c06d0 0x7f16ec0a41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:36.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16e3fff640 1 -- 172.21.15.133:0/3535444199 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e4009a70 con 0x7f16ec0c4100 2023-12-19T18:59:36.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.627+0000 7f16e3fff640 1 --2- 172.21.15.133:0/3535444199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec0c4100 0x7f16ec0bb6d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f16d400e900 tx=0x7f16d400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:36.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.631+0000 7f16e37fe640 1 -- 172.21.15.133:0/3535444199 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d4009690 con 0x7f16ec0c4100 2023-12-19T18:59:36.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.631+0000 7f16e37fe640 1 -- 172.21.15.133:0/3535444199 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d400ca00 con 0x7f16ec0c4100 2023-12-19T18:59:36.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.631+0000 7f16f1017640 1 -- 172.21.15.133:0/3535444199 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ec0a47c0 con 0x7f16ec0c4100 2023-12-19T18:59:36.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.631+0000 7f16e37fe640 1 -- 172.21.15.133:0/3535444199 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d400cd90 con 0x7f16ec0c4100 2023-12-19T18:59:36.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.631+0000 7f16f1017640 1 -- 172.21.15.133:0/3535444199 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ec1ee630 con 0x7f16ec0c4100 2023-12-19T18:59:36.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.631+0000 7f16f1017640 1 -- 172.21.15.133:0/3535444199 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ec068400 con 0x7f16ec0c4100 2023-12-19T18:59:36.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.631+0000 7f16e37fe640 1 -- 172.21.15.133:0/3535444199 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f16d4013470 con 0x7f16ec0c4100 2023-12-19T18:59:36.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.631+0000 7f16e37fe640 1 --2- 172.21.15.133:0/3535444199 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f16cc0664a0 0x7f16cc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:36.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.631+0000 7f16e37fe640 1 -- 172.21.15.133:0/3535444199 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16d4083ee0 con 0x7f16ec0c4100 2023-12-19T18:59:36.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.631+0000 7f16ead9d640 1 --2- 172.21.15.133:0/3535444199 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f16cc0664a0 0x7f16cc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:36.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.635+0000 7f16ead9d640 1 --2- 172.21.15.133:0/3535444199 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f16cc0664a0 0x7f16cc068960 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f16dc005890 tx=0x7f16dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:36.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.635+0000 7f16e37fe640 1 -- 172.21.15.133:0/3535444199 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f16d40514a0 con 0x7f16ec0c4100 2023-12-19T18:59:36.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.783+0000 7f16f1017640 1 -- 172.21.15.133:0/3535444199 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f16ec0c04b0 con 0x7f16cc0664a0 2023-12-19T18:59:36.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.791+0000 7f16e37fe640 1 -- 172.21.15.133:0/3535444199 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271138 (secure 0 0 0) 0x7f16ec0c04b0 con 0x7f16cc0664a0 2023-12-19T18:59:36.800 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:36.801 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T18:59:36.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.795+0000 7f16f1017640 1 -- 172.21.15.133:0/3535444199 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f16cc0664a0 msgr2=0x7f16cc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:36.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.795+0000 7f16f1017640 1 --2- 172.21.15.133:0/3535444199 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f16cc0664a0 0x7f16cc068960 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f16dc005890 tx=0x7f16dc009040 comp rx=0 tx=0).stop 2023-12-19T18:59:36.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.795+0000 7f16f1017640 1 -- 172.21.15.133:0/3535444199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec0c4100 msgr2=0x7f16ec0bb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:36.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.795+0000 7f16f1017640 1 --2- 172.21.15.133:0/3535444199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec0c4100 0x7f16ec0bb6d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f16d400e900 tx=0x7f16d400edc0 comp rx=0 tx=0).stop 2023-12-19T18:59:36.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.795+0000 7f16f1017640 1 -- 172.21.15.133:0/3535444199 shutdown_connections 2023-12-19T18:59:36.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.795+0000 7f16f1017640 1 --2- 172.21.15.133:0/3535444199 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f16cc0664a0 0x7f16cc068960 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:36.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.795+0000 7f16f1017640 1 --2- 172.21.15.133:0/3535444199 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16ec0c63c0 0x7f16ec0bf310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:36.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.795+0000 7f16f1017640 1 --2- 172.21.15.133:0/3535444199 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec0c4100 0x7f16ec0bb6d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:36.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.795+0000 7f16f1017640 1 --2- 172.21.15.133:0/3535444199 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16ec0c06d0 0x7f16ec0a41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:36.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.795+0000 7f16f1017640 1 -- 172.21.15.133:0/3535444199 >> 172.21.15.133:0/3535444199 conn(0x7f16ec06a5b0 msgr2=0x7f16ec1553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:36.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.795+0000 7f16f1017640 1 -- 172.21.15.133:0/3535444199 shutdown_connections 2023-12-19T18:59:36.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:36.795+0000 7f16f1017640 1 -- 172.21.15.133:0/3535444199 wait complete. 2023-12-19T18:59:36.820 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-12-19T18:59:34.843328+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220100,"kb_used_data":3940,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754620,"statfs":{"total":773094113280,"available":772868730880,"internally_reserved":0,"allocated":4034560,"data_stored":2257353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.984204"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252167+0000","last_change":"2023-12-19T18:59:27.658988+0000","last_active":"2023-12-19T18:59:29.252167+0000","last_peered":"2023-12-19T18:59:29.252167+0000","last_clean":"2023-12-19T18:59:29.252167+0000","last_became_active":"2023-12-19T18:59:27.658688+0000","last_became_peered":"2023-12-19T18:59:27.658688+0000","last_unstale":"2023-12-19T18:59:29.252167+0000","last_undegraded":"2023-12-19T18:59:29.252167+0000","last_fullsized":"2023-12-19T18:59:29.252167+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:58:40.962863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.253209+0000","last_change":"2023-12-19T18:59:27.643020+0000","last_active":"2023-12-19T18:59:29.253209+0000","last_peered":"2023-12-19T18:59:29.253209+0000","last_clean":"2023-12-19T18:59:29.253209+0000","last_became_active":"2023-12-19T18:59:27.640017+0000","last_became_peered":"2023-12-19T18:59:27.640017+0000","last_unstale":"2023-12-19T18:59:29.253209+0000","last_undegraded":"2023-12-19T18:59:29.253209+0000","last_fullsized":"2023-12-19T18:59:29.253209+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:35.855173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251977+0000","last_change":"2023-12-19T18:59:27.652238+0000","last_active":"2023-12-19T18:59:29.251977+0000","last_peered":"2023-12-19T18:59:29.251977+0000","last_clean":"2023-12-19T18:59:29.251977+0000","last_became_active":"2023-12-19T18:59:27.650827+0000","last_became_peered":"2023-12-19T18:59:27.650827+0000","last_unstale":"2023-12-19T18:59:29.251977+0000","last_undegraded":"2023-12-19T18:59:29.251977+0000","last_fullsized":"2023-12-19T18:59:29.251977+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:39.959895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252155+0000","last_change":"2023-12-19T18:59:27.646579+0000","last_active":"2023-12-19T18:59:29.252155+0000","last_peered":"2023-12-19T18:59:29.252155+0000","last_clean":"2023-12-19T18:59:29.252155+0000","last_became_active":"2023-12-19T18:59:27.646163+0000","last_became_peered":"2023-12-19T18:59:27.646163+0000","last_unstale":"2023-12-19T18:59:29.252155+0000","last_undegraded":"2023-12-19T18:59:29.252155+0000","last_fullsized":"2023-12-19T18:59:29.252155+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:43.043365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251623+0000","last_change":"2023-12-19T18:59:27.647319+0000","last_active":"2023-12-19T18:59:29.251623+0000","last_peered":"2023-12-19T18:59:29.251623+0000","last_clean":"2023-12-19T18:59:29.251623+0000","last_became_active":"2023-12-19T18:59:27.646986+0000","last_became_peered":"2023-12-19T18:59:27.646986+0000","last_unstale":"2023-12-19T18:59:29.251623+0000","last_undegraded":"2023-12-19T18:59:29.251623+0000","last_fullsized":"2023-12-19T18:59:29.251623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:11.488595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252397+0000","last_change":"2023-12-19T18:59:27.646289+0000","last_active":"2023-12-19T18:59:29.252397+0000","last_peered":"2023-12-19T18:59:29.252397+0000","last_clean":"2023-12-19T18:59:29.252397+0000","last_became_active":"2023-12-19T18:59:27.645922+0000","last_became_peered":"2023-12-19T18:59:27.645922+0000","last_unstale":"2023-12-19T18:59:29.252397+0000","last_undegraded":"2023-12-19T18:59:29.252397+0000","last_fullsized":"2023-12-19T18:59:29.252397+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:39.959895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.626501+0000","last_change":"2023-12-19T18:59:27.644547+0000","last_active":"2023-12-19T18:59:28.626501+0000","last_peered":"2023-12-19T18:59:28.626501+0000","last_clean":"2023-12-19T18:59:28.626501+0000","last_became_active":"2023-12-19T18:59:27.643524+0000","last_became_peered":"2023-12-19T18:59:27.643524+0000","last_unstale":"2023-12-19T18:59:28.626501+0000","last_undegraded":"2023-12-19T18:59:28.626501+0000","last_fullsized":"2023-12-19T18:59:28.626501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:34:10.155305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.626180+0000","last_change":"2023-12-19T18:59:27.636005+0000","last_active":"2023-12-19T18:59:28.626180+0000","last_peered":"2023-12-19T18:59:28.626180+0000","last_clean":"2023-12-19T18:59:28.626180+0000","last_became_active":"2023-12-19T18:59:27.635717+0000","last_became_peered":"2023-12-19T18:59:27.635717+0000","last_unstale":"2023-12-19T18:59:28.626180+0000","last_undegraded":"2023-12-19T18:59:28.626180+0000","last_fullsized":"2023-12-19T18:59:28.626180+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:09.434914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.627562+0000","last_change":"2023-12-19T18:59:27.644087+0000","last_active":"2023-12-19T18:59:28.627562+0000","last_peered":"2023-12-19T18:59:28.627562+0000","last_clean":"2023-12-19T18:59:28.627562+0000","last_became_active":"2023-12-19T18:59:27.643699+0000","last_became_peered":"2023-12-19T18:59:27.643699+0000","last_unstale":"2023-12-19T18:59:28.627562+0000","last_undegraded":"2023-12-19T18:59:28.627562+0000","last_fullsized":"2023-12-19T18:59:28.627562+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:09.434914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252473+0000","last_change":"2023-12-19T18:59:27.652530+0000","last_active":"2023-12-19T18:59:29.252473+0000","last_peered":"2023-12-19T18:59:29.252473+0000","last_clean":"2023-12-19T18:59:29.252473+0000","last_became_active":"2023-12-19T18:59:27.652274+0000","last_became_peered":"2023-12-19T18:59:27.652274+0000","last_unstale":"2023-12-19T18:59:29.252473+0000","last_undegraded":"2023-12-19T18:59:29.252473+0000","last_fullsized":"2023-12-19T18:59:29.252473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:45.789974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.627491+0000","last_change":"2023-12-19T18:59:27.641187+0000","last_active":"2023-12-19T18:59:28.627491+0000","last_peered":"2023-12-19T18:59:28.627491+0000","last_clean":"2023-12-19T18:59:28.627491+0000","last_became_active":"2023-12-19T18:59:27.640792+0000","last_became_peered":"2023-12-19T18:59:27.640792+0000","last_unstale":"2023-12-19T18:59:28.627491+0000","last_undegraded":"2023-12-19T18:59:28.627491+0000","last_fullsized":"2023-12-19T18:59:28.627491+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:39.959895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251702+0000","last_change":"2023-12-19T18:59:27.654938+0000","last_active":"2023-12-19T18:59:29.251702+0000","last_peered":"2023-12-19T18:59:29.251702+0000","last_clean":"2023-12-19T18:59:29.251702+0000","last_became_active":"2023-12-19T18:59:27.651744+0000","last_became_peered":"2023-12-19T18:59:27.651744+0000","last_unstale":"2023-12-19T18:59:29.251702+0000","last_undegraded":"2023-12-19T18:59:29.251702+0000","last_fullsized":"2023-12-19T18:59:29.251702+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:51:59.962934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251676+0000","last_change":"2023-12-19T18:59:27.639769+0000","last_active":"2023-12-19T18:59:29.251676+0000","last_peered":"2023-12-19T18:59:29.251676+0000","last_clean":"2023-12-19T18:59:29.251676+0000","last_became_active":"2023-12-19T18:59:27.639419+0000","last_became_peered":"2023-12-19T18:59:27.639419+0000","last_unstale":"2023-12-19T18:59:29.251676+0000","last_undegraded":"2023-12-19T18:59:29.251676+0000","last_fullsized":"2023-12-19T18:59:29.251676+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:05:06.848164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252462+0000","last_change":"2023-12-19T18:59:27.634853+0000","last_active":"2023-12-19T18:59:29.252462+0000","last_peered":"2023-12-19T18:59:29.252462+0000","last_clean":"2023-12-19T18:59:29.252462+0000","last_became_active":"2023-12-19T18:59:27.634599+0000","last_became_peered":"2023-12-19T18:59:27.634599+0000","last_unstale":"2023-12-19T18:59:29.252462+0000","last_undegraded":"2023-12-19T18:59:29.252462+0000","last_fullsized":"2023-12-19T18:59:29.252462+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:39.573719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251524+0000","last_change":"2023-12-19T18:59:27.657564+0000","last_active":"2023-12-19T18:59:29.251524+0000","last_peered":"2023-12-19T18:59:29.251524+0000","last_clean":"2023-12-19T18:59:29.251524+0000","last_became_active":"2023-12-19T18:59:27.657243+0000","last_became_peered":"2023-12-19T18:59:27.657243+0000","last_unstale":"2023-12-19T18:59:29.251524+0000","last_undegraded":"2023-12-19T18:59:29.251524+0000","last_fullsized":"2023-12-19T18:59:29.251524+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:47.457632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.626441+0000","last_change":"2023-12-19T18:59:27.642841+0000","last_active":"2023-12-19T18:59:28.626441+0000","last_peered":"2023-12-19T18:59:28.626441+0000","last_clean":"2023-12-19T18:59:28.626441+0000","last_became_active":"2023-12-19T18:59:27.642539+0000","last_became_peered":"2023-12-19T18:59:27.642539+0000","last_unstale":"2023-12-19T18:59:28.626441+0000","last_undegraded":"2023-12-19T18:59:28.626441+0000","last_fullsized":"2023-12-19T18:59:28.626441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:47.457632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.627834+0000","last_change":"2023-12-19T18:59:27.656306+0000","last_active":"2023-12-19T18:59:28.627834+0000","last_peered":"2023-12-19T18:59:28.627834+0000","last_clean":"2023-12-19T18:59:28.627834+0000","last_became_active":"2023-12-19T18:59:27.652701+0000","last_became_peered":"2023-12-19T18:59:27.652701+0000","last_unstale":"2023-12-19T18:59:28.627834+0000","last_undegraded":"2023-12-19T18:59:28.627834+0000","last_fullsized":"2023-12-19T18:59:28.627834+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:39.573719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252983+0000","last_change":"2023-12-19T18:59:27.643312+0000","last_active":"2023-12-19T18:59:29.252983+0000","last_peered":"2023-12-19T18:59:29.252983+0000","last_clean":"2023-12-19T18:59:29.252983+0000","last_became_active":"2023-12-19T18:59:27.642580+0000","last_became_peered":"2023-12-19T18:59:27.642580+0000","last_unstale":"2023-12-19T18:59:29.252983+0000","last_undegraded":"2023-12-19T18:59:29.252983+0000","last_fullsized":"2023-12-19T18:59:29.252983+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:26:27.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252737+0000","last_change":"2023-12-19T18:59:27.641655+0000","last_active":"2023-12-19T18:59:29.252737+0000","last_peered":"2023-12-19T18:59:29.252737+0000","last_clean":"2023-12-19T18:59:29.252737+0000","last_became_active":"2023-12-19T18:59:27.641399+0000","last_became_peered":"2023-12-19T18:59:27.641399+0000","last_unstale":"2023-12-19T18:59:29.252737+0000","last_undegraded":"2023-12-19T18:59:29.252737+0000","last_fullsized":"2023-12-19T18:59:29.252737+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:24:42.172134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.253054+0000","last_change":"2023-12-19T18:59:27.651935+0000","last_active":"2023-12-19T18:59:29.253054+0000","last_peered":"2023-12-19T18:59:29.253054+0000","last_clean":"2023-12-19T18:59:29.253054+0000","last_became_active":"2023-12-19T18:59:27.650665+0000","last_became_peered":"2023-12-19T18:59:27.650665+0000","last_unstale":"2023-12-19T18:59:29.253054+0000","last_undegraded":"2023-12-19T18:59:29.253054+0000","last_fullsized":"2023-12-19T18:59:29.253054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:26:29.063442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.626913+0000","last_change":"2023-12-19T18:59:27.649677+0000","last_active":"2023-12-19T18:59:28.626913+0000","last_peered":"2023-12-19T18:59:28.626913+0000","last_clean":"2023-12-19T18:59:28.626913+0000","last_became_active":"2023-12-19T18:59:27.647243+0000","last_became_peered":"2023-12-19T18:59:27.647243+0000","last_unstale":"2023-12-19T18:59:28.626913+0000","last_undegraded":"2023-12-19T18:59:28.626913+0000","last_fullsized":"2023-12-19T18:59:28.626913+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:06.335328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.627452+0000","last_change":"2023-12-19T18:59:27.648386+0000","last_active":"2023-12-19T18:59:28.627452+0000","last_peered":"2023-12-19T18:59:28.627452+0000","last_clean":"2023-12-19T18:59:28.627452+0000","last_became_active":"2023-12-19T18:59:27.647869+0000","last_became_peered":"2023-12-19T18:59:27.647869+0000","last_unstale":"2023-12-19T18:59:28.627452+0000","last_undegraded":"2023-12-19T18:59:28.627452+0000","last_fullsized":"2023-12-19T18:59:28.627452+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:10.672775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.624925+0000","last_change":"2023-12-19T18:59:27.631457+0000","last_active":"2023-12-19T18:59:28.624925+0000","last_peered":"2023-12-19T18:59:28.624925+0000","last_clean":"2023-12-19T18:59:28.624925+0000","last_became_active":"2023-12-19T18:59:27.631174+0000","last_became_peered":"2023-12-19T18:59:27.631174+0000","last_unstale":"2023-12-19T18:59:28.624925+0000","last_undegraded":"2023-12-19T18:59:28.624925+0000","last_fullsized":"2023-12-19T18:59:28.624925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:55.089240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251386+0000","last_change":"2023-12-19T18:59:27.657160+0000","last_active":"2023-12-19T18:59:29.251386+0000","last_peered":"2023-12-19T18:59:29.251386+0000","last_clean":"2023-12-19T18:59:29.251386+0000","last_became_active":"2023-12-19T18:59:27.656870+0000","last_became_peered":"2023-12-19T18:59:27.656870+0000","last_unstale":"2023-12-19T18:59:29.251386+0000","last_undegraded":"2023-12-19T18:59:29.251386+0000","last_fullsized":"2023-12-19T18:59:29.251386+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:45.789974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252740+0000","last_change":"2023-12-19T18:59:27.643752+0000","last_active":"2023-12-19T18:59:29.252740+0000","last_peered":"2023-12-19T18:59:29.252740+0000","last_clean":"2023-12-19T18:59:29.252740+0000","last_became_active":"2023-12-19T18:59:27.643478+0000","last_became_peered":"2023-12-19T18:59:27.643478+0000","last_unstale":"2023-12-19T18:59:29.252740+0000","last_undegraded":"2023-12-19T18:59:29.252740+0000","last_fullsized":"2023-12-19T18:59:29.252740+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:34:10.155305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.253107+0000","last_change":"2023-12-19T18:59:27.643887+0000","last_active":"2023-12-19T18:59:29.253107+0000","last_peered":"2023-12-19T18:59:29.253107+0000","last_clean":"2023-12-19T18:59:29.253107+0000","last_became_active":"2023-12-19T18:59:27.643624+0000","last_became_peered":"2023-12-19T18:59:27.643624+0000","last_unstale":"2023-12-19T18:59:29.253107+0000","last_undegraded":"2023-12-19T18:59:29.253107+0000","last_fullsized":"2023-12-19T18:59:29.253107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:02:02.023078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252657+0000","last_change":"2023-12-19T18:59:27.645163+0000","last_active":"2023-12-19T18:59:29.252657+0000","last_peered":"2023-12-19T18:59:29.252657+0000","last_clean":"2023-12-19T18:59:29.252657+0000","last_became_active":"2023-12-19T18:59:27.644866+0000","last_became_peered":"2023-12-19T18:59:27.644866+0000","last_unstale":"2023-12-19T18:59:29.252657+0000","last_undegraded":"2023-12-19T18:59:29.252657+0000","last_fullsized":"2023-12-19T18:59:29.252657+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:47.457632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251856+0000","last_change":"2023-12-19T18:59:27.638276+0000","last_active":"2023-12-19T18:59:29.251856+0000","last_peered":"2023-12-19T18:59:29.251856+0000","last_clean":"2023-12-19T18:59:29.251856+0000","last_became_active":"2023-12-19T18:59:27.637964+0000","last_became_peered":"2023-12-19T18:59:27.637964+0000","last_unstale":"2023-12-19T18:59:29.251856+0000","last_undegraded":"2023-12-19T18:59:29.251856+0000","last_fullsized":"2023-12-19T18:59:29.251856+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:31:54.792697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.627456+0000","last_change":"2023-12-19T18:59:27.640187+0000","last_active":"2023-12-19T18:59:28.627456+0000","last_peered":"2023-12-19T18:59:28.627456+0000","last_clean":"2023-12-19T18:59:28.627456+0000","last_became_active":"2023-12-19T18:59:27.639872+0000","last_became_peered":"2023-12-19T18:59:27.639872+0000","last_unstale":"2023-12-19T18:59:28.627456+0000","last_undegraded":"2023-12-19T18:59:28.627456+0000","last_fullsized":"2023-12-19T18:59:28.627456+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:30:07.550029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.626511+0000","last_change":"2023-12-19T18:59:27.652827+0000","last_active":"2023-12-19T18:59:28.626511+0000","last_peered":"2023-12-19T18:59:28.626511+0000","last_clean":"2023-12-19T18:59:28.626511+0000","last_became_active":"2023-12-19T18:59:27.652064+0000","last_became_peered":"2023-12-19T18:59:27.652064+0000","last_unstale":"2023-12-19T18:59:28.626511+0000","last_undegraded":"2023-12-19T18:59:28.626511+0000","last_fullsized":"2023-12-19T18:59:28.626511+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:51:59.962934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252030+0000","last_change":"2023-12-19T18:59:27.652420+0000","last_active":"2023-12-19T18:59:29.252030+0000","last_peered":"2023-12-19T18:59:29.252030+0000","last_clean":"2023-12-19T18:59:29.252030+0000","last_became_active":"2023-12-19T18:59:27.651860+0000","last_became_peered":"2023-12-19T18:59:27.651860+0000","last_unstale":"2023-12-19T18:59:29.252030+0000","last_undegraded":"2023-12-19T18:59:29.252030+0000","last_fullsized":"2023-12-19T18:59:29.252030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:51.108766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.626268+0000","last_change":"2023-12-19T18:59:27.641444+0000","last_active":"2023-12-19T18:59:28.626268+0000","last_peered":"2023-12-19T18:59:28.626268+0000","last_clean":"2023-12-19T18:59:28.626268+0000","last_became_active":"2023-12-19T18:59:27.641087+0000","last_became_peered":"2023-12-19T18:59:27.641087+0000","last_unstale":"2023-12-19T18:59:28.626268+0000","last_undegraded":"2023-12-19T18:59:28.626268+0000","last_fullsized":"2023-12-19T18:59:28.626268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:43.043365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.625385+0000","last_change":"2023-12-19T18:59:27.641456+0000","last_active":"2023-12-19T18:59:28.625385+0000","last_peered":"2023-12-19T18:59:28.625385+0000","last_clean":"2023-12-19T18:59:28.625385+0000","last_became_active":"2023-12-19T18:59:27.641199+0000","last_became_peered":"2023-12-19T18:59:27.641199+0000","last_unstale":"2023-12-19T18:59:28.625385+0000","last_undegraded":"2023-12-19T18:59:28.625385+0000","last_fullsized":"2023-12-19T18:59:28.625385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:06.335328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.870753+0000","last_change":"2023-12-19T18:59:26.890655+0000","last_active":"2023-12-19T18:59:27.870753+0000","last_peered":"2023-12-19T18:59:27.870753+0000","last_clean":"2023-12-19T18:59:27.870753+0000","last_became_active":"2023-12-19T18:59:26.890346+0000","last_became_peered":"2023-12-19T18:59:26.890346+0000","last_unstale":"2023-12-19T18:59:27.870753+0000","last_undegraded":"2023-12-19T18:59:27.870753+0000","last_fullsized":"2023-12-19T18:59:27.870753+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:13:18.250528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252173+0000","last_change":"2023-12-19T18:59:27.652815+0000","last_active":"2023-12-19T18:59:29.252173+0000","last_peered":"2023-12-19T18:59:29.252173+0000","last_clean":"2023-12-19T18:59:29.252173+0000","last_became_active":"2023-12-19T18:59:27.650397+0000","last_became_peered":"2023-12-19T18:59:27.650397+0000","last_unstale":"2023-12-19T18:59:29.252173+0000","last_undegraded":"2023-12-19T18:59:29.252173+0000","last_fullsized":"2023-12-19T18:59:29.252173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:55.089240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.870740+0000","last_change":"2023-12-19T18:59:26.882004+0000","last_active":"2023-12-19T18:59:27.870740+0000","last_peered":"2023-12-19T18:59:27.870740+0000","last_clean":"2023-12-19T18:59:27.870740+0000","last_became_active":"2023-12-19T18:59:26.881700+0000","last_became_peered":"2023-12-19T18:59:26.881700+0000","last_unstale":"2023-12-19T18:59:27.870740+0000","last_undegraded":"2023-12-19T18:59:27.870740+0000","last_fullsized":"2023-12-19T18:59:27.870740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:58:48.747485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.627113+0000","last_change":"2023-12-19T18:59:27.647256+0000","last_active":"2023-12-19T18:59:28.627113+0000","last_peered":"2023-12-19T18:59:28.627113+0000","last_clean":"2023-12-19T18:59:28.627113+0000","last_became_active":"2023-12-19T18:59:27.646852+0000","last_became_peered":"2023-12-19T18:59:27.646852+0000","last_unstale":"2023-12-19T18:59:28.627113+0000","last_undegraded":"2023-12-19T18:59:28.627113+0000","last_fullsized":"2023-12-19T18:59:28.627113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:46:08.213481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.873274+0000","last_change":"2023-12-19T18:59:26.886101+0000","last_active":"2023-12-19T18:59:27.873274+0000","last_peered":"2023-12-19T18:59:27.873274+0000","last_clean":"2023-12-19T18:59:27.873274+0000","last_became_active":"2023-12-19T18:59:26.885879+0000","last_became_peered":"2023-12-19T18:59:26.885879+0000","last_unstale":"2023-12-19T18:59:27.873274+0000","last_undegraded":"2023-12-19T18:59:27.873274+0000","last_fullsized":"2023-12-19T18:59:27.873274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:33:32.469781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252769+0000","last_change":"2023-12-19T18:59:27.644566+0000","last_active":"2023-12-19T18:59:29.252769+0000","last_peered":"2023-12-19T18:59:29.252769+0000","last_clean":"2023-12-19T18:59:29.252769+0000","last_became_active":"2023-12-19T18:59:27.644305+0000","last_became_peered":"2023-12-19T18:59:27.644305+0000","last_unstale":"2023-12-19T18:59:29.252769+0000","last_undegraded":"2023-12-19T18:59:29.252769+0000","last_fullsized":"2023-12-19T18:59:29.252769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:51:59.962934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.872611+0000","last_change":"2023-12-19T18:59:26.886614+0000","last_active":"2023-12-19T18:59:27.872611+0000","last_peered":"2023-12-19T18:59:27.872611+0000","last_clean":"2023-12-19T18:59:27.872611+0000","last_became_active":"2023-12-19T18:59:26.885790+0000","last_became_peered":"2023-12-19T18:59:26.885790+0000","last_unstale":"2023-12-19T18:59:27.872611+0000","last_undegraded":"2023-12-19T18:59:27.872611+0000","last_fullsized":"2023-12-19T18:59:27.872611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:08:30.262675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.626602+0000","last_change":"2023-12-19T18:59:27.644158+0000","last_active":"2023-12-19T18:59:28.626602+0000","last_peered":"2023-12-19T18:59:28.626602+0000","last_clean":"2023-12-19T18:59:28.626602+0000","last_became_active":"2023-12-19T18:59:27.643817+0000","last_became_peered":"2023-12-19T18:59:27.643817+0000","last_unstale":"2023-12-19T18:59:28.626602+0000","last_undegraded":"2023-12-19T18:59:28.626602+0000","last_fullsized":"2023-12-19T18:59:28.626602+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:33:33.472556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.873560+0000","last_change":"2023-12-19T18:59:26.877767+0000","last_active":"2023-12-19T18:59:27.873560+0000","last_peered":"2023-12-19T18:59:27.873560+0000","last_clean":"2023-12-19T18:59:27.873560+0000","last_became_active":"2023-12-19T18:59:26.877475+0000","last_became_peered":"2023-12-19T18:59:26.877475+0000","last_unstale":"2023-12-19T18:59:27.873560+0000","last_undegraded":"2023-12-19T18:59:27.873560+0000","last_fullsized":"2023-12-19T18:59:27.873560+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:01.602303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251649+0000","last_change":"2023-12-19T18:59:27.651327+0000","last_active":"2023-12-19T18:59:29.251649+0000","last_peered":"2023-12-19T18:59:29.251649+0000","last_clean":"2023-12-19T18:59:29.251649+0000","last_became_active":"2023-12-19T18:59:27.650744+0000","last_became_peered":"2023-12-19T18:59:27.650744+0000","last_unstale":"2023-12-19T18:59:29.251649+0000","last_undegraded":"2023-12-19T18:59:29.251649+0000","last_fullsized":"2023-12-19T18:59:29.251649+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:34:10.155305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.873597+0000","last_change":"2023-12-19T18:59:26.879513+0000","last_active":"2023-12-19T18:59:27.873597+0000","last_peered":"2023-12-19T18:59:27.873597+0000","last_clean":"2023-12-19T18:59:27.873597+0000","last_became_active":"2023-12-19T18:59:26.879190+0000","last_became_peered":"2023-12-19T18:59:26.879190+0000","last_unstale":"2023-12-19T18:59:27.873597+0000","last_undegraded":"2023-12-19T18:59:27.873597+0000","last_fullsized":"2023-12-19T18:59:27.873597+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:46:34.116596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.626716+0000","last_change":"2023-12-19T18:59:27.656486+0000","last_active":"2023-12-19T18:59:28.626716+0000","last_peered":"2023-12-19T18:59:28.626716+0000","last_clean":"2023-12-19T18:59:28.626716+0000","last_became_active":"2023-12-19T18:59:27.656254+0000","last_became_peered":"2023-12-19T18:59:27.656254+0000","last_unstale":"2023-12-19T18:59:28.626716+0000","last_undegraded":"2023-12-19T18:59:28.626716+0000","last_fullsized":"2023-12-19T18:59:28.626716+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:55.089240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.630479+0000","last_change":"2023-12-19T18:59:26.877227+0000","last_active":"2023-12-19T18:59:27.630479+0000","last_peered":"2023-12-19T18:59:27.630479+0000","last_clean":"2023-12-19T18:59:27.630479+0000","last_became_active":"2023-12-19T18:59:26.876903+0000","last_became_peered":"2023-12-19T18:59:26.876903+0000","last_unstale":"2023-12-19T18:59:27.630479+0000","last_undegraded":"2023-12-19T18:59:27.630479+0000","last_fullsized":"2023-12-19T18:59:27.630479+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:46.454857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251949+0000","last_change":"2023-12-19T18:59:27.651168+0000","last_active":"2023-12-19T18:59:29.251949+0000","last_peered":"2023-12-19T18:59:29.251949+0000","last_clean":"2023-12-19T18:59:29.251949+0000","last_became_active":"2023-12-19T18:59:27.650866+0000","last_became_peered":"2023-12-19T18:59:27.650866+0000","last_unstale":"2023-12-19T18:59:29.251949+0000","last_undegraded":"2023-12-19T18:59:29.251949+0000","last_fullsized":"2023-12-19T18:59:29.251949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:09.434914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.626288+0000","last_change":"2023-12-19T18:59:26.876597+0000","last_active":"2023-12-19T18:59:27.626288+0000","last_peered":"2023-12-19T18:59:27.626288+0000","last_clean":"2023-12-19T18:59:27.626288+0000","last_became_active":"2023-12-19T18:59:26.876270+0000","last_became_peered":"2023-12-19T18:59:26.876270+0000","last_unstale":"2023-12-19T18:59:27.626288+0000","last_undegraded":"2023-12-19T18:59:27.626288+0000","last_fullsized":"2023-12-19T18:59:27.626288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:14.142304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252407+0000","last_change":"2023-12-19T18:59:27.653287+0000","last_active":"2023-12-19T18:59:29.252407+0000","last_peered":"2023-12-19T18:59:29.252407+0000","last_clean":"2023-12-19T18:59:29.252407+0000","last_became_active":"2023-12-19T18:59:27.651740+0000","last_became_peered":"2023-12-19T18:59:27.651740+0000","last_unstale":"2023-12-19T18:59:29.252407+0000","last_undegraded":"2023-12-19T18:59:29.252407+0000","last_fullsized":"2023-12-19T18:59:29.252407+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:39.573719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.631546+0000","last_change":"2023-12-19T18:59:26.878383+0000","last_active":"2023-12-19T18:59:27.631546+0000","last_peered":"2023-12-19T18:59:27.631546+0000","last_clean":"2023-12-19T18:59:27.631546+0000","last_became_active":"2023-12-19T18:59:26.877891+0000","last_became_peered":"2023-12-19T18:59:26.877891+0000","last_unstale":"2023-12-19T18:59:27.631546+0000","last_undegraded":"2023-12-19T18:59:27.631546+0000","last_fullsized":"2023-12-19T18:59:27.631546+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:34:09.152530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252846+0000","last_change":"2023-12-19T18:59:27.640667+0000","last_active":"2023-12-19T18:59:29.252846+0000","last_peered":"2023-12-19T18:59:29.252846+0000","last_clean":"2023-12-19T18:59:29.252846+0000","last_became_active":"2023-12-19T18:59:27.640256+0000","last_became_peered":"2023-12-19T18:59:27.640256+0000","last_unstale":"2023-12-19T18:59:29.252846+0000","last_undegraded":"2023-12-19T18:59:29.252846+0000","last_fullsized":"2023-12-19T18:59:29.252846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:28:27.867595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.623123+0000","last_change":"2023-12-19T18:59:26.879898+0000","last_active":"2023-12-19T18:59:27.623123+0000","last_peered":"2023-12-19T18:59:27.623123+0000","last_clean":"2023-12-19T18:59:27.623123+0000","last_became_active":"2023-12-19T18:59:26.879150+0000","last_became_peered":"2023-12-19T18:59:26.879150+0000","last_unstale":"2023-12-19T18:59:27.623123+0000","last_undegraded":"2023-12-19T18:59:27.623123+0000","last_fullsized":"2023-12-19T18:59:27.623123+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:22:59.820667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.253120+0000","last_change":"2023-12-19T18:59:27.643508+0000","last_active":"2023-12-19T18:59:29.253120+0000","last_peered":"2023-12-19T18:59:29.253120+0000","last_clean":"2023-12-19T18:59:29.253120+0000","last_became_active":"2023-12-19T18:59:27.643200+0000","last_became_peered":"2023-12-19T18:59:27.643200+0000","last_unstale":"2023-12-19T18:59:29.253120+0000","last_undegraded":"2023-12-19T18:59:29.253120+0000","last_fullsized":"2023-12-19T18:59:29.253120+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:50.766673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":15,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.871816+0000","last_change":"2023-12-19T18:59:26.880783+0000","last_active":"2023-12-19T18:59:27.871816+0000","last_peered":"2023-12-19T18:59:27.871816+0000","last_clean":"2023-12-19T18:59:27.871816+0000","last_became_active":"2023-12-19T18:59:26.880598+0000","last_became_peered":"2023-12-19T18:59:26.880598+0000","last_unstale":"2023-12-19T18:59:27.871816+0000","last_undegraded":"2023-12-19T18:59:27.871816+0000","last_fullsized":"2023-12-19T18:59:27.871816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:48:52.735756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251775+0000","last_change":"2023-12-19T18:59:27.655885+0000","last_active":"2023-12-19T18:59:29.251775+0000","last_peered":"2023-12-19T18:59:29.251775+0000","last_clean":"2023-12-19T18:59:29.251775+0000","last_became_active":"2023-12-19T18:59:27.650924+0000","last_became_peered":"2023-12-19T18:59:27.650924+0000","last_unstale":"2023-12-19T18:59:29.251775+0000","last_undegraded":"2023-12-19T18:59:29.251775+0000","last_fullsized":"2023-12-19T18:59:29.251775+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:33:33.472556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"30'6","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.876829+0000","last_change":"2023-12-19T18:59:26.884311+0000","last_active":"2023-12-19T18:59:27.876829+0000","last_peered":"2023-12-19T18:59:27.876829+0000","last_clean":"2023-12-19T18:59:27.876829+0000","last_became_active":"2023-12-19T18:59:26.883965+0000","last_became_peered":"2023-12-19T18:59:26.883965+0000","last_unstale":"2023-12-19T18:59:27.876829+0000","last_undegraded":"2023-12-19T18:59:27.876829+0000","last_fullsized":"2023-12-19T18:59:27.876829+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:51:58.960159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251684+0000","last_change":"2023-12-19T18:59:27.651050+0000","last_active":"2023-12-19T18:59:29.251684+0000","last_peered":"2023-12-19T18:59:29.251684+0000","last_clean":"2023-12-19T18:59:29.251684+0000","last_became_active":"2023-12-19T18:59:27.650758+0000","last_became_peered":"2023-12-19T18:59:27.650758+0000","last_unstale":"2023-12-19T18:59:29.251684+0000","last_undegraded":"2023-12-19T18:59:29.251684+0000","last_fullsized":"2023-12-19T18:59:29.251684+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:30:07.550029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.869388+0000","last_change":"2023-12-19T18:59:26.878624+0000","last_active":"2023-12-19T18:59:27.869388+0000","last_peered":"2023-12-19T18:59:27.869388+0000","last_clean":"2023-12-19T18:59:27.869388+0000","last_became_active":"2023-12-19T18:59:26.878292+0000","last_became_peered":"2023-12-19T18:59:26.878292+0000","last_unstale":"2023-12-19T18:59:27.869388+0000","last_undegraded":"2023-12-19T18:59:27.869388+0000","last_fullsized":"2023-12-19T18:59:27.869388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:22:59.820667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252540+0000","last_change":"2023-12-19T18:59:27.639693+0000","last_active":"2023-12-19T18:59:29.252540+0000","last_peered":"2023-12-19T18:59:29.252540+0000","last_clean":"2023-12-19T18:59:29.252540+0000","last_became_active":"2023-12-19T18:59:27.639369+0000","last_became_peered":"2023-12-19T18:59:27.639369+0000","last_unstale":"2023-12-19T18:59:29.252540+0000","last_undegraded":"2023-12-19T18:59:29.252540+0000","last_fullsized":"2023-12-19T18:59:29.252540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:43.891549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.634471+0000","last_change":"2023-12-19T18:59:26.885753+0000","last_active":"2023-12-19T18:59:27.634471+0000","last_peered":"2023-12-19T18:59:27.634471+0000","last_clean":"2023-12-19T18:59:27.634471+0000","last_became_active":"2023-12-19T18:59:26.885304+0000","last_became_peered":"2023-12-19T18:59:26.885304+0000","last_unstale":"2023-12-19T18:59:27.634471+0000","last_undegraded":"2023-12-19T18:59:27.634471+0000","last_fullsized":"2023-12-19T18:59:27.634471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:17.224906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.626339+0000","last_change":"2023-12-19T18:59:27.644252+0000","last_active":"2023-12-19T18:59:28.626339+0000","last_peered":"2023-12-19T18:59:28.626339+0000","last_clean":"2023-12-19T18:59:28.626339+0000","last_became_active":"2023-12-19T18:59:27.643954+0000","last_became_peered":"2023-12-19T18:59:27.643954+0000","last_unstale":"2023-12-19T18:59:28.626339+0000","last_undegraded":"2023-12-19T18:59:28.626339+0000","last_fullsized":"2023-12-19T18:59:28.626339+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:48:53.738532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.630384+0000","last_change":"2023-12-19T18:59:26.874018+0000","last_active":"2023-12-19T18:59:27.630384+0000","last_peered":"2023-12-19T18:59:27.630384+0000","last_clean":"2023-12-19T18:59:27.630384+0000","last_became_active":"2023-12-19T18:59:26.873769+0000","last_became_peered":"2023-12-19T18:59:26.873769+0000","last_unstale":"2023-12-19T18:59:27.630384+0000","last_undegraded":"2023-12-19T18:59:27.630384+0000","last_fullsized":"2023-12-19T18:59:27.630384+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:44.787198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252176+0000","last_change":"2023-12-19T18:59:27.651314+0000","last_active":"2023-12-19T18:59:29.252176+0000","last_peered":"2023-12-19T18:59:29.252176+0000","last_clean":"2023-12-19T18:59:29.252176+0000","last_became_active":"2023-12-19T18:59:27.650926+0000","last_became_peered":"2023-12-19T18:59:27.650926+0000","last_unstale":"2023-12-19T18:59:29.252176+0000","last_undegraded":"2023-12-19T18:59:29.252176+0000","last_fullsized":"2023-12-19T18:59:29.252176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:18.227682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":20,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.875408+0000","last_change":"2023-12-19T18:59:26.885293+0000","last_active":"2023-12-19T18:59:27.875408+0000","last_peered":"2023-12-19T18:59:27.875408+0000","last_clean":"2023-12-19T18:59:27.875408+0000","last_became_active":"2023-12-19T18:59:26.885020+0000","last_became_peered":"2023-12-19T18:59:26.885020+0000","last_unstale":"2023-12-19T18:59:27.875408+0000","last_undegraded":"2023-12-19T18:59:27.875408+0000","last_fullsized":"2023-12-19T18:59:27.875408+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:42.040589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.627044+0000","last_change":"2023-12-19T18:59:27.638748+0000","last_active":"2023-12-19T18:59:28.627044+0000","last_peered":"2023-12-19T18:59:28.627044+0000","last_clean":"2023-12-19T18:59:28.627044+0000","last_became_active":"2023-12-19T18:59:27.637898+0000","last_became_peered":"2023-12-19T18:59:27.637898+0000","last_unstale":"2023-12-19T18:59:28.627044+0000","last_undegraded":"2023-12-19T18:59:28.627044+0000","last_fullsized":"2023-12-19T18:59:28.627044+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:09.230491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.873431+0000","last_change":"2023-12-19T18:59:26.891254+0000","last_active":"2023-12-19T18:59:27.873431+0000","last_peered":"2023-12-19T18:59:27.873431+0000","last_clean":"2023-12-19T18:59:27.873431+0000","last_became_active":"2023-12-19T18:59:26.890803+0000","last_became_peered":"2023-12-19T18:59:26.890803+0000","last_unstale":"2023-12-19T18:59:27.873431+0000","last_undegraded":"2023-12-19T18:59:27.873431+0000","last_fullsized":"2023-12-19T18:59:27.873431+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:46:07.210705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252509+0000","last_change":"2023-12-19T18:59:27.655732+0000","last_active":"2023-12-19T18:59:29.252509+0000","last_peered":"2023-12-19T18:59:29.252509+0000","last_clean":"2023-12-19T18:59:29.252509+0000","last_became_active":"2023-12-19T18:59:27.655473+0000","last_became_peered":"2023-12-19T18:59:27.655473+0000","last_unstale":"2023-12-19T18:59:29.252509+0000","last_undegraded":"2023-12-19T18:59:29.252509+0000","last_fullsized":"2023-12-19T18:59:29.252509+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:24:42.172134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.869136+0000","last_change":"2023-12-19T18:59:26.877734+0000","last_active":"2023-12-19T18:59:27.869136+0000","last_peered":"2023-12-19T18:59:27.869136+0000","last_clean":"2023-12-19T18:59:27.869136+0000","last_became_active":"2023-12-19T18:59:26.876141+0000","last_became_peered":"2023-12-19T18:59:26.876141+0000","last_unstale":"2023-12-19T18:59:27.869136+0000","last_undegraded":"2023-12-19T18:59:27.869136+0000","last_fullsized":"2023-12-19T18:59:27.869136+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:50.105990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252294+0000","last_change":"2023-12-19T18:59:27.646416+0000","last_active":"2023-12-19T18:59:29.252294+0000","last_peered":"2023-12-19T18:59:29.252294+0000","last_clean":"2023-12-19T18:59:29.252294+0000","last_became_active":"2023-12-19T18:59:27.645875+0000","last_became_peered":"2023-12-19T18:59:27.645875+0000","last_unstale":"2023-12-19T18:59:29.252294+0000","last_undegraded":"2023-12-19T18:59:29.252294+0000","last_fullsized":"2023-12-19T18:59:29.252294+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:48:53.738532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.871818+0000","last_change":"2023-12-19T18:59:26.882228+0000","last_active":"2023-12-19T18:59:27.871818+0000","last_peered":"2023-12-19T18:59:27.871818+0000","last_clean":"2023-12-19T18:59:27.871818+0000","last_became_active":"2023-12-19T18:59:26.881940+0000","last_became_peered":"2023-12-19T18:59:26.881940+0000","last_unstale":"2023-12-19T18:59:27.871818+0000","last_undegraded":"2023-12-19T18:59:27.871818+0000","last_fullsized":"2023-12-19T18:59:27.871818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:16:24.926229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.253086+0000","last_change":"2023-12-19T18:59:27.641900+0000","last_active":"2023-12-19T18:59:29.253086+0000","last_peered":"2023-12-19T18:59:29.253086+0000","last_clean":"2023-12-19T18:59:29.253086+0000","last_became_active":"2023-12-19T18:59:27.641620+0000","last_became_peered":"2023-12-19T18:59:27.641620+0000","last_unstale":"2023-12-19T18:59:29.253086+0000","last_undegraded":"2023-12-19T18:59:29.253086+0000","last_fullsized":"2023-12-19T18:59:29.253086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:15.145079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.629326+0000","last_change":"2023-12-19T18:59:26.883881+0000","last_active":"2023-12-19T18:59:27.629326+0000","last_peered":"2023-12-19T18:59:27.629326+0000","last_clean":"2023-12-19T18:59:27.629326+0000","last_became_active":"2023-12-19T18:59:26.883612+0000","last_became_peered":"2023-12-19T18:59:26.883612+0000","last_unstale":"2023-12-19T18:59:27.629326+0000","last_undegraded":"2023-12-19T18:59:27.629326+0000","last_fullsized":"2023-12-19T18:59:27.629326+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:13:18.250528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252055+0000","last_change":"2023-12-19T18:59:27.645569+0000","last_active":"2023-12-19T18:59:29.252055+0000","last_peered":"2023-12-19T18:59:29.252055+0000","last_clean":"2023-12-19T18:59:29.252055+0000","last_became_active":"2023-12-19T18:59:27.645356+0000","last_became_peered":"2023-12-19T18:59:27.645356+0000","last_unstale":"2023-12-19T18:59:29.252055+0000","last_undegraded":"2023-12-19T18:59:29.252055+0000","last_fullsized":"2023-12-19T18:59:29.252055+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:17:15.950035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.874022+0000","last_change":"2023-12-19T18:59:26.887588+0000","last_active":"2023-12-19T18:59:27.874022+0000","last_peered":"2023-12-19T18:59:27.874022+0000","last_clean":"2023-12-19T18:59:27.874022+0000","last_became_active":"2023-12-19T18:59:26.887245+0000","last_became_peered":"2023-12-19T18:59:26.887245+0000","last_unstale":"2023-12-19T18:59:27.874022+0000","last_undegraded":"2023-12-19T18:59:27.874022+0000","last_fullsized":"2023-12-19T18:59:27.874022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:36:45.699332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251739+0000","last_change":"2023-12-19T18:59:27.637097+0000","last_active":"2023-12-19T18:59:29.251739+0000","last_peered":"2023-12-19T18:59:29.251739+0000","last_clean":"2023-12-19T18:59:29.251739+0000","last_became_active":"2023-12-19T18:59:27.636689+0000","last_became_peered":"2023-12-19T18:59:27.636689+0000","last_unstale":"2023-12-19T18:59:29.251739+0000","last_undegraded":"2023-12-19T18:59:29.251739+0000","last_fullsized":"2023-12-19T18:59:29.251739+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:13:32.952346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.637308+0000","last_change":"2023-12-19T18:59:26.885971+0000","last_active":"2023-12-19T18:59:27.637308+0000","last_peered":"2023-12-19T18:59:27.637308+0000","last_clean":"2023-12-19T18:59:27.637308+0000","last_became_active":"2023-12-19T18:59:26.885633+0000","last_became_peered":"2023-12-19T18:59:26.885633+0000","last_unstale":"2023-12-19T18:59:27.637308+0000","last_undegraded":"2023-12-19T18:59:27.637308+0000","last_fullsized":"2023-12-19T18:59:27.637308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:22:59.820667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251601+0000","last_change":"2023-12-19T18:59:27.637111+0000","last_active":"2023-12-19T18:59:29.251601+0000","last_peered":"2023-12-19T18:59:29.251601+0000","last_clean":"2023-12-19T18:59:29.251601+0000","last_became_active":"2023-12-19T18:59:27.636672+0000","last_became_peered":"2023-12-19T18:59:27.636672+0000","last_unstale":"2023-12-19T18:59:29.251601+0000","last_undegraded":"2023-12-19T18:59:29.251601+0000","last_fullsized":"2023-12-19T18:59:29.251601+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:39:12.866107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.627644+0000","last_change":"2023-12-19T18:59:26.884674+0000","last_active":"2023-12-19T18:59:27.627644+0000","last_peered":"2023-12-19T18:59:27.627644+0000","last_clean":"2023-12-19T18:59:27.627644+0000","last_became_active":"2023-12-19T18:59:26.884402+0000","last_became_peered":"2023-12-19T18:59:26.884402+0000","last_unstale":"2023-12-19T18:59:27.627644+0000","last_undegraded":"2023-12-19T18:59:27.627644+0000","last_fullsized":"2023-12-19T18:59:27.627644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:36:45.699332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.626392+0000","last_change":"2023-12-19T18:59:27.644532+0000","last_active":"2023-12-19T18:59:28.626392+0000","last_peered":"2023-12-19T18:59:28.626392+0000","last_clean":"2023-12-19T18:59:28.626392+0000","last_became_active":"2023-12-19T18:59:27.642863+0000","last_became_peered":"2023-12-19T18:59:27.642863+0000","last_unstale":"2023-12-19T18:59:28.626392+0000","last_undegraded":"2023-12-19T18:59:28.626392+0000","last_fullsized":"2023-12-19T18:59:28.626392+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:45.789974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.631580+0000","last_change":"2023-12-19T18:59:26.881655+0000","last_active":"2023-12-19T18:59:27.631580+0000","last_peered":"2023-12-19T18:59:27.631580+0000","last_clean":"2023-12-19T18:59:27.631580+0000","last_became_active":"2023-12-19T18:59:26.881378+0000","last_became_peered":"2023-12-19T18:59:26.881378+0000","last_unstale":"2023-12-19T18:59:27.631580+0000","last_undegraded":"2023-12-19T18:59:27.631580+0000","last_fullsized":"2023-12-19T18:59:27.631580+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:17.224906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.253178+0000","last_change":"2023-12-19T18:59:27.651053+0000","last_active":"2023-12-19T18:59:29.253178+0000","last_peered":"2023-12-19T18:59:29.253178+0000","last_clean":"2023-12-19T18:59:29.253178+0000","last_became_active":"2023-12-19T18:59:27.650721+0000","last_became_peered":"2023-12-19T18:59:27.650721+0000","last_unstale":"2023-12-19T18:59:29.253178+0000","last_undegraded":"2023-12-19T18:59:29.253178+0000","last_fullsized":"2023-12-19T18:59:29.253178+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:36:10.546639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.871729+0000","last_change":"2023-12-19T18:59:26.879375+0000","last_active":"2023-12-19T18:59:27.871729+0000","last_peered":"2023-12-19T18:59:27.871729+0000","last_clean":"2023-12-19T18:59:27.871729+0000","last_became_active":"2023-12-19T18:59:26.879043+0000","last_became_peered":"2023-12-19T18:59:26.879043+0000","last_unstale":"2023-12-19T18:59:27.871729+0000","last_undegraded":"2023-12-19T18:59:27.871729+0000","last_fullsized":"2023-12-19T18:59:27.871729+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:09.669999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252479+0000","last_change":"2023-12-19T18:59:27.655676+0000","last_active":"2023-12-19T18:59:29.252479+0000","last_peered":"2023-12-19T18:59:29.252479+0000","last_clean":"2023-12-19T18:59:29.252479+0000","last_became_active":"2023-12-19T18:59:27.655392+0000","last_became_peered":"2023-12-19T18:59:27.655392+0000","last_unstale":"2023-12-19T18:59:29.252479+0000","last_undegraded":"2023-12-19T18:59:29.252479+0000","last_fullsized":"2023-12-19T18:59:29.252479+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:43.891549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.623263+0000","last_change":"2023-12-19T18:59:26.887521+0000","last_active":"2023-12-19T18:59:27.623263+0000","last_peered":"2023-12-19T18:59:27.623263+0000","last_clean":"2023-12-19T18:59:27.623263+0000","last_became_active":"2023-12-19T18:59:26.887126+0000","last_became_peered":"2023-12-19T18:59:26.887126+0000","last_unstale":"2023-12-19T18:59:27.623263+0000","last_undegraded":"2023-12-19T18:59:27.623263+0000","last_fullsized":"2023-12-19T18:59:27.623263+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:50.105990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.625410+0000","last_change":"2023-12-19T18:59:27.641166+0000","last_active":"2023-12-19T18:59:28.625410+0000","last_peered":"2023-12-19T18:59:28.625410+0000","last_clean":"2023-12-19T18:59:28.625410+0000","last_became_active":"2023-12-19T18:59:27.640863+0000","last_became_peered":"2023-12-19T18:59:27.640863+0000","last_unstale":"2023-12-19T18:59:28.625410+0000","last_undegraded":"2023-12-19T18:59:28.625410+0000","last_fullsized":"2023-12-19T18:59:28.625410+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:09.230491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.635004+0000","last_change":"2023-12-19T18:59:26.889176+0000","last_active":"2023-12-19T18:59:27.635004+0000","last_peered":"2023-12-19T18:59:27.635004+0000","last_clean":"2023-12-19T18:59:27.635004+0000","last_became_active":"2023-12-19T18:59:26.887785+0000","last_became_peered":"2023-12-19T18:59:26.887785+0000","last_unstale":"2023-12-19T18:59:27.635004+0000","last_undegraded":"2023-12-19T18:59:27.635004+0000","last_fullsized":"2023-12-19T18:59:27.635004+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:08.227715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.252056+0000","last_change":"2023-12-19T18:59:27.646888+0000","last_active":"2023-12-19T18:59:29.252056+0000","last_peered":"2023-12-19T18:59:29.252056+0000","last_clean":"2023-12-19T18:59:29.252056+0000","last_became_active":"2023-12-19T18:59:27.646582+0000","last_became_peered":"2023-12-19T18:59:27.646582+0000","last_unstale":"2023-12-19T18:59:29.252056+0000","last_undegraded":"2023-12-19T18:59:29.252056+0000","last_fullsized":"2023-12-19T18:59:29.252056+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:16:25.929004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.623064+0000","last_change":"2023-12-19T18:59:26.879579+0000","last_active":"2023-12-19T18:59:27.623064+0000","last_peered":"2023-12-19T18:59:27.623064+0000","last_clean":"2023-12-19T18:59:27.623064+0000","last_became_active":"2023-12-19T18:59:26.879235+0000","last_became_peered":"2023-12-19T18:59:26.879235+0000","last_unstale":"2023-12-19T18:59:27.623064+0000","last_undegraded":"2023-12-19T18:59:27.623064+0000","last_fullsized":"2023-12-19T18:59:27.623064+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:46:34.116596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.625152+0000","last_change":"2023-12-19T18:59:27.647349+0000","last_active":"2023-12-19T18:59:28.625152+0000","last_peered":"2023-12-19T18:59:28.625152+0000","last_clean":"2023-12-19T18:59:28.625152+0000","last_became_active":"2023-12-19T18:59:27.646832+0000","last_became_peered":"2023-12-19T18:59:27.646832+0000","last_unstale":"2023-12-19T18:59:28.625152+0000","last_undegraded":"2023-12-19T18:59:28.625152+0000","last_fullsized":"2023-12-19T18:59:28.625152+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:18.227682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.634605+0000","last_change":"2023-12-19T18:59:26.889247+0000","last_active":"2023-12-19T18:59:27.634605+0000","last_peered":"2023-12-19T18:59:27.634605+0000","last_clean":"2023-12-19T18:59:27.634605+0000","last_became_active":"2023-12-19T18:59:26.888058+0000","last_became_peered":"2023-12-19T18:59:26.888058+0000","last_unstale":"2023-12-19T18:59:27.634605+0000","last_undegraded":"2023-12-19T18:59:27.634605+0000","last_fullsized":"2023-12-19T18:59:27.634605+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:05.332552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:29.251764+0000","last_change":"2023-12-19T18:59:27.640476+0000","last_active":"2023-12-19T18:59:29.251764+0000","last_peered":"2023-12-19T18:59:29.251764+0000","last_clean":"2023-12-19T18:59:29.251764+0000","last_became_active":"2023-12-19T18:59:27.639994+0000","last_became_peered":"2023-12-19T18:59:27.639994+0000","last_unstale":"2023-12-19T18:59:29.251764+0000","last_undegraded":"2023-12-19T18:59:29.251764+0000","last_fullsized":"2023-12-19T18:59:29.251764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:31:54.792697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.627781+0000","last_change":"2023-12-19T18:59:26.875167+0000","last_active":"2023-12-19T18:59:27.627781+0000","last_peered":"2023-12-19T18:59:27.627781+0000","last_clean":"2023-12-19T18:59:27.627781+0000","last_became_active":"2023-12-19T18:59:26.874253+0000","last_became_peered":"2023-12-19T18:59:26.874253+0000","last_unstale":"2023-12-19T18:59:27.627781+0000","last_undegraded":"2023-12-19T18:59:27.627781+0000","last_fullsized":"2023-12-19T18:59:27.627781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:58:48.747485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.626841+0000","last_change":"2023-12-19T18:59:27.636584+0000","last_active":"2023-12-19T18:59:28.626841+0000","last_peered":"2023-12-19T18:59:28.626841+0000","last_clean":"2023-12-19T18:59:28.626841+0000","last_became_active":"2023-12-19T18:59:27.636367+0000","last_became_peered":"2023-12-19T18:59:27.636367+0000","last_unstale":"2023-12-19T18:59:28.626841+0000","last_undegraded":"2023-12-19T18:59:28.626841+0000","last_fullsized":"2023-12-19T18:59:28.626841+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:18.227682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.628819+0000","last_change":"2023-12-19T18:59:26.874040+0000","last_active":"2023-12-19T18:59:27.628819+0000","last_peered":"2023-12-19T18:59:27.628819+0000","last_clean":"2023-12-19T18:59:27.628819+0000","last_became_active":"2023-12-19T18:59:26.873816+0000","last_became_peered":"2023-12-19T18:59:26.873816+0000","last_unstale":"2023-12-19T18:59:27.628819+0000","last_undegraded":"2023-12-19T18:59:27.628819+0000","last_fullsized":"2023-12-19T18:59:27.628819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:08.432139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-12-19T18:59:28.627147+0000","last_change":"2023-12-19T18:59:27.638695+0000","last_active":"2023-12-19T18:59:28.627147+0000","last_peered":"2023-12-19T18:59:28.627147+0000","last_clean":"2023-12-19T18:59:28.627147+0000","last_became_active":"2023-12-19T18:59:27.638392+0000","last_became_peered":"2023-12-19T18:59:27.638392+0000","last_unstale":"2023-12-19T18:59:28.627147+0000","last_undegraded":"2023-12-19T18:59:28.627147+0000","last_fullsized":"2023-12-19T18:59:28.627147+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:31:54.792697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.637132+0000","last_change":"2023-12-19T18:59:26.886139+0000","last_active":"2023-12-19T18:59:27.637132+0000","last_peered":"2023-12-19T18:59:27.637132+0000","last_clean":"2023-12-19T18:59:27.637132+0000","last_became_active":"2023-12-19T18:59:26.885752+0000","last_became_peered":"2023-12-19T18:59:26.885752+0000","last_unstale":"2023-12-19T18:59:27.637132+0000","last_undegraded":"2023-12-19T18:59:27.637132+0000","last_fullsized":"2023-12-19T18:59:27.637132+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:01.602303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":176,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-12-19T18:59:27.628325+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T18:59:27.628325+0000","last_peered":"2023-12-19T18:59:27.628325+0000","last_clean":"2023-12-19T18:59:27.628325+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T18:59:27.628325+0000","last_undegraded":"2023-12-19T18:59:27.628325+0000","last_fullsized":"2023-12-19T18:59:27.628325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343896,"statfs":{"total":96636764160,"available":96608149504,"internally_reserved":0,"allocated":946176,"data_stored":724560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134718,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":134206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":135736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":134172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":364544,"data_stored":135736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":4.2000000000000002,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":7.7320000000000002,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.31}]},{"osd":2,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.9129999999999998,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.4720000000000004,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.36199999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":7.8399999999999999,"5min":7.8399999999999999,"15min":7.8399999999999999},"last":0.433},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":7.7949999999999999,"5min":7.7949999999999999,"15min":7.7949999999999999},"last":0.39700000000000002}]},{"osd":4,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":4.2690000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":4.2910000000000004,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.51500000000000001}]},{"osd":5,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":4.3490000000000002,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":4.2480000000000002,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.61099999999999999}]},{"osd":6,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":4.1609999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.3099999999999996,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.52700000000000002}]},{"osd":7,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":4.3310000000000004,"5min":4.3310000000000004,"15min":4.3310000000000004},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":4.226,"5min":4.226,"15min":4.226},"last":0.499}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27936,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343904,"statfs":{"total":96636764160,"available":96608157696,"internally_reserved":0,"allocated":937984,"data_stored":723451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.57999999999999996}]},{"osd":2,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.54700000000000004}]},{"osd":3,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.63800000000000001}]},{"osd":4,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.93700000000000006}]},{"osd":5,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.752},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.91700000000000004}]},{"osd":6,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.81100000000000005}]},{"osd":7,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.98099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T18:59:36.826 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T18:59:36.826 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T18:59:37.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.007+0000 7f7edd31d640 1 Processor -- start 2023-12-19T18:59:37.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.007+0000 7f7edd31d640 1 -- start start 2023-12-19T18:59:37.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.007+0000 7f7edd31d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ed80a5370 0x7f7ed80c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:37.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.007+0000 7f7edd31d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7ed8072090 0x7f7ed81516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:37.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.007+0000 7f7edd31d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed80c2760 con 0x7f7ed80c4110 2023-12-19T18:59:37.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.007+0000 7f7edd31d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed80c3070 con 0x7f7ed80a5370 2023-12-19T18:59:37.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.007+0000 7f7edd31d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed8151bf0 con 0x7f7ed8072090 2023-12-19T18:59:37.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.007+0000 7f7ed6ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ed80a5370 0x7f7ed80c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:37.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.011+0000 7f7ed6ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7ed80a5370 0x7f7ed80c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38390/0 (socket says 172.21.15.133:38390) 2023-12-19T18:59:37.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.011+0000 7f7ed6ffd640 1 -- 172.21.15.133:0/1279734503 learned_addr learned my addr 172.21.15.133:0/1279734503 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:37.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.011+0000 7f7ed77fe640 1 --2- 172.21.15.133:0/1279734503 >> v2:172.21.15.138:3300/0 conn(0x7f7ed8072090 0x7f7ed81516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:37.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.011+0000 7f7ed6ffd640 1 -- 172.21.15.133:0/1279734503 >> v2:172.21.15.138:3300/0 conn(0x7f7ed8072090 msgr2=0x7f7ed81516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:37.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.011+0000 7f7ed6ffd640 1 --2- 172.21.15.133:0/1279734503 >> v2:172.21.15.138:3300/0 conn(0x7f7ed8072090 0x7f7ed81516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:37.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.011+0000 7f7ed6ffd640 1 -- 172.21.15.133:0/1279734503 >> v1:172.21.15.133:6789/0 conn(0x7f7ed80c4110 legacy=0x7f7ed8150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:37.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.011+0000 7f7ed6ffd640 1 -- 172.21.15.133:0/1279734503 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed80a5750 con 0x7f7ed80a5370 2023-12-19T18:59:37.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.011+0000 7f7ed5ffb640 1 -- 172.21.15.133:0/1279734503 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1402578443 0 0) 0x7f7ed80c2760 con 0x7f7ed80c4110 2023-12-19T18:59:37.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.011+0000 7f7ed6ffd640 1 --2- 172.21.15.133:0/1279734503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ed80a5370 0x7f7ed80c3bd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8072020 tx=0x7f7ec801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2043b8ddfb2d6ceb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:37.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.011+0000 7f7ed5ffb640 1 -- 172.21.15.133:0/1279734503 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec80ab600 con 0x7f7ed80a5370 2023-12-19T18:59:37.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.011+0000 7f7ed5ffb640 1 -- 172.21.15.133:0/1279734503 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec80a7050 con 0x7f7ed80a5370 2023-12-19T18:59:37.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.011+0000 7f7ed5ffb640 1 -- 172.21.15.133:0/1279734503 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec80ab980 con 0x7f7ed80a5370 2023-12-19T18:59:37.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7edd31d640 1 -- 172.21.15.133:0/1279734503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ed80a5370 msgr2=0x7f7ed80c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:37.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7edd31d640 1 --2- 172.21.15.133:0/1279734503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ed80a5370 0x7f7ed80c3bd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8072020 tx=0x7f7ec801c3b0 comp rx=0 tx=0).stop 2023-12-19T18:59:37.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7edd31d640 1 -- 172.21.15.133:0/1279734503 shutdown_connections 2023-12-19T18:59:37.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7edd31d640 1 --2- 172.21.15.133:0/1279734503 >> v2:172.21.15.138:3300/0 conn(0x7f7ed8072090 0x7f7ed81516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:37.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7edd31d640 1 --2- 172.21.15.133:0/1279734503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ed80a5370 0x7f7ed80c3bd0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:37.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7edd31d640 1 -- 172.21.15.133:0/1279734503 >> 172.21.15.133:0/1279734503 conn(0x7f7ed806a5b0 msgr2=0x7f7ed806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:37.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7edd31d640 1 -- 172.21.15.133:0/1279734503 shutdown_connections 2023-12-19T18:59:37.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7edd31d640 1 -- 172.21.15.133:0/1279734503 wait complete. 2023-12-19T18:59:37.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7edd31d640 1 Processor -- start 2023-12-19T18:59:37.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7edd31d640 1 -- start start 2023-12-19T18:59:37.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7edd31d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7ed8072090 0x7f7ed81ee840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:37.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7edd31d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ed80a5370 0x7f7ed8142200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:37.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7edd31d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ed80c4110 0x7f7ed8142740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:37.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7edd31d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed8146800 con 0x7f7ed80a5370 2023-12-19T18:59:37.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7edd31d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed81ef290 con 0x7f7ed80c4110 2023-12-19T18:59:37.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7edd31d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed80a78f0 con 0x7f7ed8072090 2023-12-19T18:59:37.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7ed67fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ed80a5370 0x7f7ed8142200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:37.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7ed67fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ed80a5370 0x7f7ed8142200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38396/0 (socket says 172.21.15.133:38396) 2023-12-19T18:59:37.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7ed67fc640 1 -- 172.21.15.133:0/2425230343 learned_addr learned my addr 172.21.15.133:0/2425230343 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:37.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7ed77fe640 1 --2- 172.21.15.133:0/2425230343 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ed80c4110 0x7f7ed8142740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:37.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7ed6ffd640 1 --2- 172.21.15.133:0/2425230343 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7ed8072090 0x7f7ed81ee840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:37.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7ed67fc640 1 -- 172.21.15.133:0/2425230343 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7ed8072090 msgr2=0x7f7ed81ee840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:37.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7ed67fc640 1 --2- 172.21.15.133:0/2425230343 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7ed8072090 0x7f7ed81ee840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:37.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7ed67fc640 1 -- 172.21.15.133:0/2425230343 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ed80c4110 msgr2=0x7f7ed8142740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:37.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7ed67fc640 1 --2- 172.21.15.133:0/2425230343 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ed80c4110 0x7f7ed8142740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:37.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.015+0000 7f7ed67fc640 1 -- 172.21.15.133:0/2425230343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec80094d0 con 0x7f7ed80a5370 2023-12-19T18:59:37.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.019+0000 7f7ed67fc640 1 --2- 172.21.15.133:0/2425230343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ed80a5370 0x7f7ed8142200 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc001ec0 tx=0x7f7ecc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:37.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.019+0000 7f7ebf7fe640 1 -- 172.21.15.133:0/2425230343 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc0054e0 con 0x7f7ed80a5370 2023-12-19T18:59:37.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.019+0000 7f7ebf7fe640 1 -- 172.21.15.133:0/2425230343 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ecc003600 con 0x7f7ed80a5370 2023-12-19T18:59:37.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.019+0000 7f7edd31d640 1 -- 172.21.15.133:0/2425230343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed80a7bd0 con 0x7f7ed80a5370 2023-12-19T18:59:37.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.019+0000 7f7ebf7fe640 1 -- 172.21.15.133:0/2425230343 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc0039b0 con 0x7f7ed80a5370 2023-12-19T18:59:37.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.019+0000 7f7edd31d640 1 -- 172.21.15.133:0/2425230343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed80a8190 con 0x7f7ed80a5370 2023-12-19T18:59:37.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.019+0000 7f7edd31d640 1 -- 172.21.15.133:0/2425230343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed80a83b0 con 0x7f7ed80a5370 2023-12-19T18:59:37.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.019+0000 7f7ebf7fe640 1 -- 172.21.15.133:0/2425230343 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7ecc003b10 con 0x7f7ed80a5370 2023-12-19T18:59:37.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.019+0000 7f7ebf7fe640 1 --2- 172.21.15.133:0/2425230343 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7ec4066470 0x7f7ec4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:37.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.019+0000 7f7ebf7fe640 1 -- 172.21.15.133:0/2425230343 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ecc083320 con 0x7f7ed80a5370 2023-12-19T18:59:37.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.019+0000 7f7ed6ffd640 1 --2- 172.21.15.133:0/2425230343 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7ec4066470 0x7f7ec4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:37.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.023+0000 7f7ed6ffd640 1 --2- 172.21.15.133:0/2425230343 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7ec4066470 0x7f7ec4068930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7ec80ad000 tx=0x7f7ec80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:37.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.023+0000 7f7ebf7fe640 1 -- 172.21.15.133:0/2425230343 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7ecc0508e0 con 0x7f7ed80a5370 2023-12-19T18:59:37.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.227+0000 7f7edd31d640 1 -- 172.21.15.133:0/2425230343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7ed8068400 con 0x7f7ed80a5370 2023-12-19T18:59:37.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.231+0000 7f7ebf7fe640 1 -- 172.21.15.133:0/2425230343 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f7ecc0170e0 con 0x7f7ed80a5370 2023-12-19T18:59:37.235 INFO:teuthology.orchestra.run.smithi133.stdout:[client.0] 2023-12-19T18:59:37.235 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCn54FllfQwNxAAyKIESQDxKvDHfaewx+v88w== 2023-12-19T18:59:37.235 INFO:teuthology.orchestra.run.smithi133.stdout: caps mds = "allow" 2023-12-19T18:59:37.235 INFO:teuthology.orchestra.run.smithi133.stdout: caps mon = "allow r" 2023-12-19T18:59:37.236 INFO:teuthology.orchestra.run.smithi133.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-19T18:59:37.236 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2023-12-19T18:59:37.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.231+0000 7f7edd31d640 1 -- 172.21.15.133:0/2425230343 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7ec4066470 msgr2=0x7f7ec4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:37.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.231+0000 7f7edd31d640 1 --2- 172.21.15.133:0/2425230343 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7ec4066470 0x7f7ec4068930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7ec80ad000 tx=0x7f7ec80a6000 comp rx=0 tx=0).stop 2023-12-19T18:59:37.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.231+0000 7f7edd31d640 1 -- 172.21.15.133:0/2425230343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ed80a5370 msgr2=0x7f7ed8142200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:37.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.231+0000 7f7edd31d640 1 --2- 172.21.15.133:0/2425230343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ed80a5370 0x7f7ed8142200 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc001ec0 tx=0x7f7ecc00c8e0 comp rx=0 tx=0).stop 2023-12-19T18:59:37.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.231+0000 7f7edd31d640 1 -- 172.21.15.133:0/2425230343 shutdown_connections 2023-12-19T18:59:37.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.231+0000 7f7edd31d640 1 --2- 172.21.15.133:0/2425230343 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7ec4066470 0x7f7ec4068930 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:37.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.231+0000 7f7edd31d640 1 --2- 172.21.15.133:0/2425230343 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7ed80c4110 0x7f7ed8142740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:37.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.231+0000 7f7edd31d640 1 --2- 172.21.15.133:0/2425230343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7ed80a5370 0x7f7ed8142200 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:37.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.231+0000 7f7edd31d640 1 --2- 172.21.15.133:0/2425230343 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7ed8072090 0x7f7ed81ee840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:37.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.231+0000 7f7edd31d640 1 -- 172.21.15.133:0/2425230343 >> 172.21.15.133:0/2425230343 conn(0x7f7ed806a5b0 msgr2=0x7f7ed814f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:37.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.231+0000 7f7edd31d640 1 -- 172.21.15.133:0/2425230343 shutdown_connections 2023-12-19T18:59:37.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.231+0000 7f7edd31d640 1 -- 172.21.15.133:0/2425230343 wait complete. 2023-12-19T18:59:37.257 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:59:37.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.391+0000 7f8121a9a640 1 Processor -- start 2023-12-19T18:59:37.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.391+0000 7f8121a9a640 1 -- start start 2023-12-19T18:59:37.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.391+0000 7f8121a9a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f811c0c5260 0x7f811c06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:37.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.391+0000 7f8121a9a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f811c0c2580 con 0x7f811c155de0 2023-12-19T18:59:37.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.391+0000 7f8121a9a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f811c156940 con 0x7f811c0c5640 2023-12-19T18:59:37.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.391+0000 7f8121a9a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f811c153510 con 0x7f811c0c5260 2023-12-19T18:59:37.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.391+0000 7f811bfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f811c155de0 0x7f811c156230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43326/0 (socket says 172.21.15.133:43326) 2023-12-19T18:59:37.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.391+0000 7f811bfff640 1 -- 172.21.15.133:0/1224661891 learned_addr learned my addr 172.21.15.133:0/1224661891 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:37.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.391+0000 7f811b7fe640 1 --2- 172.21.15.133:0/1224661891 >> v2:172.21.15.138:3300/0 conn(0x7f811c0c5260 0x7f811c06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:37.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.391+0000 7f811a7fc640 1 -- 172.21.15.133:0/1224661891 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372894696 0 0) 0x7f811c0c2580 con 0x7f811c155de0 2023-12-19T18:59:37.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.391+0000 7f811a7fc640 1 -- 172.21.15.133:0/1224661891 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8104003530 con 0x7f811c155de0 2023-12-19T18:59:37.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.391+0000 7f811b7fe640 1 -- 172.21.15.133:0/1224661891 >> v1:172.21.15.138:6789/0 conn(0x7f811c0c5640 legacy=0x7f811c0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:37.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.391+0000 7f811b7fe640 1 -- 172.21.15.133:0/1224661891 >> v1:172.21.15.133:6789/0 conn(0x7f811c155de0 legacy=0x7f811c156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:37.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.391+0000 7f811b7fe640 1 -- 172.21.15.133:0/1224661891 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f811c0c1a00 con 0x7f811c0c5260 2023-12-19T18:59:37.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.395+0000 7f811b7fe640 1 --2- 172.21.15.133:0/1224661891 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f811c0c5260 0x7f811c06d5b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f810c0097c0 tx=0x7f810c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59380a07f756606d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:37.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.395+0000 7f811a7fc640 1 -- 172.21.15.133:0/1224661891 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c0ab600 con 0x7f811c0c5260 2023-12-19T18:59:37.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.395+0000 7f811a7fc640 1 -- 172.21.15.133:0/1224661891 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c0a7050 con 0x7f811c0c5260 2023-12-19T18:59:37.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.395+0000 7f811a7fc640 1 -- 172.21.15.133:0/1224661891 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c0ab980 con 0x7f811c0c5260 2023-12-19T18:59:37.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.395+0000 7f8121a9a640 1 -- 172.21.15.133:0/1224661891 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f811c0c5260 msgr2=0x7f811c06d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:37.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.395+0000 7f8121a9a640 1 --2- 172.21.15.133:0/1224661891 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f811c0c5260 0x7f811c06d5b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f810c0097c0 tx=0x7f810c01c3f0 comp rx=0 tx=0).stop 2023-12-19T18:59:37.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f8121a9a640 1 -- 172.21.15.133:0/1224661891 shutdown_connections 2023-12-19T18:59:37.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f8121a9a640 1 --2- 172.21.15.133:0/1224661891 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f811c0c5260 0x7f811c06d5b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:37.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f8121a9a640 1 -- 172.21.15.133:0/1224661891 >> 172.21.15.133:0/1224661891 conn(0x7f811c06a5b0 msgr2=0x7f811c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:37.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f8121a9a640 1 -- 172.21.15.133:0/1224661891 shutdown_connections 2023-12-19T18:59:37.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f8121a9a640 1 -- 172.21.15.133:0/1224661891 wait complete. 2023-12-19T18:59:37.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f8121a9a640 1 Processor -- start 2023-12-19T18:59:37.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f8121a9a640 1 -- start start 2023-12-19T18:59:37.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f8121a9a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f811c0c5260 0x7f811c1543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:37.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f8121a9a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f811c0c5640 0x7f811c0bfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:37.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f8121a9a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f811c155de0 0x7f811c15bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:37.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f8121a9a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c0a8e80 con 0x7f811c155de0 2023-12-19T18:59:37.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f8121a9a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c157280 con 0x7f811c0c5260 2023-12-19T18:59:37.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f8121a9a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f811c0a90d0 con 0x7f811c0c5640 2023-12-19T18:59:37.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f811bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f811c155de0 0x7f811c15bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:37.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f811bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f811c155de0 0x7f811c15bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38400/0 (socket says 172.21.15.133:38400) 2023-12-19T18:59:37.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f811bfff640 1 -- 172.21.15.133:0/4078642406 learned_addr learned my addr 172.21.15.133:0/4078642406 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:37.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f811b7fe640 1 --2- 172.21.15.133:0/4078642406 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f811c0c5260 0x7f811c1543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:37.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f811affd640 1 --2- 172.21.15.133:0/4078642406 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f811c0c5640 0x7f811c0bfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:37.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f811bfff640 1 -- 172.21.15.133:0/4078642406 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f811c0c5640 msgr2=0x7f811c0bfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:37.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f811bfff640 1 --2- 172.21.15.133:0/4078642406 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f811c0c5640 0x7f811c0bfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:37.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f811bfff640 1 -- 172.21.15.133:0/4078642406 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f811c0c5260 msgr2=0x7f811c1543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:37.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f811bfff640 1 --2- 172.21.15.133:0/4078642406 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f811c0c5260 0x7f811c1543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:37.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f811bfff640 1 -- 172.21.15.133:0/4078642406 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c009420 con 0x7f811c155de0 2023-12-19T18:59:37.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f811affd640 1 --2- 172.21.15.133:0/4078642406 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f811c0c5640 0x7f811c0bfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:37.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.399+0000 7f811bfff640 1 --2- 172.21.15.133:0/4078642406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f811c155de0 0x7f811c15bb10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f811400cb70 tx=0x7f811400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:37.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.403+0000 7f8103fff640 1 -- 172.21.15.133:0/4078642406 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811400ad40 con 0x7f811c155de0 2023-12-19T18:59:37.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.403+0000 7f8103fff640 1 -- 172.21.15.133:0/4078642406 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8114012400 con 0x7f811c155de0 2023-12-19T18:59:37.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.403+0000 7f8103fff640 1 -- 172.21.15.133:0/4078642406 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811400aea0 con 0x7f811c155de0 2023-12-19T18:59:37.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.403+0000 7f8121a9a640 1 -- 172.21.15.133:0/4078642406 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811c156f10 con 0x7f811c155de0 2023-12-19T18:59:37.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.403+0000 7f8121a9a640 1 -- 172.21.15.133:0/4078642406 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811c0c00a0 con 0x7f811c155de0 2023-12-19T18:59:37.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.403+0000 7f8121a9a640 1 -- 172.21.15.133:0/4078642406 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f811c156d70 con 0x7f811c155de0 2023-12-19T18:59:37.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.403+0000 7f8103fff640 1 -- 172.21.15.133:0/4078642406 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8114007070 con 0x7f811c155de0 2023-12-19T18:59:37.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.403+0000 7f8103fff640 1 --2- 172.21.15.133:0/4078642406 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8108066470 0x7f8108068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:37.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.403+0000 7f8103fff640 1 -- 172.21.15.133:0/4078642406 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8114083dc0 con 0x7f811c155de0 2023-12-19T18:59:37.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.403+0000 7f811b7fe640 1 --2- 172.21.15.133:0/4078642406 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8108066470 0x7f8108068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:37.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.407+0000 7f811b7fe640 1 --2- 172.21.15.133:0/4078642406 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8108066470 0x7f8108068930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f810c0ad000 tx=0x7f810c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:37.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.407+0000 7f8103fff640 1 -- 172.21.15.133:0/4078642406 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f811c156d70 con 0x7f811c155de0 2023-12-19T18:59:37.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.595+0000 7f8121a9a640 1 -- 172.21.15.133:0/4078642406 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f811c156d70 con 0x7f811c155de0 2023-12-19T18:59:37.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.595+0000 7f8103fff640 1 -- 172.21.15.133:0/4078642406 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f811c156d70 con 0x7f811c155de0 2023-12-19T18:59:37.600 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:37.600 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/2717901150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6835","nonce":2717901150},{"type":"v1","addr":"172.21.15.138:6837","nonce":2717901150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4986,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6836/3989181473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":3989181473},{"type":"v1","addr":"172.21.15.138:6836","nonce":3989181473}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4992,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/3180094953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":3180094953},{"type":"v1","addr":"172.21.15.133:6834","nonce":3180094953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:59:27.233483+0000","modified":"2023-12-19T18:59:30.251421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4995},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4995":{"gid":4995,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/862459875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":862459875},{"type":"v1","addr":"172.21.15.133:6835","nonce":862459875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T18:59:37.600 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 17 2023-12-19T18:59:37.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.595+0000 7f8121a9a640 1 -- 172.21.15.133:0/4078642406 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8108066470 msgr2=0x7f8108068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:37.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.595+0000 7f8121a9a640 1 --2- 172.21.15.133:0/4078642406 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8108066470 0x7f8108068930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f810c0ad000 tx=0x7f810c0a6000 comp rx=0 tx=0).stop 2023-12-19T18:59:37.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.595+0000 7f8121a9a640 1 -- 172.21.15.133:0/4078642406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f811c155de0 msgr2=0x7f811c15bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:37.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.595+0000 7f8121a9a640 1 --2- 172.21.15.133:0/4078642406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f811c155de0 0x7f811c15bb10 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f811400cb70 tx=0x7f811400a430 comp rx=0 tx=0).stop 2023-12-19T18:59:37.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.595+0000 7f8121a9a640 1 -- 172.21.15.133:0/4078642406 shutdown_connections 2023-12-19T18:59:37.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.595+0000 7f8121a9a640 1 --2- 172.21.15.133:0/4078642406 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8108066470 0x7f8108068930 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:37.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.595+0000 7f8121a9a640 1 --2- 172.21.15.133:0/4078642406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f811c155de0 0x7f811c15bb10 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:37.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.595+0000 7f8121a9a640 1 --2- 172.21.15.133:0/4078642406 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f811c0c5640 0x7f811c0bfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:37.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.595+0000 7f8121a9a640 1 --2- 172.21.15.133:0/4078642406 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f811c0c5260 0x7f811c1543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:37.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.595+0000 7f8121a9a640 1 -- 172.21.15.133:0/4078642406 >> 172.21.15.133:0/4078642406 conn(0x7f811c06a5b0 msgr2=0x7f811c153870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:37.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.595+0000 7f8121a9a640 1 -- 172.21.15.133:0/4078642406 shutdown_connections 2023-12-19T18:59:37.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:37.595+0000 7f8121a9a640 1 -- 172.21.15.133:0/4078642406 wait complete. 2023-12-19T18:59:38.024 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T18:59:27.233483+0000', 'modified': '2023-12-19T18:59:30.251421+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4995}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4995': {'gid': 4995, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.133:6835/862459875', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6832', 'nonce': 862459875}, {'type': 'v1', 'addr': '172.21.15.133:6835', 'nonce': 862459875}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T18:59:38.024 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T18:59:38.024 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-19T18:59:38.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.159+0000 7f0917f2a640 1 Processor -- start 2023-12-19T18:59:38.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.159+0000 7f0917f2a640 1 -- start start 2023-12-19T18:59:38.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.159+0000 7f0917f2a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f09100c63c0 0x7f09100c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.159+0000 7f0917f2a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f09100c4100 0x7f09100c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.159+0000 7f0917f2a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09100c31c0 con 0x7f09100c29e0 2023-12-19T18:59:38.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.159+0000 7f0917f2a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09100c34a0 con 0x7f09100c63c0 2023-12-19T18:59:38.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.159+0000 7f0917f2a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09100c1030 con 0x7f09100c4100 2023-12-19T18:59:38.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.159+0000 7f0915cc6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f09100c63c0 0x7f09100c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.159+0000 7f09164c7640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f09100c29e0 0x7f09100a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43342/0 (socket says 172.21.15.133:43342) 2023-12-19T18:59:38.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.159+0000 7f09164c7640 1 -- 172.21.15.133:0/785573533 learned_addr learned my addr 172.21.15.133:0/785573533 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:38.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.159+0000 7f09154c5640 1 --2- 172.21.15.133:0/785573533 >> v2:172.21.15.138:3300/0 conn(0x7f09100c4100 0x7f09100c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.163+0000 7f0915cc6640 1 -- 172.21.15.133:0/785573533 >> v2:172.21.15.138:3300/0 conn(0x7f09100c4100 msgr2=0x7f09100c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:38.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.163+0000 7f0915cc6640 1 --2- 172.21.15.133:0/785573533 >> v2:172.21.15.138:3300/0 conn(0x7f09100c4100 0x7f09100c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.163+0000 7f0915cc6640 1 -- 172.21.15.133:0/785573533 >> v1:172.21.15.133:6789/0 conn(0x7f09100c29e0 legacy=0x7f09100a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:38.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.163+0000 7f0914cc4640 1 -- 172.21.15.133:0/785573533 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942837639 0 0) 0x7f09100c31c0 con 0x7f09100c29e0 2023-12-19T18:59:38.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.163+0000 7f0915cc6640 1 -- 172.21.15.133:0/785573533 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09100c1310 con 0x7f09100c63c0 2023-12-19T18:59:38.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.163+0000 7f0915cc6640 1 --2- 172.21.15.133:0/785573533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09100c63c0 0x7f09100c06d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f09100a8b40 tx=0x7f090c01e520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2fbbe77cf47911 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:38.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.163+0000 7f0914cc4640 1 -- 172.21.15.133:0/785573533 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c0ad650 con 0x7f09100c63c0 2023-12-19T18:59:38.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.163+0000 7f0914cc4640 1 -- 172.21.15.133:0/785573533 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c0ad7b0 con 0x7f09100c63c0 2023-12-19T18:59:38.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.163+0000 7f0914cc4640 1 -- 172.21.15.133:0/785573533 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c0adb40 con 0x7f09100c63c0 2023-12-19T18:59:38.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.163+0000 7f0917f2a640 1 -- 172.21.15.133:0/785573533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09100c63c0 msgr2=0x7f09100c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:38.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.163+0000 7f0917f2a640 1 --2- 172.21.15.133:0/785573533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09100c63c0 0x7f09100c06d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f09100a8b40 tx=0x7f090c01e520 comp rx=0 tx=0).stop 2023-12-19T18:59:38.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f0917f2a640 1 -- 172.21.15.133:0/785573533 shutdown_connections 2023-12-19T18:59:38.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f0917f2a640 1 --2- 172.21.15.133:0/785573533 >> v2:172.21.15.138:3300/0 conn(0x7f09100c4100 0x7f09100c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f0917f2a640 1 --2- 172.21.15.133:0/785573533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09100c63c0 0x7f09100c06d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f0917f2a640 1 -- 172.21.15.133:0/785573533 >> 172.21.15.133:0/785573533 conn(0x7f091006a5b0 msgr2=0x7f091006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:38.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f0917f2a640 1 -- 172.21.15.133:0/785573533 shutdown_connections 2023-12-19T18:59:38.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f0917f2a640 1 -- 172.21.15.133:0/785573533 wait complete. 2023-12-19T18:59:38.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f0917f2a640 1 Processor -- start 2023-12-19T18:59:38.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f0917f2a640 1 -- start start 2023-12-19T18:59:38.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f0917f2a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09100c29e0 0x7f0910150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f0917f2a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09100c4100 0x7f0910153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f0917f2a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09100c63c0 0x7f091006fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f0917f2a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0910150990 con 0x7f09100c4100 2023-12-19T18:59:38.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f0917f2a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0910156170 con 0x7f09100c29e0 2023-12-19T18:59:38.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f0917f2a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09101f0c50 con 0x7f09100c63c0 2023-12-19T18:59:38.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f09154c5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09100c4100 0x7f0910153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f09154c5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09100c4100 0x7f0910153ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38428/0 (socket says 172.21.15.133:38428) 2023-12-19T18:59:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f09154c5640 1 -- 172.21.15.133:0/4148682985 learned_addr learned my addr 172.21.15.133:0/4148682985 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f0915cc6640 1 --2- 172.21.15.133:0/4148682985 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09100c29e0 0x7f0910150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f09164c7640 1 --2- 172.21.15.133:0/4148682985 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09100c63c0 0x7f091006fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f09154c5640 1 -- 172.21.15.133:0/4148682985 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09100c63c0 msgr2=0x7f091006fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f09154c5640 1 --2- 172.21.15.133:0/4148682985 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09100c63c0 0x7f091006fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f09154c5640 1 -- 172.21.15.133:0/4148682985 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09100c29e0 msgr2=0x7f0910150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f09154c5640 1 --2- 172.21.15.133:0/4148682985 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09100c29e0 0x7f0910150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f09154c5640 1 -- 172.21.15.133:0/4148682985 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c009420 con 0x7f09100c4100 2023-12-19T18:59:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f0915cc6640 1 --2- 172.21.15.133:0/4148682985 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09100c29e0 0x7f0910150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.167+0000 7f09154c5640 1 --2- 172.21.15.133:0/4148682985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09100c4100 0x7f0910153ac0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f090000e930 tx=0x7f090000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.171+0000 7f09067fc640 1 -- 172.21.15.133:0/4148682985 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0900009690 con 0x7f09100c4100 2023-12-19T18:59:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.171+0000 7f09067fc640 1 -- 172.21.15.133:0/4148682985 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090000ca00 con 0x7f09100c4100 2023-12-19T18:59:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.171+0000 7f0917f2a640 1 -- 172.21.15.133:0/4148682985 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09101f0f30 con 0x7f09100c4100 2023-12-19T18:59:38.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.171+0000 7f09067fc640 1 -- 172.21.15.133:0/4148682985 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090000cd70 con 0x7f09100c4100 2023-12-19T18:59:38.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.171+0000 7f0917f2a640 1 -- 172.21.15.133:0/4148682985 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0910071f90 con 0x7f09100c4100 2023-12-19T18:59:38.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.171+0000 7f09067fc640 1 -- 172.21.15.133:0/4148682985 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0900013470 con 0x7f09100c4100 2023-12-19T18:59:38.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.171+0000 7f09067fc640 1 --2- 172.21.15.133:0/4148682985 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f08f4066470 0x7f08f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.171+0000 7f09067fc640 1 -- 172.21.15.133:0/4148682985 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0900084160 con 0x7f09100c4100 2023-12-19T18:59:38.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.171+0000 7f091b29d000 1 Processor -- start 2023-12-19T18:59:38.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.171+0000 7f0915cc6640 1 --2- 172.21.15.133:0/4148682985 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f08f4066470 0x7f08f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.171+0000 7f091b29d000 1 -- start start 2023-12-19T18:59:38.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f091b29d000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d644807650 0x55d644807a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f091b29d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644807f70 0x55d644808350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f091b29d000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d644808890 0x55d644851de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f091b29d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6446d1f00 con 0x55d644807f70 2023-12-19T18:59:38.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f091b29d000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d644661dd0 con 0x55d644808890 2023-12-19T18:59:38.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f091b29d000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d64465f300 con 0x55d644807650 2023-12-19T18:59:38.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f0915cc6640 1 --2- 172.21.15.133:0/4148682985 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f08f4066470 0x7f08f4068930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f090c0b1000 tx=0x7f090c0a9000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:38.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f09154c5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644807f70 0x55d644808350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f09154c5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644807f70 0x55d644808350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38440/0 (socket says 172.21.15.133:38440) 2023-12-19T18:59:38.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f09154c5640 1 -- 172.21.15.133:0/2759065696 learned_addr learned my addr 172.21.15.133:0/2759065696 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:38.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f09164c7640 1 --2- 172.21.15.133:0/2759065696 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d644808890 0x55d644851de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f0915cc6640 1 --2- 172.21.15.133:0/2759065696 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d644807650 0x55d644807a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f09154c5640 1 -- 172.21.15.133:0/2759065696 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d644807650 msgr2=0x55d644807a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:38.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f09154c5640 1 --2- 172.21.15.133:0/2759065696 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d644807650 0x55d644807a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f09154c5640 1 -- 172.21.15.133:0/2759065696 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d644808890 msgr2=0x55d644851de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:38.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f09154c5640 1 --2- 172.21.15.133:0/2759065696 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d644808890 0x55d644851de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f09154c5640 1 -- 172.21.15.133:0/2759065696 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d644352890 con 0x55d644807f70 2023-12-19T18:59:38.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f09154c5640 1 --2- 172.21.15.133:0/2759065696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644807f70 0x55d644808350 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f090005d120 tx=0x7f0900055b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538926ff549eb62 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:38.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f08f37fe640 1 -- 172.21.15.133:0/2759065696 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090005d650 con 0x55d644807f70 2023-12-19T18:59:38.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f08f37fe640 1 -- 172.21.15.133:0/2759065696 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0900053490 con 0x55d644807f70 2023-12-19T18:59:38.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f08f37fe640 1 -- 172.21.15.133:0/2759065696 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0900059170 con 0x55d644807f70 2023-12-19T18:59:38.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f091b29d000 1 -- 172.21.15.133:0/2759065696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644807f70 msgr2=0x55d644808350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:38.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f091b29d000 1 --2- 172.21.15.133:0/2759065696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644807f70 0x55d644808350 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f090005d120 tx=0x7f0900055b90 comp rx=0 tx=0).stop 2023-12-19T18:59:38.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f091b29d000 1 -- 172.21.15.133:0/2759065696 shutdown_connections 2023-12-19T18:59:38.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f091b29d000 1 --2- 172.21.15.133:0/2759065696 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d644808890 0x55d644851de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f091b29d000 1 --2- 172.21.15.133:0/2759065696 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644807f70 0x55d644808350 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f091b29d000 1 --2- 172.21.15.133:0/2759065696 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d644807650 0x55d644807a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f091b29d000 1 -- 172.21.15.133:0/2759065696 >> 172.21.15.133:0/2759065696 conn(0x55d6448102f0 msgr2=0x55d644847b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:38.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f091b29d000 1 -- 172.21.15.133:0/2759065696 shutdown_connections 2023-12-19T18:59:38.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f091b29d000 1 -- 172.21.15.133:0/2759065696 wait complete. 2023-12-19T18:59:38.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f091b29d000 1 -- start start 2023-12-19T18:59:38.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.175+0000 7f091b29d000 1 Processor -- start 2023-12-19T18:59:38.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f091b29d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644807650 0x55d64480c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f091b29d000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d644807f70 0x55d64480c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f091b29d000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d644808890 0x55d64480ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f091b29d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64465abf0 con 0x55d644807650 2023-12-19T18:59:38.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f091b29d000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d644612c60 con 0x55d644808890 2023-12-19T18:59:38.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f091b29d000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d644618b00 con 0x55d644807f70 2023-12-19T18:59:38.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f091b29d000 10 client.0 _ll_register_callbacks cb 0x55d6447f5710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:59:38.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f0915cc6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644807650 0x55d64480c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f0915cc6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644807650 0x55d64480c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38452/0 (socket says 172.21.15.133:38452) 2023-12-19T18:59:38.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f0915cc6640 1 -- 172.21.15.133:0/2939758093 learned_addr learned my addr 172.21.15.133:0/2939758093 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:38.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f09154c5640 1 --2- 172.21.15.133:0/2939758093 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d644807f70 0x55d64480c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f09164c7640 1 --2- 172.21.15.133:0/2939758093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d644808890 0x55d64480ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f0915cc6640 1 -- 172.21.15.133:0/2939758093 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d644807f70 msgr2=0x55d64480c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:38.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f0915cc6640 1 --2- 172.21.15.133:0/2939758093 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d644807f70 0x55d64480c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f0915cc6640 1 -- 172.21.15.133:0/2939758093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d644808890 msgr2=0x55d64480ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:38.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f0915cc6640 1 --2- 172.21.15.133:0/2939758093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d644808890 0x55d64480ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f0915cc6640 1 -- 172.21.15.133:0/2939758093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0910071f90 con 0x55d644807650 2023-12-19T18:59:38.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f09164c7640 1 --2- 172.21.15.133:0/2939758093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d644808890 0x55d64480ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:38.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f0915cc6640 1 --2- 172.21.15.133:0/2939758093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644807650 0x55d64480c400 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f090c01c150 tx=0x7f090c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5aadb9f51c89015 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:38.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f08f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-19T18:59:38.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f08f0ff9640 1 -- 172.21.15.133:0/2939758093 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c003af0 con 0x55d644807650 2023-12-19T18:59:38.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f08f0ff9640 1 -- 172.21.15.133:0/2939758093 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f090c0bd070 con 0x55d644807650 2023-12-19T18:59:38.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f091b29d000 1 -- 172.21.15.133:0/2939758093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d644618490 con 0x55d644807650 2023-12-19T18:59:38.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f08f0ff9640 1 -- 172.21.15.133:0/2939758093 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f090c003c50 con 0x55d644807650 2023-12-19T18:59:38.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f091b29d000 10 client.5190 fetch_fsmap learned FSMap version 17 2023-12-19T18:59:38.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f091b29d000 1 -- 172.21.15.133:0/2939758093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d64461b200 con 0x55d644807650 2023-12-19T18:59:38.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f08f0ff9640 1 -- 172.21.15.133:0/2939758093 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d644618490 con 0x55d644807650 2023-12-19T18:59:38.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f08f0ff9640 1 -- 172.21.15.133:0/2939758093 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f090c0c0040 con 0x55d644807650 2023-12-19T18:59:38.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f091b29d000 10 client.5190 fetch_fsmap finished waiting for FSMap version 17 2023-12-19T18:59:38.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f091b29d000 10 client.5190 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T18:59:38.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f091b29d000 20 client.5190 populate_metadata read hostname 'smithi133' 2023-12-19T18:59:38.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f091b29d000 1 --2- 172.21.15.133:0/2939758093 >> [v2:172.21.15.133:6832/862459875,v1:172.21.15.133:6835/862459875] conn(0x55d64485a140 0x55d64485c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f091b29d000 4 client.5190 mds_command: new command op to 4995 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-19T18:59:38.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f091b29d000 1 -- 172.21.15.133:0/2939758093 --> [v2:172.21.15.133:6832/862459875,v1:172.21.15.133:6835/862459875] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d644659540 con 0x55d64485a140 2023-12-19T18:59:38.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f09154c5640 1 --2- 172.21.15.133:0/2939758093 >> [v2:172.21.15.133:6832/862459875,v1:172.21.15.133:6835/862459875] conn(0x55d64485a140 0x55d64485c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f08f0ff9640 10 client.5190 ms_handle_connect on v2:172.21.15.133:6832/862459875 2023-12-19T18:59:38.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f09154c5640 1 --2- 172.21.15.133:0/2939758093 >> [v2:172.21.15.133:6832/862459875,v1:172.21.15.133:6835/862459875] conn(0x55d64485a140 0x55d64485c530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3eaddc7e16173ba9 server_cookie=4e97b5f0d9f641e1 in_seq=0 out_seq=0 2023-12-19T18:59:38.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f08f0ff9640 1 -- 172.21.15.133:0/2939758093 <== mds.0 v2:172.21.15.133:6832/862459875 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55d644659540 con 0x55d64485a140 2023-12-19T18:59:38.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.179+0000 7f08f0ff9640 10 client.5190 handle_command_reply: tid=0 2023-12-19T18:59:38.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.183+0000 7f091b29d000 1 client.5190 shutdown 2023-12-19T18:59:38.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.183+0000 7f091b29d000 1 -- 172.21.15.133:0/2939758093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644807650 msgr2=0x55d64480c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:38.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.183+0000 7f091b29d000 1 --2- 172.21.15.133:0/2939758093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644807650 0x55d64480c400 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f090c01c150 tx=0x7f090c01cd60 comp rx=0 tx=0).stop 2023-12-19T18:59:38.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.183+0000 7f091b29d000 1 -- 172.21.15.133:0/2939758093 shutdown_connections 2023-12-19T18:59:38.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.183+0000 7f091b29d000 1 --2- 172.21.15.133:0/2939758093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d644808890 0x55d64480ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.183+0000 7f091b29d000 1 --2- 172.21.15.133:0/2939758093 >> [v2:172.21.15.133:6832/862459875,v1:172.21.15.133:6835/862459875] conn(0x55d64485a140 0x55d64485c530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.183+0000 7f091b29d000 1 --2- 172.21.15.133:0/2939758093 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d644807f70 0x55d64480c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.183+0000 7f091b29d000 1 --2- 172.21.15.133:0/2939758093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644807650 0x55d64480c400 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.183+0000 7f08f0ff9640 0 client.5190 ms_handle_reset on v2:172.21.15.133:6832/862459875 2023-12-19T18:59:38.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.183+0000 7f091b29d000 1 -- 172.21.15.133:0/2939758093 >> 172.21.15.133:0/2939758093 conn(0x55d6448102f0 msgr2=0x55d644806d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:38.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.183+0000 7f091b29d000 1 -- 172.21.15.133:0/2939758093 shutdown_connections 2023-12-19T18:59:38.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.183+0000 7f091b29d000 1 -- 172.21.15.133:0/2939758093 wait complete. 2023-12-19T18:59:38.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.183+0000 7f091b29d000 20 client.5190 trim_cache size 0 max 16384 2023-12-19T18:59:38.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.195+0000 7f091b29d000 1 Processor -- start 2023-12-19T18:59:38.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f091b29d000 1 -- start start 2023-12-19T18:59:38.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f091b29d000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d644807650 0x55d6448acb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f091b29d000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d644807f70 0x55d6448ad0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f091b29d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644808890 0x55d6448ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f091b29d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d644313940 con 0x55d644808890 2023-12-19T18:59:38.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f091b29d000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64465d750 con 0x55d644807650 2023-12-19T18:59:38.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f091b29d000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d644654ef0 con 0x55d644807f70 2023-12-19T18:59:38.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f09164c7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644808890 0x55d6448ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f09164c7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644808890 0x55d6448ad5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38460/0 (socket says 172.21.15.133:38460) 2023-12-19T18:59:38.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f09164c7640 1 -- 172.21.15.133:0/3752693744 learned_addr learned my addr 172.21.15.133:0/3752693744 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:38.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f09154c5640 1 --2- 172.21.15.133:0/3752693744 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d644807f70 0x55d6448ad0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f0915cc6640 1 --2- 172.21.15.133:0/3752693744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d644807650 0x55d6448acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f09164c7640 1 -- 172.21.15.133:0/3752693744 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d644807f70 msgr2=0x55d6448ad0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:38.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f09164c7640 1 --2- 172.21.15.133:0/3752693744 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d644807f70 0x55d6448ad0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f09164c7640 1 -- 172.21.15.133:0/3752693744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d644807650 msgr2=0x55d6448acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:38.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f09164c7640 1 --2- 172.21.15.133:0/3752693744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d644807650 0x55d6448acb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f09164c7640 1 -- 172.21.15.133:0/3752693744 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d644601500 con 0x55d644808890 2023-12-19T18:59:38.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f09164c7640 1 --2- 172.21.15.133:0/3752693744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644808890 0x55d6448ad5e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0908000f90 tx=0x7f0908005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e0f1d290c5f9f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:38.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f08f3fff640 1 -- 172.21.15.133:0/3752693744 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0908001e30 con 0x55d644808890 2023-12-19T18:59:38.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f08f3fff640 1 -- 172.21.15.133:0/3752693744 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0908001f90 con 0x55d644808890 2023-12-19T18:59:38.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f08f3fff640 1 -- 172.21.15.133:0/3752693744 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0908016650 con 0x55d644808890 2023-12-19T18:59:38.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f091b29d000 1 -- 172.21.15.133:0/3752693744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644808890 msgr2=0x55d6448ad5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:38.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f091b29d000 1 --2- 172.21.15.133:0/3752693744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644808890 0x55d6448ad5e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0908000f90 tx=0x7f0908005d40 comp rx=0 tx=0).stop 2023-12-19T18:59:38.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f091b29d000 1 -- 172.21.15.133:0/3752693744 shutdown_connections 2023-12-19T18:59:38.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f091b29d000 1 --2- 172.21.15.133:0/3752693744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644808890 0x55d6448ad5e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f091b29d000 1 --2- 172.21.15.133:0/3752693744 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d644807f70 0x55d6448ad0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f091b29d000 1 --2- 172.21.15.133:0/3752693744 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d644807650 0x55d6448acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f091b29d000 1 -- 172.21.15.133:0/3752693744 >> 172.21.15.133:0/3752693744 conn(0x55d6448102f0 msgr2=0x55d6448435e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:38.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f091b29d000 1 -- 172.21.15.133:0/3752693744 shutdown_connections 2023-12-19T18:59:38.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f091b29d000 1 -- 172.21.15.133:0/3752693744 wait complete. 2023-12-19T18:59:38.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f091b29d000 1 -- start start 2023-12-19T18:59:38.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.199+0000 7f091b29d000 1 Processor -- start 2023-12-19T18:59:38.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d644807650 0x55d6448b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644807f70 0x55d6448b1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d644808890 0x55d6448b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d644659a80 con 0x55d644807f70 2023-12-19T18:59:38.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d644630cd0 con 0x55d644808890 2023-12-19T18:59:38.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d6443531b0 con 0x55d644807650 2023-12-19T18:59:38.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 10 client.0 _ll_register_callbacks cb 0x55d6447d5f60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:59:38.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f09154c5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644807f70 0x55d6448b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f09154c5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644807f70 0x55d6448b1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38464/0 (socket says 172.21.15.133:38464) 2023-12-19T18:59:38.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f09154c5640 1 -- 172.21.15.133:0/1099477812 learned_addr learned my addr 172.21.15.133:0/1099477812 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:38.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f0915cc6640 1 --2- 172.21.15.133:0/1099477812 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d644807650 0x55d6448b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f09164c7640 1 --2- 172.21.15.133:0/1099477812 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d644808890 0x55d6448b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f09154c5640 1 -- 172.21.15.133:0/1099477812 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d644807650 msgr2=0x55d6448b0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:38.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f09154c5640 1 --2- 172.21.15.133:0/1099477812 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d644807650 0x55d6448b0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f09154c5640 1 -- 172.21.15.133:0/1099477812 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d644808890 msgr2=0x55d6448b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:38.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f09154c5640 1 --2- 172.21.15.133:0/1099477812 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d644808890 0x55d6448b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f09154c5640 1 -- 172.21.15.133:0/1099477812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090800f040 con 0x55d644807f70 2023-12-19T18:59:38.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f09154c5640 1 --2- 172.21.15.133:0/1099477812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644807f70 0x55d6448b1330 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0900055510 tx=0x7f0900000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a53eb4a6dc2d28 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:38.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f08f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-19T18:59:38.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f08f0ff9640 1 -- 172.21.15.133:0/1099477812 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0900073040 con 0x55d644807f70 2023-12-19T18:59:38.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f08f0ff9640 1 -- 172.21.15.133:0/1099477812 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09000536f0 con 0x55d644807f70 2023-12-19T18:59:38.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 1 -- 172.21.15.133:0/1099477812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6445e1a50 con 0x55d644807f70 2023-12-19T18:59:38.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f08f0ff9640 1 -- 172.21.15.133:0/1099477812 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09000731a0 con 0x55d644807f70 2023-12-19T18:59:38.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 10 client.5196 fetch_fsmap learned FSMap version 17 2023-12-19T18:59:38.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 1 -- 172.21.15.133:0/1099477812 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55d644352cc0 con 0x55d644807f70 2023-12-19T18:59:38.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f08f0ff9640 1 -- 172.21.15.133:0/1099477812 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d6445e1a50 con 0x55d644807f70 2023-12-19T18:59:38.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f08f0ff9640 1 -- 172.21.15.133:0/1099477812 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f0900011070 con 0x55d644807f70 2023-12-19T18:59:38.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 10 client.5196 fetch_fsmap finished waiting for FSMap version 17 2023-12-19T18:59:38.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 10 client.5196 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T18:59:38.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 20 client.5196 populate_metadata read hostname 'smithi133' 2023-12-19T18:59:38.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 1 --2- 172.21.15.133:0/1099477812 >> [v2:172.21.15.133:6832/862459875,v1:172.21.15.133:6835/862459875] conn(0x55d6448b2370 0x55d6448b2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 4 client.5196 mds_command: new command op to 4995 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-19T18:59:38.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 1 -- 172.21.15.133:0/1099477812 --> [v2:172.21.15.133:6832/862459875,v1:172.21.15.133:6835/862459875] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d644688f30 con 0x55d6448b2370 2023-12-19T18:59:38.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f0915cc6640 1 --2- 172.21.15.133:0/1099477812 >> [v2:172.21.15.133:6832/862459875,v1:172.21.15.133:6835/862459875] conn(0x55d6448b2370 0x55d6448b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f0915cc6640 1 --2- 172.21.15.133:0/1099477812 >> [v2:172.21.15.133:6832/862459875,v1:172.21.15.133:6835/862459875] conn(0x55d6448b2370 0x55d6448b2750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=284cf3c286fbaa5c server_cookie=f8f00e714ccc12cb in_seq=0 out_seq=0 2023-12-19T18:59:38.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f08f0ff9640 10 client.5196 ms_handle_connect on v2:172.21.15.133:6832/862459875 2023-12-19T18:59:38.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f08f0ff9640 1 -- 172.21.15.133:0/1099477812 <== mds.0 v2:172.21.15.133:6832/862459875 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+323 (crc 0 0 0) 0x55d644688f30 con 0x55d6448b2370 2023-12-19T18:59:38.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f08f0ff9640 10 client.5196 handle_command_reply: tid=0 2023-12-19T18:59:38.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 1 client.5196 shutdown 2023-12-19T18:59:38.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 1 -- 172.21.15.133:0/1099477812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644807f70 msgr2=0x55d6448b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:38.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 1 --2- 172.21.15.133:0/1099477812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644807f70 0x55d6448b1330 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0900055510 tx=0x7f0900000bd0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 1 -- 172.21.15.133:0/1099477812 shutdown_connections 2023-12-19T18:59:38.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 1 --2- 172.21.15.133:0/1099477812 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x55d644808890 0x55d6448b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 1 --2- 172.21.15.133:0/1099477812 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x55d644807f70 0x55d6448b1330 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 1 --2- 172.21.15.133:0/1099477812 >> [v2:172.21.15.133:6832/862459875,v1:172.21.15.133:6835/862459875] conn(0x55d6448b2370 0x55d6448b2750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 1 --2- 172.21.15.133:0/1099477812 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x55d644807650 0x55d6448b0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 1 -- 172.21.15.133:0/1099477812 >> 172.21.15.133:0/1099477812 conn(0x55d6448102f0 msgr2=0x55d644842d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:38.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f08f0ff9640 0 client.5196 ms_handle_reset on v2:172.21.15.133:6832/862459875 2023-12-19T18:59:38.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 1 -- 172.21.15.133:0/1099477812 shutdown_connections 2023-12-19T18:59:38.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 1 -- 172.21.15.133:0/1099477812 wait complete. 2023-12-19T18:59:38.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.203+0000 7f091b29d000 20 client.5196 trim_cache size 0 max 16384 2023-12-19T18:59:38.216 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-19T18:59:38.216 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "03e63958-005e-4bf2-ae5b-291aceb6fbbf", 2023-12-19T18:59:38.216 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2023-12-19T18:59:38.216 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 4995, 2023-12-19T18:59:38.216 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-19T18:59:38.216 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-19T18:59:38.216 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-19T18:59:38.216 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 10.3518194, 2023-12-19T18:59:38.216 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 17, 2023-12-19T18:59:38.216 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 31, 2023-12-19T18:59:38.216 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 31, 2023-12-19T18:59:38.216 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 17.270668452999999 2023-12-19T18:59:38.217 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-19T18:59:38.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.207+0000 7f0917f2a640 1 -- 172.21.15.133:0/4148682985 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f08f4066470 msgr2=0x7f08f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:38.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.207+0000 7f0917f2a640 1 --2- 172.21.15.133:0/4148682985 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f08f4066470 0x7f08f4068930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f090c0b1000 tx=0x7f090c0a9000 comp rx=0 tx=0).stop 2023-12-19T18:59:38.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.207+0000 7f0917f2a640 1 -- 172.21.15.133:0/4148682985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09100c4100 msgr2=0x7f0910153ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:38.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.207+0000 7f0917f2a640 1 --2- 172.21.15.133:0/4148682985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09100c4100 0x7f0910153ac0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f090000e930 tx=0x7f090000edf0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.207+0000 7f0917f2a640 1 -- 172.21.15.133:0/4148682985 shutdown_connections 2023-12-19T18:59:38.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.207+0000 7f0917f2a640 1 --2- 172.21.15.133:0/4148682985 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f08f4066470 0x7f08f4068930 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.207+0000 7f0917f2a640 1 --2- 172.21.15.133:0/4148682985 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09100c63c0 0x7f091006fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.207+0000 7f0917f2a640 1 --2- 172.21.15.133:0/4148682985 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09100c4100 0x7f0910153ac0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.207+0000 7f0917f2a640 1 --2- 172.21.15.133:0/4148682985 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09100c29e0 0x7f0910150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.207+0000 7f0917f2a640 1 -- 172.21.15.133:0/4148682985 >> 172.21.15.133:0/4148682985 conn(0x7f091006a5b0 msgr2=0x7f09100a9680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:38.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.207+0000 7f0917f2a640 1 -- 172.21.15.133:0/4148682985 shutdown_connections 2023-12-19T18:59:38.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.207+0000 7f0917f2a640 1 -- 172.21.15.133:0/4148682985 wait complete. 2023-12-19T18:59:38.230 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T18:59:38.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.359+0000 7fedca832640 1 Processor -- start 2023-12-19T18:59:38.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.359+0000 7fedca832640 1 -- start start 2023-12-19T18:59:38.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedca832640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedc4151e90 0x7fedc40c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedca832640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fedc40c7ea0 0x7fedc406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedca832640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc406c860 con 0x7fedc40c4e60 2023-12-19T18:59:38.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedca832640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc40c8750 con 0x7fedc40c7ea0 2023-12-19T18:59:38.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedca832640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc41552d0 con 0x7fedc4151e90 2023-12-19T18:59:38.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc8dcf640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fedc40c4e60 0x7fedc406b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43354/0 (socket says 172.21.15.133:43354) 2023-12-19T18:59:38.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc8dcf640 1 -- 172.21.15.133:0/2365969390 learned_addr learned my addr 172.21.15.133:0/2365969390 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:38.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc37fe640 1 --2- 172.21.15.133:0/2365969390 >> v2:172.21.15.138:3300/0 conn(0x7fedc40c7ea0 0x7fedc406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc3fff640 1 --2- 172.21.15.133:0/2365969390 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedc4151e90 0x7fedc40c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc2ffd640 1 -- 172.21.15.133:0/2365969390 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945478035 0 0) 0x7fedc406c860 con 0x7fedc40c4e60 2023-12-19T18:59:38.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc2ffd640 1 -- 172.21.15.133:0/2365969390 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedac003530 con 0x7fedc40c4e60 2023-12-19T18:59:38.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc2ffd640 1 -- 172.21.15.133:0/2365969390 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1563609467 0 0) 0x7fedac003530 con 0x7fedc40c4e60 2023-12-19T18:59:38.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc2ffd640 1 -- 172.21.15.133:0/2365969390 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedc4151e90 msgr2=0x7fedc40c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:38.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc2ffd640 1 --2- 172.21.15.133:0/2365969390 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedc4151e90 0x7fedc40c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc2ffd640 1 -- 172.21.15.133:0/2365969390 >> v2:172.21.15.138:3300/0 conn(0x7fedc40c7ea0 msgr2=0x7fedc406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:38.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc2ffd640 1 --2- 172.21.15.133:0/2365969390 >> v2:172.21.15.138:3300/0 conn(0x7fedc40c7ea0 0x7fedc406b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc2ffd640 1 -- 172.21.15.133:0/2365969390 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc4154930 con 0x7fedc40c4e60 2023-12-19T18:59:38.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc2ffd640 1 -- 172.21.15.133:0/2365969390 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7fedbc001a00 con 0x7fedc40c4e60 2023-12-19T18:59:38.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc2ffd640 1 -- 172.21.15.133:0/2365969390 >> v1:172.21.15.133:6789/0 conn(0x7fedc40c4e60 legacy=0x7fedc406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:38.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc2ffd640 1 --2- 172.21.15.133:0/2365969390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedac003980 0x7fedac003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc2ffd640 1 --2- 172.21.15.133:0/2365969390 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedc4151e90 0x7fedac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc2ffd640 1 --2- 172.21.15.133:0/2365969390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedac004d10 0x7fedac005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc2ffd640 1 -- 172.21.15.133:0/2365969390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc40c8750 con 0x7fedac004d10 2023-12-19T18:59:38.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc2ffd640 1 -- 172.21.15.133:0/2365969390 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc41552d0 con 0x7fedac003980 2023-12-19T18:59:38.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc2ffd640 1 -- 172.21.15.133:0/2365969390 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedac00ba10 con 0x7fedc4151e90 2023-12-19T18:59:38.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc8dcf640 1 --2- 172.21.15.133:0/2365969390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedac004d10 0x7fedac005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc37fe640 1 --2- 172.21.15.133:0/2365969390 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedc4151e90 0x7fedac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc3fff640 1 --2- 172.21.15.133:0/2365969390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedac003980 0x7fedac003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc8dcf640 1 -- 172.21.15.133:0/2365969390 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedc4151e90 msgr2=0x7fedac0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:38.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc8dcf640 1 --2- 172.21.15.133:0/2365969390 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedc4151e90 0x7fedac0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc8dcf640 1 -- 172.21.15.133:0/2365969390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedac003980 msgr2=0x7fedac003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:38.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc8dcf640 1 --2- 172.21.15.133:0/2365969390 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedac003980 0x7fedac003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.363+0000 7fedc8dcf640 1 -- 172.21.15.133:0/2365969390 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac003530 con 0x7fedac004d10 2023-12-19T18:59:38.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.367+0000 7fedc8dcf640 1 --2- 172.21.15.133:0/2365969390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedac004d10 0x7fedac005190 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00a860 tx=0x7fedbc01d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5b25db2aba0dce server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:38.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.367+0000 7fedc2ffd640 1 -- 172.21.15.133:0/2365969390 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc0ad630 con 0x7fedac004d10 2023-12-19T18:59:38.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.367+0000 7fedc2ffd640 1 -- 172.21.15.133:0/2365969390 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedbc0a8070 con 0x7fedac004d10 2023-12-19T18:59:38.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.367+0000 7fedc2ffd640 1 -- 172.21.15.133:0/2365969390 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc0ad9f0 con 0x7fedac004d10 2023-12-19T18:59:38.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.367+0000 7fedca832640 1 -- 172.21.15.133:0/2365969390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedac004d10 msgr2=0x7fedac005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:38.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.367+0000 7fedca832640 1 --2- 172.21.15.133:0/2365969390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedac004d10 0x7fedac005190 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fedbc00a860 tx=0x7fedbc01d360 comp rx=0 tx=0).stop 2023-12-19T18:59:38.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.367+0000 7fedc8dcf640 1 -- 172.21.15.133:0/2365969390 reap_dead start 2023-12-19T18:59:38.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.367+0000 7fedca832640 1 -- 172.21.15.133:0/2365969390 shutdown_connections 2023-12-19T18:59:38.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.367+0000 7fedca832640 1 -- 172.21.15.133:0/2365969390 >> 172.21.15.133:0/2365969390 conn(0x7fedc40ca170 msgr2=0x7fedc40ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:38.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.367+0000 7fedca832640 1 -- 172.21.15.133:0/2365969390 shutdown_connections 2023-12-19T18:59:38.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.367+0000 7fedca832640 1 -- 172.21.15.133:0/2365969390 wait complete. 2023-12-19T18:59:38.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedca832640 1 Processor -- start 2023-12-19T18:59:38.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedca832640 1 -- start start 2023-12-19T18:59:38.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedca832640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedc4157fc0 0x7fedc41edac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedca832640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedc4158800 0x7fedc40af690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedca832640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc40c2790 0x7fedc4150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedca832640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc4151370 con 0x7fedc40c2790 2023-12-19T18:59:38.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedca832640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc40ae4e0 con 0x7fedc4157fc0 2023-12-19T18:59:38.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedca832640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc41f1370 con 0x7fedc4158800 2023-12-19T18:59:38.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedc8dcf640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc40c2790 0x7fedc4150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedc8dcf640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc40c2790 0x7fedc4150710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38482/0 (socket says 172.21.15.133:38482) 2023-12-19T18:59:38.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedc8dcf640 1 -- 172.21.15.133:0/4129348391 learned_addr learned my addr 172.21.15.133:0/4129348391 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:38.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedc3fff640 1 --2- 172.21.15.133:0/4129348391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedc4157fc0 0x7fedc41edac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedc8dcf640 1 -- 172.21.15.133:0/4129348391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedc4158800 msgr2=0x7fedc40af690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:38.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedc37fe640 1 --2- 172.21.15.133:0/4129348391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedc4158800 0x7fedc40af690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedc8dcf640 1 --2- 172.21.15.133:0/4129348391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedc4158800 0x7fedc40af690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedc8dcf640 1 -- 172.21.15.133:0/4129348391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedc4157fc0 msgr2=0x7fedc41edac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:38.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedc8dcf640 1 --2- 172.21.15.133:0/4129348391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedc4157fc0 0x7fedc41edac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedc8dcf640 1 -- 172.21.15.133:0/4129348391 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc41f1090 con 0x7fedc40c2790 2023-12-19T18:59:38.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedc3fff640 1 --2- 172.21.15.133:0/4129348391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedc4157fc0 0x7fedc41edac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:38.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedc37fe640 1 --2- 172.21.15.133:0/4129348391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedc4158800 0x7fedc40af690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:38.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedc8dcf640 1 --2- 172.21.15.133:0/4129348391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc40c2790 0x7fedc4150710 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fedbc01cdd0 tx=0x7fedac005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:38.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedc0ff9640 1 -- 172.21.15.133:0/4129348391 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc0011d0 con 0x7fedc40c2790 2023-12-19T18:59:38.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedc0ff9640 1 -- 172.21.15.133:0/4129348391 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedbc0017c0 con 0x7fedc40c2790 2023-12-19T18:59:38.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedca832640 1 -- 172.21.15.133:0/4129348391 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc41ecfe0 con 0x7fedc40c2790 2023-12-19T18:59:38.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedc0ff9640 1 -- 172.21.15.133:0/4129348391 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc0ad430 con 0x7fedc40c2790 2023-12-19T18:59:38.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedca832640 1 -- 172.21.15.133:0/4129348391 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc41ed5a0 con 0x7fedc40c2790 2023-12-19T18:59:38.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.371+0000 7fedca832640 1 -- 172.21.15.133:0/4129348391 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc41ece40 con 0x7fedc40c2790 2023-12-19T18:59:38.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.375+0000 7fedc0ff9640 1 -- 172.21.15.133:0/4129348391 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fedbc0aa030 con 0x7fedc40c2790 2023-12-19T18:59:38.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.375+0000 7fedc0ff9640 1 --2- 172.21.15.133:0/4129348391 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fedb00664a0 0x7fedb0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:38.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.375+0000 7fedc0ff9640 1 -- 172.21.15.133:0/4129348391 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fedbc11e030 con 0x7fedc40c2790 2023-12-19T18:59:38.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.375+0000 7fedc3fff640 1 --2- 172.21.15.133:0/4129348391 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fedb00664a0 0x7fedb0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:38.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.375+0000 7fedc3fff640 1 --2- 172.21.15.133:0/4129348391 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fedb00664a0 0x7fedb0068960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fedb4009a60 tx=0x7fedb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:38.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.379+0000 7fedc0ff9640 1 -- 172.21.15.133:0/4129348391 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fedc41ece40 con 0x7fedc40c2790 2023-12-19T18:59:38.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.559+0000 7fedca832640 1 -- 172.21.15.133:0/4129348391 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fedc41ece40 con 0x7fedc40c2790 2023-12-19T18:59:38.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.559+0000 7fedc0ff9640 1 -- 172.21.15.133:0/4129348391 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fedc41ece40 con 0x7fedc40c2790 2023-12-19T18:59:38.565 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T18:59:38.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.563+0000 7fedca832640 1 -- 172.21.15.133:0/4129348391 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fedb00664a0 msgr2=0x7fedb0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:38.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.563+0000 7fedca832640 1 --2- 172.21.15.133:0/4129348391 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fedb00664a0 0x7fedb0068960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fedb4009a60 tx=0x7fedb4008040 comp rx=0 tx=0).stop 2023-12-19T18:59:38.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.563+0000 7fedca832640 1 -- 172.21.15.133:0/4129348391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc40c2790 msgr2=0x7fedc4150710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:38.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.563+0000 7fedca832640 1 --2- 172.21.15.133:0/4129348391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc40c2790 0x7fedc4150710 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fedbc01cdd0 tx=0x7fedac005800 comp rx=0 tx=0).stop 2023-12-19T18:59:38.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.563+0000 7fedca832640 1 -- 172.21.15.133:0/4129348391 shutdown_connections 2023-12-19T18:59:38.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.563+0000 7fedca832640 1 --2- 172.21.15.133:0/4129348391 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fedb00664a0 0x7fedb0068960 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.563+0000 7fedca832640 1 --2- 172.21.15.133:0/4129348391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedc40c2790 0x7fedc4150710 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.563+0000 7fedca832640 1 --2- 172.21.15.133:0/4129348391 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedc4158800 0x7fedc40af690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.563+0000 7fedca832640 1 --2- 172.21.15.133:0/4129348391 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedc4157fc0 0x7fedc41edac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:38.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.563+0000 7fedca832640 1 -- 172.21.15.133:0/4129348391 >> 172.21.15.133:0/4129348391 conn(0x7fedc40ca170 msgr2=0x7fedc40a9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:38.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.563+0000 7fedca832640 1 -- 172.21.15.133:0/4129348391 shutdown_connections 2023-12-19T18:59:38.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:38.563+0000 7fedca832640 1 -- 172.21.15.133:0/4129348391 wait complete. 2023-12-19T18:59:38.586 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T18:59:38.587 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T18:59:38.587 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-19T18:59:38.587 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T18:59:38.587 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T18:59:38.587 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T18:59:38.587 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T18:59:38.587 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T18:59:38.587 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:59:38.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:38.588 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-19T18:59:38.601 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T18:59:38.601 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T18:59:38.602 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T18:59:38.602 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:38.602 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-19T18:59:38.602 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:38.602 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:59:38.602 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:38.602 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-19T18:59:38.602 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:59:38.602 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:38.602 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-19T18:59:38.602 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:59:38.603 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:38.603 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T18:59:38.603 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:38.603 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T18:59:38.603 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42382sec preferred_lft 42382sec 2023-12-19T18:59:38.603 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-12-19T18:59:38.603 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:38.603 INFO:teuthology.orchestra.run.smithi133.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T18:59:38.603 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 02:42:26:2c:b4:18 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:38.603 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T18:59:38.603 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:38.603 INFO:teuthology.orchestra.run.smithi133.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T18:59:38.604 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:38.604 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T18:59:38.604 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:38.604 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-19T18:59:38.604 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:38.604 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T18:59:38.604 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T18:59:38.604 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-19T18:59:38.604 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:38.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:38.605 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T18:59:38.661 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-19T18:59:38.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:38.754 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-19T18:59:38.804 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-19T18:59:38.804 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T18:59:38.805 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T18:59:38.805 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T18:59:38.805 INFO:teuthology.orchestra.run.smithi133.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T18:59:38.805 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T18:59:38.805 INFO:teuthology.orchestra.run.smithi133.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T18:59:38.805 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T18:59:38.805 INFO:teuthology.orchestra.run.smithi133.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T18:59:38.805 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T18:59:38.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:38.809 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-19T18:59:38.809 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-19T18:59:38.809 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T18:59:38.809 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T18:59:38.809 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T18:59:38.809 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-19T18:59:38.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:38.902 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-19T18:59:38.912 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T18:59:38.912 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:59:38.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:38.912 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-19T18:59:38.979 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:59:38.980 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T18:59:39.034 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:59:39.035 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:59:39.035 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T18:59:39.086 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T18:59:39.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:39.086 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T18:59:39.176 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T18:59:39.176 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T18:59:39.189 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T18:59:39.189 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T18:59:39.189 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-12-19T18:59:39.189 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 0@03e63958-005e-4bf2-ae5b-291aceb6fbbf.cephfs=/ 2023-12-19T18:59:39.190 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.133:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-12-19T18:59:39.194 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T18:59:39.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:39.194 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T18:59:39.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:39.215 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T18:59:39.279 INFO:teuthology.orchestra.run.smithi133.stdout:client5205 2023-12-19T18:59:39.280 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:59:39.280 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:59:39.335 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T18:59:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.507+0000 7f59055f8640 1 Processor -- start 2023-12-19T18:59:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.507+0000 7f59055f8640 1 -- start start 2023-12-19T18:59:39.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.511+0000 7f59055f8640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f59000a5370 0x7f59000c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:39.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.511+0000 7f59055f8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f59000c4110 0x7f5900150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:39.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.511+0000 7f59055f8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5900072090 0x7f59001514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:39.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.511+0000 7f59055f8640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59000c3070 con 0x7f59000a5370 2023-12-19T18:59:39.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.511+0000 7f59055f8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59000c2760 con 0x7f59000c4110 2023-12-19T18:59:39.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.511+0000 7f59055f8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59000a5750 con 0x7f5900072090 2023-12-19T18:59:39.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.511+0000 7f58feffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f59000a5370 0x7f59000c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:39.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.511+0000 7f58feffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f59000a5370 0x7f59000c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38498/0 (socket says 172.21.15.133:38498) 2023-12-19T18:59:39.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.511+0000 7f58feffd640 1 -- 172.21.15.133:0/3978201164 learned_addr learned my addr 172.21.15.133:0/3978201164 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:39.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.511+0000 7f58feffd640 1 -- 172.21.15.133:0/3978201164 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5900072090 msgr2=0x7f59001514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:39.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.511+0000 7f58feffd640 1 --2- 172.21.15.133:0/3978201164 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5900072090 0x7f59001514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:39.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.511+0000 7f58feffd640 1 -- 172.21.15.133:0/3978201164 >> v2:172.21.15.138:3300/0 conn(0x7f59000c4110 msgr2=0x7f5900150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:39.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.511+0000 7f58feffd640 1 --2- 172.21.15.133:0/3978201164 >> v2:172.21.15.138:3300/0 conn(0x7f59000c4110 0x7f5900150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:39.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.511+0000 7f58feffd640 1 -- 172.21.15.133:0/3978201164 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59000aad20 con 0x7f59000a5370 2023-12-19T18:59:39.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.515+0000 7f58feffd640 1 --2- 172.21.15.133:0/3978201164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59000a5370 0x7f59000c3bd0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f590006b360 tx=0x7f58f001ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a064a7e5df0f279 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:39.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.515+0000 7f58fe7fc640 1 -- 172.21.15.133:0/3978201164 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f00a78a0 con 0x7f59000a5370 2023-12-19T18:59:39.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.515+0000 7f58fe7fc640 1 -- 172.21.15.133:0/3978201164 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f00a7a00 con 0x7f59000a5370 2023-12-19T18:59:39.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.515+0000 7f58fe7fc640 1 -- 172.21.15.133:0/3978201164 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f00a7d90 con 0x7f59000a5370 2023-12-19T18:59:39.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.515+0000 7f59055f8640 1 -- 172.21.15.133:0/3978201164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59000a5370 msgr2=0x7f59000c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:39.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.515+0000 7f59055f8640 1 --2- 172.21.15.133:0/3978201164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59000a5370 0x7f59000c3bd0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f590006b360 tx=0x7f58f001ea90 comp rx=0 tx=0).stop 2023-12-19T18:59:39.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.515+0000 7f59055f8640 1 -- 172.21.15.133:0/3978201164 shutdown_connections 2023-12-19T18:59:39.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.515+0000 7f59055f8640 1 --2- 172.21.15.133:0/3978201164 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5900072090 0x7f59001514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:39.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.515+0000 7f59055f8640 1 --2- 172.21.15.133:0/3978201164 >> v2:172.21.15.138:3300/0 conn(0x7f59000c4110 0x7f5900150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:39.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.515+0000 7f59055f8640 1 --2- 172.21.15.133:0/3978201164 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59000a5370 0x7f59000c3bd0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:39.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.515+0000 7f59055f8640 1 -- 172.21.15.133:0/3978201164 >> 172.21.15.133:0/3978201164 conn(0x7f590006a5b0 msgr2=0x7f590006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:39.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.515+0000 7f59055f8640 1 -- 172.21.15.133:0/3978201164 shutdown_connections 2023-12-19T18:59:39.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.515+0000 7f59055f8640 1 -- 172.21.15.133:0/3978201164 wait complete. 2023-12-19T18:59:39.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.515+0000 7f59055f8640 1 Processor -- start 2023-12-19T18:59:39.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.515+0000 7f59055f8640 1 -- start start 2023-12-19T18:59:39.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f59055f8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5900072090 0x7f590014be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:39.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f59055f8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59000a5370 0x7f59001f1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:39.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f59055f8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59000c4110 0x7f5900146ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:39.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f59055f8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59001f19b0 con 0x7f59000a5370 2023-12-19T18:59:39.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f59055f8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5900147c80 con 0x7f5900072090 2023-12-19T18:59:39.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f59055f8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59001f1630 con 0x7f59000c4110 2023-12-19T18:59:39.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f58f67fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59000a5370 0x7f59001f1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:39.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f58f67fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59000a5370 0x7f59001f1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38512/0 (socket says 172.21.15.133:38512) 2023-12-19T18:59:39.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f58f67fc640 1 -- 172.21.15.133:0/1810904532 learned_addr learned my addr 172.21.15.133:0/1810904532 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:39.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f58feffd640 1 --2- 172.21.15.133:0/1810904532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5900072090 0x7f590014be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:39.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f58ff7fe640 1 --2- 172.21.15.133:0/1810904532 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59000c4110 0x7f5900146ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:39.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f58f67fc640 1 -- 172.21.15.133:0/1810904532 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59000c4110 msgr2=0x7f5900146ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:39.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f58f67fc640 1 --2- 172.21.15.133:0/1810904532 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59000c4110 0x7f5900146ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:39.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f58f67fc640 1 -- 172.21.15.133:0/1810904532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5900072090 msgr2=0x7f590014be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:39.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f58f67fc640 1 --2- 172.21.15.133:0/1810904532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5900072090 0x7f590014be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:39.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f58f67fc640 1 -- 172.21.15.133:0/1810904532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f0009b30 con 0x7f59000a5370 2023-12-19T18:59:39.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f58feffd640 1 --2- 172.21.15.133:0/1810904532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5900072090 0x7f590014be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:39.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f58f67fc640 1 --2- 172.21.15.133:0/1810904532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59000a5370 0x7f59001f1dd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f58e800b410 tx=0x7f58e800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:39.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f58f7fff640 1 -- 172.21.15.133:0/1810904532 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e8011830 con 0x7f59000a5370 2023-12-19T18:59:39.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f58f7fff640 1 -- 172.21.15.133:0/1810904532 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e8011990 con 0x7f59000a5370 2023-12-19T18:59:39.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f59055f8640 1 -- 172.21.15.133:0/1810904532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5900150400 con 0x7f59000a5370 2023-12-19T18:59:39.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f58f7fff640 1 -- 172.21.15.133:0/1810904532 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e8011d40 con 0x7f59000a5370 2023-12-19T18:59:39.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f59055f8640 1 -- 172.21.15.133:0/1810904532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59001509c0 con 0x7f59000a5370 2023-12-19T18:59:39.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f59055f8640 1 -- 172.21.15.133:0/1810904532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5900068400 con 0x7f59000a5370 2023-12-19T18:59:39.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.519+0000 7f58f7fff640 1 -- 172.21.15.133:0/1810904532 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f58e801a400 con 0x7f59000a5370 2023-12-19T18:59:39.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.523+0000 7f58f7fff640 1 --2- 172.21.15.133:0/1810904532 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f58e0066470 0x7f58e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:39.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.523+0000 7f58f7fff640 1 -- 172.21.15.133:0/1810904532 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58e8083fb0 con 0x7f59000a5370 2023-12-19T18:59:39.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.523+0000 7f58feffd640 1 --2- 172.21.15.133:0/1810904532 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f58e0066470 0x7f58e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:39.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.523+0000 7f58feffd640 1 --2- 172.21.15.133:0/1810904532 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f58e0066470 0x7f58e0068930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f58f00b0000 tx=0x7f58f00a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:39.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.527+0000 7f58f7fff640 1 -- 172.21.15.133:0/1810904532 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f58e8051420 con 0x7f59000a5370 2023-12-19T18:59:39.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.707+0000 7f59055f8640 1 -- 172.21.15.133:0/1810904532 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f59000c6780 con 0x7f59000a5370 2023-12-19T18:59:39.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.707+0000 7f58f7fff640 1 -- 172.21.15.133:0/1810904532 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f58e8015070 con 0x7f59000a5370 2023-12-19T18:59:39.712 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T18:59:39.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.707+0000 7f59055f8640 1 -- 172.21.15.133:0/1810904532 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f58e0066470 msgr2=0x7f58e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:39.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.707+0000 7f59055f8640 1 --2- 172.21.15.133:0/1810904532 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f58e0066470 0x7f58e0068930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f58f00b0000 tx=0x7f58f00a9070 comp rx=0 tx=0).stop 2023-12-19T18:59:39.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.707+0000 7f59055f8640 1 -- 172.21.15.133:0/1810904532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59000a5370 msgr2=0x7f59001f1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:39.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.707+0000 7f59055f8640 1 --2- 172.21.15.133:0/1810904532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59000a5370 0x7f59001f1dd0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f58e800b410 tx=0x7f58e800b8d0 comp rx=0 tx=0).stop 2023-12-19T18:59:39.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.707+0000 7f59055f8640 1 -- 172.21.15.133:0/1810904532 shutdown_connections 2023-12-19T18:59:39.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.707+0000 7f59055f8640 1 --2- 172.21.15.133:0/1810904532 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f58e0066470 0x7f58e0068930 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:39.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.707+0000 7f59055f8640 1 --2- 172.21.15.133:0/1810904532 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f59000c4110 0x7f5900146ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:39.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.707+0000 7f59055f8640 1 --2- 172.21.15.133:0/1810904532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f59000a5370 0x7f59001f1dd0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:39.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.707+0000 7f59055f8640 1 --2- 172.21.15.133:0/1810904532 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5900072090 0x7f590014be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:39.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.707+0000 7f59055f8640 1 -- 172.21.15.133:0/1810904532 >> 172.21.15.133:0/1810904532 conn(0x7f590006a5b0 msgr2=0x7f59001544e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:39.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.707+0000 7f59055f8640 1 -- 172.21.15.133:0/1810904532 shutdown_connections 2023-12-19T18:59:39.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:39.707+0000 7f59055f8640 1 -- 172.21.15.133:0/1810904532 wait complete. 2023-12-19T18:59:39.733 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T18:59:39.733 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T18:59:39.733 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi138.front.sepia.ceph.com 2023-12-19T18:59:39.733 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T18:59:39.733 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T18:59:39.733 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T18:59:39.733 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T18:59:39.733 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T18:59:39.733 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T18:59:39.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:39.734 DEBUG:teuthology.orchestra.run.smithi138:> ip addr 2023-12-19T18:59:39.744 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T18:59:39.744 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T18:59:39.744 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T18:59:39.744 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:39.744 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2023-12-19T18:59:39.744 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:39.744 INFO:teuthology.orchestra.run.smithi138.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:59:39.744 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7a brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:39.744 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f0 2023-12-19T18:59:39.744 INFO:teuthology.orchestra.run.smithi138.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:59:39.744 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7b brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:39.744 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f1 2023-12-19T18:59:39.745 INFO:teuthology.orchestra.run.smithi138.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:59:39.745 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:70 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:39.745 INFO:teuthology.orchestra.run.smithi138.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T18:59:39.745 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:71 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:39.745 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.21.15.138/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T18:59:39.745 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft 42374sec preferred_lft 42374sec 2023-12-19T18:59:39.745 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::ec4:7aff:fe88:6f71/64 scope link 2023-12-19T18:59:39.745 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:39.745 INFO:teuthology.orchestra.run.smithi138.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T18:59:39.745 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 02:42:5b:f5:51:87 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:39.745 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T18:59:39.745 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:39.745 INFO:teuthology.orchestra.run.smithi138.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T18:59:39.745 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:39.746 INFO:teuthology.orchestra.run.smithi138.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T18:59:39.746 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:39.746 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-19T18:59:39.746 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:39.746 INFO:teuthology.orchestra.run.smithi138.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T18:59:39.746 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T18:59:39.746 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-19T18:59:39.746 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:39.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:39.747 DEBUG:teuthology.orchestra.run.smithi138:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T18:59:39.811 INFO:teuthology.orchestra.run.smithi138.stdout:1 2023-12-19T18:59:39.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:39.814 DEBUG:teuthology.orchestra.run.smithi138:> route 2023-12-19T18:59:39.866 INFO:teuthology.orchestra.run.smithi138.stdout:Kernel IP routing table 2023-12-19T18:59:39.866 INFO:teuthology.orchestra.run.smithi138.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T18:59:39.866 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T18:59:39.866 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T18:59:39.867 INFO:teuthology.orchestra.run.smithi138.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T18:59:39.867 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T18:59:39.867 INFO:teuthology.orchestra.run.smithi138.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T18:59:39.867 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T18:59:39.867 INFO:teuthology.orchestra.run.smithi138.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T18:59:39.867 INFO:teuthology.orchestra.run.smithi138.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T18:59:39.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:39.867 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-12-19T18:59:39.867 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-12-19T18:59:39.867 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T18:59:39.867 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T18:59:39.868 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T18:59:39.868 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-12-19T18:59:39.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:39.963 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2023-12-19T18:59:39.973 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T18:59:39.973 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T18:59:39.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:39.974 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set brx.0 up 2023-12-19T18:59:40.036 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:59:40.037 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T18:59:40.091 INFO:teuthology.orchestra.run.smithi138.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T18:59:40.092 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:59:40.092 DEBUG:teuthology.orchestra.run.smithi138:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T18:59:40.143 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T18:59:40.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:40.143 DEBUG:teuthology.orchestra.run.smithi138:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T18:59:40.239 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T18:59:40.240 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T18:59:40.253 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T18:59:40.253 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T18:59:40.253 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-12-19T18:59:40.253 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: trying mount with new device syntax: 1@03e63958-005e-4bf2-ae5b-291aceb6fbbf.cephfs=/ 2023-12-19T18:59:40.253 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.133:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-12-19T18:59:40.257 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T18:59:40.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:40.257 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T18:59:40.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:40.278 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T18:59:40.330 INFO:teuthology.orchestra.run.smithi138.stdout:client5214 2023-12-19T18:59:40.330 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:59:40.331 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:59:40.383 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-12-19T18:59:40.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.515+0000 7f29b7f57640 1 Processor -- start 2023-12-19T18:59:40.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.515+0000 7f29b7f57640 1 -- start start 2023-12-19T18:59:40.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.515+0000 7f29b7f57640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29b00a5370 0x7f29b00c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:40.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.515+0000 7f29b7f57640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f29b00c4110 0x7f29b0150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:40.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.515+0000 7f29b7f57640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f29b0072090 0x7f29b01514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:40.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.515+0000 7f29b7f57640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b00c3070 con 0x7f29b0072090 2023-12-19T18:59:40.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.515+0000 7f29b7f57640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b00c2760 con 0x7f29b00c4110 2023-12-19T18:59:40.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.515+0000 7f29b7f57640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b00a5750 con 0x7f29b00a5370 2023-12-19T18:59:40.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.519+0000 7f29b64f4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f29b0072090 0x7f29b01514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:40.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.519+0000 7f29b64f4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f29b0072090 0x7f29b01514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38528/0 (socket says 172.21.15.133:38528) 2023-12-19T18:59:40.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.519+0000 7f29b64f4640 1 -- 172.21.15.133:0/334270189 learned_addr learned my addr 172.21.15.133:0/334270189 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:40.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.519+0000 7f29b5cf3640 1 --2- 172.21.15.133:0/334270189 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29b00a5370 0x7f29b00c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:40.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.519+0000 7f29b54f2640 1 --2- 172.21.15.133:0/334270189 >> v2:172.21.15.138:3300/0 conn(0x7f29b00c4110 0x7f29b0150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:40.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.519+0000 7f29b64f4640 1 -- 172.21.15.133:0/334270189 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29b00a5370 msgr2=0x7f29b00c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:40.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.519+0000 7f29b64f4640 1 --2- 172.21.15.133:0/334270189 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29b00a5370 0x7f29b00c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:40.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.519+0000 7f29b64f4640 1 -- 172.21.15.133:0/334270189 >> v2:172.21.15.138:3300/0 conn(0x7f29b00c4110 msgr2=0x7f29b0150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:40.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.519+0000 7f29b64f4640 1 --2- 172.21.15.133:0/334270189 >> v2:172.21.15.138:3300/0 conn(0x7f29b00c4110 0x7f29b0150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:40.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.519+0000 7f29b64f4640 1 -- 172.21.15.133:0/334270189 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b00aad20 con 0x7f29b0072090 2023-12-19T18:59:40.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.519+0000 7f29b54f2640 1 --2- 172.21.15.133:0/334270189 >> v2:172.21.15.138:3300/0 conn(0x7f29b00c4110 0x7f29b0150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:40.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.519+0000 7f29b64f4640 1 --2- 172.21.15.133:0/334270189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29b0072090 0x7f29b01514e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f29b006b480 tx=0x7f29a801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1d42e3f7b270a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:40.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.519+0000 7f29b4cf1640 1 -- 172.21.15.133:0/334270189 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a80a5680 con 0x7f29b0072090 2023-12-19T18:59:40.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.519+0000 7f29b4cf1640 1 -- 172.21.15.133:0/334270189 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a80a57e0 con 0x7f29b0072090 2023-12-19T18:59:40.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.519+0000 7f29b4cf1640 1 -- 172.21.15.133:0/334270189 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a80a5b70 con 0x7f29b0072090 2023-12-19T18:59:40.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b7f57640 1 -- 172.21.15.133:0/334270189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29b0072090 msgr2=0x7f29b01514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:40.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b7f57640 1 --2- 172.21.15.133:0/334270189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29b0072090 0x7f29b01514e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f29b006b480 tx=0x7f29a801c880 comp rx=0 tx=0).stop 2023-12-19T18:59:40.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b7f57640 1 -- 172.21.15.133:0/334270189 shutdown_connections 2023-12-19T18:59:40.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b7f57640 1 --2- 172.21.15.133:0/334270189 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29b0072090 0x7f29b01514e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:40.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b7f57640 1 --2- 172.21.15.133:0/334270189 >> v2:172.21.15.138:3300/0 conn(0x7f29b00c4110 0x7f29b0150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:40.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b7f57640 1 --2- 172.21.15.133:0/334270189 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29b00a5370 0x7f29b00c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:40.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b7f57640 1 -- 172.21.15.133:0/334270189 >> 172.21.15.133:0/334270189 conn(0x7f29b006a5b0 msgr2=0x7f29b006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:40.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b7f57640 1 -- 172.21.15.133:0/334270189 shutdown_connections 2023-12-19T18:59:40.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b7f57640 1 -- 172.21.15.133:0/334270189 wait complete. 2023-12-19T18:59:40.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b7f57640 1 Processor -- start 2023-12-19T18:59:40.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b7f57640 1 -- start start 2023-12-19T18:59:40.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b7f57640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29b0072090 0x7f29b014f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:40.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b7f57640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29b00a5370 0x7f29b01ed860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:40.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b7f57640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29b00c4110 0x7f29b01edda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:40.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b7f57640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b01ed430 con 0x7f29b0072090 2023-12-19T18:59:40.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b7f57640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b01ee8a0 con 0x7f29b00c4110 2023-12-19T18:59:40.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b7f57640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b0150ba0 con 0x7f29b00a5370 2023-12-19T18:59:40.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b5cf3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29b0072090 0x7f29b014f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:40.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b5cf3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29b0072090 0x7f29b014f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38536/0 (socket says 172.21.15.133:38536) 2023-12-19T18:59:40.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b5cf3640 1 -- 172.21.15.133:0/3175994088 learned_addr learned my addr 172.21.15.133:0/3175994088 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:40.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b64f4640 1 --2- 172.21.15.133:0/3175994088 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29b00c4110 0x7f29b01edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:40.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b54f2640 1 --2- 172.21.15.133:0/3175994088 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29b00a5370 0x7f29b01ed860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:40.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b5cf3640 1 -- 172.21.15.133:0/3175994088 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29b00a5370 msgr2=0x7f29b01ed860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:40.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b5cf3640 1 --2- 172.21.15.133:0/3175994088 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29b00a5370 0x7f29b01ed860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:40.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b5cf3640 1 -- 172.21.15.133:0/3175994088 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29b00c4110 msgr2=0x7f29b01edda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:40.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b5cf3640 1 --2- 172.21.15.133:0/3175994088 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29b00c4110 0x7f29b01edda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:40.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.523+0000 7f29b5cf3640 1 -- 172.21.15.133:0/3175994088 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a8009b30 con 0x7f29b0072090 2023-12-19T18:59:40.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.527+0000 7f29b5cf3640 1 --2- 172.21.15.133:0/3175994088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29b0072090 0x7f29b014f370 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00d800 tx=0x7f29ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:40.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.527+0000 7f29a67fc640 1 -- 172.21.15.133:0/3175994088 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac0096a0 con 0x7f29b0072090 2023-12-19T18:59:40.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.527+0000 7f29a67fc640 1 -- 172.21.15.133:0/3175994088 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac009800 con 0x7f29b0072090 2023-12-19T18:59:40.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.527+0000 7f29b7f57640 1 -- 172.21.15.133:0/3175994088 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b01508c0 con 0x7f29b0072090 2023-12-19T18:59:40.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.527+0000 7f29a67fc640 1 -- 172.21.15.133:0/3175994088 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac009b70 con 0x7f29b0072090 2023-12-19T18:59:40.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.527+0000 7f29b7f57640 1 -- 172.21.15.133:0/3175994088 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b01f1730 con 0x7f29b0072090 2023-12-19T18:59:40.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.527+0000 7f29b7f57640 1 -- 172.21.15.133:0/3175994088 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b0068400 con 0x7f29b0072090 2023-12-19T18:59:40.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.527+0000 7f29a67fc640 1 -- 172.21.15.133:0/3175994088 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f29ac009cd0 con 0x7f29b0072090 2023-12-19T18:59:40.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.527+0000 7f29a67fc640 1 --2- 172.21.15.133:0/3175994088 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2994066470 0x7f2994068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:40.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.527+0000 7f29a67fc640 1 -- 172.21.15.133:0/3175994088 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29ac084560 con 0x7f29b0072090 2023-12-19T18:59:40.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.527+0000 7f29b54f2640 1 --2- 172.21.15.133:0/3175994088 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2994066470 0x7f2994068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:40.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.531+0000 7f29b54f2640 1 --2- 172.21.15.133:0/3175994088 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2994066470 0x7f2994068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f29b0154580 tx=0x7f29a0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:40.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.531+0000 7f29a67fc640 1 -- 172.21.15.133:0/3175994088 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f29ac0519d0 con 0x7f29b0072090 2023-12-19T18:59:40.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.735+0000 7f29b7f57640 1 -- 172.21.15.133:0/3175994088 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f29b00a8fd0 con 0x7f29b0072090 2023-12-19T18:59:40.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.735+0000 7f29a67fc640 1 -- 172.21.15.133:0/3175994088 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v11) v1 ==== 84+0+0 (secure 0 0 0) 0x7f29ac054ff0 con 0x7f29b0072090 2023-12-19T18:59:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.735+0000 7f29b7f57640 1 -- 172.21.15.133:0/3175994088 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2994066470 msgr2=0x7f2994068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.735+0000 7f29b7f57640 1 --2- 172.21.15.133:0/3175994088 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2994066470 0x7f2994068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f29b0154580 tx=0x7f29a0008040 comp rx=0 tx=0).stop 2023-12-19T18:59:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.735+0000 7f29b7f57640 1 -- 172.21.15.133:0/3175994088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29b0072090 msgr2=0x7f29b014f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.735+0000 7f29b7f57640 1 --2- 172.21.15.133:0/3175994088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29b0072090 0x7f29b014f370 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f29ac00d800 tx=0x7f29ac00dcc0 comp rx=0 tx=0).stop 2023-12-19T18:59:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.735+0000 7f29b7f57640 1 -- 172.21.15.133:0/3175994088 shutdown_connections 2023-12-19T18:59:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.735+0000 7f29b7f57640 1 --2- 172.21.15.133:0/3175994088 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2994066470 0x7f2994068930 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:40.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.735+0000 7f29b7f57640 1 --2- 172.21.15.133:0/3175994088 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29b00c4110 0x7f29b01edda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.735+0000 7f29b7f57640 1 --2- 172.21.15.133:0/3175994088 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29b00a5370 0x7f29b01ed860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.735+0000 7f29b7f57640 1 --2- 172.21.15.133:0/3175994088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f29b0072090 0x7f29b014f370 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.735+0000 7f29b7f57640 1 -- 172.21.15.133:0/3175994088 >> 172.21.15.133:0/3175994088 conn(0x7f29b006a5b0 msgr2=0x7f29b0146cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.735+0000 7f29b7f57640 1 -- 172.21.15.133:0/3175994088 shutdown_connections 2023-12-19T18:59:40.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.735+0000 7f29b7f57640 1 -- 172.21.15.133:0/3175994088 wait complete. 2023-12-19T18:59:40.761 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:59:40.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.895+0000 7ff739209640 1 Processor -- start 2023-12-19T18:59:40.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.895+0000 7ff739209640 1 -- start start 2023-12-19T18:59:40.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.895+0000 7ff739209640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff7340c5260 0x7ff73406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:40.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.899+0000 7ff739209640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff734155de0 0x7ff734156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:40.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.899+0000 7ff739209640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7340c2580 con 0x7ff7340c5640 2023-12-19T18:59:40.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.899+0000 7ff739209640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff734153510 con 0x7ff7340c5260 2023-12-19T18:59:40.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.899+0000 7ff739209640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7340c17f0 con 0x7ff734155de0 2023-12-19T18:59:40.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.899+0000 7ff732d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff7340c5260 0x7ff73406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:40.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.899+0000 7ff732d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff7340c5260 0x7ff73406d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38544/0 (socket says 172.21.15.133:38544) 2023-12-19T18:59:40.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.899+0000 7ff732d9d640 1 -- 172.21.15.133:0/2059744034 learned_addr learned my addr 172.21.15.133:0/2059744034 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:40.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.899+0000 7ff73359e640 1 --2- 172.21.15.133:0/2059744034 >> v2:172.21.15.138:3300/0 conn(0x7ff734155de0 0x7ff734156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:40.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.899+0000 7ff732d9d640 1 -- 172.21.15.133:0/2059744034 >> v2:172.21.15.138:3300/0 conn(0x7ff734155de0 msgr2=0x7ff734156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:40.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.899+0000 7ff732d9d640 1 --2- 172.21.15.133:0/2059744034 >> v2:172.21.15.138:3300/0 conn(0x7ff734155de0 0x7ff734156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:40.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.899+0000 7ff732d9d640 1 -- 172.21.15.133:0/2059744034 >> v1:172.21.15.138:6789/0 conn(0x7ff7340c5640 legacy=0x7ff7340c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:40.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.899+0000 7ff732d9d640 1 -- 172.21.15.133:0/2059744034 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7340c1a00 con 0x7ff7340c5260 2023-12-19T18:59:40.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.899+0000 7ff732d9d640 1 --2- 172.21.15.133:0/2059744034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7340c5260 0x7ff73406d5b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff7340c6b10 tx=0x7ff72401c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c5248938b0592f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:40.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.899+0000 7ff73259c640 1 -- 172.21.15.133:0/2059744034 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7240a5790 con 0x7ff7340c5260 2023-12-19T18:59:40.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.899+0000 7ff73259c640 1 -- 172.21.15.133:0/2059744034 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7240a58f0 con 0x7ff7340c5260 2023-12-19T18:59:40.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.899+0000 7ff73259c640 1 -- 172.21.15.133:0/2059744034 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7240a5c80 con 0x7ff7340c5260 2023-12-19T18:59:40.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.903+0000 7ff739209640 1 -- 172.21.15.133:0/2059744034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7340c5260 msgr2=0x7ff73406d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:40.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.903+0000 7ff739209640 1 --2- 172.21.15.133:0/2059744034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7340c5260 0x7ff73406d5b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff7340c6b10 tx=0x7ff72401c8d0 comp rx=0 tx=0).stop 2023-12-19T18:59:40.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.903+0000 7ff739209640 1 -- 172.21.15.133:0/2059744034 shutdown_connections 2023-12-19T18:59:40.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.903+0000 7ff739209640 1 --2- 172.21.15.133:0/2059744034 >> v2:172.21.15.138:3300/0 conn(0x7ff734155de0 0x7ff734156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:40.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.903+0000 7ff739209640 1 --2- 172.21.15.133:0/2059744034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7340c5260 0x7ff73406d5b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:40.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.903+0000 7ff739209640 1 -- 172.21.15.133:0/2059744034 >> 172.21.15.133:0/2059744034 conn(0x7ff73406a5b0 msgr2=0x7ff73406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:40.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.903+0000 7ff739209640 1 -- 172.21.15.133:0/2059744034 shutdown_connections 2023-12-19T18:59:40.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.903+0000 7ff739209640 1 -- 172.21.15.133:0/2059744034 wait complete. 2023-12-19T18:59:40.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.903+0000 7ff739209640 1 Processor -- start 2023-12-19T18:59:40.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.903+0000 7ff739209640 1 -- start start 2023-12-19T18:59:40.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.903+0000 7ff739209640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7340c5260 0x7ff7341549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:40.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.903+0000 7ff739209640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7340c5640 0x7ff73415c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:40.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.903+0000 7ff739209640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff734155de0 0x7ff7341ed750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:40.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.903+0000 7ff739209640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff734157ce0 con 0x7ff7340c5260 2023-12-19T18:59:40.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.903+0000 7ff739209640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7341f15a0 con 0x7ff734155de0 2023-12-19T18:59:40.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.903+0000 7ff739209640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7340aa860 con 0x7ff7340c5640 2023-12-19T18:59:40.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.903+0000 7ff732d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7340c5260 0x7ff7341549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:40.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.903+0000 7ff732d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7340c5260 0x7ff7341549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38548/0 (socket says 172.21.15.133:38548) 2023-12-19T18:59:40.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.903+0000 7ff732d9d640 1 -- 172.21.15.133:0/1967600844 learned_addr learned my addr 172.21.15.133:0/1967600844 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:40.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.903+0000 7ff73359e640 1 --2- 172.21.15.133:0/1967600844 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff734155de0 0x7ff7341ed750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:40.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.903+0000 7ff72a59c640 1 --2- 172.21.15.133:0/1967600844 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7340c5640 0x7ff73415c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:40.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.907+0000 7ff732d9d640 1 -- 172.21.15.133:0/1967600844 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7340c5640 msgr2=0x7ff73415c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:40.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.907+0000 7ff732d9d640 1 --2- 172.21.15.133:0/1967600844 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7340c5640 0x7ff73415c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:40.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.907+0000 7ff732d9d640 1 -- 172.21.15.133:0/1967600844 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff734155de0 msgr2=0x7ff7341ed750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:40.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.907+0000 7ff732d9d640 1 --2- 172.21.15.133:0/1967600844 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff734155de0 0x7ff7341ed750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:40.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.907+0000 7ff732d9d640 1 -- 172.21.15.133:0/1967600844 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff724009b30 con 0x7ff7340c5260 2023-12-19T18:59:40.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.907+0000 7ff732d9d640 1 --2- 172.21.15.133:0/1967600844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7340c5260 0x7ff7341549e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff7240af040 tx=0x7ff724019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:40.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.907+0000 7ff72bfff640 1 -- 172.21.15.133:0/1967600844 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7240b8670 con 0x7ff7340c5260 2023-12-19T18:59:40.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.907+0000 7ff72bfff640 1 -- 172.21.15.133:0/1967600844 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7240b87f0 con 0x7ff7340c5260 2023-12-19T18:59:40.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.907+0000 7ff739209640 1 -- 172.21.15.133:0/1967600844 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7340aab40 con 0x7ff7340c5260 2023-12-19T18:59:40.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.907+0000 7ff72bfff640 1 -- 172.21.15.133:0/1967600844 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7240b8ba0 con 0x7ff7340c5260 2023-12-19T18:59:40.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.907+0000 7ff739209640 1 -- 172.21.15.133:0/1967600844 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7341ed230 con 0x7ff7340c5260 2023-12-19T18:59:40.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.907+0000 7ff739209640 1 -- 172.21.15.133:0/1967600844 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff734068400 con 0x7ff7340c5260 2023-12-19T18:59:40.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.907+0000 7ff72bfff640 1 -- 172.21.15.133:0/1967600844 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff7240b8d00 con 0x7ff7340c5260 2023-12-19T18:59:40.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.907+0000 7ff72bfff640 1 --2- 172.21.15.133:0/1967600844 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff714066470 0x7ff714068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:40.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.911+0000 7ff72bfff640 1 -- 172.21.15.133:0/1967600844 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff72411f470 con 0x7ff7340c5260 2023-12-19T18:59:40.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.911+0000 7ff72a59c640 1 --2- 172.21.15.133:0/1967600844 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff714066470 0x7ff714068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:40.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.911+0000 7ff72a59c640 1 --2- 172.21.15.133:0/1967600844 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff714066470 0x7ff714068930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff73406dac0 tx=0x7ff71c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:40.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:40.915+0000 7ff72bfff640 1 -- 172.21.15.133:0/1967600844 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff7240eca00 con 0x7ff7340c5260 2023-12-19T18:59:41.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.063+0000 7ff739209640 1 -- 172.21.15.133:0/1967600844 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff73406d390 con 0x7ff7340c5260 2023-12-19T18:59:41.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.067+0000 7ff72bfff640 1 -- 172.21.15.133:0/1967600844 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16605 (secure 0 0 0) 0x7ff7240f0020 con 0x7ff7340c5260 2023-12-19T18:59:41.072 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:41.072 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":31,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:59:28.620155+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:59:25.798150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T18:59:26.236078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:59:41.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.067+0000 7ff739209640 1 -- 172.21.15.133:0/1967600844 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff714066470 msgr2=0x7ff714068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:41.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.067+0000 7ff739209640 1 --2- 172.21.15.133:0/1967600844 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff714066470 0x7ff714068930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff73406dac0 tx=0x7ff71c009040 comp rx=0 tx=0).stop 2023-12-19T18:59:41.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.067+0000 7ff739209640 1 -- 172.21.15.133:0/1967600844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7340c5260 msgr2=0x7ff7341549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:41.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.067+0000 7ff739209640 1 --2- 172.21.15.133:0/1967600844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7340c5260 0x7ff7341549e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff7240af040 tx=0x7ff724019670 comp rx=0 tx=0).stop 2023-12-19T18:59:41.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.067+0000 7ff739209640 1 -- 172.21.15.133:0/1967600844 shutdown_connections 2023-12-19T18:59:41.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.067+0000 7ff739209640 1 --2- 172.21.15.133:0/1967600844 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff714066470 0x7ff714068930 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.067+0000 7ff739209640 1 --2- 172.21.15.133:0/1967600844 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff734155de0 0x7ff7341ed750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.067+0000 7ff739209640 1 --2- 172.21.15.133:0/1967600844 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7340c5640 0x7ff73415c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.067+0000 7ff739209640 1 --2- 172.21.15.133:0/1967600844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7340c5260 0x7ff7341549e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.067+0000 7ff739209640 1 -- 172.21.15.133:0/1967600844 >> 172.21.15.133:0/1967600844 conn(0x7ff73406a5b0 msgr2=0x7ff734151ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:41.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.067+0000 7ff739209640 1 -- 172.21.15.133:0/1967600844 shutdown_connections 2023-12-19T18:59:41.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.067+0000 7ff739209640 1 -- 172.21.15.133:0/1967600844 wait complete. 2023-12-19T18:59:41.093 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:59:25.798150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:59:26.236078+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:59:41.094 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:59:41.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.227+0000 7f82efdc1640 1 Processor -- start 2023-12-19T18:59:41.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.227+0000 7f82efdc1640 1 -- start start 2023-12-19T18:59:41.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.231+0000 7f82efdc1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82e81560e0 0x7f82e815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.231+0000 7f82efdc1640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f82e806d520 0x7f82e8159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.231+0000 7f82efdc1640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e815c600 con 0x7f82e80bffc0 2023-12-19T18:59:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.231+0000 7f82efdc1640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e81594e0 con 0x7f82e806d520 2023-12-19T18:59:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.231+0000 7f82efdc1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e81597c0 con 0x7f82e81560e0 2023-12-19T18:59:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.231+0000 7f82ed35c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f82e806d520 0x7f82e8159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.231+0000 7f82edb5d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82e81560e0 0x7f82e815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.231+0000 7f82ed35c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f82e806d520 0x7f82e8159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:43634/0 (socket says 172.21.15.133:43634) 2023-12-19T18:59:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.231+0000 7f82ee35e640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f82e80bffc0 0x7f82e80c1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:49194/0 (socket says 172.21.15.133:49194) 2023-12-19T18:59:41.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.231+0000 7f82ed35c640 1 -- 172.21.15.133:0/1704945454 learned_addr learned my addr 172.21.15.133:0/1704945454 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:41.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.231+0000 7f82ed35c640 1 -- 172.21.15.133:0/1704945454 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82e81560e0 msgr2=0x7f82e815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:41.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.231+0000 7f82ed35c640 1 --2- 172.21.15.133:0/1704945454 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82e81560e0 0x7f82e815ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.231+0000 7f82ed35c640 1 -- 172.21.15.133:0/1704945454 >> v1:172.21.15.138:6789/0 conn(0x7f82e80bffc0 legacy=0x7f82e80c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:41.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.231+0000 7f82ed35c640 1 -- 172.21.15.133:0/1704945454 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e815bfb0 con 0x7f82e806d520 2023-12-19T18:59:41.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.235+0000 7f82ed35c640 1 --2- 172.21.15.133:0/1704945454 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82e806d520 0x7f82e8159eb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f82d8009870 tx=0x7f82d801c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22e67f2289b00e92 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:41.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.235+0000 7f82ecb5b640 1 -- 172.21.15.133:0/1704945454 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e81566d0 con 0x7f82e806d520 2023-12-19T18:59:41.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.235+0000 7f82ecb5b640 1 -- 172.21.15.133:0/1704945454 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d80a95f0 con 0x7f82e806d520 2023-12-19T18:59:41.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.235+0000 7f82ecb5b640 1 -- 172.21.15.133:0/1704945454 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d80a9980 con 0x7f82e806d520 2023-12-19T18:59:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.235+0000 7f82efdc1640 1 -- 172.21.15.133:0/1704945454 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82e806d520 msgr2=0x7f82e8159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.235+0000 7f82efdc1640 1 --2- 172.21.15.133:0/1704945454 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82e806d520 0x7f82e8159eb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f82d8009870 tx=0x7f82d801c510 comp rx=0 tx=0).stop 2023-12-19T18:59:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.235+0000 7f82efdc1640 1 -- 172.21.15.133:0/1704945454 shutdown_connections 2023-12-19T18:59:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.235+0000 7f82efdc1640 1 --2- 172.21.15.133:0/1704945454 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82e806d520 0x7f82e8159eb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.235+0000 7f82efdc1640 1 --2- 172.21.15.133:0/1704945454 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82e81560e0 0x7f82e815ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.235+0000 7f82efdc1640 1 -- 172.21.15.133:0/1704945454 >> 172.21.15.133:0/1704945454 conn(0x7f82e806a5b0 msgr2=0x7f82e806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.235+0000 7f82efdc1640 1 -- 172.21.15.133:0/1704945454 shutdown_connections 2023-12-19T18:59:41.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.235+0000 7f82efdc1640 1 -- 172.21.15.133:0/1704945454 wait complete. 2023-12-19T18:59:41.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.235+0000 7f82efdc1640 1 Processor -- start 2023-12-19T18:59:41.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.235+0000 7f82efdc1640 1 -- start start 2023-12-19T18:59:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.235+0000 7f82efdc1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82e806d520 0x7f82e81f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.235+0000 7f82efdc1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82e80bffc0 0x7f82e8152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.235+0000 7f82efdc1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82e81560e0 0x7f82e8152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.235+0000 7f82efdc1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80718e0 con 0x7f82e81560e0 2023-12-19T18:59:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.235+0000 7f82efdc1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80a7610 con 0x7f82e80bffc0 2023-12-19T18:59:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.235+0000 7f82efdc1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e8153260 con 0x7f82e806d520 2023-12-19T18:59:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.239+0000 7f82ee35e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82e81560e0 0x7f82e8152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.239+0000 7f82ee35e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82e81560e0 0x7f82e8152b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38564/0 (socket says 172.21.15.133:38564) 2023-12-19T18:59:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.239+0000 7f82ee35e640 1 -- 172.21.15.133:0/2875527597 learned_addr learned my addr 172.21.15.133:0/2875527597 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.239+0000 7f82edb5d640 1 --2- 172.21.15.133:0/2875527597 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82e806d520 0x7f82e81f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:41.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.239+0000 7f82ed35c640 1 --2- 172.21.15.133:0/2875527597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82e80bffc0 0x7f82e8152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:41.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.239+0000 7f82ee35e640 1 -- 172.21.15.133:0/2875527597 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82e806d520 msgr2=0x7f82e81f2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:41.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.239+0000 7f82ee35e640 1 --2- 172.21.15.133:0/2875527597 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82e806d520 0x7f82e81f2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.239+0000 7f82ee35e640 1 -- 172.21.15.133:0/2875527597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82e80bffc0 msgr2=0x7f82e8152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:41.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.239+0000 7f82ee35e640 1 --2- 172.21.15.133:0/2875527597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82e80bffc0 0x7f82e8152610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.239+0000 7f82ee35e640 1 -- 172.21.15.133:0/2875527597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d80094d0 con 0x7f82e81560e0 2023-12-19T18:59:41.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.239+0000 7f82edb5d640 1 --2- 172.21.15.133:0/2875527597 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82e806d520 0x7f82e81f2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:41.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.239+0000 7f82ee35e640 1 --2- 172.21.15.133:0/2875527597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82e81560e0 0x7f82e8152b50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f82e000c700 tx=0x7f82e000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:41.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.239+0000 7f82de7fc640 1 -- 172.21.15.133:0/2875527597 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e000ce10 con 0x7f82e81560e0 2023-12-19T18:59:41.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.239+0000 7f82de7fc640 1 -- 172.21.15.133:0/2875527597 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e000a640 con 0x7f82e81560e0 2023-12-19T18:59:41.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.239+0000 7f82efdc1640 1 -- 172.21.15.133:0/2875527597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e8158ad0 con 0x7f82e81560e0 2023-12-19T18:59:41.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.239+0000 7f82de7fc640 1 -- 172.21.15.133:0/2875527597 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e000a9b0 con 0x7f82e81560e0 2023-12-19T18:59:41.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.239+0000 7f82efdc1640 1 -- 172.21.15.133:0/2875527597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e80c6170 con 0x7f82e81560e0 2023-12-19T18:59:41.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.239+0000 7f82efdc1640 1 -- 172.21.15.133:0/2875527597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e8153090 con 0x7f82e81560e0 2023-12-19T18:59:41.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.239+0000 7f82de7fc640 1 -- 172.21.15.133:0/2875527597 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f82e000ab10 con 0x7f82e81560e0 2023-12-19T18:59:41.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.243+0000 7f82de7fc640 1 --2- 172.21.15.133:0/2875527597 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f82cc066470 0x7f82cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:41.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.243+0000 7f82de7fc640 1 -- 172.21.15.133:0/2875527597 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f82e0083520 con 0x7f82e81560e0 2023-12-19T18:59:41.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.243+0000 7f82edb5d640 1 --2- 172.21.15.133:0/2875527597 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f82cc066470 0x7f82cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:41.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.243+0000 7f82edb5d640 1 --2- 172.21.15.133:0/2875527597 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f82cc066470 0x7f82cc068930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f82e81590e0 tx=0x7f82e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:41.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.243+0000 7f82de7fc640 1 -- 172.21.15.133:0/2875527597 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f82e0050a40 con 0x7f82e81560e0 2023-12-19T18:59:41.298 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:59:41.302 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:59:41.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.395+0000 7f82efdc1640 1 -- 172.21.15.133:0/2875527597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82e8068400 con 0x7f82e81560e0 2023-12-19T18:59:41.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.399+0000 7f82de7fc640 1 -- 172.21.15.133:0/2875527597 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f82e0054060 con 0x7f82e81560e0 2023-12-19T18:59:41.403 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T18:59:41.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.399+0000 7f82efdc1640 1 -- 172.21.15.133:0/2875527597 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f82cc066470 msgr2=0x7f82cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:41.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.399+0000 7f82efdc1640 1 --2- 172.21.15.133:0/2875527597 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f82cc066470 0x7f82cc068930 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f82e81590e0 tx=0x7f82e4008040 comp rx=0 tx=0).stop 2023-12-19T18:59:41.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.399+0000 7f82efdc1640 1 -- 172.21.15.133:0/2875527597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82e81560e0 msgr2=0x7f82e8152b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:41.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.399+0000 7f82efdc1640 1 --2- 172.21.15.133:0/2875527597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82e81560e0 0x7f82e8152b50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f82e000c700 tx=0x7f82e000cbc0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.399+0000 7f82efdc1640 1 -- 172.21.15.133:0/2875527597 shutdown_connections 2023-12-19T18:59:41.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.399+0000 7f82efdc1640 1 --2- 172.21.15.133:0/2875527597 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f82cc066470 0x7f82cc068930 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.399+0000 7f82efdc1640 1 --2- 172.21.15.133:0/2875527597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82e81560e0 0x7f82e8152b50 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.399+0000 7f82efdc1640 1 --2- 172.21.15.133:0/2875527597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82e80bffc0 0x7f82e8152610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.399+0000 7f82efdc1640 1 --2- 172.21.15.133:0/2875527597 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82e806d520 0x7f82e81f2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.399+0000 7f82efdc1640 1 -- 172.21.15.133:0/2875527597 >> 172.21.15.133:0/2875527597 conn(0x7f82e806a5b0 msgr2=0x7f82e815a710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:41.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.399+0000 7f82efdc1640 1 -- 172.21.15.133:0/2875527597 shutdown_connections 2023-12-19T18:59:41.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.399+0000 7f82efdc1640 1 -- 172.21.15.133:0/2875527597 wait complete. 2023-12-19T18:59:41.423 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:59:41.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.559+0000 7ff176fd1640 1 Processor -- start 2023-12-19T18:59:41.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.559+0000 7ff176fd1640 1 -- start start 2023-12-19T18:59:41.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.559+0000 7ff176fd1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1700a5370 0x7ff1700c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:41.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.559+0000 7ff176fd1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff1700c4110 0x7ff170150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:41.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.559+0000 7ff176fd1640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff170072090 0x7ff1701514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:41.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.559+0000 7ff176fd1640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1700c3070 con 0x7ff1700c4110 2023-12-19T18:59:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.559+0000 7ff176fd1640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1700c2760 con 0x7ff170072090 2023-12-19T18:59:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.559+0000 7ff176fd1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1700a5750 con 0x7ff1700a5370 2023-12-19T18:59:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.559+0000 7ff16ffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff1700c4110 0x7ff170150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.559+0000 7ff16ffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff1700c4110 0x7ff170150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38578/0 (socket says 172.21.15.133:38578) 2023-12-19T18:59:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.559+0000 7ff16ffff640 1 -- 172.21.15.133:0/3088879652 learned_addr learned my addr 172.21.15.133:0/3088879652 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.559+0000 7ff17556e640 1 --2- 172.21.15.133:0/3088879652 >> v2:172.21.15.138:3300/0 conn(0x7ff170072090 0x7ff1701514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.559+0000 7ff174d6d640 1 --2- 172.21.15.133:0/3088879652 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1700a5370 0x7ff1700c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.559+0000 7ff16ffff640 1 -- 172.21.15.133:0/3088879652 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1700a5370 msgr2=0x7ff1700c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.559+0000 7ff16ffff640 1 --2- 172.21.15.133:0/3088879652 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1700a5370 0x7ff1700c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.559+0000 7ff16ffff640 1 -- 172.21.15.133:0/3088879652 >> v2:172.21.15.138:3300/0 conn(0x7ff170072090 msgr2=0x7ff1701514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.559+0000 7ff16ffff640 1 --2- 172.21.15.133:0/3088879652 >> v2:172.21.15.138:3300/0 conn(0x7ff170072090 0x7ff1701514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.559+0000 7ff16ffff640 1 -- 172.21.15.133:0/3088879652 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1700aad20 con 0x7ff1700c4110 2023-12-19T18:59:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.559+0000 7ff17556e640 1 --2- 172.21.15.133:0/3088879652 >> v2:172.21.15.138:3300/0 conn(0x7ff170072090 0x7ff1701514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:41.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.559+0000 7ff174d6d640 1 --2- 172.21.15.133:0/3088879652 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1700a5370 0x7ff1700c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:41.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.563+0000 7ff16ffff640 1 --2- 172.21.15.133:0/3088879652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1700c4110 0x7ff170150fa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff1700c4590 tx=0x7ff15c01ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a4a8836dd6b8a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:41.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.563+0000 7ff16f7fe640 1 -- 172.21.15.133:0/3088879652 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c0a7a90 con 0x7ff1700c4110 2023-12-19T18:59:41.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.563+0000 7ff16f7fe640 1 -- 172.21.15.133:0/3088879652 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15c0a7bf0 con 0x7ff1700c4110 2023-12-19T18:59:41.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.563+0000 7ff16f7fe640 1 -- 172.21.15.133:0/3088879652 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c0af440 con 0x7ff1700c4110 2023-12-19T18:59:41.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.563+0000 7ff176fd1640 1 -- 172.21.15.133:0/3088879652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1700c4110 msgr2=0x7ff170150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:41.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.563+0000 7ff176fd1640 1 --2- 172.21.15.133:0/3088879652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1700c4110 0x7ff170150fa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff1700c4590 tx=0x7ff15c01ea80 comp rx=0 tx=0).stop 2023-12-19T18:59:41.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.563+0000 7ff176fd1640 1 -- 172.21.15.133:0/3088879652 shutdown_connections 2023-12-19T18:59:41.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.563+0000 7ff176fd1640 1 --2- 172.21.15.133:0/3088879652 >> v2:172.21.15.138:3300/0 conn(0x7ff170072090 0x7ff1701514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.563+0000 7ff176fd1640 1 --2- 172.21.15.133:0/3088879652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1700c4110 0x7ff170150fa0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.563+0000 7ff176fd1640 1 --2- 172.21.15.133:0/3088879652 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1700a5370 0x7ff1700c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.563+0000 7ff176fd1640 1 -- 172.21.15.133:0/3088879652 >> 172.21.15.133:0/3088879652 conn(0x7ff17006a5b0 msgr2=0x7ff17006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:41.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.563+0000 7ff176fd1640 1 -- 172.21.15.133:0/3088879652 shutdown_connections 2023-12-19T18:59:41.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.563+0000 7ff176fd1640 1 -- 172.21.15.133:0/3088879652 wait complete. 2023-12-19T18:59:41.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff176fd1640 1 Processor -- start 2023-12-19T18:59:41.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff176fd1640 1 -- start start 2023-12-19T18:59:41.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff176fd1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff170072090 0x7ff17014bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:41.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff176fd1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1700a5370 0x7ff1700bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:41.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff176fd1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1700c4110 0x7ff1701f1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:41.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff176fd1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff170150ab0 con 0x7ff1700a5370 2023-12-19T18:59:41.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff176fd1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17014b100 con 0x7ff170072090 2023-12-19T18:59:41.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff176fd1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1701f09d0 con 0x7ff1700c4110 2023-12-19T18:59:41.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff16ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1700a5370 0x7ff1700bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:41.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff16ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1700a5370 0x7ff1700bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38588/0 (socket says 172.21.15.133:38588) 2023-12-19T18:59:41.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff16ffff640 1 -- 172.21.15.133:0/868283792 learned_addr learned my addr 172.21.15.133:0/868283792 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:41.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff17556e640 1 --2- 172.21.15.133:0/868283792 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1700c4110 0x7ff1701f1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:41.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff174d6d640 1 --2- 172.21.15.133:0/868283792 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff170072090 0x7ff17014bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:41.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff16ffff640 1 -- 172.21.15.133:0/868283792 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1700c4110 msgr2=0x7ff1701f1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:41.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff16ffff640 1 --2- 172.21.15.133:0/868283792 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1700c4110 0x7ff1701f1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff16ffff640 1 -- 172.21.15.133:0/868283792 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff170072090 msgr2=0x7ff17014bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:41.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff16ffff640 1 --2- 172.21.15.133:0/868283792 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff170072090 0x7ff17014bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff16ffff640 1 -- 172.21.15.133:0/868283792 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15c00b770 con 0x7ff1700a5370 2023-12-19T18:59:41.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff174d6d640 1 --2- 172.21.15.133:0/868283792 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff170072090 0x7ff17014bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:41.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff16ffff640 1 --2- 172.21.15.133:0/868283792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1700a5370 0x7ff1700bf360 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff15c00b2c0 tx=0x7ff15c01d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:41.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff16d7fa640 1 -- 172.21.15.133:0/868283792 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c0a7a90 con 0x7ff1700a5370 2023-12-19T18:59:41.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff16d7fa640 1 -- 172.21.15.133:0/868283792 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15c0ba480 con 0x7ff1700a5370 2023-12-19T18:59:41.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff176fd1640 1 -- 172.21.15.133:0/868283792 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1701f0cb0 con 0x7ff1700a5370 2023-12-19T18:59:41.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff16d7fa640 1 -- 172.21.15.133:0/868283792 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c0ba830 con 0x7ff1700a5370 2023-12-19T18:59:41.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff176fd1640 1 -- 172.21.15.133:0/868283792 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff17014f160 con 0x7ff1700a5370 2023-12-19T18:59:41.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.567+0000 7ff176fd1640 1 -- 172.21.15.133:0/868283792 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff170154180 con 0x7ff1700a5370 2023-12-19T18:59:41.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.571+0000 7ff16d7fa640 1 -- 172.21.15.133:0/868283792 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff15c0ba990 con 0x7ff1700a5370 2023-12-19T18:59:41.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.571+0000 7ff16d7fa640 1 --2- 172.21.15.133:0/868283792 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff1540664a0 0x7ff154068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:41.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.571+0000 7ff16d7fa640 1 -- 172.21.15.133:0/868283792 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff15c11f390 con 0x7ff1700a5370 2023-12-19T18:59:41.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.571+0000 7ff174d6d640 1 --2- 172.21.15.133:0/868283792 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff1540664a0 0x7ff154068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:41.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.571+0000 7ff174d6d640 1 --2- 172.21.15.133:0/868283792 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff1540664a0 0x7ff154068960 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff164009970 tx=0x7ff164008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:41.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.575+0000 7ff16d7fa640 1 -- 172.21.15.133:0/868283792 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff15c0ec800 con 0x7ff1700a5370 2023-12-19T18:59:41.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.723+0000 7ff176fd1640 1 -- 172.21.15.133:0/868283792 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff170068400 con 0x7ff1700a5370 2023-12-19T18:59:41.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.723+0000 7ff16d7fa640 1 -- 172.21.15.133:0/868283792 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v31) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff15c0efe20 con 0x7ff1700a5370 2023-12-19T18:59:41.729 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T18:59:41.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.723+0000 7ff176fd1640 1 -- 172.21.15.133:0/868283792 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff1540664a0 msgr2=0x7ff154068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:41.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.723+0000 7ff176fd1640 1 --2- 172.21.15.133:0/868283792 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff1540664a0 0x7ff154068960 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff164009970 tx=0x7ff164008040 comp rx=0 tx=0).stop 2023-12-19T18:59:41.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.723+0000 7ff176fd1640 1 -- 172.21.15.133:0/868283792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1700a5370 msgr2=0x7ff1700bf360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:41.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.723+0000 7ff176fd1640 1 --2- 172.21.15.133:0/868283792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1700a5370 0x7ff1700bf360 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff15c00b2c0 tx=0x7ff15c01d2c0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.723+0000 7ff176fd1640 1 -- 172.21.15.133:0/868283792 shutdown_connections 2023-12-19T18:59:41.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.723+0000 7ff176fd1640 1 --2- 172.21.15.133:0/868283792 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff1540664a0 0x7ff154068960 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.723+0000 7ff176fd1640 1 --2- 172.21.15.133:0/868283792 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1700c4110 0x7ff1701f1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.723+0000 7ff176fd1640 1 --2- 172.21.15.133:0/868283792 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1700a5370 0x7ff1700bf360 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.723+0000 7ff176fd1640 1 --2- 172.21.15.133:0/868283792 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff170072090 0x7ff17014bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.723+0000 7ff176fd1640 1 -- 172.21.15.133:0/868283792 >> 172.21.15.133:0/868283792 conn(0x7ff17006a5b0 msgr2=0x7ff17006dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:41.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.723+0000 7ff176fd1640 1 -- 172.21.15.133:0/868283792 shutdown_connections 2023-12-19T18:59:41.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.723+0000 7ff176fd1640 1 -- 172.21.15.133:0/868283792 wait complete. 2023-12-19T18:59:41.750 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:59:41.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.883+0000 7fcd2aead640 1 Processor -- start 2023-12-19T18:59:41.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.883+0000 7fcd2aead640 1 -- start start 2023-12-19T18:59:41.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.887+0000 7fcd2aead640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd2406e0b0 0x7fcd240c3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:41.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.887+0000 7fcd2aead640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd24158a90 con 0x7fcd2406c980 2023-12-19T18:59:41.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.887+0000 7fcd2aead640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd24158d70 con 0x7fcd24155dd0 2023-12-19T18:59:41.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.887+0000 7fcd2aead640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd241588a0 con 0x7fcd2406e0b0 2023-12-19T18:59:41.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.887+0000 7fcd2a6ac640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcd2406c980 0x7fcd240c3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43358/0 (socket says 172.21.15.133:43358) 2023-12-19T18:59:41.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.887+0000 7fcd2a6ac640 1 -- 172.21.15.133:0/2735160861 learned_addr learned my addr 172.21.15.133:0/2735160861 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:41.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.887+0000 7fcd296aa640 1 --2- 172.21.15.133:0/2735160861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd2406e0b0 0x7fcd240c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:41.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.887+0000 7fcd28ea9640 1 -- 172.21.15.133:0/2735160861 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915491762 0 0) 0x7fcd24158a90 con 0x7fcd2406c980 2023-12-19T18:59:41.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.887+0000 7fcd28ea9640 1 -- 172.21.15.133:0/2735160861 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd10003530 con 0x7fcd2406c980 2023-12-19T18:59:41.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.887+0000 7fcd28ea9640 1 -- 172.21.15.133:0/2735160861 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 430810465 0 0) 0x7fcd24158d70 con 0x7fcd24155dd0 2023-12-19T18:59:41.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.887+0000 7fcd28ea9640 1 -- 172.21.15.133:0/2735160861 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd24158a90 con 0x7fcd24155dd0 2023-12-19T18:59:41.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.887+0000 7fcd296aa640 1 -- 172.21.15.133:0/2735160861 >> v1:172.21.15.138:6789/0 conn(0x7fcd24155dd0 legacy=0x7fcd240c1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:41.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.887+0000 7fcd296aa640 1 -- 172.21.15.133:0/2735160861 >> v1:172.21.15.133:6789/0 conn(0x7fcd2406c980 legacy=0x7fcd240c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:41.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.887+0000 7fcd296aa640 1 -- 172.21.15.133:0/2735160861 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd24159050 con 0x7fcd2406e0b0 2023-12-19T18:59:41.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.891+0000 7fcd296aa640 1 --2- 172.21.15.133:0/2735160861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd2406e0b0 0x7fcd240c3950 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcd140097f0 tx=0x7fcd1401c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c451f602b097be16 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:41.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.891+0000 7fcd28ea9640 1 -- 172.21.15.133:0/2735160861 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd140ab600 con 0x7fcd2406e0b0 2023-12-19T18:59:41.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.891+0000 7fcd28ea9640 1 -- 172.21.15.133:0/2735160861 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd140a7050 con 0x7fcd2406e0b0 2023-12-19T18:59:41.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.891+0000 7fcd28ea9640 1 -- 172.21.15.133:0/2735160861 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd140ab960 con 0x7fcd2406e0b0 2023-12-19T18:59:41.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.891+0000 7fcd2aead640 1 -- 172.21.15.133:0/2735160861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd2406e0b0 msgr2=0x7fcd240c3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:41.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.891+0000 7fcd2aead640 1 --2- 172.21.15.133:0/2735160861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd2406e0b0 0x7fcd240c3950 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcd140097f0 tx=0x7fcd1401c3a0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.891+0000 7fcd2aead640 1 -- 172.21.15.133:0/2735160861 shutdown_connections 2023-12-19T18:59:41.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.891+0000 7fcd2aead640 1 --2- 172.21.15.133:0/2735160861 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd2406e0b0 0x7fcd240c3950 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.891+0000 7fcd2aead640 1 -- 172.21.15.133:0/2735160861 >> 172.21.15.133:0/2735160861 conn(0x7fcd240a7800 msgr2=0x7fcd240a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:41.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.891+0000 7fcd2aead640 1 -- 172.21.15.133:0/2735160861 shutdown_connections 2023-12-19T18:59:41.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.891+0000 7fcd2aead640 1 -- 172.21.15.133:0/2735160861 wait complete. 2023-12-19T18:59:41.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.891+0000 7fcd2aead640 1 Processor -- start 2023-12-19T18:59:41.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.891+0000 7fcd2aead640 1 -- start start 2023-12-19T18:59:41.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd2aead640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd2406c980 0x7fcd241522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:41.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd2aead640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd2406e0b0 0x7fcd24154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:41.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd2aead640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd24155dd0 0x7fcd241f1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:41.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd2aead640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2414ec00 con 0x7fcd24155dd0 2023-12-19T18:59:41.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd2aead640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd240a3430 con 0x7fcd2406e0b0 2023-12-19T18:59:41.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd2aead640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd241f4ed0 con 0x7fcd2406c980 2023-12-19T18:59:41.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd2a6ac640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd24155dd0 0x7fcd241f1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:41.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd2a6ac640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd24155dd0 0x7fcd241f1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38594/0 (socket says 172.21.15.133:38594) 2023-12-19T18:59:41.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd2a6ac640 1 -- 172.21.15.133:0/576780576 learned_addr learned my addr 172.21.15.133:0/576780576 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:41.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd29eab640 1 --2- 172.21.15.133:0/576780576 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd2406c980 0x7fcd241522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:41.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd296aa640 1 --2- 172.21.15.133:0/576780576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd2406e0b0 0x7fcd24154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:41.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd2a6ac640 1 -- 172.21.15.133:0/576780576 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd2406c980 msgr2=0x7fcd241522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:41.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd2a6ac640 1 --2- 172.21.15.133:0/576780576 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd2406c980 0x7fcd241522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd2a6ac640 1 -- 172.21.15.133:0/576780576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd2406e0b0 msgr2=0x7fcd24154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:41.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd2a6ac640 1 --2- 172.21.15.133:0/576780576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd2406e0b0 0x7fcd24154e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:41.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd2a6ac640 1 -- 172.21.15.133:0/576780576 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd14009420 con 0x7fcd24155dd0 2023-12-19T18:59:41.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd2a6ac640 1 --2- 172.21.15.133:0/576780576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd24155dd0 0x7fcd241f1010 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00caa0 tx=0x7fcd1c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:41.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd1a7fc640 1 -- 172.21.15.133:0/576780576 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c00ac00 con 0x7fcd24155dd0 2023-12-19T18:59:41.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd1a7fc640 1 -- 172.21.15.133:0/576780576 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c00ad80 con 0x7fcd24155dd0 2023-12-19T18:59:41.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd1a7fc640 1 -- 172.21.15.133:0/576780576 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c012640 con 0x7fcd24155dd0 2023-12-19T18:59:41.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd2aead640 1 -- 172.21.15.133:0/576780576 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd24159ff0 con 0x7fcd24155dd0 2023-12-19T18:59:41.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd2aead640 1 -- 172.21.15.133:0/576780576 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2415a5b0 con 0x7fcd24155dd0 2023-12-19T18:59:41.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd2aead640 1 -- 172.21.15.133:0/576780576 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2404e850 con 0x7fcd24155dd0 2023-12-19T18:59:41.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.895+0000 7fcd1a7fc640 1 -- 172.21.15.133:0/576780576 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fcd1c007070 con 0x7fcd24155dd0 2023-12-19T18:59:41.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.899+0000 7fcd1a7fc640 1 --2- 172.21.15.133:0/576780576 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd08066470 0x7fcd08068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:41.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.899+0000 7fcd1a7fc640 1 -- 172.21.15.133:0/576780576 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd1c083d50 con 0x7fcd24155dd0 2023-12-19T18:59:41.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.899+0000 7fcd29eab640 1 --2- 172.21.15.133:0/576780576 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd08066470 0x7fcd08068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:41.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.899+0000 7fcd29eab640 1 --2- 172.21.15.133:0/576780576 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd08066470 0x7fcd08068930 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcd240abc40 tx=0x7fcd20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:41.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:41.903+0000 7fcd1a7fc640 1 -- 172.21.15.133:0/576780576 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fcd1c051270 con 0x7fcd24155dd0 2023-12-19T18:59:42.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.051+0000 7fcd2aead640 1 -- 172.21.15.133:0/576780576 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcd2406c150 con 0x7fcd24155dd0 2023-12-19T18:59:42.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.051+0000 7fcd1a7fc640 1 -- 172.21.15.133:0/576780576 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v31) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcd1c0170a0 con 0x7fcd24155dd0 2023-12-19T18:59:42.058 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T18:59:42.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.055+0000 7fcd2aead640 1 -- 172.21.15.133:0/576780576 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd08066470 msgr2=0x7fcd08068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:42.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.055+0000 7fcd2aead640 1 --2- 172.21.15.133:0/576780576 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd08066470 0x7fcd08068930 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fcd240abc40 tx=0x7fcd20009040 comp rx=0 tx=0).stop 2023-12-19T18:59:42.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.055+0000 7fcd2aead640 1 -- 172.21.15.133:0/576780576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd24155dd0 msgr2=0x7fcd241f1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:42.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.055+0000 7fcd2aead640 1 --2- 172.21.15.133:0/576780576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd24155dd0 0x7fcd241f1010 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00caa0 tx=0x7fcd1c00cf60 comp rx=0 tx=0).stop 2023-12-19T18:59:42.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.055+0000 7fcd2aead640 1 -- 172.21.15.133:0/576780576 shutdown_connections 2023-12-19T18:59:42.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.055+0000 7fcd2aead640 1 --2- 172.21.15.133:0/576780576 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd08066470 0x7fcd08068930 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:42.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.055+0000 7fcd2aead640 1 --2- 172.21.15.133:0/576780576 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd24155dd0 0x7fcd241f1010 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:42.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.055+0000 7fcd2aead640 1 --2- 172.21.15.133:0/576780576 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd2406e0b0 0x7fcd24154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:42.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.055+0000 7fcd2aead640 1 --2- 172.21.15.133:0/576780576 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd2406c980 0x7fcd241522d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:42.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.055+0000 7fcd2aead640 1 -- 172.21.15.133:0/576780576 >> 172.21.15.133:0/576780576 conn(0x7fcd240a7800 msgr2=0x7fcd240c15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:42.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.055+0000 7fcd2aead640 1 -- 172.21.15.133:0/576780576 shutdown_connections 2023-12-19T18:59:42.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.055+0000 7fcd2aead640 1 -- 172.21.15.133:0/576780576 wait complete. 2023-12-19T18:59:42.079 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T18:59:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.211+0000 7f1c70879640 1 Processor -- start 2023-12-19T18:59:42.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.211+0000 7f1c70879640 1 -- start start 2023-12-19T18:59:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.211+0000 7f1c70879640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c6c0a5370 0x7f1c6c0c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:42.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.211+0000 7f1c70879640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1c6c0c4110 0x7f1c6c150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.211+0000 7f1c70879640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1c6c072090 0x7f1c6c1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.211+0000 7f1c70879640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6c0c3070 con 0x7f1c6c0a5370 2023-12-19T18:59:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.211+0000 7f1c70879640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6c0c2760 con 0x7f1c6c072090 2023-12-19T18:59:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.211+0000 7f1c70879640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0a5750 con 0x7f1c6c0c4110 2023-12-19T18:59:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.211+0000 7f1c6a59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c6c0a5370 0x7f1c6c0c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.211+0000 7f1c6a59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c6c0a5370 0x7f1c6c0c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38596/0 (socket says 172.21.15.133:38596) 2023-12-19T18:59:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.211+0000 7f1c6a59c640 1 -- 172.21.15.133:0/1047232359 learned_addr learned my addr 172.21.15.133:0/1047232359 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.211+0000 7f1c61d9b640 1 --2- 172.21.15.133:0/1047232359 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1c6c0c4110 0x7f1c6c150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.211+0000 7f1c6ad9d640 1 --2- 172.21.15.133:0/1047232359 >> v2:172.21.15.138:3300/0 conn(0x7f1c6c072090 0x7f1c6c1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.211+0000 7f1c6a59c640 1 -- 172.21.15.133:0/1047232359 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1c6c0c4110 msgr2=0x7f1c6c150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.211+0000 7f1c6a59c640 1 --2- 172.21.15.133:0/1047232359 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1c6c0c4110 0x7f1c6c150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.211+0000 7f1c6a59c640 1 -- 172.21.15.133:0/1047232359 >> v2:172.21.15.138:3300/0 conn(0x7f1c6c072090 msgr2=0x7f1c6c1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.211+0000 7f1c6a59c640 1 --2- 172.21.15.133:0/1047232359 >> v2:172.21.15.138:3300/0 conn(0x7f1c6c072090 0x7f1c6c1514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:42.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.211+0000 7f1c6a59c640 1 -- 172.21.15.133:0/1047232359 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c0aad20 con 0x7f1c6c0a5370 2023-12-19T18:59:42.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.215+0000 7f1c6a59c640 1 --2- 172.21.15.133:0/1047232359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c0a5370 0x7f1c6c0c3bd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c0c4590 tx=0x7f1c5c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eba23baa2186cd2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:42.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.215+0000 7f1c69d9b640 1 -- 172.21.15.133:0/1047232359 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c0ab600 con 0x7f1c6c0a5370 2023-12-19T18:59:42.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.215+0000 7f1c69d9b640 1 -- 172.21.15.133:0/1047232359 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c0a7050 con 0x7f1c6c0a5370 2023-12-19T18:59:42.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.215+0000 7f1c69d9b640 1 -- 172.21.15.133:0/1047232359 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c0ab980 con 0x7f1c6c0a5370 2023-12-19T18:59:42.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.215+0000 7f1c70879640 1 -- 172.21.15.133:0/1047232359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c0a5370 msgr2=0x7f1c6c0c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.215+0000 7f1c70879640 1 --2- 172.21.15.133:0/1047232359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c0a5370 0x7f1c6c0c3bd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c0c4590 tx=0x7f1c5c01c3b0 comp rx=0 tx=0).stop 2023-12-19T18:59:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.215+0000 7f1c70879640 1 -- 172.21.15.133:0/1047232359 shutdown_connections 2023-12-19T18:59:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.215+0000 7f1c70879640 1 --2- 172.21.15.133:0/1047232359 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1c6c0c4110 0x7f1c6c150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.215+0000 7f1c70879640 1 --2- 172.21.15.133:0/1047232359 >> v2:172.21.15.138:3300/0 conn(0x7f1c6c072090 0x7f1c6c1514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.215+0000 7f1c70879640 1 --2- 172.21.15.133:0/1047232359 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c0a5370 0x7f1c6c0c3bd0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.215+0000 7f1c70879640 1 -- 172.21.15.133:0/1047232359 >> 172.21.15.133:0/1047232359 conn(0x7f1c6c06a5b0 msgr2=0x7f1c6c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.215+0000 7f1c70879640 1 -- 172.21.15.133:0/1047232359 shutdown_connections 2023-12-19T18:59:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.215+0000 7f1c70879640 1 -- 172.21.15.133:0/1047232359 wait complete. 2023-12-19T18:59:42.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c70879640 1 Processor -- start 2023-12-19T18:59:42.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c70879640 1 -- start start 2023-12-19T18:59:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c70879640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1c6c072090 0x7f1c6c1503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:42.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c70879640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c0a5370 0x7f1c6c14f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:42.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c70879640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c6c0c4110 0x7f1c6c1f0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:42.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c70879640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c152cf0 con 0x7f1c6c0a5370 2023-12-19T18:59:42.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c70879640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c152510 con 0x7f1c6c0c4110 2023-12-19T18:59:42.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c70879640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0c1200 con 0x7f1c6c072090 2023-12-19T18:59:42.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c61d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c0a5370 0x7f1c6c14f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:42.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c61d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c0a5370 0x7f1c6c14f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38604/0 (socket says 172.21.15.133:38604) 2023-12-19T18:59:42.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c61d9b640 1 -- 172.21.15.133:0/1077237451 learned_addr learned my addr 172.21.15.133:0/1077237451 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:42.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c6a59c640 1 --2- 172.21.15.133:0/1077237451 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1c6c072090 0x7f1c6c1503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:42.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c6ad9d640 1 --2- 172.21.15.133:0/1077237451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c6c0c4110 0x7f1c6c1f0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:42.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c61d9b640 1 -- 172.21.15.133:0/1077237451 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1c6c072090 msgr2=0x7f1c6c1503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:42.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c61d9b640 1 --2- 172.21.15.133:0/1077237451 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1c6c072090 0x7f1c6c1503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:42.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c61d9b640 1 -- 172.21.15.133:0/1077237451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c6c0c4110 msgr2=0x7f1c6c1f0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:42.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c61d9b640 1 --2- 172.21.15.133:0/1077237451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c6c0c4110 0x7f1c6c1f0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:42.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c61d9b640 1 -- 172.21.15.133:0/1077237451 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c0094d0 con 0x7f1c6c0a5370 2023-12-19T18:59:42.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c6ad9d640 1 --2- 172.21.15.133:0/1077237451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c6c0c4110 0x7f1c6c1f0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:42.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c61d9b640 1 --2- 172.21.15.133:0/1077237451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c0a5370 0x7f1c6c14f3d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400d5f0 tx=0x7f1c5400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:42.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c637fe640 1 -- 172.21.15.133:0/1077237451 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c540125f0 con 0x7f1c6c0a5370 2023-12-19T18:59:42.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c637fe640 1 -- 172.21.15.133:0/1077237451 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c54012750 con 0x7f1c6c0a5370 2023-12-19T18:59:42.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c70879640 1 -- 172.21.15.133:0/1077237451 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6c1f0e00 con 0x7f1c6c0a5370 2023-12-19T18:59:42.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c637fe640 1 -- 172.21.15.133:0/1077237451 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54012ae0 con 0x7f1c6c0a5370 2023-12-19T18:59:42.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c70879640 1 -- 172.21.15.133:0/1077237451 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6c0c0f20 con 0x7f1c6c0a5370 2023-12-19T18:59:42.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.219+0000 7f1c70879640 1 -- 172.21.15.133:0/1077237451 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6c068400 con 0x7f1c6c0a5370 2023-12-19T18:59:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.223+0000 7f1c637fe640 1 -- 172.21.15.133:0/1077237451 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1c54012c40 con 0x7f1c6c0a5370 2023-12-19T18:59:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.223+0000 7f1c637fe640 1 --2- 172.21.15.133:0/1077237451 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1c4c0664a0 0x7f1c4c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.223+0000 7f1c637fe640 1 -- 172.21.15.133:0/1077237451 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c54084210 con 0x7f1c6c0a5370 2023-12-19T18:59:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.223+0000 7f1c6a59c640 1 --2- 172.21.15.133:0/1077237451 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1c4c0664a0 0x7f1c4c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:42.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.223+0000 7f1c6a59c640 1 --2- 172.21.15.133:0/1077237451 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1c4c0664a0 0x7f1c4c068960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0ad000 tx=0x7f1c5c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:42.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.227+0000 7f1c637fe640 1 -- 172.21.15.133:0/1077237451 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1c54051690 con 0x7f1c6c0a5370 2023-12-19T18:59:42.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.379+0000 7f1c70879640 1 -- 172.21.15.133:0/1077237451 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1c6c0c6780 con 0x7f1c6c0a5370 2023-12-19T18:59:42.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.379+0000 7f1c637fe640 1 -- 172.21.15.133:0/1077237451 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+207 (secure 0 0 0) 0x7f1c54007380 con 0x7f1c6c0a5370 2023-12-19T18:59:42.385 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:42.385 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2023-12-19T18:59:42.386 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:42.386 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2023-12-19T18:59:42.386 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": ".mgr" 2023-12-19T18:59:42.386 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:42.386 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:42.386 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 4, 2023-12-19T18:59:42.386 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "cephfs_metadata" 2023-12-19T18:59:42.387 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T18:59:42.387 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T18:59:42.387 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 5, 2023-12-19T18:59:42.387 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "cephfs_data" 2023-12-19T18:59:42.387 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T18:59:42.387 INFO:teuthology.orchestra.run.smithi133.stdout:] 2023-12-19T18:59:42.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.379+0000 7f1c70879640 1 -- 172.21.15.133:0/1077237451 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1c4c0664a0 msgr2=0x7f1c4c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:42.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.379+0000 7f1c70879640 1 --2- 172.21.15.133:0/1077237451 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1c4c0664a0 0x7f1c4c068960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0ad000 tx=0x7f1c5c0a6000 comp rx=0 tx=0).stop 2023-12-19T18:59:42.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.379+0000 7f1c70879640 1 -- 172.21.15.133:0/1077237451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c0a5370 msgr2=0x7f1c6c14f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:42.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.379+0000 7f1c70879640 1 --2- 172.21.15.133:0/1077237451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c0a5370 0x7f1c6c14f3d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400d5f0 tx=0x7f1c5400dab0 comp rx=0 tx=0).stop 2023-12-19T18:59:42.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.379+0000 7f1c70879640 1 -- 172.21.15.133:0/1077237451 shutdown_connections 2023-12-19T18:59:42.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.379+0000 7f1c70879640 1 --2- 172.21.15.133:0/1077237451 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1c4c0664a0 0x7f1c4c068960 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:42.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.379+0000 7f1c70879640 1 --2- 172.21.15.133:0/1077237451 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c6c0c4110 0x7f1c6c1f0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:42.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.379+0000 7f1c70879640 1 --2- 172.21.15.133:0/1077237451 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c0a5370 0x7f1c6c14f3d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:42.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.379+0000 7f1c70879640 1 --2- 172.21.15.133:0/1077237451 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1c6c072090 0x7f1c6c1503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:42.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.379+0000 7f1c70879640 1 -- 172.21.15.133:0/1077237451 >> 172.21.15.133:0/1077237451 conn(0x7f1c6c06a5b0 msgr2=0x7f1c6c0c5500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:42.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.379+0000 7f1c70879640 1 -- 172.21.15.133:0/1077237451 shutdown_connections 2023-12-19T18:59:42.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.379+0000 7f1c70879640 1 -- 172.21.15.133:0/1077237451 wait complete. 2023-12-19T18:59:42.405 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-12-19T18:59:42.406 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-12-19T18:59:42.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.543+0000 7f0ed4b2a640 1 Processor -- start 2023-12-19T18:59:42.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.543+0000 7f0ed4b2a640 1 -- start start 2023-12-19T18:59:42.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.543+0000 7f0ed4b2a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0ed00c1250 0x7f0ed00c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:42.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.543+0000 7f0ed4b2a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ed006fec0 0x7f0ed00c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:42.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.543+0000 7f0ed4b2a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed0072800 con 0x7f0ed00c0aa0 2023-12-19T18:59:42.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.543+0000 7f0ed4b2a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed00a9fc0 con 0x7f0ed00c1250 2023-12-19T18:59:42.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.543+0000 7f0ed4b2a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed0072ae0 con 0x7f0ed006fec0 2023-12-19T18:59:42.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.543+0000 7f0eced9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0ed00c0aa0 0x7f0ed00c4180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43372/0 (socket says 172.21.15.133:43372) 2023-12-19T18:59:42.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.543+0000 7f0eced9d640 1 -- 172.21.15.133:0/2157871340 learned_addr learned my addr 172.21.15.133:0/2157871340 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:42.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.543+0000 7f0ecdd9b640 1 --2- 172.21.15.133:0/2157871340 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ed006fec0 0x7f0ed00c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:42.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.543+0000 7f0ece59c640 1 --2- 172.21.15.133:0/2157871340 >> v2:172.21.15.138:3300/0 conn(0x7f0ed00c1250 0x7f0ed00c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:42.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.543+0000 7f0ecd59a640 1 -- 172.21.15.133:0/2157871340 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996012507 0 0) 0x7f0ed0072800 con 0x7f0ed00c0aa0 2023-12-19T18:59:42.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.543+0000 7f0ecd59a640 1 -- 172.21.15.133:0/2157871340 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0eb8003530 con 0x7f0ed00c0aa0 2023-12-19T18:59:42.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.543+0000 7f0ecdd9b640 1 -- 172.21.15.133:0/2157871340 >> v2:172.21.15.138:3300/0 conn(0x7f0ed00c1250 msgr2=0x7f0ed00c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:42.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.543+0000 7f0ecdd9b640 1 --2- 172.21.15.133:0/2157871340 >> v2:172.21.15.138:3300/0 conn(0x7f0ed00c1250 0x7f0ed00c1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:42.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.543+0000 7f0ecd59a640 1 -- 172.21.15.133:0/2157871340 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1316699271 0 0) 0x7f0eb8003530 con 0x7f0ed00c0aa0 2023-12-19T18:59:42.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.543+0000 7f0ecdd9b640 1 -- 172.21.15.133:0/2157871340 >> v1:172.21.15.133:6789/0 conn(0x7f0ed00c0aa0 legacy=0x7f0ed00c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:42.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.543+0000 7f0ecdd9b640 1 -- 172.21.15.133:0/2157871340 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed00a9900 con 0x7f0ed006fec0 2023-12-19T18:59:42.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.547+0000 7f0ecdd9b640 1 --2- 172.21.15.133:0/2157871340 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ed006fec0 0x7f0ed00c3c40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400ba60 tx=0x7f0ec401e920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8a6838455724085 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:42.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.547+0000 7f0ecd59a640 1 -- 172.21.15.133:0/2157871340 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec8001a00 con 0x7f0ed006fec0 2023-12-19T18:59:42.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.547+0000 7f0ecd59a640 1 -- 172.21.15.133:0/2157871340 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec40a7750 con 0x7f0ed006fec0 2023-12-19T18:59:42.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.547+0000 7f0ecd59a640 1 -- 172.21.15.133:0/2157871340 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec40a7ae0 con 0x7f0ed006fec0 2023-12-19T18:59:42.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.547+0000 7f0ed4b2a640 1 -- 172.21.15.133:0/2157871340 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ed006fec0 msgr2=0x7f0ed00c3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:42.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.547+0000 7f0ed4b2a640 1 --2- 172.21.15.133:0/2157871340 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ed006fec0 0x7f0ed00c3c40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400ba60 tx=0x7f0ec401e920 comp rx=0 tx=0).stop 2023-12-19T18:59:42.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.547+0000 7f0ed4b2a640 1 -- 172.21.15.133:0/2157871340 shutdown_connections 2023-12-19T18:59:42.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.547+0000 7f0ed4b2a640 1 --2- 172.21.15.133:0/2157871340 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ed006fec0 0x7f0ed00c3c40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:42.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.547+0000 7f0ed4b2a640 1 --2- 172.21.15.133:0/2157871340 >> v2:172.21.15.138:3300/0 conn(0x7f0ed00c1250 0x7f0ed00c1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:42.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.547+0000 7f0ed4b2a640 1 -- 172.21.15.133:0/2157871340 >> 172.21.15.133:0/2157871340 conn(0x7f0ed00c5d40 msgr2=0x7f0ed00c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:42.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.547+0000 7f0ed4b2a640 1 -- 172.21.15.133:0/2157871340 shutdown_connections 2023-12-19T18:59:42.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.547+0000 7f0ed4b2a640 1 -- 172.21.15.133:0/2157871340 wait complete. 2023-12-19T18:59:42.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ed4b2a640 1 Processor -- start 2023-12-19T18:59:42.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ed4b2a640 1 -- start start 2023-12-19T18:59:42.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ed4b2a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ed006fec0 0x7f0ed0152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:42.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ed4b2a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ed00c0aa0 0x7f0ed01ecea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:42.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ed4b2a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ed00c1250 0x7f0ed006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:42.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ed4b2a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed0153180 con 0x7f0ed00c0aa0 2023-12-19T18:59:42.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ed4b2a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed015af00 con 0x7f0ed00c1250 2023-12-19T18:59:42.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ed4b2a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed01ed3e0 con 0x7f0ed006fec0 2023-12-19T18:59:42.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ecdd9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ed00c0aa0 0x7f0ed01ecea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:42.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ecdd9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ed00c0aa0 0x7f0ed01ecea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38608/0 (socket says 172.21.15.133:38608) 2023-12-19T18:59:42.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ecdd9b640 1 -- 172.21.15.133:0/1250900976 learned_addr learned my addr 172.21.15.133:0/1250900976 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:42.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ece59c640 1 --2- 172.21.15.133:0/1250900976 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ed006fec0 0x7f0ed0152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:42.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0eced9d640 1 --2- 172.21.15.133:0/1250900976 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ed00c1250 0x7f0ed006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:42.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ecdd9b640 1 -- 172.21.15.133:0/1250900976 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ed006fec0 msgr2=0x7f0ed0152c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:42.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ecdd9b640 1 --2- 172.21.15.133:0/1250900976 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ed006fec0 0x7f0ed0152c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:42.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ecdd9b640 1 -- 172.21.15.133:0/1250900976 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ed00c1250 msgr2=0x7f0ed006d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:42.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ecdd9b640 1 --2- 172.21.15.133:0/1250900976 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ed00c1250 0x7f0ed006d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:42.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ecdd9b640 1 -- 172.21.15.133:0/1250900976 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec400b6c0 con 0x7f0ed00c0aa0 2023-12-19T18:59:42.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ecdd9b640 1 --2- 172.21.15.133:0/1250900976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ed00c0aa0 0x7f0ed01ecea0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0ec40b2040 tx=0x7f0ec401b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:42.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ebeffd640 1 -- 172.21.15.133:0/1250900976 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec40b9850 con 0x7f0ed00c0aa0 2023-12-19T18:59:42.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ebeffd640 1 -- 172.21.15.133:0/1250900976 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec40b99d0 con 0x7f0ed00c0aa0 2023-12-19T18:59:42.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ed4b2a640 1 -- 172.21.15.133:0/1250900976 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed0158f40 con 0x7f0ed00c0aa0 2023-12-19T18:59:42.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ebeffd640 1 -- 172.21.15.133:0/1250900976 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec40b9d80 con 0x7f0ed00c0aa0 2023-12-19T18:59:42.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ed4b2a640 1 -- 172.21.15.133:0/1250900976 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed006cb60 con 0x7f0ed00c0aa0 2023-12-19T18:59:42.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.551+0000 7f0ed4b2a640 1 -- 172.21.15.133:0/1250900976 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed0159440 con 0x7f0ed00c0aa0 2023-12-19T18:59:42.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.555+0000 7f0ebeffd640 1 -- 172.21.15.133:0/1250900976 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0ec40af440 con 0x7f0ed00c0aa0 2023-12-19T18:59:42.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.555+0000 7f0ebeffd640 1 --2- 172.21.15.133:0/1250900976 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0eb0066470 0x7f0eb0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:42.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.555+0000 7f0ebeffd640 1 -- 172.21.15.133:0/1250900976 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ec4120c20 con 0x7f0ed00c0aa0 2023-12-19T18:59:42.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.555+0000 7f0ece59c640 1 --2- 172.21.15.133:0/1250900976 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0eb0066470 0x7f0eb0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:42.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.555+0000 7f0ece59c640 1 --2- 172.21.15.133:0/1250900976 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0eb0066470 0x7f0eb0068930 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0ed00c0440 tx=0x7f0ec0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:42.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.559+0000 7f0ebeffd640 1 -- 172.21.15.133:0/1250900976 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0ed0159440 con 0x7f0ed00c0aa0 2023-12-19T18:59:42.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:42.707+0000 7f0ed4b2a640 1 -- 172.21.15.133:0/1250900976 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0ed0159440 con 0x7f0ed00c0aa0 2023-12-19T18:59:43.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.623+0000 7f0ebeffd640 1 -- 172.21.15.133:0/1250900976 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v32) v1 ==== 140+0+0 (secure 0 0 0) 0x7f0ed0159440 con 0x7f0ed00c0aa0 2023-12-19T18:59:43.630 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs2_metadata' created 2023-12-19T18:59:43.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.627+0000 7f0ed4b2a640 1 -- 172.21.15.133:0/1250900976 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0eb0066470 msgr2=0x7f0eb0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:43.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.627+0000 7f0ed4b2a640 1 --2- 172.21.15.133:0/1250900976 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0eb0066470 0x7f0eb0068930 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0ed00c0440 tx=0x7f0ec0009190 comp rx=0 tx=0).stop 2023-12-19T18:59:43.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.627+0000 7f0ed4b2a640 1 -- 172.21.15.133:0/1250900976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ed00c0aa0 msgr2=0x7f0ed01ecea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:43.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.627+0000 7f0ed4b2a640 1 --2- 172.21.15.133:0/1250900976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ed00c0aa0 0x7f0ed01ecea0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0ec40b2040 tx=0x7f0ec401b6c0 comp rx=0 tx=0).stop 2023-12-19T18:59:43.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.627+0000 7f0ed4b2a640 1 -- 172.21.15.133:0/1250900976 shutdown_connections 2023-12-19T18:59:43.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.627+0000 7f0ed4b2a640 1 --2- 172.21.15.133:0/1250900976 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0eb0066470 0x7f0eb0068930 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:43.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.627+0000 7f0ed4b2a640 1 --2- 172.21.15.133:0/1250900976 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0ed00c1250 0x7f0ed006d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:43.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.627+0000 7f0ed4b2a640 1 --2- 172.21.15.133:0/1250900976 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0ed00c0aa0 0x7f0ed01ecea0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:43.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.627+0000 7f0ed4b2a640 1 --2- 172.21.15.133:0/1250900976 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0ed006fec0 0x7f0ed0152c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:43.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.627+0000 7f0ed4b2a640 1 -- 172.21.15.133:0/1250900976 >> 172.21.15.133:0/1250900976 conn(0x7f0ed00c5d40 msgr2=0x7f0ed00c6120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:43.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.627+0000 7f0ed4b2a640 1 -- 172.21.15.133:0/1250900976 shutdown_connections 2023-12-19T18:59:43.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.627+0000 7f0ed4b2a640 1 -- 172.21.15.133:0/1250900976 wait complete. 2023-12-19T18:59:43.661 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T18:59:43.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.799+0000 7ff5d63c1640 1 Processor -- start 2023-12-19T18:59:43.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.799+0000 7ff5d63c1640 1 -- start start 2023-12-19T18:59:43.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.799+0000 7ff5d63c1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5d00c4100 0x7ff5d00c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:43.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.799+0000 7ff5d63c1640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff5d00c06d0 0x7ff5d00a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:43.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.799+0000 7ff5d63c1640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d00c31c0 con 0x7ff5d00c63c0 2023-12-19T18:59:43.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.799+0000 7ff5d63c1640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d00c34a0 con 0x7ff5d00c4100 2023-12-19T18:59:43.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.799+0000 7ff5d63c1640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d00c1030 con 0x7ff5d00c06d0 2023-12-19T18:59:43.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.799+0000 7ff5cf7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5d00c4100 0x7ff5d00c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:43.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.803+0000 7ff5cf7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5d00c4100 0x7ff5d00c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38614/0 (socket says 172.21.15.133:38614) 2023-12-19T18:59:43.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.803+0000 7ff5cf7fe640 1 -- 172.21.15.133:0/2409876283 learned_addr learned my addr 172.21.15.133:0/2409876283 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:43.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.803+0000 7ff5d495e640 1 --2- 172.21.15.133:0/2409876283 >> v2:172.21.15.138:3300/0 conn(0x7ff5d00c06d0 0x7ff5d00a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:43.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.803+0000 7ff5cf7fe640 1 -- 172.21.15.133:0/2409876283 >> v2:172.21.15.138:3300/0 conn(0x7ff5d00c06d0 msgr2=0x7ff5d00a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:43.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.803+0000 7ff5cf7fe640 1 --2- 172.21.15.133:0/2409876283 >> v2:172.21.15.138:3300/0 conn(0x7ff5d00c06d0 0x7ff5d00a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:43.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.803+0000 7ff5cf7fe640 1 -- 172.21.15.133:0/2409876283 >> v1:172.21.15.138:6789/0 conn(0x7ff5d00c63c0 legacy=0x7ff5d00c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:43.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.803+0000 7ff5cf7fe640 1 -- 172.21.15.133:0/2409876283 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d00c1310 con 0x7ff5d00c4100 2023-12-19T18:59:43.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.803+0000 7ff5d495e640 1 --2- 172.21.15.133:0/2409876283 >> v2:172.21.15.138:3300/0 conn(0x7ff5d00c06d0 0x7ff5d00a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:43.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.803+0000 7ff5cf7fe640 1 --2- 172.21.15.133:0/2409876283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d00c4100 0x7ff5d00c2bb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00c0ee0 tx=0x7ff5c401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2fb556c79608f5b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:43.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.803+0000 7ff5ceffd640 1 -- 172.21.15.133:0/2409876283 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d00aa3d0 con 0x7ff5d00c4100 2023-12-19T18:59:43.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.803+0000 7ff5ceffd640 1 -- 172.21.15.133:0/2409876283 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c40a7050 con 0x7ff5d00c4100 2023-12-19T18:59:43.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.803+0000 7ff5ceffd640 1 -- 172.21.15.133:0/2409876283 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c40ab820 con 0x7ff5d00c4100 2023-12-19T18:59:43.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d63c1640 1 -- 172.21.15.133:0/2409876283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d00c4100 msgr2=0x7ff5d00c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:43.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d63c1640 1 --2- 172.21.15.133:0/2409876283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d00c4100 0x7ff5d00c2bb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff5d00c0ee0 tx=0x7ff5c401c3e0 comp rx=0 tx=0).stop 2023-12-19T18:59:43.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d63c1640 1 -- 172.21.15.133:0/2409876283 shutdown_connections 2023-12-19T18:59:43.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d63c1640 1 --2- 172.21.15.133:0/2409876283 >> v2:172.21.15.138:3300/0 conn(0x7ff5d00c06d0 0x7ff5d00a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:43.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d63c1640 1 --2- 172.21.15.133:0/2409876283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d00c4100 0x7ff5d00c2bb0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:43.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d63c1640 1 -- 172.21.15.133:0/2409876283 >> 172.21.15.133:0/2409876283 conn(0x7ff5d006a5b0 msgr2=0x7ff5d006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:43.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d63c1640 1 -- 172.21.15.133:0/2409876283 shutdown_connections 2023-12-19T18:59:43.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d63c1640 1 -- 172.21.15.133:0/2409876283 wait complete. 2023-12-19T18:59:43.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d63c1640 1 Processor -- start 2023-12-19T18:59:43.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d63c1640 1 -- start start 2023-12-19T18:59:43.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d63c1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5d00c06d0 0x7ff5d0071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:43.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d63c1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5d00c4100 0x7ff5d01f0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:43.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d63c1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d00c63c0 0x7ff5d015d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:43.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d63c1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d015cdf0 con 0x7ff5d00c63c0 2023-12-19T18:59:43.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d63c1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d01f1930 con 0x7ff5d00c06d0 2023-12-19T18:59:43.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d63c1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d01f1c10 con 0x7ff5d00c4100 2023-12-19T18:59:43.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d495e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d00c63c0 0x7ff5d015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:43.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d495e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d00c63c0 0x7ff5d015d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38628/0 (socket says 172.21.15.133:38628) 2023-12-19T18:59:43.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d495e640 1 -- 172.21.15.133:0/4149591771 learned_addr learned my addr 172.21.15.133:0/4149591771 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:43.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5cffff640 1 --2- 172.21.15.133:0/4149591771 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5d00c06d0 0x7ff5d0071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:43.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5cf7fe640 1 --2- 172.21.15.133:0/4149591771 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5d00c4100 0x7ff5d01f0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:43.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d495e640 1 -- 172.21.15.133:0/4149591771 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5d00c4100 msgr2=0x7ff5d01f0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:43.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d495e640 1 --2- 172.21.15.133:0/4149591771 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5d00c4100 0x7ff5d01f0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:43.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d495e640 1 -- 172.21.15.133:0/4149591771 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5d00c06d0 msgr2=0x7ff5d0071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:43.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d495e640 1 --2- 172.21.15.133:0/4149591771 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5d00c06d0 0x7ff5d0071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:43.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d495e640 1 -- 172.21.15.133:0/4149591771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c40094d0 con 0x7ff5d00c63c0 2023-12-19T18:59:43.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.807+0000 7ff5d495e640 1 --2- 172.21.15.133:0/4149591771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d00c63c0 0x7ff5d015d560 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8007ef0 tx=0x7ff5c800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:43.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.811+0000 7ff5ccff9640 1 -- 172.21.15.133:0/4149591771 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8003ba0 con 0x7ff5d00c63c0 2023-12-19T18:59:43.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.811+0000 7ff5ccff9640 1 -- 172.21.15.133:0/4149591771 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5c800f040 con 0x7ff5d00c63c0 2023-12-19T18:59:43.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.811+0000 7ff5d63c1640 1 -- 172.21.15.133:0/4149591771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d01f1ef0 con 0x7ff5d00c63c0 2023-12-19T18:59:43.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.811+0000 7ff5ccff9640 1 -- 172.21.15.133:0/4149591771 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c800de80 con 0x7ff5d00c63c0 2023-12-19T18:59:43.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.811+0000 7ff5d63c1640 1 -- 172.21.15.133:0/4149591771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d0071640 con 0x7ff5d00c63c0 2023-12-19T18:59:43.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.811+0000 7ff5d63c1640 1 -- 172.21.15.133:0/4149591771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d015d280 con 0x7ff5d00c63c0 2023-12-19T18:59:43.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.811+0000 7ff5ccff9640 1 -- 172.21.15.133:0/4149591771 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff5c8004030 con 0x7ff5d00c63c0 2023-12-19T18:59:43.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.811+0000 7ff5ccff9640 1 --2- 172.21.15.133:0/4149591771 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5bc066470 0x7ff5bc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:43.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.811+0000 7ff5ccff9640 1 -- 172.21.15.133:0/4149591771 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6080+0+0 (secure 0 0 0) 0x7ff5c8084250 con 0x7ff5d00c63c0 2023-12-19T18:59:43.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.811+0000 7ff5cffff640 1 --2- 172.21.15.133:0/4149591771 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5bc066470 0x7ff5bc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:43.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.815+0000 7ff5cffff640 1 --2- 172.21.15.133:0/4149591771 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5bc066470 0x7ff5bc068930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0000f70 tx=0x7ff5c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:43.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.815+0000 7ff5ccff9640 1 -- 172.21.15.133:0/4149591771 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff5d015d280 con 0x7ff5d00c63c0 2023-12-19T18:59:43.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:43.967+0000 7ff5d63c1640 1 -- 172.21.15.133:0/4149591771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff5d015d280 con 0x7ff5d00c63c0 2023-12-19T18:59:44.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.627+0000 7ff5ccff9640 1 -- 172.21.15.133:0/4149591771 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v33) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff5d015d280 con 0x7ff5d00c63c0 2023-12-19T18:59:44.633 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs2_data' created 2023-12-19T18:59:44.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.631+0000 7ff5d63c1640 1 -- 172.21.15.133:0/4149591771 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5bc066470 msgr2=0x7ff5bc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:44.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.631+0000 7ff5d63c1640 1 --2- 172.21.15.133:0/4149591771 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5bc066470 0x7ff5bc068930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0000f70 tx=0x7ff5c0009040 comp rx=0 tx=0).stop 2023-12-19T18:59:44.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.631+0000 7ff5d63c1640 1 -- 172.21.15.133:0/4149591771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d00c63c0 msgr2=0x7ff5d015d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:44.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.631+0000 7ff5d63c1640 1 --2- 172.21.15.133:0/4149591771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d00c63c0 0x7ff5d015d560 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8007ef0 tx=0x7ff5c800d4a0 comp rx=0 tx=0).stop 2023-12-19T18:59:44.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.631+0000 7ff5d63c1640 1 -- 172.21.15.133:0/4149591771 shutdown_connections 2023-12-19T18:59:44.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.631+0000 7ff5d63c1640 1 --2- 172.21.15.133:0/4149591771 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5bc066470 0x7ff5bc068930 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:44.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.631+0000 7ff5d63c1640 1 --2- 172.21.15.133:0/4149591771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d00c63c0 0x7ff5d015d560 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:44.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.631+0000 7ff5d63c1640 1 --2- 172.21.15.133:0/4149591771 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5d00c4100 0x7ff5d01f0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:44.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.631+0000 7ff5d63c1640 1 --2- 172.21.15.133:0/4149591771 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5d00c06d0 0x7ff5d0071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:44.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.631+0000 7ff5d63c1640 1 -- 172.21.15.133:0/4149591771 >> 172.21.15.133:0/4149591771 conn(0x7ff5d006a5b0 msgr2=0x7ff5d015c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:44.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.631+0000 7ff5d63c1640 1 -- 172.21.15.133:0/4149591771 shutdown_connections 2023-12-19T18:59:44.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.631+0000 7ff5d63c1640 1 -- 172.21.15.133:0/4149591771 wait complete. 2023-12-19T18:59:44.677 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-12-19T18:59:44.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.811+0000 7f4d75009640 1 Processor -- start 2023-12-19T18:59:44.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.811+0000 7f4d75009640 1 -- start start 2023-12-19T18:59:44.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.811+0000 7f4d75009640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d700c63c0 0x7f4d700c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:44.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.811+0000 7f4d75009640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4d700c2bb0 0x7f4d700a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:44.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.811+0000 7f4d75009640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d700c31c0 con 0x7f4d700c4100 2023-12-19T18:59:44.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.811+0000 7f4d75009640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d700c34a0 con 0x7f4d700c2bb0 2023-12-19T18:59:44.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.811+0000 7f4d75009640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d700c1030 con 0x7f4d700c63c0 2023-12-19T18:59:44.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.815+0000 7f4d6ed9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d700c63c0 0x7f4d700c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:44.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.815+0000 7f4d6f59e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4d700c2bb0 0x7f4d700a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:44.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.815+0000 7f4d6ed9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d700c63c0 0x7f4d700c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:59000/0 (socket says 172.21.15.133:59000) 2023-12-19T18:59:44.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.815+0000 7f4d6659c640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f4d700c4100 0x7f4d700c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:43866/0 (socket says 172.21.15.133:43866) 2023-12-19T18:59:44.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.815+0000 7f4d6ed9d640 1 -- 172.21.15.133:0/4184684351 learned_addr learned my addr 172.21.15.133:0/4184684351 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:44.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.815+0000 7f4d6ed9d640 1 -- 172.21.15.133:0/4184684351 >> v2:172.21.15.138:3300/0 conn(0x7f4d700c2bb0 msgr2=0x7f4d700a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:44.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.815+0000 7f4d6ed9d640 1 --2- 172.21.15.133:0/4184684351 >> v2:172.21.15.138:3300/0 conn(0x7f4d700c2bb0 0x7f4d700a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:44.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.815+0000 7f4d6ed9d640 1 -- 172.21.15.133:0/4184684351 >> v1:172.21.15.138:6789/0 conn(0x7f4d700c4100 legacy=0x7f4d700c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:44.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.815+0000 7f4d6ed9d640 1 -- 172.21.15.133:0/4184684351 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d700c1310 con 0x7f4d700c63c0 2023-12-19T18:59:44.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.815+0000 7f4d6ed9d640 1 --2- 172.21.15.133:0/4184684351 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d700c63c0 0x7f4d700c06d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009870 tx=0x7f4d6001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60ee0d28d58d32e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:44.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.815+0000 7f4d6e59c640 1 -- 172.21.15.133:0/4184684351 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d700aa3d0 con 0x7f4d700c63c0 2023-12-19T18:59:44.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.819+0000 7f4d6e59c640 1 -- 172.21.15.133:0/4184684351 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d600a7050 con 0x7f4d700c63c0 2023-12-19T18:59:44.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.819+0000 7f4d6e59c640 1 -- 172.21.15.133:0/4184684351 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d600ab820 con 0x7f4d700c63c0 2023-12-19T18:59:44.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.819+0000 7f4d75009640 1 -- 172.21.15.133:0/4184684351 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d700c63c0 msgr2=0x7f4d700c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:44.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.819+0000 7f4d75009640 1 --2- 172.21.15.133:0/4184684351 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d700c63c0 0x7f4d700c06d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4d60009870 tx=0x7f4d6001c3f0 comp rx=0 tx=0).stop 2023-12-19T18:59:44.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.819+0000 7f4d75009640 1 -- 172.21.15.133:0/4184684351 shutdown_connections 2023-12-19T18:59:44.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.819+0000 7f4d75009640 1 --2- 172.21.15.133:0/4184684351 >> v2:172.21.15.138:3300/0 conn(0x7f4d700c2bb0 0x7f4d700a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:44.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.819+0000 7f4d75009640 1 --2- 172.21.15.133:0/4184684351 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d700c63c0 0x7f4d700c06d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:44.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.819+0000 7f4d75009640 1 -- 172.21.15.133:0/4184684351 >> 172.21.15.133:0/4184684351 conn(0x7f4d7006a5b0 msgr2=0x7f4d7006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:44.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.819+0000 7f4d75009640 1 -- 172.21.15.133:0/4184684351 shutdown_connections 2023-12-19T18:59:44.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.819+0000 7f4d75009640 1 -- 172.21.15.133:0/4184684351 wait complete. 2023-12-19T18:59:44.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.819+0000 7f4d75009640 1 Processor -- start 2023-12-19T18:59:44.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.819+0000 7f4d75009640 1 -- start start 2023-12-19T18:59:44.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.819+0000 7f4d75009640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d700c2bb0 0x7f4d701ee280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:44.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.819+0000 7f4d75009640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d700c4100 0x7f4d701ec2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:44.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.819+0000 7f4d75009640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d700c63c0 0x7f4d701ec800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:44.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.819+0000 7f4d75009640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d701eefb0 con 0x7f4d700c63c0 2023-12-19T18:59:44.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.819+0000 7f4d75009640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7014df90 con 0x7f4d700c4100 2023-12-19T18:59:44.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.819+0000 7f4d75009640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d701568c0 con 0x7f4d700c2bb0 2023-12-19T18:59:44.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.819+0000 7f4d6f59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d700c63c0 0x7f4d701ec800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:44.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.819+0000 7f4d6f59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d700c63c0 0x7f4d701ec800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59804/0 (socket says 172.21.15.133:59804) 2023-12-19T18:59:44.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.819+0000 7f4d6f59e640 1 -- 172.21.15.133:0/546759322 learned_addr learned my addr 172.21.15.133:0/546759322 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:44.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.823+0000 7f4d6659c640 1 --2- 172.21.15.133:0/546759322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d700c4100 0x7f4d701ec2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:44.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.823+0000 7f4d6ed9d640 1 --2- 172.21.15.133:0/546759322 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d700c2bb0 0x7f4d701ee280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:44.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.823+0000 7f4d6f59e640 1 -- 172.21.15.133:0/546759322 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d700c2bb0 msgr2=0x7f4d701ee280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:44.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.823+0000 7f4d6f59e640 1 --2- 172.21.15.133:0/546759322 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d700c2bb0 0x7f4d701ee280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:44.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.823+0000 7f4d6f59e640 1 -- 172.21.15.133:0/546759322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d700c4100 msgr2=0x7f4d701ec2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:44.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.823+0000 7f4d6f59e640 1 --2- 172.21.15.133:0/546759322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d700c4100 0x7f4d701ec2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:44.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.823+0000 7f4d6f59e640 1 -- 172.21.15.133:0/546759322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d600094d0 con 0x7f4d700c63c0 2023-12-19T18:59:44.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.823+0000 7f4d6f59e640 1 --2- 172.21.15.133:0/546759322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d700c63c0 0x7f4d701ec800 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800efc0 tx=0x7f4d6800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:44.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.823+0000 7f4d67fff640 1 -- 172.21.15.133:0/546759322 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d68014480 con 0x7f4d700c63c0 2023-12-19T18:59:44.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.823+0000 7f4d67fff640 1 -- 172.21.15.133:0/546759322 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6800f040 con 0x7f4d700c63c0 2023-12-19T18:59:44.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.823+0000 7f4d75009640 1 -- 172.21.15.133:0/546759322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7014b400 con 0x7f4d700c63c0 2023-12-19T18:59:44.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.823+0000 7f4d67fff640 1 -- 172.21.15.133:0/546759322 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d68014820 con 0x7f4d700c63c0 2023-12-19T18:59:44.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.823+0000 7f4d75009640 1 -- 172.21.15.133:0/546759322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7006aa20 con 0x7f4d700c63c0 2023-12-19T18:59:44.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.823+0000 7f4d75009640 1 -- 172.21.15.133:0/546759322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d70068400 con 0x7f4d700c63c0 2023-12-19T18:59:44.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.823+0000 7f4d67fff640 1 -- 172.21.15.133:0/546759322 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4d68014980 con 0x7f4d700c63c0 2023-12-19T18:59:44.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.827+0000 7f4d67fff640 1 --2- 172.21.15.133:0/546759322 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4d50066470 0x7f4d50068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:44.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.827+0000 7f4d67fff640 1 -- 172.21.15.133:0/546759322 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f4d680853b0 con 0x7f4d700c63c0 2023-12-19T18:59:44.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.827+0000 7f4d6ed9d640 1 --2- 172.21.15.133:0/546759322 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4d50066470 0x7f4d50068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:44.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.827+0000 7f4d6ed9d640 1 --2- 172.21.15.133:0/546759322 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4d50066470 0x7f4d50068930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4d600ad000 tx=0x7f4d600a4f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:44.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:44.827+0000 7f4d67fff640 1 -- 172.21.15.133:0/546759322 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4d68052660 con 0x7f4d700c63c0 2023-12-19T18:59:45.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.011+0000 7f4d75009640 1 -- 172.21.15.133:0/546759322 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f4d701ec020 con 0x7f4d700c63c0 2023-12-19T18:59:45.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.663+0000 7f4d67fff640 1 -- 172.21.15.133:0/546759322 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 6 and data pool 7 v18) v1 ==== 175+0+0 (secure 0 0 0) 0x7f4d68055c80 con 0x7f4d700c63c0 2023-12-19T18:59:45.675 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 6 and data pool 7 2023-12-19T18:59:45.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.679+0000 7f4d75009640 1 -- 172.21.15.133:0/546759322 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4d50066470 msgr2=0x7f4d50068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:45.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.679+0000 7f4d75009640 1 --2- 172.21.15.133:0/546759322 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4d50066470 0x7f4d50068930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4d600ad000 tx=0x7f4d600a4f90 comp rx=0 tx=0).stop 2023-12-19T18:59:45.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.679+0000 7f4d75009640 1 -- 172.21.15.133:0/546759322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d700c63c0 msgr2=0x7f4d701ec800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:45.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.679+0000 7f4d75009640 1 --2- 172.21.15.133:0/546759322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d700c63c0 0x7f4d701ec800 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4d6800efc0 tx=0x7f4d6800c490 comp rx=0 tx=0).stop 2023-12-19T18:59:45.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.683+0000 7f4d75009640 1 -- 172.21.15.133:0/546759322 shutdown_connections 2023-12-19T18:59:45.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.683+0000 7f4d75009640 1 --2- 172.21.15.133:0/546759322 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4d50066470 0x7f4d50068930 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:45.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.683+0000 7f4d75009640 1 --2- 172.21.15.133:0/546759322 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4d700c63c0 0x7f4d701ec800 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:45.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.683+0000 7f4d75009640 1 --2- 172.21.15.133:0/546759322 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4d700c4100 0x7f4d701ec2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:45.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.683+0000 7f4d75009640 1 --2- 172.21.15.133:0/546759322 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4d700c2bb0 0x7f4d701ee280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:45.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.683+0000 7f4d75009640 1 -- 172.21.15.133:0/546759322 >> 172.21.15.133:0/546759322 conn(0x7f4d7006a5b0 msgr2=0x7f4d700706c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:45.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.683+0000 7f4d75009640 1 -- 172.21.15.133:0/546759322 shutdown_connections 2023-12-19T18:59:45.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.683+0000 7f4d75009640 1 -- 172.21.15.133:0/546759322 wait complete. 2023-12-19T18:59:45.716 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:59:45.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.847+0000 7f5691f80640 1 Processor -- start 2023-12-19T18:59:45.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.847+0000 7f5691f80640 1 -- start start 2023-12-19T18:59:45.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.851+0000 7f5691f80640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f568c14b010 0x7f568c0bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:45.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.851+0000 7f5691f80640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f568c157c20 0x7f568c1580b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:45.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.851+0000 7f5691f80640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f568c06a5b0 con 0x7f568c073a70 2023-12-19T18:59:45.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.851+0000 7f5691f80640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f568c06b710 con 0x7f568c14b010 2023-12-19T18:59:45.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.851+0000 7f5691f80640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568c0c1d60 con 0x7f568c157c20 2023-12-19T18:59:45.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.851+0000 7f568b7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f568c14b010 0x7f568c0bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:45.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.851+0000 7f568b7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f568c14b010 0x7f568c0bf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59810/0 (socket says 172.21.15.133:59810) 2023-12-19T18:59:45.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.851+0000 7f568b7fe640 1 -- 172.21.15.133:0/530603499 learned_addr learned my addr 172.21.15.133:0/530603499 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:45.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.851+0000 7f568bfff640 1 --2- 172.21.15.133:0/530603499 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f568c157c20 0x7f568c1580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:45.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.851+0000 7f568b7fe640 1 -- 172.21.15.133:0/530603499 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f568c157c20 msgr2=0x7f568c1580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:45.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.851+0000 7f568b7fe640 1 --2- 172.21.15.133:0/530603499 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f568c157c20 0x7f568c1580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:45.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.851+0000 7f568b7fe640 1 -- 172.21.15.133:0/530603499 >> v1:172.21.15.138:6789/0 conn(0x7f568c073a70 legacy=0x7f568c06b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:45.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.851+0000 7f568b7fe640 1 -- 172.21.15.133:0/530603499 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c0c2040 con 0x7f568c14b010 2023-12-19T18:59:45.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.855+0000 7f568b7fe640 1 --2- 172.21.15.133:0/530603499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f568c14b010 0x7f568c0bf9f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f567c009870 tx=0x7f567c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1121bca5374949eb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:45.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.855+0000 7f568a7fc640 1 -- 172.21.15.133:0/530603499 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567c0a8a30 con 0x7f568c14b010 2023-12-19T18:59:45.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.855+0000 7f568a7fc640 1 -- 172.21.15.133:0/530603499 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567c0a8b90 con 0x7f568c14b010 2023-12-19T18:59:45.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.855+0000 7f568a7fc640 1 -- 172.21.15.133:0/530603499 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567c0b0440 con 0x7f568c14b010 2023-12-19T18:59:45.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.855+0000 7f5691f80640 1 -- 172.21.15.133:0/530603499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f568c14b010 msgr2=0x7f568c0bf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:45.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.855+0000 7f5691f80640 1 --2- 172.21.15.133:0/530603499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f568c14b010 0x7f568c0bf9f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f567c009870 tx=0x7f567c01ed30 comp rx=0 tx=0).stop 2023-12-19T18:59:45.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.855+0000 7f5691f80640 1 -- 172.21.15.133:0/530603499 shutdown_connections 2023-12-19T18:59:45.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.855+0000 7f5691f80640 1 --2- 172.21.15.133:0/530603499 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f568c157c20 0x7f568c1580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:45.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.855+0000 7f5691f80640 1 --2- 172.21.15.133:0/530603499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f568c14b010 0x7f568c0bf9f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:45.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.855+0000 7f5691f80640 1 -- 172.21.15.133:0/530603499 >> 172.21.15.133:0/530603499 conn(0x7f568c0c30c0 msgr2=0x7f568c0c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:45.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.855+0000 7f5691f80640 1 -- 172.21.15.133:0/530603499 shutdown_connections 2023-12-19T18:59:45.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.855+0000 7f5691f80640 1 -- 172.21.15.133:0/530603499 wait complete. 2023-12-19T18:59:45.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.855+0000 7f5691f80640 1 Processor -- start 2023-12-19T18:59:45.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.855+0000 7f5691f80640 1 -- start start 2023-12-19T18:59:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f5691f80640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f568c073a70 0x7f568c156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f5691f80640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f568c14b010 0x7f568c1e6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f5691f80640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f568c157c20 0x7f568c1e7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f5691f80640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c0c5dd0 con 0x7f568c14b010 2023-12-19T18:59:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f5691f80640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c0c5af0 con 0x7f568c157c20 2023-12-19T18:59:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f5691f80640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568c1ede30 con 0x7f568c073a70 2023-12-19T18:59:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f568affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f568c14b010 0x7f568c1e6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f568affd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f568c14b010 0x7f568c1e6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59822/0 (socket says 172.21.15.133:59822) 2023-12-19T18:59:45.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f568affd640 1 -- 172.21.15.133:0/2665526455 learned_addr learned my addr 172.21.15.133:0/2665526455 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:45.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f568bfff640 1 --2- 172.21.15.133:0/2665526455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f568c157c20 0x7f568c1e7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:45.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f568b7fe640 1 --2- 172.21.15.133:0/2665526455 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f568c073a70 0x7f568c156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:45.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f568affd640 1 -- 172.21.15.133:0/2665526455 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f568c073a70 msgr2=0x7f568c156b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:45.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f568affd640 1 --2- 172.21.15.133:0/2665526455 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f568c073a70 0x7f568c156b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:45.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f568affd640 1 -- 172.21.15.133:0/2665526455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f568c157c20 msgr2=0x7f568c1e7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:45.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f568affd640 1 --2- 172.21.15.133:0/2665526455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f568c157c20 0x7f568c1e7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:45.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f568affd640 1 -- 172.21.15.133:0/2665526455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f567c0094d0 con 0x7f568c14b010 2023-12-19T18:59:45.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f568affd640 1 --2- 172.21.15.133:0/2665526455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f568c14b010 0x7f568c1e6d50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f568000c500 tx=0x7f568000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:45.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f5673fff640 1 -- 172.21.15.133:0/2665526455 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5680005220 con 0x7f568c14b010 2023-12-19T18:59:45.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f5673fff640 1 -- 172.21.15.133:0/2665526455 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5680005380 con 0x7f568c14b010 2023-12-19T18:59:45.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f5673fff640 1 -- 172.21.15.133:0/2665526455 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5680007270 con 0x7f568c14b010 2023-12-19T18:59:45.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f5691f80640 1 -- 172.21.15.133:0/2665526455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f568c1ee110 con 0x7f568c14b010 2023-12-19T18:59:45.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f5691f80640 1 -- 172.21.15.133:0/2665526455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568c1570c0 con 0x7f568c14b010 2023-12-19T18:59:45.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f5691f80640 1 -- 172.21.15.133:0/2665526455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f568c1edc90 con 0x7f568c14b010 2023-12-19T18:59:45.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.859+0000 7f5673fff640 1 -- 172.21.15.133:0/2665526455 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f56800073d0 con 0x7f568c14b010 2023-12-19T18:59:45.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.863+0000 7f5673fff640 1 --2- 172.21.15.133:0/2665526455 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5678066470 0x7f5678068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:45.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.863+0000 7f5673fff640 1 -- 172.21.15.133:0/2665526455 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f56800839f0 con 0x7f568c14b010 2023-12-19T18:59:45.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.863+0000 7f568b7fe640 1 --2- 172.21.15.133:0/2665526455 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5678066470 0x7f5678068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:45.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.863+0000 7f568b7fe640 1 --2- 172.21.15.133:0/2665526455 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5678066470 0x7f5678068930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f567c0b2000 tx=0x7f567c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:45.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:45.867+0000 7f5673fff640 1 -- 172.21.15.133:0/2665526455 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f568c1edc90 con 0x7f568c14b010 2023-12-19T18:59:46.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.015+0000 7f5691f80640 1 -- 172.21.15.133:0/2665526455 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f568c1edc90 con 0x7f568c14b010 2023-12-19T18:59:46.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.019+0000 7f5673fff640 1 -- 172.21.15.133:0/2665526455 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+20278 (secure 0 0 0) 0x7f568c1edc90 con 0x7f568c14b010 2023-12-19T18:59:46.024 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:46.024 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":34,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:59:45.017466+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:59:25.798150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T18:59:26.236078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T18:59:42.757628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-19T18:59:44.017454+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:59:46.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.019+0000 7f5691f80640 1 -- 172.21.15.133:0/2665526455 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5678066470 msgr2=0x7f5678068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:46.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.019+0000 7f5691f80640 1 --2- 172.21.15.133:0/2665526455 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5678066470 0x7f5678068930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f567c0b2000 tx=0x7f567c009040 comp rx=0 tx=0).stop 2023-12-19T18:59:46.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.019+0000 7f5691f80640 1 -- 172.21.15.133:0/2665526455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f568c14b010 msgr2=0x7f568c1e6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:46.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.019+0000 7f5691f80640 1 --2- 172.21.15.133:0/2665526455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f568c14b010 0x7f568c1e6d50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f568000c500 tx=0x7f568000c9c0 comp rx=0 tx=0).stop 2023-12-19T18:59:46.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.019+0000 7f5691f80640 1 -- 172.21.15.133:0/2665526455 shutdown_connections 2023-12-19T18:59:46.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.019+0000 7f5691f80640 1 --2- 172.21.15.133:0/2665526455 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5678066470 0x7f5678068930 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:46.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.019+0000 7f5691f80640 1 --2- 172.21.15.133:0/2665526455 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f568c157c20 0x7f568c1e7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:46.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.019+0000 7f5691f80640 1 --2- 172.21.15.133:0/2665526455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f568c14b010 0x7f568c1e6d50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:46.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.019+0000 7f5691f80640 1 --2- 172.21.15.133:0/2665526455 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f568c073a70 0x7f568c156b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:46.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.019+0000 7f5691f80640 1 -- 172.21.15.133:0/2665526455 >> 172.21.15.133:0/2665526455 conn(0x7f568c0c30c0 msgr2=0x7f568c0bf9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:46.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.019+0000 7f5691f80640 1 -- 172.21.15.133:0/2665526455 shutdown_connections 2023-12-19T18:59:46.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.019+0000 7f5691f80640 1 -- 172.21.15.133:0/2665526455 wait complete. 2023-12-19T18:59:46.046 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:59:46.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.179+0000 7f54e3b01640 1 Processor -- start 2023-12-19T18:59:46.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.179+0000 7f54e3b01640 1 -- start start 2023-12-19T18:59:46.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.179+0000 7f54e3b01640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54dc151e90 0x7f54dc0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:46.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.179+0000 7f54e3b01640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f54dc0c7ea0 0x7f54dc06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:46.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.179+0000 7f54e3b01640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54dc06c860 con 0x7f54dc0c4e60 2023-12-19T18:59:46.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.179+0000 7f54e3b01640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54dc0c8750 con 0x7f54dc0c7ea0 2023-12-19T18:59:46.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.179+0000 7f54e3b01640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc1552d0 con 0x7f54dc151e90 2023-12-19T18:59:46.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.179+0000 7f54e109c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f54dc0c7ea0 0x7f54dc06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:46.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.179+0000 7f54e109c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f54dc0c7ea0 0x7f54dc06b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:39368/0 (socket says 172.21.15.133:39368) 2023-12-19T18:59:46.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.179+0000 7f54e109c640 1 -- 172.21.15.133:0/3274727254 learned_addr learned my addr 172.21.15.133:0/3274727254 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:46.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.179+0000 7f54e189d640 1 --2- 172.21.15.133:0/3274727254 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54dc151e90 0x7f54dc0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:46.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.179+0000 7f54e209e640 1 --1- 172.21.15.133:0/3274727254 >> v1:172.21.15.138:6789/0 conn(0x7f54dc0c4e60 0x7f54dc06b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:43886/0 (socket says 172.21.15.133:43886) 2023-12-19T18:59:46.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.179+0000 7f54e189d640 1 -- 172.21.15.133:0/3274727254 >> v2:172.21.15.138:3300/0 conn(0x7f54dc0c7ea0 msgr2=0x7f54dc06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:46.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.179+0000 7f54e189d640 1 --2- 172.21.15.133:0/3274727254 >> v2:172.21.15.138:3300/0 conn(0x7f54dc0c7ea0 0x7f54dc06b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:46.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.179+0000 7f54e189d640 1 -- 172.21.15.133:0/3274727254 >> v1:172.21.15.138:6789/0 conn(0x7f54dc0c4e60 legacy=0x7f54dc06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:46.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.179+0000 7f54e189d640 1 -- 172.21.15.133:0/3274727254 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54dc154930 con 0x7f54dc151e90 2023-12-19T18:59:46.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.179+0000 7f54e089b640 1 -- 172.21.15.133:0/3274727254 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095369223 0 0) 0x7f54dc06c860 con 0x7f54dc0c4e60 2023-12-19T18:59:46.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.179+0000 7f54e109c640 1 --2- 172.21.15.133:0/3274727254 >> v2:172.21.15.138:3300/0 conn(0x7f54dc0c7ea0 0x7f54dc06b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:59:46.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.183+0000 7f54e189d640 1 --2- 172.21.15.133:0/3274727254 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54dc151e90 0x7f54dc0c4920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f54d80097c0 tx=0x7f54d801c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66b843ad7be70a43 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:46.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.183+0000 7f54e089b640 1 -- 172.21.15.133:0/3274727254 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d80ab600 con 0x7f54dc151e90 2023-12-19T18:59:46.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.183+0000 7f54e089b640 1 -- 172.21.15.133:0/3274727254 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d80a7050 con 0x7f54dc151e90 2023-12-19T18:59:46.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.183+0000 7f54e089b640 1 -- 172.21.15.133:0/3274727254 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d80ab980 con 0x7f54dc151e90 2023-12-19T18:59:46.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.183+0000 7f54e3b01640 1 -- 172.21.15.133:0/3274727254 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54dc151e90 msgr2=0x7f54dc0c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:46.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.183+0000 7f54e3b01640 1 --2- 172.21.15.133:0/3274727254 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54dc151e90 0x7f54dc0c4920 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f54d80097c0 tx=0x7f54d801c360 comp rx=0 tx=0).stop 2023-12-19T18:59:46.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.183+0000 7f54e3b01640 1 -- 172.21.15.133:0/3274727254 shutdown_connections 2023-12-19T18:59:46.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.183+0000 7f54e3b01640 1 --2- 172.21.15.133:0/3274727254 >> v2:172.21.15.138:3300/0 conn(0x7f54dc0c7ea0 0x7f54dc06b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:46.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.183+0000 7f54e3b01640 1 --2- 172.21.15.133:0/3274727254 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54dc151e90 0x7f54dc0c4920 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:46.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.183+0000 7f54e3b01640 1 -- 172.21.15.133:0/3274727254 >> 172.21.15.133:0/3274727254 conn(0x7f54dc0ca170 msgr2=0x7f54dc0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:46.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.183+0000 7f54e3b01640 1 -- 172.21.15.133:0/3274727254 shutdown_connections 2023-12-19T18:59:46.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.183+0000 7f54e3b01640 1 -- 172.21.15.133:0/3274727254 wait complete. 2023-12-19T18:59:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.187+0000 7f54e3b01640 1 Processor -- start 2023-12-19T18:59:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.187+0000 7f54e3b01640 1 -- start start 2023-12-19T18:59:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.187+0000 7f54e3b01640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54dc0c4e60 0x7f54dc14b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.187+0000 7f54e3b01640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54dc0c7ea0 0x7f54dc1edfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.187+0000 7f54e3b01640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f54dc151e90 0x7f54dc145d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.187+0000 7f54e3b01640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc1ed420 con 0x7f54dc0c4e60 2023-12-19T18:59:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.187+0000 7f54e3b01640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc1ecb70 con 0x7f54dc151e90 2023-12-19T18:59:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.187+0000 7f54e3b01640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54dc1f0210 con 0x7f54dc0c7ea0 2023-12-19T18:59:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.187+0000 7f54e189d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54dc0c4e60 0x7f54dc14b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.187+0000 7f54e189d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54dc0c4e60 0x7f54dc14b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59830/0 (socket says 172.21.15.133:59830) 2023-12-19T18:59:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.187+0000 7f54e189d640 1 -- 172.21.15.133:0/2426186394 learned_addr learned my addr 172.21.15.133:0/2426186394 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:46.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.187+0000 7f54e109c640 1 --2- 172.21.15.133:0/2426186394 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54dc0c7ea0 0x7f54dc1edfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:46.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.187+0000 7f54e209e640 1 --2- 172.21.15.133:0/2426186394 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f54dc151e90 0x7f54dc145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:46.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.187+0000 7f54e189d640 1 -- 172.21.15.133:0/2426186394 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54dc0c7ea0 msgr2=0x7f54dc1edfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:46.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.187+0000 7f54e189d640 1 --2- 172.21.15.133:0/2426186394 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54dc0c7ea0 0x7f54dc1edfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:46.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.187+0000 7f54e189d640 1 -- 172.21.15.133:0/2426186394 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f54dc151e90 msgr2=0x7f54dc145d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:46.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.187+0000 7f54e189d640 1 --2- 172.21.15.133:0/2426186394 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f54dc151e90 0x7f54dc145d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:46.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.187+0000 7f54e189d640 1 -- 172.21.15.133:0/2426186394 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54cc0094d0 con 0x7f54dc0c4e60 2023-12-19T18:59:46.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.187+0000 7f54e189d640 1 --2- 172.21.15.133:0/2426186394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54dc0c4e60 0x7f54dc14b4a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f54d801aa10 tx=0x7f54d8019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:46.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.187+0000 7f54d27fc640 1 -- 172.21.15.133:0/2426186394 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d80abdb0 con 0x7f54dc0c4e60 2023-12-19T18:59:46.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.187+0000 7f54d27fc640 1 -- 172.21.15.133:0/2426186394 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d8006e20 con 0x7f54dc0c4e60 2023-12-19T18:59:46.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.187+0000 7f54d27fc640 1 -- 172.21.15.133:0/2426186394 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d8004220 con 0x7f54dc0c4e60 2023-12-19T18:59:46.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.187+0000 7f54e3b01640 1 -- 172.21.15.133:0/2426186394 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d8009420 con 0x7f54dc0c4e60 2023-12-19T18:59:46.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.191+0000 7f54e3b01640 1 -- 172.21.15.133:0/2426186394 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54dc1ed040 con 0x7f54dc0c4e60 2023-12-19T18:59:46.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.191+0000 7f54e3b01640 1 -- 172.21.15.133:0/2426186394 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54dc068400 con 0x7f54dc0c4e60 2023-12-19T18:59:46.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.191+0000 7f54d27fc640 1 -- 172.21.15.133:0/2426186394 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f54d80b2050 con 0x7f54dc0c4e60 2023-12-19T18:59:46.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.191+0000 7f54d27fc640 1 --2- 172.21.15.133:0/2426186394 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f54c0066470 0x7f54c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:46.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.191+0000 7f54d27fc640 1 -- 172.21.15.133:0/2426186394 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f54d811e210 con 0x7f54dc0c4e60 2023-12-19T18:59:46.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.191+0000 7f54e109c640 1 --2- 172.21.15.133:0/2426186394 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f54c0066470 0x7f54c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:46.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.191+0000 7f54e109c640 1 --2- 172.21.15.133:0/2426186394 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f54c0066470 0x7f54c0068930 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0c3260 tx=0x7f54cc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:46.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.195+0000 7f54d27fc640 1 -- 172.21.15.133:0/2426186394 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f54d80eb320 con 0x7f54dc0c4e60 2023-12-19T18:59:46.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.347+0000 7f54e3b01640 1 -- 172.21.15.133:0/2426186394 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54dc1532f0 con 0x7f54dc0c4e60 2023-12-19T18:59:46.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.351+0000 7f54d27fc640 1 -- 172.21.15.133:0/2426186394 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+20278 (secure 0 0 0) 0x7f54d80ee940 con 0x7f54dc0c4e60 2023-12-19T18:59:46.356 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:46.356 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":34,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:59:45.017466+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:59:25.798150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T18:59:26.236078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T18:59:42.757628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-19T18:59:44.017454+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:59:46.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.351+0000 7f54e3b01640 1 -- 172.21.15.133:0/2426186394 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f54c0066470 msgr2=0x7f54c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:46.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.351+0000 7f54e3b01640 1 --2- 172.21.15.133:0/2426186394 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f54c0066470 0x7f54c0068930 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f54dc0c3260 tx=0x7f54cc008040 comp rx=0 tx=0).stop 2023-12-19T18:59:46.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.351+0000 7f54e3b01640 1 -- 172.21.15.133:0/2426186394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54dc0c4e60 msgr2=0x7f54dc14b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:46.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.351+0000 7f54e3b01640 1 --2- 172.21.15.133:0/2426186394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54dc0c4e60 0x7f54dc14b4a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f54d801aa10 tx=0x7f54d8019100 comp rx=0 tx=0).stop 2023-12-19T18:59:46.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.351+0000 7f54e3b01640 1 -- 172.21.15.133:0/2426186394 shutdown_connections 2023-12-19T18:59:46.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.351+0000 7f54e3b01640 1 --2- 172.21.15.133:0/2426186394 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f54c0066470 0x7f54c0068930 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:46.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.351+0000 7f54e3b01640 1 --2- 172.21.15.133:0/2426186394 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f54dc151e90 0x7f54dc145d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:46.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.351+0000 7f54e3b01640 1 --2- 172.21.15.133:0/2426186394 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f54dc0c7ea0 0x7f54dc1edfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:46.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.351+0000 7f54e3b01640 1 --2- 172.21.15.133:0/2426186394 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f54dc0c4e60 0x7f54dc14b4a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:46.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.351+0000 7f54e3b01640 1 -- 172.21.15.133:0/2426186394 >> 172.21.15.133:0/2426186394 conn(0x7f54dc0ca170 msgr2=0x7f54dc14fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:46.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.351+0000 7f54e3b01640 1 -- 172.21.15.133:0/2426186394 shutdown_connections 2023-12-19T18:59:46.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.351+0000 7f54e3b01640 1 -- 172.21.15.133:0/2426186394 wait complete. 2023-12-19T18:59:46.377 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-12-19T18:59:46.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.511+0000 7fb19166b640 1 Processor -- start 2023-12-19T18:59:46.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.511+0000 7fb19166b640 1 -- start start 2023-12-19T18:59:46.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.515+0000 7fb19166b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb18c06fdb0 0x7fb18c0c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:46.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.515+0000 7fb19166b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb18c0c1db0 con 0x7fb18c157410 2023-12-19T18:59:46.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.515+0000 7fb19166b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb18c0c2090 con 0x7fb18c1577f0 2023-12-19T18:59:46.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.515+0000 7fb19166b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c0c5cd0 con 0x7fb18c06fdb0 2023-12-19T18:59:46.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.515+0000 7fb18affd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb18c157410 0x7fb18c0c64d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47116/0 (socket says 172.21.15.133:47116) 2023-12-19T18:59:46.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.515+0000 7fb18affd640 1 -- 172.21.15.133:0/2196070415 learned_addr learned my addr 172.21.15.133:0/2196070415 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:46.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.515+0000 7fb1827fc640 1 --2- 172.21.15.133:0/2196070415 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb18c06fdb0 0x7fb18c0c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:46.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.515+0000 7fb18a7fc640 1 -- 172.21.15.133:0/2196070415 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2837562221 0 0) 0x7fb18c0c1db0 con 0x7fb18c157410 2023-12-19T18:59:46.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.515+0000 7fb18a7fc640 1 -- 172.21.15.133:0/2196070415 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb178003530 con 0x7fb18c157410 2023-12-19T18:59:46.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.515+0000 7fb18a7fc640 1 -- 172.21.15.133:0/2196070415 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897497846 0 0) 0x7fb18c0c2090 con 0x7fb18c1577f0 2023-12-19T18:59:46.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.515+0000 7fb18a7fc640 1 -- 172.21.15.133:0/2196070415 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb18c0c1db0 con 0x7fb18c1577f0 2023-12-19T18:59:46.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.515+0000 7fb1827fc640 1 -- 172.21.15.133:0/2196070415 >> v1:172.21.15.138:6789/0 conn(0x7fb18c1577f0 legacy=0x7fb18c157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:46.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.515+0000 7fb1827fc640 1 -- 172.21.15.133:0/2196070415 >> v1:172.21.15.133:6789/0 conn(0x7fb18c157410 legacy=0x7fb18c0c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:46.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.515+0000 7fb1827fc640 1 -- 172.21.15.133:0/2196070415 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18c0c5fb0 con 0x7fb18c06fdb0 2023-12-19T18:59:46.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.515+0000 7fb1827fc640 1 --2- 172.21.15.133:0/2196070415 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb18c06fdb0 0x7fb18c0c6be0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb1740097f0 tx=0x7fb17401c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a686959781767c4c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:46.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.519+0000 7fb18a7fc640 1 -- 172.21.15.133:0/2196070415 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1740ab600 con 0x7fb18c06fdb0 2023-12-19T18:59:46.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.519+0000 7fb18a7fc640 1 -- 172.21.15.133:0/2196070415 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1740a7050 con 0x7fb18c06fdb0 2023-12-19T18:59:46.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.519+0000 7fb18a7fc640 1 -- 172.21.15.133:0/2196070415 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1740ab980 con 0x7fb18c06fdb0 2023-12-19T18:59:46.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.519+0000 7fb19166b640 1 -- 172.21.15.133:0/2196070415 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb18c06fdb0 msgr2=0x7fb18c0c6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:46.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.519+0000 7fb19166b640 1 --2- 172.21.15.133:0/2196070415 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb18c06fdb0 0x7fb18c0c6be0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb1740097f0 tx=0x7fb17401c4c0 comp rx=0 tx=0).stop 2023-12-19T18:59:46.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.519+0000 7fb19166b640 1 -- 172.21.15.133:0/2196070415 shutdown_connections 2023-12-19T18:59:46.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.519+0000 7fb19166b640 1 --2- 172.21.15.133:0/2196070415 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb18c06fdb0 0x7fb18c0c6be0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:46.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.519+0000 7fb19166b640 1 -- 172.21.15.133:0/2196070415 >> 172.21.15.133:0/2196070415 conn(0x7fb18c0a9b80 msgr2=0x7fb18c0a9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:46.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.519+0000 7fb19166b640 1 -- 172.21.15.133:0/2196070415 shutdown_connections 2023-12-19T18:59:46.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.519+0000 7fb19166b640 1 -- 172.21.15.133:0/2196070415 wait complete. 2023-12-19T18:59:46.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.519+0000 7fb19166b640 1 Processor -- start 2023-12-19T18:59:46.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.519+0000 7fb19166b640 1 -- start start 2023-12-19T18:59:46.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.519+0000 7fb19166b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb18c06fdb0 0x7fb18c145b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:46.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.519+0000 7fb19166b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb18c157410 0x7fb18c06ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:46.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.519+0000 7fb19166b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb18c1577f0 0x7fb18c1eff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:46.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.519+0000 7fb19166b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c0ac3c0 con 0x7fb18c157410 2023-12-19T18:59:46.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.519+0000 7fb19166b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c150be0 con 0x7fb18c1577f0 2023-12-19T18:59:46.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.519+0000 7fb19166b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c0ac910 con 0x7fb18c06fdb0 2023-12-19T18:59:46.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.523+0000 7fb1827fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb18c157410 0x7fb18c06ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:46.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.523+0000 7fb1827fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb18c157410 0x7fb18c06ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59832/0 (socket says 172.21.15.133:59832) 2023-12-19T18:59:46.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.523+0000 7fb1827fc640 1 -- 172.21.15.133:0/2528440350 learned_addr learned my addr 172.21.15.133:0/2528440350 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:46.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.523+0000 7fb18affd640 1 --2- 172.21.15.133:0/2528440350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb18c06fdb0 0x7fb18c145b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:46.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.523+0000 7fb18b7fe640 1 --2- 172.21.15.133:0/2528440350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb18c1577f0 0x7fb18c1eff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:46.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.523+0000 7fb1827fc640 1 -- 172.21.15.133:0/2528440350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb18c06fdb0 msgr2=0x7fb18c145b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:46.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.523+0000 7fb1827fc640 1 --2- 172.21.15.133:0/2528440350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb18c06fdb0 0x7fb18c145b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:46.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.523+0000 7fb1827fc640 1 -- 172.21.15.133:0/2528440350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb18c1577f0 msgr2=0x7fb18c1eff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:46.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.523+0000 7fb1827fc640 1 --2- 172.21.15.133:0/2528440350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb18c1577f0 0x7fb18c1eff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:46.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.523+0000 7fb1827fc640 1 -- 172.21.15.133:0/2528440350 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb174009420 con 0x7fb18c157410 2023-12-19T18:59:46.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.523+0000 7fb1827fc640 1 --2- 172.21.15.133:0/2528440350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb18c157410 0x7fb18c06ecc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb1740097f0 tx=0x7fb174019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:46.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.523+0000 7fb183fff640 1 -- 172.21.15.133:0/2528440350 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1740b4430 con 0x7fb18c157410 2023-12-19T18:59:46.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.523+0000 7fb183fff640 1 -- 172.21.15.133:0/2528440350 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1740b45b0 con 0x7fb18c157410 2023-12-19T18:59:46.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.523+0000 7fb19166b640 1 -- 172.21.15.133:0/2528440350 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb18c14d5f0 con 0x7fb18c157410 2023-12-19T18:59:46.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.523+0000 7fb183fff640 1 -- 172.21.15.133:0/2528440350 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1740b4960 con 0x7fb18c157410 2023-12-19T18:59:46.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.523+0000 7fb19166b640 1 -- 172.21.15.133:0/2528440350 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18c0ac0e0 con 0x7fb18c157410 2023-12-19T18:59:46.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.523+0000 7fb19166b640 1 -- 172.21.15.133:0/2528440350 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb18c149c90 con 0x7fb18c157410 2023-12-19T18:59:46.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.523+0000 7fb183fff640 1 -- 172.21.15.133:0/2528440350 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb1740b2040 con 0x7fb18c157410 2023-12-19T18:59:46.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.527+0000 7fb183fff640 1 --2- 172.21.15.133:0/2528440350 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb16c0664a0 0x7fb16c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:46.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.527+0000 7fb183fff640 1 -- 172.21.15.133:0/2528440350 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb17411def0 con 0x7fb18c157410 2023-12-19T18:59:46.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.527+0000 7fb18affd640 1 --2- 172.21.15.133:0/2528440350 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb16c0664a0 0x7fb16c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:46.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.527+0000 7fb18affd640 1 --2- 172.21.15.133:0/2528440350 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb16c0664a0 0x7fb16c068960 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb17c007fd0 tx=0x7fb17c007d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:46.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.531+0000 7fb183fff640 1 -- 172.21.15.133:0/2528440350 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb18c149c90 con 0x7fb18c157410 2023-12-19T18:59:46.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:46.711+0000 7fb19166b640 1 -- 172.21.15.133:0/2528440350 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb18c0abf40 con 0x7fb18c157410 2023-12-19T18:59:47.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.691+0000 7fb183fff640 1 -- 172.21.15.133:0/2528440350 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v21) v1 ==== 119+0+0 (secure 0 0 0) 0x7fb18c0abf40 con 0x7fb18c157410 2023-12-19T18:59:47.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.691+0000 7fb19166b640 1 -- 172.21.15.133:0/2528440350 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb16c0664a0 msgr2=0x7fb16c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:47.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.691+0000 7fb19166b640 1 --2- 172.21.15.133:0/2528440350 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb16c0664a0 0x7fb16c068960 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb17c007fd0 tx=0x7fb17c007d80 comp rx=0 tx=0).stop 2023-12-19T18:59:47.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.691+0000 7fb19166b640 1 -- 172.21.15.133:0/2528440350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb18c157410 msgr2=0x7fb18c06ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:47.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.691+0000 7fb19166b640 1 --2- 172.21.15.133:0/2528440350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb18c157410 0x7fb18c06ecc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb1740097f0 tx=0x7fb174019260 comp rx=0 tx=0).stop 2023-12-19T18:59:47.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.691+0000 7fb19166b640 1 -- 172.21.15.133:0/2528440350 shutdown_connections 2023-12-19T18:59:47.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.691+0000 7fb19166b640 1 --2- 172.21.15.133:0/2528440350 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb16c0664a0 0x7fb16c068960 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:47.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.691+0000 7fb19166b640 1 --2- 172.21.15.133:0/2528440350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb18c1577f0 0x7fb18c1eff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:47.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.691+0000 7fb19166b640 1 --2- 172.21.15.133:0/2528440350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb18c157410 0x7fb18c06ecc0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:47.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.691+0000 7fb19166b640 1 --2- 172.21.15.133:0/2528440350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb18c06fdb0 0x7fb18c145b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:47.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.691+0000 7fb19166b640 1 -- 172.21.15.133:0/2528440350 >> 172.21.15.133:0/2528440350 conn(0x7fb18c0a9b80 msgr2=0x7fb18c157c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:47.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.691+0000 7fb19166b640 1 -- 172.21.15.133:0/2528440350 shutdown_connections 2023-12-19T18:59:47.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.695+0000 7fb19166b640 1 -- 172.21.15.133:0/2528440350 wait complete. 2023-12-19T18:59:47.722 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T18:59:47.723 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-12-19T18:59:47.753 INFO:tasks.ceph.mds.a.smithi133.stderr:2023-12-19T18:59:47.747+0000 7f9adad86640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T18:59:47.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.863+0000 7f3ac165a640 1 Processor -- start 2023-12-19T18:59:47.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.863+0000 7f3ac165a640 1 -- start start 2023-12-19T18:59:47.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.863+0000 7f3ac165a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3abc072090 0x7f3abc150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:47.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.863+0000 7f3ac165a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3abc0725c0 0x7f3abc1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:47.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.863+0000 7f3ac165a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3abc0c2760 con 0x7f3abc0a5370 2023-12-19T18:59:47.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.863+0000 7f3ac165a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3abc0c3070 con 0x7f3abc072090 2023-12-19T18:59:47.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.863+0000 7f3ac165a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc0a5750 con 0x7f3abc0725c0 2023-12-19T18:59:47.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.863+0000 7f3abaffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3abc0a5370 0x7f3abc0c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47124/0 (socket says 172.21.15.133:47124) 2023-12-19T18:59:47.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.863+0000 7f3abaffd640 1 -- 172.21.15.133:0/1636312244 learned_addr learned my addr 172.21.15.133:0/1636312244 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:47.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.863+0000 7f3aba7fc640 1 --2- 172.21.15.133:0/1636312244 >> v2:172.21.15.133:3300/0 conn(0x7f3abc072090 0x7f3abc150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:47.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.863+0000 7f3abb7fe640 1 --2- 172.21.15.133:0/1636312244 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3abc0725c0 0x7f3abc1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:47.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.863+0000 7f3aba7fc640 1 -- 172.21.15.133:0/1636312244 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3abc0725c0 msgr2=0x7f3abc1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:47.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.863+0000 7f3aba7fc640 1 --2- 172.21.15.133:0/1636312244 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3abc0725c0 0x7f3abc1514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:47.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.863+0000 7f3ab9ffb640 1 -- 172.21.15.133:0/1636312244 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846105999 0 0) 0x7f3abc0c2760 con 0x7f3abc0a5370 2023-12-19T18:59:47.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.863+0000 7f3aba7fc640 1 -- 172.21.15.133:0/1636312244 >> v1:172.21.15.133:6789/0 conn(0x7f3abc0a5370 legacy=0x7f3abc0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:47.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.863+0000 7f3aba7fc640 1 -- 172.21.15.133:0/1636312244 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc0aad20 con 0x7f3abc072090 2023-12-19T18:59:47.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.867+0000 7f3aba7fc640 1 --2- 172.21.15.133:0/1636312244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3abc072090 0x7f3abc150fa0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00097c0 tx=0x7f3ab001c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5bff17be2115b87 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:47.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.867+0000 7f3ab9ffb640 1 -- 172.21.15.133:0/1636312244 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab00ab600 con 0x7f3abc072090 2023-12-19T18:59:47.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.867+0000 7f3ab9ffb640 1 -- 172.21.15.133:0/1636312244 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab00a7050 con 0x7f3abc072090 2023-12-19T18:59:47.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.867+0000 7f3ab9ffb640 1 -- 172.21.15.133:0/1636312244 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab00ab980 con 0x7f3abc072090 2023-12-19T18:59:47.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.867+0000 7f3ac165a640 1 -- 172.21.15.133:0/1636312244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3abc072090 msgr2=0x7f3abc150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:47.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.867+0000 7f3ac165a640 1 --2- 172.21.15.133:0/1636312244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3abc072090 0x7f3abc150fa0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3ab00097c0 tx=0x7f3ab001c330 comp rx=0 tx=0).stop 2023-12-19T18:59:47.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.867+0000 7f3ac165a640 1 -- 172.21.15.133:0/1636312244 shutdown_connections 2023-12-19T18:59:47.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.867+0000 7f3ac165a640 1 --2- 172.21.15.133:0/1636312244 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3abc0725c0 0x7f3abc1514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:47.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.867+0000 7f3ac165a640 1 --2- 172.21.15.133:0/1636312244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3abc072090 0x7f3abc150fa0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:47.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.867+0000 7f3ac165a640 1 -- 172.21.15.133:0/1636312244 >> 172.21.15.133:0/1636312244 conn(0x7f3abc06a5b0 msgr2=0x7f3abc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:47.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.867+0000 7f3ac165a640 1 -- 172.21.15.133:0/1636312244 shutdown_connections 2023-12-19T18:59:47.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.867+0000 7f3ac165a640 1 -- 172.21.15.133:0/1636312244 wait complete. 2023-12-19T18:59:47.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3ac165a640 1 Processor -- start 2023-12-19T18:59:47.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3ac165a640 1 -- start start 2023-12-19T18:59:47.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3ac165a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3abc072090 0x7f3abc0700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:47.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3ac165a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3abc0725c0 0x7f3abc0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:47.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3ac165a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3abc0a5370 0x7f3abc0a6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:47.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3ac165a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc070b30 con 0x7f3abc0725c0 2023-12-19T18:59:47.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3ac165a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc1eb100 con 0x7f3abc0a5370 2023-12-19T18:59:47.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3ac165a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc1eb630 con 0x7f3abc072090 2023-12-19T18:59:47.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3aba7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3abc0725c0 0x7f3abc0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:47.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3aba7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3abc0725c0 0x7f3abc0705f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59844/0 (socket says 172.21.15.133:59844) 2023-12-19T18:59:47.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3aba7fc640 1 -- 172.21.15.133:0/3877637984 learned_addr learned my addr 172.21.15.133:0/3877637984 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:47.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3aba7fc640 1 -- 172.21.15.133:0/3877637984 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3abc072090 msgr2=0x7f3abc0700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:47.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3abaffd640 1 --2- 172.21.15.133:0/3877637984 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3abc072090 0x7f3abc0700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:47.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3abb7fe640 1 --2- 172.21.15.133:0/3877637984 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3abc0a5370 0x7f3abc0a6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:47.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3aba7fc640 1 --2- 172.21.15.133:0/3877637984 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3abc072090 0x7f3abc0700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:47.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3aba7fc640 1 -- 172.21.15.133:0/3877637984 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3abc0a5370 msgr2=0x7f3abc0a6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:47.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3aba7fc640 1 --2- 172.21.15.133:0/3877637984 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3abc0a5370 0x7f3abc0a6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:47.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3aba7fc640 1 -- 172.21.15.133:0/3877637984 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab0009420 con 0x7f3abc0725c0 2023-12-19T18:59:47.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3abaffd640 1 --2- 172.21.15.133:0/3877637984 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3abc072090 0x7f3abc0700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:47.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3abb7fe640 1 --2- 172.21.15.133:0/3877637984 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3abc0a5370 0x7f3abc0a6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:47.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3aba7fc640 1 --2- 172.21.15.133:0/3877637984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3abc0725c0 0x7f3abc0705f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0019f60 tx=0x7f3ab00190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:47.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3aa37fe640 1 -- 172.21.15.133:0/3877637984 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab00b4840 con 0x7f3abc0725c0 2023-12-19T18:59:47.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3aa37fe640 1 -- 172.21.15.133:0/3877637984 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab00b49c0 con 0x7f3abc0725c0 2023-12-19T18:59:47.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3ac165a640 1 -- 172.21.15.133:0/3877637984 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3abc0a6330 con 0x7f3abc0725c0 2023-12-19T18:59:47.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3aa37fe640 1 -- 172.21.15.133:0/3877637984 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab00b4d70 con 0x7f3abc0725c0 2023-12-19T18:59:47.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.871+0000 7f3ac165a640 1 -- 172.21.15.133:0/3877637984 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3abc0a5ce0 con 0x7f3abc0725c0 2023-12-19T18:59:47.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.875+0000 7f3ac165a640 1 -- 172.21.15.133:0/3877637984 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3abc068400 con 0x7f3abc0725c0 2023-12-19T18:59:47.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.875+0000 7f3aa37fe640 1 -- 172.21.15.133:0/3877637984 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3ab00b2040 con 0x7f3abc0725c0 2023-12-19T18:59:47.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.875+0000 7f3aa37fe640 1 --2- 172.21.15.133:0/3877637984 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3aa80664a0 0x7f3aa8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:47.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.875+0000 7f3aa37fe640 1 -- 172.21.15.133:0/3877637984 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3ab011e3b0 con 0x7f3abc0725c0 2023-12-19T18:59:47.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.875+0000 7f3abaffd640 1 --2- 172.21.15.133:0/3877637984 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3aa80664a0 0x7f3aa8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:47.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.875+0000 7f3abaffd640 1 --2- 172.21.15.133:0/3877637984 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3aa80664a0 0x7f3aa8068960 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3aac000f70 tx=0x7f3aac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:47.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:47.879+0000 7f3aa37fe640 1 -- 172.21.15.133:0/3877637984 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f3ab00eb4c0 con 0x7f3abc0725c0 2023-12-19T18:59:48.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.059+0000 7f3ac165a640 1 -- 172.21.15.133:0/3877637984 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f3abc0c6780 con 0x7f3abc0725c0 2023-12-19T18:59:48.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.690+0000 7f3aa37fe640 1 -- 172.21.15.133:0/3877637984 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f3ab00eeae0 con 0x7f3abc0725c0 2023-12-19T18:59:48.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.694+0000 7f3ac165a640 1 -- 172.21.15.133:0/3877637984 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3aa80664a0 msgr2=0x7f3aa8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:48.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.694+0000 7f3ac165a640 1 --2- 172.21.15.133:0/3877637984 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3aa80664a0 0x7f3aa8068960 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3aac000f70 tx=0x7f3aac009040 comp rx=0 tx=0).stop 2023-12-19T18:59:48.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.694+0000 7f3ac165a640 1 -- 172.21.15.133:0/3877637984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3abc0725c0 msgr2=0x7f3abc0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:48.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.694+0000 7f3ac165a640 1 --2- 172.21.15.133:0/3877637984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3abc0725c0 0x7f3abc0705f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0019f60 tx=0x7f3ab00190d0 comp rx=0 tx=0).stop 2023-12-19T18:59:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.694+0000 7f3ac165a640 1 -- 172.21.15.133:0/3877637984 shutdown_connections 2023-12-19T18:59:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.694+0000 7f3ac165a640 1 --2- 172.21.15.133:0/3877637984 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3aa80664a0 0x7f3aa8068960 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.694+0000 7f3ac165a640 1 --2- 172.21.15.133:0/3877637984 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3abc0a5370 0x7f3abc0a6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.694+0000 7f3ac165a640 1 --2- 172.21.15.133:0/3877637984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3abc0725c0 0x7f3abc0705f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.694+0000 7f3ac165a640 1 --2- 172.21.15.133:0/3877637984 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3abc072090 0x7f3abc0700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.694+0000 7f3ac165a640 1 -- 172.21.15.133:0/3877637984 >> 172.21.15.133:0/3877637984 conn(0x7f3abc06a5b0 msgr2=0x7f3abc06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.694+0000 7f3ac165a640 1 -- 172.21.15.133:0/3877637984 shutdown_connections 2023-12-19T18:59:48.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.694+0000 7f3ac165a640 1 -- 172.21.15.133:0/3877637984 wait complete. 2023-12-19T18:59:48.720 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-12-19T18:59:48.720 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:59:48.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.894+0000 7fe0c6b80640 1 Processor -- start 2023-12-19T18:59:48.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.894+0000 7fe0c6b80640 1 -- start start 2023-12-19T18:59:48.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.894+0000 7fe0c6b80640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0c00c2bb0 0x7fe0c00c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:48.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.894+0000 7fe0c6b80640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c00c31c0 con 0x7fe0c00c63c0 2023-12-19T18:59:48.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.894+0000 7fe0c6b80640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c00c34a0 con 0x7fe0c00c4100 2023-12-19T18:59:48.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.894+0000 7fe0c6b80640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c00c1030 con 0x7fe0c00c2bb0 2023-12-19T18:59:48.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.894+0000 7fe0c491c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe0c00c63c0 0x7fe0c00c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47140/0 (socket says 172.21.15.133:47140) 2023-12-19T18:59:48.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.894+0000 7fe0c491c640 1 -- 172.21.15.133:0/3081322525 learned_addr learned my addr 172.21.15.133:0/3081322525 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:48.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.894+0000 7fe0c511d640 1 --2- 172.21.15.133:0/3081322525 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0c00c2bb0 0x7fe0c00c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:48.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.894+0000 7fe0bf7fe640 1 -- 172.21.15.133:0/3081322525 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120689821 0 0) 0x7fe0c00c31c0 con 0x7fe0c00c63c0 2023-12-19T18:59:48.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.894+0000 7fe0bf7fe640 1 -- 172.21.15.133:0/3081322525 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0a8005740 con 0x7fe0c00c63c0 2023-12-19T18:59:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.894+0000 7fe0bf7fe640 1 -- 172.21.15.133:0/3081322525 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4257726922 0 0) 0x7fe0a8005740 con 0x7fe0c00c63c0 2023-12-19T18:59:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.894+0000 7fe0bf7fe640 1 -- 172.21.15.133:0/3081322525 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0c00c2bb0 msgr2=0x7fe0c00c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.894+0000 7fe0bf7fe640 1 --2- 172.21.15.133:0/3081322525 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0c00c2bb0 0x7fe0c00c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.894+0000 7fe0bf7fe640 1 -- 172.21.15.133:0/3081322525 >> v1:172.21.15.138:6789/0 conn(0x7fe0c00c4100 legacy=0x7fe0c00a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.894+0000 7fe0bf7fe640 1 -- 172.21.15.133:0/3081322525 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c00c1310 con 0x7fe0c00c63c0 2023-12-19T18:59:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.894+0000 7fe0bf7fe640 1 -- 172.21.15.133:0/3081322525 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7fe0b0001680 con 0x7fe0c00c63c0 2023-12-19T18:59:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.894+0000 7fe0bf7fe640 1 -- 172.21.15.133:0/3081322525 >> v1:172.21.15.133:6789/0 conn(0x7fe0c00c63c0 legacy=0x7fe0c00c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.894+0000 7fe0bf7fe640 1 --2- 172.21.15.133:0/3081322525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0a8005bc0 0x7fe0a8005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.898+0000 7fe0bf7fe640 1 --2- 172.21.15.133:0/3081322525 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0a80069e0 0x7fe0a8006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.898+0000 7fe0bf7fe640 1 --2- 172.21.15.133:0/3081322525 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0c00c2bb0 0x7fe0a80073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.898+0000 7fe0bf7fe640 1 -- 172.21.15.133:0/3081322525 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c00c1030 con 0x7fe0a8005bc0 2023-12-19T18:59:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.898+0000 7fe0bf7fe640 1 -- 172.21.15.133:0/3081322525 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a800dcd0 con 0x7fe0a80069e0 2023-12-19T18:59:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.898+0000 7fe0bf7fe640 1 -- 172.21.15.133:0/3081322525 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a800de90 con 0x7fe0c00c2bb0 2023-12-19T18:59:48.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.898+0000 7fe0c491c640 1 --2- 172.21.15.133:0/3081322525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0a8005bc0 0x7fe0a8005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.898+0000 7fe0bffff640 1 --2- 172.21.15.133:0/3081322525 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0a80069e0 0x7fe0a8006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.898+0000 7fe0c511d640 1 --2- 172.21.15.133:0/3081322525 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0c00c2bb0 0x7fe0a80073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.898+0000 7fe0c491c640 1 -- 172.21.15.133:0/3081322525 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0c00c2bb0 msgr2=0x7fe0a80073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.898+0000 7fe0c491c640 1 --2- 172.21.15.133:0/3081322525 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0c00c2bb0 0x7fe0a80073e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.898+0000 7fe0c491c640 1 -- 172.21.15.133:0/3081322525 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0a80069e0 msgr2=0x7fe0a8006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.898+0000 7fe0c491c640 1 --2- 172.21.15.133:0/3081322525 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0a80069e0 0x7fe0a8006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:48.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.898+0000 7fe0c491c640 1 -- 172.21.15.133:0/3081322525 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a8005740 con 0x7fe0a8005bc0 2023-12-19T18:59:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.898+0000 7fe0c491c640 1 --2- 172.21.15.133:0/3081322525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0a8005bc0 0x7fe0a8005fa0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000c210 tx=0x7fe0b001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982c1f7490dc1ccf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.898+0000 7fe0bf7fe640 1 -- 172.21.15.133:0/3081322525 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0005ae0 con 0x7fe0a8005bc0 2023-12-19T18:59:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.898+0000 7fe0bf7fe640 1 -- 172.21.15.133:0/3081322525 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b0005c60 con 0x7fe0a8005bc0 2023-12-19T18:59:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.898+0000 7fe0bf7fe640 1 -- 172.21.15.133:0/3081322525 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0007070 con 0x7fe0a8005bc0 2023-12-19T18:59:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c6b80640 1 -- 172.21.15.133:0/3081322525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0a8005bc0 msgr2=0x7fe0a8005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:48.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c6b80640 1 --2- 172.21.15.133:0/3081322525 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0a8005bc0 0x7fe0a8005fa0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000c210 tx=0x7fe0b001cc30 comp rx=0 tx=0).stop 2023-12-19T18:59:48.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c511d640 1 -- 172.21.15.133:0/3081322525 reap_dead start 2023-12-19T18:59:48.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c6b80640 1 -- 172.21.15.133:0/3081322525 shutdown_connections 2023-12-19T18:59:48.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c6b80640 1 -- 172.21.15.133:0/3081322525 >> 172.21.15.133:0/3081322525 conn(0x7fe0c006a5b0 msgr2=0x7fe0c006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:48.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c6b80640 1 -- 172.21.15.133:0/3081322525 shutdown_connections 2023-12-19T18:59:48.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c6b80640 1 -- 172.21.15.133:0/3081322525 wait complete. 2023-12-19T18:59:48.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c6b80640 1 Processor -- start 2023-12-19T18:59:48.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c6b80640 1 -- start start 2023-12-19T18:59:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c6b80640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0a8005bc0 0x7fe0c0151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c6b80640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0c014e510 0x7fe0c0150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c6b80640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0c014f390 0x7fe0c014f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c6b80640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c01e4060 con 0x7fe0a8005bc0 2023-12-19T18:59:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c6b80640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c01e4340 con 0x7fe0c014f390 2023-12-19T18:59:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c6b80640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c01e47d0 con 0x7fe0c014e510 2023-12-19T18:59:48.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c491c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0a8005bc0 0x7fe0c0151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c491c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0a8005bc0 0x7fe0c0151a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59852/0 (socket says 172.21.15.133:59852) 2023-12-19T18:59:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c491c640 1 -- 172.21.15.133:0/2147915457 learned_addr learned my addr 172.21.15.133:0/2147915457 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0bffff640 1 --2- 172.21.15.133:0/2147915457 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0c014e510 0x7fe0c0150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c511d640 1 --2- 172.21.15.133:0/2147915457 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0c014f390 0x7fe0c014f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c491c640 1 -- 172.21.15.133:0/2147915457 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0c014e510 msgr2=0x7fe0c0150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c491c640 1 --2- 172.21.15.133:0/2147915457 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0c014e510 0x7fe0c0150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c491c640 1 -- 172.21.15.133:0/2147915457 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0c014f390 msgr2=0x7fe0c014f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c491c640 1 --2- 172.21.15.133:0/2147915457 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0c014f390 0x7fe0c014f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c491c640 1 -- 172.21.15.133:0/2147915457 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c00c69b0 con 0x7fe0a8005bc0 2023-12-19T18:59:48.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0c511d640 1 --2- 172.21.15.133:0/2147915457 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0c014f390 0x7fe0c014f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:48.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.902+0000 7fe0bffff640 1 --2- 172.21.15.133:0/2147915457 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0c014e510 0x7fe0c0150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:48.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.906+0000 7fe0c491c640 1 --2- 172.21.15.133:0/2147915457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0a8005bc0 0x7fe0c0151a20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe0b001c6a0 tx=0x7fe0a8007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:48.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.906+0000 7fe0bd7fa640 1 -- 172.21.15.133:0/2147915457 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b00b4070 con 0x7fe0a8005bc0 2023-12-19T18:59:48.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.906+0000 7fe0bd7fa640 1 -- 172.21.15.133:0/2147915457 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b0005dd0 con 0x7fe0a8005bc0 2023-12-19T18:59:48.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.906+0000 7fe0bd7fa640 1 -- 172.21.15.133:0/2147915457 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0001640 con 0x7fe0a8005bc0 2023-12-19T18:59:48.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.906+0000 7fe0c6b80640 1 -- 172.21.15.133:0/2147915457 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c014dfc0 con 0x7fe0a8005bc0 2023-12-19T18:59:48.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.906+0000 7fe0c6b80640 1 -- 172.21.15.133:0/2147915457 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c01ede10 con 0x7fe0a8005bc0 2023-12-19T18:59:48.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.906+0000 7fe0c6b80640 1 -- 172.21.15.133:0/2147915457 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c0068400 con 0x7fe0a8005bc0 2023-12-19T18:59:48.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.906+0000 7fe0bd7fa640 1 -- 172.21.15.133:0/2147915457 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe0b0007040 con 0x7fe0a8005bc0 2023-12-19T18:59:48.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.906+0000 7fe0bd7fa640 1 --2- 172.21.15.133:0/2147915457 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe0ac0664a0 0x7fe0ac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:48.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.906+0000 7fe0bd7fa640 1 -- 172.21.15.133:0/2147915457 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe0b011da10 con 0x7fe0a8005bc0 2023-12-19T18:59:48.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.906+0000 7fe0bffff640 1 --2- 172.21.15.133:0/2147915457 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe0ac0664a0 0x7fe0ac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:48.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.910+0000 7fe0bffff640 1 --2- 172.21.15.133:0/2147915457 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe0ac0664a0 0x7fe0ac068960 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe0c014ec70 tx=0x7fe0b4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:48.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:48.910+0000 7fe0bd7fa640 1 -- 172.21.15.133:0/2147915457 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fe0b00eab20 con 0x7fe0a8005bc0 2023-12-19T18:59:49.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.090+0000 7fe0c6b80640 1 -- 172.21.15.133:0/2147915457 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0c00729b0 con 0x7fe0a8005bc0 2023-12-19T18:59:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.090+0000 7fe0bd7fa640 1 -- 172.21.15.133:0/2147915457 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6189 (secure 0 0 0) 0x7fe0b00ee140 con 0x7fe0a8005bc0 2023-12-19T18:59:49.098 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:49.098 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/2717901150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6835","nonce":2717901150},{"type":"v1","addr":"172.21.15.138:6837","nonce":2717901150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4986,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6836/3989181473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":3989181473},{"type":"v1","addr":"172.21.15.138:6836","nonce":3989181473}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:59:27.233483+0000","modified":"2023-12-19T18:59:30.251421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4995},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4995":{"gid":4995,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/862459875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":862459875},{"type":"v1","addr":"172.21.15.133:6835","nonce":862459875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:59:45.017800+0000","modified":"2023-12-19T18:59:48.066331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.133:6834/3180094953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":3180094953},{"type":"v1","addr":"172.21.15.133:6834","nonce":3180094953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T18:59:49.098 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 22 2023-12-19T18:59:49.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.094+0000 7fe0c6b80640 1 -- 172.21.15.133:0/2147915457 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe0ac0664a0 msgr2=0x7fe0ac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:49.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.094+0000 7fe0c6b80640 1 --2- 172.21.15.133:0/2147915457 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe0ac0664a0 0x7fe0ac068960 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe0c014ec70 tx=0x7fe0b4009040 comp rx=0 tx=0).stop 2023-12-19T18:59:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.094+0000 7fe0c6b80640 1 -- 172.21.15.133:0/2147915457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0a8005bc0 msgr2=0x7fe0c0151a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.094+0000 7fe0c6b80640 1 --2- 172.21.15.133:0/2147915457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0a8005bc0 0x7fe0c0151a20 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe0b001c6a0 tx=0x7fe0a8007a10 comp rx=0 tx=0).stop 2023-12-19T18:59:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.094+0000 7fe0c6b80640 1 -- 172.21.15.133:0/2147915457 shutdown_connections 2023-12-19T18:59:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.094+0000 7fe0c6b80640 1 --2- 172.21.15.133:0/2147915457 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe0ac0664a0 0x7fe0ac068960 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.094+0000 7fe0c6b80640 1 --2- 172.21.15.133:0/2147915457 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe0c014f390 0x7fe0c014f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.094+0000 7fe0c6b80640 1 --2- 172.21.15.133:0/2147915457 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe0c014e510 0x7fe0c0150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.094+0000 7fe0c6b80640 1 --2- 172.21.15.133:0/2147915457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe0a8005bc0 0x7fe0c0151a20 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.094+0000 7fe0c6b80640 1 -- 172.21.15.133:0/2147915457 >> 172.21.15.133:0/2147915457 conn(0x7fe0c006a5b0 msgr2=0x7fe0c006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.094+0000 7fe0c6b80640 1 -- 172.21.15.133:0/2147915457 shutdown_connections 2023-12-19T18:59:49.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.094+0000 7fe0c6b80640 1 -- 172.21.15.133:0/2147915457 wait complete. 2023-12-19T18:59:49.120 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:59:49.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.250+0000 7fa392b2a640 1 Processor -- start 2023-12-19T18:59:49.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.250+0000 7fa392b2a640 1 -- start start 2023-12-19T18:59:49.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.250+0000 7fa392b2a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa38c0c5260 0x7fa38c06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:49.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.250+0000 7fa392b2a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa38c0c5640 0x7fa38c0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:49.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.250+0000 7fa392b2a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa38c0c2580 con 0x7fa38c0c60f0 2023-12-19T18:59:49.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.250+0000 7fa392b2a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa38c153510 con 0x7fa38c0c5260 2023-12-19T18:59:49.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.250+0000 7fa392b2a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c0c17f0 con 0x7fa38c0c5640 2023-12-19T18:59:49.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.250+0000 7fa3908c6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa38c0c5260 0x7fa38c06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:49.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.250+0000 7fa3908c6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa38c0c5260 0x7fa38c06d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59866/0 (socket says 172.21.15.133:59866) 2023-12-19T18:59:49.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.250+0000 7fa3908c6640 1 -- 172.21.15.133:0/681109473 learned_addr learned my addr 172.21.15.133:0/681109473 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:49.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.250+0000 7fa38bfff640 1 --2- 172.21.15.133:0/681109473 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa38c0c5640 0x7fa38c0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:49.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.250+0000 7fa3908c6640 1 -- 172.21.15.133:0/681109473 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa38c0c5640 msgr2=0x7fa38c0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:49.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.250+0000 7fa3908c6640 1 --2- 172.21.15.133:0/681109473 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa38c0c5640 0x7fa38c0c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.254+0000 7fa3908c6640 1 -- 172.21.15.133:0/681109473 >> v1:172.21.15.133:6789/0 conn(0x7fa38c0c60f0 legacy=0x7fa38c155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:49.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.254+0000 7fa3908c6640 1 -- 172.21.15.133:0/681109473 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c0c1a00 con 0x7fa38c0c5260 2023-12-19T18:59:49.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.254+0000 7fa3908c6640 1 --2- 172.21.15.133:0/681109473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa38c0c5260 0x7fa38c06d5b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0c1930 tx=0x7fa38001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b59cf09dd17c59 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:49.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.254+0000 7fa38b7fe640 1 -- 172.21.15.133:0/681109473 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3800ab600 con 0x7fa38c0c5260 2023-12-19T18:59:49.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.254+0000 7fa38b7fe640 1 -- 172.21.15.133:0/681109473 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3800a7050 con 0x7fa38c0c5260 2023-12-19T18:59:49.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.254+0000 7fa38b7fe640 1 -- 172.21.15.133:0/681109473 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3800ab980 con 0x7fa38c0c5260 2023-12-19T18:59:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.254+0000 7fa392b2a640 1 -- 172.21.15.133:0/681109473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa38c0c5260 msgr2=0x7fa38c06d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.254+0000 7fa392b2a640 1 --2- 172.21.15.133:0/681109473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa38c0c5260 0x7fa38c06d5b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa38c0c1930 tx=0x7fa38001c460 comp rx=0 tx=0).stop 2023-12-19T18:59:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa392b2a640 1 -- 172.21.15.133:0/681109473 shutdown_connections 2023-12-19T18:59:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa392b2a640 1 --2- 172.21.15.133:0/681109473 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa38c0c5640 0x7fa38c0c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa392b2a640 1 --2- 172.21.15.133:0/681109473 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa38c0c5260 0x7fa38c06d5b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa392b2a640 1 -- 172.21.15.133:0/681109473 >> 172.21.15.133:0/681109473 conn(0x7fa38c06a5b0 msgr2=0x7fa38c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa392b2a640 1 -- 172.21.15.133:0/681109473 shutdown_connections 2023-12-19T18:59:49.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa392b2a640 1 -- 172.21.15.133:0/681109473 wait complete. 2023-12-19T18:59:49.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa392b2a640 1 Processor -- start 2023-12-19T18:59:49.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa392b2a640 1 -- start start 2023-12-19T18:59:49.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa392b2a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa38c0c5260 0x7fa38c1edcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:49.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa392b2a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa38c0c5640 0x7fa38c071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:49.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa392b2a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa38c0c60f0 0x7fa38c0a91c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:49.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa392b2a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c0a8d30 con 0x7fa38c0c5640 2023-12-19T18:59:49.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa392b2a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c0aa6a0 con 0x7fa38c0c5260 2023-12-19T18:59:49.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa392b2a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa38c0aaeb0 con 0x7fa38c0c60f0 2023-12-19T18:59:49.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa38bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa38c0c5640 0x7fa38c071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa38bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa38c0c5640 0x7fa38c071380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59878/0 (socket says 172.21.15.133:59878) 2023-12-19T18:59:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa38bfff640 1 -- 172.21.15.133:0/612126558 learned_addr learned my addr 172.21.15.133:0/612126558 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa38bfff640 1 -- 172.21.15.133:0/612126558 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa38c0c60f0 msgr2=0x7fa38c0a91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa3910c7640 1 --2- 172.21.15.133:0/612126558 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa38c0c60f0 0x7fa38c0a91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa3908c6640 1 --2- 172.21.15.133:0/612126558 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa38c0c5260 0x7fa38c1edcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa38bfff640 1 --2- 172.21.15.133:0/612126558 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa38c0c60f0 0x7fa38c0a91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa38bfff640 1 -- 172.21.15.133:0/612126558 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa38c0c5260 msgr2=0x7fa38c1edcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa38bfff640 1 --2- 172.21.15.133:0/612126558 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa38c0c5260 0x7fa38c1edcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa38bfff640 1 -- 172.21.15.133:0/612126558 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3800094d0 con 0x7fa38c0c5640 2023-12-19T18:59:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa3910c7640 1 --2- 172.21.15.133:0/612126558 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa38c0c60f0 0x7fa38c0a91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa3908c6640 1 --2- 172.21.15.133:0/612126558 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa38c0c5260 0x7fa38c1edcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.258+0000 7fa38bfff640 1 --2- 172.21.15.133:0/612126558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa38c0c5640 0x7fa38c071380 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa37800d800 tx=0x7fa37800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:49.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.262+0000 7fa3897fa640 1 -- 172.21.15.133:0/612126558 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37800b6c0 con 0x7fa38c0c5640 2023-12-19T18:59:49.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.262+0000 7fa3897fa640 1 -- 172.21.15.133:0/612126558 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37800b820 con 0x7fa38c0c5640 2023-12-19T18:59:49.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.262+0000 7fa392b2a640 1 -- 172.21.15.133:0/612126558 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa38c1579d0 con 0x7fa38c0c5640 2023-12-19T18:59:49.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.262+0000 7fa3897fa640 1 -- 172.21.15.133:0/612126558 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37800bbb0 con 0x7fa38c0c5640 2023-12-19T18:59:49.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.262+0000 7fa392b2a640 1 -- 172.21.15.133:0/612126558 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa38c0aabd0 con 0x7fa38c0c5640 2023-12-19T18:59:49.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.262+0000 7fa392b2a640 1 -- 172.21.15.133:0/612126558 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa38c0a8ee0 con 0x7fa38c0c5640 2023-12-19T18:59:49.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.262+0000 7fa3897fa640 1 -- 172.21.15.133:0/612126558 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa37800bd10 con 0x7fa38c0c5640 2023-12-19T18:59:49.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.262+0000 7fa3897fa640 1 --2- 172.21.15.133:0/612126558 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa370066470 0x7fa370068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:49.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.262+0000 7fa3897fa640 1 -- 172.21.15.133:0/612126558 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa3780846d0 con 0x7fa38c0c5640 2023-12-19T18:59:49.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.262+0000 7fa3908c6640 1 --2- 172.21.15.133:0/612126558 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa370066470 0x7fa370068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:49.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.266+0000 7fa3908c6640 1 --2- 172.21.15.133:0/612126558 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa370066470 0x7fa370068930 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa3800ad000 tx=0x7fa380008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:49.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.266+0000 7fa3897fa640 1 -- 172.21.15.133:0/612126558 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa38c0a8ee0 con 0x7fa38c0c5640 2023-12-19T18:59:49.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.418+0000 7fa392b2a640 1 -- 172.21.15.133:0/612126558 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa38c0a8ee0 con 0x7fa38c0c5640 2023-12-19T18:59:49.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.418+0000 7fa3897fa640 1 -- 172.21.15.133:0/612126558 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20265 (secure 0 0 0) 0x7fa38c0a8ee0 con 0x7fa38c0c5640 2023-12-19T18:59:49.426 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:49.426 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":35,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:59:46.667472+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:59:25.798150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T18:59:26.236078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T18:59:42.757628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-19T18:59:44.017454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:59:49.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.422+0000 7fa392b2a640 1 -- 172.21.15.133:0/612126558 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa370066470 msgr2=0x7fa370068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:49.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.422+0000 7fa392b2a640 1 --2- 172.21.15.133:0/612126558 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa370066470 0x7fa370068930 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa3800ad000 tx=0x7fa380008040 comp rx=0 tx=0).stop 2023-12-19T18:59:49.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.422+0000 7fa392b2a640 1 -- 172.21.15.133:0/612126558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa38c0c5640 msgr2=0x7fa38c071380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:49.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.422+0000 7fa392b2a640 1 --2- 172.21.15.133:0/612126558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa38c0c5640 0x7fa38c071380 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa37800d800 tx=0x7fa37800dcc0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.422+0000 7fa392b2a640 1 -- 172.21.15.133:0/612126558 shutdown_connections 2023-12-19T18:59:49.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.422+0000 7fa392b2a640 1 --2- 172.21.15.133:0/612126558 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa370066470 0x7fa370068930 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.422+0000 7fa392b2a640 1 --2- 172.21.15.133:0/612126558 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa38c0c60f0 0x7fa38c0a91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.422+0000 7fa392b2a640 1 --2- 172.21.15.133:0/612126558 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa38c0c5640 0x7fa38c071380 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.422+0000 7fa392b2a640 1 --2- 172.21.15.133:0/612126558 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa38c0c5260 0x7fa38c1edcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.422+0000 7fa392b2a640 1 -- 172.21.15.133:0/612126558 >> 172.21.15.133:0/612126558 conn(0x7fa38c06a5b0 msgr2=0x7fa38c14ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:49.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.422+0000 7fa392b2a640 1 -- 172.21.15.133:0/612126558 shutdown_connections 2023-12-19T18:59:49.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.422+0000 7fa392b2a640 1 -- 172.21.15.133:0/612126558 wait complete. 2023-12-19T18:59:49.447 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T18:59:49.447 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T18:59:49.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a3e1d8640 1 Processor -- start 2023-12-19T18:59:49.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a3e1d8640 1 -- start start 2023-12-19T18:59:49.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a3e1d8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0a380c7ed0 0x7f0a38154650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:49.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a3e1d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a380bd660 0x7f0a38154b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:49.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a3e1d8640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a380ac4f0 con 0x7f0a38151dc0 2023-12-19T18:59:49.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a3e1d8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a38158780 con 0x7f0a380c7ed0 2023-12-19T18:59:49.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a3e1d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a38158a60 con 0x7f0a380bd660 2023-12-19T18:59:49.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a377fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0a38151dc0 0x7f0a380c4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47164/0 (socket says 172.21.15.133:47164) 2023-12-19T18:59:49.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a377fe640 1 -- 172.21.15.133:0/2411150877 learned_addr learned my addr 172.21.15.133:0/2411150877 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:49.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a36ffd640 1 --2- 172.21.15.133:0/2411150877 >> v2:172.21.15.138:3300/0 conn(0x7f0a380c7ed0 0x7f0a38154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:49.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a37fff640 1 --2- 172.21.15.133:0/2411150877 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a380bd660 0x7f0a38154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:49.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a367fc640 1 -- 172.21.15.133:0/2411150877 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203254418 0 0) 0x7f0a380ac4f0 con 0x7f0a38151dc0 2023-12-19T18:59:49.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a367fc640 1 -- 172.21.15.133:0/2411150877 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a20003530 con 0x7f0a38151dc0 2023-12-19T18:59:49.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a367fc640 1 -- 172.21.15.133:0/2411150877 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4260102910 0 0) 0x7f0a20003530 con 0x7f0a38151dc0 2023-12-19T18:59:49.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a367fc640 1 -- 172.21.15.133:0/2411150877 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a380bd660 msgr2=0x7f0a38154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:49.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a367fc640 1 --2- 172.21.15.133:0/2411150877 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a380bd660 0x7f0a38154b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a367fc640 1 -- 172.21.15.133:0/2411150877 >> v2:172.21.15.138:3300/0 conn(0x7f0a380c7ed0 msgr2=0x7f0a38154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:49.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a367fc640 1 --2- 172.21.15.133:0/2411150877 >> v2:172.21.15.138:3300/0 conn(0x7f0a380c7ed0 0x7f0a38154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a367fc640 1 -- 172.21.15.133:0/2411150877 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a380ac180 con 0x7f0a38151dc0 2023-12-19T18:59:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a367fc640 1 -- 172.21.15.133:0/2411150877 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f0a28001680 con 0x7f0a38151dc0 2023-12-19T18:59:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a367fc640 1 -- 172.21.15.133:0/2411150877 >> v1:172.21.15.133:6789/0 conn(0x7f0a38151dc0 legacy=0x7f0a380c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a367fc640 1 --2- 172.21.15.133:0/2411150877 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a380bd660 0x7f0a20003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a367fc640 1 --2- 172.21.15.133:0/2411150877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a20003f00 0x7f0a200047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a367fc640 1 --2- 172.21.15.133:0/2411150877 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a20004d10 0x7f0a20005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a367fc640 1 -- 172.21.15.133:0/2411150877 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a38158780 con 0x7f0a20003f00 2023-12-19T18:59:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a367fc640 1 -- 172.21.15.133:0/2411150877 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a38158a60 con 0x7f0a20004d10 2023-12-19T18:59:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.578+0000 7f0a367fc640 1 -- 172.21.15.133:0/2411150877 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2000ba70 con 0x7f0a380bd660 2023-12-19T18:59:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.582+0000 7f0a36ffd640 1 --2- 172.21.15.133:0/2411150877 >> v2:172.21.15.138:3300/0 conn(0x7f0a380c7ed0 0x7f0a38154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:59:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.582+0000 7f0a36ffd640 1 --2- 172.21.15.133:0/2411150877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a20003f00 0x7f0a200047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.582+0000 7f0a377fe640 1 --2- 172.21.15.133:0/2411150877 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a380bd660 0x7f0a20003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.582+0000 7f0a37fff640 1 --2- 172.21.15.133:0/2411150877 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a20004d10 0x7f0a20005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.582+0000 7f0a36ffd640 1 -- 172.21.15.133:0/2411150877 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a380bd660 msgr2=0x7f0a20003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:49.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.582+0000 7f0a36ffd640 1 --2- 172.21.15.133:0/2411150877 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a380bd660 0x7f0a20003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.582+0000 7f0a36ffd640 1 -- 172.21.15.133:0/2411150877 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a20004d10 msgr2=0x7f0a20005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:49.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.582+0000 7f0a36ffd640 1 --2- 172.21.15.133:0/2411150877 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a20004d10 0x7f0a20005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.582+0000 7f0a36ffd640 1 -- 172.21.15.133:0/2411150877 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a20003530 con 0x7f0a20003f00 2023-12-19T18:59:49.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.582+0000 7f0a36ffd640 1 --2- 172.21.15.133:0/2411150877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a20003f00 0x7f0a200047d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c009c90 tx=0x7f0a2c01cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c45405b9c2d3ce server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:49.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.582+0000 7f0a367fc640 1 -- 172.21.15.133:0/2411150877 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c004020 con 0x7f0a20003f00 2023-12-19T18:59:49.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.582+0000 7f0a367fc640 1 -- 172.21.15.133:0/2411150877 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c004180 con 0x7f0a20003f00 2023-12-19T18:59:49.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.582+0000 7f0a367fc640 1 -- 172.21.15.133:0/2411150877 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c0a5710 con 0x7f0a20003f00 2023-12-19T18:59:49.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a3e1d8640 1 -- 172.21.15.133:0/2411150877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a20003f00 msgr2=0x7f0a200047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:49.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a3e1d8640 1 --2- 172.21.15.133:0/2411150877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a20003f00 0x7f0a200047d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c009c90 tx=0x7f0a2c01cc50 comp rx=0 tx=0).stop 2023-12-19T18:59:49.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a37fff640 1 -- 172.21.15.133:0/2411150877 reap_dead start 2023-12-19T18:59:49.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a3e1d8640 1 -- 172.21.15.133:0/2411150877 shutdown_connections 2023-12-19T18:59:49.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a3e1d8640 1 -- 172.21.15.133:0/2411150877 >> 172.21.15.133:0/2411150877 conn(0x7f0a38071eb0 msgr2=0x7f0a380722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:49.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a3e1d8640 1 -- 172.21.15.133:0/2411150877 shutdown_connections 2023-12-19T18:59:49.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a3e1d8640 1 -- 172.21.15.133:0/2411150877 wait complete. 2023-12-19T18:59:49.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a3e1d8640 1 Processor -- start 2023-12-19T18:59:49.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a3e1d8640 1 -- start start 2023-12-19T18:59:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a3e1d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a20003f00 0x7f0a3814f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a3e1d8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a3815c320 0x7f0a3815c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a3e1d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a381ee370 0x7f0a381ee820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:49.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a3e1d8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a381ed2e0 con 0x7f0a3815c320 2023-12-19T18:59:49.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a3e1d8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a381f13d0 con 0x7f0a381ee370 2023-12-19T18:59:49.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a3e1d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a381f0610 con 0x7f0a20003f00 2023-12-19T18:59:49.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a36ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a3815c320 0x7f0a3815c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:49.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a36ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a3815c320 0x7f0a3815c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59900/0 (socket says 172.21.15.133:59900) 2023-12-19T18:59:49.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a36ffd640 1 -- 172.21.15.133:0/4000288335 learned_addr learned my addr 172.21.15.133:0/4000288335 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:49.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a377fe640 1 --2- 172.21.15.133:0/4000288335 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a20003f00 0x7f0a3814f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:49.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a37fff640 1 --2- 172.21.15.133:0/4000288335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a381ee370 0x7f0a381ee820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:49.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a36ffd640 1 -- 172.21.15.133:0/4000288335 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a20003f00 msgr2=0x7f0a3814f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:49.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a36ffd640 1 --2- 172.21.15.133:0/4000288335 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a20003f00 0x7f0a3814f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a36ffd640 1 -- 172.21.15.133:0/4000288335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a381ee370 msgr2=0x7f0a381ee820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:49.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a36ffd640 1 --2- 172.21.15.133:0/4000288335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a381ee370 0x7f0a381ee820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a36ffd640 1 -- 172.21.15.133:0/4000288335 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a381f08f0 con 0x7f0a3815c320 2023-12-19T18:59:49.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.586+0000 7f0a37fff640 1 --2- 172.21.15.133:0/4000288335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a381ee370 0x7f0a381ee820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:49.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.590+0000 7f0a36ffd640 1 --2- 172.21.15.133:0/4000288335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a3815c320 0x7f0a3815c7a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c01ca80 tx=0x7f0a20005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:49.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.590+0000 7f0a1ffff640 1 -- 172.21.15.133:0/4000288335 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c0044f0 con 0x7f0a3815c320 2023-12-19T18:59:49.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.590+0000 7f0a1ffff640 1 -- 172.21.15.133:0/4000288335 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c00f080 con 0x7f0a3815c320 2023-12-19T18:59:49.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.590+0000 7f0a1ffff640 1 -- 172.21.15.133:0/4000288335 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c0a5910 con 0x7f0a3815c320 2023-12-19T18:59:49.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.590+0000 7f0a3e1d8640 1 -- 172.21.15.133:0/4000288335 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a381f0bd0 con 0x7f0a3815c320 2023-12-19T18:59:49.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.590+0000 7f0a3e1d8640 1 -- 172.21.15.133:0/4000288335 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3814f950 con 0x7f0a3815c320 2023-12-19T18:59:49.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.590+0000 7f0a3e1d8640 1 -- 172.21.15.133:0/4000288335 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a38068400 con 0x7f0a3815c320 2023-12-19T18:59:49.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.590+0000 7f0a1ffff640 1 -- 172.21.15.133:0/4000288335 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0a2c0a5a70 con 0x7f0a3815c320 2023-12-19T18:59:49.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.590+0000 7f0a1ffff640 1 --2- 172.21.15.133:0/4000288335 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0a240664a0 0x7f0a24068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:49.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.590+0000 7f0a1ffff640 1 -- 172.21.15.133:0/4000288335 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0a2c11e9a0 con 0x7f0a3815c320 2023-12-19T18:59:49.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.590+0000 7f0a377fe640 1 --2- 172.21.15.133:0/4000288335 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0a240664a0 0x7f0a24068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:49.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.594+0000 7f0a377fe640 1 --2- 172.21.15.133:0/4000288335 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0a240664a0 0x7f0a24068960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0a28001130 tx=0x7f0a28001500 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:49.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.594+0000 7f0a1ffff640 1 -- 172.21.15.133:0/4000288335 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0a2c0ebb50 con 0x7f0a3815c320 2023-12-19T18:59:49.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.742+0000 7f0a3e1d8640 1 -- 172.21.15.133:0/4000288335 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0a3814bed0 con 0x7f0a240664a0 2023-12-19T18:59:49.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.762+0000 7f0a1ffff640 1 -- 172.21.15.133:0/4000288335 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527857 (secure 0 0 0) 0x7f0a3814bed0 con 0x7f0a240664a0 2023-12-19T18:59:49.770 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:49.774 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T18:59:49.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.762+0000 7f0a3e1d8640 1 -- 172.21.15.133:0/4000288335 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0a240664a0 msgr2=0x7f0a24068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:49.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.762+0000 7f0a3e1d8640 1 --2- 172.21.15.133:0/4000288335 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0a240664a0 0x7f0a24068960 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0a28001130 tx=0x7f0a28001500 comp rx=0 tx=0).stop 2023-12-19T18:59:49.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.762+0000 7f0a3e1d8640 1 -- 172.21.15.133:0/4000288335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a3815c320 msgr2=0x7f0a3815c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:49.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.762+0000 7f0a3e1d8640 1 --2- 172.21.15.133:0/4000288335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a3815c320 0x7f0a3815c7a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c01ca80 tx=0x7f0a20005800 comp rx=0 tx=0).stop 2023-12-19T18:59:49.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.762+0000 7f0a3e1d8640 1 -- 172.21.15.133:0/4000288335 shutdown_connections 2023-12-19T18:59:49.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.762+0000 7f0a3e1d8640 1 --2- 172.21.15.133:0/4000288335 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0a240664a0 0x7f0a24068960 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.762+0000 7f0a3e1d8640 1 --2- 172.21.15.133:0/4000288335 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0a381ee370 0x7f0a381ee820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.762+0000 7f0a3e1d8640 1 --2- 172.21.15.133:0/4000288335 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0a3815c320 0x7f0a3815c7a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.762+0000 7f0a3e1d8640 1 --2- 172.21.15.133:0/4000288335 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0a20003f00 0x7f0a3814f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.762+0000 7f0a3e1d8640 1 -- 172.21.15.133:0/4000288335 >> 172.21.15.133:0/4000288335 conn(0x7f0a38071eb0 msgr2=0x7f0a380722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:49.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.762+0000 7f0a3e1d8640 1 -- 172.21.15.133:0/4000288335 shutdown_connections 2023-12-19T18:59:49.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.762+0000 7f0a3e1d8640 1 -- 172.21.15.133:0/4000288335 wait complete. 2023-12-19T18:59:49.790 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-12-19T18:59:48.846684+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":245,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220344,"kb_used_data":4148,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754376,"statfs":{"total":773094113280,"available":772868481024,"internally_reserved":0,"allocated":4247552,"data_stored":2378410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.215992"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.698835+0000","last_change":"2023-12-19T18:59:45.693061+0000","last_active":"2023-12-19T18:59:45.698835+0000","last_peered":"2023-12-19T18:59:45.698835+0000","last_clean":"2023-12-19T18:59:45.698835+0000","last_became_active":"2023-12-19T18:59:45.677441+0000","last_became_peered":"2023-12-19T18:59:45.677441+0000","last_unstale":"2023-12-19T18:59:45.698835+0000","last_undegraded":"2023-12-19T18:59:45.698835+0000","last_fullsized":"2023-12-19T18:59:45.698835+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:26:45.365145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641772+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T18:59:44.641772+0000","last_peered":"2023-12-19T18:59:44.641772+0000","last_clean":"2023-12-19T18:59:44.641772+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T18:59:44.641772+0000","last_undegraded":"2023-12-19T18:59:44.641772+0000","last_fullsized":"2023-12-19T18:59:44.641772+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.664949+0000","last_change":"2023-12-19T18:59:26.886139+0000","last_active":"2023-12-19T18:59:44.664949+0000","last_peered":"2023-12-19T18:59:44.664949+0000","last_clean":"2023-12-19T18:59:44.664949+0000","last_became_active":"2023-12-19T18:59:26.885752+0000","last_became_peered":"2023-12-19T18:59:26.885752+0000","last_unstale":"2023-12-19T18:59:44.664949+0000","last_undegraded":"2023-12-19T18:59:44.664949+0000","last_fullsized":"2023-12-19T18:59:44.664949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:01.602303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641385+0000","last_change":"2023-12-19T18:59:27.638695+0000","last_active":"2023-12-19T18:59:44.641385+0000","last_peered":"2023-12-19T18:59:44.641385+0000","last_clean":"2023-12-19T18:59:44.641385+0000","last_became_active":"2023-12-19T18:59:27.638392+0000","last_became_peered":"2023-12-19T18:59:27.638392+0000","last_unstale":"2023-12-19T18:59:44.641385+0000","last_undegraded":"2023-12-19T18:59:44.641385+0000","last_fullsized":"2023-12-19T18:59:44.641385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:31:54.792697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.697828+0000","last_change":"2023-12-19T18:59:44.664452+0000","last_active":"2023-12-19T18:59:45.697828+0000","last_peered":"2023-12-19T18:59:45.697828+0000","last_clean":"2023-12-19T18:59:45.697828+0000","last_became_active":"2023-12-19T18:59:44.662526+0000","last_became_peered":"2023-12-19T18:59:44.662526+0000","last_unstale":"2023-12-19T18:59:45.697828+0000","last_undegraded":"2023-12-19T18:59:45.697828+0000","last_fullsized":"2023-12-19T18:59:45.697828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:41:10.122870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.687847+0000","last_change":"2023-12-19T18:59:45.675930+0000","last_active":"2023-12-19T18:59:45.687847+0000","last_peered":"2023-12-19T18:59:45.687847+0000","last_clean":"2023-12-19T18:59:45.687847+0000","last_became_active":"2023-12-19T18:59:45.675424+0000","last_became_peered":"2023-12-19T18:59:45.675424+0000","last_unstale":"2023-12-19T18:59:45.687847+0000","last_undegraded":"2023-12-19T18:59:45.687847+0000","last_fullsized":"2023-12-19T18:59:45.687847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:31:15.856213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.653942+0000","last_change":"2023-12-19T18:59:26.874040+0000","last_active":"2023-12-19T18:59:44.653942+0000","last_peered":"2023-12-19T18:59:44.653942+0000","last_clean":"2023-12-19T18:59:44.653942+0000","last_became_active":"2023-12-19T18:59:26.873816+0000","last_became_peered":"2023-12-19T18:59:26.873816+0000","last_unstale":"2023-12-19T18:59:44.653942+0000","last_undegraded":"2023-12-19T18:59:44.653942+0000","last_fullsized":"2023-12-19T18:59:44.653942+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:08.432139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642568+0000","last_change":"2023-12-19T18:59:27.636584+0000","last_active":"2023-12-19T18:59:44.642568+0000","last_peered":"2023-12-19T18:59:44.642568+0000","last_clean":"2023-12-19T18:59:44.642568+0000","last_became_active":"2023-12-19T18:59:27.636367+0000","last_became_peered":"2023-12-19T18:59:27.636367+0000","last_unstale":"2023-12-19T18:59:44.642568+0000","last_undegraded":"2023-12-19T18:59:44.642568+0000","last_fullsized":"2023-12-19T18:59:44.642568+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:18.227682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.664756+0000","last_change":"2023-12-19T18:59:44.650785+0000","last_active":"2023-12-19T18:59:45.664756+0000","last_peered":"2023-12-19T18:59:45.664756+0000","last_clean":"2023-12-19T18:59:45.664756+0000","last_became_active":"2023-12-19T18:59:44.650484+0000","last_became_peered":"2023-12-19T18:59:44.650484+0000","last_unstale":"2023-12-19T18:59:45.664756+0000","last_undegraded":"2023-12-19T18:59:45.664756+0000","last_fullsized":"2023-12-19T18:59:45.664756+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:28:07.538836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.684686+0000","last_change":"2023-12-19T18:59:45.678363+0000","last_active":"2023-12-19T18:59:45.684686+0000","last_peered":"2023-12-19T18:59:45.684686+0000","last_clean":"2023-12-19T18:59:45.684686+0000","last_became_active":"2023-12-19T18:59:45.678051+0000","last_became_peered":"2023-12-19T18:59:45.678051+0000","last_unstale":"2023-12-19T18:59:45.684686+0000","last_undegraded":"2023-12-19T18:59:45.684686+0000","last_fullsized":"2023-12-19T18:59:45.684686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:20:20.611803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641737+0000","last_change":"2023-12-19T18:59:26.875167+0000","last_active":"2023-12-19T18:59:44.641737+0000","last_peered":"2023-12-19T18:59:44.641737+0000","last_clean":"2023-12-19T18:59:44.641737+0000","last_became_active":"2023-12-19T18:59:26.874253+0000","last_became_peered":"2023-12-19T18:59:26.874253+0000","last_unstale":"2023-12-19T18:59:44.641737+0000","last_undegraded":"2023-12-19T18:59:44.641737+0000","last_fullsized":"2023-12-19T18:59:44.641737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:58:48.747485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.653940+0000","last_change":"2023-12-19T18:59:27.640476+0000","last_active":"2023-12-19T18:59:44.653940+0000","last_peered":"2023-12-19T18:59:44.653940+0000","last_clean":"2023-12-19T18:59:44.653940+0000","last_became_active":"2023-12-19T18:59:27.639994+0000","last_became_peered":"2023-12-19T18:59:27.639994+0000","last_unstale":"2023-12-19T18:59:44.653940+0000","last_undegraded":"2023-12-19T18:59:44.653940+0000","last_fullsized":"2023-12-19T18:59:44.653940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:31:54.792697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.656022+0000","last_change":"2023-12-19T18:59:44.664033+0000","last_active":"2023-12-19T18:59:45.656022+0000","last_peered":"2023-12-19T18:59:45.656022+0000","last_clean":"2023-12-19T18:59:45.656022+0000","last_became_active":"2023-12-19T18:59:44.663456+0000","last_became_peered":"2023-12-19T18:59:44.663456+0000","last_unstale":"2023-12-19T18:59:45.656022+0000","last_undegraded":"2023-12-19T18:59:45.656022+0000","last_fullsized":"2023-12-19T18:59:45.656022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:37:38.625301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.680542+0000","last_change":"2023-12-19T18:59:45.674020+0000","last_active":"2023-12-19T18:59:45.680542+0000","last_peered":"2023-12-19T18:59:45.680542+0000","last_clean":"2023-12-19T18:59:45.680542+0000","last_became_active":"2023-12-19T18:59:45.673581+0000","last_became_peered":"2023-12-19T18:59:45.673581+0000","last_unstale":"2023-12-19T18:59:45.680542+0000","last_undegraded":"2023-12-19T18:59:45.680542+0000","last_fullsized":"2023-12-19T18:59:45.680542+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:24:59.950274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.643796+0000","last_change":"2023-12-19T18:59:26.889247+0000","last_active":"2023-12-19T18:59:44.643796+0000","last_peered":"2023-12-19T18:59:44.643796+0000","last_clean":"2023-12-19T18:59:44.643796+0000","last_became_active":"2023-12-19T18:59:26.888058+0000","last_became_peered":"2023-12-19T18:59:26.888058+0000","last_unstale":"2023-12-19T18:59:44.643796+0000","last_undegraded":"2023-12-19T18:59:44.643796+0000","last_fullsized":"2023-12-19T18:59:44.643796+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:05.332552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.635418+0000","last_change":"2023-12-19T18:59:27.647349+0000","last_active":"2023-12-19T18:59:44.635418+0000","last_peered":"2023-12-19T18:59:44.635418+0000","last_clean":"2023-12-19T18:59:44.635418+0000","last_became_active":"2023-12-19T18:59:27.646832+0000","last_became_peered":"2023-12-19T18:59:27.646832+0000","last_unstale":"2023-12-19T18:59:44.635418+0000","last_undegraded":"2023-12-19T18:59:44.635418+0000","last_fullsized":"2023-12-19T18:59:44.635418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:18.227682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.687994+0000","last_change":"2023-12-19T18:59:44.664895+0000","last_active":"2023-12-19T18:59:45.687994+0000","last_peered":"2023-12-19T18:59:45.687994+0000","last_clean":"2023-12-19T18:59:45.687994+0000","last_became_active":"2023-12-19T18:59:44.664626+0000","last_became_peered":"2023-12-19T18:59:44.664626+0000","last_unstale":"2023-12-19T18:59:45.687994+0000","last_undegraded":"2023-12-19T18:59:45.687994+0000","last_fullsized":"2023-12-19T18:59:45.687994+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:16:31.965416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.686612+0000","last_change":"2023-12-19T18:59:45.674252+0000","last_active":"2023-12-19T18:59:45.686612+0000","last_peered":"2023-12-19T18:59:45.686612+0000","last_clean":"2023-12-19T18:59:45.686612+0000","last_became_active":"2023-12-19T18:59:45.673949+0000","last_became_peered":"2023-12-19T18:59:45.673949+0000","last_unstale":"2023-12-19T18:59:45.686612+0000","last_undegraded":"2023-12-19T18:59:45.686612+0000","last_fullsized":"2023-12-19T18:59:45.686612+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:08:41.594895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.636186+0000","last_change":"2023-12-19T18:59:26.879579+0000","last_active":"2023-12-19T18:59:44.636186+0000","last_peered":"2023-12-19T18:59:44.636186+0000","last_clean":"2023-12-19T18:59:44.636186+0000","last_became_active":"2023-12-19T18:59:26.879235+0000","last_became_peered":"2023-12-19T18:59:26.879235+0000","last_unstale":"2023-12-19T18:59:44.636186+0000","last_undegraded":"2023-12-19T18:59:44.636186+0000","last_fullsized":"2023-12-19T18:59:44.636186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:46:34.116596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.664512+0000","last_change":"2023-12-19T18:59:27.646888+0000","last_active":"2023-12-19T18:59:44.664512+0000","last_peered":"2023-12-19T18:59:44.664512+0000","last_clean":"2023-12-19T18:59:44.664512+0000","last_became_active":"2023-12-19T18:59:27.646582+0000","last_became_peered":"2023-12-19T18:59:27.646582+0000","last_unstale":"2023-12-19T18:59:44.664512+0000","last_undegraded":"2023-12-19T18:59:44.664512+0000","last_fullsized":"2023-12-19T18:59:44.664512+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:16:25.929004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.665676+0000","last_change":"2023-12-19T18:59:44.668950+0000","last_active":"2023-12-19T18:59:45.665676+0000","last_peered":"2023-12-19T18:59:45.665676+0000","last_clean":"2023-12-19T18:59:45.665676+0000","last_became_active":"2023-12-19T18:59:44.668731+0000","last_became_peered":"2023-12-19T18:59:44.668731+0000","last_unstale":"2023-12-19T18:59:45.665676+0000","last_undegraded":"2023-12-19T18:59:45.665676+0000","last_fullsized":"2023-12-19T18:59:45.665676+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:45.029456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.688163+0000","last_change":"2023-12-19T18:59:45.680241+0000","last_active":"2023-12-19T18:59:45.688163+0000","last_peered":"2023-12-19T18:59:45.688163+0000","last_clean":"2023-12-19T18:59:45.688163+0000","last_became_active":"2023-12-19T18:59:45.679925+0000","last_became_peered":"2023-12-19T18:59:45.679925+0000","last_unstale":"2023-12-19T18:59:45.688163+0000","last_undegraded":"2023-12-19T18:59:45.688163+0000","last_fullsized":"2023-12-19T18:59:45.688163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:34:27.933445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.648362+0000","last_change":"2023-12-19T18:59:26.889176+0000","last_active":"2023-12-19T18:59:44.648362+0000","last_peered":"2023-12-19T18:59:44.648362+0000","last_clean":"2023-12-19T18:59:44.648362+0000","last_became_active":"2023-12-19T18:59:26.887785+0000","last_became_peered":"2023-12-19T18:59:26.887785+0000","last_unstale":"2023-12-19T18:59:44.648362+0000","last_undegraded":"2023-12-19T18:59:44.648362+0000","last_fullsized":"2023-12-19T18:59:44.648362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:08.227715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.635871+0000","last_change":"2023-12-19T18:59:27.641166+0000","last_active":"2023-12-19T18:59:44.635871+0000","last_peered":"2023-12-19T18:59:44.635871+0000","last_clean":"2023-12-19T18:59:44.635871+0000","last_became_active":"2023-12-19T18:59:27.640863+0000","last_became_peered":"2023-12-19T18:59:27.640863+0000","last_unstale":"2023-12-19T18:59:44.635871+0000","last_undegraded":"2023-12-19T18:59:44.635871+0000","last_fullsized":"2023-12-19T18:59:44.635871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:09.230491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.655464+0000","last_change":"2023-12-19T18:59:44.659736+0000","last_active":"2023-12-19T18:59:45.655464+0000","last_peered":"2023-12-19T18:59:45.655464+0000","last_clean":"2023-12-19T18:59:45.655464+0000","last_became_active":"2023-12-19T18:59:44.659482+0000","last_became_peered":"2023-12-19T18:59:44.659482+0000","last_unstale":"2023-12-19T18:59:45.655464+0000","last_undegraded":"2023-12-19T18:59:45.655464+0000","last_fullsized":"2023-12-19T18:59:45.655464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:30:37.010239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.682250+0000","last_change":"2023-12-19T18:59:45.673840+0000","last_active":"2023-12-19T18:59:45.682250+0000","last_peered":"2023-12-19T18:59:45.682250+0000","last_clean":"2023-12-19T18:59:45.682250+0000","last_became_active":"2023-12-19T18:59:45.673549+0000","last_became_peered":"2023-12-19T18:59:45.673549+0000","last_unstale":"2023-12-19T18:59:45.682250+0000","last_undegraded":"2023-12-19T18:59:45.682250+0000","last_fullsized":"2023-12-19T18:59:45.682250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:56.917422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.636322+0000","last_change":"2023-12-19T18:59:26.887521+0000","last_active":"2023-12-19T18:59:44.636322+0000","last_peered":"2023-12-19T18:59:44.636322+0000","last_clean":"2023-12-19T18:59:44.636322+0000","last_became_active":"2023-12-19T18:59:26.887126+0000","last_became_peered":"2023-12-19T18:59:26.887126+0000","last_unstale":"2023-12-19T18:59:44.636322+0000","last_undegraded":"2023-12-19T18:59:44.636322+0000","last_fullsized":"2023-12-19T18:59:44.636322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:50.105990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.656287+0000","last_change":"2023-12-19T18:59:27.655676+0000","last_active":"2023-12-19T18:59:44.656287+0000","last_peered":"2023-12-19T18:59:44.656287+0000","last_clean":"2023-12-19T18:59:44.656287+0000","last_became_active":"2023-12-19T18:59:27.655392+0000","last_became_peered":"2023-12-19T18:59:27.655392+0000","last_unstale":"2023-12-19T18:59:44.656287+0000","last_undegraded":"2023-12-19T18:59:44.656287+0000","last_fullsized":"2023-12-19T18:59:44.656287+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:43.891549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.664264+0000","last_change":"2023-12-19T18:59:44.667397+0000","last_active":"2023-12-19T18:59:45.664264+0000","last_peered":"2023-12-19T18:59:45.664264+0000","last_clean":"2023-12-19T18:59:45.664264+0000","last_became_active":"2023-12-19T18:59:44.667173+0000","last_became_peered":"2023-12-19T18:59:44.667173+0000","last_unstale":"2023-12-19T18:59:45.664264+0000","last_undegraded":"2023-12-19T18:59:45.664264+0000","last_fullsized":"2023-12-19T18:59:45.664264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:05:54.549117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.694441+0000","last_change":"2023-12-19T18:59:45.688666+0000","last_active":"2023-12-19T18:59:45.694441+0000","last_peered":"2023-12-19T18:59:45.694441+0000","last_clean":"2023-12-19T18:59:45.694441+0000","last_became_active":"2023-12-19T18:59:45.688409+0000","last_became_peered":"2023-12-19T18:59:45.688409+0000","last_unstale":"2023-12-19T18:59:45.694441+0000","last_undegraded":"2023-12-19T18:59:45.694441+0000","last_fullsized":"2023-12-19T18:59:45.694441+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:02:19.801218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.647305+0000","last_change":"2023-12-19T18:59:26.879375+0000","last_active":"2023-12-19T18:59:44.647305+0000","last_peered":"2023-12-19T18:59:44.647305+0000","last_clean":"2023-12-19T18:59:44.647305+0000","last_became_active":"2023-12-19T18:59:26.879043+0000","last_became_peered":"2023-12-19T18:59:26.879043+0000","last_unstale":"2023-12-19T18:59:44.647305+0000","last_undegraded":"2023-12-19T18:59:44.647305+0000","last_fullsized":"2023-12-19T18:59:44.647305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:09.669999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.652428+0000","last_change":"2023-12-19T18:59:27.651053+0000","last_active":"2023-12-19T18:59:44.652428+0000","last_peered":"2023-12-19T18:59:44.652428+0000","last_clean":"2023-12-19T18:59:44.652428+0000","last_became_active":"2023-12-19T18:59:27.650721+0000","last_became_peered":"2023-12-19T18:59:27.650721+0000","last_unstale":"2023-12-19T18:59:44.652428+0000","last_undegraded":"2023-12-19T18:59:44.652428+0000","last_fullsized":"2023-12-19T18:59:44.652428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:36:10.546639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.658605+0000","last_change":"2023-12-19T18:59:44.661262+0000","last_active":"2023-12-19T18:59:45.658605+0000","last_peered":"2023-12-19T18:59:45.658605+0000","last_clean":"2023-12-19T18:59:45.658605+0000","last_became_active":"2023-12-19T18:59:44.660958+0000","last_became_peered":"2023-12-19T18:59:44.660958+0000","last_unstale":"2023-12-19T18:59:45.658605+0000","last_undegraded":"2023-12-19T18:59:45.658605+0000","last_fullsized":"2023-12-19T18:59:45.658605+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:31:14.850235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.682575+0000","last_change":"2023-12-19T18:59:45.671940+0000","last_active":"2023-12-19T18:59:45.682575+0000","last_peered":"2023-12-19T18:59:45.682575+0000","last_clean":"2023-12-19T18:59:45.682575+0000","last_became_active":"2023-12-19T18:59:45.671592+0000","last_became_peered":"2023-12-19T18:59:45.671592+0000","last_unstale":"2023-12-19T18:59:45.682575+0000","last_undegraded":"2023-12-19T18:59:45.682575+0000","last_fullsized":"2023-12-19T18:59:45.682575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:02:19.801218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.650061+0000","last_change":"2023-12-19T18:59:26.881655+0000","last_active":"2023-12-19T18:59:44.650061+0000","last_peered":"2023-12-19T18:59:44.650061+0000","last_clean":"2023-12-19T18:59:44.650061+0000","last_became_active":"2023-12-19T18:59:26.881378+0000","last_became_peered":"2023-12-19T18:59:26.881378+0000","last_unstale":"2023-12-19T18:59:44.650061+0000","last_undegraded":"2023-12-19T18:59:44.650061+0000","last_fullsized":"2023-12-19T18:59:44.650061+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:17.224906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641860+0000","last_change":"2023-12-19T18:59:27.644532+0000","last_active":"2023-12-19T18:59:44.641860+0000","last_peered":"2023-12-19T18:59:44.641860+0000","last_clean":"2023-12-19T18:59:44.641860+0000","last_became_active":"2023-12-19T18:59:27.642863+0000","last_became_peered":"2023-12-19T18:59:27.642863+0000","last_unstale":"2023-12-19T18:59:44.641860+0000","last_undegraded":"2023-12-19T18:59:44.641860+0000","last_fullsized":"2023-12-19T18:59:44.641860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:45.789974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.655160+0000","last_change":"2023-12-19T18:59:44.661534+0000","last_active":"2023-12-19T18:59:45.655160+0000","last_peered":"2023-12-19T18:59:45.655160+0000","last_clean":"2023-12-19T18:59:45.655160+0000","last_became_active":"2023-12-19T18:59:44.661259+0000","last_became_peered":"2023-12-19T18:59:44.661259+0000","last_unstale":"2023-12-19T18:59:45.655160+0000","last_undegraded":"2023-12-19T18:59:45.655160+0000","last_fullsized":"2023-12-19T18:59:45.655160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:26:59.141157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.677896+0000","last_change":"2023-12-19T18:59:45.672850+0000","last_active":"2023-12-19T18:59:45.677896+0000","last_peered":"2023-12-19T18:59:45.677896+0000","last_clean":"2023-12-19T18:59:45.677896+0000","last_became_active":"2023-12-19T18:59:45.670690+0000","last_became_peered":"2023-12-19T18:59:45.670690+0000","last_unstale":"2023-12-19T18:59:45.677896+0000","last_undegraded":"2023-12-19T18:59:45.677896+0000","last_fullsized":"2023-12-19T18:59:45.677896+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:06.872855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641646+0000","last_change":"2023-12-19T18:59:26.884674+0000","last_active":"2023-12-19T18:59:44.641646+0000","last_peered":"2023-12-19T18:59:44.641646+0000","last_clean":"2023-12-19T18:59:44.641646+0000","last_became_active":"2023-12-19T18:59:26.884402+0000","last_became_peered":"2023-12-19T18:59:26.884402+0000","last_unstale":"2023-12-19T18:59:44.641646+0000","last_undegraded":"2023-12-19T18:59:44.641646+0000","last_fullsized":"2023-12-19T18:59:44.641646+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:36:45.699332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.654480+0000","last_change":"2023-12-19T18:59:27.637111+0000","last_active":"2023-12-19T18:59:44.654480+0000","last_peered":"2023-12-19T18:59:44.654480+0000","last_clean":"2023-12-19T18:59:44.654480+0000","last_became_active":"2023-12-19T18:59:27.636672+0000","last_became_peered":"2023-12-19T18:59:27.636672+0000","last_unstale":"2023-12-19T18:59:44.654480+0000","last_undegraded":"2023-12-19T18:59:44.654480+0000","last_fullsized":"2023-12-19T18:59:44.654480+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:39:12.866107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.698324+0000","last_change":"2023-12-19T18:59:44.657059+0000","last_active":"2023-12-19T18:59:45.698324+0000","last_peered":"2023-12-19T18:59:45.698324+0000","last_clean":"2023-12-19T18:59:45.698324+0000","last_became_active":"2023-12-19T18:59:44.656547+0000","last_became_peered":"2023-12-19T18:59:44.656547+0000","last_unstale":"2023-12-19T18:59:45.698324+0000","last_undegraded":"2023-12-19T18:59:45.698324+0000","last_fullsized":"2023-12-19T18:59:45.698324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:18.589414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.695582+0000","last_change":"2023-12-19T18:59:45.688771+0000","last_active":"2023-12-19T18:59:45.695582+0000","last_peered":"2023-12-19T18:59:45.695582+0000","last_clean":"2023-12-19T18:59:45.695582+0000","last_became_active":"2023-12-19T18:59:45.688471+0000","last_became_peered":"2023-12-19T18:59:45.688471+0000","last_unstale":"2023-12-19T18:59:45.695582+0000","last_undegraded":"2023-12-19T18:59:45.695582+0000","last_fullsized":"2023-12-19T18:59:45.695582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:12.570837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.664558+0000","last_change":"2023-12-19T18:59:26.885971+0000","last_active":"2023-12-19T18:59:44.664558+0000","last_peered":"2023-12-19T18:59:44.664558+0000","last_clean":"2023-12-19T18:59:44.664558+0000","last_became_active":"2023-12-19T18:59:26.885633+0000","last_became_peered":"2023-12-19T18:59:26.885633+0000","last_unstale":"2023-12-19T18:59:44.664558+0000","last_undegraded":"2023-12-19T18:59:44.664558+0000","last_fullsized":"2023-12-19T18:59:44.664558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:22:59.820667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.652770+0000","last_change":"2023-12-19T18:59:27.637097+0000","last_active":"2023-12-19T18:59:44.652770+0000","last_peered":"2023-12-19T18:59:44.652770+0000","last_clean":"2023-12-19T18:59:44.652770+0000","last_became_active":"2023-12-19T18:59:27.636689+0000","last_became_peered":"2023-12-19T18:59:27.636689+0000","last_unstale":"2023-12-19T18:59:44.652770+0000","last_undegraded":"2023-12-19T18:59:44.652770+0000","last_fullsized":"2023-12-19T18:59:44.652770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:13:32.952346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.655655+0000","last_change":"2023-12-19T18:59:44.656780+0000","last_active":"2023-12-19T18:59:45.655655+0000","last_peered":"2023-12-19T18:59:45.655655+0000","last_clean":"2023-12-19T18:59:45.655655+0000","last_became_active":"2023-12-19T18:59:44.656477+0000","last_became_peered":"2023-12-19T18:59:44.656477+0000","last_unstale":"2023-12-19T18:59:45.655655+0000","last_undegraded":"2023-12-19T18:59:45.655655+0000","last_fullsized":"2023-12-19T18:59:45.655655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:16:31.965416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.681781+0000","last_change":"2023-12-19T18:59:45.674624+0000","last_active":"2023-12-19T18:59:45.681781+0000","last_peered":"2023-12-19T18:59:45.681781+0000","last_clean":"2023-12-19T18:59:45.681781+0000","last_became_active":"2023-12-19T18:59:45.671022+0000","last_became_peered":"2023-12-19T18:59:45.671022+0000","last_unstale":"2023-12-19T18:59:45.681781+0000","last_undegraded":"2023-12-19T18:59:45.681781+0000","last_fullsized":"2023-12-19T18:59:45.681781+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:54:08.886906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.635504+0000","last_change":"2023-12-19T18:59:26.887588+0000","last_active":"2023-12-19T18:59:44.635504+0000","last_peered":"2023-12-19T18:59:44.635504+0000","last_clean":"2023-12-19T18:59:44.635504+0000","last_became_active":"2023-12-19T18:59:26.887245+0000","last_became_peered":"2023-12-19T18:59:26.887245+0000","last_unstale":"2023-12-19T18:59:44.635504+0000","last_undegraded":"2023-12-19T18:59:44.635504+0000","last_fullsized":"2023-12-19T18:59:44.635504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:36:45.699332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.652124+0000","last_change":"2023-12-19T18:59:27.645569+0000","last_active":"2023-12-19T18:59:44.652124+0000","last_peered":"2023-12-19T18:59:44.652124+0000","last_clean":"2023-12-19T18:59:44.652124+0000","last_became_active":"2023-12-19T18:59:27.645356+0000","last_became_peered":"2023-12-19T18:59:27.645356+0000","last_unstale":"2023-12-19T18:59:44.652124+0000","last_undegraded":"2023-12-19T18:59:44.652124+0000","last_fullsized":"2023-12-19T18:59:44.652124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:17:15.950035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.676804+0000","last_change":"2023-12-19T18:59:44.653726+0000","last_active":"2023-12-19T18:59:45.676804+0000","last_peered":"2023-12-19T18:59:45.676804+0000","last_clean":"2023-12-19T18:59:45.676804+0000","last_became_active":"2023-12-19T18:59:44.653428+0000","last_became_peered":"2023-12-19T18:59:44.653428+0000","last_unstale":"2023-12-19T18:59:45.676804+0000","last_undegraded":"2023-12-19T18:59:45.676804+0000","last_fullsized":"2023-12-19T18:59:45.676804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:26:59.141157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.695733+0000","last_change":"2023-12-19T18:59:45.676334+0000","last_active":"2023-12-19T18:59:45.695733+0000","last_peered":"2023-12-19T18:59:45.695733+0000","last_clean":"2023-12-19T18:59:45.695733+0000","last_became_active":"2023-12-19T18:59:45.674586+0000","last_became_peered":"2023-12-19T18:59:45.674586+0000","last_unstale":"2023-12-19T18:59:45.695733+0000","last_undegraded":"2023-12-19T18:59:45.695733+0000","last_fullsized":"2023-12-19T18:59:45.695733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:28:08.544813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642107+0000","last_change":"2023-12-19T18:59:26.883881+0000","last_active":"2023-12-19T18:59:44.642107+0000","last_peered":"2023-12-19T18:59:44.642107+0000","last_clean":"2023-12-19T18:59:44.642107+0000","last_became_active":"2023-12-19T18:59:26.883612+0000","last_became_peered":"2023-12-19T18:59:26.883612+0000","last_unstale":"2023-12-19T18:59:44.642107+0000","last_undegraded":"2023-12-19T18:59:44.642107+0000","last_fullsized":"2023-12-19T18:59:44.642107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:13:18.250528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.652253+0000","last_change":"2023-12-19T18:59:27.641900+0000","last_active":"2023-12-19T18:59:44.652253+0000","last_peered":"2023-12-19T18:59:44.652253+0000","last_clean":"2023-12-19T18:59:44.652253+0000","last_became_active":"2023-12-19T18:59:27.641620+0000","last_became_peered":"2023-12-19T18:59:27.641620+0000","last_unstale":"2023-12-19T18:59:44.652253+0000","last_undegraded":"2023-12-19T18:59:44.652253+0000","last_fullsized":"2023-12-19T18:59:44.652253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:15.145079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.702608+0000","last_change":"2023-12-19T18:59:44.657822+0000","last_active":"2023-12-19T18:59:45.702608+0000","last_peered":"2023-12-19T18:59:45.702608+0000","last_clean":"2023-12-19T18:59:45.702608+0000","last_became_active":"2023-12-19T18:59:44.657410+0000","last_became_peered":"2023-12-19T18:59:44.657410+0000","last_unstale":"2023-12-19T18:59:45.702608+0000","last_undegraded":"2023-12-19T18:59:45.702608+0000","last_fullsized":"2023-12-19T18:59:45.702608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:26:59.141157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.681750+0000","last_change":"2023-12-19T18:59:45.672642+0000","last_active":"2023-12-19T18:59:45.681750+0000","last_peered":"2023-12-19T18:59:45.681750+0000","last_clean":"2023-12-19T18:59:45.681750+0000","last_became_active":"2023-12-19T18:59:45.672369+0000","last_became_peered":"2023-12-19T18:59:45.672369+0000","last_unstale":"2023-12-19T18:59:45.681750+0000","last_undegraded":"2023-12-19T18:59:45.681750+0000","last_fullsized":"2023-12-19T18:59:45.681750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:06:12.867380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642813+0000","last_change":"2023-12-19T18:59:26.882228+0000","last_active":"2023-12-19T18:59:44.642813+0000","last_peered":"2023-12-19T18:59:44.642813+0000","last_clean":"2023-12-19T18:59:44.642813+0000","last_became_active":"2023-12-19T18:59:26.881940+0000","last_became_peered":"2023-12-19T18:59:26.881940+0000","last_unstale":"2023-12-19T18:59:44.642813+0000","last_undegraded":"2023-12-19T18:59:44.642813+0000","last_fullsized":"2023-12-19T18:59:44.642813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:16:24.926229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.648144+0000","last_change":"2023-12-19T18:59:27.646416+0000","last_active":"2023-12-19T18:59:44.648144+0000","last_peered":"2023-12-19T18:59:44.648144+0000","last_clean":"2023-12-19T18:59:44.648144+0000","last_became_active":"2023-12-19T18:59:27.645875+0000","last_became_peered":"2023-12-19T18:59:27.645875+0000","last_unstale":"2023-12-19T18:59:44.648144+0000","last_undegraded":"2023-12-19T18:59:44.648144+0000","last_fullsized":"2023-12-19T18:59:44.648144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:48:53.738532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.696424+0000","last_change":"2023-12-19T18:59:44.660328+0000","last_active":"2023-12-19T18:59:45.696424+0000","last_peered":"2023-12-19T18:59:45.696424+0000","last_clean":"2023-12-19T18:59:45.696424+0000","last_became_active":"2023-12-19T18:59:44.660065+0000","last_became_peered":"2023-12-19T18:59:44.660065+0000","last_unstale":"2023-12-19T18:59:45.696424+0000","last_undegraded":"2023-12-19T18:59:45.696424+0000","last_fullsized":"2023-12-19T18:59:45.696424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:46:24.985643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.688084+0000","last_change":"2023-12-19T18:59:45.680910+0000","last_active":"2023-12-19T18:59:45.688084+0000","last_peered":"2023-12-19T18:59:45.688084+0000","last_clean":"2023-12-19T18:59:45.688084+0000","last_became_active":"2023-12-19T18:59:45.679457+0000","last_became_peered":"2023-12-19T18:59:45.679457+0000","last_unstale":"2023-12-19T18:59:45.688084+0000","last_undegraded":"2023-12-19T18:59:45.688084+0000","last_fullsized":"2023-12-19T18:59:45.688084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:12.570837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.643027+0000","last_change":"2023-12-19T18:59:26.877734+0000","last_active":"2023-12-19T18:59:44.643027+0000","last_peered":"2023-12-19T18:59:44.643027+0000","last_clean":"2023-12-19T18:59:44.643027+0000","last_became_active":"2023-12-19T18:59:26.876141+0000","last_became_peered":"2023-12-19T18:59:26.876141+0000","last_unstale":"2023-12-19T18:59:44.643027+0000","last_undegraded":"2023-12-19T18:59:44.643027+0000","last_fullsized":"2023-12-19T18:59:44.643027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:50.105990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.656189+0000","last_change":"2023-12-19T18:59:27.655732+0000","last_active":"2023-12-19T18:59:44.656189+0000","last_peered":"2023-12-19T18:59:44.656189+0000","last_clean":"2023-12-19T18:59:44.656189+0000","last_became_active":"2023-12-19T18:59:27.655473+0000","last_became_peered":"2023-12-19T18:59:27.655473+0000","last_unstale":"2023-12-19T18:59:44.656189+0000","last_undegraded":"2023-12-19T18:59:44.656189+0000","last_fullsized":"2023-12-19T18:59:44.656189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:24:42.172134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.655788+0000","last_change":"2023-12-19T18:59:44.668703+0000","last_active":"2023-12-19T18:59:45.655788+0000","last_peered":"2023-12-19T18:59:45.655788+0000","last_clean":"2023-12-19T18:59:45.655788+0000","last_became_active":"2023-12-19T18:59:44.668422+0000","last_became_peered":"2023-12-19T18:59:44.668422+0000","last_unstale":"2023-12-19T18:59:45.655788+0000","last_undegraded":"2023-12-19T18:59:45.655788+0000","last_fullsized":"2023-12-19T18:59:45.655788+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:48.255835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.685652+0000","last_change":"2023-12-19T18:59:45.673349+0000","last_active":"2023-12-19T18:59:45.685652+0000","last_peered":"2023-12-19T18:59:45.685652+0000","last_clean":"2023-12-19T18:59:45.685652+0000","last_became_active":"2023-12-19T18:59:45.672865+0000","last_became_peered":"2023-12-19T18:59:45.672865+0000","last_unstale":"2023-12-19T18:59:45.685652+0000","last_undegraded":"2023-12-19T18:59:45.685652+0000","last_fullsized":"2023-12-19T18:59:45.685652+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:57.738035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.647253+0000","last_change":"2023-12-19T18:59:26.891254+0000","last_active":"2023-12-19T18:59:44.647253+0000","last_peered":"2023-12-19T18:59:44.647253+0000","last_clean":"2023-12-19T18:59:44.647253+0000","last_became_active":"2023-12-19T18:59:26.890803+0000","last_became_peered":"2023-12-19T18:59:26.890803+0000","last_unstale":"2023-12-19T18:59:44.647253+0000","last_undegraded":"2023-12-19T18:59:44.647253+0000","last_fullsized":"2023-12-19T18:59:44.647253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:46:07.210705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.643026+0000","last_change":"2023-12-19T18:59:27.638748+0000","last_active":"2023-12-19T18:59:44.643026+0000","last_peered":"2023-12-19T18:59:44.643026+0000","last_clean":"2023-12-19T18:59:44.643026+0000","last_became_active":"2023-12-19T18:59:27.637898+0000","last_became_peered":"2023-12-19T18:59:27.637898+0000","last_unstale":"2023-12-19T18:59:44.643026+0000","last_undegraded":"2023-12-19T18:59:44.643026+0000","last_fullsized":"2023-12-19T18:59:44.643026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:09.230491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.692617+0000","last_change":"2023-12-19T18:59:44.661839+0000","last_active":"2023-12-19T18:59:45.692617+0000","last_peered":"2023-12-19T18:59:45.692617+0000","last_clean":"2023-12-19T18:59:45.692617+0000","last_became_active":"2023-12-19T18:59:44.661597+0000","last_became_peered":"2023-12-19T18:59:44.661597+0000","last_unstale":"2023-12-19T18:59:45.692617+0000","last_undegraded":"2023-12-19T18:59:45.692617+0000","last_fullsized":"2023-12-19T18:59:45.692617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:49:22.446873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.698549+0000","last_change":"2023-12-19T18:59:45.693327+0000","last_active":"2023-12-19T18:59:45.698549+0000","last_peered":"2023-12-19T18:59:45.698549+0000","last_clean":"2023-12-19T18:59:45.698549+0000","last_became_active":"2023-12-19T18:59:45.677229+0000","last_became_peered":"2023-12-19T18:59:45.677229+0000","last_unstale":"2023-12-19T18:59:45.698549+0000","last_undegraded":"2023-12-19T18:59:45.698549+0000","last_fullsized":"2023-12-19T18:59:45.698549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:57.351859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.654065+0000","last_change":"2023-12-19T18:59:26.885293+0000","last_active":"2023-12-19T18:59:44.654065+0000","last_peered":"2023-12-19T18:59:44.654065+0000","last_clean":"2023-12-19T18:59:44.654065+0000","last_became_active":"2023-12-19T18:59:26.885020+0000","last_became_peered":"2023-12-19T18:59:26.885020+0000","last_unstale":"2023-12-19T18:59:44.654065+0000","last_undegraded":"2023-12-19T18:59:44.654065+0000","last_fullsized":"2023-12-19T18:59:44.654065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:42.040589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.664347+0000","last_change":"2023-12-19T18:59:27.651314+0000","last_active":"2023-12-19T18:59:44.664347+0000","last_peered":"2023-12-19T18:59:44.664347+0000","last_clean":"2023-12-19T18:59:44.664347+0000","last_became_active":"2023-12-19T18:59:27.650926+0000","last_became_peered":"2023-12-19T18:59:27.650926+0000","last_unstale":"2023-12-19T18:59:44.664347+0000","last_undegraded":"2023-12-19T18:59:44.664347+0000","last_fullsized":"2023-12-19T18:59:44.664347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:18.227682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.656127+0000","last_change":"2023-12-19T18:59:44.654834+0000","last_active":"2023-12-19T18:59:45.656127+0000","last_peered":"2023-12-19T18:59:45.656127+0000","last_clean":"2023-12-19T18:59:45.656127+0000","last_became_active":"2023-12-19T18:59:44.654536+0000","last_became_peered":"2023-12-19T18:59:44.654536+0000","last_unstale":"2023-12-19T18:59:45.656127+0000","last_undegraded":"2023-12-19T18:59:45.656127+0000","last_fullsized":"2023-12-19T18:59:45.656127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:29.424024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.691731+0000","last_change":"2023-12-19T18:59:45.682531+0000","last_active":"2023-12-19T18:59:45.691731+0000","last_peered":"2023-12-19T18:59:45.691731+0000","last_clean":"2023-12-19T18:59:45.691731+0000","last_became_active":"2023-12-19T18:59:45.682161+0000","last_became_peered":"2023-12-19T18:59:45.682161+0000","last_unstale":"2023-12-19T18:59:45.691731+0000","last_undegraded":"2023-12-19T18:59:45.691731+0000","last_fullsized":"2023-12-19T18:59:45.691731+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:57.351859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.654075+0000","last_change":"2023-12-19T18:59:26.874018+0000","last_active":"2023-12-19T18:59:44.654075+0000","last_peered":"2023-12-19T18:59:44.654075+0000","last_clean":"2023-12-19T18:59:44.654075+0000","last_became_active":"2023-12-19T18:59:26.873769+0000","last_became_peered":"2023-12-19T18:59:26.873769+0000","last_unstale":"2023-12-19T18:59:44.654075+0000","last_undegraded":"2023-12-19T18:59:44.654075+0000","last_fullsized":"2023-12-19T18:59:44.654075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:44.787198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641210+0000","last_change":"2023-12-19T18:59:27.644252+0000","last_active":"2023-12-19T18:59:44.641210+0000","last_peered":"2023-12-19T18:59:44.641210+0000","last_clean":"2023-12-19T18:59:44.641210+0000","last_became_active":"2023-12-19T18:59:27.643954+0000","last_became_peered":"2023-12-19T18:59:27.643954+0000","last_unstale":"2023-12-19T18:59:44.641210+0000","last_undegraded":"2023-12-19T18:59:44.641210+0000","last_fullsized":"2023-12-19T18:59:44.641210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:48:53.738532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.700908+0000","last_change":"2023-12-19T18:59:44.665203+0000","last_active":"2023-12-19T18:59:45.700908+0000","last_peered":"2023-12-19T18:59:45.700908+0000","last_clean":"2023-12-19T18:59:45.700908+0000","last_became_active":"2023-12-19T18:59:44.664739+0000","last_became_peered":"2023-12-19T18:59:44.664739+0000","last_unstale":"2023-12-19T18:59:45.700908+0000","last_undegraded":"2023-12-19T18:59:45.700908+0000","last_fullsized":"2023-12-19T18:59:45.700908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:22:01.070678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.692737+0000","last_change":"2023-12-19T18:59:45.681440+0000","last_active":"2023-12-19T18:59:45.692737+0000","last_peered":"2023-12-19T18:59:45.692737+0000","last_clean":"2023-12-19T18:59:45.692737+0000","last_became_active":"2023-12-19T18:59:45.680899+0000","last_became_peered":"2023-12-19T18:59:45.680899+0000","last_unstale":"2023-12-19T18:59:45.692737+0000","last_undegraded":"2023-12-19T18:59:45.692737+0000","last_fullsized":"2023-12-19T18:59:45.692737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:34:39.645053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.643713+0000","last_change":"2023-12-19T18:59:26.885753+0000","last_active":"2023-12-19T18:59:44.643713+0000","last_peered":"2023-12-19T18:59:44.643713+0000","last_clean":"2023-12-19T18:59:44.643713+0000","last_became_active":"2023-12-19T18:59:26.885304+0000","last_became_peered":"2023-12-19T18:59:26.885304+0000","last_unstale":"2023-12-19T18:59:44.643713+0000","last_undegraded":"2023-12-19T18:59:44.643713+0000","last_fullsized":"2023-12-19T18:59:44.643713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:17.224906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.656347+0000","last_change":"2023-12-19T18:59:27.639693+0000","last_active":"2023-12-19T18:59:44.656347+0000","last_peered":"2023-12-19T18:59:44.656347+0000","last_clean":"2023-12-19T18:59:44.656347+0000","last_became_active":"2023-12-19T18:59:27.639369+0000","last_became_peered":"2023-12-19T18:59:27.639369+0000","last_unstale":"2023-12-19T18:59:44.656347+0000","last_undegraded":"2023-12-19T18:59:44.656347+0000","last_fullsized":"2023-12-19T18:59:44.656347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:43.891549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.708042+0000","last_change":"2023-12-19T18:59:44.666436+0000","last_active":"2023-12-19T18:59:45.708042+0000","last_peered":"2023-12-19T18:59:45.708042+0000","last_clean":"2023-12-19T18:59:45.708042+0000","last_became_active":"2023-12-19T18:59:44.666187+0000","last_became_peered":"2023-12-19T18:59:44.666187+0000","last_unstale":"2023-12-19T18:59:45.708042+0000","last_undegraded":"2023-12-19T18:59:45.708042+0000","last_fullsized":"2023-12-19T18:59:45.708042+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:08:40.588917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.684100+0000","last_change":"2023-12-19T18:59:45.675836+0000","last_active":"2023-12-19T18:59:45.684100+0000","last_peered":"2023-12-19T18:59:45.684100+0000","last_clean":"2023-12-19T18:59:45.684100+0000","last_became_active":"2023-12-19T18:59:45.673358+0000","last_became_peered":"2023-12-19T18:59:45.673358+0000","last_unstale":"2023-12-19T18:59:45.684100+0000","last_undegraded":"2023-12-19T18:59:45.684100+0000","last_fullsized":"2023-12-19T18:59:45.684100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:56.917422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642481+0000","last_change":"2023-12-19T18:59:26.878624+0000","last_active":"2023-12-19T18:59:44.642481+0000","last_peered":"2023-12-19T18:59:44.642481+0000","last_clean":"2023-12-19T18:59:44.642481+0000","last_became_active":"2023-12-19T18:59:26.878292+0000","last_became_peered":"2023-12-19T18:59:26.878292+0000","last_unstale":"2023-12-19T18:59:44.642481+0000","last_undegraded":"2023-12-19T18:59:44.642481+0000","last_fullsized":"2023-12-19T18:59:44.642481+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:22:59.820667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.643626+0000","last_change":"2023-12-19T18:59:27.651050+0000","last_active":"2023-12-19T18:59:44.643626+0000","last_peered":"2023-12-19T18:59:44.643626+0000","last_clean":"2023-12-19T18:59:44.643626+0000","last_became_active":"2023-12-19T18:59:27.650758+0000","last_became_peered":"2023-12-19T18:59:27.650758+0000","last_unstale":"2023-12-19T18:59:44.643626+0000","last_undegraded":"2023-12-19T18:59:44.643626+0000","last_fullsized":"2023-12-19T18:59:44.643626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:30:07.550029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.656527+0000","last_change":"2023-12-19T18:59:44.662108+0000","last_active":"2023-12-19T18:59:45.656527+0000","last_peered":"2023-12-19T18:59:45.656527+0000","last_clean":"2023-12-19T18:59:45.656527+0000","last_became_active":"2023-12-19T18:59:44.660356+0000","last_became_peered":"2023-12-19T18:59:44.660356+0000","last_unstale":"2023-12-19T18:59:45.656527+0000","last_undegraded":"2023-12-19T18:59:45.656527+0000","last_fullsized":"2023-12-19T18:59:45.656527+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:55:06.032043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.673796+0000","last_change":"2023-12-19T18:59:45.668869+0000","last_active":"2023-12-19T18:59:45.673796+0000","last_peered":"2023-12-19T18:59:45.673796+0000","last_clean":"2023-12-19T18:59:45.673796+0000","last_became_active":"2023-12-19T18:59:45.668457+0000","last_became_peered":"2023-12-19T18:59:45.668457+0000","last_unstale":"2023-12-19T18:59:45.673796+0000","last_undegraded":"2023-12-19T18:59:45.673796+0000","last_fullsized":"2023-12-19T18:59:45.673796+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:49:23.452851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"31'8","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658489+0000","last_change":"2023-12-19T18:59:26.884311+0000","last_active":"2023-12-19T18:59:44.658489+0000","last_peered":"2023-12-19T18:59:44.658489+0000","last_clean":"2023-12-19T18:59:44.658489+0000","last_became_active":"2023-12-19T18:59:26.883965+0000","last_became_peered":"2023-12-19T18:59:26.883965+0000","last_unstale":"2023-12-19T18:59:44.658489+0000","last_undegraded":"2023-12-19T18:59:44.658489+0000","last_fullsized":"2023-12-19T18:59:44.658489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:51:58.960159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658468+0000","last_change":"2023-12-19T18:59:27.655885+0000","last_active":"2023-12-19T18:59:44.658468+0000","last_peered":"2023-12-19T18:59:44.658468+0000","last_clean":"2023-12-19T18:59:44.658468+0000","last_became_active":"2023-12-19T18:59:27.650924+0000","last_became_peered":"2023-12-19T18:59:27.650924+0000","last_unstale":"2023-12-19T18:59:44.658468+0000","last_undegraded":"2023-12-19T18:59:44.658468+0000","last_fullsized":"2023-12-19T18:59:44.658468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:33:33.472556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.687763+0000","last_change":"2023-12-19T18:59:44.655159+0000","last_active":"2023-12-19T18:59:45.687763+0000","last_peered":"2023-12-19T18:59:45.687763+0000","last_clean":"2023-12-19T18:59:45.687763+0000","last_became_active":"2023-12-19T18:59:44.654641+0000","last_became_peered":"2023-12-19T18:59:44.654641+0000","last_unstale":"2023-12-19T18:59:45.687763+0000","last_undegraded":"2023-12-19T18:59:45.687763+0000","last_fullsized":"2023-12-19T18:59:45.687763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:06:47.044737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.697939+0000","last_change":"2023-12-19T18:59:45.696063+0000","last_active":"2023-12-19T18:59:45.697939+0000","last_peered":"2023-12-19T18:59:45.697939+0000","last_clean":"2023-12-19T18:59:45.697939+0000","last_became_active":"2023-12-19T18:59:45.695803+0000","last_became_peered":"2023-12-19T18:59:45.695803+0000","last_unstale":"2023-12-19T18:59:45.697939+0000","last_undegraded":"2023-12-19T18:59:45.697939+0000","last_fullsized":"2023-12-19T18:59:45.697939+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:53.633313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658646+0000","last_change":"2023-12-19T18:59:26.880783+0000","last_active":"2023-12-19T18:59:44.658646+0000","last_peered":"2023-12-19T18:59:44.658646+0000","last_clean":"2023-12-19T18:59:44.658646+0000","last_became_active":"2023-12-19T18:59:26.880598+0000","last_became_peered":"2023-12-19T18:59:26.880598+0000","last_unstale":"2023-12-19T18:59:44.658646+0000","last_undegraded":"2023-12-19T18:59:44.658646+0000","last_fullsized":"2023-12-19T18:59:44.658646+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:48:52.735756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658442+0000","last_change":"2023-12-19T18:59:27.643508+0000","last_active":"2023-12-19T18:59:44.658442+0000","last_peered":"2023-12-19T18:59:44.658442+0000","last_clean":"2023-12-19T18:59:44.658442+0000","last_became_active":"2023-12-19T18:59:27.643200+0000","last_became_peered":"2023-12-19T18:59:27.643200+0000","last_unstale":"2023-12-19T18:59:44.658442+0000","last_undegraded":"2023-12-19T18:59:44.658442+0000","last_fullsized":"2023-12-19T18:59:44.658442+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:50.766673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.677290+0000","last_change":"2023-12-19T18:59:44.652015+0000","last_active":"2023-12-19T18:59:45.677290+0000","last_peered":"2023-12-19T18:59:45.677290+0000","last_clean":"2023-12-19T18:59:45.677290+0000","last_became_active":"2023-12-19T18:59:44.651699+0000","last_became_peered":"2023-12-19T18:59:44.651699+0000","last_unstale":"2023-12-19T18:59:45.677290+0000","last_undegraded":"2023-12-19T18:59:45.677290+0000","last_fullsized":"2023-12-19T18:59:45.677290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:06:47.044737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.692733+0000","last_change":"2023-12-19T18:59:45.681360+0000","last_active":"2023-12-19T18:59:45.692733+0000","last_peered":"2023-12-19T18:59:45.692733+0000","last_clean":"2023-12-19T18:59:45.692733+0000","last_became_active":"2023-12-19T18:59:45.681049+0000","last_became_peered":"2023-12-19T18:59:45.681049+0000","last_unstale":"2023-12-19T18:59:45.692733+0000","last_undegraded":"2023-12-19T18:59:45.692733+0000","last_fullsized":"2023-12-19T18:59:45.692733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:41:11.128848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.636278+0000","last_change":"2023-12-19T18:59:26.879898+0000","last_active":"2023-12-19T18:59:44.636278+0000","last_peered":"2023-12-19T18:59:44.636278+0000","last_clean":"2023-12-19T18:59:44.636278+0000","last_became_active":"2023-12-19T18:59:26.879150+0000","last_became_peered":"2023-12-19T18:59:26.879150+0000","last_unstale":"2023-12-19T18:59:44.636278+0000","last_undegraded":"2023-12-19T18:59:44.636278+0000","last_fullsized":"2023-12-19T18:59:44.636278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:22:59.820667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658598+0000","last_change":"2023-12-19T18:59:27.640667+0000","last_active":"2023-12-19T18:59:44.658598+0000","last_peered":"2023-12-19T18:59:44.658598+0000","last_clean":"2023-12-19T18:59:44.658598+0000","last_became_active":"2023-12-19T18:59:27.640256+0000","last_became_peered":"2023-12-19T18:59:27.640256+0000","last_unstale":"2023-12-19T18:59:44.658598+0000","last_undegraded":"2023-12-19T18:59:44.658598+0000","last_fullsized":"2023-12-19T18:59:44.658598+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:28:27.867595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.700454+0000","last_change":"2023-12-19T18:59:44.651409+0000","last_active":"2023-12-19T18:59:45.700454+0000","last_peered":"2023-12-19T18:59:45.700454+0000","last_clean":"2023-12-19T18:59:45.700454+0000","last_became_active":"2023-12-19T18:59:44.651054+0000","last_became_peered":"2023-12-19T18:59:44.651054+0000","last_unstale":"2023-12-19T18:59:45.700454+0000","last_undegraded":"2023-12-19T18:59:45.700454+0000","last_fullsized":"2023-12-19T18:59:45.700454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:26.002653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.689777+0000","last_change":"2023-12-19T18:59:45.678666+0000","last_active":"2023-12-19T18:59:45.689777+0000","last_peered":"2023-12-19T18:59:45.689777+0000","last_clean":"2023-12-19T18:59:45.689777+0000","last_became_active":"2023-12-19T18:59:45.678414+0000","last_became_peered":"2023-12-19T18:59:45.678414+0000","last_unstale":"2023-12-19T18:59:45.689777+0000","last_undegraded":"2023-12-19T18:59:45.689777+0000","last_fullsized":"2023-12-19T18:59:45.689777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:23:48.967944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658591+0000","last_change":"2023-12-19T18:59:26.878383+0000","last_active":"2023-12-19T18:59:44.658591+0000","last_peered":"2023-12-19T18:59:44.658591+0000","last_clean":"2023-12-19T18:59:44.658591+0000","last_became_active":"2023-12-19T18:59:26.877891+0000","last_became_peered":"2023-12-19T18:59:26.877891+0000","last_unstale":"2023-12-19T18:59:44.658591+0000","last_undegraded":"2023-12-19T18:59:44.658591+0000","last_fullsized":"2023-12-19T18:59:44.658591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:34:09.152530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.656500+0000","last_change":"2023-12-19T18:59:27.653287+0000","last_active":"2023-12-19T18:59:44.656500+0000","last_peered":"2023-12-19T18:59:44.656500+0000","last_clean":"2023-12-19T18:59:44.656500+0000","last_became_active":"2023-12-19T18:59:27.651740+0000","last_became_peered":"2023-12-19T18:59:27.651740+0000","last_unstale":"2023-12-19T18:59:44.656500+0000","last_undegraded":"2023-12-19T18:59:44.656500+0000","last_fullsized":"2023-12-19T18:59:44.656500+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:39.573719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"34'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.696874+0000","last_change":"2023-12-19T18:59:44.662722+0000","last_active":"2023-12-19T18:59:45.696874+0000","last_peered":"2023-12-19T18:59:45.696874+0000","last_clean":"2023-12-19T18:59:45.696874+0000","last_became_active":"2023-12-19T18:59:44.662432+0000","last_became_peered":"2023-12-19T18:59:44.662432+0000","last_unstale":"2023-12-19T18:59:45.696874+0000","last_undegraded":"2023-12-19T18:59:45.696874+0000","last_fullsized":"2023-12-19T18:59:45.696874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:30:37.010239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.698569+0000","last_change":"2023-12-19T18:59:45.693839+0000","last_active":"2023-12-19T18:59:45.698569+0000","last_peered":"2023-12-19T18:59:45.698569+0000","last_clean":"2023-12-19T18:59:45.698569+0000","last_became_active":"2023-12-19T18:59:45.693568+0000","last_became_peered":"2023-12-19T18:59:45.693568+0000","last_unstale":"2023-12-19T18:59:45.698569+0000","last_undegraded":"2023-12-19T18:59:45.698569+0000","last_fullsized":"2023-12-19T18:59:45.698569+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:50:01.669689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641299+0000","last_change":"2023-12-19T18:59:26.876597+0000","last_active":"2023-12-19T18:59:44.641299+0000","last_peered":"2023-12-19T18:59:44.641299+0000","last_clean":"2023-12-19T18:59:44.641299+0000","last_became_active":"2023-12-19T18:59:26.876270+0000","last_became_peered":"2023-12-19T18:59:26.876270+0000","last_unstale":"2023-12-19T18:59:44.641299+0000","last_undegraded":"2023-12-19T18:59:44.641299+0000","last_fullsized":"2023-12-19T18:59:44.641299+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:14.142304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.644269+0000","last_change":"2023-12-19T18:59:27.651168+0000","last_active":"2023-12-19T18:59:44.644269+0000","last_peered":"2023-12-19T18:59:44.644269+0000","last_clean":"2023-12-19T18:59:44.644269+0000","last_became_active":"2023-12-19T18:59:27.650866+0000","last_became_peered":"2023-12-19T18:59:27.650866+0000","last_unstale":"2023-12-19T18:59:44.644269+0000","last_undegraded":"2023-12-19T18:59:44.644269+0000","last_fullsized":"2023-12-19T18:59:44.644269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:09.434914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.692409+0000","last_change":"2023-12-19T18:59:44.656063+0000","last_active":"2023-12-19T18:59:45.692409+0000","last_peered":"2023-12-19T18:59:45.692409+0000","last_clean":"2023-12-19T18:59:45.692409+0000","last_became_active":"2023-12-19T18:59:44.655631+0000","last_became_peered":"2023-12-19T18:59:44.655631+0000","last_unstale":"2023-12-19T18:59:45.692409+0000","last_undegraded":"2023-12-19T18:59:45.692409+0000","last_fullsized":"2023-12-19T18:59:45.692409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:02:18.795241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.692484+0000","last_change":"2023-12-19T18:59:45.684725+0000","last_active":"2023-12-19T18:59:45.692484+0000","last_peered":"2023-12-19T18:59:45.692484+0000","last_clean":"2023-12-19T18:59:45.692484+0000","last_became_active":"2023-12-19T18:59:45.684279+0000","last_became_peered":"2023-12-19T18:59:45.684279+0000","last_unstale":"2023-12-19T18:59:45.692484+0000","last_undegraded":"2023-12-19T18:59:45.692484+0000","last_fullsized":"2023-12-19T18:59:45.692484+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:28:45.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.654068+0000","last_change":"2023-12-19T18:59:26.877227+0000","last_active":"2023-12-19T18:59:44.654068+0000","last_peered":"2023-12-19T18:59:44.654068+0000","last_clean":"2023-12-19T18:59:44.654068+0000","last_became_active":"2023-12-19T18:59:26.876903+0000","last_became_peered":"2023-12-19T18:59:26.876903+0000","last_unstale":"2023-12-19T18:59:44.654068+0000","last_undegraded":"2023-12-19T18:59:44.654068+0000","last_fullsized":"2023-12-19T18:59:44.654068+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:46.454857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641216+0000","last_change":"2023-12-19T18:59:27.656486+0000","last_active":"2023-12-19T18:59:44.641216+0000","last_peered":"2023-12-19T18:59:44.641216+0000","last_clean":"2023-12-19T18:59:44.641216+0000","last_became_active":"2023-12-19T18:59:27.656254+0000","last_became_peered":"2023-12-19T18:59:27.656254+0000","last_unstale":"2023-12-19T18:59:44.641216+0000","last_undegraded":"2023-12-19T18:59:44.641216+0000","last_fullsized":"2023-12-19T18:59:44.641216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:55.089240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.698171+0000","last_change":"2023-12-19T18:59:44.657205+0000","last_active":"2023-12-19T18:59:45.698171+0000","last_peered":"2023-12-19T18:59:45.698171+0000","last_clean":"2023-12-19T18:59:45.698171+0000","last_became_active":"2023-12-19T18:59:44.656810+0000","last_became_peered":"2023-12-19T18:59:44.656810+0000","last_unstale":"2023-12-19T18:59:45.698171+0000","last_undegraded":"2023-12-19T18:59:45.698171+0000","last_fullsized":"2023-12-19T18:59:45.698171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:05:20.314341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.691915+0000","last_change":"2023-12-19T18:59:45.683808+0000","last_active":"2023-12-19T18:59:45.691915+0000","last_peered":"2023-12-19T18:59:45.691915+0000","last_clean":"2023-12-19T18:59:45.691915+0000","last_became_active":"2023-12-19T18:59:45.683557+0000","last_became_peered":"2023-12-19T18:59:45.683557+0000","last_unstale":"2023-12-19T18:59:45.691915+0000","last_undegraded":"2023-12-19T18:59:45.691915+0000","last_fullsized":"2023-12-19T18:59:45.691915+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:28:45.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642061+0000","last_change":"2023-12-19T18:59:26.879513+0000","last_active":"2023-12-19T18:59:44.642061+0000","last_peered":"2023-12-19T18:59:44.642061+0000","last_clean":"2023-12-19T18:59:44.642061+0000","last_became_active":"2023-12-19T18:59:26.879190+0000","last_became_peered":"2023-12-19T18:59:26.879190+0000","last_unstale":"2023-12-19T18:59:44.642061+0000","last_undegraded":"2023-12-19T18:59:44.642061+0000","last_fullsized":"2023-12-19T18:59:44.642061+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:46:34.116596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.653545+0000","last_change":"2023-12-19T18:59:27.651327+0000","last_active":"2023-12-19T18:59:44.653545+0000","last_peered":"2023-12-19T18:59:44.653545+0000","last_clean":"2023-12-19T18:59:44.653545+0000","last_became_active":"2023-12-19T18:59:27.650744+0000","last_became_peered":"2023-12-19T18:59:27.650744+0000","last_unstale":"2023-12-19T18:59:44.653545+0000","last_undegraded":"2023-12-19T18:59:44.653545+0000","last_fullsized":"2023-12-19T18:59:44.653545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:34:10.155305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.675143+0000","last_change":"2023-12-19T18:59:44.658001+0000","last_active":"2023-12-19T18:59:45.675143+0000","last_peered":"2023-12-19T18:59:45.675143+0000","last_clean":"2023-12-19T18:59:45.675143+0000","last_became_active":"2023-12-19T18:59:44.657538+0000","last_became_peered":"2023-12-19T18:59:44.657538+0000","last_unstale":"2023-12-19T18:59:45.675143+0000","last_undegraded":"2023-12-19T18:59:45.675143+0000","last_fullsized":"2023-12-19T18:59:45.675143+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:00:18.806679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.694207+0000","last_change":"2023-12-19T18:59:45.687303+0000","last_active":"2023-12-19T18:59:45.694207+0000","last_peered":"2023-12-19T18:59:45.694207+0000","last_clean":"2023-12-19T18:59:45.694207+0000","last_became_active":"2023-12-19T18:59:45.686674+0000","last_became_peered":"2023-12-19T18:59:45.686674+0000","last_unstale":"2023-12-19T18:59:45.694207+0000","last_undegraded":"2023-12-19T18:59:45.694207+0000","last_fullsized":"2023-12-19T18:59:45.694207+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:33:51.250696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642382+0000","last_change":"2023-12-19T18:59:26.877767+0000","last_active":"2023-12-19T18:59:44.642382+0000","last_peered":"2023-12-19T18:59:44.642382+0000","last_clean":"2023-12-19T18:59:44.642382+0000","last_became_active":"2023-12-19T18:59:26.877475+0000","last_became_peered":"2023-12-19T18:59:26.877475+0000","last_unstale":"2023-12-19T18:59:44.642382+0000","last_undegraded":"2023-12-19T18:59:44.642382+0000","last_fullsized":"2023-12-19T18:59:44.642382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:01.602303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641303+0000","last_change":"2023-12-19T18:59:27.644158+0000","last_active":"2023-12-19T18:59:44.641303+0000","last_peered":"2023-12-19T18:59:44.641303+0000","last_clean":"2023-12-19T18:59:44.641303+0000","last_became_active":"2023-12-19T18:59:27.643817+0000","last_became_peered":"2023-12-19T18:59:27.643817+0000","last_unstale":"2023-12-19T18:59:44.641303+0000","last_undegraded":"2023-12-19T18:59:44.641303+0000","last_fullsized":"2023-12-19T18:59:44.641303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:33:33.472556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.656015+0000","last_change":"2023-12-19T18:59:44.656933+0000","last_active":"2023-12-19T18:59:45.656015+0000","last_peered":"2023-12-19T18:59:45.656015+0000","last_clean":"2023-12-19T18:59:45.656015+0000","last_became_active":"2023-12-19T18:59:44.656669+0000","last_became_peered":"2023-12-19T18:59:44.656669+0000","last_unstale":"2023-12-19T18:59:45.656015+0000","last_undegraded":"2023-12-19T18:59:45.656015+0000","last_fullsized":"2023-12-19T18:59:45.656015+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:03:13.327714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.692472+0000","last_change":"2023-12-19T18:59:45.688293+0000","last_active":"2023-12-19T18:59:45.692472+0000","last_peered":"2023-12-19T18:59:45.692472+0000","last_clean":"2023-12-19T18:59:45.692472+0000","last_became_active":"2023-12-19T18:59:45.688001+0000","last_became_peered":"2023-12-19T18:59:45.688001+0000","last_unstale":"2023-12-19T18:59:45.692472+0000","last_undegraded":"2023-12-19T18:59:45.692472+0000","last_fullsized":"2023-12-19T18:59:45.692472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:24:59.950274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.696793+0000","last_change":"2023-12-19T18:59:44.666863+0000","last_active":"2023-12-19T18:59:45.696793+0000","last_peered":"2023-12-19T18:59:45.696793+0000","last_clean":"2023-12-19T18:59:45.696793+0000","last_became_active":"2023-12-19T18:59:44.666500+0000","last_became_peered":"2023-12-19T18:59:44.666500+0000","last_unstale":"2023-12-19T18:59:45.696793+0000","last_undegraded":"2023-12-19T18:59:45.696793+0000","last_fullsized":"2023-12-19T18:59:45.696793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:08:40.588917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.654683+0000","last_change":"2023-12-19T18:59:26.886614+0000","last_active":"2023-12-19T18:59:44.654683+0000","last_peered":"2023-12-19T18:59:44.654683+0000","last_clean":"2023-12-19T18:59:44.654683+0000","last_became_active":"2023-12-19T18:59:26.885790+0000","last_became_peered":"2023-12-19T18:59:26.885790+0000","last_unstale":"2023-12-19T18:59:44.654683+0000","last_undegraded":"2023-12-19T18:59:44.654683+0000","last_fullsized":"2023-12-19T18:59:44.654683+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:08:30.262675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.645309+0000","last_change":"2023-12-19T18:59:27.644566+0000","last_active":"2023-12-19T18:59:44.645309+0000","last_peered":"2023-12-19T18:59:44.645309+0000","last_clean":"2023-12-19T18:59:44.645309+0000","last_became_active":"2023-12-19T18:59:27.644305+0000","last_became_peered":"2023-12-19T18:59:27.644305+0000","last_unstale":"2023-12-19T18:59:44.645309+0000","last_undegraded":"2023-12-19T18:59:44.645309+0000","last_fullsized":"2023-12-19T18:59:44.645309+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:51:59.962934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.683511+0000","last_change":"2023-12-19T18:59:45.677626+0000","last_active":"2023-12-19T18:59:45.683511+0000","last_peered":"2023-12-19T18:59:45.683511+0000","last_clean":"2023-12-19T18:59:45.683511+0000","last_became_active":"2023-12-19T18:59:45.676785+0000","last_became_peered":"2023-12-19T18:59:45.676785+0000","last_unstale":"2023-12-19T18:59:45.683511+0000","last_undegraded":"2023-12-19T18:59:45.683511+0000","last_fullsized":"2023-12-19T18:59:45.683511+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:53.633313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.697226+0000","last_change":"2023-12-19T18:59:44.668644+0000","last_active":"2023-12-19T18:59:45.697226+0000","last_peered":"2023-12-19T18:59:45.697226+0000","last_clean":"2023-12-19T18:59:45.697226+0000","last_became_active":"2023-12-19T18:59:44.668363+0000","last_became_peered":"2023-12-19T18:59:44.668363+0000","last_unstale":"2023-12-19T18:59:45.697226+0000","last_undegraded":"2023-12-19T18:59:45.697226+0000","last_fullsized":"2023-12-19T18:59:45.697226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:28:05.296201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658399+0000","last_change":"2023-12-19T18:59:26.886101+0000","last_active":"2023-12-19T18:59:44.658399+0000","last_peered":"2023-12-19T18:59:44.658399+0000","last_clean":"2023-12-19T18:59:44.658399+0000","last_became_active":"2023-12-19T18:59:26.885879+0000","last_became_peered":"2023-12-19T18:59:26.885879+0000","last_unstale":"2023-12-19T18:59:44.658399+0000","last_undegraded":"2023-12-19T18:59:44.658399+0000","last_fullsized":"2023-12-19T18:59:44.658399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:33:32.469781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642027+0000","last_change":"2023-12-19T18:59:27.647256+0000","last_active":"2023-12-19T18:59:44.642027+0000","last_peered":"2023-12-19T18:59:44.642027+0000","last_clean":"2023-12-19T18:59:44.642027+0000","last_became_active":"2023-12-19T18:59:27.646852+0000","last_became_peered":"2023-12-19T18:59:27.646852+0000","last_unstale":"2023-12-19T18:59:44.642027+0000","last_undegraded":"2023-12-19T18:59:44.642027+0000","last_fullsized":"2023-12-19T18:59:44.642027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:46:08.213481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.686677+0000","last_change":"2023-12-19T18:59:45.683204+0000","last_active":"2023-12-19T18:59:45.686677+0000","last_peered":"2023-12-19T18:59:45.686677+0000","last_clean":"2023-12-19T18:59:45.686677+0000","last_became_active":"2023-12-19T18:59:45.682935+0000","last_became_peered":"2023-12-19T18:59:45.682935+0000","last_unstale":"2023-12-19T18:59:45.686677+0000","last_undegraded":"2023-12-19T18:59:45.686677+0000","last_fullsized":"2023-12-19T18:59:45.686677+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:28:08.544813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.636189+0000","last_change":"2023-12-19T18:59:26.882004+0000","last_active":"2023-12-19T18:59:44.636189+0000","last_peered":"2023-12-19T18:59:44.636189+0000","last_clean":"2023-12-19T18:59:44.636189+0000","last_became_active":"2023-12-19T18:59:26.881700+0000","last_became_peered":"2023-12-19T18:59:26.881700+0000","last_unstale":"2023-12-19T18:59:44.636189+0000","last_undegraded":"2023-12-19T18:59:44.636189+0000","last_fullsized":"2023-12-19T18:59:44.636189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:58:48.747485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.665411+0000","last_change":"2023-12-19T18:59:27.652815+0000","last_active":"2023-12-19T18:59:44.665411+0000","last_peered":"2023-12-19T18:59:44.665411+0000","last_clean":"2023-12-19T18:59:44.665411+0000","last_became_active":"2023-12-19T18:59:27.650397+0000","last_became_peered":"2023-12-19T18:59:27.650397+0000","last_unstale":"2023-12-19T18:59:44.665411+0000","last_undegraded":"2023-12-19T18:59:44.665411+0000","last_fullsized":"2023-12-19T18:59:44.665411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:55.089240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.695992+0000","last_change":"2023-12-19T18:59:44.663695+0000","last_active":"2023-12-19T18:59:45.695992+0000","last_peered":"2023-12-19T18:59:45.695992+0000","last_clean":"2023-12-19T18:59:45.695992+0000","last_became_active":"2023-12-19T18:59:44.663100+0000","last_became_peered":"2023-12-19T18:59:44.663100+0000","last_unstale":"2023-12-19T18:59:45.695992+0000","last_undegraded":"2023-12-19T18:59:45.695992+0000","last_fullsized":"2023-12-19T18:59:45.695992+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:06:47.044737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.681228+0000","last_change":"2023-12-19T18:59:45.669704+0000","last_active":"2023-12-19T18:59:45.681228+0000","last_peered":"2023-12-19T18:59:45.681228+0000","last_clean":"2023-12-19T18:59:45.681228+0000","last_became_active":"2023-12-19T18:59:45.665714+0000","last_became_peered":"2023-12-19T18:59:45.665714+0000","last_unstale":"2023-12-19T18:59:45.681228+0000","last_undegraded":"2023-12-19T18:59:45.681228+0000","last_fullsized":"2023-12-19T18:59:45.681228+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:06:48.050714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.665509+0000","last_change":"2023-12-19T18:59:26.890655+0000","last_active":"2023-12-19T18:59:44.665509+0000","last_peered":"2023-12-19T18:59:44.665509+0000","last_clean":"2023-12-19T18:59:44.665509+0000","last_became_active":"2023-12-19T18:59:26.890346+0000","last_became_peered":"2023-12-19T18:59:26.890346+0000","last_unstale":"2023-12-19T18:59:44.665509+0000","last_undegraded":"2023-12-19T18:59:44.665509+0000","last_fullsized":"2023-12-19T18:59:44.665509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:13:18.250528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.636185+0000","last_change":"2023-12-19T18:59:27.641456+0000","last_active":"2023-12-19T18:59:44.636185+0000","last_peered":"2023-12-19T18:59:44.636185+0000","last_clean":"2023-12-19T18:59:44.636185+0000","last_became_active":"2023-12-19T18:59:27.641199+0000","last_became_peered":"2023-12-19T18:59:27.641199+0000","last_unstale":"2023-12-19T18:59:44.636185+0000","last_undegraded":"2023-12-19T18:59:44.636185+0000","last_fullsized":"2023-12-19T18:59:44.636185+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:06.335328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.693244+0000","last_change":"2023-12-19T18:59:44.661322+0000","last_active":"2023-12-19T18:59:45.693244+0000","last_peered":"2023-12-19T18:59:45.693244+0000","last_clean":"2023-12-19T18:59:45.693244+0000","last_became_active":"2023-12-19T18:59:44.660959+0000","last_became_peered":"2023-12-19T18:59:44.660959+0000","last_unstale":"2023-12-19T18:59:45.693244+0000","last_undegraded":"2023-12-19T18:59:45.693244+0000","last_fullsized":"2023-12-19T18:59:45.693244+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:41.511096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.679872+0000","last_change":"2023-12-19T18:59:45.672061+0000","last_active":"2023-12-19T18:59:45.679872+0000","last_peered":"2023-12-19T18:59:45.679872+0000","last_clean":"2023-12-19T18:59:45.679872+0000","last_became_active":"2023-12-19T18:59:45.671659+0000","last_became_peered":"2023-12-19T18:59:45.671659+0000","last_unstale":"2023-12-19T18:59:45.679872+0000","last_undegraded":"2023-12-19T18:59:45.679872+0000","last_fullsized":"2023-12-19T18:59:45.679872+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:26:45.365145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641112+0000","last_change":"2023-12-19T18:59:27.641444+0000","last_active":"2023-12-19T18:59:44.641112+0000","last_peered":"2023-12-19T18:59:44.641112+0000","last_clean":"2023-12-19T18:59:44.641112+0000","last_became_active":"2023-12-19T18:59:27.641087+0000","last_became_peered":"2023-12-19T18:59:27.641087+0000","last_unstale":"2023-12-19T18:59:44.641112+0000","last_undegraded":"2023-12-19T18:59:44.641112+0000","last_fullsized":"2023-12-19T18:59:44.641112+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:43.043365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.686029+0000","last_change":"2023-12-19T18:59:45.679116+0000","last_active":"2023-12-19T18:59:45.686029+0000","last_peered":"2023-12-19T18:59:45.686029+0000","last_clean":"2023-12-19T18:59:45.686029+0000","last_became_active":"2023-12-19T18:59:45.678786+0000","last_became_peered":"2023-12-19T18:59:45.678786+0000","last_unstale":"2023-12-19T18:59:45.686029+0000","last_undegraded":"2023-12-19T18:59:45.686029+0000","last_fullsized":"2023-12-19T18:59:45.686029+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:52:17.741074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.664244+0000","last_change":"2023-12-19T18:59:27.652420+0000","last_active":"2023-12-19T18:59:44.664244+0000","last_peered":"2023-12-19T18:59:44.664244+0000","last_clean":"2023-12-19T18:59:44.664244+0000","last_became_active":"2023-12-19T18:59:27.651860+0000","last_became_peered":"2023-12-19T18:59:27.651860+0000","last_unstale":"2023-12-19T18:59:44.664244+0000","last_undegraded":"2023-12-19T18:59:44.664244+0000","last_fullsized":"2023-12-19T18:59:44.664244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:51.108766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.685601+0000","last_change":"2023-12-19T18:59:45.681604+0000","last_active":"2023-12-19T18:59:45.685601+0000","last_peered":"2023-12-19T18:59:45.685601+0000","last_clean":"2023-12-19T18:59:45.685601+0000","last_became_active":"2023-12-19T18:59:45.681416+0000","last_became_peered":"2023-12-19T18:59:45.681416+0000","last_unstale":"2023-12-19T18:59:45.685601+0000","last_undegraded":"2023-12-19T18:59:45.685601+0000","last_fullsized":"2023-12-19T18:59:45.685601+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:16:43.707144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641176+0000","last_change":"2023-12-19T18:59:27.652827+0000","last_active":"2023-12-19T18:59:44.641176+0000","last_peered":"2023-12-19T18:59:44.641176+0000","last_clean":"2023-12-19T18:59:44.641176+0000","last_became_active":"2023-12-19T18:59:27.652064+0000","last_became_peered":"2023-12-19T18:59:27.652064+0000","last_unstale":"2023-12-19T18:59:44.641176+0000","last_undegraded":"2023-12-19T18:59:44.641176+0000","last_fullsized":"2023-12-19T18:59:44.641176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:51:59.962934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.673075+0000","last_change":"2023-12-19T18:59:45.671350+0000","last_active":"2023-12-19T18:59:45.673075+0000","last_peered":"2023-12-19T18:59:45.673075+0000","last_clean":"2023-12-19T18:59:45.673075+0000","last_became_active":"2023-12-19T18:59:45.670332+0000","last_became_peered":"2023-12-19T18:59:45.670332+0000","last_unstale":"2023-12-19T18:59:45.673075+0000","last_undegraded":"2023-12-19T18:59:45.673075+0000","last_fullsized":"2023-12-19T18:59:45.673075+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:47:17.397607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642290+0000","last_change":"2023-12-19T18:59:27.640187+0000","last_active":"2023-12-19T18:59:44.642290+0000","last_peered":"2023-12-19T18:59:44.642290+0000","last_clean":"2023-12-19T18:59:44.642290+0000","last_became_active":"2023-12-19T18:59:27.639872+0000","last_became_peered":"2023-12-19T18:59:27.639872+0000","last_unstale":"2023-12-19T18:59:44.642290+0000","last_undegraded":"2023-12-19T18:59:44.642290+0000","last_fullsized":"2023-12-19T18:59:44.642290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:30:07.550029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.680156+0000","last_change":"2023-12-19T18:59:45.672149+0000","last_active":"2023-12-19T18:59:45.680156+0000","last_peered":"2023-12-19T18:59:45.680156+0000","last_clean":"2023-12-19T18:59:45.680156+0000","last_became_active":"2023-12-19T18:59:45.671898+0000","last_became_peered":"2023-12-19T18:59:45.671898+0000","last_unstale":"2023-12-19T18:59:45.680156+0000","last_undegraded":"2023-12-19T18:59:45.680156+0000","last_fullsized":"2023-12-19T18:59:45.680156+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:36.005822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.655985+0000","last_change":"2023-12-19T18:59:27.638276+0000","last_active":"2023-12-19T18:59:44.655985+0000","last_peered":"2023-12-19T18:59:44.655985+0000","last_clean":"2023-12-19T18:59:44.655985+0000","last_became_active":"2023-12-19T18:59:27.637964+0000","last_became_peered":"2023-12-19T18:59:27.637964+0000","last_unstale":"2023-12-19T18:59:44.655985+0000","last_undegraded":"2023-12-19T18:59:44.655985+0000","last_fullsized":"2023-12-19T18:59:44.655985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:31:54.792697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.691793+0000","last_change":"2023-12-19T18:59:45.682680+0000","last_active":"2023-12-19T18:59:45.691793+0000","last_peered":"2023-12-19T18:59:45.691793+0000","last_clean":"2023-12-19T18:59:45.691793+0000","last_became_active":"2023-12-19T18:59:45.682393+0000","last_became_peered":"2023-12-19T18:59:45.682393+0000","last_unstale":"2023-12-19T18:59:45.691793+0000","last_undegraded":"2023-12-19T18:59:45.691793+0000","last_fullsized":"2023-12-19T18:59:45.691793+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:50:01.669689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.645232+0000","last_change":"2023-12-19T18:59:27.645163+0000","last_active":"2023-12-19T18:59:44.645232+0000","last_peered":"2023-12-19T18:59:44.645232+0000","last_clean":"2023-12-19T18:59:44.645232+0000","last_became_active":"2023-12-19T18:59:27.644866+0000","last_became_peered":"2023-12-19T18:59:27.644866+0000","last_unstale":"2023-12-19T18:59:44.645232+0000","last_undegraded":"2023-12-19T18:59:44.645232+0000","last_fullsized":"2023-12-19T18:59:44.645232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:47.457632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.686904+0000","last_change":"2023-12-19T18:59:45.676717+0000","last_active":"2023-12-19T18:59:45.686904+0000","last_peered":"2023-12-19T18:59:45.686904+0000","last_clean":"2023-12-19T18:59:45.686904+0000","last_became_active":"2023-12-19T18:59:45.676381+0000","last_became_peered":"2023-12-19T18:59:45.676381+0000","last_unstale":"2023-12-19T18:59:45.686904+0000","last_undegraded":"2023-12-19T18:59:45.686904+0000","last_fullsized":"2023-12-19T18:59:45.686904+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:37:39.631279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658769+0000","last_change":"2023-12-19T18:59:27.643887+0000","last_active":"2023-12-19T18:59:44.658769+0000","last_peered":"2023-12-19T18:59:44.658769+0000","last_clean":"2023-12-19T18:59:44.658769+0000","last_became_active":"2023-12-19T18:59:27.643624+0000","last_became_peered":"2023-12-19T18:59:27.643624+0000","last_unstale":"2023-12-19T18:59:44.658769+0000","last_undegraded":"2023-12-19T18:59:44.658769+0000","last_fullsized":"2023-12-19T18:59:44.658769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:02:02.023078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.697175+0000","last_change":"2023-12-19T18:59:45.693293+0000","last_active":"2023-12-19T18:59:45.697175+0000","last_peered":"2023-12-19T18:59:45.697175+0000","last_clean":"2023-12-19T18:59:45.697175+0000","last_became_active":"2023-12-19T18:59:45.693022+0000","last_became_peered":"2023-12-19T18:59:45.693022+0000","last_unstale":"2023-12-19T18:59:45.697175+0000","last_undegraded":"2023-12-19T18:59:45.697175+0000","last_fullsized":"2023-12-19T18:59:45.697175+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:00:19.812657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.647126+0000","last_change":"2023-12-19T18:59:27.643752+0000","last_active":"2023-12-19T18:59:44.647126+0000","last_peered":"2023-12-19T18:59:44.647126+0000","last_clean":"2023-12-19T18:59:44.647126+0000","last_became_active":"2023-12-19T18:59:27.643478+0000","last_became_peered":"2023-12-19T18:59:27.643478+0000","last_unstale":"2023-12-19T18:59:44.647126+0000","last_undegraded":"2023-12-19T18:59:44.647126+0000","last_fullsized":"2023-12-19T18:59:44.647126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:34:10.155305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.699426+0000","last_change":"2023-12-19T18:59:45.695420+0000","last_active":"2023-12-19T18:59:45.699426+0000","last_peered":"2023-12-19T18:59:45.699426+0000","last_clean":"2023-12-19T18:59:45.699426+0000","last_became_active":"2023-12-19T18:59:45.694980+0000","last_became_peered":"2023-12-19T18:59:45.694980+0000","last_unstale":"2023-12-19T18:59:45.699426+0000","last_undegraded":"2023-12-19T18:59:45.699426+0000","last_fullsized":"2023-12-19T18:59:45.699426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:28:45.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.649971+0000","last_change":"2023-12-19T18:59:27.657160+0000","last_active":"2023-12-19T18:59:44.649971+0000","last_peered":"2023-12-19T18:59:44.649971+0000","last_clean":"2023-12-19T18:59:44.649971+0000","last_became_active":"2023-12-19T18:59:27.656870+0000","last_became_peered":"2023-12-19T18:59:27.656870+0000","last_unstale":"2023-12-19T18:59:44.649971+0000","last_undegraded":"2023-12-19T18:59:44.649971+0000","last_fullsized":"2023-12-19T18:59:44.649971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:45.789974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.687865+0000","last_change":"2023-12-19T18:59:45.684735+0000","last_active":"2023-12-19T18:59:45.687865+0000","last_peered":"2023-12-19T18:59:45.687865+0000","last_clean":"2023-12-19T18:59:45.687865+0000","last_became_active":"2023-12-19T18:59:45.680295+0000","last_became_peered":"2023-12-19T18:59:45.680295+0000","last_unstale":"2023-12-19T18:59:45.687865+0000","last_undegraded":"2023-12-19T18:59:45.687865+0000","last_fullsized":"2023-12-19T18:59:45.687865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:49:52.569482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.635307+0000","last_change":"2023-12-19T18:59:27.631457+0000","last_active":"2023-12-19T18:59:44.635307+0000","last_peered":"2023-12-19T18:59:44.635307+0000","last_clean":"2023-12-19T18:59:44.635307+0000","last_became_active":"2023-12-19T18:59:27.631174+0000","last_became_peered":"2023-12-19T18:59:27.631174+0000","last_unstale":"2023-12-19T18:59:44.635307+0000","last_undegraded":"2023-12-19T18:59:44.635307+0000","last_fullsized":"2023-12-19T18:59:44.635307+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:55.089240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.686014+0000","last_change":"2023-12-19T18:59:45.677668+0000","last_active":"2023-12-19T18:59:45.686014+0000","last_peered":"2023-12-19T18:59:45.686014+0000","last_clean":"2023-12-19T18:59:45.686014+0000","last_became_active":"2023-12-19T18:59:45.677313+0000","last_became_peered":"2023-12-19T18:59:45.677313+0000","last_unstale":"2023-12-19T18:59:45.686014+0000","last_undegraded":"2023-12-19T18:59:45.686014+0000","last_fullsized":"2023-12-19T18:59:45.686014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:33:51.250696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641933+0000","last_change":"2023-12-19T18:59:27.648386+0000","last_active":"2023-12-19T18:59:44.641933+0000","last_peered":"2023-12-19T18:59:44.641933+0000","last_clean":"2023-12-19T18:59:44.641933+0000","last_became_active":"2023-12-19T18:59:27.647869+0000","last_became_peered":"2023-12-19T18:59:27.647869+0000","last_unstale":"2023-12-19T18:59:44.641933+0000","last_undegraded":"2023-12-19T18:59:44.641933+0000","last_fullsized":"2023-12-19T18:59:44.641933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:10.672775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.684573+0000","last_change":"2023-12-19T18:59:45.675064+0000","last_active":"2023-12-19T18:59:45.684573+0000","last_peered":"2023-12-19T18:59:45.684573+0000","last_clean":"2023-12-19T18:59:45.684573+0000","last_became_active":"2023-12-19T18:59:45.674692+0000","last_became_peered":"2023-12-19T18:59:45.674692+0000","last_unstale":"2023-12-19T18:59:45.684573+0000","last_undegraded":"2023-12-19T18:59:45.684573+0000","last_fullsized":"2023-12-19T18:59:45.684573+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:20:03.568114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642200+0000","last_change":"2023-12-19T18:59:27.649677+0000","last_active":"2023-12-19T18:59:44.642200+0000","last_peered":"2023-12-19T18:59:44.642200+0000","last_clean":"2023-12-19T18:59:44.642200+0000","last_became_active":"2023-12-19T18:59:27.647243+0000","last_became_peered":"2023-12-19T18:59:27.647243+0000","last_unstale":"2023-12-19T18:59:44.642200+0000","last_undegraded":"2023-12-19T18:59:44.642200+0000","last_fullsized":"2023-12-19T18:59:44.642200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:06.335328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.697957+0000","last_change":"2023-12-19T18:59:45.696037+0000","last_active":"2023-12-19T18:59:45.697957+0000","last_peered":"2023-12-19T18:59:45.697957+0000","last_clean":"2023-12-19T18:59:45.697957+0000","last_became_active":"2023-12-19T18:59:45.695762+0000","last_became_peered":"2023-12-19T18:59:45.695762+0000","last_unstale":"2023-12-19T18:59:45.697957+0000","last_undegraded":"2023-12-19T18:59:45.697957+0000","last_fullsized":"2023-12-19T18:59:45.697957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:42.517073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.654633+0000","last_change":"2023-12-19T18:59:27.651935+0000","last_active":"2023-12-19T18:59:44.654633+0000","last_peered":"2023-12-19T18:59:44.654633+0000","last_clean":"2023-12-19T18:59:44.654633+0000","last_became_active":"2023-12-19T18:59:27.650665+0000","last_became_peered":"2023-12-19T18:59:27.650665+0000","last_unstale":"2023-12-19T18:59:44.654633+0000","last_undegraded":"2023-12-19T18:59:44.654633+0000","last_fullsized":"2023-12-19T18:59:44.654633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:26:29.063442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.695297+0000","last_change":"2023-12-19T18:59:45.689633+0000","last_active":"2023-12-19T18:59:45.695297+0000","last_peered":"2023-12-19T18:59:45.695297+0000","last_clean":"2023-12-19T18:59:45.695297+0000","last_became_active":"2023-12-19T18:59:45.689228+0000","last_became_peered":"2023-12-19T18:59:45.689228+0000","last_unstale":"2023-12-19T18:59:45.695297+0000","last_undegraded":"2023-12-19T18:59:45.695297+0000","last_fullsized":"2023-12-19T18:59:45.695297+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:05:55.555094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658396+0000","last_change":"2023-12-19T18:59:27.641655+0000","last_active":"2023-12-19T18:59:44.658396+0000","last_peered":"2023-12-19T18:59:44.658396+0000","last_clean":"2023-12-19T18:59:44.658396+0000","last_became_active":"2023-12-19T18:59:27.641399+0000","last_became_peered":"2023-12-19T18:59:27.641399+0000","last_unstale":"2023-12-19T18:59:44.658396+0000","last_undegraded":"2023-12-19T18:59:44.658396+0000","last_fullsized":"2023-12-19T18:59:44.658396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:24:42.172134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.699432+0000","last_change":"2023-12-19T18:59:45.693760+0000","last_active":"2023-12-19T18:59:45.699432+0000","last_peered":"2023-12-19T18:59:45.699432+0000","last_clean":"2023-12-19T18:59:45.699432+0000","last_became_active":"2023-12-19T18:59:45.693495+0000","last_became_peered":"2023-12-19T18:59:45.693495+0000","last_unstale":"2023-12-19T18:59:45.699432+0000","last_undegraded":"2023-12-19T18:59:45.699432+0000","last_fullsized":"2023-12-19T18:59:45.699432+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:24.113468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658692+0000","last_change":"2023-12-19T18:59:27.643312+0000","last_active":"2023-12-19T18:59:44.658692+0000","last_peered":"2023-12-19T18:59:44.658692+0000","last_clean":"2023-12-19T18:59:44.658692+0000","last_became_active":"2023-12-19T18:59:27.642580+0000","last_became_peered":"2023-12-19T18:59:27.642580+0000","last_unstale":"2023-12-19T18:59:44.658692+0000","last_undegraded":"2023-12-19T18:59:44.658692+0000","last_fullsized":"2023-12-19T18:59:44.658692+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:26:27.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.696749+0000","last_change":"2023-12-19T18:59:45.691536+0000","last_active":"2023-12-19T18:59:45.696749+0000","last_peered":"2023-12-19T18:59:45.696749+0000","last_clean":"2023-12-19T18:59:45.696749+0000","last_became_active":"2023-12-19T18:59:45.691118+0000","last_became_peered":"2023-12-19T18:59:45.691118+0000","last_unstale":"2023-12-19T18:59:45.696749+0000","last_undegraded":"2023-12-19T18:59:45.696749+0000","last_fullsized":"2023-12-19T18:59:45.696749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:54:05.235772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.643303+0000","last_change":"2023-12-19T18:59:27.656306+0000","last_active":"2023-12-19T18:59:44.643303+0000","last_peered":"2023-12-19T18:59:44.643303+0000","last_clean":"2023-12-19T18:59:44.643303+0000","last_became_active":"2023-12-19T18:59:27.652701+0000","last_became_peered":"2023-12-19T18:59:27.652701+0000","last_unstale":"2023-12-19T18:59:44.643303+0000","last_undegraded":"2023-12-19T18:59:44.643303+0000","last_fullsized":"2023-12-19T18:59:44.643303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:39.573719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.699407+0000","last_change":"2023-12-19T18:59:45.695224+0000","last_active":"2023-12-19T18:59:45.699407+0000","last_peered":"2023-12-19T18:59:45.699407+0000","last_clean":"2023-12-19T18:59:45.699407+0000","last_became_active":"2023-12-19T18:59:45.694663+0000","last_became_peered":"2023-12-19T18:59:45.694663+0000","last_unstale":"2023-12-19T18:59:45.699407+0000","last_undegraded":"2023-12-19T18:59:45.699407+0000","last_fullsized":"2023-12-19T18:59:45.699407+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:05:55.555094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641677+0000","last_change":"2023-12-19T18:59:27.642841+0000","last_active":"2023-12-19T18:59:44.641677+0000","last_peered":"2023-12-19T18:59:44.641677+0000","last_clean":"2023-12-19T18:59:44.641677+0000","last_became_active":"2023-12-19T18:59:27.642539+0000","last_became_peered":"2023-12-19T18:59:27.642539+0000","last_unstale":"2023-12-19T18:59:44.641677+0000","last_undegraded":"2023-12-19T18:59:44.641677+0000","last_fullsized":"2023-12-19T18:59:44.641677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:47.457632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.679972+0000","last_change":"2023-12-19T18:59:45.671876+0000","last_active":"2023-12-19T18:59:45.679972+0000","last_peered":"2023-12-19T18:59:45.679972+0000","last_clean":"2023-12-19T18:59:45.679972+0000","last_became_active":"2023-12-19T18:59:45.671615+0000","last_became_peered":"2023-12-19T18:59:45.671615+0000","last_unstale":"2023-12-19T18:59:45.679972+0000","last_undegraded":"2023-12-19T18:59:45.679972+0000","last_fullsized":"2023-12-19T18:59:45.679972+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:58:58.741003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.652147+0000","last_change":"2023-12-19T18:59:27.657564+0000","last_active":"2023-12-19T18:59:44.652147+0000","last_peered":"2023-12-19T18:59:44.652147+0000","last_clean":"2023-12-19T18:59:44.652147+0000","last_became_active":"2023-12-19T18:59:27.657243+0000","last_became_peered":"2023-12-19T18:59:27.657243+0000","last_unstale":"2023-12-19T18:59:44.652147+0000","last_undegraded":"2023-12-19T18:59:44.652147+0000","last_fullsized":"2023-12-19T18:59:44.652147+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:47.457632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.691833+0000","last_change":"2023-12-19T18:59:45.682627+0000","last_active":"2023-12-19T18:59:45.691833+0000","last_peered":"2023-12-19T18:59:45.691833+0000","last_clean":"2023-12-19T18:59:45.691833+0000","last_became_active":"2023-12-19T18:59:45.682137+0000","last_became_peered":"2023-12-19T18:59:45.682137+0000","last_unstale":"2023-12-19T18:59:45.691833+0000","last_undegraded":"2023-12-19T18:59:45.691833+0000","last_fullsized":"2023-12-19T18:59:45.691833+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:11.516672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.654703+0000","last_change":"2023-12-19T18:59:27.634853+0000","last_active":"2023-12-19T18:59:44.654703+0000","last_peered":"2023-12-19T18:59:44.654703+0000","last_clean":"2023-12-19T18:59:44.654703+0000","last_became_active":"2023-12-19T18:59:27.634599+0000","last_became_peered":"2023-12-19T18:59:27.634599+0000","last_unstale":"2023-12-19T18:59:44.654703+0000","last_undegraded":"2023-12-19T18:59:44.654703+0000","last_fullsized":"2023-12-19T18:59:44.654703+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:39.573719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.672622+0000","last_change":"2023-12-19T18:59:45.670389+0000","last_active":"2023-12-19T18:59:45.672622+0000","last_peered":"2023-12-19T18:59:45.672622+0000","last_clean":"2023-12-19T18:59:45.672622+0000","last_became_active":"2023-12-19T18:59:45.669992+0000","last_became_peered":"2023-12-19T18:59:45.669992+0000","last_unstale":"2023-12-19T18:59:45.672622+0000","last_undegraded":"2023-12-19T18:59:45.672622+0000","last_fullsized":"2023-12-19T18:59:45.672622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:29:00.251482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.652699+0000","last_change":"2023-12-19T18:59:27.639769+0000","last_active":"2023-12-19T18:59:44.652699+0000","last_peered":"2023-12-19T18:59:44.652699+0000","last_clean":"2023-12-19T18:59:44.652699+0000","last_became_active":"2023-12-19T18:59:27.639419+0000","last_became_peered":"2023-12-19T18:59:27.639419+0000","last_unstale":"2023-12-19T18:59:44.652699+0000","last_undegraded":"2023-12-19T18:59:44.652699+0000","last_fullsized":"2023-12-19T18:59:44.652699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:05:06.848164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.698853+0000","last_change":"2023-12-19T18:59:45.693302+0000","last_active":"2023-12-19T18:59:45.698853+0000","last_peered":"2023-12-19T18:59:45.698853+0000","last_clean":"2023-12-19T18:59:45.698853+0000","last_became_active":"2023-12-19T18:59:45.692963+0000","last_became_peered":"2023-12-19T18:59:45.692963+0000","last_unstale":"2023-12-19T18:59:45.698853+0000","last_undegraded":"2023-12-19T18:59:45.698853+0000","last_fullsized":"2023-12-19T18:59:45.698853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:53.633313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.655897+0000","last_change":"2023-12-19T18:59:27.654938+0000","last_active":"2023-12-19T18:59:44.655897+0000","last_peered":"2023-12-19T18:59:44.655897+0000","last_clean":"2023-12-19T18:59:44.655897+0000","last_became_active":"2023-12-19T18:59:27.651744+0000","last_became_peered":"2023-12-19T18:59:27.651744+0000","last_unstale":"2023-12-19T18:59:44.655897+0000","last_undegraded":"2023-12-19T18:59:44.655897+0000","last_fullsized":"2023-12-19T18:59:44.655897+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:51:59.962934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.699291+0000","last_change":"2023-12-19T18:59:45.694950+0000","last_active":"2023-12-19T18:59:45.699291+0000","last_peered":"2023-12-19T18:59:45.699291+0000","last_clean":"2023-12-19T18:59:45.699291+0000","last_became_active":"2023-12-19T18:59:45.693896+0000","last_became_peered":"2023-12-19T18:59:45.693896+0000","last_unstale":"2023-12-19T18:59:45.699291+0000","last_undegraded":"2023-12-19T18:59:45.699291+0000","last_fullsized":"2023-12-19T18:59:45.699291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:42.517073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642892+0000","last_change":"2023-12-19T18:59:27.641187+0000","last_active":"2023-12-19T18:59:44.642892+0000","last_peered":"2023-12-19T18:59:44.642892+0000","last_clean":"2023-12-19T18:59:44.642892+0000","last_became_active":"2023-12-19T18:59:27.640792+0000","last_became_peered":"2023-12-19T18:59:27.640792+0000","last_unstale":"2023-12-19T18:59:44.642892+0000","last_undegraded":"2023-12-19T18:59:44.642892+0000","last_fullsized":"2023-12-19T18:59:44.642892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:39.959895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.691749+0000","last_change":"2023-12-19T18:59:45.681344+0000","last_active":"2023-12-19T18:59:45.691749+0000","last_peered":"2023-12-19T18:59:45.691749+0000","last_clean":"2023-12-19T18:59:45.691749+0000","last_became_active":"2023-12-19T18:59:45.681037+0000","last_became_peered":"2023-12-19T18:59:45.681037+0000","last_unstale":"2023-12-19T18:59:45.691749+0000","last_undegraded":"2023-12-19T18:59:45.691749+0000","last_fullsized":"2023-12-19T18:59:45.691749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:30.430001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.645585+0000","last_change":"2023-12-19T18:59:27.652530+0000","last_active":"2023-12-19T18:59:44.645585+0000","last_peered":"2023-12-19T18:59:44.645585+0000","last_clean":"2023-12-19T18:59:44.645585+0000","last_became_active":"2023-12-19T18:59:27.652274+0000","last_became_peered":"2023-12-19T18:59:27.652274+0000","last_unstale":"2023-12-19T18:59:44.645585+0000","last_undegraded":"2023-12-19T18:59:44.645585+0000","last_fullsized":"2023-12-19T18:59:44.645585+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:45.789974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.695629+0000","last_change":"2023-12-19T18:59:45.690556+0000","last_active":"2023-12-19T18:59:45.695629+0000","last_peered":"2023-12-19T18:59:45.695629+0000","last_clean":"2023-12-19T18:59:45.695629+0000","last_became_active":"2023-12-19T18:59:45.690278+0000","last_became_peered":"2023-12-19T18:59:45.690278+0000","last_unstale":"2023-12-19T18:59:45.695629+0000","last_undegraded":"2023-12-19T18:59:45.695629+0000","last_fullsized":"2023-12-19T18:59:45.695629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:46.035434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642507+0000","last_change":"2023-12-19T18:59:27.644087+0000","last_active":"2023-12-19T18:59:44.642507+0000","last_peered":"2023-12-19T18:59:44.642507+0000","last_clean":"2023-12-19T18:59:44.642507+0000","last_became_active":"2023-12-19T18:59:27.643699+0000","last_became_peered":"2023-12-19T18:59:27.643699+0000","last_unstale":"2023-12-19T18:59:44.642507+0000","last_undegraded":"2023-12-19T18:59:44.642507+0000","last_fullsized":"2023-12-19T18:59:44.642507+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:09.434914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.672981+0000","last_change":"2023-12-19T18:59:45.668231+0000","last_active":"2023-12-19T18:59:45.672981+0000","last_peered":"2023-12-19T18:59:45.672981+0000","last_clean":"2023-12-19T18:59:45.672981+0000","last_became_active":"2023-12-19T18:59:45.667939+0000","last_became_peered":"2023-12-19T18:59:45.667939+0000","last_unstale":"2023-12-19T18:59:45.672981+0000","last_undegraded":"2023-12-19T18:59:45.672981+0000","last_fullsized":"2023-12-19T18:59:45.672981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:34:39.645053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641018+0000","last_change":"2023-12-19T18:59:27.636005+0000","last_active":"2023-12-19T18:59:44.641018+0000","last_peered":"2023-12-19T18:59:44.641018+0000","last_clean":"2023-12-19T18:59:44.641018+0000","last_became_active":"2023-12-19T18:59:27.635717+0000","last_became_peered":"2023-12-19T18:59:27.635717+0000","last_unstale":"2023-12-19T18:59:44.641018+0000","last_undegraded":"2023-12-19T18:59:44.641018+0000","last_fullsized":"2023-12-19T18:59:44.641018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:09.434914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.681750+0000","last_change":"2023-12-19T18:59:45.669713+0000","last_active":"2023-12-19T18:59:45.681750+0000","last_peered":"2023-12-19T18:59:45.681750+0000","last_clean":"2023-12-19T18:59:45.681750+0000","last_became_active":"2023-12-19T18:59:45.667994+0000","last_became_peered":"2023-12-19T18:59:45.667994+0000","last_unstale":"2023-12-19T18:59:45.681750+0000","last_undegraded":"2023-12-19T18:59:45.681750+0000","last_fullsized":"2023-12-19T18:59:45.681750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:00:19.812657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642047+0000","last_change":"2023-12-19T18:59:27.644547+0000","last_active":"2023-12-19T18:59:44.642047+0000","last_peered":"2023-12-19T18:59:44.642047+0000","last_clean":"2023-12-19T18:59:44.642047+0000","last_became_active":"2023-12-19T18:59:27.643524+0000","last_became_peered":"2023-12-19T18:59:27.643524+0000","last_unstale":"2023-12-19T18:59:44.642047+0000","last_undegraded":"2023-12-19T18:59:44.642047+0000","last_fullsized":"2023-12-19T18:59:44.642047+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:34:10.155305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.694223+0000","last_change":"2023-12-19T18:59:45.687492+0000","last_active":"2023-12-19T18:59:45.694223+0000","last_peered":"2023-12-19T18:59:45.694223+0000","last_clean":"2023-12-19T18:59:45.694223+0000","last_became_active":"2023-12-19T18:59:45.687052+0000","last_became_peered":"2023-12-19T18:59:45.687052+0000","last_unstale":"2023-12-19T18:59:45.694223+0000","last_undegraded":"2023-12-19T18:59:45.694223+0000","last_fullsized":"2023-12-19T18:59:45.694223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:57.738035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.654632+0000","last_change":"2023-12-19T18:59:27.646289+0000","last_active":"2023-12-19T18:59:44.654632+0000","last_peered":"2023-12-19T18:59:44.654632+0000","last_clean":"2023-12-19T18:59:44.654632+0000","last_became_active":"2023-12-19T18:59:27.645922+0000","last_became_peered":"2023-12-19T18:59:27.645922+0000","last_unstale":"2023-12-19T18:59:44.654632+0000","last_undegraded":"2023-12-19T18:59:44.654632+0000","last_fullsized":"2023-12-19T18:59:44.654632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:39.959895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.692751+0000","last_change":"2023-12-19T18:59:45.682642+0000","last_active":"2023-12-19T18:59:45.692751+0000","last_peered":"2023-12-19T18:59:45.692751+0000","last_clean":"2023-12-19T18:59:45.692751+0000","last_became_active":"2023-12-19T18:59:45.682152+0000","last_became_peered":"2023-12-19T18:59:45.682152+0000","last_unstale":"2023-12-19T18:59:45.692751+0000","last_undegraded":"2023-12-19T18:59:45.692751+0000","last_fullsized":"2023-12-19T18:59:45.692751+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:27:00.147134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.652622+0000","last_change":"2023-12-19T18:59:27.647319+0000","last_active":"2023-12-19T18:59:44.652622+0000","last_peered":"2023-12-19T18:59:44.652622+0000","last_clean":"2023-12-19T18:59:44.652622+0000","last_became_active":"2023-12-19T18:59:27.646986+0000","last_became_peered":"2023-12-19T18:59:27.646986+0000","last_unstale":"2023-12-19T18:59:44.652622+0000","last_undegraded":"2023-12-19T18:59:44.652622+0000","last_fullsized":"2023-12-19T18:59:44.652622+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:11.488595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.691911+0000","last_change":"2023-12-19T18:59:45.679020+0000","last_active":"2023-12-19T18:59:45.691911+0000","last_peered":"2023-12-19T18:59:45.691911+0000","last_clean":"2023-12-19T18:59:45.691911+0000","last_became_active":"2023-12-19T18:59:45.678690+0000","last_became_peered":"2023-12-19T18:59:45.678690+0000","last_unstale":"2023-12-19T18:59:45.691911+0000","last_undegraded":"2023-12-19T18:59:45.691911+0000","last_fullsized":"2023-12-19T18:59:45.691911+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:16:32.971393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.648065+0000","last_change":"2023-12-19T18:59:27.646579+0000","last_active":"2023-12-19T18:59:44.648065+0000","last_peered":"2023-12-19T18:59:44.648065+0000","last_clean":"2023-12-19T18:59:44.648065+0000","last_became_active":"2023-12-19T18:59:27.646163+0000","last_became_peered":"2023-12-19T18:59:27.646163+0000","last_unstale":"2023-12-19T18:59:44.648065+0000","last_undegraded":"2023-12-19T18:59:44.648065+0000","last_fullsized":"2023-12-19T18:59:44.648065+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:43.043365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.695769+0000","last_change":"2023-12-19T18:59:45.687938+0000","last_active":"2023-12-19T18:59:45.695769+0000","last_peered":"2023-12-19T18:59:45.695769+0000","last_clean":"2023-12-19T18:59:45.695769+0000","last_became_active":"2023-12-19T18:59:45.687544+0000","last_became_peered":"2023-12-19T18:59:45.687544+0000","last_unstale":"2023-12-19T18:59:45.695769+0000","last_undegraded":"2023-12-19T18:59:45.695769+0000","last_fullsized":"2023-12-19T18:59:45.695769+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:03:14.333691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658554+0000","last_change":"2023-12-19T18:59:27.652238+0000","last_active":"2023-12-19T18:59:44.658554+0000","last_peered":"2023-12-19T18:59:44.658554+0000","last_clean":"2023-12-19T18:59:44.658554+0000","last_became_active":"2023-12-19T18:59:27.650827+0000","last_became_peered":"2023-12-19T18:59:27.650827+0000","last_unstale":"2023-12-19T18:59:44.658554+0000","last_undegraded":"2023-12-19T18:59:44.658554+0000","last_fullsized":"2023-12-19T18:59:44.658554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:39.959895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.699271+0000","last_change":"2023-12-19T18:59:45.694324+0000","last_active":"2023-12-19T18:59:45.699271+0000","last_peered":"2023-12-19T18:59:45.699271+0000","last_clean":"2023-12-19T18:59:45.699271+0000","last_became_active":"2023-12-19T18:59:45.688928+0000","last_became_peered":"2023-12-19T18:59:45.688928+0000","last_unstale":"2023-12-19T18:59:45.699271+0000","last_undegraded":"2023-12-19T18:59:45.699271+0000","last_fullsized":"2023-12-19T18:59:45.699271+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:24:59.950274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658614+0000","last_change":"2023-12-19T18:59:27.643020+0000","last_active":"2023-12-19T18:59:44.658614+0000","last_peered":"2023-12-19T18:59:44.658614+0000","last_clean":"2023-12-19T18:59:44.658614+0000","last_became_active":"2023-12-19T18:59:27.640017+0000","last_became_peered":"2023-12-19T18:59:27.640017+0000","last_unstale":"2023-12-19T18:59:44.658614+0000","last_undegraded":"2023-12-19T18:59:44.658614+0000","last_fullsized":"2023-12-19T18:59:44.658614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:35.855173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.695283+0000","last_change":"2023-12-19T18:59:45.687321+0000","last_active":"2023-12-19T18:59:45.695283+0000","last_peered":"2023-12-19T18:59:45.695283+0000","last_clean":"2023-12-19T18:59:45.695283+0000","last_became_active":"2023-12-19T18:59:45.687017+0000","last_became_peered":"2023-12-19T18:59:45.687017+0000","last_unstale":"2023-12-19T18:59:45.695283+0000","last_undegraded":"2023-12-19T18:59:45.695283+0000","last_fullsized":"2023-12-19T18:59:45.695283+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:46.035434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.666305+0000","last_change":"2023-12-19T18:59:27.658988+0000","last_active":"2023-12-19T18:59:44.666305+0000","last_peered":"2023-12-19T18:59:44.666305+0000","last_clean":"2023-12-19T18:59:44.666305+0000","last_became_active":"2023-12-19T18:59:27.658688+0000","last_became_peered":"2023-12-19T18:59:27.658688+0000","last_unstale":"2023-12-19T18:59:44.666305+0000","last_undegraded":"2023-12-19T18:59:44.666305+0000","last_fullsized":"2023-12-19T18:59:44.666305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:58:40.962863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":987136,"data_stored":746076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.59699999999999998}]},{"osd":1,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.70299999999999996}]},{"osd":2,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.54600000000000004}]},{"osd":3,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.56899999999999995}]},{"osd":4,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.622}]},{"osd":5,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.73599999999999999}]},{"osd":6,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.76000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":148511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.62}]},{"osd":1,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.69499999999999995}]},{"osd":2,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.64200000000000002}]},{"osd":3,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.71699999999999997}]},{"osd":4,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.84299999999999997}]},{"osd":5,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.77300000000000002}]},{"osd":7,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.97599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":148567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":7.4550000000000001,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":16.951000000000001,"5min":16.951000000000001,"15min":16.951000000000001},"last":0.63}]},{"osd":1,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":19.823,"5min":19.823,"15min":19.823},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.49299999999999999}]},{"osd":2,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.56499999999999995}]},{"osd":3,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.2949999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.7649999999999997,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":0.61099999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.6499999999999999,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":0.79600000000000004}]},{"osd":6,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.59199999999999997}]},{"osd":7,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.371,"5min":2.371,"15min":2.371},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.72999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":147999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.7690000000000001,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.51800000000000002}]},{"osd":1,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":3.3849999999999998,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":0.627}]},{"osd":2,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":3.1240000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.57199999999999995}]},{"osd":3,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":3.194,"5min":3.194,"15min":3.194},"last":0.55300000000000005}]},{"osd":5,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":9.3040000000000003,"5min":9.3040000000000003,"15min":9.3040000000000003},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.433}]},{"osd":6,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":3.097,"5min":3.097,"15min":3.097},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":3.3319999999999999,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":5.0410000000000004,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":6.3449999999999998,"5min":6.3449999999999998,"15min":6.3449999999999998},"last":0.66800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":151024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.39100000000000001}]},{"osd":1,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.41099999999999998}]},{"osd":2,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.503},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.33700000000000002}]},{"osd":4,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.59999999999999998}]},{"osd":6,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.622},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.73799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":147965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.499},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.3599999999999999,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.45200000000000001}]},{"osd":1,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":0.40400000000000003}]},{"osd":3,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":3.0259999999999998,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":0.378},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.61699999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.835,"5min":2.835,"15min":2.835},"last":0.58099999999999996}]},{"osd":5,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":3.5,"5min":3.5,"15min":3.5},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":0.74099999999999999}]},{"osd":6,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.7109999999999999,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.66600000000000004}]},{"osd":7,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.875,"5min":2.875,"15min":2.875},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.59499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":151024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":4.2000000000000002,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":7.7320000000000002,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.29499999999999998}]},{"osd":2,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.9129999999999998,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.4720000000000004,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.33600000000000002}]},{"osd":3,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":7.8399999999999999,"5min":7.8399999999999999,"15min":7.8399999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":7.7949999999999999,"5min":7.7949999999999999,"15min":7.7949999999999999},"last":0.46600000000000003}]},{"osd":4,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":4.2690000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":4.2910000000000004,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.69499999999999995}]},{"osd":5,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":4.3490000000000002,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":4.2480000000000002,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.66200000000000003}]},{"osd":6,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":4.1609999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.754},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.3099999999999996,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.68200000000000005}]},{"osd":7,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":4.3310000000000004,"5min":4.3310000000000004,"15min":4.3310000000000004},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":4.226,"5min":4.226,"15min":4.226},"last":0.79400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":962560,"data_stored":737244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.375},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.44800000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.41599999999999998}]},{"osd":3,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.46300000000000002}]},{"osd":4,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.66300000000000003}]},{"osd":5,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.746}]},{"osd":6,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.76300000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.84199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T18:59:49.804 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T18:59:49.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.970+0000 7f5a45e9a640 1 Processor -- start 2023-12-19T18:59:49.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.970+0000 7f5a45e9a640 1 -- start start 2023-12-19T18:59:49.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.970+0000 7f5a45e9a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5a400a5370 0x7f5a400c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:49.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.970+0000 7f5a45e9a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5a40072090 0x7f5a401516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:49.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.970+0000 7f5a45e9a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a400c2760 con 0x7f5a400c4110 2023-12-19T18:59:49.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.970+0000 7f5a45e9a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a400c3070 con 0x7f5a400a5370 2023-12-19T18:59:49.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.970+0000 7f5a45e9a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a40151bf0 con 0x7f5a40072090 2023-12-19T18:59:49.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.970+0000 7f5a3f7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5a400a5370 0x7f5a400c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:49.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.970+0000 7f5a3f7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5a400a5370 0x7f5a400c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59902/0 (socket says 172.21.15.133:59902) 2023-12-19T18:59:49.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.970+0000 7f5a3effd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5a400c4110 0x7f5a40150fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47174/0 (socket says 172.21.15.133:47174) 2023-12-19T18:59:49.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.970+0000 7f5a3f7fe640 1 -- 172.21.15.133:0/340015938 learned_addr learned my addr 172.21.15.133:0/340015938 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:49.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.974+0000 7f5a3ffff640 1 --2- 172.21.15.133:0/340015938 >> v2:172.21.15.138:3300/0 conn(0x7f5a40072090 0x7f5a401516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:49.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.974+0000 7f5a3f7fe640 1 -- 172.21.15.133:0/340015938 >> v2:172.21.15.138:3300/0 conn(0x7f5a40072090 msgr2=0x7f5a401516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:49.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.974+0000 7f5a3e7fc640 1 -- 172.21.15.133:0/340015938 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976459682 0 0) 0x7f5a400c2760 con 0x7f5a400c4110 2023-12-19T18:59:49.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.974+0000 7f5a3f7fe640 1 --2- 172.21.15.133:0/340015938 >> v2:172.21.15.138:3300/0 conn(0x7f5a40072090 0x7f5a401516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.974+0000 7f5a3f7fe640 1 -- 172.21.15.133:0/340015938 >> v1:172.21.15.133:6789/0 conn(0x7f5a400c4110 legacy=0x7f5a40150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:49.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.974+0000 7f5a3f7fe640 1 -- 172.21.15.133:0/340015938 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a400a5750 con 0x7f5a400a5370 2023-12-19T18:59:49.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.974+0000 7f5a3ffff640 1 --2- 172.21.15.133:0/340015938 >> v2:172.21.15.138:3300/0 conn(0x7f5a40072090 0x7f5a401516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:49.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.974+0000 7f5a3f7fe640 1 --2- 172.21.15.133:0/340015938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a400a5370 0x7f5a400c3bd0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5a40072020 tx=0x7f5a3001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8cb46d5d004748b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.974+0000 7f5a3e7fc640 1 -- 172.21.15.133:0/340015938 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a300ab600 con 0x7f5a400a5370 2023-12-19T18:59:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.974+0000 7f5a3e7fc640 1 -- 172.21.15.133:0/340015938 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a300a7050 con 0x7f5a400a5370 2023-12-19T18:59:49.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.974+0000 7f5a3e7fc640 1 -- 172.21.15.133:0/340015938 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a300ab980 con 0x7f5a400a5370 2023-12-19T18:59:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a45e9a640 1 -- 172.21.15.133:0/340015938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a400a5370 msgr2=0x7f5a400c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a45e9a640 1 --2- 172.21.15.133:0/340015938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a400a5370 0x7f5a400c3bd0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5a40072020 tx=0x7f5a3001c3b0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a45e9a640 1 -- 172.21.15.133:0/340015938 shutdown_connections 2023-12-19T18:59:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a45e9a640 1 --2- 172.21.15.133:0/340015938 >> v2:172.21.15.138:3300/0 conn(0x7f5a40072090 0x7f5a401516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a45e9a640 1 --2- 172.21.15.133:0/340015938 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a400a5370 0x7f5a400c3bd0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a45e9a640 1 -- 172.21.15.133:0/340015938 >> 172.21.15.133:0/340015938 conn(0x7f5a4006a5b0 msgr2=0x7f5a4006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a45e9a640 1 -- 172.21.15.133:0/340015938 shutdown_connections 2023-12-19T18:59:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a45e9a640 1 -- 172.21.15.133:0/340015938 wait complete. 2023-12-19T18:59:49.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a45e9a640 1 Processor -- start 2023-12-19T18:59:49.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a45e9a640 1 -- start start 2023-12-19T18:59:49.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a45e9a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a40072090 0x7f5a400c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:49.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a45e9a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a400a5370 0x7f5a40147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:49.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a45e9a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5a400c4110 0x7f5a40148120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:49.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a45e9a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a401528b0 con 0x7f5a400a5370 2023-12-19T18:59:49.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a45e9a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a40152b40 con 0x7f5a40072090 2023-12-19T18:59:49.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a45e9a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a40152e20 con 0x7f5a400c4110 2023-12-19T18:59:49.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a3effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a400a5370 0x7f5a40147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:49.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a3effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a400a5370 0x7f5a40147be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59910/0 (socket says 172.21.15.133:59910) 2023-12-19T18:59:49.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a3effd640 1 -- 172.21.15.133:0/1367292193 learned_addr learned my addr 172.21.15.133:0/1367292193 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:49.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a3f7fe640 1 --2- 172.21.15.133:0/1367292193 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a40072090 0x7f5a400c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:49.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a3ffff640 1 --2- 172.21.15.133:0/1367292193 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5a400c4110 0x7f5a40148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:49.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a3effd640 1 -- 172.21.15.133:0/1367292193 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5a400c4110 msgr2=0x7f5a40148120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:49.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a3effd640 1 --2- 172.21.15.133:0/1367292193 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5a400c4110 0x7f5a40148120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a3effd640 1 -- 172.21.15.133:0/1367292193 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a40072090 msgr2=0x7f5a400c4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:49.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a3effd640 1 --2- 172.21.15.133:0/1367292193 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a40072090 0x7f5a400c4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:49.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.978+0000 7f5a3effd640 1 -- 172.21.15.133:0/1367292193 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a300094d0 con 0x7f5a400a5370 2023-12-19T18:59:49.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.982+0000 7f5a3effd640 1 --2- 172.21.15.133:0/1367292193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a400a5370 0x7f5a40147be0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400c480 tx=0x7f5a3400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:49.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.982+0000 7f5a27fff640 1 -- 172.21.15.133:0/1367292193 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a340074e0 con 0x7f5a400a5370 2023-12-19T18:59:49.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.982+0000 7f5a27fff640 1 -- 172.21.15.133:0/1367292193 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a34007660 con 0x7f5a400a5370 2023-12-19T18:59:49.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.982+0000 7f5a45e9a640 1 -- 172.21.15.133:0/1367292193 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a40153100 con 0x7f5a400a5370 2023-12-19T18:59:49.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.982+0000 7f5a27fff640 1 -- 172.21.15.133:0/1367292193 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a34004a30 con 0x7f5a400a5370 2023-12-19T18:59:49.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.982+0000 7f5a45e9a640 1 -- 172.21.15.133:0/1367292193 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a401536c0 con 0x7f5a400a5370 2023-12-19T18:59:49.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.982+0000 7f5a45e9a640 1 -- 172.21.15.133:0/1367292193 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a401538e0 con 0x7f5a400a5370 2023-12-19T18:59:49.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.982+0000 7f5a27fff640 1 -- 172.21.15.133:0/1367292193 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5a34004b90 con 0x7f5a400a5370 2023-12-19T18:59:49.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.982+0000 7f5a27fff640 1 --2- 172.21.15.133:0/1367292193 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5a2c066470 0x7f5a2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:49.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.982+0000 7f5a27fff640 1 -- 172.21.15.133:0/1367292193 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5a340832d0 con 0x7f5a400a5370 2023-12-19T18:59:49.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.986+0000 7f5a3f7fe640 1 --2- 172.21.15.133:0/1367292193 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5a2c066470 0x7f5a2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:49.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.986+0000 7f5a3f7fe640 1 --2- 172.21.15.133:0/1367292193 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5a2c066470 0x7f5a2c068930 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5a300ad000 tx=0x7f5a300a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:49.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:49.986+0000 7f5a27fff640 1 -- 172.21.15.133:0/1367292193 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5a34050490 con 0x7f5a400a5370 2023-12-19T18:59:50.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.134+0000 7f5a45e9a640 1 -- 172.21.15.133:0/1367292193 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5a400c2c90 con 0x7f5a2c066470 2023-12-19T18:59:50.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.150+0000 7f5a27fff640 1 -- 172.21.15.133:0/1367292193 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+527857 (secure 0 0 0) 0x7f5a300ab760 con 0x7f5a2c066470 2023-12-19T18:59:50.161 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:50.166 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T18:59:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.154+0000 7f5a45e9a640 1 -- 172.21.15.133:0/1367292193 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5a2c066470 msgr2=0x7f5a2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.154+0000 7f5a45e9a640 1 --2- 172.21.15.133:0/1367292193 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5a2c066470 0x7f5a2c068930 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5a300ad000 tx=0x7f5a300a6000 comp rx=0 tx=0).stop 2023-12-19T18:59:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.154+0000 7f5a45e9a640 1 -- 172.21.15.133:0/1367292193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a400a5370 msgr2=0x7f5a40147be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.154+0000 7f5a45e9a640 1 --2- 172.21.15.133:0/1367292193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a400a5370 0x7f5a40147be0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5a3400c480 tx=0x7f5a3400c940 comp rx=0 tx=0).stop 2023-12-19T18:59:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.154+0000 7f5a45e9a640 1 -- 172.21.15.133:0/1367292193 shutdown_connections 2023-12-19T18:59:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.154+0000 7f5a45e9a640 1 --2- 172.21.15.133:0/1367292193 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5a2c066470 0x7f5a2c068930 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.154+0000 7f5a45e9a640 1 --2- 172.21.15.133:0/1367292193 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5a400c4110 0x7f5a40148120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:50.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.154+0000 7f5a45e9a640 1 --2- 172.21.15.133:0/1367292193 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5a400a5370 0x7f5a40147be0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:50.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.154+0000 7f5a45e9a640 1 --2- 172.21.15.133:0/1367292193 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5a40072090 0x7f5a400c4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:50.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.154+0000 7f5a45e9a640 1 -- 172.21.15.133:0/1367292193 >> 172.21.15.133:0/1367292193 conn(0x7f5a4006a5b0 msgr2=0x7f5a40071550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:50.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.154+0000 7f5a45e9a640 1 -- 172.21.15.133:0/1367292193 shutdown_connections 2023-12-19T18:59:50.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.154+0000 7f5a45e9a640 1 -- 172.21.15.133:0/1367292193 wait complete. 2023-12-19T18:59:50.181 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2023-12-19T18:59:48.846684+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":245,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220344,"kb_used_data":4148,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754376,"statfs":{"total":773094113280,"available":772868481024,"internally_reserved":0,"allocated":4247552,"data_stored":2378410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.215992"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.698835+0000","last_change":"2023-12-19T18:59:45.693061+0000","last_active":"2023-12-19T18:59:45.698835+0000","last_peered":"2023-12-19T18:59:45.698835+0000","last_clean":"2023-12-19T18:59:45.698835+0000","last_became_active":"2023-12-19T18:59:45.677441+0000","last_became_peered":"2023-12-19T18:59:45.677441+0000","last_unstale":"2023-12-19T18:59:45.698835+0000","last_undegraded":"2023-12-19T18:59:45.698835+0000","last_fullsized":"2023-12-19T18:59:45.698835+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:26:45.365145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":179,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641772+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T18:59:44.641772+0000","last_peered":"2023-12-19T18:59:44.641772+0000","last_clean":"2023-12-19T18:59:44.641772+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T18:59:44.641772+0000","last_undegraded":"2023-12-19T18:59:44.641772+0000","last_fullsized":"2023-12-19T18:59:44.641772+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.664949+0000","last_change":"2023-12-19T18:59:26.886139+0000","last_active":"2023-12-19T18:59:44.664949+0000","last_peered":"2023-12-19T18:59:44.664949+0000","last_clean":"2023-12-19T18:59:44.664949+0000","last_became_active":"2023-12-19T18:59:26.885752+0000","last_became_peered":"2023-12-19T18:59:26.885752+0000","last_unstale":"2023-12-19T18:59:44.664949+0000","last_undegraded":"2023-12-19T18:59:44.664949+0000","last_fullsized":"2023-12-19T18:59:44.664949+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:01.602303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641385+0000","last_change":"2023-12-19T18:59:27.638695+0000","last_active":"2023-12-19T18:59:44.641385+0000","last_peered":"2023-12-19T18:59:44.641385+0000","last_clean":"2023-12-19T18:59:44.641385+0000","last_became_active":"2023-12-19T18:59:27.638392+0000","last_became_peered":"2023-12-19T18:59:27.638392+0000","last_unstale":"2023-12-19T18:59:44.641385+0000","last_undegraded":"2023-12-19T18:59:44.641385+0000","last_fullsized":"2023-12-19T18:59:44.641385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:31:54.792697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.697828+0000","last_change":"2023-12-19T18:59:44.664452+0000","last_active":"2023-12-19T18:59:45.697828+0000","last_peered":"2023-12-19T18:59:45.697828+0000","last_clean":"2023-12-19T18:59:45.697828+0000","last_became_active":"2023-12-19T18:59:44.662526+0000","last_became_peered":"2023-12-19T18:59:44.662526+0000","last_unstale":"2023-12-19T18:59:45.697828+0000","last_undegraded":"2023-12-19T18:59:45.697828+0000","last_fullsized":"2023-12-19T18:59:45.697828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:41:10.122870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.687847+0000","last_change":"2023-12-19T18:59:45.675930+0000","last_active":"2023-12-19T18:59:45.687847+0000","last_peered":"2023-12-19T18:59:45.687847+0000","last_clean":"2023-12-19T18:59:45.687847+0000","last_became_active":"2023-12-19T18:59:45.675424+0000","last_became_peered":"2023-12-19T18:59:45.675424+0000","last_unstale":"2023-12-19T18:59:45.687847+0000","last_undegraded":"2023-12-19T18:59:45.687847+0000","last_fullsized":"2023-12-19T18:59:45.687847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:31:15.856213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.653942+0000","last_change":"2023-12-19T18:59:26.874040+0000","last_active":"2023-12-19T18:59:44.653942+0000","last_peered":"2023-12-19T18:59:44.653942+0000","last_clean":"2023-12-19T18:59:44.653942+0000","last_became_active":"2023-12-19T18:59:26.873816+0000","last_became_peered":"2023-12-19T18:59:26.873816+0000","last_unstale":"2023-12-19T18:59:44.653942+0000","last_undegraded":"2023-12-19T18:59:44.653942+0000","last_fullsized":"2023-12-19T18:59:44.653942+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:08.432139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642568+0000","last_change":"2023-12-19T18:59:27.636584+0000","last_active":"2023-12-19T18:59:44.642568+0000","last_peered":"2023-12-19T18:59:44.642568+0000","last_clean":"2023-12-19T18:59:44.642568+0000","last_became_active":"2023-12-19T18:59:27.636367+0000","last_became_peered":"2023-12-19T18:59:27.636367+0000","last_unstale":"2023-12-19T18:59:44.642568+0000","last_undegraded":"2023-12-19T18:59:44.642568+0000","last_fullsized":"2023-12-19T18:59:44.642568+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:18.227682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.664756+0000","last_change":"2023-12-19T18:59:44.650785+0000","last_active":"2023-12-19T18:59:45.664756+0000","last_peered":"2023-12-19T18:59:45.664756+0000","last_clean":"2023-12-19T18:59:45.664756+0000","last_became_active":"2023-12-19T18:59:44.650484+0000","last_became_peered":"2023-12-19T18:59:44.650484+0000","last_unstale":"2023-12-19T18:59:45.664756+0000","last_undegraded":"2023-12-19T18:59:45.664756+0000","last_fullsized":"2023-12-19T18:59:45.664756+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:28:07.538836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.684686+0000","last_change":"2023-12-19T18:59:45.678363+0000","last_active":"2023-12-19T18:59:45.684686+0000","last_peered":"2023-12-19T18:59:45.684686+0000","last_clean":"2023-12-19T18:59:45.684686+0000","last_became_active":"2023-12-19T18:59:45.678051+0000","last_became_peered":"2023-12-19T18:59:45.678051+0000","last_unstale":"2023-12-19T18:59:45.684686+0000","last_undegraded":"2023-12-19T18:59:45.684686+0000","last_fullsized":"2023-12-19T18:59:45.684686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:20:20.611803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641737+0000","last_change":"2023-12-19T18:59:26.875167+0000","last_active":"2023-12-19T18:59:44.641737+0000","last_peered":"2023-12-19T18:59:44.641737+0000","last_clean":"2023-12-19T18:59:44.641737+0000","last_became_active":"2023-12-19T18:59:26.874253+0000","last_became_peered":"2023-12-19T18:59:26.874253+0000","last_unstale":"2023-12-19T18:59:44.641737+0000","last_undegraded":"2023-12-19T18:59:44.641737+0000","last_fullsized":"2023-12-19T18:59:44.641737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:58:48.747485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.653940+0000","last_change":"2023-12-19T18:59:27.640476+0000","last_active":"2023-12-19T18:59:44.653940+0000","last_peered":"2023-12-19T18:59:44.653940+0000","last_clean":"2023-12-19T18:59:44.653940+0000","last_became_active":"2023-12-19T18:59:27.639994+0000","last_became_peered":"2023-12-19T18:59:27.639994+0000","last_unstale":"2023-12-19T18:59:44.653940+0000","last_undegraded":"2023-12-19T18:59:44.653940+0000","last_fullsized":"2023-12-19T18:59:44.653940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:31:54.792697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.656022+0000","last_change":"2023-12-19T18:59:44.664033+0000","last_active":"2023-12-19T18:59:45.656022+0000","last_peered":"2023-12-19T18:59:45.656022+0000","last_clean":"2023-12-19T18:59:45.656022+0000","last_became_active":"2023-12-19T18:59:44.663456+0000","last_became_peered":"2023-12-19T18:59:44.663456+0000","last_unstale":"2023-12-19T18:59:45.656022+0000","last_undegraded":"2023-12-19T18:59:45.656022+0000","last_fullsized":"2023-12-19T18:59:45.656022+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:37:38.625301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.680542+0000","last_change":"2023-12-19T18:59:45.674020+0000","last_active":"2023-12-19T18:59:45.680542+0000","last_peered":"2023-12-19T18:59:45.680542+0000","last_clean":"2023-12-19T18:59:45.680542+0000","last_became_active":"2023-12-19T18:59:45.673581+0000","last_became_peered":"2023-12-19T18:59:45.673581+0000","last_unstale":"2023-12-19T18:59:45.680542+0000","last_undegraded":"2023-12-19T18:59:45.680542+0000","last_fullsized":"2023-12-19T18:59:45.680542+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:24:59.950274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.643796+0000","last_change":"2023-12-19T18:59:26.889247+0000","last_active":"2023-12-19T18:59:44.643796+0000","last_peered":"2023-12-19T18:59:44.643796+0000","last_clean":"2023-12-19T18:59:44.643796+0000","last_became_active":"2023-12-19T18:59:26.888058+0000","last_became_peered":"2023-12-19T18:59:26.888058+0000","last_unstale":"2023-12-19T18:59:44.643796+0000","last_undegraded":"2023-12-19T18:59:44.643796+0000","last_fullsized":"2023-12-19T18:59:44.643796+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:05.332552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.635418+0000","last_change":"2023-12-19T18:59:27.647349+0000","last_active":"2023-12-19T18:59:44.635418+0000","last_peered":"2023-12-19T18:59:44.635418+0000","last_clean":"2023-12-19T18:59:44.635418+0000","last_became_active":"2023-12-19T18:59:27.646832+0000","last_became_peered":"2023-12-19T18:59:27.646832+0000","last_unstale":"2023-12-19T18:59:44.635418+0000","last_undegraded":"2023-12-19T18:59:44.635418+0000","last_fullsized":"2023-12-19T18:59:44.635418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:18.227682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.687994+0000","last_change":"2023-12-19T18:59:44.664895+0000","last_active":"2023-12-19T18:59:45.687994+0000","last_peered":"2023-12-19T18:59:45.687994+0000","last_clean":"2023-12-19T18:59:45.687994+0000","last_became_active":"2023-12-19T18:59:44.664626+0000","last_became_peered":"2023-12-19T18:59:44.664626+0000","last_unstale":"2023-12-19T18:59:45.687994+0000","last_undegraded":"2023-12-19T18:59:45.687994+0000","last_fullsized":"2023-12-19T18:59:45.687994+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:16:31.965416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.686612+0000","last_change":"2023-12-19T18:59:45.674252+0000","last_active":"2023-12-19T18:59:45.686612+0000","last_peered":"2023-12-19T18:59:45.686612+0000","last_clean":"2023-12-19T18:59:45.686612+0000","last_became_active":"2023-12-19T18:59:45.673949+0000","last_became_peered":"2023-12-19T18:59:45.673949+0000","last_unstale":"2023-12-19T18:59:45.686612+0000","last_undegraded":"2023-12-19T18:59:45.686612+0000","last_fullsized":"2023-12-19T18:59:45.686612+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:08:41.594895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.636186+0000","last_change":"2023-12-19T18:59:26.879579+0000","last_active":"2023-12-19T18:59:44.636186+0000","last_peered":"2023-12-19T18:59:44.636186+0000","last_clean":"2023-12-19T18:59:44.636186+0000","last_became_active":"2023-12-19T18:59:26.879235+0000","last_became_peered":"2023-12-19T18:59:26.879235+0000","last_unstale":"2023-12-19T18:59:44.636186+0000","last_undegraded":"2023-12-19T18:59:44.636186+0000","last_fullsized":"2023-12-19T18:59:44.636186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:46:34.116596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.664512+0000","last_change":"2023-12-19T18:59:27.646888+0000","last_active":"2023-12-19T18:59:44.664512+0000","last_peered":"2023-12-19T18:59:44.664512+0000","last_clean":"2023-12-19T18:59:44.664512+0000","last_became_active":"2023-12-19T18:59:27.646582+0000","last_became_peered":"2023-12-19T18:59:27.646582+0000","last_unstale":"2023-12-19T18:59:44.664512+0000","last_undegraded":"2023-12-19T18:59:44.664512+0000","last_fullsized":"2023-12-19T18:59:44.664512+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:16:25.929004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.665676+0000","last_change":"2023-12-19T18:59:44.668950+0000","last_active":"2023-12-19T18:59:45.665676+0000","last_peered":"2023-12-19T18:59:45.665676+0000","last_clean":"2023-12-19T18:59:45.665676+0000","last_became_active":"2023-12-19T18:59:44.668731+0000","last_became_peered":"2023-12-19T18:59:44.668731+0000","last_unstale":"2023-12-19T18:59:45.665676+0000","last_undegraded":"2023-12-19T18:59:45.665676+0000","last_fullsized":"2023-12-19T18:59:45.665676+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:45.029456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.688163+0000","last_change":"2023-12-19T18:59:45.680241+0000","last_active":"2023-12-19T18:59:45.688163+0000","last_peered":"2023-12-19T18:59:45.688163+0000","last_clean":"2023-12-19T18:59:45.688163+0000","last_became_active":"2023-12-19T18:59:45.679925+0000","last_became_peered":"2023-12-19T18:59:45.679925+0000","last_unstale":"2023-12-19T18:59:45.688163+0000","last_undegraded":"2023-12-19T18:59:45.688163+0000","last_fullsized":"2023-12-19T18:59:45.688163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:34:27.933445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.648362+0000","last_change":"2023-12-19T18:59:26.889176+0000","last_active":"2023-12-19T18:59:44.648362+0000","last_peered":"2023-12-19T18:59:44.648362+0000","last_clean":"2023-12-19T18:59:44.648362+0000","last_became_active":"2023-12-19T18:59:26.887785+0000","last_became_peered":"2023-12-19T18:59:26.887785+0000","last_unstale":"2023-12-19T18:59:44.648362+0000","last_undegraded":"2023-12-19T18:59:44.648362+0000","last_fullsized":"2023-12-19T18:59:44.648362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:08.227715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.635871+0000","last_change":"2023-12-19T18:59:27.641166+0000","last_active":"2023-12-19T18:59:44.635871+0000","last_peered":"2023-12-19T18:59:44.635871+0000","last_clean":"2023-12-19T18:59:44.635871+0000","last_became_active":"2023-12-19T18:59:27.640863+0000","last_became_peered":"2023-12-19T18:59:27.640863+0000","last_unstale":"2023-12-19T18:59:44.635871+0000","last_undegraded":"2023-12-19T18:59:44.635871+0000","last_fullsized":"2023-12-19T18:59:44.635871+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:09.230491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.655464+0000","last_change":"2023-12-19T18:59:44.659736+0000","last_active":"2023-12-19T18:59:45.655464+0000","last_peered":"2023-12-19T18:59:45.655464+0000","last_clean":"2023-12-19T18:59:45.655464+0000","last_became_active":"2023-12-19T18:59:44.659482+0000","last_became_peered":"2023-12-19T18:59:44.659482+0000","last_unstale":"2023-12-19T18:59:45.655464+0000","last_undegraded":"2023-12-19T18:59:45.655464+0000","last_fullsized":"2023-12-19T18:59:45.655464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:30:37.010239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.682250+0000","last_change":"2023-12-19T18:59:45.673840+0000","last_active":"2023-12-19T18:59:45.682250+0000","last_peered":"2023-12-19T18:59:45.682250+0000","last_clean":"2023-12-19T18:59:45.682250+0000","last_became_active":"2023-12-19T18:59:45.673549+0000","last_became_peered":"2023-12-19T18:59:45.673549+0000","last_unstale":"2023-12-19T18:59:45.682250+0000","last_undegraded":"2023-12-19T18:59:45.682250+0000","last_fullsized":"2023-12-19T18:59:45.682250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:56.917422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"31'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.636322+0000","last_change":"2023-12-19T18:59:26.887521+0000","last_active":"2023-12-19T18:59:44.636322+0000","last_peered":"2023-12-19T18:59:44.636322+0000","last_clean":"2023-12-19T18:59:44.636322+0000","last_became_active":"2023-12-19T18:59:26.887126+0000","last_became_peered":"2023-12-19T18:59:26.887126+0000","last_unstale":"2023-12-19T18:59:44.636322+0000","last_undegraded":"2023-12-19T18:59:44.636322+0000","last_fullsized":"2023-12-19T18:59:44.636322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:50.105990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.656287+0000","last_change":"2023-12-19T18:59:27.655676+0000","last_active":"2023-12-19T18:59:44.656287+0000","last_peered":"2023-12-19T18:59:44.656287+0000","last_clean":"2023-12-19T18:59:44.656287+0000","last_became_active":"2023-12-19T18:59:27.655392+0000","last_became_peered":"2023-12-19T18:59:27.655392+0000","last_unstale":"2023-12-19T18:59:44.656287+0000","last_undegraded":"2023-12-19T18:59:44.656287+0000","last_fullsized":"2023-12-19T18:59:44.656287+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:43.891549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.664264+0000","last_change":"2023-12-19T18:59:44.667397+0000","last_active":"2023-12-19T18:59:45.664264+0000","last_peered":"2023-12-19T18:59:45.664264+0000","last_clean":"2023-12-19T18:59:45.664264+0000","last_became_active":"2023-12-19T18:59:44.667173+0000","last_became_peered":"2023-12-19T18:59:44.667173+0000","last_unstale":"2023-12-19T18:59:45.664264+0000","last_undegraded":"2023-12-19T18:59:45.664264+0000","last_fullsized":"2023-12-19T18:59:45.664264+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:05:54.549117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.694441+0000","last_change":"2023-12-19T18:59:45.688666+0000","last_active":"2023-12-19T18:59:45.694441+0000","last_peered":"2023-12-19T18:59:45.694441+0000","last_clean":"2023-12-19T18:59:45.694441+0000","last_became_active":"2023-12-19T18:59:45.688409+0000","last_became_peered":"2023-12-19T18:59:45.688409+0000","last_unstale":"2023-12-19T18:59:45.694441+0000","last_undegraded":"2023-12-19T18:59:45.694441+0000","last_fullsized":"2023-12-19T18:59:45.694441+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:02:19.801218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.647305+0000","last_change":"2023-12-19T18:59:26.879375+0000","last_active":"2023-12-19T18:59:44.647305+0000","last_peered":"2023-12-19T18:59:44.647305+0000","last_clean":"2023-12-19T18:59:44.647305+0000","last_became_active":"2023-12-19T18:59:26.879043+0000","last_became_peered":"2023-12-19T18:59:26.879043+0000","last_unstale":"2023-12-19T18:59:44.647305+0000","last_undegraded":"2023-12-19T18:59:44.647305+0000","last_fullsized":"2023-12-19T18:59:44.647305+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:09.669999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.652428+0000","last_change":"2023-12-19T18:59:27.651053+0000","last_active":"2023-12-19T18:59:44.652428+0000","last_peered":"2023-12-19T18:59:44.652428+0000","last_clean":"2023-12-19T18:59:44.652428+0000","last_became_active":"2023-12-19T18:59:27.650721+0000","last_became_peered":"2023-12-19T18:59:27.650721+0000","last_unstale":"2023-12-19T18:59:44.652428+0000","last_undegraded":"2023-12-19T18:59:44.652428+0000","last_fullsized":"2023-12-19T18:59:44.652428+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:36:10.546639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.658605+0000","last_change":"2023-12-19T18:59:44.661262+0000","last_active":"2023-12-19T18:59:45.658605+0000","last_peered":"2023-12-19T18:59:45.658605+0000","last_clean":"2023-12-19T18:59:45.658605+0000","last_became_active":"2023-12-19T18:59:44.660958+0000","last_became_peered":"2023-12-19T18:59:44.660958+0000","last_unstale":"2023-12-19T18:59:45.658605+0000","last_undegraded":"2023-12-19T18:59:45.658605+0000","last_fullsized":"2023-12-19T18:59:45.658605+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:31:14.850235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.682575+0000","last_change":"2023-12-19T18:59:45.671940+0000","last_active":"2023-12-19T18:59:45.682575+0000","last_peered":"2023-12-19T18:59:45.682575+0000","last_clean":"2023-12-19T18:59:45.682575+0000","last_became_active":"2023-12-19T18:59:45.671592+0000","last_became_peered":"2023-12-19T18:59:45.671592+0000","last_unstale":"2023-12-19T18:59:45.682575+0000","last_undegraded":"2023-12-19T18:59:45.682575+0000","last_fullsized":"2023-12-19T18:59:45.682575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:02:19.801218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.650061+0000","last_change":"2023-12-19T18:59:26.881655+0000","last_active":"2023-12-19T18:59:44.650061+0000","last_peered":"2023-12-19T18:59:44.650061+0000","last_clean":"2023-12-19T18:59:44.650061+0000","last_became_active":"2023-12-19T18:59:26.881378+0000","last_became_peered":"2023-12-19T18:59:26.881378+0000","last_unstale":"2023-12-19T18:59:44.650061+0000","last_undegraded":"2023-12-19T18:59:44.650061+0000","last_fullsized":"2023-12-19T18:59:44.650061+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:17.224906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641860+0000","last_change":"2023-12-19T18:59:27.644532+0000","last_active":"2023-12-19T18:59:44.641860+0000","last_peered":"2023-12-19T18:59:44.641860+0000","last_clean":"2023-12-19T18:59:44.641860+0000","last_became_active":"2023-12-19T18:59:27.642863+0000","last_became_peered":"2023-12-19T18:59:27.642863+0000","last_unstale":"2023-12-19T18:59:44.641860+0000","last_undegraded":"2023-12-19T18:59:44.641860+0000","last_fullsized":"2023-12-19T18:59:44.641860+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:45.789974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.655160+0000","last_change":"2023-12-19T18:59:44.661534+0000","last_active":"2023-12-19T18:59:45.655160+0000","last_peered":"2023-12-19T18:59:45.655160+0000","last_clean":"2023-12-19T18:59:45.655160+0000","last_became_active":"2023-12-19T18:59:44.661259+0000","last_became_peered":"2023-12-19T18:59:44.661259+0000","last_unstale":"2023-12-19T18:59:45.655160+0000","last_undegraded":"2023-12-19T18:59:45.655160+0000","last_fullsized":"2023-12-19T18:59:45.655160+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:26:59.141157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.677896+0000","last_change":"2023-12-19T18:59:45.672850+0000","last_active":"2023-12-19T18:59:45.677896+0000","last_peered":"2023-12-19T18:59:45.677896+0000","last_clean":"2023-12-19T18:59:45.677896+0000","last_became_active":"2023-12-19T18:59:45.670690+0000","last_became_peered":"2023-12-19T18:59:45.670690+0000","last_unstale":"2023-12-19T18:59:45.677896+0000","last_undegraded":"2023-12-19T18:59:45.677896+0000","last_fullsized":"2023-12-19T18:59:45.677896+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:03:06.872855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641646+0000","last_change":"2023-12-19T18:59:26.884674+0000","last_active":"2023-12-19T18:59:44.641646+0000","last_peered":"2023-12-19T18:59:44.641646+0000","last_clean":"2023-12-19T18:59:44.641646+0000","last_became_active":"2023-12-19T18:59:26.884402+0000","last_became_peered":"2023-12-19T18:59:26.884402+0000","last_unstale":"2023-12-19T18:59:44.641646+0000","last_undegraded":"2023-12-19T18:59:44.641646+0000","last_fullsized":"2023-12-19T18:59:44.641646+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:36:45.699332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.654480+0000","last_change":"2023-12-19T18:59:27.637111+0000","last_active":"2023-12-19T18:59:44.654480+0000","last_peered":"2023-12-19T18:59:44.654480+0000","last_clean":"2023-12-19T18:59:44.654480+0000","last_became_active":"2023-12-19T18:59:27.636672+0000","last_became_peered":"2023-12-19T18:59:27.636672+0000","last_unstale":"2023-12-19T18:59:44.654480+0000","last_undegraded":"2023-12-19T18:59:44.654480+0000","last_fullsized":"2023-12-19T18:59:44.654480+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:39:12.866107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.698324+0000","last_change":"2023-12-19T18:59:44.657059+0000","last_active":"2023-12-19T18:59:45.698324+0000","last_peered":"2023-12-19T18:59:45.698324+0000","last_clean":"2023-12-19T18:59:45.698324+0000","last_became_active":"2023-12-19T18:59:44.656547+0000","last_became_peered":"2023-12-19T18:59:44.656547+0000","last_unstale":"2023-12-19T18:59:45.698324+0000","last_undegraded":"2023-12-19T18:59:45.698324+0000","last_fullsized":"2023-12-19T18:59:45.698324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:18.589414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.695582+0000","last_change":"2023-12-19T18:59:45.688771+0000","last_active":"2023-12-19T18:59:45.695582+0000","last_peered":"2023-12-19T18:59:45.695582+0000","last_clean":"2023-12-19T18:59:45.695582+0000","last_became_active":"2023-12-19T18:59:45.688471+0000","last_became_peered":"2023-12-19T18:59:45.688471+0000","last_unstale":"2023-12-19T18:59:45.695582+0000","last_undegraded":"2023-12-19T18:59:45.695582+0000","last_fullsized":"2023-12-19T18:59:45.695582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:12.570837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.664558+0000","last_change":"2023-12-19T18:59:26.885971+0000","last_active":"2023-12-19T18:59:44.664558+0000","last_peered":"2023-12-19T18:59:44.664558+0000","last_clean":"2023-12-19T18:59:44.664558+0000","last_became_active":"2023-12-19T18:59:26.885633+0000","last_became_peered":"2023-12-19T18:59:26.885633+0000","last_unstale":"2023-12-19T18:59:44.664558+0000","last_undegraded":"2023-12-19T18:59:44.664558+0000","last_fullsized":"2023-12-19T18:59:44.664558+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:22:59.820667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.652770+0000","last_change":"2023-12-19T18:59:27.637097+0000","last_active":"2023-12-19T18:59:44.652770+0000","last_peered":"2023-12-19T18:59:44.652770+0000","last_clean":"2023-12-19T18:59:44.652770+0000","last_became_active":"2023-12-19T18:59:27.636689+0000","last_became_peered":"2023-12-19T18:59:27.636689+0000","last_unstale":"2023-12-19T18:59:44.652770+0000","last_undegraded":"2023-12-19T18:59:44.652770+0000","last_fullsized":"2023-12-19T18:59:44.652770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:13:32.952346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.655655+0000","last_change":"2023-12-19T18:59:44.656780+0000","last_active":"2023-12-19T18:59:45.655655+0000","last_peered":"2023-12-19T18:59:45.655655+0000","last_clean":"2023-12-19T18:59:45.655655+0000","last_became_active":"2023-12-19T18:59:44.656477+0000","last_became_peered":"2023-12-19T18:59:44.656477+0000","last_unstale":"2023-12-19T18:59:45.655655+0000","last_undegraded":"2023-12-19T18:59:45.655655+0000","last_fullsized":"2023-12-19T18:59:45.655655+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:16:31.965416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.681781+0000","last_change":"2023-12-19T18:59:45.674624+0000","last_active":"2023-12-19T18:59:45.681781+0000","last_peered":"2023-12-19T18:59:45.681781+0000","last_clean":"2023-12-19T18:59:45.681781+0000","last_became_active":"2023-12-19T18:59:45.671022+0000","last_became_peered":"2023-12-19T18:59:45.671022+0000","last_unstale":"2023-12-19T18:59:45.681781+0000","last_undegraded":"2023-12-19T18:59:45.681781+0000","last_fullsized":"2023-12-19T18:59:45.681781+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:54:08.886906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.635504+0000","last_change":"2023-12-19T18:59:26.887588+0000","last_active":"2023-12-19T18:59:44.635504+0000","last_peered":"2023-12-19T18:59:44.635504+0000","last_clean":"2023-12-19T18:59:44.635504+0000","last_became_active":"2023-12-19T18:59:26.887245+0000","last_became_peered":"2023-12-19T18:59:26.887245+0000","last_unstale":"2023-12-19T18:59:44.635504+0000","last_undegraded":"2023-12-19T18:59:44.635504+0000","last_fullsized":"2023-12-19T18:59:44.635504+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:36:45.699332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.652124+0000","last_change":"2023-12-19T18:59:27.645569+0000","last_active":"2023-12-19T18:59:44.652124+0000","last_peered":"2023-12-19T18:59:44.652124+0000","last_clean":"2023-12-19T18:59:44.652124+0000","last_became_active":"2023-12-19T18:59:27.645356+0000","last_became_peered":"2023-12-19T18:59:27.645356+0000","last_unstale":"2023-12-19T18:59:44.652124+0000","last_undegraded":"2023-12-19T18:59:44.652124+0000","last_fullsized":"2023-12-19T18:59:44.652124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:17:15.950035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.676804+0000","last_change":"2023-12-19T18:59:44.653726+0000","last_active":"2023-12-19T18:59:45.676804+0000","last_peered":"2023-12-19T18:59:45.676804+0000","last_clean":"2023-12-19T18:59:45.676804+0000","last_became_active":"2023-12-19T18:59:44.653428+0000","last_became_peered":"2023-12-19T18:59:44.653428+0000","last_unstale":"2023-12-19T18:59:45.676804+0000","last_undegraded":"2023-12-19T18:59:45.676804+0000","last_fullsized":"2023-12-19T18:59:45.676804+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:26:59.141157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.695733+0000","last_change":"2023-12-19T18:59:45.676334+0000","last_active":"2023-12-19T18:59:45.695733+0000","last_peered":"2023-12-19T18:59:45.695733+0000","last_clean":"2023-12-19T18:59:45.695733+0000","last_became_active":"2023-12-19T18:59:45.674586+0000","last_became_peered":"2023-12-19T18:59:45.674586+0000","last_unstale":"2023-12-19T18:59:45.695733+0000","last_undegraded":"2023-12-19T18:59:45.695733+0000","last_fullsized":"2023-12-19T18:59:45.695733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:28:08.544813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642107+0000","last_change":"2023-12-19T18:59:26.883881+0000","last_active":"2023-12-19T18:59:44.642107+0000","last_peered":"2023-12-19T18:59:44.642107+0000","last_clean":"2023-12-19T18:59:44.642107+0000","last_became_active":"2023-12-19T18:59:26.883612+0000","last_became_peered":"2023-12-19T18:59:26.883612+0000","last_unstale":"2023-12-19T18:59:44.642107+0000","last_undegraded":"2023-12-19T18:59:44.642107+0000","last_fullsized":"2023-12-19T18:59:44.642107+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:13:18.250528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.652253+0000","last_change":"2023-12-19T18:59:27.641900+0000","last_active":"2023-12-19T18:59:44.652253+0000","last_peered":"2023-12-19T18:59:44.652253+0000","last_clean":"2023-12-19T18:59:44.652253+0000","last_became_active":"2023-12-19T18:59:27.641620+0000","last_became_peered":"2023-12-19T18:59:27.641620+0000","last_unstale":"2023-12-19T18:59:44.652253+0000","last_undegraded":"2023-12-19T18:59:44.652253+0000","last_fullsized":"2023-12-19T18:59:44.652253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:15.145079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.702608+0000","last_change":"2023-12-19T18:59:44.657822+0000","last_active":"2023-12-19T18:59:45.702608+0000","last_peered":"2023-12-19T18:59:45.702608+0000","last_clean":"2023-12-19T18:59:45.702608+0000","last_became_active":"2023-12-19T18:59:44.657410+0000","last_became_peered":"2023-12-19T18:59:44.657410+0000","last_unstale":"2023-12-19T18:59:45.702608+0000","last_undegraded":"2023-12-19T18:59:45.702608+0000","last_fullsized":"2023-12-19T18:59:45.702608+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:26:59.141157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.681750+0000","last_change":"2023-12-19T18:59:45.672642+0000","last_active":"2023-12-19T18:59:45.681750+0000","last_peered":"2023-12-19T18:59:45.681750+0000","last_clean":"2023-12-19T18:59:45.681750+0000","last_became_active":"2023-12-19T18:59:45.672369+0000","last_became_peered":"2023-12-19T18:59:45.672369+0000","last_unstale":"2023-12-19T18:59:45.681750+0000","last_undegraded":"2023-12-19T18:59:45.681750+0000","last_fullsized":"2023-12-19T18:59:45.681750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:06:12.867380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642813+0000","last_change":"2023-12-19T18:59:26.882228+0000","last_active":"2023-12-19T18:59:44.642813+0000","last_peered":"2023-12-19T18:59:44.642813+0000","last_clean":"2023-12-19T18:59:44.642813+0000","last_became_active":"2023-12-19T18:59:26.881940+0000","last_became_peered":"2023-12-19T18:59:26.881940+0000","last_unstale":"2023-12-19T18:59:44.642813+0000","last_undegraded":"2023-12-19T18:59:44.642813+0000","last_fullsized":"2023-12-19T18:59:44.642813+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:16:24.926229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.648144+0000","last_change":"2023-12-19T18:59:27.646416+0000","last_active":"2023-12-19T18:59:44.648144+0000","last_peered":"2023-12-19T18:59:44.648144+0000","last_clean":"2023-12-19T18:59:44.648144+0000","last_became_active":"2023-12-19T18:59:27.645875+0000","last_became_peered":"2023-12-19T18:59:27.645875+0000","last_unstale":"2023-12-19T18:59:44.648144+0000","last_undegraded":"2023-12-19T18:59:44.648144+0000","last_fullsized":"2023-12-19T18:59:44.648144+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:48:53.738532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.696424+0000","last_change":"2023-12-19T18:59:44.660328+0000","last_active":"2023-12-19T18:59:45.696424+0000","last_peered":"2023-12-19T18:59:45.696424+0000","last_clean":"2023-12-19T18:59:45.696424+0000","last_became_active":"2023-12-19T18:59:44.660065+0000","last_became_peered":"2023-12-19T18:59:44.660065+0000","last_unstale":"2023-12-19T18:59:45.696424+0000","last_undegraded":"2023-12-19T18:59:45.696424+0000","last_fullsized":"2023-12-19T18:59:45.696424+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:46:24.985643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.688084+0000","last_change":"2023-12-19T18:59:45.680910+0000","last_active":"2023-12-19T18:59:45.688084+0000","last_peered":"2023-12-19T18:59:45.688084+0000","last_clean":"2023-12-19T18:59:45.688084+0000","last_became_active":"2023-12-19T18:59:45.679457+0000","last_became_peered":"2023-12-19T18:59:45.679457+0000","last_unstale":"2023-12-19T18:59:45.688084+0000","last_undegraded":"2023-12-19T18:59:45.688084+0000","last_fullsized":"2023-12-19T18:59:45.688084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:12.570837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.643027+0000","last_change":"2023-12-19T18:59:26.877734+0000","last_active":"2023-12-19T18:59:44.643027+0000","last_peered":"2023-12-19T18:59:44.643027+0000","last_clean":"2023-12-19T18:59:44.643027+0000","last_became_active":"2023-12-19T18:59:26.876141+0000","last_became_peered":"2023-12-19T18:59:26.876141+0000","last_unstale":"2023-12-19T18:59:44.643027+0000","last_undegraded":"2023-12-19T18:59:44.643027+0000","last_fullsized":"2023-12-19T18:59:44.643027+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:50.105990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.656189+0000","last_change":"2023-12-19T18:59:27.655732+0000","last_active":"2023-12-19T18:59:44.656189+0000","last_peered":"2023-12-19T18:59:44.656189+0000","last_clean":"2023-12-19T18:59:44.656189+0000","last_became_active":"2023-12-19T18:59:27.655473+0000","last_became_peered":"2023-12-19T18:59:27.655473+0000","last_unstale":"2023-12-19T18:59:44.656189+0000","last_undegraded":"2023-12-19T18:59:44.656189+0000","last_fullsized":"2023-12-19T18:59:44.656189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:24:42.172134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.655788+0000","last_change":"2023-12-19T18:59:44.668703+0000","last_active":"2023-12-19T18:59:45.655788+0000","last_peered":"2023-12-19T18:59:45.655788+0000","last_clean":"2023-12-19T18:59:45.655788+0000","last_became_active":"2023-12-19T18:59:44.668422+0000","last_became_peered":"2023-12-19T18:59:44.668422+0000","last_unstale":"2023-12-19T18:59:45.655788+0000","last_undegraded":"2023-12-19T18:59:45.655788+0000","last_fullsized":"2023-12-19T18:59:45.655788+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:37:48.255835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.685652+0000","last_change":"2023-12-19T18:59:45.673349+0000","last_active":"2023-12-19T18:59:45.685652+0000","last_peered":"2023-12-19T18:59:45.685652+0000","last_clean":"2023-12-19T18:59:45.685652+0000","last_became_active":"2023-12-19T18:59:45.672865+0000","last_became_peered":"2023-12-19T18:59:45.672865+0000","last_unstale":"2023-12-19T18:59:45.685652+0000","last_undegraded":"2023-12-19T18:59:45.685652+0000","last_fullsized":"2023-12-19T18:59:45.685652+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:57.738035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.647253+0000","last_change":"2023-12-19T18:59:26.891254+0000","last_active":"2023-12-19T18:59:44.647253+0000","last_peered":"2023-12-19T18:59:44.647253+0000","last_clean":"2023-12-19T18:59:44.647253+0000","last_became_active":"2023-12-19T18:59:26.890803+0000","last_became_peered":"2023-12-19T18:59:26.890803+0000","last_unstale":"2023-12-19T18:59:44.647253+0000","last_undegraded":"2023-12-19T18:59:44.647253+0000","last_fullsized":"2023-12-19T18:59:44.647253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:46:07.210705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.643026+0000","last_change":"2023-12-19T18:59:27.638748+0000","last_active":"2023-12-19T18:59:44.643026+0000","last_peered":"2023-12-19T18:59:44.643026+0000","last_clean":"2023-12-19T18:59:44.643026+0000","last_became_active":"2023-12-19T18:59:27.637898+0000","last_became_peered":"2023-12-19T18:59:27.637898+0000","last_unstale":"2023-12-19T18:59:44.643026+0000","last_undegraded":"2023-12-19T18:59:44.643026+0000","last_fullsized":"2023-12-19T18:59:44.643026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:09.230491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.692617+0000","last_change":"2023-12-19T18:59:44.661839+0000","last_active":"2023-12-19T18:59:45.692617+0000","last_peered":"2023-12-19T18:59:45.692617+0000","last_clean":"2023-12-19T18:59:45.692617+0000","last_became_active":"2023-12-19T18:59:44.661597+0000","last_became_peered":"2023-12-19T18:59:44.661597+0000","last_unstale":"2023-12-19T18:59:45.692617+0000","last_undegraded":"2023-12-19T18:59:45.692617+0000","last_fullsized":"2023-12-19T18:59:45.692617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:49:22.446873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.698549+0000","last_change":"2023-12-19T18:59:45.693327+0000","last_active":"2023-12-19T18:59:45.698549+0000","last_peered":"2023-12-19T18:59:45.698549+0000","last_clean":"2023-12-19T18:59:45.698549+0000","last_became_active":"2023-12-19T18:59:45.677229+0000","last_became_peered":"2023-12-19T18:59:45.677229+0000","last_unstale":"2023-12-19T18:59:45.698549+0000","last_undegraded":"2023-12-19T18:59:45.698549+0000","last_fullsized":"2023-12-19T18:59:45.698549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:57.351859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"30'8","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.654065+0000","last_change":"2023-12-19T18:59:26.885293+0000","last_active":"2023-12-19T18:59:44.654065+0000","last_peered":"2023-12-19T18:59:44.654065+0000","last_clean":"2023-12-19T18:59:44.654065+0000","last_became_active":"2023-12-19T18:59:26.885020+0000","last_became_peered":"2023-12-19T18:59:26.885020+0000","last_unstale":"2023-12-19T18:59:44.654065+0000","last_undegraded":"2023-12-19T18:59:44.654065+0000","last_fullsized":"2023-12-19T18:59:44.654065+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:42.040589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.664347+0000","last_change":"2023-12-19T18:59:27.651314+0000","last_active":"2023-12-19T18:59:44.664347+0000","last_peered":"2023-12-19T18:59:44.664347+0000","last_clean":"2023-12-19T18:59:44.664347+0000","last_became_active":"2023-12-19T18:59:27.650926+0000","last_became_peered":"2023-12-19T18:59:27.650926+0000","last_unstale":"2023-12-19T18:59:44.664347+0000","last_undegraded":"2023-12-19T18:59:44.664347+0000","last_fullsized":"2023-12-19T18:59:44.664347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:18.227682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.656127+0000","last_change":"2023-12-19T18:59:44.654834+0000","last_active":"2023-12-19T18:59:45.656127+0000","last_peered":"2023-12-19T18:59:45.656127+0000","last_clean":"2023-12-19T18:59:45.656127+0000","last_became_active":"2023-12-19T18:59:44.654536+0000","last_became_peered":"2023-12-19T18:59:44.654536+0000","last_unstale":"2023-12-19T18:59:45.656127+0000","last_undegraded":"2023-12-19T18:59:45.656127+0000","last_fullsized":"2023-12-19T18:59:45.656127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:29.424024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.691731+0000","last_change":"2023-12-19T18:59:45.682531+0000","last_active":"2023-12-19T18:59:45.691731+0000","last_peered":"2023-12-19T18:59:45.691731+0000","last_clean":"2023-12-19T18:59:45.691731+0000","last_became_active":"2023-12-19T18:59:45.682161+0000","last_became_peered":"2023-12-19T18:59:45.682161+0000","last_unstale":"2023-12-19T18:59:45.691731+0000","last_undegraded":"2023-12-19T18:59:45.691731+0000","last_fullsized":"2023-12-19T18:59:45.691731+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:57.351859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.654075+0000","last_change":"2023-12-19T18:59:26.874018+0000","last_active":"2023-12-19T18:59:44.654075+0000","last_peered":"2023-12-19T18:59:44.654075+0000","last_clean":"2023-12-19T18:59:44.654075+0000","last_became_active":"2023-12-19T18:59:26.873769+0000","last_became_peered":"2023-12-19T18:59:26.873769+0000","last_unstale":"2023-12-19T18:59:44.654075+0000","last_undegraded":"2023-12-19T18:59:44.654075+0000","last_fullsized":"2023-12-19T18:59:44.654075+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:44.787198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641210+0000","last_change":"2023-12-19T18:59:27.644252+0000","last_active":"2023-12-19T18:59:44.641210+0000","last_peered":"2023-12-19T18:59:44.641210+0000","last_clean":"2023-12-19T18:59:44.641210+0000","last_became_active":"2023-12-19T18:59:27.643954+0000","last_became_peered":"2023-12-19T18:59:27.643954+0000","last_unstale":"2023-12-19T18:59:44.641210+0000","last_undegraded":"2023-12-19T18:59:44.641210+0000","last_fullsized":"2023-12-19T18:59:44.641210+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:48:53.738532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.700908+0000","last_change":"2023-12-19T18:59:44.665203+0000","last_active":"2023-12-19T18:59:45.700908+0000","last_peered":"2023-12-19T18:59:45.700908+0000","last_clean":"2023-12-19T18:59:45.700908+0000","last_became_active":"2023-12-19T18:59:44.664739+0000","last_became_peered":"2023-12-19T18:59:44.664739+0000","last_unstale":"2023-12-19T18:59:45.700908+0000","last_undegraded":"2023-12-19T18:59:45.700908+0000","last_fullsized":"2023-12-19T18:59:45.700908+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:22:01.070678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.692737+0000","last_change":"2023-12-19T18:59:45.681440+0000","last_active":"2023-12-19T18:59:45.692737+0000","last_peered":"2023-12-19T18:59:45.692737+0000","last_clean":"2023-12-19T18:59:45.692737+0000","last_became_active":"2023-12-19T18:59:45.680899+0000","last_became_peered":"2023-12-19T18:59:45.680899+0000","last_unstale":"2023-12-19T18:59:45.692737+0000","last_undegraded":"2023-12-19T18:59:45.692737+0000","last_fullsized":"2023-12-19T18:59:45.692737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:34:39.645053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.643713+0000","last_change":"2023-12-19T18:59:26.885753+0000","last_active":"2023-12-19T18:59:44.643713+0000","last_peered":"2023-12-19T18:59:44.643713+0000","last_clean":"2023-12-19T18:59:44.643713+0000","last_became_active":"2023-12-19T18:59:26.885304+0000","last_became_peered":"2023-12-19T18:59:26.885304+0000","last_unstale":"2023-12-19T18:59:44.643713+0000","last_undegraded":"2023-12-19T18:59:44.643713+0000","last_fullsized":"2023-12-19T18:59:44.643713+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:17.224906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.656347+0000","last_change":"2023-12-19T18:59:27.639693+0000","last_active":"2023-12-19T18:59:44.656347+0000","last_peered":"2023-12-19T18:59:44.656347+0000","last_clean":"2023-12-19T18:59:44.656347+0000","last_became_active":"2023-12-19T18:59:27.639369+0000","last_became_peered":"2023-12-19T18:59:27.639369+0000","last_unstale":"2023-12-19T18:59:44.656347+0000","last_undegraded":"2023-12-19T18:59:44.656347+0000","last_fullsized":"2023-12-19T18:59:44.656347+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:43.891549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.708042+0000","last_change":"2023-12-19T18:59:44.666436+0000","last_active":"2023-12-19T18:59:45.708042+0000","last_peered":"2023-12-19T18:59:45.708042+0000","last_clean":"2023-12-19T18:59:45.708042+0000","last_became_active":"2023-12-19T18:59:44.666187+0000","last_became_peered":"2023-12-19T18:59:44.666187+0000","last_unstale":"2023-12-19T18:59:45.708042+0000","last_undegraded":"2023-12-19T18:59:45.708042+0000","last_fullsized":"2023-12-19T18:59:45.708042+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:08:40.588917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.684100+0000","last_change":"2023-12-19T18:59:45.675836+0000","last_active":"2023-12-19T18:59:45.684100+0000","last_peered":"2023-12-19T18:59:45.684100+0000","last_clean":"2023-12-19T18:59:45.684100+0000","last_became_active":"2023-12-19T18:59:45.673358+0000","last_became_peered":"2023-12-19T18:59:45.673358+0000","last_unstale":"2023-12-19T18:59:45.684100+0000","last_undegraded":"2023-12-19T18:59:45.684100+0000","last_fullsized":"2023-12-19T18:59:45.684100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:56.917422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642481+0000","last_change":"2023-12-19T18:59:26.878624+0000","last_active":"2023-12-19T18:59:44.642481+0000","last_peered":"2023-12-19T18:59:44.642481+0000","last_clean":"2023-12-19T18:59:44.642481+0000","last_became_active":"2023-12-19T18:59:26.878292+0000","last_became_peered":"2023-12-19T18:59:26.878292+0000","last_unstale":"2023-12-19T18:59:44.642481+0000","last_undegraded":"2023-12-19T18:59:44.642481+0000","last_fullsized":"2023-12-19T18:59:44.642481+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:22:59.820667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.643626+0000","last_change":"2023-12-19T18:59:27.651050+0000","last_active":"2023-12-19T18:59:44.643626+0000","last_peered":"2023-12-19T18:59:44.643626+0000","last_clean":"2023-12-19T18:59:44.643626+0000","last_became_active":"2023-12-19T18:59:27.650758+0000","last_became_peered":"2023-12-19T18:59:27.650758+0000","last_unstale":"2023-12-19T18:59:44.643626+0000","last_undegraded":"2023-12-19T18:59:44.643626+0000","last_fullsized":"2023-12-19T18:59:44.643626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:30:07.550029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.656527+0000","last_change":"2023-12-19T18:59:44.662108+0000","last_active":"2023-12-19T18:59:45.656527+0000","last_peered":"2023-12-19T18:59:45.656527+0000","last_clean":"2023-12-19T18:59:45.656527+0000","last_became_active":"2023-12-19T18:59:44.660356+0000","last_became_peered":"2023-12-19T18:59:44.660356+0000","last_unstale":"2023-12-19T18:59:45.656527+0000","last_undegraded":"2023-12-19T18:59:45.656527+0000","last_fullsized":"2023-12-19T18:59:45.656527+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:55:06.032043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.673796+0000","last_change":"2023-12-19T18:59:45.668869+0000","last_active":"2023-12-19T18:59:45.673796+0000","last_peered":"2023-12-19T18:59:45.673796+0000","last_clean":"2023-12-19T18:59:45.673796+0000","last_became_active":"2023-12-19T18:59:45.668457+0000","last_became_peered":"2023-12-19T18:59:45.668457+0000","last_unstale":"2023-12-19T18:59:45.673796+0000","last_undegraded":"2023-12-19T18:59:45.673796+0000","last_fullsized":"2023-12-19T18:59:45.673796+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:49:23.452851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"31'8","reported_seq":23,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658489+0000","last_change":"2023-12-19T18:59:26.884311+0000","last_active":"2023-12-19T18:59:44.658489+0000","last_peered":"2023-12-19T18:59:44.658489+0000","last_clean":"2023-12-19T18:59:44.658489+0000","last_became_active":"2023-12-19T18:59:26.883965+0000","last_became_peered":"2023-12-19T18:59:26.883965+0000","last_unstale":"2023-12-19T18:59:44.658489+0000","last_undegraded":"2023-12-19T18:59:44.658489+0000","last_fullsized":"2023-12-19T18:59:44.658489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:51:58.960159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658468+0000","last_change":"2023-12-19T18:59:27.655885+0000","last_active":"2023-12-19T18:59:44.658468+0000","last_peered":"2023-12-19T18:59:44.658468+0000","last_clean":"2023-12-19T18:59:44.658468+0000","last_became_active":"2023-12-19T18:59:27.650924+0000","last_became_peered":"2023-12-19T18:59:27.650924+0000","last_unstale":"2023-12-19T18:59:44.658468+0000","last_undegraded":"2023-12-19T18:59:44.658468+0000","last_fullsized":"2023-12-19T18:59:44.658468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:33:33.472556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.687763+0000","last_change":"2023-12-19T18:59:44.655159+0000","last_active":"2023-12-19T18:59:45.687763+0000","last_peered":"2023-12-19T18:59:45.687763+0000","last_clean":"2023-12-19T18:59:45.687763+0000","last_became_active":"2023-12-19T18:59:44.654641+0000","last_became_peered":"2023-12-19T18:59:44.654641+0000","last_unstale":"2023-12-19T18:59:45.687763+0000","last_undegraded":"2023-12-19T18:59:45.687763+0000","last_fullsized":"2023-12-19T18:59:45.687763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:06:47.044737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.697939+0000","last_change":"2023-12-19T18:59:45.696063+0000","last_active":"2023-12-19T18:59:45.697939+0000","last_peered":"2023-12-19T18:59:45.697939+0000","last_clean":"2023-12-19T18:59:45.697939+0000","last_became_active":"2023-12-19T18:59:45.695803+0000","last_became_peered":"2023-12-19T18:59:45.695803+0000","last_unstale":"2023-12-19T18:59:45.697939+0000","last_undegraded":"2023-12-19T18:59:45.697939+0000","last_fullsized":"2023-12-19T18:59:45.697939+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:53.633313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"30'3","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658646+0000","last_change":"2023-12-19T18:59:26.880783+0000","last_active":"2023-12-19T18:59:44.658646+0000","last_peered":"2023-12-19T18:59:44.658646+0000","last_clean":"2023-12-19T18:59:44.658646+0000","last_became_active":"2023-12-19T18:59:26.880598+0000","last_became_peered":"2023-12-19T18:59:26.880598+0000","last_unstale":"2023-12-19T18:59:44.658646+0000","last_undegraded":"2023-12-19T18:59:44.658646+0000","last_fullsized":"2023-12-19T18:59:44.658646+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:48:52.735756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658442+0000","last_change":"2023-12-19T18:59:27.643508+0000","last_active":"2023-12-19T18:59:44.658442+0000","last_peered":"2023-12-19T18:59:44.658442+0000","last_clean":"2023-12-19T18:59:44.658442+0000","last_became_active":"2023-12-19T18:59:27.643200+0000","last_became_peered":"2023-12-19T18:59:27.643200+0000","last_unstale":"2023-12-19T18:59:44.658442+0000","last_undegraded":"2023-12-19T18:59:44.658442+0000","last_fullsized":"2023-12-19T18:59:44.658442+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:50.766673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.677290+0000","last_change":"2023-12-19T18:59:44.652015+0000","last_active":"2023-12-19T18:59:45.677290+0000","last_peered":"2023-12-19T18:59:45.677290+0000","last_clean":"2023-12-19T18:59:45.677290+0000","last_became_active":"2023-12-19T18:59:44.651699+0000","last_became_peered":"2023-12-19T18:59:44.651699+0000","last_unstale":"2023-12-19T18:59:45.677290+0000","last_undegraded":"2023-12-19T18:59:45.677290+0000","last_fullsized":"2023-12-19T18:59:45.677290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:06:47.044737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.692733+0000","last_change":"2023-12-19T18:59:45.681360+0000","last_active":"2023-12-19T18:59:45.692733+0000","last_peered":"2023-12-19T18:59:45.692733+0000","last_clean":"2023-12-19T18:59:45.692733+0000","last_became_active":"2023-12-19T18:59:45.681049+0000","last_became_peered":"2023-12-19T18:59:45.681049+0000","last_unstale":"2023-12-19T18:59:45.692733+0000","last_undegraded":"2023-12-19T18:59:45.692733+0000","last_fullsized":"2023-12-19T18:59:45.692733+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:41:11.128848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.636278+0000","last_change":"2023-12-19T18:59:26.879898+0000","last_active":"2023-12-19T18:59:44.636278+0000","last_peered":"2023-12-19T18:59:44.636278+0000","last_clean":"2023-12-19T18:59:44.636278+0000","last_became_active":"2023-12-19T18:59:26.879150+0000","last_became_peered":"2023-12-19T18:59:26.879150+0000","last_unstale":"2023-12-19T18:59:44.636278+0000","last_undegraded":"2023-12-19T18:59:44.636278+0000","last_fullsized":"2023-12-19T18:59:44.636278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:22:59.820667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658598+0000","last_change":"2023-12-19T18:59:27.640667+0000","last_active":"2023-12-19T18:59:44.658598+0000","last_peered":"2023-12-19T18:59:44.658598+0000","last_clean":"2023-12-19T18:59:44.658598+0000","last_became_active":"2023-12-19T18:59:27.640256+0000","last_became_peered":"2023-12-19T18:59:27.640256+0000","last_unstale":"2023-12-19T18:59:44.658598+0000","last_undegraded":"2023-12-19T18:59:44.658598+0000","last_fullsized":"2023-12-19T18:59:44.658598+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:28:27.867595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.700454+0000","last_change":"2023-12-19T18:59:44.651409+0000","last_active":"2023-12-19T18:59:45.700454+0000","last_peered":"2023-12-19T18:59:45.700454+0000","last_clean":"2023-12-19T18:59:45.700454+0000","last_became_active":"2023-12-19T18:59:44.651054+0000","last_became_peered":"2023-12-19T18:59:44.651054+0000","last_unstale":"2023-12-19T18:59:45.700454+0000","last_undegraded":"2023-12-19T18:59:45.700454+0000","last_fullsized":"2023-12-19T18:59:45.700454+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:26.002653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.689777+0000","last_change":"2023-12-19T18:59:45.678666+0000","last_active":"2023-12-19T18:59:45.689777+0000","last_peered":"2023-12-19T18:59:45.689777+0000","last_clean":"2023-12-19T18:59:45.689777+0000","last_became_active":"2023-12-19T18:59:45.678414+0000","last_became_peered":"2023-12-19T18:59:45.678414+0000","last_unstale":"2023-12-19T18:59:45.689777+0000","last_undegraded":"2023-12-19T18:59:45.689777+0000","last_fullsized":"2023-12-19T18:59:45.689777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:23:48.967944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658591+0000","last_change":"2023-12-19T18:59:26.878383+0000","last_active":"2023-12-19T18:59:44.658591+0000","last_peered":"2023-12-19T18:59:44.658591+0000","last_clean":"2023-12-19T18:59:44.658591+0000","last_became_active":"2023-12-19T18:59:26.877891+0000","last_became_peered":"2023-12-19T18:59:26.877891+0000","last_unstale":"2023-12-19T18:59:44.658591+0000","last_undegraded":"2023-12-19T18:59:44.658591+0000","last_fullsized":"2023-12-19T18:59:44.658591+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:34:09.152530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.656500+0000","last_change":"2023-12-19T18:59:27.653287+0000","last_active":"2023-12-19T18:59:44.656500+0000","last_peered":"2023-12-19T18:59:44.656500+0000","last_clean":"2023-12-19T18:59:44.656500+0000","last_became_active":"2023-12-19T18:59:27.651740+0000","last_became_peered":"2023-12-19T18:59:27.651740+0000","last_unstale":"2023-12-19T18:59:44.656500+0000","last_undegraded":"2023-12-19T18:59:44.656500+0000","last_fullsized":"2023-12-19T18:59:44.656500+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:39.573719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"34'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.696874+0000","last_change":"2023-12-19T18:59:44.662722+0000","last_active":"2023-12-19T18:59:45.696874+0000","last_peered":"2023-12-19T18:59:45.696874+0000","last_clean":"2023-12-19T18:59:45.696874+0000","last_became_active":"2023-12-19T18:59:44.662432+0000","last_became_peered":"2023-12-19T18:59:44.662432+0000","last_unstale":"2023-12-19T18:59:45.696874+0000","last_undegraded":"2023-12-19T18:59:45.696874+0000","last_fullsized":"2023-12-19T18:59:45.696874+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:30:37.010239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.698569+0000","last_change":"2023-12-19T18:59:45.693839+0000","last_active":"2023-12-19T18:59:45.698569+0000","last_peered":"2023-12-19T18:59:45.698569+0000","last_clean":"2023-12-19T18:59:45.698569+0000","last_became_active":"2023-12-19T18:59:45.693568+0000","last_became_peered":"2023-12-19T18:59:45.693568+0000","last_unstale":"2023-12-19T18:59:45.698569+0000","last_undegraded":"2023-12-19T18:59:45.698569+0000","last_fullsized":"2023-12-19T18:59:45.698569+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:50:01.669689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641299+0000","last_change":"2023-12-19T18:59:26.876597+0000","last_active":"2023-12-19T18:59:44.641299+0000","last_peered":"2023-12-19T18:59:44.641299+0000","last_clean":"2023-12-19T18:59:44.641299+0000","last_became_active":"2023-12-19T18:59:26.876270+0000","last_became_peered":"2023-12-19T18:59:26.876270+0000","last_unstale":"2023-12-19T18:59:44.641299+0000","last_undegraded":"2023-12-19T18:59:44.641299+0000","last_fullsized":"2023-12-19T18:59:44.641299+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:14.142304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.644269+0000","last_change":"2023-12-19T18:59:27.651168+0000","last_active":"2023-12-19T18:59:44.644269+0000","last_peered":"2023-12-19T18:59:44.644269+0000","last_clean":"2023-12-19T18:59:44.644269+0000","last_became_active":"2023-12-19T18:59:27.650866+0000","last_became_peered":"2023-12-19T18:59:27.650866+0000","last_unstale":"2023-12-19T18:59:44.644269+0000","last_undegraded":"2023-12-19T18:59:44.644269+0000","last_fullsized":"2023-12-19T18:59:44.644269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:09.434914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.692409+0000","last_change":"2023-12-19T18:59:44.656063+0000","last_active":"2023-12-19T18:59:45.692409+0000","last_peered":"2023-12-19T18:59:45.692409+0000","last_clean":"2023-12-19T18:59:45.692409+0000","last_became_active":"2023-12-19T18:59:44.655631+0000","last_became_peered":"2023-12-19T18:59:44.655631+0000","last_unstale":"2023-12-19T18:59:45.692409+0000","last_undegraded":"2023-12-19T18:59:45.692409+0000","last_fullsized":"2023-12-19T18:59:45.692409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:02:18.795241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.692484+0000","last_change":"2023-12-19T18:59:45.684725+0000","last_active":"2023-12-19T18:59:45.692484+0000","last_peered":"2023-12-19T18:59:45.692484+0000","last_clean":"2023-12-19T18:59:45.692484+0000","last_became_active":"2023-12-19T18:59:45.684279+0000","last_became_peered":"2023-12-19T18:59:45.684279+0000","last_unstale":"2023-12-19T18:59:45.692484+0000","last_undegraded":"2023-12-19T18:59:45.692484+0000","last_fullsized":"2023-12-19T18:59:45.692484+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:28:45.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.654068+0000","last_change":"2023-12-19T18:59:26.877227+0000","last_active":"2023-12-19T18:59:44.654068+0000","last_peered":"2023-12-19T18:59:44.654068+0000","last_clean":"2023-12-19T18:59:44.654068+0000","last_became_active":"2023-12-19T18:59:26.876903+0000","last_became_peered":"2023-12-19T18:59:26.876903+0000","last_unstale":"2023-12-19T18:59:44.654068+0000","last_undegraded":"2023-12-19T18:59:44.654068+0000","last_fullsized":"2023-12-19T18:59:44.654068+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:46.454857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641216+0000","last_change":"2023-12-19T18:59:27.656486+0000","last_active":"2023-12-19T18:59:44.641216+0000","last_peered":"2023-12-19T18:59:44.641216+0000","last_clean":"2023-12-19T18:59:44.641216+0000","last_became_active":"2023-12-19T18:59:27.656254+0000","last_became_peered":"2023-12-19T18:59:27.656254+0000","last_unstale":"2023-12-19T18:59:44.641216+0000","last_undegraded":"2023-12-19T18:59:44.641216+0000","last_fullsized":"2023-12-19T18:59:44.641216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:55.089240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.698171+0000","last_change":"2023-12-19T18:59:44.657205+0000","last_active":"2023-12-19T18:59:45.698171+0000","last_peered":"2023-12-19T18:59:45.698171+0000","last_clean":"2023-12-19T18:59:45.698171+0000","last_became_active":"2023-12-19T18:59:44.656810+0000","last_became_peered":"2023-12-19T18:59:44.656810+0000","last_unstale":"2023-12-19T18:59:45.698171+0000","last_undegraded":"2023-12-19T18:59:45.698171+0000","last_fullsized":"2023-12-19T18:59:45.698171+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:05:20.314341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.691915+0000","last_change":"2023-12-19T18:59:45.683808+0000","last_active":"2023-12-19T18:59:45.691915+0000","last_peered":"2023-12-19T18:59:45.691915+0000","last_clean":"2023-12-19T18:59:45.691915+0000","last_became_active":"2023-12-19T18:59:45.683557+0000","last_became_peered":"2023-12-19T18:59:45.683557+0000","last_unstale":"2023-12-19T18:59:45.691915+0000","last_undegraded":"2023-12-19T18:59:45.691915+0000","last_fullsized":"2023-12-19T18:59:45.691915+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:28:45.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642061+0000","last_change":"2023-12-19T18:59:26.879513+0000","last_active":"2023-12-19T18:59:44.642061+0000","last_peered":"2023-12-19T18:59:44.642061+0000","last_clean":"2023-12-19T18:59:44.642061+0000","last_became_active":"2023-12-19T18:59:26.879190+0000","last_became_peered":"2023-12-19T18:59:26.879190+0000","last_unstale":"2023-12-19T18:59:44.642061+0000","last_undegraded":"2023-12-19T18:59:44.642061+0000","last_fullsized":"2023-12-19T18:59:44.642061+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:46:34.116596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.653545+0000","last_change":"2023-12-19T18:59:27.651327+0000","last_active":"2023-12-19T18:59:44.653545+0000","last_peered":"2023-12-19T18:59:44.653545+0000","last_clean":"2023-12-19T18:59:44.653545+0000","last_became_active":"2023-12-19T18:59:27.650744+0000","last_became_peered":"2023-12-19T18:59:27.650744+0000","last_unstale":"2023-12-19T18:59:44.653545+0000","last_undegraded":"2023-12-19T18:59:44.653545+0000","last_fullsized":"2023-12-19T18:59:44.653545+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:34:10.155305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.675143+0000","last_change":"2023-12-19T18:59:44.658001+0000","last_active":"2023-12-19T18:59:45.675143+0000","last_peered":"2023-12-19T18:59:45.675143+0000","last_clean":"2023-12-19T18:59:45.675143+0000","last_became_active":"2023-12-19T18:59:44.657538+0000","last_became_peered":"2023-12-19T18:59:44.657538+0000","last_unstale":"2023-12-19T18:59:45.675143+0000","last_undegraded":"2023-12-19T18:59:45.675143+0000","last_fullsized":"2023-12-19T18:59:45.675143+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:00:18.806679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.694207+0000","last_change":"2023-12-19T18:59:45.687303+0000","last_active":"2023-12-19T18:59:45.694207+0000","last_peered":"2023-12-19T18:59:45.694207+0000","last_clean":"2023-12-19T18:59:45.694207+0000","last_became_active":"2023-12-19T18:59:45.686674+0000","last_became_peered":"2023-12-19T18:59:45.686674+0000","last_unstale":"2023-12-19T18:59:45.694207+0000","last_undegraded":"2023-12-19T18:59:45.694207+0000","last_fullsized":"2023-12-19T18:59:45.694207+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:33:51.250696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642382+0000","last_change":"2023-12-19T18:59:26.877767+0000","last_active":"2023-12-19T18:59:44.642382+0000","last_peered":"2023-12-19T18:59:44.642382+0000","last_clean":"2023-12-19T18:59:44.642382+0000","last_became_active":"2023-12-19T18:59:26.877475+0000","last_became_peered":"2023-12-19T18:59:26.877475+0000","last_unstale":"2023-12-19T18:59:44.642382+0000","last_undegraded":"2023-12-19T18:59:44.642382+0000","last_fullsized":"2023-12-19T18:59:44.642382+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:01.602303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641303+0000","last_change":"2023-12-19T18:59:27.644158+0000","last_active":"2023-12-19T18:59:44.641303+0000","last_peered":"2023-12-19T18:59:44.641303+0000","last_clean":"2023-12-19T18:59:44.641303+0000","last_became_active":"2023-12-19T18:59:27.643817+0000","last_became_peered":"2023-12-19T18:59:27.643817+0000","last_unstale":"2023-12-19T18:59:44.641303+0000","last_undegraded":"2023-12-19T18:59:44.641303+0000","last_fullsized":"2023-12-19T18:59:44.641303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:33:33.472556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.656015+0000","last_change":"2023-12-19T18:59:44.656933+0000","last_active":"2023-12-19T18:59:45.656015+0000","last_peered":"2023-12-19T18:59:45.656015+0000","last_clean":"2023-12-19T18:59:45.656015+0000","last_became_active":"2023-12-19T18:59:44.656669+0000","last_became_peered":"2023-12-19T18:59:44.656669+0000","last_unstale":"2023-12-19T18:59:45.656015+0000","last_undegraded":"2023-12-19T18:59:45.656015+0000","last_fullsized":"2023-12-19T18:59:45.656015+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:03:13.327714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.692472+0000","last_change":"2023-12-19T18:59:45.688293+0000","last_active":"2023-12-19T18:59:45.692472+0000","last_peered":"2023-12-19T18:59:45.692472+0000","last_clean":"2023-12-19T18:59:45.692472+0000","last_became_active":"2023-12-19T18:59:45.688001+0000","last_became_peered":"2023-12-19T18:59:45.688001+0000","last_unstale":"2023-12-19T18:59:45.692472+0000","last_undegraded":"2023-12-19T18:59:45.692472+0000","last_fullsized":"2023-12-19T18:59:45.692472+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:24:59.950274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.696793+0000","last_change":"2023-12-19T18:59:44.666863+0000","last_active":"2023-12-19T18:59:45.696793+0000","last_peered":"2023-12-19T18:59:45.696793+0000","last_clean":"2023-12-19T18:59:45.696793+0000","last_became_active":"2023-12-19T18:59:44.666500+0000","last_became_peered":"2023-12-19T18:59:44.666500+0000","last_unstale":"2023-12-19T18:59:45.696793+0000","last_undegraded":"2023-12-19T18:59:45.696793+0000","last_fullsized":"2023-12-19T18:59:45.696793+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:08:40.588917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.654683+0000","last_change":"2023-12-19T18:59:26.886614+0000","last_active":"2023-12-19T18:59:44.654683+0000","last_peered":"2023-12-19T18:59:44.654683+0000","last_clean":"2023-12-19T18:59:44.654683+0000","last_became_active":"2023-12-19T18:59:26.885790+0000","last_became_peered":"2023-12-19T18:59:26.885790+0000","last_unstale":"2023-12-19T18:59:44.654683+0000","last_undegraded":"2023-12-19T18:59:44.654683+0000","last_fullsized":"2023-12-19T18:59:44.654683+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:08:30.262675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.645309+0000","last_change":"2023-12-19T18:59:27.644566+0000","last_active":"2023-12-19T18:59:44.645309+0000","last_peered":"2023-12-19T18:59:44.645309+0000","last_clean":"2023-12-19T18:59:44.645309+0000","last_became_active":"2023-12-19T18:59:27.644305+0000","last_became_peered":"2023-12-19T18:59:27.644305+0000","last_unstale":"2023-12-19T18:59:44.645309+0000","last_undegraded":"2023-12-19T18:59:44.645309+0000","last_fullsized":"2023-12-19T18:59:44.645309+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:51:59.962934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.683511+0000","last_change":"2023-12-19T18:59:45.677626+0000","last_active":"2023-12-19T18:59:45.683511+0000","last_peered":"2023-12-19T18:59:45.683511+0000","last_clean":"2023-12-19T18:59:45.683511+0000","last_became_active":"2023-12-19T18:59:45.676785+0000","last_became_peered":"2023-12-19T18:59:45.676785+0000","last_unstale":"2023-12-19T18:59:45.683511+0000","last_undegraded":"2023-12-19T18:59:45.683511+0000","last_fullsized":"2023-12-19T18:59:45.683511+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:53.633313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.697226+0000","last_change":"2023-12-19T18:59:44.668644+0000","last_active":"2023-12-19T18:59:45.697226+0000","last_peered":"2023-12-19T18:59:45.697226+0000","last_clean":"2023-12-19T18:59:45.697226+0000","last_became_active":"2023-12-19T18:59:44.668363+0000","last_became_peered":"2023-12-19T18:59:44.668363+0000","last_unstale":"2023-12-19T18:59:45.697226+0000","last_undegraded":"2023-12-19T18:59:45.697226+0000","last_fullsized":"2023-12-19T18:59:45.697226+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:28:05.296201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"30'2","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658399+0000","last_change":"2023-12-19T18:59:26.886101+0000","last_active":"2023-12-19T18:59:44.658399+0000","last_peered":"2023-12-19T18:59:44.658399+0000","last_clean":"2023-12-19T18:59:44.658399+0000","last_became_active":"2023-12-19T18:59:26.885879+0000","last_became_peered":"2023-12-19T18:59:26.885879+0000","last_unstale":"2023-12-19T18:59:44.658399+0000","last_undegraded":"2023-12-19T18:59:44.658399+0000","last_fullsized":"2023-12-19T18:59:44.658399+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:33:32.469781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642027+0000","last_change":"2023-12-19T18:59:27.647256+0000","last_active":"2023-12-19T18:59:44.642027+0000","last_peered":"2023-12-19T18:59:44.642027+0000","last_clean":"2023-12-19T18:59:44.642027+0000","last_became_active":"2023-12-19T18:59:27.646852+0000","last_became_peered":"2023-12-19T18:59:27.646852+0000","last_unstale":"2023-12-19T18:59:44.642027+0000","last_undegraded":"2023-12-19T18:59:44.642027+0000","last_fullsized":"2023-12-19T18:59:44.642027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:46:08.213481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.686677+0000","last_change":"2023-12-19T18:59:45.683204+0000","last_active":"2023-12-19T18:59:45.686677+0000","last_peered":"2023-12-19T18:59:45.686677+0000","last_clean":"2023-12-19T18:59:45.686677+0000","last_became_active":"2023-12-19T18:59:45.682935+0000","last_became_peered":"2023-12-19T18:59:45.682935+0000","last_unstale":"2023-12-19T18:59:45.686677+0000","last_undegraded":"2023-12-19T18:59:45.686677+0000","last_fullsized":"2023-12-19T18:59:45.686677+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:28:08.544813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"30'1","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.636189+0000","last_change":"2023-12-19T18:59:26.882004+0000","last_active":"2023-12-19T18:59:44.636189+0000","last_peered":"2023-12-19T18:59:44.636189+0000","last_clean":"2023-12-19T18:59:44.636189+0000","last_became_active":"2023-12-19T18:59:26.881700+0000","last_became_peered":"2023-12-19T18:59:26.881700+0000","last_unstale":"2023-12-19T18:59:44.636189+0000","last_undegraded":"2023-12-19T18:59:44.636189+0000","last_fullsized":"2023-12-19T18:59:44.636189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:58:48.747485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.665411+0000","last_change":"2023-12-19T18:59:27.652815+0000","last_active":"2023-12-19T18:59:44.665411+0000","last_peered":"2023-12-19T18:59:44.665411+0000","last_clean":"2023-12-19T18:59:44.665411+0000","last_became_active":"2023-12-19T18:59:27.650397+0000","last_became_peered":"2023-12-19T18:59:27.650397+0000","last_unstale":"2023-12-19T18:59:44.665411+0000","last_undegraded":"2023-12-19T18:59:44.665411+0000","last_fullsized":"2023-12-19T18:59:44.665411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:55.089240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.695992+0000","last_change":"2023-12-19T18:59:44.663695+0000","last_active":"2023-12-19T18:59:45.695992+0000","last_peered":"2023-12-19T18:59:45.695992+0000","last_clean":"2023-12-19T18:59:45.695992+0000","last_became_active":"2023-12-19T18:59:44.663100+0000","last_became_peered":"2023-12-19T18:59:44.663100+0000","last_unstale":"2023-12-19T18:59:45.695992+0000","last_undegraded":"2023-12-19T18:59:45.695992+0000","last_fullsized":"2023-12-19T18:59:45.695992+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:06:47.044737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.681228+0000","last_change":"2023-12-19T18:59:45.669704+0000","last_active":"2023-12-19T18:59:45.681228+0000","last_peered":"2023-12-19T18:59:45.681228+0000","last_clean":"2023-12-19T18:59:45.681228+0000","last_became_active":"2023-12-19T18:59:45.665714+0000","last_became_peered":"2023-12-19T18:59:45.665714+0000","last_unstale":"2023-12-19T18:59:45.681228+0000","last_undegraded":"2023-12-19T18:59:45.681228+0000","last_fullsized":"2023-12-19T18:59:45.681228+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:06:48.050714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"30'4","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.665509+0000","last_change":"2023-12-19T18:59:26.890655+0000","last_active":"2023-12-19T18:59:44.665509+0000","last_peered":"2023-12-19T18:59:44.665509+0000","last_clean":"2023-12-19T18:59:44.665509+0000","last_became_active":"2023-12-19T18:59:26.890346+0000","last_became_peered":"2023-12-19T18:59:26.890346+0000","last_unstale":"2023-12-19T18:59:44.665509+0000","last_undegraded":"2023-12-19T18:59:44.665509+0000","last_fullsized":"2023-12-19T18:59:44.665509+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:25.848407+0000","last_clean_scrub_stamp":"2023-12-19T18:59:25.848407+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:13:18.250528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.636185+0000","last_change":"2023-12-19T18:59:27.641456+0000","last_active":"2023-12-19T18:59:44.636185+0000","last_peered":"2023-12-19T18:59:44.636185+0000","last_clean":"2023-12-19T18:59:44.636185+0000","last_became_active":"2023-12-19T18:59:27.641199+0000","last_became_peered":"2023-12-19T18:59:27.641199+0000","last_unstale":"2023-12-19T18:59:44.636185+0000","last_undegraded":"2023-12-19T18:59:44.636185+0000","last_fullsized":"2023-12-19T18:59:44.636185+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:06.335328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.693244+0000","last_change":"2023-12-19T18:59:44.661322+0000","last_active":"2023-12-19T18:59:45.693244+0000","last_peered":"2023-12-19T18:59:45.693244+0000","last_clean":"2023-12-19T18:59:45.693244+0000","last_became_active":"2023-12-19T18:59:44.660959+0000","last_became_peered":"2023-12-19T18:59:44.660959+0000","last_unstale":"2023-12-19T18:59:45.693244+0000","last_undegraded":"2023-12-19T18:59:45.693244+0000","last_fullsized":"2023-12-19T18:59:45.693244+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:43.623346+0000","last_clean_scrub_stamp":"2023-12-19T18:59:43.623346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:41.511096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.679872+0000","last_change":"2023-12-19T18:59:45.672061+0000","last_active":"2023-12-19T18:59:45.679872+0000","last_peered":"2023-12-19T18:59:45.679872+0000","last_clean":"2023-12-19T18:59:45.679872+0000","last_became_active":"2023-12-19T18:59:45.671659+0000","last_became_peered":"2023-12-19T18:59:45.671659+0000","last_unstale":"2023-12-19T18:59:45.679872+0000","last_undegraded":"2023-12-19T18:59:45.679872+0000","last_fullsized":"2023-12-19T18:59:45.679872+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:26:45.365145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641112+0000","last_change":"2023-12-19T18:59:27.641444+0000","last_active":"2023-12-19T18:59:44.641112+0000","last_peered":"2023-12-19T18:59:44.641112+0000","last_clean":"2023-12-19T18:59:44.641112+0000","last_became_active":"2023-12-19T18:59:27.641087+0000","last_became_peered":"2023-12-19T18:59:27.641087+0000","last_unstale":"2023-12-19T18:59:44.641112+0000","last_undegraded":"2023-12-19T18:59:44.641112+0000","last_fullsized":"2023-12-19T18:59:44.641112+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:43.043365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.686029+0000","last_change":"2023-12-19T18:59:45.679116+0000","last_active":"2023-12-19T18:59:45.686029+0000","last_peered":"2023-12-19T18:59:45.686029+0000","last_clean":"2023-12-19T18:59:45.686029+0000","last_became_active":"2023-12-19T18:59:45.678786+0000","last_became_peered":"2023-12-19T18:59:45.678786+0000","last_unstale":"2023-12-19T18:59:45.686029+0000","last_undegraded":"2023-12-19T18:59:45.686029+0000","last_fullsized":"2023-12-19T18:59:45.686029+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:52:17.741074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.664244+0000","last_change":"2023-12-19T18:59:27.652420+0000","last_active":"2023-12-19T18:59:44.664244+0000","last_peered":"2023-12-19T18:59:44.664244+0000","last_clean":"2023-12-19T18:59:44.664244+0000","last_became_active":"2023-12-19T18:59:27.651860+0000","last_became_peered":"2023-12-19T18:59:27.651860+0000","last_unstale":"2023-12-19T18:59:44.664244+0000","last_undegraded":"2023-12-19T18:59:44.664244+0000","last_fullsized":"2023-12-19T18:59:44.664244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:51.108766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.685601+0000","last_change":"2023-12-19T18:59:45.681604+0000","last_active":"2023-12-19T18:59:45.685601+0000","last_peered":"2023-12-19T18:59:45.685601+0000","last_clean":"2023-12-19T18:59:45.685601+0000","last_became_active":"2023-12-19T18:59:45.681416+0000","last_became_peered":"2023-12-19T18:59:45.681416+0000","last_unstale":"2023-12-19T18:59:45.685601+0000","last_undegraded":"2023-12-19T18:59:45.685601+0000","last_fullsized":"2023-12-19T18:59:45.685601+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:16:43.707144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641176+0000","last_change":"2023-12-19T18:59:27.652827+0000","last_active":"2023-12-19T18:59:44.641176+0000","last_peered":"2023-12-19T18:59:44.641176+0000","last_clean":"2023-12-19T18:59:44.641176+0000","last_became_active":"2023-12-19T18:59:27.652064+0000","last_became_peered":"2023-12-19T18:59:27.652064+0000","last_unstale":"2023-12-19T18:59:44.641176+0000","last_undegraded":"2023-12-19T18:59:44.641176+0000","last_fullsized":"2023-12-19T18:59:44.641176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:51:59.962934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.673075+0000","last_change":"2023-12-19T18:59:45.671350+0000","last_active":"2023-12-19T18:59:45.673075+0000","last_peered":"2023-12-19T18:59:45.673075+0000","last_clean":"2023-12-19T18:59:45.673075+0000","last_became_active":"2023-12-19T18:59:45.670332+0000","last_became_peered":"2023-12-19T18:59:45.670332+0000","last_unstale":"2023-12-19T18:59:45.673075+0000","last_undegraded":"2023-12-19T18:59:45.673075+0000","last_fullsized":"2023-12-19T18:59:45.673075+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:47:17.397607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642290+0000","last_change":"2023-12-19T18:59:27.640187+0000","last_active":"2023-12-19T18:59:44.642290+0000","last_peered":"2023-12-19T18:59:44.642290+0000","last_clean":"2023-12-19T18:59:44.642290+0000","last_became_active":"2023-12-19T18:59:27.639872+0000","last_became_peered":"2023-12-19T18:59:27.639872+0000","last_unstale":"2023-12-19T18:59:44.642290+0000","last_undegraded":"2023-12-19T18:59:44.642290+0000","last_fullsized":"2023-12-19T18:59:44.642290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:30:07.550029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.680156+0000","last_change":"2023-12-19T18:59:45.672149+0000","last_active":"2023-12-19T18:59:45.680156+0000","last_peered":"2023-12-19T18:59:45.680156+0000","last_clean":"2023-12-19T18:59:45.680156+0000","last_became_active":"2023-12-19T18:59:45.671898+0000","last_became_peered":"2023-12-19T18:59:45.671898+0000","last_unstale":"2023-12-19T18:59:45.680156+0000","last_undegraded":"2023-12-19T18:59:45.680156+0000","last_fullsized":"2023-12-19T18:59:45.680156+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:07:36.005822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.655985+0000","last_change":"2023-12-19T18:59:27.638276+0000","last_active":"2023-12-19T18:59:44.655985+0000","last_peered":"2023-12-19T18:59:44.655985+0000","last_clean":"2023-12-19T18:59:44.655985+0000","last_became_active":"2023-12-19T18:59:27.637964+0000","last_became_peered":"2023-12-19T18:59:27.637964+0000","last_unstale":"2023-12-19T18:59:44.655985+0000","last_undegraded":"2023-12-19T18:59:44.655985+0000","last_fullsized":"2023-12-19T18:59:44.655985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:31:54.792697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.691793+0000","last_change":"2023-12-19T18:59:45.682680+0000","last_active":"2023-12-19T18:59:45.691793+0000","last_peered":"2023-12-19T18:59:45.691793+0000","last_clean":"2023-12-19T18:59:45.691793+0000","last_became_active":"2023-12-19T18:59:45.682393+0000","last_became_peered":"2023-12-19T18:59:45.682393+0000","last_unstale":"2023-12-19T18:59:45.691793+0000","last_undegraded":"2023-12-19T18:59:45.691793+0000","last_fullsized":"2023-12-19T18:59:45.691793+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:50:01.669689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.645232+0000","last_change":"2023-12-19T18:59:27.645163+0000","last_active":"2023-12-19T18:59:44.645232+0000","last_peered":"2023-12-19T18:59:44.645232+0000","last_clean":"2023-12-19T18:59:44.645232+0000","last_became_active":"2023-12-19T18:59:27.644866+0000","last_became_peered":"2023-12-19T18:59:27.644866+0000","last_unstale":"2023-12-19T18:59:44.645232+0000","last_undegraded":"2023-12-19T18:59:44.645232+0000","last_fullsized":"2023-12-19T18:59:44.645232+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:47.457632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.686904+0000","last_change":"2023-12-19T18:59:45.676717+0000","last_active":"2023-12-19T18:59:45.686904+0000","last_peered":"2023-12-19T18:59:45.686904+0000","last_clean":"2023-12-19T18:59:45.686904+0000","last_became_active":"2023-12-19T18:59:45.676381+0000","last_became_peered":"2023-12-19T18:59:45.676381+0000","last_unstale":"2023-12-19T18:59:45.686904+0000","last_undegraded":"2023-12-19T18:59:45.686904+0000","last_fullsized":"2023-12-19T18:59:45.686904+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:37:39.631279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658769+0000","last_change":"2023-12-19T18:59:27.643887+0000","last_active":"2023-12-19T18:59:44.658769+0000","last_peered":"2023-12-19T18:59:44.658769+0000","last_clean":"2023-12-19T18:59:44.658769+0000","last_became_active":"2023-12-19T18:59:27.643624+0000","last_became_peered":"2023-12-19T18:59:27.643624+0000","last_unstale":"2023-12-19T18:59:44.658769+0000","last_undegraded":"2023-12-19T18:59:44.658769+0000","last_fullsized":"2023-12-19T18:59:44.658769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:02:02.023078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.697175+0000","last_change":"2023-12-19T18:59:45.693293+0000","last_active":"2023-12-19T18:59:45.697175+0000","last_peered":"2023-12-19T18:59:45.697175+0000","last_clean":"2023-12-19T18:59:45.697175+0000","last_became_active":"2023-12-19T18:59:45.693022+0000","last_became_peered":"2023-12-19T18:59:45.693022+0000","last_unstale":"2023-12-19T18:59:45.697175+0000","last_undegraded":"2023-12-19T18:59:45.697175+0000","last_fullsized":"2023-12-19T18:59:45.697175+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:00:19.812657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.647126+0000","last_change":"2023-12-19T18:59:27.643752+0000","last_active":"2023-12-19T18:59:44.647126+0000","last_peered":"2023-12-19T18:59:44.647126+0000","last_clean":"2023-12-19T18:59:44.647126+0000","last_became_active":"2023-12-19T18:59:27.643478+0000","last_became_peered":"2023-12-19T18:59:27.643478+0000","last_unstale":"2023-12-19T18:59:44.647126+0000","last_undegraded":"2023-12-19T18:59:44.647126+0000","last_fullsized":"2023-12-19T18:59:44.647126+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:34:10.155305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.699426+0000","last_change":"2023-12-19T18:59:45.695420+0000","last_active":"2023-12-19T18:59:45.699426+0000","last_peered":"2023-12-19T18:59:45.699426+0000","last_clean":"2023-12-19T18:59:45.699426+0000","last_became_active":"2023-12-19T18:59:45.694980+0000","last_became_peered":"2023-12-19T18:59:45.694980+0000","last_unstale":"2023-12-19T18:59:45.699426+0000","last_undegraded":"2023-12-19T18:59:45.699426+0000","last_fullsized":"2023-12-19T18:59:45.699426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:28:45.645735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.649971+0000","last_change":"2023-12-19T18:59:27.657160+0000","last_active":"2023-12-19T18:59:44.649971+0000","last_peered":"2023-12-19T18:59:44.649971+0000","last_clean":"2023-12-19T18:59:44.649971+0000","last_became_active":"2023-12-19T18:59:27.656870+0000","last_became_peered":"2023-12-19T18:59:27.656870+0000","last_unstale":"2023-12-19T18:59:44.649971+0000","last_undegraded":"2023-12-19T18:59:44.649971+0000","last_fullsized":"2023-12-19T18:59:44.649971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:45.789974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.687865+0000","last_change":"2023-12-19T18:59:45.684735+0000","last_active":"2023-12-19T18:59:45.687865+0000","last_peered":"2023-12-19T18:59:45.687865+0000","last_clean":"2023-12-19T18:59:45.687865+0000","last_became_active":"2023-12-19T18:59:45.680295+0000","last_became_peered":"2023-12-19T18:59:45.680295+0000","last_unstale":"2023-12-19T18:59:45.687865+0000","last_undegraded":"2023-12-19T18:59:45.687865+0000","last_fullsized":"2023-12-19T18:59:45.687865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:49:52.569482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.635307+0000","last_change":"2023-12-19T18:59:27.631457+0000","last_active":"2023-12-19T18:59:44.635307+0000","last_peered":"2023-12-19T18:59:44.635307+0000","last_clean":"2023-12-19T18:59:44.635307+0000","last_became_active":"2023-12-19T18:59:27.631174+0000","last_became_peered":"2023-12-19T18:59:27.631174+0000","last_unstale":"2023-12-19T18:59:44.635307+0000","last_undegraded":"2023-12-19T18:59:44.635307+0000","last_fullsized":"2023-12-19T18:59:44.635307+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:05:55.089240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.686014+0000","last_change":"2023-12-19T18:59:45.677668+0000","last_active":"2023-12-19T18:59:45.686014+0000","last_peered":"2023-12-19T18:59:45.686014+0000","last_clean":"2023-12-19T18:59:45.686014+0000","last_became_active":"2023-12-19T18:59:45.677313+0000","last_became_peered":"2023-12-19T18:59:45.677313+0000","last_unstale":"2023-12-19T18:59:45.686014+0000","last_undegraded":"2023-12-19T18:59:45.686014+0000","last_fullsized":"2023-12-19T18:59:45.686014+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:33:51.250696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641933+0000","last_change":"2023-12-19T18:59:27.648386+0000","last_active":"2023-12-19T18:59:44.641933+0000","last_peered":"2023-12-19T18:59:44.641933+0000","last_clean":"2023-12-19T18:59:44.641933+0000","last_became_active":"2023-12-19T18:59:27.647869+0000","last_became_peered":"2023-12-19T18:59:27.647869+0000","last_unstale":"2023-12-19T18:59:44.641933+0000","last_undegraded":"2023-12-19T18:59:44.641933+0000","last_fullsized":"2023-12-19T18:59:44.641933+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:10.672775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.684573+0000","last_change":"2023-12-19T18:59:45.675064+0000","last_active":"2023-12-19T18:59:45.684573+0000","last_peered":"2023-12-19T18:59:45.684573+0000","last_clean":"2023-12-19T18:59:45.684573+0000","last_became_active":"2023-12-19T18:59:45.674692+0000","last_became_peered":"2023-12-19T18:59:45.674692+0000","last_unstale":"2023-12-19T18:59:45.684573+0000","last_undegraded":"2023-12-19T18:59:45.684573+0000","last_fullsized":"2023-12-19T18:59:45.684573+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:20:03.568114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642200+0000","last_change":"2023-12-19T18:59:27.649677+0000","last_active":"2023-12-19T18:59:44.642200+0000","last_peered":"2023-12-19T18:59:44.642200+0000","last_clean":"2023-12-19T18:59:44.642200+0000","last_became_active":"2023-12-19T18:59:27.647243+0000","last_became_peered":"2023-12-19T18:59:27.647243+0000","last_unstale":"2023-12-19T18:59:44.642200+0000","last_undegraded":"2023-12-19T18:59:44.642200+0000","last_fullsized":"2023-12-19T18:59:44.642200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:06.335328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.697957+0000","last_change":"2023-12-19T18:59:45.696037+0000","last_active":"2023-12-19T18:59:45.697957+0000","last_peered":"2023-12-19T18:59:45.697957+0000","last_clean":"2023-12-19T18:59:45.697957+0000","last_became_active":"2023-12-19T18:59:45.695762+0000","last_became_peered":"2023-12-19T18:59:45.695762+0000","last_unstale":"2023-12-19T18:59:45.697957+0000","last_undegraded":"2023-12-19T18:59:45.697957+0000","last_fullsized":"2023-12-19T18:59:45.697957+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:42.517073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.654633+0000","last_change":"2023-12-19T18:59:27.651935+0000","last_active":"2023-12-19T18:59:44.654633+0000","last_peered":"2023-12-19T18:59:44.654633+0000","last_clean":"2023-12-19T18:59:44.654633+0000","last_became_active":"2023-12-19T18:59:27.650665+0000","last_became_peered":"2023-12-19T18:59:27.650665+0000","last_unstale":"2023-12-19T18:59:44.654633+0000","last_undegraded":"2023-12-19T18:59:44.654633+0000","last_fullsized":"2023-12-19T18:59:44.654633+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:26:29.063442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.695297+0000","last_change":"2023-12-19T18:59:45.689633+0000","last_active":"2023-12-19T18:59:45.695297+0000","last_peered":"2023-12-19T18:59:45.695297+0000","last_clean":"2023-12-19T18:59:45.695297+0000","last_became_active":"2023-12-19T18:59:45.689228+0000","last_became_peered":"2023-12-19T18:59:45.689228+0000","last_unstale":"2023-12-19T18:59:45.695297+0000","last_undegraded":"2023-12-19T18:59:45.695297+0000","last_fullsized":"2023-12-19T18:59:45.695297+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:05:55.555094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658396+0000","last_change":"2023-12-19T18:59:27.641655+0000","last_active":"2023-12-19T18:59:44.658396+0000","last_peered":"2023-12-19T18:59:44.658396+0000","last_clean":"2023-12-19T18:59:44.658396+0000","last_became_active":"2023-12-19T18:59:27.641399+0000","last_became_peered":"2023-12-19T18:59:27.641399+0000","last_unstale":"2023-12-19T18:59:44.658396+0000","last_undegraded":"2023-12-19T18:59:44.658396+0000","last_fullsized":"2023-12-19T18:59:44.658396+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:24:42.172134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.699432+0000","last_change":"2023-12-19T18:59:45.693760+0000","last_active":"2023-12-19T18:59:45.699432+0000","last_peered":"2023-12-19T18:59:45.699432+0000","last_clean":"2023-12-19T18:59:45.699432+0000","last_became_active":"2023-12-19T18:59:45.693495+0000","last_became_peered":"2023-12-19T18:59:45.693495+0000","last_unstale":"2023-12-19T18:59:45.699432+0000","last_undegraded":"2023-12-19T18:59:45.699432+0000","last_fullsized":"2023-12-19T18:59:45.699432+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:24.113468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658692+0000","last_change":"2023-12-19T18:59:27.643312+0000","last_active":"2023-12-19T18:59:44.658692+0000","last_peered":"2023-12-19T18:59:44.658692+0000","last_clean":"2023-12-19T18:59:44.658692+0000","last_became_active":"2023-12-19T18:59:27.642580+0000","last_became_peered":"2023-12-19T18:59:27.642580+0000","last_unstale":"2023-12-19T18:59:44.658692+0000","last_undegraded":"2023-12-19T18:59:44.658692+0000","last_fullsized":"2023-12-19T18:59:44.658692+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:26:27.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.696749+0000","last_change":"2023-12-19T18:59:45.691536+0000","last_active":"2023-12-19T18:59:45.696749+0000","last_peered":"2023-12-19T18:59:45.696749+0000","last_clean":"2023-12-19T18:59:45.696749+0000","last_became_active":"2023-12-19T18:59:45.691118+0000","last_became_peered":"2023-12-19T18:59:45.691118+0000","last_unstale":"2023-12-19T18:59:45.696749+0000","last_undegraded":"2023-12-19T18:59:45.696749+0000","last_fullsized":"2023-12-19T18:59:45.696749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:54:05.235772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.643303+0000","last_change":"2023-12-19T18:59:27.656306+0000","last_active":"2023-12-19T18:59:44.643303+0000","last_peered":"2023-12-19T18:59:44.643303+0000","last_clean":"2023-12-19T18:59:44.643303+0000","last_became_active":"2023-12-19T18:59:27.652701+0000","last_became_peered":"2023-12-19T18:59:27.652701+0000","last_unstale":"2023-12-19T18:59:44.643303+0000","last_undegraded":"2023-12-19T18:59:44.643303+0000","last_fullsized":"2023-12-19T18:59:44.643303+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:39.573719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.699407+0000","last_change":"2023-12-19T18:59:45.695224+0000","last_active":"2023-12-19T18:59:45.699407+0000","last_peered":"2023-12-19T18:59:45.699407+0000","last_clean":"2023-12-19T18:59:45.699407+0000","last_became_active":"2023-12-19T18:59:45.694663+0000","last_became_peered":"2023-12-19T18:59:45.694663+0000","last_unstale":"2023-12-19T18:59:45.699407+0000","last_undegraded":"2023-12-19T18:59:45.699407+0000","last_fullsized":"2023-12-19T18:59:45.699407+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:05:55.555094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641677+0000","last_change":"2023-12-19T18:59:27.642841+0000","last_active":"2023-12-19T18:59:44.641677+0000","last_peered":"2023-12-19T18:59:44.641677+0000","last_clean":"2023-12-19T18:59:44.641677+0000","last_became_active":"2023-12-19T18:59:27.642539+0000","last_became_peered":"2023-12-19T18:59:27.642539+0000","last_unstale":"2023-12-19T18:59:44.641677+0000","last_undegraded":"2023-12-19T18:59:44.641677+0000","last_fullsized":"2023-12-19T18:59:44.641677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:47.457632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.679972+0000","last_change":"2023-12-19T18:59:45.671876+0000","last_active":"2023-12-19T18:59:45.679972+0000","last_peered":"2023-12-19T18:59:45.679972+0000","last_clean":"2023-12-19T18:59:45.679972+0000","last_became_active":"2023-12-19T18:59:45.671615+0000","last_became_peered":"2023-12-19T18:59:45.671615+0000","last_unstale":"2023-12-19T18:59:45.679972+0000","last_undegraded":"2023-12-19T18:59:45.679972+0000","last_fullsized":"2023-12-19T18:59:45.679972+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:58:58.741003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.652147+0000","last_change":"2023-12-19T18:59:27.657564+0000","last_active":"2023-12-19T18:59:44.652147+0000","last_peered":"2023-12-19T18:59:44.652147+0000","last_clean":"2023-12-19T18:59:44.652147+0000","last_became_active":"2023-12-19T18:59:27.657243+0000","last_became_peered":"2023-12-19T18:59:27.657243+0000","last_unstale":"2023-12-19T18:59:44.652147+0000","last_undegraded":"2023-12-19T18:59:44.652147+0000","last_fullsized":"2023-12-19T18:59:44.652147+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:47.457632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.691833+0000","last_change":"2023-12-19T18:59:45.682627+0000","last_active":"2023-12-19T18:59:45.691833+0000","last_peered":"2023-12-19T18:59:45.691833+0000","last_clean":"2023-12-19T18:59:45.691833+0000","last_became_active":"2023-12-19T18:59:45.682137+0000","last_became_peered":"2023-12-19T18:59:45.682137+0000","last_unstale":"2023-12-19T18:59:45.691833+0000","last_undegraded":"2023-12-19T18:59:45.691833+0000","last_fullsized":"2023-12-19T18:59:45.691833+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:11.516672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.654703+0000","last_change":"2023-12-19T18:59:27.634853+0000","last_active":"2023-12-19T18:59:44.654703+0000","last_peered":"2023-12-19T18:59:44.654703+0000","last_clean":"2023-12-19T18:59:44.654703+0000","last_became_active":"2023-12-19T18:59:27.634599+0000","last_became_peered":"2023-12-19T18:59:27.634599+0000","last_unstale":"2023-12-19T18:59:44.654703+0000","last_undegraded":"2023-12-19T18:59:44.654703+0000","last_fullsized":"2023-12-19T18:59:44.654703+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:39.573719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.672622+0000","last_change":"2023-12-19T18:59:45.670389+0000","last_active":"2023-12-19T18:59:45.672622+0000","last_peered":"2023-12-19T18:59:45.672622+0000","last_clean":"2023-12-19T18:59:45.672622+0000","last_became_active":"2023-12-19T18:59:45.669992+0000","last_became_peered":"2023-12-19T18:59:45.669992+0000","last_unstale":"2023-12-19T18:59:45.672622+0000","last_undegraded":"2023-12-19T18:59:45.672622+0000","last_fullsized":"2023-12-19T18:59:45.672622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:29:00.251482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.652699+0000","last_change":"2023-12-19T18:59:27.639769+0000","last_active":"2023-12-19T18:59:44.652699+0000","last_peered":"2023-12-19T18:59:44.652699+0000","last_clean":"2023-12-19T18:59:44.652699+0000","last_became_active":"2023-12-19T18:59:27.639419+0000","last_became_peered":"2023-12-19T18:59:27.639419+0000","last_unstale":"2023-12-19T18:59:44.652699+0000","last_undegraded":"2023-12-19T18:59:44.652699+0000","last_fullsized":"2023-12-19T18:59:44.652699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:05:06.848164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.698853+0000","last_change":"2023-12-19T18:59:45.693302+0000","last_active":"2023-12-19T18:59:45.698853+0000","last_peered":"2023-12-19T18:59:45.698853+0000","last_clean":"2023-12-19T18:59:45.698853+0000","last_became_active":"2023-12-19T18:59:45.692963+0000","last_became_peered":"2023-12-19T18:59:45.692963+0000","last_unstale":"2023-12-19T18:59:45.698853+0000","last_undegraded":"2023-12-19T18:59:45.698853+0000","last_fullsized":"2023-12-19T18:59:45.698853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:53.633313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.655897+0000","last_change":"2023-12-19T18:59:27.654938+0000","last_active":"2023-12-19T18:59:44.655897+0000","last_peered":"2023-12-19T18:59:44.655897+0000","last_clean":"2023-12-19T18:59:44.655897+0000","last_became_active":"2023-12-19T18:59:27.651744+0000","last_became_peered":"2023-12-19T18:59:27.651744+0000","last_unstale":"2023-12-19T18:59:44.655897+0000","last_undegraded":"2023-12-19T18:59:44.655897+0000","last_fullsized":"2023-12-19T18:59:44.655897+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:51:59.962934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.699291+0000","last_change":"2023-12-19T18:59:45.694950+0000","last_active":"2023-12-19T18:59:45.699291+0000","last_peered":"2023-12-19T18:59:45.699291+0000","last_clean":"2023-12-19T18:59:45.699291+0000","last_became_active":"2023-12-19T18:59:45.693896+0000","last_became_peered":"2023-12-19T18:59:45.693896+0000","last_unstale":"2023-12-19T18:59:45.699291+0000","last_undegraded":"2023-12-19T18:59:45.699291+0000","last_fullsized":"2023-12-19T18:59:45.699291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:42.517073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642892+0000","last_change":"2023-12-19T18:59:27.641187+0000","last_active":"2023-12-19T18:59:44.642892+0000","last_peered":"2023-12-19T18:59:44.642892+0000","last_clean":"2023-12-19T18:59:44.642892+0000","last_became_active":"2023-12-19T18:59:27.640792+0000","last_became_peered":"2023-12-19T18:59:27.640792+0000","last_unstale":"2023-12-19T18:59:44.642892+0000","last_undegraded":"2023-12-19T18:59:44.642892+0000","last_fullsized":"2023-12-19T18:59:44.642892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:39.959895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.691749+0000","last_change":"2023-12-19T18:59:45.681344+0000","last_active":"2023-12-19T18:59:45.691749+0000","last_peered":"2023-12-19T18:59:45.691749+0000","last_clean":"2023-12-19T18:59:45.691749+0000","last_became_active":"2023-12-19T18:59:45.681037+0000","last_became_peered":"2023-12-19T18:59:45.681037+0000","last_unstale":"2023-12-19T18:59:45.691749+0000","last_undegraded":"2023-12-19T18:59:45.691749+0000","last_fullsized":"2023-12-19T18:59:45.691749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:10:30.430001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.645585+0000","last_change":"2023-12-19T18:59:27.652530+0000","last_active":"2023-12-19T18:59:44.645585+0000","last_peered":"2023-12-19T18:59:44.645585+0000","last_clean":"2023-12-19T18:59:44.645585+0000","last_became_active":"2023-12-19T18:59:27.652274+0000","last_became_peered":"2023-12-19T18:59:27.652274+0000","last_unstale":"2023-12-19T18:59:44.645585+0000","last_undegraded":"2023-12-19T18:59:44.645585+0000","last_fullsized":"2023-12-19T18:59:44.645585+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:45.789974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.695629+0000","last_change":"2023-12-19T18:59:45.690556+0000","last_active":"2023-12-19T18:59:45.695629+0000","last_peered":"2023-12-19T18:59:45.695629+0000","last_clean":"2023-12-19T18:59:45.695629+0000","last_became_active":"2023-12-19T18:59:45.690278+0000","last_became_peered":"2023-12-19T18:59:45.690278+0000","last_unstale":"2023-12-19T18:59:45.695629+0000","last_undegraded":"2023-12-19T18:59:45.695629+0000","last_fullsized":"2023-12-19T18:59:45.695629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:46.035434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642507+0000","last_change":"2023-12-19T18:59:27.644087+0000","last_active":"2023-12-19T18:59:44.642507+0000","last_peered":"2023-12-19T18:59:44.642507+0000","last_clean":"2023-12-19T18:59:44.642507+0000","last_became_active":"2023-12-19T18:59:27.643699+0000","last_became_peered":"2023-12-19T18:59:27.643699+0000","last_unstale":"2023-12-19T18:59:44.642507+0000","last_undegraded":"2023-12-19T18:59:44.642507+0000","last_fullsized":"2023-12-19T18:59:44.642507+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:09.434914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.672981+0000","last_change":"2023-12-19T18:59:45.668231+0000","last_active":"2023-12-19T18:59:45.672981+0000","last_peered":"2023-12-19T18:59:45.672981+0000","last_clean":"2023-12-19T18:59:45.672981+0000","last_became_active":"2023-12-19T18:59:45.667939+0000","last_became_peered":"2023-12-19T18:59:45.667939+0000","last_unstale":"2023-12-19T18:59:45.672981+0000","last_undegraded":"2023-12-19T18:59:45.672981+0000","last_fullsized":"2023-12-19T18:59:45.672981+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:34:39.645053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.641018+0000","last_change":"2023-12-19T18:59:27.636005+0000","last_active":"2023-12-19T18:59:44.641018+0000","last_peered":"2023-12-19T18:59:44.641018+0000","last_clean":"2023-12-19T18:59:44.641018+0000","last_became_active":"2023-12-19T18:59:27.635717+0000","last_became_peered":"2023-12-19T18:59:27.635717+0000","last_unstale":"2023-12-19T18:59:44.641018+0000","last_undegraded":"2023-12-19T18:59:44.641018+0000","last_fullsized":"2023-12-19T18:59:44.641018+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:09.434914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.681750+0000","last_change":"2023-12-19T18:59:45.669713+0000","last_active":"2023-12-19T18:59:45.681750+0000","last_peered":"2023-12-19T18:59:45.681750+0000","last_clean":"2023-12-19T18:59:45.681750+0000","last_became_active":"2023-12-19T18:59:45.667994+0000","last_became_peered":"2023-12-19T18:59:45.667994+0000","last_unstale":"2023-12-19T18:59:45.681750+0000","last_undegraded":"2023-12-19T18:59:45.681750+0000","last_fullsized":"2023-12-19T18:59:45.681750+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:00:19.812657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.642047+0000","last_change":"2023-12-19T18:59:27.644547+0000","last_active":"2023-12-19T18:59:44.642047+0000","last_peered":"2023-12-19T18:59:44.642047+0000","last_clean":"2023-12-19T18:59:44.642047+0000","last_became_active":"2023-12-19T18:59:27.643524+0000","last_became_peered":"2023-12-19T18:59:27.643524+0000","last_unstale":"2023-12-19T18:59:44.642047+0000","last_undegraded":"2023-12-19T18:59:44.642047+0000","last_fullsized":"2023-12-19T18:59:44.642047+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:34:10.155305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.694223+0000","last_change":"2023-12-19T18:59:45.687492+0000","last_active":"2023-12-19T18:59:45.694223+0000","last_peered":"2023-12-19T18:59:45.694223+0000","last_clean":"2023-12-19T18:59:45.694223+0000","last_became_active":"2023-12-19T18:59:45.687052+0000","last_became_peered":"2023-12-19T18:59:45.687052+0000","last_unstale":"2023-12-19T18:59:45.694223+0000","last_undegraded":"2023-12-19T18:59:45.694223+0000","last_fullsized":"2023-12-19T18:59:45.694223+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:57.738035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.654632+0000","last_change":"2023-12-19T18:59:27.646289+0000","last_active":"2023-12-19T18:59:44.654632+0000","last_peered":"2023-12-19T18:59:44.654632+0000","last_clean":"2023-12-19T18:59:44.654632+0000","last_became_active":"2023-12-19T18:59:27.645922+0000","last_became_peered":"2023-12-19T18:59:27.645922+0000","last_unstale":"2023-12-19T18:59:44.654632+0000","last_undegraded":"2023-12-19T18:59:44.654632+0000","last_fullsized":"2023-12-19T18:59:44.654632+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:39.959895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.692751+0000","last_change":"2023-12-19T18:59:45.682642+0000","last_active":"2023-12-19T18:59:45.692751+0000","last_peered":"2023-12-19T18:59:45.692751+0000","last_clean":"2023-12-19T18:59:45.692751+0000","last_became_active":"2023-12-19T18:59:45.682152+0000","last_became_peered":"2023-12-19T18:59:45.682152+0000","last_unstale":"2023-12-19T18:59:45.692751+0000","last_undegraded":"2023-12-19T18:59:45.692751+0000","last_fullsized":"2023-12-19T18:59:45.692751+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:27:00.147134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.652622+0000","last_change":"2023-12-19T18:59:27.647319+0000","last_active":"2023-12-19T18:59:44.652622+0000","last_peered":"2023-12-19T18:59:44.652622+0000","last_clean":"2023-12-19T18:59:44.652622+0000","last_became_active":"2023-12-19T18:59:27.646986+0000","last_became_peered":"2023-12-19T18:59:27.646986+0000","last_unstale":"2023-12-19T18:59:44.652622+0000","last_undegraded":"2023-12-19T18:59:44.652622+0000","last_fullsized":"2023-12-19T18:59:44.652622+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:11.488595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.691911+0000","last_change":"2023-12-19T18:59:45.679020+0000","last_active":"2023-12-19T18:59:45.691911+0000","last_peered":"2023-12-19T18:59:45.691911+0000","last_clean":"2023-12-19T18:59:45.691911+0000","last_became_active":"2023-12-19T18:59:45.678690+0000","last_became_peered":"2023-12-19T18:59:45.678690+0000","last_unstale":"2023-12-19T18:59:45.691911+0000","last_undegraded":"2023-12-19T18:59:45.691911+0000","last_fullsized":"2023-12-19T18:59:45.691911+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:16:32.971393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.648065+0000","last_change":"2023-12-19T18:59:27.646579+0000","last_active":"2023-12-19T18:59:44.648065+0000","last_peered":"2023-12-19T18:59:44.648065+0000","last_clean":"2023-12-19T18:59:44.648065+0000","last_became_active":"2023-12-19T18:59:27.646163+0000","last_became_peered":"2023-12-19T18:59:27.646163+0000","last_unstale":"2023-12-19T18:59:44.648065+0000","last_undegraded":"2023-12-19T18:59:44.648065+0000","last_fullsized":"2023-12-19T18:59:44.648065+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:43.043365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.695769+0000","last_change":"2023-12-19T18:59:45.687938+0000","last_active":"2023-12-19T18:59:45.695769+0000","last_peered":"2023-12-19T18:59:45.695769+0000","last_clean":"2023-12-19T18:59:45.695769+0000","last_became_active":"2023-12-19T18:59:45.687544+0000","last_became_peered":"2023-12-19T18:59:45.687544+0000","last_unstale":"2023-12-19T18:59:45.695769+0000","last_undegraded":"2023-12-19T18:59:45.695769+0000","last_fullsized":"2023-12-19T18:59:45.695769+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:03:14.333691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658554+0000","last_change":"2023-12-19T18:59:27.652238+0000","last_active":"2023-12-19T18:59:44.658554+0000","last_peered":"2023-12-19T18:59:44.658554+0000","last_clean":"2023-12-19T18:59:44.658554+0000","last_became_active":"2023-12-19T18:59:27.650827+0000","last_became_peered":"2023-12-19T18:59:27.650827+0000","last_unstale":"2023-12-19T18:59:44.658554+0000","last_undegraded":"2023-12-19T18:59:44.658554+0000","last_fullsized":"2023-12-19T18:59:44.658554+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:39.959895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.699271+0000","last_change":"2023-12-19T18:59:45.694324+0000","last_active":"2023-12-19T18:59:45.699271+0000","last_peered":"2023-12-19T18:59:45.699271+0000","last_clean":"2023-12-19T18:59:45.699271+0000","last_became_active":"2023-12-19T18:59:45.688928+0000","last_became_peered":"2023-12-19T18:59:45.688928+0000","last_unstale":"2023-12-19T18:59:45.699271+0000","last_undegraded":"2023-12-19T18:59:45.699271+0000","last_fullsized":"2023-12-19T18:59:45.699271+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:24:59.950274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.658614+0000","last_change":"2023-12-19T18:59:27.643020+0000","last_active":"2023-12-19T18:59:44.658614+0000","last_peered":"2023-12-19T18:59:44.658614+0000","last_clean":"2023-12-19T18:59:44.658614+0000","last_became_active":"2023-12-19T18:59:27.640017+0000","last_became_peered":"2023-12-19T18:59:27.640017+0000","last_unstale":"2023-12-19T18:59:44.658614+0000","last_undegraded":"2023-12-19T18:59:44.658614+0000","last_fullsized":"2023-12-19T18:59:44.658614+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:13:35.855173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-12-19T18:59:45.695283+0000","last_change":"2023-12-19T18:59:45.687321+0000","last_active":"2023-12-19T18:59:45.695283+0000","last_peered":"2023-12-19T18:59:45.695283+0000","last_clean":"2023-12-19T18:59:45.695283+0000","last_became_active":"2023-12-19T18:59:45.687017+0000","last_became_peered":"2023-12-19T18:59:45.687017+0000","last_unstale":"2023-12-19T18:59:45.695283+0000","last_undegraded":"2023-12-19T18:59:45.695283+0000","last_fullsized":"2023-12-19T18:59:45.695283+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:44.629323+0000","last_clean_scrub_stamp":"2023-12-19T18:59:44.629323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:46.035434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-19T18:59:44.666305+0000","last_change":"2023-12-19T18:59:27.658988+0000","last_active":"2023-12-19T18:59:44.666305+0000","last_peered":"2023-12-19T18:59:44.666305+0000","last_clean":"2023-12-19T18:59:44.666305+0000","last_became_active":"2023-12-19T18:59:27.658688+0000","last_became_peered":"2023-12-19T18:59:27.658688+0000","last_unstale":"2023-12-19T18:59:44.666305+0000","last_undegraded":"2023-12-19T18:59:44.666305+0000","last_fullsized":"2023-12-19T18:59:44.666305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:59:26.851183+0000","last_clean_scrub_stamp":"2023-12-19T18:59:26.851183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:58:40.962863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":987136,"data_stored":746076,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.59699999999999998}]},{"osd":1,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.70299999999999996}]},{"osd":2,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.54600000000000004}]},{"osd":3,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.56899999999999995}]},{"osd":4,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.622}]},{"osd":5,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.73599999999999999}]},{"osd":6,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.76000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":148511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.62}]},{"osd":1,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.69499999999999995}]},{"osd":2,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.64200000000000002}]},{"osd":3,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.71699999999999997}]},{"osd":4,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.84299999999999997}]},{"osd":5,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.77300000000000002}]},{"osd":7,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.97599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":148567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":7.4550000000000001,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.36399999999999999},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":16.951000000000001,"5min":16.951000000000001,"15min":16.951000000000001},"last":0.63}]},{"osd":1,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":19.823,"5min":19.823,"15min":19.823},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.49299999999999999}]},{"osd":2,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.56499999999999995}]},{"osd":3,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.2949999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.7649999999999997,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":0.61099999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.6499999999999999,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":0.79600000000000004}]},{"osd":6,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.59199999999999997}]},{"osd":7,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.371,"5min":2.371,"15min":2.371},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.72999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":147999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.7690000000000001,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.51800000000000002}]},{"osd":1,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":3.3849999999999998,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":0.627}]},{"osd":2,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":3.1240000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.57199999999999995}]},{"osd":3,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":3.194,"5min":3.194,"15min":3.194},"last":0.55300000000000005}]},{"osd":5,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":9.3040000000000003,"5min":9.3040000000000003,"15min":9.3040000000000003},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.433}]},{"osd":6,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":3.097,"5min":3.097,"15min":3.097},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":3.3319999999999999,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":5.0410000000000004,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.60099999999999998},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":6.3449999999999998,"5min":6.3449999999999998,"15min":6.3449999999999998},"last":0.66800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":151024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.39100000000000001}]},{"osd":1,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.41099999999999998}]},{"osd":2,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.503},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.33700000000000002}]},{"osd":4,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.59999999999999998}]},{"osd":6,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.622},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.73799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":147965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.499},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.3599999999999999,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.45200000000000001}]},{"osd":1,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":0.40400000000000003}]},{"osd":3,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":3.0259999999999998,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":0.378},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.61699999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.835,"5min":2.835,"15min":2.835},"last":0.58099999999999996}]},{"osd":5,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":3.5,"5min":3.5,"15min":3.5},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":0.74099999999999999}]},{"osd":6,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.7109999999999999,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.66600000000000004}]},{"osd":7,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.875,"5min":2.875,"15min":2.875},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.59499999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":151024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":4.2000000000000002,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":7.7320000000000002,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.29499999999999998}]},{"osd":2,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.9129999999999998,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.4720000000000004,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.33600000000000002}]},{"osd":3,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":7.8399999999999999,"5min":7.8399999999999999,"15min":7.8399999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":7.7949999999999999,"5min":7.7949999999999999,"15min":7.7949999999999999},"last":0.46600000000000003}]},{"osd":4,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":4.2690000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":4.2910000000000004,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.69499999999999995}]},{"osd":5,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":4.3490000000000002,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":4.2480000000000002,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.66200000000000003}]},{"osd":6,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":4.1609999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.754},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.3099999999999996,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.68200000000000005}]},{"osd":7,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":4.3310000000000004,"5min":4.3310000000000004,"15min":4.3310000000000004},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":4.226,"5min":4.226,"15min":4.226},"last":0.79400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343876,"statfs":{"total":96636764160,"available":96608129024,"internally_reserved":0,"allocated":962560,"data_stored":737244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.375},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.44800000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.41599999999999998}]},{"osd":3,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.46300000000000002}]},{"osd":4,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.66300000000000003}]},{"osd":5,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.746}]},{"osd":6,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.76300000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.84199999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T18:59:50.190 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T18:59:50.191 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-12-19T18:59:50.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.366+0000 7f5bc2b1d640 1 Processor -- start 2023-12-19T18:59:50.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.366+0000 7f5bc2b1d640 1 -- start start 2023-12-19T18:59:50.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.366+0000 7f5bc2b1d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5bbc0c5640 0x7f5bbc0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:50.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.366+0000 7f5bc2b1d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5bbc0c60f0 0x7f5bbc155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:50.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.366+0000 7f5bc2b1d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bbc0c2580 con 0x7f5bbc0c5260 2023-12-19T18:59:50.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.366+0000 7f5bc2b1d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bbc153510 con 0x7f5bbc0c5640 2023-12-19T18:59:50.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.366+0000 7f5bc2b1d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bbc0c17f0 con 0x7f5bbc0c60f0 2023-12-19T18:59:50.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.366+0000 7f5bb3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5bbc0c5640 0x7f5bbc0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:50.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.366+0000 7f5bb3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5bbc0c5640 0x7f5bbc0c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59918/0 (socket says 172.21.15.133:59918) 2023-12-19T18:59:50.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.366+0000 7f5bc08b9640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5bbc0c5260 0x7f5bbc06d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47190/0 (socket says 172.21.15.133:47190) 2023-12-19T18:59:50.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.366+0000 7f5bb3fff640 1 -- 172.21.15.133:0/1241503376 learned_addr learned my addr 172.21.15.133:0/1241503376 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:50.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.366+0000 7f5bc10ba640 1 --2- 172.21.15.133:0/1241503376 >> v2:172.21.15.138:3300/0 conn(0x7f5bbc0c60f0 0x7f5bbc155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:50.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.366+0000 7f5bb3fff640 1 -- 172.21.15.133:0/1241503376 >> v2:172.21.15.138:3300/0 conn(0x7f5bbc0c60f0 msgr2=0x7f5bbc155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:50.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.366+0000 7f5bb3fff640 1 --2- 172.21.15.133:0/1241503376 >> v2:172.21.15.138:3300/0 conn(0x7f5bbc0c60f0 0x7f5bbc155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:50.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.366+0000 7f5bb3fff640 1 -- 172.21.15.133:0/1241503376 >> v1:172.21.15.133:6789/0 conn(0x7f5bbc0c5260 legacy=0x7f5bbc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:50.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.366+0000 7f5bb3fff640 1 -- 172.21.15.133:0/1241503376 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc0c1a00 con 0x7f5bbc0c5640 2023-12-19T18:59:50.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.366+0000 7f5bb37fe640 1 -- 172.21.15.133:0/1241503376 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664984860 0 0) 0x7f5bbc0c2580 con 0x7f5bbc0c5260 2023-12-19T18:59:50.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.370+0000 7f5bb3fff640 1 --2- 172.21.15.133:0/1241503376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bbc0c5640 0x7f5bbc0c5bb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0c6b10 tx=0x7f5bac01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5def045077d881 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:50.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.370+0000 7f5bb37fe640 1 -- 172.21.15.133:0/1241503376 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac004230 con 0x7f5bbc0c5640 2023-12-19T18:59:50.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.370+0000 7f5bb37fe640 1 -- 172.21.15.133:0/1241503376 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bac0a7050 con 0x7f5bbc0c5640 2023-12-19T18:59:50.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.370+0000 7f5bb37fe640 1 -- 172.21.15.133:0/1241503376 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bac003620 con 0x7f5bbc0c5640 2023-12-19T18:59:50.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.370+0000 7f5bc2b1d640 1 -- 172.21.15.133:0/1241503376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bbc0c5640 msgr2=0x7f5bbc0c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:50.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.370+0000 7f5bc2b1d640 1 --2- 172.21.15.133:0/1241503376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bbc0c5640 0x7f5bbc0c5bb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0c6b10 tx=0x7f5bac01c440 comp rx=0 tx=0).stop 2023-12-19T18:59:50.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.370+0000 7f5bc2b1d640 1 -- 172.21.15.133:0/1241503376 shutdown_connections 2023-12-19T18:59:50.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.370+0000 7f5bc2b1d640 1 --2- 172.21.15.133:0/1241503376 >> v2:172.21.15.138:3300/0 conn(0x7f5bbc0c60f0 0x7f5bbc155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:50.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.370+0000 7f5bc2b1d640 1 --2- 172.21.15.133:0/1241503376 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bbc0c5640 0x7f5bbc0c5bb0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:50.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.370+0000 7f5bc2b1d640 1 -- 172.21.15.133:0/1241503376 >> 172.21.15.133:0/1241503376 conn(0x7f5bbc06a5b0 msgr2=0x7f5bbc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:50.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.370+0000 7f5bc2b1d640 1 -- 172.21.15.133:0/1241503376 shutdown_connections 2023-12-19T18:59:50.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.370+0000 7f5bc2b1d640 1 -- 172.21.15.133:0/1241503376 wait complete. 2023-12-19T18:59:50.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.370+0000 7f5bc2b1d640 1 Processor -- start 2023-12-19T18:59:50.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.370+0000 7f5bc2b1d640 1 -- start start 2023-12-19T18:59:50.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bc2b1d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bbc0c5260 0x7f5bbc1ecbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:50.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bc2b1d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5bbc0c5640 0x7f5bbc0a7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:50.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bc2b1d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bbc0c60f0 0x7f5bbc1f08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:50.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bc2b1d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc1f0130 con 0x7f5bbc0c60f0 2023-12-19T18:59:50.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bc2b1d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc0a96a0 con 0x7f5bbc0c5260 2023-12-19T18:59:50.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bc2b1d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc0a9980 con 0x7f5bbc0c5640 2023-12-19T18:59:50.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bc10ba640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bbc0c60f0 0x7f5bbc1f08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:50.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bc08b9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bbc0c5260 0x7f5bbc1ecbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:50.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bc08b9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bbc0c5260 0x7f5bbc1ecbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:39450/0 (socket says 172.21.15.133:39450) 2023-12-19T18:59:50.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bc08b9640 1 -- 172.21.15.133:0/3973332175 learned_addr learned my addr 172.21.15.133:0/3973332175 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:50.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bb3fff640 1 --2- 172.21.15.133:0/3973332175 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5bbc0c5640 0x7f5bbc0a7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:50.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bc08b9640 1 -- 172.21.15.133:0/3973332175 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5bbc0c5640 msgr2=0x7f5bbc0a7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:50.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bc08b9640 1 --2- 172.21.15.133:0/3973332175 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5bbc0c5640 0x7f5bbc0a7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:50.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bc08b9640 1 -- 172.21.15.133:0/3973332175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bbc0c60f0 msgr2=0x7f5bbc1f08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:50.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bc08b9640 1 --2- 172.21.15.133:0/3973332175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bbc0c60f0 0x7f5bbc1f08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:50.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bc08b9640 1 -- 172.21.15.133:0/3973332175 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bac0094d0 con 0x7f5bbc0c5260 2023-12-19T18:59:50.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bc10ba640 1 --2- 172.21.15.133:0/3973332175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bbc0c60f0 0x7f5bbc1f08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:59:50.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bc08b9640 1 --2- 172.21.15.133:0/3973332175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bbc0c5260 0x7f5bbc1ecbc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5bb800c7c0 tx=0x7f5bb800cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:50.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bb17fa640 1 -- 172.21.15.133:0/3973332175 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb800a640 con 0x7f5bbc0c5260 2023-12-19T18:59:50.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bb17fa640 1 -- 172.21.15.133:0/3973332175 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb800a7c0 con 0x7f5bbc0c5260 2023-12-19T18:59:50.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bb17fa640 1 -- 172.21.15.133:0/3973332175 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb800ab70 con 0x7f5bbc0c5260 2023-12-19T18:59:50.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bc2b1d640 1 -- 172.21.15.133:0/3973332175 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bbc0a9c60 con 0x7f5bbc0c5260 2023-12-19T18:59:50.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bc2b1d640 1 -- 172.21.15.133:0/3973332175 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bbc0a87e0 con 0x7f5bbc0c5260 2023-12-19T18:59:50.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.374+0000 7f5bc2b1d640 1 -- 172.21.15.133:0/3973332175 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bbc1f0610 con 0x7f5bbc0c5260 2023-12-19T18:59:50.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.378+0000 7f5bb17fa640 1 -- 172.21.15.133:0/3973332175 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5bb800acd0 con 0x7f5bbc0c5260 2023-12-19T18:59:50.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.378+0000 7f5bb17fa640 1 --2- 172.21.15.133:0/3973332175 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5ba8066470 0x7f5ba8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:50.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.378+0000 7f5bb17fa640 1 -- 172.21.15.133:0/3973332175 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5bb80836f0 con 0x7f5bbc0c5260 2023-12-19T18:59:50.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.378+0000 7f5bb3fff640 1 --2- 172.21.15.133:0/3973332175 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5ba8066470 0x7f5ba8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:50.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.378+0000 7f5bb3fff640 1 --2- 172.21.15.133:0/3973332175 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5ba8066470 0x7f5ba8068930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5bac0ad000 tx=0x7f5bac0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:50.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.386+0000 7f5bb17fa640 1 -- 172.21.15.133:0/3973332175 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5bbc1f0610 con 0x7f5bbc0c5260 2023-12-19T18:59:50.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.586+0000 7f5bc2b1d640 1 -- 172.21.15.133:0/3973332175 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f5bbc1f0610 con 0x7f5bbc0c5260 2023-12-19T18:59:50.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.594+0000 7f5bb17fa640 1 -- 172.21.15.133:0/3973332175 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v12) v1 ==== 185+0+142 (secure 0 0 0) 0x7f5bbc1f0610 con 0x7f5bbc0c5260 2023-12-19T18:59:50.601 INFO:teuthology.orchestra.run.smithi133.stdout:[client.1] 2023-12-19T18:59:50.601 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCn54Fl4bbAOhAA4WXKbT5uizIcy0OTOKIaag== 2023-12-19T18:59:50.602 INFO:teuthology.orchestra.run.smithi133.stdout: caps mds = "allow" 2023-12-19T18:59:50.602 INFO:teuthology.orchestra.run.smithi133.stdout: caps mon = "allow r" 2023-12-19T18:59:50.602 INFO:teuthology.orchestra.run.smithi133.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-12-19T18:59:50.602 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.1 2023-12-19T18:59:50.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.598+0000 7f5bc2b1d640 1 -- 172.21.15.133:0/3973332175 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5ba8066470 msgr2=0x7f5ba8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:50.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.598+0000 7f5bc2b1d640 1 --2- 172.21.15.133:0/3973332175 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5ba8066470 0x7f5ba8068930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5bac0ad000 tx=0x7f5bac0a6000 comp rx=0 tx=0).stop 2023-12-19T18:59:50.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.598+0000 7f5bc2b1d640 1 -- 172.21.15.133:0/3973332175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bbc0c5260 msgr2=0x7f5bbc1ecbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:50.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.598+0000 7f5bc2b1d640 1 --2- 172.21.15.133:0/3973332175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bbc0c5260 0x7f5bbc1ecbc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5bb800c7c0 tx=0x7f5bb800cc80 comp rx=0 tx=0).stop 2023-12-19T18:59:50.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.598+0000 7f5bc2b1d640 1 -- 172.21.15.133:0/3973332175 shutdown_connections 2023-12-19T18:59:50.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.598+0000 7f5bc2b1d640 1 --2- 172.21.15.133:0/3973332175 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5ba8066470 0x7f5ba8068930 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:50.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.598+0000 7f5bc2b1d640 1 --2- 172.21.15.133:0/3973332175 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bbc0c60f0 0x7f5bbc1f08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:50.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.598+0000 7f5bc2b1d640 1 --2- 172.21.15.133:0/3973332175 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5bbc0c5640 0x7f5bbc0a7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:50.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.598+0000 7f5bc2b1d640 1 --2- 172.21.15.133:0/3973332175 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bbc0c5260 0x7f5bbc1ecbc0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:50.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.598+0000 7f5bc2b1d640 1 -- 172.21.15.133:0/3973332175 >> 172.21.15.133:0/3973332175 conn(0x7f5bbc06a5b0 msgr2=0x7f5bbc151df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:50.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.598+0000 7f5bc2b1d640 1 -- 172.21.15.133:0/3973332175 shutdown_connections 2023-12-19T18:59:50.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.598+0000 7f5bc2b1d640 1 -- 172.21.15.133:0/3973332175 wait complete. 2023-12-19T18:59:50.623 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:59:50.623 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:59:50.632 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:59:50.632 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:59:50.683 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:59:50.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.814+0000 7f5ebc5c1640 1 Processor -- start 2023-12-19T18:59:50.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.814+0000 7f5ebc5c1640 1 -- start start 2023-12-19T18:59:50.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.818+0000 7f5ebc5c1640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5eb40a5370 0x7f5eb40c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:50.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.818+0000 7f5ebc5c1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb40c2760 con 0x7f5eb4072090 2023-12-19T18:59:50.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.818+0000 7f5ebc5c1640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb40a5750 con 0x7f5eb40c4110 2023-12-19T18:59:50.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.818+0000 7f5ebc5c1640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb40c3070 con 0x7f5eb40a5370 2023-12-19T18:59:50.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.818+0000 7f5ebab5e640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5eb4072090 0x7f5eb415b4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47196/0 (socket says 172.21.15.133:47196) 2023-12-19T18:59:50.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.818+0000 7f5ebab5e640 1 -- 172.21.15.133:0/292906441 learned_addr learned my addr 172.21.15.133:0/292906441 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:50.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.818+0000 7f5eba35d640 1 --2- 172.21.15.133:0/292906441 >> v2:172.21.15.138:3300/0 conn(0x7f5eb40a5370 0x7f5eb40c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:50.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.818+0000 7f5eb935b640 1 -- 172.21.15.133:0/292906441 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781473298 0 0) 0x7f5eb40c2760 con 0x7f5eb4072090 2023-12-19T18:59:50.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.818+0000 7f5eb935b640 1 -- 172.21.15.133:0/292906441 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ea0003530 con 0x7f5eb4072090 2023-12-19T18:59:50.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.818+0000 7f5eb935b640 1 -- 172.21.15.133:0/292906441 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028858078 0 0) 0x7f5eb40a5750 con 0x7f5eb40c4110 2023-12-19T18:59:50.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.818+0000 7f5eb935b640 1 -- 172.21.15.133:0/292906441 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5eb40c2760 con 0x7f5eb40c4110 2023-12-19T18:59:50.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.818+0000 7f5eba35d640 1 -- 172.21.15.133:0/292906441 >> v1:172.21.15.138:6789/0 conn(0x7f5eb40c4110 legacy=0x7f5eb4150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:50.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.818+0000 7f5eba35d640 1 -- 172.21.15.133:0/292906441 >> v1:172.21.15.133:6789/0 conn(0x7f5eb4072090 legacy=0x7f5eb415b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:50.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.818+0000 7f5eba35d640 1 -- 172.21.15.133:0/292906441 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb40aad20 con 0x7f5eb40a5370 2023-12-19T18:59:50.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.822+0000 7f5eba35d640 1 --2- 172.21.15.133:0/292906441 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5eb40a5370 0x7f5eb40c3bd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00097c0 tx=0x7f5eb001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9722e2308a08de server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:50.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.822+0000 7f5eb935b640 1 -- 172.21.15.133:0/292906441 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb00ab600 con 0x7f5eb40a5370 2023-12-19T18:59:50.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.822+0000 7f5eb935b640 1 -- 172.21.15.133:0/292906441 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb00a7050 con 0x7f5eb40a5370 2023-12-19T18:59:50.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.822+0000 7f5eb935b640 1 -- 172.21.15.133:0/292906441 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb00ab960 con 0x7f5eb40a5370 2023-12-19T18:59:50.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.822+0000 7f5ebc5c1640 1 -- 172.21.15.133:0/292906441 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5eb40a5370 msgr2=0x7f5eb40c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:50.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.822+0000 7f5ebc5c1640 1 --2- 172.21.15.133:0/292906441 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5eb40a5370 0x7f5eb40c3bd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00097c0 tx=0x7f5eb001c330 comp rx=0 tx=0).stop 2023-12-19T18:59:50.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.822+0000 7f5ebc5c1640 1 -- 172.21.15.133:0/292906441 shutdown_connections 2023-12-19T18:59:50.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.822+0000 7f5ebc5c1640 1 --2- 172.21.15.133:0/292906441 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5eb40a5370 0x7f5eb40c3bd0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:50.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.822+0000 7f5ebc5c1640 1 -- 172.21.15.133:0/292906441 >> 172.21.15.133:0/292906441 conn(0x7f5eb406a5b0 msgr2=0x7f5eb406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:50.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.822+0000 7f5ebc5c1640 1 -- 172.21.15.133:0/292906441 shutdown_connections 2023-12-19T18:59:50.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.822+0000 7f5ebc5c1640 1 -- 172.21.15.133:0/292906441 wait complete. 2023-12-19T18:59:50.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.822+0000 7f5ebc5c1640 1 Processor -- start 2023-12-19T18:59:50.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.822+0000 7f5ebc5c1640 1 -- start start 2023-12-19T18:59:50.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.822+0000 7f5ebc5c1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5eb4072090 0x7f5eb41f0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:50.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.822+0000 7f5ebc5c1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5eb40a5370 0x7f5eb4149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:50.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.822+0000 7f5ebc5c1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5eb40c4110 0x7f5eb4147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:50.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.822+0000 7f5ebc5c1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb4071920 con 0x7f5eb4072090 2023-12-19T18:59:50.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.822+0000 7f5ebc5c1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb406e180 con 0x7f5eb40a5370 2023-12-19T18:59:50.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.822+0000 7f5ebc5c1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb4071d40 con 0x7f5eb40c4110 2023-12-19T18:59:50.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.826+0000 7f5eba35d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5eb4072090 0x7f5eb41f0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:50.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.826+0000 7f5eba35d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5eb4072090 0x7f5eb41f0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59936/0 (socket says 172.21.15.133:59936) 2023-12-19T18:59:50.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.826+0000 7f5eba35d640 1 -- 172.21.15.133:0/1359678980 learned_addr learned my addr 172.21.15.133:0/1359678980 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:50.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.826+0000 7f5eb9b5c640 1 --2- 172.21.15.133:0/1359678980 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5eb40a5370 0x7f5eb4149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:50.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.826+0000 7f5ebab5e640 1 --2- 172.21.15.133:0/1359678980 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5eb40c4110 0x7f5eb4147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:50.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.826+0000 7f5eba35d640 1 -- 172.21.15.133:0/1359678980 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5eb40c4110 msgr2=0x7f5eb4147250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:50.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.826+0000 7f5eba35d640 1 --2- 172.21.15.133:0/1359678980 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5eb40c4110 0x7f5eb4147250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:50.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.826+0000 7f5eba35d640 1 -- 172.21.15.133:0/1359678980 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5eb40a5370 msgr2=0x7f5eb4149b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:50.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.826+0000 7f5eba35d640 1 --2- 172.21.15.133:0/1359678980 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5eb40a5370 0x7f5eb4149b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:50.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.826+0000 7f5eba35d640 1 -- 172.21.15.133:0/1359678980 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb0009420 con 0x7f5eb4072090 2023-12-19T18:59:50.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.826+0000 7f5eba35d640 1 --2- 172.21.15.133:0/1359678980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5eb4072090 0x7f5eb41f0890 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00097c0 tx=0x7f5eb00190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:50.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.826+0000 7f5eaaffd640 1 -- 172.21.15.133:0/1359678980 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0006e20 con 0x7f5eb4072090 2023-12-19T18:59:50.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.826+0000 7f5eaaffd640 1 -- 172.21.15.133:0/1359678980 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb00b4400 con 0x7f5eb4072090 2023-12-19T18:59:50.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.826+0000 7f5eaaffd640 1 -- 172.21.15.133:0/1359678980 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb00b4770 con 0x7f5eb4072090 2023-12-19T18:59:50.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.826+0000 7f5ebc5c1640 1 -- 172.21.15.133:0/1359678980 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb4143350 con 0x7f5eb4072090 2023-12-19T18:59:50.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.826+0000 7f5ebc5c1640 1 -- 172.21.15.133:0/1359678980 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb41f10e0 con 0x7f5eb4072090 2023-12-19T18:59:50.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.826+0000 7f5ebc5c1640 1 -- 172.21.15.133:0/1359678980 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb4068400 con 0x7f5eb4072090 2023-12-19T18:59:50.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.826+0000 7f5eaaffd640 1 -- 172.21.15.133:0/1359678980 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5eb00b2040 con 0x7f5eb4072090 2023-12-19T18:59:50.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.830+0000 7f5eaaffd640 1 --2- 172.21.15.133:0/1359678980 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5e98066470 0x7f5e98068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:50.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.830+0000 7f5eaaffd640 1 -- 172.21.15.133:0/1359678980 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5eb011dfc0 con 0x7f5eb4072090 2023-12-19T18:59:50.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.830+0000 7f5eb9b5c640 1 --2- 172.21.15.133:0/1359678980 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5e98066470 0x7f5e98068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:50.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.830+0000 7f5eb9b5c640 1 --2- 172.21.15.133:0/1359678980 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5e98066470 0x7f5e98068930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5eb406da70 tx=0x7f5ea4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:50.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.834+0000 7f5eaaffd640 1 -- 172.21.15.133:0/1359678980 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5eb00eb0f0 con 0x7f5eb4072090 2023-12-19T18:59:50.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.986+0000 7f5ebc5c1640 1 -- 172.21.15.133:0/1359678980 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5eb40c6780 con 0x7f5eb4072090 2023-12-19T18:59:50.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.990+0000 7f5eaaffd640 1 -- 172.21.15.133:0/1359678980 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20265 (secure 0 0 0) 0x7f5eb00ee710 con 0x7f5eb4072090 2023-12-19T18:59:50.996 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:50.996 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":35,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:59:46.667472+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:59:25.798150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T18:59:26.236078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T18:59:42.757628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-19T18:59:44.017454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:59:50.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.990+0000 7f5ebc5c1640 1 -- 172.21.15.133:0/1359678980 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5e98066470 msgr2=0x7f5e98068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:50.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.990+0000 7f5ebc5c1640 1 --2- 172.21.15.133:0/1359678980 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5e98066470 0x7f5e98068930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5eb406da70 tx=0x7f5ea4009040 comp rx=0 tx=0).stop 2023-12-19T18:59:50.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.990+0000 7f5ebc5c1640 1 -- 172.21.15.133:0/1359678980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5eb4072090 msgr2=0x7f5eb41f0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:50.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.990+0000 7f5ebc5c1640 1 --2- 172.21.15.133:0/1359678980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5eb4072090 0x7f5eb41f0890 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00097c0 tx=0x7f5eb00190d0 comp rx=0 tx=0).stop 2023-12-19T18:59:50.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.990+0000 7f5ebc5c1640 1 -- 172.21.15.133:0/1359678980 shutdown_connections 2023-12-19T18:59:50.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.990+0000 7f5ebc5c1640 1 --2- 172.21.15.133:0/1359678980 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5e98066470 0x7f5e98068930 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:50.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.990+0000 7f5ebc5c1640 1 --2- 172.21.15.133:0/1359678980 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5eb40c4110 0x7f5eb4147250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:50.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.990+0000 7f5ebc5c1640 1 --2- 172.21.15.133:0/1359678980 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5eb40a5370 0x7f5eb4149b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:50.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.990+0000 7f5ebc5c1640 1 --2- 172.21.15.133:0/1359678980 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5eb4072090 0x7f5eb41f0890 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:50.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.990+0000 7f5ebc5c1640 1 -- 172.21.15.133:0/1359678980 >> 172.21.15.133:0/1359678980 conn(0x7f5eb406a5b0 msgr2=0x7f5eb406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:50.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.990+0000 7f5ebc5c1640 1 -- 172.21.15.133:0/1359678980 shutdown_connections 2023-12-19T18:59:50.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:50.990+0000 7f5ebc5c1640 1 -- 172.21.15.133:0/1359678980 wait complete. 2023-12-19T18:59:51.017 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:59:25.798150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:59:26.236078+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-19T18:59:42.757628+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-19T18:59:44.017454+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:59:51.018 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:59:51.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.150+0000 7f78528bb640 1 Processor -- start 2023-12-19T18:59:51.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.150+0000 7f78528bb640 1 -- start start 2023-12-19T18:59:51.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.154+0000 7f78528bb640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f784c14b010 0x7f784c0bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:51.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.154+0000 7f78528bb640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f784c157c20 0x7f784c158070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:51.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.154+0000 7f78528bb640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f784c06a5b0 con 0x7f784c073a70 2023-12-19T18:59:51.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.154+0000 7f78528bb640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f784c06b710 con 0x7f784c14b010 2023-12-19T18:59:51.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.154+0000 7f78528bb640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f784c0c1d60 con 0x7f784c157c20 2023-12-19T18:59:51.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.154+0000 7f784bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f784c14b010 0x7f784c0bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:51.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.154+0000 7f784bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f784c14b010 0x7f784c0bf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59952/0 (socket says 172.21.15.133:59952) 2023-12-19T18:59:51.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.154+0000 7f784bfff640 1 -- 172.21.15.133:0/3000900494 learned_addr learned my addr 172.21.15.133:0/3000900494 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:51.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.154+0000 7f7850e58640 1 --2- 172.21.15.133:0/3000900494 >> v2:172.21.15.138:3300/0 conn(0x7f784c157c20 0x7f784c158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:51.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.154+0000 7f784bfff640 1 -- 172.21.15.133:0/3000900494 >> v2:172.21.15.138:3300/0 conn(0x7f784c157c20 msgr2=0x7f784c158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:51.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.154+0000 7f784bfff640 1 --2- 172.21.15.133:0/3000900494 >> v2:172.21.15.138:3300/0 conn(0x7f784c157c20 0x7f784c158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.154+0000 7f784bfff640 1 -- 172.21.15.133:0/3000900494 >> v1:172.21.15.133:6789/0 conn(0x7f784c073a70 legacy=0x7f784c06b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:51.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.154+0000 7f784bfff640 1 -- 172.21.15.133:0/3000900494 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784c0c2040 con 0x7f784c14b010 2023-12-19T18:59:51.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.158+0000 7f784bfff640 1 --2- 172.21.15.133:0/3000900494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f784c14b010 0x7f784c0bf9f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f784c1521a0 tx=0x7f783c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9088dfb7d20e32fd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:51.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.158+0000 7f784affd640 1 -- 172.21.15.133:0/3000900494 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c0a89f0 con 0x7f784c14b010 2023-12-19T18:59:51.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.158+0000 7f784affd640 1 -- 172.21.15.133:0/3000900494 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783c0a8b50 con 0x7f784c14b010 2023-12-19T18:59:51.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.158+0000 7f784affd640 1 -- 172.21.15.133:0/3000900494 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c0b0440 con 0x7f784c14b010 2023-12-19T18:59:51.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.158+0000 7f78528bb640 1 -- 172.21.15.133:0/3000900494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f784c14b010 msgr2=0x7f784c0bf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:51.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.158+0000 7f78528bb640 1 --2- 172.21.15.133:0/3000900494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f784c14b010 0x7f784c0bf9f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f784c1521a0 tx=0x7f783c01ecf0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.158+0000 7f78528bb640 1 -- 172.21.15.133:0/3000900494 shutdown_connections 2023-12-19T18:59:51.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.158+0000 7f78528bb640 1 --2- 172.21.15.133:0/3000900494 >> v2:172.21.15.138:3300/0 conn(0x7f784c157c20 0x7f784c158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.158+0000 7f78528bb640 1 --2- 172.21.15.133:0/3000900494 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f784c14b010 0x7f784c0bf9f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.158+0000 7f78528bb640 1 -- 172.21.15.133:0/3000900494 >> 172.21.15.133:0/3000900494 conn(0x7f784c0c30c0 msgr2=0x7f784c0c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:51.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.158+0000 7f78528bb640 1 -- 172.21.15.133:0/3000900494 shutdown_connections 2023-12-19T18:59:51.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.158+0000 7f78528bb640 1 -- 172.21.15.133:0/3000900494 wait complete. 2023-12-19T18:59:51.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.158+0000 7f78528bb640 1 Processor -- start 2023-12-19T18:59:51.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.158+0000 7f78528bb640 1 -- start start 2023-12-19T18:59:51.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.162+0000 7f78528bb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f784c073a70 0x7f784c152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:51.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.162+0000 7f78528bb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f784c14b010 0x7f784c14db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:51.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.162+0000 7f78528bb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f784c157c20 0x7f784c1536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:51.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.162+0000 7f78528bb640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c153120 con 0x7f784c073a70 2023-12-19T18:59:51.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.162+0000 7f78528bb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784c14d0b0 con 0x7f784c157c20 2023-12-19T18:59:51.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.162+0000 7f78528bb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784c14e080 con 0x7f784c14b010 2023-12-19T18:59:51.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.162+0000 7f784bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f784c073a70 0x7f784c152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:51.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.162+0000 7f784bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f784c073a70 0x7f784c152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59958/0 (socket says 172.21.15.133:59958) 2023-12-19T18:59:51.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.162+0000 7f784bfff640 1 -- 172.21.15.133:0/3482537920 learned_addr learned my addr 172.21.15.133:0/3482537920 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:51.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.162+0000 7f7850e58640 1 --2- 172.21.15.133:0/3482537920 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f784c157c20 0x7f784c1536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:51.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.162+0000 7f784bfff640 1 -- 172.21.15.133:0/3482537920 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f784c14b010 msgr2=0x7f784c14db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:51.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.162+0000 7f784bfff640 1 --2- 172.21.15.133:0/3482537920 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f784c14b010 0x7f784c14db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.162+0000 7f784bfff640 1 -- 172.21.15.133:0/3482537920 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f784c157c20 msgr2=0x7f784c1536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:51.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.162+0000 7f784bfff640 1 --2- 172.21.15.133:0/3482537920 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f784c157c20 0x7f784c1536f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.162+0000 7f784bfff640 1 -- 172.21.15.133:0/3482537920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f783c0094d0 con 0x7f784c073a70 2023-12-19T18:59:51.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.162+0000 7f784bfff640 1 --2- 172.21.15.133:0/3482537920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f784c073a70 0x7f784c152be0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f783c01b900 tx=0x7f783c01ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:51.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.162+0000 7f7848ff9640 1 -- 172.21.15.133:0/3482537920 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c0ba600 con 0x7f784c073a70 2023-12-19T18:59:51.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.162+0000 7f7848ff9640 1 -- 172.21.15.133:0/3482537920 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783c0ba760 con 0x7f784c073a70 2023-12-19T18:59:51.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.162+0000 7f7848ff9640 1 -- 172.21.15.133:0/3482537920 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c0bab10 con 0x7f784c073a70 2023-12-19T18:59:51.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.162+0000 7f78528bb640 1 -- 172.21.15.133:0/3482537920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f784c0a9770 con 0x7f784c073a70 2023-12-19T18:59:51.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.162+0000 7f78528bb640 1 -- 172.21.15.133:0/3482537920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f784c14d340 con 0x7f784c073a70 2023-12-19T18:59:51.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.162+0000 7f78528bb640 1 -- 172.21.15.133:0/3482537920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784c0a9c20 con 0x7f784c073a70 2023-12-19T18:59:51.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.166+0000 7f7848ff9640 1 -- 172.21.15.133:0/3482537920 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f783c0bac70 con 0x7f784c073a70 2023-12-19T18:59:51.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.166+0000 7f7848ff9640 1 --2- 172.21.15.133:0/3482537920 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7838066470 0x7f7838068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:51.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.166+0000 7f7848ff9640 1 -- 172.21.15.133:0/3482537920 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f783c122840 con 0x7f784c073a70 2023-12-19T18:59:51.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.166+0000 7f784b7fe640 1 --2- 172.21.15.133:0/3482537920 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7838066470 0x7f7838068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:51.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.166+0000 7f784b7fe640 1 --2- 172.21.15.133:0/3482537920 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7838066470 0x7f7838068930 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7840000f70 tx=0x7f78400079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:51.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.170+0000 7f7848ff9640 1 -- 172.21.15.133:0/3482537920 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f783c0ef8c0 con 0x7f784c073a70 2023-12-19T18:59:51.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.318+0000 7f78528bb640 1 -- 172.21.15.133:0/3482537920 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f784c068400 con 0x7f784c073a70 2023-12-19T18:59:51.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.318+0000 7f7848ff9640 1 -- 172.21.15.133:0/3482537920 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f783c0f2ee0 con 0x7f784c073a70 2023-12-19T18:59:51.326 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T18:59:51.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.322+0000 7f78528bb640 1 -- 172.21.15.133:0/3482537920 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7838066470 msgr2=0x7f7838068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:51.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.322+0000 7f78528bb640 1 --2- 172.21.15.133:0/3482537920 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7838066470 0x7f7838068930 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7840000f70 tx=0x7f78400079c0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.322+0000 7f78528bb640 1 -- 172.21.15.133:0/3482537920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f784c073a70 msgr2=0x7f784c152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:51.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.322+0000 7f78528bb640 1 --2- 172.21.15.133:0/3482537920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f784c073a70 0x7f784c152be0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f783c01b900 tx=0x7f783c01ba90 comp rx=0 tx=0).stop 2023-12-19T18:59:51.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.322+0000 7f78528bb640 1 -- 172.21.15.133:0/3482537920 shutdown_connections 2023-12-19T18:59:51.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.322+0000 7f78528bb640 1 --2- 172.21.15.133:0/3482537920 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7838066470 0x7f7838068930 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.322+0000 7f78528bb640 1 --2- 172.21.15.133:0/3482537920 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f784c157c20 0x7f784c1536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.322+0000 7f78528bb640 1 --2- 172.21.15.133:0/3482537920 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f784c14b010 0x7f784c14db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.322+0000 7f78528bb640 1 --2- 172.21.15.133:0/3482537920 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f784c073a70 0x7f784c152be0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.322+0000 7f78528bb640 1 -- 172.21.15.133:0/3482537920 >> 172.21.15.133:0/3482537920 conn(0x7f784c0c30c0 msgr2=0x7f784c0bff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:51.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.322+0000 7f78528bb640 1 -- 172.21.15.133:0/3482537920 shutdown_connections 2023-12-19T18:59:51.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.322+0000 7f78528bb640 1 -- 172.21.15.133:0/3482537920 wait complete. 2023-12-19T18:59:51.347 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:59:51.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.478+0000 7f1c72f80640 1 Processor -- start 2023-12-19T18:59:51.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.482+0000 7f1c72f80640 1 -- start start 2023-12-19T18:59:51.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.482+0000 7f1c72f80640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1c6c072090 0x7f1c6c0a5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:51.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.482+0000 7f1c72f80640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c6c0c3bd0 0x7f1c6c0c4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:51.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.482+0000 7f1c72f80640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6c0c2760 con 0x7f1c6c0725c0 2023-12-19T18:59:51.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.482+0000 7f1c72f80640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6c0c3070 con 0x7f1c6c0c3bd0 2023-12-19T18:59:51.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.482+0000 7f1c72f80640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6c0c63e0 con 0x7f1c6c072090 2023-12-19T18:59:51.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.482+0000 7f1c7151d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c6c0c3bd0 0x7f1c6c0c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:51.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.482+0000 7f1c63fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1c6c0725c0 0x7f1c6c0c5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47208/0 (socket says 172.21.15.133:47208) 2023-12-19T18:59:51.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.482+0000 7f1c7151d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c6c0c3bd0 0x7f1c6c0c4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59972/0 (socket says 172.21.15.133:59972) 2023-12-19T18:59:51.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.482+0000 7f1c63fff640 1 -- 172.21.15.133:0/1889150452 learned_addr learned my addr 172.21.15.133:0/1889150452 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:51.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.482+0000 7f1c70d1c640 1 --2- 172.21.15.133:0/1889150452 >> v2:172.21.15.138:3300/0 conn(0x7f1c6c072090 0x7f1c6c0a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:51.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.482+0000 7f1c7151d640 1 -- 172.21.15.133:0/1889150452 >> v2:172.21.15.138:3300/0 conn(0x7f1c6c072090 msgr2=0x7f1c6c0a5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:51.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.482+0000 7f1c7151d640 1 --2- 172.21.15.133:0/1889150452 >> v2:172.21.15.138:3300/0 conn(0x7f1c6c072090 0x7f1c6c0a5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.482+0000 7f1c7151d640 1 -- 172.21.15.133:0/1889150452 >> v1:172.21.15.133:6789/0 conn(0x7f1c6c0725c0 legacy=0x7f1c6c0c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:51.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.482+0000 7f1c7151d640 1 -- 172.21.15.133:0/1889150452 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c0aad20 con 0x7f1c6c0c3bd0 2023-12-19T18:59:51.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.482+0000 7f1c637fe640 1 -- 172.21.15.133:0/1889150452 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443090969 0 0) 0x7f1c6c0c2760 con 0x7f1c6c0725c0 2023-12-19T18:59:51.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.486+0000 7f1c7151d640 1 --2- 172.21.15.133:0/1889150452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c0c3bd0 0x7f1c6c0c4020 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c0a8af0 tx=0x7f1c6401c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593a7ddc3951995d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:51.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.486+0000 7f1c637fe640 1 -- 172.21.15.133:0/1889150452 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c640a58b0 con 0x7f1c6c0c3bd0 2023-12-19T18:59:51.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.486+0000 7f1c637fe640 1 -- 172.21.15.133:0/1889150452 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c640a5a10 con 0x7f1c6c0c3bd0 2023-12-19T18:59:51.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.486+0000 7f1c637fe640 1 -- 172.21.15.133:0/1889150452 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c640a5da0 con 0x7f1c6c0c3bd0 2023-12-19T18:59:51.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.486+0000 7f1c72f80640 1 -- 172.21.15.133:0/1889150452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c0c3bd0 msgr2=0x7f1c6c0c4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:51.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.486+0000 7f1c72f80640 1 --2- 172.21.15.133:0/1889150452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c0c3bd0 0x7f1c6c0c4020 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c0a8af0 tx=0x7f1c6401c7f0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.486+0000 7f1c72f80640 1 -- 172.21.15.133:0/1889150452 shutdown_connections 2023-12-19T18:59:51.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.486+0000 7f1c72f80640 1 --2- 172.21.15.133:0/1889150452 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c0c3bd0 0x7f1c6c0c4020 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.486+0000 7f1c72f80640 1 --2- 172.21.15.133:0/1889150452 >> v2:172.21.15.138:3300/0 conn(0x7f1c6c072090 0x7f1c6c0a5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.486+0000 7f1c72f80640 1 -- 172.21.15.133:0/1889150452 >> 172.21.15.133:0/1889150452 conn(0x7f1c6c06a5b0 msgr2=0x7f1c6c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:51.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.486+0000 7f1c72f80640 1 -- 172.21.15.133:0/1889150452 shutdown_connections 2023-12-19T18:59:51.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.486+0000 7f1c72f80640 1 -- 172.21.15.133:0/1889150452 wait complete. 2023-12-19T18:59:51.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.486+0000 7f1c72f80640 1 Processor -- start 2023-12-19T18:59:51.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.486+0000 7f1c72f80640 1 -- start start 2023-12-19T18:59:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c72f80640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c6c072090 0x7f1c6c144230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c72f80640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c0725c0 0x7f1c6c0a64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c72f80640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1c6c0c3bd0 0x7f1c6c0a6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c72f80640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c144d20 con 0x7f1c6c0725c0 2023-12-19T18:59:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c72f80640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0a5d80 con 0x7f1c6c072090 2023-12-19T18:59:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c72f80640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c0a6060 con 0x7f1c6c0c3bd0 2023-12-19T18:59:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c63fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c0725c0 0x7f1c6c0a64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c70d1c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c6c072090 0x7f1c6c144230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c63fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c0725c0 0x7f1c6c0a64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59980/0 (socket says 172.21.15.133:59980) 2023-12-19T18:59:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c63fff640 1 -- 172.21.15.133:0/1371426290 learned_addr learned my addr 172.21.15.133:0/1371426290 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c7151d640 1 --2- 172.21.15.133:0/1371426290 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1c6c0c3bd0 0x7f1c6c0a6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:51.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c63fff640 1 -- 172.21.15.133:0/1371426290 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1c6c0c3bd0 msgr2=0x7f1c6c0a6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c63fff640 1 --2- 172.21.15.133:0/1371426290 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1c6c0c3bd0 0x7f1c6c0a6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c63fff640 1 -- 172.21.15.133:0/1371426290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c6c072090 msgr2=0x7f1c6c144230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c63fff640 1 --2- 172.21.15.133:0/1371426290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c6c072090 0x7f1c6c144230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c63fff640 1 -- 172.21.15.133:0/1371426290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c64009a70 con 0x7f1c6c0725c0 2023-12-19T18:59:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c63fff640 1 --2- 172.21.15.133:0/1371426290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c0725c0 0x7f1c6c0a64f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0011f0 tx=0x7f1c5c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c617fa640 1 -- 172.21.15.133:0/1371426290 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c0074e0 con 0x7f1c6c0725c0 2023-12-19T18:59:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c617fa640 1 -- 172.21.15.133:0/1371426290 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c007640 con 0x7f1c6c0725c0 2023-12-19T18:59:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c72f80640 1 -- 172.21.15.133:0/1371426290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6c144a80 con 0x7f1c6c0725c0 2023-12-19T18:59:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c617fa640 1 -- 172.21.15.133:0/1371426290 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c004a10 con 0x7f1c6c0725c0 2023-12-19T18:59:51.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c72f80640 1 -- 172.21.15.133:0/1371426290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6c0a7d50 con 0x7f1c6c0725c0 2023-12-19T18:59:51.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c72f80640 1 -- 172.21.15.133:0/1371426290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6c068400 con 0x7f1c6c0725c0 2023-12-19T18:59:51.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.490+0000 7f1c617fa640 1 -- 172.21.15.133:0/1371426290 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1c5c004b70 con 0x7f1c6c0725c0 2023-12-19T18:59:51.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.494+0000 7f1c617fa640 1 --2- 172.21.15.133:0/1371426290 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1c58066470 0x7f1c58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:51.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.494+0000 7f1c617fa640 1 -- 172.21.15.133:0/1371426290 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1c5c083240 con 0x7f1c6c0725c0 2023-12-19T18:59:51.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.494+0000 7f1c70d1c640 1 --2- 172.21.15.133:0/1371426290 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1c58066470 0x7f1c58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:51.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.494+0000 7f1c70d1c640 1 --2- 172.21.15.133:0/1371426290 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1c58066470 0x7f1c58068930 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1c680079c0 tx=0x7f1c68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:51.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.498+0000 7f1c617fa640 1 -- 172.21.15.133:0/1371426290 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1c5c0504a0 con 0x7f1c6c0725c0 2023-12-19T18:59:51.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.650+0000 7f1c72f80640 1 -- 172.21.15.133:0/1371426290 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1c6c0c6780 con 0x7f1c6c0725c0 2023-12-19T18:59:51.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.650+0000 7f1c617fa640 1 -- 172.21.15.133:0/1371426290 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1c5c053ac0 con 0x7f1c6c0725c0 2023-12-19T18:59:51.658 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T18:59:51.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.654+0000 7f1c72f80640 1 -- 172.21.15.133:0/1371426290 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1c58066470 msgr2=0x7f1c58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:51.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.654+0000 7f1c72f80640 1 --2- 172.21.15.133:0/1371426290 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1c58066470 0x7f1c58068930 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1c680079c0 tx=0x7f1c68008040 comp rx=0 tx=0).stop 2023-12-19T18:59:51.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.654+0000 7f1c72f80640 1 -- 172.21.15.133:0/1371426290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c0725c0 msgr2=0x7f1c6c0a64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:51.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.654+0000 7f1c72f80640 1 --2- 172.21.15.133:0/1371426290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c0725c0 0x7f1c6c0a64f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c0011f0 tx=0x7f1c5c00c9b0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.654+0000 7f1c72f80640 1 -- 172.21.15.133:0/1371426290 shutdown_connections 2023-12-19T18:59:51.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.654+0000 7f1c72f80640 1 --2- 172.21.15.133:0/1371426290 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1c58066470 0x7f1c58068930 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.654+0000 7f1c72f80640 1 --2- 172.21.15.133:0/1371426290 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1c6c0c3bd0 0x7f1c6c0a6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.654+0000 7f1c72f80640 1 --2- 172.21.15.133:0/1371426290 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c6c0725c0 0x7f1c6c0a64f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.654+0000 7f1c72f80640 1 --2- 172.21.15.133:0/1371426290 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c6c072090 0x7f1c6c144230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.654+0000 7f1c72f80640 1 -- 172.21.15.133:0/1371426290 >> 172.21.15.133:0/1371426290 conn(0x7f1c6c06a5b0 msgr2=0x7f1c6c14fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:51.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.654+0000 7f1c72f80640 1 -- 172.21.15.133:0/1371426290 shutdown_connections 2023-12-19T18:59:51.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.654+0000 7f1c72f80640 1 -- 172.21.15.133:0/1371426290 wait complete. 2023-12-19T18:59:51.679 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:59:51.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.818+0000 7f8741580640 1 Processor -- start 2023-12-19T18:59:51.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.818+0000 7f8741580640 1 -- start start 2023-12-19T18:59:51.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.818+0000 7f8741580640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f873c0c5260 0x7f873c06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:51.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.818+0000 7f8741580640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873c0c2580 con 0x7f873c0c5640 2023-12-19T18:59:51.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.818+0000 7f8741580640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f873c156940 con 0x7f873c155de0 2023-12-19T18:59:51.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.818+0000 7f8741580640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873c153510 con 0x7f873c0c5260 2023-12-19T18:59:51.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.818+0000 7f873affd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f873c0c5260 0x7f873c06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:51.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.818+0000 7f87327fc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f873c0c5640 0x7f873c0c5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47218/0 (socket says 172.21.15.133:47218) 2023-12-19T18:59:51.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.818+0000 7f87327fc640 1 -- 172.21.15.133:0/252318873 learned_addr learned my addr 172.21.15.133:0/252318873 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:51.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.818+0000 7f873affd640 1 -- 172.21.15.133:0/252318873 >> v1:172.21.15.138:6789/0 conn(0x7f873c155de0 legacy=0x7f873c156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:51.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.818+0000 7f873affd640 1 -- 172.21.15.133:0/252318873 >> v1:172.21.15.133:6789/0 conn(0x7f873c0c5640 legacy=0x7f873c0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:51.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.818+0000 7f873affd640 1 -- 172.21.15.133:0/252318873 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873c0c1a00 con 0x7f873c0c5260 2023-12-19T18:59:51.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.822+0000 7f873affd640 1 --2- 172.21.15.133:0/252318873 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f873c0c5260 0x7f873c06d5b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f872c0097c0 tx=0x7f872c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba59b563c5f9c4c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:51.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.822+0000 7f873a7fc640 1 -- 172.21.15.133:0/252318873 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c0ab600 con 0x7f873c0c5260 2023-12-19T18:59:51.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.822+0000 7f873a7fc640 1 -- 172.21.15.133:0/252318873 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872c0a7050 con 0x7f873c0c5260 2023-12-19T18:59:51.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.822+0000 7f873a7fc640 1 -- 172.21.15.133:0/252318873 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c0ab980 con 0x7f873c0c5260 2023-12-19T18:59:51.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.822+0000 7f8741580640 1 -- 172.21.15.133:0/252318873 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f873c0c5260 msgr2=0x7f873c06d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:51.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.822+0000 7f8741580640 1 --2- 172.21.15.133:0/252318873 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f873c0c5260 0x7f873c06d5b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f872c0097c0 tx=0x7f872c01c3b0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.822+0000 7f8741580640 1 -- 172.21.15.133:0/252318873 shutdown_connections 2023-12-19T18:59:51.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.822+0000 7f8741580640 1 --2- 172.21.15.133:0/252318873 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f873c0c5260 0x7f873c06d5b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.822+0000 7f8741580640 1 -- 172.21.15.133:0/252318873 >> 172.21.15.133:0/252318873 conn(0x7f873c06a5b0 msgr2=0x7f873c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:51.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.822+0000 7f8741580640 1 -- 172.21.15.133:0/252318873 shutdown_connections 2023-12-19T18:59:51.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.822+0000 7f8741580640 1 -- 172.21.15.133:0/252318873 wait complete. 2023-12-19T18:59:51.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.822+0000 7f8741580640 1 Processor -- start 2023-12-19T18:59:51.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.822+0000 7f8741580640 1 -- start start 2023-12-19T18:59:51.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f8741580640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f873c0c5260 0x7f873c14a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:51.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f8741580640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f873c0c5640 0x7f873c0c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:51.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f8741580640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f873c155de0 0x7f873c0aa790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:51.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f8741580640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c0aacd0 con 0x7f873c0c5640 2023-12-19T18:59:51.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f8741580640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873c14a750 con 0x7f873c155de0 2023-12-19T18:59:51.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f8741580640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f873c14aa30 con 0x7f873c0c5260 2023-12-19T18:59:51.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f87327fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f873c0c5640 0x7f873c0c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:51.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f87327fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f873c0c5640 0x7f873c0c43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59994/0 (socket says 172.21.15.133:59994) 2023-12-19T18:59:51.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f87327fc640 1 -- 172.21.15.133:0/3378952464 learned_addr learned my addr 172.21.15.133:0/3378952464 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:51.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f873affd640 1 --2- 172.21.15.133:0/3378952464 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f873c0c5260 0x7f873c14a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:51.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f873b7fe640 1 --2- 172.21.15.133:0/3378952464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f873c155de0 0x7f873c0aa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:51.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f87327fc640 1 -- 172.21.15.133:0/3378952464 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f873c0c5260 msgr2=0x7f873c14a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:51.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f87327fc640 1 --2- 172.21.15.133:0/3378952464 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f873c0c5260 0x7f873c14a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f87327fc640 1 -- 172.21.15.133:0/3378952464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f873c155de0 msgr2=0x7f873c0aa790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:51.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f87327fc640 1 --2- 172.21.15.133:0/3378952464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f873c155de0 0x7f873c0aa790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f87327fc640 1 -- 172.21.15.133:0/3378952464 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872c009420 con 0x7f873c0c5640 2023-12-19T18:59:51.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f873affd640 1 --2- 172.21.15.133:0/3378952464 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f873c0c5260 0x7f873c14a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:51.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f873b7fe640 1 --2- 172.21.15.133:0/3378952464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f873c155de0 0x7f873c0aa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:51.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f87327fc640 1 --2- 172.21.15.133:0/3378952464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f873c0c5640 0x7f873c0c43a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8724001ec0 tx=0x7f872400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:51.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f8733fff640 1 -- 172.21.15.133:0/3378952464 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724005cf0 con 0x7f873c0c5640 2023-12-19T18:59:51.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f8733fff640 1 -- 172.21.15.133:0/3378952464 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8724005e50 con 0x7f873c0c5640 2023-12-19T18:59:51.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f8733fff640 1 -- 172.21.15.133:0/3378952464 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87240072d0 con 0x7f873c0c5640 2023-12-19T18:59:51.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f8741580640 1 -- 172.21.15.133:0/3378952464 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f873c0c38c0 con 0x7f873c0c5640 2023-12-19T18:59:51.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f8741580640 1 -- 172.21.15.133:0/3378952464 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873c0c3e80 con 0x7f873c0c5640 2023-12-19T18:59:51.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.826+0000 7f8741580640 1 -- 172.21.15.133:0/3378952464 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873c0c40c0 con 0x7f873c0c5640 2023-12-19T18:59:51.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.830+0000 7f8733fff640 1 -- 172.21.15.133:0/3378952464 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8724007430 con 0x7f873c0c5640 2023-12-19T18:59:51.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.830+0000 7f8733fff640 1 --2- 172.21.15.133:0/3378952464 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f871c066470 0x7f871c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:51.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.830+0000 7f8733fff640 1 -- 172.21.15.133:0/3378952464 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8724083690 con 0x7f873c0c5640 2023-12-19T18:59:51.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.830+0000 7f873affd640 1 --2- 172.21.15.133:0/3378952464 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f871c066470 0x7f871c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:51.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.830+0000 7f873affd640 1 --2- 172.21.15.133:0/3378952464 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f871c066470 0x7f871c068930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f872c0ad000 tx=0x7f872c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:51.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.834+0000 7f8733fff640 1 -- 172.21.15.133:0/3378952464 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f873c0c40c0 con 0x7f873c0c5640 2023-12-19T18:59:51.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.986+0000 7f8741580640 1 -- 172.21.15.133:0/3378952464 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f873c0c40c0 con 0x7f873c0c5640 2023-12-19T18:59:51.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.986+0000 7f8733fff640 1 -- 172.21.15.133:0/3378952464 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f873c0c40c0 con 0x7f873c0c5640 2023-12-19T18:59:51.992 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T18:59:51.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.986+0000 7f8741580640 1 -- 172.21.15.133:0/3378952464 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f871c066470 msgr2=0x7f871c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:51.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.986+0000 7f8741580640 1 --2- 172.21.15.133:0/3378952464 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f871c066470 0x7f871c068930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f872c0ad000 tx=0x7f872c0a6000 comp rx=0 tx=0).stop 2023-12-19T18:59:51.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.986+0000 7f8741580640 1 -- 172.21.15.133:0/3378952464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f873c0c5640 msgr2=0x7f873c0c43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:51.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.986+0000 7f8741580640 1 --2- 172.21.15.133:0/3378952464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f873c0c5640 0x7f873c0c43a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8724001ec0 tx=0x7f872400c890 comp rx=0 tx=0).stop 2023-12-19T18:59:51.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.986+0000 7f8741580640 1 -- 172.21.15.133:0/3378952464 shutdown_connections 2023-12-19T18:59:51.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.986+0000 7f8741580640 1 --2- 172.21.15.133:0/3378952464 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f871c066470 0x7f871c068930 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.986+0000 7f8741580640 1 --2- 172.21.15.133:0/3378952464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f873c155de0 0x7f873c0aa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.986+0000 7f8741580640 1 --2- 172.21.15.133:0/3378952464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f873c0c5640 0x7f873c0c43a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.986+0000 7f8741580640 1 --2- 172.21.15.133:0/3378952464 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f873c0c5260 0x7f873c14a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:51.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.986+0000 7f8741580640 1 -- 172.21.15.133:0/3378952464 >> 172.21.15.133:0/3378952464 conn(0x7f873c06a5b0 msgr2=0x7f873c0702d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:51.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.986+0000 7f8741580640 1 -- 172.21.15.133:0/3378952464 shutdown_connections 2023-12-19T18:59:51.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:51.986+0000 7f8741580640 1 -- 172.21.15.133:0/3378952464 wait complete. 2023-12-19T18:59:52.014 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-19T18:59:52.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.146+0000 7f9de9580640 1 Processor -- start 2023-12-19T18:59:52.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.146+0000 7f9de9580640 1 -- start start 2023-12-19T18:59:52.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.150+0000 7f9de9580640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9de40c6900 0x7f9de4155d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:52.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.150+0000 7f9de9580640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9de40c30c0 0x7f9de40c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:52.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.150+0000 7f9de9580640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9de40c1f80 con 0x7f9de40a7520 2023-12-19T18:59:52.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.150+0000 7f9de9580640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9de40a7900 con 0x7f9de40c30c0 2023-12-19T18:59:52.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.150+0000 7f9de9580640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de40c60d0 con 0x7f9de40c6900 2023-12-19T18:59:52.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.150+0000 7f9de37fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9de40c30c0 0x7f9de40c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:52.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.150+0000 7f9de37fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9de40c30c0 0x7f9de40c7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60002/0 (socket says 172.21.15.133:60002) 2023-12-19T18:59:52.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.150+0000 7f9de37fe640 1 -- 172.21.15.133:0/1679395034 learned_addr learned my addr 172.21.15.133:0/1679395034 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:52.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.150+0000 7f9de27fc640 1 --2- 172.21.15.133:0/1679395034 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9de40c6900 0x7f9de4155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:52.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.150+0000 7f9de37fe640 1 -- 172.21.15.133:0/1679395034 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9de40c6900 msgr2=0x7f9de4155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:52.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.150+0000 7f9de37fe640 1 --2- 172.21.15.133:0/1679395034 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9de40c6900 0x7f9de4155d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.150+0000 7f9de37fe640 1 -- 172.21.15.133:0/1679395034 >> v1:172.21.15.138:6789/0 conn(0x7f9de40a7520 legacy=0x7f9de40c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:52.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.150+0000 7f9de37fe640 1 -- 172.21.15.133:0/1679395034 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de40c63b0 con 0x7f9de40c30c0 2023-12-19T18:59:52.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.150+0000 7f9de27fc640 1 --2- 172.21.15.133:0/1679395034 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9de40c6900 0x7f9de4155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:52.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.154+0000 7f9de37fe640 1 --2- 172.21.15.133:0/1679395034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9de40c30c0 0x7f9de40c7aa0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009e50 tx=0x7f9ddc01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec072ffc67a5d8bb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:52.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.154+0000 7f9de1ffb640 1 -- 172.21.15.133:0/1679395034 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc0a5750 con 0x7f9de40c30c0 2023-12-19T18:59:52.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.154+0000 7f9de1ffb640 1 -- 172.21.15.133:0/1679395034 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ddc0a58b0 con 0x7f9de40c30c0 2023-12-19T18:59:52.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.154+0000 7f9de1ffb640 1 -- 172.21.15.133:0/1679395034 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc0a5c40 con 0x7f9de40c30c0 2023-12-19T18:59:52.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.154+0000 7f9de9580640 1 -- 172.21.15.133:0/1679395034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9de40c30c0 msgr2=0x7f9de40c7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:52.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.154+0000 7f9de9580640 1 --2- 172.21.15.133:0/1679395034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9de40c30c0 0x7f9de40c7aa0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009e50 tx=0x7f9ddc01c980 comp rx=0 tx=0).stop 2023-12-19T18:59:52.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.154+0000 7f9de9580640 1 -- 172.21.15.133:0/1679395034 shutdown_connections 2023-12-19T18:59:52.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.154+0000 7f9de9580640 1 --2- 172.21.15.133:0/1679395034 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9de40c30c0 0x7f9de40c7aa0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.154+0000 7f9de9580640 1 --2- 172.21.15.133:0/1679395034 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9de40c6900 0x7f9de4155d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.154+0000 7f9de9580640 1 -- 172.21.15.133:0/1679395034 >> 172.21.15.133:0/1679395034 conn(0x7f9de40a9b80 msgr2=0x7f9de40a9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:52.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.154+0000 7f9de9580640 1 -- 172.21.15.133:0/1679395034 shutdown_connections 2023-12-19T18:59:52.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.154+0000 7f9de9580640 1 -- 172.21.15.133:0/1679395034 wait complete. 2023-12-19T18:59:52.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.154+0000 7f9de9580640 1 Processor -- start 2023-12-19T18:59:52.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.154+0000 7f9de9580640 1 -- start start 2023-12-19T18:59:52.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9de9580640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9de40a7520 0x7f9de40ac670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:52.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9de9580640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9de40c30c0 0x7f9de4151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:52.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9de9580640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9de40c6900 0x7f9de414d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:52.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9de9580640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de406d100 con 0x7f9de40a7520 2023-12-19T18:59:52.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9de9580640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de406ca00 con 0x7f9de40c30c0 2023-12-19T18:59:52.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9de9580640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9de406d370 con 0x7f9de40c6900 2023-12-19T18:59:52.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9de2ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9de40a7520 0x7f9de40ac670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:52.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9de2ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9de40a7520 0x7f9de40ac670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60014/0 (socket says 172.21.15.133:60014) 2023-12-19T18:59:52.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9de2ffd640 1 -- 172.21.15.133:0/1991697435 learned_addr learned my addr 172.21.15.133:0/1991697435 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:52.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9de27fc640 1 --2- 172.21.15.133:0/1991697435 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9de40c30c0 0x7f9de4151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:52.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9de37fe640 1 --2- 172.21.15.133:0/1991697435 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9de40c6900 0x7f9de414d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:52.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9de2ffd640 1 -- 172.21.15.133:0/1991697435 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9de40c6900 msgr2=0x7f9de414d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:52.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9de2ffd640 1 --2- 172.21.15.133:0/1991697435 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9de40c6900 0x7f9de414d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9de2ffd640 1 -- 172.21.15.133:0/1991697435 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9de40c30c0 msgr2=0x7f9de4151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:52.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9de2ffd640 1 --2- 172.21.15.133:0/1991697435 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9de40c30c0 0x7f9de4151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9de2ffd640 1 -- 172.21.15.133:0/1991697435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ddc009b30 con 0x7f9de40a7520 2023-12-19T18:59:52.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9de27fc640 1 --2- 172.21.15.133:0/1991697435 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9de40c30c0 0x7f9de4151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:52.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9de2ffd640 1 --2- 172.21.15.133:0/1991697435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9de40a7520 0x7f9de40ac670 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400c3c0 tx=0x7f9dd400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:52.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9dcb7fe640 1 -- 172.21.15.133:0/1991697435 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd40052d0 con 0x7f9de40a7520 2023-12-19T18:59:52.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9dcb7fe640 1 -- 172.21.15.133:0/1991697435 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd4005430 con 0x7f9de40a7520 2023-12-19T18:59:52.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9dcb7fe640 1 -- 172.21.15.133:0/1991697435 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4003840 con 0x7f9de40a7520 2023-12-19T18:59:52.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9de9580640 1 -- 172.21.15.133:0/1991697435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de406d650 con 0x7f9de40a7520 2023-12-19T18:59:52.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9de9580640 1 -- 172.21.15.133:0/1991697435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de40acbb0 con 0x7f9de40a7520 2023-12-19T18:59:52.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9de9580640 1 -- 172.21.15.133:0/1991697435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de40ab630 con 0x7f9de40a7520 2023-12-19T18:59:52.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.158+0000 7f9dcb7fe640 1 -- 172.21.15.133:0/1991697435 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9dd40039a0 con 0x7f9de40a7520 2023-12-19T18:59:52.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.162+0000 7f9dcb7fe640 1 --2- 172.21.15.133:0/1991697435 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9dd0066470 0x7f9dd0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:52.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.162+0000 7f9dcb7fe640 1 -- 172.21.15.133:0/1991697435 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9dd40837d0 con 0x7f9de40a7520 2023-12-19T18:59:52.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.162+0000 7f9de27fc640 1 --2- 172.21.15.133:0/1991697435 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9dd0066470 0x7f9dd0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:52.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.162+0000 7f9de27fc640 1 --2- 172.21.15.133:0/1991697435 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9dd0066470 0x7f9dd0068930 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9de415f0c0 tx=0x7f9dd8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:52.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.166+0000 7f9dcb7fe640 1 -- 172.21.15.133:0/1991697435 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9dd4050850 con 0x7f9de40a7520 2023-12-19T18:59:52.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.314+0000 7f9de9580640 1 -- 172.21.15.133:0/1991697435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9de40c14f0 con 0x7f9de40a7520 2023-12-19T18:59:52.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.314+0000 7f9dcb7fe640 1 -- 172.21.15.133:0/1991697435 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v35) v1 ==== 105+0+11 (secure 0 0 0) 0x7f9dd4053e70 con 0x7f9de40a7520 2023-12-19T18:59:52.321 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T18:59:52.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.314+0000 7f9de9580640 1 -- 172.21.15.133:0/1991697435 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9dd0066470 msgr2=0x7f9dd0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:52.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.314+0000 7f9de9580640 1 --2- 172.21.15.133:0/1991697435 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9dd0066470 0x7f9dd0068930 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9de415f0c0 tx=0x7f9dd8008040 comp rx=0 tx=0).stop 2023-12-19T18:59:52.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.314+0000 7f9de9580640 1 -- 172.21.15.133:0/1991697435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9de40a7520 msgr2=0x7f9de40ac670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:52.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.314+0000 7f9de9580640 1 --2- 172.21.15.133:0/1991697435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9de40a7520 0x7f9de40ac670 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400c3c0 tx=0x7f9dd400c880 comp rx=0 tx=0).stop 2023-12-19T18:59:52.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.314+0000 7f9de9580640 1 -- 172.21.15.133:0/1991697435 shutdown_connections 2023-12-19T18:59:52.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.314+0000 7f9de9580640 1 --2- 172.21.15.133:0/1991697435 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9dd0066470 0x7f9dd0068930 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.314+0000 7f9de9580640 1 --2- 172.21.15.133:0/1991697435 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9de40c6900 0x7f9de414d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.314+0000 7f9de9580640 1 --2- 172.21.15.133:0/1991697435 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9de40c30c0 0x7f9de4151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.314+0000 7f9de9580640 1 --2- 172.21.15.133:0/1991697435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9de40a7520 0x7f9de40ac670 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.314+0000 7f9de9580640 1 -- 172.21.15.133:0/1991697435 >> 172.21.15.133:0/1991697435 conn(0x7f9de40a9b80 msgr2=0x7f9de4157cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:52.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.314+0000 7f9de9580640 1 -- 172.21.15.133:0/1991697435 shutdown_connections 2023-12-19T18:59:52.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.314+0000 7f9de9580640 1 -- 172.21.15.133:0/1991697435 wait complete. 2023-12-19T18:59:52.342 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-19T18:59:52.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.474+0000 7f2cfdbaa640 1 Processor -- start 2023-12-19T18:59:52.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.474+0000 7f2cfdbaa640 1 -- start start 2023-12-19T18:59:52.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.474+0000 7f2cfdbaa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cf80a5370 0x7f2cf80c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:52.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.474+0000 7f2cfdbaa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2cf8072090 0x7f2cf81516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:52.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.474+0000 7f2cfdbaa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf80c2760 con 0x7f2cf80c4110 2023-12-19T18:59:52.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.474+0000 7f2cfdbaa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf80c3070 con 0x7f2cf8072090 2023-12-19T18:59:52.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.474+0000 7f2cfdbaa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf8151bf0 con 0x7f2cf80a5370 2023-12-19T18:59:52.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cf77fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cf80a5370 0x7f2cf80c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:52.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cf7fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2cf8072090 0x7f2cf81516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:52.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cf7fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2cf8072090 0x7f2cf81516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:39532/0 (socket says 172.21.15.133:39532) 2023-12-19T18:59:52.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cf7fff640 1 -- 172.21.15.133:0/3627795013 learned_addr learned my addr 172.21.15.133:0/3627795013 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:52.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cf6ffd640 1 --1- 172.21.15.133:0/3627795013 >> v1:172.21.15.138:6789/0 conn(0x7f2cf80c4110 0x7f2cf8150fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:43958/0 (socket says 172.21.15.133:43958) 2023-12-19T18:59:52.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cf77fe640 1 -- 172.21.15.133:0/3627795013 >> v2:172.21.15.138:3300/0 conn(0x7f2cf8072090 msgr2=0x7f2cf81516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:52.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cf77fe640 1 --2- 172.21.15.133:0/3627795013 >> v2:172.21.15.138:3300/0 conn(0x7f2cf8072090 0x7f2cf81516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cf77fe640 1 -- 172.21.15.133:0/3627795013 >> v1:172.21.15.138:6789/0 conn(0x7f2cf80c4110 legacy=0x7f2cf8150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:52.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cf77fe640 1 -- 172.21.15.133:0/3627795013 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf80a5750 con 0x7f2cf80a5370 2023-12-19T18:59:52.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cf7fff640 1 --2- 172.21.15.133:0/3627795013 >> v2:172.21.15.138:3300/0 conn(0x7f2cf8072090 0x7f2cf81516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:59:52.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cf67fc640 1 -- 172.21.15.133:0/3627795013 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1704519798 0 0) 0x7f2cf80c2760 con 0x7f2cf80c4110 2023-12-19T18:59:52.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cf77fe640 1 --2- 172.21.15.133:0/3627795013 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cf80a5370 0x7f2cf80c3bd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80097c0 tx=0x7f2ce801c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db3e355535499c98 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:52.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cf67fc640 1 -- 172.21.15.133:0/3627795013 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce80ab600 con 0x7f2cf80a5370 2023-12-19T18:59:52.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cf67fc640 1 -- 172.21.15.133:0/3627795013 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce80a7050 con 0x7f2cf80a5370 2023-12-19T18:59:52.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cf67fc640 1 -- 172.21.15.133:0/3627795013 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce80ab980 con 0x7f2cf80a5370 2023-12-19T18:59:52.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cfdbaa640 1 -- 172.21.15.133:0/3627795013 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cf80a5370 msgr2=0x7f2cf80c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:52.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cfdbaa640 1 --2- 172.21.15.133:0/3627795013 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cf80a5370 0x7f2cf80c3bd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80097c0 tx=0x7f2ce801c330 comp rx=0 tx=0).stop 2023-12-19T18:59:52.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cfdbaa640 1 -- 172.21.15.133:0/3627795013 shutdown_connections 2023-12-19T18:59:52.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cfdbaa640 1 --2- 172.21.15.133:0/3627795013 >> v2:172.21.15.138:3300/0 conn(0x7f2cf8072090 0x7f2cf81516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cfdbaa640 1 --2- 172.21.15.133:0/3627795013 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cf80a5370 0x7f2cf80c3bd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cfdbaa640 1 -- 172.21.15.133:0/3627795013 >> 172.21.15.133:0/3627795013 conn(0x7f2cf806a5b0 msgr2=0x7f2cf806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:52.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cfdbaa640 1 -- 172.21.15.133:0/3627795013 shutdown_connections 2023-12-19T18:59:52.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cfdbaa640 1 -- 172.21.15.133:0/3627795013 wait complete. 2023-12-19T18:59:52.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cfdbaa640 1 Processor -- start 2023-12-19T18:59:52.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cfdbaa640 1 -- start start 2023-12-19T18:59:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cfdbaa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cf8072090 0x7f2cf81e94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cfdbaa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cf80a5370 0x7f2cf814cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cfdbaa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cf80c4110 0x7f2cf8146f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cfdbaa640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf81e9a00 con 0x7f2cf80a5370 2023-12-19T18:59:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cfdbaa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf8146830 con 0x7f2cf8072090 2023-12-19T18:59:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.482+0000 7f2cfdbaa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf814e340 con 0x7f2cf80c4110 2023-12-19T18:59:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.486+0000 7f2cf6ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cf80a5370 0x7f2cf814cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.486+0000 7f2cf6ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cf80a5370 0x7f2cf814cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60022/0 (socket says 172.21.15.133:60022) 2023-12-19T18:59:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.486+0000 7f2cf6ffd640 1 -- 172.21.15.133:0/2885662287 learned_addr learned my addr 172.21.15.133:0/2885662287 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.486+0000 7f2cf77fe640 1 --2- 172.21.15.133:0/2885662287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cf8072090 0x7f2cf81e94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.486+0000 7f2cf7fff640 1 --2- 172.21.15.133:0/2885662287 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cf80c4110 0x7f2cf8146f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:52.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.486+0000 7f2cf6ffd640 1 -- 172.21.15.133:0/2885662287 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cf80c4110 msgr2=0x7f2cf8146f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:52.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.486+0000 7f2cf6ffd640 1 --2- 172.21.15.133:0/2885662287 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cf80c4110 0x7f2cf8146f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.486+0000 7f2cf6ffd640 1 -- 172.21.15.133:0/2885662287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cf8072090 msgr2=0x7f2cf81e94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:52.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.486+0000 7f2cf6ffd640 1 --2- 172.21.15.133:0/2885662287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cf8072090 0x7f2cf81e94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.486+0000 7f2cf6ffd640 1 -- 172.21.15.133:0/2885662287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf000bd40 con 0x7f2cf80a5370 2023-12-19T18:59:52.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.486+0000 7f2cf7fff640 1 --2- 172.21.15.133:0/2885662287 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cf80c4110 0x7f2cf8146f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:52.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.486+0000 7f2cf6ffd640 1 --2- 172.21.15.133:0/2885662287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cf80a5370 0x7f2cf814cef0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00c480 tx=0x7f2cec00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:52.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.486+0000 7f2cdffff640 1 -- 172.21.15.133:0/2885662287 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec0074e0 con 0x7f2cf80a5370 2023-12-19T18:59:52.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.486+0000 7f2cdffff640 1 -- 172.21.15.133:0/2885662287 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cec007660 con 0x7f2cf80a5370 2023-12-19T18:59:52.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.486+0000 7f2cdffff640 1 -- 172.21.15.133:0/2885662287 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec004a30 con 0x7f2cf80a5370 2023-12-19T18:59:52.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.486+0000 7f2cfdbaa640 1 -- 172.21.15.133:0/2885662287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce8009420 con 0x7f2cf80a5370 2023-12-19T18:59:52.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.486+0000 7f2cfdbaa640 1 -- 172.21.15.133:0/2885662287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf814daa0 con 0x7f2cf80a5370 2023-12-19T18:59:52.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.486+0000 7f2cfdbaa640 1 -- 172.21.15.133:0/2885662287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf8068400 con 0x7f2cf80a5370 2023-12-19T18:59:52.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.486+0000 7f2cdffff640 1 -- 172.21.15.133:0/2885662287 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2cec004b90 con 0x7f2cf80a5370 2023-12-19T18:59:52.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.490+0000 7f2cdffff640 1 --2- 172.21.15.133:0/2885662287 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2ce40664a0 0x7f2ce4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:52.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.490+0000 7f2cdffff640 1 -- 172.21.15.133:0/2885662287 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2cec0831f0 con 0x7f2cf80a5370 2023-12-19T18:59:52.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.490+0000 7f2cf77fe640 1 --2- 172.21.15.133:0/2885662287 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2ce40664a0 0x7f2ce4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:52.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.490+0000 7f2cf77fe640 1 --2- 172.21.15.133:0/2885662287 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2ce40664a0 0x7f2ce4068960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80097c0 tx=0x7f2ce80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:52.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.494+0000 7f2cdffff640 1 -- 172.21.15.133:0/2885662287 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2cec050450 con 0x7f2cf80a5370 2023-12-19T18:59:52.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.646+0000 7f2cfdbaa640 1 -- 172.21.15.133:0/2885662287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f2cf80c1820 con 0x7f2cf80a5370 2023-12-19T18:59:52.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.646+0000 7f2cdffff640 1 -- 172.21.15.133:0/2885662287 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v35) v1 ==== 101+0+11 (secure 0 0 0) 0x7f2cf80c1820 con 0x7f2cf80a5370 2023-12-19T18:59:52.649 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T18:59:52.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.646+0000 7f2cfdbaa640 1 -- 172.21.15.133:0/2885662287 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2ce40664a0 msgr2=0x7f2ce4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:52.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.646+0000 7f2cfdbaa640 1 --2- 172.21.15.133:0/2885662287 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2ce40664a0 0x7f2ce4068960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80097c0 tx=0x7f2ce80a6000 comp rx=0 tx=0).stop 2023-12-19T18:59:52.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.646+0000 7f2cfdbaa640 1 -- 172.21.15.133:0/2885662287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cf80a5370 msgr2=0x7f2cf814cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:52.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.646+0000 7f2cfdbaa640 1 --2- 172.21.15.133:0/2885662287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cf80a5370 0x7f2cf814cef0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00c480 tx=0x7f2cec00c940 comp rx=0 tx=0).stop 2023-12-19T18:59:52.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.646+0000 7f2cfdbaa640 1 -- 172.21.15.133:0/2885662287 shutdown_connections 2023-12-19T18:59:52.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.646+0000 7f2cfdbaa640 1 --2- 172.21.15.133:0/2885662287 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2ce40664a0 0x7f2ce4068960 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.646+0000 7f2cfdbaa640 1 --2- 172.21.15.133:0/2885662287 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2cf80c4110 0x7f2cf8146f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.646+0000 7f2cfdbaa640 1 --2- 172.21.15.133:0/2885662287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2cf80a5370 0x7f2cf814cef0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.646+0000 7f2cfdbaa640 1 --2- 172.21.15.133:0/2885662287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2cf8072090 0x7f2cf81e94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.646+0000 7f2cfdbaa640 1 -- 172.21.15.133:0/2885662287 >> 172.21.15.133:0/2885662287 conn(0x7f2cf806a5b0 msgr2=0x7f2cf8150fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:52.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.646+0000 7f2cfdbaa640 1 -- 172.21.15.133:0/2885662287 shutdown_connections 2023-12-19T18:59:52.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.646+0000 7f2cfdbaa640 1 -- 172.21.15.133:0/2885662287 wait complete. 2023-12-19T18:59:52.672 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T18:59:52.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.806+0000 7f74844bb640 1 Processor -- start 2023-12-19T18:59:52.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.806+0000 7f74844bb640 1 -- start start 2023-12-19T18:59:52.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f74844bb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f747c14c600 0x7f747c0abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:52.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f74844bb640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747c0c0d10 con 0x7f747c0ac4a0 2023-12-19T18:59:52.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f74844bb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747c0c2cb0 con 0x7f747c0a9670 2023-12-19T18:59:52.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f74844bb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c073d10 con 0x7f747c14c600 2023-12-19T18:59:52.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7482a58640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f747c0ac4a0 0x7f747c0ab520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47230/0 (socket says 172.21.15.133:47230) 2023-12-19T18:59:52.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7482a58640 1 -- 172.21.15.133:0/1780984695 learned_addr learned my addr 172.21.15.133:0/1780984695 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:52.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7482257640 1 --2- 172.21.15.133:0/1780984695 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f747c14c600 0x7f747c0abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7481255640 1 -- 172.21.15.133:0/1780984695 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2470927585 0 0) 0x7f747c0c0d10 con 0x7f747c0ac4a0 2023-12-19T18:59:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7481255640 1 -- 172.21.15.133:0/1780984695 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7468003530 con 0x7f747c0ac4a0 2023-12-19T18:59:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7481255640 1 -- 172.21.15.133:0/1780984695 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3517738188 0 0) 0x7f7468003530 con 0x7f747c0ac4a0 2023-12-19T18:59:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7481255640 1 -- 172.21.15.133:0/1780984695 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f747c14c600 msgr2=0x7f747c0abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7481255640 1 --2- 172.21.15.133:0/1780984695 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f747c14c600 0x7f747c0abf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7481255640 1 -- 172.21.15.133:0/1780984695 >> v1:172.21.15.138:6789/0 conn(0x7f747c0a9670 legacy=0x7f747c0aae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7481255640 1 -- 172.21.15.133:0/1780984695 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c152fd0 con 0x7f747c0ac4a0 2023-12-19T18:59:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7481255640 1 -- 172.21.15.133:0/1780984695 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f7474001a00 con 0x7f747c0ac4a0 2023-12-19T18:59:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7481255640 1 -- 172.21.15.133:0/1780984695 >> v1:172.21.15.133:6789/0 conn(0x7f747c0ac4a0 legacy=0x7f747c0ab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7481255640 1 --2- 172.21.15.133:0/1780984695 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f747c14c600 0x7f74680039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7481255640 1 --2- 172.21.15.133:0/1780984695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7468003ef0 0x7f74680047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7481255640 1 --2- 172.21.15.133:0/1780984695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7468004d10 0x7f7468005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7481255640 1 -- 172.21.15.133:0/1780984695 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c073d10 con 0x7f7468004d10 2023-12-19T18:59:52.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7481255640 1 -- 172.21.15.133:0/1780984695 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746800baa0 con 0x7f7468003ef0 2023-12-19T18:59:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7481255640 1 -- 172.21.15.133:0/1780984695 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746800bc60 con 0x7f747c14c600 2023-12-19T18:59:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7482a58640 1 --2- 172.21.15.133:0/1780984695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7468004d10 0x7f7468005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7482257640 1 --2- 172.21.15.133:0/1780984695 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f747c14c600 0x7f74680039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7481a56640 1 --2- 172.21.15.133:0/1780984695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7468003ef0 0x7f74680047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7482a58640 1 -- 172.21.15.133:0/1780984695 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f747c14c600 msgr2=0x7f74680039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7482a58640 1 --2- 172.21.15.133:0/1780984695 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f747c14c600 0x7f74680039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7482a58640 1 -- 172.21.15.133:0/1780984695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7468003ef0 msgr2=0x7f74680047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7482a58640 1 --2- 172.21.15.133:0/1780984695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7468003ef0 0x7f74680047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7482a58640 1 -- 172.21.15.133:0/1780984695 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7468003530 con 0x7f7468004d10 2023-12-19T18:59:52.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.810+0000 7f7481a56640 1 --2- 172.21.15.133:0/1780984695 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7468003ef0 0x7f74680047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:52.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.814+0000 7f7482a58640 1 --2- 172.21.15.133:0/1780984695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7468004d10 0x7f7468005190 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f747c0ac930 tx=0x7f747401d2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bf74a5bc08a07f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:52.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.814+0000 7f7481255640 1 -- 172.21.15.133:0/1780984695 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74740ad630 con 0x7f7468004d10 2023-12-19T18:59:52.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.814+0000 7f7481255640 1 -- 172.21.15.133:0/1780984695 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74740a8070 con 0x7f7468004d10 2023-12-19T18:59:52.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.814+0000 7f7481255640 1 -- 172.21.15.133:0/1780984695 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74740ada30 con 0x7f7468004d10 2023-12-19T18:59:52.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.814+0000 7f74844bb640 1 -- 172.21.15.133:0/1780984695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7468004d10 msgr2=0x7f7468005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:52.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.814+0000 7f74844bb640 1 --2- 172.21.15.133:0/1780984695 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7468004d10 0x7f7468005190 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f747c0ac930 tx=0x7f747401d2d0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.814+0000 7f7482a58640 1 -- 172.21.15.133:0/1780984695 reap_dead start 2023-12-19T18:59:52.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.814+0000 7f74844bb640 1 -- 172.21.15.133:0/1780984695 shutdown_connections 2023-12-19T18:59:52.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.814+0000 7f74844bb640 1 -- 172.21.15.133:0/1780984695 >> 172.21.15.133:0/1780984695 conn(0x7f747c0c30c0 msgr2=0x7f747c0c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:52.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.814+0000 7f74844bb640 1 -- 172.21.15.133:0/1780984695 shutdown_connections 2023-12-19T18:59:52.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.814+0000 7f74844bb640 1 -- 172.21.15.133:0/1780984695 wait complete. 2023-12-19T18:59:52.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f74844bb640 1 Processor -- start 2023-12-19T18:59:52.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f74844bb640 1 -- start start 2023-12-19T18:59:52.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f74844bb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7468004d10 0x7f747c0c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:52.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f74844bb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f747c153810 0x7f747c153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:52.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f74844bb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f747c154530 0x7f747c14ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:52.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f74844bb640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c1549e0 con 0x7f747c153810 2023-12-19T18:59:52.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f74844bb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c1ebbe0 con 0x7f7468004d10 2023-12-19T18:59:52.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f74844bb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c0c2460 con 0x7f747c154530 2023-12-19T18:59:52.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f7481a56640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f747c153810 0x7f747c153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:52.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f7481a56640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f747c153810 0x7f747c153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60038/0 (socket says 172.21.15.133:60038) 2023-12-19T18:59:52.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f7481a56640 1 -- 172.21.15.133:0/4239280617 learned_addr learned my addr 172.21.15.133:0/4239280617 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:52.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f7482a58640 1 --2- 172.21.15.133:0/4239280617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f747c154530 0x7f747c14ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:52.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f7482257640 1 --2- 172.21.15.133:0/4239280617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7468004d10 0x7f747c0c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:52.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f7481a56640 1 -- 172.21.15.133:0/4239280617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f747c154530 msgr2=0x7f747c14ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:52.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f7481a56640 1 --2- 172.21.15.133:0/4239280617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f747c154530 0x7f747c14ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f7481a56640 1 -- 172.21.15.133:0/4239280617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7468004d10 msgr2=0x7f747c0c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:52.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f7481a56640 1 --2- 172.21.15.133:0/4239280617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7468004d10 0x7f747c0c5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f7481a56640 1 -- 172.21.15.133:0/4239280617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c1ebe50 con 0x7f747c153810 2023-12-19T18:59:52.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f7482a58640 1 --2- 172.21.15.133:0/4239280617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f747c154530 0x7f747c14ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:52.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f7482257640 1 --2- 172.21.15.133:0/4239280617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7468004d10 0x7f747c0c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:52.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f7481a56640 1 --2- 172.21.15.133:0/4239280617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f747c153810 0x7f747c153ff0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f746c00e590 tx=0x7f746c00ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:52.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f7472ffd640 1 -- 172.21.15.133:0/4239280617 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c0052e0 con 0x7f747c153810 2023-12-19T18:59:52.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f7472ffd640 1 -- 172.21.15.133:0/4239280617 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746c005440 con 0x7f747c153810 2023-12-19T18:59:52.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f74844bb640 1 -- 172.21.15.133:0/4239280617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747c1ec130 con 0x7f747c153810 2023-12-19T18:59:52.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f7472ffd640 1 -- 172.21.15.133:0/4239280617 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c003820 con 0x7f747c153810 2023-12-19T18:59:52.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f74844bb640 1 -- 172.21.15.133:0/4239280617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747c0c59a0 con 0x7f747c153810 2023-12-19T18:59:52.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.818+0000 7f74844bb640 1 -- 172.21.15.133:0/4239280617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747c0c28e0 con 0x7f747c153810 2023-12-19T18:59:52.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.822+0000 7f7472ffd640 1 -- 172.21.15.133:0/4239280617 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f746c003980 con 0x7f747c153810 2023-12-19T18:59:52.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.822+0000 7f7472ffd640 1 --2- 172.21.15.133:0/4239280617 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7460066470 0x7f7460068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:52.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.822+0000 7f7472ffd640 1 -- 172.21.15.133:0/4239280617 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f746c084070 con 0x7f747c153810 2023-12-19T18:59:52.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.822+0000 7f7482257640 1 --2- 172.21.15.133:0/4239280617 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7460066470 0x7f7460068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:52.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.822+0000 7f7482257640 1 --2- 172.21.15.133:0/4239280617 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7460066470 0x7f7460068930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7478009be0 tx=0x7f7478008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:52.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.826+0000 7f7472ffd640 1 -- 172.21.15.133:0/4239280617 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f746c051190 con 0x7f747c153810 2023-12-19T18:59:52.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.986+0000 7f74844bb640 1 -- 172.21.15.133:0/4239280617 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f747c068400 con 0x7f747c153810 2023-12-19T18:59:52.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.986+0000 7f7472ffd640 1 -- 172.21.15.133:0/4239280617 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) v1 ==== 80+0+0 (secure 0 0 0) 0x7f746c0547b0 con 0x7f747c153810 2023-12-19T18:59:52.990 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-19T18:59:52.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.990+0000 7f74844bb640 1 -- 172.21.15.133:0/4239280617 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7460066470 msgr2=0x7f7460068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:52.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.990+0000 7f74844bb640 1 --2- 172.21.15.133:0/4239280617 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7460066470 0x7f7460068930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7478009be0 tx=0x7f7478008040 comp rx=0 tx=0).stop 2023-12-19T18:59:52.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.990+0000 7f74844bb640 1 -- 172.21.15.133:0/4239280617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f747c153810 msgr2=0x7f747c153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:52.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.990+0000 7f74844bb640 1 --2- 172.21.15.133:0/4239280617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f747c153810 0x7f747c153ff0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f746c00e590 tx=0x7f746c00ea50 comp rx=0 tx=0).stop 2023-12-19T18:59:52.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.990+0000 7f74844bb640 1 -- 172.21.15.133:0/4239280617 shutdown_connections 2023-12-19T18:59:52.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.990+0000 7f74844bb640 1 --2- 172.21.15.133:0/4239280617 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7460066470 0x7f7460068930 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.990+0000 7f74844bb640 1 --2- 172.21.15.133:0/4239280617 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f747c154530 0x7f747c14ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.990+0000 7f74844bb640 1 --2- 172.21.15.133:0/4239280617 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f747c153810 0x7f747c153ff0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.990+0000 7f74844bb640 1 --2- 172.21.15.133:0/4239280617 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7468004d10 0x7f747c0c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:52.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.990+0000 7f74844bb640 1 -- 172.21.15.133:0/4239280617 >> 172.21.15.133:0/4239280617 conn(0x7f747c0c30c0 msgr2=0x7f747c1493c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:52.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.990+0000 7f74844bb640 1 -- 172.21.15.133:0/4239280617 shutdown_connections 2023-12-19T18:59:52.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:52.990+0000 7f74844bb640 1 -- 172.21.15.133:0/4239280617 wait complete. 2023-12-19T18:59:53.011 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T18:59:53.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:53.011 DEBUG:teuthology.orchestra.run.smithi138:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T18:59:53.043 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi138.front.sepia.ceph.com 2023-12-19T18:59:53.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:53.043 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T18:59:53.094 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:59:53.094 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:59:53.145 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3612 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-19T18:59:53.146 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T18:59:53.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.282+0000 7fe1821df640 1 Processor -- start 2023-12-19T18:59:53.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.282+0000 7fe1821df640 1 -- start start 2023-12-19T18:59:53.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.282+0000 7fe1821df640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe17c072090 0x7fe17c150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:53.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.282+0000 7fe1821df640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17c0c2760 con 0x7fe17c0a5370 2023-12-19T18:59:53.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.282+0000 7fe1821df640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17c0a5750 con 0x7fe17c0725c0 2023-12-19T18:59:53.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.282+0000 7fe1821df640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17c0c3070 con 0x7fe17c072090 2023-12-19T18:59:53.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.282+0000 7fe17b7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe17c0a5370 0x7fe17c0c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47232/0 (socket says 172.21.15.133:47232) 2023-12-19T18:59:53.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.282+0000 7fe17b7fe640 1 -- 172.21.15.133:0/9337159 learned_addr learned my addr 172.21.15.133:0/9337159 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:53.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.282+0000 7fe173fff640 1 --2- 172.21.15.133:0/9337159 >> v2:172.21.15.133:3300/0 conn(0x7fe17c072090 0x7fe17c150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:53.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.282+0000 7fe17affd640 1 -- 172.21.15.133:0/9337159 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818770746 0 0) 0x7fe17c0c2760 con 0x7fe17c0a5370 2023-12-19T18:59:53.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.282+0000 7fe17affd640 1 -- 172.21.15.133:0/9337159 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe168003530 con 0x7fe17c0a5370 2023-12-19T18:59:53.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.282+0000 7fe173fff640 1 -- 172.21.15.133:0/9337159 >> v1:172.21.15.138:6789/0 conn(0x7fe17c0725c0 legacy=0x7fe17c1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:53.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.282+0000 7fe173fff640 1 -- 172.21.15.133:0/9337159 >> v1:172.21.15.133:6789/0 conn(0x7fe17c0a5370 legacy=0x7fe17c0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:53.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.282+0000 7fe173fff640 1 -- 172.21.15.133:0/9337159 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c0aad20 con 0x7fe17c072090 2023-12-19T18:59:53.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.286+0000 7fe173fff640 1 --2- 172.21.15.133:0/9337159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe17c072090 0x7fe17c150fa0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe1640097c0 tx=0x7fe16401c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=565fd2d28096078b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:53.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.286+0000 7fe17affd640 1 -- 172.21.15.133:0/9337159 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1640ab600 con 0x7fe17c072090 2023-12-19T18:59:53.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.286+0000 7fe17affd640 1 -- 172.21.15.133:0/9337159 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1640a7050 con 0x7fe17c072090 2023-12-19T18:59:53.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.286+0000 7fe17affd640 1 -- 172.21.15.133:0/9337159 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1640ab980 con 0x7fe17c072090 2023-12-19T18:59:53.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.286+0000 7fe1821df640 1 -- 172.21.15.133:0/9337159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe17c072090 msgr2=0x7fe17c150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:53.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.286+0000 7fe1821df640 1 --2- 172.21.15.133:0/9337159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe17c072090 0x7fe17c150fa0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe1640097c0 tx=0x7fe16401c320 comp rx=0 tx=0).stop 2023-12-19T18:59:53.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.286+0000 7fe1821df640 1 -- 172.21.15.133:0/9337159 shutdown_connections 2023-12-19T18:59:53.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.286+0000 7fe1821df640 1 --2- 172.21.15.133:0/9337159 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe17c072090 0x7fe17c150fa0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:53.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.286+0000 7fe1821df640 1 -- 172.21.15.133:0/9337159 >> 172.21.15.133:0/9337159 conn(0x7fe17c06a5b0 msgr2=0x7fe17c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:53.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.286+0000 7fe1821df640 1 -- 172.21.15.133:0/9337159 shutdown_connections 2023-12-19T18:59:53.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.286+0000 7fe1821df640 1 -- 172.21.15.133:0/9337159 wait complete. 2023-12-19T18:59:53.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe1821df640 1 Processor -- start 2023-12-19T18:59:53.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe1821df640 1 -- start start 2023-12-19T18:59:53.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe1821df640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe17c072090 0x7fe17c144040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:53.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe1821df640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe17c0725c0 0x7fe17c141d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:53.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe1821df640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe17c0a5370 0x7fe17c1422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:53.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe1821df640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c1427f0 con 0x7fe17c072090 2023-12-19T18:59:53.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe1821df640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c0a5d60 con 0x7fe17c0725c0 2023-12-19T18:59:53.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe1821df640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c1418e0 con 0x7fe17c0a5370 2023-12-19T18:59:53.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe17b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe17c072090 0x7fe17c144040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:53.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe17b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe17c072090 0x7fe17c144040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60058/0 (socket says 172.21.15.133:60058) 2023-12-19T18:59:53.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe17b7fe640 1 -- 172.21.15.133:0/2596532689 learned_addr learned my addr 172.21.15.133:0/2596532689 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:53.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe173fff640 1 --2- 172.21.15.133:0/2596532689 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe17c0725c0 0x7fe17c141d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:53.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe17bfff640 1 --2- 172.21.15.133:0/2596532689 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe17c0a5370 0x7fe17c1422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:53.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe17b7fe640 1 -- 172.21.15.133:0/2596532689 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe17c0a5370 msgr2=0x7fe17c1422b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:53.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe17b7fe640 1 --2- 172.21.15.133:0/2596532689 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe17c0a5370 0x7fe17c1422b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:53.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe17b7fe640 1 -- 172.21.15.133:0/2596532689 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe17c0725c0 msgr2=0x7fe17c141d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:53.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe17b7fe640 1 --2- 172.21.15.133:0/2596532689 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe17c0725c0 0x7fe17c141d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:53.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe17b7fe640 1 -- 172.21.15.133:0/2596532689 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe164009420 con 0x7fe17c072090 2023-12-19T18:59:53.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe173fff640 1 --2- 172.21.15.133:0/2596532689 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe17c0725c0 0x7fe17c141d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:53.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe17b7fe640 1 --2- 172.21.15.133:0/2596532689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe17c072090 0x7fe17c144040 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe16c00c450 tx=0x7fe16c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:53.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe178ff9640 1 -- 172.21.15.133:0/2596532689 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c005cf0 con 0x7fe17c072090 2023-12-19T18:59:53.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe178ff9640 1 -- 172.21.15.133:0/2596532689 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c005e50 con 0x7fe17c072090 2023-12-19T18:59:53.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe178ff9640 1 -- 172.21.15.133:0/2596532689 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c007270 con 0x7fe17c072090 2023-12-19T18:59:53.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe1821df640 1 -- 172.21.15.133:0/2596532689 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c1436c0 con 0x7fe17c072090 2023-12-19T18:59:53.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe1821df640 1 -- 172.21.15.133:0/2596532689 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c0a71d0 con 0x7fe17c072090 2023-12-19T18:59:53.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.290+0000 7fe1821df640 1 -- 172.21.15.133:0/2596532689 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17c068400 con 0x7fe17c072090 2023-12-19T18:59:53.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.294+0000 7fe178ff9640 1 -- 172.21.15.133:0/2596532689 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe16c0073d0 con 0x7fe17c072090 2023-12-19T18:59:53.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.294+0000 7fe178ff9640 1 --2- 172.21.15.133:0/2596532689 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe15c066470 0x7fe15c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:53.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.294+0000 7fe178ff9640 1 -- 172.21.15.133:0/2596532689 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe16c083700 con 0x7fe17c072090 2023-12-19T18:59:53.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.294+0000 7fe173fff640 1 --2- 172.21.15.133:0/2596532689 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe15c066470 0x7fe15c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:53.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.294+0000 7fe173fff640 1 --2- 172.21.15.133:0/2596532689 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe15c066470 0x7fe15c068930 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe1640ad000 tx=0x7fe164008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:53.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.298+0000 7fe178ff9640 1 -- 172.21.15.133:0/2596532689 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fe16c050830 con 0x7fe17c072090 2023-12-19T18:59:53.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.478+0000 7fe1821df640 1 -- 172.21.15.133:0/2596532689 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe17c151850 con 0x7fe17c072090 2023-12-19T18:59:53.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.478+0000 7fe178ff9640 1 -- 172.21.15.133:0/2596532689 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+149 (secure 0 0 0) 0x7fe16c0170b0 con 0x7fe17c072090 2023-12-19T18:59:53.482 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T18:59:53.482 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-19T18:59:53.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.482+0000 7fe1821df640 1 -- 172.21.15.133:0/2596532689 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe15c066470 msgr2=0x7fe15c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:53.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.482+0000 7fe1821df640 1 --2- 172.21.15.133:0/2596532689 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe15c066470 0x7fe15c068930 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe1640ad000 tx=0x7fe164008040 comp rx=0 tx=0).stop 2023-12-19T18:59:53.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.482+0000 7fe1821df640 1 -- 172.21.15.133:0/2596532689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe17c072090 msgr2=0x7fe17c144040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:53.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.482+0000 7fe1821df640 1 --2- 172.21.15.133:0/2596532689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe17c072090 0x7fe17c144040 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe16c00c450 tx=0x7fe16c00c910 comp rx=0 tx=0).stop 2023-12-19T18:59:53.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.482+0000 7fe1821df640 1 -- 172.21.15.133:0/2596532689 shutdown_connections 2023-12-19T18:59:53.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.482+0000 7fe1821df640 1 --2- 172.21.15.133:0/2596532689 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe15c066470 0x7fe15c068930 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:53.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.482+0000 7fe1821df640 1 --2- 172.21.15.133:0/2596532689 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe17c0a5370 0x7fe17c1422b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:53.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.482+0000 7fe1821df640 1 --2- 172.21.15.133:0/2596532689 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe17c0725c0 0x7fe17c141d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:53.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.482+0000 7fe1821df640 1 --2- 172.21.15.133:0/2596532689 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe17c072090 0x7fe17c144040 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:53.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.482+0000 7fe1821df640 1 -- 172.21.15.133:0/2596532689 >> 172.21.15.133:0/2596532689 conn(0x7fe17c06a5b0 msgr2=0x7fe17c06d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:53.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.482+0000 7fe1821df640 1 -- 172.21.15.133:0/2596532689 shutdown_connections 2023-12-19T18:59:53.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:53.482+0000 7fe1821df640 1 -- 172.21.15.133:0/2596532689 wait complete. 2023-12-19T18:59:53.503 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-19T18:59:53.503 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T18:59:53.504 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi138.front.sepia.ceph.com 2023-12-19T18:59:53.504 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T18:59:53.504 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T18:59:53.504 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-19T18:59:53.504 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T18:59:53.504 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T18:59:53.504 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T18:59:53.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:53.504 DEBUG:teuthology.orchestra.run.smithi138:> ip addr 2023-12-19T18:59:53.514 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T18:59:53.515 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T18:59:53.515 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T18:59:53.515 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:53.515 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2023-12-19T18:59:53.515 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:53.515 INFO:teuthology.orchestra.run.smithi138.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:59:53.515 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7a brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:53.515 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f0 2023-12-19T18:59:53.515 INFO:teuthology.orchestra.run.smithi138.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:59:53.515 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7b brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:53.515 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f1 2023-12-19T18:59:53.515 INFO:teuthology.orchestra.run.smithi138.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:59:53.515 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:70 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:53.515 INFO:teuthology.orchestra.run.smithi138.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T18:59:53.515 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:71 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:53.516 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.21.15.138/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T18:59:53.516 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft 42360sec preferred_lft 42360sec 2023-12-19T18:59:53.516 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::ec4:7aff:fe88:6f71/64 scope link 2023-12-19T18:59:53.516 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:53.516 INFO:teuthology.orchestra.run.smithi138.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T18:59:53.516 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 02:42:5b:f5:51:87 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:53.516 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T18:59:53.516 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:53.516 INFO:teuthology.orchestra.run.smithi138.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T18:59:53.516 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:53.516 INFO:teuthology.orchestra.run.smithi138.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T18:59:53.516 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:53.516 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-19T18:59:53.516 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:53.516 INFO:teuthology.orchestra.run.smithi138.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T18:59:53.517 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T18:59:53.517 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-19T18:59:53.517 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:53.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:53.518 DEBUG:teuthology.orchestra.run.smithi138:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T18:59:53.579 INFO:teuthology.orchestra.run.smithi138.stdout:1 2023-12-19T18:59:53.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:53.582 DEBUG:teuthology.orchestra.run.smithi138:> route 2023-12-19T18:59:53.639 INFO:teuthology.orchestra.run.smithi138.stdout:Kernel IP routing table 2023-12-19T18:59:53.639 INFO:teuthology.orchestra.run.smithi138.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T18:59:53.640 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T18:59:53.640 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T18:59:53.640 INFO:teuthology.orchestra.run.smithi138.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T18:59:53.640 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T18:59:53.640 INFO:teuthology.orchestra.run.smithi138.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T18:59:53.640 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T18:59:53.640 INFO:teuthology.orchestra.run.smithi138.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T18:59:53.640 INFO:teuthology.orchestra.run.smithi138.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T18:59:53.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:53.640 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-12-19T18:59:53.640 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-12-19T18:59:53.641 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T18:59:53.641 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T18:59:53.641 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T18:59:53.641 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-12-19T18:59:53.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:53.740 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2023-12-19T18:59:53.750 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T18:59:53.750 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T18:59:53.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:53.751 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set brx.0 up 2023-12-19T18:59:53.812 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:59:53.812 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T18:59:53.864 INFO:teuthology.orchestra.run.smithi138.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T18:59:53.864 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:59:53.864 DEBUG:teuthology.orchestra.run.smithi138:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T18:59:53.919 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-12-19T18:59:53.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:53.919 DEBUG:teuthology.orchestra.run.smithi138:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T18:59:54.015 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T18:59:54.015 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T18:59:54.029 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T18:59:54.029 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T18:59:54.029 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-12-19T18:59:54.029 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: trying mount with new device syntax: 1@03e63958-005e-4bf2-ae5b-291aceb6fbbf.cephfs2=/ 2023-12-19T18:59:54.029 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.133:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-12-19T18:59:54.033 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T18:59:54.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:54.033 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T18:59:54.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:54.055 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T18:59:54.114 INFO:teuthology.orchestra.run.smithi138.stdout:client5385 2023-12-19T18:59:54.115 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:59:54.115 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:59:54.163 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs authorize cephfs client.testuser / rw 2023-12-19T18:59:54.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.302+0000 7f20054fe640 1 Processor -- start 2023-12-19T18:59:54.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.302+0000 7f20054fe640 1 -- start start 2023-12-19T18:59:54.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.306+0000 7f20054fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f20000c7f70 0x7f20000c9850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:54.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.306+0000 7f20054fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f20000c4d20 0x7f2000155210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:54.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.306+0000 7f20054fe640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2000155750 con 0x7f20000c4940 2023-12-19T18:59:54.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.306+0000 7f20054fe640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20000c5650 con 0x7f20000c7f70 2023-12-19T18:59:54.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.306+0000 7f20054fe640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20000a9ff0 con 0x7f20000c4d20 2023-12-19T18:59:54.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.306+0000 7f1ff67fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f20000c7f70 0x7f20000c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:54.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.306+0000 7f1ff67fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f20000c7f70 0x7f20000c9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60062/0 (socket says 172.21.15.133:60062) 2023-12-19T18:59:54.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.306+0000 7f1ff67fc640 1 -- 172.21.15.133:0/2318171609 learned_addr learned my addr 172.21.15.133:0/2318171609 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:54.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.306+0000 7f1fff7fe640 1 --2- 172.21.15.133:0/2318171609 >> v2:172.21.15.138:3300/0 conn(0x7f20000c4d20 0x7f2000155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:54.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.306+0000 7f1ff67fc640 1 -- 172.21.15.133:0/2318171609 >> v2:172.21.15.138:3300/0 conn(0x7f20000c4d20 msgr2=0x7f2000155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:54.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.306+0000 7f1ff67fc640 1 --2- 172.21.15.133:0/2318171609 >> v2:172.21.15.138:3300/0 conn(0x7f20000c4d20 0x7f2000155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:54.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.306+0000 7f1ff67fc640 1 -- 172.21.15.133:0/2318171609 >> v1:172.21.15.138:6789/0 conn(0x7f20000c4940 legacy=0x7f20000a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:54.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.306+0000 7f1ff67fc640 1 -- 172.21.15.133:0/2318171609 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20000c8b20 con 0x7f20000c7f70 2023-12-19T18:59:54.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.306+0000 7f1fff7fe640 1 --2- 172.21.15.133:0/2318171609 >> v2:172.21.15.138:3300/0 conn(0x7f20000c4d20 0x7f2000155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:54.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.310+0000 7f1ff67fc640 1 --2- 172.21.15.133:0/2318171609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20000c7f70 0x7f20000c9850 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f200008bc40 tx=0x7f1fe801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac91a2d668aad08 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:54.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.310+0000 7f1ffe7fc640 1 -- 172.21.15.133:0/2318171609 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80ab610 con 0x7f20000c7f70 2023-12-19T18:59:54.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.310+0000 7f1ffe7fc640 1 -- 172.21.15.133:0/2318171609 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe80ab770 con 0x7f20000c7f70 2023-12-19T18:59:54.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.310+0000 7f1ffe7fc640 1 -- 172.21.15.133:0/2318171609 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe80abb00 con 0x7f20000c7f70 2023-12-19T18:59:54.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.310+0000 7f20054fe640 1 -- 172.21.15.133:0/2318171609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20000c7f70 msgr2=0x7f20000c9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:54.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.310+0000 7f20054fe640 1 --2- 172.21.15.133:0/2318171609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20000c7f70 0x7f20000c9850 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f200008bc40 tx=0x7f1fe801c500 comp rx=0 tx=0).stop 2023-12-19T18:59:54.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.310+0000 7f20054fe640 1 -- 172.21.15.133:0/2318171609 shutdown_connections 2023-12-19T18:59:54.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.310+0000 7f20054fe640 1 --2- 172.21.15.133:0/2318171609 >> v2:172.21.15.138:3300/0 conn(0x7f20000c4d20 0x7f2000155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:54.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.310+0000 7f20054fe640 1 --2- 172.21.15.133:0/2318171609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20000c7f70 0x7f20000c9850 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:54.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.310+0000 7f20054fe640 1 -- 172.21.15.133:0/2318171609 >> 172.21.15.133:0/2318171609 conn(0x7f20000abb70 msgr2=0x7f20000abf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:54.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.310+0000 7f20054fe640 1 -- 172.21.15.133:0/2318171609 shutdown_connections 2023-12-19T18:59:54.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.310+0000 7f20054fe640 1 -- 172.21.15.133:0/2318171609 wait complete. 2023-12-19T18:59:54.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.310+0000 7f20054fe640 1 Processor -- start 2023-12-19T18:59:54.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.310+0000 7f20054fe640 1 -- start start 2023-12-19T18:59:54.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.310+0000 7f20054fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20000c4940 0x7f20000c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:54.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.310+0000 7f20054fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20000c4d20 0x7f20000bddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:54.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.310+0000 7f20054fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20000c7f70 0x7f20001f1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:54.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.310+0000 7f20054fe640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20000c0710 con 0x7f20000c7f70 2023-12-19T18:59:54.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.310+0000 7f20054fe640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20001f1320 con 0x7f20000c4940 2023-12-19T18:59:54.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.310+0000 7f20054fe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20000bf8d0 con 0x7f20000c4d20 2023-12-19T18:59:54.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.314+0000 7f1fff7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20000c7f70 0x7f20001f1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:54.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.314+0000 7f1ffeffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20000c4940 0x7f20000c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:54.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.314+0000 7f1fff7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20000c7f70 0x7f20001f1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60074/0 (socket says 172.21.15.133:60074) 2023-12-19T18:59:54.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.314+0000 7f1fff7fe640 1 -- 172.21.15.133:0/2646958996 learned_addr learned my addr 172.21.15.133:0/2646958996 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:54.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.314+0000 7f1ff67fc640 1 --2- 172.21.15.133:0/2646958996 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20000c4d20 0x7f20000bddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:54.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.314+0000 7f1fff7fe640 1 -- 172.21.15.133:0/2646958996 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20000c4d20 msgr2=0x7f20000bddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:54.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.314+0000 7f1fff7fe640 1 --2- 172.21.15.133:0/2646958996 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20000c4d20 0x7f20000bddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:54.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.314+0000 7f1fff7fe640 1 -- 172.21.15.133:0/2646958996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20000c4940 msgr2=0x7f20000c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:54.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.314+0000 7f1fff7fe640 1 --2- 172.21.15.133:0/2646958996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20000c4940 0x7f20000c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:54.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.314+0000 7f1fff7fe640 1 -- 172.21.15.133:0/2646958996 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe80094d0 con 0x7f20000c7f70 2023-12-19T18:59:54.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.314+0000 7f1fff7fe640 1 --2- 172.21.15.133:0/2646958996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20000c7f70 0x7f20001f1900 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8007ef0 tx=0x7f1ff800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:54.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.314+0000 7f1ff7fff640 1 -- 172.21.15.133:0/2646958996 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8003ba0 con 0x7f20000c7f70 2023-12-19T18:59:54.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.314+0000 7f1ff7fff640 1 -- 172.21.15.133:0/2646958996 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff800f040 con 0x7f20000c7f70 2023-12-19T18:59:54.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.314+0000 7f1ff7fff640 1 -- 172.21.15.133:0/2646958996 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff800de80 con 0x7f20000c7f70 2023-12-19T18:59:54.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.314+0000 7f20054fe640 1 -- 172.21.15.133:0/2646958996 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20000bfb90 con 0x7f20000c7f70 2023-12-19T18:59:54.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.314+0000 7f20054fe640 1 -- 172.21.15.133:0/2646958996 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20000c0150 con 0x7f20000c7f70 2023-12-19T18:59:54.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.314+0000 7f20054fe640 1 -- 172.21.15.133:0/2646958996 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2000155b90 con 0x7f20000c7f70 2023-12-19T18:59:54.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.314+0000 7f1ff7fff640 1 -- 172.21.15.133:0/2646958996 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1ff8004030 con 0x7f20000c7f70 2023-12-19T18:59:54.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.318+0000 7f1ff7fff640 1 --2- 172.21.15.133:0/2646958996 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fe00664a0 0x7f1fe0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:54.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.318+0000 7f1ff7fff640 1 -- 172.21.15.133:0/2646958996 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1ff80843f0 con 0x7f20000c7f70 2023-12-19T18:59:54.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.318+0000 7f1ffeffd640 1 --2- 172.21.15.133:0/2646958996 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fe00664a0 0x7f1fe0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:54.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.318+0000 7f1ffeffd640 1 --2- 172.21.15.133:0/2646958996 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fe00664a0 0x7f1fe0068960 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f20000bcd80 tx=0x7f1ff0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:54.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.322+0000 7f1ff7fff640 1 -- 172.21.15.133:0/2646958996 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2000155b90 con 0x7f20000c7f70 2023-12-19T18:59:54.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.498+0000 7f20054fe640 1 -- 172.21.15.133:0/2646958996 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]} v 0) v1 -- 0x7f2000155b90 con 0x7f20000c7f70 2023-12-19T18:59:54.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.502+0000 7f1ff7fff640 1 -- 172.21.15.133:0/2646958996 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]}]=0 v13) v1 ==== 134+0+185 (secure 0 0 0) 0x7f2000155b90 con 0x7f20000c7f70 2023-12-19T18:59:54.505 INFO:teuthology.orchestra.run.smithi133.stdout:[client.testuser] 2023-12-19T18:59:54.505 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAq6IFlcD31HRAAMhO9tRfILfGlrbvh1g8Kbg== 2023-12-19T18:59:54.505 INFO:teuthology.orchestra.run.smithi133.stdout: caps mds = "allow rw fsname=cephfs" 2023-12-19T18:59:54.506 INFO:teuthology.orchestra.run.smithi133.stdout: caps mon = "allow r fsname=cephfs" 2023-12-19T18:59:54.506 INFO:teuthology.orchestra.run.smithi133.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-19T18:59:54.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.506+0000 7f20054fe640 1 -- 172.21.15.133:0/2646958996 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fe00664a0 msgr2=0x7f1fe0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:54.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.506+0000 7f20054fe640 1 --2- 172.21.15.133:0/2646958996 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fe00664a0 0x7f1fe0068960 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f20000bcd80 tx=0x7f1ff0009040 comp rx=0 tx=0).stop 2023-12-19T18:59:54.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.506+0000 7f20054fe640 1 -- 172.21.15.133:0/2646958996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20000c7f70 msgr2=0x7f20001f1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:54.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.506+0000 7f20054fe640 1 --2- 172.21.15.133:0/2646958996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20000c7f70 0x7f20001f1900 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8007ef0 tx=0x7f1ff800d4a0 comp rx=0 tx=0).stop 2023-12-19T18:59:54.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.506+0000 7f20054fe640 1 -- 172.21.15.133:0/2646958996 shutdown_connections 2023-12-19T18:59:54.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.506+0000 7f20054fe640 1 --2- 172.21.15.133:0/2646958996 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fe00664a0 0x7f1fe0068960 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:54.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.506+0000 7f20054fe640 1 --2- 172.21.15.133:0/2646958996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20000c7f70 0x7f20001f1900 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:54.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.506+0000 7f20054fe640 1 --2- 172.21.15.133:0/2646958996 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20000c4d20 0x7f20000bddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:54.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.506+0000 7f20054fe640 1 --2- 172.21.15.133:0/2646958996 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20000c4940 0x7f20000c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:54.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.506+0000 7f20054fe640 1 -- 172.21.15.133:0/2646958996 >> 172.21.15.133:0/2646958996 conn(0x7f20000abb70 msgr2=0x7f200015e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:54.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.506+0000 7f20054fe640 1 -- 172.21.15.133:0/2646958996 shutdown_connections 2023-12-19T18:59:54.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.506+0000 7f20054fe640 1 -- 172.21.15.133:0/2646958996 wait complete. 2023-12-19T18:59:54.527 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2023-12-19T18:59:54.536 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.D4Kc22dlni 2023-12-19T18:59:54.536 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:59:54.536 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/tmp/tmp.D4Kc22dlni 2023-12-19T18:59:54.587 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:59:54.587 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:59:54.639 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:59:54.639 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:59:54.691 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:59:54.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.870+0000 7f1b9b78d640 1 Processor -- start 2023-12-19T18:59:54.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.870+0000 7f1b9b78d640 1 -- start start 2023-12-19T18:59:54.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.870+0000 7f1b9b78d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1b94151e90 0x7f1b940c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:54.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.870+0000 7f1b9b78d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1b940c4e60 0x7f1b9406bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:54.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.870+0000 7f1b9b78d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b9406c860 con 0x7f1b940c7ea0 2023-12-19T18:59:54.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.870+0000 7f1b9b78d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b940c8750 con 0x7f1b94151e90 2023-12-19T18:59:54.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.870+0000 7f1b9b78d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b941552d0 con 0x7f1b940c4e60 2023-12-19T18:59:54.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.870+0000 7f1b99529640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1b94151e90 0x7f1b940c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:54.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.870+0000 7f1b99529640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1b94151e90 0x7f1b940c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58570/0 (socket says 172.21.15.133:58570) 2023-12-19T18:59:54.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.870+0000 7f1b99529640 1 -- 172.21.15.133:0/322563032 learned_addr learned my addr 172.21.15.133:0/322563032 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:54.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.870+0000 7f1b99d2a640 1 --2- 172.21.15.133:0/322563032 >> v2:172.21.15.138:3300/0 conn(0x7f1b940c4e60 0x7f1b9406bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:54.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.870+0000 7f1b99529640 1 -- 172.21.15.133:0/322563032 >> v2:172.21.15.138:3300/0 conn(0x7f1b940c4e60 msgr2=0x7f1b9406bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:54.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.870+0000 7f1b99529640 1 --2- 172.21.15.133:0/322563032 >> v2:172.21.15.138:3300/0 conn(0x7f1b940c4e60 0x7f1b9406bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:54.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.870+0000 7f1b99529640 1 -- 172.21.15.133:0/322563032 >> v1:172.21.15.138:6789/0 conn(0x7f1b940c7ea0 legacy=0x7f1b9406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:54.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.870+0000 7f1b99529640 1 -- 172.21.15.133:0/322563032 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b94154930 con 0x7f1b94151e90 2023-12-19T18:59:54.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.874+0000 7f1b99529640 1 --2- 172.21.15.133:0/322563032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b94151e90 0x7f1b940c4920 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1b9408c190 tx=0x7f1b9001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a50039294f53374a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:54.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.874+0000 7f1b8bfff640 1 -- 172.21.15.133:0/322563032 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900ab600 con 0x7f1b94151e90 2023-12-19T18:59:54.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.874+0000 7f1b8bfff640 1 -- 172.21.15.133:0/322563032 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b900a7050 con 0x7f1b94151e90 2023-12-19T18:59:54.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.874+0000 7f1b8bfff640 1 -- 172.21.15.133:0/322563032 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900ab980 con 0x7f1b94151e90 2023-12-19T18:59:54.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.874+0000 7f1b9b78d640 1 -- 172.21.15.133:0/322563032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b94151e90 msgr2=0x7f1b940c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:54.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.874+0000 7f1b9b78d640 1 --2- 172.21.15.133:0/322563032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b94151e90 0x7f1b940c4920 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1b9408c190 tx=0x7f1b9001c3e0 comp rx=0 tx=0).stop 2023-12-19T18:59:54.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.874+0000 7f1b9b78d640 1 -- 172.21.15.133:0/322563032 shutdown_connections 2023-12-19T18:59:54.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.874+0000 7f1b9b78d640 1 --2- 172.21.15.133:0/322563032 >> v2:172.21.15.138:3300/0 conn(0x7f1b940c4e60 0x7f1b9406bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:54.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.874+0000 7f1b9b78d640 1 --2- 172.21.15.133:0/322563032 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b94151e90 0x7f1b940c4920 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:54.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.874+0000 7f1b9b78d640 1 -- 172.21.15.133:0/322563032 >> 172.21.15.133:0/322563032 conn(0x7f1b940ca170 msgr2=0x7f1b940ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:54.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.874+0000 7f1b9b78d640 1 -- 172.21.15.133:0/322563032 shutdown_connections 2023-12-19T18:59:54.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.874+0000 7f1b9b78d640 1 -- 172.21.15.133:0/322563032 wait complete. 2023-12-19T18:59:54.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b9b78d640 1 Processor -- start 2023-12-19T18:59:54.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b9b78d640 1 -- start start 2023-12-19T18:59:54.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b9b78d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b940c4e60 0x7f1b941ecc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:54.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b9b78d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b940c7ea0 0x7f1b9414be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:54.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b9b78d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b94151e90 0x7f1b940c34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:54.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b9b78d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9414e000 con 0x7f1b940c4e60 2023-12-19T18:59:54.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b9b78d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9414c6d0 con 0x7f1b94151e90 2023-12-19T18:59:54.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b9b78d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9414c9b0 con 0x7f1b940c7ea0 2023-12-19T18:59:54.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b99529640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b940c4e60 0x7f1b941ecc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:54.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b99529640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b940c4e60 0x7f1b941ecc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58580/0 (socket says 172.21.15.133:58580) 2023-12-19T18:59:54.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b99529640 1 -- 172.21.15.133:0/309435872 learned_addr learned my addr 172.21.15.133:0/309435872 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:54.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b99d2a640 1 --2- 172.21.15.133:0/309435872 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b94151e90 0x7f1b940c34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:54.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b98d28640 1 --2- 172.21.15.133:0/309435872 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b940c7ea0 0x7f1b9414be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:54.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b99529640 1 -- 172.21.15.133:0/309435872 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b940c7ea0 msgr2=0x7f1b9414be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:54.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b99529640 1 --2- 172.21.15.133:0/309435872 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b940c7ea0 0x7f1b9414be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:54.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b99529640 1 -- 172.21.15.133:0/309435872 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b94151e90 msgr2=0x7f1b940c34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:54.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b99529640 1 --2- 172.21.15.133:0/309435872 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b94151e90 0x7f1b940c34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:54.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b99529640 1 -- 172.21.15.133:0/309435872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b900094d0 con 0x7f1b940c4e60 2023-12-19T18:59:54.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b99529640 1 --2- 172.21.15.133:0/309435872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b940c4e60 0x7f1b941ecc70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1b900ae040 tx=0x7f1b9001ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:54.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b89ffb640 1 -- 172.21.15.133:0/309435872 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900b6620 con 0x7f1b940c4e60 2023-12-19T18:59:54.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b89ffb640 1 -- 172.21.15.133:0/309435872 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b900abe90 con 0x7f1b940c4e60 2023-12-19T18:59:54.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b9b78d640 1 -- 172.21.15.133:0/309435872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b9414cc90 con 0x7f1b940c4e60 2023-12-19T18:59:54.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b89ffb640 1 -- 172.21.15.133:0/309435872 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b900b69e0 con 0x7f1b940c4e60 2023-12-19T18:59:54.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.878+0000 7f1b9b78d640 1 -- 172.21.15.133:0/309435872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b9414c3c0 con 0x7f1b940c4e60 2023-12-19T18:59:54.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.882+0000 7f1b9b78d640 1 -- 172.21.15.133:0/309435872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b94068400 con 0x7f1b940c4e60 2023-12-19T18:59:54.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.882+0000 7f1b89ffb640 1 -- 172.21.15.133:0/309435872 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1b900b2040 con 0x7f1b940c4e60 2023-12-19T18:59:54.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.882+0000 7f1b89ffb640 1 --2- 172.21.15.133:0/309435872 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1b780664a0 0x7f1b78068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:54.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.882+0000 7f1b89ffb640 1 -- 172.21.15.133:0/309435872 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1b9011e660 con 0x7f1b940c4e60 2023-12-19T18:59:54.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.882+0000 7f1b98d28640 1 --2- 172.21.15.133:0/309435872 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1b780664a0 0x7f1b78068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:54.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.882+0000 7f1b98d28640 1 --2- 172.21.15.133:0/309435872 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1b780664a0 0x7f1b78068960 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1b94158c30 tx=0x7f1b84009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:54.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:54.886+0000 7f1b89ffb640 1 -- 172.21.15.133:0/309435872 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1b900eb790 con 0x7f1b940c4e60 2023-12-19T18:59:55.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.038+0000 7f1b9b78d640 1 -- 172.21.15.133:0/309435872 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b940c40a0 con 0x7f1b940c4e60 2023-12-19T18:59:55.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.042+0000 7f1b89ffb640 1 -- 172.21.15.133:0/309435872 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20265 (secure 0 0 0) 0x7f1b900eedb0 con 0x7f1b940c4e60 2023-12-19T18:59:55.043 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:55.043 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":35,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:59:46.667472+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:59:25.798150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T18:59:26.236078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T18:59:42.757628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-19T18:59:44.017454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:59:55.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.042+0000 7f1b9b78d640 1 -- 172.21.15.133:0/309435872 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1b780664a0 msgr2=0x7f1b78068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:55.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.042+0000 7f1b9b78d640 1 --2- 172.21.15.133:0/309435872 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1b780664a0 0x7f1b78068960 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1b94158c30 tx=0x7f1b84009040 comp rx=0 tx=0).stop 2023-12-19T18:59:55.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.042+0000 7f1b9b78d640 1 -- 172.21.15.133:0/309435872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b940c4e60 msgr2=0x7f1b941ecc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:55.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.042+0000 7f1b9b78d640 1 --2- 172.21.15.133:0/309435872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b940c4e60 0x7f1b941ecc70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f1b900ae040 tx=0x7f1b9001ac20 comp rx=0 tx=0).stop 2023-12-19T18:59:55.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.042+0000 7f1b9b78d640 1 -- 172.21.15.133:0/309435872 shutdown_connections 2023-12-19T18:59:55.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.042+0000 7f1b9b78d640 1 --2- 172.21.15.133:0/309435872 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1b780664a0 0x7f1b78068960 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.042+0000 7f1b9b78d640 1 --2- 172.21.15.133:0/309435872 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1b94151e90 0x7f1b940c34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.042+0000 7f1b9b78d640 1 --2- 172.21.15.133:0/309435872 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1b940c7ea0 0x7f1b9414be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.042+0000 7f1b9b78d640 1 --2- 172.21.15.133:0/309435872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b940c4e60 0x7f1b941ecc70 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.042+0000 7f1b9b78d640 1 -- 172.21.15.133:0/309435872 >> 172.21.15.133:0/309435872 conn(0x7f1b940ca170 msgr2=0x7f1b9415e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:55.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.042+0000 7f1b9b78d640 1 -- 172.21.15.133:0/309435872 shutdown_connections 2023-12-19T18:59:55.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.042+0000 7f1b9b78d640 1 -- 172.21.15.133:0/309435872 wait complete. 2023-12-19T18:59:55.065 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:59:25.798150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:59:26.236078+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-19T18:59:42.757628+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-19T18:59:44.017454+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:59:55.065 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:59:55.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.202+0000 7f5cb37aa640 1 Processor -- start 2023-12-19T18:59:55.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.202+0000 7f5cb37aa640 1 -- start start 2023-12-19T18:59:55.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.202+0000 7f5cb37aa640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5cac152030 0x7f5cac0c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:55.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.206+0000 7f5cb37aa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5cac157c90 0x7f5cac0c2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:55.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.206+0000 7f5cb37aa640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cac154b60 con 0x7f5cac06c470 2023-12-19T18:59:55.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.206+0000 7f5cb37aa640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cac152410 con 0x7f5cac152030 2023-12-19T18:59:55.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.206+0000 7f5cb37aa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cac155700 con 0x7f5cac157c90 2023-12-19T18:59:55.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.206+0000 7f5cb1546640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5cac152030 0x7f5cac0c0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:55.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.206+0000 7f5cb0d45640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5cac06c470 0x7f5cac154ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41358/0 (socket says 172.21.15.133:41358) 2023-12-19T18:59:55.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.206+0000 7f5cb0d45640 1 -- 172.21.15.133:0/4060159611 learned_addr learned my addr 172.21.15.133:0/4060159611 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:55.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.206+0000 7f5cb1546640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5cac152030 0x7f5cac0c0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58584/0 (socket says 172.21.15.133:58584) 2023-12-19T18:59:55.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.206+0000 7f5cb1546640 1 -- 172.21.15.133:0/4060159611 >> v2:172.21.15.138:3300/0 conn(0x7f5cac157c90 msgr2=0x7f5cac0c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:55.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.206+0000 7f5cb1546640 1 --2- 172.21.15.133:0/4060159611 >> v2:172.21.15.138:3300/0 conn(0x7f5cac157c90 0x7f5cac0c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.206+0000 7f5cb1546640 1 -- 172.21.15.133:0/4060159611 >> v1:172.21.15.133:6789/0 conn(0x7f5cac06c470 legacy=0x7f5cac154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:55.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.206+0000 7f5cb1546640 1 -- 172.21.15.133:0/4060159611 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac0c1820 con 0x7f5cac152030 2023-12-19T18:59:55.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.206+0000 7f5ca3fff640 1 -- 172.21.15.133:0/4060159611 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310800738 0 0) 0x7f5cac154b60 con 0x7f5cac06c470 2023-12-19T18:59:55.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.206+0000 7f5cb1546640 1 --2- 172.21.15.133:0/4060159611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cac152030 0x7f5cac0c0c40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5cac06ca00 tx=0x7f5ca801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3f05dff43d28a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:55.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.206+0000 7f5ca3fff640 1 -- 172.21.15.133:0/4060159611 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca80ac410 con 0x7f5cac152030 2023-12-19T18:59:55.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.206+0000 7f5ca3fff640 1 -- 172.21.15.133:0/4060159611 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca80ac570 con 0x7f5cac152030 2023-12-19T18:59:55.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.206+0000 7f5ca3fff640 1 -- 172.21.15.133:0/4060159611 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca80ac900 con 0x7f5cac152030 2023-12-19T18:59:55.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb37aa640 1 -- 172.21.15.133:0/4060159611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cac152030 msgr2=0x7f5cac0c0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:55.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb37aa640 1 --2- 172.21.15.133:0/4060159611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cac152030 0x7f5cac0c0c40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5cac06ca00 tx=0x7f5ca801c3b0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb37aa640 1 -- 172.21.15.133:0/4060159611 shutdown_connections 2023-12-19T18:59:55.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb37aa640 1 --2- 172.21.15.133:0/4060159611 >> v2:172.21.15.138:3300/0 conn(0x7f5cac157c90 0x7f5cac0c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb37aa640 1 --2- 172.21.15.133:0/4060159611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cac152030 0x7f5cac0c0c40 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb37aa640 1 -- 172.21.15.133:0/4060159611 >> 172.21.15.133:0/4060159611 conn(0x7f5cac06a5b0 msgr2=0x7f5cac06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:55.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb37aa640 1 -- 172.21.15.133:0/4060159611 shutdown_connections 2023-12-19T18:59:55.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb37aa640 1 -- 172.21.15.133:0/4060159611 wait complete. 2023-12-19T18:59:55.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb37aa640 1 Processor -- start 2023-12-19T18:59:55.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb37aa640 1 -- start start 2023-12-19T18:59:55.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb37aa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cac06c470 0x7f5cac0ab450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:55.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb37aa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cac152030 0x7f5cac153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:55.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb37aa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cac157c90 0x7f5cac14a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:55.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb37aa640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac0a9e60 con 0x7f5cac06c470 2023-12-19T18:59:55.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb37aa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac0ab0c0 con 0x7f5cac157c90 2023-12-19T18:59:55.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb37aa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac14b420 con 0x7f5cac152030 2023-12-19T18:59:55.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb1546640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cac06c470 0x7f5cac0ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:55.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb1546640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cac06c470 0x7f5cac0ab450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58596/0 (socket says 172.21.15.133:58596) 2023-12-19T18:59:55.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb1546640 1 -- 172.21.15.133:0/3744521106 learned_addr learned my addr 172.21.15.133:0/3744521106 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:55.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb1d47640 1 --2- 172.21.15.133:0/3744521106 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cac157c90 0x7f5cac14a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:55.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb0d45640 1 --2- 172.21.15.133:0/3744521106 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cac152030 0x7f5cac153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:55.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb1546640 1 -- 172.21.15.133:0/3744521106 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cac152030 msgr2=0x7f5cac153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:55.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb1546640 1 --2- 172.21.15.133:0/3744521106 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cac152030 0x7f5cac153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb1546640 1 -- 172.21.15.133:0/3744521106 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cac157c90 msgr2=0x7f5cac14a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:55.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb1546640 1 --2- 172.21.15.133:0/3744521106 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cac157c90 0x7f5cac14a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb1546640 1 -- 172.21.15.133:0/3744521106 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca8009420 con 0x7f5cac06c470 2023-12-19T18:59:55.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb0d45640 1 --2- 172.21.15.133:0/3744521106 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cac152030 0x7f5cac153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:55.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.210+0000 7f5cb1d47640 1 --2- 172.21.15.133:0/3744521106 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cac157c90 0x7f5cac14a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:55.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.214+0000 7f5cb1546640 1 --2- 172.21.15.133:0/3744521106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cac06c470 0x7f5cac0ab450 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80af040 tx=0x7f5ca8019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:55.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.214+0000 7f5ca1ffb640 1 -- 172.21.15.133:0/3744521106 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca80ac410 con 0x7f5cac06c470 2023-12-19T18:59:55.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.214+0000 7f5ca1ffb640 1 -- 172.21.15.133:0/3744521106 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ca8006e20 con 0x7f5cac06c470 2023-12-19T18:59:55.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.214+0000 7f5cb37aa640 1 -- 172.21.15.133:0/3744521106 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cac14b840 con 0x7f5cac06c470 2023-12-19T18:59:55.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.214+0000 7f5ca1ffb640 1 -- 172.21.15.133:0/3744521106 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca80b5860 con 0x7f5cac06c470 2023-12-19T18:59:55.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.214+0000 7f5cb37aa640 1 -- 172.21.15.133:0/3744521106 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cac0a9b80 con 0x7f5cac06c470 2023-12-19T18:59:55.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.214+0000 7f5cb37aa640 1 -- 172.21.15.133:0/3744521106 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cac14b560 con 0x7f5cac06c470 2023-12-19T18:59:55.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.214+0000 7f5ca1ffb640 1 -- 172.21.15.133:0/3744521106 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5ca80b3040 con 0x7f5cac06c470 2023-12-19T18:59:55.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.214+0000 7f5ca1ffb640 1 --2- 172.21.15.133:0/3744521106 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5c90066470 0x7f5c90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:55.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.214+0000 7f5ca1ffb640 1 -- 172.21.15.133:0/3744521106 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5ca811e540 con 0x7f5cac06c470 2023-12-19T18:59:55.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.214+0000 7f5cb0d45640 1 --2- 172.21.15.133:0/3744521106 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5c90066470 0x7f5c90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:55.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.218+0000 7f5cb0d45640 1 --2- 172.21.15.133:0/3744521106 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5c90066470 0x7f5c90068930 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5cac151a30 tx=0x7f5c9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:55.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.218+0000 7f5ca1ffb640 1 -- 172.21.15.133:0/3744521106 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5cac14b560 con 0x7f5cac06c470 2023-12-19T18:59:55.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.370+0000 7f5cb37aa640 1 -- 172.21.15.133:0/3744521106 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5cac068400 con 0x7f5cac06c470 2023-12-19T18:59:55.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.370+0000 7f5ca1ffb640 1 -- 172.21.15.133:0/3744521106 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ca80ef0e0 con 0x7f5cac06c470 2023-12-19T18:59:55.373 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T18:59:55.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.370+0000 7f5cb37aa640 1 -- 172.21.15.133:0/3744521106 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5c90066470 msgr2=0x7f5c90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:55.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.370+0000 7f5cb37aa640 1 --2- 172.21.15.133:0/3744521106 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5c90066470 0x7f5c90068930 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5cac151a30 tx=0x7f5c9c009040 comp rx=0 tx=0).stop 2023-12-19T18:59:55.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.370+0000 7f5cb37aa640 1 -- 172.21.15.133:0/3744521106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cac06c470 msgr2=0x7f5cac0ab450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:55.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.370+0000 7f5cb37aa640 1 --2- 172.21.15.133:0/3744521106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cac06c470 0x7f5cac0ab450 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80af040 tx=0x7f5ca8019150 comp rx=0 tx=0).stop 2023-12-19T18:59:55.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.370+0000 7f5cb37aa640 1 -- 172.21.15.133:0/3744521106 shutdown_connections 2023-12-19T18:59:55.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.370+0000 7f5cb37aa640 1 --2- 172.21.15.133:0/3744521106 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5c90066470 0x7f5c90068930 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.370+0000 7f5cb37aa640 1 --2- 172.21.15.133:0/3744521106 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5cac157c90 0x7f5cac14a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.370+0000 7f5cb37aa640 1 --2- 172.21.15.133:0/3744521106 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5cac152030 0x7f5cac153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.370+0000 7f5cb37aa640 1 --2- 172.21.15.133:0/3744521106 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5cac06c470 0x7f5cac0ab450 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.370+0000 7f5cb37aa640 1 -- 172.21.15.133:0/3744521106 >> 172.21.15.133:0/3744521106 conn(0x7f5cac06a5b0 msgr2=0x7f5cac150fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:55.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.370+0000 7f5cb37aa640 1 -- 172.21.15.133:0/3744521106 shutdown_connections 2023-12-19T18:59:55.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.370+0000 7f5cb37aa640 1 -- 172.21.15.133:0/3744521106 wait complete. 2023-12-19T18:59:55.394 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:59:55.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.530+0000 7f21c111e640 1 Processor -- start 2023-12-19T18:59:55.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.530+0000 7f21c111e640 1 -- start start 2023-12-19T18:59:55.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.534+0000 7f21c111e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21bc155950 0x7f21bc0c2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:55.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.534+0000 7f21c111e640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21bc0a76e0 con 0x7f21bc0c5ac0 2023-12-19T18:59:55.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.534+0000 7f21c111e640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21bc158590 con 0x7f21bc0c2580 2023-12-19T18:59:55.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.534+0000 7f21c111e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0c3540 con 0x7f21bc155950 2023-12-19T18:59:55.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.534+0000 7f21bb7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f21bc0c5ac0 0x7f21bc15cd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41364/0 (socket says 172.21.15.133:41364) 2023-12-19T18:59:55.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.534+0000 7f21bb7fe640 1 -- 172.21.15.133:0/3498752454 learned_addr learned my addr 172.21.15.133:0/3498752454 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:55.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.534+0000 7f21c091d640 1 --2- 172.21.15.133:0/3498752454 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21bc155950 0x7f21bc0c2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:55.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.534+0000 7f21baffd640 1 -- 172.21.15.133:0/3498752454 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3602002023 0 0) 0x7f21bc0a76e0 con 0x7f21bc0c5ac0 2023-12-19T18:59:55.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.534+0000 7f21baffd640 1 -- 172.21.15.133:0/3498752454 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21a4003530 con 0x7f21bc0c5ac0 2023-12-19T18:59:55.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.534+0000 7f21baffd640 1 -- 172.21.15.133:0/3498752454 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34451243 0 0) 0x7f21bc158590 con 0x7f21bc0c2580 2023-12-19T18:59:55.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.534+0000 7f21c091d640 1 -- 172.21.15.133:0/3498752454 >> v1:172.21.15.138:6789/0 conn(0x7f21bc0c2580 legacy=0x7f21bc154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:55.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.534+0000 7f21c091d640 1 -- 172.21.15.133:0/3498752454 >> v1:172.21.15.133:6789/0 conn(0x7f21bc0c5ac0 legacy=0x7f21bc15cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:55.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.534+0000 7f21c091d640 1 -- 172.21.15.133:0/3498752454 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc1545f0 con 0x7f21bc155950 2023-12-19T18:59:55.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.538+0000 7f21c091d640 1 --2- 172.21.15.133:0/3498752454 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21bc155950 0x7f21bc0c2960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009dc0 tx=0x7f21b401c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb63f6c0b22d98bb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:55.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.538+0000 7f21baffd640 1 -- 172.21.15.133:0/3498752454 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b40a5840 con 0x7f21bc155950 2023-12-19T18:59:55.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.538+0000 7f21baffd640 1 -- 172.21.15.133:0/3498752454 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b40a59a0 con 0x7f21bc155950 2023-12-19T18:59:55.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.538+0000 7f21baffd640 1 -- 172.21.15.133:0/3498752454 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b40a5d10 con 0x7f21bc155950 2023-12-19T18:59:55.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.538+0000 7f21c111e640 1 -- 172.21.15.133:0/3498752454 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21bc155950 msgr2=0x7f21bc0c2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:55.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.538+0000 7f21c111e640 1 --2- 172.21.15.133:0/3498752454 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21bc155950 0x7f21bc0c2960 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f21b4009dc0 tx=0x7f21b401c820 comp rx=0 tx=0).stop 2023-12-19T18:59:55.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.538+0000 7f21c111e640 1 -- 172.21.15.133:0/3498752454 shutdown_connections 2023-12-19T18:59:55.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.538+0000 7f21c111e640 1 --2- 172.21.15.133:0/3498752454 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21bc155950 0x7f21bc0c2960 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.538+0000 7f21c111e640 1 -- 172.21.15.133:0/3498752454 >> 172.21.15.133:0/3498752454 conn(0x7f21bc0a9930 msgr2=0x7f21bc0a9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:55.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.538+0000 7f21c111e640 1 -- 172.21.15.133:0/3498752454 shutdown_connections 2023-12-19T18:59:55.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.538+0000 7f21c111e640 1 -- 172.21.15.133:0/3498752454 wait complete. 2023-12-19T18:59:55.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.538+0000 7f21c111e640 1 Processor -- start 2023-12-19T18:59:55.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.538+0000 7f21c111e640 1 -- start start 2023-12-19T18:59:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.538+0000 7f21c111e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21bc0c2580 0x7f21bc0a7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.538+0000 7f21c111e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21bc0c5ac0 0x7f21bc14e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.538+0000 7f21c111e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21bc155950 0x7f21bc14c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.538+0000 7f21c111e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc155de0 con 0x7f21bc155950 2023-12-19T18:59:55.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.538+0000 7f21c111e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc155500 con 0x7f21bc0c5ac0 2023-12-19T18:59:55.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.538+0000 7f21c111e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc0a7300 con 0x7f21bc0c2580 2023-12-19T18:59:55.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.542+0000 7f21c091d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21bc155950 0x7f21bc14c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:55.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.542+0000 7f21c091d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21bc155950 0x7f21bc14c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58604/0 (socket says 172.21.15.133:58604) 2023-12-19T18:59:55.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.542+0000 7f21c091d640 1 -- 172.21.15.133:0/1614266116 learned_addr learned my addr 172.21.15.133:0/1614266116 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:55.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.542+0000 7f21bbfff640 1 --2- 172.21.15.133:0/1614266116 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21bc0c2580 0x7f21bc0a7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:55.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.542+0000 7f21bb7fe640 1 --2- 172.21.15.133:0/1614266116 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21bc0c5ac0 0x7f21bc14e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:55.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.542+0000 7f21c091d640 1 -- 172.21.15.133:0/1614266116 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21bc0c2580 msgr2=0x7f21bc0a7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:55.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.542+0000 7f21c091d640 1 --2- 172.21.15.133:0/1614266116 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21bc0c2580 0x7f21bc0a7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.542+0000 7f21c091d640 1 -- 172.21.15.133:0/1614266116 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21bc0c5ac0 msgr2=0x7f21bc14e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:55.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.542+0000 7f21c091d640 1 --2- 172.21.15.133:0/1614266116 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21bc0c5ac0 0x7f21bc14e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.542+0000 7f21c091d640 1 -- 172.21.15.133:0/1614266116 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b4009a70 con 0x7f21bc155950 2023-12-19T18:59:55.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.542+0000 7f21c091d640 1 --2- 172.21.15.133:0/1614266116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21bc155950 0x7f21bc14c250 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f21b401a450 tx=0x7f21b40195c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:55.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.542+0000 7f21b8ff9640 1 -- 172.21.15.133:0/1614266116 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b40ad440 con 0x7f21bc155950 2023-12-19T18:59:55.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.542+0000 7f21b8ff9640 1 -- 172.21.15.133:0/1614266116 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b40ad5a0 con 0x7f21bc155950 2023-12-19T18:59:55.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.542+0000 7f21b8ff9640 1 -- 172.21.15.133:0/1614266116 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b40ad930 con 0x7f21bc155950 2023-12-19T18:59:55.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.542+0000 7f21c111e640 1 -- 172.21.15.133:0/1614266116 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21bc0c2280 con 0x7f21bc155950 2023-12-19T18:59:55.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.542+0000 7f21c111e640 1 -- 172.21.15.133:0/1614266116 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21bc1ed660 con 0x7f21bc155950 2023-12-19T18:59:55.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.542+0000 7f21c111e640 1 -- 172.21.15.133:0/1614266116 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21bc067a00 con 0x7f21bc155950 2023-12-19T18:59:55.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.542+0000 7f21b8ff9640 1 -- 172.21.15.133:0/1614266116 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f21b40ada90 con 0x7f21bc155950 2023-12-19T18:59:55.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.542+0000 7f21b8ff9640 1 --2- 172.21.15.133:0/1614266116 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f21a8066470 0x7f21a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:55.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.546+0000 7f21b8ff9640 1 -- 172.21.15.133:0/1614266116 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f21b411f510 con 0x7f21bc155950 2023-12-19T18:59:55.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.546+0000 7f21bbfff640 1 --2- 172.21.15.133:0/1614266116 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f21a8066470 0x7f21a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:55.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.546+0000 7f21bbfff640 1 --2- 172.21.15.133:0/1614266116 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f21a8066470 0x7f21a8068930 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0a7600 tx=0x7f21ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:55.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.546+0000 7f21b8ff9640 1 -- 172.21.15.133:0/1614266116 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f21b40ec6d0 con 0x7f21bc155950 2023-12-19T18:59:55.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.694+0000 7f21c111e640 1 -- 172.21.15.133:0/1614266116 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f21bc04e850 con 0x7f21bc155950 2023-12-19T18:59:55.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.694+0000 7f21b8ff9640 1 -- 172.21.15.133:0/1614266116 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f21b40bc020 con 0x7f21bc155950 2023-12-19T18:59:55.698 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T18:59:55.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.698+0000 7f21c111e640 1 -- 172.21.15.133:0/1614266116 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f21a8066470 msgr2=0x7f21a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:55.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.698+0000 7f21c111e640 1 --2- 172.21.15.133:0/1614266116 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f21a8066470 0x7f21a8068930 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f21bc0a7600 tx=0x7f21ac009040 comp rx=0 tx=0).stop 2023-12-19T18:59:55.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.698+0000 7f21c111e640 1 -- 172.21.15.133:0/1614266116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21bc155950 msgr2=0x7f21bc14c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:55.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.698+0000 7f21c111e640 1 --2- 172.21.15.133:0/1614266116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21bc155950 0x7f21bc14c250 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f21b401a450 tx=0x7f21b40195c0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.698+0000 7f21c111e640 1 -- 172.21.15.133:0/1614266116 shutdown_connections 2023-12-19T18:59:55.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.698+0000 7f21c111e640 1 --2- 172.21.15.133:0/1614266116 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f21a8066470 0x7f21a8068930 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.698+0000 7f21c111e640 1 --2- 172.21.15.133:0/1614266116 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21bc155950 0x7f21bc14c250 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.698+0000 7f21c111e640 1 --2- 172.21.15.133:0/1614266116 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21bc0c5ac0 0x7f21bc14e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.698+0000 7f21c111e640 1 --2- 172.21.15.133:0/1614266116 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21bc0c2580 0x7f21bc0a7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.698+0000 7f21c111e640 1 -- 172.21.15.133:0/1614266116 >> 172.21.15.133:0/1614266116 conn(0x7f21bc0a9930 msgr2=0x7f21bc0a9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:55.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.698+0000 7f21c111e640 1 -- 172.21.15.133:0/1614266116 shutdown_connections 2023-12-19T18:59:55.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.698+0000 7f21c111e640 1 -- 172.21.15.133:0/1614266116 wait complete. 2023-12-19T18:59:55.719 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:59:55.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.858+0000 7fa90e054640 1 Processor -- start 2023-12-19T18:59:55.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.858+0000 7fa90e054640 1 -- start start 2023-12-19T18:59:55.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.858+0000 7fa90e054640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa9080c63c0 0x7fa9080c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.858+0000 7fa90e054640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa9080c4100 0x7fa9080c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.858+0000 7fa90e054640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9080c31c0 con 0x7fa9080c29e0 2023-12-19T18:59:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.858+0000 7fa90e054640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9080c34a0 con 0x7fa9080c63c0 2023-12-19T18:59:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.858+0000 7fa90e054640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9080c1030 con 0x7fa9080c4100 2023-12-19T18:59:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.858+0000 7fa9077fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa9080c63c0 0x7fa9080c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.858+0000 7fa9077fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa9080c63c0 0x7fa9080c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58614/0 (socket says 172.21.15.133:58614) 2023-12-19T18:59:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.858+0000 7fa9077fe640 1 -- 172.21.15.133:0/2155298348 learned_addr learned my addr 172.21.15.133:0/2155298348 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:55.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.858+0000 7fa906ffd640 1 --2- 172.21.15.133:0/2155298348 >> v2:172.21.15.138:3300/0 conn(0x7fa9080c4100 0x7fa9080c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:55.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.858+0000 7fa9077fe640 1 -- 172.21.15.133:0/2155298348 >> v2:172.21.15.138:3300/0 conn(0x7fa9080c4100 msgr2=0x7fa9080c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:55.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.858+0000 7fa9077fe640 1 --2- 172.21.15.133:0/2155298348 >> v2:172.21.15.138:3300/0 conn(0x7fa9080c4100 0x7fa9080c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.858+0000 7fa9077fe640 1 -- 172.21.15.133:0/2155298348 >> v1:172.21.15.138:6789/0 conn(0x7fa9080c29e0 legacy=0x7fa9080a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:55.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.858+0000 7fa9077fe640 1 -- 172.21.15.133:0/2155298348 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9080c1310 con 0x7fa9080c63c0 2023-12-19T18:59:55.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.862+0000 7fa9077fe640 1 --2- 172.21.15.133:0/2155298348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080c63c0 0x7fa9080c06d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa9080a8b40 tx=0x7fa8f801ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55012f9d2db6b9d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:55.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.862+0000 7fa9067fc640 1 -- 172.21.15.133:0/2155298348 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f80a7a70 con 0x7fa9080c63c0 2023-12-19T18:59:55.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.862+0000 7fa9067fc640 1 -- 172.21.15.133:0/2155298348 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8f80a7bd0 con 0x7fa9080c63c0 2023-12-19T18:59:55.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.862+0000 7fa9067fc640 1 -- 172.21.15.133:0/2155298348 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8f80af440 con 0x7fa9080c63c0 2023-12-19T18:59:55.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.862+0000 7fa90e054640 1 -- 172.21.15.133:0/2155298348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080c63c0 msgr2=0x7fa9080c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:55.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.862+0000 7fa90e054640 1 --2- 172.21.15.133:0/2155298348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080c63c0 0x7fa9080c06d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa9080a8b40 tx=0x7fa8f801ea80 comp rx=0 tx=0).stop 2023-12-19T18:59:55.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.862+0000 7fa90e054640 1 -- 172.21.15.133:0/2155298348 shutdown_connections 2023-12-19T18:59:55.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.862+0000 7fa90e054640 1 --2- 172.21.15.133:0/2155298348 >> v2:172.21.15.138:3300/0 conn(0x7fa9080c4100 0x7fa9080c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.862+0000 7fa90e054640 1 --2- 172.21.15.133:0/2155298348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080c63c0 0x7fa9080c06d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.862+0000 7fa90e054640 1 -- 172.21.15.133:0/2155298348 >> 172.21.15.133:0/2155298348 conn(0x7fa90806a5b0 msgr2=0x7fa90806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:55.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.862+0000 7fa90e054640 1 -- 172.21.15.133:0/2155298348 shutdown_connections 2023-12-19T18:59:55.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.862+0000 7fa90e054640 1 -- 172.21.15.133:0/2155298348 wait complete. 2023-12-19T18:59:55.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa90e054640 1 Processor -- start 2023-12-19T18:59:55.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa90e054640 1 -- start start 2023-12-19T18:59:55.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa90e054640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9080c29e0 0x7fa9080bfd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:55.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa90e054640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9080c4100 0x7fa9081ed580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:55.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa90e054640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080c63c0 0x7fa9081edac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:55.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa90e054640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa90809b520 con 0x7fa9080c63c0 2023-12-19T18:59:55.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa90e054640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa908159c70 con 0x7fa9080c4100 2023-12-19T18:59:55.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa90e054640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa908099a70 con 0x7fa9080c29e0 2023-12-19T18:59:55.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa907fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080c63c0 0x7fa9081edac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:55.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa907fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080c63c0 0x7fa9081edac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58628/0 (socket says 172.21.15.133:58628) 2023-12-19T18:59:55.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa907fff640 1 -- 172.21.15.133:0/2910493833 learned_addr learned my addr 172.21.15.133:0/2910493833 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:55.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa906ffd640 1 --2- 172.21.15.133:0/2910493833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9080c4100 0x7fa9081ed580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:55.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa9077fe640 1 --2- 172.21.15.133:0/2910493833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9080c29e0 0x7fa9080bfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:55.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa907fff640 1 -- 172.21.15.133:0/2910493833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9080c29e0 msgr2=0x7fa9080bfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:55.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa907fff640 1 --2- 172.21.15.133:0/2910493833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9080c29e0 0x7fa9080bfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa907fff640 1 -- 172.21.15.133:0/2910493833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9080c4100 msgr2=0x7fa9081ed580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:55.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa907fff640 1 --2- 172.21.15.133:0/2910493833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9080c4100 0x7fa9081ed580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:55.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa907fff640 1 -- 172.21.15.133:0/2910493833 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8f800b770 con 0x7fa9080c63c0 2023-12-19T18:59:55.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa907fff640 1 --2- 172.21.15.133:0/2910493833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080c63c0 0x7fa9081edac0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa90000c770 tx=0x7fa90000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:55.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa8effff640 1 -- 172.21.15.133:0/2910493833 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa900003b80 con 0x7fa9080c63c0 2023-12-19T18:59:55.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa8effff640 1 -- 172.21.15.133:0/2910493833 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa900003ce0 con 0x7fa9080c63c0 2023-12-19T18:59:55.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa8effff640 1 -- 172.21.15.133:0/2910493833 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90000aa90 con 0x7fa9080c63c0 2023-12-19T18:59:55.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa90e054640 1 -- 172.21.15.133:0/2910493833 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa90815b1b0 con 0x7fa9080c63c0 2023-12-19T18:59:55.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.866+0000 7fa90e054640 1 -- 172.21.15.133:0/2910493833 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa908159e80 con 0x7fa9080c63c0 2023-12-19T18:59:55.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.870+0000 7fa90e054640 1 -- 172.21.15.133:0/2910493833 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9081ed2a0 con 0x7fa9080c63c0 2023-12-19T18:59:55.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.870+0000 7fa8effff640 1 -- 172.21.15.133:0/2910493833 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa90000abf0 con 0x7fa9080c63c0 2023-12-19T18:59:55.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.870+0000 7fa8effff640 1 --2- 172.21.15.133:0/2910493833 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa8f4066470 0x7fa8f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:55.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.870+0000 7fa8effff640 1 -- 172.21.15.133:0/2910493833 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa900083ee0 con 0x7fa9080c63c0 2023-12-19T18:59:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.870+0000 7fa9077fe640 1 --2- 172.21.15.133:0/2910493833 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa8f4066470 0x7fa8f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:55.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.870+0000 7fa9077fe640 1 --2- 172.21.15.133:0/2910493833 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa8f4066470 0x7fa8f4068930 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa8f80b1000 tx=0x7fa8f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:55.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:55.874+0000 7fa8effff640 1 -- 172.21.15.133:0/2910493833 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa9081ed2a0 con 0x7fa9080c63c0 2023-12-19T18:59:56.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.026+0000 7fa90e054640 1 -- 172.21.15.133:0/2910493833 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa9081ed2a0 con 0x7fa9080c63c0 2023-12-19T18:59:56.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.026+0000 7fa8effff640 1 -- 172.21.15.133:0/2910493833 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa9081ed2a0 con 0x7fa9080c63c0 2023-12-19T18:59:56.031 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T18:59:56.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.030+0000 7fa90e054640 1 -- 172.21.15.133:0/2910493833 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa8f4066470 msgr2=0x7fa8f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:56.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.030+0000 7fa90e054640 1 --2- 172.21.15.133:0/2910493833 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa8f4066470 0x7fa8f4068930 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa8f80b1000 tx=0x7fa8f8008040 comp rx=0 tx=0).stop 2023-12-19T18:59:56.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.030+0000 7fa90e054640 1 -- 172.21.15.133:0/2910493833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080c63c0 msgr2=0x7fa9081edac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:56.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.030+0000 7fa90e054640 1 --2- 172.21.15.133:0/2910493833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080c63c0 0x7fa9081edac0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa90000c770 tx=0x7fa90000cc30 comp rx=0 tx=0).stop 2023-12-19T18:59:56.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.030+0000 7fa90e054640 1 -- 172.21.15.133:0/2910493833 shutdown_connections 2023-12-19T18:59:56.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.030+0000 7fa90e054640 1 --2- 172.21.15.133:0/2910493833 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa8f4066470 0x7fa8f4068930 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.030+0000 7fa90e054640 1 --2- 172.21.15.133:0/2910493833 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9080c63c0 0x7fa9081edac0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.030+0000 7fa90e054640 1 --2- 172.21.15.133:0/2910493833 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9080c4100 0x7fa9081ed580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.030+0000 7fa90e054640 1 --2- 172.21.15.133:0/2910493833 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9080c29e0 0x7fa9080bfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.030+0000 7fa90e054640 1 -- 172.21.15.133:0/2910493833 >> 172.21.15.133:0/2910493833 conn(0x7fa90806a5b0 msgr2=0x7fa90806d770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:56.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.030+0000 7fa90e054640 1 -- 172.21.15.133:0/2910493833 shutdown_connections 2023-12-19T18:59:56.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.030+0000 7fa90e054640 1 -- 172.21.15.133:0/2910493833 wait complete. 2023-12-19T18:59:56.052 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-19T18:59:56.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.190+0000 7f3e48dc4640 1 Processor -- start 2023-12-19T18:59:56.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.190+0000 7f3e48dc4640 1 -- start start 2023-12-19T18:59:56.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e48dc4640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e4406d520 0x7f3e4415ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:56.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e48dc4640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4415c600 con 0x7f3e440bffc0 2023-12-19T18:59:56.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e48dc4640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e4415a5c0 con 0x7f3e441560e0 2023-12-19T18:59:56.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e48dc4640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e441594e0 con 0x7f3e4406d520 2023-12-19T18:59:56.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e42d9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3e440bffc0 0x7f3e440c1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41380/0 (socket says 172.21.15.133:41380) 2023-12-19T18:59:56.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e42d9d640 1 -- 172.21.15.133:0/1590361913 learned_addr learned my addr 172.21.15.133:0/1590361913 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:56.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e41d9b640 1 --2- 172.21.15.133:0/1590361913 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e4406d520 0x7f3e4415ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:56.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e4159a640 1 -- 172.21.15.133:0/1590361913 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497376902 0 0) 0x7f3e4415c600 con 0x7f3e440bffc0 2023-12-19T18:59:56.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e4159a640 1 -- 172.21.15.133:0/1590361913 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e2c003530 con 0x7f3e440bffc0 2023-12-19T18:59:56.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e4159a640 1 -- 172.21.15.133:0/1590361913 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215773973 0 0) 0x7f3e4415a5c0 con 0x7f3e441560e0 2023-12-19T18:59:56.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e4159a640 1 -- 172.21.15.133:0/1590361913 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e4415c600 con 0x7f3e441560e0 2023-12-19T18:59:56.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e4159a640 1 -- 172.21.15.133:0/1590361913 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3879488354 0 0) 0x7f3e2c003530 con 0x7f3e440bffc0 2023-12-19T18:59:56.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e4159a640 1 -- 172.21.15.133:0/1590361913 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e4406d520 msgr2=0x7f3e4415ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:56.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e4159a640 1 --2- 172.21.15.133:0/1590361913 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e4406d520 0x7f3e4415ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e4159a640 1 -- 172.21.15.133:0/1590361913 >> v1:172.21.15.138:6789/0 conn(0x7f3e441560e0 legacy=0x7f3e44159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:56.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e4159a640 1 -- 172.21.15.133:0/1590361913 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e441597c0 con 0x7f3e440bffc0 2023-12-19T18:59:56.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e4159a640 1 -- 172.21.15.133:0/1590361913 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f3e3c001a00 con 0x7f3e440bffc0 2023-12-19T18:59:56.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e41d9b640 1 --2- 172.21.15.133:0/1590361913 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e4406d520 0x7f3e4415ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:59:56.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e4159a640 1 -- 172.21.15.133:0/1590361913 >> v1:172.21.15.133:6789/0 conn(0x7f3e440bffc0 legacy=0x7f3e440c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:56.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e4159a640 1 --2- 172.21.15.133:0/1590361913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e2c003b40 0x7f3e2c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:56.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e4159a640 1 --2- 172.21.15.133:0/1590361913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e2c0047d0 0x7f3e2c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:56.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e4159a640 1 --2- 172.21.15.133:0/1590361913 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e4406d520 0x7f3e2c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:56.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e4159a640 1 -- 172.21.15.133:0/1590361913 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e441594e0 con 0x7f3e2c0047d0 2023-12-19T18:59:56.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e4159a640 1 -- 172.21.15.133:0/1590361913 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c00ba40 con 0x7f3e2c003b40 2023-12-19T18:59:56.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e4159a640 1 -- 172.21.15.133:0/1590361913 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2c00bbd0 con 0x7f3e4406d520 2023-12-19T18:59:56.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e41d9b640 1 --2- 172.21.15.133:0/1590361913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e2c0047d0 0x7f3e2c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:56.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e42d9d640 1 --2- 172.21.15.133:0/1590361913 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e4406d520 0x7f3e2c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:56.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e4259c640 1 --2- 172.21.15.133:0/1590361913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e2c003b40 0x7f3e2c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:56.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e41d9b640 1 -- 172.21.15.133:0/1590361913 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e4406d520 msgr2=0x7f3e2c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:56.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e41d9b640 1 --2- 172.21.15.133:0/1590361913 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e4406d520 0x7f3e2c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e41d9b640 1 -- 172.21.15.133:0/1590361913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e2c003b40 msgr2=0x7f3e2c003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:56.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e41d9b640 1 --2- 172.21.15.133:0/1590361913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e2c003b40 0x7f3e2c003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e41d9b640 1 -- 172.21.15.133:0/1590361913 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e38009420 con 0x7f3e2c0047d0 2023-12-19T18:59:56.200 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.194+0000 7f3e4259c640 1 --2- 172.21.15.133:0/1590361913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e2c003b40 0x7f3e2c003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:56.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.198+0000 7f3e41d9b640 1 --2- 172.21.15.133:0/1590361913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e2c0047d0 0x7f3e2c004c50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3e4406d960 tx=0x7f3e3801cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3570eabe3e0851 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:56.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.198+0000 7f3e4159a640 1 -- 172.21.15.133:0/1590361913 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e380a5830 con 0x7f3e2c0047d0 2023-12-19T18:59:56.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.198+0000 7f3e4159a640 1 -- 172.21.15.133:0/1590361913 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e380a5990 con 0x7f3e2c0047d0 2023-12-19T18:59:56.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.198+0000 7f3e4159a640 1 -- 172.21.15.133:0/1590361913 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e380a5d40 con 0x7f3e2c0047d0 2023-12-19T18:59:56.201 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.198+0000 7f3e48dc4640 1 -- 172.21.15.133:0/1590361913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e2c0047d0 msgr2=0x7f3e2c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:56.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.198+0000 7f3e48dc4640 1 --2- 172.21.15.133:0/1590361913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e2c0047d0 0x7f3e2c004c50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f3e4406d960 tx=0x7f3e3801cb70 comp rx=0 tx=0).stop 2023-12-19T18:59:56.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.198+0000 7f3e42d9d640 1 -- 172.21.15.133:0/1590361913 reap_dead start 2023-12-19T18:59:56.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.198+0000 7f3e48dc4640 1 -- 172.21.15.133:0/1590361913 shutdown_connections 2023-12-19T18:59:56.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.198+0000 7f3e48dc4640 1 -- 172.21.15.133:0/1590361913 >> 172.21.15.133:0/1590361913 conn(0x7f3e4406a5b0 msgr2=0x7f3e4406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:56.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.198+0000 7f3e48dc4640 1 -- 172.21.15.133:0/1590361913 shutdown_connections 2023-12-19T18:59:56.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.198+0000 7f3e48dc4640 1 -- 172.21.15.133:0/1590361913 wait complete. 2023-12-19T18:59:56.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.198+0000 7f3e48dc4640 1 Processor -- start 2023-12-19T18:59:56.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.198+0000 7f3e48dc4640 1 -- start start 2023-12-19T18:59:56.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e48dc4640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e2c0047d0 0x7f3e441f1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:56.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e48dc4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e440a5bf0 0x7f3e4406fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:56.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e48dc4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e44154e00 0x7f3e44155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:56.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e48dc4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e440a62a0 con 0x7f3e44154e00 2023-12-19T18:59:56.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e48dc4640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e44155910 con 0x7f3e440a5bf0 2023-12-19T18:59:56.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e48dc4640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e441f2580 con 0x7f3e2c0047d0 2023-12-19T18:59:56.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e42d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e44154e00 0x7f3e44155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:56.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e42d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e44154e00 0x7f3e44155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58656/0 (socket says 172.21.15.133:58656) 2023-12-19T18:59:56.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e42d9d640 1 -- 172.21.15.133:0/2888353858 learned_addr learned my addr 172.21.15.133:0/2888353858 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:56.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e41d9b640 1 --2- 172.21.15.133:0/2888353858 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e440a5bf0 0x7f3e4406fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:56.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e4259c640 1 --2- 172.21.15.133:0/2888353858 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e2c0047d0 0x7f3e441f1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:56.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e42d9d640 1 -- 172.21.15.133:0/2888353858 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e2c0047d0 msgr2=0x7f3e441f1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:56.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e42d9d640 1 --2- 172.21.15.133:0/2888353858 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e2c0047d0 0x7f3e441f1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e42d9d640 1 -- 172.21.15.133:0/2888353858 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e440a5bf0 msgr2=0x7f3e4406fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:56.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e42d9d640 1 --2- 172.21.15.133:0/2888353858 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e440a5bf0 0x7f3e4406fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e42d9d640 1 -- 172.21.15.133:0/2888353858 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e441f2820 con 0x7f3e44154e00 2023-12-19T18:59:56.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e41d9b640 1 --2- 172.21.15.133:0/2888353858 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e440a5bf0 0x7f3e4406fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:56.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e42d9d640 1 --2- 172.21.15.133:0/2888353858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e44154e00 0x7f3e44155280 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3e440a5800 tx=0x7f3e3c007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:56.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e32ffd640 1 -- 172.21.15.133:0/2888353858 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c0020e0 con 0x7f3e44154e00 2023-12-19T18:59:56.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e32ffd640 1 -- 172.21.15.133:0/2888353858 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3c00ea80 con 0x7f3e44154e00 2023-12-19T18:59:56.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e32ffd640 1 -- 172.21.15.133:0/2888353858 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3c00ee50 con 0x7f3e44154e00 2023-12-19T18:59:56.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e48dc4640 1 -- 172.21.15.133:0/2888353858 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e440a7ed0 con 0x7f3e44154e00 2023-12-19T18:59:56.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e48dc4640 1 -- 172.21.15.133:0/2888353858 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e44070e60 con 0x7f3e44154e00 2023-12-19T18:59:56.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e48dc4640 1 -- 172.21.15.133:0/2888353858 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e44068400 con 0x7f3e44154e00 2023-12-19T18:59:56.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.202+0000 7f3e32ffd640 1 -- 172.21.15.133:0/2888353858 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3e3c01d460 con 0x7f3e44154e00 2023-12-19T18:59:56.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.206+0000 7f3e32ffd640 1 --2- 172.21.15.133:0/2888353858 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3e24066470 0x7f3e24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:56.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.206+0000 7f3e32ffd640 1 -- 172.21.15.133:0/2888353858 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3e3c084540 con 0x7f3e44154e00 2023-12-19T18:59:56.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.206+0000 7f3e4259c640 1 --2- 172.21.15.133:0/2888353858 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3e24066470 0x7f3e24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:56.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.206+0000 7f3e4259c640 1 --2- 172.21.15.133:0/2888353858 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3e24066470 0x7f3e24068930 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3e34007af0 tx=0x7f3e34007940 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:56.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.210+0000 7f3e32ffd640 1 -- 172.21.15.133:0/2888353858 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f3e3c051650 con 0x7f3e44154e00 2023-12-19T18:59:56.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.358+0000 7f3e48dc4640 1 -- 172.21.15.133:0/2888353858 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3e440c3cf0 con 0x7f3e44154e00 2023-12-19T18:59:56.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.358+0000 7f3e32ffd640 1 -- 172.21.15.133:0/2888353858 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v35) v1 ==== 105+0+11 (secure 0 0 0) 0x7f3e3c054c70 con 0x7f3e44154e00 2023-12-19T18:59:56.362 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T18:59:56.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.362+0000 7f3e48dc4640 1 -- 172.21.15.133:0/2888353858 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3e24066470 msgr2=0x7f3e24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:56.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.362+0000 7f3e48dc4640 1 --2- 172.21.15.133:0/2888353858 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3e24066470 0x7f3e24068930 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3e34007af0 tx=0x7f3e34007940 comp rx=0 tx=0).stop 2023-12-19T18:59:56.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.362+0000 7f3e48dc4640 1 -- 172.21.15.133:0/2888353858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e44154e00 msgr2=0x7f3e44155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:56.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.362+0000 7f3e48dc4640 1 --2- 172.21.15.133:0/2888353858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e44154e00 0x7f3e44155280 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f3e440a5800 tx=0x7f3e3c007bc0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.362+0000 7f3e48dc4640 1 -- 172.21.15.133:0/2888353858 shutdown_connections 2023-12-19T18:59:56.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.362+0000 7f3e48dc4640 1 --2- 172.21.15.133:0/2888353858 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3e24066470 0x7f3e24068930 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.362+0000 7f3e48dc4640 1 --2- 172.21.15.133:0/2888353858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e44154e00 0x7f3e44155280 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.362+0000 7f3e48dc4640 1 --2- 172.21.15.133:0/2888353858 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e440a5bf0 0x7f3e4406fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.362+0000 7f3e48dc4640 1 --2- 172.21.15.133:0/2888353858 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e2c0047d0 0x7f3e441f1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.362+0000 7f3e48dc4640 1 -- 172.21.15.133:0/2888353858 >> 172.21.15.133:0/2888353858 conn(0x7f3e4406a5b0 msgr2=0x7f3e4406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:56.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.362+0000 7f3e48dc4640 1 -- 172.21.15.133:0/2888353858 shutdown_connections 2023-12-19T18:59:56.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.362+0000 7f3e48dc4640 1 -- 172.21.15.133:0/2888353858 wait complete. 2023-12-19T18:59:56.383 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-19T18:59:56.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.518+0000 7fc2fe438640 1 Processor -- start 2023-12-19T18:59:56.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.518+0000 7fc2fe438640 1 -- start start 2023-12-19T18:59:56.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.522+0000 7fc2fe438640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2f806e0b0 0x7fc2f80c3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:56.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.522+0000 7fc2fe438640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc2f806c980 0x7fc2f80c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:56.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.522+0000 7fc2fe438640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f8158a90 con 0x7fc2f8155dd0 2023-12-19T18:59:56.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.522+0000 7fc2fe438640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f81588a0 con 0x7fc2f806c980 2023-12-19T18:59:56.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.522+0000 7fc2fe438640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f8158d70 con 0x7fc2f806e0b0 2023-12-19T18:59:56.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.522+0000 7fc2fcc35640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2f806e0b0 0x7fc2f80c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:56.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.522+0000 7fc2fdc37640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc2f806c980 0x7fc2f80c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:56.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.522+0000 7fc2fcc35640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2f806e0b0 0x7fc2f80c3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:45068/0 (socket says 172.21.15.133:45068) 2023-12-19T18:59:56.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.522+0000 7fc2fcc35640 1 -- 172.21.15.133:0/3586514275 learned_addr learned my addr 172.21.15.133:0/3586514275 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:56.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.522+0000 7fc2fdc37640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc2f806c980 0x7fc2f80c3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:47312/0 (socket says 172.21.15.133:47312) 2023-12-19T18:59:56.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.522+0000 7fc2fcc35640 1 -- 172.21.15.133:0/3586514275 >> v2:172.21.15.138:3300/0 conn(0x7fc2f806c980 msgr2=0x7fc2f80c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:56.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.522+0000 7fc2fcc35640 1 --2- 172.21.15.133:0/3586514275 >> v2:172.21.15.138:3300/0 conn(0x7fc2f806c980 0x7fc2f80c3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.522+0000 7fc2fcc35640 1 -- 172.21.15.133:0/3586514275 >> v1:172.21.15.138:6789/0 conn(0x7fc2f8155dd0 legacy=0x7fc2f80c1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:56.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.522+0000 7fc2fcc35640 1 -- 172.21.15.133:0/3586514275 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f8159050 con 0x7fc2f806e0b0 2023-12-19T18:59:56.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.522+0000 7fc2fdc37640 1 --2- 172.21.15.133:0/3586514275 >> v2:172.21.15.138:3300/0 conn(0x7fc2f806c980 0x7fc2f80c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:59:56.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.526+0000 7fc2fcc35640 1 --2- 172.21.15.133:0/3586514275 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2f806e0b0 0x7fc2f80c3950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8009870 tx=0x7fc2e801c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=698d8121ebfd6e58 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:56.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.526+0000 7fc2effff640 1 -- 172.21.15.133:0/3586514275 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80ab600 con 0x7fc2f806e0b0 2023-12-19T18:59:56.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.526+0000 7fc2effff640 1 -- 172.21.15.133:0/3586514275 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e80a7050 con 0x7fc2f806e0b0 2023-12-19T18:59:56.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.526+0000 7fc2effff640 1 -- 172.21.15.133:0/3586514275 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80ab980 con 0x7fc2f806e0b0 2023-12-19T18:59:56.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.526+0000 7fc2fe438640 1 -- 172.21.15.133:0/3586514275 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2f806e0b0 msgr2=0x7fc2f80c3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:56.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.526+0000 7fc2fe438640 1 --2- 172.21.15.133:0/3586514275 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2f806e0b0 0x7fc2f80c3950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8009870 tx=0x7fc2e801c420 comp rx=0 tx=0).stop 2023-12-19T18:59:56.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.526+0000 7fc2fe438640 1 -- 172.21.15.133:0/3586514275 shutdown_connections 2023-12-19T18:59:56.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.526+0000 7fc2fe438640 1 --2- 172.21.15.133:0/3586514275 >> v2:172.21.15.138:3300/0 conn(0x7fc2f806c980 0x7fc2f80c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.526+0000 7fc2fe438640 1 --2- 172.21.15.133:0/3586514275 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2f806e0b0 0x7fc2f80c3950 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.526+0000 7fc2fe438640 1 -- 172.21.15.133:0/3586514275 >> 172.21.15.133:0/3586514275 conn(0x7fc2f80a7800 msgr2=0x7fc2f80a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:56.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.526+0000 7fc2fe438640 1 -- 172.21.15.133:0/3586514275 shutdown_connections 2023-12-19T18:59:56.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.526+0000 7fc2fe438640 1 -- 172.21.15.133:0/3586514275 wait complete. 2023-12-19T18:59:56.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.526+0000 7fc2fe438640 1 Processor -- start 2023-12-19T18:59:56.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.526+0000 7fc2fe438640 1 -- start start 2023-12-19T18:59:56.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2fe438640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2f806c980 0x7fc2f8154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:56.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2fe438640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2f806e0b0 0x7fc2f80ab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:56.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2fe438640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2f8155dd0 0x7fc2f81f4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:56.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2fe438640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f80a88b0 con 0x7fc2f806e0b0 2023-12-19T18:59:56.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2fe438640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f80a8b00 con 0x7fc2f806c980 2023-12-19T18:59:56.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2fe438640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f80a8de0 con 0x7fc2f8155dd0 2023-12-19T18:59:56.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2fcc35640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2f806e0b0 0x7fc2f80ab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:56.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2fcc35640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2f806e0b0 0x7fc2f80ab5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58658/0 (socket says 172.21.15.133:58658) 2023-12-19T18:59:56.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2fcc35640 1 -- 172.21.15.133:0/3832891248 learned_addr learned my addr 172.21.15.133:0/3832891248 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:56.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2fd436640 1 --2- 172.21.15.133:0/3832891248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2f806c980 0x7fc2f8154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:56.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2fdc37640 1 --2- 172.21.15.133:0/3832891248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2f8155dd0 0x7fc2f81f4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:56.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2fcc35640 1 -- 172.21.15.133:0/3832891248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2f8155dd0 msgr2=0x7fc2f81f4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:56.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2fcc35640 1 --2- 172.21.15.133:0/3832891248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2f8155dd0 0x7fc2f81f4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2fcc35640 1 -- 172.21.15.133:0/3832891248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2f806c980 msgr2=0x7fc2f8154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:56.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2fcc35640 1 --2- 172.21.15.133:0/3832891248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2f806c980 0x7fc2f8154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2fcc35640 1 -- 172.21.15.133:0/3832891248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f0009a70 con 0x7fc2f806e0b0 2023-12-19T18:59:56.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2fcc35640 1 --2- 172.21.15.133:0/3832891248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2f806e0b0 0x7fc2f80ab5f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80ae040 tx=0x7fc2e80191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:56.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2edffb640 1 -- 172.21.15.133:0/3832891248 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80b4440 con 0x7fc2f806e0b0 2023-12-19T18:59:56.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2edffb640 1 -- 172.21.15.133:0/3832891248 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e80b45c0 con 0x7fc2f806e0b0 2023-12-19T18:59:56.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2edffb640 1 -- 172.21.15.133:0/3832891248 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80b4970 con 0x7fc2f806e0b0 2023-12-19T18:59:56.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2fe438640 1 -- 172.21.15.133:0/3832891248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e80094d0 con 0x7fc2f806e0b0 2023-12-19T18:59:56.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2fe438640 1 -- 172.21.15.133:0/3832891248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f80a93a0 con 0x7fc2f806e0b0 2023-12-19T18:59:56.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2fe438640 1 -- 172.21.15.133:0/3832891248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f804e850 con 0x7fc2f806e0b0 2023-12-19T18:59:56.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.530+0000 7fc2edffb640 1 -- 172.21.15.133:0/3832891248 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc2e80b2070 con 0x7fc2f806e0b0 2023-12-19T18:59:56.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.534+0000 7fc2edffb640 1 --2- 172.21.15.133:0/3832891248 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2dc066470 0x7fc2dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:56.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.534+0000 7fc2edffb640 1 -- 172.21.15.133:0/3832891248 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc2e811df40 con 0x7fc2f806e0b0 2023-12-19T18:59:56.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.534+0000 7fc2fd436640 1 --2- 172.21.15.133:0/3832891248 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2dc066470 0x7fc2dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:56.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.534+0000 7fc2fd436640 1 --2- 172.21.15.133:0/3832891248 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2dc066470 0x7fc2dc068930 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4007fd0 tx=0x7fc2f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:56.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.538+0000 7fc2edffb640 1 -- 172.21.15.133:0/3832891248 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc2e80eb050 con 0x7fc2f806e0b0 2023-12-19T18:59:56.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.682+0000 7fc2fe438640 1 -- 172.21.15.133:0/3832891248 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fc2f806dad0 con 0x7fc2f806e0b0 2023-12-19T18:59:56.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.686+0000 7fc2edffb640 1 -- 172.21.15.133:0/3832891248 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v35) v1 ==== 101+0+11 (secure 0 0 0) 0x7fc2e80ee670 con 0x7fc2f806e0b0 2023-12-19T18:59:56.687 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T18:59:56.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.686+0000 7fc2fe438640 1 -- 172.21.15.133:0/3832891248 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2dc066470 msgr2=0x7fc2dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:56.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.686+0000 7fc2fe438640 1 --2- 172.21.15.133:0/3832891248 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2dc066470 0x7fc2dc068930 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4007fd0 tx=0x7fc2f4009040 comp rx=0 tx=0).stop 2023-12-19T18:59:56.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.686+0000 7fc2fe438640 1 -- 172.21.15.133:0/3832891248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2f806e0b0 msgr2=0x7fc2f80ab5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:56.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.686+0000 7fc2fe438640 1 --2- 172.21.15.133:0/3832891248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2f806e0b0 0x7fc2f80ab5f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc2e80ae040 tx=0x7fc2e80191c0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.686+0000 7fc2fe438640 1 -- 172.21.15.133:0/3832891248 shutdown_connections 2023-12-19T18:59:56.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.686+0000 7fc2fe438640 1 --2- 172.21.15.133:0/3832891248 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2dc066470 0x7fc2dc068930 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.686+0000 7fc2fe438640 1 --2- 172.21.15.133:0/3832891248 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2f8155dd0 0x7fc2f81f4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.686+0000 7fc2fe438640 1 --2- 172.21.15.133:0/3832891248 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2f806e0b0 0x7fc2f80ab5f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.686+0000 7fc2fe438640 1 --2- 172.21.15.133:0/3832891248 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2f806c980 0x7fc2f8154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.686+0000 7fc2fe438640 1 -- 172.21.15.133:0/3832891248 >> 172.21.15.133:0/3832891248 conn(0x7fc2f80a7800 msgr2=0x7fc2f80714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:56.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.686+0000 7fc2fe438640 1 -- 172.21.15.133:0/3832891248 shutdown_connections 2023-12-19T18:59:56.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.686+0000 7fc2fe438640 1 -- 172.21.15.133:0/3832891248 wait complete. 2023-12-19T18:59:56.709 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T18:59:56.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.846+0000 7f27f4479640 1 Processor -- start 2023-12-19T18:59:56.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.846+0000 7f27f4479640 1 -- start start 2023-12-19T18:59:56.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.846+0000 7f27f4479640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f27ec0c5260 0x7f27ec06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:56.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.846+0000 7f27f4479640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f27ec0c5640 0x7f27ec0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:56.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.846+0000 7f27f4479640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ec0c2580 con 0x7f27ec0c60f0 2023-12-19T18:59:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.846+0000 7f27f4479640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27ec153510 con 0x7f27ec0c5260 2023-12-19T18:59:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.846+0000 7f27f4479640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec0c17f0 con 0x7f27ec0c5640 2023-12-19T18:59:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.846+0000 7f27f2215640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f27ec0c5260 0x7f27ec06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.846+0000 7f27f2215640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f27ec0c5260 0x7f27ec06d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58666/0 (socket says 172.21.15.133:58666) 2023-12-19T18:59:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.846+0000 7f27f2215640 1 -- 172.21.15.133:0/2949769506 learned_addr learned my addr 172.21.15.133:0/2949769506 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.846+0000 7f27f2a16640 1 --1- 172.21.15.133:0/2949769506 >> v1:172.21.15.133:6789/0 conn(0x7f27ec0c60f0 0x7f27ec155de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41392/0 (socket says 172.21.15.133:41392) 2023-12-19T18:59:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.846+0000 7f27f1a14640 1 --2- 172.21.15.133:0/2949769506 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f27ec0c5640 0x7f27ec0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.846+0000 7f27f2215640 1 -- 172.21.15.133:0/2949769506 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f27ec0c5640 msgr2=0x7f27ec0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.846+0000 7f27f2215640 1 --2- 172.21.15.133:0/2949769506 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f27ec0c5640 0x7f27ec0c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.846+0000 7f27f2215640 1 -- 172.21.15.133:0/2949769506 >> v1:172.21.15.133:6789/0 conn(0x7f27ec0c60f0 legacy=0x7f27ec155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.846+0000 7f27f2215640 1 -- 172.21.15.133:0/2949769506 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec0c1a00 con 0x7f27ec0c5260 2023-12-19T18:59:56.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.846+0000 7f27f1a14640 1 --2- 172.21.15.133:0/2949769506 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f27ec0c5640 0x7f27ec0c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:56.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.850+0000 7f27f2215640 1 --2- 172.21.15.133:0/2949769506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27ec0c5260 0x7f27ec06d5b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f27ec0c1930 tx=0x7f27e801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca3cefd7a46e2fd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:56.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.850+0000 7f27f1213640 1 -- 172.21.15.133:0/2949769506 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e80ab600 con 0x7f27ec0c5260 2023-12-19T18:59:56.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.850+0000 7f27f1213640 1 -- 172.21.15.133:0/2949769506 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e80a7050 con 0x7f27ec0c5260 2023-12-19T18:59:56.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.850+0000 7f27f1213640 1 -- 172.21.15.133:0/2949769506 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e80ab980 con 0x7f27ec0c5260 2023-12-19T18:59:56.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.850+0000 7f27f4479640 1 -- 172.21.15.133:0/2949769506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27ec0c5260 msgr2=0x7f27ec06d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:56.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.850+0000 7f27f4479640 1 --2- 172.21.15.133:0/2949769506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27ec0c5260 0x7f27ec06d5b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f27ec0c1930 tx=0x7f27e801c460 comp rx=0 tx=0).stop 2023-12-19T18:59:56.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.850+0000 7f27f4479640 1 -- 172.21.15.133:0/2949769506 shutdown_connections 2023-12-19T18:59:56.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.850+0000 7f27f4479640 1 --2- 172.21.15.133:0/2949769506 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f27ec0c5640 0x7f27ec0c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.850+0000 7f27f4479640 1 --2- 172.21.15.133:0/2949769506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27ec0c5260 0x7f27ec06d5b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.850+0000 7f27f4479640 1 -- 172.21.15.133:0/2949769506 >> 172.21.15.133:0/2949769506 conn(0x7f27ec06a5b0 msgr2=0x7f27ec06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:56.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.850+0000 7f27f4479640 1 -- 172.21.15.133:0/2949769506 shutdown_connections 2023-12-19T18:59:56.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.850+0000 7f27f4479640 1 -- 172.21.15.133:0/2949769506 wait complete. 2023-12-19T18:59:56.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27f4479640 1 Processor -- start 2023-12-19T18:59:56.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27f4479640 1 -- start start 2023-12-19T18:59:56.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27f4479640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27ec0c5260 0x7f27ec0a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:56.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27f4479640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27ec0c5640 0x7f27ec14ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:56.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27f4479640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f27ec0c60f0 0x7f27ec14f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:56.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27f4479640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec0aaef0 con 0x7f27ec0c5640 2023-12-19T18:59:56.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27f4479640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec157780 con 0x7f27ec0c5260 2023-12-19T18:59:56.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27f4479640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec14f990 con 0x7f27ec0c60f0 2023-12-19T18:59:56.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27f1a14640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27ec0c5640 0x7f27ec14ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:56.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27f1a14640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27ec0c5640 0x7f27ec14ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58670/0 (socket says 172.21.15.133:58670) 2023-12-19T18:59:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27f1a14640 1 -- 172.21.15.133:0/1488156238 learned_addr learned my addr 172.21.15.133:0/1488156238 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27f2215640 1 --2- 172.21.15.133:0/1488156238 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27ec0c5260 0x7f27ec0a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27f2a16640 1 --2- 172.21.15.133:0/1488156238 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f27ec0c60f0 0x7f27ec14f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27f1a14640 1 -- 172.21.15.133:0/1488156238 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f27ec0c60f0 msgr2=0x7f27ec14f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27f1a14640 1 --2- 172.21.15.133:0/1488156238 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f27ec0c60f0 0x7f27ec14f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27f1a14640 1 -- 172.21.15.133:0/1488156238 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27ec0c5260 msgr2=0x7f27ec0a9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27f1a14640 1 --2- 172.21.15.133:0/1488156238 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27ec0c5260 0x7f27ec0a9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27f1a14640 1 -- 172.21.15.133:0/1488156238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e80094d0 con 0x7f27ec0c5640 2023-12-19T18:59:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27f2a16640 1 --2- 172.21.15.133:0/1488156238 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f27ec0c60f0 0x7f27ec14f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27f1a14640 1 --2- 172.21.15.133:0/1488156238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27ec0c5640 0x7f27ec14ef10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f27dc00d800 tx=0x7f27dc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27e2ffd640 1 -- 172.21.15.133:0/1488156238 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc0096a0 con 0x7f27ec0c5640 2023-12-19T18:59:56.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27e2ffd640 1 -- 172.21.15.133:0/1488156238 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27dc009800 con 0x7f27ec0c5640 2023-12-19T18:59:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27e2ffd640 1 -- 172.21.15.133:0/1488156238 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27dc009bb0 con 0x7f27ec0c5640 2023-12-19T18:59:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27f4479640 1 -- 172.21.15.133:0/1488156238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27ec15c5f0 con 0x7f27ec0c5640 2023-12-19T18:59:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.854+0000 7f27f4479640 1 -- 172.21.15.133:0/1488156238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ec0aa6f0 con 0x7f27ec0c5640 2023-12-19T18:59:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.858+0000 7f27f4479640 1 -- 172.21.15.133:0/1488156238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27ec068400 con 0x7f27ec0c5640 2023-12-19T18:59:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.858+0000 7f27e2ffd640 1 -- 172.21.15.133:0/1488156238 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f27dc009d10 con 0x7f27ec0c5640 2023-12-19T18:59:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.858+0000 7f27e2ffd640 1 --2- 172.21.15.133:0/1488156238 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f27d0066470 0x7f27d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.858+0000 7f27e2ffd640 1 -- 172.21.15.133:0/1488156238 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f27dc084610 con 0x7f27ec0c5640 2023-12-19T18:59:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.858+0000 7f27f2215640 1 --2- 172.21.15.133:0/1488156238 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f27d0066470 0x7f27d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:56.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.858+0000 7f27f2215640 1 --2- 172.21.15.133:0/1488156238 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f27d0066470 0x7f27d0068930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f27e80ad000 tx=0x7f27e80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:56.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:56.862+0000 7f27e2ffd640 1 -- 172.21.15.133:0/1488156238 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f27dc051720 con 0x7f27ec0c5640 2023-12-19T18:59:57.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.026+0000 7f27f4479640 1 -- 172.21.15.133:0/1488156238 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f27ec0722c0 con 0x7f27ec0c5640 2023-12-19T18:59:57.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.026+0000 7f27e2ffd640 1 -- 172.21.15.133:0/1488156238 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) v1 ==== 80+0+0 (secure 0 0 0) 0x7f27dc054d40 con 0x7f27ec0c5640 2023-12-19T18:59:57.028 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-19T18:59:57.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.026+0000 7f27f4479640 1 -- 172.21.15.133:0/1488156238 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f27d0066470 msgr2=0x7f27d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:57.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.026+0000 7f27f4479640 1 --2- 172.21.15.133:0/1488156238 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f27d0066470 0x7f27d0068930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f27e80ad000 tx=0x7f27e80a6000 comp rx=0 tx=0).stop 2023-12-19T18:59:57.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.026+0000 7f27f4479640 1 -- 172.21.15.133:0/1488156238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27ec0c5640 msgr2=0x7f27ec14ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:57.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.026+0000 7f27f4479640 1 --2- 172.21.15.133:0/1488156238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27ec0c5640 0x7f27ec14ef10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f27dc00d800 tx=0x7f27dc00dcc0 comp rx=0 tx=0).stop 2023-12-19T18:59:57.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.026+0000 7f27f4479640 1 -- 172.21.15.133:0/1488156238 shutdown_connections 2023-12-19T18:59:57.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.026+0000 7f27f4479640 1 --2- 172.21.15.133:0/1488156238 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f27d0066470 0x7f27d0068930 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:57.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.026+0000 7f27f4479640 1 --2- 172.21.15.133:0/1488156238 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f27ec0c60f0 0x7f27ec14f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:57.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.026+0000 7f27f4479640 1 --2- 172.21.15.133:0/1488156238 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27ec0c5640 0x7f27ec14ef10 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:57.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.026+0000 7f27f4479640 1 --2- 172.21.15.133:0/1488156238 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f27ec0c5260 0x7f27ec0a9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:57.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.026+0000 7f27f4479640 1 -- 172.21.15.133:0/1488156238 >> 172.21.15.133:0/1488156238 conn(0x7f27ec06a5b0 msgr2=0x7f27ec151980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:57.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.026+0000 7f27f4479640 1 -- 172.21.15.133:0/1488156238 shutdown_connections 2023-12-19T18:59:57.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.026+0000 7f27f4479640 1 -- 172.21.15.133:0/1488156238 wait complete. 2023-12-19T18:59:57.048 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T18:59:57.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:57.049 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T18:59:57.076 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-19T18:59:57.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:57.076 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T18:59:57.128 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:59:57.128 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:59:57.179 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3517 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-19T18:59:57.179 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T18:59:57.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.358+0000 7fd2dd37d640 1 Processor -- start 2023-12-19T18:59:57.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.358+0000 7fd2dd37d640 1 -- start start 2023-12-19T18:59:57.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.358+0000 7fd2dd37d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2d80c2580 0x7fd2d8155950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:57.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.358+0000 7fd2dd37d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d80a76e0 con 0x7fd2d80c5ac0 2023-12-19T18:59:57.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.358+0000 7fd2dd37d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d80c2df0 con 0x7fd2d80c2960 2023-12-19T18:59:57.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.358+0000 7fd2dd37d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80c3540 con 0x7fd2d80c2580 2023-12-19T18:59:57.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.358+0000 7fd2d77fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd2d80c5ac0 0x7fd2d8154df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41396/0 (socket says 172.21.15.133:41396) 2023-12-19T18:59:57.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.358+0000 7fd2d77fe640 1 -- 172.21.15.133:0/2946388811 learned_addr learned my addr 172.21.15.133:0/2946388811 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:57.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.358+0000 7fd2d7fff640 1 --2- 172.21.15.133:0/2946388811 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2d80c2580 0x7fd2d8155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:57.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.358+0000 7fd2d6ffd640 1 -- 172.21.15.133:0/2946388811 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3026570482 0 0) 0x7fd2d80a76e0 con 0x7fd2d80c5ac0 2023-12-19T18:59:57.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.358+0000 7fd2d6ffd640 1 -- 172.21.15.133:0/2946388811 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2c0003530 con 0x7fd2d80c5ac0 2023-12-19T18:59:57.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.358+0000 7fd2d6ffd640 1 -- 172.21.15.133:0/2946388811 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571152637 0 0) 0x7fd2d00014a0 con 0x7fd2d80c2960 2023-12-19T18:59:57.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.358+0000 7fd2d7fff640 1 -- 172.21.15.133:0/2946388811 >> v1:172.21.15.138:6789/0 conn(0x7fd2d80c2960 legacy=0x7fd2d815eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:57.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.358+0000 7fd2d7fff640 1 -- 172.21.15.133:0/2946388811 >> v1:172.21.15.133:6789/0 conn(0x7fd2d80c5ac0 legacy=0x7fd2d8154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:57.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.358+0000 7fd2d7fff640 1 -- 172.21.15.133:0/2946388811 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d8158590 con 0x7fd2d80c2580 2023-12-19T18:59:57.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.362+0000 7fd2d7fff640 1 --2- 172.21.15.133:0/2946388811 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2d80c2580 0x7fd2d8155950 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80097f0 tx=0x7fd2c801c1b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee46e34526cdc77e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:57.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.362+0000 7fd2d6ffd640 1 -- 172.21.15.133:0/2946388811 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc001680 con 0x7fd2d80c2580 2023-12-19T18:59:57.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.362+0000 7fd2d6ffd640 1 -- 172.21.15.133:0/2946388811 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c80a7050 con 0x7fd2d80c2580 2023-12-19T18:59:57.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.362+0000 7fd2d6ffd640 1 -- 172.21.15.133:0/2946388811 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c80ab400 con 0x7fd2d80c2580 2023-12-19T18:59:57.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.362+0000 7fd2dd37d640 1 -- 172.21.15.133:0/2946388811 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2d80c2580 msgr2=0x7fd2d8155950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:57.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.362+0000 7fd2dd37d640 1 --2- 172.21.15.133:0/2946388811 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2d80c2580 0x7fd2d8155950 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80097f0 tx=0x7fd2c801c1b0 comp rx=0 tx=0).stop 2023-12-19T18:59:57.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.362+0000 7fd2dd37d640 1 -- 172.21.15.133:0/2946388811 shutdown_connections 2023-12-19T18:59:57.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.362+0000 7fd2dd37d640 1 --2- 172.21.15.133:0/2946388811 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2d80c2580 0x7fd2d8155950 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:57.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.362+0000 7fd2dd37d640 1 -- 172.21.15.133:0/2946388811 >> 172.21.15.133:0/2946388811 conn(0x7fd2d80a9930 msgr2=0x7fd2d80a9d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:57.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.362+0000 7fd2dd37d640 1 -- 172.21.15.133:0/2946388811 shutdown_connections 2023-12-19T18:59:57.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.362+0000 7fd2dd37d640 1 -- 172.21.15.133:0/2946388811 wait complete. 2023-12-19T18:59:57.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2dd37d640 1 Processor -- start 2023-12-19T18:59:57.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2dd37d640 1 -- start start 2023-12-19T18:59:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2dd37d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2d80c2580 0x7fd2d806ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2dd37d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2d80c2960 0x7fd2d8145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2dd37d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2d80c5ac0 0x7fd2d81463e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2dd37d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d8155500 con 0x7fd2d80c2960 2023-12-19T18:59:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2dd37d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80a7300 con 0x7fd2d80c2580 2023-12-19T18:59:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2dd37d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d80a74e0 con 0x7fd2d80c5ac0 2023-12-19T18:59:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2d77fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2d80c2960 0x7fd2d8145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2d77fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2d80c2960 0x7fd2d8145ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58674/0 (socket says 172.21.15.133:58674) 2023-12-19T18:59:57.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2d77fe640 1 -- 172.21.15.133:0/3871168449 learned_addr learned my addr 172.21.15.133:0/3871168449 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2d7fff640 1 --2- 172.21.15.133:0/3871168449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2d80c2580 0x7fd2d806ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2dcb7c640 1 --2- 172.21.15.133:0/3871168449 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2d80c5ac0 0x7fd2d81463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2d77fe640 1 -- 172.21.15.133:0/3871168449 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2d80c5ac0 msgr2=0x7fd2d81463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2d77fe640 1 --2- 172.21.15.133:0/3871168449 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2d80c5ac0 0x7fd2d81463e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2d77fe640 1 -- 172.21.15.133:0/3871168449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2d80c2580 msgr2=0x7fd2d806ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2d77fe640 1 --2- 172.21.15.133:0/3871168449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2d80c2580 0x7fd2d806ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2d77fe640 1 -- 172.21.15.133:0/3871168449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c8009420 con 0x7fd2d80c2960 2023-12-19T18:59:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2d7fff640 1 --2- 172.21.15.133:0/3871168449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2d80c2580 0x7fd2d806ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2dcb7c640 1 --2- 172.21.15.133:0/3871168449 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2d80c5ac0 0x7fd2d81463e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:59:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2d77fe640 1 --2- 172.21.15.133:0/3871168449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2d80c2960 0x7fd2d8145ea0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00c730 tx=0x7fd2cc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:57.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2d4ff9640 1 -- 172.21.15.133:0/3871168449 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc0074e0 con 0x7fd2d80c2960 2023-12-19T18:59:57.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2d4ff9640 1 -- 172.21.15.133:0/3871168449 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2cc007660 con 0x7fd2d80c2960 2023-12-19T18:59:57.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2d4ff9640 1 -- 172.21.15.133:0/3871168449 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2cc004a30 con 0x7fd2d80c2960 2023-12-19T18:59:57.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2dd37d640 1 -- 172.21.15.133:0/3871168449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d806f990 con 0x7fd2d80c2960 2023-12-19T18:59:57.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2dd37d640 1 -- 172.21.15.133:0/3871168449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d81456a0 con 0x7fd2d80c2960 2023-12-19T18:59:57.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.366+0000 7fd2dd37d640 1 -- 172.21.15.133:0/3871168449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d8067a00 con 0x7fd2d80c2960 2023-12-19T18:59:57.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.370+0000 7fd2d4ff9640 1 -- 172.21.15.133:0/3871168449 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd2cc004b90 con 0x7fd2d80c2960 2023-12-19T18:59:57.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.370+0000 7fd2d4ff9640 1 --2- 172.21.15.133:0/3871168449 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd2c4066470 0x7fd2c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:57.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.370+0000 7fd2d4ff9640 1 -- 172.21.15.133:0/3871168449 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd2cc083830 con 0x7fd2d80c2960 2023-12-19T18:59:57.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.370+0000 7fd2d7fff640 1 --2- 172.21.15.133:0/3871168449 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd2c4066470 0x7fd2c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:57.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.370+0000 7fd2d7fff640 1 --2- 172.21.15.133:0/3871168449 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd2c4066470 0x7fd2c4068930 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80ad000 tx=0x7fd2c8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:57.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.374+0000 7fd2d4ff9640 1 -- 172.21.15.133:0/3871168449 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd2cc0508b0 con 0x7fd2d80c2960 2023-12-19T18:59:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.558+0000 7fd2dd37d640 1 -- 172.21.15.133:0/3871168449 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd2d804e850 con 0x7fd2d80c2960 2023-12-19T18:59:57.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.558+0000 7fd2d4ff9640 1 -- 172.21.15.133:0/3871168449 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+149 (secure 0 0 0) 0x7fd2cc018070 con 0x7fd2d80c2960 2023-12-19T18:59:57.560 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T18:59:57.561 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-19T18:59:57.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.558+0000 7fd2dd37d640 1 -- 172.21.15.133:0/3871168449 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd2c4066470 msgr2=0x7fd2c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:57.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.558+0000 7fd2dd37d640 1 --2- 172.21.15.133:0/3871168449 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd2c4066470 0x7fd2c4068930 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd2c80ad000 tx=0x7fd2c8008040 comp rx=0 tx=0).stop 2023-12-19T18:59:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.558+0000 7fd2dd37d640 1 -- 172.21.15.133:0/3871168449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2d80c2960 msgr2=0x7fd2d8145ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.558+0000 7fd2dd37d640 1 --2- 172.21.15.133:0/3871168449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2d80c2960 0x7fd2d8145ea0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc00c730 tx=0x7fd2cc00cbf0 comp rx=0 tx=0).stop 2023-12-19T18:59:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.558+0000 7fd2dd37d640 1 -- 172.21.15.133:0/3871168449 shutdown_connections 2023-12-19T18:59:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.558+0000 7fd2dd37d640 1 --2- 172.21.15.133:0/3871168449 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd2c4066470 0x7fd2c4068930 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.558+0000 7fd2dd37d640 1 --2- 172.21.15.133:0/3871168449 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd2d80c5ac0 0x7fd2d81463e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.558+0000 7fd2dd37d640 1 --2- 172.21.15.133:0/3871168449 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd2d80c2960 0x7fd2d8145ea0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.558+0000 7fd2dd37d640 1 --2- 172.21.15.133:0/3871168449 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd2d80c2580 0x7fd2d806ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.558+0000 7fd2dd37d640 1 -- 172.21.15.133:0/3871168449 >> 172.21.15.133:0/3871168449 conn(0x7fd2d80a9930 msgr2=0x7fd2d80c0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.558+0000 7fd2dd37d640 1 -- 172.21.15.133:0/3871168449 shutdown_connections 2023-12-19T18:59:57.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:57.558+0000 7fd2dd37d640 1 -- 172.21.15.133:0/3871168449 wait complete. 2023-12-19T18:59:57.582 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-19T18:59:57.582 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T18:59:57.582 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-19T18:59:57.582 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-19T18:59:57.582 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T18:59:57.582 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-19T18:59:57.582 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T18:59:57.582 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.D4Kc22dlni 2023-12-19T18:59:57.583 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2023-12-19T18:59:57.591 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.tGQnKIPzIj 2023-12-19T18:59:57.592 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /tmp/tmp.D4Kc22dlni /tmp/tmp.tGQnKIPzIj 2023-12-19T18:59:57.655 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.tGQnKIPzIj 2023-12-19T18:59:57.772 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.tGQnKIPzIj is 185B 2023-12-19T18:59:57.797 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.tGQnKIPzIj 2023-12-19T18:59:57.805 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQAq6IFlcD31HRAAMhO9tRfILfGlrbvh1g8Kbg== caps mds = "allow rw fsname=cephfs" caps mon = "allow r fsname=cephfs" caps osd = "allow rw tag cephfs data=cephfs" 2023-12-19T18:59:57.805 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:59:57.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:57.805 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-19T18:59:57.855 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T18:59:57.855 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T18:59:57.856 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T18:59:57.856 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:57.856 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-19T18:59:57.856 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:57.856 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:59:57.856 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:57.856 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-19T18:59:57.856 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:59:57.856 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:57.856 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-19T18:59:57.856 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:59:57.856 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:57.856 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T18:59:57.856 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T18:59:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42362sec preferred_lft 42362sec 2023-12-19T18:59:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-12-19T18:59:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:57.857 INFO:teuthology.orchestra.run.smithi133.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T18:59:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 02:42:26:2c:b4:18 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T18:59:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:57.857 INFO:teuthology.orchestra.run.smithi133.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T18:59:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T18:59:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T18:59:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-19T18:59:57.857 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:57.858 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T18:59:57.858 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T18:59:57.858 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-19T18:59:57.858 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:59:57.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:57.858 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T18:59:57.918 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-19T18:59:57.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:57.920 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-19T18:59:57.973 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-19T18:59:57.974 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T18:59:57.974 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T18:59:57.974 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T18:59:57.974 INFO:teuthology.orchestra.run.smithi133.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T18:59:57.974 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T18:59:57.974 INFO:teuthology.orchestra.run.smithi133.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T18:59:57.974 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T18:59:57.974 INFO:teuthology.orchestra.run.smithi133.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T18:59:57.974 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T18:59:57.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:57.975 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-19T18:59:57.975 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-19T18:59:57.975 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T18:59:57.975 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T18:59:57.975 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T18:59:57.975 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-19T18:59:58.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:58.066 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-19T18:59:58.075 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T18:59:58.075 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:59:58.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:58.075 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-19T18:59:58.142 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:59:58.142 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T18:59:58.195 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:59:58.195 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:59:58.195 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T18:59:58.250 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:59:58.250 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/tmp/tmp.D4Kc22dlni of=/dev/stdout 2023-12-19T18:59:58.302 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-12-19T18:59:58.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:59:58.302 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQAq6IFlcD31HRAAMhO9tRfILfGlrbvh1g8Kbg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T18:59:58.393 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,secret=AQAq6IFlcD31HRAAMhO9tRfILfGlrbvh1g8Kbg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T18:59:58.393 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T18:59:58.393 INFO:teuthology.orchestra.run.smithi133.stdout:keyring.get_secret failed 2023-12-19T18:59:58.402 INFO:teuthology.orchestra.run.smithi133.stderr:mount.ceph: kernel BUG! 2023-12-19T18:59:58.402 INFO:teuthology.orchestra.run.smithi133.stderr:mount error: no mds server is up or the cluster is laggy 2023-12-19T18:59:58.403 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,secret=AQAq6IFlcD31HRAAMhO9tRfILfGlrbvh1g8Kbg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T18:59:58.404 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T18:59:58.404 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-12-19T18:59:58.404 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: testuser@03e63958-005e-4bf2-ae5b-291aceb6fbbf.cephfs2=/ 2023-12-19T18:59:58.404 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.133:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-12-19T18:59:58.407 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T18:59:58.407 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-12-19T18:59:58.408 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T18:59:58.408 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T18:59:58.466 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T18:59:58.554 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T18:59:58.554 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T18:59:58.554 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:59:58.563 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3517 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-19T18:59:58.563 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:59:58.564 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:59:58.573 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T18:59:58.573 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:59:58.624 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:59:58.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.758+0000 7f8378b57640 1 Processor -- start 2023-12-19T18:59:58.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.758+0000 7f8378b57640 1 -- start start 2023-12-19T18:59:58.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.758+0000 7f8378b57640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83740c4100 0x7f83740c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:58.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.758+0000 7f8378b57640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83740c31c0 con 0x7f83740c63c0 2023-12-19T18:59:58.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.758+0000 7f8378b57640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83740c34a0 con 0x7f83740c06d0 2023-12-19T18:59:58.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.758+0000 7f8378b57640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83740c1030 con 0x7f83740c4100 2023-12-19T18:59:58.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.758+0000 7f837259c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f83740c63c0 0x7f83740c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41408/0 (socket says 172.21.15.133:41408) 2023-12-19T18:59:58.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.758+0000 7f837259c640 1 -- 172.21.15.133:0/1263344905 learned_addr learned my addr 172.21.15.133:0/1263344905 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:58.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.758+0000 7f8371d9b640 1 --2- 172.21.15.133:0/1263344905 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83740c4100 0x7f83740c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:58.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.758+0000 7f837159a640 1 -- 172.21.15.133:0/1263344905 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959070817 0 0) 0x7f83740c31c0 con 0x7f83740c63c0 2023-12-19T18:59:58.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f837159a640 1 -- 172.21.15.133:0/1263344905 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f835c003530 con 0x7f83740c63c0 2023-12-19T18:59:58.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f837159a640 1 -- 172.21.15.133:0/1263344905 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654256773 0 0) 0x7f83740c34a0 con 0x7f83740c06d0 2023-12-19T18:59:58.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f837159a640 1 -- 172.21.15.133:0/1263344905 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83740c31c0 con 0x7f83740c06d0 2023-12-19T18:59:58.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f837159a640 1 -- 172.21.15.133:0/1263344905 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1144727905 0 0) 0x7f835c003530 con 0x7f83740c63c0 2023-12-19T18:59:58.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f837159a640 1 -- 172.21.15.133:0/1263344905 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83740c4100 msgr2=0x7f83740c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:58.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f837159a640 1 --2- 172.21.15.133:0/1263344905 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83740c4100 0x7f83740c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:58.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f837159a640 1 -- 172.21.15.133:0/1263344905 >> v1:172.21.15.138:6789/0 conn(0x7f83740c06d0 legacy=0x7f83740a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:58.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f837159a640 1 -- 172.21.15.133:0/1263344905 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83740c1310 con 0x7f83740c63c0 2023-12-19T18:59:58.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f837159a640 1 -- 172.21.15.133:0/1263344905 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f8364001680 con 0x7f83740c63c0 2023-12-19T18:59:58.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f837159a640 1 -- 172.21.15.133:0/1263344905 >> v1:172.21.15.133:6789/0 conn(0x7f83740c63c0 legacy=0x7f83740c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:58.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f837159a640 1 --2- 172.21.15.133:0/1263344905 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f835c003b40 0x7f835c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:58.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f837159a640 1 --2- 172.21.15.133:0/1263344905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f835c0047d0 0x7f835c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:58.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f837159a640 1 --2- 172.21.15.133:0/1263344905 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83740c4100 0x7f835c005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:58.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f837159a640 1 -- 172.21.15.133:0/1263344905 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83740c1030 con 0x7f835c0047d0 2023-12-19T18:59:58.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f837159a640 1 -- 172.21.15.133:0/1263344905 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835c00dda0 con 0x7f835c003b40 2023-12-19T18:59:58.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f837159a640 1 -- 172.21.15.133:0/1263344905 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f835c00df60 con 0x7f83740c4100 2023-12-19T18:59:58.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f8371d9b640 1 --2- 172.21.15.133:0/1263344905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f835c0047d0 0x7f835c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:58.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f837259c640 1 --2- 172.21.15.133:0/1263344905 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f835c003b40 0x7f835c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:58.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f8372d9d640 1 --2- 172.21.15.133:0/1263344905 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83740c4100 0x7f835c005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:58.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f8371d9b640 1 -- 172.21.15.133:0/1263344905 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83740c4100 msgr2=0x7f835c005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:58.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f8371d9b640 1 --2- 172.21.15.133:0/1263344905 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f83740c4100 0x7f835c005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:58.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f8371d9b640 1 -- 172.21.15.133:0/1263344905 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f835c003b40 msgr2=0x7f835c003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:58.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f8371d9b640 1 --2- 172.21.15.133:0/1263344905 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f835c003b40 0x7f835c003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:58.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f8371d9b640 1 -- 172.21.15.133:0/1263344905 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c003530 con 0x7f835c0047d0 2023-12-19T18:59:58.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.762+0000 7f8371d9b640 1 --2- 172.21.15.133:0/1263344905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f835c0047d0 0x7f835c004c50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8368009ab0 tx=0x7f836801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4185113e884b415f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:58.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.766+0000 7f837159a640 1 -- 172.21.15.133:0/1263344905 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83680a9410 con 0x7f835c0047d0 2023-12-19T18:59:58.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.766+0000 7f837159a640 1 -- 172.21.15.133:0/1263344905 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83680a9570 con 0x7f835c0047d0 2023-12-19T18:59:58.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.766+0000 7f837159a640 1 -- 172.21.15.133:0/1263344905 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83680a98e0 con 0x7f835c0047d0 2023-12-19T18:59:58.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.766+0000 7f8378b57640 1 -- 172.21.15.133:0/1263344905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f835c0047d0 msgr2=0x7f835c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:58.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.766+0000 7f8378b57640 1 --2- 172.21.15.133:0/1263344905 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f835c0047d0 0x7f835c004c50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8368009ab0 tx=0x7f836801ca30 comp rx=0 tx=0).stop 2023-12-19T18:59:58.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.766+0000 7f8372d9d640 1 -- 172.21.15.133:0/1263344905 reap_dead start 2023-12-19T18:59:58.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.766+0000 7f8378b57640 1 -- 172.21.15.133:0/1263344905 shutdown_connections 2023-12-19T18:59:58.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.766+0000 7f8378b57640 1 -- 172.21.15.133:0/1263344905 >> 172.21.15.133:0/1263344905 conn(0x7f837406a5b0 msgr2=0x7f837406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:58.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.766+0000 7f8378b57640 1 -- 172.21.15.133:0/1263344905 shutdown_connections 2023-12-19T18:59:58.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.766+0000 7f8378b57640 1 -- 172.21.15.133:0/1263344905 wait complete. 2023-12-19T18:59:58.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.766+0000 7f8378b57640 1 Processor -- start 2023-12-19T18:59:58.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.766+0000 7f8378b57640 1 -- start start 2023-12-19T18:59:58.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.766+0000 7f8378b57640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f835c0047d0 0x7f8374154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:58.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.766+0000 7f8378b57640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f837414fc40 0x7f83740a6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:58.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.766+0000 7f8378b57640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f837406fe50 0x7f83740a72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:58.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.766+0000 7f8378b57640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837414f710 con 0x7f837414fc40 2023-12-19T18:59:58.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.766+0000 7f8378b57640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83740a7820 con 0x7f837406fe50 2023-12-19T18:59:58.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.766+0000 7f8378b57640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837414f960 con 0x7f835c0047d0 2023-12-19T18:59:58.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.766+0000 7f8371d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f837414fc40 0x7f83740a6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:58.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.766+0000 7f8371d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f837414fc40 0x7f83740a6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58698/0 (socket says 172.21.15.133:58698) 2023-12-19T18:59:58.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.766+0000 7f8371d9b640 1 -- 172.21.15.133:0/971407169 learned_addr learned my addr 172.21.15.133:0/971407169 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:58.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.770+0000 7f8372d9d640 1 --2- 172.21.15.133:0/971407169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f837406fe50 0x7f83740a72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:58.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.770+0000 7f837259c640 1 --2- 172.21.15.133:0/971407169 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f835c0047d0 0x7f8374154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:58.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.770+0000 7f8371d9b640 1 -- 172.21.15.133:0/971407169 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f835c0047d0 msgr2=0x7f8374154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:58.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.770+0000 7f8371d9b640 1 --2- 172.21.15.133:0/971407169 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f835c0047d0 0x7f8374154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:58.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.770+0000 7f8371d9b640 1 -- 172.21.15.133:0/971407169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f837406fe50 msgr2=0x7f83740a72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:58.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.770+0000 7f8371d9b640 1 --2- 172.21.15.133:0/971407169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f837406fe50 0x7f83740a72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:58.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.770+0000 7f8371d9b640 1 -- 172.21.15.133:0/971407169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83740c69b0 con 0x7f837414fc40 2023-12-19T18:59:58.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.770+0000 7f8371d9b640 1 --2- 172.21.15.133:0/971407169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f837414fc40 0x7f83740a6da0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8368009ab0 tx=0x7f835c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:58.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.770+0000 7f8362ffd640 1 -- 172.21.15.133:0/971407169 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83680b6070 con 0x7f837414fc40 2023-12-19T18:59:58.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.770+0000 7f8362ffd640 1 -- 172.21.15.133:0/971407169 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836800f000 con 0x7f837414fc40 2023-12-19T18:59:58.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.770+0000 7f8378b57640 1 -- 172.21.15.133:0/971407169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83741e32f0 con 0x7f837414fc40 2023-12-19T18:59:58.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.770+0000 7f8362ffd640 1 -- 172.21.15.133:0/971407169 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83680ba3f0 con 0x7f837414fc40 2023-12-19T18:59:58.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.770+0000 7f8378b57640 1 -- 172.21.15.133:0/971407169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83741e38b0 con 0x7f837414fc40 2023-12-19T18:59:58.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.770+0000 7f8378b57640 1 -- 172.21.15.133:0/971407169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83741564c0 con 0x7f837414fc40 2023-12-19T18:59:58.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.770+0000 7f8362ffd640 1 -- 172.21.15.133:0/971407169 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f83680ba550 con 0x7f837414fc40 2023-12-19T18:59:58.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.770+0000 7f8362ffd640 1 --2- 172.21.15.133:0/971407169 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8354066470 0x7f8354068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:58.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.770+0000 7f8362ffd640 1 -- 172.21.15.133:0/971407169 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f836811e5d0 con 0x7f837414fc40 2023-12-19T18:59:58.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.774+0000 7f837259c640 1 --2- 172.21.15.133:0/971407169 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8354066470 0x7f8354068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:58.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.774+0000 7f837259c640 1 --2- 172.21.15.133:0/971407169 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8354066470 0x7f8354068930 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8374072200 tx=0x7f8364001050 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:58.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.778+0000 7f8362ffd640 1 -- 172.21.15.133:0/971407169 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f83680eb8b0 con 0x7f837414fc40 2023-12-19T18:59:58.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.934+0000 7f8378b57640 1 -- 172.21.15.133:0/971407169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8374068400 con 0x7f837414fc40 2023-12-19T18:59:58.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.934+0000 7f8362ffd640 1 -- 172.21.15.133:0/971407169 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20265 (secure 0 0 0) 0x7f83680eeed0 con 0x7f837414fc40 2023-12-19T18:59:58.938 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T18:59:58.938 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":35,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:59:46.667472+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:59:25.798150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T18:59:26.236078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T18:59:42.757628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-19T18:59:44.017454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:59:58.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.938+0000 7f8378b57640 1 -- 172.21.15.133:0/971407169 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8354066470 msgr2=0x7f8354068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:58.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.938+0000 7f8378b57640 1 --2- 172.21.15.133:0/971407169 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8354066470 0x7f8354068930 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8374072200 tx=0x7f8364001050 comp rx=0 tx=0).stop 2023-12-19T18:59:58.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.938+0000 7f8378b57640 1 -- 172.21.15.133:0/971407169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f837414fc40 msgr2=0x7f83740a6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:58.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.938+0000 7f8378b57640 1 --2- 172.21.15.133:0/971407169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f837414fc40 0x7f83740a6da0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8368009ab0 tx=0x7f835c005800 comp rx=0 tx=0).stop 2023-12-19T18:59:58.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.938+0000 7f8378b57640 1 -- 172.21.15.133:0/971407169 shutdown_connections 2023-12-19T18:59:58.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.938+0000 7f8378b57640 1 --2- 172.21.15.133:0/971407169 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8354066470 0x7f8354068930 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:58.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.938+0000 7f8378b57640 1 --2- 172.21.15.133:0/971407169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f837406fe50 0x7f83740a72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:58.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.938+0000 7f8378b57640 1 --2- 172.21.15.133:0/971407169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f837414fc40 0x7f83740a6da0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:58.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.938+0000 7f8378b57640 1 --2- 172.21.15.133:0/971407169 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f835c0047d0 0x7f8374154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:58.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.938+0000 7f8378b57640 1 -- 172.21.15.133:0/971407169 >> 172.21.15.133:0/971407169 conn(0x7f837406a5b0 msgr2=0x7f8374155db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:58.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.938+0000 7f8378b57640 1 -- 172.21.15.133:0/971407169 shutdown_connections 2023-12-19T18:59:58.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:58.938+0000 7f8378b57640 1 -- 172.21.15.133:0/971407169 wait complete. 2023-12-19T18:59:58.959 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:59:25.798150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:59:26.236078+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-19T18:59:42.757628+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-19T18:59:44.017454+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:59:58.960 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:59:59.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.098+0000 7fa98359e640 1 Processor -- start 2023-12-19T18:59:59.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.098+0000 7fa98359e640 1 -- start start 2023-12-19T18:59:59.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.098+0000 7fa98359e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa984154be0 0x7fa98415fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:59.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.098+0000 7fa98359e640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9840c8160 con 0x7fa984151cd0 2023-12-19T18:59:59.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.098+0000 7fa98359e640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa984157b40 con 0x7fa9840c7c50 2023-12-19T18:59:59.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.098+0000 7fa98359e640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa984157e20 con 0x7fa984154be0 2023-12-19T18:59:59.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.098+0000 7fa98259c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa984151cd0 0x7fa9840ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41422/0 (socket says 172.21.15.133:41422) 2023-12-19T18:59:59.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.098+0000 7fa98259c640 1 -- 172.21.15.133:0/215857217 learned_addr learned my addr 172.21.15.133:0/215857217 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:59.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.098+0000 7fa982d9d640 1 --2- 172.21.15.133:0/215857217 >> v2:172.21.15.133:3300/0 conn(0x7fa984154be0 0x7fa98415fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:59.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.098+0000 7fa982d9d640 1 -- 172.21.15.133:0/215857217 >> v1:172.21.15.138:6789/0 conn(0x7fa9840c7c50 legacy=0x7fa9841544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:59.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.098+0000 7fa982d9d640 1 -- 172.21.15.133:0/215857217 >> v1:172.21.15.133:6789/0 conn(0x7fa984151cd0 legacy=0x7fa9840ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:59.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.098+0000 7fa982d9d640 1 -- 172.21.15.133:0/215857217 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa984158100 con 0x7fa984154be0 2023-12-19T18:59:59.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.098+0000 7fa98159a640 1 -- 172.21.15.133:0/215857217 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886285293 0 0) 0x7fa9840c8160 con 0x7fa984151cd0 2023-12-19T18:59:59.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.102+0000 7fa982d9d640 1 --2- 172.21.15.133:0/215857217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa984154be0 0x7fa98415fe40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009d90 tx=0x7fa97c01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9129c2bbd4badeca server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:59.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.102+0000 7fa98159a640 1 -- 172.21.15.133:0/215857217 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c0a5a00 con 0x7fa984154be0 2023-12-19T18:59:59.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.102+0000 7fa98159a640 1 -- 172.21.15.133:0/215857217 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97c0a5b60 con 0x7fa984154be0 2023-12-19T18:59:59.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.102+0000 7fa98159a640 1 -- 172.21.15.133:0/215857217 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c0ad440 con 0x7fa984154be0 2023-12-19T18:59:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.102+0000 7fa98359e640 1 -- 172.21.15.133:0/215857217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa984154be0 msgr2=0x7fa98415fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.102+0000 7fa98359e640 1 --2- 172.21.15.133:0/215857217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa984154be0 0x7fa98415fe40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009d90 tx=0x7fa97c01c920 comp rx=0 tx=0).stop 2023-12-19T18:59:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.102+0000 7fa98359e640 1 -- 172.21.15.133:0/215857217 shutdown_connections 2023-12-19T18:59:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.102+0000 7fa98359e640 1 --2- 172.21.15.133:0/215857217 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa984154be0 0x7fa98415fe40 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.102+0000 7fa98359e640 1 -- 172.21.15.133:0/215857217 >> 172.21.15.133:0/215857217 conn(0x7fa9840abee0 msgr2=0x7fa9840c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.102+0000 7fa98359e640 1 -- 172.21.15.133:0/215857217 shutdown_connections 2023-12-19T18:59:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.102+0000 7fa98359e640 1 -- 172.21.15.133:0/215857217 wait complete. 2023-12-19T18:59:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa98359e640 1 Processor -- start 2023-12-19T18:59:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa98359e640 1 -- start start 2023-12-19T18:59:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa98359e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9840c7c50 0x7fa9840ab310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa98359e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa984151cd0 0x7fa9841434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa98359e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa984154be0 0x7fa984152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:59.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa98359e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa984154070 con 0x7fa984154be0 2023-12-19T18:59:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa98359e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98414e9c0 con 0x7fa984151cd0 2023-12-19T18:59:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa98359e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9841ed720 con 0x7fa9840c7c50 2023-12-19T18:59:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa982d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa984154be0 0x7fa984152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa982d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa984154be0 0x7fa984152320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58714/0 (socket says 172.21.15.133:58714) 2023-12-19T18:59:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa982d9d640 1 -- 172.21.15.133:0/1382554038 learned_addr learned my addr 172.21.15.133:0/1382554038 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa98259c640 1 --2- 172.21.15.133:0/1382554038 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9840c7c50 0x7fa9840ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa981d9b640 1 --2- 172.21.15.133:0/1382554038 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa984151cd0 0x7fa9841434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa982d9d640 1 -- 172.21.15.133:0/1382554038 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9840c7c50 msgr2=0x7fa9840ab310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:59.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa982d9d640 1 --2- 172.21.15.133:0/1382554038 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9840c7c50 0x7fa9840ab310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa982d9d640 1 -- 172.21.15.133:0/1382554038 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa984151cd0 msgr2=0x7fa9841434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa982d9d640 1 --2- 172.21.15.133:0/1382554038 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa984151cd0 0x7fa9841434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa982d9d640 1 -- 172.21.15.133:0/1382554038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97c009a70 con 0x7fa984154be0 2023-12-19T18:59:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa982d9d640 1 --2- 172.21.15.133:0/1382554038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa984154be0 0x7fa984152320 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa97c019530 tx=0x7fa97c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa972ffd640 1 -- 172.21.15.133:0/1382554038 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c0ade00 con 0x7fa984154be0 2023-12-19T18:59:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa972ffd640 1 -- 172.21.15.133:0/1382554038 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97c0b7410 con 0x7fa984154be0 2023-12-19T18:59:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa98359e640 1 -- 172.21.15.133:0/1382554038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa984154310 con 0x7fa984154be0 2023-12-19T18:59:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa972ffd640 1 -- 172.21.15.133:0/1382554038 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c0b77c0 con 0x7fa984154be0 2023-12-19T18:59:59.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.106+0000 7fa98359e640 1 -- 172.21.15.133:0/1382554038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9840a9730 con 0x7fa984154be0 2023-12-19T18:59:59.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.110+0000 7fa98359e640 1 -- 172.21.15.133:0/1382554038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa98414ebe0 con 0x7fa984154be0 2023-12-19T18:59:59.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.110+0000 7fa972ffd640 1 -- 172.21.15.133:0/1382554038 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa97c0b4050 con 0x7fa984154be0 2023-12-19T18:59:59.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.110+0000 7fa972ffd640 1 --2- 172.21.15.133:0/1382554038 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa9640664a0 0x7fa964068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:59.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.110+0000 7fa972ffd640 1 -- 172.21.15.133:0/1382554038 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa97c11f270 con 0x7fa984154be0 2023-12-19T18:59:59.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.110+0000 7fa98259c640 1 --2- 172.21.15.133:0/1382554038 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa9640664a0 0x7fa964068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:59.114 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.110+0000 7fa98259c640 1 --2- 172.21.15.133:0/1382554038 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa9640664a0 0x7fa964068960 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa974000f70 tx=0x7fa974007bc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:59.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.114+0000 7fa972ffd640 1 -- 172.21.15.133:0/1382554038 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa98414ebe0 con 0x7fa984154be0 2023-12-19T18:59:59.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.266+0000 7fa98359e640 1 -- 172.21.15.133:0/1382554038 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa98414ebe0 con 0x7fa984154be0 2023-12-19T18:59:59.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.266+0000 7fa972ffd640 1 -- 172.21.15.133:0/1382554038 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa98414ebe0 con 0x7fa984154be0 2023-12-19T18:59:59.269 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T18:59:59.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.266+0000 7fa98359e640 1 -- 172.21.15.133:0/1382554038 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa9640664a0 msgr2=0x7fa964068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:59.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.266+0000 7fa98359e640 1 --2- 172.21.15.133:0/1382554038 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa9640664a0 0x7fa964068960 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa974000f70 tx=0x7fa974007bc0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.266+0000 7fa98359e640 1 -- 172.21.15.133:0/1382554038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa984154be0 msgr2=0x7fa984152320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:59.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.266+0000 7fa98359e640 1 --2- 172.21.15.133:0/1382554038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa984154be0 0x7fa984152320 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa97c019530 tx=0x7fa97c0196c0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.266+0000 7fa98359e640 1 -- 172.21.15.133:0/1382554038 shutdown_connections 2023-12-19T18:59:59.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.266+0000 7fa98359e640 1 --2- 172.21.15.133:0/1382554038 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa9640664a0 0x7fa964068960 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.266+0000 7fa98359e640 1 --2- 172.21.15.133:0/1382554038 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa984154be0 0x7fa984152320 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.266+0000 7fa98359e640 1 --2- 172.21.15.133:0/1382554038 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa984151cd0 0x7fa9841434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.266+0000 7fa98359e640 1 --2- 172.21.15.133:0/1382554038 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9840c7c50 0x7fa9840ab310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.266+0000 7fa98359e640 1 -- 172.21.15.133:0/1382554038 >> 172.21.15.133:0/1382554038 conn(0x7fa9840abee0 msgr2=0x7fa9840c8940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:59.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.266+0000 7fa98359e640 1 -- 172.21.15.133:0/1382554038 shutdown_connections 2023-12-19T18:59:59.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.266+0000 7fa98359e640 1 -- 172.21.15.133:0/1382554038 wait complete. 2023-12-19T18:59:59.289 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:59:59.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.426+0000 7f16f1079640 1 Processor -- start 2023-12-19T18:59:59.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.426+0000 7f16f1079640 1 -- start start 2023-12-19T18:59:59.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.426+0000 7f16f1079640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f16ec0a5370 0x7f16ec0c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:59.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.426+0000 7f16f1079640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16ec072090 0x7f16ec1516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:59.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.426+0000 7f16f1079640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ec0c2760 con 0x7f16ec0c4110 2023-12-19T18:59:59.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.426+0000 7f16f1079640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ec0c3070 con 0x7f16ec0a5370 2023-12-19T18:59:59.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.426+0000 7f16f1079640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec151bf0 con 0x7f16ec072090 2023-12-19T18:59:59.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.430+0000 7f16e3fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f16ec0c4110 0x7f16ec150fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41432/0 (socket says 172.21.15.133:41432) 2023-12-19T18:59:59.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.430+0000 7f16e3fff640 1 -- 172.21.15.133:0/2153080626 learned_addr learned my addr 172.21.15.133:0/2153080626 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T18:59:59.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.430+0000 7f16eb59e640 1 --2- 172.21.15.133:0/2153080626 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16ec072090 0x7f16ec1516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:59.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.430+0000 7f16ead9d640 1 --2- 172.21.15.133:0/2153080626 >> v2:172.21.15.138:3300/0 conn(0x7f16ec0a5370 0x7f16ec0c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:59.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.430+0000 7f16ea59c640 1 -- 172.21.15.133:0/2153080626 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2900745075 0 0) 0x7f16ec0c2760 con 0x7f16ec0c4110 2023-12-19T18:59:59.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.430+0000 7f16ea59c640 1 -- 172.21.15.133:0/2153080626 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16d8005740 con 0x7f16ec0c4110 2023-12-19T18:59:59.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.430+0000 7f16eb59e640 1 -- 172.21.15.133:0/2153080626 >> v2:172.21.15.138:3300/0 conn(0x7f16ec0a5370 msgr2=0x7f16ec0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:59.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.430+0000 7f16eb59e640 1 --2- 172.21.15.133:0/2153080626 >> v2:172.21.15.138:3300/0 conn(0x7f16ec0a5370 0x7f16ec0c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.430+0000 7f16eb59e640 1 -- 172.21.15.133:0/2153080626 >> v1:172.21.15.133:6789/0 conn(0x7f16ec0c4110 legacy=0x7f16ec150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:59.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.430+0000 7f16eb59e640 1 -- 172.21.15.133:0/2153080626 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec0a5750 con 0x7f16ec072090 2023-12-19T18:59:59.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.430+0000 7f16eb59e640 1 --2- 172.21.15.133:0/2153080626 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16ec072090 0x7f16ec1516b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f16e400aea0 tx=0x7f16e401c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61006145bbe45a55 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:59.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.430+0000 7f16ea59c640 1 -- 172.21.15.133:0/2153080626 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e400a2d0 con 0x7f16ec072090 2023-12-19T18:59:59.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.434+0000 7f16ea59c640 1 -- 172.21.15.133:0/2153080626 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e40a5640 con 0x7f16ec072090 2023-12-19T18:59:59.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.434+0000 7f16ea59c640 1 -- 172.21.15.133:0/2153080626 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e40a59b0 con 0x7f16ec072090 2023-12-19T18:59:59.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.434+0000 7f16f1079640 1 -- 172.21.15.133:0/2153080626 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16ec072090 msgr2=0x7f16ec1516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:59.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.434+0000 7f16f1079640 1 --2- 172.21.15.133:0/2153080626 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16ec072090 0x7f16ec1516b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f16e400aea0 tx=0x7f16e401c800 comp rx=0 tx=0).stop 2023-12-19T18:59:59.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.434+0000 7f16f1079640 1 -- 172.21.15.133:0/2153080626 shutdown_connections 2023-12-19T18:59:59.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.434+0000 7f16f1079640 1 --2- 172.21.15.133:0/2153080626 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16ec072090 0x7f16ec1516b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.434+0000 7f16f1079640 1 --2- 172.21.15.133:0/2153080626 >> v2:172.21.15.138:3300/0 conn(0x7f16ec0a5370 0x7f16ec0c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.434+0000 7f16f1079640 1 -- 172.21.15.133:0/2153080626 >> 172.21.15.133:0/2153080626 conn(0x7f16ec06a5b0 msgr2=0x7f16ec06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:59.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.434+0000 7f16f1079640 1 -- 172.21.15.133:0/2153080626 shutdown_connections 2023-12-19T18:59:59.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.434+0000 7f16f1079640 1 -- 172.21.15.133:0/2153080626 wait complete. 2023-12-19T18:59:59.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.434+0000 7f16f1079640 1 Processor -- start 2023-12-19T18:59:59.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.434+0000 7f16f1079640 1 -- start start 2023-12-19T18:59:59.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.434+0000 7f16f1079640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16ec072090 0x7f16ec1549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:59.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.434+0000 7f16f1079640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16ec0a5370 0x7f16ec1e8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:59.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.434+0000 7f16f1079640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec0c4110 0x7f16ec1e9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:59.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.434+0000 7f16f1079640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec14c790 con 0x7f16ec0c4110 2023-12-19T18:59:59.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.434+0000 7f16f1079640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec1e9870 con 0x7f16ec0a5370 2023-12-19T18:59:59.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.434+0000 7f16f1079640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec154380 con 0x7f16ec072090 2023-12-19T18:59:59.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.434+0000 7f16eb59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec0c4110 0x7f16ec1e9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:59.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.434+0000 7f16eb59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec0c4110 0x7f16ec1e9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58728/0 (socket says 172.21.15.133:58728) 2023-12-19T18:59:59.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.434+0000 7f16eb59e640 1 -- 172.21.15.133:0/3884701909 learned_addr learned my addr 172.21.15.133:0/3884701909 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:59.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.434+0000 7f16e3fff640 1 --2- 172.21.15.133:0/3884701909 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16ec0a5370 0x7f16ec1e8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:59.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.434+0000 7f16ead9d640 1 --2- 172.21.15.133:0/3884701909 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16ec072090 0x7f16ec1549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:59.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.438+0000 7f16eb59e640 1 -- 172.21.15.133:0/3884701909 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16ec072090 msgr2=0x7f16ec1549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:59.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.438+0000 7f16eb59e640 1 --2- 172.21.15.133:0/3884701909 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16ec072090 0x7f16ec1549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.438+0000 7f16eb59e640 1 -- 172.21.15.133:0/3884701909 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16ec0a5370 msgr2=0x7f16ec1e8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:59.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.438+0000 7f16eb59e640 1 --2- 172.21.15.133:0/3884701909 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16ec0a5370 0x7f16ec1e8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.438+0000 7f16eb59e640 1 -- 172.21.15.133:0/3884701909 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e400ab80 con 0x7f16ec0c4110 2023-12-19T18:59:59.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.438+0000 7f16eb59e640 1 --2- 172.21.15.133:0/3884701909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec0c4110 0x7f16ec1e9330 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f16e401d0a0 tx=0x7f16e40195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:59.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.438+0000 7f16e37fe640 1 -- 172.21.15.133:0/3884701909 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e4007000 con 0x7f16ec0c4110 2023-12-19T18:59:59.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.438+0000 7f16e37fe640 1 -- 172.21.15.133:0/3884701909 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e40b8640 con 0x7f16ec0c4110 2023-12-19T18:59:59.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.438+0000 7f16e37fe640 1 -- 172.21.15.133:0/3884701909 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e40b8a30 con 0x7f16ec0c4110 2023-12-19T18:59:59.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.438+0000 7f16f1079640 1 -- 172.21.15.133:0/3884701909 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ec1540e0 con 0x7f16ec0c4110 2023-12-19T18:59:59.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.438+0000 7f16f1079640 1 -- 172.21.15.133:0/3884701909 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ec145db0 con 0x7f16ec0c4110 2023-12-19T18:59:59.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.438+0000 7f16f1079640 1 -- 172.21.15.133:0/3884701909 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ec068400 con 0x7f16ec0c4110 2023-12-19T18:59:59.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.438+0000 7f16e37fe640 1 -- 172.21.15.133:0/3884701909 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f16e40b8b90 con 0x7f16ec0c4110 2023-12-19T18:59:59.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.438+0000 7f16e37fe640 1 --2- 172.21.15.133:0/3884701909 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f16cc066470 0x7f16cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:59.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.438+0000 7f16e37fe640 1 -- 172.21.15.133:0/3884701909 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f16e411eea0 con 0x7f16ec0c4110 2023-12-19T18:59:59.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.438+0000 7f16ead9d640 1 --2- 172.21.15.133:0/3884701909 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f16cc066470 0x7f16cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:59.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.442+0000 7f16ead9d640 1 --2- 172.21.15.133:0/3884701909 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f16cc066470 0x7f16cc068930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f16d4009b60 tx=0x7f16d4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:59.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.442+0000 7f16e37fe640 1 -- 172.21.15.133:0/3884701909 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f16e40ec060 con 0x7f16ec0c4110 2023-12-19T18:59:59.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.594+0000 7f16f1079640 1 -- 172.21.15.133:0/3884701909 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16ec0c6780 con 0x7f16ec0c4110 2023-12-19T18:59:59.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.594+0000 7f16e37fe640 1 -- 172.21.15.133:0/3884701909 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f16e400a560 con 0x7f16ec0c4110 2023-12-19T18:59:59.596 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T18:59:59.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.594+0000 7f16f1079640 1 -- 172.21.15.133:0/3884701909 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f16cc066470 msgr2=0x7f16cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:59.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.594+0000 7f16f1079640 1 --2- 172.21.15.133:0/3884701909 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f16cc066470 0x7f16cc068930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f16d4009b60 tx=0x7f16d4009190 comp rx=0 tx=0).stop 2023-12-19T18:59:59.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.594+0000 7f16f1079640 1 -- 172.21.15.133:0/3884701909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec0c4110 msgr2=0x7f16ec1e9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:59.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.594+0000 7f16f1079640 1 --2- 172.21.15.133:0/3884701909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec0c4110 0x7f16ec1e9330 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f16e401d0a0 tx=0x7f16e40195a0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.594+0000 7f16f1079640 1 -- 172.21.15.133:0/3884701909 shutdown_connections 2023-12-19T18:59:59.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.594+0000 7f16f1079640 1 --2- 172.21.15.133:0/3884701909 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f16cc066470 0x7f16cc068930 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.594+0000 7f16f1079640 1 --2- 172.21.15.133:0/3884701909 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16ec0c4110 0x7f16ec1e9330 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.594+0000 7f16f1079640 1 --2- 172.21.15.133:0/3884701909 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f16ec0a5370 0x7f16ec1e8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.594+0000 7f16f1079640 1 --2- 172.21.15.133:0/3884701909 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16ec072090 0x7f16ec1549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.594+0000 7f16f1079640 1 -- 172.21.15.133:0/3884701909 >> 172.21.15.133:0/3884701909 conn(0x7f16ec06a5b0 msgr2=0x7f16ec150df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:59.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.594+0000 7f16f1079640 1 -- 172.21.15.133:0/3884701909 shutdown_connections 2023-12-19T18:59:59.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.594+0000 7f16f1079640 1 -- 172.21.15.133:0/3884701909 wait complete. 2023-12-19T18:59:59.617 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:59:59.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.758+0000 7f60190fe640 1 Processor -- start 2023-12-19T18:59:59.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.758+0000 7f60190fe640 1 -- start start 2023-12-19T18:59:59.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.758+0000 7f60190fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f60140c63c0 0x7f60140c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.758+0000 7f60190fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f60140c2bb0 0x7f60140a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.758+0000 7f60190fe640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60140c31c0 con 0x7f60140c4100 2023-12-19T18:59:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.758+0000 7f60190fe640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60140c34a0 con 0x7f60140c63c0 2023-12-19T18:59:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.758+0000 7f60190fe640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60140c1030 con 0x7f60140c2bb0 2023-12-19T18:59:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.758+0000 7f6012d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f60140c63c0 0x7f60140c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.758+0000 7f6012d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f60140c63c0 0x7f60140c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58744/0 (socket says 172.21.15.133:58744) 2023-12-19T18:59:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.758+0000 7f6012d9d640 1 -- 172.21.15.133:0/3953010058 learned_addr learned my addr 172.21.15.133:0/3953010058 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.758+0000 7f601359e640 1 --2- 172.21.15.133:0/3953010058 >> v2:172.21.15.138:3300/0 conn(0x7f60140c2bb0 0x7f60140a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.758+0000 7f6012d9d640 1 -- 172.21.15.133:0/3953010058 >> v2:172.21.15.138:3300/0 conn(0x7f60140c2bb0 msgr2=0x7f60140a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:59:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.758+0000 7f6012d9d640 1 --2- 172.21.15.133:0/3953010058 >> v2:172.21.15.138:3300/0 conn(0x7f60140c2bb0 0x7f60140a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.762+0000 7f6012d9d640 1 -- 172.21.15.133:0/3953010058 >> v1:172.21.15.138:6789/0 conn(0x7f60140c4100 legacy=0x7f60140c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.762+0000 7f6012d9d640 1 -- 172.21.15.133:0/3953010058 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60140c1310 con 0x7f60140c63c0 2023-12-19T18:59:59.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.762+0000 7f601359e640 1 --2- 172.21.15.133:0/3953010058 >> v2:172.21.15.138:3300/0 conn(0x7f60140c2bb0 0x7f60140a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:59:59.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.762+0000 7f6012d9d640 1 --2- 172.21.15.133:0/3953010058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60140c63c0 0x7f60140c06d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f60140c4550 tx=0x7f600401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b010d62a027827ee server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:59.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.762+0000 7f601259c640 1 -- 172.21.15.133:0/3953010058 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60140aa3d0 con 0x7f60140c63c0 2023-12-19T18:59:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.762+0000 7f601259c640 1 -- 172.21.15.133:0/3953010058 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60040ab600 con 0x7f60140c63c0 2023-12-19T18:59:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.762+0000 7f601259c640 1 -- 172.21.15.133:0/3953010058 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60040ab990 con 0x7f60140c63c0 2023-12-19T18:59:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.762+0000 7f60190fe640 1 -- 172.21.15.133:0/3953010058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60140c63c0 msgr2=0x7f60140c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.762+0000 7f60190fe640 1 --2- 172.21.15.133:0/3953010058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60140c63c0 0x7f60140c06d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f60140c4550 tx=0x7f600401c3e0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.762+0000 7f60190fe640 1 -- 172.21.15.133:0/3953010058 shutdown_connections 2023-12-19T18:59:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.762+0000 7f60190fe640 1 --2- 172.21.15.133:0/3953010058 >> v2:172.21.15.138:3300/0 conn(0x7f60140c2bb0 0x7f60140a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.762+0000 7f60190fe640 1 --2- 172.21.15.133:0/3953010058 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60140c63c0 0x7f60140c06d0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.762+0000 7f60190fe640 1 -- 172.21.15.133:0/3953010058 >> 172.21.15.133:0/3953010058 conn(0x7f601406a5b0 msgr2=0x7f601406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.762+0000 7f60190fe640 1 -- 172.21.15.133:0/3953010058 shutdown_connections 2023-12-19T18:59:59.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.762+0000 7f60190fe640 1 -- 172.21.15.133:0/3953010058 wait complete. 2023-12-19T18:59:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f60190fe640 1 Processor -- start 2023-12-19T18:59:59.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f60190fe640 1 -- start start 2023-12-19T18:59:59.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f60190fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60140c2bb0 0x7f60141f0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f60190fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60140c4100 0x7f60141504f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f60190fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60140c63c0 0x7f601415b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f60190fe640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6014157560 con 0x7f60140c63c0 2023-12-19T18:59:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f60190fe640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6014157840 con 0x7f60140c2bb0 2023-12-19T18:59:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f60190fe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60141f0030 con 0x7f60140c4100 2023-12-19T18:59:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f601359e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60140c63c0 0x7f601415b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f601359e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60140c63c0 0x7f601415b630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58760/0 (socket says 172.21.15.133:58760) 2023-12-19T18:59:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f601359e640 1 -- 172.21.15.133:0/1010293151 learned_addr learned my addr 172.21.15.133:0/1010293151 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T18:59:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f6012d9d640 1 --2- 172.21.15.133:0/1010293151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60140c2bb0 0x7f60141f0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f600bfff640 1 --2- 172.21.15.133:0/1010293151 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60140c4100 0x7f60141504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f601359e640 1 -- 172.21.15.133:0/1010293151 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60140c4100 msgr2=0x7f60141504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f601359e640 1 --2- 172.21.15.133:0/1010293151 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60140c4100 0x7f60141504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f601359e640 1 -- 172.21.15.133:0/1010293151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60140c2bb0 msgr2=0x7f60141f0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:59.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f601359e640 1 --2- 172.21.15.133:0/1010293151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60140c2bb0 0x7f60141f0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f601359e640 1 -- 172.21.15.133:0/1010293151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60040094d0 con 0x7f60140c63c0 2023-12-19T18:59:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f601359e640 1 --2- 172.21.15.133:0/1010293151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60140c63c0 0x7f601415b630 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f600c007ef0 tx=0x7f600c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f600b7fe640 1 -- 172.21.15.133:0/1010293151 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c003ba0 con 0x7f60140c63c0 2023-12-19T18:59:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f600b7fe640 1 -- 172.21.15.133:0/1010293151 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600c00f040 con 0x7f60140c63c0 2023-12-19T18:59:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f600b7fe640 1 -- 172.21.15.133:0/1010293151 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c00de80 con 0x7f60140c63c0 2023-12-19T18:59:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f60190fe640 1 -- 172.21.15.133:0/1010293151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60141f0310 con 0x7f60140c63c0 2023-12-19T18:59:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.766+0000 7f60190fe640 1 -- 172.21.15.133:0/1010293151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601415bb70 con 0x7f60140c63c0 2023-12-19T18:59:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.770+0000 7f60190fe640 1 -- 172.21.15.133:0/1010293151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60141f0830 con 0x7f60140c63c0 2023-12-19T18:59:59.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.770+0000 7f600b7fe640 1 -- 172.21.15.133:0/1010293151 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f600c004030 con 0x7f60140c63c0 2023-12-19T18:59:59.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.770+0000 7f600b7fe640 1 --2- 172.21.15.133:0/1010293151 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5ff4066470 0x7f5ff4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:59:59.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.770+0000 7f600b7fe640 1 -- 172.21.15.133:0/1010293151 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f600c084350 con 0x7f60140c63c0 2023-12-19T18:59:59.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.770+0000 7f6012d9d640 1 --2- 172.21.15.133:0/1010293151 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5ff4066470 0x7f5ff4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:59:59.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.770+0000 7f6012d9d640 1 --2- 172.21.15.133:0/1010293151 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5ff4066470 0x7f5ff4068930 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f60040af000 tx=0x7f60040b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:59:59.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.774+0000 7f600b7fe640 1 -- 172.21.15.133:0/1010293151 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f60141f0830 con 0x7f60140c63c0 2023-12-19T18:59:59.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.922+0000 7f60190fe640 1 -- 172.21.15.133:0/1010293151 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f60141f0830 con 0x7f60140c63c0 2023-12-19T18:59:59.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.926+0000 7f600b7fe640 1 -- 172.21.15.133:0/1010293151 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f60141f0830 con 0x7f60140c63c0 2023-12-19T18:59:59.928 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T18:59:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.926+0000 7f60190fe640 1 -- 172.21.15.133:0/1010293151 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5ff4066470 msgr2=0x7f5ff4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.926+0000 7f60190fe640 1 --2- 172.21.15.133:0/1010293151 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5ff4066470 0x7f5ff4068930 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f60040af000 tx=0x7f60040b6040 comp rx=0 tx=0).stop 2023-12-19T18:59:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.926+0000 7f60190fe640 1 -- 172.21.15.133:0/1010293151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60140c63c0 msgr2=0x7f601415b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:59:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.926+0000 7f60190fe640 1 --2- 172.21.15.133:0/1010293151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60140c63c0 0x7f601415b630 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f600c007ef0 tx=0x7f600c00d4a0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.926+0000 7f60190fe640 1 -- 172.21.15.133:0/1010293151 shutdown_connections 2023-12-19T18:59:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.926+0000 7f60190fe640 1 --2- 172.21.15.133:0/1010293151 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5ff4066470 0x7f5ff4068930 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.926+0000 7f60190fe640 1 --2- 172.21.15.133:0/1010293151 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60140c63c0 0x7f601415b630 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.926+0000 7f60190fe640 1 --2- 172.21.15.133:0/1010293151 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f60140c4100 0x7f60141504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.926+0000 7f60190fe640 1 --2- 172.21.15.133:0/1010293151 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f60140c2bb0 0x7f60141f0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:59:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.926+0000 7f60190fe640 1 -- 172.21.15.133:0/1010293151 >> 172.21.15.133:0/1010293151 conn(0x7f601406a5b0 msgr2=0x7f60140a65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:59:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.926+0000 7f60190fe640 1 -- 172.21.15.133:0/1010293151 shutdown_connections 2023-12-19T18:59:59.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T18:59:59.926+0000 7f60190fe640 1 -- 172.21.15.133:0/1010293151 wait complete. 2023-12-19T18:59:59.950 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-19T19:00:00.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.086+0000 7f8bc411d640 1 Processor -- start 2023-12-19T19:00:00.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.090+0000 7f8bc411d640 1 -- start start 2023-12-19T19:00:00.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.090+0000 7f8bc411d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bbc0c5640 0x7f8bbc0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:00.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.090+0000 7f8bc411d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bbc0c2580 con 0x7f8bbc0c60f0 2023-12-19T19:00:00.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.090+0000 7f8bc411d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bbc0c1a00 con 0x7f8bbc0c5260 2023-12-19T19:00:00.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.090+0000 7f8bc411d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc153510 con 0x7f8bbc0c5640 2023-12-19T19:00:00.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.090+0000 7f8bc26ba640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8bbc0c60f0 0x7f8bbc155de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41434/0 (socket says 172.21.15.133:41434) 2023-12-19T19:00:00.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.090+0000 7f8bc26ba640 1 -- 172.21.15.133:0/1379232787 learned_addr learned my addr 172.21.15.133:0/1379232787 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:00.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.090+0000 7f8bc16b8640 1 --2- 172.21.15.133:0/1379232787 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bbc0c5640 0x7f8bbc0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:00.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.090+0000 7f8bc0eb7640 1 -- 172.21.15.133:0/1379232787 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720135053 0 0) 0x7f8bbc0c2580 con 0x7f8bbc0c60f0 2023-12-19T19:00:00.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.090+0000 7f8bc0eb7640 1 -- 172.21.15.133:0/1379232787 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ba8003530 con 0x7f8bbc0c60f0 2023-12-19T19:00:00.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.090+0000 7f8bc0eb7640 1 -- 172.21.15.133:0/1379232787 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155486455 0 0) 0x7f8bbc0c1a00 con 0x7f8bbc0c5260 2023-12-19T19:00:00.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.090+0000 7f8bc0eb7640 1 -- 172.21.15.133:0/1379232787 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bbc0c2580 con 0x7f8bbc0c5260 2023-12-19T19:00:00.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.090+0000 7f8bc16b8640 1 -- 172.21.15.133:0/1379232787 >> v1:172.21.15.138:6789/0 conn(0x7f8bbc0c5260 legacy=0x7f8bbc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:00.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.090+0000 7f8bc16b8640 1 -- 172.21.15.133:0/1379232787 >> v1:172.21.15.133:6789/0 conn(0x7f8bbc0c60f0 legacy=0x7f8bbc155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:00.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.090+0000 7f8bc16b8640 1 -- 172.21.15.133:0/1379232787 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc0c1ce0 con 0x7f8bbc0c5640 2023-12-19T19:00:00.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.094+0000 7f8bc16b8640 1 --2- 172.21.15.133:0/1379232787 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bbc0c5640 0x7f8bbc0c5bb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8bac0097f0 tx=0x7f8bac01c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8982a6331ad27c56 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:00.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.094+0000 7f8bc0eb7640 1 -- 172.21.15.133:0/1379232787 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac0ab600 con 0x7f8bbc0c5640 2023-12-19T19:00:00.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.094+0000 7f8bc0eb7640 1 -- 172.21.15.133:0/1379232787 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bac0a7050 con 0x7f8bbc0c5640 2023-12-19T19:00:00.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.094+0000 7f8bc0eb7640 1 -- 172.21.15.133:0/1379232787 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac0ab960 con 0x7f8bbc0c5640 2023-12-19T19:00:00.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc411d640 1 -- 172.21.15.133:0/1379232787 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bbc0c5640 msgr2=0x7f8bbc0c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:00.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc411d640 1 --2- 172.21.15.133:0/1379232787 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bbc0c5640 0x7f8bbc0c5bb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8bac0097f0 tx=0x7f8bac01c430 comp rx=0 tx=0).stop 2023-12-19T19:00:00.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc411d640 1 -- 172.21.15.133:0/1379232787 shutdown_connections 2023-12-19T19:00:00.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc411d640 1 --2- 172.21.15.133:0/1379232787 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bbc0c5640 0x7f8bbc0c5bb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc411d640 1 -- 172.21.15.133:0/1379232787 >> 172.21.15.133:0/1379232787 conn(0x7f8bbc06a5b0 msgr2=0x7f8bbc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:00.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc411d640 1 -- 172.21.15.133:0/1379232787 shutdown_connections 2023-12-19T19:00:00.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc411d640 1 -- 172.21.15.133:0/1379232787 wait complete. 2023-12-19T19:00:00.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc411d640 1 Processor -- start 2023-12-19T19:00:00.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc411d640 1 -- start start 2023-12-19T19:00:00.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc411d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bbc0c5260 0x7f8bbc071630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:00.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc411d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bbc0c5640 0x7f8bbc145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:00.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc411d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bbc0c60f0 0x7f8bbc1461a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:00.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc411d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc148840 con 0x7f8bbc0c60f0 2023-12-19T19:00:00.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc411d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc1eb930 con 0x7f8bbc0c5640 2023-12-19T19:00:00.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc411d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc06fef0 con 0x7f8bbc0c5260 2023-12-19T19:00:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc26ba640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bbc0c60f0 0x7f8bbc1461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc26ba640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bbc0c60f0 0x7f8bbc1461a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58776/0 (socket says 172.21.15.133:58776) 2023-12-19T19:00:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc26ba640 1 -- 172.21.15.133:0/4062777051 learned_addr learned my addr 172.21.15.133:0/4062777051 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc1eb9640 1 --2- 172.21.15.133:0/4062777051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bbc0c5260 0x7f8bbc071630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc16b8640 1 --2- 172.21.15.133:0/4062777051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bbc0c5640 0x7f8bbc145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc26ba640 1 -- 172.21.15.133:0/4062777051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bbc0c5260 msgr2=0x7f8bbc071630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc26ba640 1 --2- 172.21.15.133:0/4062777051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bbc0c5260 0x7f8bbc071630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc26ba640 1 -- 172.21.15.133:0/4062777051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bbc0c5640 msgr2=0x7f8bbc145c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc26ba640 1 --2- 172.21.15.133:0/4062777051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bbc0c5640 0x7f8bbc145c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc26ba640 1 -- 172.21.15.133:0/4062777051 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac009420 con 0x7f8bbc0c60f0 2023-12-19T19:00:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.098+0000 7f8bc1eb9640 1 --2- 172.21.15.133:0/4062777051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bbc0c5260 0x7f8bbc071630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:00.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.102+0000 7f8bc26ba640 1 --2- 172.21.15.133:0/4062777051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bbc0c60f0 0x7f8bbc1461a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400caf0 tx=0x7f8bb400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:00.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.102+0000 7f8bb27fc640 1 -- 172.21.15.133:0/4062777051 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb400aca0 con 0x7f8bbc0c60f0 2023-12-19T19:00:00.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.102+0000 7f8bb27fc640 1 -- 172.21.15.133:0/4062777051 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb400ae00 con 0x7f8bbc0c60f0 2023-12-19T19:00:00.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.102+0000 7f8bb27fc640 1 -- 172.21.15.133:0/4062777051 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4012620 con 0x7f8bbc0c60f0 2023-12-19T19:00:00.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.102+0000 7f8bc411d640 1 -- 172.21.15.133:0/4062777051 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bbc0701d0 con 0x7f8bbc0c60f0 2023-12-19T19:00:00.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.102+0000 7f8bc411d640 1 -- 172.21.15.133:0/4062777051 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bbc071b70 con 0x7f8bbc0c60f0 2023-12-19T19:00:00.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.102+0000 7f8bc411d640 1 -- 172.21.15.133:0/4062777051 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bbc0703c0 con 0x7f8bbc0c60f0 2023-12-19T19:00:00.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.102+0000 7f8bb27fc640 1 -- 172.21.15.133:0/4062777051 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8bb4007070 con 0x7f8bbc0c60f0 2023-12-19T19:00:00.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.102+0000 7f8bb27fc640 1 --2- 172.21.15.133:0/4062777051 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8ba0066470 0x7f8ba0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:00.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.102+0000 7f8bb27fc640 1 -- 172.21.15.133:0/4062777051 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8bb4084190 con 0x7f8bbc0c60f0 2023-12-19T19:00:00.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.106+0000 7f8bc1eb9640 1 --2- 172.21.15.133:0/4062777051 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8ba0066470 0x7f8ba0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:00.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.106+0000 7f8bc1eb9640 1 --2- 172.21.15.133:0/4062777051 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8ba0066470 0x7f8ba0068930 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc14e000 tx=0x7f8bb8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:00.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.106+0000 7f8bb27fc640 1 -- 172.21.15.133:0/4062777051 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8bb40512a0 con 0x7f8bbc0c60f0 2023-12-19T19:00:00.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.286+0000 7f8bc411d640 1 -- 172.21.15.133:0/4062777051 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8bbc068400 con 0x7f8bbc0c60f0 2023-12-19T19:00:00.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.286+0000 7f8bb27fc640 1 -- 172.21.15.133:0/4062777051 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v35) v1 ==== 105+0+11 (secure 0 0 0) 0x7f8bb40548c0 con 0x7f8bbc0c60f0 2023-12-19T19:00:00.290 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:00:00.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.290+0000 7f8bc411d640 1 -- 172.21.15.133:0/4062777051 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8ba0066470 msgr2=0x7f8ba0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.290+0000 7f8bc411d640 1 --2- 172.21.15.133:0/4062777051 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8ba0066470 0x7f8ba0068930 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc14e000 tx=0x7f8bb8009040 comp rx=0 tx=0).stop 2023-12-19T19:00:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.290+0000 7f8bc411d640 1 -- 172.21.15.133:0/4062777051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bbc0c60f0 msgr2=0x7f8bbc1461a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.290+0000 7f8bc411d640 1 --2- 172.21.15.133:0/4062777051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bbc0c60f0 0x7f8bbc1461a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400caf0 tx=0x7f8bb400a060 comp rx=0 tx=0).stop 2023-12-19T19:00:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.290+0000 7f8bc411d640 1 -- 172.21.15.133:0/4062777051 shutdown_connections 2023-12-19T19:00:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.290+0000 7f8bc411d640 1 --2- 172.21.15.133:0/4062777051 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8ba0066470 0x7f8ba0068930 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.290+0000 7f8bc411d640 1 --2- 172.21.15.133:0/4062777051 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bbc0c60f0 0x7f8bbc1461a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.290+0000 7f8bc411d640 1 --2- 172.21.15.133:0/4062777051 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bbc0c5640 0x7f8bbc145c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.290+0000 7f8bc411d640 1 --2- 172.21.15.133:0/4062777051 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bbc0c5260 0x7f8bbc071630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.290+0000 7f8bc411d640 1 -- 172.21.15.133:0/4062777051 >> 172.21.15.133:0/4062777051 conn(0x7f8bbc06a5b0 msgr2=0x7f8bbc06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:00.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.290+0000 7f8bc411d640 1 -- 172.21.15.133:0/4062777051 shutdown_connections 2023-12-19T19:00:00.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.290+0000 7f8bc411d640 1 -- 172.21.15.133:0/4062777051 wait complete. 2023-12-19T19:00:00.312 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-19T19:00:00.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.450+0000 7f91083c1640 1 Processor -- start 2023-12-19T19:00:00.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.450+0000 7f91083c1640 1 -- start start 2023-12-19T19:00:00.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.450+0000 7f91083c1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91000bd660 0x7f9100154d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:00.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.450+0000 7f91083c1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91000ac4f0 con 0x7f9100151dc0 2023-12-19T19:00:00.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.450+0000 7f91083c1640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9100158780 con 0x7f91000c7ed0 2023-12-19T19:00:00.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.450+0000 7f91083c1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9100158a60 con 0x7f91000bd660 2023-12-19T19:00:00.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.450+0000 7f910615d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9100151dc0 0x7f91000c4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41450/0 (socket says 172.21.15.133:41450) 2023-12-19T19:00:00.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.450+0000 7f910615d640 1 -- 172.21.15.133:0/3943463709 learned_addr learned my addr 172.21.15.133:0/3943463709 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:00.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910695e640 1 --2- 172.21.15.133:0/3943463709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91000bd660 0x7f9100154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:00.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910515b640 1 -- 172.21.15.133:0/3943463709 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1385343666 0 0) 0x7f91000ac4f0 con 0x7f9100151dc0 2023-12-19T19:00:00.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910515b640 1 -- 172.21.15.133:0/3943463709 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90ec003530 con 0x7f9100151dc0 2023-12-19T19:00:00.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910515b640 1 -- 172.21.15.133:0/3943463709 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2529949367 0 0) 0x7f90ec003530 con 0x7f9100151dc0 2023-12-19T19:00:00.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910515b640 1 -- 172.21.15.133:0/3943463709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91000bd660 msgr2=0x7f9100154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:00.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910515b640 1 --2- 172.21.15.133:0/3943463709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91000bd660 0x7f9100154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910515b640 1 -- 172.21.15.133:0/3943463709 >> v1:172.21.15.138:6789/0 conn(0x7f91000c7ed0 legacy=0x7f9100154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:00.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910515b640 1 -- 172.21.15.133:0/3943463709 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91000ac180 con 0x7f9100151dc0 2023-12-19T19:00:00.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910515b640 1 -- 172.21.15.133:0/3943463709 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f90fc001680 con 0x7f9100151dc0 2023-12-19T19:00:00.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910515b640 1 -- 172.21.15.133:0/3943463709 >> v1:172.21.15.133:6789/0 conn(0x7f9100151dc0 legacy=0x7f91000c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:00.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910515b640 1 --2- 172.21.15.133:0/3943463709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90ec0039b0 0x7f90ec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:00.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910515b640 1 --2- 172.21.15.133:0/3943463709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90ec0047d0 0x7f90ec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:00.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910515b640 1 --2- 172.21.15.133:0/3943463709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91000bd660 0x7f90ec0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:00.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910515b640 1 -- 172.21.15.133:0/3943463709 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9100158a60 con 0x7f90ec0047d0 2023-12-19T19:00:00.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910515b640 1 -- 172.21.15.133:0/3943463709 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec00bac0 con 0x7f90ec0039b0 2023-12-19T19:00:00.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910515b640 1 -- 172.21.15.133:0/3943463709 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90ec00bc80 con 0x7f91000bd660 2023-12-19T19:00:00.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910595c640 1 --2- 172.21.15.133:0/3943463709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90ec0047d0 0x7f90ec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:00.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910615d640 1 --2- 172.21.15.133:0/3943463709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90ec0039b0 0x7f90ec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:00.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910695e640 1 --2- 172.21.15.133:0/3943463709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91000bd660 0x7f90ec0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:00.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910595c640 1 -- 172.21.15.133:0/3943463709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91000bd660 msgr2=0x7f90ec0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:00.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910595c640 1 --2- 172.21.15.133:0/3943463709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91000bd660 0x7f90ec0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910595c640 1 -- 172.21.15.133:0/3943463709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90ec0039b0 msgr2=0x7f90ec003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:00.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910595c640 1 --2- 172.21.15.133:0/3943463709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90ec0039b0 0x7f90ec003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.454+0000 7f910595c640 1 -- 172.21.15.133:0/3943463709 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec003530 con 0x7f90ec0047d0 2023-12-19T19:00:00.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.458+0000 7f910595c640 1 --2- 172.21.15.133:0/3943463709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90ec0047d0 0x7f90ec004c50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f90f0001910 tx=0x7f90f001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1306fd25938fb282 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:00.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.458+0000 7f910515b640 1 -- 172.21.15.133:0/3943463709 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f00ab600 con 0x7f90ec0047d0 2023-12-19T19:00:00.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.458+0000 7f910515b640 1 -- 172.21.15.133:0/3943463709 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f00a7050 con 0x7f90ec0047d0 2023-12-19T19:00:00.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.458+0000 7f910515b640 1 -- 172.21.15.133:0/3943463709 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f00ab9c0 con 0x7f90ec0047d0 2023-12-19T19:00:00.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.458+0000 7f91083c1640 1 -- 172.21.15.133:0/3943463709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90ec0047d0 msgr2=0x7f90ec004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:00.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.458+0000 7f91083c1640 1 --2- 172.21.15.133:0/3943463709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90ec0047d0 0x7f90ec004c50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f90f0001910 tx=0x7f90f001c540 comp rx=0 tx=0).stop 2023-12-19T19:00:00.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.458+0000 7f910695e640 1 -- 172.21.15.133:0/3943463709 reap_dead start 2023-12-19T19:00:00.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.458+0000 7f91083c1640 1 -- 172.21.15.133:0/3943463709 shutdown_connections 2023-12-19T19:00:00.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.458+0000 7f91083c1640 1 -- 172.21.15.133:0/3943463709 >> 172.21.15.133:0/3943463709 conn(0x7f9100071eb0 msgr2=0x7f91000722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:00.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.458+0000 7f91083c1640 1 -- 172.21.15.133:0/3943463709 shutdown_connections 2023-12-19T19:00:00.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.458+0000 7f91083c1640 1 -- 172.21.15.133:0/3943463709 wait complete. 2023-12-19T19:00:00.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.458+0000 7f91083c1640 1 Processor -- start 2023-12-19T19:00:00.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.458+0000 7f91083c1640 1 -- start start 2023-12-19T19:00:00.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.458+0000 7f91083c1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90ec0047d0 0x7f91000bd010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:00.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.458+0000 7f91083c1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91000ab660 0x7f9100150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:00.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.458+0000 7f91083c1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91000bffa0 0x7f91000c0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:00.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.458+0000 7f91083c1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91000be680 con 0x7f91000ab660 2023-12-19T19:00:00.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.458+0000 7f91083c1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91001edec0 con 0x7f90ec0047d0 2023-12-19T19:00:00.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.458+0000 7f91083c1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91000c0960 con 0x7f91000bffa0 2023-12-19T19:00:00.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.462+0000 7f910595c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91000ab660 0x7f9100150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:00.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.462+0000 7f910595c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91000ab660 0x7f9100150e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58796/0 (socket says 172.21.15.133:58796) 2023-12-19T19:00:00.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.462+0000 7f910595c640 1 -- 172.21.15.133:0/2869256952 learned_addr learned my addr 172.21.15.133:0/2869256952 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:00.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.462+0000 7f910615d640 1 --2- 172.21.15.133:0/2869256952 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90ec0047d0 0x7f91000bd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:00.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.462+0000 7f910695e640 1 --2- 172.21.15.133:0/2869256952 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91000bffa0 0x7f91000c0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:00.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.462+0000 7f910595c640 1 -- 172.21.15.133:0/2869256952 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91000bffa0 msgr2=0x7f91000c0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:00.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.462+0000 7f910595c640 1 --2- 172.21.15.133:0/2869256952 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91000bffa0 0x7f91000c0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.462+0000 7f910595c640 1 -- 172.21.15.133:0/2869256952 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90ec0047d0 msgr2=0x7f91000bd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:00.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.462+0000 7f910595c640 1 --2- 172.21.15.133:0/2869256952 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90ec0047d0 0x7f91000bd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.462+0000 7f910595c640 1 -- 172.21.15.133:0/2869256952 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91000bfac0 con 0x7f91000ab660 2023-12-19T19:00:00.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.462+0000 7f910595c640 1 --2- 172.21.15.133:0/2869256952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91000ab660 0x7f9100150e20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f90f00ae040 tx=0x7f90ec005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:00.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.462+0000 7f90f6ffd640 1 -- 172.21.15.133:0/2869256952 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f0005350 con 0x7f91000ab660 2023-12-19T19:00:00.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.462+0000 7f90f6ffd640 1 -- 172.21.15.133:0/2869256952 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90f00054d0 con 0x7f91000ab660 2023-12-19T19:00:00.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.462+0000 7f90f6ffd640 1 -- 172.21.15.133:0/2869256952 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90f00abbc0 con 0x7f91000ab660 2023-12-19T19:00:00.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.462+0000 7f91083c1640 1 -- 172.21.15.133:0/2869256952 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9100150180 con 0x7f91000ab660 2023-12-19T19:00:00.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.462+0000 7f91083c1640 1 -- 172.21.15.133:0/2869256952 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91000bdde0 con 0x7f91000ab660 2023-12-19T19:00:00.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.462+0000 7f91083c1640 1 -- 172.21.15.133:0/2869256952 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9100067a00 con 0x7f91000ab660 2023-12-19T19:00:00.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.462+0000 7f90f6ffd640 1 -- 172.21.15.133:0/2869256952 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f90f00b2050 con 0x7f91000ab660 2023-12-19T19:00:00.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.462+0000 7f90f6ffd640 1 --2- 172.21.15.133:0/2869256952 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f90e4066470 0x7f90e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:00.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.466+0000 7f90f6ffd640 1 -- 172.21.15.133:0/2869256952 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f90f011d090 con 0x7f91000ab660 2023-12-19T19:00:00.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.466+0000 7f910615d640 1 --2- 172.21.15.133:0/2869256952 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f90e4066470 0x7f90e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:00.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.466+0000 7f910615d640 1 --2- 172.21.15.133:0/2869256952 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f90e4066470 0x7f90e4068930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f90fc007c30 tx=0x7f90fc000ff0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:00.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.466+0000 7f90f6ffd640 1 -- 172.21.15.133:0/2869256952 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f90f00ea130 con 0x7f91000ab660 2023-12-19T19:00:00.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.618+0000 7f91083c1640 1 -- 172.21.15.133:0/2869256952 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f9100068400 con 0x7f91000ab660 2023-12-19T19:00:00.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.618+0000 7f90f6ffd640 1 -- 172.21.15.133:0/2869256952 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v35) v1 ==== 101+0+11 (secure 0 0 0) 0x7f90f00ed750 con 0x7f91000ab660 2023-12-19T19:00:00.621 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:00:00.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.618+0000 7f91083c1640 1 -- 172.21.15.133:0/2869256952 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f90e4066470 msgr2=0x7f90e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:00.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.618+0000 7f91083c1640 1 --2- 172.21.15.133:0/2869256952 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f90e4066470 0x7f90e4068930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f90fc007c30 tx=0x7f90fc000ff0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.618+0000 7f91083c1640 1 -- 172.21.15.133:0/2869256952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91000ab660 msgr2=0x7f9100150e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:00.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.618+0000 7f91083c1640 1 --2- 172.21.15.133:0/2869256952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91000ab660 0x7f9100150e20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f90f00ae040 tx=0x7f90ec005800 comp rx=0 tx=0).stop 2023-12-19T19:00:00.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.618+0000 7f91083c1640 1 -- 172.21.15.133:0/2869256952 shutdown_connections 2023-12-19T19:00:00.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.618+0000 7f91083c1640 1 --2- 172.21.15.133:0/2869256952 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f90e4066470 0x7f90e4068930 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.618+0000 7f91083c1640 1 --2- 172.21.15.133:0/2869256952 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91000bffa0 0x7f91000c0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.618+0000 7f91083c1640 1 --2- 172.21.15.133:0/2869256952 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91000ab660 0x7f9100150e20 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.618+0000 7f91083c1640 1 --2- 172.21.15.133:0/2869256952 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90ec0047d0 0x7f91000bd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.618+0000 7f91083c1640 1 -- 172.21.15.133:0/2869256952 >> 172.21.15.133:0/2869256952 conn(0x7f9100071eb0 msgr2=0x7f91000c4850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:00.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.618+0000 7f91083c1640 1 -- 172.21.15.133:0/2869256952 shutdown_connections 2023-12-19T19:00:00.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.618+0000 7f91083c1640 1 -- 172.21.15.133:0/2869256952 wait complete. 2023-12-19T19:00:00.641 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T19:00:00.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.778+0000 7f7c8d6c9640 1 Processor -- start 2023-12-19T19:00:00.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.778+0000 7f7c8d6c9640 1 -- start start 2023-12-19T19:00:00.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.782+0000 7f7c8d6c9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7c8806bbb0 0x7f7c881600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:00.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.782+0000 7f7c8d6c9640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c8806c860 con 0x7f7c88151e90 2023-12-19T19:00:00.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.782+0000 7f7c8d6c9640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c8806c000 con 0x7f7c880c7ea0 2023-12-19T19:00:00.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.782+0000 7f7c8d6c9640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c880c8750 con 0x7f7c8806bbb0 2023-12-19T19:00:00.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.782+0000 7f7c86ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7c88151e90 0x7f7c880c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41456/0 (socket says 172.21.15.133:41456) 2023-12-19T19:00:00.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.782+0000 7f7c86ffd640 1 -- 172.21.15.133:0/1007592507 learned_addr learned my addr 172.21.15.133:0/1007592507 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:00.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.782+0000 7f7c877fe640 1 --2- 172.21.15.133:0/1007592507 >> v2:172.21.15.133:3300/0 conn(0x7f7c8806bbb0 0x7f7c881600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:00.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.782+0000 7f7c867fc640 1 -- 172.21.15.133:0/1007592507 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1030922588 0 0) 0x7f7c8806c860 con 0x7f7c88151e90 2023-12-19T19:00:00.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.782+0000 7f7c867fc640 1 -- 172.21.15.133:0/1007592507 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c74003530 con 0x7f7c88151e90 2023-12-19T19:00:00.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.782+0000 7f7c877fe640 1 -- 172.21.15.133:0/1007592507 >> v1:172.21.15.138:6789/0 conn(0x7f7c880c7ea0 legacy=0x7f7c8806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:00.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.782+0000 7f7c877fe640 1 -- 172.21.15.133:0/1007592507 >> v1:172.21.15.133:6789/0 conn(0x7f7c88151e90 legacy=0x7f7c880c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:00.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.782+0000 7f7c877fe640 1 -- 172.21.15.133:0/1007592507 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c88154930 con 0x7f7c8806bbb0 2023-12-19T19:00:00.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.786+0000 7f7c877fe640 1 --2- 172.21.15.133:0/1007592507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8806bbb0 0x7f7c881600b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7c800097c0 tx=0x7f7c8001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10be3765ad5546aa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:00.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.786+0000 7f7c867fc640 1 -- 172.21.15.133:0/1007592507 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c800ab600 con 0x7f7c8806bbb0 2023-12-19T19:00:00.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.786+0000 7f7c867fc640 1 -- 172.21.15.133:0/1007592507 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c800a7050 con 0x7f7c8806bbb0 2023-12-19T19:00:00.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.786+0000 7f7c867fc640 1 -- 172.21.15.133:0/1007592507 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c800ab960 con 0x7f7c8806bbb0 2023-12-19T19:00:00.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.786+0000 7f7c8d6c9640 1 -- 172.21.15.133:0/1007592507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8806bbb0 msgr2=0x7f7c881600b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:00.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.786+0000 7f7c8d6c9640 1 --2- 172.21.15.133:0/1007592507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8806bbb0 0x7f7c881600b0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7c800097c0 tx=0x7f7c8001c360 comp rx=0 tx=0).stop 2023-12-19T19:00:00.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.786+0000 7f7c8d6c9640 1 -- 172.21.15.133:0/1007592507 shutdown_connections 2023-12-19T19:00:00.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.786+0000 7f7c8d6c9640 1 --2- 172.21.15.133:0/1007592507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8806bbb0 0x7f7c881600b0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.786+0000 7f7c8d6c9640 1 -- 172.21.15.133:0/1007592507 >> 172.21.15.133:0/1007592507 conn(0x7f7c880ca170 msgr2=0x7f7c880ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:00.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.786+0000 7f7c8d6c9640 1 -- 172.21.15.133:0/1007592507 shutdown_connections 2023-12-19T19:00:00.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.786+0000 7f7c8d6c9640 1 -- 172.21.15.133:0/1007592507 wait complete. 2023-12-19T19:00:00.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.786+0000 7f7c8d6c9640 1 Processor -- start 2023-12-19T19:00:00.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.786+0000 7f7c8d6c9640 1 -- start start 2023-12-19T19:00:00.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c8d6c9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8806bbb0 0x7f7c88147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:00.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c8d6c9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c880c7ea0 0x7f7c880c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:00.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c8d6c9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c88151e90 0x7f7c880c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:00.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c8d6c9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c881552d0 con 0x7f7c8806bbb0 2023-12-19T19:00:00.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c8d6c9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c881ed6f0 con 0x7f7c88151e90 2023-12-19T19:00:00.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c8d6c9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c881edc20 con 0x7f7c880c7ea0 2023-12-19T19:00:00.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c86ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8806bbb0 0x7f7c88147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:00.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c86ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8806bbb0 0x7f7c88147d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58806/0 (socket says 172.21.15.133:58806) 2023-12-19T19:00:00.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c86ffd640 1 -- 172.21.15.133:0/137265886 learned_addr learned my addr 172.21.15.133:0/137265886 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:00.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c877fe640 1 --2- 172.21.15.133:0/137265886 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c88151e90 0x7f7c880c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:00.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c7e7fc640 1 --2- 172.21.15.133:0/137265886 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c880c7ea0 0x7f7c880c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:00.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c86ffd640 1 -- 172.21.15.133:0/137265886 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c880c7ea0 msgr2=0x7f7c880c14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:00.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c86ffd640 1 --2- 172.21.15.133:0/137265886 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c880c7ea0 0x7f7c880c14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c86ffd640 1 -- 172.21.15.133:0/137265886 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c88151e90 msgr2=0x7f7c880c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:00.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c86ffd640 1 --2- 172.21.15.133:0/137265886 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c88151e90 0x7f7c880c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c86ffd640 1 -- 172.21.15.133:0/137265886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c80009420 con 0x7f7c8806bbb0 2023-12-19T19:00:00.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c86ffd640 1 --2- 172.21.15.133:0/137265886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8806bbb0 0x7f7c88147d40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7c7800cbf0 tx=0x7f7c7800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:00.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c7ffff640 1 -- 172.21.15.133:0/137265886 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7800ad50 con 0x7f7c8806bbb0 2023-12-19T19:00:00.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c7ffff640 1 -- 172.21.15.133:0/137265886 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c78012400 con 0x7f7c8806bbb0 2023-12-19T19:00:00.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c7ffff640 1 -- 172.21.15.133:0/137265886 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c78012790 con 0x7f7c8806bbb0 2023-12-19T19:00:00.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c8d6c9640 1 -- 172.21.15.133:0/137265886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c8814ef50 con 0x7f7c8806bbb0 2023-12-19T19:00:00.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c8d6c9640 1 -- 172.21.15.133:0/137265886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c881486e0 con 0x7f7c8806bbb0 2023-12-19T19:00:00.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c8d6c9640 1 -- 172.21.15.133:0/137265886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c88068400 con 0x7f7c8806bbb0 2023-12-19T19:00:00.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.790+0000 7f7c7ffff640 1 -- 172.21.15.133:0/137265886 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7c78007070 con 0x7f7c8806bbb0 2023-12-19T19:00:00.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.794+0000 7f7c7ffff640 1 --2- 172.21.15.133:0/137265886 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7c68066470 0x7f7c68068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:00.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.794+0000 7f7c7ffff640 1 -- 172.21.15.133:0/137265886 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7c78084210 con 0x7f7c8806bbb0 2023-12-19T19:00:00.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.794+0000 7f7c7e7fc640 1 --2- 172.21.15.133:0/137265886 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7c68066470 0x7f7c68068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:00.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.794+0000 7f7c7e7fc640 1 --2- 172.21.15.133:0/137265886 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7c68066470 0x7f7c68068930 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7c881f0140 tx=0x7f7c70009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:00.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.798+0000 7f7c7ffff640 1 -- 172.21.15.133:0/137265886 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7c780513d0 con 0x7f7c8806bbb0 2023-12-19T19:00:00.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.966+0000 7f7c8d6c9640 1 -- 172.21.15.133:0/137265886 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7c8806ca50 con 0x7f7c8806bbb0 2023-12-19T19:00:00.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.966+0000 7f7c7ffff640 1 -- 172.21.15.133:0/137265886 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7c780549f0 con 0x7f7c8806bbb0 2023-12-19T19:00:00.968 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-19T19:00:00.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.966+0000 7f7c8d6c9640 1 -- 172.21.15.133:0/137265886 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7c68066470 msgr2=0x7f7c68068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:00.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.966+0000 7f7c8d6c9640 1 --2- 172.21.15.133:0/137265886 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7c68066470 0x7f7c68068930 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7c881f0140 tx=0x7f7c70009040 comp rx=0 tx=0).stop 2023-12-19T19:00:00.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.966+0000 7f7c8d6c9640 1 -- 172.21.15.133:0/137265886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8806bbb0 msgr2=0x7f7c88147d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:00.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.966+0000 7f7c8d6c9640 1 --2- 172.21.15.133:0/137265886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8806bbb0 0x7f7c88147d40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7c7800cbf0 tx=0x7f7c7800a430 comp rx=0 tx=0).stop 2023-12-19T19:00:00.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.966+0000 7f7c8d6c9640 1 -- 172.21.15.133:0/137265886 shutdown_connections 2023-12-19T19:00:00.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.966+0000 7f7c8d6c9640 1 --2- 172.21.15.133:0/137265886 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7c68066470 0x7f7c68068930 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.966+0000 7f7c8d6c9640 1 --2- 172.21.15.133:0/137265886 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c88151e90 0x7f7c880c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.966+0000 7f7c8d6c9640 1 --2- 172.21.15.133:0/137265886 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c880c7ea0 0x7f7c880c14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.966+0000 7f7c8d6c9640 1 --2- 172.21.15.133:0/137265886 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c8806bbb0 0x7f7c88147d40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:00.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.966+0000 7f7c8d6c9640 1 -- 172.21.15.133:0/137265886 >> 172.21.15.133:0/137265886 conn(0x7f7c880ca170 msgr2=0x7f7c880ac2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:00.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.966+0000 7f7c8d6c9640 1 -- 172.21.15.133:0/137265886 shutdown_connections 2023-12-19T19:00:00.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:00.966+0000 7f7c8d6c9640 1 -- 172.21.15.133:0/137265886 wait complete. 2023-12-19T19:00:00.989 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T19:00:00.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:00.989 DEBUG:teuthology.orchestra.run.smithi138:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T19:00:01.019 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi138.front.sepia.ceph.com 2023-12-19T19:00:01.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:01.019 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T19:00:01.077 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:00:01.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.210+0000 7f1fa4add640 1 Processor -- start 2023-12-19T19:00:01.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.210+0000 7f1fa4add640 1 -- start start 2023-12-19T19:00:01.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.214+0000 7f1fa4add640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fa00c5640 0x7f1fa00c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:01.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.214+0000 7f1fa4add640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1fa00c60f0 0x7f1fa0155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:01.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.214+0000 7f1fa4add640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa00c2580 con 0x7f1fa00c5260 2023-12-19T19:00:01.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.214+0000 7f1fa4add640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa0153510 con 0x7f1fa00c60f0 2023-12-19T19:00:01.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.214+0000 7f1fa4add640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa00c17f0 con 0x7f1fa00c5640 2023-12-19T19:00:01.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.214+0000 7f1f9ed9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1fa00c60f0 0x7f1fa0155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:01.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.214+0000 7f1f9e59c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1fa00c5260 0x7f1fa006d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41462/0 (socket says 172.21.15.133:41462) 2023-12-19T19:00:01.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.214+0000 7f1f9e59c640 1 -- 172.21.15.133:0/2323207133 learned_addr learned my addr 172.21.15.133:0/2323207133 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:01.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.214+0000 7f1f9ed9d640 1 -- 172.21.15.133:0/2323207133 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fa00c5640 msgr2=0x7f1fa00c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:01.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.214+0000 7f1f95d9b640 1 --2- 172.21.15.133:0/2323207133 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fa00c5640 0x7f1fa00c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:01.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.214+0000 7f1f9ed9d640 1 --2- 172.21.15.133:0/2323207133 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fa00c5640 0x7f1fa00c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.214+0000 7f1f9ed9d640 1 -- 172.21.15.133:0/2323207133 >> v1:172.21.15.133:6789/0 conn(0x7f1fa00c5260 legacy=0x7f1fa006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:01.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.214+0000 7f1f9dd9b640 1 -- 172.21.15.133:0/2323207133 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182781702 0 0) 0x7f1fa00c2580 con 0x7f1fa00c5260 2023-12-19T19:00:01.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.214+0000 7f1f9ed9d640 1 -- 172.21.15.133:0/2323207133 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa00c1a00 con 0x7f1fa00c60f0 2023-12-19T19:00:01.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.218+0000 7f1f9ed9d640 1 --2- 172.21.15.133:0/2323207133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fa00c60f0 0x7f1fa0155de0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00c1930 tx=0x7f1f9801c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c714287d5c8f07d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:01.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.218+0000 7f1f9dd9b640 1 -- 172.21.15.133:0/2323207133 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f980a5930 con 0x7f1fa00c60f0 2023-12-19T19:00:01.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.218+0000 7f1f9dd9b640 1 -- 172.21.15.133:0/2323207133 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f980a5a90 con 0x7f1fa00c60f0 2023-12-19T19:00:01.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.218+0000 7f1f9dd9b640 1 -- 172.21.15.133:0/2323207133 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f980a5e20 con 0x7f1fa00c60f0 2023-12-19T19:00:01.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.218+0000 7f1fa4add640 1 -- 172.21.15.133:0/2323207133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fa00c60f0 msgr2=0x7f1fa0155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:01.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.218+0000 7f1fa4add640 1 --2- 172.21.15.133:0/2323207133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fa00c60f0 0x7f1fa0155de0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00c1930 tx=0x7f1f9801c870 comp rx=0 tx=0).stop 2023-12-19T19:00:01.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.218+0000 7f1fa4add640 1 -- 172.21.15.133:0/2323207133 shutdown_connections 2023-12-19T19:00:01.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.218+0000 7f1fa4add640 1 --2- 172.21.15.133:0/2323207133 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fa00c60f0 0x7f1fa0155de0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.218+0000 7f1fa4add640 1 --2- 172.21.15.133:0/2323207133 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fa00c5640 0x7f1fa00c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.218+0000 7f1fa4add640 1 -- 172.21.15.133:0/2323207133 >> 172.21.15.133:0/2323207133 conn(0x7f1fa006a5b0 msgr2=0x7f1fa006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:01.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.218+0000 7f1fa4add640 1 -- 172.21.15.133:0/2323207133 shutdown_connections 2023-12-19T19:00:01.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.218+0000 7f1fa4add640 1 -- 172.21.15.133:0/2323207133 wait complete. 2023-12-19T19:00:01.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.218+0000 7f1fa4add640 1 Processor -- start 2023-12-19T19:00:01.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.218+0000 7f1fa4add640 1 -- start start 2023-12-19T19:00:01.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1fa4add640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fa00c5260 0x7f1fa01513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:01.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1fa4add640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fa00c5640 0x7f1fa014cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:01.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1fa4add640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fa00c60f0 0x7f1fa01ed3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:01.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1fa4add640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa0070b70 con 0x7f1fa00c5260 2023-12-19T19:00:01.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1fa4add640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa00711b0 con 0x7f1fa00c5640 2023-12-19T19:00:01.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1fa4add640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa00c0370 con 0x7f1fa00c60f0 2023-12-19T19:00:01.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1f9e59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fa00c5260 0x7f1fa01513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:01.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1f9e59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fa00c5260 0x7f1fa01513a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58822/0 (socket says 172.21.15.133:58822) 2023-12-19T19:00:01.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1f9e59c640 1 -- 172.21.15.133:0/4224158656 learned_addr learned my addr 172.21.15.133:0/4224158656 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:01.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1f95d9b640 1 --2- 172.21.15.133:0/4224158656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fa00c5640 0x7f1fa014cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:01.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1f9ed9d640 1 --2- 172.21.15.133:0/4224158656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fa00c60f0 0x7f1fa01ed3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:01.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1f9e59c640 1 -- 172.21.15.133:0/4224158656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fa00c60f0 msgr2=0x7f1fa01ed3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:01.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1f9e59c640 1 --2- 172.21.15.133:0/4224158656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fa00c60f0 0x7f1fa01ed3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1f9e59c640 1 -- 172.21.15.133:0/4224158656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fa00c5640 msgr2=0x7f1fa014cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:01.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1f9e59c640 1 --2- 172.21.15.133:0/4224158656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fa00c5640 0x7f1fa014cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1f9e59c640 1 -- 172.21.15.133:0/4224158656 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f98009a70 con 0x7f1fa00c5260 2023-12-19T19:00:01.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1f9e59c640 1 --2- 172.21.15.133:0/4224158656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fa00c5260 0x7f1fa01513a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000c480 tx=0x7f1f9000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:01.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1f977fe640 1 -- 172.21.15.133:0/4224158656 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f900074e0 con 0x7f1fa00c5260 2023-12-19T19:00:01.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1f977fe640 1 -- 172.21.15.133:0/4224158656 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f90007660 con 0x7f1fa00c5260 2023-12-19T19:00:01.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1fa4add640 1 -- 172.21.15.133:0/4224158656 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa0070890 con 0x7f1fa00c5260 2023-12-19T19:00:01.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1f977fe640 1 -- 172.21.15.133:0/4224158656 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f90004a30 con 0x7f1fa00c5260 2023-12-19T19:00:01.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1fa4add640 1 -- 172.21.15.133:0/4224158656 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa01f11d0 con 0x7f1fa00c5260 2023-12-19T19:00:01.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1fa4add640 1 -- 172.21.15.133:0/4224158656 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa01ecd50 con 0x7f1fa00c5260 2023-12-19T19:00:01.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.222+0000 7f1f977fe640 1 -- 172.21.15.133:0/4224158656 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1f90004b90 con 0x7f1fa00c5260 2023-12-19T19:00:01.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.226+0000 7f1f977fe640 1 --2- 172.21.15.133:0/4224158656 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f80066470 0x7f1f80068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:01.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.226+0000 7f1f977fe640 1 -- 172.21.15.133:0/4224158656 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1f900835f0 con 0x7f1fa00c5260 2023-12-19T19:00:01.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.226+0000 7f1f95d9b640 1 --2- 172.21.15.133:0/4224158656 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f80066470 0x7f1f80068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:01.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.226+0000 7f1f95d9b640 1 --2- 172.21.15.133:0/4224158656 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f80066470 0x7f1f80068930 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00a68a0 tx=0x7f1f88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:01.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.230+0000 7f1f977fe640 1 -- 172.21.15.133:0/4224158656 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1f90054230 con 0x7f1fa00c5260 2023-12-19T19:00:01.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.410+0000 7f1fa4add640 1 -- 172.21.15.133:0/4224158656 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1fa01f0d50 con 0x7f1fa00c5260 2023-12-19T19:00:01.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.410+0000 7f1f977fe640 1 -- 172.21.15.133:0/4224158656 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6189 (secure 0 0 0) 0x7f1fa01f0d50 con 0x7f1fa00c5260 2023-12-19T19:00:01.414 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:01.414 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/2717901150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6835","nonce":2717901150},{"type":"v1","addr":"172.21.15.138:6837","nonce":2717901150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4986,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6836/3989181473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":3989181473},{"type":"v1","addr":"172.21.15.138:6836","nonce":3989181473}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:59:27.233483+0000","modified":"2023-12-19T18:59:30.251421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4995},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4995":{"gid":4995,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/862459875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":862459875},{"type":"v1","addr":"172.21.15.133:6835","nonce":862459875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:59:45.017800+0000","modified":"2023-12-19T18:59:48.066331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.133:6834/3180094953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":3180094953},{"type":"v1","addr":"172.21.15.133:6834","nonce":3180094953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T19:00:01.416 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 22 2023-12-19T19:00:01.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.410+0000 7f1fa4add640 1 -- 172.21.15.133:0/4224158656 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f80066470 msgr2=0x7f1f80068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:01.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.410+0000 7f1fa4add640 1 --2- 172.21.15.133:0/4224158656 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f80066470 0x7f1f80068930 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00a68a0 tx=0x7f1f88008040 comp rx=0 tx=0).stop 2023-12-19T19:00:01.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.410+0000 7f1fa4add640 1 -- 172.21.15.133:0/4224158656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fa00c5260 msgr2=0x7f1fa01513a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:01.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.410+0000 7f1fa4add640 1 --2- 172.21.15.133:0/4224158656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fa00c5260 0x7f1fa01513a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000c480 tx=0x7f1f9000c940 comp rx=0 tx=0).stop 2023-12-19T19:00:01.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.414+0000 7f1fa4add640 1 -- 172.21.15.133:0/4224158656 shutdown_connections 2023-12-19T19:00:01.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.414+0000 7f1fa4add640 1 --2- 172.21.15.133:0/4224158656 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f80066470 0x7f1f80068930 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.414+0000 7f1fa4add640 1 --2- 172.21.15.133:0/4224158656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fa00c60f0 0x7f1fa01ed3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.414+0000 7f1fa4add640 1 --2- 172.21.15.133:0/4224158656 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fa00c5640 0x7f1fa014cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.414+0000 7f1fa4add640 1 --2- 172.21.15.133:0/4224158656 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fa00c5260 0x7f1fa01513a0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.414+0000 7f1fa4add640 1 -- 172.21.15.133:0/4224158656 >> 172.21.15.133:0/4224158656 conn(0x7f1fa006a5b0 msgr2=0x7f1fa006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:01.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.414+0000 7f1fa4add640 1 -- 172.21.15.133:0/4224158656 shutdown_connections 2023-12-19T19:00:01.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.414+0000 7f1fa4add640 1 -- 172.21.15.133:0/4224158656 wait complete. 2023-12-19T19:00:01.435 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:00:01.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.570+0000 7f193d32a640 1 Processor -- start 2023-12-19T19:00:01.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.570+0000 7f193d32a640 1 -- start start 2023-12-19T19:00:01.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.570+0000 7f193d32a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f19380c5260 0x7f193806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:01.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.570+0000 7f193d32a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f19380c5640 0x7f19380c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:01.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.570+0000 7f193d32a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19380c60f0 0x7f1938155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:01.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.570+0000 7f193d32a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19380c17f0 con 0x7f19380c5260 2023-12-19T19:00:01.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.570+0000 7f193d32a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19380c2580 con 0x7f19380c5640 2023-12-19T19:00:01.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.570+0000 7f193d32a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19380c1a00 con 0x7f19380c60f0 2023-12-19T19:00:01.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.570+0000 7f1936ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f19380c5260 0x7f193806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:01.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.570+0000 7f1936ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f19380c5260 0x7f193806d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58828/0 (socket says 172.21.15.133:58828) 2023-12-19T19:00:01.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.570+0000 7f1936ffd640 1 -- 172.21.15.133:0/2030682134 learned_addr learned my addr 172.21.15.133:0/2030682134 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:01.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.570+0000 7f192e7fc640 1 --2- 172.21.15.133:0/2030682134 >> v2:172.21.15.138:3300/0 conn(0x7f19380c5640 0x7f19380c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:01.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.570+0000 7f19377fe640 1 --2- 172.21.15.133:0/2030682134 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19380c60f0 0x7f1938155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:01.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.570+0000 7f1936ffd640 1 -- 172.21.15.133:0/2030682134 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19380c60f0 msgr2=0x7f1938155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:01.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.570+0000 7f1936ffd640 1 --2- 172.21.15.133:0/2030682134 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19380c60f0 0x7f1938155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.570+0000 7f1936ffd640 1 -- 172.21.15.133:0/2030682134 >> v2:172.21.15.138:3300/0 conn(0x7f19380c5640 msgr2=0x7f19380c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:01.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.570+0000 7f1936ffd640 1 --2- 172.21.15.133:0/2030682134 >> v2:172.21.15.138:3300/0 conn(0x7f19380c5640 0x7f19380c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.570+0000 7f1936ffd640 1 -- 172.21.15.133:0/2030682134 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19380c1ce0 con 0x7f19380c5260 2023-12-19T19:00:01.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.574+0000 7f1936ffd640 1 --2- 172.21.15.133:0/2030682134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19380c5260 0x7f193806d5b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f193806b390 tx=0x7f192801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28fe79b511d77aab server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:01.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.574+0000 7f19367fc640 1 -- 172.21.15.133:0/2030682134 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19280a56a0 con 0x7f19380c5260 2023-12-19T19:00:01.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.574+0000 7f19367fc640 1 -- 172.21.15.133:0/2030682134 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19280a5800 con 0x7f19380c5260 2023-12-19T19:00:01.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.574+0000 7f19367fc640 1 -- 172.21.15.133:0/2030682134 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19280a5b90 con 0x7f19380c5260 2023-12-19T19:00:01.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.574+0000 7f193d32a640 1 -- 172.21.15.133:0/2030682134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19380c5260 msgr2=0x7f193806d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:01.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.574+0000 7f193d32a640 1 --2- 172.21.15.133:0/2030682134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19380c5260 0x7f193806d5b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f193806b390 tx=0x7f192801c910 comp rx=0 tx=0).stop 2023-12-19T19:00:01.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.574+0000 7f193d32a640 1 -- 172.21.15.133:0/2030682134 shutdown_connections 2023-12-19T19:00:01.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.574+0000 7f193d32a640 1 --2- 172.21.15.133:0/2030682134 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19380c60f0 0x7f1938155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.574+0000 7f193d32a640 1 --2- 172.21.15.133:0/2030682134 >> v2:172.21.15.138:3300/0 conn(0x7f19380c5640 0x7f19380c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.574+0000 7f193d32a640 1 --2- 172.21.15.133:0/2030682134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19380c5260 0x7f193806d5b0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.574+0000 7f193d32a640 1 -- 172.21.15.133:0/2030682134 >> 172.21.15.133:0/2030682134 conn(0x7f193806a5b0 msgr2=0x7f193806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:01.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.574+0000 7f193d32a640 1 -- 172.21.15.133:0/2030682134 shutdown_connections 2023-12-19T19:00:01.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.574+0000 7f193d32a640 1 -- 172.21.15.133:0/2030682134 wait complete. 2023-12-19T19:00:01.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.578+0000 7f193d32a640 1 Processor -- start 2023-12-19T19:00:01.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.578+0000 7f193d32a640 1 -- start start 2023-12-19T19:00:01.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.578+0000 7f193d32a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19380c5260 0x7f193814c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:01.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.578+0000 7f193d32a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19380c5640 0x7f1938071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:01.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.578+0000 7f193d32a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19380c60f0 0x7f1938150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:01.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.578+0000 7f193d32a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19381518f0 con 0x7f19380c5640 2023-12-19T19:00:01.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.578+0000 7f193d32a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193814c8f0 con 0x7f19380c60f0 2023-12-19T19:00:01.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.578+0000 7f193d32a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193814c0d0 con 0x7f19380c5260 2023-12-19T19:00:01.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.578+0000 7f192e7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19380c5640 0x7f1938071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:01.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.578+0000 7f192e7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19380c5640 0x7f1938071100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58832/0 (socket says 172.21.15.133:58832) 2023-12-19T19:00:01.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.578+0000 7f192e7fc640 1 -- 172.21.15.133:0/3346409012 learned_addr learned my addr 172.21.15.133:0/3346409012 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:01.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.578+0000 7f19377fe640 1 --2- 172.21.15.133:0/3346409012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19380c60f0 0x7f1938150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:01.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.578+0000 7f1936ffd640 1 --2- 172.21.15.133:0/3346409012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19380c5260 0x7f193814c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:01.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.578+0000 7f192e7fc640 1 -- 172.21.15.133:0/3346409012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19380c5260 msgr2=0x7f193814c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:01.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.578+0000 7f192e7fc640 1 --2- 172.21.15.133:0/3346409012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19380c5260 0x7f193814c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.578+0000 7f192e7fc640 1 -- 172.21.15.133:0/3346409012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19380c60f0 msgr2=0x7f1938150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:01.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.578+0000 7f192e7fc640 1 --2- 172.21.15.133:0/3346409012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19380c60f0 0x7f1938150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.578+0000 7f192e7fc640 1 -- 172.21.15.133:0/3346409012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1928009b30 con 0x7f19380c5640 2023-12-19T19:00:01.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.578+0000 7f192e7fc640 1 --2- 172.21.15.133:0/3346409012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19380c5640 0x7f1938071100 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f192000d7d0 tx=0x7f192000dbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:01.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.578+0000 7f192ffff640 1 -- 172.21.15.133:0/3346409012 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19200096a0 con 0x7f19380c5640 2023-12-19T19:00:01.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.578+0000 7f192ffff640 1 -- 172.21.15.133:0/3346409012 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1920009800 con 0x7f19380c5640 2023-12-19T19:00:01.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.578+0000 7f193d32a640 1 -- 172.21.15.133:0/3346409012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19381edaf0 con 0x7f19380c5640 2023-12-19T19:00:01.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.582+0000 7f192ffff640 1 -- 172.21.15.133:0/3346409012 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1920009bb0 con 0x7f19380c5640 2023-12-19T19:00:01.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.582+0000 7f193d32a640 1 -- 172.21.15.133:0/3346409012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19381eddd0 con 0x7f19380c5640 2023-12-19T19:00:01.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.582+0000 7f193d32a640 1 -- 172.21.15.133:0/3346409012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1938068400 con 0x7f19380c5640 2023-12-19T19:00:01.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.582+0000 7f192ffff640 1 -- 172.21.15.133:0/3346409012 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1920009d10 con 0x7f19380c5640 2023-12-19T19:00:01.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.582+0000 7f192ffff640 1 --2- 172.21.15.133:0/3346409012 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1918066470 0x7f1918068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:01.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.582+0000 7f192ffff640 1 -- 172.21.15.133:0/3346409012 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f19200847d0 con 0x7f19380c5640 2023-12-19T19:00:01.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.582+0000 7f1936ffd640 1 --2- 172.21.15.133:0/3346409012 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1918066470 0x7f1918068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:01.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.586+0000 7f1936ffd640 1 --2- 172.21.15.133:0/3346409012 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1918066470 0x7f1918068930 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f19280ae000 tx=0x7f19280a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:01.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.586+0000 7f192ffff640 1 -- 172.21.15.133:0/3346409012 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f19200518e0 con 0x7f19380c5640 2023-12-19T19:00:01.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.746+0000 7f193d32a640 1 -- 172.21.15.133:0/3346409012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f193806d390 con 0x7f19380c5640 2023-12-19T19:00:01.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.746+0000 7f192ffff640 1 -- 172.21.15.133:0/3346409012 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20265 (secure 0 0 0) 0x7f1920054f00 con 0x7f19380c5640 2023-12-19T19:00:01.749 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:01.749 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":35,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:59:46.667472+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:59:25.798150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T18:59:26.236078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T18:59:42.757628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-19T18:59:44.017454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:00:01.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.746+0000 7f193d32a640 1 -- 172.21.15.133:0/3346409012 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1918066470 msgr2=0x7f1918068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:01.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.746+0000 7f193d32a640 1 --2- 172.21.15.133:0/3346409012 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1918066470 0x7f1918068930 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f19280ae000 tx=0x7f19280a7070 comp rx=0 tx=0).stop 2023-12-19T19:00:01.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.746+0000 7f193d32a640 1 -- 172.21.15.133:0/3346409012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19380c5640 msgr2=0x7f1938071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:01.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.746+0000 7f193d32a640 1 --2- 172.21.15.133:0/3346409012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19380c5640 0x7f1938071100 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f192000d7d0 tx=0x7f192000dbd0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.746+0000 7f193d32a640 1 -- 172.21.15.133:0/3346409012 shutdown_connections 2023-12-19T19:00:01.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.746+0000 7f193d32a640 1 --2- 172.21.15.133:0/3346409012 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1918066470 0x7f1918068930 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.746+0000 7f193d32a640 1 --2- 172.21.15.133:0/3346409012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19380c60f0 0x7f1938150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.746+0000 7f193d32a640 1 --2- 172.21.15.133:0/3346409012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19380c5640 0x7f1938071100 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.746+0000 7f193d32a640 1 --2- 172.21.15.133:0/3346409012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19380c5260 0x7f193814c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.746+0000 7f193d32a640 1 -- 172.21.15.133:0/3346409012 >> 172.21.15.133:0/3346409012 conn(0x7f193806a5b0 msgr2=0x7f19380bf990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:01.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.746+0000 7f193d32a640 1 -- 172.21.15.133:0/3346409012 shutdown_connections 2023-12-19T19:00:01.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.746+0000 7f193d32a640 1 -- 172.21.15.133:0/3346409012 wait complete. 2023-12-19T19:00:01.770 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:59:25.798150+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:59:26.236078+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-19T18:59:42.757628+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-19T18:59:44.017454+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T19:00:01.771 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T19:00:01.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.910+0000 7fa8f389c640 1 Processor -- start 2023-12-19T19:00:01.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.910+0000 7fa8f389c640 1 -- start start 2023-12-19T19:00:01.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.910+0000 7fa8f389c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa8ec1560e0 0x7fa8ec15ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:01.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.910+0000 7fa8f389c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8ec06d520 0x7fa8ec159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:01.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.910+0000 7fa8f389c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa8ec0bffc0 0x7fa8ec0c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:01.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.910+0000 7fa8f389c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8ec15c600 con 0x7fa8ec1560e0 2023-12-19T19:00:01.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.910+0000 7fa8f389c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8ec1594e0 con 0x7fa8ec0bffc0 2023-12-19T19:00:01.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.910+0000 7fa8f389c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec1597c0 con 0x7fa8ec06d520 2023-12-19T19:00:01.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.910+0000 7fa8f1638640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa8ec1560e0 0x7fa8ec15ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:01.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.910+0000 7fa8f1638640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa8ec1560e0 0x7fa8ec15ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58844/0 (socket says 172.21.15.133:58844) 2023-12-19T19:00:01.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.910+0000 7fa8f1638640 1 -- 172.21.15.133:0/820277459 learned_addr learned my addr 172.21.15.133:0/820277459 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:01.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.910+0000 7fa8f0e37640 1 --2- 172.21.15.133:0/820277459 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8ec06d520 0x7fa8ec159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:01.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.910+0000 7fa8f1e39640 1 --2- 172.21.15.133:0/820277459 >> v2:172.21.15.138:3300/0 conn(0x7fa8ec0bffc0 0x7fa8ec0c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:01.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.910+0000 7fa8f1638640 1 -- 172.21.15.133:0/820277459 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8ec06d520 msgr2=0x7fa8ec159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:01.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.910+0000 7fa8f1638640 1 --2- 172.21.15.133:0/820277459 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8ec06d520 0x7fa8ec159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.910+0000 7fa8f1638640 1 -- 172.21.15.133:0/820277459 >> v2:172.21.15.138:3300/0 conn(0x7fa8ec0bffc0 msgr2=0x7fa8ec0c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:01.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.910+0000 7fa8f1638640 1 --2- 172.21.15.133:0/820277459 >> v2:172.21.15.138:3300/0 conn(0x7fa8ec0bffc0 0x7fa8ec0c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.910+0000 7fa8f1638640 1 -- 172.21.15.133:0/820277459 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ec15bfb0 con 0x7fa8ec1560e0 2023-12-19T19:00:01.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.914+0000 7fa8f1638640 1 --2- 172.21.15.133:0/820277459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8ec1560e0 0x7fa8ec15ca90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0c66a0 tx=0x7fa8e801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e3c30596a251d38 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:01.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.914+0000 7fa8e3fff640 1 -- 172.21.15.133:0/820277459 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80ac600 con 0x7fa8ec1560e0 2023-12-19T19:00:01.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.914+0000 7fa8e3fff640 1 -- 172.21.15.133:0/820277459 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e80a8050 con 0x7fa8ec1560e0 2023-12-19T19:00:01.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.914+0000 7fa8e3fff640 1 -- 172.21.15.133:0/820277459 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80ac980 con 0x7fa8ec1560e0 2023-12-19T19:00:01.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.914+0000 7fa8f389c640 1 -- 172.21.15.133:0/820277459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8ec1560e0 msgr2=0x7fa8ec15ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:01.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.914+0000 7fa8f389c640 1 --2- 172.21.15.133:0/820277459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8ec1560e0 0x7fa8ec15ca90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0c66a0 tx=0x7fa8e801c4d0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.914+0000 7fa8f389c640 1 -- 172.21.15.133:0/820277459 shutdown_connections 2023-12-19T19:00:01.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.914+0000 7fa8f389c640 1 --2- 172.21.15.133:0/820277459 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8ec06d520 0x7fa8ec159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.914+0000 7fa8f389c640 1 --2- 172.21.15.133:0/820277459 >> v2:172.21.15.138:3300/0 conn(0x7fa8ec0bffc0 0x7fa8ec0c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.914+0000 7fa8f389c640 1 --2- 172.21.15.133:0/820277459 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8ec1560e0 0x7fa8ec15ca90 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.914+0000 7fa8f389c640 1 -- 172.21.15.133:0/820277459 >> 172.21.15.133:0/820277459 conn(0x7fa8ec06a5b0 msgr2=0x7fa8ec06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:01.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.914+0000 7fa8f389c640 1 -- 172.21.15.133:0/820277459 shutdown_connections 2023-12-19T19:00:01.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.914+0000 7fa8f389c640 1 -- 172.21.15.133:0/820277459 wait complete. 2023-12-19T19:00:01.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.914+0000 7fa8f389c640 1 Processor -- start 2023-12-19T19:00:01.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8f389c640 1 -- start start 2023-12-19T19:00:01.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8f389c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8ec06d520 0x7fa8ec14fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:01.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8f389c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8ec0bffc0 0x7fa8ec06fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:01.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8f389c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8ec1560e0 0x7fa8ec0a3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:01.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8f389c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec0a2960 con 0x7fa8ec06d520 2023-12-19T19:00:01.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8f389c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec0a3690 con 0x7fa8ec1560e0 2023-12-19T19:00:01.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8f389c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec0a3a40 con 0x7fa8ec0bffc0 2023-12-19T19:00:01.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8f1638640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8ec06d520 0x7fa8ec14fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:01.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8f1638640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8ec06d520 0x7fa8ec14fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58860/0 (socket says 172.21.15.133:58860) 2023-12-19T19:00:01.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8f1638640 1 -- 172.21.15.133:0/310530856 learned_addr learned my addr 172.21.15.133:0/310530856 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:01.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8f1e39640 1 --2- 172.21.15.133:0/310530856 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8ec1560e0 0x7fa8ec0a3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:01.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8f0e37640 1 --2- 172.21.15.133:0/310530856 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8ec0bffc0 0x7fa8ec06fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:01.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8f1638640 1 -- 172.21.15.133:0/310530856 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8ec0bffc0 msgr2=0x7fa8ec06fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:01.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8f1638640 1 --2- 172.21.15.133:0/310530856 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8ec0bffc0 0x7fa8ec06fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8f1638640 1 -- 172.21.15.133:0/310530856 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8ec1560e0 msgr2=0x7fa8ec0a3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:01.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8f1638640 1 --2- 172.21.15.133:0/310530856 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8ec1560e0 0x7fa8ec0a3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:01.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8f1638640 1 -- 172.21.15.133:0/310530856 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e80094d0 con 0x7fa8ec06d520 2023-12-19T19:00:01.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8f1638640 1 --2- 172.21.15.133:0/310530856 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8ec06d520 0x7fa8ec14fad0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa8e801cd70 tx=0x7fa8e801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:01.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8e1ffb640 1 -- 172.21.15.133:0/310530856 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80b7650 con 0x7fa8ec06d520 2023-12-19T19:00:01.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8e1ffb640 1 -- 172.21.15.133:0/310530856 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e80b77d0 con 0x7fa8ec06d520 2023-12-19T19:00:01.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8e1ffb640 1 -- 172.21.15.133:0/310530856 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80b7b80 con 0x7fa8ec06d520 2023-12-19T19:00:01.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8f389c640 1 -- 172.21.15.133:0/310530856 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ec0a4b90 con 0x7fa8ec06d520 2023-12-19T19:00:01.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8f389c640 1 -- 172.21.15.133:0/310530856 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ec0a5150 con 0x7fa8ec06d520 2023-12-19T19:00:01.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.918+0000 7fa8f389c640 1 -- 172.21.15.133:0/310530856 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8ec0a3bd0 con 0x7fa8ec06d520 2023-12-19T19:00:01.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.922+0000 7fa8e1ffb640 1 -- 172.21.15.133:0/310530856 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa8e80b3070 con 0x7fa8ec06d520 2023-12-19T19:00:01.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.922+0000 7fa8e1ffb640 1 --2- 172.21.15.133:0/310530856 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa8d0066470 0x7fa8d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:01.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.922+0000 7fa8e1ffb640 1 -- 172.21.15.133:0/310530856 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa8e811e710 con 0x7fa8ec06d520 2023-12-19T19:00:01.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.922+0000 7fa8f0e37640 1 --2- 172.21.15.133:0/310530856 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa8d0066470 0x7fa8d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:01.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.922+0000 7fa8f0e37640 1 --2- 172.21.15.133:0/310530856 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa8d0066470 0x7fa8d0068930 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec155660 tx=0x7fa8dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:01.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:01.926+0000 7fa8e1ffb640 1 -- 172.21.15.133:0/310530856 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa8e80eb8d0 con 0x7fa8ec06d520 2023-12-19T19:00:02.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.078+0000 7fa8f389c640 1 -- 172.21.15.133:0/310530856 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8ec068400 con 0x7fa8ec06d520 2023-12-19T19:00:02.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.078+0000 7fa8e1ffb640 1 -- 172.21.15.133:0/310530856 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa8e80eeef0 con 0x7fa8ec06d520 2023-12-19T19:00:02.080 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T19:00:02.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.078+0000 7fa8f389c640 1 -- 172.21.15.133:0/310530856 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa8d0066470 msgr2=0x7fa8d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:02.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.078+0000 7fa8f389c640 1 --2- 172.21.15.133:0/310530856 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa8d0066470 0x7fa8d0068930 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec155660 tx=0x7fa8dc008040 comp rx=0 tx=0).stop 2023-12-19T19:00:02.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.078+0000 7fa8f389c640 1 -- 172.21.15.133:0/310530856 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8ec06d520 msgr2=0x7fa8ec14fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:02.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.078+0000 7fa8f389c640 1 --2- 172.21.15.133:0/310530856 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8ec06d520 0x7fa8ec14fad0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fa8e801cd70 tx=0x7fa8e801ad10 comp rx=0 tx=0).stop 2023-12-19T19:00:02.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.078+0000 7fa8f389c640 1 -- 172.21.15.133:0/310530856 shutdown_connections 2023-12-19T19:00:02.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.078+0000 7fa8f389c640 1 --2- 172.21.15.133:0/310530856 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa8d0066470 0x7fa8d0068930 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.078+0000 7fa8f389c640 1 --2- 172.21.15.133:0/310530856 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa8ec1560e0 0x7fa8ec0a3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.078+0000 7fa8f389c640 1 --2- 172.21.15.133:0/310530856 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa8ec0bffc0 0x7fa8ec06fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.078+0000 7fa8f389c640 1 --2- 172.21.15.133:0/310530856 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8ec06d520 0x7fa8ec14fad0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.078+0000 7fa8f389c640 1 -- 172.21.15.133:0/310530856 >> 172.21.15.133:0/310530856 conn(0x7fa8ec06a5b0 msgr2=0x7fa8ec0c5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:02.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.078+0000 7fa8f389c640 1 -- 172.21.15.133:0/310530856 shutdown_connections 2023-12-19T19:00:02.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.078+0000 7fa8f389c640 1 -- 172.21.15.133:0/310530856 wait complete. 2023-12-19T19:00:02.101 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T19:00:02.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.238+0000 7fa85249c640 1 Processor -- start 2023-12-19T19:00:02.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.238+0000 7fa85249c640 1 -- start start 2023-12-19T19:00:02.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.238+0000 7fa85249c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa84c0c63c0 0x7fa84c0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:02.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.238+0000 7fa85249c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa84c0c4100 0x7fa84c0c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:02.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.238+0000 7fa85249c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa84c0c31c0 con 0x7fa84c0c29e0 2023-12-19T19:00:02.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.238+0000 7fa85249c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa84c0c34a0 con 0x7fa84c0c63c0 2023-12-19T19:00:02.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.238+0000 7fa85249c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa84c0c1030 con 0x7fa84c0c4100 2023-12-19T19:00:02.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.242+0000 7fa84bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa84c0c63c0 0x7fa84c0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:02.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.242+0000 7fa84bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa84c0c63c0 0x7fa84c0c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58862/0 (socket says 172.21.15.133:58862) 2023-12-19T19:00:02.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.242+0000 7fa84bfff640 1 -- 172.21.15.133:0/1421199901 learned_addr learned my addr 172.21.15.133:0/1421199901 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:02.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.242+0000 7fa850a39640 1 --1- 172.21.15.133:0/1421199901 >> v1:172.21.15.133:6789/0 conn(0x7fa84c0c29e0 0x7fa84c0a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41470/0 (socket says 172.21.15.133:41470) 2023-12-19T19:00:02.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.242+0000 7fa84b7fe640 1 --2- 172.21.15.133:0/1421199901 >> v2:172.21.15.138:3300/0 conn(0x7fa84c0c4100 0x7fa84c0c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:02.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.242+0000 7fa84bfff640 1 -- 172.21.15.133:0/1421199901 >> v2:172.21.15.138:3300/0 conn(0x7fa84c0c4100 msgr2=0x7fa84c0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:02.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.242+0000 7fa84bfff640 1 --2- 172.21.15.133:0/1421199901 >> v2:172.21.15.138:3300/0 conn(0x7fa84c0c4100 0x7fa84c0c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.242+0000 7fa84bfff640 1 -- 172.21.15.133:0/1421199901 >> v1:172.21.15.133:6789/0 conn(0x7fa84c0c29e0 legacy=0x7fa84c0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:02.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.242+0000 7fa84bfff640 1 -- 172.21.15.133:0/1421199901 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84c0c1310 con 0x7fa84c0c63c0 2023-12-19T19:00:02.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.242+0000 7fa84affd640 1 -- 172.21.15.133:0/1421199901 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868994806 0 0) 0x7fa84c0c31c0 con 0x7fa84c0c29e0 2023-12-19T19:00:02.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.242+0000 7fa84bfff640 1 --2- 172.21.15.133:0/1421199901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa84c0c63c0 0x7fa84c0c06d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa84c0a8b40 tx=0x7fa83c01ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08f029037a92feb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:02.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa84affd640 1 -- 172.21.15.133:0/1421199901 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c0a7a70 con 0x7fa84c0c63c0 2023-12-19T19:00:02.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa84affd640 1 -- 172.21.15.133:0/1421199901 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c0a7bd0 con 0x7fa84c0c63c0 2023-12-19T19:00:02.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa84affd640 1 -- 172.21.15.133:0/1421199901 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c0af440 con 0x7fa84c0c63c0 2023-12-19T19:00:02.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa85249c640 1 -- 172.21.15.133:0/1421199901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa84c0c63c0 msgr2=0x7fa84c0c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:02.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa85249c640 1 --2- 172.21.15.133:0/1421199901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa84c0c63c0 0x7fa84c0c06d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa84c0a8b40 tx=0x7fa83c01ea80 comp rx=0 tx=0).stop 2023-12-19T19:00:02.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa85249c640 1 -- 172.21.15.133:0/1421199901 shutdown_connections 2023-12-19T19:00:02.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa85249c640 1 --2- 172.21.15.133:0/1421199901 >> v2:172.21.15.138:3300/0 conn(0x7fa84c0c4100 0x7fa84c0c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa85249c640 1 --2- 172.21.15.133:0/1421199901 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa84c0c63c0 0x7fa84c0c06d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa85249c640 1 -- 172.21.15.133:0/1421199901 >> 172.21.15.133:0/1421199901 conn(0x7fa84c06a5b0 msgr2=0x7fa84c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:02.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa85249c640 1 -- 172.21.15.133:0/1421199901 shutdown_connections 2023-12-19T19:00:02.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa85249c640 1 -- 172.21.15.133:0/1421199901 wait complete. 2023-12-19T19:00:02.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa85249c640 1 Processor -- start 2023-12-19T19:00:02.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa85249c640 1 -- start start 2023-12-19T19:00:02.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa85249c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa84c0c29e0 0x7fa84c0befe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:02.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa85249c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa84c0c4100 0x7fa84c1f0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:02.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa85249c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa84c0c63c0 0x7fa84c1f0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:02.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa85249c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c099e30 con 0x7fa84c0c63c0 2023-12-19T19:00:02.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa85249c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c0bfaa0 con 0x7fa84c0c4100 2023-12-19T19:00:02.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa85249c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c0c0290 con 0x7fa84c0c29e0 2023-12-19T19:00:02.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa850a39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa84c0c63c0 0x7fa84c1f0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:02.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa850a39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa84c0c63c0 0x7fa84c1f0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58870/0 (socket says 172.21.15.133:58870) 2023-12-19T19:00:02.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa850a39640 1 -- 172.21.15.133:0/2884175778 learned_addr learned my addr 172.21.15.133:0/2884175778 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:02.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa84b7fe640 1 --2- 172.21.15.133:0/2884175778 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa84c0c4100 0x7fa84c1f0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:02.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.246+0000 7fa84bfff640 1 --2- 172.21.15.133:0/2884175778 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa84c0c29e0 0x7fa84c0befe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:02.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.250+0000 7fa850a39640 1 -- 172.21.15.133:0/2884175778 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa84c0c29e0 msgr2=0x7fa84c0befe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:02.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.250+0000 7fa850a39640 1 --2- 172.21.15.133:0/2884175778 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa84c0c29e0 0x7fa84c0befe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.250+0000 7fa850a39640 1 -- 172.21.15.133:0/2884175778 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa84c0c4100 msgr2=0x7fa84c1f0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:02.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.250+0000 7fa850a39640 1 --2- 172.21.15.133:0/2884175778 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa84c0c4100 0x7fa84c1f0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.250+0000 7fa850a39640 1 -- 172.21.15.133:0/2884175778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa83c00b770 con 0x7fa84c0c63c0 2023-12-19T19:00:02.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.250+0000 7fa84bfff640 1 --2- 172.21.15.133:0/2884175778 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa84c0c29e0 0x7fa84c0befe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:02.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.250+0000 7fa84b7fe640 1 --2- 172.21.15.133:0/2884175778 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa84c0c4100 0x7fa84c1f0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:02.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.250+0000 7fa850a39640 1 --2- 172.21.15.133:0/2884175778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa84c0c63c0 0x7fa84c1f0eb0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa844001570 tx=0x7fa84400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:02.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.250+0000 7fa848ff9640 1 -- 172.21.15.133:0/2884175778 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84400a640 con 0x7fa84c0c63c0 2023-12-19T19:00:02.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.250+0000 7fa848ff9640 1 -- 172.21.15.133:0/2884175778 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84400a7c0 con 0x7fa84c0c63c0 2023-12-19T19:00:02.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.250+0000 7fa85249c640 1 -- 172.21.15.133:0/2884175778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa84c1f1500 con 0x7fa84c0c63c0 2023-12-19T19:00:02.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.250+0000 7fa848ff9640 1 -- 172.21.15.133:0/2884175778 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84400ab70 con 0x7fa84c0c63c0 2023-12-19T19:00:02.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.250+0000 7fa85249c640 1 -- 172.21.15.133:0/2884175778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84c0c0830 con 0x7fa84c0c63c0 2023-12-19T19:00:02.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.250+0000 7fa85249c640 1 -- 172.21.15.133:0/2884175778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa84c099fa0 con 0x7fa84c0c63c0 2023-12-19T19:00:02.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.250+0000 7fa848ff9640 1 -- 172.21.15.133:0/2884175778 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa84400acd0 con 0x7fa84c0c63c0 2023-12-19T19:00:02.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.250+0000 7fa848ff9640 1 --2- 172.21.15.133:0/2884175778 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa838066470 0x7fa838068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:02.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.250+0000 7fa848ff9640 1 -- 172.21.15.133:0/2884175778 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa844083990 con 0x7fa84c0c63c0 2023-12-19T19:00:02.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.250+0000 7fa84bfff640 1 --2- 172.21.15.133:0/2884175778 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa838066470 0x7fa838068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:02.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.254+0000 7fa84bfff640 1 --2- 172.21.15.133:0/2884175778 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa838066470 0x7fa838068930 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa83c0b1000 tx=0x7fa83c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:02.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.254+0000 7fa848ff9640 1 -- 172.21.15.133:0/2884175778 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa844050b40 con 0x7fa84c0c63c0 2023-12-19T19:00:02.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.406+0000 7fa85249c640 1 -- 172.21.15.133:0/2884175778 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa84c068400 con 0x7fa84c0c63c0 2023-12-19T19:00:02.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.406+0000 7fa848ff9640 1 -- 172.21.15.133:0/2884175778 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa844018020 con 0x7fa84c0c63c0 2023-12-19T19:00:02.410 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:00:02.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.410+0000 7fa85249c640 1 -- 172.21.15.133:0/2884175778 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa838066470 msgr2=0x7fa838068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:02.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.410+0000 7fa85249c640 1 --2- 172.21.15.133:0/2884175778 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa838066470 0x7fa838068930 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa83c0b1000 tx=0x7fa83c008040 comp rx=0 tx=0).stop 2023-12-19T19:00:02.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.410+0000 7fa85249c640 1 -- 172.21.15.133:0/2884175778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa84c0c63c0 msgr2=0x7fa84c1f0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:02.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.410+0000 7fa85249c640 1 --2- 172.21.15.133:0/2884175778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa84c0c63c0 0x7fa84c1f0eb0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa844001570 tx=0x7fa84400cca0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.410+0000 7fa85249c640 1 -- 172.21.15.133:0/2884175778 shutdown_connections 2023-12-19T19:00:02.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.410+0000 7fa85249c640 1 --2- 172.21.15.133:0/2884175778 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa838066470 0x7fa838068930 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.410+0000 7fa85249c640 1 --2- 172.21.15.133:0/2884175778 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa84c0c63c0 0x7fa84c1f0eb0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.410+0000 7fa85249c640 1 --2- 172.21.15.133:0/2884175778 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa84c0c4100 0x7fa84c1f0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.410+0000 7fa85249c640 1 --2- 172.21.15.133:0/2884175778 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa84c0c29e0 0x7fa84c0befe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.410+0000 7fa85249c640 1 -- 172.21.15.133:0/2884175778 >> 172.21.15.133:0/2884175778 conn(0x7fa84c06a5b0 msgr2=0x7fa84c0706f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:02.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.410+0000 7fa85249c640 1 -- 172.21.15.133:0/2884175778 shutdown_connections 2023-12-19T19:00:02.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.410+0000 7fa85249c640 1 -- 172.21.15.133:0/2884175778 wait complete. 2023-12-19T19:00:02.431 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T19:00:02.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.566+0000 7f2e18d72640 1 Processor -- start 2023-12-19T19:00:02.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.570+0000 7f2e18d72640 1 -- start start 2023-12-19T19:00:02.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.570+0000 7f2e18d72640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2e1414b010 0x7f2e140bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:02.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.570+0000 7f2e18d72640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1406a5b0 con 0x7f2e14073a70 2023-12-19T19:00:02.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.570+0000 7f2e18d72640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1406b710 con 0x7f2e14157c20 2023-12-19T19:00:02.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.570+0000 7f2e18d72640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e140c1d60 con 0x7f2e1414b010 2023-12-19T19:00:02.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.570+0000 7f2e1259c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2e1414b010 0x7f2e140bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:02.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.570+0000 7f2e1259c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2e1414b010 0x7f2e140bf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58882/0 (socket says 172.21.15.133:58882) 2023-12-19T19:00:02.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.570+0000 7f2e1259c640 1 -- 172.21.15.133:0/2729152846 learned_addr learned my addr 172.21.15.133:0/2729152846 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:02.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.570+0000 7f2e11d9b640 1 --1- 172.21.15.133:0/2729152846 >> v1:172.21.15.133:6789/0 conn(0x7f2e14073a70 0x7f2e1406b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41476/0 (socket says 172.21.15.133:41476) 2023-12-19T19:00:02.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.570+0000 7f2e1259c640 1 -- 172.21.15.133:0/2729152846 >> v1:172.21.15.138:6789/0 conn(0x7f2e14157c20 legacy=0x7f2e14158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:02.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.570+0000 7f2e1259c640 1 -- 172.21.15.133:0/2729152846 >> v1:172.21.15.133:6789/0 conn(0x7f2e14073a70 legacy=0x7f2e1406b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:02.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.570+0000 7f2e1159a640 1 -- 172.21.15.133:0/2729152846 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633487338 0 0) 0x7f2e1406a5b0 con 0x7f2e14073a70 2023-12-19T19:00:02.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.570+0000 7f2e1259c640 1 -- 172.21.15.133:0/2729152846 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e140c2040 con 0x7f2e1414b010 2023-12-19T19:00:02.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.574+0000 7f2e1259c640 1 --2- 172.21.15.133:0/2729152846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e1414b010 0x7f2e140bf9f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2e04009870 tx=0x7f2e0401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d20a593d02ab6a92 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:02.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.574+0000 7f2e1159a640 1 -- 172.21.15.133:0/2729152846 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e040a8a30 con 0x7f2e1414b010 2023-12-19T19:00:02.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.574+0000 7f2e1159a640 1 -- 172.21.15.133:0/2729152846 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e040a8b90 con 0x7f2e1414b010 2023-12-19T19:00:02.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.574+0000 7f2e1159a640 1 -- 172.21.15.133:0/2729152846 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e040b0440 con 0x7f2e1414b010 2023-12-19T19:00:02.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.574+0000 7f2e18d72640 1 -- 172.21.15.133:0/2729152846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e1414b010 msgr2=0x7f2e140bf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:02.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.574+0000 7f2e18d72640 1 --2- 172.21.15.133:0/2729152846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e1414b010 0x7f2e140bf9f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f2e04009870 tx=0x7f2e0401ed30 comp rx=0 tx=0).stop 2023-12-19T19:00:02.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.574+0000 7f2e18d72640 1 -- 172.21.15.133:0/2729152846 shutdown_connections 2023-12-19T19:00:02.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.574+0000 7f2e18d72640 1 --2- 172.21.15.133:0/2729152846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e1414b010 0x7f2e140bf9f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.574+0000 7f2e18d72640 1 -- 172.21.15.133:0/2729152846 >> 172.21.15.133:0/2729152846 conn(0x7f2e140c30c0 msgr2=0x7f2e140c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:02.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.574+0000 7f2e18d72640 1 -- 172.21.15.133:0/2729152846 shutdown_connections 2023-12-19T19:00:02.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.574+0000 7f2e18d72640 1 -- 172.21.15.133:0/2729152846 wait complete. 2023-12-19T19:00:02.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.574+0000 7f2e18d72640 1 Processor -- start 2023-12-19T19:00:02.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.574+0000 7f2e18d72640 1 -- start start 2023-12-19T19:00:02.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.578+0000 7f2e18d72640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e14073a70 0x7f2e140c5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:02.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.578+0000 7f2e18d72640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e1414b010 0x7f2e141430f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:02.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.578+0000 7f2e18d72640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e14157c20 0x7f2e14143630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:02.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.578+0000 7f2e18d72640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e141ee400 con 0x7f2e14157c20 2023-12-19T19:00:02.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.578+0000 7f2e18d72640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e140ac9e0 con 0x7f2e14073a70 2023-12-19T19:00:02.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.578+0000 7f2e18d72640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e141eded0 con 0x7f2e1414b010 2023-12-19T19:00:02.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.578+0000 7f2e12d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e14157c20 0x7f2e14143630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:02.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.578+0000 7f2e12d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e14157c20 0x7f2e14143630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58898/0 (socket says 172.21.15.133:58898) 2023-12-19T19:00:02.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.578+0000 7f2e12d9d640 1 -- 172.21.15.133:0/1675548317 learned_addr learned my addr 172.21.15.133:0/1675548317 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:02.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.578+0000 7f2e11d9b640 1 --2- 172.21.15.133:0/1675548317 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e1414b010 0x7f2e141430f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:02.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.578+0000 7f2e1259c640 1 --2- 172.21.15.133:0/1675548317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e14073a70 0x7f2e140c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:02.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.578+0000 7f2e12d9d640 1 -- 172.21.15.133:0/1675548317 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e1414b010 msgr2=0x7f2e141430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:02.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.578+0000 7f2e12d9d640 1 --2- 172.21.15.133:0/1675548317 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e1414b010 0x7f2e141430f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.578+0000 7f2e12d9d640 1 -- 172.21.15.133:0/1675548317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e14073a70 msgr2=0x7f2e140c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:02.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.578+0000 7f2e12d9d640 1 --2- 172.21.15.133:0/1675548317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e14073a70 0x7f2e140c5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.578+0000 7f2e12d9d640 1 -- 172.21.15.133:0/1675548317 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e040094d0 con 0x7f2e14157c20 2023-12-19T19:00:02.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.578+0000 7f2e12d9d640 1 --2- 172.21.15.133:0/1675548317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e14157c20 0x7f2e14143630 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00c760 tx=0x7f2e0c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:02.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.578+0000 7f2e02ffd640 1 -- 172.21.15.133:0/1675548317 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c003b80 con 0x7f2e14157c20 2023-12-19T19:00:02.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.578+0000 7f2e02ffd640 1 -- 172.21.15.133:0/1675548317 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c003ce0 con 0x7f2e14157c20 2023-12-19T19:00:02.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.578+0000 7f2e02ffd640 1 -- 172.21.15.133:0/1675548317 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c00aa30 con 0x7f2e14157c20 2023-12-19T19:00:02.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.578+0000 7f2e18d72640 1 -- 172.21.15.133:0/1675548317 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e141514f0 con 0x7f2e14157c20 2023-12-19T19:00:02.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.578+0000 7f2e18d72640 1 -- 172.21.15.133:0/1675548317 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e14150ee0 con 0x7f2e14157c20 2023-12-19T19:00:02.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.578+0000 7f2e18d72640 1 -- 172.21.15.133:0/1675548317 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e14150d40 con 0x7f2e14157c20 2023-12-19T19:00:02.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.582+0000 7f2e02ffd640 1 -- 172.21.15.133:0/1675548317 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2e0c00ab90 con 0x7f2e14157c20 2023-12-19T19:00:02.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.582+0000 7f2e02ffd640 1 --2- 172.21.15.133:0/1675548317 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2df4066470 0x7f2df4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:02.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.582+0000 7f2e02ffd640 1 -- 172.21.15.133:0/1675548317 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2e0c083d90 con 0x7f2e14157c20 2023-12-19T19:00:02.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.582+0000 7f2e1259c640 1 --2- 172.21.15.133:0/1675548317 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2df4066470 0x7f2df4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:02.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.582+0000 7f2e1259c640 1 --2- 172.21.15.133:0/1675548317 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2df4066470 0x7f2df4068930 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2e040b2000 tx=0x7f2e04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:02.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.586+0000 7f2e02ffd640 1 -- 172.21.15.133:0/1675548317 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2e14150d40 con 0x7f2e14157c20 2023-12-19T19:00:02.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.734+0000 7f2e18d72640 1 -- 172.21.15.133:0/1675548317 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2e14150d40 con 0x7f2e14157c20 2023-12-19T19:00:02.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.734+0000 7f2e02ffd640 1 -- 172.21.15.133:0/1675548317 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2e14150d40 con 0x7f2e14157c20 2023-12-19T19:00:02.739 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:00:02.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.738+0000 7f2e18d72640 1 -- 172.21.15.133:0/1675548317 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2df4066470 msgr2=0x7f2df4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:02.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.738+0000 7f2e18d72640 1 --2- 172.21.15.133:0/1675548317 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2df4066470 0x7f2df4068930 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2e040b2000 tx=0x7f2e04009040 comp rx=0 tx=0).stop 2023-12-19T19:00:02.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.738+0000 7f2e18d72640 1 -- 172.21.15.133:0/1675548317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e14157c20 msgr2=0x7f2e14143630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:02.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.738+0000 7f2e18d72640 1 --2- 172.21.15.133:0/1675548317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e14157c20 0x7f2e14143630 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00c760 tx=0x7f2e0c00cc20 comp rx=0 tx=0).stop 2023-12-19T19:00:02.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.738+0000 7f2e18d72640 1 -- 172.21.15.133:0/1675548317 shutdown_connections 2023-12-19T19:00:02.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.738+0000 7f2e18d72640 1 --2- 172.21.15.133:0/1675548317 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2df4066470 0x7f2df4068930 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.738+0000 7f2e18d72640 1 --2- 172.21.15.133:0/1675548317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e14157c20 0x7f2e14143630 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.738+0000 7f2e18d72640 1 --2- 172.21.15.133:0/1675548317 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e1414b010 0x7f2e141430f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.738+0000 7f2e18d72640 1 --2- 172.21.15.133:0/1675548317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e14073a70 0x7f2e140c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.738+0000 7f2e18d72640 1 -- 172.21.15.133:0/1675548317 >> 172.21.15.133:0/1675548317 conn(0x7f2e140c30c0 msgr2=0x7f2e14072690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:02.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.738+0000 7f2e18d72640 1 -- 172.21.15.133:0/1675548317 shutdown_connections 2023-12-19T19:00:02.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.738+0000 7f2e18d72640 1 -- 172.21.15.133:0/1675548317 wait complete. 2023-12-19T19:00:02.760 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-19T19:00:02.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.898+0000 7f960b617640 1 Processor -- start 2023-12-19T19:00:02.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.898+0000 7f960b617640 1 -- start start 2023-12-19T19:00:02.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.898+0000 7f960b617640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9604152030 0x7f96040c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:02.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.898+0000 7f960b617640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f960406c470 0x7f9604157c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:02.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.898+0000 7f960b617640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9604154b60 con 0x7f9604154ff0 2023-12-19T19:00:02.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.898+0000 7f960b617640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9604152410 con 0x7f960406c470 2023-12-19T19:00:02.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.898+0000 7f960b617640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96040c1820 con 0x7f9604152030 2023-12-19T19:00:02.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.898+0000 7f9608bb2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f960406c470 0x7f9604157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:02.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.898+0000 7f9609bb4640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9604154ff0 0x7f96040c2270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41492/0 (socket says 172.21.15.133:41492) 2023-12-19T19:00:02.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.898+0000 7f9609bb4640 1 -- 172.21.15.133:0/4090649385 learned_addr learned my addr 172.21.15.133:0/4090649385 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:02.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.898+0000 7f9608bb2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f960406c470 0x7f9604157c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58908/0 (socket says 172.21.15.133:58908) 2023-12-19T19:00:02.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.898+0000 7f96093b3640 1 --2- 172.21.15.133:0/4090649385 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9604152030 0x7f96040c0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:02.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.902+0000 7f9608bb2640 1 -- 172.21.15.133:0/4090649385 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9604152030 msgr2=0x7f96040c0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:02.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.902+0000 7f9608bb2640 1 --2- 172.21.15.133:0/4090649385 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9604152030 0x7f96040c0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.902+0000 7f9608bb2640 1 -- 172.21.15.133:0/4090649385 >> v1:172.21.15.133:6789/0 conn(0x7f9604154ff0 legacy=0x7f96040c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:02.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.902+0000 7f9608bb2640 1 -- 172.21.15.133:0/4090649385 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96040c1260 con 0x7f960406c470 2023-12-19T19:00:02.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.902+0000 7f95fbfff640 1 -- 172.21.15.133:0/4090649385 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1252732328 0 0) 0x7f9604154b60 con 0x7f9604154ff0 2023-12-19T19:00:02.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.902+0000 7f9608bb2640 1 --2- 172.21.15.133:0/4090649385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f960406c470 0x7f9604157c90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f95f40097c0 tx=0x7f95f401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26f8a62980e7efc5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:02.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.902+0000 7f95fbfff640 1 -- 172.21.15.133:0/4090649385 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f40ab5f0 con 0x7f960406c470 2023-12-19T19:00:02.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.902+0000 7f95fbfff640 1 -- 172.21.15.133:0/4090649385 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f40ab750 con 0x7f960406c470 2023-12-19T19:00:02.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.902+0000 7f95fbfff640 1 -- 172.21.15.133:0/4090649385 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f40abae0 con 0x7f960406c470 2023-12-19T19:00:02.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.902+0000 7f960b617640 1 -- 172.21.15.133:0/4090649385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f960406c470 msgr2=0x7f9604157c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:02.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.902+0000 7f960b617640 1 --2- 172.21.15.133:0/4090649385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f960406c470 0x7f9604157c90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f95f40097c0 tx=0x7f95f401c3f0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.902+0000 7f960b617640 1 -- 172.21.15.133:0/4090649385 shutdown_connections 2023-12-19T19:00:02.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.902+0000 7f960b617640 1 --2- 172.21.15.133:0/4090649385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f960406c470 0x7f9604157c90 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.902+0000 7f960b617640 1 --2- 172.21.15.133:0/4090649385 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9604152030 0x7f96040c0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.902+0000 7f960b617640 1 -- 172.21.15.133:0/4090649385 >> 172.21.15.133:0/4090649385 conn(0x7f960406a5b0 msgr2=0x7f960406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:02.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.902+0000 7f960b617640 1 -- 172.21.15.133:0/4090649385 shutdown_connections 2023-12-19T19:00:02.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f960b617640 1 -- 172.21.15.133:0/4090649385 wait complete. 2023-12-19T19:00:02.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f960b617640 1 Processor -- start 2023-12-19T19:00:02.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f960b617640 1 -- start start 2023-12-19T19:00:02.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f960b617640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f960406c470 0x7f96041f0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:02.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f960b617640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9604152030 0x7f960414e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:02.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f960b617640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9604154ff0 0x7f9604149c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:02.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f960b617640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9604157d20 con 0x7f9604152030 2023-12-19T19:00:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f960b617640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96041f0430 con 0x7f9604154ff0 2023-12-19T19:00:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f960b617640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9604155fa0 con 0x7f960406c470 2023-12-19T19:00:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f9608bb2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9604152030 0x7f960414e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f9608bb2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9604152030 0x7f960414e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58922/0 (socket says 172.21.15.133:58922) 2023-12-19T19:00:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f9608bb2640 1 -- 172.21.15.133:0/3156666331 learned_addr learned my addr 172.21.15.133:0/3156666331 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f96093b3640 1 --2- 172.21.15.133:0/3156666331 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f960406c470 0x7f96041f0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f9609bb4640 1 --2- 172.21.15.133:0/3156666331 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9604154ff0 0x7f9604149c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f9608bb2640 1 -- 172.21.15.133:0/3156666331 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f960406c470 msgr2=0x7f96041f0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f9608bb2640 1 --2- 172.21.15.133:0/3156666331 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f960406c470 0x7f96041f0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f9608bb2640 1 -- 172.21.15.133:0/3156666331 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9604154ff0 msgr2=0x7f9604149c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f9608bb2640 1 --2- 172.21.15.133:0/3156666331 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9604154ff0 0x7f9604149c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f9608bb2640 1 -- 172.21.15.133:0/3156666331 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f4009420 con 0x7f9604152030 2023-12-19T19:00:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f9608bb2640 1 --2- 172.21.15.133:0/3156666331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9604152030 0x7f960414e120 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f95f40ad040 tx=0x7f95f401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f95f9ffb640 1 -- 172.21.15.133:0/3156666331 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f40bf610 con 0x7f9604152030 2023-12-19T19:00:02.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f95f9ffb640 1 -- 172.21.15.133:0/3156666331 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f40bf7b0 con 0x7f9604152030 2023-12-19T19:00:02.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f95f9ffb640 1 -- 172.21.15.133:0/3156666331 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f40bfb60 con 0x7f9604152030 2023-12-19T19:00:02.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.906+0000 7f960b617640 1 -- 172.21.15.133:0/3156666331 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96041f1310 con 0x7f9604152030 2023-12-19T19:00:02.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.910+0000 7f960b617640 1 -- 172.21.15.133:0/3156666331 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9604156260 con 0x7f9604152030 2023-12-19T19:00:02.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.910+0000 7f960b617640 1 -- 172.21.15.133:0/3156666331 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960406d540 con 0x7f9604152030 2023-12-19T19:00:02.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.910+0000 7f95f9ffb640 1 -- 172.21.15.133:0/3156666331 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f95f40b5400 con 0x7f9604152030 2023-12-19T19:00:02.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.910+0000 7f95f9ffb640 1 --2- 172.21.15.133:0/3156666331 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f95e8066470 0x7f95e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:02.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.910+0000 7f95f9ffb640 1 -- 172.21.15.133:0/3156666331 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f95f40a8050 con 0x7f9604152030 2023-12-19T19:00:02.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.910+0000 7f96093b3640 1 --2- 172.21.15.133:0/3156666331 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f95e8066470 0x7f95e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:02.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.914+0000 7f96093b3640 1 --2- 172.21.15.133:0/3156666331 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f95e8066470 0x7f95e8068930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f96000079c0 tx=0x7f9600008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:02.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:02.914+0000 7f95f9ffb640 1 -- 172.21.15.133:0/3156666331 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f95f40ebdd0 con 0x7f9604152030 2023-12-19T19:00:03.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.066+0000 7f960b617640 1 -- 172.21.15.133:0/3156666331 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9604068400 con 0x7f9604152030 2023-12-19T19:00:03.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.066+0000 7f95f9ffb640 1 -- 172.21.15.133:0/3156666331 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v35) v1 ==== 105+0+11 (secure 0 0 0) 0x7f95f40ef3f0 con 0x7f9604152030 2023-12-19T19:00:03.069 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:00:03.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.066+0000 7f960b617640 1 -- 172.21.15.133:0/3156666331 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f95e8066470 msgr2=0x7f95e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:03.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.066+0000 7f960b617640 1 --2- 172.21.15.133:0/3156666331 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f95e8066470 0x7f95e8068930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f96000079c0 tx=0x7f9600008040 comp rx=0 tx=0).stop 2023-12-19T19:00:03.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.066+0000 7f960b617640 1 -- 172.21.15.133:0/3156666331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9604152030 msgr2=0x7f960414e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:03.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.066+0000 7f960b617640 1 --2- 172.21.15.133:0/3156666331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9604152030 0x7f960414e120 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f95f40ad040 tx=0x7f95f401ac30 comp rx=0 tx=0).stop 2023-12-19T19:00:03.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.066+0000 7f960b617640 1 -- 172.21.15.133:0/3156666331 shutdown_connections 2023-12-19T19:00:03.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.066+0000 7f960b617640 1 --2- 172.21.15.133:0/3156666331 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f95e8066470 0x7f95e8068930 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.066+0000 7f960b617640 1 --2- 172.21.15.133:0/3156666331 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9604154ff0 0x7f9604149c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.066+0000 7f960b617640 1 --2- 172.21.15.133:0/3156666331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9604152030 0x7f960414e120 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.066+0000 7f960b617640 1 --2- 172.21.15.133:0/3156666331 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f960406c470 0x7f96041f0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.066+0000 7f960b617640 1 -- 172.21.15.133:0/3156666331 >> 172.21.15.133:0/3156666331 conn(0x7f960406a5b0 msgr2=0x7f960406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:03.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.066+0000 7f960b617640 1 -- 172.21.15.133:0/3156666331 shutdown_connections 2023-12-19T19:00:03.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.066+0000 7f960b617640 1 -- 172.21.15.133:0/3156666331 wait complete. 2023-12-19T19:00:03.090 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-19T19:00:03.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.226+0000 7f6a0e5f5640 1 Processor -- start 2023-12-19T19:00:03.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.226+0000 7f6a0e5f5640 1 -- start start 2023-12-19T19:00:03.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.230+0000 7f6a0e5f5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6a080c5260 0x7f6a0806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:03.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.230+0000 7f6a0e5f5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a08155de0 0x7f6a08156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:03.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.230+0000 7f6a0e5f5640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a080c2580 con 0x7f6a080c5640 2023-12-19T19:00:03.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.230+0000 7f6a0e5f5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a08153510 con 0x7f6a080c5260 2023-12-19T19:00:03.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.230+0000 7f6a0e5f5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080c17f0 con 0x7f6a08155de0 2023-12-19T19:00:03.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.230+0000 7f6a07fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6a080c5260 0x7f6a0806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:03.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.230+0000 7f6a07fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6a080c5260 0x7f6a0806d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58932/0 (socket says 172.21.15.133:58932) 2023-12-19T19:00:03.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.230+0000 7f6a07fff640 1 -- 172.21.15.133:0/2800445318 learned_addr learned my addr 172.21.15.133:0/2800445318 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:03.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.230+0000 7f6a0cb92640 1 --2- 172.21.15.133:0/2800445318 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a08155de0 0x7f6a08156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:03.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.230+0000 7f6a07fff640 1 -- 172.21.15.133:0/2800445318 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a08155de0 msgr2=0x7f6a08156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:03.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.230+0000 7f6a07fff640 1 --2- 172.21.15.133:0/2800445318 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a08155de0 0x7f6a08156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.230+0000 7f6a07fff640 1 -- 172.21.15.133:0/2800445318 >> v1:172.21.15.138:6789/0 conn(0x7f6a080c5640 legacy=0x7f6a080c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:03.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.230+0000 7f6a07fff640 1 -- 172.21.15.133:0/2800445318 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a080c1a00 con 0x7f6a080c5260 2023-12-19T19:00:03.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.230+0000 7f6a07fff640 1 --2- 172.21.15.133:0/2800445318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a080c5260 0x7f6a0806d5b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6a080c1930 tx=0x7f69f801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869ea34417695349 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:03.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a06ffd640 1 -- 172.21.15.133:0/2800445318 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f80ab660 con 0x7f6a080c5260 2023-12-19T19:00:03.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a06ffd640 1 -- 172.21.15.133:0/2800445318 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f80ab7c0 con 0x7f6a080c5260 2023-12-19T19:00:03.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a06ffd640 1 -- 172.21.15.133:0/2800445318 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f80abb50 con 0x7f6a080c5260 2023-12-19T19:00:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a0e5f5640 1 -- 172.21.15.133:0/2800445318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a080c5260 msgr2=0x7f6a0806d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a0e5f5640 1 --2- 172.21.15.133:0/2800445318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a080c5260 0x7f6a0806d5b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6a080c1930 tx=0x7f69f801c460 comp rx=0 tx=0).stop 2023-12-19T19:00:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a0e5f5640 1 -- 172.21.15.133:0/2800445318 shutdown_connections 2023-12-19T19:00:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a0e5f5640 1 --2- 172.21.15.133:0/2800445318 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a08155de0 0x7f6a08156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a0e5f5640 1 --2- 172.21.15.133:0/2800445318 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a080c5260 0x7f6a0806d5b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a0e5f5640 1 -- 172.21.15.133:0/2800445318 >> 172.21.15.133:0/2800445318 conn(0x7f6a0806a5b0 msgr2=0x7f6a0806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a0e5f5640 1 -- 172.21.15.133:0/2800445318 shutdown_connections 2023-12-19T19:00:03.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a0e5f5640 1 -- 172.21.15.133:0/2800445318 wait complete. 2023-12-19T19:00:03.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a0e5f5640 1 Processor -- start 2023-12-19T19:00:03.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a0e5f5640 1 -- start start 2023-12-19T19:00:03.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a0e5f5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a080c5260 0x7f6a080bffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:03.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a0e5f5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a080c5640 0x7f6a081ee300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:03.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a0e5f5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a08155de0 0x7f6a080a73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:03.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a0e5f5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080bbf00 con 0x7f6a08155de0 2023-12-19T19:00:03.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a0e5f5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a080bbbb0 con 0x7f6a080c5260 2023-12-19T19:00:03.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a0e5f5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a081eed90 con 0x7f6a080c5640 2023-12-19T19:00:03.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a0cb92640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a08155de0 0x7f6a080a73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:03.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a0cb92640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a08155de0 0x7f6a080a73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58934/0 (socket says 172.21.15.133:58934) 2023-12-19T19:00:03.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a0cb92640 1 -- 172.21.15.133:0/469198934 learned_addr learned my addr 172.21.15.133:0/469198934 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:03.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a07fff640 1 --2- 172.21.15.133:0/469198934 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a080c5260 0x7f6a080bffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:03.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.234+0000 7f6a077fe640 1 --2- 172.21.15.133:0/469198934 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a080c5640 0x7f6a081ee300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:03.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.238+0000 7f6a0cb92640 1 -- 172.21.15.133:0/469198934 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a080c5640 msgr2=0x7f6a081ee300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:03.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.238+0000 7f6a0cb92640 1 --2- 172.21.15.133:0/469198934 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a080c5640 0x7f6a081ee300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.238+0000 7f6a0cb92640 1 -- 172.21.15.133:0/469198934 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a080c5260 msgr2=0x7f6a080bffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:03.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.238+0000 7f6a0cb92640 1 --2- 172.21.15.133:0/469198934 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a080c5260 0x7f6a080bffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.238+0000 7f6a0cb92640 1 -- 172.21.15.133:0/469198934 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f80094d0 con 0x7f6a08155de0 2023-12-19T19:00:03.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.238+0000 7f6a0cb92640 1 --2- 172.21.15.133:0/469198934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a08155de0 0x7f6a080a73e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6a00007e40 tx=0x7f6a0000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:03.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.238+0000 7f6a04ff9640 1 -- 172.21.15.133:0/469198934 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00014620 con 0x7f6a08155de0 2023-12-19T19:00:03.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.238+0000 7f6a04ff9640 1 -- 172.21.15.133:0/469198934 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0000ee90 con 0x7f6a08155de0 2023-12-19T19:00:03.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.238+0000 7f6a0e5f5640 1 -- 172.21.15.133:0/469198934 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a080badc0 con 0x7f6a08155de0 2023-12-19T19:00:03.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.238+0000 7f6a04ff9640 1 -- 172.21.15.133:0/469198934 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a000149e0 con 0x7f6a08155de0 2023-12-19T19:00:03.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.238+0000 7f6a0e5f5640 1 -- 172.21.15.133:0/469198934 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a0814f450 con 0x7f6a08155de0 2023-12-19T19:00:03.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.238+0000 7f6a0e5f5640 1 -- 172.21.15.133:0/469198934 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a080bc0b0 con 0x7f6a08155de0 2023-12-19T19:00:03.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.238+0000 7f6a04ff9640 1 -- 172.21.15.133:0/469198934 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6a00014b40 con 0x7f6a08155de0 2023-12-19T19:00:03.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.238+0000 7f6a04ff9640 1 --2- 172.21.15.133:0/469198934 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f69f4066470 0x7f69f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:03.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.238+0000 7f6a04ff9640 1 -- 172.21.15.133:0/469198934 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6a00084a60 con 0x7f6a08155de0 2023-12-19T19:00:03.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.242+0000 7f6a07fff640 1 --2- 172.21.15.133:0/469198934 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f69f4066470 0x7f69f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:03.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.242+0000 7f6a07fff640 1 --2- 172.21.15.133:0/469198934 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f69f4066470 0x7f69f4068930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f69f80af000 tx=0x7f69f80b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:03.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.242+0000 7f6a04ff9640 1 -- 172.21.15.133:0/469198934 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6a080bc0b0 con 0x7f6a08155de0 2023-12-19T19:00:03.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.394+0000 7f6a0e5f5640 1 -- 172.21.15.133:0/469198934 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f6a080bc0b0 con 0x7f6a08155de0 2023-12-19T19:00:03.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.394+0000 7f6a04ff9640 1 -- 172.21.15.133:0/469198934 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v35) v1 ==== 101+0+11 (secure 0 0 0) 0x7f6a080bc0b0 con 0x7f6a08155de0 2023-12-19T19:00:03.397 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:00:03.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.394+0000 7f6a0e5f5640 1 -- 172.21.15.133:0/469198934 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f69f4066470 msgr2=0x7f69f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:03.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.394+0000 7f6a0e5f5640 1 --2- 172.21.15.133:0/469198934 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f69f4066470 0x7f69f4068930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f69f80af000 tx=0x7f69f80b6040 comp rx=0 tx=0).stop 2023-12-19T19:00:03.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.394+0000 7f6a0e5f5640 1 -- 172.21.15.133:0/469198934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a08155de0 msgr2=0x7f6a080a73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:03.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.394+0000 7f6a0e5f5640 1 --2- 172.21.15.133:0/469198934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a08155de0 0x7f6a080a73e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f6a00007e40 tx=0x7f6a0000e4b0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.394+0000 7f6a0e5f5640 1 -- 172.21.15.133:0/469198934 shutdown_connections 2023-12-19T19:00:03.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.394+0000 7f6a0e5f5640 1 --2- 172.21.15.133:0/469198934 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f69f4066470 0x7f69f4068930 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.394+0000 7f6a0e5f5640 1 --2- 172.21.15.133:0/469198934 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6a08155de0 0x7f6a080a73e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.394+0000 7f6a0e5f5640 1 --2- 172.21.15.133:0/469198934 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6a080c5640 0x7f6a081ee300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.394+0000 7f6a0e5f5640 1 --2- 172.21.15.133:0/469198934 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6a080c5260 0x7f6a080bffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.394+0000 7f6a0e5f5640 1 -- 172.21.15.133:0/469198934 >> 172.21.15.133:0/469198934 conn(0x7f6a0806a5b0 msgr2=0x7f6a08152d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:03.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.394+0000 7f6a0e5f5640 1 -- 172.21.15.133:0/469198934 shutdown_connections 2023-12-19T19:00:03.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.398+0000 7f6a0e5f5640 1 -- 172.21.15.133:0/469198934 wait complete. 2023-12-19T19:00:03.419 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:00:03.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.554+0000 7f7eb6a17640 1 Processor -- start 2023-12-19T19:00:03.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.554+0000 7f7eb6a17640 1 -- start start 2023-12-19T19:00:03.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.554+0000 7f7eb6a17640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7eb00c2bb0 0x7f7eb00c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:03.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.554+0000 7f7eb6a17640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb00c31c0 con 0x7f7eb00c4100 2023-12-19T19:00:03.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.554+0000 7f7eb6a17640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb00c34a0 con 0x7f7eb00c63c0 2023-12-19T19:00:03.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.554+0000 7f7eb6a17640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb00c1030 con 0x7f7eb00c2bb0 2023-12-19T19:00:03.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.554+0000 7f7eaf7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7eb00c4100 0x7f7eb00a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41500/0 (socket says 172.21.15.133:41500) 2023-12-19T19:00:03.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.554+0000 7f7eaf7fe640 1 -- 172.21.15.133:0/258582305 learned_addr learned my addr 172.21.15.133:0/258582305 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:03.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.554+0000 7f7eaeffd640 1 -- 172.21.15.133:0/258582305 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1576961748 0 0) 0x7f7eb00c31c0 con 0x7f7eb00c4100 2023-12-19T19:00:03.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.554+0000 7f7eb4fb4640 1 --2- 172.21.15.133:0/258582305 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7eb00c2bb0 0x7f7eb00c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:03.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.554+0000 7f7eaeffd640 1 -- 172.21.15.133:0/258582305 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e98005740 con 0x7f7eb00c4100 2023-12-19T19:00:03.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.558+0000 7f7eaeffd640 1 -- 172.21.15.133:0/258582305 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2716590098 0 0) 0x7f7e98005740 con 0x7f7eb00c4100 2023-12-19T19:00:03.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.558+0000 7f7eaeffd640 1 -- 172.21.15.133:0/258582305 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7eb00c2bb0 msgr2=0x7f7eb00c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:03.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.558+0000 7f7eaeffd640 1 --2- 172.21.15.133:0/258582305 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7eb00c2bb0 0x7f7eb00c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.558+0000 7f7eaeffd640 1 -- 172.21.15.133:0/258582305 >> v1:172.21.15.138:6789/0 conn(0x7f7eb00c63c0 legacy=0x7f7eb00c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:03.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.558+0000 7f7eaeffd640 1 -- 172.21.15.133:0/258582305 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb00c1310 con 0x7f7eb00c4100 2023-12-19T19:00:03.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.558+0000 7f7eaeffd640 1 -- 172.21.15.133:0/258582305 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f7ea4001680 con 0x7f7eb00c4100 2023-12-19T19:00:03.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.558+0000 7f7eaeffd640 1 -- 172.21.15.133:0/258582305 >> v1:172.21.15.133:6789/0 conn(0x7f7eb00c4100 legacy=0x7f7eb00a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:03.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.558+0000 7f7eaeffd640 1 --2- 172.21.15.133:0/258582305 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e98005bc0 0x7f7e98005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:03.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.558+0000 7f7eaeffd640 1 --2- 172.21.15.133:0/258582305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e980069e0 0x7f7e98006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:03.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.558+0000 7f7eaeffd640 1 --2- 172.21.15.133:0/258582305 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7eb00c2bb0 0x7f7e9800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:03.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.558+0000 7f7eaeffd640 1 -- 172.21.15.133:0/258582305 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb00c1030 con 0x7f7e980069e0 2023-12-19T19:00:03.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.558+0000 7f7eaeffd640 1 -- 172.21.15.133:0/258582305 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e98007700 con 0x7f7e98005bc0 2023-12-19T19:00:03.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.558+0000 7f7eaeffd640 1 -- 172.21.15.133:0/258582305 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9800e0e0 con 0x7f7eb00c2bb0 2023-12-19T19:00:03.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.558+0000 7f7eaf7fe640 1 --2- 172.21.15.133:0/258582305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e980069e0 0x7f7e98006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.558+0000 7f7eb4fb4640 1 --2- 172.21.15.133:0/258582305 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7eb00c2bb0 0x7f7e9800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.558+0000 7f7eaffff640 1 --2- 172.21.15.133:0/258582305 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e98005bc0 0x7f7e98005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.558+0000 7f7eaf7fe640 1 -- 172.21.15.133:0/258582305 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7eb00c2bb0 msgr2=0x7f7e9800dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.558+0000 7f7eaf7fe640 1 --2- 172.21.15.133:0/258582305 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7eb00c2bb0 0x7f7e9800dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.558+0000 7f7eaf7fe640 1 -- 172.21.15.133:0/258582305 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e98005bc0 msgr2=0x7f7e98005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.558+0000 7f7eaf7fe640 1 --2- 172.21.15.133:0/258582305 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e98005bc0 0x7f7e98005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.558+0000 7f7eaf7fe640 1 -- 172.21.15.133:0/258582305 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e98005740 con 0x7f7e980069e0 2023-12-19T19:00:03.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.558+0000 7f7eaffff640 1 --2- 172.21.15.133:0/258582305 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7e98005bc0 0x7f7e98005fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:03.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.558+0000 7f7eaf7fe640 1 --2- 172.21.15.133:0/258582305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e980069e0 0x7f7e98006e60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7ea400c0e0 tx=0x7f7ea401cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6c37baf5d042b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:03.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.562+0000 7f7eaeffd640 1 -- 172.21.15.133:0/258582305 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4005ae0 con 0x7f7e980069e0 2023-12-19T19:00:03.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.562+0000 7f7eaeffd640 1 -- 172.21.15.133:0/258582305 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea4005c40 con 0x7f7e980069e0 2023-12-19T19:00:03.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.562+0000 7f7eaeffd640 1 -- 172.21.15.133:0/258582305 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4007070 con 0x7f7e980069e0 2023-12-19T19:00:03.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.562+0000 7f7eb6a17640 1 -- 172.21.15.133:0/258582305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e980069e0 msgr2=0x7f7e98006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:03.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.562+0000 7f7eb6a17640 1 --2- 172.21.15.133:0/258582305 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7e980069e0 0x7f7e98006e60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f7ea400c0e0 tx=0x7f7ea401cb30 comp rx=0 tx=0).stop 2023-12-19T19:00:03.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.562+0000 7f7eb4fb4640 1 -- 172.21.15.133:0/258582305 reap_dead start 2023-12-19T19:00:03.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.562+0000 7f7eb6a17640 1 -- 172.21.15.133:0/258582305 shutdown_connections 2023-12-19T19:00:03.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.562+0000 7f7eb6a17640 1 -- 172.21.15.133:0/258582305 >> 172.21.15.133:0/258582305 conn(0x7f7eb006a5b0 msgr2=0x7f7eb006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:03.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.562+0000 7f7eb6a17640 1 -- 172.21.15.133:0/258582305 shutdown_connections 2023-12-19T19:00:03.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.562+0000 7f7eb6a17640 1 -- 172.21.15.133:0/258582305 wait complete. 2023-12-19T19:00:03.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.562+0000 7f7eb6a17640 1 Processor -- start 2023-12-19T19:00:03.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.562+0000 7f7eb6a17640 1 -- start start 2023-12-19T19:00:03.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.562+0000 7f7eb6a17640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7eb0150300 0x7f7eb01e9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:03.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.562+0000 7f7eb6a17640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7eb014a620 0x7f7eb01506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.562+0000 7f7eb6a17640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7eb01551f0 0x7f7eb0148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.562+0000 7f7eb6a17640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb0149580 con 0x7f7eb0150300 2023-12-19T19:00:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.562+0000 7f7eb6a17640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb0149860 con 0x7f7eb01551f0 2023-12-19T19:00:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.562+0000 7f7eb6a17640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb0149b40 con 0x7f7eb014a620 2023-12-19T19:00:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.562+0000 7f7eaffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7eb0150300 0x7f7eb01e9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.562+0000 7f7eaffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7eb0150300 0x7f7eb01e9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58944/0 (socket says 172.21.15.133:58944) 2023-12-19T19:00:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.562+0000 7f7eaffff640 1 -- 172.21.15.133:0/2323400201 learned_addr learned my addr 172.21.15.133:0/2323400201 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.562+0000 7f7eaf7fe640 1 --2- 172.21.15.133:0/2323400201 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7eb014a620 0x7f7eb01506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.562+0000 7f7eb4fb4640 1 --2- 172.21.15.133:0/2323400201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7eb01551f0 0x7f7eb0148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.566+0000 7f7eaffff640 1 -- 172.21.15.133:0/2323400201 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7eb014a620 msgr2=0x7f7eb01506e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.566+0000 7f7eaffff640 1 --2- 172.21.15.133:0/2323400201 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7eb014a620 0x7f7eb01506e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.566+0000 7f7eaffff640 1 -- 172.21.15.133:0/2323400201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7eb01551f0 msgr2=0x7f7eb0148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.566+0000 7f7eaffff640 1 --2- 172.21.15.133:0/2323400201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7eb01551f0 0x7f7eb0148a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.566+0000 7f7eaffff640 1 -- 172.21.15.133:0/2323400201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb00c69b0 con 0x7f7eb0150300 2023-12-19T19:00:03.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.566+0000 7f7eaf7fe640 1 --2- 172.21.15.133:0/2323400201 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7eb014a620 0x7f7eb01506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:03.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.566+0000 7f7eb4fb4640 1 --2- 172.21.15.133:0/2323400201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7eb01551f0 0x7f7eb0148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:03.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.566+0000 7f7eaffff640 1 --2- 172.21.15.133:0/2323400201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7eb0150300 0x7f7eb01e9140 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000e4d0 tx=0x7f7ea000e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:03.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.566+0000 7f7eacff9640 1 -- 172.21.15.133:0/2323400201 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea00052e0 con 0x7f7eb0150300 2023-12-19T19:00:03.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.566+0000 7f7eacff9640 1 -- 172.21.15.133:0/2323400201 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea0005440 con 0x7f7eb0150300 2023-12-19T19:00:03.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.566+0000 7f7eb6a17640 1 -- 172.21.15.133:0/2323400201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb0149e20 con 0x7f7eb0150300 2023-12-19T19:00:03.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.566+0000 7f7eacff9640 1 -- 172.21.15.133:0/2323400201 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0003820 con 0x7f7eb0150300 2023-12-19T19:00:03.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.566+0000 7f7eb6a17640 1 -- 172.21.15.133:0/2323400201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb0150d80 con 0x7f7eb0150300 2023-12-19T19:00:03.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.566+0000 7f7eb6a17640 1 -- 172.21.15.133:0/2323400201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb0068400 con 0x7f7eb0150300 2023-12-19T19:00:03.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.566+0000 7f7eacff9640 1 -- 172.21.15.133:0/2323400201 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7ea0003980 con 0x7f7eb0150300 2023-12-19T19:00:03.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.566+0000 7f7eacff9640 1 --2- 172.21.15.133:0/2323400201 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7e9c0664a0 0x7f7e9c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:03.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.566+0000 7f7eacff9640 1 -- 172.21.15.133:0/2323400201 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7ea0083f40 con 0x7f7eb0150300 2023-12-19T19:00:03.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.566+0000 7f7eaf7fe640 1 --2- 172.21.15.133:0/2323400201 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7e9c0664a0 0x7f7e9c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:03.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.570+0000 7f7eaf7fe640 1 --2- 172.21.15.133:0/2323400201 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7e9c0664a0 0x7f7e9c068960 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40ab000 tx=0x7f7ea40b1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:03.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.570+0000 7f7eacff9640 1 -- 172.21.15.133:0/2323400201 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7ea0051060 con 0x7f7eb0150300 2023-12-19T19:00:03.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.754+0000 7f7eb6a17640 1 -- 172.21.15.133:0/2323400201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7eb00c3e70 con 0x7f7eb0150300 2023-12-19T19:00:03.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.754+0000 7f7eacff9640 1 -- 172.21.15.133:0/2323400201 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6189 (secure 0 0 0) 0x7f7ea0054680 con 0x7f7eb0150300 2023-12-19T19:00:03.756 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:03.756 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/2717901150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6835","nonce":2717901150},{"type":"v1","addr":"172.21.15.138:6837","nonce":2717901150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4986,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6836/3989181473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":3989181473},{"type":"v1","addr":"172.21.15.138:6836","nonce":3989181473}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:59:27.233483+0000","modified":"2023-12-19T18:59:30.251421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4995},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4995":{"gid":4995,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/862459875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":862459875},{"type":"v1","addr":"172.21.15.133:6835","nonce":862459875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:59:45.017800+0000","modified":"2023-12-19T18:59:48.066331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.133:6834/3180094953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":3180094953},{"type":"v1","addr":"172.21.15.133:6834","nonce":3180094953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T19:00:03.757 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 22 2023-12-19T19:00:03.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.754+0000 7f7eb6a17640 1 -- 172.21.15.133:0/2323400201 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7e9c0664a0 msgr2=0x7f7e9c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:03.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.754+0000 7f7eb6a17640 1 --2- 172.21.15.133:0/2323400201 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7e9c0664a0 0x7f7e9c068960 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40ab000 tx=0x7f7ea40b1040 comp rx=0 tx=0).stop 2023-12-19T19:00:03.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.754+0000 7f7eb6a17640 1 -- 172.21.15.133:0/2323400201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7eb0150300 msgr2=0x7f7eb01e9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:03.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.754+0000 7f7eb6a17640 1 --2- 172.21.15.133:0/2323400201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7eb0150300 0x7f7eb01e9140 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f7ea000e4d0 tx=0x7f7ea000e990 comp rx=0 tx=0).stop 2023-12-19T19:00:03.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.754+0000 7f7eb6a17640 1 -- 172.21.15.133:0/2323400201 shutdown_connections 2023-12-19T19:00:03.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.754+0000 7f7eb6a17640 1 --2- 172.21.15.133:0/2323400201 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7e9c0664a0 0x7f7e9c068960 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.754+0000 7f7eb6a17640 1 --2- 172.21.15.133:0/2323400201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7eb01551f0 0x7f7eb0148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.754+0000 7f7eb6a17640 1 --2- 172.21.15.133:0/2323400201 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7eb014a620 0x7f7eb01506e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.754+0000 7f7eb6a17640 1 --2- 172.21.15.133:0/2323400201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7eb0150300 0x7f7eb01e9140 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.754+0000 7f7eb6a17640 1 -- 172.21.15.133:0/2323400201 >> 172.21.15.133:0/2323400201 conn(0x7f7eb006a5b0 msgr2=0x7f7eb00a62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:03.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.754+0000 7f7eb6a17640 1 -- 172.21.15.133:0/2323400201 shutdown_connections 2023-12-19T19:00:03.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.754+0000 7f7eb6a17640 1 -- 172.21.15.133:0/2323400201 wait complete. 2023-12-19T19:00:03.778 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:00:03.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.914+0000 7f9902dd1640 1 Processor -- start 2023-12-19T19:00:03.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.914+0000 7f9902dd1640 1 -- start start 2023-12-19T19:00:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.914+0000 7f9902dd1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f98fc0c2bb0 0x7f98fc0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.914+0000 7f9902dd1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98fc0c31c0 con 0x7f98fc0c4100 2023-12-19T19:00:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.914+0000 7f9902dd1640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98fc0c34a0 con 0x7f98fc0c63c0 2023-12-19T19:00:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.914+0000 7f9902dd1640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98fc0c1030 con 0x7f98fc0c2bb0 2023-12-19T19:00:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.914+0000 7f990136e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f98fc0c2bb0 0x7f98fc0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.914+0000 7f990136e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f98fc0c2bb0 0x7f98fc0c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58954/0 (socket says 172.21.15.133:58954) 2023-12-19T19:00:03.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.914+0000 7f990136e640 1 -- 172.21.15.133:0/1110604202 learned_addr learned my addr 172.21.15.133:0/1110604202 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:03.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.914+0000 7f990136e640 1 -- 172.21.15.133:0/1110604202 >> v1:172.21.15.138:6789/0 conn(0x7f98fc0c63c0 legacy=0x7f98fc0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:03.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.914+0000 7f990136e640 1 -- 172.21.15.133:0/1110604202 >> v1:172.21.15.133:6789/0 conn(0x7f98fc0c4100 legacy=0x7f98fc0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:03.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.914+0000 7f990136e640 1 -- 172.21.15.133:0/1110604202 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc0c1310 con 0x7f98fc0c2bb0 2023-12-19T19:00:03.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.914+0000 7f98fb7fe640 1 -- 172.21.15.133:0/1110604202 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378367944 0 0) 0x7f98fc0c31c0 con 0x7f98fc0c4100 2023-12-19T19:00:03.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.918+0000 7f990136e640 1 --2- 172.21.15.133:0/1110604202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98fc0c2bb0 0x7f98fc0c06d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f98f4009e50 tx=0x7f98f401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5d441796d011d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:03.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.918+0000 7f98fb7fe640 1 -- 172.21.15.133:0/1110604202 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f40a57d0 con 0x7f98fc0c2bb0 2023-12-19T19:00:03.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.918+0000 7f98fb7fe640 1 -- 172.21.15.133:0/1110604202 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f40a5930 con 0x7f98fc0c2bb0 2023-12-19T19:00:03.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.918+0000 7f98fb7fe640 1 -- 172.21.15.133:0/1110604202 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f40a5cc0 con 0x7f98fc0c2bb0 2023-12-19T19:00:03.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.918+0000 7f9902dd1640 1 -- 172.21.15.133:0/1110604202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98fc0c2bb0 msgr2=0x7f98fc0c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:03.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.918+0000 7f9902dd1640 1 --2- 172.21.15.133:0/1110604202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98fc0c2bb0 0x7f98fc0c06d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f98f4009e50 tx=0x7f98f401c8f0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.918+0000 7f9902dd1640 1 -- 172.21.15.133:0/1110604202 shutdown_connections 2023-12-19T19:00:03.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.918+0000 7f9902dd1640 1 --2- 172.21.15.133:0/1110604202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98fc0c2bb0 0x7f98fc0c06d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.918+0000 7f9902dd1640 1 -- 172.21.15.133:0/1110604202 >> 172.21.15.133:0/1110604202 conn(0x7f98fc06a5b0 msgr2=0x7f98fc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:03.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.918+0000 7f9902dd1640 1 -- 172.21.15.133:0/1110604202 shutdown_connections 2023-12-19T19:00:03.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.918+0000 7f9902dd1640 1 -- 172.21.15.133:0/1110604202 wait complete. 2023-12-19T19:00:03.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f9902dd1640 1 Processor -- start 2023-12-19T19:00:03.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f9902dd1640 1 -- start start 2023-12-19T19:00:03.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f9902dd1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98fc0c2bb0 0x7f98fc14bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f9902dd1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98fc0c4100 0x7f98fc14e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f9902dd1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98fc0c63c0 0x7f98fc0700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f9902dd1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc1544c0 con 0x7f98fc0c63c0 2023-12-19T19:00:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f9902dd1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc154760 con 0x7f98fc0c2bb0 2023-12-19T19:00:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f9902dd1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98fc154a40 con 0x7f98fc0c4100 2023-12-19T19:00:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f990136e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98fc0c63c0 0x7f98fc0700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f990136e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98fc0c63c0 0x7f98fc0700b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58966/0 (socket says 172.21.15.133:58966) 2023-12-19T19:00:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f990136e640 1 -- 172.21.15.133:0/2850386287 learned_addr learned my addr 172.21.15.133:0/2850386287 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f9900b6d640 1 --2- 172.21.15.133:0/2850386287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98fc0c2bb0 0x7f98fc14bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f98fbfff640 1 --2- 172.21.15.133:0/2850386287 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98fc0c4100 0x7f98fc14e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f990136e640 1 -- 172.21.15.133:0/2850386287 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98fc0c4100 msgr2=0x7f98fc14e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f990136e640 1 --2- 172.21.15.133:0/2850386287 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98fc0c4100 0x7f98fc14e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f990136e640 1 -- 172.21.15.133:0/2850386287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98fc0c2bb0 msgr2=0x7f98fc14bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f990136e640 1 --2- 172.21.15.133:0/2850386287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98fc0c2bb0 0x7f98fc14bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f990136e640 1 -- 172.21.15.133:0/2850386287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f4009b30 con 0x7f98fc0c63c0 2023-12-19T19:00:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f98fbfff640 1 --2- 172.21.15.133:0/2850386287 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98fc0c4100 0x7f98fc14e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:00:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f990136e640 1 --2- 172.21.15.133:0/2850386287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98fc0c63c0 0x7f98fc0700b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f98f40af040 tx=0x7f98f4019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f98f97fa640 1 -- 172.21.15.133:0/2850386287 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f4009210 con 0x7f98fc0c63c0 2023-12-19T19:00:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f98f97fa640 1 -- 172.21.15.133:0/2850386287 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f40b8680 con 0x7f98fc0c63c0 2023-12-19T19:00:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f98f97fa640 1 -- 172.21.15.133:0/2850386287 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f40b89f0 con 0x7f98fc0c63c0 2023-12-19T19:00:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f9902dd1640 1 -- 172.21.15.133:0/2850386287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98fc14dba0 con 0x7f98fc0c63c0 2023-12-19T19:00:03.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.922+0000 7f9902dd1640 1 -- 172.21.15.133:0/2850386287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98fc0705f0 con 0x7f98fc0c63c0 2023-12-19T19:00:03.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.926+0000 7f9902dd1640 1 -- 172.21.15.133:0/2850386287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98fc14dde0 con 0x7f98fc0c63c0 2023-12-19T19:00:03.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.926+0000 7f98f97fa640 1 -- 172.21.15.133:0/2850386287 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f98f40b8b50 con 0x7f98fc0c63c0 2023-12-19T19:00:03.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.926+0000 7f98f97fa640 1 --2- 172.21.15.133:0/2850386287 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f98e0066470 0x7f98e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:03.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.926+0000 7f98f97fa640 1 -- 172.21.15.133:0/2850386287 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f98f411f7b0 con 0x7f98fc0c63c0 2023-12-19T19:00:03.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.926+0000 7f9900b6d640 1 --2- 172.21.15.133:0/2850386287 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f98e0066470 0x7f98e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:03.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.926+0000 7f9900b6d640 1 --2- 172.21.15.133:0/2850386287 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f98e0066470 0x7f98e0068930 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f98f0000f70 tx=0x7f98f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:03.933 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:03.930+0000 7f98f97fa640 1 -- 172.21.15.133:0/2850386287 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f98fc14dde0 con 0x7f98fc0c63c0 2023-12-19T19:00:04.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.086+0000 7f9902dd1640 1 -- 172.21.15.133:0/2850386287 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98fc14dde0 con 0x7f98fc0c63c0 2023-12-19T19:00:04.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.086+0000 7f98f97fa640 1 -- 172.21.15.133:0/2850386287 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20265 (secure 0 0 0) 0x7f98fc14dde0 con 0x7f98fc0c63c0 2023-12-19T19:00:04.089 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:04.089 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":35,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:59:46.667472+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:59:25.798150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T18:59:26.236078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T18:59:42.757628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-19T18:59:44.017454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:00:04.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.086+0000 7f9902dd1640 1 -- 172.21.15.133:0/2850386287 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f98e0066470 msgr2=0x7f98e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:04.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.086+0000 7f9902dd1640 1 --2- 172.21.15.133:0/2850386287 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f98e0066470 0x7f98e0068930 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f98f0000f70 tx=0x7f98f0009040 comp rx=0 tx=0).stop 2023-12-19T19:00:04.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.086+0000 7f9902dd1640 1 -- 172.21.15.133:0/2850386287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98fc0c63c0 msgr2=0x7f98fc0700b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:04.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.086+0000 7f9902dd1640 1 --2- 172.21.15.133:0/2850386287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98fc0c63c0 0x7f98fc0700b0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f98f40af040 tx=0x7f98f4019690 comp rx=0 tx=0).stop 2023-12-19T19:00:04.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.086+0000 7f9902dd1640 1 -- 172.21.15.133:0/2850386287 shutdown_connections 2023-12-19T19:00:04.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.086+0000 7f9902dd1640 1 --2- 172.21.15.133:0/2850386287 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f98e0066470 0x7f98e0068930 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.086+0000 7f9902dd1640 1 --2- 172.21.15.133:0/2850386287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98fc0c63c0 0x7f98fc0700b0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.086+0000 7f9902dd1640 1 --2- 172.21.15.133:0/2850386287 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98fc0c4100 0x7f98fc14e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.086+0000 7f9902dd1640 1 --2- 172.21.15.133:0/2850386287 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98fc0c2bb0 0x7f98fc14bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.086+0000 7f9902dd1640 1 -- 172.21.15.133:0/2850386287 >> 172.21.15.133:0/2850386287 conn(0x7f98fc06a5b0 msgr2=0x7f98fc06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:04.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.090+0000 7f9902dd1640 1 -- 172.21.15.133:0/2850386287 shutdown_connections 2023-12-19T19:00:04.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.090+0000 7f9902dd1640 1 -- 172.21.15.133:0/2850386287 wait complete. 2023-12-19T19:00:04.111 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T19:00:04.111 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:00:04.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.246+0000 7f5d1cc5a640 1 Processor -- start 2023-12-19T19:00:04.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.246+0000 7f5d1cc5a640 1 -- start start 2023-12-19T19:00:04.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.246+0000 7f5d1cc5a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5d180c5260 0x7f5d1806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:04.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.246+0000 7f5d1cc5a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d180c5640 0x7f5d180c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:04.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.246+0000 7f5d1cc5a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5d180c60f0 0x7f5d18155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:04.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.246+0000 7f5d1cc5a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d180c17f0 con 0x7f5d180c60f0 2023-12-19T19:00:04.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.246+0000 7f5d1cc5a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d180c2580 con 0x7f5d180c5260 2023-12-19T19:00:04.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.246+0000 7f5d1cc5a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d180c1a00 con 0x7f5d180c5640 2023-12-19T19:00:04.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.246+0000 7f5d16d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5d180c60f0 0x7f5d18155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:04.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.246+0000 7f5d16d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5d180c60f0 0x7f5d18155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58982/0 (socket says 172.21.15.133:58982) 2023-12-19T19:00:04.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.246+0000 7f5d16d9d640 1 -- 172.21.15.133:0/409563441 learned_addr learned my addr 172.21.15.133:0/409563441 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:04.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.246+0000 7f5d0dd9b640 1 --2- 172.21.15.133:0/409563441 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d180c5640 0x7f5d180c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:04.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.246+0000 7f5d1659c640 1 --2- 172.21.15.133:0/409563441 >> v2:172.21.15.138:3300/0 conn(0x7f5d180c5260 0x7f5d1806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:04.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.246+0000 7f5d16d9d640 1 -- 172.21.15.133:0/409563441 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d180c5640 msgr2=0x7f5d180c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:04.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.246+0000 7f5d16d9d640 1 --2- 172.21.15.133:0/409563441 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d180c5640 0x7f5d180c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.246+0000 7f5d16d9d640 1 -- 172.21.15.133:0/409563441 >> v2:172.21.15.138:3300/0 conn(0x7f5d180c5260 msgr2=0x7f5d1806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:04.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.246+0000 7f5d16d9d640 1 --2- 172.21.15.133:0/409563441 >> v2:172.21.15.138:3300/0 conn(0x7f5d180c5260 0x7f5d1806d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.246+0000 7f5d16d9d640 1 -- 172.21.15.133:0/409563441 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d180c1ce0 con 0x7f5d180c60f0 2023-12-19T19:00:04.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.246+0000 7f5d1659c640 1 --2- 172.21.15.133:0/409563441 >> v2:172.21.15.138:3300/0 conn(0x7f5d180c5260 0x7f5d1806d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:04.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.250+0000 7f5d16d9d640 1 --2- 172.21.15.133:0/409563441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d180c60f0 0x7f5d18155de0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5d180c6920 tx=0x7f5d1001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fbcce164a097836 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:04.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.250+0000 7f5d15d9b640 1 -- 172.21.15.133:0/409563441 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d100a5790 con 0x7f5d180c60f0 2023-12-19T19:00:04.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.250+0000 7f5d15d9b640 1 -- 172.21.15.133:0/409563441 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d100a58f0 con 0x7f5d180c60f0 2023-12-19T19:00:04.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.250+0000 7f5d15d9b640 1 -- 172.21.15.133:0/409563441 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d100a5c80 con 0x7f5d180c60f0 2023-12-19T19:00:04.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.250+0000 7f5d1cc5a640 1 -- 172.21.15.133:0/409563441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d180c60f0 msgr2=0x7f5d18155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:04.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.250+0000 7f5d1cc5a640 1 --2- 172.21.15.133:0/409563441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d180c60f0 0x7f5d18155de0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5d180c6920 tx=0x7f5d1001c910 comp rx=0 tx=0).stop 2023-12-19T19:00:04.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.250+0000 7f5d1cc5a640 1 -- 172.21.15.133:0/409563441 shutdown_connections 2023-12-19T19:00:04.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.250+0000 7f5d1cc5a640 1 --2- 172.21.15.133:0/409563441 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d180c5640 0x7f5d180c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.250+0000 7f5d1cc5a640 1 --2- 172.21.15.133:0/409563441 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d180c60f0 0x7f5d18155de0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.250+0000 7f5d1cc5a640 1 --2- 172.21.15.133:0/409563441 >> v2:172.21.15.138:3300/0 conn(0x7f5d180c5260 0x7f5d1806d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.250+0000 7f5d1cc5a640 1 -- 172.21.15.133:0/409563441 >> 172.21.15.133:0/409563441 conn(0x7f5d1806a5b0 msgr2=0x7f5d1806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:04.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.250+0000 7f5d1cc5a640 1 -- 172.21.15.133:0/409563441 shutdown_connections 2023-12-19T19:00:04.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.250+0000 7f5d1cc5a640 1 -- 172.21.15.133:0/409563441 wait complete. 2023-12-19T19:00:04.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.254+0000 7f5d1cc5a640 1 Processor -- start 2023-12-19T19:00:04.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.254+0000 7f5d1cc5a640 1 -- start start 2023-12-19T19:00:04.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.254+0000 7f5d1cc5a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d180c5260 0x7f5d180bb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:04.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.254+0000 7f5d1cc5a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d180c5640 0x7f5d180bbb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:04.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.254+0000 7f5d1cc5a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d180c60f0 0x7f5d18151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:04.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.254+0000 7f5d1cc5a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d180bc080 con 0x7f5d180c5260 2023-12-19T19:00:04.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.254+0000 7f5d1cc5a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d180bfa10 con 0x7f5d180c60f0 2023-12-19T19:00:04.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.254+0000 7f5d1cc5a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d180bff90 con 0x7f5d180c5640 2023-12-19T19:00:04.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.254+0000 7f5d1659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d180c5260 0x7f5d180bb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:04.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.254+0000 7f5d1659c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d180c5260 0x7f5d180bb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58988/0 (socket says 172.21.15.133:58988) 2023-12-19T19:00:04.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.254+0000 7f5d1659c640 1 -- 172.21.15.133:0/1136653474 learned_addr learned my addr 172.21.15.133:0/1136653474 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:04.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.254+0000 7f5d0dd9b640 1 --2- 172.21.15.133:0/1136653474 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d180c5640 0x7f5d180bbb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:04.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.254+0000 7f5d16d9d640 1 --2- 172.21.15.133:0/1136653474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d180c60f0 0x7f5d18151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.254+0000 7f5d1659c640 1 -- 172.21.15.133:0/1136653474 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d180c5640 msgr2=0x7f5d180bbb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.254+0000 7f5d1659c640 1 --2- 172.21.15.133:0/1136653474 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d180c5640 0x7f5d180bbb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.254+0000 7f5d1659c640 1 -- 172.21.15.133:0/1136653474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d180c60f0 msgr2=0x7f5d18151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.254+0000 7f5d1659c640 1 --2- 172.21.15.133:0/1136653474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d180c60f0 0x7f5d18151dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.254+0000 7f5d1659c640 1 -- 172.21.15.133:0/1136653474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d10009b30 con 0x7f5d180c5260 2023-12-19T19:00:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.254+0000 7f5d1659c640 1 --2- 172.21.15.133:0/1136653474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d180c5260 0x7f5d180bb600 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800d800 tx=0x7f5d0800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.254+0000 7f5d0f7fe640 1 -- 172.21.15.133:0/1136653474 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d08004030 con 0x7f5d180c5260 2023-12-19T19:00:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.254+0000 7f5d0f7fe640 1 -- 172.21.15.133:0/1136653474 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d08004190 con 0x7f5d180c5260 2023-12-19T19:00:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.258+0000 7f5d1cc5a640 1 -- 172.21.15.133:0/1136653474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d180bfcb0 con 0x7f5d180c5260 2023-12-19T19:00:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.258+0000 7f5d0f7fe640 1 -- 172.21.15.133:0/1136653474 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d08004520 con 0x7f5d180c5260 2023-12-19T19:00:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.258+0000 7f5d1cc5a640 1 -- 172.21.15.133:0/1136653474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d1815cb40 con 0x7f5d180c5260 2023-12-19T19:00:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.258+0000 7f5d1cc5a640 1 -- 172.21.15.133:0/1136653474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d18068400 con 0x7f5d180c5260 2023-12-19T19:00:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.258+0000 7f5d0f7fe640 1 -- 172.21.15.133:0/1136653474 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5d080096a0 con 0x7f5d180c5260 2023-12-19T19:00:04.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.258+0000 7f5d0f7fe640 1 --2- 172.21.15.133:0/1136653474 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5cf80664a0 0x7f5cf8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:04.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.258+0000 7f5d0f7fe640 1 -- 172.21.15.133:0/1136653474 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5d080843e0 con 0x7f5d180c5260 2023-12-19T19:00:04.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.258+0000 7f5d0dd9b640 1 --2- 172.21.15.133:0/1136653474 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5cf80664a0 0x7f5cf8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:04.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.258+0000 7f5d0dd9b640 1 --2- 172.21.15.133:0/1136653474 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5cf80664a0 0x7f5cf8068960 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5d180bc3e0 tx=0x7f5d00008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:04.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.262+0000 7f5d0f7fe640 1 -- 172.21.15.133:0/1136653474 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5d08051590 con 0x7f5d180c5260 2023-12-19T19:00:04.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.442+0000 7f5d1cc5a640 1 -- 172.21.15.133:0/1136653474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d1806d390 con 0x7f5d180c5260 2023-12-19T19:00:04.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.442+0000 7f5d0f7fe640 1 -- 172.21.15.133:0/1136653474 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6189 (secure 0 0 0) 0x7f5d0800b3a0 con 0x7f5d180c5260 2023-12-19T19:00:04.447 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:04.447 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/2717901150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6835","nonce":2717901150},{"type":"v1","addr":"172.21.15.138:6837","nonce":2717901150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4986,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6836/3989181473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":3989181473},{"type":"v1","addr":"172.21.15.138:6836","nonce":3989181473}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:59:27.233483+0000","modified":"2023-12-19T18:59:30.251421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4995},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4995":{"gid":4995,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/862459875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":862459875},{"type":"v1","addr":"172.21.15.133:6835","nonce":862459875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:59:45.017800+0000","modified":"2023-12-19T18:59:48.066331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.133:6834/3180094953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":3180094953},{"type":"v1","addr":"172.21.15.133:6834","nonce":3180094953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T19:00:04.447 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 22 2023-12-19T19:00:04.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.446+0000 7f5d1cc5a640 1 -- 172.21.15.133:0/1136653474 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5cf80664a0 msgr2=0x7f5cf8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:04.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.446+0000 7f5d1cc5a640 1 --2- 172.21.15.133:0/1136653474 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5cf80664a0 0x7f5cf8068960 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5d180bc3e0 tx=0x7f5d00008040 comp rx=0 tx=0).stop 2023-12-19T19:00:04.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.446+0000 7f5d1cc5a640 1 -- 172.21.15.133:0/1136653474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d180c5260 msgr2=0x7f5d180bb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:04.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.446+0000 7f5d1cc5a640 1 --2- 172.21.15.133:0/1136653474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d180c5260 0x7f5d180bb600 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800d800 tx=0x7f5d0800dcc0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.446+0000 7f5d1cc5a640 1 -- 172.21.15.133:0/1136653474 shutdown_connections 2023-12-19T19:00:04.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.446+0000 7f5d1cc5a640 1 --2- 172.21.15.133:0/1136653474 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5cf80664a0 0x7f5cf8068960 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.446+0000 7f5d1cc5a640 1 --2- 172.21.15.133:0/1136653474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d180c60f0 0x7f5d18151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.446+0000 7f5d1cc5a640 1 --2- 172.21.15.133:0/1136653474 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d180c5640 0x7f5d180bbb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.446+0000 7f5d1cc5a640 1 --2- 172.21.15.133:0/1136653474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d180c5260 0x7f5d180bb600 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.446+0000 7f5d1cc5a640 1 -- 172.21.15.133:0/1136653474 >> 172.21.15.133:0/1136653474 conn(0x7f5d1806a5b0 msgr2=0x7f5d1806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:04.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.446+0000 7f5d1cc5a640 1 -- 172.21.15.133:0/1136653474 shutdown_connections 2023-12-19T19:00:04.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.446+0000 7f5d1cc5a640 1 -- 172.21.15.133:0/1136653474 wait complete. 2023-12-19T19:00:04.467 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:00:04.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347d101640 1 Processor -- start 2023-12-19T19:00:04.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347d101640 1 -- start start 2023-12-19T19:00:04.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347d101640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f34781560e0 0x7f347815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:04.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347d101640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f347815c600 con 0x7f34780bffc0 2023-12-19T19:00:04.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347d101640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f347815a5c0 con 0x7f347806d520 2023-12-19T19:00:04.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347d101640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34781594e0 con 0x7f34781560e0 2023-12-19T19:00:04.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347759e640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f34780bffc0 0x7f34780c1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:45712/0 (socket says 172.21.15.133:45712) 2023-12-19T19:00:04.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347759e640 1 -- 172.21.15.133:0/2910473081 learned_addr learned my addr 172.21.15.133:0/2910473081 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f3476d9d640 1 --2- 172.21.15.133:0/2910473081 >> v2:172.21.15.138:3300/0 conn(0x7f34781560e0 0x7f347815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347659c640 1 -- 172.21.15.133:0/2910473081 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128855053 0 0) 0x7f347815c600 con 0x7f34780bffc0 2023-12-19T19:00:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347659c640 1 -- 172.21.15.133:0/2910473081 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3464003530 con 0x7f34780bffc0 2023-12-19T19:00:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347659c640 1 -- 172.21.15.133:0/2910473081 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1249450350 0 0) 0x7f3464003530 con 0x7f34780bffc0 2023-12-19T19:00:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347659c640 1 -- 172.21.15.133:0/2910473081 >> v2:172.21.15.138:3300/0 conn(0x7f34781560e0 msgr2=0x7f347815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347659c640 1 --2- 172.21.15.133:0/2910473081 >> v2:172.21.15.138:3300/0 conn(0x7f34781560e0 0x7f347815ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347659c640 1 -- 172.21.15.133:0/2910473081 >> v1:172.21.15.138:6789/0 conn(0x7f347806d520 legacy=0x7f3478159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347659c640 1 -- 172.21.15.133:0/2910473081 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34781597c0 con 0x7f34780bffc0 2023-12-19T19:00:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347659c640 1 -- 172.21.15.133:0/2910473081 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f3470001a00 con 0x7f34780bffc0 2023-12-19T19:00:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347659c640 1 -- 172.21.15.133:0/2910473081 >> v1:172.21.15.133:6789/0 conn(0x7f34780bffc0 legacy=0x7f34780c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347659c640 1 --2- 172.21.15.133:0/2910473081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3464003980 0x7f3464003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347659c640 1 --2- 172.21.15.133:0/2910473081 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3464004380 0x7f3464004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347659c640 1 --2- 172.21.15.133:0/2910473081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3464005050 0x7f346400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347659c640 1 -- 172.21.15.133:0/2910473081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34781594e0 con 0x7f3464005050 2023-12-19T19:00:04.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347659c640 1 -- 172.21.15.133:0/2910473081 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346400bfb0 con 0x7f3464003980 2023-12-19T19:00:04.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347659c640 1 -- 172.21.15.133:0/2910473081 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346400c170 con 0x7f3464004380 2023-12-19T19:00:04.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.602+0000 7f347759e640 1 --2- 172.21.15.133:0/2910473081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3464005050 0x7f346400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:04.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.606+0000 7f3476d9d640 1 --2- 172.21.15.133:0/2910473081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3464003980 0x7f3464003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:04.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.606+0000 7f346ffff640 1 --2- 172.21.15.133:0/2910473081 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3464004380 0x7f3464004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:04.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.606+0000 7f347759e640 1 -- 172.21.15.133:0/2910473081 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3464004380 msgr2=0x7f3464004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:04.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.606+0000 7f347759e640 1 --2- 172.21.15.133:0/2910473081 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3464004380 0x7f3464004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.606+0000 7f347759e640 1 -- 172.21.15.133:0/2910473081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3464003980 msgr2=0x7f3464003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:04.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.606+0000 7f347759e640 1 --2- 172.21.15.133:0/2910473081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3464003980 0x7f3464003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.606+0000 7f347759e640 1 -- 172.21.15.133:0/2910473081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3464003530 con 0x7f3464005050 2023-12-19T19:00:04.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.606+0000 7f347759e640 1 -- 172.21.15.133:0/2910473081 reap_dead start 2023-12-19T19:00:04.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.606+0000 7f347759e640 1 --2- 172.21.15.133:0/2910473081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3464005050 0x7f346400b990 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f347000a7d0 tx=0x7f347001fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3156d05fafefebe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:04.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.606+0000 7f347659c640 1 -- 172.21.15.133:0/2910473081 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34700af070 con 0x7f3464005050 2023-12-19T19:00:04.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.606+0000 7f347659c640 1 -- 172.21.15.133:0/2910473081 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34700aa450 con 0x7f3464005050 2023-12-19T19:00:04.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.606+0000 7f347659c640 1 -- 172.21.15.133:0/2910473081 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34700aa820 con 0x7f3464005050 2023-12-19T19:00:04.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.606+0000 7f347d101640 1 -- 172.21.15.133:0/2910473081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3464005050 msgr2=0x7f346400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:04.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.606+0000 7f347d101640 1 --2- 172.21.15.133:0/2910473081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3464005050 0x7f346400b990 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f347000a7d0 tx=0x7f347001fa20 comp rx=0 tx=0).stop 2023-12-19T19:00:04.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f347d101640 1 -- 172.21.15.133:0/2910473081 shutdown_connections 2023-12-19T19:00:04.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f347d101640 1 --2- 172.21.15.133:0/2910473081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3464005050 0x7f346400b990 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f347d101640 1 -- 172.21.15.133:0/2910473081 >> 172.21.15.133:0/2910473081 conn(0x7f347806a5b0 msgr2=0x7f347806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:04.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f347d101640 1 -- 172.21.15.133:0/2910473081 shutdown_connections 2023-12-19T19:00:04.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f347d101640 1 -- 172.21.15.133:0/2910473081 wait complete. 2023-12-19T19:00:04.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f347d101640 1 Processor -- start 2023-12-19T19:00:04.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f347d101640 1 -- start start 2023-12-19T19:00:04.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f347d101640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3464005050 0x7f347815b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:04.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f347d101640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34781eddf0 0x7f34781eb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:04.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f347d101640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34781eb660 0x7f34780a2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:04.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f347d101640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34780a5450 con 0x7f34781eb660 2023-12-19T19:00:04.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f347d101640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34780c5920 con 0x7f3464005050 2023-12-19T19:00:04.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f347d101640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34780c5df0 con 0x7f34781eddf0 2023-12-19T19:00:04.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f347759e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34781eb660 0x7f34780a2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:04.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f347759e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34781eb660 0x7f34780a2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54666/0 (socket says 172.21.15.133:54666) 2023-12-19T19:00:04.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f347759e640 1 -- 172.21.15.133:0/3286727016 learned_addr learned my addr 172.21.15.133:0/3286727016 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:04.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f346ffff640 1 --2- 172.21.15.133:0/3286727016 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34781eddf0 0x7f34781eb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:04.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f3476d9d640 1 --2- 172.21.15.133:0/3286727016 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3464005050 0x7f347815b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:04.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f347759e640 1 -- 172.21.15.133:0/3286727016 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34781eddf0 msgr2=0x7f34781eb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:04.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f347759e640 1 --2- 172.21.15.133:0/3286727016 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34781eddf0 0x7f34781eb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f347759e640 1 -- 172.21.15.133:0/3286727016 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3464005050 msgr2=0x7f347815b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:04.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f347759e640 1 --2- 172.21.15.133:0/3286727016 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3464005050 0x7f347815b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f347759e640 1 -- 172.21.15.133:0/3286727016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34780a9e40 con 0x7f34781eb660 2023-12-19T19:00:04.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.610+0000 7f347759e640 1 --2- 172.21.15.133:0/3286727016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34781eb660 0x7f34780a2280 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f34700ad040 tx=0x7f3464005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:04.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.614+0000 7f346f7fe640 1 -- 172.21.15.133:0/3286727016 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34700af040 con 0x7f34781eb660 2023-12-19T19:00:04.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.614+0000 7f346f7fe640 1 -- 172.21.15.133:0/3286727016 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34700aa7c0 con 0x7f34781eb660 2023-12-19T19:00:04.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.614+0000 7f347d101640 1 -- 172.21.15.133:0/3286727016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34780c5b10 con 0x7f34781eb660 2023-12-19T19:00:04.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.614+0000 7f346f7fe640 1 -- 172.21.15.133:0/3286727016 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34700aab50 con 0x7f34781eb660 2023-12-19T19:00:04.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.614+0000 7f347d101640 1 -- 172.21.15.133:0/3286727016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f347815bb60 con 0x7f34781eb660 2023-12-19T19:00:04.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.614+0000 7f347d101640 1 -- 172.21.15.133:0/3286727016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34780a9ca0 con 0x7f34781eb660 2023-12-19T19:00:04.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.614+0000 7f346f7fe640 1 -- 172.21.15.133:0/3286727016 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f34700aacb0 con 0x7f34781eb660 2023-12-19T19:00:04.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.614+0000 7f346f7fe640 1 --2- 172.21.15.133:0/3286727016 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3458066470 0x7f3458068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:04.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.614+0000 7f346f7fe640 1 -- 172.21.15.133:0/3286727016 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3470121200 con 0x7f34781eb660 2023-12-19T19:00:04.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.614+0000 7f3476d9d640 1 --2- 172.21.15.133:0/3286727016 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3458066470 0x7f3458068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:04.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.618+0000 7f3476d9d640 1 --2- 172.21.15.133:0/3286727016 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3458066470 0x7f3458068930 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3468009b60 tx=0x7f3468009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:04.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.618+0000 7f346f7fe640 1 -- 172.21.15.133:0/3286727016 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f34780a9ca0 con 0x7f34781eb660 2023-12-19T19:00:04.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.798+0000 7f347d101640 1 -- 172.21.15.133:0/3286727016 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34780a9ca0 con 0x7f34781eb660 2023-12-19T19:00:04.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.798+0000 7f346f7fe640 1 -- 172.21.15.133:0/3286727016 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+6189 (secure 0 0 0) 0x7f34780a9ca0 con 0x7f34781eb660 2023-12-19T19:00:04.801 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:04.801 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/2717901150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6835","nonce":2717901150},{"type":"v1","addr":"172.21.15.138:6837","nonce":2717901150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4986,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6836/3989181473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":3989181473},{"type":"v1","addr":"172.21.15.138:6836","nonce":3989181473}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:59:27.233483+0000","modified":"2023-12-19T18:59:30.251421+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4995},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4995":{"gid":4995,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6835/862459875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":862459875},{"type":"v1","addr":"172.21.15.133:6835","nonce":862459875}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:59:45.017800+0000","modified":"2023-12-19T18:59:48.066331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.133:6834/3180094953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":3180094953},{"type":"v1","addr":"172.21.15.133:6834","nonce":3180094953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T19:00:04.801 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 22 2023-12-19T19:00:04.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.798+0000 7f347d101640 1 -- 172.21.15.133:0/3286727016 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3458066470 msgr2=0x7f3458068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:04.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.798+0000 7f347d101640 1 --2- 172.21.15.133:0/3286727016 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3458066470 0x7f3458068930 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3468009b60 tx=0x7f3468009190 comp rx=0 tx=0).stop 2023-12-19T19:00:04.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.798+0000 7f347d101640 1 -- 172.21.15.133:0/3286727016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34781eb660 msgr2=0x7f34780a2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:04.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.798+0000 7f347d101640 1 --2- 172.21.15.133:0/3286727016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34781eb660 0x7f34780a2280 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f34700ad040 tx=0x7f3464005800 comp rx=0 tx=0).stop 2023-12-19T19:00:04.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.802+0000 7f347d101640 1 -- 172.21.15.133:0/3286727016 shutdown_connections 2023-12-19T19:00:04.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.802+0000 7f347d101640 1 --2- 172.21.15.133:0/3286727016 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3458066470 0x7f3458068930 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.802+0000 7f347d101640 1 --2- 172.21.15.133:0/3286727016 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34781eb660 0x7f34780a2280 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.802+0000 7f347d101640 1 --2- 172.21.15.133:0/3286727016 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34781eddf0 0x7f34781eb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.802+0000 7f347d101640 1 --2- 172.21.15.133:0/3286727016 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3464005050 0x7f347815b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.802+0000 7f347d101640 1 -- 172.21.15.133:0/3286727016 >> 172.21.15.133:0/3286727016 conn(0x7f347806a5b0 msgr2=0x7f34780a7180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:04.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.802+0000 7f347d101640 1 -- 172.21.15.133:0/3286727016 shutdown_connections 2023-12-19T19:00:04.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.802+0000 7f347d101640 1 -- 172.21.15.133:0/3286727016 wait complete. 2023-12-19T19:00:04.822 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:00:04.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.958+0000 7ff5dc19d640 1 Processor -- start 2023-12-19T19:00:04.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.958+0000 7ff5dc19d640 1 -- start start 2023-12-19T19:00:04.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.962+0000 7ff5dc19d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5d41560e0 0x7ff5d415ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:04.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.962+0000 7ff5dc19d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5d40bffc0 0x7ff5d40c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:04.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.962+0000 7ff5dc19d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5d415c600 con 0x7ff5d406d520 2023-12-19T19:00:04.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.962+0000 7ff5dc19d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d415a5c0 con 0x7ff5d40bffc0 2023-12-19T19:00:04.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.962+0000 7ff5dc19d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d41594e0 con 0x7ff5d41560e0 2023-12-19T19:00:04.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.962+0000 7ff5da73a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5d40bffc0 0x7ff5d40c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:04.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.962+0000 7ff5da73a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5d40bffc0 0x7ff5d40c1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54678/0 (socket says 172.21.15.133:54678) 2023-12-19T19:00:04.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.962+0000 7ff5da73a640 1 -- 172.21.15.133:0/1305799134 learned_addr learned my addr 172.21.15.133:0/1305799134 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:04.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.962+0000 7ff5d9f39640 1 --2- 172.21.15.133:0/1305799134 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5d41560e0 0x7ff5d415ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:04.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.962+0000 7ff5da73a640 1 -- 172.21.15.133:0/1305799134 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5d41560e0 msgr2=0x7ff5d415ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:04.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.962+0000 7ff5da73a640 1 --2- 172.21.15.133:0/1305799134 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5d41560e0 0x7ff5d415ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.962+0000 7ff5da73a640 1 -- 172.21.15.133:0/1305799134 >> v1:172.21.15.133:6789/0 conn(0x7ff5d406d520 legacy=0x7ff5d4159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:04.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.962+0000 7ff5da73a640 1 -- 172.21.15.133:0/1305799134 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d41597c0 con 0x7ff5d40bffc0 2023-12-19T19:00:04.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.962+0000 7ff5d9f39640 1 --2- 172.21.15.133:0/1305799134 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5d41560e0 0x7ff5d415ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:04.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.962+0000 7ff5da73a640 1 --2- 172.21.15.133:0/1305799134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d40bffc0 0x7ff5d40c1bf0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009e50 tx=0x7ff5cc01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd381c25a8d7dc0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:04.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.966+0000 7ff5d8f37640 1 -- 172.21.15.133:0/1305799134 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc0a57c0 con 0x7ff5d40bffc0 2023-12-19T19:00:04.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.966+0000 7ff5d8f37640 1 -- 172.21.15.133:0/1305799134 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc0a5920 con 0x7ff5d40bffc0 2023-12-19T19:00:04.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.966+0000 7ff5d8f37640 1 -- 172.21.15.133:0/1305799134 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc0a5cb0 con 0x7ff5d40bffc0 2023-12-19T19:00:04.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.966+0000 7ff5dc19d640 1 -- 172.21.15.133:0/1305799134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d40bffc0 msgr2=0x7ff5d40c1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:04.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.966+0000 7ff5dc19d640 1 --2- 172.21.15.133:0/1305799134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d40bffc0 0x7ff5d40c1bf0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc009e50 tx=0x7ff5cc01c9e0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.966+0000 7ff5dc19d640 1 -- 172.21.15.133:0/1305799134 shutdown_connections 2023-12-19T19:00:04.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.966+0000 7ff5dc19d640 1 --2- 172.21.15.133:0/1305799134 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d40bffc0 0x7ff5d40c1bf0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.966+0000 7ff5dc19d640 1 --2- 172.21.15.133:0/1305799134 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5d41560e0 0x7ff5d415ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.966+0000 7ff5dc19d640 1 -- 172.21.15.133:0/1305799134 >> 172.21.15.133:0/1305799134 conn(0x7ff5d406a5b0 msgr2=0x7ff5d406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:04.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.966+0000 7ff5dc19d640 1 -- 172.21.15.133:0/1305799134 shutdown_connections 2023-12-19T19:00:04.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.966+0000 7ff5dc19d640 1 -- 172.21.15.133:0/1305799134 wait complete. 2023-12-19T19:00:04.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.966+0000 7ff5dc19d640 1 Processor -- start 2023-12-19T19:00:04.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.966+0000 7ff5dc19d640 1 -- start start 2023-12-19T19:00:04.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.966+0000 7ff5dc19d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5d406d520 0x7ff5d40700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:04.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.966+0000 7ff5dc19d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5d40bffc0 0x7ff5d40a97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:04.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.966+0000 7ff5dc19d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d41560e0 0x7ff5d40a9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:04.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.966+0000 7ff5dc19d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40aa260 con 0x7ff5d41560e0 2023-12-19T19:00:04.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.966+0000 7ff5dc19d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d41504a0 con 0x7ff5d406d520 2023-12-19T19:00:04.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.966+0000 7ff5dc19d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d41519e0 con 0x7ff5d40bffc0 2023-12-19T19:00:04.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.966+0000 7ff5da73a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d41560e0 0x7ff5d40a9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:04.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.970+0000 7ff5da73a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d41560e0 0x7ff5d40a9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54688/0 (socket says 172.21.15.133:54688) 2023-12-19T19:00:04.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.970+0000 7ff5da73a640 1 -- 172.21.15.133:0/169282090 learned_addr learned my addr 172.21.15.133:0/169282090 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:04.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.970+0000 7ff5d9f39640 1 --2- 172.21.15.133:0/169282090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5d406d520 0x7ff5d40700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:04.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.970+0000 7ff5d9738640 1 --2- 172.21.15.133:0/169282090 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5d40bffc0 0x7ff5d40a97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:04.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.970+0000 7ff5da73a640 1 -- 172.21.15.133:0/169282090 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5d40bffc0 msgr2=0x7ff5d40a97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:04.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.970+0000 7ff5da73a640 1 --2- 172.21.15.133:0/169282090 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5d40bffc0 0x7ff5d40a97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.970+0000 7ff5da73a640 1 -- 172.21.15.133:0/169282090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5d406d520 msgr2=0x7ff5d40700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:04.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.970+0000 7ff5da73a640 1 --2- 172.21.15.133:0/169282090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5d406d520 0x7ff5d40700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:04.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.970+0000 7ff5da73a640 1 -- 172.21.15.133:0/169282090 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5cc009b30 con 0x7ff5d41560e0 2023-12-19T19:00:04.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.970+0000 7ff5d9f39640 1 --2- 172.21.15.133:0/169282090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5d406d520 0x7ff5d40700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:04.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.970+0000 7ff5da73a640 1 --2- 172.21.15.133:0/169282090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d41560e0 0x7ff5d40a9d20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc01a610 tx=0x7ff5cc019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:04.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.970+0000 7ff5ca7fc640 1 -- 172.21.15.133:0/169282090 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc0b8670 con 0x7ff5d41560e0 2023-12-19T19:00:04.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.970+0000 7ff5ca7fc640 1 -- 172.21.15.133:0/169282090 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc0b87d0 con 0x7ff5d41560e0 2023-12-19T19:00:04.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.970+0000 7ff5ca7fc640 1 -- 172.21.15.133:0/169282090 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc0b8b60 con 0x7ff5d41560e0 2023-12-19T19:00:04.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.970+0000 7ff5dc19d640 1 -- 172.21.15.133:0/169282090 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d41501c0 con 0x7ff5d41560e0 2023-12-19T19:00:04.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.970+0000 7ff5dc19d640 1 -- 172.21.15.133:0/169282090 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d40705f0 con 0x7ff5d41560e0 2023-12-19T19:00:04.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.970+0000 7ff5dc19d640 1 -- 172.21.15.133:0/169282090 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d4151b50 con 0x7ff5d41560e0 2023-12-19T19:00:04.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.970+0000 7ff5ca7fc640 1 -- 172.21.15.133:0/169282090 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff5cc0b8cc0 con 0x7ff5d41560e0 2023-12-19T19:00:04.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.970+0000 7ff5ca7fc640 1 --2- 172.21.15.133:0/169282090 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5b80664a0 0x7ff5b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:04.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.970+0000 7ff5ca7fc640 1 -- 172.21.15.133:0/169282090 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff5cc11f4d0 con 0x7ff5d41560e0 2023-12-19T19:00:04.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.974+0000 7ff5d9f39640 1 --2- 172.21.15.133:0/169282090 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5b80664a0 0x7ff5b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:04.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.974+0000 7ff5d9f39640 1 --2- 172.21.15.133:0/169282090 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5b80664a0 0x7ff5b8068960 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000b990 tx=0x7ff5d0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:04.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:04.974+0000 7ff5ca7fc640 1 -- 172.21.15.133:0/169282090 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff5cc0ec840 con 0x7ff5d41560e0 2023-12-19T19:00:05.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.126+0000 7ff5dc19d640 1 -- 172.21.15.133:0/169282090 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5d4068400 con 0x7ff5d41560e0 2023-12-19T19:00:05.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.126+0000 7ff5ca7fc640 1 -- 172.21.15.133:0/169282090 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+20265 (secure 0 0 0) 0x7ff5cc0efe60 con 0x7ff5d41560e0 2023-12-19T19:00:05.130 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:05.130 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":35,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T18:59:46.667472+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:59:25.798150+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-19T18:59:26.236078+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T18:59:42.757628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-19T18:59:44.017454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:00:05.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.130+0000 7ff5dc19d640 1 -- 172.21.15.133:0/169282090 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5b80664a0 msgr2=0x7ff5b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:05.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.130+0000 7ff5dc19d640 1 --2- 172.21.15.133:0/169282090 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5b80664a0 0x7ff5b8068960 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000b990 tx=0x7ff5d0008040 comp rx=0 tx=0).stop 2023-12-19T19:00:05.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.130+0000 7ff5dc19d640 1 -- 172.21.15.133:0/169282090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d41560e0 msgr2=0x7ff5d40a9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:05.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.130+0000 7ff5dc19d640 1 --2- 172.21.15.133:0/169282090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d41560e0 0x7ff5d40a9d20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc01a610 tx=0x7ff5cc019780 comp rx=0 tx=0).stop 2023-12-19T19:00:05.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.130+0000 7ff5dc19d640 1 -- 172.21.15.133:0/169282090 shutdown_connections 2023-12-19T19:00:05.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.130+0000 7ff5dc19d640 1 --2- 172.21.15.133:0/169282090 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff5b80664a0 0x7ff5b8068960 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:05.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.130+0000 7ff5dc19d640 1 --2- 172.21.15.133:0/169282090 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5d41560e0 0x7ff5d40a9d20 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:05.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.130+0000 7ff5dc19d640 1 --2- 172.21.15.133:0/169282090 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff5d40bffc0 0x7ff5d40a97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:05.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.130+0000 7ff5dc19d640 1 --2- 172.21.15.133:0/169282090 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff5d406d520 0x7ff5d40700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:05.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.130+0000 7ff5dc19d640 1 -- 172.21.15.133:0/169282090 >> 172.21.15.133:0/169282090 conn(0x7ff5d406a5b0 msgr2=0x7ff5d406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:05.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.130+0000 7ff5dc19d640 1 -- 172.21.15.133:0/169282090 shutdown_connections 2023-12-19T19:00:05.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.130+0000 7ff5dc19d640 1 -- 172.21.15.133:0/169282090 wait complete. 2023-12-19T19:00:05.152 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T19:00:05.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.286+0000 7f8bfdbdf640 1 Processor -- start 2023-12-19T19:00:05.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.286+0000 7f8bfdbdf640 1 -- start start 2023-12-19T19:00:05.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.290+0000 7f8bfdbdf640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8bf8151e90 0x7f8bf80c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:05.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.290+0000 7f8bfdbdf640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bf80c7ea0 0x7f8bf806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:05.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.290+0000 7f8bfdbdf640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf806c860 con 0x7f8bf80c4e60 2023-12-19T19:00:05.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.290+0000 7f8bfdbdf640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf80c8750 con 0x7f8bf8151e90 2023-12-19T19:00:05.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.290+0000 7f8bfdbdf640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf81552d0 con 0x7f8bf80c7ea0 2023-12-19T19:00:05.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.290+0000 7f8bf77fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8bf8151e90 0x7f8bf80c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:05.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.290+0000 7f8bf7fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8bf80c4e60 0x7f8bf806b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:45728/0 (socket says 172.21.15.133:45728) 2023-12-19T19:00:05.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.290+0000 7f8bf7fff640 1 -- 172.21.15.133:0/2751199714 learned_addr learned my addr 172.21.15.133:0/2751199714 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.290+0000 7f8bf77fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8bf8151e90 0x7f8bf80c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54692/0 (socket says 172.21.15.133:54692) 2023-12-19T19:00:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.290+0000 7f8beffff640 1 --2- 172.21.15.133:0/2751199714 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bf80c7ea0 0x7f8bf806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.290+0000 7f8bf77fe640 1 -- 172.21.15.133:0/2751199714 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bf80c7ea0 msgr2=0x7f8bf806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.290+0000 7f8bf77fe640 1 --2- 172.21.15.133:0/2751199714 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bf80c7ea0 0x7f8bf806b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.290+0000 7f8bf77fe640 1 -- 172.21.15.133:0/2751199714 >> v1:172.21.15.133:6789/0 conn(0x7f8bf80c4e60 legacy=0x7f8bf806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.290+0000 7f8bf77fe640 1 -- 172.21.15.133:0/2751199714 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf8154930 con 0x7f8bf8151e90 2023-12-19T19:00:05.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.290+0000 7f8beffff640 1 --2- 172.21.15.133:0/2751199714 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bf80c7ea0 0x7f8bf806b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:00:05.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.294+0000 7f8bf77fe640 1 --2- 172.21.15.133:0/2751199714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bf8151e90 0x7f8bf80c4920 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8be80097c0 tx=0x7f8be801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5476b42c2883f5f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:05.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.294+0000 7f8bf6ffd640 1 -- 172.21.15.133:0/2751199714 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be80ab600 con 0x7f8bf8151e90 2023-12-19T19:00:05.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.294+0000 7f8bf6ffd640 1 -- 172.21.15.133:0/2751199714 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be80a7050 con 0x7f8bf8151e90 2023-12-19T19:00:05.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.294+0000 7f8bf6ffd640 1 -- 172.21.15.133:0/2751199714 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be80ab980 con 0x7f8bf8151e90 2023-12-19T19:00:05.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.294+0000 7f8bfdbdf640 1 -- 172.21.15.133:0/2751199714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bf8151e90 msgr2=0x7f8bf80c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:05.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.294+0000 7f8bfdbdf640 1 --2- 172.21.15.133:0/2751199714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bf8151e90 0x7f8bf80c4920 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8be80097c0 tx=0x7f8be801c360 comp rx=0 tx=0).stop 2023-12-19T19:00:05.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.294+0000 7f8bfdbdf640 1 -- 172.21.15.133:0/2751199714 shutdown_connections 2023-12-19T19:00:05.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.294+0000 7f8bfdbdf640 1 --2- 172.21.15.133:0/2751199714 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bf80c7ea0 0x7f8bf806b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:05.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.294+0000 7f8bfdbdf640 1 --2- 172.21.15.133:0/2751199714 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bf8151e90 0x7f8bf80c4920 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:05.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.294+0000 7f8bfdbdf640 1 -- 172.21.15.133:0/2751199714 >> 172.21.15.133:0/2751199714 conn(0x7f8bf80ca170 msgr2=0x7f8bf80ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:05.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.294+0000 7f8bfdbdf640 1 -- 172.21.15.133:0/2751199714 shutdown_connections 2023-12-19T19:00:05.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.294+0000 7f8bfdbdf640 1 -- 172.21.15.133:0/2751199714 wait complete. 2023-12-19T19:00:05.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.294+0000 7f8bfdbdf640 1 Processor -- start 2023-12-19T19:00:05.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.294+0000 7f8bfdbdf640 1 -- start start 2023-12-19T19:00:05.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8bfdbdf640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bf80c4e60 0x7f8bf8158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:05.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8bfdbdf640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bf80c7ea0 0x7f8bf81f0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:05.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8bfdbdf640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bf8151e90 0x7f8bf81f05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:05.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8bfdbdf640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf8155f00 con 0x7f8bf80c7ea0 2023-12-19T19:00:05.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8bfdbdf640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf8144320 con 0x7f8bf8151e90 2023-12-19T19:00:05.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8bfdbdf640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf80aac70 con 0x7f8bf80c4e60 2023-12-19T19:00:05.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8beffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bf80c7ea0 0x7f8bf81f0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:05.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8beffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bf80c7ea0 0x7f8bf81f0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54698/0 (socket says 172.21.15.133:54698) 2023-12-19T19:00:05.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8beffff640 1 -- 172.21.15.133:0/2261380385 learned_addr learned my addr 172.21.15.133:0/2261380385 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:05.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8bf7fff640 1 --2- 172.21.15.133:0/2261380385 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bf8151e90 0x7f8bf81f05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:05.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8bf77fe640 1 --2- 172.21.15.133:0/2261380385 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bf80c4e60 0x7f8bf8158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:05.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8beffff640 1 -- 172.21.15.133:0/2261380385 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bf80c4e60 msgr2=0x7f8bf8158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:05.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8beffff640 1 --2- 172.21.15.133:0/2261380385 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bf80c4e60 0x7f8bf8158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:05.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8beffff640 1 -- 172.21.15.133:0/2261380385 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bf8151e90 msgr2=0x7f8bf81f05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:05.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8beffff640 1 --2- 172.21.15.133:0/2261380385 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bf8151e90 0x7f8bf81f05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:05.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8beffff640 1 -- 172.21.15.133:0/2261380385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be8009420 con 0x7f8bf80c7ea0 2023-12-19T19:00:05.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8beffff640 1 --2- 172.21.15.133:0/2261380385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bf80c7ea0 0x7f8bf81f0070 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8be000c7f0 tx=0x7f8be000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:05.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8bf4ff9640 1 -- 172.21.15.133:0/2261380385 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be000cea0 con 0x7f8bf80c7ea0 2023-12-19T19:00:05.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8bf4ff9640 1 -- 172.21.15.133:0/2261380385 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be00079d0 con 0x7f8bf80c7ea0 2023-12-19T19:00:05.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8bf4ff9640 1 -- 172.21.15.133:0/2261380385 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be0007d80 con 0x7f8bf80c7ea0 2023-12-19T19:00:05.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8bfdbdf640 1 -- 172.21.15.133:0/2261380385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf80aa370 con 0x7f8bf80c7ea0 2023-12-19T19:00:05.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8bfdbdf640 1 -- 172.21.15.133:0/2261380385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf80aaf10 con 0x7f8bf80c7ea0 2023-12-19T19:00:05.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8bfdbdf640 1 -- 172.21.15.133:0/2261380385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf8068400 con 0x7f8bf80c7ea0 2023-12-19T19:00:05.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.298+0000 7f8bf4ff9640 1 -- 172.21.15.133:0/2261380385 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8be00113f0 con 0x7f8bf80c7ea0 2023-12-19T19:00:05.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.302+0000 7f8bf4ff9640 1 --2- 172.21.15.133:0/2261380385 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8bd8066470 0x7f8bd8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:05.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.302+0000 7f8bf4ff9640 1 -- 172.21.15.133:0/2261380385 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8be00841a0 con 0x7f8bf80c7ea0 2023-12-19T19:00:05.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.302+0000 7f8bf77fe640 1 --2- 172.21.15.133:0/2261380385 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8bd8066470 0x7f8bd8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:05.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.302+0000 7f8bf77fe640 1 --2- 172.21.15.133:0/2261380385 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8bd8066470 0x7f8bd8068930 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8be80ad000 tx=0x7f8be80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:05.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.306+0000 7f8bf4ff9640 1 -- 172.21.15.133:0/2261380385 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8be0051400 con 0x7f8bf80c7ea0 2023-12-19T19:00:05.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.486+0000 7f8bfdbdf640 1 -- 172.21.15.133:0/2261380385 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8bf8066ff0 con 0x7f8bf80c7ea0 2023-12-19T19:00:05.490 INFO:tasks.ceph.mon.a.smithi133.stderr:2023-12-19T19:00:05.486+0000 7f5189f85640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T19:00:05.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.490+0000 7f8bf4ff9640 1 -- 172.21.15.133:0/2261380385 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8be0054a20 con 0x7f8bf80c7ea0 2023-12-19T19:00:05.494 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T19:00:05.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.494+0000 7f8bfdbdf640 1 -- 172.21.15.133:0/2261380385 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8bd8066470 msgr2=0x7f8bd8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:05.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.494+0000 7f8bfdbdf640 1 --2- 172.21.15.133:0/2261380385 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8bd8066470 0x7f8bd8068930 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8be80ad000 tx=0x7f8be80a6000 comp rx=0 tx=0).stop 2023-12-19T19:00:05.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.494+0000 7f8bfdbdf640 1 -- 172.21.15.133:0/2261380385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bf80c7ea0 msgr2=0x7f8bf81f0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:05.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.494+0000 7f8bfdbdf640 1 --2- 172.21.15.133:0/2261380385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bf80c7ea0 0x7f8bf81f0070 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8be000c7f0 tx=0x7f8be000ccb0 comp rx=0 tx=0).stop 2023-12-19T19:00:05.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.494+0000 7f8bfdbdf640 1 -- 172.21.15.133:0/2261380385 shutdown_connections 2023-12-19T19:00:05.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.494+0000 7f8bfdbdf640 1 --2- 172.21.15.133:0/2261380385 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8bd8066470 0x7f8bd8068930 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:05.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.494+0000 7f8bfdbdf640 1 --2- 172.21.15.133:0/2261380385 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8bf8151e90 0x7f8bf81f05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.494+0000 7f8bfdbdf640 1 --2- 172.21.15.133:0/2261380385 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8bf80c7ea0 0x7f8bf81f0070 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.494+0000 7f8bfdbdf640 1 --2- 172.21.15.133:0/2261380385 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8bf80c4e60 0x7f8bf8158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.494+0000 7f8bfdbdf640 1 -- 172.21.15.133:0/2261380385 >> 172.21.15.133:0/2261380385 conn(0x7f8bf80ca170 msgr2=0x7f8bf80ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.494+0000 7f8bfdbdf640 1 -- 172.21.15.133:0/2261380385 shutdown_connections 2023-12-19T19:00:05.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.494+0000 7f8bfdbdf640 1 -- 172.21.15.133:0/2261380385 wait complete. 2023-12-19T19:00:05.506 INFO:tasks.ceph.mds.c.smithi133.stderr: -2776> 2023-12-19T18:59:32.747+0000 7ff262483640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T19:00:05.524 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T19:00:05.562 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2023-12-19T19:00:05.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.670+0000 7fcd2507b640 1 Processor -- start 2023-12-19T19:00:05.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.670+0000 7fcd2507b640 1 -- start start 2023-12-19T19:00:05.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.670+0000 7fcd2507b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd2006c310 0x7fcd2006a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:05.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.670+0000 7fcd2507b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2006cb80 con 0x7fcd201586e0 2023-12-19T19:00:05.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.670+0000 7fcd2507b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd20158250 con 0x7fcd2006c6f0 2023-12-19T19:00:05.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.670+0000 7fcd2507b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2006b750 con 0x7fcd2006c310 2023-12-19T19:00:05.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.670+0000 7fcd1f7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcd201586e0 0x7fcd200c7cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:45758/0 (socket says 172.21.15.133:45758) 2023-12-19T19:00:05.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.670+0000 7fcd1f7fe640 1 -- 172.21.15.133:0/2218760673 learned_addr learned my addr 172.21.15.133:0/2218760673 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:05.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.674+0000 7fcd1ffff640 1 --2- 172.21.15.133:0/2218760673 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd2006c310 0x7fcd2006a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:05.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.674+0000 7fcd1effd640 1 -- 172.21.15.133:0/2218760673 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 637425904 0 0) 0x7fcd14001120 con 0x7fcd201586e0 2023-12-19T19:00:05.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.674+0000 7fcd1effd640 1 -- 172.21.15.133:0/2218760673 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd08003530 con 0x7fcd201586e0 2023-12-19T19:00:05.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.674+0000 7fcd1effd640 1 -- 172.21.15.133:0/2218760673 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445167732 0 0) 0x7fcd20158250 con 0x7fcd2006c6f0 2023-12-19T19:00:05.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.674+0000 7fcd1effd640 1 -- 172.21.15.133:0/2218760673 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd14001120 con 0x7fcd2006c6f0 2023-12-19T19:00:05.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.674+0000 7fcd1ffff640 1 -- 172.21.15.133:0/2218760673 >> v1:172.21.15.138:6789/0 conn(0x7fcd2006c6f0 legacy=0x7fcd2015eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:05.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.674+0000 7fcd1ffff640 1 -- 172.21.15.133:0/2218760673 >> v1:172.21.15.133:6789/0 conn(0x7fcd201586e0 legacy=0x7fcd200c7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:05.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.674+0000 7fcd1ffff640 1 -- 172.21.15.133:0/2218760673 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd200c83e0 con 0x7fcd2006c310 2023-12-19T19:00:05.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.674+0000 7fcd1ffff640 1 --2- 172.21.15.133:0/2218760673 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd2006c310 0x7fcd2006a9e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcd100097f0 tx=0x7fcd1001c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79681afb5de94aa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:05.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.674+0000 7fcd1effd640 1 -- 172.21.15.133:0/2218760673 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd100ab600 con 0x7fcd2006c310 2023-12-19T19:00:05.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.674+0000 7fcd1effd640 1 -- 172.21.15.133:0/2218760673 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd100a7050 con 0x7fcd2006c310 2023-12-19T19:00:05.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.674+0000 7fcd1effd640 1 -- 172.21.15.133:0/2218760673 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd100ab980 con 0x7fcd2006c310 2023-12-19T19:00:05.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd2507b640 1 -- 172.21.15.133:0/2218760673 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd2006c310 msgr2=0x7fcd2006a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:05.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd2507b640 1 --2- 172.21.15.133:0/2218760673 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd2006c310 0x7fcd2006a9e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcd100097f0 tx=0x7fcd1001c3a0 comp rx=0 tx=0).stop 2023-12-19T19:00:05.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd2507b640 1 -- 172.21.15.133:0/2218760673 shutdown_connections 2023-12-19T19:00:05.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd2507b640 1 --2- 172.21.15.133:0/2218760673 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd2006c310 0x7fcd2006a9e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:05.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd2507b640 1 -- 172.21.15.133:0/2218760673 >> 172.21.15.133:0/2218760673 conn(0x7fcd200abc10 msgr2=0x7fcd200ac020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:05.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd2507b640 1 -- 172.21.15.133:0/2218760673 shutdown_connections 2023-12-19T19:00:05.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd2507b640 1 -- 172.21.15.133:0/2218760673 wait complete. 2023-12-19T19:00:05.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd2507b640 1 Processor -- start 2023-12-19T19:00:05.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd2507b640 1 -- start start 2023-12-19T19:00:05.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd2507b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd2006c310 0x7fcd20145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:05.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd2507b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd2006c6f0 0x7fcd20154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:05.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd2507b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd201586e0 0x7fcd20154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:05.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd2507b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd20152970 con 0x7fcd2006c310 2023-12-19T19:00:05.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd2507b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd201455a0 con 0x7fcd201586e0 2023-12-19T19:00:05.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd2507b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd20155530 con 0x7fcd2006c6f0 2023-12-19T19:00:05.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd1ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd2006c310 0x7fcd20145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:05.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd1ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd2006c310 0x7fcd20145060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54720/0 (socket says 172.21.15.133:54720) 2023-12-19T19:00:05.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd1ffff640 1 -- 172.21.15.133:0/3569551254 learned_addr learned my addr 172.21.15.133:0/3569551254 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:05.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd1f7fe640 1 --2- 172.21.15.133:0/3569551254 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd2006c6f0 0x7fcd20154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:05.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd2487a640 1 --2- 172.21.15.133:0/3569551254 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd201586e0 0x7fcd20154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:05.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd1ffff640 1 -- 172.21.15.133:0/3569551254 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd2006c6f0 msgr2=0x7fcd20154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:05.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd1ffff640 1 --2- 172.21.15.133:0/3569551254 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd2006c6f0 0x7fcd20154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:05.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd1ffff640 1 -- 172.21.15.133:0/3569551254 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd201586e0 msgr2=0x7fcd20154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:05.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd1ffff640 1 --2- 172.21.15.133:0/3569551254 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd201586e0 0x7fcd20154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:05.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd1ffff640 1 -- 172.21.15.133:0/3569551254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd10009420 con 0x7fcd2006c310 2023-12-19T19:00:05.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.678+0000 7fcd1ffff640 1 --2- 172.21.15.133:0/3569551254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd2006c310 0x7fcd20145060 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fcd10018fb0 tx=0x7fcd1001abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:05.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.682+0000 7fcd1cff9640 1 -- 172.21.15.133:0/3569551254 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd100b7450 con 0x7fcd2006c310 2023-12-19T19:00:05.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.682+0000 7fcd1cff9640 1 -- 172.21.15.133:0/3569551254 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd100b75d0 con 0x7fcd2006c310 2023-12-19T19:00:05.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.682+0000 7fcd2507b640 1 -- 172.21.15.133:0/3569551254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd201496c0 con 0x7fcd2006c310 2023-12-19T19:00:05.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.682+0000 7fcd1cff9640 1 -- 172.21.15.133:0/3569551254 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd100b7980 con 0x7fcd2006c310 2023-12-19T19:00:05.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.682+0000 7fcd2507b640 1 -- 172.21.15.133:0/3569551254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd20149c80 con 0x7fcd2006c310 2023-12-19T19:00:05.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.682+0000 7fcd2507b640 1 -- 172.21.15.133:0/3569551254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2004e850 con 0x7fcd2006c310 2023-12-19T19:00:05.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.682+0000 7fcd1cff9640 1 -- 172.21.15.133:0/3569551254 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fcd100b7ae0 con 0x7fcd2006c310 2023-12-19T19:00:05.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.682+0000 7fcd1cff9640 1 --2- 172.21.15.133:0/3569551254 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd0c066470 0x7fcd0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:05.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.682+0000 7fcd1cff9640 1 -- 172.21.15.133:0/3569551254 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6651+0+0 (secure 0 0 0) 0x7fcd1011ea90 con 0x7fcd2006c310 2023-12-19T19:00:05.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.682+0000 7fcd1f7fe640 1 --2- 172.21.15.133:0/3569551254 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd0c066470 0x7fcd0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:05.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.686+0000 7fcd1f7fe640 1 --2- 172.21.15.133:0/3569551254 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd0c066470 0x7fcd0c068930 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcd20160250 tx=0x7fcd14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:05.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.686+0000 7fcd1cff9640 1 -- 172.21.15.133:0/3569551254 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fcd100ebbf0 con 0x7fcd2006c310 2023-12-19T19:00:05.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:05.870+0000 7fcd2507b640 1 -- 172.21.15.133:0/3569551254 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcd200ab630 con 0x7fcd2006c310 2023-12-19T19:00:06.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.494+0000 7fcd1cff9640 1 -- 172.21.15.133:0/3569551254 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcd100ef210 con 0x7fcd2006c310 2023-12-19T19:00:06.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.494+0000 7fcd2507b640 1 -- 172.21.15.133:0/3569551254 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd0c066470 msgr2=0x7fcd0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:06.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.494+0000 7fcd2507b640 1 --2- 172.21.15.133:0/3569551254 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd0c066470 0x7fcd0c068930 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fcd20160250 tx=0x7fcd14009040 comp rx=0 tx=0).stop 2023-12-19T19:00:06.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.494+0000 7fcd2507b640 1 -- 172.21.15.133:0/3569551254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd2006c310 msgr2=0x7fcd20145060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:06.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.494+0000 7fcd2507b640 1 --2- 172.21.15.133:0/3569551254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd2006c310 0x7fcd20145060 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fcd10018fb0 tx=0x7fcd1001abe0 comp rx=0 tx=0).stop 2023-12-19T19:00:06.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.494+0000 7fcd2507b640 1 -- 172.21.15.133:0/3569551254 shutdown_connections 2023-12-19T19:00:06.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.494+0000 7fcd2507b640 1 --2- 172.21.15.133:0/3569551254 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd0c066470 0x7fcd0c068930 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:06.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.494+0000 7fcd2507b640 1 --2- 172.21.15.133:0/3569551254 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd201586e0 0x7fcd20154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:06.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.494+0000 7fcd2507b640 1 --2- 172.21.15.133:0/3569551254 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd2006c6f0 0x7fcd20154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:06.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.494+0000 7fcd2507b640 1 --2- 172.21.15.133:0/3569551254 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd2006c310 0x7fcd20145060 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:06.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.494+0000 7fcd2507b640 1 -- 172.21.15.133:0/3569551254 >> 172.21.15.133:0/3569551254 conn(0x7fcd200abc10 msgr2=0x7fcd20066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:06.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.494+0000 7fcd2507b640 1 -- 172.21.15.133:0/3569551254 shutdown_connections 2023-12-19T19:00:06.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.494+0000 7fcd2507b640 1 -- 172.21.15.133:0/3569551254 wait complete. 2023-12-19T19:00:06.521 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T19:00:06.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.702+0000 7f7f24ff8640 1 Processor -- start 2023-12-19T19:00:06.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.702+0000 7f7f24ff8640 1 -- start start 2023-12-19T19:00:06.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.706+0000 7f7f24ff8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f200c6d80 0x7f7f20154760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:06.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.706+0000 7f7f24ff8640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7f200c5bc0 0x7f7f20151b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:06.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.706+0000 7f7f24ff8640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f20157e70 con 0x7f7f200c7eb0 2023-12-19T19:00:06.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.706+0000 7f7f24ff8640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f200c6af0 con 0x7f7f200c5bc0 2023-12-19T19:00:06.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.706+0000 7f7f24ff8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f200c6530 con 0x7f7f200c6d80 2023-12-19T19:00:06.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.706+0000 7f7f1ffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7f200c5bc0 0x7f7f20151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:06.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.706+0000 7f7f1f7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7f200c7eb0 0x7f7f20158630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:45762/0 (socket says 172.21.15.133:45762) 2023-12-19T19:00:06.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.706+0000 7f7f1f7fe640 1 -- 172.21.15.133:0/2890164668 learned_addr learned my addr 172.21.15.133:0/2890164668 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:06.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.706+0000 7f7f1effd640 1 --2- 172.21.15.133:0/2890164668 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f200c6d80 0x7f7f20154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:06.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.706+0000 7f7f1ffff640 1 -- 172.21.15.133:0/2890164668 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f200c6d80 msgr2=0x7f7f20154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:06.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.706+0000 7f7f1ffff640 1 --2- 172.21.15.133:0/2890164668 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f200c6d80 0x7f7f20154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:06.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.706+0000 7f7f1ffff640 1 -- 172.21.15.133:0/2890164668 >> v1:172.21.15.133:6789/0 conn(0x7f7f200c7eb0 legacy=0x7f7f20158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:06.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.706+0000 7f7f1ffff640 1 -- 172.21.15.133:0/2890164668 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f200c6810 con 0x7f7f200c5bc0 2023-12-19T19:00:06.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.706+0000 7f7f1e7fc640 1 -- 172.21.15.133:0/2890164668 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736961227 0 0) 0x7f7f20157e70 con 0x7f7f200c7eb0 2023-12-19T19:00:06.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.710+0000 7f7f1ffff640 1 --2- 172.21.15.133:0/2890164668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f200c5bc0 0x7f7f20151b20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7f18009d90 tx=0x7f7f1801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99e396f7f2363e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:06.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.710+0000 7f7f1e7fc640 1 -- 172.21.15.133:0/2890164668 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f180a5970 con 0x7f7f200c5bc0 2023-12-19T19:00:06.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.710+0000 7f7f1e7fc640 1 -- 172.21.15.133:0/2890164668 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f180a5ad0 con 0x7f7f200c5bc0 2023-12-19T19:00:06.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.710+0000 7f7f1e7fc640 1 -- 172.21.15.133:0/2890164668 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f180a5e60 con 0x7f7f200c5bc0 2023-12-19T19:00:06.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.710+0000 7f7f24ff8640 1 -- 172.21.15.133:0/2890164668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f200c5bc0 msgr2=0x7f7f20151b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:06.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.710+0000 7f7f24ff8640 1 --2- 172.21.15.133:0/2890164668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f200c5bc0 0x7f7f20151b20 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f7f18009d90 tx=0x7f7f1801c890 comp rx=0 tx=0).stop 2023-12-19T19:00:06.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.710+0000 7f7f24ff8640 1 -- 172.21.15.133:0/2890164668 shutdown_connections 2023-12-19T19:00:06.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.710+0000 7f7f24ff8640 1 --2- 172.21.15.133:0/2890164668 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f200c5bc0 0x7f7f20151b20 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:06.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.710+0000 7f7f24ff8640 1 --2- 172.21.15.133:0/2890164668 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f200c6d80 0x7f7f20154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:06.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.710+0000 7f7f24ff8640 1 -- 172.21.15.133:0/2890164668 >> 172.21.15.133:0/2890164668 conn(0x7f7f200a9a30 msgr2=0x7f7f200a9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:06.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.710+0000 7f7f24ff8640 1 -- 172.21.15.133:0/2890164668 shutdown_connections 2023-12-19T19:00:06.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.710+0000 7f7f24ff8640 1 -- 172.21.15.133:0/2890164668 wait complete. 2023-12-19T19:00:06.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.710+0000 7f7f24ff8640 1 Processor -- start 2023-12-19T19:00:06.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.710+0000 7f7f24ff8640 1 -- start start 2023-12-19T19:00:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f24ff8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f200c5bc0 0x7f7f2014e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f24ff8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f200c6d80 0x7f7f201441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f24ff8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f200c7eb0 0x7f7f20144730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f24ff8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2014b940 con 0x7f7f200c6d80 2023-12-19T19:00:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f24ff8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2006ce40 con 0x7f7f200c5bc0 2023-12-19T19:00:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f24ff8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2006d120 con 0x7f7f200c7eb0 2023-12-19T19:00:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f1effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f200c6d80 0x7f7f201441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f1effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f200c6d80 0x7f7f201441f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54746/0 (socket says 172.21.15.133:54746) 2023-12-19T19:00:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f1effd640 1 -- 172.21.15.133:0/1395071084 learned_addr learned my addr 172.21.15.133:0/1395071084 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:06.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f1ffff640 1 --2- 172.21.15.133:0/1395071084 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f200c7eb0 0x7f7f20144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:06.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f1f7fe640 1 --2- 172.21.15.133:0/1395071084 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f200c5bc0 0x7f7f2014e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:06.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f1effd640 1 -- 172.21.15.133:0/1395071084 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f200c7eb0 msgr2=0x7f7f20144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:06.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f1effd640 1 --2- 172.21.15.133:0/1395071084 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f200c7eb0 0x7f7f20144730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:06.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f1effd640 1 -- 172.21.15.133:0/1395071084 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f200c5bc0 msgr2=0x7f7f2014e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:06.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f1effd640 1 --2- 172.21.15.133:0/1395071084 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f200c5bc0 0x7f7f2014e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:06.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f1effd640 1 -- 172.21.15.133:0/1395071084 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f18009a70 con 0x7f7f200c6d80 2023-12-19T19:00:06.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f1f7fe640 1 --2- 172.21.15.133:0/1395071084 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f200c5bc0 0x7f7f2014e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:06.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f1effd640 1 --2- 172.21.15.133:0/1395071084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f200c6d80 0x7f7f201441f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7f1400e900 tx=0x7f7f1400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:06.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f07fff640 1 -- 172.21.15.133:0/1395071084 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f14009690 con 0x7f7f200c6d80 2023-12-19T19:00:06.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f07fff640 1 -- 172.21.15.133:0/1395071084 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1400ca00 con 0x7f7f200c6d80 2023-12-19T19:00:06.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f07fff640 1 -- 172.21.15.133:0/1395071084 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1400cdb0 con 0x7f7f200c6d80 2023-12-19T19:00:06.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f24ff8640 1 -- 172.21.15.133:0/1395071084 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2006d400 con 0x7f7f200c6d80 2023-12-19T19:00:06.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f24ff8640 1 -- 172.21.15.133:0/1395071084 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f20143cd0 con 0x7f7f200c6d80 2023-12-19T19:00:06.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f24ff8640 1 -- 172.21.15.133:0/1395071084 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2004e850 con 0x7f7f200c6d80 2023-12-19T19:00:06.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.714+0000 7f7f07fff640 1 -- 172.21.15.133:0/1395071084 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7f14013470 con 0x7f7f200c6d80 2023-12-19T19:00:06.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.718+0000 7f7f07fff640 1 --2- 172.21.15.133:0/1395071084 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7f0c066470 0x7f7f0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:06.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.718+0000 7f7f07fff640 1 -- 172.21.15.133:0/1395071084 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f7f140843f0 con 0x7f7f200c6d80 2023-12-19T19:00:06.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.718+0000 7f7f1f7fe640 1 --2- 172.21.15.133:0/1395071084 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7f0c066470 0x7f7f0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:06.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.718+0000 7f7f1f7fe640 1 --2- 172.21.15.133:0/1395071084 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7f0c066470 0x7f7f0c068930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7f10000f70 tx=0x7f7f10007cb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:06.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.722+0000 7f7f07fff640 1 -- 172.21.15.133:0/1395071084 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7f14051570 con 0x7f7f200c6d80 2023-12-19T19:00:06.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:06.870+0000 7f7f24ff8640 1 -- 172.21.15.133:0/1395071084 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7f20153f10 con 0x7f7f200c6d80 2023-12-19T19:00:07.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.502+0000 7f7f07fff640 1 -- 172.21.15.133:0/1395071084 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7f14054b90 con 0x7f7f200c6d80 2023-12-19T19:00:07.504 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2023-12-19T19:00:07.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.506+0000 7f7f24ff8640 1 -- 172.21.15.133:0/1395071084 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7f0c066470 msgr2=0x7f7f0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:07.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.506+0000 7f7f24ff8640 1 --2- 172.21.15.133:0/1395071084 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7f0c066470 0x7f7f0c068930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7f10000f70 tx=0x7f7f10007cb0 comp rx=0 tx=0).stop 2023-12-19T19:00:07.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.506+0000 7f7f24ff8640 1 -- 172.21.15.133:0/1395071084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f200c6d80 msgr2=0x7f7f201441f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:07.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.506+0000 7f7f24ff8640 1 --2- 172.21.15.133:0/1395071084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f200c6d80 0x7f7f201441f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f7f1400e900 tx=0x7f7f1400edc0 comp rx=0 tx=0).stop 2023-12-19T19:00:07.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.506+0000 7f7f24ff8640 1 -- 172.21.15.133:0/1395071084 shutdown_connections 2023-12-19T19:00:07.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.506+0000 7f7f24ff8640 1 --2- 172.21.15.133:0/1395071084 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7f0c066470 0x7f7f0c068930 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:07.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.506+0000 7f7f24ff8640 1 --2- 172.21.15.133:0/1395071084 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7f200c7eb0 0x7f7f20144730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:07.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.506+0000 7f7f24ff8640 1 --2- 172.21.15.133:0/1395071084 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f200c6d80 0x7f7f201441f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:07.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.506+0000 7f7f24ff8640 1 --2- 172.21.15.133:0/1395071084 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7f200c5bc0 0x7f7f2014e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:07.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.506+0000 7f7f24ff8640 1 -- 172.21.15.133:0/1395071084 >> 172.21.15.133:0/1395071084 conn(0x7f7f200a9a30 msgr2=0x7f7f20154f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:07.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.506+0000 7f7f24ff8640 1 -- 172.21.15.133:0/1395071084 shutdown_connections 2023-12-19T19:00:07.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.506+0000 7f7f24ff8640 1 -- 172.21.15.133:0/1395071084 wait complete. 2023-12-19T19:00:07.533 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T19:00:07.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.674+0000 7fda26b2a640 1 Processor -- start 2023-12-19T19:00:07.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.674+0000 7fda26b2a640 1 -- start start 2023-12-19T19:00:07.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda26b2a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda200c07f0 0x7fda200c19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:07.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda26b2a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda20073b70 con 0x7fda20151e00 2023-12-19T19:00:07.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda26b2a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda200c0c80 con 0x7fda200c0370 2023-12-19T19:00:07.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda26b2a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda200735b0 con 0x7fda200c07f0 2023-12-19T19:00:07.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda248c6640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fda20151e00 0x7fda20158580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:45774/0 (socket says 172.21.15.133:45774) 2023-12-19T19:00:07.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda248c6640 1 -- 172.21.15.133:0/1579333140 learned_addr learned my addr 172.21.15.133:0/1579333140 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:07.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda250c7640 1 --2- 172.21.15.133:0/1579333140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda200c07f0 0x7fda200c19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:07.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda177fe640 1 -- 172.21.15.133:0/1579333140 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 903192057 0 0) 0x7fda20073b70 con 0x7fda20151e00 2023-12-19T19:00:07.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda177fe640 1 -- 172.21.15.133:0/1579333140 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda08003530 con 0x7fda20151e00 2023-12-19T19:00:07.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda177fe640 1 -- 172.21.15.133:0/1579333140 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 947563133 0 0) 0x7fda08003530 con 0x7fda20151e00 2023-12-19T19:00:07.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda177fe640 1 -- 172.21.15.133:0/1579333140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda200c07f0 msgr2=0x7fda200c19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:07.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda177fe640 1 --2- 172.21.15.133:0/1579333140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda200c07f0 0x7fda200c19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:07.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda177fe640 1 -- 172.21.15.133:0/1579333140 >> v1:172.21.15.138:6789/0 conn(0x7fda200c0370 legacy=0x7fda200c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:07.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda177fe640 1 -- 172.21.15.133:0/1579333140 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda20073890 con 0x7fda20151e00 2023-12-19T19:00:07.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda177fe640 1 -- 172.21.15.133:0/1579333140 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7fda1c001680 con 0x7fda20151e00 2023-12-19T19:00:07.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda177fe640 1 -- 172.21.15.133:0/1579333140 >> v1:172.21.15.133:6789/0 conn(0x7fda20151e00 legacy=0x7fda20158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:07.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda177fe640 1 --2- 172.21.15.133:0/1579333140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda080039b0 0x7fda08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:07.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda177fe640 1 --2- 172.21.15.133:0/1579333140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda200c07f0 0x7fda080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:07.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda177fe640 1 --2- 172.21.15.133:0/1579333140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda08004d10 0x7fda08005170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:07.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda177fe640 1 -- 172.21.15.133:0/1579333140 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda200735b0 con 0x7fda080039b0 2023-12-19T19:00:07.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda177fe640 1 -- 172.21.15.133:0/1579333140 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0800bbd0 con 0x7fda08004d10 2023-12-19T19:00:07.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda177fe640 1 -- 172.21.15.133:0/1579333140 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0800bd90 con 0x7fda200c07f0 2023-12-19T19:00:07.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda248c6640 1 --2- 172.21.15.133:0/1579333140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda080039b0 0x7fda08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:07.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda17fff640 1 --2- 172.21.15.133:0/1579333140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda200c07f0 0x7fda080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:07.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda250c7640 1 --2- 172.21.15.133:0/1579333140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda08004d10 0x7fda08005170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:07.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda248c6640 1 -- 172.21.15.133:0/1579333140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda200c07f0 msgr2=0x7fda080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:07.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda248c6640 1 --2- 172.21.15.133:0/1579333140 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda200c07f0 0x7fda080047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:07.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda248c6640 1 -- 172.21.15.133:0/1579333140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda08004d10 msgr2=0x7fda08005170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:07.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda248c6640 1 --2- 172.21.15.133:0/1579333140 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda08004d10 0x7fda08005170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:07.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.678+0000 7fda248c6640 1 -- 172.21.15.133:0/1579333140 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda08003530 con 0x7fda080039b0 2023-12-19T19:00:07.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.682+0000 7fda248c6640 1 --2- 172.21.15.133:0/1579333140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda080039b0 0x7fda08003dd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fda1c00c0e0 tx=0x7fda1c01cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5e1808cf815464 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:07.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.682+0000 7fda177fe640 1 -- 172.21.15.133:0/1579333140 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c005ae0 con 0x7fda080039b0 2023-12-19T19:00:07.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.682+0000 7fda177fe640 1 -- 172.21.15.133:0/1579333140 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1c005c40 con 0x7fda080039b0 2023-12-19T19:00:07.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.682+0000 7fda177fe640 1 -- 172.21.15.133:0/1579333140 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1c007070 con 0x7fda080039b0 2023-12-19T19:00:07.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.682+0000 7fda26b2a640 1 -- 172.21.15.133:0/1579333140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda080039b0 msgr2=0x7fda08003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:07.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.682+0000 7fda26b2a640 1 --2- 172.21.15.133:0/1579333140 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda080039b0 0x7fda08003dd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fda1c00c0e0 tx=0x7fda1c01cb60 comp rx=0 tx=0).stop 2023-12-19T19:00:07.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.682+0000 7fda250c7640 1 -- 172.21.15.133:0/1579333140 reap_dead start 2023-12-19T19:00:07.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.682+0000 7fda26b2a640 1 -- 172.21.15.133:0/1579333140 shutdown_connections 2023-12-19T19:00:07.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.682+0000 7fda26b2a640 1 -- 172.21.15.133:0/1579333140 >> 172.21.15.133:0/1579333140 conn(0x7fda200c31a0 msgr2=0x7fda200c35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:07.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.682+0000 7fda26b2a640 1 -- 172.21.15.133:0/1579333140 shutdown_connections 2023-12-19T19:00:07.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.682+0000 7fda26b2a640 1 -- 172.21.15.133:0/1579333140 wait complete. 2023-12-19T19:00:07.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.682+0000 7fda26b2a640 1 Processor -- start 2023-12-19T19:00:07.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.682+0000 7fda26b2a640 1 -- start start 2023-12-19T19:00:07.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.686+0000 7fda26b2a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda080039b0 0x7fda201ed670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:07.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.686+0000 7fda26b2a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda200abcc0 0x7fda200ac140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:07.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.686+0000 7fda26b2a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda201471c0 0x7fda20147640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:07.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.686+0000 7fda26b2a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda20156780 con 0x7fda201471c0 2023-12-19T19:00:07.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.686+0000 7fda26b2a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda200a82b0 con 0x7fda080039b0 2023-12-19T19:00:07.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.686+0000 7fda26b2a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda200aa300 con 0x7fda200abcc0 2023-12-19T19:00:07.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.686+0000 7fda250c7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda201471c0 0x7fda20147640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:07.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.686+0000 7fda250c7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda201471c0 0x7fda20147640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54758/0 (socket says 172.21.15.133:54758) 2023-12-19T19:00:07.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.686+0000 7fda250c7640 1 -- 172.21.15.133:0/476561050 learned_addr learned my addr 172.21.15.133:0/476561050 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:07.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.686+0000 7fda17fff640 1 --2- 172.21.15.133:0/476561050 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda200abcc0 0x7fda200ac140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:07.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.686+0000 7fda248c6640 1 --2- 172.21.15.133:0/476561050 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda080039b0 0x7fda201ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:07.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.686+0000 7fda250c7640 1 -- 172.21.15.133:0/476561050 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda200abcc0 msgr2=0x7fda200ac140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:07.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.686+0000 7fda250c7640 1 --2- 172.21.15.133:0/476561050 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda200abcc0 0x7fda200ac140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:07.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.686+0000 7fda250c7640 1 -- 172.21.15.133:0/476561050 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda080039b0 msgr2=0x7fda201ed670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:07.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.686+0000 7fda250c7640 1 --2- 172.21.15.133:0/476561050 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda080039b0 0x7fda201ed670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:07.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.686+0000 7fda250c7640 1 -- 172.21.15.133:0/476561050 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda20147b80 con 0x7fda201471c0 2023-12-19T19:00:07.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.686+0000 7fda250c7640 1 --2- 172.21.15.133:0/476561050 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda201471c0 0x7fda20147640 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fda200a9410 tx=0x7fda1800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:07.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.686+0000 7fda157fa640 1 -- 172.21.15.133:0/476561050 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1800e040 con 0x7fda201471c0 2023-12-19T19:00:07.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.686+0000 7fda157fa640 1 -- 172.21.15.133:0/476561050 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1800f040 con 0x7fda201471c0 2023-12-19T19:00:07.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.686+0000 7fda26b2a640 1 -- 172.21.15.133:0/476561050 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda20155bb0 con 0x7fda201471c0 2023-12-19T19:00:07.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.686+0000 7fda157fa640 1 -- 172.21.15.133:0/476561050 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18015430 con 0x7fda201471c0 2023-12-19T19:00:07.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.686+0000 7fda26b2a640 1 -- 172.21.15.133:0/476561050 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda20156170 con 0x7fda201471c0 2023-12-19T19:00:07.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.686+0000 7fda26b2a640 1 -- 172.21.15.133:0/476561050 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda20156390 con 0x7fda201471c0 2023-12-19T19:00:07.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.690+0000 7fda157fa640 1 -- 172.21.15.133:0/476561050 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fda18015590 con 0x7fda201471c0 2023-12-19T19:00:07.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.690+0000 7fda157fa640 1 --2- 172.21.15.133:0/476561050 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fda0c0664a0 0x7fda0c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:07.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.690+0000 7fda157fa640 1 -- 172.21.15.133:0/476561050 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6213+0+0 (secure 0 0 0) 0x7fda180848b0 con 0x7fda201471c0 2023-12-19T19:00:07.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.690+0000 7fda248c6640 1 --2- 172.21.15.133:0/476561050 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fda0c0664a0 0x7fda0c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:07.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.690+0000 7fda248c6640 1 --2- 172.21.15.133:0/476561050 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fda0c0664a0 0x7fda0c068960 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fda1c0ab000 tx=0x7fda1c0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:07.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.694+0000 7fda157fa640 1 -- 172.21.15.133:0/476561050 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fda18051bd0 con 0x7fda201471c0 2023-12-19T19:00:07.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:07.846+0000 7fda26b2a640 1 -- 172.21.15.133:0/476561050 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fda20068400 con 0x7fda201471c0 2023-12-19T19:00:08.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.630+0000 7fda157fa640 1 -- 172.21.15.133:0/476561050 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) v1 ==== 169+0+0 (secure 0 0 0) 0x7fda180551f0 con 0x7fda201471c0 2023-12-19T19:00:08.632 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2023-12-19T19:00:08.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.634+0000 7fda26b2a640 1 -- 172.21.15.133:0/476561050 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fda0c0664a0 msgr2=0x7fda0c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:08.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.634+0000 7fda26b2a640 1 --2- 172.21.15.133:0/476561050 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fda0c0664a0 0x7fda0c068960 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fda1c0ab000 tx=0x7fda1c0a7070 comp rx=0 tx=0).stop 2023-12-19T19:00:08.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.634+0000 7fda26b2a640 1 -- 172.21.15.133:0/476561050 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda201471c0 msgr2=0x7fda20147640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:08.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.634+0000 7fda26b2a640 1 --2- 172.21.15.133:0/476561050 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda201471c0 0x7fda20147640 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fda200a9410 tx=0x7fda1800f580 comp rx=0 tx=0).stop 2023-12-19T19:00:08.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.634+0000 7fda26b2a640 1 -- 172.21.15.133:0/476561050 shutdown_connections 2023-12-19T19:00:08.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.634+0000 7fda26b2a640 1 --2- 172.21.15.133:0/476561050 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fda0c0664a0 0x7fda0c068960 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:08.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.634+0000 7fda26b2a640 1 --2- 172.21.15.133:0/476561050 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda201471c0 0x7fda20147640 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:08.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.634+0000 7fda26b2a640 1 --2- 172.21.15.133:0/476561050 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fda200abcc0 0x7fda200ac140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:08.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.634+0000 7fda26b2a640 1 --2- 172.21.15.133:0/476561050 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fda080039b0 0x7fda201ed670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:08.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.634+0000 7fda26b2a640 1 -- 172.21.15.133:0/476561050 >> 172.21.15.133:0/476561050 conn(0x7fda200c31a0 msgr2=0x7fda20150fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:08.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.634+0000 7fda26b2a640 1 -- 172.21.15.133:0/476561050 shutdown_connections 2023-12-19T19:00:08.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.634+0000 7fda26b2a640 1 -- 172.21.15.133:0/476561050 wait complete. 2023-12-19T19:00:08.661 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:00:08.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.798+0000 7f654dbaa640 1 Processor -- start 2023-12-19T19:00:08.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.798+0000 7f654dbaa640 1 -- start start 2023-12-19T19:00:08.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.798+0000 7f654dbaa640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f65480bffc0 0x7f654815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:08.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.798+0000 7f654dbaa640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f654815c600 con 0x7f65481560e0 2023-12-19T19:00:08.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.798+0000 7f654dbaa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f654815a5c0 con 0x7f654806d520 2023-12-19T19:00:08.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.798+0000 7f654dbaa640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65481594e0 con 0x7f65480bffc0 2023-12-19T19:00:08.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.798+0000 7f65477fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f65481560e0 0x7f6548159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:45778/0 (socket says 172.21.15.133:45778) 2023-12-19T19:00:08.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.798+0000 7f65477fe640 1 -- 172.21.15.133:0/897063967 learned_addr learned my addr 172.21.15.133:0/897063967 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:08.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.798+0000 7f6547fff640 1 --2- 172.21.15.133:0/897063967 >> v2:172.21.15.133:3300/0 conn(0x7f65480bffc0 0x7f654815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:08.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.798+0000 7f6547fff640 1 -- 172.21.15.133:0/897063967 >> v1:172.21.15.138:6789/0 conn(0x7f654806d520 legacy=0x7f65480c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:08.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.798+0000 7f6547fff640 1 -- 172.21.15.133:0/897063967 >> v1:172.21.15.133:6789/0 conn(0x7f65481560e0 legacy=0x7f6548159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:08.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.798+0000 7f6546ffd640 1 -- 172.21.15.133:0/897063967 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4182984725 0 0) 0x7f654815c600 con 0x7f65481560e0 2023-12-19T19:00:08.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.798+0000 7f6547fff640 1 -- 172.21.15.133:0/897063967 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65481597c0 con 0x7f65480bffc0 2023-12-19T19:00:08.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.802+0000 7f6547fff640 1 --2- 172.21.15.133:0/897063967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65480bffc0 0x7f654815ca90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6540009d90 tx=0x7f654001c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1cf7b8892335289 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:08.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.802+0000 7f6546ffd640 1 -- 172.21.15.133:0/897063967 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65400a59e0 con 0x7f65480bffc0 2023-12-19T19:00:08.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.802+0000 7f6546ffd640 1 -- 172.21.15.133:0/897063967 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65400a5b40 con 0x7f65480bffc0 2023-12-19T19:00:08.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.802+0000 7f6546ffd640 1 -- 172.21.15.133:0/897063967 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65400ad440 con 0x7f65480bffc0 2023-12-19T19:00:08.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.802+0000 7f654dbaa640 1 -- 172.21.15.133:0/897063967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65480bffc0 msgr2=0x7f654815ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:08.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.802+0000 7f654dbaa640 1 --2- 172.21.15.133:0/897063967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65480bffc0 0x7f654815ca90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f6540009d90 tx=0x7f654001c920 comp rx=0 tx=0).stop 2023-12-19T19:00:08.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.802+0000 7f654dbaa640 1 -- 172.21.15.133:0/897063967 shutdown_connections 2023-12-19T19:00:08.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.802+0000 7f654dbaa640 1 --2- 172.21.15.133:0/897063967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f65480bffc0 0x7f654815ca90 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:08.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.802+0000 7f654dbaa640 1 -- 172.21.15.133:0/897063967 >> 172.21.15.133:0/897063967 conn(0x7f654806a5b0 msgr2=0x7f654806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:08.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.802+0000 7f654dbaa640 1 -- 172.21.15.133:0/897063967 shutdown_connections 2023-12-19T19:00:08.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.802+0000 7f654dbaa640 1 -- 172.21.15.133:0/897063967 wait complete. 2023-12-19T19:00:08.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f654dbaa640 1 Processor -- start 2023-12-19T19:00:08.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f654dbaa640 1 -- start start 2023-12-19T19:00:08.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f654dbaa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f654806d520 0x7f65481f47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:08.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f654dbaa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65480bffc0 0x7f65481f2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:08.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f654dbaa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65481560e0 0x7f65481f2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:08.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f654dbaa640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65480ab1a0 con 0x7f654806d520 2023-12-19T19:00:08.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f654dbaa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65480a54d0 con 0x7f65481560e0 2023-12-19T19:00:08.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f654dbaa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65481f5250 con 0x7f65480bffc0 2023-12-19T19:00:08.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f65477fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f654806d520 0x7f65481f47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:08.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f65477fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f654806d520 0x7f65481f47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54772/0 (socket says 172.21.15.133:54772) 2023-12-19T19:00:08.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f65477fe640 1 -- 172.21.15.133:0/3227519989 learned_addr learned my addr 172.21.15.133:0/3227519989 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:08.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f6547fff640 1 --2- 172.21.15.133:0/3227519989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65481560e0 0x7f65481f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:08.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f653ffff640 1 --2- 172.21.15.133:0/3227519989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65480bffc0 0x7f65481f2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:08.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f65477fe640 1 -- 172.21.15.133:0/3227519989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65480bffc0 msgr2=0x7f65481f2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:08.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f65477fe640 1 --2- 172.21.15.133:0/3227519989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65480bffc0 0x7f65481f2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:08.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f65477fe640 1 -- 172.21.15.133:0/3227519989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65481560e0 msgr2=0x7f65481f2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:08.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f65477fe640 1 --2- 172.21.15.133:0/3227519989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65481560e0 0x7f65481f2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:08.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f65477fe640 1 -- 172.21.15.133:0/3227519989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6540009a70 con 0x7f654806d520 2023-12-19T19:00:08.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f65477fe640 1 --2- 172.21.15.133:0/3227519989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f654806d520 0x7f65481f47c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f653800c4a0 tx=0x7f653800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:08.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f6544ff9640 1 -- 172.21.15.133:0/3227519989 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65380074e0 con 0x7f654806d520 2023-12-19T19:00:08.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f6544ff9640 1 -- 172.21.15.133:0/3227519989 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6538007640 con 0x7f654806d520 2023-12-19T19:00:08.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f6544ff9640 1 -- 172.21.15.133:0/3227519989 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6538004a30 con 0x7f654806d520 2023-12-19T19:00:08.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f654dbaa640 1 -- 172.21.15.133:0/3227519989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65480aae30 con 0x7f654806d520 2023-12-19T19:00:08.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.806+0000 7f654dbaa640 1 -- 172.21.15.133:0/3227519989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65481f3180 con 0x7f654806d520 2023-12-19T19:00:08.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.810+0000 7f654dbaa640 1 -- 172.21.15.133:0/3227519989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65480ab310 con 0x7f654806d520 2023-12-19T19:00:08.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.810+0000 7f6544ff9640 1 -- 172.21.15.133:0/3227519989 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6538004b90 con 0x7f654806d520 2023-12-19T19:00:08.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.810+0000 7f6544ff9640 1 --2- 172.21.15.133:0/3227519989 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6528066470 0x7f6528068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:08.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.810+0000 7f6544ff9640 1 -- 172.21.15.133:0/3227519989 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f65380830d0 con 0x7f654806d520 2023-12-19T19:00:08.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.810+0000 7f653ffff640 1 --2- 172.21.15.133:0/3227519989 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6528066470 0x7f6528068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:08.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.810+0000 7f653ffff640 1 --2- 172.21.15.133:0/3227519989 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6528066470 0x7f6528068930 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f654815a460 tx=0x7f6530009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:08.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.814+0000 7f6544ff9640 1 -- 172.21.15.133:0/3227519989 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6538050590 con 0x7f654806d520 2023-12-19T19:00:08.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.966+0000 7f654dbaa640 1 -- 172.21.15.133:0/3227519989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6548068400 con 0x7f654806d520 2023-12-19T19:00:08.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.966+0000 7f6544ff9640 1 -- 172.21.15.133:0/3227519989 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16682 (secure 0 0 0) 0x7f6538018020 con 0x7f654806d520 2023-12-19T19:00:08.971 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:08.971 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":38,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:00:08.629610+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T18:59:42.757628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-19T18:59:44.017454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6835/862459875":"2023-12-20T19:00:05.490309+0000","172.21.15.133:6832/862459875":"2023-12-20T19:00:05.490309+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:00:08.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.970+0000 7f654dbaa640 1 -- 172.21.15.133:0/3227519989 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6528066470 msgr2=0x7f6528068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:08.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.970+0000 7f654dbaa640 1 --2- 172.21.15.133:0/3227519989 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6528066470 0x7f6528068930 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f654815a460 tx=0x7f6530009040 comp rx=0 tx=0).stop 2023-12-19T19:00:08.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.970+0000 7f654dbaa640 1 -- 172.21.15.133:0/3227519989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f654806d520 msgr2=0x7f65481f47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:08.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.970+0000 7f654dbaa640 1 --2- 172.21.15.133:0/3227519989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f654806d520 0x7f65481f47c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f653800c4a0 tx=0x7f653800c960 comp rx=0 tx=0).stop 2023-12-19T19:00:08.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.970+0000 7f654dbaa640 1 -- 172.21.15.133:0/3227519989 shutdown_connections 2023-12-19T19:00:08.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.970+0000 7f654dbaa640 1 --2- 172.21.15.133:0/3227519989 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6528066470 0x7f6528068930 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:08.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.970+0000 7f654dbaa640 1 --2- 172.21.15.133:0/3227519989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f65481560e0 0x7f65481f2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:08.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.970+0000 7f654dbaa640 1 --2- 172.21.15.133:0/3227519989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f65480bffc0 0x7f65481f2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:08.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.970+0000 7f654dbaa640 1 --2- 172.21.15.133:0/3227519989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f654806d520 0x7f65481f47c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:08.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.970+0000 7f654dbaa640 1 -- 172.21.15.133:0/3227519989 >> 172.21.15.133:0/3227519989 conn(0x7f654806a5b0 msgr2=0x7f654806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:08.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.970+0000 7f654dbaa640 1 -- 172.21.15.133:0/3227519989 shutdown_connections 2023-12-19T19:00:08.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:08.970+0000 7f654dbaa640 1 -- 172.21.15.133:0/3227519989 wait complete. 2023-12-19T19:00:08.993 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-19T18:59:42.757628+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-19T18:59:44.017454+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T19:00:08.994 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T19:00:09.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.138+0000 7fec5e51d640 1 Processor -- start 2023-12-19T19:00:09.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.138+0000 7fec5e51d640 1 -- start start 2023-12-19T19:00:09.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.138+0000 7fec5e51d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fec580c63c0 0x7fec580c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:09.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.138+0000 7fec5e51d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec580c2bb0 0x7fec580a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:09.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.138+0000 7fec5e51d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec580c31c0 con 0x7fec580c4100 2023-12-19T19:00:09.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.138+0000 7fec5e51d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec580c34a0 con 0x7fec580c63c0 2023-12-19T19:00:09.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.138+0000 7fec5e51d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec580c1030 con 0x7fec580c2bb0 2023-12-19T19:00:09.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.142+0000 7fec57fff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fec580c63c0 0x7fec580c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:09.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.142+0000 7fec5caba640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec580c2bb0 0x7fec580a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:09.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.142+0000 7fec577fe640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fec580c4100 0x7fec580c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:46216/0 (socket says 172.21.15.133:46216) 2023-12-19T19:00:09.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.142+0000 7fec577fe640 1 -- 172.21.15.133:0/2719560739 learned_addr learned my addr 172.21.15.133:0/2719560739 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:09.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.142+0000 7fec56ffd640 1 -- 172.21.15.133:0/2719560739 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1645705572 0 0) 0x7fec580c31c0 con 0x7fec580c4100 2023-12-19T19:00:09.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.142+0000 7fec5caba640 1 -- 172.21.15.133:0/2719560739 >> v2:172.21.15.138:3300/0 conn(0x7fec580c63c0 msgr2=0x7fec580c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:09.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.142+0000 7fec5caba640 1 --2- 172.21.15.133:0/2719560739 >> v2:172.21.15.138:3300/0 conn(0x7fec580c63c0 0x7fec580c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.142+0000 7fec5caba640 1 -- 172.21.15.133:0/2719560739 >> v1:172.21.15.138:6789/0 conn(0x7fec580c4100 legacy=0x7fec580c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:09.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.142+0000 7fec5caba640 1 -- 172.21.15.133:0/2719560739 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec580c1310 con 0x7fec580c2bb0 2023-12-19T19:00:09.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.142+0000 7fec5caba640 1 --2- 172.21.15.133:0/2719560739 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec580c2bb0 0x7fec580a9680 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fec50009d90 tx=0x7fec5001c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=751271394746e774 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:09.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.142+0000 7fec56ffd640 1 -- 172.21.15.133:0/2719560739 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec580aa3d0 con 0x7fec580c2bb0 2023-12-19T19:00:09.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.142+0000 7fec56ffd640 1 -- 172.21.15.133:0/2719560739 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec500a58e0 con 0x7fec580c2bb0 2023-12-19T19:00:09.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.142+0000 7fec56ffd640 1 -- 172.21.15.133:0/2719560739 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec500a5c70 con 0x7fec580c2bb0 2023-12-19T19:00:09.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec5e51d640 1 -- 172.21.15.133:0/2719560739 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec580c2bb0 msgr2=0x7fec580a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:09.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec5e51d640 1 --2- 172.21.15.133:0/2719560739 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec580c2bb0 0x7fec580a9680 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fec50009d90 tx=0x7fec5001c800 comp rx=0 tx=0).stop 2023-12-19T19:00:09.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec5e51d640 1 -- 172.21.15.133:0/2719560739 shutdown_connections 2023-12-19T19:00:09.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec5e51d640 1 --2- 172.21.15.133:0/2719560739 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec580c2bb0 0x7fec580a9680 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec5e51d640 1 --2- 172.21.15.133:0/2719560739 >> v2:172.21.15.138:3300/0 conn(0x7fec580c63c0 0x7fec580c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec5e51d640 1 -- 172.21.15.133:0/2719560739 >> 172.21.15.133:0/2719560739 conn(0x7fec5806a5b0 msgr2=0x7fec5806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:09.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec5e51d640 1 -- 172.21.15.133:0/2719560739 shutdown_connections 2023-12-19T19:00:09.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec5e51d640 1 -- 172.21.15.133:0/2719560739 wait complete. 2023-12-19T19:00:09.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec5e51d640 1 Processor -- start 2023-12-19T19:00:09.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec5e51d640 1 -- start start 2023-12-19T19:00:09.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec5e51d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec580c2bb0 0x7fec580a6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:09.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec5e51d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec580c4100 0x7fec58156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:09.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec5e51d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec580c63c0 0x7fec581572a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:09.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec5e51d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec580bef10 con 0x7fec580c2bb0 2023-12-19T19:00:09.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec5e51d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec580bf7b0 con 0x7fec580c63c0 2023-12-19T19:00:09.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec5e51d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec581eebd0 con 0x7fec580c4100 2023-12-19T19:00:09.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec57fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec580c2bb0 0x7fec580a6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:09.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec57fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec580c2bb0 0x7fec580a6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54778/0 (socket says 172.21.15.133:54778) 2023-12-19T19:00:09.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec57fff640 1 -- 172.21.15.133:0/1072353062 learned_addr learned my addr 172.21.15.133:0/1072353062 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:09.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec5caba640 1 --2- 172.21.15.133:0/1072353062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec580c63c0 0x7fec581572a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:09.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec577fe640 1 --2- 172.21.15.133:0/1072353062 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec580c4100 0x7fec58156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:09.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec57fff640 1 -- 172.21.15.133:0/1072353062 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec580c4100 msgr2=0x7fec58156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:09.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec57fff640 1 --2- 172.21.15.133:0/1072353062 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec580c4100 0x7fec58156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec57fff640 1 -- 172.21.15.133:0/1072353062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec580c63c0 msgr2=0x7fec581572a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:09.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec57fff640 1 --2- 172.21.15.133:0/1072353062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec580c63c0 0x7fec581572a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.146+0000 7fec57fff640 1 -- 172.21.15.133:0/1072353062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec50009a70 con 0x7fec580c2bb0 2023-12-19T19:00:09.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.150+0000 7fec57fff640 1 --2- 172.21.15.133:0/1072353062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec580c2bb0 0x7fec580a6090 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fec4800e870 tx=0x7fec4800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:09.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.150+0000 7fec54ff9640 1 -- 172.21.15.133:0/1072353062 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec48009510 con 0x7fec580c2bb0 2023-12-19T19:00:09.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.150+0000 7fec54ff9640 1 -- 172.21.15.133:0/1072353062 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4800eec0 con 0x7fec580c2bb0 2023-12-19T19:00:09.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.150+0000 7fec54ff9640 1 -- 172.21.15.133:0/1072353062 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4800cb40 con 0x7fec580c2bb0 2023-12-19T19:00:09.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.150+0000 7fec5e51d640 1 -- 172.21.15.133:0/1072353062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec580bf160 con 0x7fec580c2bb0 2023-12-19T19:00:09.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.150+0000 7fec5e51d640 1 -- 172.21.15.133:0/1072353062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec580a65d0 con 0x7fec580c2bb0 2023-12-19T19:00:09.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.150+0000 7fec5e51d640 1 -- 172.21.15.133:0/1072353062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec58068400 con 0x7fec580c2bb0 2023-12-19T19:00:09.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.150+0000 7fec54ff9640 1 -- 172.21.15.133:0/1072353062 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fec4800cca0 con 0x7fec580c2bb0 2023-12-19T19:00:09.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.150+0000 7fec54ff9640 1 --2- 172.21.15.133:0/1072353062 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fec44066470 0x7fec44068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:09.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.150+0000 7fec54ff9640 1 -- 172.21.15.133:0/1072353062 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fec48083fc0 con 0x7fec580c2bb0 2023-12-19T19:00:09.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.154+0000 7fec577fe640 1 --2- 172.21.15.133:0/1072353062 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fec44066470 0x7fec44068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:09.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.154+0000 7fec577fe640 1 --2- 172.21.15.133:0/1072353062 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fec44066470 0x7fec44068930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fec58156390 tx=0x7fec4c007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:09.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.154+0000 7fec54ff9640 1 -- 172.21.15.133:0/1072353062 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fec48051480 con 0x7fec580c2bb0 2023-12-19T19:00:09.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.310+0000 7fec5e51d640 1 -- 172.21.15.133:0/1072353062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec580674e0 con 0x7fec580c2bb0 2023-12-19T19:00:09.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.314+0000 7fec54ff9640 1 -- 172.21.15.133:0/1072353062 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec48054aa0 con 0x7fec580c2bb0 2023-12-19T19:00:09.315 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T19:00:09.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.314+0000 7fec5e51d640 1 -- 172.21.15.133:0/1072353062 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fec44066470 msgr2=0x7fec44068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:09.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.314+0000 7fec5e51d640 1 --2- 172.21.15.133:0/1072353062 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fec44066470 0x7fec44068930 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fec58156390 tx=0x7fec4c007d60 comp rx=0 tx=0).stop 2023-12-19T19:00:09.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.314+0000 7fec5e51d640 1 -- 172.21.15.133:0/1072353062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec580c2bb0 msgr2=0x7fec580a6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:09.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.314+0000 7fec5e51d640 1 --2- 172.21.15.133:0/1072353062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec580c2bb0 0x7fec580a6090 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fec4800e870 tx=0x7fec4800ec70 comp rx=0 tx=0).stop 2023-12-19T19:00:09.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.314+0000 7fec5e51d640 1 -- 172.21.15.133:0/1072353062 shutdown_connections 2023-12-19T19:00:09.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.314+0000 7fec5e51d640 1 --2- 172.21.15.133:0/1072353062 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fec44066470 0x7fec44068930 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.314+0000 7fec5e51d640 1 --2- 172.21.15.133:0/1072353062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fec580c63c0 0x7fec581572a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.314+0000 7fec5e51d640 1 --2- 172.21.15.133:0/1072353062 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fec580c4100 0x7fec58156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.314+0000 7fec5e51d640 1 --2- 172.21.15.133:0/1072353062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fec580c2bb0 0x7fec580a6090 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.314+0000 7fec5e51d640 1 -- 172.21.15.133:0/1072353062 >> 172.21.15.133:0/1072353062 conn(0x7fec5806a5b0 msgr2=0x7fec5806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:09.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.314+0000 7fec5e51d640 1 -- 172.21.15.133:0/1072353062 shutdown_connections 2023-12-19T19:00:09.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.314+0000 7fec5e51d640 1 -- 172.21.15.133:0/1072353062 wait complete. 2023-12-19T19:00:09.337 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-19T19:00:09.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.474+0000 7f17a77b8640 1 Processor -- start 2023-12-19T19:00:09.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.474+0000 7f17a77b8640 1 -- start start 2023-12-19T19:00:09.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.474+0000 7f17a77b8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f17a00a5240 0x7f17a00bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:09.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.474+0000 7f17a77b8640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f17a01561f0 0x7f17a0156640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:09.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.474+0000 7f17a77b8640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a00c3bd0 con 0x7f17a00c01c0 2023-12-19T19:00:09.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.474+0000 7f17a77b8640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a00bf1e0 con 0x7f17a01561f0 2023-12-19T19:00:09.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.474+0000 7f17a77b8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a00c3e20 con 0x7f17a00a5240 2023-12-19T19:00:09.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.474+0000 7f17a4d53640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f17a00c01c0 0x7f17a00c5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:45786/0 (socket says 172.21.15.133:45786) 2023-12-19T19:00:09.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.474+0000 7f17a4d53640 1 -- 172.21.15.133:0/1152495496 learned_addr learned my addr 172.21.15.133:0/1152495496 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:09.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.474+0000 7f17a5d55640 1 --2- 172.21.15.133:0/1152495496 >> v2:172.21.15.133:3300/0 conn(0x7f17a01561f0 0x7f17a0156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:09.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.478+0000 7f17a5554640 1 --2- 172.21.15.133:0/1152495496 >> v2:172.21.15.138:3300/0 conn(0x7f17a00a5240 0x7f17a00bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:09.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.478+0000 7f17a5d55640 1 -- 172.21.15.133:0/1152495496 >> v2:172.21.15.138:3300/0 conn(0x7f17a00a5240 msgr2=0x7f17a00bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:09.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.478+0000 7f17a5d55640 1 --2- 172.21.15.133:0/1152495496 >> v2:172.21.15.138:3300/0 conn(0x7f17a00a5240 0x7f17a00bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.478+0000 7f17a5d55640 1 -- 172.21.15.133:0/1152495496 >> v1:172.21.15.133:6789/0 conn(0x7f17a00c01c0 legacy=0x7f17a00c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:09.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.478+0000 7f17a5d55640 1 -- 172.21.15.133:0/1152495496 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a00c4100 con 0x7f17a01561f0 2023-12-19T19:00:09.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.478+0000 7f1797fff640 1 -- 172.21.15.133:0/1152495496 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358911271 0 0) 0x7f17a00c3bd0 con 0x7f17a00c01c0 2023-12-19T19:00:09.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.478+0000 7f17a5d55640 1 --2- 172.21.15.133:0/1152495496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a01561f0 0x7f17a0156640 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f17a00bf530 tx=0x7f179801c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5dc345fa079085 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:09.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.478+0000 7f1797fff640 1 -- 172.21.15.133:0/1152495496 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17980a5820 con 0x7f17a01561f0 2023-12-19T19:00:09.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.478+0000 7f1797fff640 1 -- 172.21.15.133:0/1152495496 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17980a5980 con 0x7f17a01561f0 2023-12-19T19:00:09.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.478+0000 7f1797fff640 1 -- 172.21.15.133:0/1152495496 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17980a5d10 con 0x7f17a01561f0 2023-12-19T19:00:09.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.478+0000 7f17a77b8640 1 -- 172.21.15.133:0/1152495496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a01561f0 msgr2=0x7f17a0156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:09.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.478+0000 7f17a77b8640 1 --2- 172.21.15.133:0/1152495496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a01561f0 0x7f17a0156640 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f17a00bf530 tx=0x7f179801c850 comp rx=0 tx=0).stop 2023-12-19T19:00:09.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a77b8640 1 -- 172.21.15.133:0/1152495496 shutdown_connections 2023-12-19T19:00:09.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a77b8640 1 --2- 172.21.15.133:0/1152495496 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a01561f0 0x7f17a0156640 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a77b8640 1 --2- 172.21.15.133:0/1152495496 >> v2:172.21.15.138:3300/0 conn(0x7f17a00a5240 0x7f17a00bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a77b8640 1 -- 172.21.15.133:0/1152495496 >> 172.21.15.133:0/1152495496 conn(0x7f17a006a5b0 msgr2=0x7f17a006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:09.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a77b8640 1 -- 172.21.15.133:0/1152495496 shutdown_connections 2023-12-19T19:00:09.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a77b8640 1 -- 172.21.15.133:0/1152495496 wait complete. 2023-12-19T19:00:09.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a77b8640 1 Processor -- start 2023-12-19T19:00:09.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a77b8640 1 -- start start 2023-12-19T19:00:09.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a77b8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17a00a5240 0x7f17a00a8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:09.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a77b8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17a00c01c0 0x7f17a00a3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:09.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a77b8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a01561f0 0x7f17a00a92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:09.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a77b8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a00a89b0 con 0x7f17a01561f0 2023-12-19T19:00:09.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a77b8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a00aac10 con 0x7f17a00a5240 2023-12-19T19:00:09.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a77b8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a00a3de0 con 0x7f17a00c01c0 2023-12-19T19:00:09.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a5d55640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a01561f0 0x7f17a00a92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:09.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a5d55640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a01561f0 0x7f17a00a92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54806/0 (socket says 172.21.15.133:54806) 2023-12-19T19:00:09.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a5d55640 1 -- 172.21.15.133:0/106886062 learned_addr learned my addr 172.21.15.133:0/106886062 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:09.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a5554640 1 --2- 172.21.15.133:0/106886062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17a00a5240 0x7f17a00a8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:09.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a4d53640 1 --2- 172.21.15.133:0/106886062 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17a00c01c0 0x7f17a00a3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:09.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a5d55640 1 -- 172.21.15.133:0/106886062 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17a00c01c0 msgr2=0x7f17a00a3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:09.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a5d55640 1 --2- 172.21.15.133:0/106886062 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17a00c01c0 0x7f17a00a3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a5d55640 1 -- 172.21.15.133:0/106886062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17a00a5240 msgr2=0x7f17a00a8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:09.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a5d55640 1 --2- 172.21.15.133:0/106886062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17a00a5240 0x7f17a00a8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a5d55640 1 -- 172.21.15.133:0/106886062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1798009a70 con 0x7f17a01561f0 2023-12-19T19:00:09.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.482+0000 7f17a5d55640 1 --2- 172.21.15.133:0/106886062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a01561f0 0x7f17a00a92f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f17980b0040 tx=0x7f17980195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:09.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.486+0000 7f1795ffb640 1 -- 172.21.15.133:0/106886062 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17980b9860 con 0x7f17a01561f0 2023-12-19T19:00:09.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.486+0000 7f1795ffb640 1 -- 172.21.15.133:0/106886062 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17980b99c0 con 0x7f17a01561f0 2023-12-19T19:00:09.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.486+0000 7f1795ffb640 1 -- 172.21.15.133:0/106886062 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17980b9d70 con 0x7f17a01561f0 2023-12-19T19:00:09.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.486+0000 7f17a77b8640 1 -- 172.21.15.133:0/106886062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a00be540 con 0x7f17a01561f0 2023-12-19T19:00:09.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.486+0000 7f17a77b8640 1 -- 172.21.15.133:0/106886062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a0156890 con 0x7f17a01561f0 2023-12-19T19:00:09.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.486+0000 7f17a77b8640 1 -- 172.21.15.133:0/106886062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a00c52e0 con 0x7f17a01561f0 2023-12-19T19:00:09.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.486+0000 7f1795ffb640 1 -- 172.21.15.133:0/106886062 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f17980ad440 con 0x7f17a01561f0 2023-12-19T19:00:09.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.486+0000 7f1795ffb640 1 --2- 172.21.15.133:0/106886062 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f17840664a0 0x7f1784068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:09.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.486+0000 7f1795ffb640 1 -- 172.21.15.133:0/106886062 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f179811eff0 con 0x7f17a01561f0 2023-12-19T19:00:09.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.486+0000 7f17a5554640 1 --2- 172.21.15.133:0/106886062 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f17840664a0 0x7f1784068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:09.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.490+0000 7f17a5554640 1 --2- 172.21.15.133:0/106886062 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f17840664a0 0x7f1784068960 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f179c00b930 tx=0x7f179c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:09.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.490+0000 7f1795ffb640 1 -- 172.21.15.133:0/106886062 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f17980ec5a0 con 0x7f17a01561f0 2023-12-19T19:00:09.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.642+0000 7f17a77b8640 1 -- 172.21.15.133:0/106886062 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f17a0068400 con 0x7f17a01561f0 2023-12-19T19:00:09.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.642+0000 7f1795ffb640 1 -- 172.21.15.133:0/106886062 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v38) v1 ==== 105+0+11 (secure 0 0 0) 0x7f17980efbc0 con 0x7f17a01561f0 2023-12-19T19:00:09.644 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:00:09.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.642+0000 7f17a77b8640 1 -- 172.21.15.133:0/106886062 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f17840664a0 msgr2=0x7f1784068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:09.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.642+0000 7f17a77b8640 1 --2- 172.21.15.133:0/106886062 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f17840664a0 0x7f1784068960 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f179c00b930 tx=0x7f179c008040 comp rx=0 tx=0).stop 2023-12-19T19:00:09.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.642+0000 7f17a77b8640 1 -- 172.21.15.133:0/106886062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a01561f0 msgr2=0x7f17a00a92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:09.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.642+0000 7f17a77b8640 1 --2- 172.21.15.133:0/106886062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a01561f0 0x7f17a00a92f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f17980b0040 tx=0x7f17980195f0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.642+0000 7f17a77b8640 1 -- 172.21.15.133:0/106886062 shutdown_connections 2023-12-19T19:00:09.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.642+0000 7f17a77b8640 1 --2- 172.21.15.133:0/106886062 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f17840664a0 0x7f1784068960 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.642+0000 7f17a77b8640 1 --2- 172.21.15.133:0/106886062 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a01561f0 0x7f17a00a92f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.642+0000 7f17a77b8640 1 --2- 172.21.15.133:0/106886062 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17a00c01c0 0x7f17a00a3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.642+0000 7f17a77b8640 1 --2- 172.21.15.133:0/106886062 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17a00a5240 0x7f17a00a8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.642+0000 7f17a77b8640 1 -- 172.21.15.133:0/106886062 >> 172.21.15.133:0/106886062 conn(0x7f17a006a5b0 msgr2=0x7f17a00c07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:09.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.642+0000 7f17a77b8640 1 -- 172.21.15.133:0/106886062 shutdown_connections 2023-12-19T19:00:09.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.642+0000 7f17a77b8640 1 -- 172.21.15.133:0/106886062 wait complete. 2023-12-19T19:00:09.665 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-19T19:00:09.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.806+0000 7efede8fe640 1 Processor -- start 2023-12-19T19:00:09.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.806+0000 7efede8fe640 1 -- start start 2023-12-19T19:00:09.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.810+0000 7efede8fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efed80a5370 0x7efed80c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:09.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.810+0000 7efede8fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efed80c4110 0x7efed8150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:09.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.810+0000 7efede8fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efed8072090 0x7efed81514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:09.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.810+0000 7efede8fe640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed80c3070 con 0x7efed80c4110 2023-12-19T19:00:09.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.810+0000 7efede8fe640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed80c2760 con 0x7efed8072090 2023-12-19T19:00:09.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.810+0000 7efede8fe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed80a5750 con 0x7efed80a5370 2023-12-19T19:00:09.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.810+0000 7efed77fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efed80c4110 0x7efed8150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:09.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.810+0000 7efed77fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efed80c4110 0x7efed8150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54818/0 (socket says 172.21.15.133:54818) 2023-12-19T19:00:09.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.810+0000 7efed77fe640 1 -- 172.21.15.133:0/4095231224 learned_addr learned my addr 172.21.15.133:0/4095231224 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:09.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.810+0000 7efed7fff640 1 --2- 172.21.15.133:0/4095231224 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efed80a5370 0x7efed80c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:09.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.810+0000 7efedce9b640 1 --2- 172.21.15.133:0/4095231224 >> v2:172.21.15.138:3300/0 conn(0x7efed8072090 0x7efed81514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:09.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.810+0000 7efed77fe640 1 -- 172.21.15.133:0/4095231224 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efed80a5370 msgr2=0x7efed80c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:09.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.810+0000 7efed77fe640 1 --2- 172.21.15.133:0/4095231224 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efed80a5370 0x7efed80c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.810+0000 7efed77fe640 1 -- 172.21.15.133:0/4095231224 >> v2:172.21.15.138:3300/0 conn(0x7efed8072090 msgr2=0x7efed81514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:09.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.810+0000 7efed77fe640 1 --2- 172.21.15.133:0/4095231224 >> v2:172.21.15.138:3300/0 conn(0x7efed8072090 0x7efed81514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.810+0000 7efed77fe640 1 -- 172.21.15.133:0/4095231224 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed80aad20 con 0x7efed80c4110 2023-12-19T19:00:09.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.814+0000 7efed77fe640 1 --2- 172.21.15.133:0/4095231224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed80c4110 0x7efed8150fa0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7efed80c4590 tx=0x7efecc01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47a02b7a2a8d4f55 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:09.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.814+0000 7efed6ffd640 1 -- 172.21.15.133:0/4095231224 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc0ab600 con 0x7efed80c4110 2023-12-19T19:00:09.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.814+0000 7efed6ffd640 1 -- 172.21.15.133:0/4095231224 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efecc0a7050 con 0x7efed80c4110 2023-12-19T19:00:09.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.814+0000 7efed6ffd640 1 -- 172.21.15.133:0/4095231224 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc0ab980 con 0x7efed80c4110 2023-12-19T19:00:09.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.814+0000 7efede8fe640 1 -- 172.21.15.133:0/4095231224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed80c4110 msgr2=0x7efed8150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:09.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.814+0000 7efede8fe640 1 --2- 172.21.15.133:0/4095231224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed80c4110 0x7efed8150fa0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7efed80c4590 tx=0x7efecc01c3b0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.814+0000 7efede8fe640 1 -- 172.21.15.133:0/4095231224 shutdown_connections 2023-12-19T19:00:09.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.814+0000 7efede8fe640 1 --2- 172.21.15.133:0/4095231224 >> v2:172.21.15.138:3300/0 conn(0x7efed8072090 0x7efed81514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.814+0000 7efede8fe640 1 --2- 172.21.15.133:0/4095231224 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed80c4110 0x7efed8150fa0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.814+0000 7efede8fe640 1 --2- 172.21.15.133:0/4095231224 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efed80a5370 0x7efed80c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.814+0000 7efede8fe640 1 -- 172.21.15.133:0/4095231224 >> 172.21.15.133:0/4095231224 conn(0x7efed806a5b0 msgr2=0x7efed806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:09.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.814+0000 7efede8fe640 1 -- 172.21.15.133:0/4095231224 shutdown_connections 2023-12-19T19:00:09.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.814+0000 7efede8fe640 1 -- 172.21.15.133:0/4095231224 wait complete. 2023-12-19T19:00:09.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.814+0000 7efede8fe640 1 Processor -- start 2023-12-19T19:00:09.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.814+0000 7efede8fe640 1 -- start start 2023-12-19T19:00:09.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.814+0000 7efede8fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed8072090 0x7efed81f1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:09.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.814+0000 7efede8fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efed80a5370 0x7efed8151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:09.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.818+0000 7efede8fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efed80c4110 0x7efed8071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:09.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.818+0000 7efede8fe640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed81ed940 con 0x7efed8072090 2023-12-19T19:00:09.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.818+0000 7efede8fe640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed81ede70 con 0x7efed80c4110 2023-12-19T19:00:09.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.818+0000 7efede8fe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed81edb90 con 0x7efed80a5370 2023-12-19T19:00:09.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.818+0000 7efed7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed8072090 0x7efed81f1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:09.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.818+0000 7efed7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed8072090 0x7efed81f1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54822/0 (socket says 172.21.15.133:54822) 2023-12-19T19:00:09.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.818+0000 7efed7fff640 1 -- 172.21.15.133:0/396088414 learned_addr learned my addr 172.21.15.133:0/396088414 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:09.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.818+0000 7efed77fe640 1 --2- 172.21.15.133:0/396088414 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efed80a5370 0x7efed8151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:09.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.818+0000 7efedce9b640 1 --2- 172.21.15.133:0/396088414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efed80c4110 0x7efed8071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:09.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.818+0000 7efed7fff640 1 -- 172.21.15.133:0/396088414 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efed80a5370 msgr2=0x7efed8151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:09.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.818+0000 7efed7fff640 1 --2- 172.21.15.133:0/396088414 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efed80a5370 0x7efed8151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.818+0000 7efed7fff640 1 -- 172.21.15.133:0/396088414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efed80c4110 msgr2=0x7efed8071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:09.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.818+0000 7efed7fff640 1 --2- 172.21.15.133:0/396088414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efed80c4110 0x7efed8071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.818+0000 7efed7fff640 1 -- 172.21.15.133:0/396088414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc0094d0 con 0x7efed8072090 2023-12-19T19:00:09.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.818+0000 7efed7fff640 1 --2- 172.21.15.133:0/396088414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed8072090 0x7efed81f1040 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7efec800d830 tx=0x7efec800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:09.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.818+0000 7efed4ff9640 1 -- 172.21.15.133:0/396088414 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec800b6c0 con 0x7efed8072090 2023-12-19T19:00:09.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.818+0000 7efed4ff9640 1 -- 172.21.15.133:0/396088414 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec800b820 con 0x7efed8072090 2023-12-19T19:00:09.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.818+0000 7efed4ff9640 1 -- 172.21.15.133:0/396088414 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec800bb90 con 0x7efed8072090 2023-12-19T19:00:09.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.818+0000 7efede8fe640 1 -- 172.21.15.133:0/396088414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed81f0560 con 0x7efed8072090 2023-12-19T19:00:09.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.818+0000 7efede8fe640 1 -- 172.21.15.133:0/396088414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed81f0b20 con 0x7efed8072090 2023-12-19T19:00:09.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.818+0000 7efede8fe640 1 -- 172.21.15.133:0/396088414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed8068400 con 0x7efed8072090 2023-12-19T19:00:09.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.818+0000 7efed4ff9640 1 -- 172.21.15.133:0/396088414 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7efec801e460 con 0x7efed8072090 2023-12-19T19:00:09.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.818+0000 7efed4ff9640 1 --2- 172.21.15.133:0/396088414 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7efec4066470 0x7efec4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:09.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.822+0000 7efed4ff9640 1 -- 172.21.15.133:0/396088414 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7efec8084580 con 0x7efed8072090 2023-12-19T19:00:09.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.822+0000 7efed77fe640 1 --2- 172.21.15.133:0/396088414 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7efec4066470 0x7efec4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:09.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.822+0000 7efed77fe640 1 --2- 172.21.15.133:0/396088414 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7efec4066470 0x7efec4068930 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efecc0ad000 tx=0x7efecc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:09.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.822+0000 7efed4ff9640 1 -- 172.21.15.133:0/396088414 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7efec8051a40 con 0x7efed8072090 2023-12-19T19:00:09.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.974+0000 7efede8fe640 1 -- 172.21.15.133:0/396088414 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7efed806abb0 con 0x7efed8072090 2023-12-19T19:00:09.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.974+0000 7efed4ff9640 1 -- 172.21.15.133:0/396088414 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v38) v1 ==== 101+0+11 (secure 0 0 0) 0x7efec8055060 con 0x7efed8072090 2023-12-19T19:00:09.977 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:00:09.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.974+0000 7efede8fe640 1 -- 172.21.15.133:0/396088414 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7efec4066470 msgr2=0x7efec4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:09.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.974+0000 7efede8fe640 1 --2- 172.21.15.133:0/396088414 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7efec4066470 0x7efec4068930 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7efecc0ad000 tx=0x7efecc0a6000 comp rx=0 tx=0).stop 2023-12-19T19:00:09.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.978+0000 7efede8fe640 1 -- 172.21.15.133:0/396088414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed8072090 msgr2=0x7efed81f1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:09.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.978+0000 7efede8fe640 1 --2- 172.21.15.133:0/396088414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed8072090 0x7efed81f1040 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7efec800d830 tx=0x7efec800dcf0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.978+0000 7efede8fe640 1 -- 172.21.15.133:0/396088414 shutdown_connections 2023-12-19T19:00:09.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.978+0000 7efede8fe640 1 --2- 172.21.15.133:0/396088414 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7efec4066470 0x7efec4068930 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.978+0000 7efede8fe640 1 --2- 172.21.15.133:0/396088414 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efed80c4110 0x7efed8071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.978+0000 7efede8fe640 1 --2- 172.21.15.133:0/396088414 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efed80a5370 0x7efed8151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.978+0000 7efede8fe640 1 --2- 172.21.15.133:0/396088414 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efed8072090 0x7efed81f1040 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:09.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.978+0000 7efede8fe640 1 -- 172.21.15.133:0/396088414 >> 172.21.15.133:0/396088414 conn(0x7efed806a5b0 msgr2=0x7efed814c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:09.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.978+0000 7efede8fe640 1 -- 172.21.15.133:0/396088414 shutdown_connections 2023-12-19T19:00:09.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:09.978+0000 7efede8fe640 1 -- 172.21.15.133:0/396088414 wait complete. 2023-12-19T19:00:10.001 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:00:10.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.134+0000 7f88075c4640 1 Processor -- start 2023-12-19T19:00:10.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.134+0000 7f88075c4640 1 -- start start 2023-12-19T19:00:10.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.134+0000 7f88075c4640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f88000c63c0 0x7f88000c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:10.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.134+0000 7f88075c4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88000c4100 0x7f88000c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:10.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.134+0000 7f88075c4640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88000c31c0 con 0x7f88000c29e0 2023-12-19T19:00:10.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.134+0000 7f88075c4640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88000c34a0 con 0x7f88000c4100 2023-12-19T19:00:10.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.134+0000 7f88075c4640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88000c1030 con 0x7f88000c63c0 2023-12-19T19:00:10.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.134+0000 7f8804b5f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88000c4100 0x7f88000c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:10.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.134+0000 7f8804b5f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88000c4100 0x7f88000c24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54832/0 (socket says 172.21.15.133:54832) 2023-12-19T19:00:10.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.134+0000 7f8804b5f640 1 -- 172.21.15.133:0/3846162074 learned_addr learned my addr 172.21.15.133:0/3846162074 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:10.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.138+0000 7f8805360640 1 --2- 172.21.15.133:0/3846162074 >> v2:172.21.15.138:3300/0 conn(0x7f88000c63c0 0x7f88000c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:10.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.138+0000 7f8804b5f640 1 -- 172.21.15.133:0/3846162074 >> v2:172.21.15.138:3300/0 conn(0x7f88000c63c0 msgr2=0x7f88000c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:10.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.138+0000 7f8804b5f640 1 --2- 172.21.15.133:0/3846162074 >> v2:172.21.15.138:3300/0 conn(0x7f88000c63c0 0x7f88000c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.138+0000 7f8804b5f640 1 -- 172.21.15.133:0/3846162074 >> v1:172.21.15.138:6789/0 conn(0x7f88000c29e0 legacy=0x7f88000a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:10.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.138+0000 7f8804b5f640 1 -- 172.21.15.133:0/3846162074 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88000c1310 con 0x7f88000c4100 2023-12-19T19:00:10.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.138+0000 7f8804b5f640 1 --2- 172.21.15.133:0/3846162074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88000c4100 0x7f88000c24a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f880006e000 tx=0x7f87f001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2fd4547d7adaa32 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:10.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.138+0000 7f87f7fff640 1 -- 172.21.15.133:0/3846162074 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f00ac630 con 0x7f88000c4100 2023-12-19T19:00:10.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.138+0000 7f87f7fff640 1 -- 172.21.15.133:0/3846162074 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f00ac790 con 0x7f88000c4100 2023-12-19T19:00:10.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.138+0000 7f87f7fff640 1 -- 172.21.15.133:0/3846162074 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f00acb20 con 0x7f88000c4100 2023-12-19T19:00:10.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.138+0000 7f88075c4640 1 -- 172.21.15.133:0/3846162074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88000c4100 msgr2=0x7f88000c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:10.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.138+0000 7f88075c4640 1 --2- 172.21.15.133:0/3846162074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88000c4100 0x7f88000c24a0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f880006e000 tx=0x7f87f001c3b0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f88075c4640 1 -- 172.21.15.133:0/3846162074 shutdown_connections 2023-12-19T19:00:10.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f88075c4640 1 --2- 172.21.15.133:0/3846162074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88000c4100 0x7f88000c24a0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f88075c4640 1 --2- 172.21.15.133:0/3846162074 >> v2:172.21.15.138:3300/0 conn(0x7f88000c63c0 0x7f88000c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f88075c4640 1 -- 172.21.15.133:0/3846162074 >> 172.21.15.133:0/3846162074 conn(0x7f880006a5b0 msgr2=0x7f880006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:10.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f88075c4640 1 -- 172.21.15.133:0/3846162074 shutdown_connections 2023-12-19T19:00:10.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f88075c4640 1 -- 172.21.15.133:0/3846162074 wait complete. 2023-12-19T19:00:10.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f88075c4640 1 Processor -- start 2023-12-19T19:00:10.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f88075c4640 1 -- start start 2023-12-19T19:00:10.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f88075c4640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f88000c29e0 0x7f88001ed750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:10.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f88075c4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88000c4100 0x7f880014fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:10.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f88075c4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88000c63c0 0x7f88000bf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:10.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f88075c4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88001edc90 con 0x7f88000c4100 2023-12-19T19:00:10.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f88075c4640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f880015ac70 con 0x7f88000c63c0 2023-12-19T19:00:10.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f88075c4640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8800158170 con 0x7f88000c29e0 2023-12-19T19:00:10.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f8804b5f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88000c4100 0x7f880014fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:10.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f8804b5f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88000c4100 0x7f880014fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54834/0 (socket says 172.21.15.133:54834) 2023-12-19T19:00:10.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f8804b5f640 1 -- 172.21.15.133:0/2349872506 learned_addr learned my addr 172.21.15.133:0/2349872506 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:10.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f8805360640 1 --2- 172.21.15.133:0/2349872506 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f88000c29e0 0x7f88001ed750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:10.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f8805b61640 1 --2- 172.21.15.133:0/2349872506 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88000c63c0 0x7f88000bf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:10.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f8804b5f640 1 -- 172.21.15.133:0/2349872506 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f88000c29e0 msgr2=0x7f88001ed750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:10.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f8804b5f640 1 --2- 172.21.15.133:0/2349872506 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f88000c29e0 0x7f88001ed750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f8804b5f640 1 -- 172.21.15.133:0/2349872506 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88000c63c0 msgr2=0x7f88000bf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:10.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f8804b5f640 1 --2- 172.21.15.133:0/2349872506 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88000c63c0 0x7f88000bf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f8804b5f640 1 -- 172.21.15.133:0/2349872506 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f00094d0 con 0x7f88000c4100 2023-12-19T19:00:10.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f8804b5f640 1 --2- 172.21.15.133:0/2349872506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88000c4100 0x7f880014fd30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f87f0018fc0 tx=0x7f87f0019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:10.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.142+0000 7f87f5ffb640 1 -- 172.21.15.133:0/2349872506 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f00b5640 con 0x7f88000c4100 2023-12-19T19:00:10.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.146+0000 7f87f5ffb640 1 -- 172.21.15.133:0/2349872506 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f00b57a0 con 0x7f88000c4100 2023-12-19T19:00:10.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.146+0000 7f87f5ffb640 1 -- 172.21.15.133:0/2349872506 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f00b5b10 con 0x7f88000c4100 2023-12-19T19:00:10.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.146+0000 7f88075c4640 1 -- 172.21.15.133:0/2349872506 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8800150270 con 0x7f88000c4100 2023-12-19T19:00:10.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.146+0000 7f88075c4640 1 -- 172.21.15.133:0/2349872506 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88000a4780 con 0x7f88000c4100 2023-12-19T19:00:10.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.146+0000 7f88075c4640 1 -- 172.21.15.133:0/2349872506 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88000a4910 con 0x7f88000c4100 2023-12-19T19:00:10.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.146+0000 7f87f5ffb640 1 -- 172.21.15.133:0/2349872506 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f87f00b3070 con 0x7f88000c4100 2023-12-19T19:00:10.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.146+0000 7f87f5ffb640 1 --2- 172.21.15.133:0/2349872506 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f87e4066470 0x7f87e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:10.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.146+0000 7f87f5ffb640 1 -- 172.21.15.133:0/2349872506 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f87f011de70 con 0x7f88000c4100 2023-12-19T19:00:10.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.150+0000 7f8805360640 1 --2- 172.21.15.133:0/2349872506 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f87e4066470 0x7f87e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:10.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.150+0000 7f8805360640 1 --2- 172.21.15.133:0/2349872506 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f87e4066470 0x7f87e4068930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00b930 tx=0x7f87fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:10.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.150+0000 7f87f5ffb640 1 -- 172.21.15.133:0/2349872506 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f87f00eb440 con 0x7f88000c4100 2023-12-19T19:00:10.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.334+0000 7f88075c4640 1 -- 172.21.15.133:0/2349872506 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8800068400 con 0x7f88000c4100 2023-12-19T19:00:10.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.334+0000 7f87f5ffb640 1 -- 172.21.15.133:0/2349872506 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f87f00eea60 con 0x7f88000c4100 2023-12-19T19:00:10.336 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:10.336 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/2717901150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6835","nonce":2717901150},{"type":"v1","addr":"172.21.15.138:6837","nonce":2717901150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4986,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6836/3989181473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":3989181473},{"type":"v1","addr":"172.21.15.138:6836","nonce":3989181473}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5598,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/163738173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":163738173},{"type":"v1","addr":"172.21.15.133:6835","nonce":163738173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:59:45.017800+0000","modified":"2023-12-19T18:59:48.066331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.133:6834/3180094953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":3180094953},{"type":"v1","addr":"172.21.15.133:6834","nonce":3180094953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T19:00:10.336 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 24 2023-12-19T19:00:10.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.334+0000 7f88075c4640 1 -- 172.21.15.133:0/2349872506 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f87e4066470 msgr2=0x7f87e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:10.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.334+0000 7f88075c4640 1 --2- 172.21.15.133:0/2349872506 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f87e4066470 0x7f87e4068930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f87fc00b930 tx=0x7f87fc008040 comp rx=0 tx=0).stop 2023-12-19T19:00:10.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.334+0000 7f88075c4640 1 -- 172.21.15.133:0/2349872506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88000c4100 msgr2=0x7f880014fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:10.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.334+0000 7f88075c4640 1 --2- 172.21.15.133:0/2349872506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88000c4100 0x7f880014fd30 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f87f0018fc0 tx=0x7f87f0019150 comp rx=0 tx=0).stop 2023-12-19T19:00:10.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.334+0000 7f88075c4640 1 -- 172.21.15.133:0/2349872506 shutdown_connections 2023-12-19T19:00:10.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.334+0000 7f88075c4640 1 --2- 172.21.15.133:0/2349872506 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f87e4066470 0x7f87e4068930 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.334+0000 7f88075c4640 1 --2- 172.21.15.133:0/2349872506 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f88000c63c0 0x7f88000bf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.334+0000 7f88075c4640 1 --2- 172.21.15.133:0/2349872506 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88000c4100 0x7f880014fd30 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.334+0000 7f88075c4640 1 --2- 172.21.15.133:0/2349872506 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f88000c29e0 0x7f88001ed750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.334+0000 7f88075c4640 1 -- 172.21.15.133:0/2349872506 >> 172.21.15.133:0/2349872506 conn(0x7f880006a5b0 msgr2=0x7f8800071e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:10.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.334+0000 7f88075c4640 1 -- 172.21.15.133:0/2349872506 shutdown_connections 2023-12-19T19:00:10.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.334+0000 7f88075c4640 1 -- 172.21.15.133:0/2349872506 wait complete. 2023-12-19T19:00:10.357 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:00:10.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.490+0000 7fedf1701640 1 Processor -- start 2023-12-19T19:00:10.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.490+0000 7fedf1701640 1 -- start start 2023-12-19T19:00:10.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.494+0000 7fedf1701640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fedec151e90 0x7fedec0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:10.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.494+0000 7fedf1701640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec0c7ea0 0x7fedec06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:10.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.494+0000 7fedf1701640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fedec0c4e60 0x7fedec06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:10.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.494+0000 7fedf1701640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedec0c8750 con 0x7fedec151e90 2023-12-19T19:00:10.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.494+0000 7fedf1701640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedec1552d0 con 0x7fedec0c4e60 2023-12-19T19:00:10.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.494+0000 7fedf1701640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedec0c5c60 con 0x7fedec0c7ea0 2023-12-19T19:00:10.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.494+0000 7fedeaffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fedec151e90 0x7fedec0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:10.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.494+0000 7fedeaffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fedec151e90 0x7fedec0c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54840/0 (socket says 172.21.15.133:54840) 2023-12-19T19:00:10.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.494+0000 7fedeaffd640 1 -- 172.21.15.133:0/387406686 learned_addr learned my addr 172.21.15.133:0/387406686 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:10.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.494+0000 7fede27fc640 1 --2- 172.21.15.133:0/387406686 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec0c7ea0 0x7fedec06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:10.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.494+0000 7fedeb7fe640 1 --2- 172.21.15.133:0/387406686 >> v2:172.21.15.138:3300/0 conn(0x7fedec0c4e60 0x7fedec06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:10.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.494+0000 7fedeaffd640 1 -- 172.21.15.133:0/387406686 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec0c7ea0 msgr2=0x7fedec06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:10.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.494+0000 7fedeaffd640 1 --2- 172.21.15.133:0/387406686 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec0c7ea0 0x7fedec06b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.494+0000 7fedeaffd640 1 -- 172.21.15.133:0/387406686 >> v2:172.21.15.138:3300/0 conn(0x7fedec0c4e60 msgr2=0x7fedec06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:10.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.494+0000 7fedeaffd640 1 --2- 172.21.15.133:0/387406686 >> v2:172.21.15.138:3300/0 conn(0x7fedec0c4e60 0x7fedec06b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.494+0000 7fedeaffd640 1 -- 172.21.15.133:0/387406686 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec06c860 con 0x7fedec151e90 2023-12-19T19:00:10.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.494+0000 7fede27fc640 1 --2- 172.21.15.133:0/387406686 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec0c7ea0 0x7fedec06b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:10.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.498+0000 7fedeaffd640 1 --2- 172.21.15.133:0/387406686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec151e90 0x7fedec0c4920 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fedec0bd660 tx=0x7feddc01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2fe133061793ad server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:10.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.498+0000 7fedea7fc640 1 -- 172.21.15.133:0/387406686 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc0a5530 con 0x7fedec151e90 2023-12-19T19:00:10.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.498+0000 7fedea7fc640 1 -- 172.21.15.133:0/387406686 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feddc0a5690 con 0x7fedec151e90 2023-12-19T19:00:10.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.498+0000 7fedea7fc640 1 -- 172.21.15.133:0/387406686 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc0a5a20 con 0x7fedec151e90 2023-12-19T19:00:10.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.498+0000 7fedf1701640 1 -- 172.21.15.133:0/387406686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec151e90 msgr2=0x7fedec0c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:10.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.498+0000 7fedf1701640 1 --2- 172.21.15.133:0/387406686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec151e90 0x7fedec0c4920 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fedec0bd660 tx=0x7feddc01c8b0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.498+0000 7fedf1701640 1 -- 172.21.15.133:0/387406686 shutdown_connections 2023-12-19T19:00:10.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.498+0000 7fedf1701640 1 --2- 172.21.15.133:0/387406686 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec0c7ea0 0x7fedec06b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.498+0000 7fedf1701640 1 --2- 172.21.15.133:0/387406686 >> v2:172.21.15.138:3300/0 conn(0x7fedec0c4e60 0x7fedec06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.498+0000 7fedf1701640 1 --2- 172.21.15.133:0/387406686 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec151e90 0x7fedec0c4920 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.498+0000 7fedf1701640 1 -- 172.21.15.133:0/387406686 >> 172.21.15.133:0/387406686 conn(0x7fedec0ca170 msgr2=0x7fedec0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:10.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.498+0000 7fedf1701640 1 -- 172.21.15.133:0/387406686 shutdown_connections 2023-12-19T19:00:10.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.498+0000 7fedf1701640 1 -- 172.21.15.133:0/387406686 wait complete. 2023-12-19T19:00:10.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.498+0000 7fedf1701640 1 Processor -- start 2023-12-19T19:00:10.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.498+0000 7fedf1701640 1 -- start start 2023-12-19T19:00:10.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fedf1701640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec0c4e60 0x7fedec0af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:10.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fedf1701640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedec0c7ea0 0x7fedec0c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fedf1701640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec151e90 0x7fedec1f0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fedf1701640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec14be10 con 0x7fedec151e90 2023-12-19T19:00:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fedf1701640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec1f1990 con 0x7fedec0c7ea0 2023-12-19T19:00:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fedf1701640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedec0ad3e0 con 0x7fedec0c4e60 2023-12-19T19:00:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fedeb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec151e90 0x7fedec1f0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fedeb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec151e90 0x7fedec1f0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54848/0 (socket says 172.21.15.133:54848) 2023-12-19T19:00:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fedeb7fe640 1 -- 172.21.15.133:0/2233242864 learned_addr learned my addr 172.21.15.133:0/2233242864 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fede27fc640 1 --2- 172.21.15.133:0/2233242864 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedec0c7ea0 0x7fedec0c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fedeaffd640 1 --2- 172.21.15.133:0/2233242864 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec0c4e60 0x7fedec0af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fedeb7fe640 1 -- 172.21.15.133:0/2233242864 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec0c4e60 msgr2=0x7fedec0af2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fedeb7fe640 1 --2- 172.21.15.133:0/2233242864 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec0c4e60 0x7fedec0af2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fedeb7fe640 1 -- 172.21.15.133:0/2233242864 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedec0c7ea0 msgr2=0x7fedec0c20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fedeb7fe640 1 --2- 172.21.15.133:0/2233242864 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedec0c7ea0 0x7fedec0c20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fedeb7fe640 1 -- 172.21.15.133:0/2233242864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc009b30 con 0x7fedec151e90 2023-12-19T19:00:10.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fedeb7fe640 1 --2- 172.21.15.133:0/2233242864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec151e90 0x7fedec1f0ce0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fede400d5d0 tx=0x7fede400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:10.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fede3fff640 1 -- 172.21.15.133:0/2233242864 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede4014620 con 0x7fedec151e90 2023-12-19T19:00:10.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fede3fff640 1 -- 172.21.15.133:0/2233242864 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede40147a0 con 0x7fedec151e90 2023-12-19T19:00:10.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fede3fff640 1 -- 172.21.15.133:0/2233242864 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede4014b50 con 0x7fedec151e90 2023-12-19T19:00:10.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fedf1701640 1 -- 172.21.15.133:0/2233242864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedec0ad6c0 con 0x7fedec151e90 2023-12-19T19:00:10.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fedf1701640 1 -- 172.21.15.133:0/2233242864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedec0aedf0 con 0x7fedec151e90 2023-12-19T19:00:10.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fedf1701640 1 -- 172.21.15.133:0/2233242864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedec1509f0 con 0x7fedec151e90 2023-12-19T19:00:10.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.502+0000 7fede3fff640 1 -- 172.21.15.133:0/2233242864 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fede4014cb0 con 0x7fedec151e90 2023-12-19T19:00:10.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.506+0000 7fede3fff640 1 --2- 172.21.15.133:0/2233242864 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fedcc0664a0 0x7fedcc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:10.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.506+0000 7fede3fff640 1 -- 172.21.15.133:0/2233242864 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fede4084390 con 0x7fedec151e90 2023-12-19T19:00:10.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.506+0000 7fedeaffd640 1 --2- 172.21.15.133:0/2233242864 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fedcc0664a0 0x7fedcc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:10.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.506+0000 7fedeaffd640 1 --2- 172.21.15.133:0/2233242864 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fedcc0664a0 0x7fedcc068960 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7feddc0ae000 tx=0x7feddc0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:10.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.510+0000 7fede3fff640 1 -- 172.21.15.133:0/2233242864 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fede4051850 con 0x7fedec151e90 2023-12-19T19:00:10.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.662+0000 7fedf1701640 1 -- 172.21.15.133:0/2233242864 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fedec068400 con 0x7fedec151e90 2023-12-19T19:00:10.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.662+0000 7fede3fff640 1 -- 172.21.15.133:0/2233242864 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16682 (secure 0 0 0) 0x7fede4054e70 con 0x7fedec151e90 2023-12-19T19:00:10.665 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:10.665 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":38,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:00:08.629610+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T18:59:42.757628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-19T18:59:44.017454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6835/862459875":"2023-12-20T19:00:05.490309+0000","172.21.15.133:6832/862459875":"2023-12-20T19:00:05.490309+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:00:10.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.662+0000 7fedf1701640 1 -- 172.21.15.133:0/2233242864 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fedcc0664a0 msgr2=0x7fedcc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:10.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.662+0000 7fedf1701640 1 --2- 172.21.15.133:0/2233242864 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fedcc0664a0 0x7fedcc068960 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7feddc0ae000 tx=0x7feddc0a7070 comp rx=0 tx=0).stop 2023-12-19T19:00:10.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.662+0000 7fedf1701640 1 -- 172.21.15.133:0/2233242864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec151e90 msgr2=0x7fedec1f0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:10.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.662+0000 7fedf1701640 1 --2- 172.21.15.133:0/2233242864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec151e90 0x7fedec1f0ce0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fede400d5d0 tx=0x7fede400da90 comp rx=0 tx=0).stop 2023-12-19T19:00:10.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.662+0000 7fedf1701640 1 -- 172.21.15.133:0/2233242864 shutdown_connections 2023-12-19T19:00:10.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.662+0000 7fedf1701640 1 --2- 172.21.15.133:0/2233242864 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fedcc0664a0 0x7fedcc068960 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.662+0000 7fedf1701640 1 --2- 172.21.15.133:0/2233242864 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fedec151e90 0x7fedec1f0ce0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.662+0000 7fedf1701640 1 --2- 172.21.15.133:0/2233242864 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fedec0c7ea0 0x7fedec0c20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.662+0000 7fedf1701640 1 --2- 172.21.15.133:0/2233242864 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fedec0c4e60 0x7fedec0af2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.662+0000 7fedf1701640 1 -- 172.21.15.133:0/2233242864 >> 172.21.15.133:0/2233242864 conn(0x7fedec0ca170 msgr2=0x7fedec1502e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:10.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.666+0000 7fedf1701640 1 -- 172.21.15.133:0/2233242864 shutdown_connections 2023-12-19T19:00:10.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.666+0000 7fedf1701640 1 -- 172.21.15.133:0/2233242864 wait complete. 2023-12-19T19:00:10.686 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-12-19T19:00:10.686 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:00:10.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.822+0000 7f654479d640 1 Processor -- start 2023-12-19T19:00:10.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.822+0000 7f654479d640 1 -- start start 2023-12-19T19:00:10.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.822+0000 7f654479d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f653c0c2bb0 0x7f653c0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:10.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.822+0000 7f654479d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f653c0c31c0 con 0x7f653c0c4100 2023-12-19T19:00:10.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.822+0000 7f654479d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f653c0c34a0 con 0x7f653c0c63c0 2023-12-19T19:00:10.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.822+0000 7f654479d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653c0c1030 con 0x7f653c0c2bb0 2023-12-19T19:00:10.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.822+0000 7f6541d38640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f653c0c4100 0x7f653c0a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:45800/0 (socket says 172.21.15.133:45800) 2023-12-19T19:00:10.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.822+0000 7f6541d38640 1 -- 172.21.15.133:0/3248875531 learned_addr learned my addr 172.21.15.133:0/3248875531 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:10.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.822+0000 7f6542d3a640 1 --2- 172.21.15.133:0/3248875531 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f653c0c2bb0 0x7f653c0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:10.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.822+0000 7f6541537640 1 -- 172.21.15.133:0/3248875531 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437757763 0 0) 0x7f653c0c31c0 con 0x7f653c0c4100 2023-12-19T19:00:10.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.822+0000 7f6541537640 1 -- 172.21.15.133:0/3248875531 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6528005740 con 0x7f653c0c4100 2023-12-19T19:00:10.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.822+0000 7f6541537640 1 -- 172.21.15.133:0/3248875531 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223294456 0 0) 0x7f653c0c34a0 con 0x7f653c0c63c0 2023-12-19T19:00:10.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.822+0000 7f6541537640 1 -- 172.21.15.133:0/3248875531 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f653c0c31c0 con 0x7f653c0c63c0 2023-12-19T19:00:10.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.822+0000 7f6541537640 1 -- 172.21.15.133:0/3248875531 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3221881743 0 0) 0x7f6528005740 con 0x7f653c0c4100 2023-12-19T19:00:10.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.822+0000 7f6542d3a640 1 -- 172.21.15.133:0/3248875531 >> v1:172.21.15.138:6789/0 conn(0x7f653c0c63c0 legacy=0x7f653c0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:10.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.822+0000 7f6542d3a640 1 -- 172.21.15.133:0/3248875531 >> v1:172.21.15.133:6789/0 conn(0x7f653c0c4100 legacy=0x7f653c0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:10.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.822+0000 7f6542d3a640 1 -- 172.21.15.133:0/3248875531 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653c0c1310 con 0x7f653c0c2bb0 2023-12-19T19:00:10.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.826+0000 7f6542d3a640 1 --2- 172.21.15.133:0/3248875531 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f653c0c2bb0 0x7f653c0c06d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6534009dc0 tx=0x7f653401c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afc0518337505a55 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:10.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.826+0000 7f6541537640 1 -- 172.21.15.133:0/3248875531 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c001680 con 0x7f653c0c2bb0 2023-12-19T19:00:10.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.826+0000 7f6541537640 1 -- 172.21.15.133:0/3248875531 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65340a64b0 con 0x7f653c0c2bb0 2023-12-19T19:00:10.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.826+0000 7f6541537640 1 -- 172.21.15.133:0/3248875531 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65340a6840 con 0x7f653c0c2bb0 2023-12-19T19:00:10.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.826+0000 7f654479d640 1 -- 172.21.15.133:0/3248875531 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f653c0c2bb0 msgr2=0x7f653c0c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:10.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.826+0000 7f654479d640 1 --2- 172.21.15.133:0/3248875531 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f653c0c2bb0 0x7f653c0c06d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6534009dc0 tx=0x7f653401c740 comp rx=0 tx=0).stop 2023-12-19T19:00:10.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.826+0000 7f654479d640 1 -- 172.21.15.133:0/3248875531 shutdown_connections 2023-12-19T19:00:10.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.826+0000 7f654479d640 1 --2- 172.21.15.133:0/3248875531 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f653c0c2bb0 0x7f653c0c06d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.826+0000 7f654479d640 1 -- 172.21.15.133:0/3248875531 >> 172.21.15.133:0/3248875531 conn(0x7f653c06a5b0 msgr2=0x7f653c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:10.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.826+0000 7f654479d640 1 -- 172.21.15.133:0/3248875531 shutdown_connections 2023-12-19T19:00:10.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.826+0000 7f654479d640 1 -- 172.21.15.133:0/3248875531 wait complete. 2023-12-19T19:00:10.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f654479d640 1 Processor -- start 2023-12-19T19:00:10.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f654479d640 1 -- start start 2023-12-19T19:00:10.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f654479d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f653c0c2bb0 0x7f653c156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:10.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f654479d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f653c0c4100 0x7f653c15b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:10.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f654479d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f653c0c63c0 0x7f653c15ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:10.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f654479d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c1e9950 con 0x7f653c0c63c0 2023-12-19T19:00:10.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f654479d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c157490 con 0x7f653c0c4100 2023-12-19T19:00:10.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f654479d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653c1e8ff0 con 0x7f653c0c2bb0 2023-12-19T19:00:10.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f6542d3a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f653c0c63c0 0x7f653c15ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:10.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f6542d3a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f653c0c63c0 0x7f653c15ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54856/0 (socket says 172.21.15.133:54856) 2023-12-19T19:00:10.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f6542d3a640 1 -- 172.21.15.133:0/2278815415 learned_addr learned my addr 172.21.15.133:0/2278815415 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:10.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f6542539640 1 --2- 172.21.15.133:0/2278815415 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f653c0c2bb0 0x7f653c156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:10.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f6541d38640 1 --2- 172.21.15.133:0/2278815415 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f653c0c4100 0x7f653c15b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:10.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f6542d3a640 1 -- 172.21.15.133:0/2278815415 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f653c0c2bb0 msgr2=0x7f653c156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:10.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f6542d3a640 1 --2- 172.21.15.133:0/2278815415 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f653c0c2bb0 0x7f653c156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f6542d3a640 1 -- 172.21.15.133:0/2278815415 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f653c0c4100 msgr2=0x7f653c15b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:10.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f6542d3a640 1 --2- 172.21.15.133:0/2278815415 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f653c0c4100 0x7f653c15b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:10.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f6542d3a640 1 -- 172.21.15.133:0/2278815415 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6534009a70 con 0x7f653c0c63c0 2023-12-19T19:00:10.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f6541d38640 1 --2- 172.21.15.133:0/2278815415 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f653c0c4100 0x7f653c15b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:10.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f6542d3a640 1 --2- 172.21.15.133:0/2278815415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f653c0c63c0 0x7f653c15ba30 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6534098340 tx=0x7f65340194e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:10.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f6532ffd640 1 -- 172.21.15.133:0/2278815415 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65340a6bf0 con 0x7f653c0c63c0 2023-12-19T19:00:10.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f6532ffd640 1 -- 172.21.15.133:0/2278815415 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65340a6d50 con 0x7f653c0c63c0 2023-12-19T19:00:10.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f6532ffd640 1 -- 172.21.15.133:0/2278815415 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534003ba0 con 0x7f653c0c63c0 2023-12-19T19:00:10.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f654479d640 1 -- 172.21.15.133:0/2278815415 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f653c1e9290 con 0x7f653c0c63c0 2023-12-19T19:00:10.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.830+0000 7f654479d640 1 -- 172.21.15.133:0/2278815415 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653c1576c0 con 0x7f653c0c63c0 2023-12-19T19:00:10.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.834+0000 7f654479d640 1 -- 172.21.15.133:0/2278815415 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f653c068400 con 0x7f653c0c63c0 2023-12-19T19:00:10.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.834+0000 7f6532ffd640 1 -- 172.21.15.133:0/2278815415 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6534003d00 con 0x7f653c0c63c0 2023-12-19T19:00:10.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.834+0000 7f6532ffd640 1 --2- 172.21.15.133:0/2278815415 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6520066470 0x7f6520068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:10.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.834+0000 7f6532ffd640 1 -- 172.21.15.133:0/2278815415 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f65340aa070 con 0x7f653c0c63c0 2023-12-19T19:00:10.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.834+0000 7f6542539640 1 --2- 172.21.15.133:0/2278815415 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6520066470 0x7f6520068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:10.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.834+0000 7f6542539640 1 --2- 172.21.15.133:0/2278815415 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6520066470 0x7f6520068930 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f65380011f0 tx=0x7f6538009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:10.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:10.838+0000 7f6532ffd640 1 -- 172.21.15.133:0/2278815415 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6534150290 con 0x7f653c0c63c0 2023-12-19T19:00:11.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.022+0000 7f654479d640 1 -- 172.21.15.133:0/2278815415 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f653c072360 con 0x7f653c0c63c0 2023-12-19T19:00:11.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.022+0000 7f6532ffd640 1 -- 172.21.15.133:0/2278815415 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f65340c7090 con 0x7f653c0c63c0 2023-12-19T19:00:11.026 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:11.026 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/2717901150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6835","nonce":2717901150},{"type":"v1","addr":"172.21.15.138:6837","nonce":2717901150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4986,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6836/3989181473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":3989181473},{"type":"v1","addr":"172.21.15.138:6836","nonce":3989181473}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5598,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/163738173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":163738173},{"type":"v1","addr":"172.21.15.133:6835","nonce":163738173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:59:45.017800+0000","modified":"2023-12-19T18:59:48.066331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.133:6834/3180094953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":3180094953},{"type":"v1","addr":"172.21.15.133:6834","nonce":3180094953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T19:00:11.026 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 24 2023-12-19T19:00:11.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.026+0000 7f654479d640 1 -- 172.21.15.133:0/2278815415 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6520066470 msgr2=0x7f6520068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:11.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.026+0000 7f654479d640 1 --2- 172.21.15.133:0/2278815415 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6520066470 0x7f6520068930 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f65380011f0 tx=0x7f6538009040 comp rx=0 tx=0).stop 2023-12-19T19:00:11.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.026+0000 7f654479d640 1 -- 172.21.15.133:0/2278815415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f653c0c63c0 msgr2=0x7f653c15ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:11.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.026+0000 7f654479d640 1 --2- 172.21.15.133:0/2278815415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f653c0c63c0 0x7f653c15ba30 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6534098340 tx=0x7f65340194e0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.026+0000 7f654479d640 1 -- 172.21.15.133:0/2278815415 shutdown_connections 2023-12-19T19:00:11.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.026+0000 7f654479d640 1 --2- 172.21.15.133:0/2278815415 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6520066470 0x7f6520068930 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.026+0000 7f654479d640 1 --2- 172.21.15.133:0/2278815415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f653c0c63c0 0x7f653c15ba30 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.026+0000 7f654479d640 1 --2- 172.21.15.133:0/2278815415 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f653c0c4100 0x7f653c15b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.026+0000 7f654479d640 1 --2- 172.21.15.133:0/2278815415 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f653c0c2bb0 0x7f653c156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.026+0000 7f654479d640 1 -- 172.21.15.133:0/2278815415 >> 172.21.15.133:0/2278815415 conn(0x7f653c06a5b0 msgr2=0x7f653c0c2310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:11.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.026+0000 7f654479d640 1 -- 172.21.15.133:0/2278815415 shutdown_connections 2023-12-19T19:00:11.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.026+0000 7f654479d640 1 -- 172.21.15.133:0/2278815415 wait complete. 2023-12-19T19:00:11.048 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:00:11.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.182+0000 7f38a7f2a640 1 Processor -- start 2023-12-19T19:00:11.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.182+0000 7f38a7f2a640 1 -- start start 2023-12-19T19:00:11.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.186+0000 7f38a7f2a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f38a01560e0 0x7f38a015ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:11.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.186+0000 7f38a7f2a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f38a00bffc0 0x7f38a00c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:11.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.186+0000 7f38a7f2a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a015c600 con 0x7f38a006d520 2023-12-19T19:00:11.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.186+0000 7f38a7f2a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a015a5c0 con 0x7f38a00bffc0 2023-12-19T19:00:11.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.186+0000 7f38a7f2a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a01594e0 con 0x7f38a01560e0 2023-12-19T19:00:11.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.186+0000 7f38a64c7640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f38a00bffc0 0x7f38a00c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:11.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.186+0000 7f38a64c7640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f38a00bffc0 0x7f38a00c1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54862/0 (socket says 172.21.15.133:54862) 2023-12-19T19:00:11.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.186+0000 7f38a64c7640 1 -- 172.21.15.133:0/3101774754 learned_addr learned my addr 172.21.15.133:0/3101774754 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:11.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.186+0000 7f38a5cc6640 1 --2- 172.21.15.133:0/3101774754 >> v2:172.21.15.138:3300/0 conn(0x7f38a01560e0 0x7f38a015ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:11.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.186+0000 7f38a64c7640 1 -- 172.21.15.133:0/3101774754 >> v2:172.21.15.138:3300/0 conn(0x7f38a01560e0 msgr2=0x7f38a015ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:11.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.186+0000 7f38a64c7640 1 --2- 172.21.15.133:0/3101774754 >> v2:172.21.15.138:3300/0 conn(0x7f38a01560e0 0x7f38a015ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.186+0000 7f38a64c7640 1 -- 172.21.15.133:0/3101774754 >> v1:172.21.15.138:6789/0 conn(0x7f38a006d520 legacy=0x7f38a0159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:11.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.186+0000 7f38a64c7640 1 -- 172.21.15.133:0/3101774754 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a01597c0 con 0x7f38a00bffc0 2023-12-19T19:00:11.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.186+0000 7f38a5cc6640 1 --2- 172.21.15.133:0/3101774754 >> v2:172.21.15.138:3300/0 conn(0x7f38a01560e0 0x7f38a015ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:00:11.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.186+0000 7f38a64c7640 1 --2- 172.21.15.133:0/3101774754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a00bffc0 0x7f38a00c1bf0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f38a006b390 tx=0x7f389801c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79523352a20813af server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:11.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.186+0000 7f38a4cc4640 1 -- 172.21.15.133:0/3101774754 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38980a5730 con 0x7f38a00bffc0 2023-12-19T19:00:11.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.186+0000 7f38a4cc4640 1 -- 172.21.15.133:0/3101774754 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38980a5890 con 0x7f38a00bffc0 2023-12-19T19:00:11.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.186+0000 7f38a4cc4640 1 -- 172.21.15.133:0/3101774754 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38980a5c20 con 0x7f38a00bffc0 2023-12-19T19:00:11.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.190+0000 7f38a7f2a640 1 -- 172.21.15.133:0/3101774754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a00bffc0 msgr2=0x7f38a00c1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:11.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.190+0000 7f38a7f2a640 1 --2- 172.21.15.133:0/3101774754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a00bffc0 0x7f38a00c1bf0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f38a006b390 tx=0x7f389801c960 comp rx=0 tx=0).stop 2023-12-19T19:00:11.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.190+0000 7f38a7f2a640 1 -- 172.21.15.133:0/3101774754 shutdown_connections 2023-12-19T19:00:11.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.190+0000 7f38a7f2a640 1 --2- 172.21.15.133:0/3101774754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a00bffc0 0x7f38a00c1bf0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.190+0000 7f38a7f2a640 1 --2- 172.21.15.133:0/3101774754 >> v2:172.21.15.138:3300/0 conn(0x7f38a01560e0 0x7f38a015ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.190+0000 7f38a7f2a640 1 -- 172.21.15.133:0/3101774754 >> 172.21.15.133:0/3101774754 conn(0x7f38a006a5b0 msgr2=0x7f38a006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:11.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.190+0000 7f38a7f2a640 1 -- 172.21.15.133:0/3101774754 shutdown_connections 2023-12-19T19:00:11.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.190+0000 7f38a7f2a640 1 -- 172.21.15.133:0/3101774754 wait complete. 2023-12-19T19:00:11.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.190+0000 7f38a7f2a640 1 Processor -- start 2023-12-19T19:00:11.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.190+0000 7f38a7f2a640 1 -- start start 2023-12-19T19:00:11.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.190+0000 7f38a7f2a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38a006d520 0x7f38a00a2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:11.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.190+0000 7f38a7f2a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38a00bffc0 0x7f38a0144c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:11.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.190+0000 7f38a7f2a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a01560e0 0x7f38a0145190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:11.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.190+0000 7f38a7f2a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a00a3800 con 0x7f38a01560e0 2023-12-19T19:00:11.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.190+0000 7f38a7f2a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a01f4a70 con 0x7f38a006d520 2023-12-19T19:00:11.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.190+0000 7f38a7f2a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a01f4d30 con 0x7f38a00bffc0 2023-12-19T19:00:11.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.190+0000 7f38a64c7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a01560e0 0x7f38a0145190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:11.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.190+0000 7f38a64c7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a01560e0 0x7f38a0145190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54864/0 (socket says 172.21.15.133:54864) 2023-12-19T19:00:11.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.190+0000 7f38a64c7640 1 -- 172.21.15.133:0/2374631511 learned_addr learned my addr 172.21.15.133:0/2374631511 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:11.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.190+0000 7f38a5cc6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38a006d520 0x7f38a00a2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:11.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.190+0000 7f38a54c5640 1 --2- 172.21.15.133:0/2374631511 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38a00bffc0 0x7f38a0144c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:11.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.194+0000 7f38a64c7640 1 -- 172.21.15.133:0/2374631511 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38a00bffc0 msgr2=0x7f38a0144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:11.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.194+0000 7f38a64c7640 1 --2- 172.21.15.133:0/2374631511 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38a00bffc0 0x7f38a0144c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.194+0000 7f38a64c7640 1 -- 172.21.15.133:0/2374631511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38a006d520 msgr2=0x7f38a00a2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:11.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.194+0000 7f38a64c7640 1 --2- 172.21.15.133:0/2374631511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38a006d520 0x7f38a00a2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.194+0000 7f38a64c7640 1 -- 172.21.15.133:0/2374631511 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3898009b30 con 0x7f38a01560e0 2023-12-19T19:00:11.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.194+0000 7f38a64c7640 1 --2- 172.21.15.133:0/2374631511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a01560e0 0x7f38a0145190 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f389801a590 tx=0x7f3898019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:11.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.194+0000 7f38967fc640 1 -- 172.21.15.133:0/2374631511 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38980b8670 con 0x7f38a01560e0 2023-12-19T19:00:11.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.194+0000 7f38967fc640 1 -- 172.21.15.133:0/2374631511 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38980b87d0 con 0x7f38a01560e0 2023-12-19T19:00:11.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.194+0000 7f38967fc640 1 -- 172.21.15.133:0/2374631511 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38980b8b80 con 0x7f38a01560e0 2023-12-19T19:00:11.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.194+0000 7f38a7f2a640 1 -- 172.21.15.133:0/2374631511 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a00c3fb0 con 0x7f38a01560e0 2023-12-19T19:00:11.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.194+0000 7f38a7f2a640 1 -- 172.21.15.133:0/2374631511 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a00c4570 con 0x7f38a01560e0 2023-12-19T19:00:11.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.194+0000 7f38a7f2a640 1 -- 172.21.15.133:0/2374631511 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a0068400 con 0x7f38a01560e0 2023-12-19T19:00:11.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.194+0000 7f38967fc640 1 -- 172.21.15.133:0/2374631511 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f38980b8ce0 con 0x7f38a01560e0 2023-12-19T19:00:11.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.194+0000 7f38967fc640 1 --2- 172.21.15.133:0/2374631511 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3884066470 0x7f3884068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:11.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.194+0000 7f38967fc640 1 -- 172.21.15.133:0/2374631511 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f389811f370 con 0x7f38a01560e0 2023-12-19T19:00:11.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.194+0000 7f38a5cc6640 1 --2- 172.21.15.133:0/2374631511 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3884066470 0x7f3884068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:11.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.198+0000 7f38a5cc6640 1 --2- 172.21.15.133:0/2374631511 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3884066470 0x7f3884068930 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f389c006fd0 tx=0x7f389c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:11.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.198+0000 7f38967fc640 1 -- 172.21.15.133:0/2374631511 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f38980ec9f0 con 0x7f38a01560e0 2023-12-19T19:00:11.362 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T19:00:11.367 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T19:00:11.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.382+0000 7f38a7f2a640 1 -- 172.21.15.133:0/2374631511 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f38a0164130 con 0x7f38a01560e0 2023-12-19T19:00:11.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.382+0000 7f38967fc640 1 -- 172.21.15.133:0/2374631511 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4949 (secure 0 0 0) 0x7f38980f0010 con 0x7f38a01560e0 2023-12-19T19:00:11.384 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:11.384 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/2717901150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6835","nonce":2717901150},{"type":"v1","addr":"172.21.15.138:6837","nonce":2717901150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4986,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6836/3989181473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":3989181473},{"type":"v1","addr":"172.21.15.138:6836","nonce":3989181473}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5598,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/163738173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":163738173},{"type":"v1","addr":"172.21.15.133:6835","nonce":163738173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:59:45.017800+0000","modified":"2023-12-19T18:59:48.066331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4992},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4992":{"gid":4992,"name":"a","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.133:6834/3180094953","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":3180094953},{"type":"v1","addr":"172.21.15.133:6834","nonce":3180094953}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T19:00:11.384 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 24 2023-12-19T19:00:11.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.382+0000 7f38a7f2a640 1 -- 172.21.15.133:0/2374631511 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3884066470 msgr2=0x7f3884068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:11.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.382+0000 7f38a7f2a640 1 --2- 172.21.15.133:0/2374631511 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3884066470 0x7f3884068930 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f389c006fd0 tx=0x7f389c008040 comp rx=0 tx=0).stop 2023-12-19T19:00:11.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.382+0000 7f38a7f2a640 1 -- 172.21.15.133:0/2374631511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a01560e0 msgr2=0x7f38a0145190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:11.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.382+0000 7f38a7f2a640 1 --2- 172.21.15.133:0/2374631511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a01560e0 0x7f38a0145190 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f389801a590 tx=0x7f3898019700 comp rx=0 tx=0).stop 2023-12-19T19:00:11.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.382+0000 7f38a7f2a640 1 -- 172.21.15.133:0/2374631511 shutdown_connections 2023-12-19T19:00:11.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.382+0000 7f38a7f2a640 1 --2- 172.21.15.133:0/2374631511 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3884066470 0x7f3884068930 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.382+0000 7f38a7f2a640 1 --2- 172.21.15.133:0/2374631511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a01560e0 0x7f38a0145190 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.382+0000 7f38a7f2a640 1 --2- 172.21.15.133:0/2374631511 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38a00bffc0 0x7f38a0144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.382+0000 7f38a7f2a640 1 --2- 172.21.15.133:0/2374631511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38a006d520 0x7f38a00a2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.382+0000 7f38a7f2a640 1 -- 172.21.15.133:0/2374631511 >> 172.21.15.133:0/2374631511 conn(0x7f38a006a5b0 msgr2=0x7f38a015b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:11.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.382+0000 7f38a7f2a640 1 -- 172.21.15.133:0/2374631511 shutdown_connections 2023-12-19T19:00:11.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.382+0000 7f38a7f2a640 1 -- 172.21.15.133:0/2374631511 wait complete. 2023-12-19T19:00:11.406 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:00:11.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.582+0000 7efdb1757640 1 Processor -- start 2023-12-19T19:00:11.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.582+0000 7efdb1757640 1 -- start start 2023-12-19T19:00:11.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.582+0000 7efdb1757640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7efdac06b270 0x7efdac155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:11.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.582+0000 7efdb1757640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efdac0c6310 0x7efdac0c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:11.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.582+0000 7efdb1757640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdac0c8370 0x7efdac157d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:11.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.582+0000 7efdb1757640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdac0c56d0 con 0x7efdac0c6310 2023-12-19T19:00:11.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.582+0000 7efdb1757640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdac0c8800 con 0x7efdac06b270 2023-12-19T19:00:11.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.582+0000 7efdb1757640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdac0c9d30 con 0x7efdac0c8370 2023-12-19T19:00:11.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.582+0000 7efda27fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efdac0c6310 0x7efdac0c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:11.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.582+0000 7efda27fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efdac0c6310 0x7efdac0c7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54880/0 (socket says 172.21.15.133:54880) 2023-12-19T19:00:11.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.582+0000 7efda27fc640 1 -- 172.21.15.133:0/104870206 learned_addr learned my addr 172.21.15.133:0/104870206 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:11.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.582+0000 7efdaaffd640 1 --2- 172.21.15.133:0/104870206 >> v2:172.21.15.138:3300/0 conn(0x7efdac06b270 0x7efdac155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:11.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.582+0000 7efda27fc640 1 -- 172.21.15.133:0/104870206 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdac0c8370 msgr2=0x7efdac157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:11.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.582+0000 7efdab7fe640 1 --2- 172.21.15.133:0/104870206 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdac0c8370 0x7efdac157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:11.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.582+0000 7efda27fc640 1 --2- 172.21.15.133:0/104870206 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdac0c8370 0x7efdac157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.582+0000 7efda27fc640 1 -- 172.21.15.133:0/104870206 >> v2:172.21.15.138:3300/0 conn(0x7efdac06b270 msgr2=0x7efdac155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:11.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.582+0000 7efda27fc640 1 --2- 172.21.15.133:0/104870206 >> v2:172.21.15.138:3300/0 conn(0x7efdac06b270 0x7efdac155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.582+0000 7efda27fc640 1 -- 172.21.15.133:0/104870206 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac0c4da0 con 0x7efdac0c6310 2023-12-19T19:00:11.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.582+0000 7efdaaffd640 1 --2- 172.21.15.133:0/104870206 >> v2:172.21.15.138:3300/0 conn(0x7efdac06b270 0x7efdac155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:00:11.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.582+0000 7efdab7fe640 1 --2- 172.21.15.133:0/104870206 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdac0c8370 0x7efdac157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:00:11.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.586+0000 7efda27fc640 1 --2- 172.21.15.133:0/104870206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdac0c6310 0x7efdac0c7e30 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7efdac0a99b0 tx=0x7efd9401c1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c0b95bf290640e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:11.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.586+0000 7efdaa7fc640 1 -- 172.21.15.133:0/104870206 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd940ab600 con 0x7efdac0c6310 2023-12-19T19:00:11.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.586+0000 7efdaa7fc640 1 -- 172.21.15.133:0/104870206 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd940a7050 con 0x7efdac0c6310 2023-12-19T19:00:11.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.586+0000 7efdaa7fc640 1 -- 172.21.15.133:0/104870206 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd940ab980 con 0x7efdac0c6310 2023-12-19T19:00:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.586+0000 7efdb1757640 1 -- 172.21.15.133:0/104870206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdac0c6310 msgr2=0x7efdac0c7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.586+0000 7efdb1757640 1 --2- 172.21.15.133:0/104870206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdac0c6310 0x7efdac0c7e30 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7efdac0a99b0 tx=0x7efd9401c1b0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.586+0000 7efdb1757640 1 -- 172.21.15.133:0/104870206 shutdown_connections 2023-12-19T19:00:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.586+0000 7efdb1757640 1 --2- 172.21.15.133:0/104870206 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdac0c8370 0x7efdac157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.586+0000 7efdb1757640 1 --2- 172.21.15.133:0/104870206 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdac0c6310 0x7efdac0c7e30 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.586+0000 7efdb1757640 1 --2- 172.21.15.133:0/104870206 >> v2:172.21.15.138:3300/0 conn(0x7efdac06b270 0x7efdac155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.586+0000 7efdb1757640 1 -- 172.21.15.133:0/104870206 >> 172.21.15.133:0/104870206 conn(0x7efdac0ca100 msgr2=0x7efdac0ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.586+0000 7efdb1757640 1 -- 172.21.15.133:0/104870206 shutdown_connections 2023-12-19T19:00:11.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.586+0000 7efdb1757640 1 -- 172.21.15.133:0/104870206 wait complete. 2023-12-19T19:00:11.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efdb1757640 1 Processor -- start 2023-12-19T19:00:11.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efdb1757640 1 -- start start 2023-12-19T19:00:11.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efdb1757640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdac06b270 0x7efdac148a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:11.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efdb1757640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdac0c6310 0x7efdac156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:11.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efdb1757640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdac0c8370 0x7efdac156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:11.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efdb1757640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac1f0870 con 0x7efdac0c6310 2023-12-19T19:00:11.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efdb1757640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac1f0b50 con 0x7efdac0c8370 2023-12-19T19:00:11.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efdb1757640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdac1f0e30 con 0x7efdac06b270 2023-12-19T19:00:11.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efda27fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdac0c6310 0x7efdac156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:11.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efda27fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdac0c6310 0x7efdac156980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54882/0 (socket says 172.21.15.133:54882) 2023-12-19T19:00:11.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efda27fc640 1 -- 172.21.15.133:0/4279594766 learned_addr learned my addr 172.21.15.133:0/4279594766 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:11.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efdaaffd640 1 --2- 172.21.15.133:0/4279594766 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdac06b270 0x7efdac148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:11.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efdab7fe640 1 --2- 172.21.15.133:0/4279594766 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdac0c8370 0x7efdac156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:11.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efda27fc640 1 -- 172.21.15.133:0/4279594766 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdac06b270 msgr2=0x7efdac148a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:11.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efda27fc640 1 --2- 172.21.15.133:0/4279594766 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdac06b270 0x7efdac148a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efda27fc640 1 -- 172.21.15.133:0/4279594766 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdac0c8370 msgr2=0x7efdac156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:11.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efda27fc640 1 --2- 172.21.15.133:0/4279594766 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdac0c8370 0x7efdac156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efda27fc640 1 -- 172.21.15.133:0/4279594766 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd940094d0 con 0x7efdac0c6310 2023-12-19T19:00:11.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efdaaffd640 1 --2- 172.21.15.133:0/4279594766 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdac06b270 0x7efdac148a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:11.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efdab7fe640 1 --2- 172.21.15.133:0/4279594766 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdac0c8370 0x7efdac156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:11.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efda27fc640 1 --2- 172.21.15.133:0/4279594766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdac0c6310 0x7efdac156980 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7efd9401a860 tx=0x7efd94018f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:11.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efda3fff640 1 -- 172.21.15.133:0/4279594766 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd940b37d0 con 0x7efdac0c6310 2023-12-19T19:00:11.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efda3fff640 1 -- 172.21.15.133:0/4279594766 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd940b3930 con 0x7efdac0c6310 2023-12-19T19:00:11.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efda3fff640 1 -- 172.21.15.133:0/4279594766 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd940b3ce0 con 0x7efdac0c6310 2023-12-19T19:00:11.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efdb1757640 1 -- 172.21.15.133:0/4279594766 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdac1f1110 con 0x7efdac0c6310 2023-12-19T19:00:11.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.590+0000 7efdb1757640 1 -- 172.21.15.133:0/4279594766 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdac1f04d0 con 0x7efdac0c6310 2023-12-19T19:00:11.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.594+0000 7efdb1757640 1 -- 172.21.15.133:0/4279594766 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdac04e850 con 0x7efdac0c6310 2023-12-19T19:00:11.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.594+0000 7efda3fff640 1 -- 172.21.15.133:0/4279594766 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7efd940b2070 con 0x7efdac0c6310 2023-12-19T19:00:11.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.594+0000 7efda3fff640 1 --2- 172.21.15.133:0/4279594766 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7efd8c066470 0x7efd8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:11.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.594+0000 7efda3fff640 1 -- 172.21.15.133:0/4279594766 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7efd9411e2d0 con 0x7efdac0c6310 2023-12-19T19:00:11.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.594+0000 7efdaaffd640 1 --2- 172.21.15.133:0/4279594766 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7efd8c066470 0x7efd8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:11.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.594+0000 7efdaaffd640 1 --2- 172.21.15.133:0/4279594766 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7efd8c066470 0x7efd8c068930 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7efd9c006fd0 tx=0x7efd9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:11.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.598+0000 7efda3fff640 1 -- 172.21.15.133:0/4279594766 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7efd940eb6e0 con 0x7efdac0c6310 2023-12-19T19:00:11.751 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.750+0000 7efdb1757640 1 -- 172.21.15.133:0/4279594766 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efdac067a00 con 0x7efdac0c6310 2023-12-19T19:00:11.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.750+0000 7efda3fff640 1 -- 172.21.15.133:0/4279594766 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16682 (secure 0 0 0) 0x7efd940eed00 con 0x7efdac0c6310 2023-12-19T19:00:11.753 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:11.753 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":38,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:00:08.629610+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T18:59:42.757628+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2023-12-19T18:59:44.017454+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6835/862459875":"2023-12-20T19:00:05.490309+0000","172.21.15.133:6832/862459875":"2023-12-20T19:00:05.490309+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:00:11.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.750+0000 7efdb1757640 1 -- 172.21.15.133:0/4279594766 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7efd8c066470 msgr2=0x7efd8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:11.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.750+0000 7efdb1757640 1 --2- 172.21.15.133:0/4279594766 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7efd8c066470 0x7efd8c068930 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7efd9c006fd0 tx=0x7efd9c008040 comp rx=0 tx=0).stop 2023-12-19T19:00:11.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.750+0000 7efdb1757640 1 -- 172.21.15.133:0/4279594766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdac0c6310 msgr2=0x7efdac156980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:11.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.750+0000 7efdb1757640 1 --2- 172.21.15.133:0/4279594766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdac0c6310 0x7efdac156980 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7efd9401a860 tx=0x7efd94018f50 comp rx=0 tx=0).stop 2023-12-19T19:00:11.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.750+0000 7efdb1757640 1 -- 172.21.15.133:0/4279594766 shutdown_connections 2023-12-19T19:00:11.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.750+0000 7efdb1757640 1 --2- 172.21.15.133:0/4279594766 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7efd8c066470 0x7efd8c068930 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.750+0000 7efdb1757640 1 --2- 172.21.15.133:0/4279594766 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efdac0c8370 0x7efdac156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.750+0000 7efdb1757640 1 --2- 172.21.15.133:0/4279594766 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efdac0c6310 0x7efdac156980 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.750+0000 7efdb1757640 1 --2- 172.21.15.133:0/4279594766 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efdac06b270 0x7efdac148a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.750+0000 7efdb1757640 1 -- 172.21.15.133:0/4279594766 >> 172.21.15.133:0/4279594766 conn(0x7efdac0ca100 msgr2=0x7efdac151910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:11.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.754+0000 7efdb1757640 1 -- 172.21.15.133:0/4279594766 shutdown_connections 2023-12-19T19:00:11.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.754+0000 7efdb1757640 1 -- 172.21.15.133:0/4279594766 wait complete. 2023-12-19T19:00:11.775 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-12-19T19:00:11.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.910+0000 7fdca650f640 1 Processor -- start 2023-12-19T19:00:11.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.910+0000 7fdca650f640 1 -- start start 2023-12-19T19:00:11.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.914+0000 7fdca650f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fdca01560e0 0x7fdca015ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:11.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.914+0000 7fdca650f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdca00bffc0 0x7fdca00c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:11.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.914+0000 7fdca650f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca015c600 con 0x7fdca006d520 2023-12-19T19:00:11.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.914+0000 7fdca650f640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca015a5c0 con 0x7fdca00bffc0 2023-12-19T19:00:11.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.914+0000 7fdca650f640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca01594e0 con 0x7fdca01560e0 2023-12-19T19:00:11.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.914+0000 7fdca4aac640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdca00bffc0 0x7fdca00c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:11.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.914+0000 7fdc9f7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdca006d520 0x7fdca0159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:45810/0 (socket says 172.21.15.133:45810) 2023-12-19T19:00:11.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.914+0000 7fdc9f7fe640 1 -- 172.21.15.133:0/221586167 learned_addr learned my addr 172.21.15.133:0/221586167 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:11.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.914+0000 7fdc9ffff640 1 --2- 172.21.15.133:0/221586167 >> v2:172.21.15.138:3300/0 conn(0x7fdca01560e0 0x7fdca015ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:11.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.914+0000 7fdca4aac640 1 -- 172.21.15.133:0/221586167 >> v2:172.21.15.138:3300/0 conn(0x7fdca01560e0 msgr2=0x7fdca015ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:11.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.914+0000 7fdca4aac640 1 --2- 172.21.15.133:0/221586167 >> v2:172.21.15.138:3300/0 conn(0x7fdca01560e0 0x7fdca015ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.914+0000 7fdca4aac640 1 -- 172.21.15.133:0/221586167 >> v1:172.21.15.133:6789/0 conn(0x7fdca006d520 legacy=0x7fdca0159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:11.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.914+0000 7fdca4aac640 1 -- 172.21.15.133:0/221586167 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca01597c0 con 0x7fdca00bffc0 2023-12-19T19:00:11.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.914+0000 7fdc9effd640 1 -- 172.21.15.133:0/221586167 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424692674 0 0) 0x7fdca015c600 con 0x7fdca006d520 2023-12-19T19:00:11.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.918+0000 7fdca4aac640 1 --2- 172.21.15.133:0/221586167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca00bffc0 0x7fdca00c1bf0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdca006b390 tx=0x7fdc9801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55448d82ba6f156 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:11.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.918+0000 7fdc9effd640 1 -- 172.21.15.133:0/221586167 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc980a58b0 con 0x7fdca00bffc0 2023-12-19T19:00:11.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.918+0000 7fdc9effd640 1 -- 172.21.15.133:0/221586167 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc980a5a10 con 0x7fdca00bffc0 2023-12-19T19:00:11.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.918+0000 7fdc9effd640 1 -- 172.21.15.133:0/221586167 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc980a5da0 con 0x7fdca00bffc0 2023-12-19T19:00:11.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.918+0000 7fdca650f640 1 -- 172.21.15.133:0/221586167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca00bffc0 msgr2=0x7fdca00c1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:11.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.918+0000 7fdca650f640 1 --2- 172.21.15.133:0/221586167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca00bffc0 0x7fdca00c1bf0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fdca006b390 tx=0x7fdc9801c8e0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.918+0000 7fdca650f640 1 -- 172.21.15.133:0/221586167 shutdown_connections 2023-12-19T19:00:11.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.918+0000 7fdca650f640 1 --2- 172.21.15.133:0/221586167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca00bffc0 0x7fdca00c1bf0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.918+0000 7fdca650f640 1 --2- 172.21.15.133:0/221586167 >> v2:172.21.15.138:3300/0 conn(0x7fdca01560e0 0x7fdca015ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.918+0000 7fdca650f640 1 -- 172.21.15.133:0/221586167 >> 172.21.15.133:0/221586167 conn(0x7fdca006a5b0 msgr2=0x7fdca006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:11.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.918+0000 7fdca650f640 1 -- 172.21.15.133:0/221586167 shutdown_connections 2023-12-19T19:00:11.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.918+0000 7fdca650f640 1 -- 172.21.15.133:0/221586167 wait complete. 2023-12-19T19:00:11.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.918+0000 7fdca650f640 1 Processor -- start 2023-12-19T19:00:11.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.918+0000 7fdca650f640 1 -- start start 2023-12-19T19:00:11.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdca650f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdca006d520 0x7fdca00a2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:11.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdca650f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca00bffc0 0x7fdca0157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:11.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdca650f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdca01560e0 0x7fdca0158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:11.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdca650f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca01f5bc0 con 0x7fdca00bffc0 2023-12-19T19:00:11.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdca650f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca00c3f10 con 0x7fdca006d520 2023-12-19T19:00:11.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdca650f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca0157880 con 0x7fdca01560e0 2023-12-19T19:00:11.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdc9f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca00bffc0 0x7fdca0157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:11.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdc9f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca00bffc0 0x7fdca0157d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54902/0 (socket says 172.21.15.133:54902) 2023-12-19T19:00:11.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdc9f7fe640 1 -- 172.21.15.133:0/3288920450 learned_addr learned my addr 172.21.15.133:0/3288920450 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:11.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdc9ffff640 1 --2- 172.21.15.133:0/3288920450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdca006d520 0x7fdca00a2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:11.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdca4aac640 1 --2- 172.21.15.133:0/3288920450 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdca01560e0 0x7fdca0158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:11.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdc9f7fe640 1 -- 172.21.15.133:0/3288920450 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdca01560e0 msgr2=0x7fdca0158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:11.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdc9f7fe640 1 --2- 172.21.15.133:0/3288920450 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdca01560e0 0x7fdca0158250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdc9f7fe640 1 -- 172.21.15.133:0/3288920450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdca006d520 msgr2=0x7fdca00a2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:11.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdc9f7fe640 1 --2- 172.21.15.133:0/3288920450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdca006d520 0x7fdca00a2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:11.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdc9f7fe640 1 -- 172.21.15.133:0/3288920450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc98009a70 con 0x7fdca00bffc0 2023-12-19T19:00:11.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdc9ffff640 1 --2- 172.21.15.133:0/3288920450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdca006d520 0x7fdca00a2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:11.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdc9f7fe640 1 --2- 172.21.15.133:0/3288920450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca00bffc0 0x7fdca0157d10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400c4e0 tx=0x7fdc9400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:11.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdc9cff9640 1 -- 172.21.15.133:0/3288920450 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc940074e0 con 0x7fdca00bffc0 2023-12-19T19:00:11.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdc9cff9640 1 -- 172.21.15.133:0/3288920450 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc94007660 con 0x7fdca00bffc0 2023-12-19T19:00:11.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdca650f640 1 -- 172.21.15.133:0/3288920450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca0153930 con 0x7fdca00bffc0 2023-12-19T19:00:11.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdc9cff9640 1 -- 172.21.15.133:0/3288920450 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94004a30 con 0x7fdca00bffc0 2023-12-19T19:00:11.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdca650f640 1 -- 172.21.15.133:0/3288920450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca00c5cb0 con 0x7fdca00bffc0 2023-12-19T19:00:11.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdca650f640 1 -- 172.21.15.133:0/3288920450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca0157a30 con 0x7fdca00bffc0 2023-12-19T19:00:11.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.922+0000 7fdc9cff9640 1 -- 172.21.15.133:0/3288920450 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fdc94004b90 con 0x7fdca00bffc0 2023-12-19T19:00:11.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.926+0000 7fdc9cff9640 1 --2- 172.21.15.133:0/3288920450 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdc8c066470 0x7fdc8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:11.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.926+0000 7fdc9cff9640 1 -- 172.21.15.133:0/3288920450 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fdc940832b0 con 0x7fdca00bffc0 2023-12-19T19:00:11.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.926+0000 7fdc9ffff640 1 --2- 172.21.15.133:0/3288920450 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdc8c066470 0x7fdc8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:11.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.926+0000 7fdc9ffff640 1 --2- 172.21.15.133:0/3288920450 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdc8c066470 0x7fdc8c068930 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000b9f0 tx=0x7fdc90008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:11.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:11.930+0000 7fdc9cff9640 1 -- 172.21.15.133:0/3288920450 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fdca0157a30 con 0x7fdca00bffc0 2023-12-19T19:00:12.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.110+0000 7fdca650f640 1 -- 172.21.15.133:0/3288920450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7fdca0157a30 con 0x7fdca00bffc0 2023-12-19T19:00:12.113 INFO:tasks.ceph.mon.a.smithi133.stderr:2023-12-19T19:00:12.110+0000 7f5189f85640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T19:00:12.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.114+0000 7fdc9cff9640 1 -- 172.21.15.133:0/3288920450 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 163+0+0 (secure 0 0 0) 0x7fdca0157a30 con 0x7fdca00bffc0 2023-12-19T19:00:12.116 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T19:00:12.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.114+0000 7fdca650f640 1 -- 172.21.15.133:0/3288920450 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdc8c066470 msgr2=0x7fdc8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:12.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.114+0000 7fdca650f640 1 --2- 172.21.15.133:0/3288920450 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdc8c066470 0x7fdc8c068930 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdc9000b9f0 tx=0x7fdc90008040 comp rx=0 tx=0).stop 2023-12-19T19:00:12.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.114+0000 7fdca650f640 1 -- 172.21.15.133:0/3288920450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca00bffc0 msgr2=0x7fdca0157d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:12.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.114+0000 7fdca650f640 1 --2- 172.21.15.133:0/3288920450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca00bffc0 0x7fdca0157d10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400c4e0 tx=0x7fdc9400c9a0 comp rx=0 tx=0).stop 2023-12-19T19:00:12.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.114+0000 7fdca650f640 1 -- 172.21.15.133:0/3288920450 shutdown_connections 2023-12-19T19:00:12.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.114+0000 7fdca650f640 1 --2- 172.21.15.133:0/3288920450 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdc8c066470 0x7fdc8c068930 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:12.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.114+0000 7fdca650f640 1 --2- 172.21.15.133:0/3288920450 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdca01560e0 0x7fdca0158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:12.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.114+0000 7fdca650f640 1 --2- 172.21.15.133:0/3288920450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdca00bffc0 0x7fdca0157d10 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:12.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.114+0000 7fdca650f640 1 --2- 172.21.15.133:0/3288920450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdca006d520 0x7fdca00a2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:12.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.114+0000 7fdca650f640 1 -- 172.21.15.133:0/3288920450 >> 172.21.15.133:0/3288920450 conn(0x7fdca006a5b0 msgr2=0x7fdca00a82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:12.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.114+0000 7fdca650f640 1 -- 172.21.15.133:0/3288920450 shutdown_connections 2023-12-19T19:00:12.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.118+0000 7fdca650f640 1 -- 172.21.15.133:0/3288920450 wait complete. 2023-12-19T19:00:12.125 INFO:tasks.ceph.mds.a.smithi133.stderr: -2034> 2023-12-19T18:59:47.747+0000 7f9adad86640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T19:00:12.140 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-12-19T19:00:12.171 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2023-12-19T19:00:12.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.278+0000 7f6824e46640 1 Processor -- start 2023-12-19T19:00:12.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.282+0000 7f6824e46640 1 -- start start 2023-12-19T19:00:12.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.282+0000 7f6824e46640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f68200c63c0 0x7f68200c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:12.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.282+0000 7f6824e46640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68200c4100 0x7f68200c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:12.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.282+0000 7f6824e46640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68200c31c0 con 0x7f68200c29e0 2023-12-19T19:00:12.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.282+0000 7f6824e46640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68200c34a0 con 0x7f68200c63c0 2023-12-19T19:00:12.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.282+0000 7f6824e46640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68200c1030 con 0x7f68200c4100 2023-12-19T19:00:12.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.282+0000 7f681e59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f68200c63c0 0x7f68200c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:12.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.282+0000 7f681e59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f68200c63c0 0x7f68200c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54924/0 (socket says 172.21.15.133:54924) 2023-12-19T19:00:12.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.282+0000 7f681e59c640 1 -- 172.21.15.133:0/2251027704 learned_addr learned my addr 172.21.15.133:0/2251027704 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:12.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.282+0000 7f6815d9b640 1 --2- 172.21.15.133:0/2251027704 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68200c4100 0x7f68200c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:12.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.282+0000 7f681e59c640 1 -- 172.21.15.133:0/2251027704 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68200c4100 msgr2=0x7f68200c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:12.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.282+0000 7f681e59c640 1 --2- 172.21.15.133:0/2251027704 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68200c4100 0x7f68200c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:12.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.282+0000 7f681e59c640 1 -- 172.21.15.133:0/2251027704 >> v1:172.21.15.138:6789/0 conn(0x7f68200c29e0 legacy=0x7f68200a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:12.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.282+0000 7f681e59c640 1 -- 172.21.15.133:0/2251027704 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68200c1310 con 0x7f68200c63c0 2023-12-19T19:00:12.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.286+0000 7f681e59c640 1 --2- 172.21.15.133:0/2251027704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68200c63c0 0x7f68200c06d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6810009870 tx=0x7f681001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e483b33372ee54a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:12.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.286+0000 7f681dd9b640 1 -- 172.21.15.133:0/2251027704 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68100ad640 con 0x7f68200c63c0 2023-12-19T19:00:12.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.286+0000 7f681dd9b640 1 -- 172.21.15.133:0/2251027704 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68100ad7a0 con 0x7f68200c63c0 2023-12-19T19:00:12.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.286+0000 7f681dd9b640 1 -- 172.21.15.133:0/2251027704 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68100adb30 con 0x7f68200c63c0 2023-12-19T19:00:12.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.286+0000 7f6824e46640 1 -- 172.21.15.133:0/2251027704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68200c63c0 msgr2=0x7f68200c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:12.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.286+0000 7f6824e46640 1 --2- 172.21.15.133:0/2251027704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68200c63c0 0x7f68200c06d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6810009870 tx=0x7f681001c3b0 comp rx=0 tx=0).stop 2023-12-19T19:00:12.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.286+0000 7f6824e46640 1 -- 172.21.15.133:0/2251027704 shutdown_connections 2023-12-19T19:00:12.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.286+0000 7f6824e46640 1 --2- 172.21.15.133:0/2251027704 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68200c4100 0x7f68200c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:12.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.286+0000 7f6824e46640 1 --2- 172.21.15.133:0/2251027704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68200c63c0 0x7f68200c06d0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:12.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.286+0000 7f6824e46640 1 -- 172.21.15.133:0/2251027704 >> 172.21.15.133:0/2251027704 conn(0x7f682006a5b0 msgr2=0x7f682006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:12.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.286+0000 7f6824e46640 1 -- 172.21.15.133:0/2251027704 shutdown_connections 2023-12-19T19:00:12.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.286+0000 7f6824e46640 1 -- 172.21.15.133:0/2251027704 wait complete. 2023-12-19T19:00:12.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.286+0000 7f6824e46640 1 Processor -- start 2023-12-19T19:00:12.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.286+0000 7f6824e46640 1 -- start start 2023-12-19T19:00:12.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f6824e46640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68200c29e0 0x7f6820150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:12.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f6824e46640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68200c4100 0x7f68200c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:12.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f6824e46640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68200c63c0 0x7f6820156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:12.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f6824e46640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68200bcea0 con 0x7f68200c4100 2023-12-19T19:00:12.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f6824e46640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6820156330 con 0x7f68200c63c0 2023-12-19T19:00:12.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f6824e46640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68200bc920 con 0x7f68200c29e0 2023-12-19T19:00:12.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f681e59c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68200c29e0 0x7f6820150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:12.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f6815d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68200c4100 0x7f68200c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:12.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f681e59c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68200c29e0 0x7f6820150d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:33508/0 (socket says 172.21.15.133:33508) 2023-12-19T19:00:12.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f681e59c640 1 -- 172.21.15.133:0/444163234 learned_addr learned my addr 172.21.15.133:0/444163234 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:12.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f681ed9d640 1 --2- 172.21.15.133:0/444163234 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68200c63c0 0x7f6820156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:12.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f6815d9b640 1 -- 172.21.15.133:0/444163234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68200c29e0 msgr2=0x7f6820150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:12.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f6815d9b640 1 --2- 172.21.15.133:0/444163234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68200c29e0 0x7f6820150d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:12.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f6815d9b640 1 -- 172.21.15.133:0/444163234 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68200c63c0 msgr2=0x7f6820156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:12.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f6815d9b640 1 --2- 172.21.15.133:0/444163234 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68200c63c0 0x7f6820156750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:12.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f6815d9b640 1 -- 172.21.15.133:0/444163234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68100094d0 con 0x7f68200c4100 2023-12-19T19:00:12.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f681e59c640 1 --2- 172.21.15.133:0/444163234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68200c29e0 0x7f6820150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:00:12.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f6815d9b640 1 --2- 172.21.15.133:0/444163234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68200c4100 0x7f68200c5390 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f680800d5f0 tx=0x7f680800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:12.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f68177fe640 1 -- 172.21.15.133:0/444163234 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68080125f0 con 0x7f68200c4100 2023-12-19T19:00:12.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f68177fe640 1 -- 172.21.15.133:0/444163234 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6808012750 con 0x7f68200c4100 2023-12-19T19:00:12.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f68177fe640 1 -- 172.21.15.133:0/444163234 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808012ae0 con 0x7f68200c4100 2023-12-19T19:00:12.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f6824e46640 1 -- 172.21.15.133:0/444163234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68200713a0 con 0x7f68200c4100 2023-12-19T19:00:12.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f6824e46640 1 -- 172.21.15.133:0/444163234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6820155f50 con 0x7f68200c4100 2023-12-19T19:00:12.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.290+0000 7f6824e46640 1 -- 172.21.15.133:0/444163234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6820155db0 con 0x7f68200c4100 2023-12-19T19:00:12.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.294+0000 7f68177fe640 1 -- 172.21.15.133:0/444163234 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6808012c40 con 0x7f68200c4100 2023-12-19T19:00:12.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.294+0000 7f68177fe640 1 --2- 172.21.15.133:0/444163234 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6800066470 0x7f6800068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:12.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.294+0000 7f68177fe640 1 -- 172.21.15.133:0/444163234 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f6808084330 con 0x7f68200c4100 2023-12-19T19:00:12.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.294+0000 7f681e59c640 1 --2- 172.21.15.133:0/444163234 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6800066470 0x7f6800068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:12.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.294+0000 7f681e59c640 1 --2- 172.21.15.133:0/444163234 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6800066470 0x7f6800068930 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6810009870 tx=0x7f6810009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:12.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.298+0000 7f68177fe640 1 -- 172.21.15.133:0/444163234 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6820155db0 con 0x7f68200c4100 2023-12-19T19:00:12.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:12.478+0000 7f6824e46640 1 -- 172.21.15.133:0/444163234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6820155db0 con 0x7f68200c4100 2023-12-19T19:00:13.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.114+0000 7f68177fe640 1 -- 172.21.15.133:0/444163234 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 105+0+0 (secure 0 0 0) 0x7f6820155db0 con 0x7f68200c4100 2023-12-19T19:00:13.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.118+0000 7f6824e46640 1 -- 172.21.15.133:0/444163234 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6800066470 msgr2=0x7f6800068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:13.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.118+0000 7f6824e46640 1 --2- 172.21.15.133:0/444163234 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6800066470 0x7f6800068930 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6810009870 tx=0x7f6810009040 comp rx=0 tx=0).stop 2023-12-19T19:00:13.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.118+0000 7f6824e46640 1 -- 172.21.15.133:0/444163234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68200c4100 msgr2=0x7f68200c5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:13.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.118+0000 7f6824e46640 1 --2- 172.21.15.133:0/444163234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68200c4100 0x7f68200c5390 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f680800d5f0 tx=0x7f680800dab0 comp rx=0 tx=0).stop 2023-12-19T19:00:13.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.118+0000 7f6824e46640 1 -- 172.21.15.133:0/444163234 shutdown_connections 2023-12-19T19:00:13.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.118+0000 7f6824e46640 1 --2- 172.21.15.133:0/444163234 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6800066470 0x7f6800068930 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:13.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.118+0000 7f6824e46640 1 --2- 172.21.15.133:0/444163234 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f68200c63c0 0x7f6820156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:13.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.118+0000 7f6824e46640 1 --2- 172.21.15.133:0/444163234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f68200c4100 0x7f68200c5390 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:13.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.118+0000 7f6824e46640 1 --2- 172.21.15.133:0/444163234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f68200c29e0 0x7f6820150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:13.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.118+0000 7f6824e46640 1 -- 172.21.15.133:0/444163234 >> 172.21.15.133:0/444163234 conn(0x7f682006a5b0 msgr2=0x7f68201553a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:13.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.118+0000 7f6824e46640 1 -- 172.21.15.133:0/444163234 shutdown_connections 2023-12-19T19:00:13.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.118+0000 7f6824e46640 1 -- 172.21.15.133:0/444163234 wait complete. 2023-12-19T19:00:13.145 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-12-19T19:00:13.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.330+0000 7ff3d6032640 1 Processor -- start 2023-12-19T19:00:13.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.330+0000 7ff3d6032640 1 -- start start 2023-12-19T19:00:13.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.330+0000 7ff3d6032640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff3d006a5b0 0x7ff3d006a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:13.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.330+0000 7ff3d6032640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff3d00bfb80 0x7ff3d0154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:13.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.330+0000 7ff3d6032640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3d00c07e0 con 0x7ff3d00bf670 2023-12-19T19:00:13.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.330+0000 7ff3d6032640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d00c1170 con 0x7ff3d00bfb80 2023-12-19T19:00:13.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.330+0000 7ff3d6032640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3d01545d0 con 0x7ff3d006a5b0 2023-12-19T19:00:13.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.330+0000 7ff3ceffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff3d00bfb80 0x7ff3d0154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.330+0000 7ff3ceffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff3d00bfb80 0x7ff3d0154ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54940/0 (socket says 172.21.15.133:54940) 2023-12-19T19:00:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.330+0000 7ff3ceffd640 1 -- 172.21.15.133:0/1758713551 learned_addr learned my addr 172.21.15.133:0/1758713551 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.330+0000 7ff3cf7fe640 1 --2- 172.21.15.133:0/1758713551 >> v2:172.21.15.138:3300/0 conn(0x7ff3d006a5b0 0x7ff3d006a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.330+0000 7ff3ceffd640 1 -- 172.21.15.133:0/1758713551 >> v2:172.21.15.138:3300/0 conn(0x7ff3d006a5b0 msgr2=0x7ff3d006a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.330+0000 7ff3ceffd640 1 --2- 172.21.15.133:0/1758713551 >> v2:172.21.15.138:3300/0 conn(0x7ff3d006a5b0 0x7ff3d006a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.330+0000 7ff3ceffd640 1 -- 172.21.15.133:0/1758713551 >> v1:172.21.15.138:6789/0 conn(0x7ff3d00bf670 legacy=0x7ff3d0155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.330+0000 7ff3ceffd640 1 -- 172.21.15.133:0/1758713551 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d00c0500 con 0x7ff3d00bfb80 2023-12-19T19:00:13.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.334+0000 7ff3ceffd640 1 --2- 172.21.15.133:0/1758713551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3d00bfb80 0x7ff3d0154ad0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff3d006e410 tx=0x7ff3c401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfdcb7d6e7e2fb24 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:13.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.334+0000 7ff3ce7fc640 1 -- 172.21.15.133:0/1758713551 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c40ac600 con 0x7ff3d00bfb80 2023-12-19T19:00:13.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.334+0000 7ff3ce7fc640 1 -- 172.21.15.133:0/1758713551 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c40a8050 con 0x7ff3d00bfb80 2023-12-19T19:00:13.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.334+0000 7ff3ce7fc640 1 -- 172.21.15.133:0/1758713551 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c40ac980 con 0x7ff3d00bfb80 2023-12-19T19:00:13.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.334+0000 7ff3d6032640 1 -- 172.21.15.133:0/1758713551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3d00bfb80 msgr2=0x7ff3d0154ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:13.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.334+0000 7ff3d6032640 1 --2- 172.21.15.133:0/1758713551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3d00bfb80 0x7ff3d0154ad0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff3d006e410 tx=0x7ff3c401c3a0 comp rx=0 tx=0).stop 2023-12-19T19:00:13.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.334+0000 7ff3d6032640 1 -- 172.21.15.133:0/1758713551 shutdown_connections 2023-12-19T19:00:13.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.334+0000 7ff3d6032640 1 --2- 172.21.15.133:0/1758713551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3d00bfb80 0x7ff3d0154ad0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:13.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.334+0000 7ff3d6032640 1 --2- 172.21.15.133:0/1758713551 >> v2:172.21.15.138:3300/0 conn(0x7ff3d006a5b0 0x7ff3d006a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:13.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.334+0000 7ff3d6032640 1 -- 172.21.15.133:0/1758713551 >> 172.21.15.133:0/1758713551 conn(0x7ff3d00a8ad0 msgr2=0x7ff3d00c6240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:13.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.334+0000 7ff3d6032640 1 -- 172.21.15.133:0/1758713551 shutdown_connections 2023-12-19T19:00:13.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.334+0000 7ff3d6032640 1 -- 172.21.15.133:0/1758713551 wait complete. 2023-12-19T19:00:13.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3d6032640 1 Processor -- start 2023-12-19T19:00:13.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3d6032640 1 -- start start 2023-12-19T19:00:13.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3d6032640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3d006a5b0 0x7ff3d01f0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:13.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3d6032640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3d00bf670 0x7ff3d01471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:13.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3d6032640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3d00bfb80 0x7ff3d00c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:13.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3d6032640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d00c42d0 con 0x7ff3d00bf670 2023-12-19T19:00:13.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3d6032640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d01f1060 con 0x7ff3d006a5b0 2023-12-19T19:00:13.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3d6032640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3d00c5170 con 0x7ff3d00bfb80 2023-12-19T19:00:13.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3ceffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3d00bf670 0x7ff3d01471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:13.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3ceffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3d00bf670 0x7ff3d01471a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54942/0 (socket says 172.21.15.133:54942) 2023-12-19T19:00:13.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3ceffd640 1 -- 172.21.15.133:0/3235989125 learned_addr learned my addr 172.21.15.133:0/3235989125 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:13.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3cf7fe640 1 --2- 172.21.15.133:0/3235989125 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3d006a5b0 0x7ff3d01f0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:13.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3cffff640 1 --2- 172.21.15.133:0/3235989125 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3d00bfb80 0x7ff3d00c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:13.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3ceffd640 1 -- 172.21.15.133:0/3235989125 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3d00bfb80 msgr2=0x7ff3d00c4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:13.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3ceffd640 1 --2- 172.21.15.133:0/3235989125 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3d00bfb80 0x7ff3d00c4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:13.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3ceffd640 1 -- 172.21.15.133:0/3235989125 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3d006a5b0 msgr2=0x7ff3d01f0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:13.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3ceffd640 1 --2- 172.21.15.133:0/3235989125 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3d006a5b0 0x7ff3d01f0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:13.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3ceffd640 1 -- 172.21.15.133:0/3235989125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c40094d0 con 0x7ff3d00bf670 2023-12-19T19:00:13.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3ceffd640 1 --2- 172.21.15.133:0/3235989125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3d00bf670 0x7ff3d01471a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4019fd0 tx=0x7ff3c401abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:13.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3b7fff640 1 -- 172.21.15.133:0/3235989125 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c40b5830 con 0x7ff3d00bf670 2023-12-19T19:00:13.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3b7fff640 1 -- 172.21.15.133:0/3235989125 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c40b59b0 con 0x7ff3d00bf670 2023-12-19T19:00:13.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3b7fff640 1 -- 172.21.15.133:0/3235989125 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c40b5d60 con 0x7ff3d00bf670 2023-12-19T19:00:13.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3d6032640 1 -- 172.21.15.133:0/3235989125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3d00c5410 con 0x7ff3d00bf670 2023-12-19T19:00:13.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.338+0000 7ff3d6032640 1 -- 172.21.15.133:0/3235989125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3d00c3f60 con 0x7ff3d00bf670 2023-12-19T19:00:13.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.342+0000 7ff3d6032640 1 -- 172.21.15.133:0/3235989125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3d00c4440 con 0x7ff3d00bf670 2023-12-19T19:00:13.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.342+0000 7ff3b7fff640 1 -- 172.21.15.133:0/3235989125 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff3c40b3070 con 0x7ff3d00bf670 2023-12-19T19:00:13.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.342+0000 7ff3b7fff640 1 --2- 172.21.15.133:0/3235989125 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff3bc066470 0x7ff3bc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:13.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.342+0000 7ff3b7fff640 1 -- 172.21.15.133:0/3235989125 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5885+0+0 (secure 0 0 0) 0x7ff3c411e2d0 con 0x7ff3d00bf670 2023-12-19T19:00:13.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.342+0000 7ff3cf7fe640 1 --2- 172.21.15.133:0/3235989125 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff3bc066470 0x7ff3bc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:13.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.342+0000 7ff3cf7fe640 1 --2- 172.21.15.133:0/3235989125 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff3bc066470 0x7ff3bc068930 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00079c0 tx=0x7ff3c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:13.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.346+0000 7ff3b7fff640 1 -- 172.21.15.133:0/3235989125 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff3c40eb860 con 0x7ff3d00bf670 2023-12-19T19:00:13.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:13.494+0000 7ff3d6032640 1 -- 172.21.15.133:0/3235989125 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff3d0068400 con 0x7ff3d00bf670 2023-12-19T19:00:14.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.118+0000 7ff3b7fff640 1 -- 172.21.15.133:0/3235989125 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v40) v1 ==== 184+0+0 (secure 0 0 0) 0x7ff3c40eee80 con 0x7ff3d00bf670 2023-12-19T19:00:14.121 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs2_metadata' removed 2023-12-19T19:00:14.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.118+0000 7ff3d6032640 1 -- 172.21.15.133:0/3235989125 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff3bc066470 msgr2=0x7ff3bc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:14.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.118+0000 7ff3d6032640 1 --2- 172.21.15.133:0/3235989125 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff3bc066470 0x7ff3bc068930 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00079c0 tx=0x7ff3c0008040 comp rx=0 tx=0).stop 2023-12-19T19:00:14.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.118+0000 7ff3d6032640 1 -- 172.21.15.133:0/3235989125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3d00bf670 msgr2=0x7ff3d01471a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:14.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.118+0000 7ff3d6032640 1 --2- 172.21.15.133:0/3235989125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3d00bf670 0x7ff3d01471a0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff3c4019fd0 tx=0x7ff3c401abe0 comp rx=0 tx=0).stop 2023-12-19T19:00:14.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.122+0000 7ff3d6032640 1 -- 172.21.15.133:0/3235989125 shutdown_connections 2023-12-19T19:00:14.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.122+0000 7ff3d6032640 1 --2- 172.21.15.133:0/3235989125 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff3bc066470 0x7ff3bc068930 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:14.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.122+0000 7ff3d6032640 1 --2- 172.21.15.133:0/3235989125 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3d00bfb80 0x7ff3d00c4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:14.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.122+0000 7ff3d6032640 1 --2- 172.21.15.133:0/3235989125 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3d00bf670 0x7ff3d01471a0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:14.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.122+0000 7ff3d6032640 1 --2- 172.21.15.133:0/3235989125 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3d006a5b0 0x7ff3d01f0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:14.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.122+0000 7ff3d6032640 1 -- 172.21.15.133:0/3235989125 >> 172.21.15.133:0/3235989125 conn(0x7ff3d00a8ad0 msgr2=0x7ff3d00c3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:14.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.122+0000 7ff3d6032640 1 -- 172.21.15.133:0/3235989125 shutdown_connections 2023-12-19T19:00:14.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.122+0000 7ff3d6032640 1 -- 172.21.15.133:0/3235989125 wait complete. 2023-12-19T19:00:14.148 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-12-19T19:00:14.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.286+0000 7f23bd31d640 1 Processor -- start 2023-12-19T19:00:14.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.290+0000 7f23bd31d640 1 -- start start 2023-12-19T19:00:14.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.290+0000 7f23bd31d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f23b80c4940 0x7f23b80c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:14.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.290+0000 7f23bd31d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23b80c4d20 0x7f23b8155210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:14.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.290+0000 7f23bd31d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b8155750 con 0x7f23b80c9850 2023-12-19T19:00:14.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.290+0000 7f23bd31d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b80c5650 con 0x7f23b80c4940 2023-12-19T19:00:14.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.290+0000 7f23bd31d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b80a9ff0 con 0x7f23b80c4d20 2023-12-19T19:00:14.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.290+0000 7f23b77fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23b80c4d20 0x7f23b8155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:14.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.290+0000 7f23b77fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23b80c4d20 0x7f23b8155210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:33516/0 (socket says 172.21.15.133:33516) 2023-12-19T19:00:14.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.290+0000 7f23b77fe640 1 -- 172.21.15.133:0/4093009481 learned_addr learned my addr 172.21.15.133:0/4093009481 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:14.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.290+0000 7f23b6ffd640 1 --2- 172.21.15.133:0/4093009481 >> v2:172.21.15.138:3300/0 conn(0x7f23b80c4940 0x7f23b80c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:14.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.290+0000 7f23b77fe640 1 -- 172.21.15.133:0/4093009481 >> v2:172.21.15.138:3300/0 conn(0x7f23b80c4940 msgr2=0x7f23b80c7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:14.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.290+0000 7f23b77fe640 1 --2- 172.21.15.133:0/4093009481 >> v2:172.21.15.138:3300/0 conn(0x7f23b80c4940 0x7f23b80c7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:14.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.290+0000 7f23b77fe640 1 -- 172.21.15.133:0/4093009481 >> v1:172.21.15.138:6789/0 conn(0x7f23b80c9850 legacy=0x7f23b80a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:14.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.290+0000 7f23b77fe640 1 -- 172.21.15.133:0/4093009481 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b80c8b20 con 0x7f23b80c4d20 2023-12-19T19:00:14.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.294+0000 7f23b77fe640 1 --2- 172.21.15.133:0/4093009481 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23b80c4d20 0x7f23b8155210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009870 tx=0x7f23b001c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cce844aa1675d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:14.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.294+0000 7f23b67fc640 1 -- 172.21.15.133:0/4093009481 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b00ab600 con 0x7f23b80c4d20 2023-12-19T19:00:14.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.294+0000 7f23b67fc640 1 -- 172.21.15.133:0/4093009481 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b00a7050 con 0x7f23b80c4d20 2023-12-19T19:00:14.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.294+0000 7f23b67fc640 1 -- 172.21.15.133:0/4093009481 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b00ab980 con 0x7f23b80c4d20 2023-12-19T19:00:14.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.294+0000 7f23bd31d640 1 -- 172.21.15.133:0/4093009481 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23b80c4d20 msgr2=0x7f23b8155210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:14.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.294+0000 7f23bd31d640 1 --2- 172.21.15.133:0/4093009481 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23b80c4d20 0x7f23b8155210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f23b0009870 tx=0x7f23b001c540 comp rx=0 tx=0).stop 2023-12-19T19:00:14.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.294+0000 7f23bd31d640 1 -- 172.21.15.133:0/4093009481 shutdown_connections 2023-12-19T19:00:14.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.294+0000 7f23bd31d640 1 --2- 172.21.15.133:0/4093009481 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23b80c4d20 0x7f23b8155210 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:14.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.294+0000 7f23bd31d640 1 --2- 172.21.15.133:0/4093009481 >> v2:172.21.15.138:3300/0 conn(0x7f23b80c4940 0x7f23b80c7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:14.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.294+0000 7f23bd31d640 1 -- 172.21.15.133:0/4093009481 >> 172.21.15.133:0/4093009481 conn(0x7f23b80abb70 msgr2=0x7f23b80abf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:14.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.294+0000 7f23bd31d640 1 -- 172.21.15.133:0/4093009481 shutdown_connections 2023-12-19T19:00:14.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.294+0000 7f23bd31d640 1 -- 172.21.15.133:0/4093009481 wait complete. 2023-12-19T19:00:14.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.294+0000 7f23bd31d640 1 Processor -- start 2023-12-19T19:00:14.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23bd31d640 1 -- start start 2023-12-19T19:00:14.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23bd31d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23b80c4940 0x7f23b814b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:14.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23bd31d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23b80c4d20 0x7f23b81514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:14.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23bd31d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23b80c9850 0x7f23b81494f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:14.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23bd31d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b81577e0 con 0x7f23b80c4940 2023-12-19T19:00:14.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23bd31d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b81f1760 con 0x7f23b80c9850 2023-12-19T19:00:14.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23bd31d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b8157a80 con 0x7f23b80c4d20 2023-12-19T19:00:14.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23b6ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23b80c4940 0x7f23b814b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:14.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23b6ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23b80c4940 0x7f23b814b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:54948/0 (socket says 172.21.15.133:54948) 2023-12-19T19:00:14.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23b6ffd640 1 -- 172.21.15.133:0/2324173256 learned_addr learned my addr 172.21.15.133:0/2324173256 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:14.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23b77fe640 1 --2- 172.21.15.133:0/2324173256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23b80c9850 0x7f23b81494f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:14.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23ae7fc640 1 --2- 172.21.15.133:0/2324173256 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23b80c4d20 0x7f23b81514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:14.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23b6ffd640 1 -- 172.21.15.133:0/2324173256 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23b80c4d20 msgr2=0x7f23b81514b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:14.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23b6ffd640 1 --2- 172.21.15.133:0/2324173256 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23b80c4d20 0x7f23b81514b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:14.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23b6ffd640 1 -- 172.21.15.133:0/2324173256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23b80c9850 msgr2=0x7f23b81494f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:14.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23b6ffd640 1 --2- 172.21.15.133:0/2324173256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23b80c9850 0x7f23b81494f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:14.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23b6ffd640 1 -- 172.21.15.133:0/2324173256 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b00094d0 con 0x7f23b80c4940 2023-12-19T19:00:14.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23ae7fc640 1 --2- 172.21.15.133:0/2324173256 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23b80c4d20 0x7f23b81514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:14.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23b6ffd640 1 --2- 172.21.15.133:0/2324173256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23b80c4940 0x7f23b814b5e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f23a800efc0 tx=0x7f23a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:14.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23affff640 1 -- 172.21.15.133:0/2324173256 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a8014480 con 0x7f23b80c4940 2023-12-19T19:00:14.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23affff640 1 -- 172.21.15.133:0/2324173256 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a800f040 con 0x7f23b80c4940 2023-12-19T19:00:14.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23affff640 1 -- 172.21.15.133:0/2324173256 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a8014800 con 0x7f23b80c4940 2023-12-19T19:00:14.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23bd31d640 1 -- 172.21.15.133:0/2324173256 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b81f1a40 con 0x7f23b80c4940 2023-12-19T19:00:14.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23bd31d640 1 -- 172.21.15.133:0/2324173256 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b81519f0 con 0x7f23b80c4940 2023-12-19T19:00:14.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.298+0000 7f23bd31d640 1 -- 172.21.15.133:0/2324173256 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b8157c40 con 0x7f23b80c4940 2023-12-19T19:00:14.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.302+0000 7f23affff640 1 -- 172.21.15.133:0/2324173256 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f23a8014960 con 0x7f23b80c4940 2023-12-19T19:00:14.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.302+0000 7f23affff640 1 --2- 172.21.15.133:0/2324173256 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f23980664a0 0x7f2398068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:14.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.302+0000 7f23affff640 1 -- 172.21.15.133:0/2324173256 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5445+0+0 (secure 0 0 0) 0x7f23a80847e0 con 0x7f23b80c4940 2023-12-19T19:00:14.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.302+0000 7f23ae7fc640 1 --2- 172.21.15.133:0/2324173256 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f23980664a0 0x7f2398068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:14.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.302+0000 7f23ae7fc640 1 --2- 172.21.15.133:0/2324173256 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f23980664a0 0x7f2398068960 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f23b80ad690 tx=0x7f23a0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:14.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.306+0000 7f23affff640 1 -- 172.21.15.133:0/2324173256 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f23a8051df0 con 0x7f23b80c4940 2023-12-19T19:00:14.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:14.466+0000 7f23bd31d640 1 -- 172.21.15.133:0/2324173256 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f23b8068400 con 0x7f23b80c4940 2023-12-19T19:00:15.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.126+0000 7f23affff640 1 -- 172.21.15.133:0/2324173256 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v41) v1 ==== 172+0+0 (secure 0 0 0) 0x7f23a8055410 con 0x7f23b80c4940 2023-12-19T19:00:15.128 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs2_data' removed 2023-12-19T19:00:15.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.130+0000 7f23bd31d640 1 -- 172.21.15.133:0/2324173256 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f23980664a0 msgr2=0x7f2398068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:15.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.130+0000 7f23bd31d640 1 --2- 172.21.15.133:0/2324173256 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f23980664a0 0x7f2398068960 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f23b80ad690 tx=0x7f23a0009040 comp rx=0 tx=0).stop 2023-12-19T19:00:15.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.130+0000 7f23bd31d640 1 -- 172.21.15.133:0/2324173256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23b80c4940 msgr2=0x7f23b814b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:15.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.130+0000 7f23bd31d640 1 --2- 172.21.15.133:0/2324173256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23b80c4940 0x7f23b814b5e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f23a800efc0 tx=0x7f23a800c490 comp rx=0 tx=0).stop 2023-12-19T19:00:15.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.130+0000 7f23bd31d640 1 -- 172.21.15.133:0/2324173256 shutdown_connections 2023-12-19T19:00:15.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.130+0000 7f23bd31d640 1 --2- 172.21.15.133:0/2324173256 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f23980664a0 0x7f2398068960 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:15.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.130+0000 7f23bd31d640 1 --2- 172.21.15.133:0/2324173256 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23b80c9850 0x7f23b81494f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:15.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.130+0000 7f23bd31d640 1 --2- 172.21.15.133:0/2324173256 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23b80c4d20 0x7f23b81514b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:15.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.130+0000 7f23bd31d640 1 --2- 172.21.15.133:0/2324173256 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23b80c4940 0x7f23b814b5e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:15.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.130+0000 7f23bd31d640 1 -- 172.21.15.133:0/2324173256 >> 172.21.15.133:0/2324173256 conn(0x7f23b80abb70 msgr2=0x7f23b80abf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:15.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.130+0000 7f23bd31d640 1 -- 172.21.15.133:0/2324173256 shutdown_connections 2023-12-19T19:00:15.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.130+0000 7f23bd31d640 1 -- 172.21.15.133:0/2324173256 wait complete. 2023-12-19T19:00:15.158 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T19:00:15.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.310+0000 7f8f459d0640 1 Processor -- start 2023-12-19T19:00:15.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.310+0000 7f8f459d0640 1 -- start start 2023-12-19T19:00:15.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.310+0000 7f8f459d0640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f400c47d0 0x7f8f400c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:15.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.310+0000 7f8f459d0640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8f400c7f70 0x7f8f40157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:15.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.310+0000 7f8f459d0640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f40154920 con 0x7f8f40158100 2023-12-19T19:00:15.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.310+0000 7f8f459d0640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f400c5370 con 0x7f8f400c7f70 2023-12-19T19:00:15.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.310+0000 7f8f459d0640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f40154c00 con 0x7f8f400c47d0 2023-12-19T19:00:15.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.310+0000 7f8f451cf640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8f40158100 0x7f8f4006ba90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50536/0 (socket says 172.21.15.133:50536) 2023-12-19T19:00:15.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.310+0000 7f8f451cf640 1 -- 172.21.15.133:0/1624689327 learned_addr learned my addr 172.21.15.133:0/1624689327 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:15.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.310+0000 7f8f3ffff640 1 --2- 172.21.15.133:0/1624689327 >> v2:172.21.15.138:3300/0 conn(0x7f8f400c7f70 0x7f8f40157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:15.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.310+0000 7f8f449ce640 1 --2- 172.21.15.133:0/1624689327 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f400c47d0 0x7f8f400c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:15.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.310+0000 7f8f3f7fe640 1 -- 172.21.15.133:0/1624689327 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277784572 0 0) 0x7f8f40154920 con 0x7f8f40158100 2023-12-19T19:00:15.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.310+0000 7f8f3f7fe640 1 -- 172.21.15.133:0/1624689327 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f30003530 con 0x7f8f40158100 2023-12-19T19:00:15.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.310+0000 7f8f449ce640 1 -- 172.21.15.133:0/1624689327 >> v2:172.21.15.138:3300/0 conn(0x7f8f400c7f70 msgr2=0x7f8f40157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:15.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.310+0000 7f8f449ce640 1 --2- 172.21.15.133:0/1624689327 >> v2:172.21.15.138:3300/0 conn(0x7f8f400c7f70 0x7f8f40157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:15.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.314+0000 7f8f449ce640 1 -- 172.21.15.133:0/1624689327 >> v1:172.21.15.133:6789/0 conn(0x7f8f40158100 legacy=0x7f8f4006ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:15.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.314+0000 7f8f3f7fe640 1 -- 172.21.15.133:0/1624689327 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2142312905 0 0) 0x7f8f30003530 con 0x7f8f40158100 2023-12-19T19:00:15.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.314+0000 7f8f449ce640 1 -- 172.21.15.133:0/1624689327 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f40154ee0 con 0x7f8f400c47d0 2023-12-19T19:00:15.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.314+0000 7f8f3ffff640 1 --2- 172.21.15.133:0/1624689327 >> v2:172.21.15.138:3300/0 conn(0x7f8f400c7f70 0x7f8f40157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:00:15.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.314+0000 7f8f449ce640 1 --2- 172.21.15.133:0/1624689327 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f400c47d0 0x7f8f400c4bb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8f340097c0 tx=0x7f8f3401c250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51740e4ceedee368 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:15.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.314+0000 7f8f3f7fe640 1 -- 172.21.15.133:0/1624689327 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38001a00 con 0x7f8f400c47d0 2023-12-19T19:00:15.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.314+0000 7f8f3f7fe640 1 -- 172.21.15.133:0/1624689327 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f340a7050 con 0x7f8f400c47d0 2023-12-19T19:00:15.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.314+0000 7f8f3f7fe640 1 -- 172.21.15.133:0/1624689327 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f340ab620 con 0x7f8f400c47d0 2023-12-19T19:00:15.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.318+0000 7f8f459d0640 1 -- 172.21.15.133:0/1624689327 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f400c47d0 msgr2=0x7f8f400c4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:15.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.318+0000 7f8f459d0640 1 --2- 172.21.15.133:0/1624689327 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f400c47d0 0x7f8f400c4bb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8f340097c0 tx=0x7f8f3401c250 comp rx=0 tx=0).stop 2023-12-19T19:00:15.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.318+0000 7f8f459d0640 1 -- 172.21.15.133:0/1624689327 shutdown_connections 2023-12-19T19:00:15.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.318+0000 7f8f459d0640 1 --2- 172.21.15.133:0/1624689327 >> v2:172.21.15.138:3300/0 conn(0x7f8f400c7f70 0x7f8f40157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:15.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.318+0000 7f8f459d0640 1 --2- 172.21.15.133:0/1624689327 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f400c47d0 0x7f8f400c4bb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:15.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.318+0000 7f8f459d0640 1 -- 172.21.15.133:0/1624689327 >> 172.21.15.133:0/1624689327 conn(0x7f8f400ab9e0 msgr2=0x7f8f400abdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:15.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.318+0000 7f8f459d0640 1 -- 172.21.15.133:0/1624689327 shutdown_connections 2023-12-19T19:00:15.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.318+0000 7f8f459d0640 1 -- 172.21.15.133:0/1624689327 wait complete. 2023-12-19T19:00:15.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.318+0000 7f8f459d0640 1 Processor -- start 2023-12-19T19:00:15.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.318+0000 7f8f459d0640 1 -- start start 2023-12-19T19:00:15.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.318+0000 7f8f459d0640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f400c47d0 0x7f8f401f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:15.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.318+0000 7f8f459d0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f400c7f70 0x7f8f4014a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:15.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.318+0000 7f8f459d0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f40158100 0x7f8f4014a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:15.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.318+0000 7f8f459d0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f400c1370 con 0x7f8f40158100 2023-12-19T19:00:15.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.318+0000 7f8f459d0640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f400c2fa0 con 0x7f8f400c7f70 2023-12-19T19:00:15.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.318+0000 7f8f459d0640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f401f1550 con 0x7f8f400c47d0 2023-12-19T19:00:15.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.318+0000 7f8f451cf640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f40158100 0x7f8f4014a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:15.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.318+0000 7f8f451cf640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f40158100 0x7f8f4014a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53350/0 (socket says 172.21.15.133:53350) 2023-12-19T19:00:15.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.318+0000 7f8f451cf640 1 -- 172.21.15.133:0/1897207432 learned_addr learned my addr 172.21.15.133:0/1897207432 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:15.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.318+0000 7f8f3ffff640 1 --2- 172.21.15.133:0/1897207432 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f400c7f70 0x7f8f4014a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:15.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.318+0000 7f8f449ce640 1 --2- 172.21.15.133:0/1897207432 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f400c47d0 0x7f8f401f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:15.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.318+0000 7f8f451cf640 1 -- 172.21.15.133:0/1897207432 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f400c47d0 msgr2=0x7f8f401f0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:15.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.318+0000 7f8f451cf640 1 --2- 172.21.15.133:0/1897207432 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f400c47d0 0x7f8f401f0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:15.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.322+0000 7f8f451cf640 1 -- 172.21.15.133:0/1897207432 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f400c7f70 msgr2=0x7f8f4014a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:15.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.322+0000 7f8f451cf640 1 --2- 172.21.15.133:0/1897207432 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f400c7f70 0x7f8f4014a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:15.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.322+0000 7f8f451cf640 1 -- 172.21.15.133:0/1897207432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c009420 con 0x7f8f40158100 2023-12-19T19:00:15.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.322+0000 7f8f451cf640 1 --2- 172.21.15.133:0/1897207432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f40158100 0x7f8f4014a7a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f8f380018a0 tx=0x7f8f3800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:15.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.322+0000 7f8f3d7fa640 1 -- 172.21.15.133:0/1897207432 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38012400 con 0x7f8f40158100 2023-12-19T19:00:15.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.322+0000 7f8f3d7fa640 1 -- 172.21.15.133:0/1897207432 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f38012560 con 0x7f8f40158100 2023-12-19T19:00:15.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.322+0000 7f8f3d7fa640 1 -- 172.21.15.133:0/1897207432 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38012910 con 0x7f8f40158100 2023-12-19T19:00:15.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.322+0000 7f8f459d0640 1 -- 172.21.15.133:0/1897207432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f34009420 con 0x7f8f40158100 2023-12-19T19:00:15.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.322+0000 7f8f459d0640 1 -- 172.21.15.133:0/1897207432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f401f1830 con 0x7f8f40158100 2023-12-19T19:00:15.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.322+0000 7f8f459d0640 1 -- 172.21.15.133:0/1897207432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f4004e850 con 0x7f8f40158100 2023-12-19T19:00:15.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.322+0000 7f8f3d7fa640 1 -- 172.21.15.133:0/1897207432 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8f38012a70 con 0x7f8f40158100 2023-12-19T19:00:15.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.322+0000 7f8f3d7fa640 1 --2- 172.21.15.133:0/1897207432 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8f24066470 0x7f8f24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:15.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.322+0000 7f8f3d7fa640 1 -- 172.21.15.133:0/1897207432 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8f380842b0 con 0x7f8f40158100 2023-12-19T19:00:15.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.322+0000 7f8f449ce640 1 --2- 172.21.15.133:0/1897207432 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8f24066470 0x7f8f24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:15.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.326+0000 7f8f449ce640 1 --2- 172.21.15.133:0/1897207432 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8f24066470 0x7f8f24068930 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8f340ad000 tx=0x7f8f34008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:15.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.326+0000 7f8f3d7fa640 1 -- 172.21.15.133:0/1897207432 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8f38051a70 con 0x7f8f40158100 2023-12-19T19:00:15.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.478+0000 7f8f459d0640 1 -- 172.21.15.133:0/1897207432 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8f400c3410 con 0x7f8f40158100 2023-12-19T19:00:15.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.482+0000 7f8f3d7fa640 1 -- 172.21.15.133:0/1897207432 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8f38055090 con 0x7f8f40158100 2023-12-19T19:00:15.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.482+0000 7f8f459d0640 1 -- 172.21.15.133:0/1897207432 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8f24066470 msgr2=0x7f8f24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:15.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.482+0000 7f8f459d0640 1 --2- 172.21.15.133:0/1897207432 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8f24066470 0x7f8f24068930 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8f340ad000 tx=0x7f8f34008040 comp rx=0 tx=0).stop 2023-12-19T19:00:15.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.482+0000 7f8f459d0640 1 -- 172.21.15.133:0/1897207432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f40158100 msgr2=0x7f8f4014a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:15.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.482+0000 7f8f459d0640 1 --2- 172.21.15.133:0/1897207432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f40158100 0x7f8f4014a7a0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f8f380018a0 tx=0x7f8f3800a430 comp rx=0 tx=0).stop 2023-12-19T19:00:15.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.482+0000 7f8f459d0640 1 -- 172.21.15.133:0/1897207432 shutdown_connections 2023-12-19T19:00:15.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.482+0000 7f8f459d0640 1 --2- 172.21.15.133:0/1897207432 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8f24066470 0x7f8f24068930 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:15.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.482+0000 7f8f459d0640 1 --2- 172.21.15.133:0/1897207432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f40158100 0x7f8f4014a7a0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:15.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.482+0000 7f8f459d0640 1 --2- 172.21.15.133:0/1897207432 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f400c7f70 0x7f8f4014a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:15.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.482+0000 7f8f459d0640 1 --2- 172.21.15.133:0/1897207432 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f400c47d0 0x7f8f401f0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:15.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.482+0000 7f8f459d0640 1 -- 172.21.15.133:0/1897207432 >> 172.21.15.133:0/1897207432 conn(0x7f8f400ab9e0 msgr2=0x7f8f4015f420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:15.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.482+0000 7f8f459d0640 1 -- 172.21.15.133:0/1897207432 shutdown_connections 2023-12-19T19:00:15.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.482+0000 7f8f459d0640 1 -- 172.21.15.133:0/1897207432 wait complete. 2023-12-19T19:00:15.506 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2023-12-19T19:00:15.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.638+0000 7fd3a8b10640 1 Processor -- start 2023-12-19T19:00:15.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.638+0000 7fd3a8b10640 1 -- start start 2023-12-19T19:00:15.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.642+0000 7fd3a8b10640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd3a40af5c0 0x7fd3a40c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:15.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.642+0000 7fd3a8b10640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd3a40c4bc0 0x7fd3a4154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:15.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.642+0000 7fd3a8b10640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a406c660 con 0x7fd3a40c4750 2023-12-19T19:00:15.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.642+0000 7fd3a8b10640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a40c5010 con 0x7fd3a40c4bc0 2023-12-19T19:00:15.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.642+0000 7fd3a8b10640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a406ba50 con 0x7fd3a40af5c0 2023-12-19T19:00:15.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.642+0000 7fd3a3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd3a40c4bc0 0x7fd3a4154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:15.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.642+0000 7fd3a37fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd3a40af5c0 0x7fd3a40c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:15.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.642+0000 7fd3a3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd3a40c4bc0 0x7fd3a4154bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53358/0 (socket says 172.21.15.133:53358) 2023-12-19T19:00:15.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.642+0000 7fd3a3fff640 1 -- 172.21.15.133:0/2742957497 learned_addr learned my addr 172.21.15.133:0/2742957497 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:15.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.642+0000 7fd3a3fff640 1 -- 172.21.15.133:0/2742957497 >> v2:172.21.15.138:3300/0 conn(0x7fd3a40af5c0 msgr2=0x7fd3a40c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:15.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.642+0000 7fd3a3fff640 1 --2- 172.21.15.133:0/2742957497 >> v2:172.21.15.138:3300/0 conn(0x7fd3a40af5c0 0x7fd3a40c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:15.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.642+0000 7fd3a3fff640 1 -- 172.21.15.133:0/2742957497 >> v1:172.21.15.138:6789/0 conn(0x7fd3a40c4750 legacy=0x7fd3a41544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:15.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.642+0000 7fd3a3fff640 1 -- 172.21.15.133:0/2742957497 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a406bd30 con 0x7fd3a40c4bc0 2023-12-19T19:00:15.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.642+0000 7fd3a37fe640 1 --2- 172.21.15.133:0/2742957497 >> v2:172.21.15.138:3300/0 conn(0x7fd3a40af5c0 0x7fd3a40c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:00:15.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.646+0000 7fd3a3fff640 1 --2- 172.21.15.133:0/2742957497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3a40c4bc0 0x7fd3a4154bd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40c6730 tx=0x7fd39c01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777652dc149d0f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:15.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.646+0000 7fd3a27fc640 1 -- 172.21.15.133:0/2742957497 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39c0a5780 con 0x7fd3a40c4bc0 2023-12-19T19:00:15.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.646+0000 7fd3a27fc640 1 -- 172.21.15.133:0/2742957497 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39c0a58e0 con 0x7fd3a40c4bc0 2023-12-19T19:00:15.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.646+0000 7fd3a27fc640 1 -- 172.21.15.133:0/2742957497 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39c0a5c70 con 0x7fd3a40c4bc0 2023-12-19T19:00:15.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.646+0000 7fd3a8b10640 1 -- 172.21.15.133:0/2742957497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3a40c4bc0 msgr2=0x7fd3a4154bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:15.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.646+0000 7fd3a8b10640 1 --2- 172.21.15.133:0/2742957497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3a40c4bc0 0x7fd3a4154bd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40c6730 tx=0x7fd39c01c9d0 comp rx=0 tx=0).stop 2023-12-19T19:00:15.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.646+0000 7fd3a8b10640 1 -- 172.21.15.133:0/2742957497 shutdown_connections 2023-12-19T19:00:15.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.646+0000 7fd3a8b10640 1 --2- 172.21.15.133:0/2742957497 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3a40c4bc0 0x7fd3a4154bd0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:15.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.646+0000 7fd3a8b10640 1 --2- 172.21.15.133:0/2742957497 >> v2:172.21.15.138:3300/0 conn(0x7fd3a40af5c0 0x7fd3a40c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:15.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.646+0000 7fd3a8b10640 1 -- 172.21.15.133:0/2742957497 >> 172.21.15.133:0/2742957497 conn(0x7fd3a40ab960 msgr2=0x7fd3a40abd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:15.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.646+0000 7fd3a8b10640 1 -- 172.21.15.133:0/2742957497 shutdown_connections 2023-12-19T19:00:15.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.646+0000 7fd3a8b10640 1 -- 172.21.15.133:0/2742957497 wait complete. 2023-12-19T19:00:15.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.646+0000 7fd3a8b10640 1 Processor -- start 2023-12-19T19:00:15.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.646+0000 7fd3a8b10640 1 -- start start 2023-12-19T19:00:15.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd3a8b10640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3a40af5c0 0x7fd3a41ed760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd3a8b10640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3a40c4750 0x7fd3a40c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd3a8b10640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3a40c4bc0 0x7fd3a4152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd3a8b10640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a40adc90 con 0x7fd3a40c4750 2023-12-19T19:00:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd3a8b10640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a41edca0 con 0x7fd3a40af5c0 2023-12-19T19:00:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd3a8b10640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a4152310 con 0x7fd3a40c4bc0 2023-12-19T19:00:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd3a2ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3a40c4750 0x7fd3a40c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd3a2ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3a40c4750 0x7fd3a40c8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53364/0 (socket says 172.21.15.133:53364) 2023-12-19T19:00:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd3a37fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3a40af5c0 0x7fd3a41ed760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd3a2ffd640 1 -- 172.21.15.133:0/3343518493 learned_addr learned my addr 172.21.15.133:0/3343518493 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:15.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd3a3fff640 1 --2- 172.21.15.133:0/3343518493 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3a40c4bc0 0x7fd3a4152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:15.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd3a2ffd640 1 -- 172.21.15.133:0/3343518493 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3a40c4bc0 msgr2=0x7fd3a4152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:15.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd3a2ffd640 1 --2- 172.21.15.133:0/3343518493 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3a40c4bc0 0x7fd3a4152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:15.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd3a2ffd640 1 -- 172.21.15.133:0/3343518493 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3a40af5c0 msgr2=0x7fd3a41ed760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:15.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd3a2ffd640 1 --2- 172.21.15.133:0/3343518493 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3a40af5c0 0x7fd3a41ed760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:15.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd3a2ffd640 1 -- 172.21.15.133:0/3343518493 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd394009420 con 0x7fd3a40c4750 2023-12-19T19:00:15.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd3a2ffd640 1 --2- 172.21.15.133:0/3343518493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3a40c4750 0x7fd3a40c8d80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd39800c3f0 tx=0x7fd39800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:15.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd38bfff640 1 -- 172.21.15.133:0/3343518493 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3980052d0 con 0x7fd3a40c4750 2023-12-19T19:00:15.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd38bfff640 1 -- 172.21.15.133:0/3343518493 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd398005430 con 0x7fd3a40c4750 2023-12-19T19:00:15.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd38bfff640 1 -- 172.21.15.133:0/3343518493 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd398003840 con 0x7fd3a40c4750 2023-12-19T19:00:15.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd3a8b10640 1 -- 172.21.15.133:0/3343518493 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd39c009b30 con 0x7fd3a40c4750 2023-12-19T19:00:15.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd3a8b10640 1 -- 172.21.15.133:0/3343518493 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a41525f0 con 0x7fd3a40c4750 2023-12-19T19:00:15.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd3a8b10640 1 -- 172.21.15.133:0/3343518493 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a4152780 con 0x7fd3a40c4750 2023-12-19T19:00:15.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.650+0000 7fd38bfff640 1 -- 172.21.15.133:0/3343518493 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd3980039a0 con 0x7fd3a40c4750 2023-12-19T19:00:15.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.654+0000 7fd38bfff640 1 --2- 172.21.15.133:0/3343518493 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd3900664a0 0x7fd390068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:15.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.654+0000 7fd38bfff640 1 -- 172.21.15.133:0/3343518493 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd398083060 con 0x7fd3a40c4750 2023-12-19T19:00:15.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.654+0000 7fd3a37fe640 1 --2- 172.21.15.133:0/3343518493 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd3900664a0 0x7fd390068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:15.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.654+0000 7fd3a37fe640 1 --2- 172.21.15.133:0/3343518493 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd3900664a0 0x7fd390068960 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd394009c50 tx=0x7fd394009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:15.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.658+0000 7fd38bfff640 1 -- 172.21.15.133:0/3343518493 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd3980b4290 con 0x7fd3a40c4750 2023-12-19T19:00:15.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:15.858+0000 7fd3a8b10640 1 -- 172.21.15.133:0/3343518493 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7fd3a404e850 con 0x7fd3a40c4750 2023-12-19T19:00:16.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.126+0000 7fd38bfff640 1 -- 172.21.15.133:0/3343518493 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v114) v1 ==== 159+0+0 (secure 0 0 0) 0x7fd398050820 con 0x7fd3a40c4750 2023-12-19T19:00:16.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.130+0000 7fd3a8b10640 1 -- 172.21.15.133:0/3343518493 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd3900664a0 msgr2=0x7fd390068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:16.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.130+0000 7fd3a8b10640 1 --2- 172.21.15.133:0/3343518493 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd3900664a0 0x7fd390068960 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd394009c50 tx=0x7fd394009190 comp rx=0 tx=0).stop 2023-12-19T19:00:16.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.130+0000 7fd3a8b10640 1 -- 172.21.15.133:0/3343518493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3a40c4750 msgr2=0x7fd3a40c8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:16.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.130+0000 7fd3a8b10640 1 --2- 172.21.15.133:0/3343518493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3a40c4750 0x7fd3a40c8d80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd39800c3f0 tx=0x7fd39800c8b0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.130+0000 7fd3a8b10640 1 -- 172.21.15.133:0/3343518493 shutdown_connections 2023-12-19T19:00:16.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.130+0000 7fd3a8b10640 1 --2- 172.21.15.133:0/3343518493 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd3900664a0 0x7fd390068960 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.130+0000 7fd3a8b10640 1 --2- 172.21.15.133:0/3343518493 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd3a40c4bc0 0x7fd3a4152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.130+0000 7fd3a8b10640 1 --2- 172.21.15.133:0/3343518493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd3a40c4750 0x7fd3a40c8d80 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.130+0000 7fd3a8b10640 1 --2- 172.21.15.133:0/3343518493 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd3a40af5c0 0x7fd3a41ed760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.130+0000 7fd3a8b10640 1 -- 172.21.15.133:0/3343518493 >> 172.21.15.133:0/3343518493 conn(0x7fd3a40ab960 msgr2=0x7fd3a40abd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:16.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.130+0000 7fd3a8b10640 1 -- 172.21.15.133:0/3343518493 shutdown_connections 2023-12-19T19:00:16.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.130+0000 7fd3a8b10640 1 -- 172.21.15.133:0/3343518493 wait complete. 2023-12-19T19:00:16.152 INFO:tasks.cephfs_test_runner:test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-12-19T19:00:16.153 INFO:tasks.cephfs_test_runner:Starting test: test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2023-12-19T19:00:16.153 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:00:16.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.286+0000 7ff378b65640 1 Processor -- start 2023-12-19T19:00:16.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff378b65640 1 -- start start 2023-12-19T19:00:16.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff378b65640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff3740c4100 0x7ff3740c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:16.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff378b65640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3740c31c0 con 0x7ff3740c63c0 2023-12-19T19:00:16.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff378b65640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3740c34a0 con 0x7ff3740c06d0 2023-12-19T19:00:16.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff378b65640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3740c1030 con 0x7ff3740c4100 2023-12-19T19:00:16.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff37259c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff3740c63c0 0x7ff3740c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50552/0 (socket says 172.21.15.133:50552) 2023-12-19T19:00:16.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff37259c640 1 -- 172.21.15.133:0/3510515401 learned_addr learned my addr 172.21.15.133:0/3510515401 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:16.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff36bfff640 1 --2- 172.21.15.133:0/3510515401 >> v2:172.21.15.138:3300/0 conn(0x7ff3740c4100 0x7ff3740c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:16.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff371d9b640 1 -- 172.21.15.133:0/3510515401 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2614518485 0 0) 0x7ff3740c31c0 con 0x7ff3740c63c0 2023-12-19T19:00:16.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff371d9b640 1 -- 172.21.15.133:0/3510515401 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff360003530 con 0x7ff3740c63c0 2023-12-19T19:00:16.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff371d9b640 1 -- 172.21.15.133:0/3510515401 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1693419001 0 0) 0x7ff360003530 con 0x7ff3740c63c0 2023-12-19T19:00:16.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff371d9b640 1 -- 172.21.15.133:0/3510515401 >> v2:172.21.15.138:3300/0 conn(0x7ff3740c4100 msgr2=0x7ff3740c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:16.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff371d9b640 1 --2- 172.21.15.133:0/3510515401 >> v2:172.21.15.138:3300/0 conn(0x7ff3740c4100 0x7ff3740c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff371d9b640 1 -- 172.21.15.133:0/3510515401 >> v1:172.21.15.138:6789/0 conn(0x7ff3740c06d0 legacy=0x7ff3740a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:16.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff371d9b640 1 -- 172.21.15.133:0/3510515401 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3740c1310 con 0x7ff3740c63c0 2023-12-19T19:00:16.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff371d9b640 1 -- 172.21.15.133:0/3510515401 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7ff3640016a0 con 0x7ff3740c63c0 2023-12-19T19:00:16.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff371d9b640 1 -- 172.21.15.133:0/3510515401 >> v1:172.21.15.133:6789/0 conn(0x7ff3740c63c0 legacy=0x7ff3740c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:16.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff371d9b640 1 --2- 172.21.15.133:0/3510515401 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3600039d0 0x7ff360003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:16.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff371d9b640 1 --2- 172.21.15.133:0/3510515401 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3600047d0 0x7ff360004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:16.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff371d9b640 1 --2- 172.21.15.133:0/3510515401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3600052b0 0x7ff36000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:16.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff371d9b640 1 -- 172.21.15.133:0/3510515401 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3740c1030 con 0x7ff3600052b0 2023-12-19T19:00:16.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff371d9b640 1 -- 172.21.15.133:0/3510515401 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36000c1b0 con 0x7ff3600039d0 2023-12-19T19:00:16.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff371d9b640 1 -- 172.21.15.133:0/3510515401 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36000c370 con 0x7ff3600047d0 2023-12-19T19:00:16.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff372d9d640 1 --2- 172.21.15.133:0/3510515401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3600052b0 0x7ff36000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:16.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff37259c640 1 --2- 172.21.15.133:0/3510515401 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3600039d0 0x7ff360003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:16.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff36bfff640 1 --2- 172.21.15.133:0/3510515401 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3600047d0 0x7ff360004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:16.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff372d9d640 1 -- 172.21.15.133:0/3510515401 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3600047d0 msgr2=0x7ff360004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:16.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff372d9d640 1 --2- 172.21.15.133:0/3510515401 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3600047d0 0x7ff360004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff372d9d640 1 -- 172.21.15.133:0/3510515401 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3600039d0 msgr2=0x7ff360003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:16.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff372d9d640 1 --2- 172.21.15.133:0/3510515401 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3600039d0 0x7ff360003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.290+0000 7ff372d9d640 1 -- 172.21.15.133:0/3510515401 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff360003530 con 0x7ff3600052b0 2023-12-19T19:00:16.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.294+0000 7ff372d9d640 1 -- 172.21.15.133:0/3510515401 reap_dead start 2023-12-19T19:00:16.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.294+0000 7ff372d9d640 1 --2- 172.21.15.133:0/3510515401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3600052b0 0x7ff36000b990 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff36c001e70 tx=0x7ff36c01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e87d60905cab5a3c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:16.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.294+0000 7ff371d9b640 1 -- 172.21.15.133:0/3510515401 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c003b80 con 0x7ff3600052b0 2023-12-19T19:00:16.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.294+0000 7ff371d9b640 1 -- 172.21.15.133:0/3510515401 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c003d20 con 0x7ff3600052b0 2023-12-19T19:00:16.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.294+0000 7ff371d9b640 1 -- 172.21.15.133:0/3510515401 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c005310 con 0x7ff3600052b0 2023-12-19T19:00:16.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.294+0000 7ff378b65640 1 -- 172.21.15.133:0/3510515401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3600052b0 msgr2=0x7ff36000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:16.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.294+0000 7ff378b65640 1 --2- 172.21.15.133:0/3510515401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3600052b0 0x7ff36000b990 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff36c001e70 tx=0x7ff36c01c760 comp rx=0 tx=0).stop 2023-12-19T19:00:16.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.294+0000 7ff378b65640 1 -- 172.21.15.133:0/3510515401 shutdown_connections 2023-12-19T19:00:16.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.294+0000 7ff378b65640 1 --2- 172.21.15.133:0/3510515401 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3600052b0 0x7ff36000b990 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.294+0000 7ff378b65640 1 -- 172.21.15.133:0/3510515401 >> 172.21.15.133:0/3510515401 conn(0x7ff37406a5b0 msgr2=0x7ff37406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:16.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.294+0000 7ff378b65640 1 -- 172.21.15.133:0/3510515401 shutdown_connections 2023-12-19T19:00:16.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.294+0000 7ff378b65640 1 -- 172.21.15.133:0/3510515401 wait complete. 2023-12-19T19:00:16.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff378b65640 1 Processor -- start 2023-12-19T19:00:16.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff378b65640 1 -- start start 2023-12-19T19:00:16.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff378b65640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3600052b0 0x7ff37414e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:16.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff378b65640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3740a4f30 0x7ff3740bed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:16.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff378b65640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3741eed60 0x7ff3741ef1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:16.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff378b65640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3740be0f0 con 0x7ff3740a4f30 2023-12-19T19:00:16.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff378b65640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3741efae0 con 0x7ff3741eed60 2023-12-19T19:00:16.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff378b65640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff374150820 con 0x7ff3600052b0 2023-12-19T19:00:16.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff36bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3740a4f30 0x7ff3740bed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:16.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff36bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3740a4f30 0x7ff3740bed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53380/0 (socket says 172.21.15.133:53380) 2023-12-19T19:00:16.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff36bfff640 1 -- 172.21.15.133:0/2907680006 learned_addr learned my addr 172.21.15.133:0/2907680006 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:16.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff37259c640 1 --2- 172.21.15.133:0/2907680006 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3600052b0 0x7ff37414e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:16.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff372d9d640 1 --2- 172.21.15.133:0/2907680006 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3741eed60 0x7ff3741ef1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:16.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff36bfff640 1 -- 172.21.15.133:0/2907680006 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3600052b0 msgr2=0x7ff37414e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:16.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff36bfff640 1 --2- 172.21.15.133:0/2907680006 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3600052b0 0x7ff37414e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff36bfff640 1 -- 172.21.15.133:0/2907680006 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3741eed60 msgr2=0x7ff3741ef1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:16.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff36bfff640 1 --2- 172.21.15.133:0/2907680006 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3741eed60 0x7ff3741ef1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff36bfff640 1 -- 172.21.15.133:0/2907680006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3740c69b0 con 0x7ff3740a4f30 2023-12-19T19:00:16.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff36bfff640 1 --2- 172.21.15.133:0/2907680006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3740a4f30 0x7ff3740bed90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0118e0 tx=0x7ff35c011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:16.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff36affd640 1 -- 172.21.15.133:0/2907680006 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c00faf0 con 0x7ff3740a4f30 2023-12-19T19:00:16.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff36affd640 1 -- 172.21.15.133:0/2907680006 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35c00fc50 con 0x7ff3740a4f30 2023-12-19T19:00:16.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff378b65640 1 -- 172.21.15.133:0/2907680006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff374150ac0 con 0x7ff3740a4f30 2023-12-19T19:00:16.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff36affd640 1 -- 172.21.15.133:0/2907680006 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c014440 con 0x7ff3740a4f30 2023-12-19T19:00:16.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.298+0000 7ff378b65640 1 -- 172.21.15.133:0/2907680006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3741ef720 con 0x7ff3740a4f30 2023-12-19T19:00:16.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.302+0000 7ff378b65640 1 -- 172.21.15.133:0/2907680006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3741efc70 con 0x7ff3740a4f30 2023-12-19T19:00:16.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.302+0000 7ff36affd640 1 -- 172.21.15.133:0/2907680006 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff35c01d400 con 0x7ff3740a4f30 2023-12-19T19:00:16.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.302+0000 7ff36affd640 1 --2- 172.21.15.133:0/2907680006 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff3540664a0 0x7ff354068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:16.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.302+0000 7ff36affd640 1 -- 172.21.15.133:0/2907680006 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff35c0842a0 con 0x7ff3740a4f30 2023-12-19T19:00:16.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.302+0000 7ff37259c640 1 --2- 172.21.15.133:0/2907680006 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff3540664a0 0x7ff354068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:16.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.302+0000 7ff37259c640 1 --2- 172.21.15.133:0/2907680006 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff3540664a0 0x7ff354068960 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff3740a5c30 tx=0x7ff364001580 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:16.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.306+0000 7ff36affd640 1 -- 172.21.15.133:0/2907680006 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff35c051b00 con 0x7ff3740a4f30 2023-12-19T19:00:16.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.454+0000 7ff378b65640 1 -- 172.21.15.133:0/2907680006 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3740a6f60 con 0x7ff3740a4f30 2023-12-19T19:00:16.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.454+0000 7ff36affd640 1 -- 172.21.15.133:0/2907680006 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+13154 (secure 0 0 0) 0x7ff35c055120 con 0x7ff3740a4f30 2023-12-19T19:00:16.459 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:16.459 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":41,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:00:15.120960+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6834/3180094953":"2023-12-20T19:00:12.113433+0000","172.21.15.133:6833/3180094953":"2023-12-20T19:00:12.113433+0000","172.21.15.133:6835/862459875":"2023-12-20T19:00:05.490309+0000","172.21.15.133:6832/862459875":"2023-12-20T19:00:05.490309+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:00:16.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.458+0000 7ff378b65640 1 -- 172.21.15.133:0/2907680006 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff3540664a0 msgr2=0x7ff354068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:16.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.458+0000 7ff378b65640 1 --2- 172.21.15.133:0/2907680006 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff3540664a0 0x7ff354068960 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff3740a5c30 tx=0x7ff364001580 comp rx=0 tx=0).stop 2023-12-19T19:00:16.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.458+0000 7ff378b65640 1 -- 172.21.15.133:0/2907680006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3740a4f30 msgr2=0x7ff3740bed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:16.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.458+0000 7ff378b65640 1 --2- 172.21.15.133:0/2907680006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3740a4f30 0x7ff3740bed90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff35c0118e0 tx=0x7ff35c011da0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.458+0000 7ff378b65640 1 -- 172.21.15.133:0/2907680006 shutdown_connections 2023-12-19T19:00:16.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.458+0000 7ff378b65640 1 --2- 172.21.15.133:0/2907680006 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff3540664a0 0x7ff354068960 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.458+0000 7ff378b65640 1 --2- 172.21.15.133:0/2907680006 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff3741eed60 0x7ff3741ef1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.458+0000 7ff378b65640 1 --2- 172.21.15.133:0/2907680006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff3740a4f30 0x7ff3740bed90 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.458+0000 7ff378b65640 1 --2- 172.21.15.133:0/2907680006 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff3600052b0 0x7ff37414e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.458+0000 7ff378b65640 1 -- 172.21.15.133:0/2907680006 >> 172.21.15.133:0/2907680006 conn(0x7ff37406a5b0 msgr2=0x7ff3740a6850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:16.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.458+0000 7ff378b65640 1 -- 172.21.15.133:0/2907680006 shutdown_connections 2023-12-19T19:00:16.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.458+0000 7ff378b65640 1 -- 172.21.15.133:0/2907680006 wait complete. 2023-12-19T19:00:16.480 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T19:00:16.481 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T19:00:16.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.618+0000 7f0b05580640 1 Processor -- start 2023-12-19T19:00:16.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.618+0000 7f0b05580640 1 -- start start 2023-12-19T19:00:16.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.622+0000 7f0b05580640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0b00151dc0 0x7f0b000c4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:16.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.622+0000 7f0b05580640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b000c7ed0 0x7f0b00154650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:16.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.622+0000 7f0b05580640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b000ac4f0 con 0x7f0b000bd660 2023-12-19T19:00:16.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.622+0000 7f0b05580640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b00158780 con 0x7f0b00151dc0 2023-12-19T19:00:16.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.622+0000 7f0b05580640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b00158a60 con 0x7f0b000c7ed0 2023-12-19T19:00:16.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.622+0000 7f0afeffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0b00151dc0 0x7f0b000c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:16.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.622+0000 7f0aff7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0b000bd660 0x7f0b00154b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50566/0 (socket says 172.21.15.133:50566) 2023-12-19T19:00:16.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.622+0000 7f0aff7fe640 1 -- 172.21.15.133:0/885466309 learned_addr learned my addr 172.21.15.133:0/885466309 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:16.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.622+0000 7f0af67fc640 1 --2- 172.21.15.133:0/885466309 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b000c7ed0 0x7f0b00154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:16.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.622+0000 7f0afeffd640 1 -- 172.21.15.133:0/885466309 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b000c7ed0 msgr2=0x7f0b00154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:16.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.622+0000 7f0afeffd640 1 --2- 172.21.15.133:0/885466309 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b000c7ed0 0x7f0b00154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.622+0000 7f0afeffd640 1 -- 172.21.15.133:0/885466309 >> v1:172.21.15.133:6789/0 conn(0x7f0b000bd660 legacy=0x7f0b00154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:16.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.622+0000 7f0afeffd640 1 -- 172.21.15.133:0/885466309 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b000ac180 con 0x7f0b00151dc0 2023-12-19T19:00:16.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.622+0000 7f0af67fc640 1 --2- 172.21.15.133:0/885466309 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b000c7ed0 0x7f0b00154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:16.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.622+0000 7f0afe7fc640 1 -- 172.21.15.133:0/885466309 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790246728 0 0) 0x7f0b000ac4f0 con 0x7f0b000bd660 2023-12-19T19:00:16.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.626+0000 7f0afeffd640 1 --2- 172.21.15.133:0/885466309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b00151dc0 0x7f0b000c4950 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0af00097c0 tx=0x7f0af001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0e1cea8ae38ae server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:16.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.626+0000 7f0afe7fc640 1 -- 172.21.15.133:0/885466309 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af00ab600 con 0x7f0b00151dc0 2023-12-19T19:00:16.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.626+0000 7f0afe7fc640 1 -- 172.21.15.133:0/885466309 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af00a7050 con 0x7f0b00151dc0 2023-12-19T19:00:16.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.626+0000 7f0afe7fc640 1 -- 172.21.15.133:0/885466309 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af00ab980 con 0x7f0b00151dc0 2023-12-19T19:00:16.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.626+0000 7f0b05580640 1 -- 172.21.15.133:0/885466309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b00151dc0 msgr2=0x7f0b000c4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:16.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.626+0000 7f0b05580640 1 --2- 172.21.15.133:0/885466309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b00151dc0 0x7f0b000c4950 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0af00097c0 tx=0x7f0af001c360 comp rx=0 tx=0).stop 2023-12-19T19:00:16.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.626+0000 7f0b05580640 1 -- 172.21.15.133:0/885466309 shutdown_connections 2023-12-19T19:00:16.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.626+0000 7f0b05580640 1 --2- 172.21.15.133:0/885466309 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b000c7ed0 0x7f0b00154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.626+0000 7f0b05580640 1 --2- 172.21.15.133:0/885466309 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b00151dc0 0x7f0b000c4950 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.626+0000 7f0b05580640 1 -- 172.21.15.133:0/885466309 >> 172.21.15.133:0/885466309 conn(0x7f0b00071eb0 msgr2=0x7f0b000722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:16.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.626+0000 7f0b05580640 1 -- 172.21.15.133:0/885466309 shutdown_connections 2023-12-19T19:00:16.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.626+0000 7f0b05580640 1 -- 172.21.15.133:0/885466309 wait complete. 2023-12-19T19:00:16.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.626+0000 7f0b05580640 1 Processor -- start 2023-12-19T19:00:16.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.626+0000 7f0b05580640 1 -- start start 2023-12-19T19:00:16.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0b05580640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b000bd660 0x7f0b001f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:16.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0b05580640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b000c7ed0 0x7f0b0015e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:16.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0b05580640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b00151dc0 0x7f0b001ece40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:16.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0b05580640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b000c09e0 con 0x7f0b000bd660 2023-12-19T19:00:16.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0b05580640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b001f08c0 con 0x7f0b000c7ed0 2023-12-19T19:00:16.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0b05580640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b001f1290 con 0x7f0b00151dc0 2023-12-19T19:00:16.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0afeffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b000bd660 0x7f0b001f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:16.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0afeffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b000bd660 0x7f0b001f0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53402/0 (socket says 172.21.15.133:53402) 2023-12-19T19:00:16.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0afeffd640 1 -- 172.21.15.133:0/415712478 learned_addr learned my addr 172.21.15.133:0/415712478 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:16.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0afeffd640 1 -- 172.21.15.133:0/415712478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b00151dc0 msgr2=0x7f0b001ece40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:16.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0afeffd640 1 --2- 172.21.15.133:0/415712478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b00151dc0 0x7f0b001ece40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0afeffd640 1 -- 172.21.15.133:0/415712478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b000c7ed0 msgr2=0x7f0b0015e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:16.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0af67fc640 1 --2- 172.21.15.133:0/415712478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b000c7ed0 0x7f0b0015e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:16.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0afeffd640 1 --2- 172.21.15.133:0/415712478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b000c7ed0 0x7f0b0015e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0afeffd640 1 -- 172.21.15.133:0/415712478 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af0009420 con 0x7f0b000bd660 2023-12-19T19:00:16.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0af67fc640 1 --2- 172.21.15.133:0/415712478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b000c7ed0 0x7f0b0015e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:00:16.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0afeffd640 1 --2- 172.21.15.133:0/415712478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b000bd660 0x7f0b001f0d50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0af0019f90 tx=0x7f0af0019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:16.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0af7fff640 1 -- 172.21.15.133:0/415712478 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af00b4610 con 0x7f0b000bd660 2023-12-19T19:00:16.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0af7fff640 1 -- 172.21.15.133:0/415712478 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af00abe90 con 0x7f0b000bd660 2023-12-19T19:00:16.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0af7fff640 1 -- 172.21.15.133:0/415712478 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af00b49d0 con 0x7f0b000bd660 2023-12-19T19:00:16.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0b05580640 1 -- 172.21.15.133:0/415712478 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b000c0420 con 0x7f0b000bd660 2023-12-19T19:00:16.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0b05580640 1 -- 172.21.15.133:0/415712478 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b001f0550 con 0x7f0b000bd660 2023-12-19T19:00:16.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0b05580640 1 -- 172.21.15.133:0/415712478 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b001f03b0 con 0x7f0b000bd660 2023-12-19T19:00:16.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.630+0000 7f0af7fff640 1 -- 172.21.15.133:0/415712478 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0af00b2040 con 0x7f0b000bd660 2023-12-19T19:00:16.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.634+0000 7f0af7fff640 1 --2- 172.21.15.133:0/415712478 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0ae0066470 0x7f0ae0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:16.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.634+0000 7f0af7fff640 1 -- 172.21.15.133:0/415712478 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f0af011dd80 con 0x7f0b000bd660 2023-12-19T19:00:16.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.634+0000 7f0af67fc640 1 --2- 172.21.15.133:0/415712478 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0ae0066470 0x7f0ae0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:16.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.634+0000 7f0af67fc640 1 --2- 172.21.15.133:0/415712478 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0ae0066470 0x7f0ae0068930 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0b001eac80 tx=0x7f0ae8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:16.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.638+0000 7f0af7fff640 1 -- 172.21.15.133:0/415712478 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0b001f03b0 con 0x7f0b000bd660 2023-12-19T19:00:16.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.786+0000 7f0b05580640 1 -- 172.21.15.133:0/415712478 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0b001f03b0 con 0x7f0b000bd660 2023-12-19T19:00:16.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.786+0000 7f0af7fff640 1 -- 172.21.15.133:0/415712478 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0b001f03b0 con 0x7f0b000bd660 2023-12-19T19:00:16.789 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T19:00:16.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.786+0000 7f0b05580640 1 -- 172.21.15.133:0/415712478 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0ae0066470 msgr2=0x7f0ae0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:16.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.786+0000 7f0b05580640 1 --2- 172.21.15.133:0/415712478 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0ae0066470 0x7f0ae0068930 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0b001eac80 tx=0x7f0ae8008040 comp rx=0 tx=0).stop 2023-12-19T19:00:16.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.786+0000 7f0b05580640 1 -- 172.21.15.133:0/415712478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b000bd660 msgr2=0x7f0b001f0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:16.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.786+0000 7f0b05580640 1 --2- 172.21.15.133:0/415712478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b000bd660 0x7f0b001f0d50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0af0019f90 tx=0x7f0af0019100 comp rx=0 tx=0).stop 2023-12-19T19:00:16.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.786+0000 7f0b05580640 1 -- 172.21.15.133:0/415712478 shutdown_connections 2023-12-19T19:00:16.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.786+0000 7f0b05580640 1 --2- 172.21.15.133:0/415712478 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0ae0066470 0x7f0ae0068930 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.786+0000 7f0b05580640 1 --2- 172.21.15.133:0/415712478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0b00151dc0 0x7f0b001ece40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.786+0000 7f0b05580640 1 --2- 172.21.15.133:0/415712478 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0b000c7ed0 0x7f0b0015e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.786+0000 7f0b05580640 1 --2- 172.21.15.133:0/415712478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0b000bd660 0x7f0b001f0d50 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.786+0000 7f0b05580640 1 -- 172.21.15.133:0/415712478 >> 172.21.15.133:0/415712478 conn(0x7f0b00071eb0 msgr2=0x7f0b0014d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:16.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.786+0000 7f0b05580640 1 -- 172.21.15.133:0/415712478 shutdown_connections 2023-12-19T19:00:16.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.786+0000 7f0b05580640 1 -- 172.21.15.133:0/415712478 wait complete. 2023-12-19T19:00:16.810 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-12-19T19:00:16.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fe17d1640 1 Processor -- start 2023-12-19T19:00:16.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fe17d1640 1 -- start start 2023-12-19T19:00:16.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fe17d1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fdc06bbb0 0x7f1fdc1600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:16.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fe17d1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fdc06c860 con 0x7f1fdc151e90 2023-12-19T19:00:16.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fe17d1640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fdc06c040 con 0x7f1fdc0c7ea0 2023-12-19T19:00:16.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fe17d1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc0c8750 con 0x7f1fdc06bbb0 2023-12-19T19:00:16.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fdaffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1fdc151e90 0x7f1fdc0c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50578/0 (socket says 172.21.15.133:50578) 2023-12-19T19:00:16.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fdaffd640 1 -- 172.21.15.133:0/3357095888 learned_addr learned my addr 172.21.15.133:0/3357095888 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:16.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fda7fc640 1 -- 172.21.15.133:0/3357095888 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 437590413 0 0) 0x7f1fdc06c860 con 0x7f1fdc151e90 2023-12-19T19:00:16.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fda7fc640 1 -- 172.21.15.133:0/3357095888 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fc8003530 con 0x7f1fdc151e90 2023-12-19T19:00:16.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fdb7fe640 1 --2- 172.21.15.133:0/3357095888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fdc06bbb0 0x7f1fdc1600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:16.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fda7fc640 1 -- 172.21.15.133:0/3357095888 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1998461954 0 0) 0x7f1fc8003530 con 0x7f1fdc151e90 2023-12-19T19:00:16.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fda7fc640 1 -- 172.21.15.133:0/3357095888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fdc06bbb0 msgr2=0x7f1fdc1600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:16.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fda7fc640 1 --2- 172.21.15.133:0/3357095888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fdc06bbb0 0x7f1fdc1600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fda7fc640 1 -- 172.21.15.133:0/3357095888 >> v1:172.21.15.138:6789/0 conn(0x7f1fdc0c7ea0 legacy=0x7f1fdc06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:16.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fda7fc640 1 -- 172.21.15.133:0/3357095888 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc154930 con 0x7f1fdc151e90 2023-12-19T19:00:16.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fda7fc640 1 -- 172.21.15.133:0/3357095888 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f1fc4001680 con 0x7f1fdc151e90 2023-12-19T19:00:16.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fdb7fe640 1 --2- 172.21.15.133:0/3357095888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fdc06bbb0 0x7f1fdc1600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:16.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fda7fc640 1 -- 172.21.15.133:0/3357095888 >> v1:172.21.15.133:6789/0 conn(0x7f1fdc151e90 legacy=0x7f1fdc0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:16.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fda7fc640 1 --2- 172.21.15.133:0/3357095888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fc80039b0 0x7f1fc8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:16.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fda7fc640 1 --2- 172.21.15.133:0/3357095888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fc80047d0 0x7f1fc8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:16.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fda7fc640 1 --2- 172.21.15.133:0/3357095888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fdc06bbb0 0x7f1fc800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:16.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fda7fc640 1 -- 172.21.15.133:0/3357095888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc0c8750 con 0x7f1fc80039b0 2023-12-19T19:00:16.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fda7fc640 1 -- 172.21.15.133:0/3357095888 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc80054d0 con 0x7f1fc80047d0 2023-12-19T19:00:16.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.946+0000 7f1fda7fc640 1 -- 172.21.15.133:0/3357095888 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc8005690 con 0x7f1fdc06bbb0 2023-12-19T19:00:16.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.950+0000 7f1fdaffd640 1 --2- 172.21.15.133:0/3357095888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fc80039b0 0x7f1fc8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:16.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.950+0000 7f1fd27fc640 1 --2- 172.21.15.133:0/3357095888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fc80047d0 0x7f1fc8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:16.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.950+0000 7f1fdb7fe640 1 --2- 172.21.15.133:0/3357095888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fdc06bbb0 0x7f1fc800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:16.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.950+0000 7f1fdaffd640 1 -- 172.21.15.133:0/3357095888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fdc06bbb0 msgr2=0x7f1fc800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:16.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.950+0000 7f1fdaffd640 1 --2- 172.21.15.133:0/3357095888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fdc06bbb0 0x7f1fc800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.950+0000 7f1fdaffd640 1 -- 172.21.15.133:0/3357095888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fc80047d0 msgr2=0x7f1fc8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:16.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.950+0000 7f1fdaffd640 1 --2- 172.21.15.133:0/3357095888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fc80047d0 0x7f1fc8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.950+0000 7f1fdaffd640 1 -- 172.21.15.133:0/3357095888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc8003530 con 0x7f1fc80039b0 2023-12-19T19:00:16.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.950+0000 7f1fdb7fe640 1 --2- 172.21.15.133:0/3357095888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fdc06bbb0 0x7f1fc800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:16.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.950+0000 7f1fdaffd640 1 --2- 172.21.15.133:0/3357095888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fc80039b0 0x7f1fc8003dd0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400c240 tx=0x7f1fc401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d89d365f12b97a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:16.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.950+0000 7f1fda7fc640 1 -- 172.21.15.133:0/3357095888 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4005ae0 con 0x7f1fc80039b0 2023-12-19T19:00:16.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.950+0000 7f1fda7fc640 1 -- 172.21.15.133:0/3357095888 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc4005c40 con 0x7f1fc80039b0 2023-12-19T19:00:16.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.950+0000 7f1fda7fc640 1 -- 172.21.15.133:0/3357095888 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fc4007070 con 0x7f1fc80039b0 2023-12-19T19:00:16.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.950+0000 7f1fe17d1640 1 -- 172.21.15.133:0/3357095888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fc80039b0 msgr2=0x7f1fc8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:16.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.950+0000 7f1fe17d1640 1 --2- 172.21.15.133:0/3357095888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fc80039b0 0x7f1fc8003dd0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f1fc400c240 tx=0x7f1fc401cc40 comp rx=0 tx=0).stop 2023-12-19T19:00:16.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.950+0000 7f1fdb7fe640 1 -- 172.21.15.133:0/3357095888 reap_dead start 2023-12-19T19:00:16.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.950+0000 7f1fe17d1640 1 -- 172.21.15.133:0/3357095888 shutdown_connections 2023-12-19T19:00:16.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.950+0000 7f1fe17d1640 1 -- 172.21.15.133:0/3357095888 >> 172.21.15.133:0/3357095888 conn(0x7f1fdc0ca170 msgr2=0x7f1fdc0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:16.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.954+0000 7f1fe17d1640 1 -- 172.21.15.133:0/3357095888 shutdown_connections 2023-12-19T19:00:16.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.954+0000 7f1fe17d1640 1 -- 172.21.15.133:0/3357095888 wait complete. 2023-12-19T19:00:16.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.954+0000 7f1fe17d1640 1 Processor -- start 2023-12-19T19:00:16.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.954+0000 7f1fe17d1640 1 -- start start 2023-12-19T19:00:16.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.954+0000 7f1fe17d1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fc80039b0 0x7f1fdc14b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:16.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.954+0000 7f1fe17d1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fdc14b7e0 0x7f1fdc149d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:16.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.954+0000 7f1fe17d1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fdc14a2a0 0x7f1fdc1f03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:16.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.954+0000 7f1fe17d1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc1552d0 con 0x7f1fdc14b7e0 2023-12-19T19:00:16.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.954+0000 7f1fe17d1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc14a720 con 0x7f1fdc14a2a0 2023-12-19T19:00:16.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.954+0000 7f1fe17d1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc14a890 con 0x7f1fc80039b0 2023-12-19T19:00:16.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.954+0000 7f1fd27fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fdc14b7e0 0x7f1fdc149d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:16.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.954+0000 7f1fd27fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fdc14b7e0 0x7f1fdc149d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53426/0 (socket says 172.21.15.133:53426) 2023-12-19T19:00:16.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.954+0000 7f1fd27fc640 1 -- 172.21.15.133:0/1675472407 learned_addr learned my addr 172.21.15.133:0/1675472407 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:16.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.954+0000 7f1fdaffd640 1 --2- 172.21.15.133:0/1675472407 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fc80039b0 0x7f1fdc14b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:16.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.954+0000 7f1fdb7fe640 1 --2- 172.21.15.133:0/1675472407 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fdc14a2a0 0x7f1fdc1f03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:16.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.954+0000 7f1fd27fc640 1 -- 172.21.15.133:0/1675472407 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fc80039b0 msgr2=0x7f1fdc14b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:16.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.954+0000 7f1fd27fc640 1 --2- 172.21.15.133:0/1675472407 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fc80039b0 0x7f1fdc14b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.954+0000 7f1fd27fc640 1 -- 172.21.15.133:0/1675472407 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fdc14a2a0 msgr2=0x7f1fdc1f03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:16.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.954+0000 7f1fd27fc640 1 --2- 172.21.15.133:0/1675472407 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fdc14a2a0 0x7f1fdc1f03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:16.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.954+0000 7f1fd27fc640 1 -- 172.21.15.133:0/1675472407 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc0acbe0 con 0x7f1fdc14b7e0 2023-12-19T19:00:16.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.954+0000 7f1fdaffd640 1 --2- 172.21.15.133:0/1675472407 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fc80039b0 0x7f1fdc14b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:16.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.954+0000 7f1fdb7fe640 1 --2- 172.21.15.133:0/1675472407 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fdc14a2a0 0x7f1fdc1f03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:16.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.954+0000 7f1fd27fc640 1 --2- 172.21.15.133:0/1675472407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fdc14b7e0 0x7f1fdc149d60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00f820 tx=0x7f1fcc00fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:16.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.958+0000 7f1fd3fff640 1 -- 172.21.15.133:0/1675472407 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0050d0 con 0x7f1fdc14b7e0 2023-12-19T19:00:16.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.958+0000 7f1fd3fff640 1 -- 172.21.15.133:0/1675472407 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc005230 con 0x7f1fdc14b7e0 2023-12-19T19:00:16.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.958+0000 7f1fd3fff640 1 -- 172.21.15.133:0/1675472407 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc00d730 con 0x7f1fdc14b7e0 2023-12-19T19:00:16.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.958+0000 7f1fe17d1640 1 -- 172.21.15.133:0/1675472407 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fdc0ace30 con 0x7f1fdc14b7e0 2023-12-19T19:00:16.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.958+0000 7f1fe17d1640 1 -- 172.21.15.133:0/1675472407 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fdc14aaa0 con 0x7f1fdc14b7e0 2023-12-19T19:00:16.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.958+0000 7f1fe17d1640 1 -- 172.21.15.133:0/1675472407 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fdc068400 con 0x7f1fdc14b7e0 2023-12-19T19:00:16.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.958+0000 7f1fd3fff640 1 -- 172.21.15.133:0/1675472407 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1fcc00d890 con 0x7f1fdc14b7e0 2023-12-19T19:00:16.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.958+0000 7f1fd3fff640 1 --2- 172.21.15.133:0/1675472407 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fbc0664a0 0x7f1fbc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:16.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.958+0000 7f1fd3fff640 1 -- 172.21.15.133:0/1675472407 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f1fcc083b20 con 0x7f1fdc14b7e0 2023-12-19T19:00:16.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.958+0000 7f1fdaffd640 1 --2- 172.21.15.133:0/1675472407 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fbc0664a0 0x7f1fbc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:16.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.962+0000 7f1fdaffd640 1 --2- 172.21.15.133:0/1675472407 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fbc0664a0 0x7f1fbc068960 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40ab000 tx=0x7f1fc40a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:16.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:16.962+0000 7f1fd3fff640 1 -- 172.21.15.133:0/1675472407 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1fcc051230 con 0x7f1fdc14b7e0 2023-12-19T19:00:17.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:17.162+0000 7f1fe17d1640 1 -- 172.21.15.133:0/1675472407 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7f1fdc0c40a0 con 0x7f1fdc14b7e0 2023-12-19T19:00:18.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.134+0000 7f1fd3fff640 1 -- 172.21.15.133:0/1675472407 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v116) v1 ==== 187+0+0 (secure 0 0 0) 0x7f1fcc054850 con 0x7f1fdc14b7e0 2023-12-19T19:00:18.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.138+0000 7f1fe17d1640 1 -- 172.21.15.133:0/1675472407 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fbc0664a0 msgr2=0x7f1fbc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:18.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.138+0000 7f1fe17d1640 1 --2- 172.21.15.133:0/1675472407 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fbc0664a0 0x7f1fbc068960 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1fc40ab000 tx=0x7f1fc40a7070 comp rx=0 tx=0).stop 2023-12-19T19:00:18.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.138+0000 7f1fe17d1640 1 -- 172.21.15.133:0/1675472407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fdc14b7e0 msgr2=0x7f1fdc149d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:18.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.138+0000 7f1fe17d1640 1 --2- 172.21.15.133:0/1675472407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fdc14b7e0 0x7f1fdc149d60 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc00f820 tx=0x7f1fcc00fce0 comp rx=0 tx=0).stop 2023-12-19T19:00:18.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.138+0000 7f1fe17d1640 1 -- 172.21.15.133:0/1675472407 shutdown_connections 2023-12-19T19:00:18.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.138+0000 7f1fe17d1640 1 --2- 172.21.15.133:0/1675472407 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fbc0664a0 0x7f1fbc068960 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:18.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.138+0000 7f1fe17d1640 1 --2- 172.21.15.133:0/1675472407 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fdc14a2a0 0x7f1fdc1f03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:18.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.138+0000 7f1fe17d1640 1 --2- 172.21.15.133:0/1675472407 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fdc14b7e0 0x7f1fdc149d60 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:18.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.138+0000 7f1fe17d1640 1 --2- 172.21.15.133:0/1675472407 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fc80039b0 0x7f1fdc14b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:18.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.138+0000 7f1fe17d1640 1 -- 172.21.15.133:0/1675472407 >> 172.21.15.133:0/1675472407 conn(0x7f1fdc0ca170 msgr2=0x7f1fdc0ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:18.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.138+0000 7f1fe17d1640 1 -- 172.21.15.133:0/1675472407 shutdown_connections 2023-12-19T19:00:18.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.138+0000 7f1fe17d1640 1 -- 172.21.15.133:0/1675472407 wait complete. 2023-12-19T19:00:18.164 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T19:00:18.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.306+0000 7f82998dd640 1 Processor -- start 2023-12-19T19:00:18.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.306+0000 7f82998dd640 1 -- start start 2023-12-19T19:00:18.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.306+0000 7f82998dd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82940c5c60 0x7f82940c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:18.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.306+0000 7f82998dd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f82941561f0 0x7f8294156680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:18.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.306+0000 7f82998dd640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82940c3bd0 con 0x7f82940a5240 2023-12-19T19:00:18.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.306+0000 7f82998dd640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82940bf1e0 con 0x7f82941561f0 2023-12-19T19:00:18.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.306+0000 7f82998dd640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82940c3e20 con 0x7f82940c5c60 2023-12-19T19:00:18.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.306+0000 7f8292ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f82940a5240 0x7f82940bfc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50580/0 (socket says 172.21.15.133:50580) 2023-12-19T19:00:18.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.306+0000 7f8292ffd640 1 -- 172.21.15.133:0/2517039465 learned_addr learned my addr 172.21.15.133:0/2517039465 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:18.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.306+0000 7f82937fe640 1 --2- 172.21.15.133:0/2517039465 >> v2:172.21.15.133:3300/0 conn(0x7f82941561f0 0x7f8294156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:18.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.306+0000 7f828a7fc640 1 --2- 172.21.15.133:0/2517039465 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82940c5c60 0x7f82940c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:18.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.306+0000 7f82927fc640 1 -- 172.21.15.133:0/2517039465 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3924167487 0 0) 0x7f82940c3bd0 con 0x7f82940a5240 2023-12-19T19:00:18.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.306+0000 7f82927fc640 1 -- 172.21.15.133:0/2517039465 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8280003530 con 0x7f82940a5240 2023-12-19T19:00:18.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.306+0000 7f82937fe640 1 -- 172.21.15.133:0/2517039465 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82940c5c60 msgr2=0x7f82940c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:18.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.306+0000 7f82937fe640 1 --2- 172.21.15.133:0/2517039465 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82940c5c60 0x7f82940c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:18.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.306+0000 7f82937fe640 1 -- 172.21.15.133:0/2517039465 >> v1:172.21.15.133:6789/0 conn(0x7f82940a5240 legacy=0x7f82940bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:18.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.306+0000 7f82937fe640 1 -- 172.21.15.133:0/2517039465 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82940c4100 con 0x7f82941561f0 2023-12-19T19:00:18.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.306+0000 7f828a7fc640 1 --2- 172.21.15.133:0/2517039465 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82940c5c60 0x7f82940c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:18.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.310+0000 7f82937fe640 1 --2- 172.21.15.133:0/2517039465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82941561f0 0x7f8294156680 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f828c009dc0 tx=0x7f828c01c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19a40536d81502da server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:18.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.310+0000 7f82927fc640 1 -- 172.21.15.133:0/2517039465 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c0a58a0 con 0x7f82941561f0 2023-12-19T19:00:18.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.310+0000 7f82927fc640 1 -- 172.21.15.133:0/2517039465 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c0a5a00 con 0x7f82941561f0 2023-12-19T19:00:18.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.310+0000 7f82927fc640 1 -- 172.21.15.133:0/2517039465 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c0a5d90 con 0x7f82941561f0 2023-12-19T19:00:18.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.310+0000 7f82998dd640 1 -- 172.21.15.133:0/2517039465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82941561f0 msgr2=0x7f8294156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:18.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.310+0000 7f82998dd640 1 --2- 172.21.15.133:0/2517039465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82941561f0 0x7f8294156680 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f828c009dc0 tx=0x7f828c01c7e0 comp rx=0 tx=0).stop 2023-12-19T19:00:18.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.310+0000 7f82998dd640 1 -- 172.21.15.133:0/2517039465 shutdown_connections 2023-12-19T19:00:18.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.310+0000 7f82998dd640 1 --2- 172.21.15.133:0/2517039465 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82941561f0 0x7f8294156680 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:18.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.310+0000 7f82998dd640 1 --2- 172.21.15.133:0/2517039465 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82940c5c60 0x7f82940c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:18.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.310+0000 7f82998dd640 1 -- 172.21.15.133:0/2517039465 >> 172.21.15.133:0/2517039465 conn(0x7f829406a5b0 msgr2=0x7f829406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:18.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.310+0000 7f82998dd640 1 -- 172.21.15.133:0/2517039465 shutdown_connections 2023-12-19T19:00:18.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.310+0000 7f82998dd640 1 -- 172.21.15.133:0/2517039465 wait complete. 2023-12-19T19:00:18.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f82998dd640 1 Processor -- start 2023-12-19T19:00:18.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f82998dd640 1 -- start start 2023-12-19T19:00:18.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f82998dd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82940a5240 0x7f8294071750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:18.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f82998dd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82940c5c60 0x7f8294071e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:18.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f82998dd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82941561f0 0x7f8294159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:18.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f82998dd640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82941f1640 con 0x7f82941561f0 2023-12-19T19:00:18.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f82998dd640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8294070990 con 0x7f82940a5240 2023-12-19T19:00:18.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f82998dd640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8294070c70 con 0x7f82940c5c60 2023-12-19T19:00:18.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f82937fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82941561f0 0x7f8294159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:18.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f82937fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82941561f0 0x7f8294159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53452/0 (socket says 172.21.15.133:53452) 2023-12-19T19:00:18.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f82937fe640 1 -- 172.21.15.133:0/1373749178 learned_addr learned my addr 172.21.15.133:0/1373749178 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:18.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f828a7fc640 1 --2- 172.21.15.133:0/1373749178 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82940c5c60 0x7f8294071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:18.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f8292ffd640 1 --2- 172.21.15.133:0/1373749178 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82940a5240 0x7f8294071750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:18.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f82937fe640 1 -- 172.21.15.133:0/1373749178 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82940c5c60 msgr2=0x7f8294071e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:18.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f82937fe640 1 --2- 172.21.15.133:0/1373749178 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82940c5c60 0x7f8294071e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:18.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f82937fe640 1 -- 172.21.15.133:0/1373749178 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82940a5240 msgr2=0x7f8294071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:18.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f82937fe640 1 --2- 172.21.15.133:0/1373749178 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82940a5240 0x7f8294071750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:18.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f82937fe640 1 -- 172.21.15.133:0/1373749178 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c009a70 con 0x7f82941561f0 2023-12-19T19:00:18.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f8292ffd640 1 --2- 172.21.15.133:0/1373749178 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82940a5240 0x7f8294071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:18.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f82937fe640 1 --2- 172.21.15.133:0/1373749178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82941561f0 0x7f8294159e30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f828c01a410 tx=0x7f828c019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:18.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f8290ff9640 1 -- 172.21.15.133:0/1373749178 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c0b9860 con 0x7f82941561f0 2023-12-19T19:00:18.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f8290ff9640 1 -- 172.21.15.133:0/1373749178 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c0b99c0 con 0x7f82941561f0 2023-12-19T19:00:18.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f82998dd640 1 -- 172.21.15.133:0/1373749178 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8294070f50 con 0x7f82941561f0 2023-12-19T19:00:18.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f8290ff9640 1 -- 172.21.15.133:0/1373749178 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c0b9d70 con 0x7f82941561f0 2023-12-19T19:00:18.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.314+0000 7f82998dd640 1 -- 172.21.15.133:0/1373749178 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82941591c0 con 0x7f82941561f0 2023-12-19T19:00:18.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.318+0000 7f82998dd640 1 -- 172.21.15.133:0/1373749178 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82940c52e0 con 0x7f82941561f0 2023-12-19T19:00:18.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.318+0000 7f8290ff9640 1 -- 172.21.15.133:0/1373749178 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f828c0ad440 con 0x7f82941561f0 2023-12-19T19:00:18.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.318+0000 7f8290ff9640 1 --2- 172.21.15.133:0/1373749178 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8274066470 0x7f8274068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:18.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.318+0000 7f8290ff9640 1 -- 172.21.15.133:0/1373749178 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f828c11eec0 con 0x7f82941561f0 2023-12-19T19:00:18.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.318+0000 7f8292ffd640 1 --2- 172.21.15.133:0/1373749178 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8274066470 0x7f8274068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:18.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.318+0000 7f8292ffd640 1 --2- 172.21.15.133:0/1373749178 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8274066470 0x7f8274068930 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f82840011f0 tx=0x7f8284009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:18.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.322+0000 7f8290ff9640 1 -- 172.21.15.133:0/1373749178 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f828c0ec5d0 con 0x7f82941561f0 2023-12-19T19:00:18.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.474+0000 7f82998dd640 1 -- 172.21.15.133:0/1373749178 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8294068400 con 0x7f82941561f0 2023-12-19T19:00:18.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.478+0000 7f8290ff9640 1 -- 172.21.15.133:0/1373749178 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f828c0efbf0 con 0x7f82941561f0 2023-12-19T19:00:18.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.482+0000 7f82998dd640 1 -- 172.21.15.133:0/1373749178 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8274066470 msgr2=0x7f8274068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:18.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.482+0000 7f82998dd640 1 --2- 172.21.15.133:0/1373749178 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8274066470 0x7f8274068930 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f82840011f0 tx=0x7f8284009040 comp rx=0 tx=0).stop 2023-12-19T19:00:18.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.482+0000 7f82998dd640 1 -- 172.21.15.133:0/1373749178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82941561f0 msgr2=0x7f8294159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:18.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.482+0000 7f82998dd640 1 --2- 172.21.15.133:0/1373749178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82941561f0 0x7f8294159e30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f828c01a410 tx=0x7f828c019580 comp rx=0 tx=0).stop 2023-12-19T19:00:18.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.482+0000 7f82998dd640 1 -- 172.21.15.133:0/1373749178 shutdown_connections 2023-12-19T19:00:18.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.482+0000 7f82998dd640 1 --2- 172.21.15.133:0/1373749178 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8274066470 0x7f8274068930 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:18.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.482+0000 7f82998dd640 1 --2- 172.21.15.133:0/1373749178 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f82941561f0 0x7f8294159e30 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:18.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.482+0000 7f82998dd640 1 --2- 172.21.15.133:0/1373749178 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f82940c5c60 0x7f8294071e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:18.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.482+0000 7f82998dd640 1 --2- 172.21.15.133:0/1373749178 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f82940a5240 0x7f8294071750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:18.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.482+0000 7f82998dd640 1 -- 172.21.15.133:0/1373749178 >> 172.21.15.133:0/1373749178 conn(0x7f829406a5b0 msgr2=0x7f829406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:18.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.482+0000 7f82998dd640 1 -- 172.21.15.133:0/1373749178 shutdown_connections 2023-12-19T19:00:18.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.482+0000 7f82998dd640 1 -- 172.21.15.133:0/1373749178 wait complete. 2023-12-19T19:00:18.504 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T19:00:18.504 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T19:00:18.554 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T19:00:18.646 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T19:00:18.646 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T19:00:18.646 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:00:18.656 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3517 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-19T19:00:18.656 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:00:18.656 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:00:18.665 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3612 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-19T19:00:18.665 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-12-19T19:00:18.666 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:00:18.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.838+0000 7f7c079c1640 1 Processor -- start 2023-12-19T19:00:18.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.838+0000 7f7c079c1640 1 -- start start 2023-12-19T19:00:18.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.838+0000 7f7c079c1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c00151e90 0x7f7c000c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:18.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.838+0000 7f7c079c1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c0006c860 con 0x7f7c000c7ea0 2023-12-19T19:00:18.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.838+0000 7f7c079c1640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c00154930 con 0x7f7c000c4e60 2023-12-19T19:00:18.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.838+0000 7f7c079c1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c000c8750 con 0x7f7c00151e90 2023-12-19T19:00:18.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.838+0000 7f7c04f5c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7c000c7ea0 0x7f7c0006b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:50594/0 (socket says 172.21.15.133:50594) 2023-12-19T19:00:18.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.838+0000 7f7c04f5c640 1 -- 172.21.15.133:0/553640502 learned_addr learned my addr 172.21.15.133:0/553640502 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:18.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.838+0000 7f7c0575d640 1 --2- 172.21.15.133:0/553640502 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c00151e90 0x7f7c000c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:18.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.838+0000 7f7bf7fff640 1 -- 172.21.15.133:0/553640502 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222071463 0 0) 0x7f7c0006c860 con 0x7f7c000c7ea0 2023-12-19T19:00:18.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.838+0000 7f7bf7fff640 1 -- 172.21.15.133:0/553640502 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bec003530 con 0x7f7c000c7ea0 2023-12-19T19:00:18.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.838+0000 7f7bf7fff640 1 -- 172.21.15.133:0/553640502 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987197248 0 0) 0x7f7c00154930 con 0x7f7c000c4e60 2023-12-19T19:00:18.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.838+0000 7f7bf7fff640 1 -- 172.21.15.133:0/553640502 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c0006c860 con 0x7f7c000c4e60 2023-12-19T19:00:18.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.838+0000 7f7bf7fff640 1 -- 172.21.15.133:0/553640502 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3006382192 0 0) 0x7f7bec003530 con 0x7f7c000c7ea0 2023-12-19T19:00:18.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.838+0000 7f7bf7fff640 1 -- 172.21.15.133:0/553640502 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c00151e90 msgr2=0x7f7c000c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:18.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.838+0000 7f7bf7fff640 1 --2- 172.21.15.133:0/553640502 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c00151e90 0x7f7c000c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:18.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.838+0000 7f7bf7fff640 1 -- 172.21.15.133:0/553640502 >> v1:172.21.15.138:6789/0 conn(0x7f7c000c4e60 legacy=0x7f7c0015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:18.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.838+0000 7f7bf7fff640 1 -- 172.21.15.133:0/553640502 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c00154c10 con 0x7f7c000c7ea0 2023-12-19T19:00:18.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.838+0000 7f7bf7fff640 1 -- 172.21.15.133:0/553640502 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f7bf0001680 con 0x7f7c000c7ea0 2023-12-19T19:00:18.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.838+0000 7f7bf7fff640 1 -- 172.21.15.133:0/553640502 >> v1:172.21.15.133:6789/0 conn(0x7f7c000c7ea0 legacy=0x7f7c0006b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:18.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.838+0000 7f7bf7fff640 1 --2- 172.21.15.133:0/553640502 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7bec003b40 0x7f7bec003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:18.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.838+0000 7f7bf7fff640 1 --2- 172.21.15.133:0/553640502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bec0047d0 0x7f7bec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:18.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.838+0000 7f7bf7fff640 1 --2- 172.21.15.133:0/553640502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bec005190 0x7f7bec00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:18.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.842+0000 7f7bf7fff640 1 -- 172.21.15.133:0/553640502 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c000c8750 con 0x7f7bec0047d0 2023-12-19T19:00:18.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.842+0000 7f7bf7fff640 1 -- 172.21.15.133:0/553640502 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec00c0c0 con 0x7f7bec005190 2023-12-19T19:00:18.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.842+0000 7f7bf7fff640 1 -- 172.21.15.133:0/553640502 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec00c280 con 0x7f7bec003b40 2023-12-19T19:00:18.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.842+0000 7f7c0575d640 1 --2- 172.21.15.133:0/553640502 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c00151e90 0x7f7c000c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:00:18.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.842+0000 7f7c04f5c640 1 --2- 172.21.15.133:0/553640502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bec0047d0 0x7f7bec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:18.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.842+0000 7f7c05f5e640 1 --2- 172.21.15.133:0/553640502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bec005190 0x7f7bec00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:18.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.842+0000 7f7c0575d640 1 --2- 172.21.15.133:0/553640502 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7bec003b40 0x7f7bec003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:18.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.842+0000 7f7c04f5c640 1 -- 172.21.15.133:0/553640502 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7bec003b40 msgr2=0x7f7bec003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:18.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.842+0000 7f7c04f5c640 1 --2- 172.21.15.133:0/553640502 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7bec003b40 0x7f7bec003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:18.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.842+0000 7f7c04f5c640 1 -- 172.21.15.133:0/553640502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bec005190 msgr2=0x7f7bec00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:18.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.842+0000 7f7c04f5c640 1 --2- 172.21.15.133:0/553640502 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bec005190 0x7f7bec00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:18.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.842+0000 7f7c04f5c640 1 -- 172.21.15.133:0/553640502 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bec003530 con 0x7f7bec0047d0 2023-12-19T19:00:18.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.842+0000 7f7c0575d640 1 --2- 172.21.15.133:0/553640502 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7bec003b40 0x7f7bec003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:18.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.842+0000 7f7c04f5c640 1 --2- 172.21.15.133:0/553640502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bec0047d0 0x7f7bec004c50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7c000c8300 tx=0x7f7bf001cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330f18177bb58dc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:18.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.842+0000 7f7bf7fff640 1 -- 172.21.15.133:0/553640502 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf00058e0 con 0x7f7bec0047d0 2023-12-19T19:00:18.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.842+0000 7f7bf7fff640 1 -- 172.21.15.133:0/553640502 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf0005a60 con 0x7f7bec0047d0 2023-12-19T19:00:18.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.842+0000 7f7bf7fff640 1 -- 172.21.15.133:0/553640502 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0005e50 con 0x7f7bec0047d0 2023-12-19T19:00:18.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c079c1640 1 -- 172.21.15.133:0/553640502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bec0047d0 msgr2=0x7f7bec004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:18.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c079c1640 1 --2- 172.21.15.133:0/553640502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7bec0047d0 0x7f7bec004c50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7c000c8300 tx=0x7f7bf001cb80 comp rx=0 tx=0).stop 2023-12-19T19:00:18.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c05f5e640 1 -- 172.21.15.133:0/553640502 reap_dead start 2023-12-19T19:00:18.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c079c1640 1 -- 172.21.15.133:0/553640502 shutdown_connections 2023-12-19T19:00:18.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c079c1640 1 -- 172.21.15.133:0/553640502 >> 172.21.15.133:0/553640502 conn(0x7f7c000ca170 msgr2=0x7f7c000ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:18.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c079c1640 1 -- 172.21.15.133:0/553640502 shutdown_connections 2023-12-19T19:00:18.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c079c1640 1 -- 172.21.15.133:0/553640502 wait complete. 2023-12-19T19:00:18.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c079c1640 1 Processor -- start 2023-12-19T19:00:18.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c079c1640 1 -- start start 2023-12-19T19:00:18.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c079c1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bec0047d0 0x7f7c001f0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:18.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c079c1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c0014e610 0x7f7c000c2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:18.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c079c1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c001f1320 0x7f7c000c25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:18.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c079c1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c001552d0 con 0x7f7c0014e610 2023-12-19T19:00:18.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c079c1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c000c2b00 con 0x7f7bec0047d0 2023-12-19T19:00:18.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c079c1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c001f1870 con 0x7f7c001f1320 2023-12-19T19:00:18.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c04f5c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c0014e610 0x7f7c000c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:18.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c04f5c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c0014e610 0x7f7c000c2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53466/0 (socket says 172.21.15.133:53466) 2023-12-19T19:00:18.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c04f5c640 1 -- 172.21.15.133:0/2921217735 learned_addr learned my addr 172.21.15.133:0/2921217735 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:18.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c0575d640 1 --2- 172.21.15.133:0/2921217735 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bec0047d0 0x7f7c001f0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:18.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c05f5e640 1 --2- 172.21.15.133:0/2921217735 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c001f1320 0x7f7c000c25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:18.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c04f5c640 1 -- 172.21.15.133:0/2921217735 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c001f1320 msgr2=0x7f7c000c25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:18.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c04f5c640 1 --2- 172.21.15.133:0/2921217735 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c001f1320 0x7f7c000c25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:18.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c04f5c640 1 -- 172.21.15.133:0/2921217735 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bec0047d0 msgr2=0x7f7c001f0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:18.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c04f5c640 1 --2- 172.21.15.133:0/2921217735 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bec0047d0 0x7f7c001f0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:18.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c04f5c640 1 -- 172.21.15.133:0/2921217735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c000c3730 con 0x7f7c0014e610 2023-12-19T19:00:18.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.846+0000 7f7c05f5e640 1 --2- 172.21.15.133:0/2921217735 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c001f1320 0x7f7c000c25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:18.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.850+0000 7f7c04f5c640 1 --2- 172.21.15.133:0/2921217735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c0014e610 0x7f7c000c2080 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0007040 tx=0x7f7bec005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:18.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.850+0000 7f7bf5ffb640 1 -- 172.21.15.133:0/2921217735 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf00047f0 con 0x7f7c0014e610 2023-12-19T19:00:18.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.850+0000 7f7bf5ffb640 1 -- 172.21.15.133:0/2921217735 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf0004970 con 0x7f7c0014e610 2023-12-19T19:00:18.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.850+0000 7f7bf5ffb640 1 -- 172.21.15.133:0/2921217735 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0004d20 con 0x7f7c0014e610 2023-12-19T19:00:18.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.850+0000 7f7c079c1640 1 -- 172.21.15.133:0/2921217735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c000c3a10 con 0x7f7c0014e610 2023-12-19T19:00:18.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.850+0000 7f7c079c1640 1 -- 172.21.15.133:0/2921217735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c000ab670 con 0x7f7c0014e610 2023-12-19T19:00:18.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.850+0000 7f7c079c1640 1 -- 172.21.15.133:0/2921217735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c00068400 con 0x7f7c0014e610 2023-12-19T19:00:18.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.850+0000 7f7bf5ffb640 1 -- 172.21.15.133:0/2921217735 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7bf0007070 con 0x7f7c0014e610 2023-12-19T19:00:18.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.850+0000 7f7bf5ffb640 1 --2- 172.21.15.133:0/2921217735 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7be4066470 0x7f7be4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:18.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.850+0000 7f7bf5ffb640 1 -- 172.21.15.133:0/2921217735 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7bf011d3d0 con 0x7f7c0014e610 2023-12-19T19:00:18.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.850+0000 7f7c0575d640 1 --2- 172.21.15.133:0/2921217735 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7be4066470 0x7f7be4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:18.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.854+0000 7f7c0575d640 1 --2- 172.21.15.133:0/2921217735 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7be4066470 0x7f7be4068930 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0093f0 tx=0x7f7bfc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:18.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:18.854+0000 7f7bf5ffb640 1 -- 172.21.15.133:0/2921217735 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7bf00eab80 con 0x7f7c0014e610 2023-12-19T19:00:19.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:19.038+0000 7f7c079c1640 1 -- 172.21.15.133:0/2921217735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c000c75f0 con 0x7f7c0014e610 2023-12-19T19:00:19.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:19.038+0000 7f7bf5ffb640 1 -- 172.21.15.133:0/2921217735 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3708 (secure 0 0 0) 0x7f7bf00ee1a0 con 0x7f7c0014e610 2023-12-19T19:00:19.041 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:19.041 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4739,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/2717901150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6835","nonce":2717901150},{"type":"v1","addr":"172.21.15.138:6837","nonce":2717901150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4986,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6836/3989181473","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":3989181473},{"type":"v1","addr":"172.21.15.138:6836","nonce":3989181473}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5186,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/1971736974","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":1971736974},{"type":"v1","addr":"172.21.15.133:6834","nonce":1971736974}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5598,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/163738173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":163738173},{"type":"v1","addr":"172.21.15.133:6835","nonce":163738173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":24}],"filesystems":[]} 2023-12-19T19:00:19.042 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 26 2023-12-19T19:00:19.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:19.042+0000 7f7c079c1640 1 -- 172.21.15.133:0/2921217735 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7be4066470 msgr2=0x7f7be4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:19.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:19.042+0000 7f7c079c1640 1 --2- 172.21.15.133:0/2921217735 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7be4066470 0x7f7be4068930 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7bfc0093f0 tx=0x7f7bfc008040 comp rx=0 tx=0).stop 2023-12-19T19:00:19.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:19.042+0000 7f7c079c1640 1 -- 172.21.15.133:0/2921217735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c0014e610 msgr2=0x7f7c000c2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:19.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:19.042+0000 7f7c079c1640 1 --2- 172.21.15.133:0/2921217735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c0014e610 0x7f7c000c2080 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f7bf0007040 tx=0x7f7bec005800 comp rx=0 tx=0).stop 2023-12-19T19:00:19.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:19.042+0000 7f7c079c1640 1 -- 172.21.15.133:0/2921217735 shutdown_connections 2023-12-19T19:00:19.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:19.042+0000 7f7c079c1640 1 --2- 172.21.15.133:0/2921217735 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7be4066470 0x7f7be4068930 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:19.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:19.042+0000 7f7c079c1640 1 --2- 172.21.15.133:0/2921217735 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c001f1320 0x7f7c000c25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:19.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:19.042+0000 7f7c079c1640 1 --2- 172.21.15.133:0/2921217735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c0014e610 0x7f7c000c2080 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:19.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:19.042+0000 7f7c079c1640 1 --2- 172.21.15.133:0/2921217735 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7bec0047d0 0x7f7c001f0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:19.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:19.042+0000 7f7c079c1640 1 -- 172.21.15.133:0/2921217735 >> 172.21.15.133:0/2921217735 conn(0x7f7c000ca170 msgr2=0x7f7c00151040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:19.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:19.042+0000 7f7c079c1640 1 -- 172.21.15.133:0/2921217735 shutdown_connections 2023-12-19T19:00:19.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:19.042+0000 7f7c079c1640 1 -- 172.21.15.133:0/2921217735 wait complete. 2023-12-19T19:00:19.063 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T19:00:19.063 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T19:00:19.063 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T19:00:19.063 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:00:19.063 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T19:00:19.064 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T19:00:19.064 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T19:00:19.064 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:00:19.064 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T19:00:19.064 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T19:00:19.065 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T19:00:19.065 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:00:19.065 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T19:00:19.065 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T19:00:19.066 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T19:00:19.066 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:00:19.076 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T19:00:19.077 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T19:00:19.078 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T19:00:19.078 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T19:00:19.083 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T19:00:19.083 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T19:00:19.125 INFO:tasks.ceph.mds.a:Started 2023-12-19T19:00:19.125 DEBUG:teuthology.parallel:result is None 2023-12-19T19:00:19.128 INFO:tasks.ceph.mds.c:Started 2023-12-19T19:00:19.128 DEBUG:teuthology.parallel:result is None 2023-12-19T19:00:19.130 INFO:tasks.ceph.mds.d:Started 2023-12-19T19:00:19.130 DEBUG:teuthology.parallel:result is None 2023-12-19T19:00:19.210 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2023-12-19T19:00:19.213 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2023-12-19T19:00:19.224 INFO:tasks.ceph.mds.d.smithi138.stdout:starting mds.d at 2023-12-19T19:00:23.649 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-12-19T19:00:25.083 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T19:00:25.084 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T19:00:25.088 INFO:tasks.ceph.mds.b:Started 2023-12-19T19:00:25.088 DEBUG:teuthology.parallel:result is None 2023-12-19T19:00:25.088 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T19:00:25.178 INFO:tasks.ceph.mds.b.smithi138.stdout:starting mds.b at 2023-12-19T19:00:25.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.238+0000 7f9c26580640 1 Processor -- start 2023-12-19T19:00:25.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.238+0000 7f9c26580640 1 -- start start 2023-12-19T19:00:25.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.238+0000 7f9c26580640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9c201555c0 0x7f9c200a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:25.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.238+0000 7f9c26580640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c200c28e0 con 0x7f9c200c61e0 2023-12-19T19:00:25.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.238+0000 7f9c26580640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c200c2b80 con 0x7f9c200c1270 2023-12-19T19:00:25.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.238+0000 7f9c26580640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c200c3680 con 0x7f9c201555c0 2023-12-19T19:00:25.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.238+0000 7f9c1f7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9c200c61e0 0x7f9c200c6730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33746/0 (socket says 172.21.15.133:33746) 2023-12-19T19:00:25.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.238+0000 7f9c1f7fe640 1 -- 172.21.15.133:0/2403705915 learned_addr learned my addr 172.21.15.133:0/2403705915 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:25.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.238+0000 7f9c1ffff640 1 --2- 172.21.15.133:0/2403705915 >> v2:172.21.15.138:3300/0 conn(0x7f9c201555c0 0x7f9c200a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:25.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.238+0000 7f9c1effd640 1 -- 172.21.15.133:0/2403705915 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 886931545 0 0) 0x7f9c200c28e0 con 0x7f9c200c61e0 2023-12-19T19:00:25.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.238+0000 7f9c1effd640 1 -- 172.21.15.133:0/2403705915 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c08003530 con 0x7f9c200c61e0 2023-12-19T19:00:25.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.238+0000 7f9c1effd640 1 -- 172.21.15.133:0/2403705915 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783959925 0 0) 0x7f9c200c2b80 con 0x7f9c200c1270 2023-12-19T19:00:25.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.238+0000 7f9c1effd640 1 -- 172.21.15.133:0/2403705915 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c200c28e0 con 0x7f9c200c1270 2023-12-19T19:00:25.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.238+0000 7f9c1ffff640 1 -- 172.21.15.133:0/2403705915 >> v1:172.21.15.138:6789/0 conn(0x7f9c200c1270 legacy=0x7f9c200c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:25.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.238+0000 7f9c1ffff640 1 -- 172.21.15.133:0/2403705915 >> v1:172.21.15.133:6789/0 conn(0x7f9c200c61e0 legacy=0x7f9c200c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:25.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.238+0000 7f9c1ffff640 1 -- 172.21.15.133:0/2403705915 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c200c32a0 con 0x7f9c201555c0 2023-12-19T19:00:25.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.242+0000 7f9c1ffff640 1 --2- 172.21.15.133:0/2403705915 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c201555c0 0x7f9c200a6df0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9c100097c0 tx=0x7f9c1001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=719a53f14f929515 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:25.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.242+0000 7f9c1effd640 1 -- 172.21.15.133:0/2403705915 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c100ab600 con 0x7f9c201555c0 2023-12-19T19:00:25.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.242+0000 7f9c1effd640 1 -- 172.21.15.133:0/2403705915 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c100a7050 con 0x7f9c201555c0 2023-12-19T19:00:25.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.242+0000 7f9c1effd640 1 -- 172.21.15.133:0/2403705915 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c100ab980 con 0x7f9c201555c0 2023-12-19T19:00:25.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.242+0000 7f9c26580640 1 -- 172.21.15.133:0/2403705915 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c201555c0 msgr2=0x7f9c200a6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:25.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.242+0000 7f9c26580640 1 --2- 172.21.15.133:0/2403705915 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c201555c0 0x7f9c200a6df0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9c100097c0 tx=0x7f9c1001c480 comp rx=0 tx=0).stop 2023-12-19T19:00:25.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.242+0000 7f9c26580640 1 -- 172.21.15.133:0/2403705915 shutdown_connections 2023-12-19T19:00:25.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.242+0000 7f9c26580640 1 --2- 172.21.15.133:0/2403705915 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c201555c0 0x7f9c200a6df0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:25.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.242+0000 7f9c26580640 1 -- 172.21.15.133:0/2403705915 >> 172.21.15.133:0/2403705915 conn(0x7f9c200c7e40 msgr2=0x7f9c200c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:25.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.242+0000 7f9c26580640 1 -- 172.21.15.133:0/2403705915 shutdown_connections 2023-12-19T19:00:25.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.242+0000 7f9c26580640 1 -- 172.21.15.133:0/2403705915 wait complete. 2023-12-19T19:00:25.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c26580640 1 Processor -- start 2023-12-19T19:00:25.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c26580640 1 -- start start 2023-12-19T19:00:25.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c26580640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c200c1270 0x7f9c201f0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:25.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c26580640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c200c61e0 0x7f9c2014cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:25.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c26580640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c201555c0 0x7f9c2014d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:25.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c26580640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2014e250 con 0x7f9c200c1270 2023-12-19T19:00:25.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c26580640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c201f0e30 con 0x7f9c200c61e0 2023-12-19T19:00:25.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c26580640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2014e460 con 0x7f9c201555c0 2023-12-19T19:00:25.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c1ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c200c1270 0x7f9c201f0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:25.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c1ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c200c1270 0x7f9c201f0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37300/0 (socket says 172.21.15.133:37300) 2023-12-19T19:00:25.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c1ffff640 1 -- 172.21.15.133:0/2215349113 learned_addr learned my addr 172.21.15.133:0/2215349113 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:25.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c1f7fe640 1 --2- 172.21.15.133:0/2215349113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c200c61e0 0x7f9c2014cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:25.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c24b1d640 1 --2- 172.21.15.133:0/2215349113 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c201555c0 0x7f9c2014d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:25.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c1ffff640 1 -- 172.21.15.133:0/2215349113 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c201555c0 msgr2=0x7f9c2014d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:25.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c1ffff640 1 --2- 172.21.15.133:0/2215349113 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c201555c0 0x7f9c2014d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:25.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c1ffff640 1 -- 172.21.15.133:0/2215349113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c200c61e0 msgr2=0x7f9c2014cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:25.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c1ffff640 1 --2- 172.21.15.133:0/2215349113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c200c61e0 0x7f9c2014cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:25.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c1ffff640 1 -- 172.21.15.133:0/2215349113 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c10009420 con 0x7f9c200c1270 2023-12-19T19:00:25.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c1f7fe640 1 --2- 172.21.15.133:0/2215349113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c200c61e0 0x7f9c2014cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:00:25.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c1ffff640 1 --2- 172.21.15.133:0/2215349113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c200c1270 0x7f9c201f0330 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9c100ae040 tx=0x7f9c1001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:25.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c1cff9640 1 -- 172.21.15.133:0/2215349113 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c100b7450 con 0x7f9c200c1270 2023-12-19T19:00:25.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c1cff9640 1 -- 172.21.15.133:0/2215349113 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c100b75d0 con 0x7f9c200c1270 2023-12-19T19:00:25.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c1cff9640 1 -- 172.21.15.133:0/2215349113 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c100b7980 con 0x7f9c200c1270 2023-12-19T19:00:25.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c26580640 1 -- 172.21.15.133:0/2215349113 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c2014e740 con 0x7f9c200c1270 2023-12-19T19:00:25.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.246+0000 7f9c26580640 1 -- 172.21.15.133:0/2215349113 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c201566d0 con 0x7f9c200c1270 2023-12-19T19:00:25.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.250+0000 7f9c26580640 1 -- 172.21.15.133:0/2215349113 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c20068400 con 0x7f9c200c1270 2023-12-19T19:00:25.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.250+0000 7f9c1cff9640 1 -- 172.21.15.133:0/2215349113 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9c100b7ae0 con 0x7f9c200c1270 2023-12-19T19:00:25.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.250+0000 7f9c1cff9640 1 --2- 172.21.15.133:0/2215349113 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9c0c066470 0x7f9c0c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:25.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.250+0000 7f9c1cff9640 1 -- 172.21.15.133:0/2215349113 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9c1011e100 con 0x7f9c200c1270 2023-12-19T19:00:25.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.250+0000 7f9c1f7fe640 1 --2- 172.21.15.133:0/2215349113 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9c0c066470 0x7f9c0c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:25.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.250+0000 7f9c1f7fe640 1 --2- 172.21.15.133:0/2215349113 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9c0c066470 0x7f9c0c068930 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9c200c2160 tx=0x7f9c14007d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:25.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.254+0000 7f9c1cff9640 1 -- 172.21.15.133:0/2215349113 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9c100eba80 con 0x7f9c200c1270 2023-12-19T19:00:25.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:25.418+0000 7f9c26580640 1 -- 172.21.15.133:0/2215349113 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9c200c51a0 con 0x7f9c200c1270 2023-12-19T19:00:26.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:26.934+0000 7f9c1cff9640 1 -- 172.21.15.133:0/2215349113 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v46) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9c100ef0a0 con 0x7f9c200c1270 2023-12-19T19:00:26.938 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blocklist entries 2023-12-19T19:00:26.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:26.938+0000 7f9c26580640 1 -- 172.21.15.133:0/2215349113 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9c0c066470 msgr2=0x7f9c0c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:26.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:26.938+0000 7f9c26580640 1 --2- 172.21.15.133:0/2215349113 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9c0c066470 0x7f9c0c068930 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f9c200c2160 tx=0x7f9c14007d80 comp rx=0 tx=0).stop 2023-12-19T19:00:26.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:26.938+0000 7f9c26580640 1 -- 172.21.15.133:0/2215349113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c200c1270 msgr2=0x7f9c201f0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:26.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:26.938+0000 7f9c26580640 1 --2- 172.21.15.133:0/2215349113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c200c1270 0x7f9c201f0330 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f9c100ae040 tx=0x7f9c1001acc0 comp rx=0 tx=0).stop 2023-12-19T19:00:26.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:26.938+0000 7f9c26580640 1 -- 172.21.15.133:0/2215349113 shutdown_connections 2023-12-19T19:00:26.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:26.938+0000 7f9c26580640 1 --2- 172.21.15.133:0/2215349113 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9c0c066470 0x7f9c0c068930 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:26.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:26.938+0000 7f9c26580640 1 --2- 172.21.15.133:0/2215349113 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c201555c0 0x7f9c2014d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:26.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:26.938+0000 7f9c26580640 1 --2- 172.21.15.133:0/2215349113 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c200c61e0 0x7f9c2014cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:26.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:26.938+0000 7f9c26580640 1 --2- 172.21.15.133:0/2215349113 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c200c1270 0x7f9c201f0330 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:26.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:26.938+0000 7f9c26580640 1 -- 172.21.15.133:0/2215349113 >> 172.21.15.133:0/2215349113 conn(0x7f9c200c7e40 msgr2=0x7f9c200c6730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:26.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:26.938+0000 7f9c26580640 1 -- 172.21.15.133:0/2215349113 shutdown_connections 2023-12-19T19:00:26.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:26.938+0000 7f9c26580640 1 -- 172.21.15.133:0/2215349113 wait complete. 2023-12-19T19:00:26.964 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T19:00:27.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.102+0000 7fcfb60ea640 1 Processor -- start 2023-12-19T19:00:27.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.102+0000 7fcfb60ea640 1 -- start start 2023-12-19T19:00:27.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.102+0000 7fcfb60ea640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcfb00c63c0 0x7fcfb00c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:27.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.102+0000 7fcfb60ea640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfb00c4100 0x7fcfb00c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:27.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.102+0000 7fcfb60ea640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb00c31c0 con 0x7fcfb00c29e0 2023-12-19T19:00:27.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.102+0000 7fcfb60ea640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb00c34a0 con 0x7fcfb00c63c0 2023-12-19T19:00:27.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.102+0000 7fcfb60ea640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb00c1030 con 0x7fcfb00c4100 2023-12-19T19:00:27.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.102+0000 7fcfaf7fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcfb00c63c0 0x7fcfb00c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:27.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.102+0000 7fcfaeffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfb00c4100 0x7fcfb00c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:27.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.106+0000 7fcfaffff640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7fcfb00c29e0 0x7fcfb00a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:46940/0 (socket says 172.21.15.133:46940) 2023-12-19T19:00:27.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.106+0000 7fcfaffff640 1 -- 172.21.15.133:0/4090716218 learned_addr learned my addr 172.21.15.133:0/4090716218 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:27.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.106+0000 7fcfaf7fe640 1 -- 172.21.15.133:0/4090716218 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfb00c4100 msgr2=0x7fcfb00c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:27.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.106+0000 7fcfaf7fe640 1 --2- 172.21.15.133:0/4090716218 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfb00c4100 0x7fcfb00c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.106+0000 7fcfaf7fe640 1 -- 172.21.15.133:0/4090716218 >> v1:172.21.15.138:6789/0 conn(0x7fcfb00c29e0 legacy=0x7fcfb00a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:27.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.106+0000 7fcfaf7fe640 1 -- 172.21.15.133:0/4090716218 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb00c1310 con 0x7fcfb00c63c0 2023-12-19T19:00:27.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.106+0000 7fcfae7fc640 1 -- 172.21.15.133:0/4090716218 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302213709 0 0) 0x7fcfb00c31c0 con 0x7fcfb00c29e0 2023-12-19T19:00:27.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.106+0000 7fcfaf7fe640 1 --2- 172.21.15.133:0/4090716218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb00c63c0 0x7fcfb00c06d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00097c0 tx=0x7fcfa001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8321fcb8cc27c8e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:27.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.106+0000 7fcfae7fc640 1 -- 172.21.15.133:0/4090716218 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0004230 con 0x7fcfb00c63c0 2023-12-19T19:00:27.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.106+0000 7fcfae7fc640 1 -- 172.21.15.133:0/4090716218 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa00a7050 con 0x7fcfb00c63c0 2023-12-19T19:00:27.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.106+0000 7fcfae7fc640 1 -- 172.21.15.133:0/4090716218 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0003620 con 0x7fcfb00c63c0 2023-12-19T19:00:27.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.110+0000 7fcfb60ea640 1 -- 172.21.15.133:0/4090716218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb00c63c0 msgr2=0x7fcfb00c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:27.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.110+0000 7fcfb60ea640 1 --2- 172.21.15.133:0/4090716218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb00c63c0 0x7fcfb00c06d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00097c0 tx=0x7fcfa001c330 comp rx=0 tx=0).stop 2023-12-19T19:00:27.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.110+0000 7fcfb60ea640 1 -- 172.21.15.133:0/4090716218 shutdown_connections 2023-12-19T19:00:27.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.110+0000 7fcfb60ea640 1 --2- 172.21.15.133:0/4090716218 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfb00c4100 0x7fcfb00c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.110+0000 7fcfb60ea640 1 --2- 172.21.15.133:0/4090716218 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb00c63c0 0x7fcfb00c06d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.110+0000 7fcfb60ea640 1 -- 172.21.15.133:0/4090716218 >> 172.21.15.133:0/4090716218 conn(0x7fcfb006a5b0 msgr2=0x7fcfb006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:27.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.110+0000 7fcfb60ea640 1 -- 172.21.15.133:0/4090716218 shutdown_connections 2023-12-19T19:00:27.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.110+0000 7fcfb60ea640 1 -- 172.21.15.133:0/4090716218 wait complete. 2023-12-19T19:00:27.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.110+0000 7fcfb60ea640 1 Processor -- start 2023-12-19T19:00:27.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.110+0000 7fcfb60ea640 1 -- start start 2023-12-19T19:00:27.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.110+0000 7fcfb60ea640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfb00c29e0 0x7fcfb00a6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:27.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.110+0000 7fcfb60ea640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb00c4100 0x7fcfb0070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:27.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.110+0000 7fcfb60ea640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfb00c63c0 0x7fcfb0070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:27.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.110+0000 7fcfb60ea640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb0070e90 con 0x7fcfb00c29e0 2023-12-19T19:00:27.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.110+0000 7fcfb60ea640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb01ed960 con 0x7fcfb00c4100 2023-12-19T19:00:27.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.110+0000 7fcfb60ea640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb00715f0 con 0x7fcfb00c63c0 2023-12-19T19:00:27.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.110+0000 7fcfaf7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfb00c29e0 0x7fcfb00a6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:27.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.110+0000 7fcfaf7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfb00c29e0 0x7fcfb00a6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37302/0 (socket says 172.21.15.133:37302) 2023-12-19T19:00:27.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.110+0000 7fcfaf7fe640 1 -- 172.21.15.133:0/4195428791 learned_addr learned my addr 172.21.15.133:0/4195428791 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:27.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.110+0000 7fcfaffff640 1 --2- 172.21.15.133:0/4195428791 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfb00c63c0 0x7fcfb0070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:27.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.110+0000 7fcfaeffd640 1 --2- 172.21.15.133:0/4195428791 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb00c4100 0x7fcfb0070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:27.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.114+0000 7fcfaf7fe640 1 -- 172.21.15.133:0/4195428791 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfb00c63c0 msgr2=0x7fcfb0070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:27.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.114+0000 7fcfaf7fe640 1 --2- 172.21.15.133:0/4195428791 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfb00c63c0 0x7fcfb0070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.114+0000 7fcfaf7fe640 1 -- 172.21.15.133:0/4195428791 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb00c4100 msgr2=0x7fcfb0070410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:27.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.114+0000 7fcfaf7fe640 1 --2- 172.21.15.133:0/4195428791 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb00c4100 0x7fcfb0070410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.114+0000 7fcfaf7fe640 1 -- 172.21.15.133:0/4195428791 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa0009420 con 0x7fcfb00c29e0 2023-12-19T19:00:27.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.114+0000 7fcfaffff640 1 --2- 172.21.15.133:0/4195428791 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfb00c63c0 0x7fcfb0070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:00:27.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.114+0000 7fcfaf7fe640 1 --2- 172.21.15.133:0/4195428791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfb00c29e0 0x7fcfb00a6690 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00ae040 tx=0x7fcfa00190d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:27.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.114+0000 7fcf97fff640 1 -- 172.21.15.133:0/4195428791 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0003af0 con 0x7fcfb00c29e0 2023-12-19T19:00:27.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.114+0000 7fcf97fff640 1 -- 172.21.15.133:0/4195428791 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa0003c50 con 0x7fcfb00c29e0 2023-12-19T19:00:27.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.114+0000 7fcfb60ea640 1 -- 172.21.15.133:0/4195428791 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb00718d0 con 0x7fcfb00c29e0 2023-12-19T19:00:27.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.114+0000 7fcf97fff640 1 -- 172.21.15.133:0/4195428791 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa00ab440 con 0x7fcfb00c29e0 2023-12-19T19:00:27.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.114+0000 7fcfb60ea640 1 -- 172.21.15.133:0/4195428791 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb006fef0 con 0x7fcfb00c29e0 2023-12-19T19:00:27.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.114+0000 7fcfb60ea640 1 -- 172.21.15.133:0/4195428791 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb00700e0 con 0x7fcfb00c29e0 2023-12-19T19:00:27.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.114+0000 7fcf97fff640 1 -- 172.21.15.133:0/4195428791 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fcfa00b2040 con 0x7fcfb00c29e0 2023-12-19T19:00:27.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.114+0000 7fcf97fff640 1 --2- 172.21.15.133:0/4195428791 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcf9c0664a0 0x7fcf9c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:27.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.114+0000 7fcf97fff640 1 -- 172.21.15.133:0/4195428791 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcfa011daf0 con 0x7fcfb00c29e0 2023-12-19T19:00:27.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.114+0000 7fcfaeffd640 1 --2- 172.21.15.133:0/4195428791 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcf9c0664a0 0x7fcf9c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:27.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.118+0000 7fcfaeffd640 1 --2- 172.21.15.133:0/4195428791 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcf9c0664a0 0x7fcf9c068960 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcfb00a6f30 tx=0x7fcfa4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:27.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.118+0000 7fcf97fff640 1 -- 172.21.15.133:0/4195428791 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fcfa00eb2b0 con 0x7fcfb00c29e0 2023-12-19T19:00:27.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.322+0000 7fcfb60ea640 1 -- 172.21.15.133:0/4195428791 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fcfb0068400 con 0x7fcfb00c29e0 2023-12-19T19:00:27.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.322+0000 7fcf97fff640 1 -- 172.21.15.133:0/4195428791 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5021 (secure 0 0 0) 0x7fcfa00b0090 con 0x7fcfb00c29e0 2023-12-19T19:00:27.325 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:27.325 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-19T19:00:27.325 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2023-12-19T19:00:27.325 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:00:27.325 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2023-12-19T19:00:27.325 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54FlwoplHxAAVjcRzu+wQdwT5Mzra21oYw==", 2023-12-19T19:00:27.325 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:00:27.325 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-19T19:00:27.325 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-19T19:00:27.325 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-19T19:00:27.325 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:00:27.325 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:00:27.326 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:00:27.326 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:00:27.326 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2023-12-19T19:00:27.326 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54Fl5g/pKxAA/I3R1pRmk8mQOBa4FoGj8g==", 2023-12-19T19:00:27.326 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:00:27.326 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-19T19:00:27.326 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-19T19:00:27.326 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-19T19:00:27.326 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:00:27.326 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:00:27.326 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:00:27.326 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:00:27.326 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2023-12-19T19:00:27.326 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54FlWEW0JhAAMd5FSzdRUAJgoSga/f0RCw==", 2023-12-19T19:00:27.326 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:00:27.327 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-19T19:00:27.327 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-19T19:00:27.327 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-19T19:00:27.327 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:00:27.327 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:00:27.327 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:00:27.327 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:00:27.327 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.d", 2023-12-19T19:00:27.327 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54FllCg0MxAAwWY3wtGD5Om88qWPkpzVhw==", 2023-12-19T19:00:27.327 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:00:27.327 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-19T19:00:27.327 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-19T19:00:27.327 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-19T19:00:27.327 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:00:27.327 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:00:27.327 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:00:27.328 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:00:27.328 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2023-12-19T19:00:27.328 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCr54FlMNpECRAAMTwNBHtXhYqqZ2BjCRh9MQ==", 2023-12-19T19:00:27.328 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:00:27.328 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T19:00:27.328 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T19:00:27.328 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:00:27.328 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:00:27.328 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:00:27.328 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:00:27.328 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2023-12-19T19:00:27.328 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCu54FlebMLERAADuy4l18uDpuzQTlHxpa6vg==", 2023-12-19T19:00:27.328 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:00:27.328 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T19:00:27.328 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T19:00:27.329 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:00:27.329 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:00:27.329 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:00:27.329 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:00:27.329 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2023-12-19T19:00:27.329 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCx54FlIGE0FxAAH1d5WYGkA6lc9/1uQ08+vw==", 2023-12-19T19:00:27.329 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:00:27.329 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T19:00:27.329 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T19:00:27.329 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:00:27.329 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:00:27.329 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:00:27.329 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:00:27.329 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2023-12-19T19:00:27.329 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQC054Fl6lBFHhAAezVECb7AsJH7i7o805mKYA==", 2023-12-19T19:00:27.330 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:00:27.330 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T19:00:27.330 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T19:00:27.330 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:00:27.330 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:00:27.330 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:00:27.330 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:00:27.330 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2023-12-19T19:00:27.330 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQC654Fl2Hw1JBAAFb/W356pK2UkqTbL3k+rgg==", 2023-12-19T19:00:27.330 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:00:27.330 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T19:00:27.330 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T19:00:27.330 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:00:27.330 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:00:27.330 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:00:27.331 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:00:27.331 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2023-12-19T19:00:27.331 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQC954FlDNTYKxAAOdTpUouNeNyeKWV4rSkfHA==", 2023-12-19T19:00:27.331 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:00:27.331 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T19:00:27.331 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T19:00:27.331 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:00:27.331 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:00:27.331 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:00:27.331 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:00:27.331 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2023-12-19T19:00:27.331 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDA54Fl8V0WMhAAurXUfZDjwkFUcN0/0AvCRA==", 2023-12-19T19:00:27.331 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:00:27.331 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T19:00:27.331 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T19:00:27.332 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:00:27.332 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:00:27.332 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:00:27.332 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:00:27.332 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2023-12-19T19:00:27.332 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDD54FlLS76ORAAjLklJxdnUAoGK7D7NMOuQA==", 2023-12-19T19:00:27.332 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:00:27.332 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T19:00:27.332 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T19:00:27.332 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:00:27.332 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:00:27.332 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:00:27.332 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:00:27.332 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2023-12-19T19:00:27.332 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54FllfQwNxAAyKIESQDxKvDHfaewx+v88w==", 2023-12-19T19:00:27.332 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:00:27.333 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-19T19:00:27.333 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2023-12-19T19:00:27.333 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T19:00:27.333 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:00:27.333 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:00:27.333 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:00:27.333 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2023-12-19T19:00:27.333 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54Fl4bbAOhAA4WXKbT5uizIcy0OTOKIaag==", 2023-12-19T19:00:27.333 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:00:27.333 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-19T19:00:27.333 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2023-12-19T19:00:27.333 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs2_data" 2023-12-19T19:00:27.333 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:00:27.334 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:00:27.334 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:00:27.334 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2023-12-19T19:00:27.334 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54FlrcDgAhAARPWdoItsNLlu+aiRPCG6Tg==", 2023-12-19T19:00:27.334 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:00:27.334 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-19T19:00:27.334 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-19T19:00:27.334 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-19T19:00:27.334 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:00:27.334 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:00:27.334 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:00:27.334 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:00:27.334 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.testuser", 2023-12-19T19:00:27.334 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQAq6IFlcD31HRAAMhO9tRfILfGlrbvh1g8Kbg==", 2023-12-19T19:00:27.334 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:00:27.335 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow rw fsname=cephfs", 2023-12-19T19:00:27.335 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r fsname=cephfs", 2023-12-19T19:00:27.335 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T19:00:27.335 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:00:27.335 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:00:27.335 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:00:27.335 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2023-12-19T19:00:27.335 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54FlEyVGGxAAleA1zB0F6jgR7QOYMr55Bg==", 2023-12-19T19:00:27.335 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:00:27.335 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-19T19:00:27.335 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2023-12-19T19:00:27.335 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:00:27.335 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:00:27.335 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:00:27.335 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:00:27.336 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2023-12-19T19:00:27.336 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54Fl9H5OFxAARCZdZbwW/Mw/x2X1zAvzqg==", 2023-12-19T19:00:27.336 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:00:27.336 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-19T19:00:27.336 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2023-12-19T19:00:27.336 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:00:27.336 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:00:27.336 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:00:27.336 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2023-12-19T19:00:27.336 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-19T19:00:27.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.322+0000 7fcfb60ea640 1 -- 172.21.15.133:0/4195428791 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcf9c0664a0 msgr2=0x7fcf9c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:27.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.322+0000 7fcfb60ea640 1 --2- 172.21.15.133:0/4195428791 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcf9c0664a0 0x7fcf9c068960 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fcfb00a6f30 tx=0x7fcfa4008040 comp rx=0 tx=0).stop 2023-12-19T19:00:27.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.322+0000 7fcfb60ea640 1 -- 172.21.15.133:0/4195428791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfb00c29e0 msgr2=0x7fcfb00a6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:27.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.322+0000 7fcfb60ea640 1 --2- 172.21.15.133:0/4195428791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfb00c29e0 0x7fcfb00a6690 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00ae040 tx=0x7fcfa00190d0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.322+0000 7fcfb60ea640 1 -- 172.21.15.133:0/4195428791 shutdown_connections 2023-12-19T19:00:27.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.322+0000 7fcfb60ea640 1 --2- 172.21.15.133:0/4195428791 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcf9c0664a0 0x7fcf9c068960 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.322+0000 7fcfb60ea640 1 --2- 172.21.15.133:0/4195428791 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfb00c63c0 0x7fcfb0070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.322+0000 7fcfb60ea640 1 --2- 172.21.15.133:0/4195428791 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfb00c4100 0x7fcfb0070410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.322+0000 7fcfb60ea640 1 --2- 172.21.15.133:0/4195428791 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfb00c29e0 0x7fcfb00a6690 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.322+0000 7fcfb60ea640 1 -- 172.21.15.133:0/4195428791 >> 172.21.15.133:0/4195428791 conn(0x7fcfb006a5b0 msgr2=0x7fcfb00c47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:27.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.322+0000 7fcfb60ea640 1 -- 172.21.15.133:0/4195428791 shutdown_connections 2023-12-19T19:00:27.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.322+0000 7fcfb60ea640 1 -- 172.21.15.133:0/4195428791 wait complete. 2023-12-19T19:00:27.346 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-12-19T19:00:27.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.482+0000 7fb47c78d640 1 Processor -- start 2023-12-19T19:00:27.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.482+0000 7fb47c78d640 1 -- start start 2023-12-19T19:00:27.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.482+0000 7fb47c78d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb4740c63c0 0x7fb4740c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:27.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.482+0000 7fb47c78d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4740c4100 0x7fb4740c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:27.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.482+0000 7fb47c78d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4740c29e0 0x7fb4740a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:27.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.482+0000 7fb47c78d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4740c31c0 con 0x7fb4740c4100 2023-12-19T19:00:27.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.482+0000 7fb47c78d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4740c34a0 con 0x7fb4740c63c0 2023-12-19T19:00:27.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.482+0000 7fb47c78d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4740c1030 con 0x7fb4740c29e0 2023-12-19T19:00:27.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.482+0000 7fb479d28640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4740c4100 0x7fb4740c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:27.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.482+0000 7fb479d28640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4740c4100 0x7fb4740c24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37314/0 (socket says 172.21.15.133:37314) 2023-12-19T19:00:27.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.482+0000 7fb479d28640 1 -- 172.21.15.133:0/3209107392 learned_addr learned my addr 172.21.15.133:0/3209107392 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:27.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.482+0000 7fb47a529640 1 --2- 172.21.15.133:0/3209107392 >> v2:172.21.15.138:3300/0 conn(0x7fb4740c63c0 0x7fb4740c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:27.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.482+0000 7fb479d28640 1 -- 172.21.15.133:0/3209107392 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4740c29e0 msgr2=0x7fb4740a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:27.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.482+0000 7fb47ad2a640 1 --2- 172.21.15.133:0/3209107392 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4740c29e0 0x7fb4740a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:27.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.482+0000 7fb479d28640 1 --2- 172.21.15.133:0/3209107392 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4740c29e0 0x7fb4740a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.482+0000 7fb479d28640 1 -- 172.21.15.133:0/3209107392 >> v2:172.21.15.138:3300/0 conn(0x7fb4740c63c0 msgr2=0x7fb4740c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:27.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.482+0000 7fb479d28640 1 --2- 172.21.15.133:0/3209107392 >> v2:172.21.15.138:3300/0 conn(0x7fb4740c63c0 0x7fb4740c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.482+0000 7fb479d28640 1 -- 172.21.15.133:0/3209107392 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4740c1310 con 0x7fb4740c4100 2023-12-19T19:00:27.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.482+0000 7fb47a529640 1 --2- 172.21.15.133:0/3209107392 >> v2:172.21.15.138:3300/0 conn(0x7fb4740c63c0 0x7fb4740c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:00:27.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.482+0000 7fb47ad2a640 1 --2- 172.21.15.133:0/3209107392 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4740c29e0 0x7fb4740a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:00:27.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.486+0000 7fb479d28640 1 --2- 172.21.15.133:0/3209107392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4740c4100 0x7fb4740c24a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb47406e000 tx=0x7fb46401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3ad5d98e72cbd7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:27.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.486+0000 7fb479527640 1 -- 172.21.15.133:0/3209107392 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4740aa3d0 con 0x7fb4740c4100 2023-12-19T19:00:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.486+0000 7fb479527640 1 -- 172.21.15.133:0/3209107392 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4640ad640 con 0x7fb4740c4100 2023-12-19T19:00:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.486+0000 7fb479527640 1 -- 172.21.15.133:0/3209107392 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4640ad9d0 con 0x7fb4740c4100 2023-12-19T19:00:27.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.486+0000 7fb47c78d640 1 -- 172.21.15.133:0/3209107392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4740c4100 msgr2=0x7fb4740c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.486+0000 7fb47c78d640 1 --2- 172.21.15.133:0/3209107392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4740c4100 0x7fb4740c24a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fb47406e000 tx=0x7fb46401c3b0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.486+0000 7fb47c78d640 1 -- 172.21.15.133:0/3209107392 shutdown_connections 2023-12-19T19:00:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.486+0000 7fb47c78d640 1 --2- 172.21.15.133:0/3209107392 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4740c29e0 0x7fb4740a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.486+0000 7fb47c78d640 1 --2- 172.21.15.133:0/3209107392 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4740c4100 0x7fb4740c24a0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.486+0000 7fb47c78d640 1 --2- 172.21.15.133:0/3209107392 >> v2:172.21.15.138:3300/0 conn(0x7fb4740c63c0 0x7fb4740c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.486+0000 7fb47c78d640 1 -- 172.21.15.133:0/3209107392 >> 172.21.15.133:0/3209107392 conn(0x7fb47406a5b0 msgr2=0x7fb47406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.486+0000 7fb47c78d640 1 -- 172.21.15.133:0/3209107392 shutdown_connections 2023-12-19T19:00:27.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.486+0000 7fb47c78d640 1 -- 172.21.15.133:0/3209107392 wait complete. 2023-12-19T19:00:27.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb47c78d640 1 Processor -- start 2023-12-19T19:00:27.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb47c78d640 1 -- start start 2023-12-19T19:00:27.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb47c78d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb4740c29e0 0x7fb4741ed220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:27.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb47c78d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4740c4100 0x7fb4741f0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:27.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb47c78d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4740c63c0 0x7fb474071230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:27.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb47c78d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4741f0b60 con 0x7fb4740c4100 2023-12-19T19:00:27.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb47c78d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4741ecd90 con 0x7fb4740c29e0 2023-12-19T19:00:27.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb47c78d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47415ad00 con 0x7fb4740c63c0 2023-12-19T19:00:27.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb479d28640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4740c4100 0x7fb4741f0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:27.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb479d28640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4740c4100 0x7fb4741f0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37316/0 (socket says 172.21.15.133:37316) 2023-12-19T19:00:27.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb479d28640 1 -- 172.21.15.133:0/422000918 learned_addr learned my addr 172.21.15.133:0/422000918 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:27.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb47ad2a640 1 --2- 172.21.15.133:0/422000918 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4740c63c0 0x7fb474071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:27.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb47a529640 1 --2- 172.21.15.133:0/422000918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb4740c29e0 0x7fb4741ed220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:27.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb479d28640 1 -- 172.21.15.133:0/422000918 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4740c63c0 msgr2=0x7fb474071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:27.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb479d28640 1 --2- 172.21.15.133:0/422000918 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4740c63c0 0x7fb474071230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb479d28640 1 -- 172.21.15.133:0/422000918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb4740c29e0 msgr2=0x7fb4741ed220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:27.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb479d28640 1 --2- 172.21.15.133:0/422000918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb4740c29e0 0x7fb4741ed220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb479d28640 1 -- 172.21.15.133:0/422000918 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4640094d0 con 0x7fb4740c4100 2023-12-19T19:00:27.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb479d28640 1 --2- 172.21.15.133:0/422000918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4740c4100 0x7fb4741f0620 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb4640b0040 tx=0x7fb464019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:27.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb46affd640 1 -- 172.21.15.133:0/422000918 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4640b77f0 con 0x7fb4740c4100 2023-12-19T19:00:27.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb46affd640 1 -- 172.21.15.133:0/422000918 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4640a6040 con 0x7fb4740c4100 2023-12-19T19:00:27.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb46affd640 1 -- 172.21.15.133:0/422000918 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4640b7bb0 con 0x7fb4740c4100 2023-12-19T19:00:27.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb47c78d640 1 -- 172.21.15.133:0/422000918 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4740c69b0 con 0x7fb4740c4100 2023-12-19T19:00:27.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb47c78d640 1 -- 172.21.15.133:0/422000918 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4740bb9e0 con 0x7fb4740c4100 2023-12-19T19:00:27.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.490+0000 7fb47c78d640 1 -- 172.21.15.133:0/422000918 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb474068400 con 0x7fb4740c4100 2023-12-19T19:00:27.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.494+0000 7fb46affd640 1 -- 172.21.15.133:0/422000918 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb4640b7d10 con 0x7fb4740c4100 2023-12-19T19:00:27.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.494+0000 7fb46affd640 1 --2- 172.21.15.133:0/422000918 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb458066470 0x7fb458068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:27.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.494+0000 7fb46affd640 1 -- 172.21.15.133:0/422000918 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb46411e7f0 con 0x7fb4740c4100 2023-12-19T19:00:27.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.494+0000 7fb47a529640 1 --2- 172.21.15.133:0/422000918 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb458066470 0x7fb458068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:27.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.494+0000 7fb47a529640 1 --2- 172.21.15.133:0/422000918 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb458066470 0x7fb458068930 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb470006fd0 tx=0x7fb470008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:27.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.498+0000 7fb46affd640 1 -- 172.21.15.133:0/422000918 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb4640ec050 con 0x7fb4740c4100 2023-12-19T19:00:27.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.702+0000 7fb47c78d640 1 -- 172.21.15.133:0/422000918 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7fb4740c3e70 con 0x7fb4740c4100 2023-12-19T19:00:27.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.706+0000 7fb46affd640 1 -- 172.21.15.133:0/422000918 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v14) v1 ==== 85+0+0 (secure 0 0 0) 0x7fb4640b2090 con 0x7fb4740c4100 2023-12-19T19:00:27.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.706+0000 7fb47c78d640 1 -- 172.21.15.133:0/422000918 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb458066470 msgr2=0x7fb458068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:27.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.706+0000 7fb47c78d640 1 --2- 172.21.15.133:0/422000918 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb458066470 0x7fb458068930 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb470006fd0 tx=0x7fb470008040 comp rx=0 tx=0).stop 2023-12-19T19:00:27.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.706+0000 7fb47c78d640 1 -- 172.21.15.133:0/422000918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4740c4100 msgr2=0x7fb4741f0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:27.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.706+0000 7fb47c78d640 1 --2- 172.21.15.133:0/422000918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4740c4100 0x7fb4741f0620 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fb4640b0040 tx=0x7fb464019150 comp rx=0 tx=0).stop 2023-12-19T19:00:27.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.706+0000 7fb47c78d640 1 -- 172.21.15.133:0/422000918 shutdown_connections 2023-12-19T19:00:27.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.706+0000 7fb47c78d640 1 --2- 172.21.15.133:0/422000918 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb458066470 0x7fb458068930 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.706+0000 7fb47c78d640 1 --2- 172.21.15.133:0/422000918 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4740c63c0 0x7fb474071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.706+0000 7fb47c78d640 1 --2- 172.21.15.133:0/422000918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4740c4100 0x7fb4741f0620 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.706+0000 7fb47c78d640 1 --2- 172.21.15.133:0/422000918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb4740c29e0 0x7fb4741ed220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.706+0000 7fb47c78d640 1 -- 172.21.15.133:0/422000918 >> 172.21.15.133:0/422000918 conn(0x7fb47406a5b0 msgr2=0x7fb47406d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:27.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.706+0000 7fb47c78d640 1 -- 172.21.15.133:0/422000918 shutdown_connections 2023-12-19T19:00:27.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.706+0000 7fb47c78d640 1 -- 172.21.15.133:0/422000918 wait complete. 2023-12-19T19:00:27.730 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:00:27.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.866+0000 7f5d39232640 1 Processor -- start 2023-12-19T19:00:27.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.866+0000 7f5d39232640 1 -- start start 2023-12-19T19:00:27.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.866+0000 7f5d39232640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5d34151e90 0x7f5d340c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:27.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.866+0000 7f5d39232640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d3406c860 con 0x7f5d340c7ea0 2023-12-19T19:00:27.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.866+0000 7f5d39232640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d34154930 con 0x7f5d340c4e60 2023-12-19T19:00:27.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.866+0000 7f5d39232640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d340c8750 con 0x7f5d34151e90 2023-12-19T19:00:27.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.866+0000 7f5d32d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5d34151e90 0x7f5d340c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:27.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.866+0000 7f5d2a59c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5d340c7ea0 0x7f5d3406b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33760/0 (socket says 172.21.15.133:33760) 2023-12-19T19:00:27.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.866+0000 7f5d2a59c640 1 -- 172.21.15.133:0/368090246 learned_addr learned my addr 172.21.15.133:0/368090246 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:27.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.866+0000 7f5d32d9d640 1 -- 172.21.15.133:0/368090246 >> v1:172.21.15.138:6789/0 conn(0x7f5d340c4e60 legacy=0x7f5d3415f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:27.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.866+0000 7f5d32d9d640 1 -- 172.21.15.133:0/368090246 >> v1:172.21.15.133:6789/0 conn(0x7f5d340c7ea0 legacy=0x7f5d3406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:27.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.866+0000 7f5d32d9d640 1 -- 172.21.15.133:0/368090246 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d34154c10 con 0x7f5d34151e90 2023-12-19T19:00:27.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.870+0000 7f5d32d9d640 1 --2- 172.21.15.133:0/368090246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d34151e90 0x7f5d340c4920 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c0097c0 tx=0x7f5d1c01c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec2ee90c46d9a88 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:27.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.870+0000 7f5d3259c640 1 -- 172.21.15.133:0/368090246 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0ab600 con 0x7f5d34151e90 2023-12-19T19:00:27.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.870+0000 7f5d3259c640 1 -- 172.21.15.133:0/368090246 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c0a7050 con 0x7f5d34151e90 2023-12-19T19:00:27.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.870+0000 7f5d3259c640 1 -- 172.21.15.133:0/368090246 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0ab980 con 0x7f5d34151e90 2023-12-19T19:00:27.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.870+0000 7f5d39232640 1 -- 172.21.15.133:0/368090246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d34151e90 msgr2=0x7f5d340c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:27.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.870+0000 7f5d39232640 1 --2- 172.21.15.133:0/368090246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d34151e90 0x7f5d340c4920 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c0097c0 tx=0x7f5d1c01c320 comp rx=0 tx=0).stop 2023-12-19T19:00:27.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.870+0000 7f5d39232640 1 -- 172.21.15.133:0/368090246 shutdown_connections 2023-12-19T19:00:27.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.870+0000 7f5d39232640 1 --2- 172.21.15.133:0/368090246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d34151e90 0x7f5d340c4920 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.870+0000 7f5d39232640 1 -- 172.21.15.133:0/368090246 >> 172.21.15.133:0/368090246 conn(0x7f5d340ca170 msgr2=0x7f5d340ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:27.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.870+0000 7f5d39232640 1 -- 172.21.15.133:0/368090246 shutdown_connections 2023-12-19T19:00:27.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.870+0000 7f5d39232640 1 -- 172.21.15.133:0/368090246 wait complete. 2023-12-19T19:00:27.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d39232640 1 Processor -- start 2023-12-19T19:00:27.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d39232640 1 -- start start 2023-12-19T19:00:27.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d39232640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d340c4e60 0x7f5d34141f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:27.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d39232640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d340c7ea0 0x7f5d340ab130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:27.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d39232640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d34151e90 0x7f5d34143440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:27.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d39232640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d341552d0 con 0x7f5d340c4e60 2023-12-19T19:00:27.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d39232640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3414c870 con 0x7f5d340c7ea0 2023-12-19T19:00:27.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d39232640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d34144d60 con 0x7f5d34151e90 2023-12-19T19:00:27.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d32d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d340c4e60 0x7f5d34141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:27.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d32d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d340c4e60 0x7f5d34141f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37334/0 (socket says 172.21.15.133:37334) 2023-12-19T19:00:27.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d32d9d640 1 -- 172.21.15.133:0/268931832 learned_addr learned my addr 172.21.15.133:0/268931832 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:27.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d2a59c640 1 --2- 172.21.15.133:0/268931832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d340c7ea0 0x7f5d340ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:27.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d3359e640 1 --2- 172.21.15.133:0/268931832 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d34151e90 0x7f5d34143440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:27.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d32d9d640 1 -- 172.21.15.133:0/268931832 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d34151e90 msgr2=0x7f5d34143440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:27.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d32d9d640 1 --2- 172.21.15.133:0/268931832 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d34151e90 0x7f5d34143440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d32d9d640 1 -- 172.21.15.133:0/268931832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d340c7ea0 msgr2=0x7f5d340ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:27.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d32d9d640 1 --2- 172.21.15.133:0/268931832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d340c7ea0 0x7f5d340ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:27.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d32d9d640 1 -- 172.21.15.133:0/268931832 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c009420 con 0x7f5d340c4e60 2023-12-19T19:00:27.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d3359e640 1 --2- 172.21.15.133:0/268931832 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d34151e90 0x7f5d34143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:00:27.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d32d9d640 1 --2- 172.21.15.133:0/268931832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d340c4e60 0x7f5d34141f00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c018f30 tx=0x7f5d1c01ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:27.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d2bfff640 1 -- 172.21.15.133:0/268931832 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0b7650 con 0x7f5d340c4e60 2023-12-19T19:00:27.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d2bfff640 1 -- 172.21.15.133:0/268931832 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c0b77b0 con 0x7f5d340c4e60 2023-12-19T19:00:27.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d39232640 1 -- 172.21.15.133:0/268931832 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d3414f1b0 con 0x7f5d340c4e60 2023-12-19T19:00:27.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d2bfff640 1 -- 172.21.15.133:0/268931832 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0b7b60 con 0x7f5d340c4e60 2023-12-19T19:00:27.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.874+0000 7f5d39232640 1 -- 172.21.15.133:0/268931832 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d3414a280 con 0x7f5d340c4e60 2023-12-19T19:00:27.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.878+0000 7f5d39232640 1 -- 172.21.15.133:0/268931832 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d34068400 con 0x7f5d340c4e60 2023-12-19T19:00:27.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.878+0000 7f5d2bfff640 1 -- 172.21.15.133:0/268931832 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5d1c0b7cc0 con 0x7f5d340c4e60 2023-12-19T19:00:27.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.878+0000 7f5d2bfff640 1 --2- 172.21.15.133:0/268931832 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5d140664a0 0x7f5d14068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:27.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.878+0000 7f5d2bfff640 1 -- 172.21.15.133:0/268931832 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5d1c11e510 con 0x7f5d340c4e60 2023-12-19T19:00:27.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.878+0000 7f5d2a59c640 1 --2- 172.21.15.133:0/268931832 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5d140664a0 0x7f5d14068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:27.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.882+0000 7f5d2a59c640 1 --2- 172.21.15.133:0/268931832 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5d140664a0 0x7f5d14068960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5d3414f770 tx=0x7f5d24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:27.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:27.882+0000 7f5d2bfff640 1 -- 172.21.15.133:0/268931832 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5d1c0ebdf0 con 0x7f5d340c4e60 2023-12-19T19:00:28.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.038+0000 7f5d39232640 1 -- 172.21.15.133:0/268931832 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d340c6040 con 0x7f5d340c4e60 2023-12-19T19:00:28.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.038+0000 7f5d2bfff640 1 -- 172.21.15.133:0/268931832 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+12893 (secure 0 0 0) 0x7f5d1c0bb090 con 0x7f5d340c4e60 2023-12-19T19:00:28.041 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:28.041 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":46,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:00:26.931267+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:00:28.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.038+0000 7f5d39232640 1 -- 172.21.15.133:0/268931832 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5d140664a0 msgr2=0x7f5d14068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:28.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.038+0000 7f5d39232640 1 --2- 172.21.15.133:0/268931832 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5d140664a0 0x7f5d14068960 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5d3414f770 tx=0x7f5d24009040 comp rx=0 tx=0).stop 2023-12-19T19:00:28.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.038+0000 7f5d39232640 1 -- 172.21.15.133:0/268931832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d340c4e60 msgr2=0x7f5d34141f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:28.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.038+0000 7f5d39232640 1 --2- 172.21.15.133:0/268931832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d340c4e60 0x7f5d34141f00 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c018f30 tx=0x7f5d1c01ab60 comp rx=0 tx=0).stop 2023-12-19T19:00:28.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.038+0000 7f5d39232640 1 -- 172.21.15.133:0/268931832 shutdown_connections 2023-12-19T19:00:28.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.038+0000 7f5d39232640 1 --2- 172.21.15.133:0/268931832 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5d140664a0 0x7f5d14068960 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.038+0000 7f5d39232640 1 --2- 172.21.15.133:0/268931832 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5d34151e90 0x7f5d34143440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.038+0000 7f5d39232640 1 --2- 172.21.15.133:0/268931832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5d340c7ea0 0x7f5d340ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.038+0000 7f5d39232640 1 --2- 172.21.15.133:0/268931832 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d340c4e60 0x7f5d34141f00 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.038+0000 7f5d39232640 1 -- 172.21.15.133:0/268931832 >> 172.21.15.133:0/268931832 conn(0x7f5d340ca170 msgr2=0x7f5d34148490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:28.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.038+0000 7f5d39232640 1 -- 172.21.15.133:0/268931832 shutdown_connections 2023-12-19T19:00:28.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.038+0000 7f5d39232640 1 -- 172.21.15.133:0/268931832 wait complete. 2023-12-19T19:00:28.062 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T19:00:28.062 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T19:00:28.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.202+0000 7f15e7b1d640 1 Processor -- start 2023-12-19T19:00:28.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.202+0000 7f15e7b1d640 1 -- start start 2023-12-19T19:00:28.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.202+0000 7f15e7b1d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15e00c4100 0x7f15e00c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:28.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.202+0000 7f15e7b1d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f15e00c06d0 0x7f15e00a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:28.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.202+0000 7f15e7b1d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e00c31c0 con 0x7f15e00c63c0 2023-12-19T19:00:28.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.202+0000 7f15e7b1d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e00c34a0 con 0x7f15e00c06d0 2023-12-19T19:00:28.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.202+0000 7f15e7b1d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e00c1030 con 0x7f15e00c4100 2023-12-19T19:00:28.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.202+0000 7f15e58b9640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f15e00c63c0 0x7f15e00c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33768/0 (socket says 172.21.15.133:33768) 2023-12-19T19:00:28.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.202+0000 7f15e58b9640 1 -- 172.21.15.133:0/4269641782 learned_addr learned my addr 172.21.15.133:0/4269641782 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:28.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.202+0000 7f15e50b8640 1 --2- 172.21.15.133:0/4269641782 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15e00c4100 0x7f15e00c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:28.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.202+0000 7f15e60ba640 1 --2- 172.21.15.133:0/4269641782 >> v2:172.21.15.138:3300/0 conn(0x7f15e00c06d0 0x7f15e00a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:28.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.202+0000 7f15e48b7640 1 -- 172.21.15.133:0/4269641782 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2390474907 0 0) 0x7f15e00c31c0 con 0x7f15e00c63c0 2023-12-19T19:00:28.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.202+0000 7f15e48b7640 1 -- 172.21.15.133:0/4269641782 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15cc003530 con 0x7f15e00c63c0 2023-12-19T19:00:28.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.202+0000 7f15e60ba640 1 -- 172.21.15.133:0/4269641782 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15e00c4100 msgr2=0x7f15e00c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:28.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.202+0000 7f15e60ba640 1 --2- 172.21.15.133:0/4269641782 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15e00c4100 0x7f15e00c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.202+0000 7f15e60ba640 1 -- 172.21.15.133:0/4269641782 >> v1:172.21.15.133:6789/0 conn(0x7f15e00c63c0 legacy=0x7f15e00c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:28.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.202+0000 7f15e60ba640 1 -- 172.21.15.133:0/4269641782 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e00c1310 con 0x7f15e00c06d0 2023-12-19T19:00:28.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.202+0000 7f15e50b8640 1 --2- 172.21.15.133:0/4269641782 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15e00c4100 0x7f15e00c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:00:28.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.206+0000 7f15e60ba640 1 --2- 172.21.15.133:0/4269641782 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15e00c06d0 0x7f15e00a9680 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009d90 tx=0x7f15d801c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f15d45267f65b5b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:28.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.206+0000 7f15e48b7640 1 -- 172.21.15.133:0/4269641782 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e00aa3d0 con 0x7f15e00c06d0 2023-12-19T19:00:28.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.206+0000 7f15e48b7640 1 -- 172.21.15.133:0/4269641782 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d80a5800 con 0x7f15e00c06d0 2023-12-19T19:00:28.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.206+0000 7f15e48b7640 1 -- 172.21.15.133:0/4269641782 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d80a5b70 con 0x7f15e00c06d0 2023-12-19T19:00:28.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.206+0000 7f15e7b1d640 1 -- 172.21.15.133:0/4269641782 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15e00c06d0 msgr2=0x7f15e00a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:28.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.206+0000 7f15e7b1d640 1 --2- 172.21.15.133:0/4269641782 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15e00c06d0 0x7f15e00a9680 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009d90 tx=0x7f15d801c830 comp rx=0 tx=0).stop 2023-12-19T19:00:28.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.206+0000 7f15e7b1d640 1 -- 172.21.15.133:0/4269641782 shutdown_connections 2023-12-19T19:00:28.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.206+0000 7f15e7b1d640 1 --2- 172.21.15.133:0/4269641782 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15e00c06d0 0x7f15e00a9680 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.206+0000 7f15e7b1d640 1 --2- 172.21.15.133:0/4269641782 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15e00c4100 0x7f15e00c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.206+0000 7f15e7b1d640 1 -- 172.21.15.133:0/4269641782 >> 172.21.15.133:0/4269641782 conn(0x7f15e006a5b0 msgr2=0x7f15e006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:28.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.206+0000 7f15e7b1d640 1 -- 172.21.15.133:0/4269641782 shutdown_connections 2023-12-19T19:00:28.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.206+0000 7f15e7b1d640 1 -- 172.21.15.133:0/4269641782 wait complete. 2023-12-19T19:00:28.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15e7b1d640 1 Processor -- start 2023-12-19T19:00:28.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15e7b1d640 1 -- start start 2023-12-19T19:00:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15e7b1d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15e00c06d0 0x7f15e0155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15e7b1d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15e00c4100 0x7f15e00bbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15e7b1d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15e00c63c0 0x7f15e00bc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15e7b1d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e00bdaa0 con 0x7f15e00c06d0 2023-12-19T19:00:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15e7b1d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e00bbaa0 con 0x7f15e00c63c0 2023-12-19T19:00:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15e7b1d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e00bc9b0 con 0x7f15e00c4100 2023-12-19T19:00:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15e58b9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15e00c06d0 0x7f15e0155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15e58b9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15e00c06d0 0x7f15e0155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37336/0 (socket says 172.21.15.133:37336) 2023-12-19T19:00:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15e58b9640 1 -- 172.21.15.133:0/3312503000 learned_addr learned my addr 172.21.15.133:0/3312503000 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15e50b8640 1 --2- 172.21.15.133:0/3312503000 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15e00c4100 0x7f15e00bbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15e60ba640 1 --2- 172.21.15.133:0/3312503000 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15e00c63c0 0x7f15e00bc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15e58b9640 1 -- 172.21.15.133:0/3312503000 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15e00c4100 msgr2=0x7f15e00bbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:28.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15e58b9640 1 --2- 172.21.15.133:0/3312503000 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15e00c4100 0x7f15e00bbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15e58b9640 1 -- 172.21.15.133:0/3312503000 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15e00c63c0 msgr2=0x7f15e00bc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:28.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15e58b9640 1 --2- 172.21.15.133:0/3312503000 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15e00c63c0 0x7f15e00bc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15e58b9640 1 -- 172.21.15.133:0/3312503000 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d0009420 con 0x7f15e00c06d0 2023-12-19T19:00:28.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15e50b8640 1 --2- 172.21.15.133:0/3312503000 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15e00c4100 0x7f15e00bbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:00:28.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15e58b9640 1 --2- 172.21.15.133:0/3312503000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15e00c06d0 0x7f15e0155060 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f15dc00c450 tx=0x7f15dc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:28.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15d67fc640 1 -- 172.21.15.133:0/3312503000 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc005cf0 con 0x7f15e00c06d0 2023-12-19T19:00:28.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15d67fc640 1 -- 172.21.15.133:0/3312503000 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15dc005e50 con 0x7f15e00c06d0 2023-12-19T19:00:28.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15d67fc640 1 -- 172.21.15.133:0/3312503000 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc007270 con 0x7f15e00c06d0 2023-12-19T19:00:28.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15e7b1d640 1 -- 172.21.15.133:0/3312503000 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d8009a70 con 0x7f15e00c06d0 2023-12-19T19:00:28.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15e7b1d640 1 -- 172.21.15.133:0/3312503000 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e00bb170 con 0x7f15e00c06d0 2023-12-19T19:00:28.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.210+0000 7f15e7b1d640 1 -- 172.21.15.133:0/3312503000 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e0068400 con 0x7f15e00c06d0 2023-12-19T19:00:28.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.214+0000 7f15d67fc640 1 -- 172.21.15.133:0/3312503000 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f15dc0073d0 con 0x7f15e00c06d0 2023-12-19T19:00:28.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.214+0000 7f15d67fc640 1 --2- 172.21.15.133:0/3312503000 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f15c40664a0 0x7f15c4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:28.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.214+0000 7f15d67fc640 1 -- 172.21.15.133:0/3312503000 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f15dc082f00 con 0x7f15e00c06d0 2023-12-19T19:00:28.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.214+0000 7f15e50b8640 1 --2- 172.21.15.133:0/3312503000 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f15c40664a0 0x7f15c4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:28.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.214+0000 7f15e50b8640 1 --2- 172.21.15.133:0/3312503000 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f15c40664a0 0x7f15c4068960 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f15e00aab00 tx=0x7f15d0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:28.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.218+0000 7f15d67fc640 1 -- 172.21.15.133:0/3312503000 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f15dc050770 con 0x7f15e00c06d0 2023-12-19T19:00:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.370+0000 7f15e7b1d640 1 -- 172.21.15.133:0/3312503000 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f15e00c3e70 con 0x7f15e00c06d0 2023-12-19T19:00:28.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.370+0000 7f15d67fc640 1 -- 172.21.15.133:0/3312503000 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f15dc017020 con 0x7f15e00c06d0 2023-12-19T19:00:28.373 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T19:00:28.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.370+0000 7f15e7b1d640 1 -- 172.21.15.133:0/3312503000 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f15c40664a0 msgr2=0x7f15c4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.370+0000 7f15e7b1d640 1 --2- 172.21.15.133:0/3312503000 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f15c40664a0 0x7f15c4068960 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f15e00aab00 tx=0x7f15d0009190 comp rx=0 tx=0).stop 2023-12-19T19:00:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.370+0000 7f15e7b1d640 1 -- 172.21.15.133:0/3312503000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15e00c06d0 msgr2=0x7f15e0155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.370+0000 7f15e7b1d640 1 --2- 172.21.15.133:0/3312503000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15e00c06d0 0x7f15e0155060 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f15dc00c450 tx=0x7f15dc00c910 comp rx=0 tx=0).stop 2023-12-19T19:00:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.370+0000 7f15e7b1d640 1 -- 172.21.15.133:0/3312503000 shutdown_connections 2023-12-19T19:00:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.370+0000 7f15e7b1d640 1 --2- 172.21.15.133:0/3312503000 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f15c40664a0 0x7f15c4068960 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.370+0000 7f15e7b1d640 1 --2- 172.21.15.133:0/3312503000 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15e00c63c0 0x7f15e00bc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.370+0000 7f15e7b1d640 1 --2- 172.21.15.133:0/3312503000 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15e00c4100 0x7f15e00bbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.370+0000 7f15e7b1d640 1 --2- 172.21.15.133:0/3312503000 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15e00c06d0 0x7f15e0155060 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.370+0000 7f15e7b1d640 1 -- 172.21.15.133:0/3312503000 >> 172.21.15.133:0/3312503000 conn(0x7f15e006a5b0 msgr2=0x7f15e00703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.370+0000 7f15e7b1d640 1 -- 172.21.15.133:0/3312503000 shutdown_connections 2023-12-19T19:00:28.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.370+0000 7f15e7b1d640 1 -- 172.21.15.133:0/3312503000 wait complete. 2023-12-19T19:00:28.393 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T19:00:28.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.534+0000 7f708f8fe640 1 Processor -- start 2023-12-19T19:00:28.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.534+0000 7f708f8fe640 1 -- start start 2023-12-19T19:00:28.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.534+0000 7f708f8fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f70880725c0 0x7f70880a5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:28.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.534+0000 7f708f8fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70880c3bd0 0x7f70880c4060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:28.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.534+0000 7f708f8fe640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70880c2760 con 0x7f7088072090 2023-12-19T19:00:28.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.534+0000 7f708f8fe640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70880c3070 con 0x7f70880725c0 2023-12-19T19:00:28.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.534+0000 7f708f8fe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70880c63e0 con 0x7f70880c3bd0 2023-12-19T19:00:28.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.534+0000 7f708d69a640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7088072090 0x7f70880c5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33776/0 (socket says 172.21.15.133:33776) 2023-12-19T19:00:28.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.534+0000 7f708d69a640 1 -- 172.21.15.133:0/2947617792 learned_addr learned my addr 172.21.15.133:0/2947617792 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:28.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.534+0000 7f708de9b640 1 --2- 172.21.15.133:0/2947617792 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70880c3bd0 0x7f70880c4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:28.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.534+0000 7f708ce99640 1 --2- 172.21.15.133:0/2947617792 >> v2:172.21.15.138:3300/0 conn(0x7f70880725c0 0x7f70880a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:28.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.534+0000 7f707ffff640 1 -- 172.21.15.133:0/2947617792 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 490607627 0 0) 0x7f70880c2760 con 0x7f7088072090 2023-12-19T19:00:28.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.534+0000 7f707ffff640 1 -- 172.21.15.133:0/2947617792 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7074003530 con 0x7f7088072090 2023-12-19T19:00:28.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.534+0000 7f708de9b640 1 -- 172.21.15.133:0/2947617792 >> v2:172.21.15.138:3300/0 conn(0x7f70880725c0 msgr2=0x7f70880a5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:28.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.534+0000 7f708de9b640 1 --2- 172.21.15.133:0/2947617792 >> v2:172.21.15.138:3300/0 conn(0x7f70880725c0 0x7f70880a5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.534+0000 7f708de9b640 1 -- 172.21.15.133:0/2947617792 >> v1:172.21.15.133:6789/0 conn(0x7f7088072090 legacy=0x7f70880c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:28.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.534+0000 7f708de9b640 1 -- 172.21.15.133:0/2947617792 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70880aad20 con 0x7f70880c3bd0 2023-12-19T19:00:28.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.538+0000 7f708de9b640 1 --2- 172.21.15.133:0/2947617792 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70880c3bd0 0x7f70880c4060 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7080009d90 tx=0x7f708001c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d98853d8245375b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:28.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.538+0000 7f707ffff640 1 -- 172.21.15.133:0/2947617792 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70800a5910 con 0x7f70880c3bd0 2023-12-19T19:00:28.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.538+0000 7f707ffff640 1 -- 172.21.15.133:0/2947617792 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70800a5a70 con 0x7f70880c3bd0 2023-12-19T19:00:28.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.538+0000 7f707ffff640 1 -- 172.21.15.133:0/2947617792 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70800a5e00 con 0x7f70880c3bd0 2023-12-19T19:00:28.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.538+0000 7f708f8fe640 1 -- 172.21.15.133:0/2947617792 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70880c3bd0 msgr2=0x7f70880c4060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:28.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.538+0000 7f708f8fe640 1 --2- 172.21.15.133:0/2947617792 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70880c3bd0 0x7f70880c4060 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7080009d90 tx=0x7f708001c830 comp rx=0 tx=0).stop 2023-12-19T19:00:28.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.538+0000 7f708f8fe640 1 -- 172.21.15.133:0/2947617792 shutdown_connections 2023-12-19T19:00:28.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.538+0000 7f708f8fe640 1 --2- 172.21.15.133:0/2947617792 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f70880c3bd0 0x7f70880c4060 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.538+0000 7f708f8fe640 1 --2- 172.21.15.133:0/2947617792 >> v2:172.21.15.138:3300/0 conn(0x7f70880725c0 0x7f70880a5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.538+0000 7f708f8fe640 1 -- 172.21.15.133:0/2947617792 >> 172.21.15.133:0/2947617792 conn(0x7f708806a5b0 msgr2=0x7f708806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:28.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.538+0000 7f708f8fe640 1 -- 172.21.15.133:0/2947617792 shutdown_connections 2023-12-19T19:00:28.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.538+0000 7f708f8fe640 1 -- 172.21.15.133:0/2947617792 wait complete. 2023-12-19T19:00:28.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f708f8fe640 1 Processor -- start 2023-12-19T19:00:28.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f708f8fe640 1 -- start start 2023-12-19T19:00:28.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f708f8fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7088072090 0x7f7088147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:28.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f708f8fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70880725c0 0x7f70880a53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:28.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f708f8fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70880c3bd0 0x7f70881452d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:28.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f708f8fe640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70880a77b0 con 0x7f70880725c0 2023-12-19T19:00:28.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f708f8fe640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70881ece00 con 0x7f70880c3bd0 2023-12-19T19:00:28.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f708f8fe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70880a58f0 con 0x7f7088072090 2023-12-19T19:00:28.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f708ce99640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70880725c0 0x7f70880a53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:28.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f708ce99640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70880725c0 0x7f70880a53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37338/0 (socket says 172.21.15.133:37338) 2023-12-19T19:00:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f708ce99640 1 -- 172.21.15.133:0/4076655198 learned_addr learned my addr 172.21.15.133:0/4076655198 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f708ce99640 1 -- 172.21.15.133:0/4076655198 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7088072090 msgr2=0x7f7088147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f708d69a640 1 --2- 172.21.15.133:0/4076655198 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7088072090 0x7f7088147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f708de9b640 1 --2- 172.21.15.133:0/4076655198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70880c3bd0 0x7f70881452d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f708ce99640 1 --2- 172.21.15.133:0/4076655198 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7088072090 0x7f7088147ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f708ce99640 1 -- 172.21.15.133:0/4076655198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70880c3bd0 msgr2=0x7f70881452d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f708ce99640 1 --2- 172.21.15.133:0/4076655198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70880c3bd0 0x7f70881452d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f708ce99640 1 -- 172.21.15.133:0/4076655198 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7080009a70 con 0x7f70880725c0 2023-12-19T19:00:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f708d69a640 1 --2- 172.21.15.133:0/4076655198 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7088072090 0x7f7088147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:00:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f708de9b640 1 --2- 172.21.15.133:0/4076655198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70880c3bd0 0x7f70881452d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:00:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f708ce99640 1 --2- 172.21.15.133:0/4076655198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70880725c0 0x7f70880a53b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f707800e960 tx=0x7f707800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f707dffb640 1 -- 172.21.15.133:0/4076655198 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7078009690 con 0x7f70880725c0 2023-12-19T19:00:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f707dffb640 1 -- 172.21.15.133:0/4076655198 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707800ca00 con 0x7f70880725c0 2023-12-19T19:00:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f707dffb640 1 -- 172.21.15.133:0/4076655198 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707800cd70 con 0x7f70880725c0 2023-12-19T19:00:28.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f708f8fe640 1 -- 172.21.15.133:0/4076655198 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7088145c30 con 0x7f70880725c0 2023-12-19T19:00:28.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.542+0000 7f708f8fe640 1 -- 172.21.15.133:0/4076655198 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70880a74d0 con 0x7f70880725c0 2023-12-19T19:00:28.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.546+0000 7f708f8fe640 1 -- 172.21.15.133:0/4076655198 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70881ecfb0 con 0x7f70880725c0 2023-12-19T19:00:28.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.546+0000 7f707dffb640 1 -- 172.21.15.133:0/4076655198 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7078013470 con 0x7f70880725c0 2023-12-19T19:00:28.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.546+0000 7f707dffb640 1 --2- 172.21.15.133:0/4076655198 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f706c066470 0x7f706c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:28.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.546+0000 7f707dffb640 1 -- 172.21.15.133:0/4076655198 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7078084170 con 0x7f70880725c0 2023-12-19T19:00:28.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.546+0000 7f708d69a640 1 --2- 172.21.15.133:0/4076655198 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f706c066470 0x7f706c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:28.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.546+0000 7f708d69a640 1 --2- 172.21.15.133:0/4076655198 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f706c066470 0x7f706c068930 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f70840011f0 tx=0x7f7084009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:28.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.550+0000 7f707dffb640 1 -- 172.21.15.133:0/4076655198 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7078051930 con 0x7f70880725c0 2023-12-19T19:00:28.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.702+0000 7f708f8fe640 1 -- 172.21.15.133:0/4076655198 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7088068400 con 0x7f70880725c0 2023-12-19T19:00:28.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.702+0000 7f707dffb640 1 -- 172.21.15.133:0/4076655198 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v46) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7078054f50 con 0x7f70880725c0 2023-12-19T19:00:28.706 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:28.706 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2023-12-19T19:00:28.706 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:00:28.706 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2023-12-19T19:00:28.707 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": ".mgr" 2023-12-19T19:00:28.707 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:00:28.707 INFO:teuthology.orchestra.run.smithi133.stdout:] 2023-12-19T19:00:28.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.706+0000 7f708f8fe640 1 -- 172.21.15.133:0/4076655198 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f706c066470 msgr2=0x7f706c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:28.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.706+0000 7f708f8fe640 1 --2- 172.21.15.133:0/4076655198 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f706c066470 0x7f706c068930 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f70840011f0 tx=0x7f7084009040 comp rx=0 tx=0).stop 2023-12-19T19:00:28.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.706+0000 7f708f8fe640 1 -- 172.21.15.133:0/4076655198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70880725c0 msgr2=0x7f70880a53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:28.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.706+0000 7f708f8fe640 1 --2- 172.21.15.133:0/4076655198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70880725c0 0x7f70880a53b0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f707800e960 tx=0x7f707800ee20 comp rx=0 tx=0).stop 2023-12-19T19:00:28.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.706+0000 7f708f8fe640 1 -- 172.21.15.133:0/4076655198 shutdown_connections 2023-12-19T19:00:28.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.706+0000 7f708f8fe640 1 --2- 172.21.15.133:0/4076655198 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f706c066470 0x7f706c068930 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.706+0000 7f708f8fe640 1 --2- 172.21.15.133:0/4076655198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f70880c3bd0 0x7f70881452d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.706+0000 7f708f8fe640 1 --2- 172.21.15.133:0/4076655198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f70880725c0 0x7f70880a53b0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.706+0000 7f708f8fe640 1 --2- 172.21.15.133:0/4076655198 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7088072090 0x7f7088147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.706+0000 7f708f8fe640 1 -- 172.21.15.133:0/4076655198 >> 172.21.15.133:0/4076655198 conn(0x7f708806a5b0 msgr2=0x7f708806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:28.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.706+0000 7f708f8fe640 1 -- 172.21.15.133:0/4076655198 shutdown_connections 2023-12-19T19:00:28.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.706+0000 7f708f8fe640 1 -- 172.21.15.133:0/4076655198 wait complete. 2023-12-19T19:00:28.727 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T19:00:28.727 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T19:00:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.866+0000 7fccacdaa640 1 Processor -- start 2023-12-19T19:00:28.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.866+0000 7fccacdaa640 1 -- start start 2023-12-19T19:00:28.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.870+0000 7fccacdaa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcca814f9f0 0x7fcca80c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.870+0000 7fccacdaa640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcca80c2d10 0x7fcca806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.870+0000 7fccacdaa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcca80c5ba0 con 0x7fcca80c07b0 2023-12-19T19:00:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.870+0000 7fccacdaa640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca806e320 con 0x7fcca80c2d10 2023-12-19T19:00:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.870+0000 7fccacdaa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcca806c160 con 0x7fcca814f9f0 2023-12-19T19:00:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.870+0000 7fcca6d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcca80c2d10 0x7fcca806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.870+0000 7fcca6d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcca80c2d10 0x7fcca806dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37340/0 (socket says 172.21.15.133:37340) 2023-12-19T19:00:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.870+0000 7fcca6d9d640 1 -- 172.21.15.133:0/3464236709 learned_addr learned my addr 172.21.15.133:0/3464236709 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:28.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.870+0000 7fcca659c640 1 --2- 172.21.15.133:0/3464236709 >> v2:172.21.15.138:3300/0 conn(0x7fcca814f9f0 0x7fcca80c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.870+0000 7fcca6d9d640 1 -- 172.21.15.133:0/3464236709 >> v2:172.21.15.138:3300/0 conn(0x7fcca814f9f0 msgr2=0x7fcca80c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.870+0000 7fcca6d9d640 1 --2- 172.21.15.133:0/3464236709 >> v2:172.21.15.138:3300/0 conn(0x7fcca814f9f0 0x7fcca80c27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.870+0000 7fcca6d9d640 1 -- 172.21.15.133:0/3464236709 >> v1:172.21.15.138:6789/0 conn(0x7fcca80c07b0 legacy=0x7fcca806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:28.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.870+0000 7fcca6d9d640 1 -- 172.21.15.133:0/3464236709 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca80c5410 con 0x7fcca80c2d10 2023-12-19T19:00:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.874+0000 7fcca6d9d640 1 --2- 172.21.15.133:0/3464236709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcca80c2d10 0x7fcca806dde0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009e50 tx=0x7fcca001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec9fd9b5b2a093d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.874+0000 7fcca559a640 1 -- 172.21.15.133:0/3464236709 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca00a57d0 con 0x7fcca80c2d10 2023-12-19T19:00:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.874+0000 7fcca559a640 1 -- 172.21.15.133:0/3464236709 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca00a5930 con 0x7fcca80c2d10 2023-12-19T19:00:28.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.874+0000 7fcca559a640 1 -- 172.21.15.133:0/3464236709 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca00a5cc0 con 0x7fcca80c2d10 2023-12-19T19:00:28.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.874+0000 7fccacdaa640 1 -- 172.21.15.133:0/3464236709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcca80c2d10 msgr2=0x7fcca806dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:28.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.874+0000 7fccacdaa640 1 --2- 172.21.15.133:0/3464236709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcca80c2d10 0x7fcca806dde0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fcca0009e50 tx=0x7fcca001c910 comp rx=0 tx=0).stop 2023-12-19T19:00:28.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.874+0000 7fccacdaa640 1 -- 172.21.15.133:0/3464236709 shutdown_connections 2023-12-19T19:00:28.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.874+0000 7fccacdaa640 1 --2- 172.21.15.133:0/3464236709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcca80c2d10 0x7fcca806dde0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.874+0000 7fccacdaa640 1 --2- 172.21.15.133:0/3464236709 >> v2:172.21.15.138:3300/0 conn(0x7fcca814f9f0 0x7fcca80c27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.874+0000 7fccacdaa640 1 -- 172.21.15.133:0/3464236709 >> 172.21.15.133:0/3464236709 conn(0x7fcca80c5d40 msgr2=0x7fcca80c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:28.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.874+0000 7fccacdaa640 1 -- 172.21.15.133:0/3464236709 shutdown_connections 2023-12-19T19:00:28.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.874+0000 7fccacdaa640 1 -- 172.21.15.133:0/3464236709 wait complete. 2023-12-19T19:00:28.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.874+0000 7fccacdaa640 1 Processor -- start 2023-12-19T19:00:28.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.874+0000 7fccacdaa640 1 -- start start 2023-12-19T19:00:28.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fccacdaa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcca80c07b0 0x7fcca8071580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:28.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fccacdaa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcca80c2d10 0x7fcca814d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:28.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fccacdaa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcca814f9f0 0x7fcca814b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:28.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fccacdaa640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca814db60 con 0x7fcca814f9f0 2023-12-19T19:00:28.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fccacdaa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcca81ee400 con 0x7fcca80c07b0 2023-12-19T19:00:28.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fccacdaa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcca8071c10 con 0x7fcca80c2d10 2023-12-19T19:00:28.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fcca6d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcca814f9f0 0x7fcca814b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:28.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fcca6d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcca814f9f0 0x7fcca814b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37350/0 (socket says 172.21.15.133:37350) 2023-12-19T19:00:28.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fcca6d9d640 1 -- 172.21.15.133:0/3524848039 learned_addr learned my addr 172.21.15.133:0/3524848039 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:28.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fcca659c640 1 --2- 172.21.15.133:0/3524848039 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcca80c07b0 0x7fcca8071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:28.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fcca5d9b640 1 --2- 172.21.15.133:0/3524848039 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcca80c2d10 0x7fcca814d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:28.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fcca6d9d640 1 -- 172.21.15.133:0/3524848039 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcca80c2d10 msgr2=0x7fcca814d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:28.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fcca6d9d640 1 --2- 172.21.15.133:0/3524848039 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcca80c2d10 0x7fcca814d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fcca6d9d640 1 -- 172.21.15.133:0/3524848039 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcca80c07b0 msgr2=0x7fcca8071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:28.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fcca6d9d640 1 --2- 172.21.15.133:0/3524848039 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcca80c07b0 0x7fcca8071580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:28.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fcca6d9d640 1 -- 172.21.15.133:0/3524848039 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcca0009b30 con 0x7fcca814f9f0 2023-12-19T19:00:28.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fcca6d9d640 1 --2- 172.21.15.133:0/3524848039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcca814f9f0 0x7fcca814b620 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fcca0019520 tx=0x7fcca00196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:28.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fcc96ffd640 1 -- 172.21.15.133:0/3524848039 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca00b8670 con 0x7fcca814f9f0 2023-12-19T19:00:28.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fcc96ffd640 1 -- 172.21.15.133:0/3524848039 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcca00b87d0 con 0x7fcca814f9f0 2023-12-19T19:00:28.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fcc96ffd640 1 -- 172.21.15.133:0/3524848039 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcca00b8b40 con 0x7fcca814f9f0 2023-12-19T19:00:28.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fccacdaa640 1 -- 172.21.15.133:0/3524848039 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcca8071ef0 con 0x7fcca814f9f0 2023-12-19T19:00:28.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fccacdaa640 1 -- 172.21.15.133:0/3524848039 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcca814c380 con 0x7fcca814f9f0 2023-12-19T19:00:28.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fccacdaa640 1 -- 172.21.15.133:0/3524848039 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca8068400 con 0x7fcca814f9f0 2023-12-19T19:00:28.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.878+0000 7fcc96ffd640 1 -- 172.21.15.133:0/3524848039 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fcca00b8ca0 con 0x7fcca814f9f0 2023-12-19T19:00:28.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.882+0000 7fcc96ffd640 1 --2- 172.21.15.133:0/3524848039 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcc88066470 0x7fcc88068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:28.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.882+0000 7fcc96ffd640 1 -- 172.21.15.133:0/3524848039 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcca011f210 con 0x7fcca814f9f0 2023-12-19T19:00:28.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.882+0000 7fcca659c640 1 --2- 172.21.15.133:0/3524848039 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcc88066470 0x7fcc88068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:28.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.882+0000 7fcca659c640 1 --2- 172.21.15.133:0/3524848039 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcc88066470 0x7fcc88068930 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcc98009b60 tx=0x7fcc98009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:28.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:28.886+0000 7fcc96ffd640 1 -- 172.21.15.133:0/3524848039 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fcca00eca60 con 0x7fcca814f9f0 2023-12-19T19:00:29.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:29.038+0000 7fccacdaa640 1 -- 172.21.15.133:0/3524848039 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcca81ee870 con 0x7fcca814f9f0 2023-12-19T19:00:29.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:29.950+0000 7fcc96ffd640 1 -- 172.21.15.133:0/3524848039 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v47) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcca00f0080 con 0x7fcca814f9f0 2023-12-19T19:00:29.955 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2023-12-19T19:00:29.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:29.954+0000 7fccacdaa640 1 -- 172.21.15.133:0/3524848039 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcc88066470 msgr2=0x7fcc88068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:29.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:29.954+0000 7fccacdaa640 1 --2- 172.21.15.133:0/3524848039 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcc88066470 0x7fcc88068930 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcc98009b60 tx=0x7fcc98009190 comp rx=0 tx=0).stop 2023-12-19T19:00:29.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:29.954+0000 7fccacdaa640 1 -- 172.21.15.133:0/3524848039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcca814f9f0 msgr2=0x7fcca814b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:29.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:29.954+0000 7fccacdaa640 1 --2- 172.21.15.133:0/3524848039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcca814f9f0 0x7fcca814b620 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fcca0019520 tx=0x7fcca00196b0 comp rx=0 tx=0).stop 2023-12-19T19:00:29.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:29.954+0000 7fccacdaa640 1 -- 172.21.15.133:0/3524848039 shutdown_connections 2023-12-19T19:00:29.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:29.954+0000 7fccacdaa640 1 --2- 172.21.15.133:0/3524848039 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcc88066470 0x7fcc88068930 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:29.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:29.954+0000 7fccacdaa640 1 --2- 172.21.15.133:0/3524848039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcca814f9f0 0x7fcca814b620 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:29.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:29.954+0000 7fccacdaa640 1 --2- 172.21.15.133:0/3524848039 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcca80c2d10 0x7fcca814d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:29.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:29.954+0000 7fccacdaa640 1 --2- 172.21.15.133:0/3524848039 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcca80c07b0 0x7fcca8071580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:29.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:29.954+0000 7fccacdaa640 1 -- 172.21.15.133:0/3524848039 >> 172.21.15.133:0/3524848039 conn(0x7fcca80c5d40 msgr2=0x7fcca814a210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:29.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:29.954+0000 7fccacdaa640 1 -- 172.21.15.133:0/3524848039 shutdown_connections 2023-12-19T19:00:29.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:29.954+0000 7fccacdaa640 1 -- 172.21.15.133:0/3524848039 wait complete. 2023-12-19T19:00:29.987 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T19:00:30.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f22357640 1 Processor -- start 2023-12-19T19:00:30.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f22357640 1 -- start start 2023-12-19T19:00:30.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f22357640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f1c0c5640 0x7f1f1c0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:30.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f22357640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f1c0c2580 con 0x7f1f1c0c5260 2023-12-19T19:00:30.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f22357640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f1c0c1a00 con 0x7f1f1c0c60f0 2023-12-19T19:00:30.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f22357640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c153510 con 0x7f1f1c0c5640 2023-12-19T19:00:30.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f1bfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1f1c0c5260 0x7f1f1c06d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33778/0 (socket says 172.21.15.133:33778) 2023-12-19T19:00:30.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f1bfff640 1 -- 172.21.15.133:0/2197461813 learned_addr learned my addr 172.21.15.133:0/2197461813 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:30.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f1b7fe640 1 --2- 172.21.15.133:0/2197461813 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f1c0c5640 0x7f1f1c0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:30.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f1affd640 1 -- 172.21.15.133:0/2197461813 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 51269450 0 0) 0x7f1f1c0c2580 con 0x7f1f1c0c5260 2023-12-19T19:00:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f1affd640 1 -- 172.21.15.133:0/2197461813 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f04003530 con 0x7f1f1c0c5260 2023-12-19T19:00:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f1affd640 1 -- 172.21.15.133:0/2197461813 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4294718953 0 0) 0x7f1f04003530 con 0x7f1f1c0c5260 2023-12-19T19:00:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f1affd640 1 -- 172.21.15.133:0/2197461813 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f1c0c5640 msgr2=0x7f1f1c0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f1affd640 1 --2- 172.21.15.133:0/2197461813 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f1c0c5640 0x7f1f1c0c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f1affd640 1 -- 172.21.15.133:0/2197461813 >> v1:172.21.15.138:6789/0 conn(0x7f1f1c0c60f0 legacy=0x7f1f1c155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f1affd640 1 -- 172.21.15.133:0/2197461813 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1c0c1ce0 con 0x7f1f1c0c5260 2023-12-19T19:00:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f1affd640 1 -- 172.21.15.133:0/2197461813 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f1f0c001680 con 0x7f1f1c0c5260 2023-12-19T19:00:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f1affd640 1 -- 172.21.15.133:0/2197461813 >> v1:172.21.15.133:6789/0 conn(0x7f1f1c0c5260 legacy=0x7f1f1c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f1affd640 1 --2- 172.21.15.133:0/2197461813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f040039b0 0x7f1f04003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f1affd640 1 --2- 172.21.15.133:0/2197461813 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f1c0c5640 0x7f1f040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f1affd640 1 --2- 172.21.15.133:0/2197461813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f04004d10 0x7f1f04005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f1affd640 1 -- 172.21.15.133:0/2197461813 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0400ba40 con 0x7f1f04004d10 2023-12-19T19:00:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f1affd640 1 -- 172.21.15.133:0/2197461813 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0400bb80 con 0x7f1f040039b0 2023-12-19T19:00:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f1affd640 1 -- 172.21.15.133:0/2197461813 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0400bd40 con 0x7f1f1c0c5640 2023-12-19T19:00:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f208f4640 1 --2- 172.21.15.133:0/2197461813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f04004d10 0x7f1f04005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:30.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f1bfff640 1 --2- 172.21.15.133:0/2197461813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f040039b0 0x7f1f04003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:30.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f1b7fe640 1 --2- 172.21.15.133:0/2197461813 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f1c0c5640 0x7f1f040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:30.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f208f4640 1 -- 172.21.15.133:0/2197461813 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f1c0c5640 msgr2=0x7f1f040047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:30.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f208f4640 1 --2- 172.21.15.133:0/2197461813 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f1c0c5640 0x7f1f040047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:30.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f208f4640 1 -- 172.21.15.133:0/2197461813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f040039b0 msgr2=0x7f1f04003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:30.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f208f4640 1 --2- 172.21.15.133:0/2197461813 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f040039b0 0x7f1f04003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:30.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.134+0000 7f1f208f4640 1 -- 172.21.15.133:0/2197461813 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f04003530 con 0x7f1f04004d10 2023-12-19T19:00:30.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.138+0000 7f1f208f4640 1 --2- 172.21.15.133:0/2197461813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f04004d10 0x7f1f04005190 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1f14001f60 tx=0x7f1f1401c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7411478f649edd48 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:30.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.138+0000 7f1f1affd640 1 -- 172.21.15.133:0/2197461813 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f140a6650 con 0x7f1f04004d10 2023-12-19T19:00:30.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.138+0000 7f1f1affd640 1 -- 172.21.15.133:0/2197461813 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f140a67b0 con 0x7f1f04004d10 2023-12-19T19:00:30.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.138+0000 7f1f1affd640 1 -- 172.21.15.133:0/2197461813 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f140a6b60 con 0x7f1f04004d10 2023-12-19T19:00:30.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.138+0000 7f1f22357640 1 -- 172.21.15.133:0/2197461813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f04004d10 msgr2=0x7f1f04005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:30.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.138+0000 7f1f22357640 1 --2- 172.21.15.133:0/2197461813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f04004d10 0x7f1f04005190 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f1f14001f60 tx=0x7f1f1401c860 comp rx=0 tx=0).stop 2023-12-19T19:00:30.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.138+0000 7f1f208f4640 1 -- 172.21.15.133:0/2197461813 reap_dead start 2023-12-19T19:00:30.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.138+0000 7f1f22357640 1 -- 172.21.15.133:0/2197461813 shutdown_connections 2023-12-19T19:00:30.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.138+0000 7f1f22357640 1 -- 172.21.15.133:0/2197461813 >> 172.21.15.133:0/2197461813 conn(0x7f1f1c06a5b0 msgr2=0x7f1f1c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:30.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.138+0000 7f1f22357640 1 -- 172.21.15.133:0/2197461813 shutdown_connections 2023-12-19T19:00:30.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.138+0000 7f1f22357640 1 -- 172.21.15.133:0/2197461813 wait complete. 2023-12-19T19:00:30.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f22357640 1 Processor -- start 2023-12-19T19:00:30.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f22357640 1 -- start start 2023-12-19T19:00:30.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f22357640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f04004d10 0x7f1f1c0a8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:30.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f22357640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f1c071e40 0x7f1f1c14cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:30.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f22357640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f1c1ed000 0x7f1f1c0712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:30.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f22357640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c0a9910 con 0x7f1f04004d10 2023-12-19T19:00:30.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f22357640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c1f0f30 con 0x7f1f1c1ed000 2023-12-19T19:00:30.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f22357640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f1c14c550 con 0x7f1f1c071e40 2023-12-19T19:00:30.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f1bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f04004d10 0x7f1f1c0a8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:30.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f1bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f04004d10 0x7f1f1c0a8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37368/0 (socket says 172.21.15.133:37368) 2023-12-19T19:00:30.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f1bfff640 1 -- 172.21.15.133:0/3628205670 learned_addr learned my addr 172.21.15.133:0/3628205670 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:30.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f1b7fe640 1 --2- 172.21.15.133:0/3628205670 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f1c071e40 0x7f1f1c14cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:30.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f208f4640 1 --2- 172.21.15.133:0/3628205670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f1c1ed000 0x7f1f1c0712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:30.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f1bfff640 1 -- 172.21.15.133:0/3628205670 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f1c071e40 msgr2=0x7f1f1c14cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:30.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f1bfff640 1 --2- 172.21.15.133:0/3628205670 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f1c071e40 0x7f1f1c14cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:30.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f1bfff640 1 -- 172.21.15.133:0/3628205670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f1c1ed000 msgr2=0x7f1f1c0712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:30.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f1bfff640 1 --2- 172.21.15.133:0/3628205670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f1c1ed000 0x7f1f1c0712b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:30.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f1bfff640 1 -- 172.21.15.133:0/3628205670 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f1c1f1490 con 0x7f1f04004d10 2023-12-19T19:00:30.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f208f4640 1 --2- 172.21.15.133:0/3628205670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f1c1ed000 0x7f1f1c0712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:30.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f1bfff640 1 --2- 172.21.15.133:0/3628205670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f04004d10 0x7f1f1c0a8dc0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c007290 tx=0x7f1f0c007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:30.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f18ff9640 1 -- 172.21.15.133:0/3628205670 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c001440 con 0x7f1f04004d10 2023-12-19T19:00:30.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f18ff9640 1 -- 172.21.15.133:0/3628205670 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f0c00f960 con 0x7f1f04004d10 2023-12-19T19:00:30.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f18ff9640 1 -- 172.21.15.133:0/3628205670 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f0c00fd10 con 0x7f1f04004d10 2023-12-19T19:00:30.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f22357640 1 -- 172.21.15.133:0/3628205670 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f1c14c270 con 0x7f1f04004d10 2023-12-19T19:00:30.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f22357640 1 -- 172.21.15.133:0/3628205670 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f1c1f1120 con 0x7f1f04004d10 2023-12-19T19:00:30.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.142+0000 7f1f22357640 1 -- 172.21.15.133:0/3628205670 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f1c1f12e0 con 0x7f1f04004d10 2023-12-19T19:00:30.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.146+0000 7f1f18ff9640 1 -- 172.21.15.133:0/3628205670 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1f0c01d460 con 0x7f1f04004d10 2023-12-19T19:00:30.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.146+0000 7f1f18ff9640 1 --2- 172.21.15.133:0/3628205670 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f080664a0 0x7f1f08068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:30.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.146+0000 7f1f18ff9640 1 -- 172.21.15.133:0/3628205670 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f1f0c083cb0 con 0x7f1f04004d10 2023-12-19T19:00:30.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.146+0000 7f1f1b7fe640 1 --2- 172.21.15.133:0/3628205670 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f080664a0 0x7f1f08068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:30.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.146+0000 7f1f1b7fe640 1 --2- 172.21.15.133:0/3628205670 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f080664a0 0x7f1f08068960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c0aa4a0 tx=0x7f1f10009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:30.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.150+0000 7f1f18ff9640 1 -- 172.21.15.133:0/3628205670 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1f0c051300 con 0x7f1f04004d10 2023-12-19T19:00:30.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.314+0000 7f1f22357640 1 -- 172.21.15.133:0/3628205670 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1f1c0aab20 con 0x7f1f04004d10 2023-12-19T19:00:30.363 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-12-19T19:00:30.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.958+0000 7f1f18ff9640 1 -- 172.21.15.133:0/3628205670 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v48) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1f1c0aab20 con 0x7f1f04004d10 2023-12-19T19:00:30.963 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2023-12-19T19:00:30.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.962+0000 7f1f22357640 1 -- 172.21.15.133:0/3628205670 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f080664a0 msgr2=0x7f1f08068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:30.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.962+0000 7f1f22357640 1 --2- 172.21.15.133:0/3628205670 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f080664a0 0x7f1f08068960 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c0aa4a0 tx=0x7f1f10009190 comp rx=0 tx=0).stop 2023-12-19T19:00:30.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.962+0000 7f1f22357640 1 -- 172.21.15.133:0/3628205670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f04004d10 msgr2=0x7f1f1c0a8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:30.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.962+0000 7f1f22357640 1 --2- 172.21.15.133:0/3628205670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f04004d10 0x7f1f1c0a8dc0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c007290 tx=0x7f1f0c007690 comp rx=0 tx=0).stop 2023-12-19T19:00:30.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.962+0000 7f1f22357640 1 -- 172.21.15.133:0/3628205670 shutdown_connections 2023-12-19T19:00:30.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.962+0000 7f1f22357640 1 --2- 172.21.15.133:0/3628205670 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f080664a0 0x7f1f08068960 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:30.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.962+0000 7f1f22357640 1 --2- 172.21.15.133:0/3628205670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1f1c1ed000 0x7f1f1c0712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:30.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.962+0000 7f1f22357640 1 --2- 172.21.15.133:0/3628205670 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1f1c071e40 0x7f1f1c14cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:30.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.962+0000 7f1f22357640 1 --2- 172.21.15.133:0/3628205670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f04004d10 0x7f1f1c0a8dc0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:30.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.962+0000 7f1f22357640 1 -- 172.21.15.133:0/3628205670 >> 172.21.15.133:0/3628205670 conn(0x7f1f1c06a5b0 msgr2=0x7f1f1c14f290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:30.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.962+0000 7f1f22357640 1 -- 172.21.15.133:0/3628205670 shutdown_connections 2023-12-19T19:00:30.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:30.962+0000 7f1f22357640 1 -- 172.21.15.133:0/3628205670 wait complete. 2023-12-19T19:00:30.999 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T19:00:31.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8e0799d640 1 Processor -- start 2023-12-19T19:00:31.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8e0799d640 1 -- start start 2023-12-19T19:00:31.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8e0799d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e000c5260 0x7f8e0006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:31.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8e0799d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e00156960 con 0x7f8e000c5640 2023-12-19T19:00:31.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8e0799d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e000c2580 con 0x7f8e00155de0 2023-12-19T19:00:31.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8e0799d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e00153510 con 0x7f8e000c5260 2023-12-19T19:00:31.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8e04f38640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8e000c5640 0x7f8e000c5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33786/0 (socket says 172.21.15.133:33786) 2023-12-19T19:00:31.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8e04f38640 1 -- 172.21.15.133:0/205464662 learned_addr learned my addr 172.21.15.133:0/205464662 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:31.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8e05739640 1 --2- 172.21.15.133:0/205464662 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e000c5260 0x7f8e0006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:31.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8df7fff640 1 -- 172.21.15.133:0/205464662 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2862475834 0 0) 0x7f8df0001120 con 0x7f8e000c5640 2023-12-19T19:00:31.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8df7fff640 1 -- 172.21.15.133:0/205464662 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dec003530 con 0x7f8e000c5640 2023-12-19T19:00:31.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8df7fff640 1 -- 172.21.15.133:0/205464662 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3636130702 0 0) 0x7f8dec003530 con 0x7f8e000c5640 2023-12-19T19:00:31.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8df7fff640 1 -- 172.21.15.133:0/205464662 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e000c5260 msgr2=0x7f8e0006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:31.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8df7fff640 1 --2- 172.21.15.133:0/205464662 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e000c5260 0x7f8e0006d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:31.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8df7fff640 1 -- 172.21.15.133:0/205464662 >> v1:172.21.15.138:6789/0 conn(0x7f8e00155de0 legacy=0x7f8e00156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:31.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8df7fff640 1 -- 172.21.15.133:0/205464662 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e000c1a00 con 0x7f8e000c5640 2023-12-19T19:00:31.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8df7fff640 1 -- 172.21.15.133:0/205464662 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f8df0001830 con 0x7f8e000c5640 2023-12-19T19:00:31.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8df7fff640 1 -- 172.21.15.133:0/205464662 >> v1:172.21.15.133:6789/0 conn(0x7f8e000c5640 legacy=0x7f8e000c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:31.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8df7fff640 1 --2- 172.21.15.133:0/205464662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dec0039b0 0x7f8dec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:31.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8df7fff640 1 --2- 172.21.15.133:0/205464662 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e000c5260 0x7f8dec0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:31.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8df7fff640 1 --2- 172.21.15.133:0/205464662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8dec004d10 0x7f8dec005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:31.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8df7fff640 1 -- 172.21.15.133:0/205464662 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec00bb20 con 0x7f8dec0039b0 2023-12-19T19:00:31.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8df7fff640 1 -- 172.21.15.133:0/205464662 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec00bc60 con 0x7f8dec004d10 2023-12-19T19:00:31.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8df7fff640 1 -- 172.21.15.133:0/205464662 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec00be20 con 0x7f8e000c5260 2023-12-19T19:00:31.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8e05739640 1 --2- 172.21.15.133:0/205464662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dec0039b0 0x7f8dec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:31.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8e04f38640 1 --2- 172.21.15.133:0/205464662 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e000c5260 0x7f8dec0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:31.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8e05f3a640 1 --2- 172.21.15.133:0/205464662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8dec004d10 0x7f8dec005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:31.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8e05739640 1 -- 172.21.15.133:0/205464662 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e000c5260 msgr2=0x7f8dec0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:31.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8e05739640 1 --2- 172.21.15.133:0/205464662 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e000c5260 0x7f8dec0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:31.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8e05739640 1 -- 172.21.15.133:0/205464662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8dec004d10 msgr2=0x7f8dec005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:31.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8e05739640 1 --2- 172.21.15.133:0/205464662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8dec004d10 0x7f8dec005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:31.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8e05739640 1 -- 172.21.15.133:0/205464662 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dec003530 con 0x7f8dec0039b0 2023-12-19T19:00:31.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.138+0000 7f8e05f3a640 1 --2- 172.21.15.133:0/205464662 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8dec004d10 0x7f8dec005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:31.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.142+0000 7f8e05739640 1 --2- 172.21.15.133:0/205464662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dec0039b0 0x7f8dec003dd0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc009ae0 tx=0x7f8dfc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350a124bfc46e7ac server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:31.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.142+0000 7f8df7fff640 1 -- 172.21.15.133:0/205464662 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc0a5510 con 0x7f8dec0039b0 2023-12-19T19:00:31.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.142+0000 7f8df7fff640 1 -- 172.21.15.133:0/205464662 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dfc0a5670 con 0x7f8dec0039b0 2023-12-19T19:00:31.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.142+0000 7f8df7fff640 1 -- 172.21.15.133:0/205464662 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc0a5a20 con 0x7f8dec0039b0 2023-12-19T19:00:31.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.142+0000 7f8e0799d640 1 -- 172.21.15.133:0/205464662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dec0039b0 msgr2=0x7f8dec003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:31.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.142+0000 7f8e0799d640 1 --2- 172.21.15.133:0/205464662 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dec0039b0 0x7f8dec003dd0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc009ae0 tx=0x7f8dfc01ca50 comp rx=0 tx=0).stop 2023-12-19T19:00:31.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.142+0000 7f8e05f3a640 1 -- 172.21.15.133:0/205464662 reap_dead start 2023-12-19T19:00:31.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.142+0000 7f8e0799d640 1 -- 172.21.15.133:0/205464662 shutdown_connections 2023-12-19T19:00:31.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.142+0000 7f8e0799d640 1 -- 172.21.15.133:0/205464662 >> 172.21.15.133:0/205464662 conn(0x7f8e0006a5b0 msgr2=0x7f8e0006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:31.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.142+0000 7f8e0799d640 1 -- 172.21.15.133:0/205464662 shutdown_connections 2023-12-19T19:00:31.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.142+0000 7f8e0799d640 1 -- 172.21.15.133:0/205464662 wait complete. 2023-12-19T19:00:31.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8e0799d640 1 Processor -- start 2023-12-19T19:00:31.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8e0799d640 1 -- start start 2023-12-19T19:00:31.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8e0799d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dec0039b0 0x7f8e00153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:31.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8e0799d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e000a7a50 0x7f8e001540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:31.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8e0799d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e000a7e80 0x7f8e001519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:31.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8e0799d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e001e9050 con 0x7f8dec0039b0 2023-12-19T19:00:31.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8e0799d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e001e9580 con 0x7f8e000a7a50 2023-12-19T19:00:31.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8e0799d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e00153530 con 0x7f8e000a7e80 2023-12-19T19:00:31.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8e05739640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dec0039b0 0x7f8e00153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:31.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8e05739640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dec0039b0 0x7f8e00153bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37384/0 (socket says 172.21.15.133:37384) 2023-12-19T19:00:31.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8e05739640 1 -- 172.21.15.133:0/3857146426 learned_addr learned my addr 172.21.15.133:0/3857146426 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:31.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8e04f38640 1 --2- 172.21.15.133:0/3857146426 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e000a7a50 0x7f8e001540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:31.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8e05f3a640 1 --2- 172.21.15.133:0/3857146426 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e000a7e80 0x7f8e001519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:31.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8e05739640 1 -- 172.21.15.133:0/3857146426 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e000a7e80 msgr2=0x7f8e001519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:31.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8e05739640 1 --2- 172.21.15.133:0/3857146426 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e000a7e80 0x7f8e001519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:31.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8e05739640 1 -- 172.21.15.133:0/3857146426 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e000a7a50 msgr2=0x7f8e001540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:31.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8e05739640 1 --2- 172.21.15.133:0/3857146426 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e000a7a50 0x7f8e001540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:31.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8e05739640 1 -- 172.21.15.133:0/3857146426 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e001546d0 con 0x7f8dec0039b0 2023-12-19T19:00:31.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8e04f38640 1 --2- 172.21.15.133:0/3857146426 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e000a7a50 0x7f8e001540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:31.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8e05739640 1 --2- 172.21.15.133:0/3857146426 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dec0039b0 0x7f8e00153bb0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc01c880 tx=0x7f8dec005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:31.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8df5ffb640 1 -- 172.21.15.133:0/3857146426 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc004020 con 0x7f8dec0039b0 2023-12-19T19:00:31.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8df5ffb640 1 -- 172.21.15.133:0/3857146426 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dfc004180 con 0x7f8dec0039b0 2023-12-19T19:00:31.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8df5ffb640 1 -- 172.21.15.133:0/3857146426 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc0044f0 con 0x7f8dec0039b0 2023-12-19T19:00:31.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.146+0000 7f8e0799d640 1 -- 172.21.15.133:0/3857146426 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e001e92a0 con 0x7f8dec0039b0 2023-12-19T19:00:31.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.150+0000 7f8e0799d640 1 -- 172.21.15.133:0/3857146426 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e00151f20 con 0x7f8dec0039b0 2023-12-19T19:00:31.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.150+0000 7f8e0799d640 1 -- 172.21.15.133:0/3857146426 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e00068400 con 0x7f8dec0039b0 2023-12-19T19:00:31.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.150+0000 7f8df5ffb640 1 -- 172.21.15.133:0/3857146426 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8dfc0b4040 con 0x7f8dec0039b0 2023-12-19T19:00:31.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.150+0000 7f8df5ffb640 1 --2- 172.21.15.133:0/3857146426 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8de4066470 0x7f8de4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:31.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.150+0000 7f8df5ffb640 1 -- 172.21.15.133:0/3857146426 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f8dfc11da50 con 0x7f8dec0039b0 2023-12-19T19:00:31.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.150+0000 7f8e04f38640 1 --2- 172.21.15.133:0/3857146426 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8de4066470 0x7f8de4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:31.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.154+0000 7f8e04f38640 1 --2- 172.21.15.133:0/3857146426 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8de4066470 0x7f8de4068930 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8df00012c0 tx=0x7f8df0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:31.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.154+0000 7f8df5ffb640 1 -- 172.21.15.133:0/3857146426 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8dfc0eaf20 con 0x7f8dec0039b0 2023-12-19T19:00:31.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.338+0000 7f8e0799d640 1 -- 172.21.15.133:0/3857146426 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8e0006d390 con 0x7f8dec0039b0 2023-12-19T19:00:31.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.962+0000 7f8df5ffb640 1 -- 172.21.15.133:0/3857146426 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v29) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8dfc0a5e60 con 0x7f8dec0039b0 2023-12-19T19:00:31.966 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 8 and data pool 9 2023-12-19T19:00:31.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.966+0000 7f8e0799d640 1 -- 172.21.15.133:0/3857146426 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8de4066470 msgr2=0x7f8de4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:31.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.966+0000 7f8e0799d640 1 --2- 172.21.15.133:0/3857146426 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8de4066470 0x7f8de4068930 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8df00012c0 tx=0x7f8df0009040 comp rx=0 tx=0).stop 2023-12-19T19:00:31.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.966+0000 7f8e0799d640 1 -- 172.21.15.133:0/3857146426 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dec0039b0 msgr2=0x7f8e00153bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:31.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.966+0000 7f8e0799d640 1 --2- 172.21.15.133:0/3857146426 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dec0039b0 0x7f8e00153bb0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc01c880 tx=0x7f8dec005800 comp rx=0 tx=0).stop 2023-12-19T19:00:31.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.966+0000 7f8e0799d640 1 -- 172.21.15.133:0/3857146426 shutdown_connections 2023-12-19T19:00:31.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.966+0000 7f8e0799d640 1 --2- 172.21.15.133:0/3857146426 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8de4066470 0x7f8de4068930 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:31.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.966+0000 7f8e0799d640 1 --2- 172.21.15.133:0/3857146426 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8e000a7e80 0x7f8e001519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:31.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.966+0000 7f8e0799d640 1 --2- 172.21.15.133:0/3857146426 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8e000a7a50 0x7f8e001540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:31.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.966+0000 7f8e0799d640 1 --2- 172.21.15.133:0/3857146426 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dec0039b0 0x7f8e00153bb0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:31.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.966+0000 7f8e0799d640 1 -- 172.21.15.133:0/3857146426 >> 172.21.15.133:0/3857146426 conn(0x7f8e0006a5b0 msgr2=0x7f8e00156250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:31.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.966+0000 7f8e0799d640 1 -- 172.21.15.133:0/3857146426 shutdown_connections 2023-12-19T19:00:31.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:31.966+0000 7f8e0799d640 1 -- 172.21.15.133:0/3857146426 wait complete. 2023-12-19T19:00:32.016 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:00:32.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.150+0000 7f64fbf2a640 1 Processor -- start 2023-12-19T19:00:32.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.150+0000 7f64fbf2a640 1 -- start start 2023-12-19T19:00:32.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64fbf2a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64f406d520 0x7f64f415ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:32.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64fbf2a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f415c600 con 0x7f64f41560e0 2023-12-19T19:00:32.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64fbf2a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f415a5c0 con 0x7f64f40bffc0 2023-12-19T19:00:32.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64fbf2a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f41594e0 con 0x7f64f406d520 2023-12-19T19:00:32.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f9cc6640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f64f41560e0 0x7f64f4159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33800/0 (socket says 172.21.15.133:33800) 2023-12-19T19:00:32.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f9cc6640 1 -- 172.21.15.133:0/1386836838 learned_addr learned my addr 172.21.15.133:0/1386836838 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:32.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f94c5640 1 --2- 172.21.15.133:0/1386836838 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64f406d520 0x7f64f415ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:32.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f8cc4640 1 -- 172.21.15.133:0/1386836838 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213483713 0 0) 0x7f64f415c600 con 0x7f64f41560e0 2023-12-19T19:00:32.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f8cc4640 1 -- 172.21.15.133:0/1386836838 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64e0003530 con 0x7f64f41560e0 2023-12-19T19:00:32.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f8cc4640 1 -- 172.21.15.133:0/1386836838 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2448013879 0 0) 0x7f64f415a5c0 con 0x7f64f40bffc0 2023-12-19T19:00:32.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f8cc4640 1 -- 172.21.15.133:0/1386836838 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64f415c600 con 0x7f64f40bffc0 2023-12-19T19:00:32.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f8cc4640 1 -- 172.21.15.133:0/1386836838 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2768473562 0 0) 0x7f64e0003530 con 0x7f64f41560e0 2023-12-19T19:00:32.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f8cc4640 1 -- 172.21.15.133:0/1386836838 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64f406d520 msgr2=0x7f64f415ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:32.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f8cc4640 1 --2- 172.21.15.133:0/1386836838 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64f406d520 0x7f64f415ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:32.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f8cc4640 1 -- 172.21.15.133:0/1386836838 >> v1:172.21.15.138:6789/0 conn(0x7f64f40bffc0 legacy=0x7f64f40c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:32.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f8cc4640 1 -- 172.21.15.133:0/1386836838 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f41597c0 con 0x7f64f41560e0 2023-12-19T19:00:32.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f8cc4640 1 -- 172.21.15.133:0/1386836838 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f64f0001680 con 0x7f64f41560e0 2023-12-19T19:00:32.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f8cc4640 1 -- 172.21.15.133:0/1386836838 >> v1:172.21.15.133:6789/0 conn(0x7f64f41560e0 legacy=0x7f64f4159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:32.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f8cc4640 1 --2- 172.21.15.133:0/1386836838 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64f406d520 0x7f64e0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:32.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f8cc4640 1 --2- 172.21.15.133:0/1386836838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64e00040a0 0x7f64e00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:32.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f8cc4640 1 --2- 172.21.15.133:0/1386836838 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64e0004d10 0x7f64e0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:32.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f8cc4640 1 -- 172.21.15.133:0/1386836838 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f41594e0 con 0x7f64e00040a0 2023-12-19T19:00:32.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f8cc4640 1 -- 172.21.15.133:0/1386836838 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e000ba70 con 0x7f64e0004d10 2023-12-19T19:00:32.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f8cc4640 1 -- 172.21.15.133:0/1386836838 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e000bc30 con 0x7f64f406d520 2023-12-19T19:00:32.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f94c5640 1 --2- 172.21.15.133:0/1386836838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64e00040a0 0x7f64e00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:32.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f9cc6640 1 --2- 172.21.15.133:0/1386836838 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64f406d520 0x7f64e0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:32.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64fa4c7640 1 --2- 172.21.15.133:0/1386836838 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64e0004d10 0x7f64e0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:32.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f94c5640 1 -- 172.21.15.133:0/1386836838 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64f406d520 msgr2=0x7f64e0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:32.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f94c5640 1 --2- 172.21.15.133:0/1386836838 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64f406d520 0x7f64e0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:32.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f94c5640 1 -- 172.21.15.133:0/1386836838 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64e0004d10 msgr2=0x7f64e0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:32.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f94c5640 1 --2- 172.21.15.133:0/1386836838 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64e0004d10 0x7f64e0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:32.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.154+0000 7f64f94c5640 1 -- 172.21.15.133:0/1386836838 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e0003530 con 0x7f64e00040a0 2023-12-19T19:00:32.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.158+0000 7f64f94c5640 1 --2- 172.21.15.133:0/1386836838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64e00040a0 0x7f64e00047d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f64e4009ab0 tx=0x7f64e401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6fc9fb02ae2e20 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:32.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.158+0000 7f64f8cc4640 1 -- 172.21.15.133:0/1386836838 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e40a5620 con 0x7f64e00040a0 2023-12-19T19:00:32.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.158+0000 7f64f8cc4640 1 -- 172.21.15.133:0/1386836838 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64e40a5780 con 0x7f64e00040a0 2023-12-19T19:00:32.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.158+0000 7f64f8cc4640 1 -- 172.21.15.133:0/1386836838 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64e40a5b30 con 0x7f64e00040a0 2023-12-19T19:00:32.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.158+0000 7f64fbf2a640 1 -- 172.21.15.133:0/1386836838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64e00040a0 msgr2=0x7f64e00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:32.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.158+0000 7f64fbf2a640 1 --2- 172.21.15.133:0/1386836838 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64e00040a0 0x7f64e00047d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f64e4009ab0 tx=0x7f64e401ca30 comp rx=0 tx=0).stop 2023-12-19T19:00:32.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.158+0000 7f64fa4c7640 1 -- 172.21.15.133:0/1386836838 reap_dead start 2023-12-19T19:00:32.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.158+0000 7f64fbf2a640 1 -- 172.21.15.133:0/1386836838 shutdown_connections 2023-12-19T19:00:32.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.158+0000 7f64fbf2a640 1 -- 172.21.15.133:0/1386836838 >> 172.21.15.133:0/1386836838 conn(0x7f64f406a5b0 msgr2=0x7f64f406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:32.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.158+0000 7f64fbf2a640 1 -- 172.21.15.133:0/1386836838 shutdown_connections 2023-12-19T19:00:32.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.158+0000 7f64fbf2a640 1 -- 172.21.15.133:0/1386836838 wait complete. 2023-12-19T19:00:32.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.158+0000 7f64fbf2a640 1 Processor -- start 2023-12-19T19:00:32.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.158+0000 7f64fbf2a640 1 -- start start 2023-12-19T19:00:32.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.162+0000 7f64fbf2a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64e00040a0 0x7f64f40a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:32.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.162+0000 7f64fbf2a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64f40aa5d0 0x7f64f40a7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:32.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.162+0000 7f64fbf2a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64f40a7770 0x7f64f4154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:32.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.162+0000 7f64fbf2a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f40a3bc0 con 0x7f64f40a7770 2023-12-19T19:00:32.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.162+0000 7f64fbf2a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f40a5690 con 0x7f64f40aa5d0 2023-12-19T19:00:32.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.162+0000 7f64fbf2a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f41f22a0 con 0x7f64e00040a0 2023-12-19T19:00:32.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.162+0000 7f64fa4c7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64f40a7770 0x7f64f4154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:32.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.162+0000 7f64fa4c7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64f40a7770 0x7f64f4154cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37408/0 (socket says 172.21.15.133:37408) 2023-12-19T19:00:32.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.162+0000 7f64fa4c7640 1 -- 172.21.15.133:0/494901759 learned_addr learned my addr 172.21.15.133:0/494901759 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:32.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.162+0000 7f64f94c5640 1 --2- 172.21.15.133:0/494901759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64f40aa5d0 0x7f64f40a7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:32.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.162+0000 7f64f9cc6640 1 --2- 172.21.15.133:0/494901759 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64e00040a0 0x7f64f40a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:32.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.162+0000 7f64fa4c7640 1 -- 172.21.15.133:0/494901759 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64e00040a0 msgr2=0x7f64f40a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:32.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.162+0000 7f64fa4c7640 1 --2- 172.21.15.133:0/494901759 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64e00040a0 0x7f64f40a84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:32.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.162+0000 7f64fa4c7640 1 -- 172.21.15.133:0/494901759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64f40aa5d0 msgr2=0x7f64f40a7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:32.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.162+0000 7f64fa4c7640 1 --2- 172.21.15.133:0/494901759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64f40aa5d0 0x7f64f40a7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:32.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.162+0000 7f64fa4c7640 1 -- 172.21.15.133:0/494901759 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f40ab280 con 0x7f64f40a7770 2023-12-19T19:00:32.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.162+0000 7f64fa4c7640 1 --2- 172.21.15.133:0/494901759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64f40a7770 0x7f64f4154cb0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f64f40c3840 tx=0x7f64ec00f170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:32.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.162+0000 7f64ea7fc640 1 -- 172.21.15.133:0/494901759 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec00fcc0 con 0x7f64f40a7770 2023-12-19T19:00:32.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.162+0000 7f64ea7fc640 1 -- 172.21.15.133:0/494901759 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec00fe60 con 0x7f64f40a7770 2023-12-19T19:00:32.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.162+0000 7f64ea7fc640 1 -- 172.21.15.133:0/494901759 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec015650 con 0x7f64f40a7770 2023-12-19T19:00:32.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.162+0000 7f64fbf2a640 1 -- 172.21.15.133:0/494901759 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f41f2540 con 0x7f64f40a7770 2023-12-19T19:00:32.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.162+0000 7f64fbf2a640 1 -- 172.21.15.133:0/494901759 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f40a53b0 con 0x7f64f40a7770 2023-12-19T19:00:32.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.162+0000 7f64fbf2a640 1 -- 172.21.15.133:0/494901759 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f4068400 con 0x7f64f40a7770 2023-12-19T19:00:32.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.166+0000 7f64ea7fc640 1 -- 172.21.15.133:0/494901759 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f64ec0157b0 con 0x7f64f40a7770 2023-12-19T19:00:32.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.166+0000 7f64ea7fc640 1 --2- 172.21.15.133:0/494901759 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f64d80664a0 0x7f64d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:32.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.166+0000 7f64ea7fc640 1 -- 172.21.15.133:0/494901759 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64ec087220 con 0x7f64f40a7770 2023-12-19T19:00:32.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.166+0000 7f64f9cc6640 1 --2- 172.21.15.133:0/494901759 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f64d80664a0 0x7f64d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:32.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.166+0000 7f64f9cc6640 1 --2- 172.21.15.133:0/494901759 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f64d80664a0 0x7f64d8068960 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f64f0001c50 tx=0x7f64f0001e30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:32.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.170+0000 7f64ea7fc640 1 -- 172.21.15.133:0/494901759 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f64ec0546b0 con 0x7f64f40a7770 2023-12-19T19:00:32.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.318+0000 7f64fbf2a640 1 -- 172.21.15.133:0/494901759 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64f40c2410 con 0x7f64f40a7770 2023-12-19T19:00:32.323 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.322+0000 7f64ea7fc640 1 -- 172.21.15.133:0/494901759 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16614 (secure 0 0 0) 0x7f64ec057cd0 con 0x7f64f40a7770 2023-12-19T19:00:32.324 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:32.324 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":49,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:00:31.341852+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:00:29.085029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T19:00:30.359577+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:00:32.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.322+0000 7f64fbf2a640 1 -- 172.21.15.133:0/494901759 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f64d80664a0 msgr2=0x7f64d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:32.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.322+0000 7f64fbf2a640 1 --2- 172.21.15.133:0/494901759 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f64d80664a0 0x7f64d8068960 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f64f0001c50 tx=0x7f64f0001e30 comp rx=0 tx=0).stop 2023-12-19T19:00:32.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.322+0000 7f64fbf2a640 1 -- 172.21.15.133:0/494901759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64f40a7770 msgr2=0x7f64f4154cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:32.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.322+0000 7f64fbf2a640 1 --2- 172.21.15.133:0/494901759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64f40a7770 0x7f64f4154cb0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f64f40c3840 tx=0x7f64ec00f170 comp rx=0 tx=0).stop 2023-12-19T19:00:32.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.322+0000 7f64fbf2a640 1 -- 172.21.15.133:0/494901759 shutdown_connections 2023-12-19T19:00:32.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.322+0000 7f64fbf2a640 1 --2- 172.21.15.133:0/494901759 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f64d80664a0 0x7f64d8068960 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:32.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.322+0000 7f64fbf2a640 1 --2- 172.21.15.133:0/494901759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64f40a7770 0x7f64f4154cb0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:32.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.322+0000 7f64fbf2a640 1 --2- 172.21.15.133:0/494901759 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64f40aa5d0 0x7f64f40a7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:32.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.322+0000 7f64fbf2a640 1 --2- 172.21.15.133:0/494901759 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64e00040a0 0x7f64f40a84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:32.326 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.322+0000 7f64fbf2a640 1 -- 172.21.15.133:0/494901759 >> 172.21.15.133:0/494901759 conn(0x7f64f406a5b0 msgr2=0x7f64f4157a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:32.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.322+0000 7f64fbf2a640 1 -- 172.21.15.133:0/494901759 shutdown_connections 2023-12-19T19:00:32.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.322+0000 7f64fbf2a640 1 -- 172.21.15.133:0/494901759 wait complete. 2023-12-19T19:00:32.346 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:00:32.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.482+0000 7f90f9e7b640 1 Processor -- start 2023-12-19T19:00:32.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.482+0000 7f90f9e7b640 1 -- start start 2023-12-19T19:00:32.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.482+0000 7f90f9e7b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f90f40c7c50 0x7f90f41544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:32.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.482+0000 7f90f9e7b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f90f4154a10 0x7f90f415ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:32.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.482+0000 7f90f9e7b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f40c8160 con 0x7f90f4151cd0 2023-12-19T19:00:32.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.482+0000 7f90f9e7b640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f4157b40 con 0x7f90f4154a10 2023-12-19T19:00:32.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.482+0000 7f90f9e7b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f4157e20 con 0x7f90f40c7c50 2023-12-19T19:00:32.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.482+0000 7f90f967a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f90f4154a10 0x7f90f415ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:32.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.482+0000 7f90f967a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f90f4154a10 0x7f90f415ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37410/0 (socket says 172.21.15.133:37410) 2023-12-19T19:00:32.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.482+0000 7f90f967a640 1 -- 172.21.15.133:0/1717739088 learned_addr learned my addr 172.21.15.133:0/1717739088 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:32.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.482+0000 7f90f3fff640 1 --2- 172.21.15.133:0/1717739088 >> v2:172.21.15.138:3300/0 conn(0x7f90f40c7c50 0x7f90f41544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:32.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.482+0000 7f90f967a640 1 -- 172.21.15.133:0/1717739088 >> v2:172.21.15.138:3300/0 conn(0x7f90f40c7c50 msgr2=0x7f90f41544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:32.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.482+0000 7f90f967a640 1 --2- 172.21.15.133:0/1717739088 >> v2:172.21.15.138:3300/0 conn(0x7f90f40c7c50 0x7f90f41544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:32.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.482+0000 7f90f967a640 1 -- 172.21.15.133:0/1717739088 >> v1:172.21.15.138:6789/0 conn(0x7f90f4151cd0 legacy=0x7f90f40ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:32.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.482+0000 7f90f967a640 1 -- 172.21.15.133:0/1717739088 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f4158100 con 0x7f90f4154a10 2023-12-19T19:00:32.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.482+0000 7f90f3fff640 1 --2- 172.21.15.133:0/1717739088 >> v2:172.21.15.138:3300/0 conn(0x7f90f40c7c50 0x7f90f41544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:32.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.486+0000 7f90f967a640 1 --2- 172.21.15.133:0/1717739088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90f4154a10 0x7f90f415ee30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f90f40ac7a0 tx=0x7f90ec01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106d963dd38f7a6d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:32.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.486+0000 7f90f37fe640 1 -- 172.21.15.133:0/1717739088 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec0a5880 con 0x7f90f4154a10 2023-12-19T19:00:32.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.486+0000 7f90f37fe640 1 -- 172.21.15.133:0/1717739088 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ec0a59e0 con 0x7f90f4154a10 2023-12-19T19:00:32.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.486+0000 7f90f37fe640 1 -- 172.21.15.133:0/1717739088 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec0a5d70 con 0x7f90f4154a10 2023-12-19T19:00:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.486+0000 7f90f9e7b640 1 -- 172.21.15.133:0/1717739088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90f4154a10 msgr2=0x7f90f415ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.486+0000 7f90f9e7b640 1 --2- 172.21.15.133:0/1717739088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90f4154a10 0x7f90f415ee30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f90f40ac7a0 tx=0x7f90ec01c9a0 comp rx=0 tx=0).stop 2023-12-19T19:00:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.486+0000 7f90f9e7b640 1 -- 172.21.15.133:0/1717739088 shutdown_connections 2023-12-19T19:00:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.486+0000 7f90f9e7b640 1 --2- 172.21.15.133:0/1717739088 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90f4154a10 0x7f90f415ee30 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.486+0000 7f90f9e7b640 1 --2- 172.21.15.133:0/1717739088 >> v2:172.21.15.138:3300/0 conn(0x7f90f40c7c50 0x7f90f41544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:32.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.486+0000 7f90f9e7b640 1 -- 172.21.15.133:0/1717739088 >> 172.21.15.133:0/1717739088 conn(0x7f90f40abee0 msgr2=0x7f90f40c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:32.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.486+0000 7f90f9e7b640 1 -- 172.21.15.133:0/1717739088 shutdown_connections 2023-12-19T19:00:32.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.486+0000 7f90f9e7b640 1 -- 172.21.15.133:0/1717739088 wait complete. 2023-12-19T19:00:32.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.486+0000 7f90f9e7b640 1 Processor -- start 2023-12-19T19:00:32.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.486+0000 7f90f9e7b640 1 -- start start 2023-12-19T19:00:32.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f9e7b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90f40c7c50 0x7f90f40a9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:32.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f9e7b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90f4151cd0 0x7f90f40aa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:32.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f9e7b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90f4154a10 0x7f90f4141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:32.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f9e7b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40a9d70 con 0x7f90f4151cd0 2023-12-19T19:00:32.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f9e7b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f4145be0 con 0x7f90f40c7c50 2023-12-19T19:00:32.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f9e7b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f4146070 con 0x7f90f4154a10 2023-12-19T19:00:32.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90f4151cd0 0x7f90f40aa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:32.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90f4151cd0 0x7f90f40aa7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37416/0 (socket says 172.21.15.133:37416) 2023-12-19T19:00:32.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f3fff640 1 -- 172.21.15.133:0/1029051225 learned_addr learned my addr 172.21.15.133:0/1029051225 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:32.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f967a640 1 --2- 172.21.15.133:0/1029051225 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90f4154a10 0x7f90f4141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:32.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f8e79640 1 --2- 172.21.15.133:0/1029051225 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90f40c7c50 0x7f90f40a9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f3fff640 1 -- 172.21.15.133:0/1029051225 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90f4154a10 msgr2=0x7f90f4141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f3fff640 1 --2- 172.21.15.133:0/1029051225 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90f4154a10 0x7f90f4141fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f3fff640 1 -- 172.21.15.133:0/1029051225 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90f40c7c50 msgr2=0x7f90f40a9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f3fff640 1 --2- 172.21.15.133:0/1029051225 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90f40c7c50 0x7f90f40a9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f3fff640 1 -- 172.21.15.133:0/1029051225 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90ec009b30 con 0x7f90f4151cd0 2023-12-19T19:00:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f8e79640 1 --2- 172.21.15.133:0/1029051225 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90f40c7c50 0x7f90f40a9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f3fff640 1 --2- 172.21.15.133:0/1029051225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90f4151cd0 0x7f90f40aa7a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f90e000d800 tx=0x7f90e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f17fa640 1 -- 172.21.15.133:0/1029051225 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e00096a0 con 0x7f90f4151cd0 2023-12-19T19:00:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f17fa640 1 -- 172.21.15.133:0/1029051225 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e0009800 con 0x7f90f4151cd0 2023-12-19T19:00:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f17fa640 1 -- 172.21.15.133:0/1029051225 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e0009bb0 con 0x7f90f4151cd0 2023-12-19T19:00:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f9e7b640 1 -- 172.21.15.133:0/1029051225 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f4144fd0 con 0x7f90f4151cd0 2023-12-19T19:00:32.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f9e7b640 1 -- 172.21.15.133:0/1029051225 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f4145590 con 0x7f90f4151cd0 2023-12-19T19:00:32.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f9e7b640 1 -- 172.21.15.133:0/1029051225 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f40c6140 con 0x7f90f4151cd0 2023-12-19T19:00:32.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.490+0000 7f90f17fa640 1 -- 172.21.15.133:0/1029051225 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f90e0009d10 con 0x7f90f4151cd0 2023-12-19T19:00:32.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.494+0000 7f90f17fa640 1 --2- 172.21.15.133:0/1029051225 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f90d80664a0 0x7f90d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:32.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.494+0000 7f90f17fa640 1 -- 172.21.15.133:0/1029051225 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90e0084290 con 0x7f90f4151cd0 2023-12-19T19:00:32.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.494+0000 7f90f8e79640 1 --2- 172.21.15.133:0/1029051225 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f90d80664a0 0x7f90d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:32.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.494+0000 7f90f8e79640 1 --2- 172.21.15.133:0/1029051225 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f90d80664a0 0x7f90d8068960 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f90f40aaf90 tx=0x7f90e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:32.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.498+0000 7f90f17fa640 1 -- 172.21.15.133:0/1029051225 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f90e0051700 con 0x7f90f4151cd0 2023-12-19T19:00:32.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.650+0000 7f90f9e7b640 1 -- 172.21.15.133:0/1029051225 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90f404e850 con 0x7f90f4151cd0 2023-12-19T19:00:32.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.650+0000 7f90f17fa640 1 -- 172.21.15.133:0/1029051225 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16614 (secure 0 0 0) 0x7f90e0054d20 con 0x7f90f4151cd0 2023-12-19T19:00:32.653 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:32.654 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":49,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:00:31.341852+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:00:29.085029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T19:00:30.359577+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:00:32.655 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.654+0000 7f90f9e7b640 1 -- 172.21.15.133:0/1029051225 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f90d80664a0 msgr2=0x7f90d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:32.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.654+0000 7f90f9e7b640 1 --2- 172.21.15.133:0/1029051225 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f90d80664a0 0x7f90d8068960 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f90f40aaf90 tx=0x7f90e8009040 comp rx=0 tx=0).stop 2023-12-19T19:00:32.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.654+0000 7f90f9e7b640 1 -- 172.21.15.133:0/1029051225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90f4151cd0 msgr2=0x7f90f40aa7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:32.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.654+0000 7f90f9e7b640 1 --2- 172.21.15.133:0/1029051225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90f4151cd0 0x7f90f40aa7a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f90e000d800 tx=0x7f90e000dcc0 comp rx=0 tx=0).stop 2023-12-19T19:00:32.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.654+0000 7f90f9e7b640 1 -- 172.21.15.133:0/1029051225 shutdown_connections 2023-12-19T19:00:32.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.654+0000 7f90f9e7b640 1 --2- 172.21.15.133:0/1029051225 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f90d80664a0 0x7f90d8068960 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:32.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.654+0000 7f90f9e7b640 1 --2- 172.21.15.133:0/1029051225 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90f4154a10 0x7f90f4141fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:32.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.654+0000 7f90f9e7b640 1 --2- 172.21.15.133:0/1029051225 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90f4151cd0 0x7f90f40aa7a0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:32.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.654+0000 7f90f9e7b640 1 --2- 172.21.15.133:0/1029051225 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90f40c7c50 0x7f90f40a9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:32.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.654+0000 7f90f9e7b640 1 -- 172.21.15.133:0/1029051225 >> 172.21.15.133:0/1029051225 conn(0x7f90f40abee0 msgr2=0x7f90f406c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:32.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.654+0000 7f90f9e7b640 1 -- 172.21.15.133:0/1029051225 shutdown_connections 2023-12-19T19:00:32.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.654+0000 7f90f9e7b640 1 -- 172.21.15.133:0/1029051225 wait complete. 2023-12-19T19:00:32.675 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T19:00:32.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.814+0000 7f17a4f0f640 1 Processor -- start 2023-12-19T19:00:32.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.814+0000 7f17a4f0f640 1 -- start start 2023-12-19T19:00:32.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.814+0000 7f17a4f0f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f17a00c4100 0x7f17a00c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:32.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.814+0000 7f17a4f0f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a00c31c0 con 0x7f17a00c06d0 2023-12-19T19:00:32.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.814+0000 7f17a4f0f640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a00c34a0 con 0x7f17a00c63c0 2023-12-19T19:00:32.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.814+0000 7f17a4f0f640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a00c1030 con 0x7f17a00c4100 2023-12-19T19:00:32.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.814+0000 7f179ed9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f17a00c06d0 0x7f17a00a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:33804/0 (socket says 172.21.15.133:33804) 2023-12-19T19:00:32.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.814+0000 7f179ed9d640 1 -- 172.21.15.133:0/1510369584 learned_addr learned my addr 172.21.15.133:0/1510369584 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:32.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.814+0000 7f1795d9b640 1 --2- 172.21.15.133:0/1510369584 >> v2:172.21.15.138:3300/0 conn(0x7f17a00c4100 0x7f17a00c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:32.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.814+0000 7f179dd9b640 1 -- 172.21.15.133:0/1510369584 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1243431851 0 0) 0x7f17a00c31c0 con 0x7f17a00c06d0 2023-12-19T19:00:32.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.814+0000 7f179dd9b640 1 -- 172.21.15.133:0/1510369584 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f178c003530 con 0x7f17a00c06d0 2023-12-19T19:00:32.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.814+0000 7f179dd9b640 1 -- 172.21.15.133:0/1510369584 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222599417 0 0) 0x7f17a00c34a0 con 0x7f17a00c63c0 2023-12-19T19:00:32.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.814+0000 7f179dd9b640 1 -- 172.21.15.133:0/1510369584 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17a00c31c0 con 0x7f17a00c63c0 2023-12-19T19:00:32.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.814+0000 7f1795d9b640 1 -- 172.21.15.133:0/1510369584 >> v1:172.21.15.138:6789/0 conn(0x7f17a00c63c0 legacy=0x7f17a00c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:32.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.814+0000 7f1795d9b640 1 -- 172.21.15.133:0/1510369584 >> v1:172.21.15.133:6789/0 conn(0x7f17a00c06d0 legacy=0x7f17a00a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:32.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.814+0000 7f1795d9b640 1 -- 172.21.15.133:0/1510369584 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a00c1310 con 0x7f17a00c4100 2023-12-19T19:00:32.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.818+0000 7f1795d9b640 1 --2- 172.21.15.133:0/1510369584 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17a00c4100 0x7f17a00c2bb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f17880097c0 tx=0x7f178801c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1849266673cbe7b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:32.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.818+0000 7f179dd9b640 1 -- 172.21.15.133:0/1510369584 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17880ab600 con 0x7f17a00c4100 2023-12-19T19:00:32.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.818+0000 7f179dd9b640 1 -- 172.21.15.133:0/1510369584 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17880a7050 con 0x7f17a00c4100 2023-12-19T19:00:32.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.818+0000 7f179dd9b640 1 -- 172.21.15.133:0/1510369584 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17880ab980 con 0x7f17a00c4100 2023-12-19T19:00:32.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.818+0000 7f17a4f0f640 1 -- 172.21.15.133:0/1510369584 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17a00c4100 msgr2=0x7f17a00c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:32.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.818+0000 7f17a4f0f640 1 --2- 172.21.15.133:0/1510369584 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17a00c4100 0x7f17a00c2bb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f17880097c0 tx=0x7f178801c360 comp rx=0 tx=0).stop 2023-12-19T19:00:32.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.818+0000 7f17a4f0f640 1 -- 172.21.15.133:0/1510369584 shutdown_connections 2023-12-19T19:00:32.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.818+0000 7f17a4f0f640 1 --2- 172.21.15.133:0/1510369584 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17a00c4100 0x7f17a00c2bb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:32.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.818+0000 7f17a4f0f640 1 -- 172.21.15.133:0/1510369584 >> 172.21.15.133:0/1510369584 conn(0x7f17a006a5b0 msgr2=0x7f17a006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:32.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.818+0000 7f17a4f0f640 1 -- 172.21.15.133:0/1510369584 shutdown_connections 2023-12-19T19:00:32.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.818+0000 7f17a4f0f640 1 -- 172.21.15.133:0/1510369584 wait complete. 2023-12-19T19:00:32.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f17a4f0f640 1 Processor -- start 2023-12-19T19:00:32.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f17a4f0f640 1 -- start start 2023-12-19T19:00:32.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f17a4f0f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a00c06d0 0x7f17a00c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:32.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f17a4f0f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17a00c4100 0x7f17a0155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:32.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f17a4f0f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17a00c63c0 0x7f17a01562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:32.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f17a4f0f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a01575e0 con 0x7f17a00c06d0 2023-12-19T19:00:32.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f17a4f0f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a0156830 con 0x7f17a00c4100 2023-12-19T19:00:32.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f17a4f0f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a015b800 con 0x7f17a00c63c0 2023-12-19T19:00:32.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f179e59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a00c06d0 0x7f17a00c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:32.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f179e59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a00c06d0 0x7f17a00c4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37430/0 (socket says 172.21.15.133:37430) 2023-12-19T19:00:32.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f179e59c640 1 -- 172.21.15.133:0/1900699853 learned_addr learned my addr 172.21.15.133:0/1900699853 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:32.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f179ed9d640 1 --2- 172.21.15.133:0/1900699853 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17a00c63c0 0x7f17a01562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:32.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f1795d9b640 1 --2- 172.21.15.133:0/1900699853 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17a00c4100 0x7f17a0155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:32.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f179e59c640 1 -- 172.21.15.133:0/1900699853 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17a00c63c0 msgr2=0x7f17a01562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:32.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f179e59c640 1 --2- 172.21.15.133:0/1900699853 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17a00c63c0 0x7f17a01562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:32.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f179e59c640 1 -- 172.21.15.133:0/1900699853 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17a00c4100 msgr2=0x7f17a0155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:32.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f179e59c640 1 --2- 172.21.15.133:0/1900699853 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17a00c4100 0x7f17a0155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:32.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f179e59c640 1 -- 172.21.15.133:0/1900699853 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1788009420 con 0x7f17a00c06d0 2023-12-19T19:00:32.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f179e59c640 1 --2- 172.21.15.133:0/1900699853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a00c06d0 0x7f17a00c4860 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f179000c430 tx=0x7f179000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:32.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f17977fe640 1 -- 172.21.15.133:0/1900699853 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17900052d0 con 0x7f17a00c06d0 2023-12-19T19:00:32.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f17977fe640 1 -- 172.21.15.133:0/1900699853 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1790005450 con 0x7f17a00c06d0 2023-12-19T19:00:32.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f17977fe640 1 -- 172.21.15.133:0/1900699853 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1790003840 con 0x7f17a00c06d0 2023-12-19T19:00:32.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f17a4f0f640 1 -- 172.21.15.133:0/1900699853 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a015bc90 con 0x7f17a00c06d0 2023-12-19T19:00:32.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.822+0000 7f17a4f0f640 1 -- 172.21.15.133:0/1900699853 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a01577f0 con 0x7f17a00c06d0 2023-12-19T19:00:32.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.826+0000 7f17a4f0f640 1 -- 172.21.15.133:0/1900699853 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a0068400 con 0x7f17a00c06d0 2023-12-19T19:00:32.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.826+0000 7f17977fe640 1 -- 172.21.15.133:0/1900699853 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f17900039a0 con 0x7f17a00c06d0 2023-12-19T19:00:32.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.826+0000 7f17977fe640 1 --2- 172.21.15.133:0/1900699853 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1780066470 0x7f1780068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:32.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.826+0000 7f17977fe640 1 -- 172.21.15.133:0/1900699853 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1790083410 con 0x7f17a00c06d0 2023-12-19T19:00:32.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.826+0000 7f1795d9b640 1 --2- 172.21.15.133:0/1900699853 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1780066470 0x7f1780068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:32.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.826+0000 7f1795d9b640 1 --2- 172.21.15.133:0/1900699853 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1780066470 0x7f1780068930 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f17880ad000 tx=0x7f1788008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:32.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:32.830+0000 7f17977fe640 1 -- 172.21.15.133:0/1900699853 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1790050940 con 0x7f17a00c06d0 2023-12-19T19:00:33.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:33.014+0000 7f17a4f0f640 1 -- 172.21.15.133:0/1900699853 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f17a00c2f00 con 0x7f17a00c06d0 2023-12-19T19:00:33.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:33.990+0000 7f17977fe640 1 -- 172.21.15.133:0/1900699853 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1790053f60 con 0x7f17a00c06d0 2023-12-19T19:00:33.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:33.994+0000 7f17a4f0f640 1 -- 172.21.15.133:0/1900699853 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1780066470 msgr2=0x7f1780068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:33.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:33.994+0000 7f17a4f0f640 1 --2- 172.21.15.133:0/1900699853 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1780066470 0x7f1780068930 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f17880ad000 tx=0x7f1788008040 comp rx=0 tx=0).stop 2023-12-19T19:00:33.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:33.994+0000 7f17a4f0f640 1 -- 172.21.15.133:0/1900699853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a00c06d0 msgr2=0x7f17a00c4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:33.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:33.994+0000 7f17a4f0f640 1 --2- 172.21.15.133:0/1900699853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a00c06d0 0x7f17a00c4860 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f179000c430 tx=0x7f179000c8f0 comp rx=0 tx=0).stop 2023-12-19T19:00:33.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:33.994+0000 7f17a4f0f640 1 -- 172.21.15.133:0/1900699853 shutdown_connections 2023-12-19T19:00:33.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:33.994+0000 7f17a4f0f640 1 --2- 172.21.15.133:0/1900699853 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1780066470 0x7f1780068930 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:33.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:33.994+0000 7f17a4f0f640 1 --2- 172.21.15.133:0/1900699853 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f17a00c63c0 0x7f17a01562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:33.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:33.994+0000 7f17a4f0f640 1 --2- 172.21.15.133:0/1900699853 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f17a00c4100 0x7f17a0155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:33.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:33.994+0000 7f17a4f0f640 1 --2- 172.21.15.133:0/1900699853 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f17a00c06d0 0x7f17a00c4860 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:33.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:33.994+0000 7f17a4f0f640 1 -- 172.21.15.133:0/1900699853 >> 172.21.15.133:0/1900699853 conn(0x7f17a006a5b0 msgr2=0x7f17a01551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:33.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:33.994+0000 7f17a4f0f640 1 -- 172.21.15.133:0/1900699853 shutdown_connections 2023-12-19T19:00:33.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:33.994+0000 7f17a4f0f640 1 -- 172.21.15.133:0/1900699853 wait complete. 2023-12-19T19:00:34.020 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T19:00:34.021 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T19:00:34.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.162+0000 7f569fd1d640 1 Processor -- start 2023-12-19T19:00:34.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.162+0000 7f569fd1d640 1 -- start start 2023-12-19T19:00:34.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.162+0000 7f569fd1d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f56980c5640 0x7f56980c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:34.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.162+0000 7f569fd1d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56980c60f0 0x7f5698155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:34.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.162+0000 7f569fd1d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56980c2580 con 0x7f56980c5260 2023-12-19T19:00:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.162+0000 7f569fd1d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5698153510 con 0x7f56980c5640 2023-12-19T19:00:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.162+0000 7f569fd1d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56980c17f0 con 0x7f56980c60f0 2023-12-19T19:00:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.162+0000 7f569d2b8640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f56980c5640 0x7f56980c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.162+0000 7f569d2b8640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f56980c5640 0x7f56980c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37434/0 (socket says 172.21.15.133:37434) 2023-12-19T19:00:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.162+0000 7f569d2b8640 1 -- 172.21.15.133:0/481644260 learned_addr learned my addr 172.21.15.133:0/481644260 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:34.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.166+0000 7f569e2ba640 1 --2- 172.21.15.133:0/481644260 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56980c60f0 0x7f5698155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:34.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.166+0000 7f569d2b8640 1 -- 172.21.15.133:0/481644260 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56980c60f0 msgr2=0x7f5698155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:34.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.166+0000 7f569d2b8640 1 --2- 172.21.15.133:0/481644260 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56980c60f0 0x7f5698155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:34.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.166+0000 7f569d2b8640 1 -- 172.21.15.133:0/481644260 >> v1:172.21.15.138:6789/0 conn(0x7f56980c5260 legacy=0x7f569806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:34.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.166+0000 7f569d2b8640 1 -- 172.21.15.133:0/481644260 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56980c1a00 con 0x7f56980c5640 2023-12-19T19:00:34.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.166+0000 7f569d2b8640 1 --2- 172.21.15.133:0/481644260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56980c5640 0x7f56980c5bb0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f56980c1930 tx=0x7f568801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84e70614a30d8de server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:34.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.166+0000 7f569cab7640 1 -- 172.21.15.133:0/481644260 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56880ab600 con 0x7f56980c5640 2023-12-19T19:00:34.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.166+0000 7f569cab7640 1 -- 172.21.15.133:0/481644260 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56880a7050 con 0x7f56980c5640 2023-12-19T19:00:34.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.166+0000 7f569cab7640 1 -- 172.21.15.133:0/481644260 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56880ab980 con 0x7f56980c5640 2023-12-19T19:00:34.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.166+0000 7f569fd1d640 1 -- 172.21.15.133:0/481644260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56980c5640 msgr2=0x7f56980c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:34.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.166+0000 7f569fd1d640 1 --2- 172.21.15.133:0/481644260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56980c5640 0x7f56980c5bb0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f56980c1930 tx=0x7f568801c420 comp rx=0 tx=0).stop 2023-12-19T19:00:34.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.166+0000 7f569fd1d640 1 -- 172.21.15.133:0/481644260 shutdown_connections 2023-12-19T19:00:34.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.166+0000 7f569fd1d640 1 --2- 172.21.15.133:0/481644260 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56980c60f0 0x7f5698155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:34.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.166+0000 7f569fd1d640 1 --2- 172.21.15.133:0/481644260 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56980c5640 0x7f56980c5bb0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:34.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.166+0000 7f569fd1d640 1 -- 172.21.15.133:0/481644260 >> 172.21.15.133:0/481644260 conn(0x7f569806a5b0 msgr2=0x7f569806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:34.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f569fd1d640 1 -- 172.21.15.133:0/481644260 shutdown_connections 2023-12-19T19:00:34.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f569fd1d640 1 -- 172.21.15.133:0/481644260 wait complete. 2023-12-19T19:00:34.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f569fd1d640 1 Processor -- start 2023-12-19T19:00:34.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f569fd1d640 1 -- start start 2023-12-19T19:00:34.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f569fd1d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56980c5260 0x7f56980a9580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:34.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f569fd1d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56980c5640 0x7f56981513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:34.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f569fd1d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56980c60f0 0x7f56980a7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:34.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f569fd1d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5698151fc0 con 0x7f56980c60f0 2023-12-19T19:00:34.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f569fd1d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56980a9ac0 con 0x7f56980c5260 2023-12-19T19:00:34.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f569fd1d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56980a66c0 con 0x7f56980c5640 2023-12-19T19:00:34.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f569e2ba640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56980c60f0 0x7f56980a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:34.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f569e2ba640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56980c60f0 0x7f56980a7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37442/0 (socket says 172.21.15.133:37442) 2023-12-19T19:00:34.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f569e2ba640 1 -- 172.21.15.133:0/1036508202 learned_addr learned my addr 172.21.15.133:0/1036508202 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:34.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f569d2b8640 1 --2- 172.21.15.133:0/1036508202 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56980c5640 0x7f56981513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:34.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f569dab9640 1 --2- 172.21.15.133:0/1036508202 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56980c5260 0x7f56980a9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:34.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f569e2ba640 1 -- 172.21.15.133:0/1036508202 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56980c5640 msgr2=0x7f56981513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:34.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f569e2ba640 1 --2- 172.21.15.133:0/1036508202 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56980c5640 0x7f56981513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:34.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f569e2ba640 1 -- 172.21.15.133:0/1036508202 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56980c5260 msgr2=0x7f56980a9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:34.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f569e2ba640 1 --2- 172.21.15.133:0/1036508202 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56980c5260 0x7f56980a9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:34.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f569e2ba640 1 -- 172.21.15.133:0/1036508202 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56880094d0 con 0x7f56980c60f0 2023-12-19T19:00:34.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f569e2ba640 1 --2- 172.21.15.133:0/1036508202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56980c60f0 0x7f56980a7760 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5690007e40 tx=0x7f569000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:34.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f568e7fc640 1 -- 172.21.15.133:0/1036508202 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5690014620 con 0x7f56980c60f0 2023-12-19T19:00:34.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f568e7fc640 1 -- 172.21.15.133:0/1036508202 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569000ee90 con 0x7f56980c60f0 2023-12-19T19:00:34.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f569fd1d640 1 -- 172.21.15.133:0/1036508202 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56980a69a0 con 0x7f56980c60f0 2023-12-19T19:00:34.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.170+0000 7f568e7fc640 1 -- 172.21.15.133:0/1036508202 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56900149e0 con 0x7f56980c60f0 2023-12-19T19:00:34.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.174+0000 7f569fd1d640 1 -- 172.21.15.133:0/1036508202 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56980a6f60 con 0x7f56980c60f0 2023-12-19T19:00:34.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.174+0000 7f569fd1d640 1 -- 172.21.15.133:0/1036508202 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5698068400 con 0x7f56980c60f0 2023-12-19T19:00:34.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.174+0000 7f568e7fc640 1 -- 172.21.15.133:0/1036508202 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5690014b40 con 0x7f56980c60f0 2023-12-19T19:00:34.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.174+0000 7f568e7fc640 1 --2- 172.21.15.133:0/1036508202 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f567c066470 0x7f567c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:34.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.174+0000 7f568e7fc640 1 -- 172.21.15.133:0/1036508202 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5690084810 con 0x7f56980c60f0 2023-12-19T19:00:34.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.174+0000 7f569dab9640 1 --2- 172.21.15.133:0/1036508202 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f567c066470 0x7f567c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:34.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.178+0000 7f569dab9640 1 --2- 172.21.15.133:0/1036508202 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f567c066470 0x7f567c068930 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f56940098e0 tx=0x7f5694009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:34.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.178+0000 7f568e7fc640 1 -- 172.21.15.133:0/1036508202 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5690051ca0 con 0x7f56980c60f0 2023-12-19T19:00:34.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:34.366+0000 7f569fd1d640 1 -- 172.21.15.133:0/1036508202 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f569806d390 con 0x7f56980c60f0 2023-12-19T19:00:35.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.002+0000 7f568e7fc640 1 -- 172.21.15.133:0/1036508202 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f56900552c0 con 0x7f56980c60f0 2023-12-19T19:00:35.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.002+0000 7f569fd1d640 1 -- 172.21.15.133:0/1036508202 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f567c066470 msgr2=0x7f567c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:35.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.002+0000 7f569fd1d640 1 --2- 172.21.15.133:0/1036508202 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f567c066470 0x7f567c068930 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f56940098e0 tx=0x7f5694009060 comp rx=0 tx=0).stop 2023-12-19T19:00:35.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.002+0000 7f569fd1d640 1 -- 172.21.15.133:0/1036508202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56980c60f0 msgr2=0x7f56980a7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:35.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.002+0000 7f569fd1d640 1 --2- 172.21.15.133:0/1036508202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56980c60f0 0x7f56980a7760 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f5690007e40 tx=0x7f569000e4b0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.002+0000 7f569fd1d640 1 -- 172.21.15.133:0/1036508202 shutdown_connections 2023-12-19T19:00:35.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.002+0000 7f569fd1d640 1 --2- 172.21.15.133:0/1036508202 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f567c066470 0x7f567c068930 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.002+0000 7f569fd1d640 1 --2- 172.21.15.133:0/1036508202 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f56980c60f0 0x7f56980a7760 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.002+0000 7f569fd1d640 1 --2- 172.21.15.133:0/1036508202 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f56980c5640 0x7f56981513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.002+0000 7f569fd1d640 1 --2- 172.21.15.133:0/1036508202 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f56980c5260 0x7f56980a9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.002+0000 7f569fd1d640 1 -- 172.21.15.133:0/1036508202 >> 172.21.15.133:0/1036508202 conn(0x7f569806a5b0 msgr2=0x7f56980c2710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:35.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.002+0000 7f569fd1d640 1 -- 172.21.15.133:0/1036508202 shutdown_connections 2023-12-19T19:00:35.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.002+0000 7f569fd1d640 1 -- 172.21.15.133:0/1036508202 wait complete. 2023-12-19T19:00:35.026 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T19:00:35.026 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:00:35.154 INFO:tasks.ceph.mds.c.smithi133.stderr:2023-12-19T19:00:35.150+0000 7f58d758b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T19:00:35.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.162+0000 7f7b3d29a640 1 Processor -- start 2023-12-19T19:00:35.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.162+0000 7f7b3d29a640 1 -- start start 2023-12-19T19:00:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.162+0000 7f7b3d29a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7b38151e90 0x7f7b380c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.162+0000 7f7b3d29a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7b380c7ea0 0x7f7b3806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.162+0000 7f7b3d29a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b3806c860 con 0x7f7b380c4e60 2023-12-19T19:00:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.162+0000 7f7b3d29a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b380c8750 con 0x7f7b38151e90 2023-12-19T19:00:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.162+0000 7f7b3d29a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b381552d0 con 0x7f7b380c7ea0 2023-12-19T19:00:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.162+0000 7f7b36ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7b38151e90 0x7f7b380c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.162+0000 7f7b36ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7b38151e90 0x7f7b380c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59068/0 (socket says 172.21.15.133:59068) 2023-12-19T19:00:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.162+0000 7f7b36ffd640 1 -- 172.21.15.133:0/3552175904 learned_addr learned my addr 172.21.15.133:0/3552175904 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.162+0000 7f7b367fc640 1 --2- 172.21.15.133:0/3552175904 >> v2:172.21.15.138:3300/0 conn(0x7f7b380c7ea0 0x7f7b3806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.162+0000 7f7b36ffd640 1 -- 172.21.15.133:0/3552175904 >> v2:172.21.15.138:3300/0 conn(0x7f7b380c7ea0 msgr2=0x7f7b3806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.162+0000 7f7b36ffd640 1 --2- 172.21.15.133:0/3552175904 >> v2:172.21.15.138:3300/0 conn(0x7f7b380c7ea0 0x7f7b3806b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.162+0000 7f7b36ffd640 1 -- 172.21.15.133:0/3552175904 >> v1:172.21.15.138:6789/0 conn(0x7f7b380c4e60 legacy=0x7f7b3806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.162+0000 7f7b36ffd640 1 -- 172.21.15.133:0/3552175904 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b38154930 con 0x7f7b38151e90 2023-12-19T19:00:35.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.166+0000 7f7b36ffd640 1 --2- 172.21.15.133:0/3552175904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b38151e90 0x7f7b380c4920 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7b380a9a70 tx=0x7f7b2801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb082611dbefa5c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:35.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.166+0000 7f7b35ffb640 1 -- 172.21.15.133:0/3552175904 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b280ab600 con 0x7f7b38151e90 2023-12-19T19:00:35.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.166+0000 7f7b35ffb640 1 -- 172.21.15.133:0/3552175904 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b280a7050 con 0x7f7b38151e90 2023-12-19T19:00:35.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.166+0000 7f7b35ffb640 1 -- 172.21.15.133:0/3552175904 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b280ab980 con 0x7f7b38151e90 2023-12-19T19:00:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.166+0000 7f7b3d29a640 1 -- 172.21.15.133:0/3552175904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b38151e90 msgr2=0x7f7b380c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.166+0000 7f7b3d29a640 1 --2- 172.21.15.133:0/3552175904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b38151e90 0x7f7b380c4920 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7b380a9a70 tx=0x7f7b2801c3a0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.166+0000 7f7b3d29a640 1 -- 172.21.15.133:0/3552175904 shutdown_connections 2023-12-19T19:00:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.166+0000 7f7b3d29a640 1 --2- 172.21.15.133:0/3552175904 >> v2:172.21.15.138:3300/0 conn(0x7f7b380c7ea0 0x7f7b3806b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.166+0000 7f7b3d29a640 1 --2- 172.21.15.133:0/3552175904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b38151e90 0x7f7b380c4920 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.166+0000 7f7b3d29a640 1 -- 172.21.15.133:0/3552175904 >> 172.21.15.133:0/3552175904 conn(0x7f7b380ca170 msgr2=0x7f7b380ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.166+0000 7f7b3d29a640 1 -- 172.21.15.133:0/3552175904 shutdown_connections 2023-12-19T19:00:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.166+0000 7f7b3d29a640 1 -- 172.21.15.133:0/3552175904 wait complete. 2023-12-19T19:00:35.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.166+0000 7f7b3d29a640 1 Processor -- start 2023-12-19T19:00:35.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.166+0000 7f7b3d29a640 1 -- start start 2023-12-19T19:00:35.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.170+0000 7f7b3d29a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b380c4e60 0x7f7b38153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:35.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.170+0000 7f7b3d29a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b380c7ea0 0x7f7b380c1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:35.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.170+0000 7f7b3d29a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b38151e90 0x7f7b380c1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:35.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.170+0000 7f7b3d29a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b380c12a0 con 0x7f7b380c4e60 2023-12-19T19:00:35.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.170+0000 7f7b3d29a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b380abc70 con 0x7f7b38151e90 2023-12-19T19:00:35.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.170+0000 7f7b3d29a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b380ab3d0 con 0x7f7b380c7ea0 2023-12-19T19:00:35.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.170+0000 7f7b36ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b380c4e60 0x7f7b38153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:35.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.170+0000 7f7b36ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b380c4e60 0x7f7b38153330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59080/0 (socket says 172.21.15.133:59080) 2023-12-19T19:00:35.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.170+0000 7f7b36ffd640 1 -- 172.21.15.133:0/313782080 learned_addr learned my addr 172.21.15.133:0/313782080 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:35.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.170+0000 7f7b377fe640 1 --2- 172.21.15.133:0/313782080 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b38151e90 0x7f7b380c1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:35.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.170+0000 7f7b367fc640 1 --2- 172.21.15.133:0/313782080 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b380c7ea0 0x7f7b380c1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:35.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.170+0000 7f7b36ffd640 1 -- 172.21.15.133:0/313782080 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b380c7ea0 msgr2=0x7f7b380c1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:35.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.170+0000 7f7b36ffd640 1 --2- 172.21.15.133:0/313782080 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b380c7ea0 0x7f7b380c1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.170+0000 7f7b36ffd640 1 -- 172.21.15.133:0/313782080 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b38151e90 msgr2=0x7f7b380c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:35.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.170+0000 7f7b36ffd640 1 --2- 172.21.15.133:0/313782080 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b38151e90 0x7f7b380c1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.170+0000 7f7b36ffd640 1 -- 172.21.15.133:0/313782080 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b280094d0 con 0x7f7b380c4e60 2023-12-19T19:00:35.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.170+0000 7f7b36ffd640 1 --2- 172.21.15.133:0/313782080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b380c4e60 0x7f7b38153330 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7b280ae040 tx=0x7f7b2801abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:35.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.170+0000 7f7b1f7fe640 1 -- 172.21.15.133:0/313782080 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b280b6620 con 0x7f7b380c4e60 2023-12-19T19:00:35.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.170+0000 7f7b1f7fe640 1 -- 172.21.15.133:0/313782080 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b280abe90 con 0x7f7b380c4e60 2023-12-19T19:00:35.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.170+0000 7f7b1f7fe640 1 -- 172.21.15.133:0/313782080 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b280b69e0 con 0x7f7b380c4e60 2023-12-19T19:00:35.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.170+0000 7f7b3d29a640 1 -- 172.21.15.133:0/313782080 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b380ab6b0 con 0x7f7b380c4e60 2023-12-19T19:00:35.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.170+0000 7f7b3d29a640 1 -- 172.21.15.133:0/313782080 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b380c3310 con 0x7f7b380c4e60 2023-12-19T19:00:35.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.170+0000 7f7b3d29a640 1 -- 172.21.15.133:0/313782080 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b380c5e90 con 0x7f7b380c4e60 2023-12-19T19:00:35.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.174+0000 7f7b1f7fe640 1 -- 172.21.15.133:0/313782080 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7b280b2040 con 0x7f7b380c4e60 2023-12-19T19:00:35.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.174+0000 7f7b1f7fe640 1 --2- 172.21.15.133:0/313782080 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b24066470 0x7f7b24068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:35.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.174+0000 7f7b1f7fe640 1 -- 172.21.15.133:0/313782080 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b2811e2c0 con 0x7f7b380c4e60 2023-12-19T19:00:35.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.174+0000 7f7b367fc640 1 --2- 172.21.15.133:0/313782080 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b24066470 0x7f7b24068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:35.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.174+0000 7f7b367fc640 1 --2- 172.21.15.133:0/313782080 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b24066470 0x7f7b24068930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7b3814f790 tx=0x7f7b2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:35.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.178+0000 7f7b1f7fe640 1 -- 172.21.15.133:0/313782080 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7b280eb7e0 con 0x7f7b380c4e60 2023-12-19T19:00:35.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.354+0000 7f7b3d29a640 1 -- 172.21.15.133:0/313782080 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b38068400 con 0x7f7b380c4e60 2023-12-19T19:00:35.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.358+0000 7f7b1f7fe640 1 -- 172.21.15.133:0/313782080 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f7b280eee00 con 0x7f7b380c4e60 2023-12-19T19:00:35.360 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:35.360 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3200335051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3200335051},{"type":"v1","addr":"172.21.15.133:6833","nonce":3200335051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2114705112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":2114705112},{"type":"v1","addr":"172.21.15.138:6835","nonce":2114705112}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3661017926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3661017926},{"type":"v1","addr":"172.21.15.138:6837","nonce":3661017926}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:00:31.342186+0000","modified":"2023-12-19T19:00:34.368238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5763},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5763":{"gid":5763,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6835/1203400706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1203400706},{"type":"v1","addr":"172.21.15.133:6835","nonce":1203400706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T19:00:35.360 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 32 2023-12-19T19:00:35.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.358+0000 7f7b3d29a640 1 -- 172.21.15.133:0/313782080 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b24066470 msgr2=0x7f7b24068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:35.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.358+0000 7f7b3d29a640 1 --2- 172.21.15.133:0/313782080 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b24066470 0x7f7b24068930 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7b3814f790 tx=0x7f7b2c008040 comp rx=0 tx=0).stop 2023-12-19T19:00:35.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.358+0000 7f7b3d29a640 1 -- 172.21.15.133:0/313782080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b380c4e60 msgr2=0x7f7b38153330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.358+0000 7f7b3d29a640 1 --2- 172.21.15.133:0/313782080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b380c4e60 0x7f7b38153330 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7b280ae040 tx=0x7f7b2801abe0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.358+0000 7f7b3d29a640 1 -- 172.21.15.133:0/313782080 shutdown_connections 2023-12-19T19:00:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.358+0000 7f7b3d29a640 1 --2- 172.21.15.133:0/313782080 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b24066470 0x7f7b24068930 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.358+0000 7f7b3d29a640 1 --2- 172.21.15.133:0/313782080 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b38151e90 0x7f7b380c1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.358+0000 7f7b3d29a640 1 --2- 172.21.15.133:0/313782080 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b380c7ea0 0x7f7b380c1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.358+0000 7f7b3d29a640 1 --2- 172.21.15.133:0/313782080 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b380c4e60 0x7f7b38153330 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.358+0000 7f7b3d29a640 1 -- 172.21.15.133:0/313782080 >> 172.21.15.133:0/313782080 conn(0x7f7b380ca170 msgr2=0x7f7b381493a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.358+0000 7f7b3d29a640 1 -- 172.21.15.133:0/313782080 shutdown_connections 2023-12-19T19:00:35.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.358+0000 7f7b3d29a640 1 -- 172.21.15.133:0/313782080 wait complete. 2023-12-19T19:00:35.380 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:00:35.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.514+0000 7f7b7226b640 1 Processor -- start 2023-12-19T19:00:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.514+0000 7f7b7226b640 1 -- start start 2023-12-19T19:00:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.514+0000 7f7b7226b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7b6c0c5640 0x7f7b6c0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.514+0000 7f7b7226b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7b6c0c60f0 0x7f7b6c155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:35.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.514+0000 7f7b7226b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b6c0c2580 con 0x7f7b6c0c5260 2023-12-19T19:00:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.514+0000 7f7b7226b640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b6c153510 con 0x7f7b6c0c60f0 2023-12-19T19:00:35.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.514+0000 7f7b7226b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b6c0c17f0 con 0x7f7b6c0c5640 2023-12-19T19:00:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.514+0000 7f7b70808640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7b6c0c60f0 0x7f7b6c155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.514+0000 7f7b6bfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7b6c0c5260 0x7f7b6c06d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46692/0 (socket says 172.21.15.133:46692) 2023-12-19T19:00:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.518+0000 7f7b6bfff640 1 -- 172.21.15.133:0/3222913502 learned_addr learned my addr 172.21.15.133:0/3222913502 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.518+0000 7f7b6b7fe640 1 --2- 172.21.15.133:0/3222913502 >> v2:172.21.15.138:3300/0 conn(0x7f7b6c0c5640 0x7f7b6c0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.518+0000 7f7b70808640 1 -- 172.21.15.133:0/3222913502 >> v2:172.21.15.138:3300/0 conn(0x7f7b6c0c5640 msgr2=0x7f7b6c0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.518+0000 7f7b70808640 1 --2- 172.21.15.133:0/3222913502 >> v2:172.21.15.138:3300/0 conn(0x7f7b6c0c5640 0x7f7b6c0c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.518+0000 7f7b70808640 1 -- 172.21.15.133:0/3222913502 >> v1:172.21.15.133:6789/0 conn(0x7f7b6c0c5260 legacy=0x7f7b6c06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:35.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.518+0000 7f7b70808640 1 -- 172.21.15.133:0/3222913502 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6c0c1a00 con 0x7f7b6c0c60f0 2023-12-19T19:00:35.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.518+0000 7f7b70808640 1 --2- 172.21.15.133:0/3222913502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b6c0c60f0 0x7f7b6c155de0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c06b390 tx=0x7f7b6401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4291b13fcbfc55c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:35.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.518+0000 7f7b6affd640 1 -- 172.21.15.133:0/3222913502 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b640a5910 con 0x7f7b6c0c60f0 2023-12-19T19:00:35.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.518+0000 7f7b6affd640 1 -- 172.21.15.133:0/3222913502 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b640a5a70 con 0x7f7b6c0c60f0 2023-12-19T19:00:35.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.518+0000 7f7b6affd640 1 -- 172.21.15.133:0/3222913502 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b640a5e00 con 0x7f7b6c0c60f0 2023-12-19T19:00:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b7226b640 1 -- 172.21.15.133:0/3222913502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b6c0c60f0 msgr2=0x7f7b6c155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b7226b640 1 --2- 172.21.15.133:0/3222913502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b6c0c60f0 0x7f7b6c155de0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c06b390 tx=0x7f7b6401c850 comp rx=0 tx=0).stop 2023-12-19T19:00:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b7226b640 1 -- 172.21.15.133:0/3222913502 shutdown_connections 2023-12-19T19:00:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b7226b640 1 --2- 172.21.15.133:0/3222913502 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b6c0c60f0 0x7f7b6c155de0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b7226b640 1 --2- 172.21.15.133:0/3222913502 >> v2:172.21.15.138:3300/0 conn(0x7f7b6c0c5640 0x7f7b6c0c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b7226b640 1 -- 172.21.15.133:0/3222913502 >> 172.21.15.133:0/3222913502 conn(0x7f7b6c06a5b0 msgr2=0x7f7b6c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:35.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b7226b640 1 -- 172.21.15.133:0/3222913502 shutdown_connections 2023-12-19T19:00:35.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b7226b640 1 -- 172.21.15.133:0/3222913502 wait complete. 2023-12-19T19:00:35.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b7226b640 1 Processor -- start 2023-12-19T19:00:35.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b7226b640 1 -- start start 2023-12-19T19:00:35.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b7226b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b6c0c5260 0x7f7b6c1ed190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:35.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b7226b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b6c0c5640 0x7f7b6c0aa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:35.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b7226b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b6c0c60f0 0x7f7b6c1f0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:35.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b7226b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c1ed6d0 con 0x7f7b6c0c5640 2023-12-19T19:00:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b7226b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c1f0b10 con 0x7f7b6c0c60f0 2023-12-19T19:00:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b7226b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c15cda0 con 0x7f7b6c0c5260 2023-12-19T19:00:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b6b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b6c0c5640 0x7f7b6c0aa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b6b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b6c0c5640 0x7f7b6c0aa130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59098/0 (socket says 172.21.15.133:59098) 2023-12-19T19:00:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b6b7fe640 1 -- 172.21.15.133:0/1613518365 learned_addr learned my addr 172.21.15.133:0/1613518365 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b6bfff640 1 --2- 172.21.15.133:0/1613518365 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b6c0c5260 0x7f7b6c1ed190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b70808640 1 --2- 172.21.15.133:0/1613518365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b6c0c60f0 0x7f7b6c1f0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b6b7fe640 1 -- 172.21.15.133:0/1613518365 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b6c0c5260 msgr2=0x7f7b6c1ed190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b6b7fe640 1 --2- 172.21.15.133:0/1613518365 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b6c0c5260 0x7f7b6c1ed190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b6b7fe640 1 -- 172.21.15.133:0/1613518365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b6c0c60f0 msgr2=0x7f7b6c1f0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b6b7fe640 1 --2- 172.21.15.133:0/1613518365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b6c0c60f0 0x7f7b6c1f0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.522+0000 7f7b6b7fe640 1 -- 172.21.15.133:0/1613518365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b64009a70 con 0x7f7b6c0c5640 2023-12-19T19:00:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.526+0000 7f7b6b7fe640 1 --2- 172.21.15.133:0/1613518365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b6c0c5640 0x7f7b6c0aa130 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000e900 tx=0x7f7b6000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.526+0000 7f7b68ff9640 1 -- 172.21.15.133:0/1613518365 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b60009690 con 0x7f7b6c0c5640 2023-12-19T19:00:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.526+0000 7f7b68ff9640 1 -- 172.21.15.133:0/1613518365 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6000ca00 con 0x7f7b6c0c5640 2023-12-19T19:00:35.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.526+0000 7f7b68ff9640 1 -- 172.21.15.133:0/1613518365 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6000cdb0 con 0x7f7b6c0c5640 2023-12-19T19:00:35.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.526+0000 7f7b7226b640 1 -- 172.21.15.133:0/1613518365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b6c156e10 con 0x7f7b6c0c5640 2023-12-19T19:00:35.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.526+0000 7f7b7226b640 1 -- 172.21.15.133:0/1613518365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6c1573d0 con 0x7f7b6c0c5640 2023-12-19T19:00:35.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.526+0000 7f7b7226b640 1 -- 172.21.15.133:0/1613518365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b6c068400 con 0x7f7b6c0c5640 2023-12-19T19:00:35.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.526+0000 7f7b68ff9640 1 -- 172.21.15.133:0/1613518365 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7b60013470 con 0x7f7b6c0c5640 2023-12-19T19:00:35.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.526+0000 7f7b68ff9640 1 --2- 172.21.15.133:0/1613518365 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b58066470 0x7f7b58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:35.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.526+0000 7f7b68ff9640 1 -- 172.21.15.133:0/1613518365 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b600843e0 con 0x7f7b6c0c5640 2023-12-19T19:00:35.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.526+0000 7f7b6bfff640 1 --2- 172.21.15.133:0/1613518365 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b58066470 0x7f7b58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:35.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.530+0000 7f7b6bfff640 1 --2- 172.21.15.133:0/1613518365 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b58066470 0x7f7b58068930 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c005890 tx=0x7f7b5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:35.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.530+0000 7f7b68ff9640 1 -- 172.21.15.133:0/1613518365 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7b60051900 con 0x7f7b6c0c5640 2023-12-19T19:00:35.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.682+0000 7f7b7226b640 1 -- 172.21.15.133:0/1613518365 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7b6c1f0c50 con 0x7f7b6c0c5640 2023-12-19T19:00:35.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.682+0000 7f7b68ff9640 1 -- 172.21.15.133:0/1613518365 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16601 (secure 0 0 0) 0x7f7b60054f20 con 0x7f7b6c0c5640 2023-12-19T19:00:35.685 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:35.685 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":50,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:00:32.977420+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:00:29.085029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T19:00:30.359577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:00:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.682+0000 7f7b7226b640 1 -- 172.21.15.133:0/1613518365 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b58066470 msgr2=0x7f7b58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.682+0000 7f7b7226b640 1 --2- 172.21.15.133:0/1613518365 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b58066470 0x7f7b58068930 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c005890 tx=0x7f7b5c009040 comp rx=0 tx=0).stop 2023-12-19T19:00:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.682+0000 7f7b7226b640 1 -- 172.21.15.133:0/1613518365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b6c0c5640 msgr2=0x7f7b6c0aa130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.682+0000 7f7b7226b640 1 --2- 172.21.15.133:0/1613518365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b6c0c5640 0x7f7b6c0aa130 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000e900 tx=0x7f7b6000edc0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.682+0000 7f7b7226b640 1 -- 172.21.15.133:0/1613518365 shutdown_connections 2023-12-19T19:00:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.682+0000 7f7b7226b640 1 --2- 172.21.15.133:0/1613518365 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b58066470 0x7f7b58068930 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.682+0000 7f7b7226b640 1 --2- 172.21.15.133:0/1613518365 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b6c0c60f0 0x7f7b6c1f0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.682+0000 7f7b7226b640 1 --2- 172.21.15.133:0/1613518365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b6c0c5640 0x7f7b6c0aa130 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.682+0000 7f7b7226b640 1 --2- 172.21.15.133:0/1613518365 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b6c0c5260 0x7f7b6c1ed190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.682+0000 7f7b7226b640 1 -- 172.21.15.133:0/1613518365 >> 172.21.15.133:0/1613518365 conn(0x7f7b6c06a5b0 msgr2=0x7f7b6c06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.682+0000 7f7b7226b640 1 -- 172.21.15.133:0/1613518365 shutdown_connections 2023-12-19T19:00:35.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.682+0000 7f7b7226b640 1 -- 172.21.15.133:0/1613518365 wait complete. 2023-12-19T19:00:35.706 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T19:00:35.707 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T19:00:35.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.842+0000 7f81a6879640 1 Processor -- start 2023-12-19T19:00:35.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.842+0000 7f81a6879640 1 -- start start 2023-12-19T19:00:35.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.842+0000 7f81a6879640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f81a0152030 0x7f81a00c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:35.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.842+0000 7f81a6879640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f81a0157c90 0x7f81a00c2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:35.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.842+0000 7f81a6879640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a0154b60 con 0x7f81a006c470 2023-12-19T19:00:35.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.842+0000 7f81a6879640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a0152410 con 0x7f81a0157c90 2023-12-19T19:00:35.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.842+0000 7f81a6879640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a0155700 con 0x7f81a0152030 2023-12-19T19:00:35.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.842+0000 7f81a4e16640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f81a0157c90 0x7f81a00c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:35.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.842+0000 7f81a4e16640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f81a0157c90 0x7f81a00c2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59102/0 (socket says 172.21.15.133:59102) 2023-12-19T19:00:35.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.842+0000 7f81a4e16640 1 -- 172.21.15.133:0/196812609 learned_addr learned my addr 172.21.15.133:0/196812609 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:35.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.842+0000 7f819ffff640 1 --2- 172.21.15.133:0/196812609 >> v2:172.21.15.138:3300/0 conn(0x7f81a0152030 0x7f81a00c0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:35.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.842+0000 7f81a4e16640 1 -- 172.21.15.133:0/196812609 >> v2:172.21.15.138:3300/0 conn(0x7f81a0152030 msgr2=0x7f81a00c0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:35.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.842+0000 7f81a4e16640 1 --2- 172.21.15.133:0/196812609 >> v2:172.21.15.138:3300/0 conn(0x7f81a0152030 0x7f81a00c0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.842+0000 7f81a4e16640 1 -- 172.21.15.133:0/196812609 >> v1:172.21.15.138:6789/0 conn(0x7f81a006c470 legacy=0x7f81a0154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:35.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.842+0000 7f81a4e16640 1 -- 172.21.15.133:0/196812609 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a00c1820 con 0x7f81a0157c90 2023-12-19T19:00:35.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.842+0000 7f819ffff640 1 --2- 172.21.15.133:0/196812609 >> v2:172.21.15.138:3300/0 conn(0x7f81a0152030 0x7f81a00c0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:00:35.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.846+0000 7f81a4e16640 1 --2- 172.21.15.133:0/196812609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a0157c90 0x7f81a00c2270 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f81a0067d90 tx=0x7f819801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6abc9f2cdffbbfbd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:35.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.846+0000 7f819effd640 1 -- 172.21.15.133:0/196812609 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81980a57a0 con 0x7f81a0157c90 2023-12-19T19:00:35.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.846+0000 7f819effd640 1 -- 172.21.15.133:0/196812609 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81980a5900 con 0x7f81a0157c90 2023-12-19T19:00:35.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.846+0000 7f819effd640 1 -- 172.21.15.133:0/196812609 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81980a5c90 con 0x7f81a0157c90 2023-12-19T19:00:35.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.846+0000 7f81a6879640 1 -- 172.21.15.133:0/196812609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a0157c90 msgr2=0x7f81a00c2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:35.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.846+0000 7f81a6879640 1 --2- 172.21.15.133:0/196812609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a0157c90 0x7f81a00c2270 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f81a0067d90 tx=0x7f819801c8e0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.846+0000 7f81a6879640 1 -- 172.21.15.133:0/196812609 shutdown_connections 2023-12-19T19:00:35.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.846+0000 7f81a6879640 1 --2- 172.21.15.133:0/196812609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a0157c90 0x7f81a00c2270 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.846+0000 7f81a6879640 1 --2- 172.21.15.133:0/196812609 >> v2:172.21.15.138:3300/0 conn(0x7f81a0152030 0x7f81a00c0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.846+0000 7f81a6879640 1 -- 172.21.15.133:0/196812609 >> 172.21.15.133:0/196812609 conn(0x7f81a006a5b0 msgr2=0x7f81a006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:35.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.846+0000 7f81a6879640 1 -- 172.21.15.133:0/196812609 shutdown_connections 2023-12-19T19:00:35.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.846+0000 7f81a6879640 1 -- 172.21.15.133:0/196812609 wait complete. 2023-12-19T19:00:35.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.846+0000 7f81a6879640 1 Processor -- start 2023-12-19T19:00:35.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f81a6879640 1 -- start start 2023-12-19T19:00:35.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f81a6879640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a006c470 0x7f81a0144bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:35.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f81a6879640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81a0152030 0x7f81a0070780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:35.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f81a6879640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81a0157c90 0x7f81a0071c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:35.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f81a6879640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a00712b0 con 0x7f81a006c470 2023-12-19T19:00:35.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f81a6879640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a00717b0 con 0x7f81a0152030 2023-12-19T19:00:35.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f81a6879640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a00714b0 con 0x7f81a0157c90 2023-12-19T19:00:35.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f819ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a006c470 0x7f81a0144bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:35.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f819ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a006c470 0x7f81a0144bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59104/0 (socket says 172.21.15.133:59104) 2023-12-19T19:00:35.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f819ffff640 1 -- 172.21.15.133:0/689289093 learned_addr learned my addr 172.21.15.133:0/689289093 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:35.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f819f7fe640 1 --2- 172.21.15.133:0/689289093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81a0152030 0x7f81a0070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:35.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f81a4e16640 1 --2- 172.21.15.133:0/689289093 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81a0157c90 0x7f81a0071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:35.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f819ffff640 1 -- 172.21.15.133:0/689289093 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81a0157c90 msgr2=0x7f81a0071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:35.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f819ffff640 1 --2- 172.21.15.133:0/689289093 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81a0157c90 0x7f81a0071c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f819ffff640 1 -- 172.21.15.133:0/689289093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81a0152030 msgr2=0x7f81a0070780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:35.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f819ffff640 1 --2- 172.21.15.133:0/689289093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81a0152030 0x7f81a0070780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:35.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f819ffff640 1 -- 172.21.15.133:0/689289093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8198009b30 con 0x7f81a006c470 2023-12-19T19:00:35.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f819ffff640 1 --2- 172.21.15.133:0/689289093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a006c470 0x7f81a0144bf0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f819000c7f0 tx=0x7f819000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:35.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f819cff9640 1 -- 172.21.15.133:0/689289093 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819000cea0 con 0x7f81a006c470 2023-12-19T19:00:35.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f819cff9640 1 -- 172.21.15.133:0/689289093 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8190007a30 con 0x7f81a006c470 2023-12-19T19:00:35.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f819cff9640 1 -- 172.21.15.133:0/689289093 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8190007de0 con 0x7f81a006c470 2023-12-19T19:00:35.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f81a6879640 1 -- 172.21.15.133:0/689289093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a0070fd0 con 0x7f81a006c470 2023-12-19T19:00:35.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f81a6879640 1 -- 172.21.15.133:0/689289093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a0148c80 con 0x7f81a006c470 2023-12-19T19:00:35.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.850+0000 7f81a6879640 1 -- 172.21.15.133:0/689289093 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a006d540 con 0x7f81a006c470 2023-12-19T19:00:35.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.854+0000 7f819cff9640 1 -- 172.21.15.133:0/689289093 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f81900113f0 con 0x7f81a006c470 2023-12-19T19:00:35.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.854+0000 7f819cff9640 1 --2- 172.21.15.133:0/689289093 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f818c066470 0x7f818c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:35.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.854+0000 7f819cff9640 1 -- 172.21.15.133:0/689289093 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8190083eb0 con 0x7f81a006c470 2023-12-19T19:00:35.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.854+0000 7f819f7fe640 1 --2- 172.21.15.133:0/689289093 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f818c066470 0x7f818c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:35.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.854+0000 7f819f7fe640 1 --2- 172.21.15.133:0/689289093 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f818c066470 0x7f818c068930 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f81a01465e0 tx=0x7f8194007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:35.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:35.858+0000 7f819cff9640 1 -- 172.21.15.133:0/689289093 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f81900513d0 con 0x7f81a006c470 2023-12-19T19:00:36.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.006+0000 7f81a6879640 1 -- 172.21.15.133:0/689289093 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f81a006ce70 con 0x7f818c066470 2023-12-19T19:00:36.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.014+0000 7f819cff9640 1 -- 172.21.15.133:0/689289093 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277404 (secure 0 0 0) 0x7f8194004c00 con 0x7f818c066470 2023-12-19T19:00:36.021 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:36.023 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T19:00:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.018+0000 7f81a6879640 1 -- 172.21.15.133:0/689289093 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f818c066470 msgr2=0x7f818c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.018+0000 7f81a6879640 1 --2- 172.21.15.133:0/689289093 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f818c066470 0x7f818c068930 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f81a01465e0 tx=0x7f8194007e40 comp rx=0 tx=0).stop 2023-12-19T19:00:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.018+0000 7f81a6879640 1 -- 172.21.15.133:0/689289093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a006c470 msgr2=0x7f81a0144bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.018+0000 7f81a6879640 1 --2- 172.21.15.133:0/689289093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a006c470 0x7f81a0144bf0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f819000c7f0 tx=0x7f819000ccb0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.018+0000 7f81a6879640 1 -- 172.21.15.133:0/689289093 shutdown_connections 2023-12-19T19:00:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.018+0000 7f81a6879640 1 --2- 172.21.15.133:0/689289093 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f818c066470 0x7f818c068930 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.018+0000 7f81a6879640 1 --2- 172.21.15.133:0/689289093 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81a0157c90 0x7f81a0071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.018+0000 7f81a6879640 1 --2- 172.21.15.133:0/689289093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81a0152030 0x7f81a0070780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.018+0000 7f81a6879640 1 --2- 172.21.15.133:0/689289093 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a006c470 0x7f81a0144bf0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.018+0000 7f81a6879640 1 -- 172.21.15.133:0/689289093 >> 172.21.15.133:0/689289093 conn(0x7f81a006a5b0 msgr2=0x7f81a0150e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:36.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.018+0000 7f81a6879640 1 -- 172.21.15.133:0/689289093 shutdown_connections 2023-12-19T19:00:36.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.018+0000 7f81a6879640 1 -- 172.21.15.133:0/689289093 wait complete. 2023-12-19T19:00:36.044 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2023-12-19T19:00:34.857587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":225852,"kb_used_data":5528,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748868,"statfs":{"total":773094113280,"available":772862840832,"internally_reserved":0,"allocated":5660672,"data_stored":3035892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.899786"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.964719+0000","last_change":"2023-12-19T19:00:29.964719+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.964719+0000","last_undegraded":"2023-12-19T19:00:29.964719+0000","last_fullsized":"2023-12-19T19:00:29.964719+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.961340+0000","last_change":"2023-12-19T19:00:29.961340+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.961340+0000","last_undegraded":"2023-12-19T19:00:29.961340+0000","last_fullsized":"2023-12-19T19:00:29.961340+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.965244+0000","last_change":"2023-12-19T19:00:29.965244+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.965244+0000","last_undegraded":"2023-12-19T19:00:29.965244+0000","last_fullsized":"2023-12-19T19:00:29.965244+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.963195+0000","last_change":"2023-12-19T19:00:29.963195+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.963195+0000","last_undegraded":"2023-12-19T19:00:29.963195+0000","last_fullsized":"2023-12-19T19:00:29.963195+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.961107+0000","last_change":"2023-12-19T19:00:29.961107+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.961107+0000","last_undegraded":"2023-12-19T19:00:29.961107+0000","last_fullsized":"2023-12-19T19:00:29.961107+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.963576+0000","last_change":"2023-12-19T19:00:29.963576+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.963576+0000","last_undegraded":"2023-12-19T19:00:29.963576+0000","last_fullsized":"2023-12-19T19:00:29.963576+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.962767+0000","last_change":"2023-12-19T19:00:29.962767+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.962767+0000","last_undegraded":"2023-12-19T19:00:29.962767+0000","last_fullsized":"2023-12-19T19:00:29.962767+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.960060+0000","last_change":"2023-12-19T19:00:29.960060+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.960060+0000","last_undegraded":"2023-12-19T19:00:29.960060+0000","last_fullsized":"2023-12-19T19:00:29.960060+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.960933+0000","last_change":"2023-12-19T19:00:29.960933+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.960933+0000","last_undegraded":"2023-12-19T19:00:29.960933+0000","last_fullsized":"2023-12-19T19:00:29.960933+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.960774+0000","last_change":"2023-12-19T19:00:29.960774+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.960774+0000","last_undegraded":"2023-12-19T19:00:29.960774+0000","last_fullsized":"2023-12-19T19:00:29.960774+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.960399+0000","last_change":"2023-12-19T19:00:29.960399+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.960399+0000","last_undegraded":"2023-12-19T19:00:29.960399+0000","last_fullsized":"2023-12-19T19:00:29.960399+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.961618+0000","last_change":"2023-12-19T19:00:29.961618+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.961618+0000","last_undegraded":"2023-12-19T19:00:29.961618+0000","last_fullsized":"2023-12-19T19:00:29.961618+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.960676+0000","last_change":"2023-12-19T19:00:29.960676+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.960676+0000","last_undegraded":"2023-12-19T19:00:29.960676+0000","last_fullsized":"2023-12-19T19:00:29.960676+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.969610+0000","last_change":"2023-12-19T19:00:29.969610+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.969610+0000","last_undegraded":"2023-12-19T19:00:29.969610+0000","last_fullsized":"2023-12-19T19:00:29.969610+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.962082+0000","last_change":"2023-12-19T19:00:29.962082+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.962082+0000","last_undegraded":"2023-12-19T19:00:29.962082+0000","last_fullsized":"2023-12-19T19:00:29.962082+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.960388+0000","last_change":"2023-12-19T19:00:29.960388+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.960388+0000","last_undegraded":"2023-12-19T19:00:29.960388+0000","last_fullsized":"2023-12-19T19:00:29.960388+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.959578+0000","last_change":"2023-12-19T19:00:29.959578+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.959578+0000","last_undegraded":"2023-12-19T19:00:29.959578+0000","last_fullsized":"2023-12-19T19:00:29.959578+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.965075+0000","last_change":"2023-12-19T19:00:29.965075+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.965075+0000","last_undegraded":"2023-12-19T19:00:29.965075+0000","last_fullsized":"2023-12-19T19:00:29.965075+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.962313+0000","last_change":"2023-12-19T19:00:29.962313+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.962313+0000","last_undegraded":"2023-12-19T19:00:29.962313+0000","last_fullsized":"2023-12-19T19:00:29.962313+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.963598+0000","last_change":"2023-12-19T19:00:29.963598+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.963598+0000","last_undegraded":"2023-12-19T19:00:29.963598+0000","last_fullsized":"2023-12-19T19:00:29.963598+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.959638+0000","last_change":"2023-12-19T19:00:29.959638+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.959638+0000","last_undegraded":"2023-12-19T19:00:29.959638+0000","last_fullsized":"2023-12-19T19:00:29.959638+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.965842+0000","last_change":"2023-12-19T19:00:29.965842+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.965842+0000","last_undegraded":"2023-12-19T19:00:29.965842+0000","last_fullsized":"2023-12-19T19:00:29.965842+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.962143+0000","last_change":"2023-12-19T19:00:29.962143+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.962143+0000","last_undegraded":"2023-12-19T19:00:29.962143+0000","last_fullsized":"2023-12-19T19:00:29.962143+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.966371+0000","last_change":"2023-12-19T19:00:29.966371+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.966371+0000","last_undegraded":"2023-12-19T19:00:29.966371+0000","last_fullsized":"2023-12-19T19:00:29.966371+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.964580+0000","last_change":"2023-12-19T19:00:29.964580+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.964580+0000","last_undegraded":"2023-12-19T19:00:29.964580+0000","last_fullsized":"2023-12-19T19:00:29.964580+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.969560+0000","last_change":"2023-12-19T19:00:29.969560+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.969560+0000","last_undegraded":"2023-12-19T19:00:29.969560+0000","last_fullsized":"2023-12-19T19:00:29.969560+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.962629+0000","last_change":"2023-12-19T19:00:29.962629+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.962629+0000","last_undegraded":"2023-12-19T19:00:29.962629+0000","last_fullsized":"2023-12-19T19:00:29.962629+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.967799+0000","last_change":"2023-12-19T19:00:29.967799+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.967799+0000","last_undegraded":"2023-12-19T19:00:29.967799+0000","last_fullsized":"2023-12-19T19:00:29.967799+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.960029+0000","last_change":"2023-12-19T19:00:29.960029+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.960029+0000","last_undegraded":"2023-12-19T19:00:29.960029+0000","last_fullsized":"2023-12-19T19:00:29.960029+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.965291+0000","last_change":"2023-12-19T19:00:29.965291+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.965291+0000","last_undegraded":"2023-12-19T19:00:29.965291+0000","last_fullsized":"2023-12-19T19:00:29.965291+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.959566+0000","last_change":"2023-12-19T19:00:29.959566+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.959566+0000","last_undegraded":"2023-12-19T19:00:29.959566+0000","last_fullsized":"2023-12-19T19:00:29.959566+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.969519+0000","last_change":"2023-12-19T19:00:29.969519+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.969519+0000","last_undegraded":"2023-12-19T19:00:29.969519+0000","last_fullsized":"2023-12-19T19:00:29.969519+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":192,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T19:00:26.941083+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T19:00:26.941083+0000","last_peered":"2023-12-19T19:00:26.941083+0000","last_clean":"2023-12-19T19:00:26.941083+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T19:00:26.941083+0000","last_undegraded":"2023-12-19T19:00:26.941083+0000","last_fullsized":"2023-12-19T19:00:26.941083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28148,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343692,"statfs":{"total":96636764160,"available":96607940608,"internally_reserved":0,"allocated":1155072,"data_stored":823117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.64800000000000002}]},{"osd":1,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.57899999999999996}]},{"osd":2,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.77800000000000002}]},{"osd":3,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.68799999999999994}]},{"osd":4,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.62}]},{"osd":5,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.74199999999999999}]},{"osd":6,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.79700000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.77500000000000002}]},{"osd":1,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.72599999999999998}]},{"osd":2,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.73899999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.76000000000000001}]},{"osd":4,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.53900000000000003}]},{"osd":5,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.61399999999999999}]},{"osd":7,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.67700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":226932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":7.4550000000000001,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.877},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":16.951000000000001,"5min":16.951000000000001,"15min":16.951000000000001},"last":0.90300000000000002}]},{"osd":1,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":19.823,"5min":19.823,"15min":19.823},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.83999999999999997}]},{"osd":2,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.85999999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.2949999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.7649999999999997,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":0.88900000000000001}]},{"osd":4,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.6499999999999999,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":0.58399999999999996}]},{"osd":6,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.623}]},{"osd":7,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.371,"5min":2.371,"15min":2.371},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.55800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.7690000000000001,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.70099999999999996}]},{"osd":1,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":3.3849999999999998,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":0.71899999999999997}]},{"osd":2,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":3.1240000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.78000000000000003}]},{"osd":3,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":0.747},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":3.194,"5min":3.194,"15min":3.194},"last":0.79700000000000004}]},{"osd":5,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":9.3040000000000003,"5min":9.3040000000000003,"15min":9.3040000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.59699999999999998}]},{"osd":6,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":3.097,"5min":3.097,"15min":3.097},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":3.3319999999999999,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.81200000000000006}]},{"osd":7,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":5.0410000000000004,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":6.3449999999999998,"5min":6.3449999999999998,"15min":6.3449999999999998},"last":0.73199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.49299999999999999}]},{"osd":1,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.38500000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.42299999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.64300000000000002}]},{"osd":5,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.67000000000000004}]},{"osd":6,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.65300000000000002}]},{"osd":7,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.626},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.56599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.3599999999999999,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.60899999999999999}]},{"osd":1,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":0.56599999999999995}]},{"osd":3,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":3.0259999999999998,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.58499999999999996}]},{"osd":4,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.835,"5min":2.835,"15min":2.835},"last":0.74099999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":3.5,"5min":3.5,"15min":3.5},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":0.81299999999999994}]},{"osd":6,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.7109999999999999,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.82599999999999996}]},{"osd":7,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.875,"5min":2.875,"15min":2.875},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.86299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":4.2000000000000002,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.318},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":7.7320000000000002,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.38500000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.9129999999999998,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.4720000000000004,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.42199999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":7.8399999999999999,"5min":7.8399999999999999,"15min":7.8399999999999999},"last":0.505},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":7.7949999999999999,"5min":7.7949999999999999,"15min":7.7949999999999999},"last":0.52600000000000002}]},{"osd":4,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":4.2690000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":4.2910000000000004,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.751}]},{"osd":5,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":4.3490000000000002,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":4.2480000000000002,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.63800000000000001}]},{"osd":6,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":4.1609999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.3099999999999996,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.76400000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":4.3310000000000004,"5min":4.3310000000000004,"15min":4.3310000000000004},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":4.226,"5min":4.226,"15min":4.226},"last":0.83299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1150976,"data_stored":822098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.63100000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.45100000000000001}]},{"osd":3,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.86899999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.018}]},{"osd":5,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.90500000000000003}]},{"osd":6,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.88400000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.96699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T19:00:36.050 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T19:00:36.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.218+0000 7f357c1f8640 1 Processor -- start 2023-12-19T19:00:36.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.218+0000 7f357c1f8640 1 -- start start 2023-12-19T19:00:36.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.218+0000 7f357c1f8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35740c5640 0x7f35740c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:36.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.218+0000 7f357c1f8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f35740c60f0 0x7f3574155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:36.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.218+0000 7f357c1f8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35740c2580 con 0x7f35740c5260 2023-12-19T19:00:36.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.218+0000 7f357c1f8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3574153510 con 0x7f35740c60f0 2023-12-19T19:00:36.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.218+0000 7f357c1f8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35740c17f0 con 0x7f35740c5640 2023-12-19T19:00:36.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.218+0000 7f3579793640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35740c5640 0x7f35740c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:36.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.218+0000 7f357a795640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f35740c60f0 0x7f3574155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:36.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.218+0000 7f3579f94640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f35740c5260 0x7f357406d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:54658/0 (socket says 172.21.15.133:54658) 2023-12-19T19:00:36.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.218+0000 7f3579f94640 1 -- 172.21.15.133:0/1031727201 learned_addr learned my addr 172.21.15.133:0/1031727201 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:36.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.218+0000 7f3579793640 1 --2- 172.21.15.133:0/1031727201 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35740c5640 0x7f35740c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:57152/0 (socket says 172.21.15.133:57152) 2023-12-19T19:00:36.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.218+0000 7f3578f92640 1 -- 172.21.15.133:0/1031727201 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026656232 0 0) 0x7f35740c2580 con 0x7f35740c5260 2023-12-19T19:00:36.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.218+0000 7f3578f92640 1 -- 172.21.15.133:0/1031727201 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3560003530 con 0x7f35740c5260 2023-12-19T19:00:36.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.218+0000 7f3579793640 1 -- 172.21.15.133:0/1031727201 >> v2:172.21.15.138:3300/0 conn(0x7f35740c60f0 msgr2=0x7f3574155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:36.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.218+0000 7f3579793640 1 --2- 172.21.15.133:0/1031727201 >> v2:172.21.15.138:3300/0 conn(0x7f35740c60f0 0x7f3574155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.218+0000 7f3579793640 1 -- 172.21.15.133:0/1031727201 >> v1:172.21.15.138:6789/0 conn(0x7f35740c5260 legacy=0x7f357406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:36.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.218+0000 7f3579793640 1 -- 172.21.15.133:0/1031727201 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35740c1a00 con 0x7f35740c5640 2023-12-19T19:00:36.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.218+0000 7f357a795640 1 --2- 172.21.15.133:0/1031727201 >> v2:172.21.15.138:3300/0 conn(0x7f35740c60f0 0x7f3574155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:00:36.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.222+0000 7f3579793640 1 --2- 172.21.15.133:0/1031727201 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35740c5640 0x7f35740c5bb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f35740c1930 tx=0x7f356401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1119793cfa6795d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:36.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.222+0000 7f3578f92640 1 -- 172.21.15.133:0/1031727201 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35640ab600 con 0x7f35740c5640 2023-12-19T19:00:36.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.222+0000 7f3578f92640 1 -- 172.21.15.133:0/1031727201 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35640a7050 con 0x7f35740c5640 2023-12-19T19:00:36.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.222+0000 7f3578f92640 1 -- 172.21.15.133:0/1031727201 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35640ab980 con 0x7f35740c5640 2023-12-19T19:00:36.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.222+0000 7f357c1f8640 1 -- 172.21.15.133:0/1031727201 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35740c5640 msgr2=0x7f35740c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:36.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.222+0000 7f357c1f8640 1 --2- 172.21.15.133:0/1031727201 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35740c5640 0x7f35740c5bb0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f35740c1930 tx=0x7f356401c3c0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.222+0000 7f357c1f8640 1 -- 172.21.15.133:0/1031727201 shutdown_connections 2023-12-19T19:00:36.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.222+0000 7f357c1f8640 1 --2- 172.21.15.133:0/1031727201 >> v2:172.21.15.138:3300/0 conn(0x7f35740c60f0 0x7f3574155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.222+0000 7f357c1f8640 1 --2- 172.21.15.133:0/1031727201 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35740c5640 0x7f35740c5bb0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.222+0000 7f357c1f8640 1 -- 172.21.15.133:0/1031727201 >> 172.21.15.133:0/1031727201 conn(0x7f357406a5b0 msgr2=0x7f357406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:36.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.222+0000 7f357c1f8640 1 -- 172.21.15.133:0/1031727201 shutdown_connections 2023-12-19T19:00:36.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.222+0000 7f357c1f8640 1 -- 172.21.15.133:0/1031727201 wait complete. 2023-12-19T19:00:36.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f357c1f8640 1 Processor -- start 2023-12-19T19:00:36.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f357c1f8640 1 -- start start 2023-12-19T19:00:36.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f357c1f8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35740c5260 0x7f3574150350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:36.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f357c1f8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35740c5640 0x7f3574140f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:36.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f357c1f8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35740c60f0 0x7f3574141470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:36.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f357c1f8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35740a71f0 con 0x7f35740c5640 2023-12-19T19:00:36.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f357c1f8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35741f08a0 con 0x7f35740c5260 2023-12-19T19:00:36.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f357c1f8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35741f0630 con 0x7f35740c60f0 2023-12-19T19:00:36.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f3579793640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35740c5640 0x7f3574140f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:36.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f3579793640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35740c5640 0x7f3574140f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59110/0 (socket says 172.21.15.133:59110) 2023-12-19T19:00:36.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f3579793640 1 -- 172.21.15.133:0/3377844874 learned_addr learned my addr 172.21.15.133:0/3377844874 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:36.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f357a795640 1 --2- 172.21.15.133:0/3377844874 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35740c60f0 0x7f3574141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:36.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f3579f94640 1 --2- 172.21.15.133:0/3377844874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35740c5260 0x7f3574150350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:36.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f3579793640 1 -- 172.21.15.133:0/3377844874 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35740c60f0 msgr2=0x7f3574141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:36.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f3579793640 1 --2- 172.21.15.133:0/3377844874 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35740c60f0 0x7f3574141470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f3579793640 1 -- 172.21.15.133:0/3377844874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35740c5260 msgr2=0x7f3574150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:36.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f3579793640 1 --2- 172.21.15.133:0/3377844874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35740c5260 0x7f3574150350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f3579793640 1 -- 172.21.15.133:0/3377844874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c009a70 con 0x7f35740c5640 2023-12-19T19:00:36.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f3579793640 1 --2- 172.21.15.133:0/3377844874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35740c5640 0x7f3574140f30 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f35640ae040 tx=0x7f3564019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:36.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f356a7fc640 1 -- 172.21.15.133:0/3377844874 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3564006e20 con 0x7f35740c5640 2023-12-19T19:00:36.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f356a7fc640 1 -- 172.21.15.133:0/3377844874 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35640b4410 con 0x7f35740c5640 2023-12-19T19:00:36.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f356a7fc640 1 -- 172.21.15.133:0/3377844874 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35640b47c0 con 0x7f35740c5640 2023-12-19T19:00:36.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f357c1f8640 1 -- 172.21.15.133:0/3377844874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3564009420 con 0x7f35740c5640 2023-12-19T19:00:36.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f357c1f8640 1 -- 172.21.15.133:0/3377844874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3574070260 con 0x7f35740c5640 2023-12-19T19:00:36.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.226+0000 7f357c1f8640 1 -- 172.21.15.133:0/3377844874 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3574068400 con 0x7f35740c5640 2023-12-19T19:00:36.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.230+0000 7f356a7fc640 1 -- 172.21.15.133:0/3377844874 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f35640b2040 con 0x7f35740c5640 2023-12-19T19:00:36.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.230+0000 7f356a7fc640 1 --2- 172.21.15.133:0/3377844874 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3558066470 0x7f3558068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:36.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.230+0000 7f356a7fc640 1 -- 172.21.15.133:0/3377844874 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f356411dce0 con 0x7f35740c5640 2023-12-19T19:00:36.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.230+0000 7f3579f94640 1 --2- 172.21.15.133:0/3377844874 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3558066470 0x7f3558068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:36.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.230+0000 7f3579f94640 1 --2- 172.21.15.133:0/3377844874 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3558066470 0x7f3558068930 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f35700011f0 tx=0x7f3570007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:36.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.234+0000 7f356a7fc640 1 -- 172.21.15.133:0/3377844874 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f35640eb1f0 con 0x7f35740c5640 2023-12-19T19:00:36.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.382+0000 7f357c1f8640 1 -- 172.21.15.133:0/3377844874 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f357406cf80 con 0x7f3558066470 2023-12-19T19:00:36.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.390+0000 7f356a7fc640 1 -- 172.21.15.133:0/3377844874 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277404 (secure 0 0 0) 0x7f357406cf80 con 0x7f3558066470 2023-12-19T19:00:36.396 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:36.398 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T19:00:36.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.394+0000 7f357c1f8640 1 -- 172.21.15.133:0/3377844874 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3558066470 msgr2=0x7f3558068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:36.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.394+0000 7f357c1f8640 1 --2- 172.21.15.133:0/3377844874 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3558066470 0x7f3558068930 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f35700011f0 tx=0x7f3570007d40 comp rx=0 tx=0).stop 2023-12-19T19:00:36.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.394+0000 7f357c1f8640 1 -- 172.21.15.133:0/3377844874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35740c5640 msgr2=0x7f3574140f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:36.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.394+0000 7f357c1f8640 1 --2- 172.21.15.133:0/3377844874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35740c5640 0x7f3574140f30 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f35640ae040 tx=0x7f3564019160 comp rx=0 tx=0).stop 2023-12-19T19:00:36.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.394+0000 7f357c1f8640 1 -- 172.21.15.133:0/3377844874 shutdown_connections 2023-12-19T19:00:36.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.394+0000 7f357c1f8640 1 --2- 172.21.15.133:0/3377844874 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3558066470 0x7f3558068930 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.394+0000 7f357c1f8640 1 --2- 172.21.15.133:0/3377844874 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f35740c60f0 0x7f3574141470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.394+0000 7f357c1f8640 1 --2- 172.21.15.133:0/3377844874 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f35740c5640 0x7f3574140f30 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.394+0000 7f357c1f8640 1 --2- 172.21.15.133:0/3377844874 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35740c5260 0x7f3574150350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.394+0000 7f357c1f8640 1 -- 172.21.15.133:0/3377844874 >> 172.21.15.133:0/3377844874 conn(0x7f357406a5b0 msgr2=0x7f35740bf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:36.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.394+0000 7f357c1f8640 1 -- 172.21.15.133:0/3377844874 shutdown_connections 2023-12-19T19:00:36.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.394+0000 7f357c1f8640 1 -- 172.21.15.133:0/3377844874 wait complete. 2023-12-19T19:00:36.416 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2023-12-19T19:00:34.857587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":225852,"kb_used_data":5528,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748868,"statfs":{"total":773094113280,"available":772862840832,"internally_reserved":0,"allocated":5660672,"data_stored":3035892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.899786"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.964719+0000","last_change":"2023-12-19T19:00:29.964719+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.964719+0000","last_undegraded":"2023-12-19T19:00:29.964719+0000","last_fullsized":"2023-12-19T19:00:29.964719+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.961340+0000","last_change":"2023-12-19T19:00:29.961340+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.961340+0000","last_undegraded":"2023-12-19T19:00:29.961340+0000","last_fullsized":"2023-12-19T19:00:29.961340+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.965244+0000","last_change":"2023-12-19T19:00:29.965244+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.965244+0000","last_undegraded":"2023-12-19T19:00:29.965244+0000","last_fullsized":"2023-12-19T19:00:29.965244+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.963195+0000","last_change":"2023-12-19T19:00:29.963195+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.963195+0000","last_undegraded":"2023-12-19T19:00:29.963195+0000","last_fullsized":"2023-12-19T19:00:29.963195+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.961107+0000","last_change":"2023-12-19T19:00:29.961107+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.961107+0000","last_undegraded":"2023-12-19T19:00:29.961107+0000","last_fullsized":"2023-12-19T19:00:29.961107+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.963576+0000","last_change":"2023-12-19T19:00:29.963576+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.963576+0000","last_undegraded":"2023-12-19T19:00:29.963576+0000","last_fullsized":"2023-12-19T19:00:29.963576+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.962767+0000","last_change":"2023-12-19T19:00:29.962767+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.962767+0000","last_undegraded":"2023-12-19T19:00:29.962767+0000","last_fullsized":"2023-12-19T19:00:29.962767+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.960060+0000","last_change":"2023-12-19T19:00:29.960060+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.960060+0000","last_undegraded":"2023-12-19T19:00:29.960060+0000","last_fullsized":"2023-12-19T19:00:29.960060+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.960933+0000","last_change":"2023-12-19T19:00:29.960933+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.960933+0000","last_undegraded":"2023-12-19T19:00:29.960933+0000","last_fullsized":"2023-12-19T19:00:29.960933+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.960774+0000","last_change":"2023-12-19T19:00:29.960774+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.960774+0000","last_undegraded":"2023-12-19T19:00:29.960774+0000","last_fullsized":"2023-12-19T19:00:29.960774+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.960399+0000","last_change":"2023-12-19T19:00:29.960399+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.960399+0000","last_undegraded":"2023-12-19T19:00:29.960399+0000","last_fullsized":"2023-12-19T19:00:29.960399+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.961618+0000","last_change":"2023-12-19T19:00:29.961618+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.961618+0000","last_undegraded":"2023-12-19T19:00:29.961618+0000","last_fullsized":"2023-12-19T19:00:29.961618+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.960676+0000","last_change":"2023-12-19T19:00:29.960676+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.960676+0000","last_undegraded":"2023-12-19T19:00:29.960676+0000","last_fullsized":"2023-12-19T19:00:29.960676+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.969610+0000","last_change":"2023-12-19T19:00:29.969610+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.969610+0000","last_undegraded":"2023-12-19T19:00:29.969610+0000","last_fullsized":"2023-12-19T19:00:29.969610+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.962082+0000","last_change":"2023-12-19T19:00:29.962082+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.962082+0000","last_undegraded":"2023-12-19T19:00:29.962082+0000","last_fullsized":"2023-12-19T19:00:29.962082+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.960388+0000","last_change":"2023-12-19T19:00:29.960388+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.960388+0000","last_undegraded":"2023-12-19T19:00:29.960388+0000","last_fullsized":"2023-12-19T19:00:29.960388+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.959578+0000","last_change":"2023-12-19T19:00:29.959578+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.959578+0000","last_undegraded":"2023-12-19T19:00:29.959578+0000","last_fullsized":"2023-12-19T19:00:29.959578+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.965075+0000","last_change":"2023-12-19T19:00:29.965075+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.965075+0000","last_undegraded":"2023-12-19T19:00:29.965075+0000","last_fullsized":"2023-12-19T19:00:29.965075+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.962313+0000","last_change":"2023-12-19T19:00:29.962313+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.962313+0000","last_undegraded":"2023-12-19T19:00:29.962313+0000","last_fullsized":"2023-12-19T19:00:29.962313+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.963598+0000","last_change":"2023-12-19T19:00:29.963598+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.963598+0000","last_undegraded":"2023-12-19T19:00:29.963598+0000","last_fullsized":"2023-12-19T19:00:29.963598+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.959638+0000","last_change":"2023-12-19T19:00:29.959638+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.959638+0000","last_undegraded":"2023-12-19T19:00:29.959638+0000","last_fullsized":"2023-12-19T19:00:29.959638+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.965842+0000","last_change":"2023-12-19T19:00:29.965842+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.965842+0000","last_undegraded":"2023-12-19T19:00:29.965842+0000","last_fullsized":"2023-12-19T19:00:29.965842+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.962143+0000","last_change":"2023-12-19T19:00:29.962143+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.962143+0000","last_undegraded":"2023-12-19T19:00:29.962143+0000","last_fullsized":"2023-12-19T19:00:29.962143+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.966371+0000","last_change":"2023-12-19T19:00:29.966371+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.966371+0000","last_undegraded":"2023-12-19T19:00:29.966371+0000","last_fullsized":"2023-12-19T19:00:29.966371+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.964580+0000","last_change":"2023-12-19T19:00:29.964580+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.964580+0000","last_undegraded":"2023-12-19T19:00:29.964580+0000","last_fullsized":"2023-12-19T19:00:29.964580+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.969560+0000","last_change":"2023-12-19T19:00:29.969560+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.969560+0000","last_undegraded":"2023-12-19T19:00:29.969560+0000","last_fullsized":"2023-12-19T19:00:29.969560+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.962629+0000","last_change":"2023-12-19T19:00:29.962629+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.962629+0000","last_undegraded":"2023-12-19T19:00:29.962629+0000","last_fullsized":"2023-12-19T19:00:29.962629+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.967799+0000","last_change":"2023-12-19T19:00:29.967799+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.967799+0000","last_undegraded":"2023-12-19T19:00:29.967799+0000","last_fullsized":"2023-12-19T19:00:29.967799+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.960029+0000","last_change":"2023-12-19T19:00:29.960029+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.960029+0000","last_undegraded":"2023-12-19T19:00:29.960029+0000","last_fullsized":"2023-12-19T19:00:29.960029+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.965291+0000","last_change":"2023-12-19T19:00:29.965291+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.965291+0000","last_undegraded":"2023-12-19T19:00:29.965291+0000","last_fullsized":"2023-12-19T19:00:29.965291+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.959566+0000","last_change":"2023-12-19T19:00:29.959566+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.959566+0000","last_undegraded":"2023-12-19T19:00:29.959566+0000","last_fullsized":"2023-12-19T19:00:29.959566+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.969519+0000","last_change":"2023-12-19T19:00:29.969519+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.969519+0000","last_undegraded":"2023-12-19T19:00:29.969519+0000","last_fullsized":"2023-12-19T19:00:29.969519+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":192,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T19:00:26.941083+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T19:00:26.941083+0000","last_peered":"2023-12-19T19:00:26.941083+0000","last_clean":"2023-12-19T19:00:26.941083+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T19:00:26.941083+0000","last_undegraded":"2023-12-19T19:00:26.941083+0000","last_fullsized":"2023-12-19T19:00:26.941083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28148,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343692,"statfs":{"total":96636764160,"available":96607940608,"internally_reserved":0,"allocated":1155072,"data_stored":823117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.64800000000000002}]},{"osd":1,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.57899999999999996}]},{"osd":2,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.77800000000000002}]},{"osd":3,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.68799999999999994}]},{"osd":4,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.62}]},{"osd":5,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.74199999999999999}]},{"osd":6,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.79700000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.77500000000000002}]},{"osd":1,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.72599999999999998}]},{"osd":2,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.73899999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.76000000000000001}]},{"osd":4,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.53900000000000003}]},{"osd":5,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.61399999999999999}]},{"osd":7,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.67700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":226932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":7.4550000000000001,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.877},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":16.951000000000001,"5min":16.951000000000001,"15min":16.951000000000001},"last":0.90300000000000002}]},{"osd":1,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":19.823,"5min":19.823,"15min":19.823},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.83999999999999997}]},{"osd":2,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.85999999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.2949999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.7649999999999997,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":0.88900000000000001}]},{"osd":4,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.6499999999999999,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":0.58399999999999996}]},{"osd":6,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.623}]},{"osd":7,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.371,"5min":2.371,"15min":2.371},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.55800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.7690000000000001,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.70099999999999996}]},{"osd":1,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":3.3849999999999998,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":0.71899999999999997}]},{"osd":2,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":3.1240000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.78000000000000003}]},{"osd":3,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":0.747},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":3.194,"5min":3.194,"15min":3.194},"last":0.79700000000000004}]},{"osd":5,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":9.3040000000000003,"5min":9.3040000000000003,"15min":9.3040000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.59699999999999998}]},{"osd":6,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":3.097,"5min":3.097,"15min":3.097},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":3.3319999999999999,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.81200000000000006}]},{"osd":7,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":5.0410000000000004,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":6.3449999999999998,"5min":6.3449999999999998,"15min":6.3449999999999998},"last":0.73199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.49299999999999999}]},{"osd":1,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.38500000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.42299999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.64300000000000002}]},{"osd":5,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.67000000000000004}]},{"osd":6,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.65300000000000002}]},{"osd":7,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.626},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.56599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.3599999999999999,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.60899999999999999}]},{"osd":1,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":0.56599999999999995}]},{"osd":3,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":3.0259999999999998,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.58499999999999996}]},{"osd":4,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.835,"5min":2.835,"15min":2.835},"last":0.74099999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":3.5,"5min":3.5,"15min":3.5},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":0.81299999999999994}]},{"osd":6,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.7109999999999999,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.82599999999999996}]},{"osd":7,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.875,"5min":2.875,"15min":2.875},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.86299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":4.2000000000000002,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.318},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":7.7320000000000002,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.38500000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.9129999999999998,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.4720000000000004,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.42199999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":7.8399999999999999,"5min":7.8399999999999999,"15min":7.8399999999999999},"last":0.505},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":7.7949999999999999,"5min":7.7949999999999999,"15min":7.7949999999999999},"last":0.52600000000000002}]},{"osd":4,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":4.2690000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":4.2910000000000004,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.751}]},{"osd":5,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":4.3490000000000002,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":4.2480000000000002,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.63800000000000001}]},{"osd":6,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":4.1609999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.3099999999999996,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.76400000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":4.3310000000000004,"5min":4.3310000000000004,"15min":4.3310000000000004},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":4.226,"5min":4.226,"15min":4.226},"last":0.83299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1150976,"data_stored":822098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.63100000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.45100000000000001}]},{"osd":3,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.86899999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.018}]},{"osd":5,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.90500000000000003}]},{"osd":6,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.88400000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.96699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T19:00:36.421 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T19:00:36.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.590+0000 7f49f6ac9640 1 Processor -- start 2023-12-19T19:00:36.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.590+0000 7f49f6ac9640 1 -- start start 2023-12-19T19:00:36.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.594+0000 7f49f6ac9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f49f00a5370 0x7f49f00c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:36.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.594+0000 7f49f6ac9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49f00c4110 0x7f49f0150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:36.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.594+0000 7f49f6ac9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f49f0072090 0x7f49f01514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.594+0000 7f49f6ac9640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f00c3070 con 0x7f49f0072090 2023-12-19T19:00:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.594+0000 7f49f6ac9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f00c2760 con 0x7f49f00a5370 2023-12-19T19:00:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.594+0000 7f49f6ac9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f00a5750 con 0x7f49f00c4110 2023-12-19T19:00:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.594+0000 7f49f5066640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f49f0072090 0x7f49f01514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.594+0000 7f49f5066640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f49f0072090 0x7f49f01514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59118/0 (socket says 172.21.15.133:59118) 2023-12-19T19:00:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.594+0000 7f49f5066640 1 -- 172.21.15.133:0/3774998781 learned_addr learned my addr 172.21.15.133:0/3774998781 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.594+0000 7f49effff640 1 --2- 172.21.15.133:0/3774998781 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49f00c4110 0x7f49f0150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.594+0000 7f49f4865640 1 --2- 172.21.15.133:0/3774998781 >> v2:172.21.15.138:3300/0 conn(0x7f49f00a5370 0x7f49f00c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.594+0000 7f49f5066640 1 -- 172.21.15.133:0/3774998781 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49f00c4110 msgr2=0x7f49f0150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.594+0000 7f49f5066640 1 --2- 172.21.15.133:0/3774998781 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49f00c4110 0x7f49f0150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.594+0000 7f49f5066640 1 -- 172.21.15.133:0/3774998781 >> v2:172.21.15.138:3300/0 conn(0x7f49f00a5370 msgr2=0x7f49f00c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.594+0000 7f49f5066640 1 --2- 172.21.15.133:0/3774998781 >> v2:172.21.15.138:3300/0 conn(0x7f49f00a5370 0x7f49f00c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.594+0000 7f49f5066640 1 -- 172.21.15.133:0/3774998781 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f00aad20 con 0x7f49f0072090 2023-12-19T19:00:36.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.594+0000 7f49f4865640 1 --2- 172.21.15.133:0/3774998781 >> v2:172.21.15.138:3300/0 conn(0x7f49f00a5370 0x7f49f00c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:36.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.598+0000 7f49f5066640 1 --2- 172.21.15.133:0/3774998781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49f0072090 0x7f49f01514e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f49f00a8af0 tx=0x7f49e801c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d0c08162d9f5075 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:36.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.598+0000 7f49ef7fe640 1 -- 172.21.15.133:0/3774998781 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e80a5680 con 0x7f49f0072090 2023-12-19T19:00:36.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.598+0000 7f49ef7fe640 1 -- 172.21.15.133:0/3774998781 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e80a57e0 con 0x7f49f0072090 2023-12-19T19:00:36.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.598+0000 7f49ef7fe640 1 -- 172.21.15.133:0/3774998781 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e80a5b70 con 0x7f49f0072090 2023-12-19T19:00:36.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.598+0000 7f49f6ac9640 1 -- 172.21.15.133:0/3774998781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49f0072090 msgr2=0x7f49f01514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:36.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.598+0000 7f49f6ac9640 1 --2- 172.21.15.133:0/3774998781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49f0072090 0x7f49f01514e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f49f00a8af0 tx=0x7f49e801c880 comp rx=0 tx=0).stop 2023-12-19T19:00:36.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.598+0000 7f49f6ac9640 1 -- 172.21.15.133:0/3774998781 shutdown_connections 2023-12-19T19:00:36.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.598+0000 7f49f6ac9640 1 --2- 172.21.15.133:0/3774998781 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49f00c4110 0x7f49f0150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.598+0000 7f49f6ac9640 1 --2- 172.21.15.133:0/3774998781 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49f0072090 0x7f49f01514e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.598+0000 7f49f6ac9640 1 --2- 172.21.15.133:0/3774998781 >> v2:172.21.15.138:3300/0 conn(0x7f49f00a5370 0x7f49f00c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.598+0000 7f49f6ac9640 1 -- 172.21.15.133:0/3774998781 >> 172.21.15.133:0/3774998781 conn(0x7f49f006a5b0 msgr2=0x7f49f006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:36.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.598+0000 7f49f6ac9640 1 -- 172.21.15.133:0/3774998781 shutdown_connections 2023-12-19T19:00:36.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.598+0000 7f49f6ac9640 1 -- 172.21.15.133:0/3774998781 wait complete. 2023-12-19T19:00:36.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.598+0000 7f49f6ac9640 1 Processor -- start 2023-12-19T19:00:36.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.598+0000 7f49f6ac9640 1 -- start start 2023-12-19T19:00:36.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49f6ac9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49f0072090 0x7f49f01f0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:36.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49f6ac9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49f00a5370 0x7f49f014f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:36.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49f6ac9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49f00c4110 0x7f49f00a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:36.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49f6ac9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f01f1200 con 0x7f49f00c4110 2023-12-19T19:00:36.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49f6ac9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f014ed10 con 0x7f49f0072090 2023-12-19T19:00:36.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49f6ac9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f0153cc0 con 0x7f49f00a5370 2023-12-19T19:00:36.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49f5066640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49f00c4110 0x7f49f00a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:36.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49f5066640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49f00c4110 0x7f49f00a5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59122/0 (socket says 172.21.15.133:59122) 2023-12-19T19:00:36.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49f5066640 1 -- 172.21.15.133:0/2713132142 learned_addr learned my addr 172.21.15.133:0/2713132142 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:36.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49f4865640 1 --2- 172.21.15.133:0/2713132142 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49f0072090 0x7f49f01f0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:36.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49effff640 1 --2- 172.21.15.133:0/2713132142 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49f00a5370 0x7f49f014f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:36.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49f5066640 1 -- 172.21.15.133:0/2713132142 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49f00a5370 msgr2=0x7f49f014f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:36.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49f5066640 1 --2- 172.21.15.133:0/2713132142 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49f00a5370 0x7f49f014f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49f5066640 1 -- 172.21.15.133:0/2713132142 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49f0072090 msgr2=0x7f49f01f0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:36.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49f5066640 1 --2- 172.21.15.133:0/2713132142 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49f0072090 0x7f49f01f0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49f5066640 1 -- 172.21.15.133:0/2713132142 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e8009b30 con 0x7f49f00c4110 2023-12-19T19:00:36.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49effff640 1 --2- 172.21.15.133:0/2713132142 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49f00a5370 0x7f49f014f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:36.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49f5066640 1 --2- 172.21.15.133:0/2713132142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49f00c4110 0x7f49f00a5890 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f49e80af040 tx=0x7f49e8019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:36.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49ed7fa640 1 -- 172.21.15.133:0/2713132142 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e80b8670 con 0x7f49f00c4110 2023-12-19T19:00:36.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49ed7fa640 1 -- 172.21.15.133:0/2713132142 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e80b87d0 con 0x7f49f00c4110 2023-12-19T19:00:36.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49ed7fa640 1 -- 172.21.15.133:0/2713132142 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e80b8b80 con 0x7f49f00c4110 2023-12-19T19:00:36.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49f6ac9640 1 -- 172.21.15.133:0/2713132142 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f01539e0 con 0x7f49f00c4110 2023-12-19T19:00:36.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49f6ac9640 1 -- 172.21.15.133:0/2713132142 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f015a4b0 con 0x7f49f00c4110 2023-12-19T19:00:36.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49f6ac9640 1 -- 172.21.15.133:0/2713132142 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f014eee0 con 0x7f49f00c4110 2023-12-19T19:00:36.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.602+0000 7f49ed7fa640 1 -- 172.21.15.133:0/2713132142 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f49e80b8ce0 con 0x7f49f00c4110 2023-12-19T19:00:36.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.606+0000 7f49ed7fa640 1 --2- 172.21.15.133:0/2713132142 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f49d4066470 0x7f49d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:36.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.606+0000 7f49ed7fa640 1 -- 172.21.15.133:0/2713132142 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49e811f390 con 0x7f49f00c4110 2023-12-19T19:00:36.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.606+0000 7f49f4865640 1 --2- 172.21.15.133:0/2713132142 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f49d4066470 0x7f49d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:36.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.606+0000 7f49f4865640 1 --2- 172.21.15.133:0/2713132142 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f49d4066470 0x7f49d4068930 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f49e400c880 tx=0x7f49e4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:36.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.610+0000 7f49ed7fa640 1 -- 172.21.15.133:0/2713132142 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f49f014eee0 con 0x7f49f00c4110 2023-12-19T19:00:36.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.754+0000 7f49f6ac9640 1 -- 172.21.15.133:0/2713132142 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f49f01541c0 con 0x7f49d4066470 2023-12-19T19:00:36.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.762+0000 7f49ed7fa640 1 -- 172.21.15.133:0/2713132142 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277404 (secure 0 0 0) 0x7f49e400ce60 con 0x7f49d4066470 2023-12-19T19:00:36.767 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:36.769 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T19:00:36.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.766+0000 7f49f6ac9640 1 -- 172.21.15.133:0/2713132142 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f49d4066470 msgr2=0x7f49d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:36.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.766+0000 7f49f6ac9640 1 --2- 172.21.15.133:0/2713132142 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f49d4066470 0x7f49d4068930 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f49e400c880 tx=0x7f49e4008040 comp rx=0 tx=0).stop 2023-12-19T19:00:36.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.766+0000 7f49f6ac9640 1 -- 172.21.15.133:0/2713132142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49f00c4110 msgr2=0x7f49f00a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:36.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.766+0000 7f49f6ac9640 1 --2- 172.21.15.133:0/2713132142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49f00c4110 0x7f49f00a5890 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f49e80af040 tx=0x7f49e8019620 comp rx=0 tx=0).stop 2023-12-19T19:00:36.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.766+0000 7f49f6ac9640 1 -- 172.21.15.133:0/2713132142 shutdown_connections 2023-12-19T19:00:36.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.766+0000 7f49f6ac9640 1 --2- 172.21.15.133:0/2713132142 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f49d4066470 0x7f49d4068930 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.766+0000 7f49f6ac9640 1 --2- 172.21.15.133:0/2713132142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49f00c4110 0x7f49f00a5890 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.766+0000 7f49f6ac9640 1 --2- 172.21.15.133:0/2713132142 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49f00a5370 0x7f49f014f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.766+0000 7f49f6ac9640 1 --2- 172.21.15.133:0/2713132142 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49f0072090 0x7f49f01f0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.766+0000 7f49f6ac9640 1 -- 172.21.15.133:0/2713132142 >> 172.21.15.133:0/2713132142 conn(0x7f49f006a5b0 msgr2=0x7f49f00bf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:36.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.766+0000 7f49f6ac9640 1 -- 172.21.15.133:0/2713132142 shutdown_connections 2023-12-19T19:00:36.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.766+0000 7f49f6ac9640 1 -- 172.21.15.133:0/2713132142 wait complete. 2023-12-19T19:00:36.787 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":105,"stamp":"2023-12-19T19:00:34.857587+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":21,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":225852,"kb_used_data":5528,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748868,"statfs":{"total":773094113280,"available":772862840832,"internally_reserved":0,"allocated":5660672,"data_stored":3035892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.899786"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.964719+0000","last_change":"2023-12-19T19:00:29.964719+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.964719+0000","last_undegraded":"2023-12-19T19:00:29.964719+0000","last_fullsized":"2023-12-19T19:00:29.964719+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.961340+0000","last_change":"2023-12-19T19:00:29.961340+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.961340+0000","last_undegraded":"2023-12-19T19:00:29.961340+0000","last_fullsized":"2023-12-19T19:00:29.961340+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.965244+0000","last_change":"2023-12-19T19:00:29.965244+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.965244+0000","last_undegraded":"2023-12-19T19:00:29.965244+0000","last_fullsized":"2023-12-19T19:00:29.965244+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.963195+0000","last_change":"2023-12-19T19:00:29.963195+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.963195+0000","last_undegraded":"2023-12-19T19:00:29.963195+0000","last_fullsized":"2023-12-19T19:00:29.963195+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.961107+0000","last_change":"2023-12-19T19:00:29.961107+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.961107+0000","last_undegraded":"2023-12-19T19:00:29.961107+0000","last_fullsized":"2023-12-19T19:00:29.961107+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.963576+0000","last_change":"2023-12-19T19:00:29.963576+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.963576+0000","last_undegraded":"2023-12-19T19:00:29.963576+0000","last_fullsized":"2023-12-19T19:00:29.963576+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.962767+0000","last_change":"2023-12-19T19:00:29.962767+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.962767+0000","last_undegraded":"2023-12-19T19:00:29.962767+0000","last_fullsized":"2023-12-19T19:00:29.962767+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.960060+0000","last_change":"2023-12-19T19:00:29.960060+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.960060+0000","last_undegraded":"2023-12-19T19:00:29.960060+0000","last_fullsized":"2023-12-19T19:00:29.960060+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.960933+0000","last_change":"2023-12-19T19:00:29.960933+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.960933+0000","last_undegraded":"2023-12-19T19:00:29.960933+0000","last_fullsized":"2023-12-19T19:00:29.960933+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.960774+0000","last_change":"2023-12-19T19:00:29.960774+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.960774+0000","last_undegraded":"2023-12-19T19:00:29.960774+0000","last_fullsized":"2023-12-19T19:00:29.960774+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.960399+0000","last_change":"2023-12-19T19:00:29.960399+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.960399+0000","last_undegraded":"2023-12-19T19:00:29.960399+0000","last_fullsized":"2023-12-19T19:00:29.960399+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.961618+0000","last_change":"2023-12-19T19:00:29.961618+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.961618+0000","last_undegraded":"2023-12-19T19:00:29.961618+0000","last_fullsized":"2023-12-19T19:00:29.961618+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.960676+0000","last_change":"2023-12-19T19:00:29.960676+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.960676+0000","last_undegraded":"2023-12-19T19:00:29.960676+0000","last_fullsized":"2023-12-19T19:00:29.960676+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.969610+0000","last_change":"2023-12-19T19:00:29.969610+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.969610+0000","last_undegraded":"2023-12-19T19:00:29.969610+0000","last_fullsized":"2023-12-19T19:00:29.969610+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.962082+0000","last_change":"2023-12-19T19:00:29.962082+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.962082+0000","last_undegraded":"2023-12-19T19:00:29.962082+0000","last_fullsized":"2023-12-19T19:00:29.962082+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.960388+0000","last_change":"2023-12-19T19:00:29.960388+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.960388+0000","last_undegraded":"2023-12-19T19:00:29.960388+0000","last_fullsized":"2023-12-19T19:00:29.960388+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.959578+0000","last_change":"2023-12-19T19:00:29.959578+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.959578+0000","last_undegraded":"2023-12-19T19:00:29.959578+0000","last_fullsized":"2023-12-19T19:00:29.959578+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.965075+0000","last_change":"2023-12-19T19:00:29.965075+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.965075+0000","last_undegraded":"2023-12-19T19:00:29.965075+0000","last_fullsized":"2023-12-19T19:00:29.965075+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.962313+0000","last_change":"2023-12-19T19:00:29.962313+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.962313+0000","last_undegraded":"2023-12-19T19:00:29.962313+0000","last_fullsized":"2023-12-19T19:00:29.962313+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.963598+0000","last_change":"2023-12-19T19:00:29.963598+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.963598+0000","last_undegraded":"2023-12-19T19:00:29.963598+0000","last_fullsized":"2023-12-19T19:00:29.963598+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.959638+0000","last_change":"2023-12-19T19:00:29.959638+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.959638+0000","last_undegraded":"2023-12-19T19:00:29.959638+0000","last_fullsized":"2023-12-19T19:00:29.959638+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.965842+0000","last_change":"2023-12-19T19:00:29.965842+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.965842+0000","last_undegraded":"2023-12-19T19:00:29.965842+0000","last_fullsized":"2023-12-19T19:00:29.965842+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.962143+0000","last_change":"2023-12-19T19:00:29.962143+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.962143+0000","last_undegraded":"2023-12-19T19:00:29.962143+0000","last_fullsized":"2023-12-19T19:00:29.962143+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.966371+0000","last_change":"2023-12-19T19:00:29.966371+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.966371+0000","last_undegraded":"2023-12-19T19:00:29.966371+0000","last_fullsized":"2023-12-19T19:00:29.966371+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.964580+0000","last_change":"2023-12-19T19:00:29.964580+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.964580+0000","last_undegraded":"2023-12-19T19:00:29.964580+0000","last_fullsized":"2023-12-19T19:00:29.964580+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.969560+0000","last_change":"2023-12-19T19:00:29.969560+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.969560+0000","last_undegraded":"2023-12-19T19:00:29.969560+0000","last_fullsized":"2023-12-19T19:00:29.969560+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.962629+0000","last_change":"2023-12-19T19:00:29.962629+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.962629+0000","last_undegraded":"2023-12-19T19:00:29.962629+0000","last_fullsized":"2023-12-19T19:00:29.962629+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.967799+0000","last_change":"2023-12-19T19:00:29.967799+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.967799+0000","last_undegraded":"2023-12-19T19:00:29.967799+0000","last_fullsized":"2023-12-19T19:00:29.967799+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.960029+0000","last_change":"2023-12-19T19:00:29.960029+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.960029+0000","last_undegraded":"2023-12-19T19:00:29.960029+0000","last_fullsized":"2023-12-19T19:00:29.960029+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.965291+0000","last_change":"2023-12-19T19:00:29.965291+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.965291+0000","last_undegraded":"2023-12-19T19:00:29.965291+0000","last_fullsized":"2023-12-19T19:00:29.965291+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.959566+0000","last_change":"2023-12-19T19:00:29.959566+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.959566+0000","last_undegraded":"2023-12-19T19:00:29.959566+0000","last_fullsized":"2023-12-19T19:00:29.959566+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-19T19:00:30.955078+0000","last_change":"2023-12-19T19:00:30.955078+0000","last_active":"2023-12-19T19:00:30.955078+0000","last_peered":"2023-12-19T19:00:30.955078+0000","last_clean":"2023-12-19T19:00:30.955078+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:30.955078+0000","last_undegraded":"2023-12-19T19:00:30.955078+0000","last_fullsized":"2023-12-19T19:00:30.955078+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":47,"state":"creating+peering","last_fresh":"2023-12-19T19:00:29.969519+0000","last_change":"2023-12-19T19:00:29.969519+0000","last_active":"2023-12-19T19:00:29.946723+0000","last_peered":"2023-12-19T19:00:29.946723+0000","last_clean":"2023-12-19T19:00:29.946723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:00:29.969519+0000","last_undegraded":"2023-12-19T19:00:29.969519+0000","last_fullsized":"2023-12-19T19:00:29.969519+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":192,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-19T19:00:26.941083+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T19:00:26.941083+0000","last_peered":"2023-12-19T19:00:26.941083+0000","last_clean":"2023-12-19T19:00:26.941083+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T19:00:26.941083+0000","last_undegraded":"2023-12-19T19:00:26.941083+0000","last_fullsized":"2023-12-19T19:00:26.941083+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28148,"kb_used_data":1128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343692,"statfs":{"total":96636764160,"available":96607940608,"internally_reserved":0,"allocated":1155072,"data_stored":823117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.64800000000000002}]},{"osd":1,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.57899999999999996}]},{"osd":2,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.77800000000000002}]},{"osd":3,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.68799999999999994}]},{"osd":4,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.62}]},{"osd":5,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.74199999999999999}]},{"osd":6,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.79700000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.77500000000000002}]},{"osd":1,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.72599999999999998}]},{"osd":2,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.73899999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.76000000000000001}]},{"osd":4,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.53900000000000003}]},{"osd":5,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.61399999999999999}]},{"osd":7,"last update":"Tue Dec 19 18:59:31 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.67700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":548864,"data_stored":226932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":7.4550000000000001,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.877},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":16.951000000000001,"5min":16.951000000000001,"15min":16.951000000000001},"last":0.90300000000000002}]},{"osd":1,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":19.823,"5min":19.823,"15min":19.823},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.83999999999999997}]},{"osd":2,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.85999999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.2949999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.7649999999999997,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":0.88900000000000001}]},{"osd":4,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.6499999999999999,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":0.58399999999999996}]},{"osd":6,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.623}]},{"osd":7,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.371,"5min":2.371,"15min":2.371},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.55800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.7690000000000001,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.70099999999999996}]},{"osd":1,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":3.3849999999999998,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":0.71899999999999997}]},{"osd":2,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":3.1240000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.78000000000000003}]},{"osd":3,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":0.747},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":3.194,"5min":3.194,"15min":3.194},"last":0.79700000000000004}]},{"osd":5,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":9.3040000000000003,"5min":9.3040000000000003,"15min":9.3040000000000003},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.59699999999999998}]},{"osd":6,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":3.097,"5min":3.097,"15min":3.097},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":3.3319999999999999,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.81200000000000006}]},{"osd":7,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":5.0410000000000004,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":6.3449999999999998,"5min":6.3449999999999998,"15min":6.3449999999999998},"last":0.73199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.49299999999999999}]},{"osd":1,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.38500000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.42299999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.64300000000000002}]},{"osd":5,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.67000000000000004}]},{"osd":6,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.65300000000000002}]},{"osd":7,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.626},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.56599999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.3599999999999999,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.60899999999999999}]},{"osd":1,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":0.56599999999999995}]},{"osd":3,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":3.0259999999999998,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.9259999999999999,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.58499999999999996}]},{"osd":4,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.835,"5min":2.835,"15min":2.835},"last":0.74099999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":3.5,"5min":3.5,"15min":3.5},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.996,"5min":1.996,"15min":1.996},"last":0.81299999999999994}]},{"osd":6,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.903,"5min":2.903,"15min":2.903},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.7109999999999999,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.82599999999999996}]},{"osd":7,"last update":"Tue Dec 19 18:59:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":2.875,"5min":2.875,"15min":2.875},"last":0.79900000000000004},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.7570000000000001,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.86299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27568,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344272,"statfs":{"total":96636764160,"available":96608534528,"internally_reserved":0,"allocated":561152,"data_stored":232749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":4.2000000000000002,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.318},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":7.7320000000000002,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.38500000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":3.9129999999999998,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.4720000000000004,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.42199999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":7.8399999999999999,"5min":7.8399999999999999,"15min":7.8399999999999999},"last":0.505},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":7.7949999999999999,"5min":7.7949999999999999,"15min":7.7949999999999999},"last":0.52600000000000002}]},{"osd":4,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":4.2690000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":4.2910000000000004,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.751}]},{"osd":5,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":4.3490000000000002,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":4.2480000000000002,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.63800000000000001}]},{"osd":6,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":4.1609999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":4.3099999999999996,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.76400000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":4.3310000000000004,"5min":4.3310000000000004,"15min":4.3310000000000004},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":4.226,"5min":4.226,"15min":4.226},"last":0.83299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1150976,"data_stored":822098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.63100000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.45100000000000001}]},{"osd":3,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.86899999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":1.018}]},{"osd":5,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.90500000000000003}]},{"osd":6,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.88400000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:59:30 2023","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.96699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T19:00:36.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3f is not active+clean 2023-12-19T19:00:36.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3e is not active+clean 2023-12-19T19:00:36.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3d is not active+clean 2023-12-19T19:00:36.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3c is not active+clean 2023-12-19T19:00:36.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3b is not active+clean 2023-12-19T19:00:36.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3a is not active+clean 2023-12-19T19:00:36.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.39 is not active+clean 2023-12-19T19:00:36.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.38 is not active+clean 2023-12-19T19:00:36.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.37 is not active+clean 2023-12-19T19:00:36.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.36 is not active+clean 2023-12-19T19:00:36.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.35 is not active+clean 2023-12-19T19:00:36.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.34 is not active+clean 2023-12-19T19:00:36.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.33 is not active+clean 2023-12-19T19:00:36.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.32 is not active+clean 2023-12-19T19:00:36.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.31 is not active+clean 2023-12-19T19:00:36.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.30 is not active+clean 2023-12-19T19:00:36.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2f is not active+clean 2023-12-19T19:00:36.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2e is not active+clean 2023-12-19T19:00:36.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2d is not active+clean 2023-12-19T19:00:36.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2c is not active+clean 2023-12-19T19:00:36.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2b is not active+clean 2023-12-19T19:00:36.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2a is not active+clean 2023-12-19T19:00:36.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.29 is not active+clean 2023-12-19T19:00:36.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.28 is not active+clean 2023-12-19T19:00:36.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.27 is not active+clean 2023-12-19T19:00:36.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.26 is not active+clean 2023-12-19T19:00:36.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.25 is not active+clean 2023-12-19T19:00:36.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.24 is not active+clean 2023-12-19T19:00:36.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.23 is not active+clean 2023-12-19T19:00:36.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.22 is not active+clean 2023-12-19T19:00:36.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.21 is not active+clean 2023-12-19T19:00:36.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.20 is not active+clean 2023-12-19T19:00:36.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1e is not active+clean 2023-12-19T19:00:36.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1f is not active+clean 2023-12-19T19:00:36.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.964719+0000', 'last_change': '2023-12-19T19:00:29.964719+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.964719+0000', 'last_undegraded': '2023-12-19T19:00:29.964719+0000', 'last_fullsized': '2023-12-19T19:00:29.964719+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T19:00:36.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1f is not active+clean 2023-12-19T19:00:36.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1e is not active+clean 2023-12-19T19:00:36.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.961340+0000', 'last_change': '2023-12-19T19:00:29.961340+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.961340+0000', 'last_undegraded': '2023-12-19T19:00:29.961340+0000', 'last_fullsized': '2023-12-19T19:00:29.961340+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T19:00:36.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1c is not active+clean 2023-12-19T19:00:36.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1d is not active+clean 2023-12-19T19:00:36.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.965244+0000', 'last_change': '2023-12-19T19:00:29.965244+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.965244+0000', 'last_undegraded': '2023-12-19T19:00:29.965244+0000', 'last_fullsized': '2023-12-19T19:00:29.965244+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T19:00:36.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1d is not active+clean 2023-12-19T19:00:36.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1c is not active+clean 2023-12-19T19:00:36.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.963195+0000', 'last_change': '2023-12-19T19:00:29.963195+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.963195+0000', 'last_undegraded': '2023-12-19T19:00:29.963195+0000', 'last_fullsized': '2023-12-19T19:00:29.963195+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T19:00:36.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1a is not active+clean 2023-12-19T19:00:36.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-12-19T19:00:36.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.961107+0000', 'last_change': '2023-12-19T19:00:29.961107+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.961107+0000', 'last_undegraded': '2023-12-19T19:00:29.961107+0000', 'last_fullsized': '2023-12-19T19:00:29.961107+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T19:00:36.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1b is not active+clean 2023-12-19T19:00:36.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1a is not active+clean 2023-12-19T19:00:36.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.963576+0000', 'last_change': '2023-12-19T19:00:29.963576+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.963576+0000', 'last_undegraded': '2023-12-19T19:00:29.963576+0000', 'last_fullsized': '2023-12-19T19:00:29.963576+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T19:00:36.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.18 is not active+clean 2023-12-19T19:00:36.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.19 is not active+clean 2023-12-19T19:00:36.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.962767+0000', 'last_change': '2023-12-19T19:00:29.962767+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.962767+0000', 'last_undegraded': '2023-12-19T19:00:29.962767+0000', 'last_fullsized': '2023-12-19T19:00:29.962767+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T19:00:36.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.19 is not active+clean 2023-12-19T19:00:36.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-12-19T19:00:36.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.960060+0000', 'last_change': '2023-12-19T19:00:29.960060+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.960060+0000', 'last_undegraded': '2023-12-19T19:00:29.960060+0000', 'last_fullsized': '2023-12-19T19:00:29.960060+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T19:00:36.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.16 is not active+clean 2023-12-19T19:00:36.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.17 is not active+clean 2023-12-19T19:00:36.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.960933+0000', 'last_change': '2023-12-19T19:00:29.960933+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.960933+0000', 'last_undegraded': '2023-12-19T19:00:29.960933+0000', 'last_fullsized': '2023-12-19T19:00:29.960933+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T19:00:36.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.17 is not active+clean 2023-12-19T19:00:36.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.16 is not active+clean 2023-12-19T19:00:36.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.960774+0000', 'last_change': '2023-12-19T19:00:29.960774+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.960774+0000', 'last_undegraded': '2023-12-19T19:00:29.960774+0000', 'last_fullsized': '2023-12-19T19:00:29.960774+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T19:00:36.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.14 is not active+clean 2023-12-19T19:00:36.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.15 is not active+clean 2023-12-19T19:00:36.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.960399+0000', 'last_change': '2023-12-19T19:00:29.960399+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.960399+0000', 'last_undegraded': '2023-12-19T19:00:29.960399+0000', 'last_fullsized': '2023-12-19T19:00:29.960399+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T19:00:36.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.15 is not active+clean 2023-12-19T19:00:36.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-12-19T19:00:36.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.961618+0000', 'last_change': '2023-12-19T19:00:29.961618+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.961618+0000', 'last_undegraded': '2023-12-19T19:00:29.961618+0000', 'last_fullsized': '2023-12-19T19:00:29.961618+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T19:00:36.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.12 is not active+clean 2023-12-19T19:00:36.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.13 is not active+clean 2023-12-19T19:00:36.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.960676+0000', 'last_change': '2023-12-19T19:00:29.960676+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.960676+0000', 'last_undegraded': '2023-12-19T19:00:29.960676+0000', 'last_fullsized': '2023-12-19T19:00:29.960676+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T19:00:36.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.13 is not active+clean 2023-12-19T19:00:36.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-12-19T19:00:36.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.969610+0000', 'last_change': '2023-12-19T19:00:29.969610+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.969610+0000', 'last_undegraded': '2023-12-19T19:00:29.969610+0000', 'last_fullsized': '2023-12-19T19:00:29.969610+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T19:00:36.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.10 is not active+clean 2023-12-19T19:00:36.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.11 is not active+clean 2023-12-19T19:00:36.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.962082+0000', 'last_change': '2023-12-19T19:00:29.962082+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.962082+0000', 'last_undegraded': '2023-12-19T19:00:29.962082+0000', 'last_fullsized': '2023-12-19T19:00:29.962082+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T19:00:36.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.11 is not active+clean 2023-12-19T19:00:36.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.10 is not active+clean 2023-12-19T19:00:36.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.960388+0000', 'last_change': '2023-12-19T19:00:29.960388+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.960388+0000', 'last_undegraded': '2023-12-19T19:00:29.960388+0000', 'last_fullsized': '2023-12-19T19:00:29.960388+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T19:00:36.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.e is not active+clean 2023-12-19T19:00:36.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.f is not active+clean 2023-12-19T19:00:36.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.959578+0000', 'last_change': '2023-12-19T19:00:29.959578+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.959578+0000', 'last_undegraded': '2023-12-19T19:00:29.959578+0000', 'last_fullsized': '2023-12-19T19:00:29.959578+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T19:00:36.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.f is not active+clean 2023-12-19T19:00:36.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.e is not active+clean 2023-12-19T19:00:36.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.965075+0000', 'last_change': '2023-12-19T19:00:29.965075+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.965075+0000', 'last_undegraded': '2023-12-19T19:00:29.965075+0000', 'last_fullsized': '2023-12-19T19:00:29.965075+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T19:00:36.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.c is not active+clean 2023-12-19T19:00:36.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.d is not active+clean 2023-12-19T19:00:36.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.962313+0000', 'last_change': '2023-12-19T19:00:29.962313+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.962313+0000', 'last_undegraded': '2023-12-19T19:00:29.962313+0000', 'last_fullsized': '2023-12-19T19:00:29.962313+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T19:00:36.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.d is not active+clean 2023-12-19T19:00:36.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.c is not active+clean 2023-12-19T19:00:36.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.963598+0000', 'last_change': '2023-12-19T19:00:29.963598+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.963598+0000', 'last_undegraded': '2023-12-19T19:00:29.963598+0000', 'last_fullsized': '2023-12-19T19:00:29.963598+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T19:00:36.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.a is not active+clean 2023-12-19T19:00:36.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.b is not active+clean 2023-12-19T19:00:36.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.959638+0000', 'last_change': '2023-12-19T19:00:29.959638+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.959638+0000', 'last_undegraded': '2023-12-19T19:00:29.959638+0000', 'last_fullsized': '2023-12-19T19:00:29.959638+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T19:00:36.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.b is not active+clean 2023-12-19T19:00:36.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-12-19T19:00:36.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.965842+0000', 'last_change': '2023-12-19T19:00:29.965842+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.965842+0000', 'last_undegraded': '2023-12-19T19:00:29.965842+0000', 'last_fullsized': '2023-12-19T19:00:29.965842+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T19:00:36.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.9 is not active+clean 2023-12-19T19:00:36.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.8 is not active+clean 2023-12-19T19:00:36.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.962143+0000', 'last_change': '2023-12-19T19:00:29.962143+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.962143+0000', 'last_undegraded': '2023-12-19T19:00:29.962143+0000', 'last_fullsized': '2023-12-19T19:00:29.962143+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T19:00:36.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.6 is not active+clean 2023-12-19T19:00:36.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-12-19T19:00:36.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.966371+0000', 'last_change': '2023-12-19T19:00:29.966371+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.966371+0000', 'last_undegraded': '2023-12-19T19:00:29.966371+0000', 'last_fullsized': '2023-12-19T19:00:29.966371+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T19:00:36.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.7 is not active+clean 2023-12-19T19:00:36.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.6 is not active+clean 2023-12-19T19:00:36.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.964580+0000', 'last_change': '2023-12-19T19:00:29.964580+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.964580+0000', 'last_undegraded': '2023-12-19T19:00:29.964580+0000', 'last_fullsized': '2023-12-19T19:00:29.964580+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T19:00:36.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.4 is not active+clean 2023-12-19T19:00:36.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-12-19T19:00:36.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.969560+0000', 'last_change': '2023-12-19T19:00:29.969560+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.969560+0000', 'last_undegraded': '2023-12-19T19:00:29.969560+0000', 'last_fullsized': '2023-12-19T19:00:29.969560+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T19:00:36.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.5 is not active+clean 2023-12-19T19:00:36.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.4 is not active+clean 2023-12-19T19:00:36.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.962629+0000', 'last_change': '2023-12-19T19:00:29.962629+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.962629+0000', 'last_undegraded': '2023-12-19T19:00:29.962629+0000', 'last_fullsized': '2023-12-19T19:00:29.962629+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T19:00:36.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.2 is not active+clean 2023-12-19T19:00:36.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-12-19T19:00:36.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.967799+0000', 'last_change': '2023-12-19T19:00:29.967799+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.967799+0000', 'last_undegraded': '2023-12-19T19:00:29.967799+0000', 'last_fullsized': '2023-12-19T19:00:29.967799+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T19:00:36.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.3 is not active+clean 2023-12-19T19:00:36.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-12-19T19:00:36.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.960029+0000', 'last_change': '2023-12-19T19:00:29.960029+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.960029+0000', 'last_undegraded': '2023-12-19T19:00:29.960029+0000', 'last_fullsized': '2023-12-19T19:00:29.960029+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T19:00:36.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.0 is not active+clean 2023-12-19T19:00:36.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2023-12-19T19:00:36.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.965291+0000', 'last_change': '2023-12-19T19:00:29.965291+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.965291+0000', 'last_undegraded': '2023-12-19T19:00:29.965291+0000', 'last_fullsized': '2023-12-19T19:00:29.965291+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T19:00:36.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.1 is not active+clean 2023-12-19T19:00:36.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.0 is not active+clean 2023-12-19T19:00:36.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.959566+0000', 'last_change': '2023-12-19T19:00:29.959566+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.959566+0000', 'last_undegraded': '2023-12-19T19:00:29.959566+0000', 'last_fullsized': '2023-12-19T19:00:29.959566+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T19:00:36.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 9.8 is not active+clean 2023-12-19T19:00:36.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-19T19:00:30.955078+0000', 'last_change': '2023-12-19T19:00:30.955078+0000', 'last_active': '2023-12-19T19:00:30.955078+0000', 'last_peered': '2023-12-19T19:00:30.955078+0000', 'last_clean': '2023-12-19T19:00:30.955078+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:30.955078+0000', 'last_undegraded': '2023-12-19T19:00:30.955078+0000', 'last_fullsized': '2023-12-19T19:00:30.955078+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:30.955078+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-19T19:00:36.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-12-19T19:00:36.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 47, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:00:29.969519+0000', 'last_change': '2023-12-19T19:00:29.969519+0000', 'last_active': '2023-12-19T19:00:29.946723+0000', 'last_peered': '2023-12-19T19:00:29.946723+0000', 'last_clean': '2023-12-19T19:00:29.946723+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:00:29.969519+0000', 'last_undegraded': '2023-12-19T19:00:29.969519+0000', 'last_fullsized': '2023-12-19T19:00:29.969519+0000', 'mapping_epoch': 47, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 47, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'last_clean_scrub_stamp': '2023-12-19T19:00:29.946723+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T19:00:36.809 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-19T19:00:36.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.966+0000 7ff12a017640 1 Processor -- start 2023-12-19T19:00:36.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.966+0000 7ff12a017640 1 -- start start 2023-12-19T19:00:36.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.966+0000 7ff12a017640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff124151cd0 0x7ff1240ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:36.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.966+0000 7ff12a017640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff1240c7c50 0x7ff1241544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:36.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.966+0000 7ff12a017640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1240c8160 con 0x7ff1240ca9a0 2023-12-19T19:00:36.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.966+0000 7ff12a017640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff124157b40 con 0x7ff1240c7c50 2023-12-19T19:00:36.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.966+0000 7ff12a017640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff124157e20 con 0x7ff124151cd0 2023-12-19T19:00:36.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.966+0000 7ff128814640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff1240c7c50 0x7ff1241544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:36.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.966+0000 7ff128814640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff1240c7c50 0x7ff1241544d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59136/0 (socket says 172.21.15.133:59136) 2023-12-19T19:00:36.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.966+0000 7ff128814640 1 -- 172.21.15.133:0/1266727361 learned_addr learned my addr 172.21.15.133:0/1266727361 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:36.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.966+0000 7ff129015640 1 --2- 172.21.15.133:0/1266727361 >> v2:172.21.15.138:3300/0 conn(0x7ff124151cd0 0x7ff1240ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:36.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.966+0000 7ff128814640 1 -- 172.21.15.133:0/1266727361 >> v2:172.21.15.138:3300/0 conn(0x7ff124151cd0 msgr2=0x7ff1240ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:36.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.966+0000 7ff128814640 1 --2- 172.21.15.133:0/1266727361 >> v2:172.21.15.138:3300/0 conn(0x7ff124151cd0 0x7ff1240ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.966+0000 7ff128814640 1 -- 172.21.15.133:0/1266727361 >> v1:172.21.15.138:6789/0 conn(0x7ff1240ca9a0 legacy=0x7ff12406b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:36.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.966+0000 7ff128814640 1 -- 172.21.15.133:0/1266727361 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff124158100 con 0x7ff1240c7c50 2023-12-19T19:00:36.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.970+0000 7ff128814640 1 --2- 172.21.15.133:0/1266727361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1240c7c50 0x7ff1241544d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff12408b9c0 tx=0x7ff11401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78430de5137ff6cc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:36.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.970+0000 7ff11bfff640 1 -- 172.21.15.133:0/1266727361 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1140aa650 con 0x7ff1240c7c50 2023-12-19T19:00:36.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.970+0000 7ff11bfff640 1 -- 172.21.15.133:0/1266727361 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1140aa7b0 con 0x7ff1240c7c50 2023-12-19T19:00:36.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.970+0000 7ff11bfff640 1 -- 172.21.15.133:0/1266727361 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1140aab40 con 0x7ff1240c7c50 2023-12-19T19:00:36.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.970+0000 7ff12a017640 1 -- 172.21.15.133:0/1266727361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1240c7c50 msgr2=0x7ff1241544d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:36.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.970+0000 7ff12a017640 1 --2- 172.21.15.133:0/1266727361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1240c7c50 0x7ff1241544d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7ff12408b9c0 tx=0x7ff11401c4d0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.970+0000 7ff12a017640 1 -- 172.21.15.133:0/1266727361 shutdown_connections 2023-12-19T19:00:36.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.970+0000 7ff12a017640 1 --2- 172.21.15.133:0/1266727361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1240c7c50 0x7ff1241544d0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.970+0000 7ff12a017640 1 --2- 172.21.15.133:0/1266727361 >> v2:172.21.15.138:3300/0 conn(0x7ff124151cd0 0x7ff1240ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.970+0000 7ff12a017640 1 -- 172.21.15.133:0/1266727361 >> 172.21.15.133:0/1266727361 conn(0x7ff1240abee0 msgr2=0x7ff1240c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:36.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.970+0000 7ff12a017640 1 -- 172.21.15.133:0/1266727361 shutdown_connections 2023-12-19T19:00:36.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.970+0000 7ff12a017640 1 -- 172.21.15.133:0/1266727361 wait complete. 2023-12-19T19:00:36.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff12a017640 1 Processor -- start 2023-12-19T19:00:36.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff12a017640 1 -- start start 2023-12-19T19:00:36.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff12a017640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1240c7c50 0x7ff124156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:36.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff12a017640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1240ca9a0 0x7ff12414d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:36.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff12a017640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff124151cd0 0x7ff12414de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:36.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff12a017640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12414e720 con 0x7ff1240c7c50 2023-12-19T19:00:36.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff12a017640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1241edb90 con 0x7ff124151cd0 2023-12-19T19:00:36.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff12a017640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff124145b60 con 0x7ff1240ca9a0 2023-12-19T19:00:36.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff129015640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1240c7c50 0x7ff124156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:36.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff129015640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1240c7c50 0x7ff124156a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59140/0 (socket says 172.21.15.133:59140) 2023-12-19T19:00:36.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff129015640 1 -- 172.21.15.133:0/3119073794 learned_addr learned my addr 172.21.15.133:0/3119073794 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:36.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff128814640 1 --2- 172.21.15.133:0/3119073794 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1240ca9a0 0x7ff12414d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:36.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff129816640 1 --2- 172.21.15.133:0/3119073794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff124151cd0 0x7ff12414de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:36.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff129015640 1 -- 172.21.15.133:0/3119073794 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1240ca9a0 msgr2=0x7ff12414d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:36.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff129015640 1 --2- 172.21.15.133:0/3119073794 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1240ca9a0 0x7ff12414d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff129015640 1 -- 172.21.15.133:0/3119073794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff124151cd0 msgr2=0x7ff12414de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:36.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff129015640 1 --2- 172.21.15.133:0/3119073794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff124151cd0 0x7ff12414de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:36.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff129015640 1 -- 172.21.15.133:0/3119073794 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1140094d0 con 0x7ff1240c7c50 2023-12-19T19:00:36.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff128814640 1 --2- 172.21.15.133:0/3119073794 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1240ca9a0 0x7ff12414d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:36.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff129015640 1 --2- 172.21.15.133:0/3119073794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1240c7c50 0x7ff124156a00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff12000e870 tx=0x7ff12000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:36.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff119ffb640 1 -- 172.21.15.133:0/3119073794 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff120009510 con 0x7ff1240c7c50 2023-12-19T19:00:36.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff119ffb640 1 -- 172.21.15.133:0/3119073794 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12000eec0 con 0x7ff1240c7c50 2023-12-19T19:00:36.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff12a017640 1 -- 172.21.15.133:0/3119073794 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12414e380 con 0x7ff1240c7c50 2023-12-19T19:00:36.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff119ffb640 1 -- 172.21.15.133:0/3119073794 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12000cb40 con 0x7ff1240c7c50 2023-12-19T19:00:36.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff12a017640 1 -- 172.21.15.133:0/3119073794 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1241ed2f0 con 0x7ff1240c7c50 2023-12-19T19:00:36.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.974+0000 7ff12a017640 1 -- 172.21.15.133:0/3119073794 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff124152380 con 0x7ff1240c7c50 2023-12-19T19:00:36.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.978+0000 7ff119ffb640 1 -- 172.21.15.133:0/3119073794 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff12000cca0 con 0x7ff1240c7c50 2023-12-19T19:00:36.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.978+0000 7ff119ffb640 1 --2- 172.21.15.133:0/3119073794 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff108066470 0x7ff108068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:36.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.978+0000 7ff119ffb640 1 -- 172.21.15.133:0/3119073794 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff120083f20 con 0x7ff1240c7c50 2023-12-19T19:00:36.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.978+0000 7ff128814640 1 --2- 172.21.15.133:0/3119073794 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff108066470 0x7ff108068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:36.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.978+0000 7ff128814640 1 --2- 172.21.15.133:0/3119073794 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff108066470 0x7ff108068930 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff1140ae000 tx=0x7ff1140a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:36.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:36.982+0000 7ff119ffb640 1 -- 172.21.15.133:0/3119073794 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff120051430 con 0x7ff1240c7c50 2023-12-19T19:00:37.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.190+0000 7ff12a017640 1 -- 172.21.15.133:0/3119073794 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff124154710 con 0x7ff1240c7c50 2023-12-19T19:00:37.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.190+0000 7ff119ffb640 1 -- 172.21.15.133:0/3119073794 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1431 (secure 0 0 0) 0x7ff120054a50 con 0x7ff1240c7c50 2023-12-19T19:00:37.193 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:37.193 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":139,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":50,"num_osds":8,"num_up_osds":8,"osd_up_since":1703012310,"num_in_osds":8,"osd_in_since":1703012300,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":231673856,"bytes_avail":772862439424,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":32,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":5763}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-12-19T19:00:22.854810+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-19T19:00:37.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.190+0000 7ff12a017640 1 -- 172.21.15.133:0/3119073794 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff108066470 msgr2=0x7ff108068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:37.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.190+0000 7ff12a017640 1 --2- 172.21.15.133:0/3119073794 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff108066470 0x7ff108068930 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff1140ae000 tx=0x7ff1140a7000 comp rx=0 tx=0).stop 2023-12-19T19:00:37.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.190+0000 7ff12a017640 1 -- 172.21.15.133:0/3119073794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1240c7c50 msgr2=0x7ff124156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:37.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.190+0000 7ff12a017640 1 --2- 172.21.15.133:0/3119073794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1240c7c50 0x7ff124156a00 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7ff12000e870 tx=0x7ff12000ec70 comp rx=0 tx=0).stop 2023-12-19T19:00:37.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.190+0000 7ff12a017640 1 -- 172.21.15.133:0/3119073794 shutdown_connections 2023-12-19T19:00:37.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.190+0000 7ff12a017640 1 --2- 172.21.15.133:0/3119073794 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff108066470 0x7ff108068930 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:37.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.190+0000 7ff12a017640 1 --2- 172.21.15.133:0/3119073794 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff124151cd0 0x7ff12414de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:37.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.190+0000 7ff12a017640 1 --2- 172.21.15.133:0/3119073794 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1240ca9a0 0x7ff12414d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:37.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.190+0000 7ff12a017640 1 --2- 172.21.15.133:0/3119073794 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1240c7c50 0x7ff124156a00 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:37.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.190+0000 7ff12a017640 1 -- 172.21.15.133:0/3119073794 >> 172.21.15.133:0/3119073794 conn(0x7ff1240abee0 msgr2=0x7ff12406b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:37.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.190+0000 7ff12a017640 1 -- 172.21.15.133:0/3119073794 shutdown_connections 2023-12-19T19:00:37.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.190+0000 7ff12a017640 1 -- 172.21.15.133:0/3119073794 wait complete. 2023-12-19T19:00:37.213 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-19T19:00:37.213 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T19:00:37.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.346+0000 7f72a8957640 1 Processor -- start 2023-12-19T19:00:37.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.346+0000 7f72a8957640 1 -- start start 2023-12-19T19:00:37.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.350+0000 7f72a8957640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72a40c63c0 0x7f72a40c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:37.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.350+0000 7f72a8957640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f72a40c2bb0 0x7f72a40a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:37.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.350+0000 7f72a8957640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a40c31c0 con 0x7f72a40c4100 2023-12-19T19:00:37.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.350+0000 7f72a8957640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a40c34a0 con 0x7f72a40c2bb0 2023-12-19T19:00:37.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.350+0000 7f72a8957640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a40c1030 con 0x7f72a40c63c0 2023-12-19T19:00:37.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.350+0000 7f729bfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f72a40c4100 0x7f72a40c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46708/0 (socket says 172.21.15.133:46708) 2023-12-19T19:00:37.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.350+0000 7f729bfff640 1 -- 172.21.15.133:0/2874140474 learned_addr learned my addr 172.21.15.133:0/2874140474 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:37.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.350+0000 7f72a2d9d640 1 --2- 172.21.15.133:0/2874140474 >> v2:172.21.15.133:3300/0 conn(0x7f72a40c2bb0 0x7f72a40a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:37.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.350+0000 7f72a259c640 1 --2- 172.21.15.133:0/2874140474 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72a40c63c0 0x7f72a40c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:37.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.350+0000 7f72a1d9b640 1 -- 172.21.15.133:0/2874140474 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1778599395 0 0) 0x7f72a40c31c0 con 0x7f72a40c4100 2023-12-19T19:00:37.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.350+0000 7f72a1d9b640 1 -- 172.21.15.133:0/2874140474 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7290003530 con 0x7f72a40c4100 2023-12-19T19:00:37.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.350+0000 7f72a2d9d640 1 -- 172.21.15.133:0/2874140474 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72a40c63c0 msgr2=0x7f72a40c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:37.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.350+0000 7f72a2d9d640 1 --2- 172.21.15.133:0/2874140474 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72a40c63c0 0x7f72a40c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:37.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.350+0000 7f72a2d9d640 1 -- 172.21.15.133:0/2874140474 >> v1:172.21.15.133:6789/0 conn(0x7f72a40c4100 legacy=0x7f72a40c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:37.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.350+0000 7f72a2d9d640 1 -- 172.21.15.133:0/2874140474 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a40c1310 con 0x7f72a40c2bb0 2023-12-19T19:00:37.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.354+0000 7f72a2d9d640 1 --2- 172.21.15.133:0/2874140474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72a40c2bb0 0x7f72a40a9680 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f729c009d90 tx=0x7f729c01c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168ad996917b41c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:37.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.354+0000 7f72a1d9b640 1 -- 172.21.15.133:0/2874140474 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a40aa3d0 con 0x7f72a40c2bb0 2023-12-19T19:00:37.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.354+0000 7f72a1d9b640 1 -- 172.21.15.133:0/2874140474 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729c0a58e0 con 0x7f72a40c2bb0 2023-12-19T19:00:37.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.354+0000 7f72a1d9b640 1 -- 172.21.15.133:0/2874140474 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c0a5c70 con 0x7f72a40c2bb0 2023-12-19T19:00:37.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.354+0000 7f72a8957640 1 -- 172.21.15.133:0/2874140474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72a40c2bb0 msgr2=0x7f72a40a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:37.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.354+0000 7f72a8957640 1 --2- 172.21.15.133:0/2874140474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72a40c2bb0 0x7f72a40a9680 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f729c009d90 tx=0x7f729c01c800 comp rx=0 tx=0).stop 2023-12-19T19:00:37.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.354+0000 7f72a8957640 1 -- 172.21.15.133:0/2874140474 shutdown_connections 2023-12-19T19:00:37.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.354+0000 7f72a8957640 1 --2- 172.21.15.133:0/2874140474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72a40c2bb0 0x7f72a40a9680 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:37.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.354+0000 7f72a8957640 1 --2- 172.21.15.133:0/2874140474 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72a40c63c0 0x7f72a40c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:37.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.354+0000 7f72a8957640 1 -- 172.21.15.133:0/2874140474 >> 172.21.15.133:0/2874140474 conn(0x7f72a406a5b0 msgr2=0x7f72a406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:37.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.354+0000 7f72a8957640 1 -- 172.21.15.133:0/2874140474 shutdown_connections 2023-12-19T19:00:37.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.354+0000 7f72a8957640 1 -- 172.21.15.133:0/2874140474 wait complete. 2023-12-19T19:00:37.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.354+0000 7f72a8957640 1 Processor -- start 2023-12-19T19:00:37.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.354+0000 7f72a8957640 1 -- start start 2023-12-19T19:00:37.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.354+0000 7f72a8957640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72a40c2bb0 0x7f72a40c0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:37.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.354+0000 7f72a8957640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f72a40c4100 0x7f72a415a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:37.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.354+0000 7f72a8957640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72a40c63c0 0x7f72a415d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:37.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.354+0000 7f72a8957640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a40c0a40 con 0x7f72a40c63c0 2023-12-19T19:00:37.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.354+0000 7f72a8957640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a406fe50 con 0x7f72a40c4100 2023-12-19T19:00:37.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.354+0000 7f72a8957640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a40700a0 con 0x7f72a40c2bb0 2023-12-19T19:00:37.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.358+0000 7f72a2d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72a40c63c0 0x7f72a415d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:37.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.358+0000 7f72a2d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72a40c63c0 0x7f72a415d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59154/0 (socket says 172.21.15.133:59154) 2023-12-19T19:00:37.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.358+0000 7f72a2d9d640 1 -- 172.21.15.133:0/2913971215 learned_addr learned my addr 172.21.15.133:0/2913971215 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:37.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.358+0000 7f72a259c640 1 --2- 172.21.15.133:0/2913971215 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72a40c2bb0 0x7f72a40c0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:37.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.358+0000 7f729bfff640 1 --2- 172.21.15.133:0/2913971215 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f72a40c4100 0x7f72a415a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:37.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.358+0000 7f72a2d9d640 1 -- 172.21.15.133:0/2913971215 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72a40c2bb0 msgr2=0x7f72a40c0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:37.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.358+0000 7f72a2d9d640 1 --2- 172.21.15.133:0/2913971215 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72a40c2bb0 0x7f72a40c0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:37.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.358+0000 7f72a2d9d640 1 -- 172.21.15.133:0/2913971215 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f72a40c4100 msgr2=0x7f72a415a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:37.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.358+0000 7f72a2d9d640 1 --2- 172.21.15.133:0/2913971215 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f72a40c4100 0x7f72a415a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:37.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.358+0000 7f72a2d9d640 1 -- 172.21.15.133:0/2913971215 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729c009a70 con 0x7f72a40c63c0 2023-12-19T19:00:37.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.358+0000 7f729bfff640 1 --2- 172.21.15.133:0/2913971215 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f72a40c4100 0x7f72a415a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:37.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.358+0000 7f72a2d9d640 1 --2- 172.21.15.133:0/2913971215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72a40c63c0 0x7f72a415d700 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f729c0b0040 tx=0x7f729c0195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:37.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.358+0000 7f729affd640 1 -- 172.21.15.133:0/2913971215 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c0b9660 con 0x7f72a40c63c0 2023-12-19T19:00:37.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.358+0000 7f729affd640 1 -- 172.21.15.133:0/2913971215 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729c0b97c0 con 0x7f72a40c63c0 2023-12-19T19:00:37.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.358+0000 7f729affd640 1 -- 172.21.15.133:0/2913971215 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c0b9b70 con 0x7f72a40c63c0 2023-12-19T19:00:37.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.358+0000 7f72a8957640 1 -- 172.21.15.133:0/2913971215 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a40717b0 con 0x7f72a40c63c0 2023-12-19T19:00:37.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.358+0000 7f72a8957640 1 -- 172.21.15.133:0/2913971215 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a4071d70 con 0x7f72a40c63c0 2023-12-19T19:00:37.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.358+0000 7f72a8957640 1 -- 172.21.15.133:0/2913971215 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a4068400 con 0x7f72a40c63c0 2023-12-19T19:00:37.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.358+0000 7f729affd640 1 -- 172.21.15.133:0/2913971215 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f729c0b9cd0 con 0x7f72a40c63c0 2023-12-19T19:00:37.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.362+0000 7f729affd640 1 --2- 172.21.15.133:0/2913971215 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f72840664a0 0x7f7284068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:37.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.362+0000 7f729affd640 1 -- 172.21.15.133:0/2913971215 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f729c11eed0 con 0x7f72a40c63c0 2023-12-19T19:00:37.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.362+0000 7f72a259c640 1 --2- 172.21.15.133:0/2913971215 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f72840664a0 0x7f7284068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:37.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.362+0000 7f72a259c640 1 --2- 172.21.15.133:0/2913971215 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f72840664a0 0x7f7284068960 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f72a414ed90 tx=0x7f7294009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:37.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.362+0000 7f729affd640 1 -- 172.21.15.133:0/2913971215 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f729c0ec2c0 con 0x7f72a40c63c0 2023-12-19T19:00:37.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.510+0000 7f72a8957640 1 -- 172.21.15.133:0/2913971215 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f72a40c3a90 con 0x7f72840664a0 2023-12-19T19:00:37.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.518+0000 7f729affd640 1 -- 172.21.15.133:0/2913971215 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289260 (secure 0 0 0) 0x7f72a40c3a90 con 0x7f72840664a0 2023-12-19T19:00:37.524 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:37.525 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T19:00:37.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.522+0000 7f72a8957640 1 -- 172.21.15.133:0/2913971215 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f72840664a0 msgr2=0x7f7284068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:37.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.522+0000 7f72a8957640 1 --2- 172.21.15.133:0/2913971215 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f72840664a0 0x7f7284068960 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f72a414ed90 tx=0x7f7294009190 comp rx=0 tx=0).stop 2023-12-19T19:00:37.526 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.522+0000 7f72a8957640 1 -- 172.21.15.133:0/2913971215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72a40c63c0 msgr2=0x7f72a415d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:37.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.522+0000 7f72a8957640 1 --2- 172.21.15.133:0/2913971215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72a40c63c0 0x7f72a415d700 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f729c0b0040 tx=0x7f729c0195a0 comp rx=0 tx=0).stop 2023-12-19T19:00:37.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.522+0000 7f72a8957640 1 -- 172.21.15.133:0/2913971215 shutdown_connections 2023-12-19T19:00:37.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.522+0000 7f72a8957640 1 --2- 172.21.15.133:0/2913971215 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f72840664a0 0x7f7284068960 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:37.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.522+0000 7f72a8957640 1 --2- 172.21.15.133:0/2913971215 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f72a40c63c0 0x7f72a415d700 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:37.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.522+0000 7f72a8957640 1 --2- 172.21.15.133:0/2913971215 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f72a40c4100 0x7f72a415a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:37.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.522+0000 7f72a8957640 1 --2- 172.21.15.133:0/2913971215 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72a40c2bb0 0x7f72a40c0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:37.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.522+0000 7f72a8957640 1 -- 172.21.15.133:0/2913971215 >> 172.21.15.133:0/2913971215 conn(0x7f72a406a5b0 msgr2=0x7f72a406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:37.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.522+0000 7f72a8957640 1 -- 172.21.15.133:0/2913971215 shutdown_connections 2023-12-19T19:00:37.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:37.522+0000 7f72a8957640 1 -- 172.21.15.133:0/2913971215 wait complete. 2023-12-19T19:00:37.543 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2023-12-19T19:00:36.858012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226244,"kb_used_data":5892,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748476,"statfs":{"total":773094113280,"available":772862439424,"internally_reserved":0,"allocated":6033408,"data_stored":3201265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001621"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706682+0000","last_change":"2023-12-19T19:00:31.998328+0000","last_active":"2023-12-19T19:00:33.706682+0000","last_peered":"2023-12-19T19:00:33.706682+0000","last_clean":"2023-12-19T19:00:33.706682+0000","last_became_active":"2023-12-19T19:00:31.998072+0000","last_became_peered":"2023-12-19T19:00:31.998072+0000","last_unstale":"2023-12-19T19:00:33.706682+0000","last_undegraded":"2023-12-19T19:00:33.706682+0000","last_fullsized":"2023-12-19T19:00:33.706682+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:11:16.755757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.986996+0000","last_change":"2023-12-19T19:00:31.988596+0000","last_active":"2023-12-19T19:00:32.986996+0000","last_peered":"2023-12-19T19:00:32.986996+0000","last_clean":"2023-12-19T19:00:32.986996+0000","last_became_active":"2023-12-19T19:00:31.988327+0000","last_became_peered":"2023-12-19T19:00:31.988327+0000","last_unstale":"2023-12-19T19:00:32.986996+0000","last_undegraded":"2023-12-19T19:00:32.986996+0000","last_fullsized":"2023-12-19T19:00:32.986996+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:05:42.607715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.989194+0000","last_change":"2023-12-19T19:00:31.987245+0000","last_active":"2023-12-19T19:00:32.989194+0000","last_peered":"2023-12-19T19:00:32.989194+0000","last_clean":"2023-12-19T19:00:32.989194+0000","last_became_active":"2023-12-19T19:00:31.986953+0000","last_became_peered":"2023-12-19T19:00:31.986953+0000","last_unstale":"2023-12-19T19:00:32.989194+0000","last_undegraded":"2023-12-19T19:00:32.989194+0000","last_fullsized":"2023-12-19T19:00:32.989194+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:34.630792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706027+0000","last_change":"2023-12-19T19:00:32.009662+0000","last_active":"2023-12-19T19:00:33.706027+0000","last_peered":"2023-12-19T19:00:33.706027+0000","last_clean":"2023-12-19T19:00:33.706027+0000","last_became_active":"2023-12-19T19:00:32.009345+0000","last_became_peered":"2023-12-19T19:00:32.009345+0000","last_unstale":"2023-12-19T19:00:33.706027+0000","last_undegraded":"2023-12-19T19:00:33.706027+0000","last_fullsized":"2023-12-19T19:00:33.706027+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:27:21.821975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.705926+0000","last_change":"2023-12-19T19:00:32.008158+0000","last_active":"2023-12-19T19:00:33.705926+0000","last_peered":"2023-12-19T19:00:33.705926+0000","last_clean":"2023-12-19T19:00:33.705926+0000","last_became_active":"2023-12-19T19:00:32.005772+0000","last_became_peered":"2023-12-19T19:00:32.005772+0000","last_unstale":"2023-12-19T19:00:33.705926+0000","last_undegraded":"2023-12-19T19:00:33.705926+0000","last_fullsized":"2023-12-19T19:00:33.705926+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:34.376469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706079+0000","last_change":"2023-12-19T19:00:31.995665+0000","last_active":"2023-12-19T19:00:33.706079+0000","last_peered":"2023-12-19T19:00:33.706079+0000","last_clean":"2023-12-19T19:00:33.706079+0000","last_became_active":"2023-12-19T19:00:31.995407+0000","last_became_peered":"2023-12-19T19:00:31.995407+0000","last_unstale":"2023-12-19T19:00:33.706079+0000","last_undegraded":"2023-12-19T19:00:33.706079+0000","last_fullsized":"2023-12-19T19:00:33.706079+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:34.630792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.988302+0000","last_change":"2023-12-19T19:00:31.987493+0000","last_active":"2023-12-19T19:00:32.988302+0000","last_peered":"2023-12-19T19:00:32.988302+0000","last_clean":"2023-12-19T19:00:32.988302+0000","last_became_active":"2023-12-19T19:00:31.987252+0000","last_became_peered":"2023-12-19T19:00:31.987252+0000","last_unstale":"2023-12-19T19:00:32.988302+0000","last_undegraded":"2023-12-19T19:00:32.988302+0000","last_fullsized":"2023-12-19T19:00:32.988302+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:07:48.132861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.986632+0000","last_change":"2023-12-19T19:00:31.995216+0000","last_active":"2023-12-19T19:00:32.986632+0000","last_peered":"2023-12-19T19:00:32.986632+0000","last_clean":"2023-12-19T19:00:32.986632+0000","last_became_active":"2023-12-19T19:00:31.994879+0000","last_became_peered":"2023-12-19T19:00:31.994879+0000","last_unstale":"2023-12-19T19:00:32.986632+0000","last_undegraded":"2023-12-19T19:00:32.986632+0000","last_fullsized":"2023-12-19T19:00:32.986632+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:50.358908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.989564+0000","last_change":"2023-12-19T19:00:32.007195+0000","last_active":"2023-12-19T19:00:32.989564+0000","last_peered":"2023-12-19T19:00:32.989564+0000","last_clean":"2023-12-19T19:00:32.989564+0000","last_became_active":"2023-12-19T19:00:32.006848+0000","last_became_peered":"2023-12-19T19:00:32.006848+0000","last_unstale":"2023-12-19T19:00:32.989564+0000","last_undegraded":"2023-12-19T19:00:32.989564+0000","last_fullsized":"2023-12-19T19:00:32.989564+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:03.755019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.495354+0000","last_change":"2023-12-19T19:00:31.996387+0000","last_active":"2023-12-19T19:00:33.495354+0000","last_peered":"2023-12-19T19:00:33.495354+0000","last_clean":"2023-12-19T19:00:33.495354+0000","last_became_active":"2023-12-19T19:00:31.996111+0000","last_became_peered":"2023-12-19T19:00:31.996111+0000","last_unstale":"2023-12-19T19:00:33.495354+0000","last_undegraded":"2023-12-19T19:00:33.495354+0000","last_fullsized":"2023-12-19T19:00:33.495354+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:07:14.048441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.495284+0000","last_change":"2023-12-19T19:00:31.998530+0000","last_active":"2023-12-19T19:00:33.495284+0000","last_peered":"2023-12-19T19:00:33.495284+0000","last_clean":"2023-12-19T19:00:33.495284+0000","last_became_active":"2023-12-19T19:00:31.998192+0000","last_became_peered":"2023-12-19T19:00:31.998192+0000","last_unstale":"2023-12-19T19:00:33.495284+0000","last_undegraded":"2023-12-19T19:00:33.495284+0000","last_fullsized":"2023-12-19T19:00:33.495284+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:04:28.425713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706187+0000","last_change":"2023-12-19T19:00:31.996756+0000","last_active":"2023-12-19T19:00:33.706187+0000","last_peered":"2023-12-19T19:00:33.706187+0000","last_clean":"2023-12-19T19:00:33.706187+0000","last_became_active":"2023-12-19T19:00:31.996480+0000","last_became_peered":"2023-12-19T19:00:31.996480+0000","last_unstale":"2023-12-19T19:00:33.706187+0000","last_undegraded":"2023-12-19T19:00:33.706187+0000","last_fullsized":"2023-12-19T19:00:33.706187+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:36.947100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706635+0000","last_change":"2023-12-19T19:00:32.013269+0000","last_active":"2023-12-19T19:00:33.706635+0000","last_peered":"2023-12-19T19:00:33.706635+0000","last_clean":"2023-12-19T19:00:33.706635+0000","last_became_active":"2023-12-19T19:00:32.012808+0000","last_became_peered":"2023-12-19T19:00:32.012808+0000","last_unstale":"2023-12-19T19:00:33.706635+0000","last_undegraded":"2023-12-19T19:00:33.706635+0000","last_fullsized":"2023-12-19T19:00:33.706635+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:38:03.773877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.988526+0000","last_change":"2023-12-19T19:00:31.994520+0000","last_active":"2023-12-19T19:00:32.988526+0000","last_peered":"2023-12-19T19:00:32.988526+0000","last_clean":"2023-12-19T19:00:32.988526+0000","last_became_active":"2023-12-19T19:00:31.994221+0000","last_became_peered":"2023-12-19T19:00:31.994221+0000","last_unstale":"2023-12-19T19:00:32.988526+0000","last_undegraded":"2023-12-19T19:00:32.988526+0000","last_fullsized":"2023-12-19T19:00:32.988526+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:27.267758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.988442+0000","last_change":"2023-12-19T19:00:31.993938+0000","last_active":"2023-12-19T19:00:32.988442+0000","last_peered":"2023-12-19T19:00:32.988442+0000","last_clean":"2023-12-19T19:00:32.988442+0000","last_became_active":"2023-12-19T19:00:31.993647+0000","last_became_peered":"2023-12-19T19:00:31.993647+0000","last_unstale":"2023-12-19T19:00:32.988442+0000","last_undegraded":"2023-12-19T19:00:32.988442+0000","last_fullsized":"2023-12-19T19:00:32.988442+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:34.112789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.705864+0000","last_change":"2023-12-19T19:00:31.993839+0000","last_active":"2023-12-19T19:00:33.705864+0000","last_peered":"2023-12-19T19:00:33.705864+0000","last_clean":"2023-12-19T19:00:33.705864+0000","last_became_active":"2023-12-19T19:00:31.989969+0000","last_became_peered":"2023-12-19T19:00:31.989969+0000","last_unstale":"2023-12-19T19:00:33.705864+0000","last_undegraded":"2023-12-19T19:00:33.705864+0000","last_fullsized":"2023-12-19T19:00:33.705864+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:30.930514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.987194+0000","last_change":"2023-12-19T19:00:31.992695+0000","last_active":"2023-12-19T19:00:32.987194+0000","last_peered":"2023-12-19T19:00:32.987194+0000","last_clean":"2023-12-19T19:00:32.987194+0000","last_became_active":"2023-12-19T19:00:31.992420+0000","last_became_peered":"2023-12-19T19:00:31.992420+0000","last_unstale":"2023-12-19T19:00:32.987194+0000","last_undegraded":"2023-12-19T19:00:32.987194+0000","last_fullsized":"2023-12-19T19:00:32.987194+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:15:06.831796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.989362+0000","last_change":"2023-12-19T19:00:32.004815+0000","last_active":"2023-12-19T19:00:32.989362+0000","last_peered":"2023-12-19T19:00:32.989362+0000","last_clean":"2023-12-19T19:00:32.989362+0000","last_became_active":"2023-12-19T19:00:32.004530+0000","last_became_peered":"2023-12-19T19:00:32.004530+0000","last_unstale":"2023-12-19T19:00:32.989362+0000","last_undegraded":"2023-12-19T19:00:32.989362+0000","last_fullsized":"2023-12-19T19:00:32.989362+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:12:29.382064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706496+0000","last_change":"2023-12-19T19:00:31.994588+0000","last_active":"2023-12-19T19:00:33.706496+0000","last_peered":"2023-12-19T19:00:33.706496+0000","last_clean":"2023-12-19T19:00:33.706496+0000","last_became_active":"2023-12-19T19:00:31.994303+0000","last_became_peered":"2023-12-19T19:00:31.994303+0000","last_unstale":"2023-12-19T19:00:33.706496+0000","last_undegraded":"2023-12-19T19:00:33.706496+0000","last_fullsized":"2023-12-19T19:00:33.706496+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:38:25.957034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.987238+0000","last_change":"2023-12-19T19:00:32.003503+0000","last_active":"2023-12-19T19:00:32.987238+0000","last_peered":"2023-12-19T19:00:32.987238+0000","last_clean":"2023-12-19T19:00:32.987238+0000","last_became_active":"2023-12-19T19:00:32.002889+0000","last_became_peered":"2023-12-19T19:00:32.002889+0000","last_unstale":"2023-12-19T19:00:32.987238+0000","last_undegraded":"2023-12-19T19:00:32.987238+0000","last_fullsized":"2023-12-19T19:00:32.987238+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:06:56.288379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.988632+0000","last_change":"2023-12-19T19:00:31.995238+0000","last_active":"2023-12-19T19:00:32.988632+0000","last_peered":"2023-12-19T19:00:32.988632+0000","last_clean":"2023-12-19T19:00:32.988632+0000","last_became_active":"2023-12-19T19:00:31.994950+0000","last_became_peered":"2023-12-19T19:00:31.994950+0000","last_unstale":"2023-12-19T19:00:32.988632+0000","last_undegraded":"2023-12-19T19:00:32.988632+0000","last_fullsized":"2023-12-19T19:00:32.988632+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:36.947100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.986664+0000","last_change":"2023-12-19T19:00:31.998862+0000","last_active":"2023-12-19T19:00:32.986664+0000","last_peered":"2023-12-19T19:00:32.986664+0000","last_clean":"2023-12-19T19:00:32.986664+0000","last_became_active":"2023-12-19T19:00:31.996848+0000","last_became_peered":"2023-12-19T19:00:31.996848+0000","last_unstale":"2023-12-19T19:00:32.986664+0000","last_undegraded":"2023-12-19T19:00:32.986664+0000","last_fullsized":"2023-12-19T19:00:32.986664+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:52:36.347842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.988659+0000","last_change":"2023-12-19T19:00:31.986797+0000","last_active":"2023-12-19T19:00:32.988659+0000","last_peered":"2023-12-19T19:00:32.988659+0000","last_clean":"2023-12-19T19:00:32.988659+0000","last_became_active":"2023-12-19T19:00:31.986522+0000","last_became_peered":"2023-12-19T19:00:31.986522+0000","last_unstale":"2023-12-19T19:00:32.988659+0000","last_undegraded":"2023-12-19T19:00:32.988659+0000","last_fullsized":"2023-12-19T19:00:32.988659+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:34:59.517827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706004+0000","last_change":"2023-12-19T19:00:32.003120+0000","last_active":"2023-12-19T19:00:33.706004+0000","last_peered":"2023-12-19T19:00:33.706004+0000","last_clean":"2023-12-19T19:00:33.706004+0000","last_became_active":"2023-12-19T19:00:32.002670+0000","last_became_peered":"2023-12-19T19:00:32.002670+0000","last_unstale":"2023-12-19T19:00:33.706004+0000","last_undegraded":"2023-12-19T19:00:33.706004+0000","last_fullsized":"2023-12-19T19:00:33.706004+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:56:49.821008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706769+0000","last_change":"2023-12-19T19:00:32.006868+0000","last_active":"2023-12-19T19:00:33.706769+0000","last_peered":"2023-12-19T19:00:33.706769+0000","last_clean":"2023-12-19T19:00:33.706769+0000","last_became_active":"2023-12-19T19:00:32.004570+0000","last_became_peered":"2023-12-19T19:00:32.004570+0000","last_unstale":"2023-12-19T19:00:33.706769+0000","last_undegraded":"2023-12-19T19:00:33.706769+0000","last_fullsized":"2023-12-19T19:00:33.706769+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:00.659446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706655+0000","last_change":"2023-12-19T19:00:31.995715+0000","last_active":"2023-12-19T19:00:33.706655+0000","last_peered":"2023-12-19T19:00:33.706655+0000","last_clean":"2023-12-19T19:00:33.706655+0000","last_became_active":"2023-12-19T19:00:31.995368+0000","last_became_peered":"2023-12-19T19:00:31.995368+0000","last_unstale":"2023-12-19T19:00:33.706655+0000","last_undegraded":"2023-12-19T19:00:33.706655+0000","last_fullsized":"2023-12-19T19:00:33.706655+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:30.930514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706279+0000","last_change":"2023-12-19T19:00:32.003346+0000","last_active":"2023-12-19T19:00:33.706279+0000","last_peered":"2023-12-19T19:00:33.706279+0000","last_clean":"2023-12-19T19:00:33.706279+0000","last_became_active":"2023-12-19T19:00:32.003084+0000","last_became_peered":"2023-12-19T19:00:32.003084+0000","last_unstale":"2023-12-19T19:00:33.706279+0000","last_undegraded":"2023-12-19T19:00:33.706279+0000","last_fullsized":"2023-12-19T19:00:33.706279+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:22:03.749312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706473+0000","last_change":"2023-12-19T19:00:32.000999+0000","last_active":"2023-12-19T19:00:33.706473+0000","last_peered":"2023-12-19T19:00:33.706473+0000","last_clean":"2023-12-19T19:00:33.706473+0000","last_became_active":"2023-12-19T19:00:32.000704+0000","last_became_peered":"2023-12-19T19:00:32.000704+0000","last_unstale":"2023-12-19T19:00:33.706473+0000","last_undegraded":"2023-12-19T19:00:33.706473+0000","last_fullsized":"2023-12-19T19:00:33.706473+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:17:19.297149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.987156+0000","last_change":"2023-12-19T19:00:32.000428+0000","last_active":"2023-12-19T19:00:32.987156+0000","last_peered":"2023-12-19T19:00:32.987156+0000","last_clean":"2023-12-19T19:00:32.987156+0000","last_became_active":"2023-12-19T19:00:31.996129+0000","last_became_peered":"2023-12-19T19:00:31.996129+0000","last_unstale":"2023-12-19T19:00:32.987156+0000","last_undegraded":"2023-12-19T19:00:32.987156+0000","last_fullsized":"2023-12-19T19:00:32.987156+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:37:12.617236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.988675+0000","last_change":"2023-12-19T19:00:31.996533+0000","last_active":"2023-12-19T19:00:32.988675+0000","last_peered":"2023-12-19T19:00:32.988675+0000","last_clean":"2023-12-19T19:00:32.988675+0000","last_became_active":"2023-12-19T19:00:31.996157+0000","last_became_peered":"2023-12-19T19:00:31.996157+0000","last_unstale":"2023-12-19T19:00:32.988675+0000","last_undegraded":"2023-12-19T19:00:32.988675+0000","last_fullsized":"2023-12-19T19:00:32.988675+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:29.762134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.705797+0000","last_change":"2023-12-19T19:00:32.004191+0000","last_active":"2023-12-19T19:00:33.705797+0000","last_peered":"2023-12-19T19:00:33.705797+0000","last_clean":"2023-12-19T19:00:33.705797+0000","last_became_active":"2023-12-19T19:00:32.003858+0000","last_became_peered":"2023-12-19T19:00:32.003858+0000","last_unstale":"2023-12-19T19:00:33.705797+0000","last_undegraded":"2023-12-19T19:00:33.705797+0000","last_fullsized":"2023-12-19T19:00:33.705797+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:27:46.472889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.705886+0000","last_change":"2023-12-19T19:00:31.989937+0000","last_active":"2023-12-19T19:00:33.705886+0000","last_peered":"2023-12-19T19:00:33.705886+0000","last_clean":"2023-12-19T19:00:33.705886+0000","last_became_active":"2023-12-19T19:00:31.989530+0000","last_became_peered":"2023-12-19T19:00:31.989530+0000","last_unstale":"2023-12-19T19:00:33.705886+0000","last_undegraded":"2023-12-19T19:00:33.705886+0000","last_fullsized":"2023-12-19T19:00:33.705886+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:13:48.628064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706748+0000","last_change":"2023-12-19T19:00:31.993377+0000","last_active":"2023-12-19T19:00:33.706748+0000","last_peered":"2023-12-19T19:00:33.706748+0000","last_clean":"2023-12-19T19:00:33.706748+0000","last_became_active":"2023-12-19T19:00:31.993093+0000","last_became_peered":"2023-12-19T19:00:31.993093+0000","last_unstale":"2023-12-19T19:00:33.706748+0000","last_undegraded":"2023-12-19T19:00:33.706748+0000","last_fullsized":"2023-12-19T19:00:33.706748+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:12.475407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.014609+0000","last_change":"2023-12-19T19:00:30.991662+0000","last_active":"2023-12-19T19:00:32.014609+0000","last_peered":"2023-12-19T19:00:32.014609+0000","last_clean":"2023-12-19T19:00:32.014609+0000","last_became_active":"2023-12-19T19:00:30.990025+0000","last_became_peered":"2023-12-19T19:00:30.990025+0000","last_unstale":"2023-12-19T19:00:32.014609+0000","last_undegraded":"2023-12-19T19:00:32.014609+0000","last_fullsized":"2023-12-19T19:00:32.014609+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:39:36.100774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.495441+0000","last_change":"2023-12-19T19:00:31.994303+0000","last_active":"2023-12-19T19:00:33.495441+0000","last_peered":"2023-12-19T19:00:33.495441+0000","last_clean":"2023-12-19T19:00:33.495441+0000","last_became_active":"2023-12-19T19:00:31.993980+0000","last_became_peered":"2023-12-19T19:00:31.993980+0000","last_unstale":"2023-12-19T19:00:33.495441+0000","last_undegraded":"2023-12-19T19:00:33.495441+0000","last_fullsized":"2023-12-19T19:00:33.495441+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:43:14.293623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.004940+0000","last_change":"2023-12-19T19:00:30.982126+0000","last_active":"2023-12-19T19:00:32.004940+0000","last_peered":"2023-12-19T19:00:32.004940+0000","last_clean":"2023-12-19T19:00:32.004940+0000","last_became_active":"2023-12-19T19:00:30.981838+0000","last_became_peered":"2023-12-19T19:00:30.981838+0000","last_unstale":"2023-12-19T19:00:32.004940+0000","last_undegraded":"2023-12-19T19:00:32.004940+0000","last_fullsized":"2023-12-19T19:00:32.004940+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:22.410919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706291+0000","last_change":"2023-12-19T19:00:32.012177+0000","last_active":"2023-12-19T19:00:33.706291+0000","last_peered":"2023-12-19T19:00:33.706291+0000","last_clean":"2023-12-19T19:00:33.706291+0000","last_became_active":"2023-12-19T19:00:32.009090+0000","last_became_peered":"2023-12-19T19:00:32.009090+0000","last_unstale":"2023-12-19T19:00:33.706291+0000","last_undegraded":"2023-12-19T19:00:33.706291+0000","last_fullsized":"2023-12-19T19:00:33.706291+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:12:29.382064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.012468+0000","last_change":"2023-12-19T19:00:30.989448+0000","last_active":"2023-12-19T19:00:32.012468+0000","last_peered":"2023-12-19T19:00:32.012468+0000","last_clean":"2023-12-19T19:00:32.012468+0000","last_became_active":"2023-12-19T19:00:30.989187+0000","last_became_peered":"2023-12-19T19:00:30.989187+0000","last_unstale":"2023-12-19T19:00:32.012468+0000","last_undegraded":"2023-12-19T19:00:32.012468+0000","last_fullsized":"2023-12-19T19:00:32.012468+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:34:58.509471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706519+0000","last_change":"2023-12-19T19:00:31.993032+0000","last_active":"2023-12-19T19:00:33.706519+0000","last_peered":"2023-12-19T19:00:33.706519+0000","last_clean":"2023-12-19T19:00:33.706519+0000","last_became_active":"2023-12-19T19:00:31.992397+0000","last_became_peered":"2023-12-19T19:00:31.992397+0000","last_unstale":"2023-12-19T19:00:33.706519+0000","last_undegraded":"2023-12-19T19:00:33.706519+0000","last_fullsized":"2023-12-19T19:00:33.706519+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:26:52.085902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.001580+0000","last_change":"2023-12-19T19:00:30.987551+0000","last_active":"2023-12-19T19:00:32.001580+0000","last_peered":"2023-12-19T19:00:32.001580+0000","last_clean":"2023-12-19T19:00:32.001580+0000","last_became_active":"2023-12-19T19:00:30.987118+0000","last_became_peered":"2023-12-19T19:00:30.987118+0000","last_unstale":"2023-12-19T19:00:32.001580+0000","last_undegraded":"2023-12-19T19:00:32.001580+0000","last_fullsized":"2023-12-19T19:00:32.001580+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:39:48.045336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.986795+0000","last_change":"2023-12-19T19:00:31.992097+0000","last_active":"2023-12-19T19:00:32.986795+0000","last_peered":"2023-12-19T19:00:32.986795+0000","last_clean":"2023-12-19T19:00:32.986795+0000","last_became_active":"2023-12-19T19:00:31.991760+0000","last_became_peered":"2023-12-19T19:00:31.991760+0000","last_unstale":"2023-12-19T19:00:32.986795+0000","last_undegraded":"2023-12-19T19:00:32.986795+0000","last_fullsized":"2023-12-19T19:00:32.986795+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:25:47.564222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.003745+0000","last_change":"2023-12-19T19:00:30.993158+0000","last_active":"2023-12-19T19:00:32.003745+0000","last_peered":"2023-12-19T19:00:32.003745+0000","last_clean":"2023-12-19T19:00:32.003745+0000","last_became_active":"2023-12-19T19:00:30.992878+0000","last_became_peered":"2023-12-19T19:00:30.992878+0000","last_unstale":"2023-12-19T19:00:32.003745+0000","last_undegraded":"2023-12-19T19:00:32.003745+0000","last_fullsized":"2023-12-19T19:00:32.003745+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:15:13.218056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.987044+0000","last_change":"2023-12-19T19:00:32.013474+0000","last_active":"2023-12-19T19:00:32.987044+0000","last_peered":"2023-12-19T19:00:32.987044+0000","last_clean":"2023-12-19T19:00:32.987044+0000","last_became_active":"2023-12-19T19:00:32.013185+0000","last_became_peered":"2023-12-19T19:00:32.013185+0000","last_unstale":"2023-12-19T19:00:32.987044+0000","last_undegraded":"2023-12-19T19:00:32.987044+0000","last_fullsized":"2023-12-19T19:00:32.987044+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:05.421482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.012469+0000","last_change":"2023-12-19T19:00:30.988798+0000","last_active":"2023-12-19T19:00:32.012469+0000","last_peered":"2023-12-19T19:00:32.012469+0000","last_clean":"2023-12-19T19:00:32.012469+0000","last_became_active":"2023-12-19T19:00:30.988493+0000","last_became_peered":"2023-12-19T19:00:30.988493+0000","last_unstale":"2023-12-19T19:00:32.012469+0000","last_undegraded":"2023-12-19T19:00:32.012469+0000","last_fullsized":"2023-12-19T19:00:32.012469+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:02.746664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706170+0000","last_change":"2023-12-19T19:00:31.998669+0000","last_active":"2023-12-19T19:00:33.706170+0000","last_peered":"2023-12-19T19:00:33.706170+0000","last_clean":"2023-12-19T19:00:33.706170+0000","last_became_active":"2023-12-19T19:00:31.997493+0000","last_became_peered":"2023-12-19T19:00:31.997493+0000","last_unstale":"2023-12-19T19:00:33.706170+0000","last_undegraded":"2023-12-19T19:00:33.706170+0000","last_fullsized":"2023-12-19T19:00:33.706170+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:28.740800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.984647+0000","last_change":"2023-12-19T19:00:30.987264+0000","last_active":"2023-12-19T19:00:31.984647+0000","last_peered":"2023-12-19T19:00:31.984647+0000","last_clean":"2023-12-19T19:00:31.984647+0000","last_became_active":"2023-12-19T19:00:30.986365+0000","last_became_peered":"2023-12-19T19:00:30.986365+0000","last_unstale":"2023-12-19T19:00:31.984647+0000","last_undegraded":"2023-12-19T19:00:31.984647+0000","last_fullsized":"2023-12-19T19:00:31.984647+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:14.427919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.986816+0000","last_change":"2023-12-19T19:00:31.992961+0000","last_active":"2023-12-19T19:00:32.986816+0000","last_peered":"2023-12-19T19:00:32.986816+0000","last_clean":"2023-12-19T19:00:32.986816+0000","last_became_active":"2023-12-19T19:00:31.992515+0000","last_became_peered":"2023-12-19T19:00:31.992515+0000","last_unstale":"2023-12-19T19:00:32.986816+0000","last_undegraded":"2023-12-19T19:00:32.986816+0000","last_fullsized":"2023-12-19T19:00:32.986816+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:25:16.196549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.974863+0000","last_change":"2023-12-19T19:00:30.984169+0000","last_active":"2023-12-19T19:00:31.974863+0000","last_peered":"2023-12-19T19:00:31.974863+0000","last_clean":"2023-12-19T19:00:31.974863+0000","last_became_active":"2023-12-19T19:00:30.982847+0000","last_became_peered":"2023-12-19T19:00:30.982847+0000","last_unstale":"2023-12-19T19:00:31.974863+0000","last_undegraded":"2023-12-19T19:00:31.974863+0000","last_fullsized":"2023-12-19T19:00:31.974863+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:56:39.717560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.989611+0000","last_change":"2023-12-19T19:00:31.995512+0000","last_active":"2023-12-19T19:00:32.989611+0000","last_peered":"2023-12-19T19:00:32.989611+0000","last_clean":"2023-12-19T19:00:32.989611+0000","last_became_active":"2023-12-19T19:00:31.994458+0000","last_became_peered":"2023-12-19T19:00:31.994458+0000","last_unstale":"2023-12-19T19:00:32.989611+0000","last_undegraded":"2023-12-19T19:00:32.989611+0000","last_fullsized":"2023-12-19T19:00:32.989611+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:33:10.803785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.973623+0000","last_change":"2023-12-19T19:00:30.992474+0000","last_active":"2023-12-19T19:00:31.973623+0000","last_peered":"2023-12-19T19:00:31.973623+0000","last_clean":"2023-12-19T19:00:31.973623+0000","last_became_active":"2023-12-19T19:00:30.992125+0000","last_became_peered":"2023-12-19T19:00:30.992125+0000","last_unstale":"2023-12-19T19:00:31.973623+0000","last_undegraded":"2023-12-19T19:00:31.973623+0000","last_fullsized":"2023-12-19T19:00:31.973623+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:26.259403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.989563+0000","last_change":"2023-12-19T19:00:31.999958+0000","last_active":"2023-12-19T19:00:32.989563+0000","last_peered":"2023-12-19T19:00:32.989563+0000","last_clean":"2023-12-19T19:00:32.989563+0000","last_became_active":"2023-12-19T19:00:31.999674+0000","last_became_peered":"2023-12-19T19:00:31.999674+0000","last_unstale":"2023-12-19T19:00:32.989563+0000","last_undegraded":"2023-12-19T19:00:32.989563+0000","last_fullsized":"2023-12-19T19:00:32.989563+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:40.147962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.977408+0000","last_change":"2023-12-19T19:00:30.992655+0000","last_active":"2023-12-19T19:00:31.977408+0000","last_peered":"2023-12-19T19:00:31.977408+0000","last_clean":"2023-12-19T19:00:31.977408+0000","last_became_active":"2023-12-19T19:00:30.992388+0000","last_became_peered":"2023-12-19T19:00:30.992388+0000","last_unstale":"2023-12-19T19:00:31.977408+0000","last_undegraded":"2023-12-19T19:00:31.977408+0000","last_fullsized":"2023-12-19T19:00:31.977408+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:29:24.264763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.495152+0000","last_change":"2023-12-19T19:00:31.999476+0000","last_active":"2023-12-19T19:00:33.495152+0000","last_peered":"2023-12-19T19:00:33.495152+0000","last_clean":"2023-12-19T19:00:33.495152+0000","last_became_active":"2023-12-19T19:00:31.998991+0000","last_became_peered":"2023-12-19T19:00:31.998991+0000","last_unstale":"2023-12-19T19:00:33.495152+0000","last_undegraded":"2023-12-19T19:00:33.495152+0000","last_fullsized":"2023-12-19T19:00:33.495152+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:50:25.706371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.006722+0000","last_change":"2023-12-19T19:00:30.986780+0000","last_active":"2023-12-19T19:00:32.006722+0000","last_peered":"2023-12-19T19:00:32.006722+0000","last_clean":"2023-12-19T19:00:32.006722+0000","last_became_active":"2023-12-19T19:00:30.986477+0000","last_became_peered":"2023-12-19T19:00:30.986477+0000","last_unstale":"2023-12-19T19:00:32.006722+0000","last_undegraded":"2023-12-19T19:00:32.006722+0000","last_fullsized":"2023-12-19T19:00:32.006722+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:40:24.990216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.989194+0000","last_change":"2023-12-19T19:00:32.000825+0000","last_active":"2023-12-19T19:00:32.989194+0000","last_peered":"2023-12-19T19:00:32.989194+0000","last_clean":"2023-12-19T19:00:32.989194+0000","last_became_active":"2023-12-19T19:00:32.000565+0000","last_became_peered":"2023-12-19T19:00:32.000565+0000","last_unstale":"2023-12-19T19:00:32.989194+0000","last_undegraded":"2023-12-19T19:00:32.989194+0000","last_fullsized":"2023-12-19T19:00:32.989194+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:22:03.749312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"49'6","reported_seq":18,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.018092+0000","last_change":"2023-12-19T19:00:30.990334+0000","last_active":"2023-12-19T19:00:32.018092+0000","last_peered":"2023-12-19T19:00:32.018092+0000","last_clean":"2023-12-19T19:00:32.018092+0000","last_became_active":"2023-12-19T19:00:30.989993+0000","last_became_peered":"2023-12-19T19:00:30.989993+0000","last_unstale":"2023-12-19T19:00:32.018092+0000","last_undegraded":"2023-12-19T19:00:32.018092+0000","last_fullsized":"2023-12-19T19:00:32.018092+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:04:27.417357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706335+0000","last_change":"2023-12-19T19:00:32.011251+0000","last_active":"2023-12-19T19:00:33.706335+0000","last_peered":"2023-12-19T19:00:33.706335+0000","last_clean":"2023-12-19T19:00:33.706335+0000","last_became_active":"2023-12-19T19:00:32.010982+0000","last_became_peered":"2023-12-19T19:00:32.010982+0000","last_unstale":"2023-12-19T19:00:33.706335+0000","last_undegraded":"2023-12-19T19:00:33.706335+0000","last_fullsized":"2023-12-19T19:00:33.706335+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:34:59.517827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.008691+0000","last_change":"2023-12-19T19:00:30.993444+0000","last_active":"2023-12-19T19:00:32.008691+0000","last_peered":"2023-12-19T19:00:32.008691+0000","last_clean":"2023-12-19T19:00:32.008691+0000","last_became_active":"2023-12-19T19:00:30.993163+0000","last_became_peered":"2023-12-19T19:00:30.993163+0000","last_unstale":"2023-12-19T19:00:32.008691+0000","last_undegraded":"2023-12-19T19:00:32.008691+0000","last_fullsized":"2023-12-19T19:00:32.008691+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:11.467052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.988851+0000","last_change":"2023-12-19T19:00:31.990491+0000","last_active":"2023-12-19T19:00:32.988851+0000","last_peered":"2023-12-19T19:00:32.988851+0000","last_clean":"2023-12-19T19:00:32.988851+0000","last_became_active":"2023-12-19T19:00:31.990211+0000","last_became_peered":"2023-12-19T19:00:31.990211+0000","last_unstale":"2023-12-19T19:00:32.988851+0000","last_undegraded":"2023-12-19T19:00:32.988851+0000","last_fullsized":"2023-12-19T19:00:32.988851+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:30.930514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.980893+0000","last_change":"2023-12-19T19:00:30.982775+0000","last_active":"2023-12-19T19:00:31.980893+0000","last_peered":"2023-12-19T19:00:31.980893+0000","last_clean":"2023-12-19T19:00:31.980893+0000","last_became_active":"2023-12-19T19:00:30.982471+0000","last_became_peered":"2023-12-19T19:00:30.982471+0000","last_unstale":"2023-12-19T19:00:31.980893+0000","last_undegraded":"2023-12-19T19:00:31.980893+0000","last_fullsized":"2023-12-19T19:00:31.980893+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:55:52.355420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.988302+0000","last_change":"2023-12-19T19:00:31.990882+0000","last_active":"2023-12-19T19:00:32.988302+0000","last_peered":"2023-12-19T19:00:32.988302+0000","last_clean":"2023-12-19T19:00:32.988302+0000","last_became_active":"2023-12-19T19:00:31.990571+0000","last_became_peered":"2023-12-19T19:00:31.990571+0000","last_unstale":"2023-12-19T19:00:32.988302+0000","last_undegraded":"2023-12-19T19:00:32.988302+0000","last_fullsized":"2023-12-19T19:00:32.988302+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:21:56.040888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.982847+0000","last_change":"2023-12-19T19:00:30.987616+0000","last_active":"2023-12-19T19:00:31.982847+0000","last_peered":"2023-12-19T19:00:31.982847+0000","last_clean":"2023-12-19T19:00:31.982847+0000","last_became_active":"2023-12-19T19:00:30.987300+0000","last_became_peered":"2023-12-19T19:00:30.987300+0000","last_unstale":"2023-12-19T19:00:31.982847+0000","last_undegraded":"2023-12-19T19:00:31.982847+0000","last_fullsized":"2023-12-19T19:00:31.982847+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:30.598024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.988687+0000","last_change":"2023-12-19T19:00:31.986177+0000","last_active":"2023-12-19T19:00:32.988687+0000","last_peered":"2023-12-19T19:00:32.988687+0000","last_clean":"2023-12-19T19:00:32.988687+0000","last_became_active":"2023-12-19T19:00:31.985896+0000","last_became_peered":"2023-12-19T19:00:31.985896+0000","last_unstale":"2023-12-19T19:00:32.988687+0000","last_undegraded":"2023-12-19T19:00:32.988687+0000","last_fullsized":"2023-12-19T19:00:32.988687+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:36.845071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.004321+0000","last_change":"2023-12-19T19:00:30.990218+0000","last_active":"2023-12-19T19:00:32.004321+0000","last_peered":"2023-12-19T19:00:32.004321+0000","last_clean":"2023-12-19T19:00:32.004321+0000","last_became_active":"2023-12-19T19:00:30.989907+0000","last_became_peered":"2023-12-19T19:00:30.989907+0000","last_unstale":"2023-12-19T19:00:32.004321+0000","last_undegraded":"2023-12-19T19:00:32.004321+0000","last_fullsized":"2023-12-19T19:00:32.004321+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:32:52.108796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.989523+0000","last_change":"2023-12-19T19:00:31.996849+0000","last_active":"2023-12-19T19:00:32.989523+0000","last_peered":"2023-12-19T19:00:32.989523+0000","last_clean":"2023-12-19T19:00:32.989523+0000","last_became_active":"2023-12-19T19:00:31.996575+0000","last_became_peered":"2023-12-19T19:00:31.996575+0000","last_unstale":"2023-12-19T19:00:32.989523+0000","last_undegraded":"2023-12-19T19:00:32.989523+0000","last_fullsized":"2023-12-19T19:00:32.989523+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:26:52.085902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.009534+0000","last_change":"2023-12-19T19:00:30.991150+0000","last_active":"2023-12-19T19:00:32.009534+0000","last_peered":"2023-12-19T19:00:32.009534+0000","last_clean":"2023-12-19T19:00:32.009534+0000","last_became_active":"2023-12-19T19:00:30.990867+0000","last_became_peered":"2023-12-19T19:00:30.990867+0000","last_unstale":"2023-12-19T19:00:32.009534+0000","last_undegraded":"2023-12-19T19:00:32.009534+0000","last_fullsized":"2023-12-19T19:00:32.009534+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:32.181776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706591+0000","last_change":"2023-12-19T19:00:32.012118+0000","last_active":"2023-12-19T19:00:33.706591+0000","last_peered":"2023-12-19T19:00:33.706591+0000","last_clean":"2023-12-19T19:00:33.706591+0000","last_became_active":"2023-12-19T19:00:32.011853+0000","last_became_peered":"2023-12-19T19:00:32.011853+0000","last_unstale":"2023-12-19T19:00:33.706591+0000","last_undegraded":"2023-12-19T19:00:33.706591+0000","last_fullsized":"2023-12-19T19:00:33.706591+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:29.762134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.006399+0000","last_change":"2023-12-19T19:00:30.990317+0000","last_active":"2023-12-19T19:00:32.006399+0000","last_peered":"2023-12-19T19:00:32.006399+0000","last_clean":"2023-12-19T19:00:32.006399+0000","last_became_active":"2023-12-19T19:00:30.990062+0000","last_became_peered":"2023-12-19T19:00:30.990062+0000","last_unstale":"2023-12-19T19:00:32.006399+0000","last_undegraded":"2023-12-19T19:00:32.006399+0000","last_fullsized":"2023-12-19T19:00:32.006399+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:35.938744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.986996+0000","last_change":"2023-12-19T19:00:31.995086+0000","last_active":"2023-12-19T19:00:32.986996+0000","last_peered":"2023-12-19T19:00:32.986996+0000","last_clean":"2023-12-19T19:00:32.986996+0000","last_became_active":"2023-12-19T19:00:31.993887+0000","last_became_peered":"2023-12-19T19:00:31.993887+0000","last_unstale":"2023-12-19T19:00:32.986996+0000","last_undegraded":"2023-12-19T19:00:32.986996+0000","last_fullsized":"2023-12-19T19:00:32.986996+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:36:00.677744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.001288+0000","last_change":"2023-12-19T19:00:30.987882+0000","last_active":"2023-12-19T19:00:32.001288+0000","last_peered":"2023-12-19T19:00:32.001288+0000","last_clean":"2023-12-19T19:00:32.001288+0000","last_became_active":"2023-12-19T19:00:30.987654+0000","last_became_peered":"2023-12-19T19:00:30.987654+0000","last_unstale":"2023-12-19T19:00:32.001288+0000","last_undegraded":"2023-12-19T19:00:32.001288+0000","last_fullsized":"2023-12-19T19:00:32.001288+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:40:24.990216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.989348+0000","last_change":"2023-12-19T19:00:32.002709+0000","last_active":"2023-12-19T19:00:32.989348+0000","last_peered":"2023-12-19T19:00:32.989348+0000","last_clean":"2023-12-19T19:00:32.989348+0000","last_became_active":"2023-12-19T19:00:32.002313+0000","last_became_peered":"2023-12-19T19:00:32.002313+0000","last_unstale":"2023-12-19T19:00:32.989348+0000","last_undegraded":"2023-12-19T19:00:32.989348+0000","last_fullsized":"2023-12-19T19:00:32.989348+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:10:42.677327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.971797+0000","last_change":"2023-12-19T19:00:30.989148+0000","last_active":"2023-12-19T19:00:31.971797+0000","last_peered":"2023-12-19T19:00:31.971797+0000","last_clean":"2023-12-19T19:00:31.971797+0000","last_became_active":"2023-12-19T19:00:30.988771+0000","last_became_peered":"2023-12-19T19:00:30.988771+0000","last_unstale":"2023-12-19T19:00:31.971797+0000","last_undegraded":"2023-12-19T19:00:31.971797+0000","last_fullsized":"2023-12-19T19:00:31.971797+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:40:24.990216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.705935+0000","last_change":"2023-12-19T19:00:32.011171+0000","last_active":"2023-12-19T19:00:33.705935+0000","last_peered":"2023-12-19T19:00:33.705935+0000","last_clean":"2023-12-19T19:00:33.705935+0000","last_became_active":"2023-12-19T19:00:32.010974+0000","last_became_peered":"2023-12-19T19:00:32.010974+0000","last_unstale":"2023-12-19T19:00:33.705935+0000","last_undegraded":"2023-12-19T19:00:33.705935+0000","last_fullsized":"2023-12-19T19:00:33.705935+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:39:37.109129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.009551+0000","last_change":"2023-12-19T19:00:30.982999+0000","last_active":"2023-12-19T19:00:32.009551+0000","last_peered":"2023-12-19T19:00:32.009551+0000","last_clean":"2023-12-19T19:00:32.009551+0000","last_became_active":"2023-12-19T19:00:30.982708+0000","last_became_peered":"2023-12-19T19:00:30.982708+0000","last_unstale":"2023-12-19T19:00:32.009551+0000","last_undegraded":"2023-12-19T19:00:32.009551+0000","last_fullsized":"2023-12-19T19:00:32.009551+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:09:34.416071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706281+0000","last_change":"2023-12-19T19:00:32.001553+0000","last_active":"2023-12-19T19:00:33.706281+0000","last_peered":"2023-12-19T19:00:33.706281+0000","last_clean":"2023-12-19T19:00:33.706281+0000","last_became_active":"2023-12-19T19:00:32.001282+0000","last_became_peered":"2023-12-19T19:00:32.001282+0000","last_unstale":"2023-12-19T19:00:33.706281+0000","last_undegraded":"2023-12-19T19:00:33.706281+0000","last_fullsized":"2023-12-19T19:00:33.706281+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:10:42.677327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.990549+0000","last_change":"2023-12-19T19:00:30.991975+0000","last_active":"2023-12-19T19:00:31.990549+0000","last_peered":"2023-12-19T19:00:31.990549+0000","last_clean":"2023-12-19T19:00:31.990549+0000","last_became_active":"2023-12-19T19:00:30.991624+0000","last_became_peered":"2023-12-19T19:00:30.991624+0000","last_unstale":"2023-12-19T19:00:31.990549+0000","last_undegraded":"2023-12-19T19:00:31.990549+0000","last_fullsized":"2023-12-19T19:00:31.990549+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:56:48.812653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.705820+0000","last_change":"2023-12-19T19:00:31.993747+0000","last_active":"2023-12-19T19:00:33.705820+0000","last_peered":"2023-12-19T19:00:33.705820+0000","last_clean":"2023-12-19T19:00:33.705820+0000","last_became_active":"2023-12-19T19:00:31.993287+0000","last_became_peered":"2023-12-19T19:00:31.993287+0000","last_unstale":"2023-12-19T19:00:33.705820+0000","last_undegraded":"2023-12-19T19:00:33.705820+0000","last_fullsized":"2023-12-19T19:00:33.705820+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:36.845071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.982558+0000","last_change":"2023-12-19T19:00:30.992699+0000","last_active":"2023-12-19T19:00:31.982558+0000","last_peered":"2023-12-19T19:00:31.982558+0000","last_clean":"2023-12-19T19:00:31.982558+0000","last_became_active":"2023-12-19T19:00:30.992392+0000","last_became_peered":"2023-12-19T19:00:30.992392+0000","last_unstale":"2023-12-19T19:00:31.982558+0000","last_undegraded":"2023-12-19T19:00:31.982558+0000","last_fullsized":"2023-12-19T19:00:31.982558+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:02.746664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706759+0000","last_change":"2023-12-19T19:00:31.991312+0000","last_active":"2023-12-19T19:00:33.706759+0000","last_peered":"2023-12-19T19:00:33.706759+0000","last_clean":"2023-12-19T19:00:33.706759+0000","last_became_active":"2023-12-19T19:00:31.991010+0000","last_became_peered":"2023-12-19T19:00:31.991010+0000","last_unstale":"2023-12-19T19:00:33.706759+0000","last_undegraded":"2023-12-19T19:00:33.706759+0000","last_fullsized":"2023-12-19T19:00:33.706759+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:13:48.628064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.010630+0000","last_change":"2023-12-19T19:00:30.984710+0000","last_active":"2023-12-19T19:00:32.010630+0000","last_peered":"2023-12-19T19:00:32.010630+0000","last_clean":"2023-12-19T19:00:32.010630+0000","last_became_active":"2023-12-19T19:00:30.984405+0000","last_became_peered":"2023-12-19T19:00:30.984405+0000","last_unstale":"2023-12-19T19:00:32.010630+0000","last_undegraded":"2023-12-19T19:00:32.010630+0000","last_fullsized":"2023-12-19T19:00:32.010630+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:27.732444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706613+0000","last_change":"2023-12-19T19:00:31.994005+0000","last_active":"2023-12-19T19:00:33.706613+0000","last_peered":"2023-12-19T19:00:33.706613+0000","last_clean":"2023-12-19T19:00:33.706613+0000","last_became_active":"2023-12-19T19:00:31.993709+0000","last_became_peered":"2023-12-19T19:00:31.993709+0000","last_unstale":"2023-12-19T19:00:33.706613+0000","last_undegraded":"2023-12-19T19:00:33.706613+0000","last_fullsized":"2023-12-19T19:00:33.706613+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:36.845071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706843+0000","last_change":"2023-12-19T19:00:30.988721+0000","last_active":"2023-12-19T19:00:33.706843+0000","last_peered":"2023-12-19T19:00:33.706843+0000","last_clean":"2023-12-19T19:00:33.706843+0000","last_became_active":"2023-12-19T19:00:30.988432+0000","last_became_peered":"2023-12-19T19:00:30.988432+0000","last_unstale":"2023-12-19T19:00:33.706843+0000","last_undegraded":"2023-12-19T19:00:33.706843+0000","last_fullsized":"2023-12-19T19:00:33.706843+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:28.753779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.495232+0000","last_change":"2023-12-19T19:00:31.999271+0000","last_active":"2023-12-19T19:00:33.495232+0000","last_peered":"2023-12-19T19:00:33.495232+0000","last_clean":"2023-12-19T19:00:33.495232+0000","last_became_active":"2023-12-19T19:00:31.998645+0000","last_became_peered":"2023-12-19T19:00:31.998645+0000","last_unstale":"2023-12-19T19:00:33.495232+0000","last_undegraded":"2023-12-19T19:00:33.495232+0000","last_fullsized":"2023-12-19T19:00:33.495232+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:05:19.291688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.980984+0000","last_change":"2023-12-19T19:00:30.981887+0000","last_active":"2023-12-19T19:00:31.980984+0000","last_peered":"2023-12-19T19:00:31.980984+0000","last_clean":"2023-12-19T19:00:31.980984+0000","last_became_active":"2023-12-19T19:00:30.981538+0000","last_became_peered":"2023-12-19T19:00:30.981538+0000","last_unstale":"2023-12-19T19:00:31.980984+0000","last_undegraded":"2023-12-19T19:00:31.980984+0000","last_fullsized":"2023-12-19T19:00:31.980984+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:50:37.886882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706645+0000","last_change":"2023-12-19T19:00:31.993214+0000","last_active":"2023-12-19T19:00:33.706645+0000","last_peered":"2023-12-19T19:00:33.706645+0000","last_clean":"2023-12-19T19:00:33.706645+0000","last_became_active":"2023-12-19T19:00:31.992758+0000","last_became_peered":"2023-12-19T19:00:31.992758+0000","last_unstale":"2023-12-19T19:00:33.706645+0000","last_undegraded":"2023-12-19T19:00:33.706645+0000","last_fullsized":"2023-12-19T19:00:33.706645+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:40.147962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.985896+0000","last_change":"2023-12-19T19:00:30.992052+0000","last_active":"2023-12-19T19:00:31.985896+0000","last_peered":"2023-12-19T19:00:31.985896+0000","last_clean":"2023-12-19T19:00:31.985896+0000","last_became_active":"2023-12-19T19:00:30.991738+0000","last_became_peered":"2023-12-19T19:00:30.991738+0000","last_unstale":"2023-12-19T19:00:31.985896+0000","last_undegraded":"2023-12-19T19:00:31.985896+0000","last_fullsized":"2023-12-19T19:00:31.985896+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:31:59.956264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.986966+0000","last_change":"2023-12-19T19:00:31.998634+0000","last_active":"2023-12-19T19:00:32.986966+0000","last_peered":"2023-12-19T19:00:32.986966+0000","last_clean":"2023-12-19T19:00:32.986966+0000","last_became_active":"2023-12-19T19:00:31.996473+0000","last_became_peered":"2023-12-19T19:00:31.996473+0000","last_unstale":"2023-12-19T19:00:32.986966+0000","last_undegraded":"2023-12-19T19:00:32.986966+0000","last_fullsized":"2023-12-19T19:00:32.986966+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:00:47.322868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.986935+0000","last_change":"2023-12-19T19:00:30.990963+0000","last_active":"2023-12-19T19:00:31.986935+0000","last_peered":"2023-12-19T19:00:31.986935+0000","last_clean":"2023-12-19T19:00:31.986935+0000","last_became_active":"2023-12-19T19:00:30.990686+0000","last_became_peered":"2023-12-19T19:00:30.990686+0000","last_unstale":"2023-12-19T19:00:31.986935+0000","last_undegraded":"2023-12-19T19:00:31.986935+0000","last_fullsized":"2023-12-19T19:00:31.986935+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:49:29.844694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.988851+0000","last_change":"2023-12-19T19:00:31.987546+0000","last_active":"2023-12-19T19:00:32.988851+0000","last_peered":"2023-12-19T19:00:32.988851+0000","last_clean":"2023-12-19T19:00:32.988851+0000","last_became_active":"2023-12-19T19:00:31.987153+0000","last_became_peered":"2023-12-19T19:00:31.987153+0000","last_unstale":"2023-12-19T19:00:32.988851+0000","last_undegraded":"2023-12-19T19:00:32.988851+0000","last_fullsized":"2023-12-19T19:00:32.988851+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:13:48.628064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.974233+0000","last_change":"2023-12-19T19:00:30.989522+0000","last_active":"2023-12-19T19:00:31.974233+0000","last_peered":"2023-12-19T19:00:31.974233+0000","last_clean":"2023-12-19T19:00:31.974233+0000","last_became_active":"2023-12-19T19:00:30.988571+0000","last_became_peered":"2023-12-19T19:00:30.988571+0000","last_unstale":"2023-12-19T19:00:31.974233+0000","last_undegraded":"2023-12-19T19:00:31.974233+0000","last_fullsized":"2023-12-19T19:00:31.974233+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:10:42.744434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.494933+0000","last_change":"2023-12-19T19:00:32.001673+0000","last_active":"2023-12-19T19:00:33.494933+0000","last_peered":"2023-12-19T19:00:33.494933+0000","last_clean":"2023-12-19T19:00:33.494933+0000","last_became_active":"2023-12-19T19:00:32.001362+0000","last_became_peered":"2023-12-19T19:00:32.001362+0000","last_unstale":"2023-12-19T19:00:33.494933+0000","last_undegraded":"2023-12-19T19:00:33.494933+0000","last_fullsized":"2023-12-19T19:00:33.494933+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:57:25.004342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.986990+0000","last_change":"2023-12-19T19:00:30.989018+0000","last_active":"2023-12-19T19:00:31.986990+0000","last_peered":"2023-12-19T19:00:31.986990+0000","last_clean":"2023-12-19T19:00:31.986990+0000","last_became_active":"2023-12-19T19:00:30.988742+0000","last_became_peered":"2023-12-19T19:00:30.988742+0000","last_unstale":"2023-12-19T19:00:31.986990+0000","last_undegraded":"2023-12-19T19:00:31.986990+0000","last_fullsized":"2023-12-19T19:00:31.986990+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:10:01.359410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.986729+0000","last_change":"2023-12-19T19:00:31.992787+0000","last_active":"2023-12-19T19:00:32.986729+0000","last_peered":"2023-12-19T19:00:32.986729+0000","last_clean":"2023-12-19T19:00:32.986729+0000","last_became_active":"2023-12-19T19:00:31.992110+0000","last_became_peered":"2023-12-19T19:00:31.992110+0000","last_unstale":"2023-12-19T19:00:32.986729+0000","last_undegraded":"2023-12-19T19:00:32.986729+0000","last_fullsized":"2023-12-19T19:00:32.986729+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:43:46.671588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.976460+0000","last_change":"2023-12-19T19:00:30.987505+0000","last_active":"2023-12-19T19:00:31.976460+0000","last_peered":"2023-12-19T19:00:31.976460+0000","last_clean":"2023-12-19T19:00:31.976460+0000","last_became_active":"2023-12-19T19:00:30.987202+0000","last_became_peered":"2023-12-19T19:00:30.987202+0000","last_unstale":"2023-12-19T19:00:31.976460+0000","last_undegraded":"2023-12-19T19:00:31.976460+0000","last_fullsized":"2023-12-19T19:00:31.976460+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:39.139606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.986656+0000","last_change":"2023-12-19T19:00:32.003139+0000","last_active":"2023-12-19T19:00:32.986656+0000","last_peered":"2023-12-19T19:00:32.986656+0000","last_clean":"2023-12-19T19:00:32.986656+0000","last_became_active":"2023-12-19T19:00:32.002764+0000","last_became_peered":"2023-12-19T19:00:32.002764+0000","last_unstale":"2023-12-19T19:00:32.986656+0000","last_undegraded":"2023-12-19T19:00:32.986656+0000","last_fullsized":"2023-12-19T19:00:32.986656+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:49:14.764281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.981401+0000","last_change":"2023-12-19T19:00:30.990667+0000","last_active":"2023-12-19T19:00:31.981401+0000","last_peered":"2023-12-19T19:00:31.981401+0000","last_clean":"2023-12-19T19:00:31.981401+0000","last_became_active":"2023-12-19T19:00:30.989615+0000","last_became_peered":"2023-12-19T19:00:30.989615+0000","last_unstale":"2023-12-19T19:00:31.981401+0000","last_undegraded":"2023-12-19T19:00:31.981401+0000","last_fullsized":"2023-12-19T19:00:31.981401+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:49:29.844694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":196,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.988617+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T19:00:32.988617+0000","last_peered":"2023-12-19T19:00:32.988617+0000","last_clean":"2023-12-19T19:00:32.988617+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T19:00:32.988617+0000","last_undegraded":"2023-12-19T19:00:32.988617+0000","last_fullsized":"2023-12-19T19:00:32.988617+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1200128,"data_stored":842619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68600000000000005,"15min":0.69099999999999995},"min":{"1min":0.434,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83399999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72399999999999998,"15min":0.72599999999999998},"min":{"1min":0.54400000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.91200000000000003,"5min":1.117,"15min":1.117},"last":0.56100000000000005}]},{"osd":1,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95699999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.54200000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85699999999999998,"5min":1.01,"15min":1.01},"last":0.62}]},{"osd":2,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68400000000000005,"15min":0.68600000000000005},"min":{"1min":0.50900000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92700000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.54600000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94699999999999995,"5min":1.089,"15min":1.089},"last":0.83999999999999997}]},{"osd":3,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72399999999999998,"15min":0.73099999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89300000000000002,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.56899999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.74099999999999999}]},{"osd":4,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65600000000000003,"15min":0.66000000000000003},"min":{"1min":0.434,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68000000000000005,"15min":0.67800000000000005},"min":{"1min":0.49299999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.93400000000000005,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.69799999999999995}]},{"osd":5,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69899999999999995,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92500000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.52300000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91900000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.66800000000000004}]},{"osd":6,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.59699999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.96399999999999997,"5min":1.069,"15min":1.069},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.52200000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.91700000000000004,"5min":1.026,"15min":1.026},"last":0.86399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":598016,"data_stored":252091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.627,"15min":0.629},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86299999999999999,"5min":1.022,"15min":1.022},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98299999999999998,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.626}]},{"osd":1,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.52100000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92600000000000005,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88700000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.54400000000000004}]},{"osd":2,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.83899999999999997,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71399999999999997,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94899999999999995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.69399999999999995}]},{"osd":3,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.50900000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92700000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.747},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72799999999999998,"15min":0.72899999999999998},"min":{"1min":0.59099999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.90200000000000002,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.73499999999999999}]},{"osd":4,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.66100000000000003,"15min":0.67100000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90600000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.52800000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88900000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.70699999999999996}]},{"osd":5,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.47299999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.73599999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96499999999999997,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.72299999999999998}]},{"osd":7,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76200000000000001,"15min":0.76500000000000001},"min":{"1min":0.502,"5min":0.437,"15min":0.437},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76900000000000002,"15min":0.76800000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.76500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":252743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":7.4550000000000001,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":16.951000000000001,"5min":16.951000000000001,"15min":16.951000000000001},"last":0.65400000000000003}]},{"osd":1,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":19.823,"5min":19.823,"15min":19.823},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.57699999999999996}]},{"osd":2,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.48899999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.2949999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.7649999999999997,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":0.68100000000000005}]},{"osd":4,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.6499999999999999,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":0.70299999999999996}]},{"osd":6,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.77700000000000002}]},{"osd":7,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.371,"5min":2.371,"15min":2.371},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.747}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":253703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.7690000000000001,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.65600000000000003}]},{"osd":1,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":3.3849999999999998,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":0.83899999999999997}]},{"osd":2,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":3.1240000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.74099999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":3.194,"5min":3.194,"15min":3.194},"last":0.85399999999999998}]},{"osd":5,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":9.3040000000000003,"5min":9.3040000000000003,"15min":9.3040000000000003},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.81399999999999995}]},{"osd":6,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":3.097,"5min":3.097,"15min":3.097},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":3.3319999999999999,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.89500000000000002}]},{"osd":7,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":5.0410000000000004,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.876},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":6.3449999999999998,"5min":6.3449999999999998,"15min":6.3449999999999998},"last":0.94599999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":252147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45600000000000002,"15min":0.45800000000000002},"min":{"1min":0.30099999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.44400000000000001,"15min":0.44600000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58299999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.40200000000000002}]},{"osd":1,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.47899999999999998,"15min":0.48899999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60699999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.63100000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.439}]},{"osd":2,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65700000000000003,"5min":0.75,"15min":0.75},"last":0.505},{"interface":"front","average":{"1min":0.497,"5min":0.54300000000000004,"15min":0.55100000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70999999999999996,"5min":0.875,"15min":0.875},"last":0.47399999999999998}]},{"osd":4,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78900000000000003,"15min":0.79100000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.99199999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.80600000000000005,"15min":0.81499999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.90900000000000003,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.77200000000000002}]},{"osd":5,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.75,"15min":0.755},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97599999999999998,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.91800000000000004,"5min":1.202,"15min":1.202},"last":0.57399999999999995}]},{"osd":6,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82099999999999995,"15min":0.82999999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.95599999999999996,"5min":1.298,"15min":1.298},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80100000000000005,"15min":0.80700000000000005},"min":{"1min":0.61599999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.93300000000000005,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.81200000000000006}]},{"osd":7,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79200000000000004,"15min":0.79600000000000004},"min":{"1min":0.60399999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.95299999999999996,"5min":1.155,"15min":1.155},"last":0.746},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77700000000000002,"15min":0.78300000000000003},"min":{"1min":0.56499999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.90600000000000003,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.85899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":252147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.497,"15min":0.50700000000000001},"min":{"1min":0.313,"5min":0.31,"15min":0.31},"max":{"1min":0.57899999999999996,"5min":1.458,"15min":1.458},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.627,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.627}]},{"osd":1,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.57899999999999996,"15min":0.59899999999999998},"min":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.58499999999999996,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.60399999999999998,"15min":0.624},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.61799999999999999,"5min":2.444,"15min":2.444},"last":0.36599999999999999}]},{"osd":3,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.59599999999999997,"15min":0.62},"min":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65300000000000002,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.625,"15min":0.64300000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.69199999999999995,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.47099999999999997}]},{"osd":4,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.93899999999999995,"15min":0.97499999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.94399999999999995,"5min":1.968,"15min":1.968},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.89500000000000002,"15min":0.92500000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.90700000000000003,"5min":2.835,"15min":2.835},"last":0.59399999999999997}]},{"osd":5,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.91600000000000004,"15min":0.94999999999999996},"min":{"1min":0.56000000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.94599999999999995,"5min":3.5,"15min":3.5},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.91100000000000003,"15min":0.93999999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.99099999999999999,"5min":1.996,"15min":1.996},"last":0.61299999999999999}]},{"osd":6,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.91200000000000003,"15min":0.94699999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.97599999999999998,"5min":2.903,"15min":2.903},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.99199999999999999,"15min":1.034},"min":{"1min":0.53700000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.92800000000000005,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.53700000000000003}]},{"osd":7,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.94999999999999996,"15min":0.98599999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.0049999999999999,"5min":2.875,"15min":2.875},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.94299999999999995,"15min":0.98099999999999998},"min":{"1min":0.59399999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.91900000000000004,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.65300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":602112,"data_stored":252181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.55200000000000005,"15min":0.58099999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.51600000000000001,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.748,"15min":0.80100000000000005},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.70399999999999996,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.375}]},{"osd":2,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.57199999999999995,"15min":0.59599999999999997},"min":{"1min":0.316,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.63,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.65600000000000003,"15min":0.68899999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65300000000000002,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.45300000000000001}]},{"osd":3,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.79300000000000004,"15min":0.84199999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.629,"5min":7.8399999999999999,"15min":7.8399999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.81200000000000006,"15min":0.85999999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72499999999999998,"5min":7.7949999999999999,"15min":7.7949999999999999},"last":0.436}]},{"osd":4,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.86799999999999999,"15min":0.89900000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0900000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.755},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.89900000000000002,"15min":0.93000000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0289999999999999,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.66100000000000003}]},{"osd":5,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.879,"15min":0.90900000000000003},"min":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92600000000000005,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.88500000000000001,"15min":0.91800000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98899999999999999,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.69699999999999995}]},{"osd":6,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.88300000000000001,"15min":0.90800000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94699999999999995,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.93100000000000005,"15min":0.96899999999999997},"min":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0469999999999999,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.71799999999999997}]},{"osd":7,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.93600000000000005,"15min":0.96799999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1180000000000001,"5min":4.3310000000000004,"15min":4.3310000000000004},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.89200000000000002,"15min":0.92000000000000004},"min":{"1min":0.55200000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.97599999999999998,"5min":4.226,"15min":4.226},"last":0.878}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1204224,"data_stored":843634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.44700000000000001,"15min":0.45200000000000001},"min":{"1min":0.29199999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63100000000000001,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.46300000000000002}]},{"osd":2,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.35799999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79600000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.746,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.42899999999999999}]},{"osd":3,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70699999999999996,"5min":0.747,"15min":0.747},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86899999999999999,"5min":1.264,"15min":1.264},"last":0.57899999999999996}]},{"osd":4,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0589999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.018,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.58999999999999997}]},{"osd":5,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.91200000000000003,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.81100000000000005,"15min":0.82299999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97899999999999998,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.81999999999999995,"15min":0.83299999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.024,"5min":1.349,"15min":1.349},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.88400000000000001,"5min":1.115,"15min":1.115},"last":0.66800000000000004}]},{"osd":7,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.78500000000000003,"15min":0.79900000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.89400000000000002,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.80700000000000005,"15min":0.81699999999999995},"min":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.997,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.68300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T19:00:40.550 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T19:00:40.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.685+0000 7f0deec79640 1 Processor -- start 2023-12-19T19:00:40.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.685+0000 7f0deec79640 1 -- start start 2023-12-19T19:00:40.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0deec79640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0de80c4100 0x7f0de80c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:40.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0deec79640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0de80c06d0 0x7f0de80a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:40.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0deec79640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de80c31c0 con 0x7f0de80c63c0 2023-12-19T19:00:40.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0deec79640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de80c34a0 con 0x7f0de80c4100 2023-12-19T19:00:40.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0deec79640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de80c1030 con 0x7f0de80c06d0 2023-12-19T19:00:40.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0deca15640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0de80c63c0 0x7f0de80c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46724/0 (socket says 172.21.15.133:46724) 2023-12-19T19:00:40.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0deca15640 1 -- 172.21.15.133:0/1628634931 learned_addr learned my addr 172.21.15.133:0/1628634931 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:40.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0de77fe640 1 -- 172.21.15.133:0/1628634931 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363982179 0 0) 0x7f0de80c31c0 con 0x7f0de80c63c0 2023-12-19T19:00:40.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0de77fe640 1 -- 172.21.15.133:0/1628634931 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0dd8005740 con 0x7f0de80c63c0 2023-12-19T19:00:40.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0de7fff640 1 --2- 172.21.15.133:0/1628634931 >> v2:172.21.15.138:3300/0 conn(0x7f0de80c4100 0x7f0de80c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:40.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0ded216640 1 --2- 172.21.15.133:0/1628634931 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0de80c06d0 0x7f0de80a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:40.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0de77fe640 1 -- 172.21.15.133:0/1628634931 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2664517275 0 0) 0x7f0dd8005740 con 0x7f0de80c63c0 2023-12-19T19:00:40.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0de77fe640 1 -- 172.21.15.133:0/1628634931 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0de80c06d0 msgr2=0x7f0de80a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:40.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0de77fe640 1 --2- 172.21.15.133:0/1628634931 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0de80c06d0 0x7f0de80a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:40.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0de77fe640 1 -- 172.21.15.133:0/1628634931 >> v2:172.21.15.138:3300/0 conn(0x7f0de80c4100 msgr2=0x7f0de80c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:40.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0de77fe640 1 --2- 172.21.15.133:0/1628634931 >> v2:172.21.15.138:3300/0 conn(0x7f0de80c4100 0x7f0de80c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:40.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0de77fe640 1 -- 172.21.15.133:0/1628634931 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de80c1310 con 0x7f0de80c63c0 2023-12-19T19:00:40.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0de77fe640 1 -- 172.21.15.133:0/1628634931 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f0ddc001680 con 0x7f0de80c63c0 2023-12-19T19:00:40.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0de77fe640 1 -- 172.21.15.133:0/1628634931 >> v1:172.21.15.133:6789/0 conn(0x7f0de80c63c0 legacy=0x7f0de80c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:40.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0de77fe640 1 --2- 172.21.15.133:0/1628634931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dd8005b90 0x7f0dd8005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:40.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0de77fe640 1 --2- 172.21.15.133:0/1628634931 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0de80c06d0 0x7f0dd80069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:40.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0de77fe640 1 --2- 172.21.15.133:0/1628634931 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dd8006f20 0x7f0dd80073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:40.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0de77fe640 1 -- 172.21.15.133:0/1628634931 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de80c34a0 con 0x7f0dd8005b90 2023-12-19T19:00:40.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0de77fe640 1 -- 172.21.15.133:0/1628634931 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de80c1030 con 0x7f0dd8006f20 2023-12-19T19:00:40.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0de77fe640 1 -- 172.21.15.133:0/1628634931 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd800dde0 con 0x7f0de80c06d0 2023-12-19T19:00:40.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0deca15640 1 --2- 172.21.15.133:0/1628634931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dd8005b90 0x7f0dd8005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:40.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0de7fff640 1 --2- 172.21.15.133:0/1628634931 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0de80c06d0 0x7f0dd80069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:40.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0ded216640 1 --2- 172.21.15.133:0/1628634931 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dd8006f20 0x7f0dd80073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:40.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0deca15640 1 -- 172.21.15.133:0/1628634931 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0de80c06d0 msgr2=0x7f0dd80069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:40.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0deca15640 1 --2- 172.21.15.133:0/1628634931 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0de80c06d0 0x7f0dd80069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:40.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0deca15640 1 -- 172.21.15.133:0/1628634931 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dd8006f20 msgr2=0x7f0dd80073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:40.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0deca15640 1 --2- 172.21.15.133:0/1628634931 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dd8006f20 0x7f0dd80073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:40.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0deca15640 1 -- 172.21.15.133:0/1628634931 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd8005740 con 0x7f0dd8005b90 2023-12-19T19:00:40.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.689+0000 7f0ded216640 1 --2- 172.21.15.133:0/1628634931 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0dd8006f20 0x7f0dd80073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:40.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.693+0000 7f0deca15640 1 --2- 172.21.15.133:0/1628634931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dd8005b90 0x7f0dd8005fb0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00c0e0 tx=0x7f0ddc01cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63dc7a8cb0b0092 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:40.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.693+0000 7f0de77fe640 1 -- 172.21.15.133:0/1628634931 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc0058e0 con 0x7f0dd8005b90 2023-12-19T19:00:40.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.693+0000 7f0de77fe640 1 -- 172.21.15.133:0/1628634931 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ddc005a60 con 0x7f0dd8005b90 2023-12-19T19:00:40.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.693+0000 7f0de77fe640 1 -- 172.21.15.133:0/1628634931 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc005e10 con 0x7f0dd8005b90 2023-12-19T19:00:40.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.693+0000 7f0deec79640 1 -- 172.21.15.133:0/1628634931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dd8005b90 msgr2=0x7f0dd8005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:40.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.693+0000 7f0deec79640 1 --2- 172.21.15.133:0/1628634931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0dd8005b90 0x7f0dd8005fb0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00c0e0 tx=0x7f0ddc01cb60 comp rx=0 tx=0).stop 2023-12-19T19:00:40.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.693+0000 7f0ded216640 1 -- 172.21.15.133:0/1628634931 reap_dead start 2023-12-19T19:00:40.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.693+0000 7f0deec79640 1 -- 172.21.15.133:0/1628634931 shutdown_connections 2023-12-19T19:00:40.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.693+0000 7f0deec79640 1 -- 172.21.15.133:0/1628634931 >> 172.21.15.133:0/1628634931 conn(0x7f0de806a5b0 msgr2=0x7f0de806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:40.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.693+0000 7f0deec79640 1 -- 172.21.15.133:0/1628634931 shutdown_connections 2023-12-19T19:00:40.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.693+0000 7f0deec79640 1 -- 172.21.15.133:0/1628634931 wait complete. 2023-12-19T19:00:40.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.693+0000 7f0deec79640 1 Processor -- start 2023-12-19T19:00:40.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.693+0000 7f0deec79640 1 -- start start 2023-12-19T19:00:40.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0deec79640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0dd8005b90 0x7f0de80c2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:40.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0deec79640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0de809bbf0 0x7f0de809c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:40.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0deec79640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0de809a360 0x7f0de809a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:40.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0deec79640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de8157130 con 0x7f0de809bbf0 2023-12-19T19:00:40.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0deec79640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de8099ed0 con 0x7f0de809a360 2023-12-19T19:00:40.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0deec79640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de8158130 con 0x7f0dd8005b90 2023-12-19T19:00:40.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0de7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0de809bbf0 0x7f0de809c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:40.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0de7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0de809bbf0 0x7f0de809c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59182/0 (socket says 172.21.15.133:59182) 2023-12-19T19:00:40.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0de7fff640 1 -- 172.21.15.133:0/1094196053 learned_addr learned my addr 172.21.15.133:0/1094196053 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:40.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0deca15640 1 --2- 172.21.15.133:0/1094196053 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0dd8005b90 0x7f0de80c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:40.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0ded216640 1 --2- 172.21.15.133:0/1094196053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0de809a360 0x7f0de809a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:40.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0de7fff640 1 -- 172.21.15.133:0/1094196053 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0dd8005b90 msgr2=0x7f0de80c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:40.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0de7fff640 1 --2- 172.21.15.133:0/1094196053 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0dd8005b90 0x7f0de80c2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:40.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0de7fff640 1 -- 172.21.15.133:0/1094196053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0de809a360 msgr2=0x7f0de809a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0de7fff640 1 --2- 172.21.15.133:0/1094196053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0de809a360 0x7f0de809a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0de7fff640 1 -- 172.21.15.133:0/1094196053 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de80aa3a0 con 0x7f0de809bbf0 2023-12-19T19:00:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0de7fff640 1 --2- 172.21.15.133:0/1094196053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0de809bbf0 0x7f0de809c050 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400f600 tx=0x7f0dd400fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0de57fa640 1 -- 172.21.15.133:0/1094196053 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4004230 con 0x7f0de809bbf0 2023-12-19T19:00:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0de57fa640 1 -- 172.21.15.133:0/1094196053 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd4004390 con 0x7f0de809bbf0 2023-12-19T19:00:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0de57fa640 1 -- 172.21.15.133:0/1094196053 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4014890 con 0x7f0de809bbf0 2023-12-19T19:00:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0deec79640 1 -- 172.21.15.133:0/1094196053 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de8099ba0 con 0x7f0de809bbf0 2023-12-19T19:00:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0deec79640 1 -- 172.21.15.133:0/1094196053 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de80c2c40 con 0x7f0de809bbf0 2023-12-19T19:00:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0deec79640 1 -- 172.21.15.133:0/1094196053 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de8068400 con 0x7f0de809bbf0 2023-12-19T19:00:40.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.697+0000 7f0de57fa640 1 -- 172.21.15.133:0/1094196053 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0dd40149f0 con 0x7f0de809bbf0 2023-12-19T19:00:40.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.701+0000 7f0de57fa640 1 --2- 172.21.15.133:0/1094196053 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0dcc066470 0x7f0dcc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:40.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.701+0000 7f0de57fa640 1 -- 172.21.15.133:0/1094196053 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0dd4084640 con 0x7f0de809bbf0 2023-12-19T19:00:40.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.701+0000 7f0deca15640 1 --2- 172.21.15.133:0/1094196053 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0dcc066470 0x7f0dcc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:40.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.701+0000 7f0deca15640 1 --2- 172.21.15.133:0/1094196053 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0dcc066470 0x7f0dcc068930 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0aa000 tx=0x7f0ddc0019b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:40.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.705+0000 7f0de57fa640 1 -- 172.21.15.133:0/1094196053 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0dd4051c00 con 0x7f0de809bbf0 2023-12-19T19:00:40.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.853+0000 7f0deec79640 1 -- 172.21.15.133:0/1094196053 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0de80c3930 con 0x7f0dcc066470 2023-12-19T19:00:40.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.861+0000 7f0de57fa640 1 -- 172.21.15.133:0/1094196053 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289260 (secure 0 0 0) 0x7f0de80c3930 con 0x7f0dcc066470 2023-12-19T19:00:40.867 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:40.869 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T19:00:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.865+0000 7f0deec79640 1 -- 172.21.15.133:0/1094196053 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0dcc066470 msgr2=0x7f0dcc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.865+0000 7f0deec79640 1 --2- 172.21.15.133:0/1094196053 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0dcc066470 0x7f0dcc068930 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0aa000 tx=0x7f0ddc0019b0 comp rx=0 tx=0).stop 2023-12-19T19:00:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.865+0000 7f0deec79640 1 -- 172.21.15.133:0/1094196053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0de809bbf0 msgr2=0x7f0de809c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.865+0000 7f0deec79640 1 --2- 172.21.15.133:0/1094196053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0de809bbf0 0x7f0de809c050 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400f600 tx=0x7f0dd400fac0 comp rx=0 tx=0).stop 2023-12-19T19:00:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.865+0000 7f0deec79640 1 -- 172.21.15.133:0/1094196053 shutdown_connections 2023-12-19T19:00:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.865+0000 7f0deec79640 1 --2- 172.21.15.133:0/1094196053 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0dcc066470 0x7f0dcc068930 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.865+0000 7f0deec79640 1 --2- 172.21.15.133:0/1094196053 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0de809a360 0x7f0de809a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:40.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.865+0000 7f0deec79640 1 --2- 172.21.15.133:0/1094196053 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0de809bbf0 0x7f0de809c050 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.865+0000 7f0deec79640 1 --2- 172.21.15.133:0/1094196053 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0dd8005b90 0x7f0de80c2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.865+0000 7f0deec79640 1 -- 172.21.15.133:0/1094196053 >> 172.21.15.133:0/1094196053 conn(0x7f0de806a5b0 msgr2=0x7f0de80bf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.865+0000 7f0deec79640 1 -- 172.21.15.133:0/1094196053 shutdown_connections 2023-12-19T19:00:40.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:40.865+0000 7f0deec79640 1 -- 172.21.15.133:0/1094196053 wait complete. 2023-12-19T19:00:40.888 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2023-12-19T19:00:38.858619+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226244,"kb_used_data":5892,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754748476,"statfs":{"total":773094113280,"available":772862439424,"internally_reserved":0,"allocated":6033408,"data_stored":3201265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.894089"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706682+0000","last_change":"2023-12-19T19:00:31.998328+0000","last_active":"2023-12-19T19:00:33.706682+0000","last_peered":"2023-12-19T19:00:33.706682+0000","last_clean":"2023-12-19T19:00:33.706682+0000","last_became_active":"2023-12-19T19:00:31.998072+0000","last_became_peered":"2023-12-19T19:00:31.998072+0000","last_unstale":"2023-12-19T19:00:33.706682+0000","last_undegraded":"2023-12-19T19:00:33.706682+0000","last_fullsized":"2023-12-19T19:00:33.706682+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:11:16.755757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.986996+0000","last_change":"2023-12-19T19:00:31.988596+0000","last_active":"2023-12-19T19:00:32.986996+0000","last_peered":"2023-12-19T19:00:32.986996+0000","last_clean":"2023-12-19T19:00:32.986996+0000","last_became_active":"2023-12-19T19:00:31.988327+0000","last_became_peered":"2023-12-19T19:00:31.988327+0000","last_unstale":"2023-12-19T19:00:32.986996+0000","last_undegraded":"2023-12-19T19:00:32.986996+0000","last_fullsized":"2023-12-19T19:00:32.986996+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:05:42.607715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.989194+0000","last_change":"2023-12-19T19:00:31.987245+0000","last_active":"2023-12-19T19:00:32.989194+0000","last_peered":"2023-12-19T19:00:32.989194+0000","last_clean":"2023-12-19T19:00:32.989194+0000","last_became_active":"2023-12-19T19:00:31.986953+0000","last_became_peered":"2023-12-19T19:00:31.986953+0000","last_unstale":"2023-12-19T19:00:32.989194+0000","last_undegraded":"2023-12-19T19:00:32.989194+0000","last_fullsized":"2023-12-19T19:00:32.989194+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:34.630792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706027+0000","last_change":"2023-12-19T19:00:32.009662+0000","last_active":"2023-12-19T19:00:33.706027+0000","last_peered":"2023-12-19T19:00:33.706027+0000","last_clean":"2023-12-19T19:00:33.706027+0000","last_became_active":"2023-12-19T19:00:32.009345+0000","last_became_peered":"2023-12-19T19:00:32.009345+0000","last_unstale":"2023-12-19T19:00:33.706027+0000","last_undegraded":"2023-12-19T19:00:33.706027+0000","last_fullsized":"2023-12-19T19:00:33.706027+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:27:21.821975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.705926+0000","last_change":"2023-12-19T19:00:32.008158+0000","last_active":"2023-12-19T19:00:33.705926+0000","last_peered":"2023-12-19T19:00:33.705926+0000","last_clean":"2023-12-19T19:00:33.705926+0000","last_became_active":"2023-12-19T19:00:32.005772+0000","last_became_peered":"2023-12-19T19:00:32.005772+0000","last_unstale":"2023-12-19T19:00:33.705926+0000","last_undegraded":"2023-12-19T19:00:33.705926+0000","last_fullsized":"2023-12-19T19:00:33.705926+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:34.376469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706079+0000","last_change":"2023-12-19T19:00:31.995665+0000","last_active":"2023-12-19T19:00:33.706079+0000","last_peered":"2023-12-19T19:00:33.706079+0000","last_clean":"2023-12-19T19:00:33.706079+0000","last_became_active":"2023-12-19T19:00:31.995407+0000","last_became_peered":"2023-12-19T19:00:31.995407+0000","last_unstale":"2023-12-19T19:00:33.706079+0000","last_undegraded":"2023-12-19T19:00:33.706079+0000","last_fullsized":"2023-12-19T19:00:33.706079+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:34.630792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.988302+0000","last_change":"2023-12-19T19:00:31.987493+0000","last_active":"2023-12-19T19:00:32.988302+0000","last_peered":"2023-12-19T19:00:32.988302+0000","last_clean":"2023-12-19T19:00:32.988302+0000","last_became_active":"2023-12-19T19:00:31.987252+0000","last_became_peered":"2023-12-19T19:00:31.987252+0000","last_unstale":"2023-12-19T19:00:32.988302+0000","last_undegraded":"2023-12-19T19:00:32.988302+0000","last_fullsized":"2023-12-19T19:00:32.988302+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:07:48.132861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.986632+0000","last_change":"2023-12-19T19:00:31.995216+0000","last_active":"2023-12-19T19:00:32.986632+0000","last_peered":"2023-12-19T19:00:32.986632+0000","last_clean":"2023-12-19T19:00:32.986632+0000","last_became_active":"2023-12-19T19:00:31.994879+0000","last_became_peered":"2023-12-19T19:00:31.994879+0000","last_unstale":"2023-12-19T19:00:32.986632+0000","last_undegraded":"2023-12-19T19:00:32.986632+0000","last_fullsized":"2023-12-19T19:00:32.986632+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:50.358908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.989564+0000","last_change":"2023-12-19T19:00:32.007195+0000","last_active":"2023-12-19T19:00:32.989564+0000","last_peered":"2023-12-19T19:00:32.989564+0000","last_clean":"2023-12-19T19:00:32.989564+0000","last_became_active":"2023-12-19T19:00:32.006848+0000","last_became_peered":"2023-12-19T19:00:32.006848+0000","last_unstale":"2023-12-19T19:00:32.989564+0000","last_undegraded":"2023-12-19T19:00:32.989564+0000","last_fullsized":"2023-12-19T19:00:32.989564+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:03.755019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.495354+0000","last_change":"2023-12-19T19:00:31.996387+0000","last_active":"2023-12-19T19:00:33.495354+0000","last_peered":"2023-12-19T19:00:33.495354+0000","last_clean":"2023-12-19T19:00:33.495354+0000","last_became_active":"2023-12-19T19:00:31.996111+0000","last_became_peered":"2023-12-19T19:00:31.996111+0000","last_unstale":"2023-12-19T19:00:33.495354+0000","last_undegraded":"2023-12-19T19:00:33.495354+0000","last_fullsized":"2023-12-19T19:00:33.495354+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:07:14.048441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.495284+0000","last_change":"2023-12-19T19:00:31.998530+0000","last_active":"2023-12-19T19:00:33.495284+0000","last_peered":"2023-12-19T19:00:33.495284+0000","last_clean":"2023-12-19T19:00:33.495284+0000","last_became_active":"2023-12-19T19:00:31.998192+0000","last_became_peered":"2023-12-19T19:00:31.998192+0000","last_unstale":"2023-12-19T19:00:33.495284+0000","last_undegraded":"2023-12-19T19:00:33.495284+0000","last_fullsized":"2023-12-19T19:00:33.495284+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:04:28.425713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706187+0000","last_change":"2023-12-19T19:00:31.996756+0000","last_active":"2023-12-19T19:00:33.706187+0000","last_peered":"2023-12-19T19:00:33.706187+0000","last_clean":"2023-12-19T19:00:33.706187+0000","last_became_active":"2023-12-19T19:00:31.996480+0000","last_became_peered":"2023-12-19T19:00:31.996480+0000","last_unstale":"2023-12-19T19:00:33.706187+0000","last_undegraded":"2023-12-19T19:00:33.706187+0000","last_fullsized":"2023-12-19T19:00:33.706187+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:36.947100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706635+0000","last_change":"2023-12-19T19:00:32.013269+0000","last_active":"2023-12-19T19:00:33.706635+0000","last_peered":"2023-12-19T19:00:33.706635+0000","last_clean":"2023-12-19T19:00:33.706635+0000","last_became_active":"2023-12-19T19:00:32.012808+0000","last_became_peered":"2023-12-19T19:00:32.012808+0000","last_unstale":"2023-12-19T19:00:33.706635+0000","last_undegraded":"2023-12-19T19:00:33.706635+0000","last_fullsized":"2023-12-19T19:00:33.706635+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:38:03.773877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.988526+0000","last_change":"2023-12-19T19:00:31.994520+0000","last_active":"2023-12-19T19:00:32.988526+0000","last_peered":"2023-12-19T19:00:32.988526+0000","last_clean":"2023-12-19T19:00:32.988526+0000","last_became_active":"2023-12-19T19:00:31.994221+0000","last_became_peered":"2023-12-19T19:00:31.994221+0000","last_unstale":"2023-12-19T19:00:32.988526+0000","last_undegraded":"2023-12-19T19:00:32.988526+0000","last_fullsized":"2023-12-19T19:00:32.988526+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:27.267758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.988442+0000","last_change":"2023-12-19T19:00:31.993938+0000","last_active":"2023-12-19T19:00:32.988442+0000","last_peered":"2023-12-19T19:00:32.988442+0000","last_clean":"2023-12-19T19:00:32.988442+0000","last_became_active":"2023-12-19T19:00:31.993647+0000","last_became_peered":"2023-12-19T19:00:31.993647+0000","last_unstale":"2023-12-19T19:00:32.988442+0000","last_undegraded":"2023-12-19T19:00:32.988442+0000","last_fullsized":"2023-12-19T19:00:32.988442+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:34.112789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.705864+0000","last_change":"2023-12-19T19:00:31.993839+0000","last_active":"2023-12-19T19:00:33.705864+0000","last_peered":"2023-12-19T19:00:33.705864+0000","last_clean":"2023-12-19T19:00:33.705864+0000","last_became_active":"2023-12-19T19:00:31.989969+0000","last_became_peered":"2023-12-19T19:00:31.989969+0000","last_unstale":"2023-12-19T19:00:33.705864+0000","last_undegraded":"2023-12-19T19:00:33.705864+0000","last_fullsized":"2023-12-19T19:00:33.705864+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:30.930514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.987194+0000","last_change":"2023-12-19T19:00:31.992695+0000","last_active":"2023-12-19T19:00:32.987194+0000","last_peered":"2023-12-19T19:00:32.987194+0000","last_clean":"2023-12-19T19:00:32.987194+0000","last_became_active":"2023-12-19T19:00:31.992420+0000","last_became_peered":"2023-12-19T19:00:31.992420+0000","last_unstale":"2023-12-19T19:00:32.987194+0000","last_undegraded":"2023-12-19T19:00:32.987194+0000","last_fullsized":"2023-12-19T19:00:32.987194+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:15:06.831796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.989362+0000","last_change":"2023-12-19T19:00:32.004815+0000","last_active":"2023-12-19T19:00:32.989362+0000","last_peered":"2023-12-19T19:00:32.989362+0000","last_clean":"2023-12-19T19:00:32.989362+0000","last_became_active":"2023-12-19T19:00:32.004530+0000","last_became_peered":"2023-12-19T19:00:32.004530+0000","last_unstale":"2023-12-19T19:00:32.989362+0000","last_undegraded":"2023-12-19T19:00:32.989362+0000","last_fullsized":"2023-12-19T19:00:32.989362+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:12:29.382064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706496+0000","last_change":"2023-12-19T19:00:31.994588+0000","last_active":"2023-12-19T19:00:33.706496+0000","last_peered":"2023-12-19T19:00:33.706496+0000","last_clean":"2023-12-19T19:00:33.706496+0000","last_became_active":"2023-12-19T19:00:31.994303+0000","last_became_peered":"2023-12-19T19:00:31.994303+0000","last_unstale":"2023-12-19T19:00:33.706496+0000","last_undegraded":"2023-12-19T19:00:33.706496+0000","last_fullsized":"2023-12-19T19:00:33.706496+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:38:25.957034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.987238+0000","last_change":"2023-12-19T19:00:32.003503+0000","last_active":"2023-12-19T19:00:32.987238+0000","last_peered":"2023-12-19T19:00:32.987238+0000","last_clean":"2023-12-19T19:00:32.987238+0000","last_became_active":"2023-12-19T19:00:32.002889+0000","last_became_peered":"2023-12-19T19:00:32.002889+0000","last_unstale":"2023-12-19T19:00:32.987238+0000","last_undegraded":"2023-12-19T19:00:32.987238+0000","last_fullsized":"2023-12-19T19:00:32.987238+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:06:56.288379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.988632+0000","last_change":"2023-12-19T19:00:31.995238+0000","last_active":"2023-12-19T19:00:32.988632+0000","last_peered":"2023-12-19T19:00:32.988632+0000","last_clean":"2023-12-19T19:00:32.988632+0000","last_became_active":"2023-12-19T19:00:31.994950+0000","last_became_peered":"2023-12-19T19:00:31.994950+0000","last_unstale":"2023-12-19T19:00:32.988632+0000","last_undegraded":"2023-12-19T19:00:32.988632+0000","last_fullsized":"2023-12-19T19:00:32.988632+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:36.947100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.986664+0000","last_change":"2023-12-19T19:00:31.998862+0000","last_active":"2023-12-19T19:00:32.986664+0000","last_peered":"2023-12-19T19:00:32.986664+0000","last_clean":"2023-12-19T19:00:32.986664+0000","last_became_active":"2023-12-19T19:00:31.996848+0000","last_became_peered":"2023-12-19T19:00:31.996848+0000","last_unstale":"2023-12-19T19:00:32.986664+0000","last_undegraded":"2023-12-19T19:00:32.986664+0000","last_fullsized":"2023-12-19T19:00:32.986664+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:52:36.347842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.988659+0000","last_change":"2023-12-19T19:00:31.986797+0000","last_active":"2023-12-19T19:00:32.988659+0000","last_peered":"2023-12-19T19:00:32.988659+0000","last_clean":"2023-12-19T19:00:32.988659+0000","last_became_active":"2023-12-19T19:00:31.986522+0000","last_became_peered":"2023-12-19T19:00:31.986522+0000","last_unstale":"2023-12-19T19:00:32.988659+0000","last_undegraded":"2023-12-19T19:00:32.988659+0000","last_fullsized":"2023-12-19T19:00:32.988659+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:34:59.517827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706004+0000","last_change":"2023-12-19T19:00:32.003120+0000","last_active":"2023-12-19T19:00:33.706004+0000","last_peered":"2023-12-19T19:00:33.706004+0000","last_clean":"2023-12-19T19:00:33.706004+0000","last_became_active":"2023-12-19T19:00:32.002670+0000","last_became_peered":"2023-12-19T19:00:32.002670+0000","last_unstale":"2023-12-19T19:00:33.706004+0000","last_undegraded":"2023-12-19T19:00:33.706004+0000","last_fullsized":"2023-12-19T19:00:33.706004+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:56:49.821008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706769+0000","last_change":"2023-12-19T19:00:32.006868+0000","last_active":"2023-12-19T19:00:33.706769+0000","last_peered":"2023-12-19T19:00:33.706769+0000","last_clean":"2023-12-19T19:00:33.706769+0000","last_became_active":"2023-12-19T19:00:32.004570+0000","last_became_peered":"2023-12-19T19:00:32.004570+0000","last_unstale":"2023-12-19T19:00:33.706769+0000","last_undegraded":"2023-12-19T19:00:33.706769+0000","last_fullsized":"2023-12-19T19:00:33.706769+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:00.659446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706655+0000","last_change":"2023-12-19T19:00:31.995715+0000","last_active":"2023-12-19T19:00:33.706655+0000","last_peered":"2023-12-19T19:00:33.706655+0000","last_clean":"2023-12-19T19:00:33.706655+0000","last_became_active":"2023-12-19T19:00:31.995368+0000","last_became_peered":"2023-12-19T19:00:31.995368+0000","last_unstale":"2023-12-19T19:00:33.706655+0000","last_undegraded":"2023-12-19T19:00:33.706655+0000","last_fullsized":"2023-12-19T19:00:33.706655+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:30.930514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706279+0000","last_change":"2023-12-19T19:00:32.003346+0000","last_active":"2023-12-19T19:00:33.706279+0000","last_peered":"2023-12-19T19:00:33.706279+0000","last_clean":"2023-12-19T19:00:33.706279+0000","last_became_active":"2023-12-19T19:00:32.003084+0000","last_became_peered":"2023-12-19T19:00:32.003084+0000","last_unstale":"2023-12-19T19:00:33.706279+0000","last_undegraded":"2023-12-19T19:00:33.706279+0000","last_fullsized":"2023-12-19T19:00:33.706279+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:22:03.749312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706473+0000","last_change":"2023-12-19T19:00:32.000999+0000","last_active":"2023-12-19T19:00:33.706473+0000","last_peered":"2023-12-19T19:00:33.706473+0000","last_clean":"2023-12-19T19:00:33.706473+0000","last_became_active":"2023-12-19T19:00:32.000704+0000","last_became_peered":"2023-12-19T19:00:32.000704+0000","last_unstale":"2023-12-19T19:00:33.706473+0000","last_undegraded":"2023-12-19T19:00:33.706473+0000","last_fullsized":"2023-12-19T19:00:33.706473+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:17:19.297149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.987156+0000","last_change":"2023-12-19T19:00:32.000428+0000","last_active":"2023-12-19T19:00:32.987156+0000","last_peered":"2023-12-19T19:00:32.987156+0000","last_clean":"2023-12-19T19:00:32.987156+0000","last_became_active":"2023-12-19T19:00:31.996129+0000","last_became_peered":"2023-12-19T19:00:31.996129+0000","last_unstale":"2023-12-19T19:00:32.987156+0000","last_undegraded":"2023-12-19T19:00:32.987156+0000","last_fullsized":"2023-12-19T19:00:32.987156+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:37:12.617236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.988675+0000","last_change":"2023-12-19T19:00:31.996533+0000","last_active":"2023-12-19T19:00:32.988675+0000","last_peered":"2023-12-19T19:00:32.988675+0000","last_clean":"2023-12-19T19:00:32.988675+0000","last_became_active":"2023-12-19T19:00:31.996157+0000","last_became_peered":"2023-12-19T19:00:31.996157+0000","last_unstale":"2023-12-19T19:00:32.988675+0000","last_undegraded":"2023-12-19T19:00:32.988675+0000","last_fullsized":"2023-12-19T19:00:32.988675+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:29.762134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.705797+0000","last_change":"2023-12-19T19:00:32.004191+0000","last_active":"2023-12-19T19:00:33.705797+0000","last_peered":"2023-12-19T19:00:33.705797+0000","last_clean":"2023-12-19T19:00:33.705797+0000","last_became_active":"2023-12-19T19:00:32.003858+0000","last_became_peered":"2023-12-19T19:00:32.003858+0000","last_unstale":"2023-12-19T19:00:33.705797+0000","last_undegraded":"2023-12-19T19:00:33.705797+0000","last_fullsized":"2023-12-19T19:00:33.705797+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:27:46.472889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.705886+0000","last_change":"2023-12-19T19:00:31.989937+0000","last_active":"2023-12-19T19:00:33.705886+0000","last_peered":"2023-12-19T19:00:33.705886+0000","last_clean":"2023-12-19T19:00:33.705886+0000","last_became_active":"2023-12-19T19:00:31.989530+0000","last_became_peered":"2023-12-19T19:00:31.989530+0000","last_unstale":"2023-12-19T19:00:33.705886+0000","last_undegraded":"2023-12-19T19:00:33.705886+0000","last_fullsized":"2023-12-19T19:00:33.705886+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:13:48.628064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706748+0000","last_change":"2023-12-19T19:00:31.993377+0000","last_active":"2023-12-19T19:00:33.706748+0000","last_peered":"2023-12-19T19:00:33.706748+0000","last_clean":"2023-12-19T19:00:33.706748+0000","last_became_active":"2023-12-19T19:00:31.993093+0000","last_became_peered":"2023-12-19T19:00:31.993093+0000","last_unstale":"2023-12-19T19:00:33.706748+0000","last_undegraded":"2023-12-19T19:00:33.706748+0000","last_fullsized":"2023-12-19T19:00:33.706748+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:12.475407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":16,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.014609+0000","last_change":"2023-12-19T19:00:30.991662+0000","last_active":"2023-12-19T19:00:32.014609+0000","last_peered":"2023-12-19T19:00:32.014609+0000","last_clean":"2023-12-19T19:00:32.014609+0000","last_became_active":"2023-12-19T19:00:30.990025+0000","last_became_peered":"2023-12-19T19:00:30.990025+0000","last_unstale":"2023-12-19T19:00:32.014609+0000","last_undegraded":"2023-12-19T19:00:32.014609+0000","last_fullsized":"2023-12-19T19:00:32.014609+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:39:36.100774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.495441+0000","last_change":"2023-12-19T19:00:31.994303+0000","last_active":"2023-12-19T19:00:33.495441+0000","last_peered":"2023-12-19T19:00:33.495441+0000","last_clean":"2023-12-19T19:00:33.495441+0000","last_became_active":"2023-12-19T19:00:31.993980+0000","last_became_peered":"2023-12-19T19:00:31.993980+0000","last_unstale":"2023-12-19T19:00:33.495441+0000","last_undegraded":"2023-12-19T19:00:33.495441+0000","last_fullsized":"2023-12-19T19:00:33.495441+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:43:14.293623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.004940+0000","last_change":"2023-12-19T19:00:30.982126+0000","last_active":"2023-12-19T19:00:32.004940+0000","last_peered":"2023-12-19T19:00:32.004940+0000","last_clean":"2023-12-19T19:00:32.004940+0000","last_became_active":"2023-12-19T19:00:30.981838+0000","last_became_peered":"2023-12-19T19:00:30.981838+0000","last_unstale":"2023-12-19T19:00:32.004940+0000","last_undegraded":"2023-12-19T19:00:32.004940+0000","last_fullsized":"2023-12-19T19:00:32.004940+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:22.410919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706291+0000","last_change":"2023-12-19T19:00:32.012177+0000","last_active":"2023-12-19T19:00:33.706291+0000","last_peered":"2023-12-19T19:00:33.706291+0000","last_clean":"2023-12-19T19:00:33.706291+0000","last_became_active":"2023-12-19T19:00:32.009090+0000","last_became_peered":"2023-12-19T19:00:32.009090+0000","last_unstale":"2023-12-19T19:00:33.706291+0000","last_undegraded":"2023-12-19T19:00:33.706291+0000","last_fullsized":"2023-12-19T19:00:33.706291+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:12:29.382064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.012468+0000","last_change":"2023-12-19T19:00:30.989448+0000","last_active":"2023-12-19T19:00:32.012468+0000","last_peered":"2023-12-19T19:00:32.012468+0000","last_clean":"2023-12-19T19:00:32.012468+0000","last_became_active":"2023-12-19T19:00:30.989187+0000","last_became_peered":"2023-12-19T19:00:30.989187+0000","last_unstale":"2023-12-19T19:00:32.012468+0000","last_undegraded":"2023-12-19T19:00:32.012468+0000","last_fullsized":"2023-12-19T19:00:32.012468+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:34:58.509471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706519+0000","last_change":"2023-12-19T19:00:31.993032+0000","last_active":"2023-12-19T19:00:33.706519+0000","last_peered":"2023-12-19T19:00:33.706519+0000","last_clean":"2023-12-19T19:00:33.706519+0000","last_became_active":"2023-12-19T19:00:31.992397+0000","last_became_peered":"2023-12-19T19:00:31.992397+0000","last_unstale":"2023-12-19T19:00:33.706519+0000","last_undegraded":"2023-12-19T19:00:33.706519+0000","last_fullsized":"2023-12-19T19:00:33.706519+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:26:52.085902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.001580+0000","last_change":"2023-12-19T19:00:30.987551+0000","last_active":"2023-12-19T19:00:32.001580+0000","last_peered":"2023-12-19T19:00:32.001580+0000","last_clean":"2023-12-19T19:00:32.001580+0000","last_became_active":"2023-12-19T19:00:30.987118+0000","last_became_peered":"2023-12-19T19:00:30.987118+0000","last_unstale":"2023-12-19T19:00:32.001580+0000","last_undegraded":"2023-12-19T19:00:32.001580+0000","last_fullsized":"2023-12-19T19:00:32.001580+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:39:48.045336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.986795+0000","last_change":"2023-12-19T19:00:31.992097+0000","last_active":"2023-12-19T19:00:32.986795+0000","last_peered":"2023-12-19T19:00:32.986795+0000","last_clean":"2023-12-19T19:00:32.986795+0000","last_became_active":"2023-12-19T19:00:31.991760+0000","last_became_peered":"2023-12-19T19:00:31.991760+0000","last_unstale":"2023-12-19T19:00:32.986795+0000","last_undegraded":"2023-12-19T19:00:32.986795+0000","last_fullsized":"2023-12-19T19:00:32.986795+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:25:47.564222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.003745+0000","last_change":"2023-12-19T19:00:30.993158+0000","last_active":"2023-12-19T19:00:32.003745+0000","last_peered":"2023-12-19T19:00:32.003745+0000","last_clean":"2023-12-19T19:00:32.003745+0000","last_became_active":"2023-12-19T19:00:30.992878+0000","last_became_peered":"2023-12-19T19:00:30.992878+0000","last_unstale":"2023-12-19T19:00:32.003745+0000","last_undegraded":"2023-12-19T19:00:32.003745+0000","last_fullsized":"2023-12-19T19:00:32.003745+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:15:13.218056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.987044+0000","last_change":"2023-12-19T19:00:32.013474+0000","last_active":"2023-12-19T19:00:32.987044+0000","last_peered":"2023-12-19T19:00:32.987044+0000","last_clean":"2023-12-19T19:00:32.987044+0000","last_became_active":"2023-12-19T19:00:32.013185+0000","last_became_peered":"2023-12-19T19:00:32.013185+0000","last_unstale":"2023-12-19T19:00:32.987044+0000","last_undegraded":"2023-12-19T19:00:32.987044+0000","last_fullsized":"2023-12-19T19:00:32.987044+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:05.421482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.012469+0000","last_change":"2023-12-19T19:00:30.988798+0000","last_active":"2023-12-19T19:00:32.012469+0000","last_peered":"2023-12-19T19:00:32.012469+0000","last_clean":"2023-12-19T19:00:32.012469+0000","last_became_active":"2023-12-19T19:00:30.988493+0000","last_became_peered":"2023-12-19T19:00:30.988493+0000","last_unstale":"2023-12-19T19:00:32.012469+0000","last_undegraded":"2023-12-19T19:00:32.012469+0000","last_fullsized":"2023-12-19T19:00:32.012469+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:02.746664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706170+0000","last_change":"2023-12-19T19:00:31.998669+0000","last_active":"2023-12-19T19:00:33.706170+0000","last_peered":"2023-12-19T19:00:33.706170+0000","last_clean":"2023-12-19T19:00:33.706170+0000","last_became_active":"2023-12-19T19:00:31.997493+0000","last_became_peered":"2023-12-19T19:00:31.997493+0000","last_unstale":"2023-12-19T19:00:33.706170+0000","last_undegraded":"2023-12-19T19:00:33.706170+0000","last_fullsized":"2023-12-19T19:00:33.706170+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:28.740800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.984647+0000","last_change":"2023-12-19T19:00:30.987264+0000","last_active":"2023-12-19T19:00:31.984647+0000","last_peered":"2023-12-19T19:00:31.984647+0000","last_clean":"2023-12-19T19:00:31.984647+0000","last_became_active":"2023-12-19T19:00:30.986365+0000","last_became_peered":"2023-12-19T19:00:30.986365+0000","last_unstale":"2023-12-19T19:00:31.984647+0000","last_undegraded":"2023-12-19T19:00:31.984647+0000","last_fullsized":"2023-12-19T19:00:31.984647+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:14.427919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.986816+0000","last_change":"2023-12-19T19:00:31.992961+0000","last_active":"2023-12-19T19:00:32.986816+0000","last_peered":"2023-12-19T19:00:32.986816+0000","last_clean":"2023-12-19T19:00:32.986816+0000","last_became_active":"2023-12-19T19:00:31.992515+0000","last_became_peered":"2023-12-19T19:00:31.992515+0000","last_unstale":"2023-12-19T19:00:32.986816+0000","last_undegraded":"2023-12-19T19:00:32.986816+0000","last_fullsized":"2023-12-19T19:00:32.986816+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:25:16.196549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.974863+0000","last_change":"2023-12-19T19:00:30.984169+0000","last_active":"2023-12-19T19:00:31.974863+0000","last_peered":"2023-12-19T19:00:31.974863+0000","last_clean":"2023-12-19T19:00:31.974863+0000","last_became_active":"2023-12-19T19:00:30.982847+0000","last_became_peered":"2023-12-19T19:00:30.982847+0000","last_unstale":"2023-12-19T19:00:31.974863+0000","last_undegraded":"2023-12-19T19:00:31.974863+0000","last_fullsized":"2023-12-19T19:00:31.974863+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:56:39.717560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.989611+0000","last_change":"2023-12-19T19:00:31.995512+0000","last_active":"2023-12-19T19:00:32.989611+0000","last_peered":"2023-12-19T19:00:32.989611+0000","last_clean":"2023-12-19T19:00:32.989611+0000","last_became_active":"2023-12-19T19:00:31.994458+0000","last_became_peered":"2023-12-19T19:00:31.994458+0000","last_unstale":"2023-12-19T19:00:32.989611+0000","last_undegraded":"2023-12-19T19:00:32.989611+0000","last_fullsized":"2023-12-19T19:00:32.989611+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:33:10.803785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.973623+0000","last_change":"2023-12-19T19:00:30.992474+0000","last_active":"2023-12-19T19:00:31.973623+0000","last_peered":"2023-12-19T19:00:31.973623+0000","last_clean":"2023-12-19T19:00:31.973623+0000","last_became_active":"2023-12-19T19:00:30.992125+0000","last_became_peered":"2023-12-19T19:00:30.992125+0000","last_unstale":"2023-12-19T19:00:31.973623+0000","last_undegraded":"2023-12-19T19:00:31.973623+0000","last_fullsized":"2023-12-19T19:00:31.973623+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:26.259403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.989563+0000","last_change":"2023-12-19T19:00:31.999958+0000","last_active":"2023-12-19T19:00:32.989563+0000","last_peered":"2023-12-19T19:00:32.989563+0000","last_clean":"2023-12-19T19:00:32.989563+0000","last_became_active":"2023-12-19T19:00:31.999674+0000","last_became_peered":"2023-12-19T19:00:31.999674+0000","last_unstale":"2023-12-19T19:00:32.989563+0000","last_undegraded":"2023-12-19T19:00:32.989563+0000","last_fullsized":"2023-12-19T19:00:32.989563+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:40.147962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.977408+0000","last_change":"2023-12-19T19:00:30.992655+0000","last_active":"2023-12-19T19:00:31.977408+0000","last_peered":"2023-12-19T19:00:31.977408+0000","last_clean":"2023-12-19T19:00:31.977408+0000","last_became_active":"2023-12-19T19:00:30.992388+0000","last_became_peered":"2023-12-19T19:00:30.992388+0000","last_unstale":"2023-12-19T19:00:31.977408+0000","last_undegraded":"2023-12-19T19:00:31.977408+0000","last_fullsized":"2023-12-19T19:00:31.977408+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:29:24.264763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.495152+0000","last_change":"2023-12-19T19:00:31.999476+0000","last_active":"2023-12-19T19:00:33.495152+0000","last_peered":"2023-12-19T19:00:33.495152+0000","last_clean":"2023-12-19T19:00:33.495152+0000","last_became_active":"2023-12-19T19:00:31.998991+0000","last_became_peered":"2023-12-19T19:00:31.998991+0000","last_unstale":"2023-12-19T19:00:33.495152+0000","last_undegraded":"2023-12-19T19:00:33.495152+0000","last_fullsized":"2023-12-19T19:00:33.495152+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:50:25.706371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":15,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.006722+0000","last_change":"2023-12-19T19:00:30.986780+0000","last_active":"2023-12-19T19:00:32.006722+0000","last_peered":"2023-12-19T19:00:32.006722+0000","last_clean":"2023-12-19T19:00:32.006722+0000","last_became_active":"2023-12-19T19:00:30.986477+0000","last_became_peered":"2023-12-19T19:00:30.986477+0000","last_unstale":"2023-12-19T19:00:32.006722+0000","last_undegraded":"2023-12-19T19:00:32.006722+0000","last_fullsized":"2023-12-19T19:00:32.006722+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:40:24.990216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.989194+0000","last_change":"2023-12-19T19:00:32.000825+0000","last_active":"2023-12-19T19:00:32.989194+0000","last_peered":"2023-12-19T19:00:32.989194+0000","last_clean":"2023-12-19T19:00:32.989194+0000","last_became_active":"2023-12-19T19:00:32.000565+0000","last_became_peered":"2023-12-19T19:00:32.000565+0000","last_unstale":"2023-12-19T19:00:32.989194+0000","last_undegraded":"2023-12-19T19:00:32.989194+0000","last_fullsized":"2023-12-19T19:00:32.989194+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:22:03.749312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"49'6","reported_seq":18,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.018092+0000","last_change":"2023-12-19T19:00:30.990334+0000","last_active":"2023-12-19T19:00:32.018092+0000","last_peered":"2023-12-19T19:00:32.018092+0000","last_clean":"2023-12-19T19:00:32.018092+0000","last_became_active":"2023-12-19T19:00:30.989993+0000","last_became_peered":"2023-12-19T19:00:30.989993+0000","last_unstale":"2023-12-19T19:00:32.018092+0000","last_undegraded":"2023-12-19T19:00:32.018092+0000","last_fullsized":"2023-12-19T19:00:32.018092+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:04:27.417357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706335+0000","last_change":"2023-12-19T19:00:32.011251+0000","last_active":"2023-12-19T19:00:33.706335+0000","last_peered":"2023-12-19T19:00:33.706335+0000","last_clean":"2023-12-19T19:00:33.706335+0000","last_became_active":"2023-12-19T19:00:32.010982+0000","last_became_peered":"2023-12-19T19:00:32.010982+0000","last_unstale":"2023-12-19T19:00:33.706335+0000","last_undegraded":"2023-12-19T19:00:33.706335+0000","last_fullsized":"2023-12-19T19:00:33.706335+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:34:59.517827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.008691+0000","last_change":"2023-12-19T19:00:30.993444+0000","last_active":"2023-12-19T19:00:32.008691+0000","last_peered":"2023-12-19T19:00:32.008691+0000","last_clean":"2023-12-19T19:00:32.008691+0000","last_became_active":"2023-12-19T19:00:30.993163+0000","last_became_peered":"2023-12-19T19:00:30.993163+0000","last_unstale":"2023-12-19T19:00:32.008691+0000","last_undegraded":"2023-12-19T19:00:32.008691+0000","last_fullsized":"2023-12-19T19:00:32.008691+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:11.467052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.988851+0000","last_change":"2023-12-19T19:00:31.990491+0000","last_active":"2023-12-19T19:00:32.988851+0000","last_peered":"2023-12-19T19:00:32.988851+0000","last_clean":"2023-12-19T19:00:32.988851+0000","last_became_active":"2023-12-19T19:00:31.990211+0000","last_became_peered":"2023-12-19T19:00:31.990211+0000","last_unstale":"2023-12-19T19:00:32.988851+0000","last_undegraded":"2023-12-19T19:00:32.988851+0000","last_fullsized":"2023-12-19T19:00:32.988851+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:30.930514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.980893+0000","last_change":"2023-12-19T19:00:30.982775+0000","last_active":"2023-12-19T19:00:31.980893+0000","last_peered":"2023-12-19T19:00:31.980893+0000","last_clean":"2023-12-19T19:00:31.980893+0000","last_became_active":"2023-12-19T19:00:30.982471+0000","last_became_peered":"2023-12-19T19:00:30.982471+0000","last_unstale":"2023-12-19T19:00:31.980893+0000","last_undegraded":"2023-12-19T19:00:31.980893+0000","last_fullsized":"2023-12-19T19:00:31.980893+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:55:52.355420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.988302+0000","last_change":"2023-12-19T19:00:31.990882+0000","last_active":"2023-12-19T19:00:32.988302+0000","last_peered":"2023-12-19T19:00:32.988302+0000","last_clean":"2023-12-19T19:00:32.988302+0000","last_became_active":"2023-12-19T19:00:31.990571+0000","last_became_peered":"2023-12-19T19:00:31.990571+0000","last_unstale":"2023-12-19T19:00:32.988302+0000","last_undegraded":"2023-12-19T19:00:32.988302+0000","last_fullsized":"2023-12-19T19:00:32.988302+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:21:56.040888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.982847+0000","last_change":"2023-12-19T19:00:30.987616+0000","last_active":"2023-12-19T19:00:31.982847+0000","last_peered":"2023-12-19T19:00:31.982847+0000","last_clean":"2023-12-19T19:00:31.982847+0000","last_became_active":"2023-12-19T19:00:30.987300+0000","last_became_peered":"2023-12-19T19:00:30.987300+0000","last_unstale":"2023-12-19T19:00:31.982847+0000","last_undegraded":"2023-12-19T19:00:31.982847+0000","last_fullsized":"2023-12-19T19:00:31.982847+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:30.598024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.988687+0000","last_change":"2023-12-19T19:00:31.986177+0000","last_active":"2023-12-19T19:00:32.988687+0000","last_peered":"2023-12-19T19:00:32.988687+0000","last_clean":"2023-12-19T19:00:32.988687+0000","last_became_active":"2023-12-19T19:00:31.985896+0000","last_became_peered":"2023-12-19T19:00:31.985896+0000","last_unstale":"2023-12-19T19:00:32.988687+0000","last_undegraded":"2023-12-19T19:00:32.988687+0000","last_fullsized":"2023-12-19T19:00:32.988687+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:36.845071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":20,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.004321+0000","last_change":"2023-12-19T19:00:30.990218+0000","last_active":"2023-12-19T19:00:32.004321+0000","last_peered":"2023-12-19T19:00:32.004321+0000","last_clean":"2023-12-19T19:00:32.004321+0000","last_became_active":"2023-12-19T19:00:30.989907+0000","last_became_peered":"2023-12-19T19:00:30.989907+0000","last_unstale":"2023-12-19T19:00:32.004321+0000","last_undegraded":"2023-12-19T19:00:32.004321+0000","last_fullsized":"2023-12-19T19:00:32.004321+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:32:52.108796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.989523+0000","last_change":"2023-12-19T19:00:31.996849+0000","last_active":"2023-12-19T19:00:32.989523+0000","last_peered":"2023-12-19T19:00:32.989523+0000","last_clean":"2023-12-19T19:00:32.989523+0000","last_became_active":"2023-12-19T19:00:31.996575+0000","last_became_peered":"2023-12-19T19:00:31.996575+0000","last_unstale":"2023-12-19T19:00:32.989523+0000","last_undegraded":"2023-12-19T19:00:32.989523+0000","last_fullsized":"2023-12-19T19:00:32.989523+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:26:52.085902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.009534+0000","last_change":"2023-12-19T19:00:30.991150+0000","last_active":"2023-12-19T19:00:32.009534+0000","last_peered":"2023-12-19T19:00:32.009534+0000","last_clean":"2023-12-19T19:00:32.009534+0000","last_became_active":"2023-12-19T19:00:30.990867+0000","last_became_peered":"2023-12-19T19:00:30.990867+0000","last_unstale":"2023-12-19T19:00:32.009534+0000","last_undegraded":"2023-12-19T19:00:32.009534+0000","last_fullsized":"2023-12-19T19:00:32.009534+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:32.181776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706591+0000","last_change":"2023-12-19T19:00:32.012118+0000","last_active":"2023-12-19T19:00:33.706591+0000","last_peered":"2023-12-19T19:00:33.706591+0000","last_clean":"2023-12-19T19:00:33.706591+0000","last_became_active":"2023-12-19T19:00:32.011853+0000","last_became_peered":"2023-12-19T19:00:32.011853+0000","last_unstale":"2023-12-19T19:00:33.706591+0000","last_undegraded":"2023-12-19T19:00:33.706591+0000","last_fullsized":"2023-12-19T19:00:33.706591+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:29.762134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.006399+0000","last_change":"2023-12-19T19:00:30.990317+0000","last_active":"2023-12-19T19:00:32.006399+0000","last_peered":"2023-12-19T19:00:32.006399+0000","last_clean":"2023-12-19T19:00:32.006399+0000","last_became_active":"2023-12-19T19:00:30.990062+0000","last_became_peered":"2023-12-19T19:00:30.990062+0000","last_unstale":"2023-12-19T19:00:32.006399+0000","last_undegraded":"2023-12-19T19:00:32.006399+0000","last_fullsized":"2023-12-19T19:00:32.006399+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:35.938744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.986996+0000","last_change":"2023-12-19T19:00:31.995086+0000","last_active":"2023-12-19T19:00:32.986996+0000","last_peered":"2023-12-19T19:00:32.986996+0000","last_clean":"2023-12-19T19:00:32.986996+0000","last_became_active":"2023-12-19T19:00:31.993887+0000","last_became_peered":"2023-12-19T19:00:31.993887+0000","last_unstale":"2023-12-19T19:00:32.986996+0000","last_undegraded":"2023-12-19T19:00:32.986996+0000","last_fullsized":"2023-12-19T19:00:32.986996+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:36:00.677744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":13,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.001288+0000","last_change":"2023-12-19T19:00:30.987882+0000","last_active":"2023-12-19T19:00:32.001288+0000","last_peered":"2023-12-19T19:00:32.001288+0000","last_clean":"2023-12-19T19:00:32.001288+0000","last_became_active":"2023-12-19T19:00:30.987654+0000","last_became_peered":"2023-12-19T19:00:30.987654+0000","last_unstale":"2023-12-19T19:00:32.001288+0000","last_undegraded":"2023-12-19T19:00:32.001288+0000","last_fullsized":"2023-12-19T19:00:32.001288+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:40:24.990216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.989348+0000","last_change":"2023-12-19T19:00:32.002709+0000","last_active":"2023-12-19T19:00:32.989348+0000","last_peered":"2023-12-19T19:00:32.989348+0000","last_clean":"2023-12-19T19:00:32.989348+0000","last_became_active":"2023-12-19T19:00:32.002313+0000","last_became_peered":"2023-12-19T19:00:32.002313+0000","last_unstale":"2023-12-19T19:00:32.989348+0000","last_undegraded":"2023-12-19T19:00:32.989348+0000","last_fullsized":"2023-12-19T19:00:32.989348+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:10:42.677327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.971797+0000","last_change":"2023-12-19T19:00:30.989148+0000","last_active":"2023-12-19T19:00:31.971797+0000","last_peered":"2023-12-19T19:00:31.971797+0000","last_clean":"2023-12-19T19:00:31.971797+0000","last_became_active":"2023-12-19T19:00:30.988771+0000","last_became_peered":"2023-12-19T19:00:30.988771+0000","last_unstale":"2023-12-19T19:00:31.971797+0000","last_undegraded":"2023-12-19T19:00:31.971797+0000","last_fullsized":"2023-12-19T19:00:31.971797+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:40:24.990216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.705935+0000","last_change":"2023-12-19T19:00:32.011171+0000","last_active":"2023-12-19T19:00:33.705935+0000","last_peered":"2023-12-19T19:00:33.705935+0000","last_clean":"2023-12-19T19:00:33.705935+0000","last_became_active":"2023-12-19T19:00:32.010974+0000","last_became_peered":"2023-12-19T19:00:32.010974+0000","last_unstale":"2023-12-19T19:00:33.705935+0000","last_undegraded":"2023-12-19T19:00:33.705935+0000","last_fullsized":"2023-12-19T19:00:33.705935+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:39:37.109129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.009551+0000","last_change":"2023-12-19T19:00:30.982999+0000","last_active":"2023-12-19T19:00:32.009551+0000","last_peered":"2023-12-19T19:00:32.009551+0000","last_clean":"2023-12-19T19:00:32.009551+0000","last_became_active":"2023-12-19T19:00:30.982708+0000","last_became_peered":"2023-12-19T19:00:30.982708+0000","last_unstale":"2023-12-19T19:00:32.009551+0000","last_undegraded":"2023-12-19T19:00:32.009551+0000","last_fullsized":"2023-12-19T19:00:32.009551+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:09:34.416071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706281+0000","last_change":"2023-12-19T19:00:32.001553+0000","last_active":"2023-12-19T19:00:33.706281+0000","last_peered":"2023-12-19T19:00:33.706281+0000","last_clean":"2023-12-19T19:00:33.706281+0000","last_became_active":"2023-12-19T19:00:32.001282+0000","last_became_peered":"2023-12-19T19:00:32.001282+0000","last_unstale":"2023-12-19T19:00:33.706281+0000","last_undegraded":"2023-12-19T19:00:33.706281+0000","last_fullsized":"2023-12-19T19:00:33.706281+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:10:42.677327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.990549+0000","last_change":"2023-12-19T19:00:30.991975+0000","last_active":"2023-12-19T19:00:31.990549+0000","last_peered":"2023-12-19T19:00:31.990549+0000","last_clean":"2023-12-19T19:00:31.990549+0000","last_became_active":"2023-12-19T19:00:30.991624+0000","last_became_peered":"2023-12-19T19:00:30.991624+0000","last_unstale":"2023-12-19T19:00:31.990549+0000","last_undegraded":"2023-12-19T19:00:31.990549+0000","last_fullsized":"2023-12-19T19:00:31.990549+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:56:48.812653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.705820+0000","last_change":"2023-12-19T19:00:31.993747+0000","last_active":"2023-12-19T19:00:33.705820+0000","last_peered":"2023-12-19T19:00:33.705820+0000","last_clean":"2023-12-19T19:00:33.705820+0000","last_became_active":"2023-12-19T19:00:31.993287+0000","last_became_peered":"2023-12-19T19:00:31.993287+0000","last_unstale":"2023-12-19T19:00:33.705820+0000","last_undegraded":"2023-12-19T19:00:33.705820+0000","last_fullsized":"2023-12-19T19:00:33.705820+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:36.845071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.982558+0000","last_change":"2023-12-19T19:00:30.992699+0000","last_active":"2023-12-19T19:00:31.982558+0000","last_peered":"2023-12-19T19:00:31.982558+0000","last_clean":"2023-12-19T19:00:31.982558+0000","last_became_active":"2023-12-19T19:00:30.992392+0000","last_became_peered":"2023-12-19T19:00:30.992392+0000","last_unstale":"2023-12-19T19:00:31.982558+0000","last_undegraded":"2023-12-19T19:00:31.982558+0000","last_fullsized":"2023-12-19T19:00:31.982558+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:02.746664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706759+0000","last_change":"2023-12-19T19:00:31.991312+0000","last_active":"2023-12-19T19:00:33.706759+0000","last_peered":"2023-12-19T19:00:33.706759+0000","last_clean":"2023-12-19T19:00:33.706759+0000","last_became_active":"2023-12-19T19:00:31.991010+0000","last_became_peered":"2023-12-19T19:00:31.991010+0000","last_unstale":"2023-12-19T19:00:33.706759+0000","last_undegraded":"2023-12-19T19:00:33.706759+0000","last_fullsized":"2023-12-19T19:00:33.706759+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:13:48.628064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":14,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.010630+0000","last_change":"2023-12-19T19:00:30.984710+0000","last_active":"2023-12-19T19:00:32.010630+0000","last_peered":"2023-12-19T19:00:32.010630+0000","last_clean":"2023-12-19T19:00:32.010630+0000","last_became_active":"2023-12-19T19:00:30.984405+0000","last_became_peered":"2023-12-19T19:00:30.984405+0000","last_unstale":"2023-12-19T19:00:32.010630+0000","last_undegraded":"2023-12-19T19:00:32.010630+0000","last_fullsized":"2023-12-19T19:00:32.010630+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:27.732444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706613+0000","last_change":"2023-12-19T19:00:31.994005+0000","last_active":"2023-12-19T19:00:33.706613+0000","last_peered":"2023-12-19T19:00:33.706613+0000","last_clean":"2023-12-19T19:00:33.706613+0000","last_became_active":"2023-12-19T19:00:31.993709+0000","last_became_peered":"2023-12-19T19:00:31.993709+0000","last_unstale":"2023-12-19T19:00:33.706613+0000","last_undegraded":"2023-12-19T19:00:33.706613+0000","last_fullsized":"2023-12-19T19:00:33.706613+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:36.845071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706843+0000","last_change":"2023-12-19T19:00:30.988721+0000","last_active":"2023-12-19T19:00:33.706843+0000","last_peered":"2023-12-19T19:00:33.706843+0000","last_clean":"2023-12-19T19:00:33.706843+0000","last_became_active":"2023-12-19T19:00:30.988432+0000","last_became_peered":"2023-12-19T19:00:30.988432+0000","last_unstale":"2023-12-19T19:00:33.706843+0000","last_undegraded":"2023-12-19T19:00:33.706843+0000","last_fullsized":"2023-12-19T19:00:33.706843+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:28.753779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.495232+0000","last_change":"2023-12-19T19:00:31.999271+0000","last_active":"2023-12-19T19:00:33.495232+0000","last_peered":"2023-12-19T19:00:33.495232+0000","last_clean":"2023-12-19T19:00:33.495232+0000","last_became_active":"2023-12-19T19:00:31.998645+0000","last_became_peered":"2023-12-19T19:00:31.998645+0000","last_unstale":"2023-12-19T19:00:33.495232+0000","last_undegraded":"2023-12-19T19:00:33.495232+0000","last_fullsized":"2023-12-19T19:00:33.495232+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:05:19.291688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.980984+0000","last_change":"2023-12-19T19:00:30.981887+0000","last_active":"2023-12-19T19:00:31.980984+0000","last_peered":"2023-12-19T19:00:31.980984+0000","last_clean":"2023-12-19T19:00:31.980984+0000","last_became_active":"2023-12-19T19:00:30.981538+0000","last_became_peered":"2023-12-19T19:00:30.981538+0000","last_unstale":"2023-12-19T19:00:31.980984+0000","last_undegraded":"2023-12-19T19:00:31.980984+0000","last_fullsized":"2023-12-19T19:00:31.980984+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:50:37.886882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.706645+0000","last_change":"2023-12-19T19:00:31.993214+0000","last_active":"2023-12-19T19:00:33.706645+0000","last_peered":"2023-12-19T19:00:33.706645+0000","last_clean":"2023-12-19T19:00:33.706645+0000","last_became_active":"2023-12-19T19:00:31.992758+0000","last_became_peered":"2023-12-19T19:00:31.992758+0000","last_unstale":"2023-12-19T19:00:33.706645+0000","last_undegraded":"2023-12-19T19:00:33.706645+0000","last_fullsized":"2023-12-19T19:00:33.706645+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:40.147962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.985896+0000","last_change":"2023-12-19T19:00:30.992052+0000","last_active":"2023-12-19T19:00:31.985896+0000","last_peered":"2023-12-19T19:00:31.985896+0000","last_clean":"2023-12-19T19:00:31.985896+0000","last_became_active":"2023-12-19T19:00:30.991738+0000","last_became_peered":"2023-12-19T19:00:30.991738+0000","last_unstale":"2023-12-19T19:00:31.985896+0000","last_undegraded":"2023-12-19T19:00:31.985896+0000","last_fullsized":"2023-12-19T19:00:31.985896+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:31:59.956264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.986966+0000","last_change":"2023-12-19T19:00:31.998634+0000","last_active":"2023-12-19T19:00:32.986966+0000","last_peered":"2023-12-19T19:00:32.986966+0000","last_clean":"2023-12-19T19:00:32.986966+0000","last_became_active":"2023-12-19T19:00:31.996473+0000","last_became_peered":"2023-12-19T19:00:31.996473+0000","last_unstale":"2023-12-19T19:00:32.986966+0000","last_undegraded":"2023-12-19T19:00:32.986966+0000","last_fullsized":"2023-12-19T19:00:32.986966+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:00:47.322868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.986935+0000","last_change":"2023-12-19T19:00:30.990963+0000","last_active":"2023-12-19T19:00:31.986935+0000","last_peered":"2023-12-19T19:00:31.986935+0000","last_clean":"2023-12-19T19:00:31.986935+0000","last_became_active":"2023-12-19T19:00:30.990686+0000","last_became_peered":"2023-12-19T19:00:30.990686+0000","last_unstale":"2023-12-19T19:00:31.986935+0000","last_undegraded":"2023-12-19T19:00:31.986935+0000","last_fullsized":"2023-12-19T19:00:31.986935+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:49:29.844694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.988851+0000","last_change":"2023-12-19T19:00:31.987546+0000","last_active":"2023-12-19T19:00:32.988851+0000","last_peered":"2023-12-19T19:00:32.988851+0000","last_clean":"2023-12-19T19:00:32.988851+0000","last_became_active":"2023-12-19T19:00:31.987153+0000","last_became_peered":"2023-12-19T19:00:31.987153+0000","last_unstale":"2023-12-19T19:00:32.988851+0000","last_undegraded":"2023-12-19T19:00:32.988851+0000","last_fullsized":"2023-12-19T19:00:32.988851+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:13:48.628064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.974233+0000","last_change":"2023-12-19T19:00:30.989522+0000","last_active":"2023-12-19T19:00:31.974233+0000","last_peered":"2023-12-19T19:00:31.974233+0000","last_clean":"2023-12-19T19:00:31.974233+0000","last_became_active":"2023-12-19T19:00:30.988571+0000","last_became_peered":"2023-12-19T19:00:30.988571+0000","last_unstale":"2023-12-19T19:00:31.974233+0000","last_undegraded":"2023-12-19T19:00:31.974233+0000","last_fullsized":"2023-12-19T19:00:31.974233+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:10:42.744434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:33.494933+0000","last_change":"2023-12-19T19:00:32.001673+0000","last_active":"2023-12-19T19:00:33.494933+0000","last_peered":"2023-12-19T19:00:33.494933+0000","last_clean":"2023-12-19T19:00:33.494933+0000","last_became_active":"2023-12-19T19:00:32.001362+0000","last_became_peered":"2023-12-19T19:00:32.001362+0000","last_unstale":"2023-12-19T19:00:33.494933+0000","last_undegraded":"2023-12-19T19:00:33.494933+0000","last_fullsized":"2023-12-19T19:00:33.494933+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:57:25.004342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.986990+0000","last_change":"2023-12-19T19:00:30.989018+0000","last_active":"2023-12-19T19:00:31.986990+0000","last_peered":"2023-12-19T19:00:31.986990+0000","last_clean":"2023-12-19T19:00:31.986990+0000","last_became_active":"2023-12-19T19:00:30.988742+0000","last_became_peered":"2023-12-19T19:00:30.988742+0000","last_unstale":"2023-12-19T19:00:31.986990+0000","last_undegraded":"2023-12-19T19:00:31.986990+0000","last_fullsized":"2023-12-19T19:00:31.986990+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:10:01.359410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.986729+0000","last_change":"2023-12-19T19:00:31.992787+0000","last_active":"2023-12-19T19:00:32.986729+0000","last_peered":"2023-12-19T19:00:32.986729+0000","last_clean":"2023-12-19T19:00:32.986729+0000","last_became_active":"2023-12-19T19:00:31.992110+0000","last_became_peered":"2023-12-19T19:00:31.992110+0000","last_unstale":"2023-12-19T19:00:32.986729+0000","last_undegraded":"2023-12-19T19:00:32.986729+0000","last_fullsized":"2023-12-19T19:00:32.986729+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:43:46.671588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.976460+0000","last_change":"2023-12-19T19:00:30.987505+0000","last_active":"2023-12-19T19:00:31.976460+0000","last_peered":"2023-12-19T19:00:31.976460+0000","last_clean":"2023-12-19T19:00:31.976460+0000","last_became_active":"2023-12-19T19:00:30.987202+0000","last_became_peered":"2023-12-19T19:00:30.987202+0000","last_unstale":"2023-12-19T19:00:31.976460+0000","last_undegraded":"2023-12-19T19:00:31.976460+0000","last_fullsized":"2023-12-19T19:00:31.976460+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:39.139606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.986656+0000","last_change":"2023-12-19T19:00:32.003139+0000","last_active":"2023-12-19T19:00:32.986656+0000","last_peered":"2023-12-19T19:00:32.986656+0000","last_clean":"2023-12-19T19:00:32.986656+0000","last_became_active":"2023-12-19T19:00:32.002764+0000","last_became_peered":"2023-12-19T19:00:32.002764+0000","last_unstale":"2023-12-19T19:00:32.986656+0000","last_undegraded":"2023-12-19T19:00:32.986656+0000","last_fullsized":"2023-12-19T19:00:32.986656+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:49:14.764281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-12-19T19:00:31.981401+0000","last_change":"2023-12-19T19:00:30.990667+0000","last_active":"2023-12-19T19:00:31.981401+0000","last_peered":"2023-12-19T19:00:31.981401+0000","last_clean":"2023-12-19T19:00:31.981401+0000","last_became_active":"2023-12-19T19:00:30.989615+0000","last_became_peered":"2023-12-19T19:00:30.989615+0000","last_unstale":"2023-12-19T19:00:31.981401+0000","last_undegraded":"2023-12-19T19:00:31.981401+0000","last_fullsized":"2023-12-19T19:00:31.981401+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:49:29.844694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":196,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-12-19T19:00:32.988617+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T19:00:32.988617+0000","last_peered":"2023-12-19T19:00:32.988617+0000","last_clean":"2023-12-19T19:00:32.988617+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T19:00:32.988617+0000","last_undegraded":"2023-12-19T19:00:32.988617+0000","last_fullsized":"2023-12-19T19:00:32.988617+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28196,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343644,"statfs":{"total":96636764160,"available":96607891456,"internally_reserved":0,"allocated":1200128,"data_stored":842619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68600000000000005,"15min":0.69099999999999995},"min":{"1min":0.434,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83399999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72399999999999998,"15min":0.72599999999999998},"min":{"1min":0.54400000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.91200000000000003,"5min":1.117,"15min":1.117},"last":0.56100000000000005}]},{"osd":1,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95699999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.54200000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85699999999999998,"5min":1.01,"15min":1.01},"last":0.62}]},{"osd":2,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68400000000000005,"15min":0.68600000000000005},"min":{"1min":0.50900000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92700000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.54600000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94699999999999995,"5min":1.089,"15min":1.089},"last":0.83999999999999997}]},{"osd":3,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72399999999999998,"15min":0.73099999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89300000000000002,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.56899999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.74099999999999999}]},{"osd":4,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65600000000000003,"15min":0.66000000000000003},"min":{"1min":0.434,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68000000000000005,"15min":0.67800000000000005},"min":{"1min":0.49299999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.93400000000000005,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.69799999999999995}]},{"osd":5,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69899999999999995,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92500000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.52300000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91900000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.66800000000000004}]},{"osd":6,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.59699999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.96399999999999997,"5min":1.069,"15min":1.069},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.52200000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.91700000000000004,"5min":1.026,"15min":1.026},"last":0.86399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27608,"kb_used_data":584,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344232,"statfs":{"total":96636764160,"available":96608493568,"internally_reserved":0,"allocated":598016,"data_stored":252091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.627,"15min":0.629},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86299999999999999,"5min":1.022,"15min":1.022},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98299999999999998,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.626}]},{"osd":1,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.52100000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92600000000000005,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88700000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.54400000000000004}]},{"osd":2,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.83899999999999997,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71399999999999997,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94899999999999995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.69399999999999995}]},{"osd":3,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.50900000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92700000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.747},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72799999999999998,"15min":0.72899999999999998},"min":{"1min":0.59099999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.90200000000000002,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.73499999999999999}]},{"osd":4,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.66100000000000003,"15min":0.67100000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90600000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.52800000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88900000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.70699999999999996}]},{"osd":5,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.47299999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.73599999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96499999999999997,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.72299999999999998}]},{"osd":7,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76200000000000001,"15min":0.76500000000000001},"min":{"1min":0.502,"5min":0.437,"15min":0.437},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76900000000000002,"15min":0.76800000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.76500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":252743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":7.4550000000000001,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.508,"5min":1.508,"15min":1.508},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":16.951000000000001,"5min":16.951000000000001,"15min":16.951000000000001},"last":0.65400000000000003}]},{"osd":1,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":19.823,"5min":19.823,"15min":19.823},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.57699999999999996}]},{"osd":2,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.1659999999999999,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.585,"5min":1.585,"15min":1.585},"last":0.48899999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":2.2949999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":6.7649999999999997,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":0.68100000000000005}]},{"osd":4,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.716,"5min":1.716,"15min":1.716},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.6499999999999999,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":0.70299999999999996}]},{"osd":6,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.77700000000000002}]},{"osd":7,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.371,"5min":2.371,"15min":2.371},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.5760000000000001,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.747}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27620,"kb_used_data":596,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344220,"statfs":{"total":96636764160,"available":96608481280,"internally_reserved":0,"allocated":610304,"data_stored":253703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.7690000000000001,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.65600000000000003}]},{"osd":1,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":3.3849999999999998,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":0.83899999999999997}]},{"osd":2,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":3.1240000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.74099999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":3.641,"5min":3.641,"15min":3.641},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":3.194,"5min":3.194,"15min":3.194},"last":0.85399999999999998}]},{"osd":5,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":9.3040000000000003,"5min":9.3040000000000003,"15min":9.3040000000000003},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.81399999999999995}]},{"osd":6,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":3.097,"5min":3.097,"15min":3.097},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":3.3319999999999999,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.89500000000000002}]},{"osd":7,"last update":"Tue Dec 19 18:59:34 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":5.0410000000000004,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.876},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":6.3449999999999998,"5min":6.3449999999999998,"15min":6.3449999999999998},"last":0.94599999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":252147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45600000000000002,"15min":0.45800000000000002},"min":{"1min":0.30099999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.44400000000000001,"15min":0.44600000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58299999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.40200000000000002}]},{"osd":1,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.47899999999999998,"15min":0.48899999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60699999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.63100000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.439}]},{"osd":2,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65700000000000003,"5min":0.75,"15min":0.75},"last":0.505},{"interface":"front","average":{"1min":0.497,"5min":0.54300000000000004,"15min":0.55100000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70999999999999996,"5min":0.875,"15min":0.875},"last":0.47399999999999998}]},{"osd":4,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78900000000000003,"15min":0.79100000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.99199999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.80600000000000005,"15min":0.81499999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.90900000000000003,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.77200000000000002}]},{"osd":5,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.75,"15min":0.755},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97599999999999998,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.91800000000000004,"5min":1.202,"15min":1.202},"last":0.57399999999999995}]},{"osd":6,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82099999999999995,"15min":0.82999999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.95599999999999996,"5min":1.298,"15min":1.298},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80100000000000005,"15min":0.80700000000000005},"min":{"1min":0.61599999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.93300000000000005,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.81200000000000006}]},{"osd":7,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79200000000000004,"15min":0.79600000000000004},"min":{"1min":0.60399999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.95299999999999996,"5min":1.155,"15min":1.155},"last":0.746},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77700000000000002,"15min":0.78300000000000003},"min":{"1min":0.56499999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.90600000000000003,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.85899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27616,"kb_used_data":592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344224,"statfs":{"total":96636764160,"available":96608485376,"internally_reserved":0,"allocated":606208,"data_stored":252147,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.497,"15min":0.50700000000000001},"min":{"1min":0.313,"5min":0.31,"15min":0.31},"max":{"1min":0.57899999999999996,"5min":1.458,"15min":1.458},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.627,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.627}]},{"osd":1,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.57899999999999996,"15min":0.59899999999999998},"min":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.58499999999999996,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.60399999999999998,"15min":0.624},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.61799999999999999,"5min":2.444,"15min":2.444},"last":0.36599999999999999}]},{"osd":3,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.59599999999999997,"15min":0.62},"min":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65300000000000002,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.625,"15min":0.64300000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.69199999999999995,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.47099999999999997}]},{"osd":4,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.93899999999999995,"15min":0.97499999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.94399999999999995,"5min":1.968,"15min":1.968},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.89500000000000002,"15min":0.92500000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.90700000000000003,"5min":2.835,"15min":2.835},"last":0.59399999999999997}]},{"osd":5,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.91600000000000004,"15min":0.94999999999999996},"min":{"1min":0.56000000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.94599999999999995,"5min":3.5,"15min":3.5},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.91100000000000003,"15min":0.93999999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.99099999999999999,"5min":1.996,"15min":1.996},"last":0.61299999999999999}]},{"osd":6,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.91200000000000003,"15min":0.94699999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.97599999999999998,"5min":2.903,"15min":2.903},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.99199999999999999,"15min":1.034},"min":{"1min":0.53700000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.92800000000000005,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.53700000000000003}]},{"osd":7,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.94999999999999996,"15min":0.98599999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.0049999999999999,"5min":2.875,"15min":2.875},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.94299999999999995,"15min":0.98099999999999998},"min":{"1min":0.59399999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.91900000000000004,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.65300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27612,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344228,"statfs":{"total":96636764160,"available":96608489472,"internally_reserved":0,"allocated":602112,"data_stored":252181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.55200000000000005,"15min":0.58099999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.51600000000000001,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.748,"15min":0.80100000000000005},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.70399999999999996,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.375}]},{"osd":2,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.57199999999999995,"15min":0.59599999999999997},"min":{"1min":0.316,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.63,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.65600000000000003,"15min":0.68899999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65300000000000002,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.45300000000000001}]},{"osd":3,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.79300000000000004,"15min":0.84199999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.629,"5min":7.8399999999999999,"15min":7.8399999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.81200000000000006,"15min":0.85999999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72499999999999998,"5min":7.7949999999999999,"15min":7.7949999999999999},"last":0.436}]},{"osd":4,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.86799999999999999,"15min":0.89900000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0900000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.755},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.89900000000000002,"15min":0.93000000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0289999999999999,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.66100000000000003}]},{"osd":5,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.879,"15min":0.90900000000000003},"min":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92600000000000005,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.88500000000000001,"15min":0.91800000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98899999999999999,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.69699999999999995}]},{"osd":6,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.88300000000000001,"15min":0.90800000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94699999999999995,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.93100000000000005,"15min":0.96899999999999997},"min":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0469999999999999,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.71799999999999997}]},{"osd":7,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.93600000000000005,"15min":0.96799999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1180000000000001,"5min":4.3310000000000004,"15min":4.3310000000000004},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.89200000000000002,"15min":0.92000000000000004},"min":{"1min":0.55200000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.97599999999999998,"5min":4.226,"15min":4.226},"last":0.878}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32360,"kb_used_data":1176,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339480,"statfs":{"total":96636764160,"available":96603627520,"internally_reserved":0,"allocated":1204224,"data_stored":843634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.44700000000000001,"15min":0.45200000000000001},"min":{"1min":0.29199999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63100000000000001,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.46300000000000002}]},{"osd":2,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.35799999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79600000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.746,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.42899999999999999}]},{"osd":3,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70699999999999996,"5min":0.747,"15min":0.747},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86899999999999999,"5min":1.264,"15min":1.264},"last":0.57899999999999996}]},{"osd":4,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0589999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.018,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.58999999999999997}]},{"osd":5,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.91200000000000003,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.81100000000000005,"15min":0.82299999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97899999999999998,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.65700000000000003}]},{"osd":6,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.81999999999999995,"15min":0.83299999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.024,"5min":1.349,"15min":1.349},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.88400000000000001,"5min":1.115,"15min":1.115},"last":0.66800000000000004}]},{"osd":7,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.78500000000000003,"15min":0.79900000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.89400000000000002,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.80700000000000005,"15min":0.81699999999999995},"min":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.997,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.68300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T19:00:40.892 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T19:00:40.893 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T19:00:41.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.073+0000 7f4af485a640 1 Processor -- start 2023-12-19T19:00:41.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.073+0000 7f4af485a640 1 -- start start 2023-12-19T19:00:41.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.073+0000 7f4af485a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4af00c5260 0x7f4af006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:41.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.073+0000 7f4af485a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4af0155de0 0x7f4af0156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:41.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.073+0000 7f4af485a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4af00c2580 con 0x7f4af00c5640 2023-12-19T19:00:41.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.073+0000 7f4af485a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4af0153510 con 0x7f4af00c5260 2023-12-19T19:00:41.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.073+0000 7f4af485a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af00c17f0 con 0x7f4af0155de0 2023-12-19T19:00:41.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.073+0000 7f4ae7fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4af00c5640 0x7f4af00c5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46740/0 (socket says 172.21.15.133:46740) 2023-12-19T19:00:41.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.073+0000 7f4ae7fff640 1 -- 172.21.15.133:0/4027367792 learned_addr learned my addr 172.21.15.133:0/4027367792 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:41.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.073+0000 7f4aeed9d640 1 --2- 172.21.15.133:0/4027367792 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4af0155de0 0x7f4af0156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:41.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.073+0000 7f4aee59c640 1 --2- 172.21.15.133:0/4027367792 >> v2:172.21.15.138:3300/0 conn(0x7f4af00c5260 0x7f4af006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:41.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.073+0000 7f4aedd9b640 1 -- 172.21.15.133:0/4027367792 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2799172203 0 0) 0x7f4af00c2580 con 0x7f4af00c5640 2023-12-19T19:00:41.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.073+0000 7f4aedd9b640 1 -- 172.21.15.133:0/4027367792 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4adc003530 con 0x7f4af00c5640 2023-12-19T19:00:41.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.073+0000 7f4aeed9d640 1 -- 172.21.15.133:0/4027367792 >> v2:172.21.15.138:3300/0 conn(0x7f4af00c5260 msgr2=0x7f4af006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:41.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.073+0000 7f4aeed9d640 1 --2- 172.21.15.133:0/4027367792 >> v2:172.21.15.138:3300/0 conn(0x7f4af00c5260 0x7f4af006d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:41.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.073+0000 7f4aedd9b640 1 -- 172.21.15.133:0/4027367792 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3270616728 0 0) 0x7f4adc003530 con 0x7f4af00c5640 2023-12-19T19:00:41.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.073+0000 7f4aeed9d640 1 -- 172.21.15.133:0/4027367792 >> v1:172.21.15.133:6789/0 conn(0x7f4af00c5640 legacy=0x7f4af00c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:41.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.073+0000 7f4aeed9d640 1 -- 172.21.15.133:0/4027367792 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af00c1a00 con 0x7f4af0155de0 2023-12-19T19:00:41.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.077+0000 7f4aeed9d640 1 --2- 172.21.15.133:0/4027367792 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4af0155de0 0x7f4af0156230 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4af00c1930 tx=0x7f4ae801c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efd1d6ffb3b0ac7c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:41.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.077+0000 7f4aedd9b640 1 -- 172.21.15.133:0/4027367792 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad8001680 con 0x7f4af0155de0 2023-12-19T19:00:41.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.077+0000 7f4aedd9b640 1 -- 172.21.15.133:0/4027367792 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae80a5590 con 0x7f4af0155de0 2023-12-19T19:00:41.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.077+0000 7f4aedd9b640 1 -- 172.21.15.133:0/4027367792 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae80a5900 con 0x7f4af0155de0 2023-12-19T19:00:41.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.077+0000 7f4af485a640 1 -- 172.21.15.133:0/4027367792 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4af0155de0 msgr2=0x7f4af0156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:41.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.077+0000 7f4af485a640 1 --2- 172.21.15.133:0/4027367792 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4af0155de0 0x7f4af0156230 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4af00c1930 tx=0x7f4ae801c790 comp rx=0 tx=0).stop 2023-12-19T19:00:41.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.077+0000 7f4af485a640 1 -- 172.21.15.133:0/4027367792 shutdown_connections 2023-12-19T19:00:41.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.077+0000 7f4af485a640 1 --2- 172.21.15.133:0/4027367792 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4af0155de0 0x7f4af0156230 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:41.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.077+0000 7f4af485a640 1 --2- 172.21.15.133:0/4027367792 >> v2:172.21.15.138:3300/0 conn(0x7f4af00c5260 0x7f4af006d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:41.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.077+0000 7f4af485a640 1 -- 172.21.15.133:0/4027367792 >> 172.21.15.133:0/4027367792 conn(0x7f4af006a5b0 msgr2=0x7f4af006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:41.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.077+0000 7f4af485a640 1 -- 172.21.15.133:0/4027367792 shutdown_connections 2023-12-19T19:00:41.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.077+0000 7f4af485a640 1 -- 172.21.15.133:0/4027367792 wait complete. 2023-12-19T19:00:41.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4af485a640 1 Processor -- start 2023-12-19T19:00:41.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4af485a640 1 -- start start 2023-12-19T19:00:41.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4af485a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4af00c5260 0x7f4af0071680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:41.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4af485a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4af00c5640 0x7f4af00a8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:41.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4af485a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af0155de0 0x7f4af00a9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:41.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4af485a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af00aaae0 con 0x7f4af0155de0 2023-12-19T19:00:41.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4af485a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af0155810 con 0x7f4af00c5260 2023-12-19T19:00:41.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4af485a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4af00aa800 con 0x7f4af00c5640 2023-12-19T19:00:41.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4aeed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af0155de0 0x7f4af00a9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:41.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4aeed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af0155de0 0x7f4af00a9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59192/0 (socket says 172.21.15.133:59192) 2023-12-19T19:00:41.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4aeed9d640 1 -- 172.21.15.133:0/1559391250 learned_addr learned my addr 172.21.15.133:0/1559391250 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:41.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4ae7fff640 1 --2- 172.21.15.133:0/1559391250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4af00c5640 0x7f4af00a8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:41.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4aee59c640 1 --2- 172.21.15.133:0/1559391250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4af00c5260 0x7f4af0071680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:41.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4aeed9d640 1 -- 172.21.15.133:0/1559391250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4af00c5640 msgr2=0x7f4af00a8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:41.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4aeed9d640 1 --2- 172.21.15.133:0/1559391250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4af00c5640 0x7f4af00a8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:41.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4aeed9d640 1 -- 172.21.15.133:0/1559391250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4af00c5260 msgr2=0x7f4af0071680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:41.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4aeed9d640 1 --2- 172.21.15.133:0/1559391250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4af00c5260 0x7f4af0071680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:41.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4aeed9d640 1 -- 172.21.15.133:0/1559391250 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae8009a70 con 0x7f4af0155de0 2023-12-19T19:00:41.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4aeed9d640 1 --2- 172.21.15.133:0/1559391250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af0155de0 0x7f4af00a9150 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4ae801ae40 tx=0x7f4ae8019530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:41.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4ae6ffd640 1 -- 172.21.15.133:0/1559391250 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae80ad640 con 0x7f4af0155de0 2023-12-19T19:00:41.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4ae6ffd640 1 -- 172.21.15.133:0/1559391250 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ae80ad7a0 con 0x7f4af0155de0 2023-12-19T19:00:41.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4ae6ffd640 1 -- 172.21.15.133:0/1559391250 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae80adb30 con 0x7f4af0155de0 2023-12-19T19:00:41.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4af485a640 1 -- 172.21.15.133:0/1559391250 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af01f0010 con 0x7f4af0155de0 2023-12-19T19:00:41.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4af485a640 1 -- 172.21.15.133:0/1559391250 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af01f05d0 con 0x7f4af0155de0 2023-12-19T19:00:41.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.081+0000 7f4af485a640 1 -- 172.21.15.133:0/1559391250 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4af01efe70 con 0x7f4af0155de0 2023-12-19T19:00:41.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.085+0000 7f4ae6ffd640 1 -- 172.21.15.133:0/1559391250 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4ae80b4070 con 0x7f4af0155de0 2023-12-19T19:00:41.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.085+0000 7f4ae6ffd640 1 --2- 172.21.15.133:0/1559391250 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4ad0066470 0x7f4ad0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:41.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.085+0000 7f4ae6ffd640 1 -- 172.21.15.133:0/1559391250 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ae811e670 con 0x7f4af0155de0 2023-12-19T19:00:41.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.085+0000 7f4aee59c640 1 --2- 172.21.15.133:0/1559391250 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4ad0066470 0x7f4ad0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:41.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.085+0000 7f4aee59c640 1 --2- 172.21.15.133:0/1559391250 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4ad0066470 0x7f4ad0068930 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009ac0 tx=0x7f4ae0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:41.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.089+0000 7f4ae6ffd640 1 -- 172.21.15.133:0/1559391250 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4af01efe70 con 0x7f4af0155de0 2023-12-19T19:00:41.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.293+0000 7f4af485a640 1 -- 172.21.15.133:0/1559391250 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4af01efe70 con 0x7f4af0155de0 2023-12-19T19:00:41.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.293+0000 7f4ae6ffd640 1 -- 172.21.15.133:0/1559391250 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f4af01efe70 con 0x7f4af0155de0 2023-12-19T19:00:41.299 INFO:teuthology.orchestra.run.smithi133.stdout:[client.0] 2023-12-19T19:00:41.299 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCn54FllfQwNxAAyKIESQDxKvDHfaewx+v88w== 2023-12-19T19:00:41.299 INFO:teuthology.orchestra.run.smithi133.stdout: caps mds = "allow" 2023-12-19T19:00:41.299 INFO:teuthology.orchestra.run.smithi133.stdout: caps mon = "allow r" 2023-12-19T19:00:41.299 INFO:teuthology.orchestra.run.smithi133.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-19T19:00:41.299 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2023-12-19T19:00:41.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.297+0000 7f4af485a640 1 -- 172.21.15.133:0/1559391250 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4ad0066470 msgr2=0x7f4ad0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:41.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.297+0000 7f4af485a640 1 --2- 172.21.15.133:0/1559391250 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4ad0066470 0x7f4ad0068930 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009ac0 tx=0x7f4ae0009190 comp rx=0 tx=0).stop 2023-12-19T19:00:41.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.297+0000 7f4af485a640 1 -- 172.21.15.133:0/1559391250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af0155de0 msgr2=0x7f4af00a9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:41.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.297+0000 7f4af485a640 1 --2- 172.21.15.133:0/1559391250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af0155de0 0x7f4af00a9150 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4ae801ae40 tx=0x7f4ae8019530 comp rx=0 tx=0).stop 2023-12-19T19:00:41.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.297+0000 7f4af485a640 1 -- 172.21.15.133:0/1559391250 shutdown_connections 2023-12-19T19:00:41.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.297+0000 7f4af485a640 1 --2- 172.21.15.133:0/1559391250 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4ad0066470 0x7f4ad0068930 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:41.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.297+0000 7f4af485a640 1 --2- 172.21.15.133:0/1559391250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4af0155de0 0x7f4af00a9150 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:41.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.297+0000 7f4af485a640 1 --2- 172.21.15.133:0/1559391250 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4af00c5640 0x7f4af00a8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:41.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.297+0000 7f4af485a640 1 --2- 172.21.15.133:0/1559391250 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4af00c5260 0x7f4af0071680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:41.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.297+0000 7f4af485a640 1 -- 172.21.15.133:0/1559391250 >> 172.21.15.133:0/1559391250 conn(0x7f4af006a5b0 msgr2=0x7f4af00a6210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:41.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.297+0000 7f4af485a640 1 -- 172.21.15.133:0/1559391250 shutdown_connections 2023-12-19T19:00:41.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.297+0000 7f4af485a640 1 -- 172.21.15.133:0/1559391250 wait complete. 2023-12-19T19:00:41.320 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:00:41.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.453+0000 7f09f9ac9640 1 Processor -- start 2023-12-19T19:00:41.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.453+0000 7f09f9ac9640 1 -- start start 2023-12-19T19:00:41.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.453+0000 7f09f9ac9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f09f40c63c0 0x7f09f40c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:41.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.457+0000 7f09f9ac9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f09f40c4100 0x7f09f40c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:41.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.457+0000 7f09f9ac9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09f40c29e0 0x7f09f40a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:41.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.457+0000 7f09f9ac9640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f40c31c0 con 0x7f09f40c4100 2023-12-19T19:00:41.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.457+0000 7f09f9ac9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f40c34a0 con 0x7f09f40c63c0 2023-12-19T19:00:41.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.457+0000 7f09f9ac9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f40c1030 con 0x7f09f40c29e0 2023-12-19T19:00:41.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.457+0000 7f09f2ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f09f40c4100 0x7f09f40c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:41.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.457+0000 7f09f2ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f09f40c4100 0x7f09f40c24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59208/0 (socket says 172.21.15.133:59208) 2023-12-19T19:00:41.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.457+0000 7f09f2ffd640 1 -- 172.21.15.133:0/1908544446 learned_addr learned my addr 172.21.15.133:0/1908544446 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:41.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.457+0000 7f09f3fff640 1 --2- 172.21.15.133:0/1908544446 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09f40c29e0 0x7f09f40a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:41.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.457+0000 7f09f37fe640 1 --2- 172.21.15.133:0/1908544446 >> v2:172.21.15.138:3300/0 conn(0x7f09f40c63c0 0x7f09f40c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:41.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.457+0000 7f09f2ffd640 1 -- 172.21.15.133:0/1908544446 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09f40c29e0 msgr2=0x7f09f40a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:41.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.457+0000 7f09f2ffd640 1 --2- 172.21.15.133:0/1908544446 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09f40c29e0 0x7f09f40a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:41.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.457+0000 7f09f2ffd640 1 -- 172.21.15.133:0/1908544446 >> v2:172.21.15.138:3300/0 conn(0x7f09f40c63c0 msgr2=0x7f09f40c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:41.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.457+0000 7f09f2ffd640 1 --2- 172.21.15.133:0/1908544446 >> v2:172.21.15.138:3300/0 conn(0x7f09f40c63c0 0x7f09f40c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:41.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.457+0000 7f09f2ffd640 1 -- 172.21.15.133:0/1908544446 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f40c1310 con 0x7f09f40c4100 2023-12-19T19:00:41.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.457+0000 7f09f2ffd640 1 --2- 172.21.15.133:0/1908544446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09f40c4100 0x7f09f40c24a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f09f406e000 tx=0x7f09e801ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc7b9e0afde484 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:41.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.457+0000 7f09f27fc640 1 -- 172.21.15.133:0/1908544446 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f40aa3d0 con 0x7f09f40c4100 2023-12-19T19:00:41.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.457+0000 7f09f27fc640 1 -- 172.21.15.133:0/1908544446 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e80a7b30 con 0x7f09f40c4100 2023-12-19T19:00:41.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.457+0000 7f09f27fc640 1 -- 172.21.15.133:0/1908544446 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e80af440 con 0x7f09f40c4100 2023-12-19T19:00:41.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.461+0000 7f09f9ac9640 1 -- 172.21.15.133:0/1908544446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09f40c4100 msgr2=0x7f09f40c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:41.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.461+0000 7f09f9ac9640 1 --2- 172.21.15.133:0/1908544446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09f40c4100 0x7f09f40c24a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f09f406e000 tx=0x7f09e801ea80 comp rx=0 tx=0).stop 2023-12-19T19:00:41.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.461+0000 7f09f9ac9640 1 -- 172.21.15.133:0/1908544446 shutdown_connections 2023-12-19T19:00:41.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.461+0000 7f09f9ac9640 1 --2- 172.21.15.133:0/1908544446 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09f40c29e0 0x7f09f40a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:41.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.461+0000 7f09f9ac9640 1 --2- 172.21.15.133:0/1908544446 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09f40c4100 0x7f09f40c24a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:41.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.461+0000 7f09f9ac9640 1 --2- 172.21.15.133:0/1908544446 >> v2:172.21.15.138:3300/0 conn(0x7f09f40c63c0 0x7f09f40c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:41.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.461+0000 7f09f9ac9640 1 -- 172.21.15.133:0/1908544446 >> 172.21.15.133:0/1908544446 conn(0x7f09f406a5b0 msgr2=0x7f09f406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:41.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.461+0000 7f09f9ac9640 1 -- 172.21.15.133:0/1908544446 shutdown_connections 2023-12-19T19:00:41.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.461+0000 7f09f9ac9640 1 -- 172.21.15.133:0/1908544446 wait complete. 2023-12-19T19:00:41.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.461+0000 7f09f9ac9640 1 Processor -- start 2023-12-19T19:00:41.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.461+0000 7f09f9ac9640 1 -- start start 2023-12-19T19:00:41.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.461+0000 7f09f9ac9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09f40c29e0 0x7f09f414d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:41.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.461+0000 7f09f9ac9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09f40c4100 0x7f09f4070ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:41.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.461+0000 7f09f9ac9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09f40c63c0 0x7f09f41f4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:41.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.461+0000 7f09f9ac9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f414ed70 con 0x7f09f40c29e0 2023-12-19T19:00:41.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.461+0000 7f09f9ac9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f41f4230 con 0x7f09f40c4100 2023-12-19T19:00:41.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.461+0000 7f09f9ac9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f414ded0 con 0x7f09f40c63c0 2023-12-19T19:00:41.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.461+0000 7f09f37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09f40c29e0 0x7f09f414d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:41.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.461+0000 7f09f37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09f40c29e0 0x7f09f414d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59222/0 (socket says 172.21.15.133:59222) 2023-12-19T19:00:41.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.461+0000 7f09f37fe640 1 -- 172.21.15.133:0/102617285 learned_addr learned my addr 172.21.15.133:0/102617285 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:41.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.461+0000 7f09f2ffd640 1 --2- 172.21.15.133:0/102617285 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09f40c4100 0x7f09f4070ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:41.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.465+0000 7f09f3fff640 1 --2- 172.21.15.133:0/102617285 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09f40c63c0 0x7f09f41f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:41.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.465+0000 7f09f37fe640 1 -- 172.21.15.133:0/102617285 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09f40c63c0 msgr2=0x7f09f41f4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:41.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.465+0000 7f09f37fe640 1 --2- 172.21.15.133:0/102617285 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09f40c63c0 0x7f09f41f4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:41.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.465+0000 7f09f37fe640 1 -- 172.21.15.133:0/102617285 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09f40c4100 msgr2=0x7f09f4070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:41.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.465+0000 7f09f37fe640 1 --2- 172.21.15.133:0/102617285 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09f40c4100 0x7f09f4070ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:41.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.465+0000 7f09f37fe640 1 -- 172.21.15.133:0/102617285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e800b770 con 0x7f09f40c29e0 2023-12-19T19:00:41.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.465+0000 7f09f37fe640 1 --2- 172.21.15.133:0/102617285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09f40c29e0 0x7f09f414d990 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f09e400e8a0 tx=0x7f09e400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:41.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.465+0000 7f09dbfff640 1 -- 172.21.15.133:0/102617285 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4009510 con 0x7f09f40c29e0 2023-12-19T19:00:41.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.465+0000 7f09dbfff640 1 -- 172.21.15.133:0/102617285 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e400c940 con 0x7f09f40c29e0 2023-12-19T19:00:41.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.465+0000 7f09f9ac9640 1 -- 172.21.15.133:0/102617285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f40c69b0 con 0x7f09f40c29e0 2023-12-19T19:00:41.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.465+0000 7f09dbfff640 1 -- 172.21.15.133:0/102617285 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e400ccb0 con 0x7f09f40c29e0 2023-12-19T19:00:41.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.465+0000 7f09f9ac9640 1 -- 172.21.15.133:0/102617285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f406db20 con 0x7f09f40c29e0 2023-12-19T19:00:41.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.465+0000 7f09f9ac9640 1 -- 172.21.15.133:0/102617285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f4068400 con 0x7f09f40c29e0 2023-12-19T19:00:41.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.465+0000 7f09dbfff640 1 -- 172.21.15.133:0/102617285 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f09e4013470 con 0x7f09f40c29e0 2023-12-19T19:00:41.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.465+0000 7f09dbfff640 1 --2- 172.21.15.133:0/102617285 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f09e00664a0 0x7f09e0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:41.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.465+0000 7f09dbfff640 1 -- 172.21.15.133:0/102617285 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09e4083f20 con 0x7f09f40c29e0 2023-12-19T19:00:41.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.465+0000 7f09f2ffd640 1 --2- 172.21.15.133:0/102617285 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f09e00664a0 0x7f09e0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:41.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.469+0000 7f09f2ffd640 1 --2- 172.21.15.133:0/102617285 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f09e00664a0 0x7f09e0068960 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f09e80b1000 tx=0x7f09e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:41.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.469+0000 7f09dbfff640 1 -- 172.21.15.133:0/102617285 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f09e40513b0 con 0x7f09f40c29e0 2023-12-19T19:00:41.494 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T19:00:41.499 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T19:00:41.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.653+0000 7f09f9ac9640 1 -- 172.21.15.133:0/102617285 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09f40676f0 con 0x7f09f40c29e0 2023-12-19T19:00:41.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.653+0000 7f09dbfff640 1 -- 172.21.15.133:0/102617285 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4950 (secure 0 0 0) 0x7f09e40549d0 con 0x7f09f40c29e0 2023-12-19T19:00:41.659 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:41.659 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3200335051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3200335051},{"type":"v1","addr":"172.21.15.133:6833","nonce":3200335051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2114705112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":2114705112},{"type":"v1","addr":"172.21.15.138:6835","nonce":2114705112}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/3661017926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3661017926},{"type":"v1","addr":"172.21.15.138:6837","nonce":3661017926}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:00:31.342186+0000","modified":"2023-12-19T19:00:34.368238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5763},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5763":{"gid":5763,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6835/1203400706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1203400706},{"type":"v1","addr":"172.21.15.133:6835","nonce":1203400706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T19:00:41.659 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 32 2023-12-19T19:00:41.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.657+0000 7f09f9ac9640 1 -- 172.21.15.133:0/102617285 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f09e00664a0 msgr2=0x7f09e0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:41.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.657+0000 7f09f9ac9640 1 --2- 172.21.15.133:0/102617285 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f09e00664a0 0x7f09e0068960 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f09e80b1000 tx=0x7f09e8008040 comp rx=0 tx=0).stop 2023-12-19T19:00:41.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.657+0000 7f09f9ac9640 1 -- 172.21.15.133:0/102617285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09f40c29e0 msgr2=0x7f09f414d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:41.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.657+0000 7f09f9ac9640 1 --2- 172.21.15.133:0/102617285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09f40c29e0 0x7f09f414d990 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f09e400e8a0 tx=0x7f09e400eca0 comp rx=0 tx=0).stop 2023-12-19T19:00:41.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.657+0000 7f09f9ac9640 1 -- 172.21.15.133:0/102617285 shutdown_connections 2023-12-19T19:00:41.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.657+0000 7f09f9ac9640 1 --2- 172.21.15.133:0/102617285 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f09e00664a0 0x7f09e0068960 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:41.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.657+0000 7f09f9ac9640 1 --2- 172.21.15.133:0/102617285 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09f40c63c0 0x7f09f41f4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:41.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.657+0000 7f09f9ac9640 1 --2- 172.21.15.133:0/102617285 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f09f40c4100 0x7f09f4070ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:41.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.657+0000 7f09f9ac9640 1 --2- 172.21.15.133:0/102617285 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09f40c29e0 0x7f09f414d990 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:41.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.657+0000 7f09f9ac9640 1 -- 172.21.15.133:0/102617285 >> 172.21.15.133:0/102617285 conn(0x7f09f406a5b0 msgr2=0x7f09f406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:41.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.657+0000 7f09f9ac9640 1 -- 172.21.15.133:0/102617285 shutdown_connections 2023-12-19T19:00:41.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:41.657+0000 7f09f9ac9640 1 -- 172.21.15.133:0/102617285 wait complete. 2023-12-19T19:00:42.083 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T19:00:31.342186+0000', 'modified': '2023-12-19T19:00:34.368238+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5763}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5763': {'gid': 5763, 'name': 'c', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.133:6835/1203400706', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6834', 'nonce': 1203400706}, {'type': 'v1', 'addr': '172.21.15.133:6835', 'nonce': 1203400706}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T19:00:42.083 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T19:00:42.083 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-19T19:00:42.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.217+0000 7fe9179aa640 1 Processor -- start 2023-12-19T19:00:42.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.217+0000 7fe9179aa640 1 -- start start 2023-12-19T19:00:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.221+0000 7fe9179aa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe910155de0 0x7fe910156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.221+0000 7fe9179aa640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9100c2580 con 0x7fe9100c5260 2023-12-19T19:00:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.221+0000 7fe9179aa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9100c1a00 con 0x7fe9100c5640 2023-12-19T19:00:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.221+0000 7fe9179aa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe910153510 con 0x7fe910155de0 2023-12-19T19:00:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.221+0000 7fe915746640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe9100c5260 0x7fe91006d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46754/0 (socket says 172.21.15.133:46754) 2023-12-19T19:00:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.221+0000 7fe915746640 1 -- 172.21.15.133:0/969670024 learned_addr learned my addr 172.21.15.133:0/969670024 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.221+0000 7fe915f47640 1 --2- 172.21.15.133:0/969670024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe910155de0 0x7fe910156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.221+0000 7fe907fff640 1 -- 172.21.15.133:0/969670024 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2550817247 0 0) 0x7fe9100c2580 con 0x7fe9100c5260 2023-12-19T19:00:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.221+0000 7fe907fff640 1 -- 172.21.15.133:0/969670024 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8fc003530 con 0x7fe9100c5260 2023-12-19T19:00:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.221+0000 7fe907fff640 1 -- 172.21.15.133:0/969670024 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 135514970 0 0) 0x7fe9100c1a00 con 0x7fe9100c5640 2023-12-19T19:00:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.221+0000 7fe907fff640 1 -- 172.21.15.133:0/969670024 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9100c2580 con 0x7fe9100c5640 2023-12-19T19:00:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.221+0000 7fe907fff640 1 -- 172.21.15.133:0/969670024 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1120547096 0 0) 0x7fe8fc003530 con 0x7fe9100c5260 2023-12-19T19:00:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.221+0000 7fe915f47640 1 -- 172.21.15.133:0/969670024 >> v1:172.21.15.138:6789/0 conn(0x7fe9100c5640 legacy=0x7fe9100c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.221+0000 7fe915f47640 1 -- 172.21.15.133:0/969670024 >> v1:172.21.15.133:6789/0 conn(0x7fe9100c5260 legacy=0x7fe91006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:42.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.221+0000 7fe915f47640 1 -- 172.21.15.133:0/969670024 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9100c1ce0 con 0x7fe910155de0 2023-12-19T19:00:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.225+0000 7fe915f47640 1 --2- 172.21.15.133:0/969670024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe910155de0 0x7fe910156230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe908009dc0 tx=0x7fe90801c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b3c59a181504d3e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.225+0000 7fe907fff640 1 -- 172.21.15.133:0/969670024 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c001680 con 0x7fe910155de0 2023-12-19T19:00:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.225+0000 7fe907fff640 1 -- 172.21.15.133:0/969670024 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9080a5530 con 0x7fe910155de0 2023-12-19T19:00:42.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.225+0000 7fe907fff640 1 -- 172.21.15.133:0/969670024 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9080a58a0 con 0x7fe910155de0 2023-12-19T19:00:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.225+0000 7fe9179aa640 1 -- 172.21.15.133:0/969670024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe910155de0 msgr2=0x7fe910156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.225+0000 7fe9179aa640 1 --2- 172.21.15.133:0/969670024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe910155de0 0x7fe910156230 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe908009dc0 tx=0x7fe90801c800 comp rx=0 tx=0).stop 2023-12-19T19:00:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.225+0000 7fe9179aa640 1 -- 172.21.15.133:0/969670024 shutdown_connections 2023-12-19T19:00:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.225+0000 7fe9179aa640 1 --2- 172.21.15.133:0/969670024 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe910155de0 0x7fe910156230 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.225+0000 7fe9179aa640 1 -- 172.21.15.133:0/969670024 >> 172.21.15.133:0/969670024 conn(0x7fe91006a5b0 msgr2=0x7fe91006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.225+0000 7fe9179aa640 1 -- 172.21.15.133:0/969670024 shutdown_connections 2023-12-19T19:00:42.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.225+0000 7fe9179aa640 1 -- 172.21.15.133:0/969670024 wait complete. 2023-12-19T19:00:42.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.225+0000 7fe9179aa640 1 Processor -- start 2023-12-19T19:00:42.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.225+0000 7fe9179aa640 1 -- start start 2023-12-19T19:00:42.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.229+0000 7fe9179aa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9100c5260 0x7fe910071560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.229+0000 7fe9179aa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9100c5640 0x7fe910148c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.229+0000 7fe9179aa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe910155de0 0x7fe9101491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.229+0000 7fe9179aa640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9100a87d0 con 0x7fe9100c5260 2023-12-19T19:00:42.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.229+0000 7fe9179aa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe910149710 con 0x7fe910155de0 2023-12-19T19:00:42.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.229+0000 7fe9179aa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9100a7f70 con 0x7fe9100c5640 2023-12-19T19:00:42.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.229+0000 7fe915746640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9100c5260 0x7fe910071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.229+0000 7fe915746640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9100c5260 0x7fe910071560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59238/0 (socket says 172.21.15.133:59238) 2023-12-19T19:00:42.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.229+0000 7fe915746640 1 -- 172.21.15.133:0/4211763868 learned_addr learned my addr 172.21.15.133:0/4211763868 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:42.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.229+0000 7fe914f45640 1 --2- 172.21.15.133:0/4211763868 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9100c5640 0x7fe910148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.229+0000 7fe915f47640 1 --2- 172.21.15.133:0/4211763868 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe910155de0 0x7fe9101491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.229+0000 7fe915746640 1 -- 172.21.15.133:0/4211763868 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9100c5640 msgr2=0x7fe910148c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:42.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.229+0000 7fe915746640 1 --2- 172.21.15.133:0/4211763868 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9100c5640 0x7fe910148c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.229+0000 7fe915746640 1 -- 172.21.15.133:0/4211763868 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe910155de0 msgr2=0x7fe9101491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:42.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.229+0000 7fe915746640 1 --2- 172.21.15.133:0/4211763868 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe910155de0 0x7fe9101491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.229+0000 7fe915746640 1 -- 172.21.15.133:0/4211763868 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe908009a70 con 0x7fe9100c5260 2023-12-19T19:00:42.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.229+0000 7fe914f45640 1 --2- 172.21.15.133:0/4211763868 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9100c5640 0x7fe910148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:42.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.229+0000 7fe915746640 1 --2- 172.21.15.133:0/4211763868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9100c5260 0x7fe910071560 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fe90c00c730 tx=0x7fe90c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:42.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.229+0000 7fe905ffb640 1 -- 172.21.15.133:0/4211763868 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c005ae0 con 0x7fe9100c5260 2023-12-19T19:00:42.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.229+0000 7fe905ffb640 1 -- 172.21.15.133:0/4211763868 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90c005c40 con 0x7fe9100c5260 2023-12-19T19:00:42.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.229+0000 7fe905ffb640 1 -- 172.21.15.133:0/4211763868 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c007070 con 0x7fe9100c5260 2023-12-19T19:00:42.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.229+0000 7fe9179aa640 1 -- 172.21.15.133:0/4211763868 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9100a8270 con 0x7fe9100c5260 2023-12-19T19:00:42.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.229+0000 7fe9179aa640 1 -- 172.21.15.133:0/4211763868 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe910148770 con 0x7fe9100c5260 2023-12-19T19:00:42.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe905ffb640 1 -- 172.21.15.133:0/4211763868 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe90c0071d0 con 0x7fe9100c5260 2023-12-19T19:00:42.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe905ffb640 1 --2- 172.21.15.133:0/4211763868 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe8f4066470 0x7fe8f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe905ffb640 1 -- 172.21.15.133:0/4211763868 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe90c0834a0 con 0x7fe9100c5260 2023-12-19T19:00:42.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe914f45640 1 --2- 172.21.15.133:0/4211763868 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe8f4066470 0x7fe8f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe91ad16000 1 Processor -- start 2023-12-19T19:00:42.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe91ad16000 1 -- start start 2023-12-19T19:00:42.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe914f45640 1 --2- 172.21.15.133:0/4211763868 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe8f4066470 0x7fe8f4068930 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe9100a8cb0 tx=0x7fe900009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:42.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe91ad16000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564318e54650 0x564318e54a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe91ad16000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564318e54f70 0x564318e55350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe91ad16000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e55890 0x564318e9ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe91ad16000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564318d1ef00 con 0x564318e55890 2023-12-19T19:00:42.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe91ad16000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x564318caedd0 con 0x564318e54f70 2023-12-19T19:00:42.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe91ad16000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x564318cac300 con 0x564318e54650 2023-12-19T19:00:42.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe915f47640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e55890 0x564318e9ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe915746640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564318e54650 0x564318e54a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe915746640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564318e54650 0x564318e54a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:57284/0 (socket says 172.21.15.133:57284) 2023-12-19T19:00:42.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe915746640 1 -- 172.21.15.133:0/3339019583 learned_addr learned my addr 172.21.15.133:0/3339019583 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:42.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe914f45640 1 --2- 172.21.15.133:0/3339019583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564318e54f70 0x564318e55350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe915f47640 1 -- 172.21.15.133:0/3339019583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564318e54650 msgr2=0x564318e54a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:42.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe915f47640 1 --2- 172.21.15.133:0/3339019583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564318e54650 0x564318e54a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe915f47640 1 -- 172.21.15.133:0/3339019583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564318e54f70 msgr2=0x564318e55350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:42.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe915f47640 1 --2- 172.21.15.133:0/3339019583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564318e54f70 0x564318e55350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe915f47640 1 -- 172.21.15.133:0/3339019583 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56431899f890 con 0x564318e55890 2023-12-19T19:00:42.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe915746640 1 --2- 172.21.15.133:0/3339019583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564318e54650 0x564318e54a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:00:42.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.233+0000 7fe915f47640 1 --2- 172.21.15.133:0/3339019583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e55890 0x564318e9ede0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe9080ac000 tx=0x7fe908004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d841c79c2c2c370e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:42.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe8f2ffd640 1 -- 172.21.15.133:0/3339019583 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9080a5920 con 0x564318e55890 2023-12-19T19:00:42.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe8f2ffd640 1 -- 172.21.15.133:0/3339019583 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9080a5a80 con 0x564318e55890 2023-12-19T19:00:42.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe8f2ffd640 1 -- 172.21.15.133:0/3339019583 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9080a5e70 con 0x564318e55890 2023-12-19T19:00:42.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe91ad16000 1 -- 172.21.15.133:0/3339019583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e55890 msgr2=0x564318e9ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:42.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe91ad16000 1 --2- 172.21.15.133:0/3339019583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e55890 0x564318e9ede0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fe9080ac000 tx=0x7fe908004ac0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe91ad16000 1 -- 172.21.15.133:0/3339019583 shutdown_connections 2023-12-19T19:00:42.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe91ad16000 1 --2- 172.21.15.133:0/3339019583 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e55890 0x564318e9ede0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe91ad16000 1 --2- 172.21.15.133:0/3339019583 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564318e54f70 0x564318e55350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe91ad16000 1 --2- 172.21.15.133:0/3339019583 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564318e54650 0x564318e54a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe91ad16000 1 -- 172.21.15.133:0/3339019583 >> 172.21.15.133:0/3339019583 conn(0x564318e5d2f0 msgr2=0x564318e94b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:42.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe91ad16000 1 -- 172.21.15.133:0/3339019583 shutdown_connections 2023-12-19T19:00:42.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe91ad16000 1 -- 172.21.15.133:0/3339019583 wait complete. 2023-12-19T19:00:42.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe91ad16000 1 -- start start 2023-12-19T19:00:42.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe91ad16000 1 Processor -- start 2023-12-19T19:00:42.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe91ad16000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564318e54650 0x564318e59400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe91ad16000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e54f70 0x564318e59940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe91ad16000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564318e55890 0x564318e59e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe91ad16000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564318ca7bf0 con 0x564318e54f70 2023-12-19T19:00:42.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe91ad16000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x564318c5fc60 con 0x564318e54650 2023-12-19T19:00:42.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe91ad16000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x564318c65b00 con 0x564318e55890 2023-12-19T19:00:42.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe91ad16000 10 client.0 _ll_register_callbacks cb 0x564318e42710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T19:00:42.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe914f45640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e54f70 0x564318e59940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe914f45640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e54f70 0x564318e59940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59250/0 (socket says 172.21.15.133:59250) 2023-12-19T19:00:42.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe915746640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564318e54650 0x564318e59400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe914f45640 1 -- 172.21.15.133:0/1157500640 learned_addr learned my addr 172.21.15.133:0/1157500640 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:42.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe915f47640 1 --2- 172.21.15.133:0/1157500640 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564318e55890 0x564318e59e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe914f45640 1 -- 172.21.15.133:0/1157500640 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564318e55890 msgr2=0x564318e59e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:42.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe914f45640 1 --2- 172.21.15.133:0/1157500640 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564318e55890 0x564318e59e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe914f45640 1 -- 172.21.15.133:0/1157500640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564318e54650 msgr2=0x564318e59400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:42.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe914f45640 1 --2- 172.21.15.133:0/1157500640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564318e54650 0x564318e59400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe914f45640 1 -- 172.21.15.133:0/1157500640 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe910148770 con 0x564318e54f70 2023-12-19T19:00:42.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe915746640 1 --2- 172.21.15.133:0/1157500640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564318e54650 0x564318e59400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:00:42.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe914f45640 1 --2- 172.21.15.133:0/1157500640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e54f70 0x564318e59940 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe90000ea60 tx=0x7fe900001160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206dc60a8c134319 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:42.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.237+0000 7fe8ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-19T19:00:42.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe8ebfff640 1 -- 172.21.15.133:0/1157500640 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe900003d90 con 0x564318e54f70 2023-12-19T19:00:42.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe8ebfff640 1 -- 172.21.15.133:0/1157500640 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe900023b00 con 0x564318e54f70 2023-12-19T19:00:42.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe91ad16000 1 -- 172.21.15.133:0/1157500640 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564318c65490 con 0x564318e54f70 2023-12-19T19:00:42.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe8ebfff640 1 -- 172.21.15.133:0/1157500640 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe900023cc0 con 0x564318e54f70 2023-12-19T19:00:42.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe91ad16000 10 client.5931 fetch_fsmap learned FSMap version 32 2023-12-19T19:00:42.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe91ad16000 1 -- 172.21.15.133:0/1157500640 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x7fe9100c1ce0 con 0x564318e54f70 2023-12-19T19:00:42.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe8ebfff640 1 -- 172.21.15.133:0/1157500640 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564318c65490 con 0x564318e54f70 2023-12-19T19:00:42.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe8ebfff640 1 -- 172.21.15.133:0/1157500640 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe900020070 con 0x564318e54f70 2023-12-19T19:00:42.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe91ad16000 10 client.5931 fetch_fsmap finished waiting for FSMap version 32 2023-12-19T19:00:42.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe91ad16000 10 client.5931 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T19:00:42.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe91ad16000 20 client.5931 populate_metadata read hostname 'smithi133' 2023-12-19T19:00:42.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe91ad16000 1 --2- 172.21.15.133:0/1157500640 >> [v2:172.21.15.133:6834/1203400706,v1:172.21.15.133:6835/1203400706] conn(0x564318ea7140 0x564318ea9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe91ad16000 4 client.5931 mds_command: new command op to 5763 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-19T19:00:42.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe91ad16000 1 -- 172.21.15.133:0/1157500640 --> [v2:172.21.15.133:6834/1203400706,v1:172.21.15.133:6835/1203400706] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564318ca6540 con 0x564318ea7140 2023-12-19T19:00:42.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe915746640 1 --2- 172.21.15.133:0/1157500640 >> [v2:172.21.15.133:6834/1203400706,v1:172.21.15.133:6835/1203400706] conn(0x564318ea7140 0x564318ea9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe8ebfff640 10 client.5931 ms_handle_connect on v2:172.21.15.133:6834/1203400706 2023-12-19T19:00:42.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe915746640 1 --2- 172.21.15.133:0/1157500640 >> [v2:172.21.15.133:6834/1203400706,v1:172.21.15.133:6835/1203400706] conn(0x564318ea7140 0x564318ea9530 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6dcc008b2179ae6 server_cookie=d39457379186060f in_seq=0 out_seq=0 2023-12-19T19:00:42.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe8ebfff640 1 -- 172.21.15.133:0/1157500640 <== mds.0 v2:172.21.15.133:6834/1203400706 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564318ca6540 con 0x564318ea7140 2023-12-19T19:00:42.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe8ebfff640 10 client.5931 handle_command_reply: tid=0 2023-12-19T19:00:42.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe91ad16000 1 client.5931 shutdown 2023-12-19T19:00:42.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe91ad16000 1 -- 172.21.15.133:0/1157500640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e54f70 msgr2=0x564318e59940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:42.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe91ad16000 1 --2- 172.21.15.133:0/1157500640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e54f70 0x564318e59940 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fe90000ea60 tx=0x7fe900001160 comp rx=0 tx=0).stop 2023-12-19T19:00:42.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe91ad16000 1 -- 172.21.15.133:0/1157500640 shutdown_connections 2023-12-19T19:00:42.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe91ad16000 1 --2- 172.21.15.133:0/1157500640 >> [v2:172.21.15.133:6834/1203400706,v1:172.21.15.133:6835/1203400706] conn(0x564318ea7140 0x564318ea9530 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe91ad16000 1 --2- 172.21.15.133:0/1157500640 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564318e55890 0x564318e59e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe91ad16000 1 --2- 172.21.15.133:0/1157500640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e54f70 0x564318e59940 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe8ebfff640 0 client.5931 ms_handle_reset on v2:172.21.15.133:6834/1203400706 2023-12-19T19:00:42.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe91ad16000 1 --2- 172.21.15.133:0/1157500640 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564318e54650 0x564318e59400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe91ad16000 1 -- 172.21.15.133:0/1157500640 >> 172.21.15.133:0/1157500640 conn(0x564318e5d2f0 msgr2=0x564318e53d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:42.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe91ad16000 1 -- 172.21.15.133:0/1157500640 shutdown_connections 2023-12-19T19:00:42.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe91ad16000 1 -- 172.21.15.133:0/1157500640 wait complete. 2023-12-19T19:00:42.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.241+0000 7fe91ad16000 20 client.5931 trim_cache size 0 max 16384 2023-12-19T19:00:42.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.257+0000 7fe91ad16000 1 Processor -- start 2023-12-19T19:00:42.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.257+0000 7fe91ad16000 1 -- start start 2023-12-19T19:00:42.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.257+0000 7fe91ad16000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e5d2f0 0x564318ea4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.257+0000 7fe91ad16000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564318e54650 0x564318ea9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.257+0000 7fe91ad16000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564318e54f70 0x564318ea9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.257+0000 7fe91ad16000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564318960940 con 0x564318e5d2f0 2023-12-19T19:00:42.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.257+0000 7fe91ad16000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x564318ca3ce0 con 0x564318e54f70 2023-12-19T19:00:42.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.257+0000 7fe91ad16000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x564318c60dd0 con 0x564318e54650 2023-12-19T19:00:42.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.257+0000 7fe915746640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e5d2f0 0x564318ea4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.257+0000 7fe915746640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e5d2f0 0x564318ea4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59254/0 (socket says 172.21.15.133:59254) 2023-12-19T19:00:42.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.257+0000 7fe915746640 1 -- 172.21.15.133:0/3209468499 learned_addr learned my addr 172.21.15.133:0/3209468499 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:42.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.257+0000 7fe915f47640 1 --2- 172.21.15.133:0/3209468499 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564318e54f70 0x564318ea9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.257+0000 7fe914f45640 1 --2- 172.21.15.133:0/3209468499 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564318e54650 0x564318ea9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.257+0000 7fe915746640 1 -- 172.21.15.133:0/3209468499 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564318e54650 msgr2=0x564318ea9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:42.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.257+0000 7fe915746640 1 --2- 172.21.15.133:0/3209468499 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564318e54650 0x564318ea9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.257+0000 7fe915746640 1 -- 172.21.15.133:0/3209468499 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564318e54f70 msgr2=0x564318ea9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:42.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.257+0000 7fe915746640 1 --2- 172.21.15.133:0/3209468499 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564318e54f70 0x564318ea9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.257+0000 7fe915746640 1 -- 172.21.15.133:0/3209468499 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564318c68200 con 0x564318e5d2f0 2023-12-19T19:00:42.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.257+0000 7fe915746640 1 --2- 172.21.15.133:0/3209468499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e5d2f0 0x564318ea4740 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe90c00a430 tx=0x7fe90c01e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af0675de6631ae8a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:42.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe8f37fe640 1 -- 172.21.15.133:0/3209468499 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c054850 con 0x564318e5d2f0 2023-12-19T19:00:42.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe8f37fe640 1 -- 172.21.15.133:0/3209468499 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe90c0549d0 con 0x564318e5d2f0 2023-12-19T19:00:42.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe8f37fe640 1 -- 172.21.15.133:0/3209468499 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90c053d20 con 0x564318e5d2f0 2023-12-19T19:00:42.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe91ad16000 1 -- 172.21.15.133:0/3209468499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e5d2f0 msgr2=0x564318ea4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:42.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe91ad16000 1 --2- 172.21.15.133:0/3209468499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e5d2f0 0x564318ea4740 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe90c00a430 tx=0x7fe90c01e040 comp rx=0 tx=0).stop 2023-12-19T19:00:42.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe91ad16000 1 -- 172.21.15.133:0/3209468499 shutdown_connections 2023-12-19T19:00:42.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe91ad16000 1 --2- 172.21.15.133:0/3209468499 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564318e54f70 0x564318ea9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe91ad16000 1 --2- 172.21.15.133:0/3209468499 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564318e54650 0x564318ea9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe91ad16000 1 --2- 172.21.15.133:0/3209468499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e5d2f0 0x564318ea4740 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe91ad16000 1 -- 172.21.15.133:0/3209468499 >> 172.21.15.133:0/3209468499 conn(0x564318e53e50 msgr2=0x564318eab770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:42.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe91ad16000 1 -- 172.21.15.133:0/3209468499 shutdown_connections 2023-12-19T19:00:42.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe91ad16000 1 -- 172.21.15.133:0/3209468499 wait complete. 2023-12-19T19:00:42.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe91ad16000 1 -- start start 2023-12-19T19:00:42.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe91ad16000 1 Processor -- start 2023-12-19T19:00:42.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe91ad16000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564318e54650 0x564318ef8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe91ad16000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564318e54f70 0x564318ef90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe91ad16000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e5d2f0 0x564318ebc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe91ad16000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564318ce9250 con 0x564318e5d2f0 2023-12-19T19:00:42.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe91ad16000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x564318cabbf0 con 0x564318e54f70 2023-12-19T19:00:42.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe91ad16000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x564318ca3560 con 0x564318e54650 2023-12-19T19:00:42.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe91ad16000 10 client.0 _ll_register_callbacks cb 0x564318e22f60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T19:00:42.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe915f47640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e5d2f0 0x564318ebc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe915f47640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e5d2f0 0x564318ebc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59260/0 (socket says 172.21.15.133:59260) 2023-12-19T19:00:42.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe915f47640 1 -- 172.21.15.133:0/4283990899 learned_addr learned my addr 172.21.15.133:0/4283990899 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:42.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe914f45640 1 --2- 172.21.15.133:0/4283990899 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564318e54f70 0x564318ef90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe915746640 1 --2- 172.21.15.133:0/4283990899 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564318e54650 0x564318ef8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe915f47640 1 -- 172.21.15.133:0/4283990899 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564318e54650 msgr2=0x564318ef8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:42.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe915f47640 1 --2- 172.21.15.133:0/4283990899 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564318e54650 0x564318ef8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe915f47640 1 -- 172.21.15.133:0/4283990899 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564318e54f70 msgr2=0x564318ef90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:42.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe915f47640 1 --2- 172.21.15.133:0/4283990899 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564318e54f70 0x564318ef90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe915f47640 1 -- 172.21.15.133:0/4283990899 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9100a8270 con 0x564318e5d2f0 2023-12-19T19:00:42.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe915f47640 1 --2- 172.21.15.133:0/4283990899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e5d2f0 0x564318ebc9b0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe908007130 tx=0x7fe90801b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f11749ea9b9d6f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:42.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe8ebfff640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-19T19:00:42.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe8ebfff640 1 -- 172.21.15.133:0/4283990899 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9080a5920 con 0x564318e5d2f0 2023-12-19T19:00:42.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe8ebfff640 1 -- 172.21.15.133:0/4283990899 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe908003e10 con 0x564318e5d2f0 2023-12-19T19:00:42.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.261+0000 7fe91ad16000 1 -- 172.21.15.133:0/4283990899 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564318c2ea50 con 0x564318e5d2f0 2023-12-19T19:00:42.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe8ebfff640 1 -- 172.21.15.133:0/4283990899 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe9080a5a80 con 0x564318e5d2f0 2023-12-19T19:00:42.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe91ad16000 10 client.5937 fetch_fsmap learned FSMap version 32 2023-12-19T19:00:42.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe91ad16000 1 -- 172.21.15.133:0/4283990899 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x564318c4e500 con 0x564318e5d2f0 2023-12-19T19:00:42.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe8ebfff640 1 -- 172.21.15.133:0/4283990899 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564318c2ea50 con 0x564318e5d2f0 2023-12-19T19:00:42.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe8ebfff640 1 -- 172.21.15.133:0/4283990899 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fe9080a5be0 con 0x564318e5d2f0 2023-12-19T19:00:42.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe91ad16000 10 client.5937 fetch_fsmap finished waiting for FSMap version 32 2023-12-19T19:00:42.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe91ad16000 10 client.5937 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T19:00:42.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe91ad16000 20 client.5937 populate_metadata read hostname 'smithi133' 2023-12-19T19:00:42.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe91ad16000 1 --2- 172.21.15.133:0/4283990899 >> [v2:172.21.15.133:6834/1203400706,v1:172.21.15.133:6835/1203400706] conn(0x564318e55890 0x564318f01be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe91ad16000 4 client.5937 mds_command: new command op to 5763 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-19T19:00:42.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe91ad16000 1 -- 172.21.15.133:0/4283990899 --> [v2:172.21.15.133:6834/1203400706,v1:172.21.15.133:6835/1203400706] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564318cd5f30 con 0x564318e55890 2023-12-19T19:00:42.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe915746640 1 --2- 172.21.15.133:0/4283990899 >> [v2:172.21.15.133:6834/1203400706,v1:172.21.15.133:6835/1203400706] conn(0x564318e55890 0x564318f01be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe915746640 1 --2- 172.21.15.133:0/4283990899 >> [v2:172.21.15.133:6834/1203400706,v1:172.21.15.133:6835/1203400706] conn(0x564318e55890 0x564318f01be0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d10c3309abbf5a3 server_cookie=af78f57c9e986cab in_seq=0 out_seq=0 2023-12-19T19:00:42.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe8ebfff640 10 client.5937 ms_handle_connect on v2:172.21.15.133:6834/1203400706 2023-12-19T19:00:42.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe8ebfff640 1 -- 172.21.15.133:0/4283990899 <== mds.0 v2:172.21.15.133:6834/1203400706 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x564318cd5f30 con 0x564318e55890 2023-12-19T19:00:42.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe8ebfff640 10 client.5937 handle_command_reply: tid=0 2023-12-19T19:00:42.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe91ad16000 1 client.5937 shutdown 2023-12-19T19:00:42.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe91ad16000 1 -- 172.21.15.133:0/4283990899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e5d2f0 msgr2=0x564318ebc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:42.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe91ad16000 1 --2- 172.21.15.133:0/4283990899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e5d2f0 0x564318ebc9b0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe908007130 tx=0x7fe90801b040 comp rx=0 tx=0).stop 2023-12-19T19:00:42.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe91ad16000 1 -- 172.21.15.133:0/4283990899 shutdown_connections 2023-12-19T19:00:42.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe91ad16000 1 --2- 172.21.15.133:0/4283990899 >> [v2:172.21.15.133:6834/1203400706,v1:172.21.15.133:6835/1203400706] conn(0x564318e55890 0x564318f01be0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe91ad16000 1 --2- 172.21.15.133:0/4283990899 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564318e5d2f0 0x564318ebc9b0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe91ad16000 1 --2- 172.21.15.133:0/4283990899 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564318e54f70 0x564318ef90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe91ad16000 1 --2- 172.21.15.133:0/4283990899 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564318e54650 0x564318ef8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe8ebfff640 0 client.5937 ms_handle_reset on v2:172.21.15.133:6834/1203400706 2023-12-19T19:00:42.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe91ad16000 1 -- 172.21.15.133:0/4283990899 >> 172.21.15.133:0/4283990899 conn(0x564318e53e50 msgr2=0x564318ea3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:42.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe91ad16000 1 -- 172.21.15.133:0/4283990899 shutdown_connections 2023-12-19T19:00:42.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe91ad16000 1 -- 172.21.15.133:0/4283990899 wait complete. 2023-12-19T19:00:42.273 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe91ad16000 20 client.5937 trim_cache size 0 max 16384 2023-12-19T19:00:42.273 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-19T19:00:42.273 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "03e63958-005e-4bf2-ae5b-291aceb6fbbf", 2023-12-19T19:00:42.273 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2023-12-19T19:00:42.273 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 5763, 2023-12-19T19:00:42.273 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-19T19:00:42.273 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-19T19:00:42.274 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-19T19:00:42.274 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 10.301960000999999, 2023-12-19T19:00:42.274 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 32, 2023-12-19T19:00:42.274 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 50, 2023-12-19T19:00:42.274 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 50, 2023-12-19T19:00:42.274 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 23.051734427 2023-12-19T19:00:42.274 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-19T19:00:42.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe9179aa640 1 -- 172.21.15.133:0/4211763868 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe8f4066470 msgr2=0x7fe8f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:42.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe9179aa640 1 --2- 172.21.15.133:0/4211763868 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe8f4066470 0x7fe8f4068930 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fe9100a8cb0 tx=0x7fe900009040 comp rx=0 tx=0).stop 2023-12-19T19:00:42.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe9179aa640 1 -- 172.21.15.133:0/4211763868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9100c5260 msgr2=0x7fe910071560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:42.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe9179aa640 1 --2- 172.21.15.133:0/4211763868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9100c5260 0x7fe910071560 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fe90c00c730 tx=0x7fe90c00cbf0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe9179aa640 1 -- 172.21.15.133:0/4211763868 shutdown_connections 2023-12-19T19:00:42.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe9179aa640 1 --2- 172.21.15.133:0/4211763868 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe8f4066470 0x7fe8f4068930 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe9179aa640 1 --2- 172.21.15.133:0/4211763868 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe910155de0 0x7fe9101491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe9179aa640 1 --2- 172.21.15.133:0/4211763868 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe9100c5640 0x7fe910148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe9179aa640 1 --2- 172.21.15.133:0/4211763868 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9100c5260 0x7fe910071560 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe9179aa640 1 -- 172.21.15.133:0/4211763868 >> 172.21.15.133:0/4211763868 conn(0x7fe91006a5b0 msgr2=0x7fe91014d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:42.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe9179aa640 1 -- 172.21.15.133:0/4211763868 shutdown_connections 2023-12-19T19:00:42.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.265+0000 7fe9179aa640 1 -- 172.21.15.133:0/4211763868 wait complete. 2023-12-19T19:00:42.288 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T19:00:42.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.421+0000 7f8f19f2a640 1 Processor -- start 2023-12-19T19:00:42.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.421+0000 7f8f19f2a640 1 -- start start 2023-12-19T19:00:42.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.425+0000 7f8f19f2a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8f140c63c0 0x7f8f140c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.425+0000 7f8f19f2a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8f140c4100 0x7f8f140c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.425+0000 7f8f19f2a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f140c31c0 con 0x7f8f140c29e0 2023-12-19T19:00:42.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.425+0000 7f8f19f2a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f140c34a0 con 0x7f8f140c63c0 2023-12-19T19:00:42.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.425+0000 7f8f19f2a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f140c1030 con 0x7f8f140c4100 2023-12-19T19:00:42.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.425+0000 7f8f137fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8f140c63c0 0x7f8f140c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.425+0000 7f8f13fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8f140c29e0 0x7f8f140a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46762/0 (socket says 172.21.15.133:46762) 2023-12-19T19:00:42.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.425+0000 7f8f13fff640 1 -- 172.21.15.133:0/4112180244 learned_addr learned my addr 172.21.15.133:0/4112180244 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:42.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.425+0000 7f8f12ffd640 1 --2- 172.21.15.133:0/4112180244 >> v2:172.21.15.138:3300/0 conn(0x7f8f140c4100 0x7f8f140c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.425+0000 7f8f137fe640 1 -- 172.21.15.133:0/4112180244 >> v2:172.21.15.138:3300/0 conn(0x7f8f140c4100 msgr2=0x7f8f140c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:42.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.425+0000 7f8f137fe640 1 --2- 172.21.15.133:0/4112180244 >> v2:172.21.15.138:3300/0 conn(0x7f8f140c4100 0x7f8f140c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.425+0000 7f8f137fe640 1 -- 172.21.15.133:0/4112180244 >> v1:172.21.15.133:6789/0 conn(0x7f8f140c29e0 legacy=0x7f8f140a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:42.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.425+0000 7f8f137fe640 1 -- 172.21.15.133:0/4112180244 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f140c1310 con 0x7f8f140c63c0 2023-12-19T19:00:42.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.429+0000 7f8f137fe640 1 --2- 172.21.15.133:0/4112180244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140c63c0 0x7f8f140c06d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8f140a8b40 tx=0x7f8f0401c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5163c71595ea650 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:42.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.429+0000 7f8f127fc640 1 -- 172.21.15.133:0/4112180244 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f040ab600 con 0x7f8f140c63c0 2023-12-19T19:00:42.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.429+0000 7f8f127fc640 1 -- 172.21.15.133:0/4112180244 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f040a7050 con 0x7f8f140c63c0 2023-12-19T19:00:42.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.429+0000 7f8f127fc640 1 -- 172.21.15.133:0/4112180244 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f040ab980 con 0x7f8f140c63c0 2023-12-19T19:00:42.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.429+0000 7f8f19f2a640 1 -- 172.21.15.133:0/4112180244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140c63c0 msgr2=0x7f8f140c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:42.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.429+0000 7f8f19f2a640 1 --2- 172.21.15.133:0/4112180244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140c63c0 0x7f8f140c06d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f8f140a8b40 tx=0x7f8f0401c310 comp rx=0 tx=0).stop 2023-12-19T19:00:42.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.429+0000 7f8f19f2a640 1 -- 172.21.15.133:0/4112180244 shutdown_connections 2023-12-19T19:00:42.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.429+0000 7f8f19f2a640 1 --2- 172.21.15.133:0/4112180244 >> v2:172.21.15.138:3300/0 conn(0x7f8f140c4100 0x7f8f140c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.429+0000 7f8f19f2a640 1 --2- 172.21.15.133:0/4112180244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140c63c0 0x7f8f140c06d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.429+0000 7f8f19f2a640 1 -- 172.21.15.133:0/4112180244 >> 172.21.15.133:0/4112180244 conn(0x7f8f1406a5b0 msgr2=0x7f8f1406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:42.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.429+0000 7f8f19f2a640 1 -- 172.21.15.133:0/4112180244 shutdown_connections 2023-12-19T19:00:42.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.429+0000 7f8f19f2a640 1 -- 172.21.15.133:0/4112180244 wait complete. 2023-12-19T19:00:42.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.429+0000 7f8f19f2a640 1 Processor -- start 2023-12-19T19:00:42.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.429+0000 7f8f19f2a640 1 -- start start 2023-12-19T19:00:42.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8f19f2a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140c29e0 0x7f8f1415a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8f19f2a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f140c4100 0x7f8f1414de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8f19f2a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f140c63c0 0x7f8f1414e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8f19f2a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f140a7800 con 0x7f8f140c29e0 2023-12-19T19:00:42.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8f19f2a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f141f0be0 con 0x7f8f140c63c0 2023-12-19T19:00:42.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8f19f2a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f141f1110 con 0x7f8f140c4100 2023-12-19T19:00:42.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8f137fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140c29e0 0x7f8f1415a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8f137fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140c29e0 0x7f8f1415a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59272/0 (socket says 172.21.15.133:59272) 2023-12-19T19:00:42.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8f137fe640 1 -- 172.21.15.133:0/3989145276 learned_addr learned my addr 172.21.15.133:0/3989145276 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:42.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8f12ffd640 1 --2- 172.21.15.133:0/3989145276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f140c4100 0x7f8f1414de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8f13fff640 1 --2- 172.21.15.133:0/3989145276 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f140c63c0 0x7f8f1414e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8f137fe640 1 -- 172.21.15.133:0/3989145276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f140c4100 msgr2=0x7f8f1414de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:42.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8f137fe640 1 --2- 172.21.15.133:0/3989145276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f140c4100 0x7f8f1414de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8f137fe640 1 -- 172.21.15.133:0/3989145276 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f140c63c0 msgr2=0x7f8f1414e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:42.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8f137fe640 1 --2- 172.21.15.133:0/3989145276 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f140c63c0 0x7f8f1414e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8f137fe640 1 -- 172.21.15.133:0/3989145276 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f04009420 con 0x7f8f140c29e0 2023-12-19T19:00:42.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8f13fff640 1 --2- 172.21.15.133:0/3989145276 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f140c63c0 0x7f8f1414e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:42.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8f137fe640 1 --2- 172.21.15.133:0/3989145276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140c29e0 0x7f8f1415a420 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8f040ae040 tx=0x7f8f040190b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:42.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8efbfff640 1 -- 172.21.15.133:0/3989145276 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f040b4430 con 0x7f8f140c29e0 2023-12-19T19:00:42.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8efbfff640 1 -- 172.21.15.133:0/3989145276 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f040b45b0 con 0x7f8f140c29e0 2023-12-19T19:00:42.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8f19f2a640 1 -- 172.21.15.133:0/3989145276 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f140a7370 con 0x7f8f140c29e0 2023-12-19T19:00:42.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8efbfff640 1 -- 172.21.15.133:0/3989145276 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f040b4960 con 0x7f8f140c29e0 2023-12-19T19:00:42.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8f19f2a640 1 -- 172.21.15.133:0/3989145276 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f1414e910 con 0x7f8f140c29e0 2023-12-19T19:00:42.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8f19f2a640 1 -- 172.21.15.133:0/3989145276 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f14068400 con 0x7f8f140c29e0 2023-12-19T19:00:42.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.433+0000 7f8efbfff640 1 -- 172.21.15.133:0/3989145276 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8f040b2040 con 0x7f8f140c29e0 2023-12-19T19:00:42.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.437+0000 7f8efbfff640 1 --2- 172.21.15.133:0/3989145276 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8f00066470 0x7f8f00068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:42.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.437+0000 7f8efbfff640 1 -- 172.21.15.133:0/3989145276 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f0411dab0 con 0x7f8f140c29e0 2023-12-19T19:00:42.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.437+0000 7f8f12ffd640 1 --2- 172.21.15.133:0/3989145276 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8f00066470 0x7f8f00068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:42.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.437+0000 7f8f12ffd640 1 --2- 172.21.15.133:0/3989145276 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8f00066470 0x7f8f00068930 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8f1415ace0 tx=0x7f8f08009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:42.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.441+0000 7f8efbfff640 1 -- 172.21.15.133:0/3989145276 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8f040eaf20 con 0x7f8f140c29e0 2023-12-19T19:00:42.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.617+0000 7f8f19f2a640 1 -- 172.21.15.133:0/3989145276 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8f140c3e70 con 0x7f8f140c29e0 2023-12-19T19:00:42.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.621+0000 7f8efbfff640 1 -- 172.21.15.133:0/3989145276 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8f040ee540 con 0x7f8f140c29e0 2023-12-19T19:00:42.623 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T19:00:42.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.621+0000 7f8f19f2a640 1 -- 172.21.15.133:0/3989145276 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8f00066470 msgr2=0x7f8f00068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:42.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.621+0000 7f8f19f2a640 1 --2- 172.21.15.133:0/3989145276 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8f00066470 0x7f8f00068930 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8f1415ace0 tx=0x7f8f08009190 comp rx=0 tx=0).stop 2023-12-19T19:00:42.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.621+0000 7f8f19f2a640 1 -- 172.21.15.133:0/3989145276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140c29e0 msgr2=0x7f8f1415a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:42.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.621+0000 7f8f19f2a640 1 --2- 172.21.15.133:0/3989145276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140c29e0 0x7f8f1415a420 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f8f040ae040 tx=0x7f8f040190b0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.621+0000 7f8f19f2a640 1 -- 172.21.15.133:0/3989145276 shutdown_connections 2023-12-19T19:00:42.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.621+0000 7f8f19f2a640 1 --2- 172.21.15.133:0/3989145276 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8f00066470 0x7f8f00068930 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.621+0000 7f8f19f2a640 1 --2- 172.21.15.133:0/3989145276 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8f140c63c0 0x7f8f1414e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.621+0000 7f8f19f2a640 1 --2- 172.21.15.133:0/3989145276 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8f140c4100 0x7f8f1414de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.621+0000 7f8f19f2a640 1 --2- 172.21.15.133:0/3989145276 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8f140c29e0 0x7f8f1415a420 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:42.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.621+0000 7f8f19f2a640 1 -- 172.21.15.133:0/3989145276 >> 172.21.15.133:0/3989145276 conn(0x7f8f1406a5b0 msgr2=0x7f8f14066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:42.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.621+0000 7f8f19f2a640 1 -- 172.21.15.133:0/3989145276 shutdown_connections 2023-12-19T19:00:42.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:42.621+0000 7f8f19f2a640 1 -- 172.21.15.133:0/3989145276 wait complete. 2023-12-19T19:00:42.645 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T19:00:42.645 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T19:00:42.645 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-19T19:00:42.645 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T19:00:42.645 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T19:00:42.645 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T19:00:42.645 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T19:00:42.645 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T19:00:42.645 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T19:00:42.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:42.646 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-19T19:00:42.656 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T19:00:42.656 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T19:00:42.656 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T19:00:42.656 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:00:42.656 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-19T19:00:42.656 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:00:42.656 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:00:42.656 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:00:42.656 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-19T19:00:42.656 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:00:42.656 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:00:42.656 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-19T19:00:42.656 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:00:42.657 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:00:42.657 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T19:00:42.657 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:00:42.657 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T19:00:42.657 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42318sec preferred_lft 42318sec 2023-12-19T19:00:42.657 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-12-19T19:00:42.657 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:00:42.657 INFO:teuthology.orchestra.run.smithi133.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T19:00:42.657 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 02:42:26:2c:b4:18 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:00:42.657 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T19:00:42.657 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:00:42.657 INFO:teuthology.orchestra.run.smithi133.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T19:00:42.657 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T19:00:42.657 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T19:00:42.658 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:00:42.658 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-19T19:00:42.658 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:00:42.658 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T19:00:42.658 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T19:00:42.658 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-19T19:00:42.658 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:00:42.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:42.658 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T19:00:42.722 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-19T19:00:42.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:42.724 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-19T19:00:42.778 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-19T19:00:42.778 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T19:00:42.778 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T19:00:42.778 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T19:00:42.778 INFO:teuthology.orchestra.run.smithi133.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T19:00:42.778 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T19:00:42.778 INFO:teuthology.orchestra.run.smithi133.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:00:42.778 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:00:42.778 INFO:teuthology.orchestra.run.smithi133.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:00:42.778 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T19:00:42.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:42.779 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-19T19:00:42.779 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-19T19:00:42.779 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T19:00:42.779 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T19:00:42.779 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T19:00:42.779 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-19T19:00:42.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:42.875 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-19T19:00:42.883 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T19:00:42.884 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T19:00:42.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:42.885 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-19T19:00:42.948 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T19:00:42.948 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T19:00:42.999 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T19:00:42.999 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T19:00:43.051 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T19:00:43.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:43.051 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:00:43.144 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:00:43.144 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T19:00:43.157 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:00:43.157 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T19:00:43.157 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-12-19T19:00:43.157 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 0@03e63958-005e-4bf2-ae5b-291aceb6fbbf.cephfs=/ 2023-12-19T19:00:43.157 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.133:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-12-19T19:00:43.161 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T19:00:43.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:43.161 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T19:00:43.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:43.183 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T19:00:43.243 INFO:teuthology.orchestra.run.smithi133.stdout:client5725 2023-12-19T19:00:43.243 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T19:00:43.244 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:00:43.295 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T19:00:43.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.473+0000 7f09839e6640 1 Processor -- start 2023-12-19T19:00:43.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.473+0000 7f09839e6640 1 -- start start 2023-12-19T19:00:43.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.473+0000 7f09839e6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f097c0c60a0 0x7f097c156900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:43.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.473+0000 7f09839e6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097c0c3bd0 con 0x7f097c0c5c60 2023-12-19T19:00:43.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.473+0000 7f09839e6640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097c0bf1e0 con 0x7f097c0a5240 2023-12-19T19:00:43.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.473+0000 7f09839e6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097c0c6530 con 0x7f097c0c60a0 2023-12-19T19:00:43.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.473+0000 7f0980f81640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f097c0c5c60 0x7f097c1561f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:46764/0 (socket says 172.21.15.133:46764) 2023-12-19T19:00:43.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.473+0000 7f0980f81640 1 -- 172.21.15.133:0/3232214951 learned_addr learned my addr 172.21.15.133:0/3232214951 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:43.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.473+0000 7f0981f83640 1 --2- 172.21.15.133:0/3232214951 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f097c0c60a0 0x7f097c156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:43.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.473+0000 7f0973fff640 1 -- 172.21.15.133:0/3232214951 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298497185 0 0) 0x7f097c0c3bd0 con 0x7f097c0c5c60 2023-12-19T19:00:43.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.473+0000 7f0973fff640 1 -- 172.21.15.133:0/3232214951 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0968003530 con 0x7f097c0c5c60 2023-12-19T19:00:43.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.477+0000 7f0973fff640 1 -- 172.21.15.133:0/3232214951 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2427834997 0 0) 0x7f0968003530 con 0x7f097c0c5c60 2023-12-19T19:00:43.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.477+0000 7f0973fff640 1 -- 172.21.15.133:0/3232214951 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f097c0c60a0 msgr2=0x7f097c156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:43.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.477+0000 7f0973fff640 1 --2- 172.21.15.133:0/3232214951 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f097c0c60a0 0x7f097c156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:43.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.477+0000 7f0973fff640 1 -- 172.21.15.133:0/3232214951 >> v1:172.21.15.138:6789/0 conn(0x7f097c0a5240 legacy=0x7f097c0bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:43.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.477+0000 7f0973fff640 1 -- 172.21.15.133:0/3232214951 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c0c3e20 con 0x7f097c0c5c60 2023-12-19T19:00:43.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.477+0000 7f0973fff640 1 -- 172.21.15.133:0/3232214951 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f096c001680 con 0x7f097c0c5c60 2023-12-19T19:00:43.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.477+0000 7f0973fff640 1 -- 172.21.15.133:0/3232214951 >> v1:172.21.15.133:6789/0 conn(0x7f097c0c5c60 legacy=0x7f097c1561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:43.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.477+0000 7f0973fff640 1 --2- 172.21.15.133:0/3232214951 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09680039b0 0x7f0968003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:43.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.477+0000 7f0973fff640 1 --2- 172.21.15.133:0/3232214951 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0968004310 0x7f09680047f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:43.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.477+0000 7f0973fff640 1 --2- 172.21.15.133:0/3232214951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0968005090 0x7f096800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:43.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.477+0000 7f0973fff640 1 -- 172.21.15.133:0/3232214951 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c0c6530 con 0x7f0968005090 2023-12-19T19:00:43.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.477+0000 7f0973fff640 1 -- 172.21.15.133:0/3232214951 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f096800bfb0 con 0x7f0968004310 2023-12-19T19:00:43.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.477+0000 7f0973fff640 1 -- 172.21.15.133:0/3232214951 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f096800c170 con 0x7f09680039b0 2023-12-19T19:00:43.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.477+0000 7f0981f83640 1 --2- 172.21.15.133:0/3232214951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0968005090 0x7f096800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:43.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.477+0000 7f0980f81640 1 --2- 172.21.15.133:0/3232214951 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0968004310 0x7f09680047f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:43.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.477+0000 7f0981782640 1 --2- 172.21.15.133:0/3232214951 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09680039b0 0x7f0968003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:43.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.477+0000 7f0981f83640 1 -- 172.21.15.133:0/3232214951 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09680039b0 msgr2=0x7f0968003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:43.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.477+0000 7f0981f83640 1 --2- 172.21.15.133:0/3232214951 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09680039b0 0x7f0968003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:43.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.477+0000 7f0981f83640 1 -- 172.21.15.133:0/3232214951 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0968004310 msgr2=0x7f09680047f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:43.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.477+0000 7f0981f83640 1 --2- 172.21.15.133:0/3232214951 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0968004310 0x7f09680047f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:43.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.477+0000 7f0981f83640 1 -- 172.21.15.133:0/3232214951 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0968003530 con 0x7f0968005090 2023-12-19T19:00:43.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.477+0000 7f0981f83640 1 --2- 172.21.15.133:0/3232214951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0968005090 0x7f096800b990 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f097c0c6480 tx=0x7f097401cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead49c512d76656d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:43.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f0973fff640 1 -- 172.21.15.133:0/3232214951 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09740a5bd0 con 0x7f0968005090 2023-12-19T19:00:43.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f0973fff640 1 -- 172.21.15.133:0/3232214951 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097400f040 con 0x7f0968005090 2023-12-19T19:00:43.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f0973fff640 1 -- 172.21.15.133:0/3232214951 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09740ad440 con 0x7f0968005090 2023-12-19T19:00:43.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f09839e6640 1 -- 172.21.15.133:0/3232214951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0968005090 msgr2=0x7f096800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:43.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f09839e6640 1 --2- 172.21.15.133:0/3232214951 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0968005090 0x7f096800b990 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f097c0c6480 tx=0x7f097401cba0 comp rx=0 tx=0).stop 2023-12-19T19:00:43.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f0981f83640 1 -- 172.21.15.133:0/3232214951 reap_dead start 2023-12-19T19:00:43.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f09839e6640 1 -- 172.21.15.133:0/3232214951 shutdown_connections 2023-12-19T19:00:43.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f09839e6640 1 -- 172.21.15.133:0/3232214951 >> 172.21.15.133:0/3232214951 conn(0x7f097c06a5b0 msgr2=0x7f097c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:43.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f09839e6640 1 -- 172.21.15.133:0/3232214951 shutdown_connections 2023-12-19T19:00:43.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f09839e6640 1 -- 172.21.15.133:0/3232214951 wait complete. 2023-12-19T19:00:43.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f09839e6640 1 Processor -- start 2023-12-19T19:00:43.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f09839e6640 1 -- start start 2023-12-19T19:00:43.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f09839e6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0968005090 0x7f097c1eb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:43.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f09839e6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f097c14d6d0 0x7f097c14fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:43.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f09839e6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f097c1e7000 0x7f097c1e7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:43.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f09839e6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c14f740 con 0x7f097c1e7000 2023-12-19T19:00:43.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f09839e6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f097c0c0b60 con 0x7f097c14d6d0 2023-12-19T19:00:43.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f09839e6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097c14f410 con 0x7f0968005090 2023-12-19T19:00:43.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f0981f83640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f097c1e7000 0x7f097c1e7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:43.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f0981f83640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f097c1e7000 0x7f097c1e7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:59294/0 (socket says 172.21.15.133:59294) 2023-12-19T19:00:43.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f0981f83640 1 -- 172.21.15.133:0/1520071783 learned_addr learned my addr 172.21.15.133:0/1520071783 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:43.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f0981782640 1 --2- 172.21.15.133:0/1520071783 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0968005090 0x7f097c1eb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:43.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f0980f81640 1 --2- 172.21.15.133:0/1520071783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f097c14d6d0 0x7f097c14fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:43.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f0981f83640 1 -- 172.21.15.133:0/1520071783 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0968005090 msgr2=0x7f097c1eb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:43.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f0981f83640 1 --2- 172.21.15.133:0/1520071783 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0968005090 0x7f097c1eb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:43.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f0981f83640 1 -- 172.21.15.133:0/1520071783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f097c14d6d0 msgr2=0x7f097c14fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:43.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f0981f83640 1 --2- 172.21.15.133:0/1520071783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f097c14d6d0 0x7f097c14fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:43.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.481+0000 7f0981f83640 1 -- 172.21.15.133:0/1520071783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c150b00 con 0x7f097c1e7000 2023-12-19T19:00:43.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.485+0000 7f0981f83640 1 --2- 172.21.15.133:0/1520071783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f097c1e7000 0x7f097c1e7480 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f09740b0040 tx=0x7f0974009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:43.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.485+0000 7f0971ffb640 1 -- 172.21.15.133:0/1520071783 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09740bc070 con 0x7f097c1e7000 2023-12-19T19:00:43.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.485+0000 7f0971ffb640 1 -- 172.21.15.133:0/1520071783 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09740039a0 con 0x7f097c1e7000 2023-12-19T19:00:43.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.485+0000 7f09839e6640 1 -- 172.21.15.133:0/1520071783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f097c0c0e00 con 0x7f097c1e7000 2023-12-19T19:00:43.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.485+0000 7f0971ffb640 1 -- 172.21.15.133:0/1520071783 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0974003d70 con 0x7f097c1e7000 2023-12-19T19:00:43.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.485+0000 7f09839e6640 1 -- 172.21.15.133:0/1520071783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f097c150110 con 0x7f097c1e7000 2023-12-19T19:00:43.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.485+0000 7f09839e6640 1 -- 172.21.15.133:0/1520071783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097c14f8f0 con 0x7f097c1e7000 2023-12-19T19:00:43.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.485+0000 7f0971ffb640 1 -- 172.21.15.133:0/1520071783 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f09740b4040 con 0x7f097c1e7000 2023-12-19T19:00:43.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.485+0000 7f0971ffb640 1 --2- 172.21.15.133:0/1520071783 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f09600664a0 0x7f0960068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:43.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.485+0000 7f0971ffb640 1 -- 172.21.15.133:0/1520071783 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f097411e2a0 con 0x7f097c1e7000 2023-12-19T19:00:43.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.489+0000 7f0981782640 1 --2- 172.21.15.133:0/1520071783 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f09600664a0 0x7f0960068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:43.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.489+0000 7f0981782640 1 --2- 172.21.15.133:0/1520071783 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f09600664a0 0x7f0960068960 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0978001210 tx=0x7f09780011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:43.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.493+0000 7f0971ffb640 1 -- 172.21.15.133:0/1520071783 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f097c14f8f0 con 0x7f097c1e7000 2023-12-19T19:00:43.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.673+0000 7f09839e6640 1 -- 172.21.15.133:0/1520071783 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f097c068400 con 0x7f097c1e7000 2023-12-19T19:00:43.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.673+0000 7f0971ffb640 1 -- 172.21.15.133:0/1520071783 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f09740b2060 con 0x7f097c1e7000 2023-12-19T19:00:43.679 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T19:00:43.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.677+0000 7f09839e6640 1 -- 172.21.15.133:0/1520071783 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f09600664a0 msgr2=0x7f0960068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:43.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.677+0000 7f09839e6640 1 --2- 172.21.15.133:0/1520071783 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f09600664a0 0x7f0960068960 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0978001210 tx=0x7f09780011a0 comp rx=0 tx=0).stop 2023-12-19T19:00:43.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.677+0000 7f09839e6640 1 -- 172.21.15.133:0/1520071783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f097c1e7000 msgr2=0x7f097c1e7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:43.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.677+0000 7f09839e6640 1 --2- 172.21.15.133:0/1520071783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f097c1e7000 0x7f097c1e7480 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f09740b0040 tx=0x7f0974009750 comp rx=0 tx=0).stop 2023-12-19T19:00:43.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.677+0000 7f09839e6640 1 -- 172.21.15.133:0/1520071783 shutdown_connections 2023-12-19T19:00:43.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.677+0000 7f09839e6640 1 --2- 172.21.15.133:0/1520071783 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f09600664a0 0x7f0960068960 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:43.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.677+0000 7f09839e6640 1 --2- 172.21.15.133:0/1520071783 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f097c1e7000 0x7f097c1e7480 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:43.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.677+0000 7f09839e6640 1 --2- 172.21.15.133:0/1520071783 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f097c14d6d0 0x7f097c14fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:43.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.677+0000 7f09839e6640 1 --2- 172.21.15.133:0/1520071783 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0968005090 0x7f097c1eb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:43.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.677+0000 7f09839e6640 1 -- 172.21.15.133:0/1520071783 >> 172.21.15.133:0/1520071783 conn(0x7f097c06a5b0 msgr2=0x7f097c06ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:43.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.677+0000 7f09839e6640 1 -- 172.21.15.133:0/1520071783 shutdown_connections 2023-12-19T19:00:43.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:43.677+0000 7f09839e6640 1 -- 172.21.15.133:0/1520071783 wait complete. 2023-12-19T19:00:43.699 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T19:00:43.699 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T19:00:43.700 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi138.front.sepia.ceph.com 2023-12-19T19:00:43.700 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T19:00:43.700 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T19:00:43.700 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T19:00:43.700 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T19:00:43.700 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T19:00:43.700 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T19:00:43.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:43.700 DEBUG:teuthology.orchestra.run.smithi138:> ip addr 2023-12-19T19:00:43.711 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T19:00:43.711 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T19:00:43.711 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T19:00:43.711 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:00:43.711 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2023-12-19T19:00:43.711 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:00:43.711 INFO:teuthology.orchestra.run.smithi138.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:00:43.711 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7a brd ff:ff:ff:ff:ff:ff 2023-12-19T19:00:43.711 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f0 2023-12-19T19:00:43.711 INFO:teuthology.orchestra.run.smithi138.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:00:43.711 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7b brd ff:ff:ff:ff:ff:ff 2023-12-19T19:00:43.711 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f1 2023-12-19T19:00:43.711 INFO:teuthology.orchestra.run.smithi138.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:00:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:70 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:00:43.712 INFO:teuthology.orchestra.run.smithi138.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T19:00:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:71 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:00:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.21.15.138/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T19:00:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft 42310sec preferred_lft 42310sec 2023-12-19T19:00:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::ec4:7aff:fe88:6f71/64 scope link 2023-12-19T19:00:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:00:43.712 INFO:teuthology.orchestra.run.smithi138.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T19:00:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 02:42:5b:f5:51:87 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:00:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T19:00:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:00:43.712 INFO:teuthology.orchestra.run.smithi138.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T19:00:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T19:00:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T19:00:43.713 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:00:43.713 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-19T19:00:43.713 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:00:43.713 INFO:teuthology.orchestra.run.smithi138.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T19:00:43.713 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T19:00:43.713 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-19T19:00:43.713 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:00:43.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:43.714 DEBUG:teuthology.orchestra.run.smithi138:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T19:00:43.780 INFO:teuthology.orchestra.run.smithi138.stdout:1 2023-12-19T19:00:43.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:43.782 DEBUG:teuthology.orchestra.run.smithi138:> route 2023-12-19T19:00:43.839 INFO:teuthology.orchestra.run.smithi138.stdout:Kernel IP routing table 2023-12-19T19:00:43.839 INFO:teuthology.orchestra.run.smithi138.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T19:00:43.839 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T19:00:43.839 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T19:00:43.839 INFO:teuthology.orchestra.run.smithi138.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T19:00:43.839 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T19:00:43.839 INFO:teuthology.orchestra.run.smithi138.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:00:43.839 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:00:43.839 INFO:teuthology.orchestra.run.smithi138.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:00:43.839 INFO:teuthology.orchestra.run.smithi138.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T19:00:43.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:43.840 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-12-19T19:00:43.840 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-12-19T19:00:43.840 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T19:00:43.840 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T19:00:43.840 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T19:00:43.840 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-12-19T19:00:43.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:43.939 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2023-12-19T19:00:43.949 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T19:00:43.949 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T19:00:43.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:43.949 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set brx.0 up 2023-12-19T19:00:44.011 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T19:00:44.012 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T19:00:44.064 INFO:teuthology.orchestra.run.smithi138.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T19:00:44.064 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T19:00:44.064 DEBUG:teuthology.orchestra.run.smithi138:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T19:00:44.115 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T19:00:44.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:44.115 DEBUG:teuthology.orchestra.run.smithi138:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:00:44.210 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:00:44.211 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T19:00:44.224 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:00:44.224 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T19:00:44.224 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-12-19T19:00:44.224 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: trying mount with new device syntax: 1@03e63958-005e-4bf2-ae5b-291aceb6fbbf.cephfs=/ 2023-12-19T19:00:44.224 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.133:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-12-19T19:00:44.228 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T19:00:44.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:44.228 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T19:00:44.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:44.295 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T19:00:44.350 INFO:teuthology.orchestra.run.smithi138.stdout:client5387 2023-12-19T19:00:44.351 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:00:44.351 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:00:44.400 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-12-19T19:00:44.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.541+0000 7eff59580640 1 Processor -- start 2023-12-19T19:00:44.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.541+0000 7eff59580640 1 -- start start 2023-12-19T19:00:44.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.541+0000 7eff59580640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7eff540c5260 0x7eff5406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:44.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.541+0000 7eff59580640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7eff540c5640 0x7eff540c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:44.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.541+0000 7eff59580640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff540c2580 con 0x7eff540c60f0 2023-12-19T19:00:44.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.541+0000 7eff59580640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff54153510 con 0x7eff540c5640 2023-12-19T19:00:44.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.541+0000 7eff59580640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff540c17f0 con 0x7eff540c5260 2023-12-19T19:00:44.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.541+0000 7eff527fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7eff540c5640 0x7eff540c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:44.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.541+0000 7eff527fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7eff540c5640 0x7eff540c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42768/0 (socket says 172.21.15.133:42768) 2023-12-19T19:00:44.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.541+0000 7eff527fc640 1 -- 172.21.15.133:0/3983084198 learned_addr learned my addr 172.21.15.133:0/3983084198 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:44.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.541+0000 7eff52ffd640 1 --2- 172.21.15.133:0/3983084198 >> v2:172.21.15.138:3300/0 conn(0x7eff540c5260 0x7eff5406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:44.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.541+0000 7eff527fc640 1 -- 172.21.15.133:0/3983084198 >> v2:172.21.15.138:3300/0 conn(0x7eff540c5260 msgr2=0x7eff5406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:44.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.541+0000 7eff527fc640 1 --2- 172.21.15.133:0/3983084198 >> v2:172.21.15.138:3300/0 conn(0x7eff540c5260 0x7eff5406d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:44.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.541+0000 7eff527fc640 1 -- 172.21.15.133:0/3983084198 >> v1:172.21.15.138:6789/0 conn(0x7eff540c60f0 legacy=0x7eff54155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:44.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.541+0000 7eff527fc640 1 -- 172.21.15.133:0/3983084198 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff540c1a00 con 0x7eff540c5640 2023-12-19T19:00:44.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.545+0000 7eff527fc640 1 --2- 172.21.15.133:0/3983084198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff540c5640 0x7eff540c5bb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7eff540c6920 tx=0x7eff4801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294dff6c5a40c6e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:44.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.545+0000 7eff51ffb640 1 -- 172.21.15.133:0/3983084198 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48004230 con 0x7eff540c5640 2023-12-19T19:00:44.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.545+0000 7eff51ffb640 1 -- 172.21.15.133:0/3983084198 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff480a7050 con 0x7eff540c5640 2023-12-19T19:00:44.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.545+0000 7eff51ffb640 1 -- 172.21.15.133:0/3983084198 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48003620 con 0x7eff540c5640 2023-12-19T19:00:44.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.545+0000 7eff59580640 1 -- 172.21.15.133:0/3983084198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff540c5640 msgr2=0x7eff540c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:44.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.545+0000 7eff59580640 1 --2- 172.21.15.133:0/3983084198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff540c5640 0x7eff540c5bb0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7eff540c6920 tx=0x7eff4801c440 comp rx=0 tx=0).stop 2023-12-19T19:00:44.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.545+0000 7eff59580640 1 -- 172.21.15.133:0/3983084198 shutdown_connections 2023-12-19T19:00:44.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.545+0000 7eff59580640 1 --2- 172.21.15.133:0/3983084198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff540c5640 0x7eff540c5bb0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:44.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.545+0000 7eff59580640 1 --2- 172.21.15.133:0/3983084198 >> v2:172.21.15.138:3300/0 conn(0x7eff540c5260 0x7eff5406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:44.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.545+0000 7eff59580640 1 -- 172.21.15.133:0/3983084198 >> 172.21.15.133:0/3983084198 conn(0x7eff5406a5b0 msgr2=0x7eff5406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:44.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.545+0000 7eff59580640 1 -- 172.21.15.133:0/3983084198 shutdown_connections 2023-12-19T19:00:44.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.545+0000 7eff59580640 1 -- 172.21.15.133:0/3983084198 wait complete. 2023-12-19T19:00:44.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.545+0000 7eff59580640 1 Processor -- start 2023-12-19T19:00:44.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.545+0000 7eff59580640 1 -- start start 2023-12-19T19:00:44.552 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff59580640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff540c5260 0x7eff5415d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:44.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff59580640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7eff540c5640 0x7eff5414eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:44.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff59580640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff540c60f0 0x7eff5414f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:44.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff59580640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff54157950 con 0x7eff540c60f0 2023-12-19T19:00:44.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff59580640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5414f540 con 0x7eff540c5260 2023-12-19T19:00:44.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff59580640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff540a8950 con 0x7eff540c5640 2023-12-19T19:00:44.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff537fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff540c60f0 0x7eff5414f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:44.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff527fc640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7eff540c5640 0x7eff5414eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:44.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff52ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff540c5260 0x7eff5415d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:44.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff537fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff540c60f0 0x7eff5414f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42778/0 (socket says 172.21.15.133:42778) 2023-12-19T19:00:44.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff527fc640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7eff540c5640 0x7eff5414eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:60222/0 (socket says 172.21.15.133:60222) 2023-12-19T19:00:44.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff537fe640 1 -- 172.21.15.133:0/3109721635 learned_addr learned my addr 172.21.15.133:0/3109721635 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:44.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff537fe640 1 -- 172.21.15.133:0/3109721635 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7eff540c5640 msgr2=0x7eff5414eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:44.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff537fe640 1 --2- 172.21.15.133:0/3109721635 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7eff540c5640 0x7eff5414eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:44.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff537fe640 1 -- 172.21.15.133:0/3109721635 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff540c5260 msgr2=0x7eff5415d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:44.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff537fe640 1 --2- 172.21.15.133:0/3109721635 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff540c5260 0x7eff5415d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:44.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff537fe640 1 -- 172.21.15.133:0/3109721635 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff480094d0 con 0x7eff540c60f0 2023-12-19T19:00:44.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff537fe640 1 --2- 172.21.15.133:0/3109721635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff540c60f0 0x7eff5414f000 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00c7a0 tx=0x7eff4c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:44.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff3b7fe640 1 -- 172.21.15.133:0/3109721635 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c003b80 con 0x7eff540c60f0 2023-12-19T19:00:44.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff3b7fe640 1 -- 172.21.15.133:0/3109721635 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff4c003ce0 con 0x7eff540c60f0 2023-12-19T19:00:44.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff3b7fe640 1 -- 172.21.15.133:0/3109721635 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4c00aa90 con 0x7eff540c60f0 2023-12-19T19:00:44.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff59580640 1 -- 172.21.15.133:0/3109721635 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff540a83d0 con 0x7eff540c60f0 2023-12-19T19:00:44.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff59580640 1 -- 172.21.15.133:0/3109721635 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff540a8670 con 0x7eff540c60f0 2023-12-19T19:00:44.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff59580640 1 -- 172.21.15.133:0/3109721635 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff541f05e0 con 0x7eff540c60f0 2023-12-19T19:00:44.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.549+0000 7eff3b7fe640 1 -- 172.21.15.133:0/3109721635 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7eff4c00abf0 con 0x7eff540c60f0 2023-12-19T19:00:44.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.553+0000 7eff3b7fe640 1 --2- 172.21.15.133:0/3109721635 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7eff40066470 0x7eff40068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:44.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.553+0000 7eff3b7fe640 1 -- 172.21.15.133:0/3109721635 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff4c083af0 con 0x7eff540c60f0 2023-12-19T19:00:44.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.553+0000 7eff52ffd640 1 --2- 172.21.15.133:0/3109721635 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7eff40066470 0x7eff40068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:44.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.553+0000 7eff52ffd640 1 --2- 172.21.15.133:0/3109721635 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7eff40066470 0x7eff40068930 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7eff440079c0 tx=0x7eff44008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:44.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.557+0000 7eff3b7fe640 1 -- 172.21.15.133:0/3109721635 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7eff4c0510b0 con 0x7eff540c60f0 2023-12-19T19:00:44.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.761+0000 7eff59580640 1 -- 172.21.15.133:0/3109721635 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7eff54068400 con 0x7eff540c60f0 2023-12-19T19:00:44.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.761+0000 7eff3b7fe640 1 -- 172.21.15.133:0/3109721635 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v15) v1 ==== 84+0+0 (secure 0 0 0) 0x7eff4c0546d0 con 0x7eff540c60f0 2023-12-19T19:00:44.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.761+0000 7eff59580640 1 -- 172.21.15.133:0/3109721635 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7eff40066470 msgr2=0x7eff40068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:44.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.761+0000 7eff59580640 1 --2- 172.21.15.133:0/3109721635 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7eff40066470 0x7eff40068930 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7eff440079c0 tx=0x7eff44008040 comp rx=0 tx=0).stop 2023-12-19T19:00:44.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.761+0000 7eff59580640 1 -- 172.21.15.133:0/3109721635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff540c60f0 msgr2=0x7eff5414f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:44.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.761+0000 7eff59580640 1 --2- 172.21.15.133:0/3109721635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff540c60f0 0x7eff5414f000 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7eff4c00c7a0 tx=0x7eff4c00cc60 comp rx=0 tx=0).stop 2023-12-19T19:00:44.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.761+0000 7eff59580640 1 -- 172.21.15.133:0/3109721635 shutdown_connections 2023-12-19T19:00:44.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.761+0000 7eff59580640 1 --2- 172.21.15.133:0/3109721635 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7eff40066470 0x7eff40068930 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:44.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.761+0000 7eff59580640 1 --2- 172.21.15.133:0/3109721635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff540c60f0 0x7eff5414f000 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:44.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.761+0000 7eff59580640 1 --2- 172.21.15.133:0/3109721635 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7eff540c5640 0x7eff5414eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:44.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.761+0000 7eff59580640 1 --2- 172.21.15.133:0/3109721635 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff540c5260 0x7eff5415d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:44.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.761+0000 7eff59580640 1 -- 172.21.15.133:0/3109721635 >> 172.21.15.133:0/3109721635 conn(0x7eff5406a5b0 msgr2=0x7eff5406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:44.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.761+0000 7eff59580640 1 -- 172.21.15.133:0/3109721635 shutdown_connections 2023-12-19T19:00:44.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.761+0000 7eff59580640 1 -- 172.21.15.133:0/3109721635 wait complete. 2023-12-19T19:00:44.786 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:00:44.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.921+0000 7f43a369c640 1 Processor -- start 2023-12-19T19:00:44.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.921+0000 7f43a369c640 1 -- start start 2023-12-19T19:00:44.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.921+0000 7f43a369c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f439c1560e0 0x7f439c15ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:44.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.921+0000 7f43a369c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f439c06d520 0x7f439c159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:44.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.921+0000 7f43a369c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f439c15c600 con 0x7f439c0bffc0 2023-12-19T19:00:44.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.921+0000 7f43a369c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f439c1594e0 con 0x7f439c06d520 2023-12-19T19:00:44.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.921+0000 7f43a369c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f439c1597c0 con 0x7f439c1560e0 2023-12-19T19:00:44.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.921+0000 7f43a0c37640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f439c06d520 0x7f439c159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:44.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.921+0000 7f43a0c37640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f439c06d520 0x7f439c159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42786/0 (socket says 172.21.15.133:42786) 2023-12-19T19:00:44.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.921+0000 7f43a0c37640 1 -- 172.21.15.133:0/2748871855 learned_addr learned my addr 172.21.15.133:0/2748871855 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:44.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.921+0000 7f43a1438640 1 --2- 172.21.15.133:0/2748871855 >> v2:172.21.15.138:3300/0 conn(0x7f439c1560e0 0x7f439c15ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:44.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.921+0000 7f43a0c37640 1 -- 172.21.15.133:0/2748871855 >> v2:172.21.15.138:3300/0 conn(0x7f439c1560e0 msgr2=0x7f439c15ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:44.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.921+0000 7f43a0c37640 1 --2- 172.21.15.133:0/2748871855 >> v2:172.21.15.138:3300/0 conn(0x7f439c1560e0 0x7f439c15ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:44.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.921+0000 7f43a0c37640 1 -- 172.21.15.133:0/2748871855 >> v1:172.21.15.138:6789/0 conn(0x7f439c0bffc0 legacy=0x7f439c0c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:44.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.921+0000 7f43a0c37640 1 -- 172.21.15.133:0/2748871855 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c15bfb0 con 0x7f439c06d520 2023-12-19T19:00:44.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.925+0000 7f43a0c37640 1 --2- 172.21.15.133:0/2748871855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f439c06d520 0x7f439c159eb0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f439c06b390 tx=0x7f438c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df4a4be1905dd6b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:44.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.925+0000 7f4393fff640 1 -- 172.21.15.133:0/2748871855 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c1566d0 con 0x7f439c06d520 2023-12-19T19:00:44.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.925+0000 7f4393fff640 1 -- 172.21.15.133:0/2748871855 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f438c0aa650 con 0x7f439c06d520 2023-12-19T19:00:44.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.925+0000 7f4393fff640 1 -- 172.21.15.133:0/2748871855 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f438c0aa9e0 con 0x7f439c06d520 2023-12-19T19:00:44.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.925+0000 7f43a369c640 1 -- 172.21.15.133:0/2748871855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f439c06d520 msgr2=0x7f439c159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:44.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.925+0000 7f43a369c640 1 --2- 172.21.15.133:0/2748871855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f439c06d520 0x7f439c159eb0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f439c06b390 tx=0x7f438c01c4d0 comp rx=0 tx=0).stop 2023-12-19T19:00:44.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.925+0000 7f43a369c640 1 -- 172.21.15.133:0/2748871855 shutdown_connections 2023-12-19T19:00:44.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.925+0000 7f43a369c640 1 --2- 172.21.15.133:0/2748871855 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f439c06d520 0x7f439c159eb0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:44.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.925+0000 7f43a369c640 1 --2- 172.21.15.133:0/2748871855 >> v2:172.21.15.138:3300/0 conn(0x7f439c1560e0 0x7f439c15ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:44.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.925+0000 7f43a369c640 1 -- 172.21.15.133:0/2748871855 >> 172.21.15.133:0/2748871855 conn(0x7f439c06a5b0 msgr2=0x7f439c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:44.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.925+0000 7f43a369c640 1 -- 172.21.15.133:0/2748871855 shutdown_connections 2023-12-19T19:00:44.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.925+0000 7f43a369c640 1 -- 172.21.15.133:0/2748871855 wait complete. 2023-12-19T19:00:44.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f43a369c640 1 Processor -- start 2023-12-19T19:00:44.932 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f43a369c640 1 -- start start 2023-12-19T19:00:44.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f43a369c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f439c06d520 0x7f439c155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:44.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f43a369c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f439c0bffc0 0x7f439c1f1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:44.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f43a369c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f439c1560e0 0x7f439c1f1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:44.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f43a369c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c0a8f10 con 0x7f439c1560e0 2023-12-19T19:00:44.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f43a369c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f439c0a2c50 con 0x7f439c0bffc0 2023-12-19T19:00:44.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f43a369c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f439c1f2180 con 0x7f439c06d520 2023-12-19T19:00:44.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f43a1c39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f439c1560e0 0x7f439c1f1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:44.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f43a1438640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f439c06d520 0x7f439c155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:44.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f43a1c39640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f439c1560e0 0x7f439c1f1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42792/0 (socket says 172.21.15.133:42792) 2023-12-19T19:00:44.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f43a1c39640 1 -- 172.21.15.133:0/2869153755 learned_addr learned my addr 172.21.15.133:0/2869153755 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:44.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f43a0c37640 1 --2- 172.21.15.133:0/2869153755 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f439c0bffc0 0x7f439c1f1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:44.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f43a1c39640 1 -- 172.21.15.133:0/2869153755 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f439c06d520 msgr2=0x7f439c155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:44.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f43a1c39640 1 --2- 172.21.15.133:0/2869153755 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f439c06d520 0x7f439c155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:44.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f43a1c39640 1 -- 172.21.15.133:0/2869153755 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f439c0bffc0 msgr2=0x7f439c1f1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:44.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f43a1c39640 1 --2- 172.21.15.133:0/2869153755 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f439c0bffc0 0x7f439c1f1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:44.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f43a1c39640 1 -- 172.21.15.133:0/2869153755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c0094d0 con 0x7f439c1560e0 2023-12-19T19:00:44.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f43a0c37640 1 --2- 172.21.15.133:0/2869153755 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f439c0bffc0 0x7f439c1f1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:00:44.935 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f43a1c39640 1 --2- 172.21.15.133:0/2869153755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f439c1560e0 0x7f439c1f1c40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f439400c770 tx=0x7f439400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:44.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f4391ffb640 1 -- 172.21.15.133:0/2869153755 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4394003b80 con 0x7f439c1560e0 2023-12-19T19:00:44.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f4391ffb640 1 -- 172.21.15.133:0/2869153755 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4394003ce0 con 0x7f439c1560e0 2023-12-19T19:00:44.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f4391ffb640 1 -- 172.21.15.133:0/2869153755 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439400aa90 con 0x7f439c1560e0 2023-12-19T19:00:44.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f43a369c640 1 -- 172.21.15.133:0/2869153755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f439c1f56c0 con 0x7f439c1560e0 2023-12-19T19:00:44.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.929+0000 7f43a369c640 1 -- 172.21.15.133:0/2869153755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439c0a23b0 con 0x7f439c1560e0 2023-12-19T19:00:44.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.933+0000 7f43a369c640 1 -- 172.21.15.133:0/2869153755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f439c1f1420 con 0x7f439c1560e0 2023-12-19T19:00:44.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.933+0000 7f4391ffb640 1 -- 172.21.15.133:0/2869153755 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f439400abf0 con 0x7f439c1560e0 2023-12-19T19:00:44.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.933+0000 7f4391ffb640 1 --2- 172.21.15.133:0/2869153755 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f43800664a0 0x7f4380068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:44.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.933+0000 7f4391ffb640 1 -- 172.21.15.133:0/2869153755 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4394083aa0 con 0x7f439c1560e0 2023-12-19T19:00:44.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.933+0000 7f43a1438640 1 --2- 172.21.15.133:0/2869153755 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f43800664a0 0x7f4380068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:44.938 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.933+0000 7f43a1438640 1 --2- 172.21.15.133:0/2869153755 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f43800664a0 0x7f4380068960 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4398009ac0 tx=0x7f4398009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:44.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:44.937+0000 7f4391ffb640 1 -- 172.21.15.133:0/2869153755 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f439c1f1420 con 0x7f439c1560e0 2023-12-19T19:00:45.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.089+0000 7f43a369c640 1 -- 172.21.15.133:0/2869153755 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f439c1f1420 con 0x7f439c1560e0 2023-12-19T19:00:45.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.089+0000 7f4391ffb640 1 -- 172.21.15.133:0/2869153755 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+16601 (secure 0 0 0) 0x7f439c1f1420 con 0x7f439c1560e0 2023-12-19T19:00:45.094 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:45.094 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":50,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:00:32.977420+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:00:29.085029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T19:00:30.359577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:00:45.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.093+0000 7f43a369c640 1 -- 172.21.15.133:0/2869153755 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f43800664a0 msgr2=0x7f4380068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:45.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.093+0000 7f43a369c640 1 --2- 172.21.15.133:0/2869153755 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f43800664a0 0x7f4380068960 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4398009ac0 tx=0x7f4398009190 comp rx=0 tx=0).stop 2023-12-19T19:00:45.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.093+0000 7f43a369c640 1 -- 172.21.15.133:0/2869153755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f439c1560e0 msgr2=0x7f439c1f1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:45.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.093+0000 7f43a369c640 1 --2- 172.21.15.133:0/2869153755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f439c1560e0 0x7f439c1f1c40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f439400c770 tx=0x7f439400cc30 comp rx=0 tx=0).stop 2023-12-19T19:00:45.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.093+0000 7f43a369c640 1 -- 172.21.15.133:0/2869153755 shutdown_connections 2023-12-19T19:00:45.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.093+0000 7f43a369c640 1 --2- 172.21.15.133:0/2869153755 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f43800664a0 0x7f4380068960 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.093+0000 7f43a369c640 1 --2- 172.21.15.133:0/2869153755 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f439c1560e0 0x7f439c1f1c40 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.093+0000 7f43a369c640 1 --2- 172.21.15.133:0/2869153755 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f439c0bffc0 0x7f439c1f1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.093+0000 7f43a369c640 1 --2- 172.21.15.133:0/2869153755 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f439c06d520 0x7f439c155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.093+0000 7f43a369c640 1 -- 172.21.15.133:0/2869153755 >> 172.21.15.133:0/2869153755 conn(0x7f439c06a5b0 msgr2=0x7f439c0a72d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:45.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.093+0000 7f43a369c640 1 -- 172.21.15.133:0/2869153755 shutdown_connections 2023-12-19T19:00:45.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.093+0000 7f43a369c640 1 -- 172.21.15.133:0/2869153755 wait complete. 2023-12-19T19:00:45.115 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T19:00:29.085029+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T19:00:30.359577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T19:00:45.116 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T19:00:45.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.253+0000 7effcbb0f640 1 Processor -- start 2023-12-19T19:00:45.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.253+0000 7effcbb0f640 1 -- start start 2023-12-19T19:00:45.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.253+0000 7effcbb0f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7effc4151e90 0x7effc40c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:45.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.253+0000 7effcbb0f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7effc40c4e60 0x7effc406bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:45.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.253+0000 7effcbb0f640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc406c860 con 0x7effc40c7ea0 2023-12-19T19:00:45.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.253+0000 7effcbb0f640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc40c8750 con 0x7effc4151e90 2023-12-19T19:00:45.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.253+0000 7effcbb0f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc41552d0 con 0x7effc40c4e60 2023-12-19T19:00:45.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.253+0000 7effc98ab640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7effc4151e90 0x7effc40c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:45.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.253+0000 7effc98ab640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7effc4151e90 0x7effc40c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42800/0 (socket says 172.21.15.133:42800) 2023-12-19T19:00:45.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.253+0000 7effc98ab640 1 -- 172.21.15.133:0/1838861635 learned_addr learned my addr 172.21.15.133:0/1838861635 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:45.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.253+0000 7effca0ac640 1 --2- 172.21.15.133:0/1838861635 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7effc40c4e60 0x7effc406bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:45.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.253+0000 7effc98ab640 1 -- 172.21.15.133:0/1838861635 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7effc40c4e60 msgr2=0x7effc406bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:45.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.253+0000 7effc98ab640 1 --2- 172.21.15.133:0/1838861635 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7effc40c4e60 0x7effc406bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.253+0000 7effc98ab640 1 -- 172.21.15.133:0/1838861635 >> v1:172.21.15.138:6789/0 conn(0x7effc40c7ea0 legacy=0x7effc406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:45.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.253+0000 7effc98ab640 1 -- 172.21.15.133:0/1838861635 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc4154930 con 0x7effc4151e90 2023-12-19T19:00:45.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.253+0000 7effca0ac640 1 --2- 172.21.15.133:0/1838861635 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7effc40c4e60 0x7effc406bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:45.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.257+0000 7effc98ab640 1 --2- 172.21.15.133:0/1838861635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effc4151e90 0x7effc40c4920 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7effc0009870 tx=0x7effc001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ded610f9f851d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:45.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.257+0000 7effc88a9640 1 -- 172.21.15.133:0/1838861635 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc00ab600 con 0x7effc4151e90 2023-12-19T19:00:45.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.257+0000 7effc88a9640 1 -- 172.21.15.133:0/1838861635 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc00a7050 con 0x7effc4151e90 2023-12-19T19:00:45.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.257+0000 7effc88a9640 1 -- 172.21.15.133:0/1838861635 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc00ab980 con 0x7effc4151e90 2023-12-19T19:00:45.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.257+0000 7effcbb0f640 1 -- 172.21.15.133:0/1838861635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effc4151e90 msgr2=0x7effc40c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:45.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.257+0000 7effcbb0f640 1 --2- 172.21.15.133:0/1838861635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effc4151e90 0x7effc40c4920 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7effc0009870 tx=0x7effc001c420 comp rx=0 tx=0).stop 2023-12-19T19:00:45.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.257+0000 7effcbb0f640 1 -- 172.21.15.133:0/1838861635 shutdown_connections 2023-12-19T19:00:45.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.257+0000 7effcbb0f640 1 --2- 172.21.15.133:0/1838861635 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7effc40c4e60 0x7effc406bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.257+0000 7effcbb0f640 1 --2- 172.21.15.133:0/1838861635 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effc4151e90 0x7effc40c4920 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.257+0000 7effcbb0f640 1 -- 172.21.15.133:0/1838861635 >> 172.21.15.133:0/1838861635 conn(0x7effc40ca170 msgr2=0x7effc40ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:45.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.257+0000 7effcbb0f640 1 -- 172.21.15.133:0/1838861635 shutdown_connections 2023-12-19T19:00:45.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.257+0000 7effcbb0f640 1 -- 172.21.15.133:0/1838861635 wait complete. 2023-12-19T19:00:45.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effcbb0f640 1 Processor -- start 2023-12-19T19:00:45.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effcbb0f640 1 -- start start 2023-12-19T19:00:45.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effcbb0f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effc40c4e60 0x7effc414a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:45.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effcbb0f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7effc40c7ea0 0x7effc414d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:45.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effcbb0f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7effc4151e90 0x7effc4142cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:45.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effcbb0f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc41f04d0 con 0x7effc40c4e60 2023-12-19T19:00:45.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effcbb0f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc41f0720 con 0x7effc40c7ea0 2023-12-19T19:00:45.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effcbb0f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc41f0a00 con 0x7effc4151e90 2023-12-19T19:00:45.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effc98ab640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effc40c4e60 0x7effc414a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:45.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effc98ab640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effc40c4e60 0x7effc414a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42804/0 (socket says 172.21.15.133:42804) 2023-12-19T19:00:45.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effc98ab640 1 -- 172.21.15.133:0/4154312035 learned_addr learned my addr 172.21.15.133:0/4154312035 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:45.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effc90aa640 1 --2- 172.21.15.133:0/4154312035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7effc40c7ea0 0x7effc414d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:45.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effca0ac640 1 --2- 172.21.15.133:0/4154312035 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7effc4151e90 0x7effc4142cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:45.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effc98ab640 1 -- 172.21.15.133:0/4154312035 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7effc4151e90 msgr2=0x7effc4142cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:45.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effc98ab640 1 --2- 172.21.15.133:0/4154312035 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7effc4151e90 0x7effc4142cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effc98ab640 1 -- 172.21.15.133:0/4154312035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7effc40c7ea0 msgr2=0x7effc414d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:45.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effc98ab640 1 --2- 172.21.15.133:0/4154312035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7effc40c7ea0 0x7effc414d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effc98ab640 1 -- 172.21.15.133:0/4154312035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc00094d0 con 0x7effc40c4e60 2023-12-19T19:00:45.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effc98ab640 1 --2- 172.21.15.133:0/4154312035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effc40c4e60 0x7effc414a6e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7effc00ae040 tx=0x7effc001ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:45.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effba7fc640 1 -- 172.21.15.133:0/4154312035 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc00b6620 con 0x7effc40c4e60 2023-12-19T19:00:45.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effba7fc640 1 -- 172.21.15.133:0/4154312035 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc00abe90 con 0x7effc40c4e60 2023-12-19T19:00:45.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effcbb0f640 1 -- 172.21.15.133:0/4154312035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc41f0ce0 con 0x7effc40c4e60 2023-12-19T19:00:45.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effba7fc640 1 -- 172.21.15.133:0/4154312035 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc00b69e0 con 0x7effc40c4e60 2023-12-19T19:00:45.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effcbb0f640 1 -- 172.21.15.133:0/4154312035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc40ab0f0 con 0x7effc40c4e60 2023-12-19T19:00:45.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.261+0000 7effcbb0f640 1 -- 172.21.15.133:0/4154312035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc4068400 con 0x7effc40c4e60 2023-12-19T19:00:45.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.265+0000 7effba7fc640 1 -- 172.21.15.133:0/4154312035 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7effc00b2040 con 0x7effc40c4e60 2023-12-19T19:00:45.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.265+0000 7effba7fc640 1 --2- 172.21.15.133:0/4154312035 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7effa8066470 0x7effa8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:45.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.265+0000 7effba7fc640 1 -- 172.21.15.133:0/4154312035 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7effc011e220 con 0x7effc40c4e60 2023-12-19T19:00:45.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.265+0000 7effc90aa640 1 --2- 172.21.15.133:0/4154312035 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7effa8066470 0x7effa8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:45.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.265+0000 7effc90aa640 1 --2- 172.21.15.133:0/4154312035 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7effa8066470 0x7effa8068930 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7effc40afe10 tx=0x7effb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:45.272 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.269+0000 7effba7fc640 1 -- 172.21.15.133:0/4154312035 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7effc00eb7e0 con 0x7effc40c4e60 2023-12-19T19:00:45.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.417+0000 7effcbb0f640 1 -- 172.21.15.133:0/4154312035 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7effc40ca6f0 con 0x7effc40c4e60 2023-12-19T19:00:45.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.417+0000 7effba7fc640 1 -- 172.21.15.133:0/4154312035 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7effc00eee00 con 0x7effc40c4e60 2023-12-19T19:00:45.422 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T19:00:45.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.421+0000 7effcbb0f640 1 -- 172.21.15.133:0/4154312035 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7effa8066470 msgr2=0x7effa8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:45.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.421+0000 7effcbb0f640 1 --2- 172.21.15.133:0/4154312035 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7effa8066470 0x7effa8068930 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7effc40afe10 tx=0x7effb4009040 comp rx=0 tx=0).stop 2023-12-19T19:00:45.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.421+0000 7effcbb0f640 1 -- 172.21.15.133:0/4154312035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effc40c4e60 msgr2=0x7effc414a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:45.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.421+0000 7effcbb0f640 1 --2- 172.21.15.133:0/4154312035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effc40c4e60 0x7effc414a6e0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7effc00ae040 tx=0x7effc001ac60 comp rx=0 tx=0).stop 2023-12-19T19:00:45.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.421+0000 7effcbb0f640 1 -- 172.21.15.133:0/4154312035 shutdown_connections 2023-12-19T19:00:45.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.421+0000 7effcbb0f640 1 --2- 172.21.15.133:0/4154312035 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7effa8066470 0x7effa8068930 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.421+0000 7effcbb0f640 1 --2- 172.21.15.133:0/4154312035 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7effc4151e90 0x7effc4142cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.421+0000 7effcbb0f640 1 --2- 172.21.15.133:0/4154312035 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7effc40c7ea0 0x7effc414d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.421+0000 7effcbb0f640 1 --2- 172.21.15.133:0/4154312035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effc40c4e60 0x7effc414a6e0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.421+0000 7effcbb0f640 1 -- 172.21.15.133:0/4154312035 >> 172.21.15.133:0/4154312035 conn(0x7effc40ca170 msgr2=0x7effc4150590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:45.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.421+0000 7effcbb0f640 1 -- 172.21.15.133:0/4154312035 shutdown_connections 2023-12-19T19:00:45.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.421+0000 7effcbb0f640 1 -- 172.21.15.133:0/4154312035 wait complete. 2023-12-19T19:00:45.443 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T19:00:45.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1fb709c640 1 Processor -- start 2023-12-19T19:00:45.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1fb709c640 1 -- start start 2023-12-19T19:00:45.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1fb709c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fb00a5370 0x7f1fb00c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:45.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1fb709c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb00c2760 con 0x7f1fb00c4110 2023-12-19T19:00:45.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1fb709c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fb00a5750 con 0x7f1fb0072090 2023-12-19T19:00:45.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1fb709c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb00c3070 con 0x7f1fb00a5370 2023-12-19T19:00:45.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1faffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1fb00c4110 0x7f1fb0150fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59508/0 (socket says 172.21.15.133:59508) 2023-12-19T19:00:45.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1faffff640 1 -- 172.21.15.133:0/2019153380 learned_addr learned my addr 172.21.15.133:0/2019153380 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:45.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1fb4e38640 1 --2- 172.21.15.133:0/2019153380 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fb00a5370 0x7f1fb00c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:45.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1faf7fe640 1 -- 172.21.15.133:0/2019153380 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606229428 0 0) 0x7f1fb00c2760 con 0x7f1fb00c4110 2023-12-19T19:00:45.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1faf7fe640 1 -- 172.21.15.133:0/2019153380 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fa0003450 con 0x7f1fb00c4110 2023-12-19T19:00:45.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1faf7fe640 1 -- 172.21.15.133:0/2019153380 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2857907672 0 0) 0x7f1fb00a5750 con 0x7f1fb0072090 2023-12-19T19:00:45.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1faf7fe640 1 -- 172.21.15.133:0/2019153380 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fb00c2760 con 0x7f1fb0072090 2023-12-19T19:00:45.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1faf7fe640 1 -- 172.21.15.133:0/2019153380 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3773998996 0 0) 0x7f1fa0003450 con 0x7f1fb00c4110 2023-12-19T19:00:45.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1faf7fe640 1 -- 172.21.15.133:0/2019153380 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fb00a5370 msgr2=0x7f1fb00c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:45.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1faf7fe640 1 --2- 172.21.15.133:0/2019153380 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fb00a5370 0x7f1fb00c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1faf7fe640 1 -- 172.21.15.133:0/2019153380 >> v1:172.21.15.138:6789/0 conn(0x7f1fb0072090 legacy=0x7f1fb015b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:45.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1faf7fe640 1 -- 172.21.15.133:0/2019153380 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb00aad20 con 0x7f1fb00c4110 2023-12-19T19:00:45.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1faf7fe640 1 -- 172.21.15.133:0/2019153380 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f1f9c001680 con 0x7f1fb00c4110 2023-12-19T19:00:45.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1fb4e38640 1 --2- 172.21.15.133:0/2019153380 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fb00a5370 0x7f1fb00c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:00:45.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1faf7fe640 1 -- 172.21.15.133:0/2019153380 >> v1:172.21.15.133:6789/0 conn(0x7f1fb00c4110 legacy=0x7f1fb0150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:45.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1faf7fe640 1 --2- 172.21.15.133:0/2019153380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fa0003c30 0x7f1fa0008860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:45.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1faf7fe640 1 --2- 172.21.15.133:0/2019153380 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fa0008da0 0x7f1fa000b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:45.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1faf7fe640 1 --2- 172.21.15.133:0/2019153380 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fb00a5370 0x7f1fa000d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:45.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1faf7fe640 1 -- 172.21.15.133:0/2019153380 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb00c3070 con 0x7f1fa0003c30 2023-12-19T19:00:45.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1faf7fe640 1 -- 172.21.15.133:0/2019153380 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa000dd00 con 0x7f1fa0008da0 2023-12-19T19:00:45.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1faf7fe640 1 -- 172.21.15.133:0/2019153380 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa000dec0 con 0x7f1fb00a5370 2023-12-19T19:00:45.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1fb4e38640 1 --2- 172.21.15.133:0/2019153380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fa0003c30 0x7f1fa0008860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:45.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1faffff640 1 --2- 172.21.15.133:0/2019153380 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fa0008da0 0x7f1fa000b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:45.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1fb5639640 1 --2- 172.21.15.133:0/2019153380 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fb00a5370 0x7f1fa000d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:45.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1fb4e38640 1 -- 172.21.15.133:0/2019153380 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fb00a5370 msgr2=0x7f1fa000d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:45.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1fb4e38640 1 --2- 172.21.15.133:0/2019153380 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fb00a5370 0x7f1fa000d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1fb4e38640 1 -- 172.21.15.133:0/2019153380 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fa0008da0 msgr2=0x7f1fa000b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:45.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1fb4e38640 1 --2- 172.21.15.133:0/2019153380 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fa0008da0 0x7f1fa000b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.581+0000 7f1fb4e38640 1 -- 172.21.15.133:0/2019153380 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa4009420 con 0x7f1fa0003c30 2023-12-19T19:00:45.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.585+0000 7f1fb4e38640 1 --2- 172.21.15.133:0/2019153380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fa0003c30 0x7f1fa0008860 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009cb0 tx=0x7f1fa401cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b19a50c54df32cf5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:45.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.585+0000 7f1faf7fe640 1 -- 172.21.15.133:0/2019153380 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa40a5860 con 0x7f1fa0003c30 2023-12-19T19:00:45.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.585+0000 7f1faf7fe640 1 -- 172.21.15.133:0/2019153380 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa40a59c0 con 0x7f1fa0003c30 2023-12-19T19:00:45.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.585+0000 7f1faf7fe640 1 -- 172.21.15.133:0/2019153380 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa40a5d70 con 0x7f1fa0003c30 2023-12-19T19:00:45.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.585+0000 7f1fb709c640 1 -- 172.21.15.133:0/2019153380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fa0003c30 msgr2=0x7f1fa0008860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:45.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.585+0000 7f1fb709c640 1 --2- 172.21.15.133:0/2019153380 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fa0003c30 0x7f1fa0008860 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1fa4009cb0 tx=0x7f1fa401cbc0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.585+0000 7f1fb5639640 1 -- 172.21.15.133:0/2019153380 reap_dead start 2023-12-19T19:00:45.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.585+0000 7f1fb709c640 1 -- 172.21.15.133:0/2019153380 shutdown_connections 2023-12-19T19:00:45.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.585+0000 7f1fb709c640 1 -- 172.21.15.133:0/2019153380 >> 172.21.15.133:0/2019153380 conn(0x7f1fb006a5b0 msgr2=0x7f1fb006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:45.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.585+0000 7f1fb709c640 1 -- 172.21.15.133:0/2019153380 shutdown_connections 2023-12-19T19:00:45.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.585+0000 7f1fb709c640 1 -- 172.21.15.133:0/2019153380 wait complete. 2023-12-19T19:00:45.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1fb709c640 1 Processor -- start 2023-12-19T19:00:45.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1fb709c640 1 -- start start 2023-12-19T19:00:45.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1fb709c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fa0003c30 0x7f1fb01e9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:45.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1fb709c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fb0145880 0x7f1fb014f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:45.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1fb709c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fb0144a20 0x7f1fb0144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:45.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1fb709c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb01e9e80 con 0x7f1fb0144a20 2023-12-19T19:00:45.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1fb709c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb01de860 con 0x7f1fb0145880 2023-12-19T19:00:45.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1fb709c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb01deb40 con 0x7f1fa0003c30 2023-12-19T19:00:45.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1fb5639640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fb0144a20 0x7f1fb0144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:45.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1fb5639640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fb0144a20 0x7f1fb0144ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42828/0 (socket says 172.21.15.133:42828) 2023-12-19T19:00:45.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1fb5639640 1 -- 172.21.15.133:0/1455168958 learned_addr learned my addr 172.21.15.133:0/1455168958 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:45.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1fb4e38640 1 --2- 172.21.15.133:0/1455168958 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fa0003c30 0x7f1fb01e9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:45.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1faffff640 1 --2- 172.21.15.133:0/1455168958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fb0145880 0x7f1fb014f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:45.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1fb5639640 1 -- 172.21.15.133:0/1455168958 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fa0003c30 msgr2=0x7f1fb01e9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:45.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1fb5639640 1 --2- 172.21.15.133:0/1455168958 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fa0003c30 0x7f1fb01e9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1fb5639640 1 -- 172.21.15.133:0/1455168958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fb0145880 msgr2=0x7f1fb014f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:45.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1fb5639640 1 --2- 172.21.15.133:0/1455168958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fb0145880 0x7f1fb014f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1fb5639640 1 -- 172.21.15.133:0/1455168958 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb01ddb30 con 0x7f1fb0144a20 2023-12-19T19:00:45.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1fb5639640 1 --2- 172.21.15.133:0/1455168958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fb0144a20 0x7f1fb0144ea0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00c0500 tx=0x7f1fa800ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:45.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1fad7fa640 1 -- 172.21.15.133:0/1455168958 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8006d70 con 0x7f1fb0144a20 2023-12-19T19:00:45.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1fad7fa640 1 -- 172.21.15.133:0/1455168958 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa8003980 con 0x7f1fb0144a20 2023-12-19T19:00:45.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1fb709c640 1 -- 172.21.15.133:0/1455168958 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb01dde10 con 0x7f1fb0144a20 2023-12-19T19:00:45.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1fad7fa640 1 -- 172.21.15.133:0/1455168958 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8003d30 con 0x7f1fb0144a20 2023-12-19T19:00:45.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.589+0000 7f1fb709c640 1 -- 172.21.15.133:0/1455168958 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb014f870 con 0x7f1fb0144a20 2023-12-19T19:00:45.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.593+0000 7f1fb709c640 1 -- 172.21.15.133:0/1455168958 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb0068400 con 0x7f1fb0144a20 2023-12-19T19:00:45.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.593+0000 7f1fad7fa640 1 -- 172.21.15.133:0/1455168958 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1fa800d740 con 0x7f1fb0144a20 2023-12-19T19:00:45.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.593+0000 7f1fad7fa640 1 --2- 172.21.15.133:0/1455168958 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f94066470 0x7f1f94068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:45.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.593+0000 7f1fad7fa640 1 -- 172.21.15.133:0/1455168958 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1fa8083260 con 0x7f1fb0144a20 2023-12-19T19:00:45.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.593+0000 7f1fb4e38640 1 --2- 172.21.15.133:0/1455168958 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f94066470 0x7f1f94068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:45.598 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.593+0000 7f1fb4e38640 1 --2- 172.21.15.133:0/1455168958 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f94066470 0x7f1f94068930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40af000 tx=0x7f1fa40046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:45.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.597+0000 7f1fad7fa640 1 -- 172.21.15.133:0/1455168958 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1fa8050790 con 0x7f1fb0144a20 2023-12-19T19:00:45.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.749+0000 7f1fb709c640 1 -- 172.21.15.133:0/1455168958 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1fb00c6780 con 0x7f1fb0144a20 2023-12-19T19:00:45.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.749+0000 7f1fad7fa640 1 -- 172.21.15.133:0/1455168958 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1fa8053db0 con 0x7f1fb0144a20 2023-12-19T19:00:45.754 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:00:45.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.753+0000 7f1fb709c640 1 -- 172.21.15.133:0/1455168958 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f94066470 msgr2=0x7f1f94068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:45.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.753+0000 7f1fb709c640 1 --2- 172.21.15.133:0/1455168958 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f94066470 0x7f1f94068930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40af000 tx=0x7f1fa40046d0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.753+0000 7f1fb709c640 1 -- 172.21.15.133:0/1455168958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fb0144a20 msgr2=0x7f1fb0144ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:45.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.753+0000 7f1fb709c640 1 --2- 172.21.15.133:0/1455168958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fb0144a20 0x7f1fb0144ea0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f1fb00c0500 tx=0x7f1fa800ff70 comp rx=0 tx=0).stop 2023-12-19T19:00:45.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.753+0000 7f1fb709c640 1 -- 172.21.15.133:0/1455168958 shutdown_connections 2023-12-19T19:00:45.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.753+0000 7f1fb709c640 1 --2- 172.21.15.133:0/1455168958 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f94066470 0x7f1f94068930 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.753+0000 7f1fb709c640 1 --2- 172.21.15.133:0/1455168958 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fb0144a20 0x7f1fb0144ea0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.753+0000 7f1fb709c640 1 --2- 172.21.15.133:0/1455168958 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fb0145880 0x7f1fb014f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.753+0000 7f1fb709c640 1 --2- 172.21.15.133:0/1455168958 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fa0003c30 0x7f1fb01e9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.753+0000 7f1fb709c640 1 -- 172.21.15.133:0/1455168958 >> 172.21.15.133:0/1455168958 conn(0x7f1fb006a5b0 msgr2=0x7f1fb0150fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:45.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.753+0000 7f1fb709c640 1 -- 172.21.15.133:0/1455168958 shutdown_connections 2023-12-19T19:00:45.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.753+0000 7f1fb709c640 1 -- 172.21.15.133:0/1455168958 wait complete. 2023-12-19T19:00:45.775 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T19:00:45.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feba6765640 1 Processor -- start 2023-12-19T19:00:45.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feba6765640 1 -- start start 2023-12-19T19:00:45.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feba6765640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feba006bbb0 0x7feba01600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:45.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feba6765640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba006c860 con 0x7feba0151e90 2023-12-19T19:00:45.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feba6765640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba006c040 con 0x7feba00c7ea0 2023-12-19T19:00:45.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feba6765640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba00c8750 con 0x7feba006bbb0 2023-12-19T19:00:45.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feb9ffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7feba0151e90 0x7feba00c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59512/0 (socket says 172.21.15.133:59512) 2023-12-19T19:00:45.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feb9ffff640 1 -- 172.21.15.133:0/2776189611 learned_addr learned my addr 172.21.15.133:0/2776189611 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:45.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feba4d02640 1 --2- 172.21.15.133:0/2776189611 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feba006bbb0 0x7feba01600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:45.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feb9f7fe640 1 -- 172.21.15.133:0/2776189611 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3123707713 0 0) 0x7feba006c860 con 0x7feba0151e90 2023-12-19T19:00:45.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feb9f7fe640 1 -- 172.21.15.133:0/2776189611 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb8c003530 con 0x7feba0151e90 2023-12-19T19:00:45.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feb9f7fe640 1 -- 172.21.15.133:0/2776189611 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120625354 0 0) 0x7feba006c040 con 0x7feba00c7ea0 2023-12-19T19:00:45.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feb9f7fe640 1 -- 172.21.15.133:0/2776189611 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feba006c860 con 0x7feba00c7ea0 2023-12-19T19:00:45.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feb9f7fe640 1 -- 172.21.15.133:0/2776189611 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1846023062 0 0) 0x7feb8c003530 con 0x7feba0151e90 2023-12-19T19:00:45.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feb9f7fe640 1 -- 172.21.15.133:0/2776189611 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feba006bbb0 msgr2=0x7feba01600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:45.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feb9f7fe640 1 --2- 172.21.15.133:0/2776189611 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feba006bbb0 0x7feba01600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feb9f7fe640 1 -- 172.21.15.133:0/2776189611 >> v1:172.21.15.138:6789/0 conn(0x7feba00c7ea0 legacy=0x7feba006b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:45.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feb9f7fe640 1 -- 172.21.15.133:0/2776189611 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba0154930 con 0x7feba0151e90 2023-12-19T19:00:45.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feb9f7fe640 1 -- 172.21.15.133:0/2776189611 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7feb90001680 con 0x7feba0151e90 2023-12-19T19:00:45.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feba4d02640 1 --2- 172.21.15.133:0/2776189611 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feba006bbb0 0x7feba01600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:00:45.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feb9f7fe640 1 -- 172.21.15.133:0/2776189611 >> v1:172.21.15.133:6789/0 conn(0x7feba0151e90 legacy=0x7feba00c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:45.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feb9f7fe640 1 --2- 172.21.15.133:0/2776189611 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feba006bbb0 0x7feb8c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:45.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feb9f7fe640 1 --2- 172.21.15.133:0/2776189611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb8c004080 0x7feb8c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:45.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feb9f7fe640 1 --2- 172.21.15.133:0/2776189611 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb8c004d10 0x7feb8c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:45.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feb9f7fe640 1 -- 172.21.15.133:0/2776189611 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba00c8750 con 0x7feb8c004080 2023-12-19T19:00:45.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feb9f7fe640 1 -- 172.21.15.133:0/2776189611 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c00bb80 con 0x7feb8c004d10 2023-12-19T19:00:45.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.913+0000 7feb9f7fe640 1 -- 172.21.15.133:0/2776189611 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8c00bd40 con 0x7feba006bbb0 2023-12-19T19:00:45.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.917+0000 7feb97fff640 1 --2- 172.21.15.133:0/2776189611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb8c004080 0x7feb8c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:45.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.917+0000 7feb9ffff640 1 --2- 172.21.15.133:0/2776189611 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feba006bbb0 0x7feb8c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:45.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.917+0000 7feba4d02640 1 --2- 172.21.15.133:0/2776189611 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb8c004d10 0x7feb8c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:45.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.917+0000 7feb9ffff640 1 -- 172.21.15.133:0/2776189611 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb8c004d10 msgr2=0x7feb8c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:45.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.917+0000 7feb9ffff640 1 --2- 172.21.15.133:0/2776189611 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feb8c004d10 0x7feb8c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.917+0000 7feb9ffff640 1 -- 172.21.15.133:0/2776189611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb8c004080 msgr2=0x7feb8c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:45.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.917+0000 7feb9ffff640 1 --2- 172.21.15.133:0/2776189611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb8c004080 0x7feb8c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.917+0000 7feb9ffff640 1 -- 172.21.15.133:0/2776189611 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb98009a70 con 0x7feba006bbb0 2023-12-19T19:00:45.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.917+0000 7feb97fff640 1 --2- 172.21.15.133:0/2776189611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb8c004080 0x7feb8c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:00:45.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.917+0000 7feb9ffff640 1 --2- 172.21.15.133:0/2776189611 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feba006bbb0 0x7feb8c003b40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feb9000c160 tx=0x7feb9001cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbf2753de618727e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:45.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.917+0000 7feb9f7fe640 1 -- 172.21.15.133:0/2776189611 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb900058e0 con 0x7feba006bbb0 2023-12-19T19:00:45.923 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.917+0000 7feb9f7fe640 1 -- 172.21.15.133:0/2776189611 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb90005a60 con 0x7feba006bbb0 2023-12-19T19:00:45.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.917+0000 7feb9f7fe640 1 -- 172.21.15.133:0/2776189611 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90005e50 con 0x7feba006bbb0 2023-12-19T19:00:45.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feba6765640 1 -- 172.21.15.133:0/2776189611 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feba006bbb0 msgr2=0x7feb8c003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:45.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feba6765640 1 --2- 172.21.15.133:0/2776189611 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feba006bbb0 0x7feb8c003b40 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feb9000c160 tx=0x7feb9001cbc0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feba4d02640 1 -- 172.21.15.133:0/2776189611 reap_dead start 2023-12-19T19:00:45.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feba6765640 1 -- 172.21.15.133:0/2776189611 shutdown_connections 2023-12-19T19:00:45.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feba6765640 1 -- 172.21.15.133:0/2776189611 >> 172.21.15.133:0/2776189611 conn(0x7feba00ca170 msgr2=0x7feba00ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:45.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feba6765640 1 -- 172.21.15.133:0/2776189611 shutdown_connections 2023-12-19T19:00:45.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feba6765640 1 -- 172.21.15.133:0/2776189611 wait complete. 2023-12-19T19:00:45.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feba6765640 1 Processor -- start 2023-12-19T19:00:45.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feba6765640 1 -- start start 2023-12-19T19:00:45.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feba6765640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feba006bbb0 0x7feba0149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:45.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feba6765640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feba00a9960 0x7feba01ecb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:45.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feba6765640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba00aa350 0x7feba01442f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:45.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feba6765640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba01552d0 con 0x7feba00aa350 2023-12-19T19:00:45.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feba6765640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba00aa0d0 con 0x7feba00a9960 2023-12-19T19:00:45.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feba6765640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba01f0290 con 0x7feba006bbb0 2023-12-19T19:00:45.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feba4d02640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba00aa350 0x7feba01442f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:45.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feba4d02640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba00aa350 0x7feba01442f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42848/0 (socket says 172.21.15.133:42848) 2023-12-19T19:00:45.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feba4d02640 1 -- 172.21.15.133:0/985321809 learned_addr learned my addr 172.21.15.133:0/985321809 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:45.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feb9ffff640 1 --2- 172.21.15.133:0/985321809 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feba006bbb0 0x7feba0149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:45.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feb97fff640 1 --2- 172.21.15.133:0/985321809 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feba00a9960 0x7feba01ecb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:45.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feba4d02640 1 -- 172.21.15.133:0/985321809 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feba006bbb0 msgr2=0x7feba0149b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:45.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feba4d02640 1 --2- 172.21.15.133:0/985321809 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feba006bbb0 0x7feba0149b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feba4d02640 1 -- 172.21.15.133:0/985321809 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feba00a9960 msgr2=0x7feba01ecb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:45.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feba4d02640 1 --2- 172.21.15.133:0/985321809 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feba00a9960 0x7feba01ecb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:45.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.921+0000 7feba4d02640 1 -- 172.21.15.133:0/985321809 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba00a9df0 con 0x7feba00aa350 2023-12-19T19:00:45.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.925+0000 7feba4d02640 1 --2- 172.21.15.133:0/985321809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba00aa350 0x7feba01442f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7feba006a9b0 tx=0x7feb9800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:45.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.925+0000 7feb9d7fa640 1 -- 172.21.15.133:0/985321809 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9800e040 con 0x7feba00aa350 2023-12-19T19:00:45.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.925+0000 7feb9d7fa640 1 -- 172.21.15.133:0/985321809 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9800f040 con 0x7feba00aa350 2023-12-19T19:00:45.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.925+0000 7feba6765640 1 -- 172.21.15.133:0/985321809 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba01f0530 con 0x7feba00aa350 2023-12-19T19:00:45.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.925+0000 7feb9d7fa640 1 -- 172.21.15.133:0/985321809 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb98003bc0 con 0x7feba00aa350 2023-12-19T19:00:45.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.925+0000 7feba6765640 1 -- 172.21.15.133:0/985321809 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba014a0c0 con 0x7feba00aa350 2023-12-19T19:00:45.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.925+0000 7feba6765640 1 -- 172.21.15.133:0/985321809 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba01f00f0 con 0x7feba00aa350 2023-12-19T19:00:45.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.925+0000 7feb9d7fa640 1 -- 172.21.15.133:0/985321809 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7feb98003d20 con 0x7feba00aa350 2023-12-19T19:00:45.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.925+0000 7feb9d7fa640 1 --2- 172.21.15.133:0/985321809 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7feb800664a0 0x7feb80068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:45.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.925+0000 7feb9d7fa640 1 -- 172.21.15.133:0/985321809 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb98084560 con 0x7feba00aa350 2023-12-19T19:00:45.930 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.925+0000 7feb9ffff640 1 --2- 172.21.15.133:0/985321809 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7feb800664a0 0x7feb80068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:45.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.929+0000 7feb9ffff640 1 --2- 172.21.15.133:0/985321809 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7feb800664a0 0x7feb80068960 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7feb900aa000 tx=0x7feb90001a00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:45.934 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:45.929+0000 7feb9d7fa640 1 -- 172.21.15.133:0/985321809 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7feba01f00f0 con 0x7feba00aa350 2023-12-19T19:00:46.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.077+0000 7feba6765640 1 -- 172.21.15.133:0/985321809 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feba01f0a50 con 0x7feba00aa350 2023-12-19T19:00:46.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.077+0000 7feb9d7fa640 1 -- 172.21.15.133:0/985321809 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7feba01f0a50 con 0x7feba00aa350 2023-12-19T19:00:46.083 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:00:46.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.081+0000 7feba6765640 1 -- 172.21.15.133:0/985321809 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7feb800664a0 msgr2=0x7feb80068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:46.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.081+0000 7feba6765640 1 --2- 172.21.15.133:0/985321809 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7feb800664a0 0x7feb80068960 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7feb900aa000 tx=0x7feb90001a00 comp rx=0 tx=0).stop 2023-12-19T19:00:46.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.081+0000 7feba6765640 1 -- 172.21.15.133:0/985321809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba00aa350 msgr2=0x7feba01442f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:46.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.081+0000 7feba6765640 1 --2- 172.21.15.133:0/985321809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba00aa350 0x7feba01442f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7feba006a9b0 tx=0x7feb9800f580 comp rx=0 tx=0).stop 2023-12-19T19:00:46.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.081+0000 7feba6765640 1 -- 172.21.15.133:0/985321809 shutdown_connections 2023-12-19T19:00:46.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.081+0000 7feba6765640 1 --2- 172.21.15.133:0/985321809 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7feb800664a0 0x7feb80068960 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:46.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.081+0000 7feba6765640 1 --2- 172.21.15.133:0/985321809 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feba00aa350 0x7feba01442f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:46.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.081+0000 7feba6765640 1 --2- 172.21.15.133:0/985321809 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7feba00a9960 0x7feba01ecb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:46.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.081+0000 7feba6765640 1 --2- 172.21.15.133:0/985321809 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7feba006bbb0 0x7feba0149b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:46.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.081+0000 7feba6765640 1 -- 172.21.15.133:0/985321809 >> 172.21.15.133:0/985321809 conn(0x7feba00ca170 msgr2=0x7feba014b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:46.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.081+0000 7feba6765640 1 -- 172.21.15.133:0/985321809 shutdown_connections 2023-12-19T19:00:46.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.081+0000 7feba6765640 1 -- 172.21.15.133:0/985321809 wait complete. 2023-12-19T19:00:46.104 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T19:00:46.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.237+0000 7f8671efe640 1 Processor -- start 2023-12-19T19:00:46.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.237+0000 7f8671efe640 1 -- start start 2023-12-19T19:00:46.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.237+0000 7f8671efe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f866c0c7ea0 0x7f866c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.237+0000 7f8671efe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f866c06b9e0 0x7f866c15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.237+0000 7f8671efe640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866c06c860 con 0x7f866c151e90 2023-12-19T19:00:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.237+0000 7f8671efe640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866c0c8750 con 0x7f866c0c7ea0 2023-12-19T19:00:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.237+0000 7f8671efe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866c1552d0 con 0x7f866c06b9e0 2023-12-19T19:00:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.237+0000 7f866b7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f866c151e90 0x7f866c0c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59524/0 (socket says 172.21.15.133:59524) 2023-12-19T19:00:46.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.237+0000 7f866b7fe640 1 -- 172.21.15.133:0/3812806304 learned_addr learned my addr 172.21.15.133:0/3812806304 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:46.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.237+0000 7f866affd640 1 --2- 172.21.15.133:0/3812806304 >> v2:172.21.15.138:3300/0 conn(0x7f866c0c7ea0 0x7f866c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:46.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.237+0000 7f866bfff640 1 --2- 172.21.15.133:0/3812806304 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f866c06b9e0 0x7f866c15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:46.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.237+0000 7f866a7fc640 1 -- 172.21.15.133:0/3812806304 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073403048 0 0) 0x7f866c06c860 con 0x7f866c151e90 2023-12-19T19:00:46.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.237+0000 7f866a7fc640 1 -- 172.21.15.133:0/3812806304 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8654003530 con 0x7f866c151e90 2023-12-19T19:00:46.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.237+0000 7f866bfff640 1 -- 172.21.15.133:0/3812806304 >> v2:172.21.15.138:3300/0 conn(0x7f866c0c7ea0 msgr2=0x7f866c06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:46.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.237+0000 7f866bfff640 1 --2- 172.21.15.133:0/3812806304 >> v2:172.21.15.138:3300/0 conn(0x7f866c0c7ea0 0x7f866c06b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:46.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.237+0000 7f866bfff640 1 -- 172.21.15.133:0/3812806304 >> v1:172.21.15.133:6789/0 conn(0x7f866c151e90 legacy=0x7f866c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:46.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.237+0000 7f866bfff640 1 -- 172.21.15.133:0/3812806304 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c154930 con 0x7f866c06b9e0 2023-12-19T19:00:46.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.241+0000 7f866bfff640 1 --2- 172.21.15.133:0/3812806304 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f866c06b9e0 0x7f866c15f0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8664009d90 tx=0x7f866401c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9c3dea2cd8f4464 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:46.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.241+0000 7f866a7fc640 1 -- 172.21.15.133:0/3812806304 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86640a6700 con 0x7f866c06b9e0 2023-12-19T19:00:46.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.241+0000 7f866a7fc640 1 -- 172.21.15.133:0/3812806304 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86640a6860 con 0x7f866c06b9e0 2023-12-19T19:00:46.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.241+0000 7f866a7fc640 1 -- 172.21.15.133:0/3812806304 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86640a6bf0 con 0x7f866c06b9e0 2023-12-19T19:00:46.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.241+0000 7f8671efe640 1 -- 172.21.15.133:0/3812806304 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f866c06b9e0 msgr2=0x7f866c15f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:46.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.241+0000 7f8671efe640 1 --2- 172.21.15.133:0/3812806304 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f866c06b9e0 0x7f866c15f0a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8664009d90 tx=0x7f866401c830 comp rx=0 tx=0).stop 2023-12-19T19:00:46.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.241+0000 7f8671efe640 1 -- 172.21.15.133:0/3812806304 shutdown_connections 2023-12-19T19:00:46.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.241+0000 7f8671efe640 1 --2- 172.21.15.133:0/3812806304 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f866c06b9e0 0x7f866c15f0a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:46.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.241+0000 7f8671efe640 1 --2- 172.21.15.133:0/3812806304 >> v2:172.21.15.138:3300/0 conn(0x7f866c0c7ea0 0x7f866c06b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:46.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.241+0000 7f8671efe640 1 -- 172.21.15.133:0/3812806304 >> 172.21.15.133:0/3812806304 conn(0x7f866c0ca170 msgr2=0x7f866c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:46.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.241+0000 7f8671efe640 1 -- 172.21.15.133:0/3812806304 shutdown_connections 2023-12-19T19:00:46.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.241+0000 7f8671efe640 1 -- 172.21.15.133:0/3812806304 wait complete. 2023-12-19T19:00:46.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f8671efe640 1 Processor -- start 2023-12-19T19:00:46.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f8671efe640 1 -- start start 2023-12-19T19:00:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f8671efe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f866c06b9e0 0x7f866c0ab360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f8671efe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f866c0c7ea0 0x7f866c1482e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f8671efe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f866c151e90 0x7f866c1ed7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f8671efe640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c0ab8a0 con 0x7f866c06b9e0 2023-12-19T19:00:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f8671efe640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c1f1430 con 0x7f866c0c7ea0 2023-12-19T19:00:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f8671efe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866c144c20 con 0x7f866c151e90 2023-12-19T19:00:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f866b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f866c06b9e0 0x7f866c0ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f866b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f866c06b9e0 0x7f866c0ab360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42850/0 (socket says 172.21.15.133:42850) 2023-12-19T19:00:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f866b7fe640 1 -- 172.21.15.133:0/512635489 learned_addr learned my addr 172.21.15.133:0/512635489 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f866bfff640 1 --2- 172.21.15.133:0/512635489 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f866c151e90 0x7f866c1ed7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f866affd640 1 --2- 172.21.15.133:0/512635489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f866c0c7ea0 0x7f866c1482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f866b7fe640 1 -- 172.21.15.133:0/512635489 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f866c151e90 msgr2=0x7f866c1ed7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:46.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f866b7fe640 1 --2- 172.21.15.133:0/512635489 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f866c151e90 0x7f866c1ed7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:46.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f866b7fe640 1 -- 172.21.15.133:0/512635489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f866c0c7ea0 msgr2=0x7f866c1482e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:46.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f866b7fe640 1 --2- 172.21.15.133:0/512635489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f866c0c7ea0 0x7f866c1482e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:46.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f866b7fe640 1 -- 172.21.15.133:0/512635489 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8664009a70 con 0x7f866c06b9e0 2023-12-19T19:00:46.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f866b7fe640 1 --2- 172.21.15.133:0/512635489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f866c06b9e0 0x7f866c0ab360 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f865c00c4d0 tx=0x7f865c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:46.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f8653fff640 1 -- 172.21.15.133:0/512635489 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c005cf0 con 0x7f866c06b9e0 2023-12-19T19:00:46.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f8653fff640 1 -- 172.21.15.133:0/512635489 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c005e50 con 0x7f866c06b9e0 2023-12-19T19:00:46.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f8653fff640 1 -- 172.21.15.133:0/512635489 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c007270 con 0x7f866c06b9e0 2023-12-19T19:00:46.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f8671efe640 1 -- 172.21.15.133:0/512635489 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866c144f00 con 0x7f866c06b9e0 2023-12-19T19:00:46.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.245+0000 7f8671efe640 1 -- 172.21.15.133:0/512635489 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866c148820 con 0x7f866c06b9e0 2023-12-19T19:00:46.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.249+0000 7f8671efe640 1 -- 172.21.15.133:0/512635489 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866c068400 con 0x7f866c06b9e0 2023-12-19T19:00:46.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.249+0000 7f8653fff640 1 -- 172.21.15.133:0/512635489 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f865c0073d0 con 0x7f866c06b9e0 2023-12-19T19:00:46.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.249+0000 7f8653fff640 1 --2- 172.21.15.133:0/512635489 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f86580664a0 0x7f8658068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:46.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.249+0000 7f8653fff640 1 -- 172.21.15.133:0/512635489 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f865c083300 con 0x7f866c06b9e0 2023-12-19T19:00:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.249+0000 7f866affd640 1 --2- 172.21.15.133:0/512635489 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f86580664a0 0x7f8658068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:46.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.249+0000 7f866affd640 1 --2- 172.21.15.133:0/512635489 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f86580664a0 0x7f8658068960 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f866c153750 tx=0x7f8660009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:46.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.253+0000 7f8653fff640 1 -- 172.21.15.133:0/512635489 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f865c050820 con 0x7f866c06b9e0 2023-12-19T19:00:46.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.409+0000 7f8671efe640 1 -- 172.21.15.133:0/512635489 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f866c0c0d80 con 0x7f866c06b9e0 2023-12-19T19:00:46.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.409+0000 7f8653fff640 1 -- 172.21.15.133:0/512635489 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v50) v1 ==== 84+0+207 (secure 0 0 0) 0x7f865c0170e0 con 0x7f866c06b9e0 2023-12-19T19:00:46.412 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:46.412 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2023-12-19T19:00:46.412 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:00:46.413 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2023-12-19T19:00:46.413 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": ".mgr" 2023-12-19T19:00:46.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:00:46.413 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:00:46.413 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 8, 2023-12-19T19:00:46.413 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "cephfs_metadata" 2023-12-19T19:00:46.413 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:00:46.413 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:00:46.413 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 9, 2023-12-19T19:00:46.413 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "cephfs_data" 2023-12-19T19:00:46.413 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:00:46.413 INFO:teuthology.orchestra.run.smithi133.stdout:] 2023-12-19T19:00:46.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.409+0000 7f8671efe640 1 -- 172.21.15.133:0/512635489 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f86580664a0 msgr2=0x7f8658068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:46.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.409+0000 7f8671efe640 1 --2- 172.21.15.133:0/512635489 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f86580664a0 0x7f8658068960 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f866c153750 tx=0x7f8660009190 comp rx=0 tx=0).stop 2023-12-19T19:00:46.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.409+0000 7f8671efe640 1 -- 172.21.15.133:0/512635489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f866c06b9e0 msgr2=0x7f866c0ab360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:46.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.409+0000 7f8671efe640 1 --2- 172.21.15.133:0/512635489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f866c06b9e0 0x7f866c0ab360 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f865c00c4d0 tx=0x7f865c00c990 comp rx=0 tx=0).stop 2023-12-19T19:00:46.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.409+0000 7f8671efe640 1 -- 172.21.15.133:0/512635489 shutdown_connections 2023-12-19T19:00:46.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.409+0000 7f8671efe640 1 --2- 172.21.15.133:0/512635489 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f86580664a0 0x7f8658068960 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:46.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.409+0000 7f8671efe640 1 --2- 172.21.15.133:0/512635489 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f866c151e90 0x7f866c1ed7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:46.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.409+0000 7f8671efe640 1 --2- 172.21.15.133:0/512635489 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f866c0c7ea0 0x7f866c1482e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:46.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.409+0000 7f8671efe640 1 --2- 172.21.15.133:0/512635489 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f866c06b9e0 0x7f866c0ab360 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:46.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.409+0000 7f8671efe640 1 -- 172.21.15.133:0/512635489 >> 172.21.15.133:0/512635489 conn(0x7f866c0ca170 msgr2=0x7f866c0c69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:46.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.409+0000 7f8671efe640 1 -- 172.21.15.133:0/512635489 shutdown_connections 2023-12-19T19:00:46.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.409+0000 7f8671efe640 1 -- 172.21.15.133:0/512635489 wait complete. 2023-12-19T19:00:46.433 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-12-19T19:00:46.434 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-12-19T19:00:46.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.569+0000 7f0700901640 1 Processor -- start 2023-12-19T19:00:46.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.569+0000 7f0700901640 1 -- start start 2023-12-19T19:00:46.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.573+0000 7f0700901640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06fc0c1250 0x7f06fc0c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:46.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.573+0000 7f0700901640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f06fc06fec0 0x7f06fc0c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:46.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.573+0000 7f0700901640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06fc072800 con 0x7f06fc0c0aa0 2023-12-19T19:00:46.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.573+0000 7f0700901640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06fc0a9fc0 con 0x7f06fc06fec0 2023-12-19T19:00:46.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.573+0000 7f0700901640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc072ae0 con 0x7f06fc0c1250 2023-12-19T19:00:46.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.573+0000 7f06f9d9b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f06fc06fec0 0x7f06fc0c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:46.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.573+0000 7f06fad9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f06fc0c0aa0 0x7f06fc0c4180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59528/0 (socket says 172.21.15.133:59528) 2023-12-19T19:00:46.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.573+0000 7f06fad9d640 1 -- 172.21.15.133:0/809094875 learned_addr learned my addr 172.21.15.133:0/809094875 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:46.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.573+0000 7f06fa59c640 1 --2- 172.21.15.133:0/809094875 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06fc0c1250 0x7f06fc0c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:46.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.573+0000 7f06f9d9b640 1 -- 172.21.15.133:0/809094875 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06fc0c1250 msgr2=0x7f06fc0c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:46.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.573+0000 7f06f9d9b640 1 --2- 172.21.15.133:0/809094875 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06fc0c1250 0x7f06fc0c1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:46.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.573+0000 7f06f9d9b640 1 -- 172.21.15.133:0/809094875 >> v1:172.21.15.133:6789/0 conn(0x7f06fc0c0aa0 legacy=0x7f06fc0c4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:46.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.573+0000 7f06f9d9b640 1 -- 172.21.15.133:0/809094875 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc0a9900 con 0x7f06fc06fec0 2023-12-19T19:00:46.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.577+0000 7f06f9d9b640 1 --2- 172.21.15.133:0/809094875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06fc06fec0 0x7f06fc0c3c40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f06f000a960 tx=0x7f06f001d700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62afec400cc0b7f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:46.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.577+0000 7f06f959a640 1 -- 172.21.15.133:0/809094875 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f00a67f0 con 0x7f06fc06fec0 2023-12-19T19:00:46.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.577+0000 7f06f959a640 1 -- 172.21.15.133:0/809094875 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f00a6950 con 0x7f06fc06fec0 2023-12-19T19:00:46.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.577+0000 7f06f959a640 1 -- 172.21.15.133:0/809094875 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f00a6ce0 con 0x7f06fc06fec0 2023-12-19T19:00:46.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.577+0000 7f0700901640 1 -- 172.21.15.133:0/809094875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06fc06fec0 msgr2=0x7f06fc0c3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:46.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.577+0000 7f0700901640 1 --2- 172.21.15.133:0/809094875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06fc06fec0 0x7f06fc0c3c40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f06f000a960 tx=0x7f06f001d700 comp rx=0 tx=0).stop 2023-12-19T19:00:46.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.577+0000 7f0700901640 1 -- 172.21.15.133:0/809094875 shutdown_connections 2023-12-19T19:00:46.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.577+0000 7f0700901640 1 --2- 172.21.15.133:0/809094875 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06fc06fec0 0x7f06fc0c3c40 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:46.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.577+0000 7f0700901640 1 --2- 172.21.15.133:0/809094875 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06fc0c1250 0x7f06fc0c1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:46.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.577+0000 7f0700901640 1 -- 172.21.15.133:0/809094875 >> 172.21.15.133:0/809094875 conn(0x7f06fc0c5d40 msgr2=0x7f06fc0c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:46.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.577+0000 7f0700901640 1 -- 172.21.15.133:0/809094875 shutdown_connections 2023-12-19T19:00:46.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.577+0000 7f0700901640 1 -- 172.21.15.133:0/809094875 wait complete. 2023-12-19T19:00:46.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.577+0000 7f0700901640 1 Processor -- start 2023-12-19T19:00:46.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.577+0000 7f0700901640 1 -- start start 2023-12-19T19:00:46.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f0700901640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06fc06fec0 0x7f06fc14de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:46.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f0700901640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06fc0c0aa0 0x7f06fc1eaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f0700901640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06fc0c1250 0x7f06fc14a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f0700901640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc157650 con 0x7f06fc06fec0 2023-12-19T19:00:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f0700901640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc156a80 con 0x7f06fc0c0aa0 2023-12-19T19:00:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f0700901640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc156d20 con 0x7f06fc0c1250 2023-12-19T19:00:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f06fa59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06fc06fec0 0x7f06fc14de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f06fa59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06fc06fec0 0x7f06fc14de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42876/0 (socket says 172.21.15.133:42876) 2023-12-19T19:00:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f06fa59c640 1 -- 172.21.15.133:0/927971269 learned_addr learned my addr 172.21.15.133:0/927971269 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f06f9d9b640 1 --2- 172.21.15.133:0/927971269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06fc0c0aa0 0x7f06fc1eaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f06fad9d640 1 --2- 172.21.15.133:0/927971269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06fc0c1250 0x7f06fc14a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f06fa59c640 1 -- 172.21.15.133:0/927971269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06fc0c1250 msgr2=0x7f06fc14a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f06fa59c640 1 --2- 172.21.15.133:0/927971269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06fc0c1250 0x7f06fc14a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f06fa59c640 1 -- 172.21.15.133:0/927971269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06fc0c0aa0 msgr2=0x7f06fc1eaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f06fa59c640 1 --2- 172.21.15.133:0/927971269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06fc0c0aa0 0x7f06fc1eaba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:46.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f06fa59c640 1 -- 172.21.15.133:0/927971269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f000a5c0 con 0x7f06fc06fec0 2023-12-19T19:00:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f06fa59c640 1 --2- 172.21.15.133:0/927971269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06fc06fec0 0x7f06fc14de80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00e930 tx=0x7f06ec00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f06eaffd640 1 -- 172.21.15.133:0/927971269 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec009690 con 0x7f06fc06fec0 2023-12-19T19:00:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f06eaffd640 1 -- 172.21.15.133:0/927971269 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec00ca00 con 0x7f06fc06fec0 2023-12-19T19:00:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f06eaffd640 1 -- 172.21.15.133:0/927971269 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec00cd70 con 0x7f06fc06fec0 2023-12-19T19:00:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f0700901640 1 -- 172.21.15.133:0/927971269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06fc157000 con 0x7f06fc06fec0 2023-12-19T19:00:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f0700901640 1 -- 172.21.15.133:0/927971269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06fc14e3c0 con 0x7f06fc06fec0 2023-12-19T19:00:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f0700901640 1 -- 172.21.15.133:0/927971269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06fc068400 con 0x7f06fc06fec0 2023-12-19T19:00:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.581+0000 7f06eaffd640 1 -- 172.21.15.133:0/927971269 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f06ec013470 con 0x7f06fc06fec0 2023-12-19T19:00:46.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.585+0000 7f06eaffd640 1 --2- 172.21.15.133:0/927971269 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f06dc066470 0x7f06dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:46.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.585+0000 7f06eaffd640 1 -- 172.21.15.133:0/927971269 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06ec0840e0 con 0x7f06fc06fec0 2023-12-19T19:00:46.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.585+0000 7f06f9d9b640 1 --2- 172.21.15.133:0/927971269 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f06dc066470 0x7f06dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:46.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.585+0000 7f06f9d9b640 1 --2- 172.21.15.133:0/927971269 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f06dc066470 0x7f06dc068930 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f06f00b0000 tx=0x7f06f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:46.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.589+0000 7f06eaffd640 1 -- 172.21.15.133:0/927971269 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f06ec051610 con 0x7f06fc06fec0 2023-12-19T19:00:46.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:46.737+0000 7f0700901640 1 -- 172.21.15.133:0/927971269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f06fc0a9220 con 0x7f06fc06fec0 2023-12-19T19:00:47.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.653+0000 7f06eaffd640 1 -- 172.21.15.133:0/927971269 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v51) v1 ==== 140+0+0 (secure 0 0 0) 0x7f06ec054c30 con 0x7f06fc06fec0 2023-12-19T19:00:47.656 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs2_metadata' created 2023-12-19T19:00:47.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.653+0000 7f0700901640 1 -- 172.21.15.133:0/927971269 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f06dc066470 msgr2=0x7f06dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:47.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.653+0000 7f0700901640 1 --2- 172.21.15.133:0/927971269 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f06dc066470 0x7f06dc068930 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f06f00b0000 tx=0x7f06f0008040 comp rx=0 tx=0).stop 2023-12-19T19:00:47.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.653+0000 7f0700901640 1 -- 172.21.15.133:0/927971269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06fc06fec0 msgr2=0x7f06fc14de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:47.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.653+0000 7f0700901640 1 --2- 172.21.15.133:0/927971269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06fc06fec0 0x7f06fc14de80 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f06ec00e930 tx=0x7f06ec00edf0 comp rx=0 tx=0).stop 2023-12-19T19:00:47.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.653+0000 7f0700901640 1 -- 172.21.15.133:0/927971269 shutdown_connections 2023-12-19T19:00:47.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.653+0000 7f0700901640 1 --2- 172.21.15.133:0/927971269 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f06dc066470 0x7f06dc068930 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:47.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.653+0000 7f0700901640 1 --2- 172.21.15.133:0/927971269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06fc0c1250 0x7f06fc14a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:47.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.653+0000 7f0700901640 1 --2- 172.21.15.133:0/927971269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06fc0c0aa0 0x7f06fc1eaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:47.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.653+0000 7f0700901640 1 --2- 172.21.15.133:0/927971269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06fc06fec0 0x7f06fc14de80 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:47.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.653+0000 7f0700901640 1 -- 172.21.15.133:0/927971269 >> 172.21.15.133:0/927971269 conn(0x7f06fc0c5d40 msgr2=0x7f06fc15b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:47.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.653+0000 7f0700901640 1 -- 172.21.15.133:0/927971269 shutdown_connections 2023-12-19T19:00:47.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.653+0000 7f0700901640 1 -- 172.21.15.133:0/927971269 wait complete. 2023-12-19T19:00:47.686 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T19:00:47.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.829+0000 7f257ad5f640 1 Processor -- start 2023-12-19T19:00:47.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.829+0000 7f257ad5f640 1 -- start start 2023-12-19T19:00:47.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.829+0000 7f257ad5f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f257406d990 0x7f25740c5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:47.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.829+0000 7f257ad5f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f25741546c0 0x7f2574154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:47.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.829+0000 7f257ad5f640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25740c1e30 con 0x7f257406c070 2023-12-19T19:00:47.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.829+0000 7f257ad5f640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257406dd70 con 0x7f25741546c0 2023-12-19T19:00:47.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.829+0000 7f257ad5f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25740c1220 con 0x7f257406d990 2023-12-19T19:00:47.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.829+0000 7f2579d5d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f257406d990 0x7f25740c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:47.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.829+0000 7f257955c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f25741546c0 0x7f2574154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:47.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.829+0000 7f2579d5d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f257406d990 0x7f25740c5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:60386/0 (socket says 172.21.15.133:60386) 2023-12-19T19:00:47.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.829+0000 7f257a55e640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f257406c070 0x7f257406c500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:57552/0 (socket says 172.21.15.133:57552) 2023-12-19T19:00:47.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.829+0000 7f2579d5d640 1 -- 172.21.15.133:0/2560551588 learned_addr learned my addr 172.21.15.133:0/2560551588 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:47.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.829+0000 7f257955c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f25741546c0 0x7f2574154b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:45444/0 (socket says 172.21.15.133:45444) 2023-12-19T19:00:47.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.829+0000 7f257955c640 1 -- 172.21.15.133:0/2560551588 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f257406d990 msgr2=0x7f25740c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:47.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.829+0000 7f257955c640 1 --2- 172.21.15.133:0/2560551588 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f257406d990 0x7f25740c5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:47.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.829+0000 7f257955c640 1 -- 172.21.15.133:0/2560551588 >> v1:172.21.15.138:6789/0 conn(0x7f257406c070 legacy=0x7f257406c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:47.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.829+0000 7f257955c640 1 -- 172.21.15.133:0/2560551588 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25740c1500 con 0x7f25741546c0 2023-12-19T19:00:47.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.829+0000 7f2579d5d640 1 --2- 172.21.15.133:0/2560551588 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f257406d990 0x7f25740c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:00:47.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.829+0000 7f2578d5b640 1 -- 172.21.15.133:0/2560551588 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 162456793 0 0) 0x7f25740c1e30 con 0x7f257406c070 2023-12-19T19:00:47.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.833+0000 7f257955c640 1 --2- 172.21.15.133:0/2560551588 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25741546c0 0x7f2574154b20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f256400ba60 tx=0x7f256401eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd236bb64c5e5574 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:47.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.833+0000 7f2578d5b640 1 -- 172.21.15.133:0/2560551588 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25640a7b10 con 0x7f25741546c0 2023-12-19T19:00:47.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.833+0000 7f2578d5b640 1 -- 172.21.15.133:0/2560551588 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25640a7c70 con 0x7f25741546c0 2023-12-19T19:00:47.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.833+0000 7f2578d5b640 1 -- 172.21.15.133:0/2560551588 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25640af440 con 0x7f25741546c0 2023-12-19T19:00:47.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.833+0000 7f257ad5f640 1 -- 172.21.15.133:0/2560551588 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25741546c0 msgr2=0x7f2574154b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:47.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.833+0000 7f257ad5f640 1 --2- 172.21.15.133:0/2560551588 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25741546c0 0x7f2574154b20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f256400ba60 tx=0x7f256401eb50 comp rx=0 tx=0).stop 2023-12-19T19:00:47.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.833+0000 7f257ad5f640 1 -- 172.21.15.133:0/2560551588 shutdown_connections 2023-12-19T19:00:47.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.833+0000 7f257ad5f640 1 --2- 172.21.15.133:0/2560551588 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f25741546c0 0x7f2574154b20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:47.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.833+0000 7f257ad5f640 1 --2- 172.21.15.133:0/2560551588 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f257406d990 0x7f25740c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:47.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.833+0000 7f257ad5f640 1 -- 172.21.15.133:0/2560551588 >> 172.21.15.133:0/2560551588 conn(0x7f25740a7800 msgr2=0x7f25740a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:47.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.833+0000 7f257ad5f640 1 -- 172.21.15.133:0/2560551588 shutdown_connections 2023-12-19T19:00:47.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.833+0000 7f257ad5f640 1 -- 172.21.15.133:0/2560551588 wait complete. 2023-12-19T19:00:47.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f257ad5f640 1 Processor -- start 2023-12-19T19:00:47.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f257ad5f640 1 -- start start 2023-12-19T19:00:47.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f257ad5f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f257406c070 0x7f25741e39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:47.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f257ad5f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f257406d990 0x7f2574070d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:47.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f257ad5f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25741546c0 0x7f25740712c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:47.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f257ad5f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25740aa820 con 0x7f25741546c0 2023-12-19T19:00:47.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f257ad5f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2574072780 con 0x7f257406d990 2023-12-19T19:00:47.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f257ad5f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2574144c80 con 0x7f257406c070 2023-12-19T19:00:47.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f257a55e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25741546c0 0x7f25740712c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:47.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f257a55e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25741546c0 0x7f25740712c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42884/0 (socket says 172.21.15.133:42884) 2023-12-19T19:00:47.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f257a55e640 1 -- 172.21.15.133:0/2296238705 learned_addr learned my addr 172.21.15.133:0/2296238705 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:47.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f257955c640 1 --2- 172.21.15.133:0/2296238705 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f257406d990 0x7f2574070d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:47.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f2579d5d640 1 --2- 172.21.15.133:0/2296238705 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f257406c070 0x7f25741e39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:47.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f257a55e640 1 -- 172.21.15.133:0/2296238705 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f257406c070 msgr2=0x7f25741e39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:47.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f257a55e640 1 --2- 172.21.15.133:0/2296238705 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f257406c070 0x7f25741e39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:47.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f257a55e640 1 -- 172.21.15.133:0/2296238705 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f257406d990 msgr2=0x7f2574070d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:47.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f257a55e640 1 --2- 172.21.15.133:0/2296238705 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f257406d990 0x7f2574070d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:47.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f257a55e640 1 -- 172.21.15.133:0/2296238705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25700094d0 con 0x7f25741546c0 2023-12-19T19:00:47.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f257a55e640 1 --2- 172.21.15.133:0/2296238705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25741546c0 0x7f25740712c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f256c00c730 tx=0x7f256c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:47.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f256a7fc640 1 -- 172.21.15.133:0/2296238705 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c00ce40 con 0x7f25741546c0 2023-12-19T19:00:47.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f257ad5f640 1 -- 172.21.15.133:0/2296238705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f256400b6c0 con 0x7f25741546c0 2023-12-19T19:00:47.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f256a7fc640 1 -- 172.21.15.133:0/2296238705 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c00a5e0 con 0x7f25741546c0 2023-12-19T19:00:47.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f256a7fc640 1 -- 172.21.15.133:0/2296238705 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c00a9d0 con 0x7f25741546c0 2023-12-19T19:00:47.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.837+0000 7f257ad5f640 1 -- 172.21.15.133:0/2296238705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2574072130 con 0x7f25741546c0 2023-12-19T19:00:47.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.841+0000 7f257ad5f640 1 -- 172.21.15.133:0/2296238705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f257404e850 con 0x7f25741546c0 2023-12-19T19:00:47.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.841+0000 7f256a7fc640 1 -- 172.21.15.133:0/2296238705 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f256c00ab30 con 0x7f25741546c0 2023-12-19T19:00:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.841+0000 7f256a7fc640 1 --2- 172.21.15.133:0/2296238705 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2558066470 0x7f2558068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.841+0000 7f256a7fc640 1 -- 172.21.15.133:0/2296238705 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f256c0833b0 con 0x7f25741546c0 2023-12-19T19:00:47.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.841+0000 7f2579d5d640 1 --2- 172.21.15.133:0/2296238705 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2558066470 0x7f2558068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:47.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.841+0000 7f2579d5d640 1 --2- 172.21.15.133:0/2296238705 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2558066470 0x7f2558068930 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f25740aa5a0 tx=0x7f2570009240 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:47.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:47.845+0000 7f256a7fc640 1 -- 172.21.15.133:0/2296238705 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f256c050780 con 0x7f25741546c0 2023-12-19T19:00:48.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.001+0000 7f257ad5f640 1 -- 172.21.15.133:0/2296238705 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f25740728c0 con 0x7f25741546c0 2023-12-19T19:00:48.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.665+0000 7f256a7fc640 1 -- 172.21.15.133:0/2296238705 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v52) v1 ==== 172+0+0 (secure 0 0 0) 0x7f256c070e60 con 0x7f25741546c0 2023-12-19T19:00:48.668 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs2_data' created 2023-12-19T19:00:48.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.665+0000 7f257ad5f640 1 -- 172.21.15.133:0/2296238705 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2558066470 msgr2=0x7f2558068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:48.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.665+0000 7f257ad5f640 1 --2- 172.21.15.133:0/2296238705 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2558066470 0x7f2558068930 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f25740aa5a0 tx=0x7f2570009240 comp rx=0 tx=0).stop 2023-12-19T19:00:48.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.665+0000 7f257ad5f640 1 -- 172.21.15.133:0/2296238705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25741546c0 msgr2=0x7f25740712c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:48.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.665+0000 7f257ad5f640 1 --2- 172.21.15.133:0/2296238705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25741546c0 0x7f25740712c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f256c00c730 tx=0x7f256c00cbf0 comp rx=0 tx=0).stop 2023-12-19T19:00:48.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.669+0000 7f257ad5f640 1 -- 172.21.15.133:0/2296238705 shutdown_connections 2023-12-19T19:00:48.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.669+0000 7f257ad5f640 1 --2- 172.21.15.133:0/2296238705 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2558066470 0x7f2558068930 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:48.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.669+0000 7f257ad5f640 1 --2- 172.21.15.133:0/2296238705 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25741546c0 0x7f25740712c0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:48.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.669+0000 7f257ad5f640 1 --2- 172.21.15.133:0/2296238705 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f257406d990 0x7f2574070d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:48.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.669+0000 7f257ad5f640 1 --2- 172.21.15.133:0/2296238705 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f257406c070 0x7f25741e39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:48.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.669+0000 7f257ad5f640 1 -- 172.21.15.133:0/2296238705 >> 172.21.15.133:0/2296238705 conn(0x7f25740a7800 msgr2=0x7f2574154ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:48.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.669+0000 7f257ad5f640 1 -- 172.21.15.133:0/2296238705 shutdown_connections 2023-12-19T19:00:48.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.669+0000 7f257ad5f640 1 -- 172.21.15.133:0/2296238705 wait complete. 2023-12-19T19:00:48.710 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-12-19T19:00:48.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.849+0000 7f1546268640 1 Processor -- start 2023-12-19T19:00:48.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.849+0000 7f1546268640 1 -- start start 2023-12-19T19:00:48.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.849+0000 7f1546268640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15400c63c0 0x7f15400c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:48.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.849+0000 7f1546268640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f15400c2bb0 0x7f15400a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:48.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.849+0000 7f1546268640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15400c31c0 con 0x7f15400c4100 2023-12-19T19:00:48.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.849+0000 7f1546268640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15400c34a0 con 0x7f15400c2bb0 2023-12-19T19:00:48.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.849+0000 7f1546268640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15400c1030 con 0x7f15400c63c0 2023-12-19T19:00:48.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.849+0000 7f1537fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f15400c4100 0x7f15400c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59538/0 (socket says 172.21.15.133:59538) 2023-12-19T19:00:48.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.849+0000 7f1544805640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f15400c2bb0 0x7f15400a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:48.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.849+0000 7f1537fff640 1 -- 172.21.15.133:0/442983904 learned_addr learned my addr 172.21.15.133:0/442983904 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:48.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.849+0000 7f153ffff640 1 --2- 172.21.15.133:0/442983904 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15400c63c0 0x7f15400c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:48.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.853+0000 7f1544805640 1 -- 172.21.15.133:0/442983904 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15400c63c0 msgr2=0x7f15400c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:48.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.853+0000 7f1544805640 1 --2- 172.21.15.133:0/442983904 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15400c63c0 0x7f15400c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:48.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.853+0000 7f1544805640 1 -- 172.21.15.133:0/442983904 >> v1:172.21.15.133:6789/0 conn(0x7f15400c4100 legacy=0x7f15400c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:48.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.853+0000 7f1544805640 1 -- 172.21.15.133:0/442983904 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15400c1310 con 0x7f15400c2bb0 2023-12-19T19:00:48.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.853+0000 7f153f7fe640 1 -- 172.21.15.133:0/442983904 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3243194014 0 0) 0x7f15400c31c0 con 0x7f15400c4100 2023-12-19T19:00:48.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.853+0000 7f1544805640 1 --2- 172.21.15.133:0/442983904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15400c2bb0 0x7f15400a9680 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f1538009d90 tx=0x7f153801c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7735ec990dd4c1c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:48.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.853+0000 7f153f7fe640 1 -- 172.21.15.133:0/442983904 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15400aa3d0 con 0x7f15400c2bb0 2023-12-19T19:00:48.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.853+0000 7f153f7fe640 1 -- 172.21.15.133:0/442983904 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15380a58e0 con 0x7f15400c2bb0 2023-12-19T19:00:48.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.853+0000 7f153f7fe640 1 -- 172.21.15.133:0/442983904 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15380a5c70 con 0x7f15400c2bb0 2023-12-19T19:00:48.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.853+0000 7f1546268640 1 -- 172.21.15.133:0/442983904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15400c2bb0 msgr2=0x7f15400a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:48.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.853+0000 7f1546268640 1 --2- 172.21.15.133:0/442983904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15400c2bb0 0x7f15400a9680 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f1538009d90 tx=0x7f153801c800 comp rx=0 tx=0).stop 2023-12-19T19:00:48.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.853+0000 7f1546268640 1 -- 172.21.15.133:0/442983904 shutdown_connections 2023-12-19T19:00:48.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.853+0000 7f1546268640 1 --2- 172.21.15.133:0/442983904 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15400c2bb0 0x7f15400a9680 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:48.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.853+0000 7f1546268640 1 --2- 172.21.15.133:0/442983904 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15400c63c0 0x7f15400c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:48.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.853+0000 7f1546268640 1 -- 172.21.15.133:0/442983904 >> 172.21.15.133:0/442983904 conn(0x7f154006a5b0 msgr2=0x7f154006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:48.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f1546268640 1 -- 172.21.15.133:0/442983904 shutdown_connections 2023-12-19T19:00:48.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f1546268640 1 -- 172.21.15.133:0/442983904 wait complete. 2023-12-19T19:00:48.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f1546268640 1 Processor -- start 2023-12-19T19:00:48.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f1546268640 1 -- start start 2023-12-19T19:00:48.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f1546268640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15400c2bb0 0x7f154014cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:48.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f1546268640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15400c4100 0x7f154015d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:48.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f1546268640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15400c63c0 0x7f15401f0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:48.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f1546268640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154014d430 con 0x7f15400c2bb0 2023-12-19T19:00:48.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f1546268640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154015cc70 con 0x7f15400c4100 2023-12-19T19:00:48.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f1546268640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154015cf50 con 0x7f15400c63c0 2023-12-19T19:00:48.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f153ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15400c2bb0 0x7f154014cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:48.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f153ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15400c2bb0 0x7f154014cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42902/0 (socket says 172.21.15.133:42902) 2023-12-19T19:00:48.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f153ffff640 1 -- 172.21.15.133:0/2055641018 learned_addr learned my addr 172.21.15.133:0/2055641018 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:48.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f1537fff640 1 --2- 172.21.15.133:0/2055641018 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15400c4100 0x7f154015d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:48.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f1544805640 1 --2- 172.21.15.133:0/2055641018 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15400c63c0 0x7f15401f0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:48.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f153ffff640 1 -- 172.21.15.133:0/2055641018 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15400c63c0 msgr2=0x7f15401f0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:48.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f153ffff640 1 --2- 172.21.15.133:0/2055641018 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15400c63c0 0x7f15401f0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:48.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f153ffff640 1 -- 172.21.15.133:0/2055641018 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15400c4100 msgr2=0x7f154015d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:48.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f153ffff640 1 --2- 172.21.15.133:0/2055641018 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15400c4100 0x7f154015d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:48.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f153ffff640 1 -- 172.21.15.133:0/2055641018 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1538009a70 con 0x7f15400c2bb0 2023-12-19T19:00:48.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f1544805640 1 --2- 172.21.15.133:0/2055641018 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15400c63c0 0x7f15401f0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:48.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f153ffff640 1 --2- 172.21.15.133:0/2055641018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15400c2bb0 0x7f154014cef0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f153000e870 tx=0x7f153000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:48.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f153d7fa640 1 -- 172.21.15.133:0/2055641018 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1530009510 con 0x7f15400c2bb0 2023-12-19T19:00:48.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f153d7fa640 1 -- 172.21.15.133:0/2055641018 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153000eec0 con 0x7f15400c2bb0 2023-12-19T19:00:48.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f1546268640 1 -- 172.21.15.133:0/2055641018 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f154015d230 con 0x7f15400c2bb0 2023-12-19T19:00:48.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f153d7fa640 1 -- 172.21.15.133:0/2055641018 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153000cb40 con 0x7f15400c2bb0 2023-12-19T19:00:48.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.857+0000 7f1546268640 1 -- 172.21.15.133:0/2055641018 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1540150810 con 0x7f15400c2bb0 2023-12-19T19:00:48.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.861+0000 7f1546268640 1 -- 172.21.15.133:0/2055641018 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15401efea0 con 0x7f15400c2bb0 2023-12-19T19:00:48.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.861+0000 7f153d7fa640 1 -- 172.21.15.133:0/2055641018 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f153000cca0 con 0x7f15400c2bb0 2023-12-19T19:00:48.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.861+0000 7f153d7fa640 1 --2- 172.21.15.133:0/2055641018 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1520066470 0x7f1520068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:48.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.861+0000 7f153d7fa640 1 -- 172.21.15.133:0/2055641018 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f15300847b0 con 0x7f15400c2bb0 2023-12-19T19:00:48.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.861+0000 7f1537fff640 1 --2- 172.21.15.133:0/2055641018 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1520066470 0x7f1520068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:48.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.865+0000 7f1537fff640 1 --2- 172.21.15.133:0/2055641018 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1520066470 0x7f1520068930 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f154006af10 tx=0x7f1528007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:48.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:48.865+0000 7f153d7fa640 1 -- 172.21.15.133:0/2055641018 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1530051a60 con 0x7f15400c2bb0 2023-12-19T19:00:49.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.049+0000 7f1546268640 1 -- 172.21.15.133:0/2055641018 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f15401efea0 con 0x7f15400c2bb0 2023-12-19T19:00:49.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.681+0000 7f153d7fa640 1 -- 172.21.15.133:0/2055641018 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 10 and data pool 11 v33) v1 ==== 177+0+0 (secure 0 0 0) 0x7f15401efea0 con 0x7f15400c2bb0 2023-12-19T19:00:49.686 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 10 and data pool 11 2023-12-19T19:00:49.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.685+0000 7f1546268640 1 -- 172.21.15.133:0/2055641018 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1520066470 msgr2=0x7f1520068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:49.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.685+0000 7f1546268640 1 --2- 172.21.15.133:0/2055641018 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1520066470 0x7f1520068930 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f154006af10 tx=0x7f1528007d60 comp rx=0 tx=0).stop 2023-12-19T19:00:49.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.685+0000 7f1546268640 1 -- 172.21.15.133:0/2055641018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15400c2bb0 msgr2=0x7f154014cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:49.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.685+0000 7f1546268640 1 --2- 172.21.15.133:0/2055641018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15400c2bb0 0x7f154014cef0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f153000e870 tx=0x7f153000ec70 comp rx=0 tx=0).stop 2023-12-19T19:00:49.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.689+0000 7f1546268640 1 -- 172.21.15.133:0/2055641018 shutdown_connections 2023-12-19T19:00:49.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.689+0000 7f1546268640 1 --2- 172.21.15.133:0/2055641018 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1520066470 0x7f1520068930 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:49.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.689+0000 7f1546268640 1 --2- 172.21.15.133:0/2055641018 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f15400c63c0 0x7f15401f0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:49.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.689+0000 7f1546268640 1 --2- 172.21.15.133:0/2055641018 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f15400c4100 0x7f154015d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:49.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.689+0000 7f1546268640 1 --2- 172.21.15.133:0/2055641018 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f15400c2bb0 0x7f154014cef0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:49.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.689+0000 7f1546268640 1 -- 172.21.15.133:0/2055641018 >> 172.21.15.133:0/2055641018 conn(0x7f154006a5b0 msgr2=0x7f15400a5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:49.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.689+0000 7f1546268640 1 -- 172.21.15.133:0/2055641018 shutdown_connections 2023-12-19T19:00:49.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.689+0000 7f1546268640 1 -- 172.21.15.133:0/2055641018 wait complete. 2023-12-19T19:00:49.726 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:00:49.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.861+0000 7fa968d65640 1 Processor -- start 2023-12-19T19:00:49.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.861+0000 7fa968d65640 1 -- start start 2023-12-19T19:00:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.861+0000 7fa968d65640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa964151e90 0x7fa9640c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.861+0000 7fa968d65640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa9640c4e60 0x7fa96406bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.861+0000 7fa968d65640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa96406c860 con 0x7fa9640c7ea0 2023-12-19T19:00:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.861+0000 7fa968d65640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9640c8750 con 0x7fa964151e90 2023-12-19T19:00:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.861+0000 7fa968d65640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9641552d0 con 0x7fa9640c4e60 2023-12-19T19:00:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.861+0000 7fa959d9b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa9640c7ea0 0x7fa96406b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59552/0 (socket says 172.21.15.133:59552) 2023-12-19T19:00:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.861+0000 7fa959d9b640 1 -- 172.21.15.133:0/3307876436 learned_addr learned my addr 172.21.15.133:0/3307876436 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.861+0000 7fa96259c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa964151e90 0x7fa9640c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:49.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.861+0000 7fa962d9d640 1 --2- 172.21.15.133:0/3307876436 >> v2:172.21.15.138:3300/0 conn(0x7fa9640c4e60 0x7fa96406bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:49.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.861+0000 7fa96259c640 1 -- 172.21.15.133:0/3307876436 >> v2:172.21.15.138:3300/0 conn(0x7fa9640c4e60 msgr2=0x7fa96406bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:49.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.861+0000 7fa96259c640 1 --2- 172.21.15.133:0/3307876436 >> v2:172.21.15.138:3300/0 conn(0x7fa9640c4e60 0x7fa96406bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:49.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.861+0000 7fa96259c640 1 -- 172.21.15.133:0/3307876436 >> v1:172.21.15.133:6789/0 conn(0x7fa9640c7ea0 legacy=0x7fa96406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:49.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.861+0000 7fa96259c640 1 -- 172.21.15.133:0/3307876436 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa964154930 con 0x7fa964151e90 2023-12-19T19:00:49.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.865+0000 7fa96259c640 1 --2- 172.21.15.133:0/3307876436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa964151e90 0x7fa9640c4920 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa96408c190 tx=0x7fa94c01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b8d8abb04e87b07 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:49.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.865+0000 7fa961d9b640 1 -- 172.21.15.133:0/3307876436 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c0ab600 con 0x7fa964151e90 2023-12-19T19:00:49.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.865+0000 7fa961d9b640 1 -- 172.21.15.133:0/3307876436 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa94c0a7050 con 0x7fa964151e90 2023-12-19T19:00:49.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.865+0000 7fa961d9b640 1 -- 172.21.15.133:0/3307876436 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa94c0ab980 con 0x7fa964151e90 2023-12-19T19:00:49.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.865+0000 7fa968d65640 1 -- 172.21.15.133:0/3307876436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa964151e90 msgr2=0x7fa9640c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:49.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.865+0000 7fa968d65640 1 --2- 172.21.15.133:0/3307876436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa964151e90 0x7fa9640c4920 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa96408c190 tx=0x7fa94c01c340 comp rx=0 tx=0).stop 2023-12-19T19:00:49.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.865+0000 7fa968d65640 1 -- 172.21.15.133:0/3307876436 shutdown_connections 2023-12-19T19:00:49.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.865+0000 7fa968d65640 1 --2- 172.21.15.133:0/3307876436 >> v2:172.21.15.138:3300/0 conn(0x7fa9640c4e60 0x7fa96406bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:49.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.865+0000 7fa968d65640 1 --2- 172.21.15.133:0/3307876436 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa964151e90 0x7fa9640c4920 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:49.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.865+0000 7fa968d65640 1 -- 172.21.15.133:0/3307876436 >> 172.21.15.133:0/3307876436 conn(0x7fa9640ca170 msgr2=0x7fa9640ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:49.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.865+0000 7fa968d65640 1 -- 172.21.15.133:0/3307876436 shutdown_connections 2023-12-19T19:00:49.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.865+0000 7fa968d65640 1 -- 172.21.15.133:0/3307876436 wait complete. 2023-12-19T19:00:49.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa968d65640 1 Processor -- start 2023-12-19T19:00:49.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa968d65640 1 -- start start 2023-12-19T19:00:49.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa968d65640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9640c4e60 0x7fa9641ee070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:49.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa968d65640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9640c7ea0 0x7fa964158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa968d65640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa964151e90 0x7fa964156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa968d65640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa964155c40 con 0x7fa964151e90 2023-12-19T19:00:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa968d65640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa964155f20 con 0x7fa9640c7ea0 2023-12-19T19:00:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa968d65640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa964156200 con 0x7fa9640c4e60 2023-12-19T19:00:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa962d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa964151e90 0x7fa964156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa962d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa964151e90 0x7fa964156ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42922/0 (socket says 172.21.15.133:42922) 2023-12-19T19:00:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa962d9d640 1 -- 172.21.15.133:0/4162515328 learned_addr learned my addr 172.21.15.133:0/4162515328 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa96259c640 1 --2- 172.21.15.133:0/4162515328 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9640c4e60 0x7fa9641ee070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa959d9b640 1 --2- 172.21.15.133:0/4162515328 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9640c7ea0 0x7fa964158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa962d9d640 1 -- 172.21.15.133:0/4162515328 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9640c4e60 msgr2=0x7fa9641ee070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa962d9d640 1 --2- 172.21.15.133:0/4162515328 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9640c4e60 0x7fa9641ee070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa962d9d640 1 -- 172.21.15.133:0/4162515328 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9640c7ea0 msgr2=0x7fa964158660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa962d9d640 1 --2- 172.21.15.133:0/4162515328 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9640c7ea0 0x7fa964158660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:49.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa962d9d640 1 -- 172.21.15.133:0/4162515328 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa94c009420 con 0x7fa964151e90 2023-12-19T19:00:49.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa962d9d640 1 --2- 172.21.15.133:0/4162515328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa964151e90 0x7fa964156ce0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa95c007e60 tx=0x7fa95c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:49.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa95b7fe640 1 -- 172.21.15.133:0/4162515328 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c014420 con 0x7fa964151e90 2023-12-19T19:00:49.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa95b7fe640 1 -- 172.21.15.133:0/4162515328 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95c0145a0 con 0x7fa964151e90 2023-12-19T19:00:49.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa95b7fe640 1 -- 172.21.15.133:0/4162515328 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa95c014950 con 0x7fa964151e90 2023-12-19T19:00:49.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa968d65640 1 -- 172.21.15.133:0/4162515328 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9641564e0 con 0x7fa964151e90 2023-12-19T19:00:49.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.869+0000 7fa968d65640 1 -- 172.21.15.133:0/4162515328 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa964158ba0 con 0x7fa964151e90 2023-12-19T19:00:49.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.873+0000 7fa968d65640 1 -- 172.21.15.133:0/4162515328 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa964156a00 con 0x7fa964151e90 2023-12-19T19:00:49.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.873+0000 7fa95b7fe640 1 -- 172.21.15.133:0/4162515328 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa95c014ab0 con 0x7fa964151e90 2023-12-19T19:00:49.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.873+0000 7fa95b7fe640 1 --2- 172.21.15.133:0/4162515328 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa9440664a0 0x7fa944068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:49.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.873+0000 7fa95b7fe640 1 -- 172.21.15.133:0/4162515328 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa95c084a20 con 0x7fa964151e90 2023-12-19T19:00:49.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.873+0000 7fa96259c640 1 --2- 172.21.15.133:0/4162515328 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa9440664a0 0x7fa944068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:49.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.873+0000 7fa96259c640 1 --2- 172.21.15.133:0/4162515328 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa9440664a0 0x7fa944068960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa94c0ad000 tx=0x7fa94c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:49.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:49.877+0000 7fa95b7fe640 1 -- 172.21.15.133:0/4162515328 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa964156a00 con 0x7fa964151e90 2023-12-19T19:00:50.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.029+0000 7fa968d65640 1 -- 172.21.15.133:0/4162515328 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa964156a00 con 0x7fa964151e90 2023-12-19T19:00:50.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.029+0000 7fa95b7fe640 1 -- 172.21.15.133:0/4162515328 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20329 (secure 0 0 0) 0x7fa964156a00 con 0x7fa964151e90 2023-12-19T19:00:50.033 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:50.034 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":53,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:00:49.053178+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:00:29.085029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T19:00:30.359577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:00:46.784805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:00:48.051355+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:00:50.035 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.033+0000 7fa968d65640 1 -- 172.21.15.133:0/4162515328 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa9440664a0 msgr2=0x7fa944068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:50.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.033+0000 7fa968d65640 1 --2- 172.21.15.133:0/4162515328 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa9440664a0 0x7fa944068960 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa94c0ad000 tx=0x7fa94c0a6000 comp rx=0 tx=0).stop 2023-12-19T19:00:50.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.033+0000 7fa968d65640 1 -- 172.21.15.133:0/4162515328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa964151e90 msgr2=0x7fa964156ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:50.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.033+0000 7fa968d65640 1 --2- 172.21.15.133:0/4162515328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa964151e90 0x7fa964156ce0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa95c007e60 tx=0x7fa95c00e4b0 comp rx=0 tx=0).stop 2023-12-19T19:00:50.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.033+0000 7fa968d65640 1 -- 172.21.15.133:0/4162515328 shutdown_connections 2023-12-19T19:00:50.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.033+0000 7fa968d65640 1 --2- 172.21.15.133:0/4162515328 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa9440664a0 0x7fa944068960 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:50.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.033+0000 7fa968d65640 1 --2- 172.21.15.133:0/4162515328 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa964151e90 0x7fa964156ce0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:50.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.033+0000 7fa968d65640 1 --2- 172.21.15.133:0/4162515328 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9640c7ea0 0x7fa964158660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:50.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.033+0000 7fa968d65640 1 --2- 172.21.15.133:0/4162515328 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9640c4e60 0x7fa9641ee070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:50.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.033+0000 7fa968d65640 1 -- 172.21.15.133:0/4162515328 >> 172.21.15.133:0/4162515328 conn(0x7fa9640ca170 msgr2=0x7fa96414fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:50.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.033+0000 7fa968d65640 1 -- 172.21.15.133:0/4162515328 shutdown_connections 2023-12-19T19:00:50.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.033+0000 7fa968d65640 1 -- 172.21.15.133:0/4162515328 wait complete. 2023-12-19T19:00:50.055 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:00:50.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.189+0000 7f4355a79640 1 Processor -- start 2023-12-19T19:00:50.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.189+0000 7f4355a79640 1 -- start start 2023-12-19T19:00:50.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.189+0000 7f4355a79640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f435006a5b0 0x7f435006a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:50.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.189+0000 7f4355a79640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f435006b1e0 0x7f43500c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:50.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.189+0000 7f4355a79640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4350072500 con 0x7f435006dfe0 2023-12-19T19:00:50.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.189+0000 7f4355a79640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435006ef50 con 0x7f435006b1e0 2023-12-19T19:00:50.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.189+0000 7f4355a79640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43500720b0 con 0x7f435006a5b0 2023-12-19T19:00:50.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.189+0000 7f434ffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f435006b1e0 0x7f43500c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:50.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.189+0000 7f434effd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f435006dfe0 0x7f43500c2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59568/0 (socket says 172.21.15.133:59568) 2023-12-19T19:00:50.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.189+0000 7f434f7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f435006a5b0 0x7f435006a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:50.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.189+0000 7f434effd640 1 -- 172.21.15.133:0/3528584280 learned_addr learned my addr 172.21.15.133:0/3528584280 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:50.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.189+0000 7f434f7fe640 1 -- 172.21.15.133:0/3528584280 >> v2:172.21.15.133:3300/0 conn(0x7f435006b1e0 msgr2=0x7f43500c27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:50.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.189+0000 7f434f7fe640 1 --2- 172.21.15.133:0/3528584280 >> v2:172.21.15.133:3300/0 conn(0x7f435006b1e0 0x7f43500c27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:50.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.189+0000 7f434f7fe640 1 -- 172.21.15.133:0/3528584280 >> v1:172.21.15.133:6789/0 conn(0x7f435006dfe0 legacy=0x7f43500c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:50.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.189+0000 7f434f7fe640 1 -- 172.21.15.133:0/3528584280 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4350070f60 con 0x7f435006a5b0 2023-12-19T19:00:50.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.189+0000 7f434ffff640 1 --2- 172.21.15.133:0/3528584280 >> v2:172.21.15.133:3300/0 conn(0x7f435006b1e0 0x7f43500c27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:00:50.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.189+0000 7f434e7fc640 1 -- 172.21.15.133:0/3528584280 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111413519 0 0) 0x7f4350072500 con 0x7f435006dfe0 2023-12-19T19:00:50.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.193+0000 7f434f7fe640 1 --2- 172.21.15.133:0/3528584280 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f435006a5b0 0x7f435006a990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f43400097c0 tx=0x7f434001c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46f90d6d75de398d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:50.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.193+0000 7f434e7fc640 1 -- 172.21.15.133:0/3528584280 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43400ab600 con 0x7f435006a5b0 2023-12-19T19:00:50.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.193+0000 7f434e7fc640 1 -- 172.21.15.133:0/3528584280 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43400a7050 con 0x7f435006a5b0 2023-12-19T19:00:50.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.193+0000 7f434e7fc640 1 -- 172.21.15.133:0/3528584280 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43400ab980 con 0x7f435006a5b0 2023-12-19T19:00:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.193+0000 7f4355a79640 1 -- 172.21.15.133:0/3528584280 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f435006a5b0 msgr2=0x7f435006a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.193+0000 7f4355a79640 1 --2- 172.21.15.133:0/3528584280 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f435006a5b0 0x7f435006a990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f43400097c0 tx=0x7f434001c3f0 comp rx=0 tx=0).stop 2023-12-19T19:00:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.193+0000 7f4355a79640 1 -- 172.21.15.133:0/3528584280 shutdown_connections 2023-12-19T19:00:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.193+0000 7f4355a79640 1 --2- 172.21.15.133:0/3528584280 >> v2:172.21.15.133:3300/0 conn(0x7f435006b1e0 0x7f43500c27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.193+0000 7f4355a79640 1 --2- 172.21.15.133:0/3528584280 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f435006a5b0 0x7f435006a990 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.193+0000 7f4355a79640 1 -- 172.21.15.133:0/3528584280 >> 172.21.15.133:0/3528584280 conn(0x7f43500c6ef0 msgr2=0x7f43500c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.193+0000 7f4355a79640 1 -- 172.21.15.133:0/3528584280 shutdown_connections 2023-12-19T19:00:50.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.193+0000 7f4355a79640 1 -- 172.21.15.133:0/3528584280 wait complete. 2023-12-19T19:00:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f4355a79640 1 Processor -- start 2023-12-19T19:00:50.199 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f4355a79640 1 -- start start 2023-12-19T19:00:50.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f4355a79640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f435006a5b0 0x7f43501486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:50.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f4355a79640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f435006b1e0 0x7f435014b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:50.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f4355a79640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f435006dfe0 0x7f435013e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:50.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f4355a79640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4350142c20 con 0x7f435006a5b0 2023-12-19T19:00:50.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f4355a79640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435015ed00 con 0x7f435006dfe0 2023-12-19T19:00:50.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f4355a79640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4350146740 con 0x7f435006b1e0 2023-12-19T19:00:50.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f434f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f435006a5b0 0x7f43501486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:50.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f434f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f435006a5b0 0x7f43501486c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42950/0 (socket says 172.21.15.133:42950) 2023-12-19T19:00:50.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f434f7fe640 1 -- 172.21.15.133:0/961319997 learned_addr learned my addr 172.21.15.133:0/961319997 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:50.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f434effd640 1 --2- 172.21.15.133:0/961319997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f435006b1e0 0x7f435014b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:50.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f434ffff640 1 --2- 172.21.15.133:0/961319997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f435006dfe0 0x7f435013e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:50.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f434f7fe640 1 -- 172.21.15.133:0/961319997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f435006b1e0 msgr2=0x7f435014b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:50.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f434f7fe640 1 --2- 172.21.15.133:0/961319997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f435006b1e0 0x7f435014b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:50.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f434f7fe640 1 -- 172.21.15.133:0/961319997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f435006dfe0 msgr2=0x7f435013e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:50.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f434f7fe640 1 --2- 172.21.15.133:0/961319997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f435006dfe0 0x7f435013e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:50.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f434f7fe640 1 -- 172.21.15.133:0/961319997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4348009a70 con 0x7f435006a5b0 2023-12-19T19:00:50.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f434ffff640 1 --2- 172.21.15.133:0/961319997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f435006dfe0 0x7f435013e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:50.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f434f7fe640 1 --2- 172.21.15.133:0/961319997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f435006a5b0 0x7f43501486c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f434001a020 tx=0x7f434001ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:50.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f4337fff640 1 -- 172.21.15.133:0/961319997 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43400b7450 con 0x7f435006a5b0 2023-12-19T19:00:50.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f4337fff640 1 -- 172.21.15.133:0/961319997 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43400b75b0 con 0x7f435006a5b0 2023-12-19T19:00:50.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f4355a79640 1 -- 172.21.15.133:0/961319997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4340009420 con 0x7f435006a5b0 2023-12-19T19:00:50.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f4337fff640 1 -- 172.21.15.133:0/961319997 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43400b7960 con 0x7f435006a5b0 2023-12-19T19:00:50.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f4355a79640 1 -- 172.21.15.133:0/961319997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4350146460 con 0x7f435006a5b0 2023-12-19T19:00:50.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.197+0000 7f4355a79640 1 -- 172.21.15.133:0/961319997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4350142a80 con 0x7f435006a5b0 2023-12-19T19:00:50.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.201+0000 7f4337fff640 1 -- 172.21.15.133:0/961319997 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f43400b7ac0 con 0x7f435006a5b0 2023-12-19T19:00:50.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.201+0000 7f4337fff640 1 --2- 172.21.15.133:0/961319997 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f433c066470 0x7f433c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:50.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.201+0000 7f4337fff640 1 -- 172.21.15.133:0/961319997 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f434011e950 con 0x7f435006a5b0 2023-12-19T19:00:50.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.201+0000 7f434effd640 1 --2- 172.21.15.133:0/961319997 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f433c066470 0x7f433c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:50.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.201+0000 7f434effd640 1 --2- 172.21.15.133:0/961319997 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f433c066470 0x7f433c068930 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4350143600 tx=0x7f4344007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:50.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.205+0000 7f4337fff640 1 -- 172.21.15.133:0/961319997 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4350142a80 con 0x7f435006a5b0 2023-12-19T19:00:50.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.353+0000 7f4355a79640 1 -- 172.21.15.133:0/961319997 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4350142a80 con 0x7f435006a5b0 2023-12-19T19:00:50.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.357+0000 7f4337fff640 1 -- 172.21.15.133:0/961319997 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+20329 (secure 0 0 0) 0x7f4350142a80 con 0x7f435006a5b0 2023-12-19T19:00:50.360 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:50.360 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":53,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:00:49.053178+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:00:29.085029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T19:00:30.359577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:00:46.784805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:00:48.051355+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:00:50.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.357+0000 7f4355a79640 1 -- 172.21.15.133:0/961319997 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f433c066470 msgr2=0x7f433c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:50.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.357+0000 7f4355a79640 1 --2- 172.21.15.133:0/961319997 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f433c066470 0x7f433c068930 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f4350143600 tx=0x7f4344007d60 comp rx=0 tx=0).stop 2023-12-19T19:00:50.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.357+0000 7f4355a79640 1 -- 172.21.15.133:0/961319997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f435006a5b0 msgr2=0x7f43501486c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:50.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.357+0000 7f4355a79640 1 --2- 172.21.15.133:0/961319997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f435006a5b0 0x7f43501486c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f434001a020 tx=0x7f434001ac30 comp rx=0 tx=0).stop 2023-12-19T19:00:50.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.357+0000 7f4355a79640 1 -- 172.21.15.133:0/961319997 shutdown_connections 2023-12-19T19:00:50.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.357+0000 7f4355a79640 1 --2- 172.21.15.133:0/961319997 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f433c066470 0x7f433c068930 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:50.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.357+0000 7f4355a79640 1 --2- 172.21.15.133:0/961319997 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f435006dfe0 0x7f435013e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:50.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.357+0000 7f4355a79640 1 --2- 172.21.15.133:0/961319997 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f435006b1e0 0x7f435014b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:50.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.357+0000 7f4355a79640 1 --2- 172.21.15.133:0/961319997 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f435006a5b0 0x7f43501486c0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:50.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.357+0000 7f4355a79640 1 -- 172.21.15.133:0/961319997 >> 172.21.15.133:0/961319997 conn(0x7f43500c6ef0 msgr2=0x7f43501420c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:50.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.357+0000 7f4355a79640 1 -- 172.21.15.133:0/961319997 shutdown_connections 2023-12-19T19:00:50.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.357+0000 7f4355a79640 1 -- 172.21.15.133:0/961319997 wait complete. 2023-12-19T19:00:50.382 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-12-19T19:00:50.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.517+0000 7f89925f2640 1 Processor -- start 2023-12-19T19:00:50.522 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.517+0000 7f89925f2640 1 -- start start 2023-12-19T19:00:50.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.521+0000 7f89925f2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f898c0a7160 0x7f898c0c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:50.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.521+0000 7f89925f2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f898c0c6a00 0x7f898c0c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:50.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.521+0000 7f89925f2640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f898c0c1600 0x7f898c0c1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:50.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.521+0000 7f89925f2640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f898c0c1ff0 con 0x7f898c0c6a00 2023-12-19T19:00:50.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.521+0000 7f89925f2640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f898c0c2fc0 con 0x7f898c0c1600 2023-12-19T19:00:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.521+0000 7f89925f2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898c0c73b0 con 0x7f898c0a7160 2023-12-19T19:00:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.521+0000 7f8990def640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f898c0c6a00 0x7f898c0c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.521+0000 7f8990def640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f898c0c6a00 0x7f898c0c49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42962/0 (socket says 172.21.15.133:42962) 2023-12-19T19:00:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.521+0000 7f8990def640 1 -- 172.21.15.133:0/1660970187 learned_addr learned my addr 172.21.15.133:0/1660970187 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.521+0000 7f89915f0640 1 --2- 172.21.15.133:0/1660970187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f898c0a7160 0x7f898c0c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.521+0000 7f8991df1640 1 --2- 172.21.15.133:0/1660970187 >> v2:172.21.15.138:3300/0 conn(0x7f898c0c1600 0x7f898c0c1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.521+0000 7f8990def640 1 -- 172.21.15.133:0/1660970187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f898c0a7160 msgr2=0x7f898c0c44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.521+0000 7f8990def640 1 --2- 172.21.15.133:0/1660970187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f898c0a7160 0x7f898c0c44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.521+0000 7f8990def640 1 -- 172.21.15.133:0/1660970187 >> v2:172.21.15.138:3300/0 conn(0x7f898c0c1600 msgr2=0x7f898c0c1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.521+0000 7f8990def640 1 --2- 172.21.15.133:0/1660970187 >> v2:172.21.15.138:3300/0 conn(0x7f898c0c1600 0x7f898c0c1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:50.525 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.521+0000 7f8990def640 1 -- 172.21.15.133:0/1660970187 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c0c7690 con 0x7f898c0c6a00 2023-12-19T19:00:50.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.525+0000 7f8990def640 1 --2- 172.21.15.133:0/1660970187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f898c0c6a00 0x7f898c0c49e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f898c071dd0 tx=0x7f897c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c45655e3056e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:50.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.525+0000 7f8983fff640 1 -- 172.21.15.133:0/1660970187 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c0aa610 con 0x7f898c0c6a00 2023-12-19T19:00:50.527 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.525+0000 7f8983fff640 1 -- 172.21.15.133:0/1660970187 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897c0a6040 con 0x7f898c0c6a00 2023-12-19T19:00:50.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.525+0000 7f8983fff640 1 -- 172.21.15.133:0/1660970187 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c0aa990 con 0x7f898c0c6a00 2023-12-19T19:00:50.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.525+0000 7f89925f2640 1 -- 172.21.15.133:0/1660970187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f898c0c6a00 msgr2=0x7f898c0c49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:50.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.525+0000 7f89925f2640 1 --2- 172.21.15.133:0/1660970187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f898c0c6a00 0x7f898c0c49e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f898c071dd0 tx=0x7f897c01c4d0 comp rx=0 tx=0).stop 2023-12-19T19:00:50.528 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.525+0000 7f89925f2640 1 -- 172.21.15.133:0/1660970187 shutdown_connections 2023-12-19T19:00:50.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.525+0000 7f89925f2640 1 --2- 172.21.15.133:0/1660970187 >> v2:172.21.15.138:3300/0 conn(0x7f898c0c1600 0x7f898c0c1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:50.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.525+0000 7f89925f2640 1 --2- 172.21.15.133:0/1660970187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f898c0c6a00 0x7f898c0c49e0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:50.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.525+0000 7f89925f2640 1 --2- 172.21.15.133:0/1660970187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f898c0a7160 0x7f898c0c44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:50.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.525+0000 7f89925f2640 1 -- 172.21.15.133:0/1660970187 >> 172.21.15.133:0/1660970187 conn(0x7f898c0c7b10 msgr2=0x7f898c0c7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:50.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.525+0000 7f89925f2640 1 -- 172.21.15.133:0/1660970187 shutdown_connections 2023-12-19T19:00:50.529 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.525+0000 7f89925f2640 1 -- 172.21.15.133:0/1660970187 wait complete. 2023-12-19T19:00:50.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.525+0000 7f89925f2640 1 Processor -- start 2023-12-19T19:00:50.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.525+0000 7f89925f2640 1 -- start start 2023-12-19T19:00:50.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.525+0000 7f89925f2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f898c0a7160 0x7f898c14eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:50.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.525+0000 7f89925f2640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f898c0c1600 0x7f898c1f0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:50.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.525+0000 7f89925f2640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f898c0c6a00 0x7f898c0ac930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:50.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.525+0000 7f89925f2640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898c0a7ce0 con 0x7f898c0c1600 2023-12-19T19:00:50.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.525+0000 7f89925f2640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898c14fb10 con 0x7f898c0c6a00 2023-12-19T19:00:50.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.525+0000 7f89925f2640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898c14fdf0 con 0x7f898c0a7160 2023-12-19T19:00:50.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.529+0000 7f8990def640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f898c0c1600 0x7f898c1f0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:50.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.529+0000 7f8990def640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f898c0c1600 0x7f898c1f0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42968/0 (socket says 172.21.15.133:42968) 2023-12-19T19:00:50.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.529+0000 7f8990def640 1 -- 172.21.15.133:0/2132066967 learned_addr learned my addr 172.21.15.133:0/2132066967 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:50.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.529+0000 7f89915f0640 1 --2- 172.21.15.133:0/2132066967 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f898c0a7160 0x7f898c14eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:50.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.529+0000 7f8991df1640 1 --2- 172.21.15.133:0/2132066967 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f898c0c6a00 0x7f898c0ac930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:50.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.529+0000 7f8990def640 1 -- 172.21.15.133:0/2132066967 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f898c0a7160 msgr2=0x7f898c14eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:50.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.529+0000 7f8990def640 1 --2- 172.21.15.133:0/2132066967 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f898c0a7160 0x7f898c14eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:50.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.529+0000 7f8990def640 1 -- 172.21.15.133:0/2132066967 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f898c0c6a00 msgr2=0x7f898c0ac930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:50.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.529+0000 7f8990def640 1 --2- 172.21.15.133:0/2132066967 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f898c0c6a00 0x7f898c0ac930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:50.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.529+0000 7f8990def640 1 -- 172.21.15.133:0/2132066967 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f897c0094d0 con 0x7f898c0c1600 2023-12-19T19:00:50.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.529+0000 7f8990def640 1 --2- 172.21.15.133:0/2132066967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f898c0c1600 0x7f898c1f0610 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f897c01ab80 tx=0x7f897c01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:50.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.529+0000 7f8981ffb640 1 -- 172.21.15.133:0/2132066967 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c0bd3f0 con 0x7f898c0c1600 2023-12-19T19:00:50.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.529+0000 7f8981ffb640 1 -- 172.21.15.133:0/2132066967 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f897c0bd550 con 0x7f898c0c1600 2023-12-19T19:00:50.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.529+0000 7f8981ffb640 1 -- 172.21.15.133:0/2132066967 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f897c0bd900 con 0x7f898c0c1600 2023-12-19T19:00:50.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.529+0000 7f89925f2640 1 -- 172.21.15.133:0/2132066967 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f898c0c6850 con 0x7f898c0c1600 2023-12-19T19:00:50.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.529+0000 7f89925f2640 1 -- 172.21.15.133:0/2132066967 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f898c14e2c0 con 0x7f898c0c1600 2023-12-19T19:00:50.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.529+0000 7f89925f2640 1 -- 172.21.15.133:0/2132066967 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f898c068050 con 0x7f898c0c1600 2023-12-19T19:00:50.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.529+0000 7f8981ffb640 1 -- 172.21.15.133:0/2132066967 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f897c0b33f0 con 0x7f898c0c1600 2023-12-19T19:00:50.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.533+0000 7f8981ffb640 1 --2- 172.21.15.133:0/2132066967 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8970066470 0x7f8970068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:50.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.533+0000 7f8981ffb640 1 -- 172.21.15.133:0/2132066967 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f897c11e8f0 con 0x7f898c0c1600 2023-12-19T19:00:50.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.533+0000 7f89915f0640 1 --2- 172.21.15.133:0/2132066967 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8970066470 0x7f8970068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:50.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.533+0000 7f89915f0640 1 --2- 172.21.15.133:0/2132066967 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8970066470 0x7f8970068930 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8988009ac0 tx=0x7f8988009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:50.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.537+0000 7f8981ffb640 1 -- 172.21.15.133:0/2132066967 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f897c0ebac0 con 0x7f898c0c1600 2023-12-19T19:00:50.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:50.721+0000 7f89925f2640 1 -- 172.21.15.133:0/2132066967 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f898c04e850 con 0x7f898c0c1600 2023-12-19T19:00:50.945 INFO:tasks.ceph.mds.b.smithi138.stderr:2023-12-19T19:00:50.941+0000 7fc3fd19e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T19:00:51.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.701+0000 7f8981ffb640 1 -- 172.21.15.133:0/2132066967 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v36) v1 ==== 119+0+0 (secure 0 0 0) 0x7f897c0ef0e0 con 0x7f898c0c1600 2023-12-19T19:00:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.701+0000 7f89925f2640 1 -- 172.21.15.133:0/2132066967 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8970066470 msgr2=0x7f8970068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.701+0000 7f89925f2640 1 --2- 172.21.15.133:0/2132066967 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8970066470 0x7f8970068930 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8988009ac0 tx=0x7f8988009190 comp rx=0 tx=0).stop 2023-12-19T19:00:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.701+0000 7f89925f2640 1 -- 172.21.15.133:0/2132066967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f898c0c1600 msgr2=0x7f898c1f0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.701+0000 7f89925f2640 1 --2- 172.21.15.133:0/2132066967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f898c0c1600 0x7f898c1f0610 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f897c01ab80 tx=0x7f897c01ad10 comp rx=0 tx=0).stop 2023-12-19T19:00:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.701+0000 7f89925f2640 1 -- 172.21.15.133:0/2132066967 shutdown_connections 2023-12-19T19:00:51.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.701+0000 7f89925f2640 1 --2- 172.21.15.133:0/2132066967 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8970066470 0x7f8970068930 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.701+0000 7f89925f2640 1 --2- 172.21.15.133:0/2132066967 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f898c0c6a00 0x7f898c0ac930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.701+0000 7f89925f2640 1 --2- 172.21.15.133:0/2132066967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f898c0c1600 0x7f898c1f0610 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.701+0000 7f89925f2640 1 --2- 172.21.15.133:0/2132066967 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f898c0a7160 0x7f898c14eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.701+0000 7f89925f2640 1 -- 172.21.15.133:0/2132066967 >> 172.21.15.133:0/2132066967 conn(0x7f898c0c7b10 msgr2=0x7f898c0c7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.701+0000 7f89925f2640 1 -- 172.21.15.133:0/2132066967 shutdown_connections 2023-12-19T19:00:51.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.701+0000 7f89925f2640 1 -- 172.21.15.133:0/2132066967 wait complete. 2023-12-19T19:00:51.726 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T19:00:51.727 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-12-19T19:00:51.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.865+0000 7fddda172640 1 Processor -- start 2023-12-19T19:00:51.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.865+0000 7fddda172640 1 -- start start 2023-12-19T19:00:51.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.865+0000 7fddda172640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fddd40c5640 0x7fddd40c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:51.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.865+0000 7fddda172640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fddd40c60f0 0x7fddd4155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:51.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.865+0000 7fddda172640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd40c2580 con 0x7fddd40c5260 2023-12-19T19:00:51.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.865+0000 7fddda172640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd4153510 con 0x7fddd40c60f0 2023-12-19T19:00:51.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.865+0000 7fddda172640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd40c17f0 con 0x7fddd40c5640 2023-12-19T19:00:51.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.865+0000 7fddd3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fddd40c60f0 0x7fddd4155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:51.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.865+0000 7fddd37fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fddd40c5260 0x7fddd406d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59576/0 (socket says 172.21.15.133:59576) 2023-12-19T19:00:51.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.865+0000 7fddd37fe640 1 -- 172.21.15.133:0/3274536361 learned_addr learned my addr 172.21.15.133:0/3274536361 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:51.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.865+0000 7fddd2ffd640 1 --2- 172.21.15.133:0/3274536361 >> v2:172.21.15.138:3300/0 conn(0x7fddd40c5640 0x7fddd40c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:51.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.865+0000 7fddd3fff640 1 -- 172.21.15.133:0/3274536361 >> v2:172.21.15.138:3300/0 conn(0x7fddd40c5640 msgr2=0x7fddd40c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:51.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.865+0000 7fddd3fff640 1 --2- 172.21.15.133:0/3274536361 >> v2:172.21.15.138:3300/0 conn(0x7fddd40c5640 0x7fddd40c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:51.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.865+0000 7fddd3fff640 1 -- 172.21.15.133:0/3274536361 >> v1:172.21.15.133:6789/0 conn(0x7fddd40c5260 legacy=0x7fddd406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:51.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.865+0000 7fddd3fff640 1 -- 172.21.15.133:0/3274536361 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd40c1a00 con 0x7fddd40c60f0 2023-12-19T19:00:51.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.865+0000 7fddd27fc640 1 -- 172.21.15.133:0/3274536361 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3719388086 0 0) 0x7fddd40c2580 con 0x7fddd40c5260 2023-12-19T19:00:51.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.869+0000 7fddd3fff640 1 --2- 172.21.15.133:0/3274536361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddd40c60f0 0x7fddd4155de0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fddd406b390 tx=0x7fddcc01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb3e5a2ae838dbc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:51.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.869+0000 7fddd27fc640 1 -- 172.21.15.133:0/3274536361 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc0a5910 con 0x7fddd40c60f0 2023-12-19T19:00:51.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.869+0000 7fddd27fc640 1 -- 172.21.15.133:0/3274536361 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddcc0a5a70 con 0x7fddd40c60f0 2023-12-19T19:00:51.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.869+0000 7fddd27fc640 1 -- 172.21.15.133:0/3274536361 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc0a5e00 con 0x7fddd40c60f0 2023-12-19T19:00:51.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.869+0000 7fddda172640 1 -- 172.21.15.133:0/3274536361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddd40c60f0 msgr2=0x7fddd4155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:51.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.869+0000 7fddda172640 1 --2- 172.21.15.133:0/3274536361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddd40c60f0 0x7fddd4155de0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fddd406b390 tx=0x7fddcc01c850 comp rx=0 tx=0).stop 2023-12-19T19:00:51.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.869+0000 7fddda172640 1 -- 172.21.15.133:0/3274536361 shutdown_connections 2023-12-19T19:00:51.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.869+0000 7fddda172640 1 --2- 172.21.15.133:0/3274536361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddd40c60f0 0x7fddd4155de0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:51.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.869+0000 7fddda172640 1 --2- 172.21.15.133:0/3274536361 >> v2:172.21.15.138:3300/0 conn(0x7fddd40c5640 0x7fddd40c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:51.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.869+0000 7fddda172640 1 -- 172.21.15.133:0/3274536361 >> 172.21.15.133:0/3274536361 conn(0x7fddd406a5b0 msgr2=0x7fddd406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:51.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.869+0000 7fddda172640 1 -- 172.21.15.133:0/3274536361 shutdown_connections 2023-12-19T19:00:51.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.869+0000 7fddda172640 1 -- 172.21.15.133:0/3274536361 wait complete. 2023-12-19T19:00:51.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.873+0000 7fddda172640 1 Processor -- start 2023-12-19T19:00:51.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.873+0000 7fddda172640 1 -- start start 2023-12-19T19:00:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.873+0000 7fddda172640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddd40c5260 0x7fddd40a9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.873+0000 7fddda172640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddd40c5640 0x7fddd414e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.873+0000 7fddda172640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddd40c60f0 0x7fddd414ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.873+0000 7fddda172640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40a88c0 con 0x7fddd40c60f0 2023-12-19T19:00:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.873+0000 7fddda172640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd4157e70 con 0x7fddd40c5260 2023-12-19T19:00:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.873+0000 7fddda172640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd41ee950 con 0x7fddd40c5640 2023-12-19T19:00:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.873+0000 7fddd3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddd40c60f0 0x7fddd414ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.873+0000 7fddd3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddd40c60f0 0x7fddd414ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:42994/0 (socket says 172.21.15.133:42994) 2023-12-19T19:00:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.873+0000 7fddd3fff640 1 -- 172.21.15.133:0/1773694087 learned_addr learned my addr 172.21.15.133:0/1773694087 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:51.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.873+0000 7fddd37fe640 1 --2- 172.21.15.133:0/1773694087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddd40c5260 0x7fddd40a9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.873+0000 7fddd2ffd640 1 --2- 172.21.15.133:0/1773694087 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddd40c5640 0x7fddd414e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.873+0000 7fddd3fff640 1 -- 172.21.15.133:0/1773694087 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddd40c5640 msgr2=0x7fddd414e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.873+0000 7fddd3fff640 1 --2- 172.21.15.133:0/1773694087 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddd40c5640 0x7fddd414e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.873+0000 7fddd3fff640 1 -- 172.21.15.133:0/1773694087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddd40c5260 msgr2=0x7fddd40a9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.873+0000 7fddd3fff640 1 --2- 172.21.15.133:0/1773694087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddd40c5260 0x7fddd40a9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.873+0000 7fddd3fff640 1 -- 172.21.15.133:0/1773694087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddcc009a70 con 0x7fddd40c60f0 2023-12-19T19:00:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.873+0000 7fddd3fff640 1 --2- 172.21.15.133:0/1773694087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddd40c60f0 0x7fddd414ece0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fddcc0b0040 tx=0x7fddcc0195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.873+0000 7fddbbfff640 1 -- 172.21.15.133:0/1773694087 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc0ad850 con 0x7fddd40c60f0 2023-12-19T19:00:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.873+0000 7fddbbfff640 1 -- 172.21.15.133:0/1773694087 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddcc0ad9b0 con 0x7fddd40c60f0 2023-12-19T19:00:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.877+0000 7fddda172640 1 -- 172.21.15.133:0/1773694087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd414f220 con 0x7fddd40c60f0 2023-12-19T19:00:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.877+0000 7fddbbfff640 1 -- 172.21.15.133:0/1773694087 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc0add60 con 0x7fddd40c60f0 2023-12-19T19:00:51.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.877+0000 7fddda172640 1 -- 172.21.15.133:0/1773694087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd40a85e0 con 0x7fddd40c60f0 2023-12-19T19:00:51.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.877+0000 7fddda172640 1 -- 172.21.15.133:0/1773694087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd41eeae0 con 0x7fddd40c60f0 2023-12-19T19:00:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.877+0000 7fddbbfff640 1 -- 172.21.15.133:0/1773694087 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fddcc0b4050 con 0x7fddd40c60f0 2023-12-19T19:00:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.877+0000 7fddbbfff640 1 --2- 172.21.15.133:0/1773694087 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fddc0066470 0x7fddc0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.877+0000 7fddbbfff640 1 -- 172.21.15.133:0/1773694087 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fddcc11f2f0 con 0x7fddd40c60f0 2023-12-19T19:00:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.877+0000 7fddd37fe640 1 --2- 172.21.15.133:0/1773694087 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fddc0066470 0x7fddc0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:51.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.877+0000 7fddd37fe640 1 --2- 172.21.15.133:0/1773694087 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fddc0066470 0x7fddc0068930 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fddc4000f70 tx=0x7fddc4007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:51.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:51.881+0000 7fddbbfff640 1 -- 172.21.15.133:0/1773694087 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fddcc0ec5d0 con 0x7fddd40c60f0 2023-12-19T19:00:52.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.069+0000 7fddda172640 1 -- 172.21.15.133:0/1773694087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fddd4068400 con 0x7fddd40c60f0 2023-12-19T19:00:52.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.701+0000 7fddbbfff640 1 -- 172.21.15.133:0/1773694087 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v37) v1 ==== 123+0+0 (secure 0 0 0) 0x7fddcc0efbf0 con 0x7fddd40c60f0 2023-12-19T19:00:52.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.705+0000 7fddda172640 1 -- 172.21.15.133:0/1773694087 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fddc0066470 msgr2=0x7fddc0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:52.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.705+0000 7fddda172640 1 --2- 172.21.15.133:0/1773694087 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fddc0066470 0x7fddc0068930 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fddc4000f70 tx=0x7fddc4007df0 comp rx=0 tx=0).stop 2023-12-19T19:00:52.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.705+0000 7fddda172640 1 -- 172.21.15.133:0/1773694087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddd40c60f0 msgr2=0x7fddd414ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:52.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.705+0000 7fddda172640 1 --2- 172.21.15.133:0/1773694087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddd40c60f0 0x7fddd414ece0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fddcc0b0040 tx=0x7fddcc0195f0 comp rx=0 tx=0).stop 2023-12-19T19:00:52.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.705+0000 7fddda172640 1 -- 172.21.15.133:0/1773694087 shutdown_connections 2023-12-19T19:00:52.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.705+0000 7fddda172640 1 --2- 172.21.15.133:0/1773694087 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fddc0066470 0x7fddc0068930 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:52.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.705+0000 7fddda172640 1 --2- 172.21.15.133:0/1773694087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddd40c60f0 0x7fddd414ece0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:52.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.705+0000 7fddda172640 1 --2- 172.21.15.133:0/1773694087 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddd40c5640 0x7fddd414e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:52.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.705+0000 7fddda172640 1 --2- 172.21.15.133:0/1773694087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddd40c5260 0x7fddd40a9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:52.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.705+0000 7fddda172640 1 -- 172.21.15.133:0/1773694087 >> 172.21.15.133:0/1773694087 conn(0x7fddd406a5b0 msgr2=0x7fddd41543f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:52.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.705+0000 7fddda172640 1 -- 172.21.15.133:0/1773694087 shutdown_connections 2023-12-19T19:00:52.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.705+0000 7fddda172640 1 -- 172.21.15.133:0/1773694087 wait complete. 2023-12-19T19:00:52.730 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-12-19T19:00:52.730 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:00:52.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.865+0000 7faf9ca17640 1 Processor -- start 2023-12-19T19:00:52.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.865+0000 7faf9ca17640 1 -- start start 2023-12-19T19:00:52.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.865+0000 7faf9ca17640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faf980c5260 0x7faf9806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:52.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.865+0000 7faf9ca17640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7faf980c5640 0x7faf980c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.865+0000 7faf9ca17640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf980c60f0 0x7faf98155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.865+0000 7faf9ca17640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf980c17f0 con 0x7faf980c5260 2023-12-19T19:00:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.865+0000 7faf9ca17640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf980c2580 con 0x7faf980c5640 2023-12-19T19:00:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.865+0000 7faf9ca17640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf980c1a00 con 0x7faf980c60f0 2023-12-19T19:00:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.869+0000 7faf9659c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faf980c5260 0x7faf9806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.869+0000 7faf9659c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7faf980c5260 0x7faf9806d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43006/0 (socket says 172.21.15.133:43006) 2023-12-19T19:00:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.869+0000 7faf9659c640 1 -- 172.21.15.133:0/2624301232 learned_addr learned my addr 172.21.15.133:0/2624301232 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.869+0000 7faf96d9d640 1 --2- 172.21.15.133:0/2624301232 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf980c60f0 0x7faf98155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.869+0000 7faf95d9b640 1 --2- 172.21.15.133:0/2624301232 >> v2:172.21.15.138:3300/0 conn(0x7faf980c5640 0x7faf980c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.869+0000 7faf9659c640 1 -- 172.21.15.133:0/2624301232 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf980c60f0 msgr2=0x7faf98155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.869+0000 7faf9659c640 1 --2- 172.21.15.133:0/2624301232 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf980c60f0 0x7faf98155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.869+0000 7faf9659c640 1 -- 172.21.15.133:0/2624301232 >> v2:172.21.15.138:3300/0 conn(0x7faf980c5640 msgr2=0x7faf980c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:52.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.869+0000 7faf9659c640 1 --2- 172.21.15.133:0/2624301232 >> v2:172.21.15.138:3300/0 conn(0x7faf980c5640 0x7faf980c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:52.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.869+0000 7faf9659c640 1 -- 172.21.15.133:0/2624301232 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf980c1ce0 con 0x7faf980c5260 2023-12-19T19:00:52.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.869+0000 7faf95d9b640 1 --2- 172.21.15.133:0/2624301232 >> v2:172.21.15.138:3300/0 conn(0x7faf980c5640 0x7faf980c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:52.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.869+0000 7faf9659c640 1 --2- 172.21.15.133:0/2624301232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf980c5260 0x7faf9806d5b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7faf9806b390 tx=0x7faf8801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af065203d3ce81e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:52.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.869+0000 7faf9559a640 1 -- 172.21.15.133:0/2624301232 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf880ac640 con 0x7faf980c5260 2023-12-19T19:00:52.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.869+0000 7faf9559a640 1 -- 172.21.15.133:0/2624301232 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf880ac7a0 con 0x7faf980c5260 2023-12-19T19:00:52.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.869+0000 7faf9559a640 1 -- 172.21.15.133:0/2624301232 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf880acb30 con 0x7faf980c5260 2023-12-19T19:00:52.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.873+0000 7faf9ca17640 1 -- 172.21.15.133:0/2624301232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf980c5260 msgr2=0x7faf9806d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:52.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.873+0000 7faf9ca17640 1 --2- 172.21.15.133:0/2624301232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf980c5260 0x7faf9806d5b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7faf9806b390 tx=0x7faf8801c440 comp rx=0 tx=0).stop 2023-12-19T19:00:52.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.873+0000 7faf9ca17640 1 -- 172.21.15.133:0/2624301232 shutdown_connections 2023-12-19T19:00:52.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.873+0000 7faf9ca17640 1 --2- 172.21.15.133:0/2624301232 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf980c60f0 0x7faf98155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:52.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.873+0000 7faf9ca17640 1 --2- 172.21.15.133:0/2624301232 >> v2:172.21.15.138:3300/0 conn(0x7faf980c5640 0x7faf980c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:52.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.873+0000 7faf9ca17640 1 --2- 172.21.15.133:0/2624301232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf980c5260 0x7faf9806d5b0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:52.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.873+0000 7faf9ca17640 1 -- 172.21.15.133:0/2624301232 >> 172.21.15.133:0/2624301232 conn(0x7faf9806a5b0 msgr2=0x7faf9806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:52.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.873+0000 7faf9ca17640 1 -- 172.21.15.133:0/2624301232 shutdown_connections 2023-12-19T19:00:52.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.873+0000 7faf9ca17640 1 -- 172.21.15.133:0/2624301232 wait complete. 2023-12-19T19:00:52.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.873+0000 7faf9ca17640 1 Processor -- start 2023-12-19T19:00:52.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.873+0000 7faf9ca17640 1 -- start start 2023-12-19T19:00:52.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.873+0000 7faf9ca17640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf980c5260 0x7faf981eba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:52.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.873+0000 7faf9ca17640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf980c5640 0x7faf98153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.873+0000 7faf9ca17640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf980c60f0 0x7faf980bb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.873+0000 7faf9ca17640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf980bcc50 con 0x7faf980c5640 2023-12-19T19:00:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.873+0000 7faf9ca17640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf980baf20 con 0x7faf980c60f0 2023-12-19T19:00:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.873+0000 7faf9ca17640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf981ebf50 con 0x7faf980c5260 2023-12-19T19:00:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.877+0000 7faf95d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf980c5640 0x7faf98153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.877+0000 7faf95d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf980c5640 0x7faf98153880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43020/0 (socket says 172.21.15.133:43020) 2023-12-19T19:00:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.877+0000 7faf95d9b640 1 -- 172.21.15.133:0/1450338898 learned_addr learned my addr 172.21.15.133:0/1450338898 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.877+0000 7faf9659c640 1 --2- 172.21.15.133:0/1450338898 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf980c5260 0x7faf981eba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.877+0000 7faf96d9d640 1 --2- 172.21.15.133:0/1450338898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf980c60f0 0x7faf980bb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.877+0000 7faf95d9b640 1 -- 172.21.15.133:0/1450338898 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf980c5260 msgr2=0x7faf981eba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.877+0000 7faf95d9b640 1 --2- 172.21.15.133:0/1450338898 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf980c5260 0x7faf981eba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.877+0000 7faf95d9b640 1 -- 172.21.15.133:0/1450338898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf980c60f0 msgr2=0x7faf980bb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.877+0000 7faf95d9b640 1 --2- 172.21.15.133:0/1450338898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf980c60f0 0x7faf980bb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:52.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.877+0000 7faf95d9b640 1 -- 172.21.15.133:0/1450338898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf880094d0 con 0x7faf980c5640 2023-12-19T19:00:52.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.877+0000 7faf96d9d640 1 --2- 172.21.15.133:0/1450338898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf980c60f0 0x7faf980bb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:00:52.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.877+0000 7faf95d9b640 1 --2- 172.21.15.133:0/1450338898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf980c5640 0x7faf98153880 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7faf8c00d7d0 tx=0x7faf8c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:52.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.877+0000 7faf86ffd640 1 -- 172.21.15.133:0/1450338898 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c004030 con 0x7faf980c5640 2023-12-19T19:00:52.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.877+0000 7faf86ffd640 1 -- 172.21.15.133:0/1450338898 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c004190 con 0x7faf980c5640 2023-12-19T19:00:52.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.877+0000 7faf86ffd640 1 -- 172.21.15.133:0/1450338898 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c004520 con 0x7faf980c5640 2023-12-19T19:00:52.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.877+0000 7faf9ca17640 1 -- 172.21.15.133:0/1450338898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf980bc0d0 con 0x7faf980c5640 2023-12-19T19:00:52.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.877+0000 7faf9ca17640 1 -- 172.21.15.133:0/1450338898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf980bc690 con 0x7faf980c5640 2023-12-19T19:00:52.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.877+0000 7faf9ca17640 1 -- 172.21.15.133:0/1450338898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf980bacf0 con 0x7faf980c5640 2023-12-19T19:00:52.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.877+0000 7faf86ffd640 1 -- 172.21.15.133:0/1450338898 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7faf8c0096a0 con 0x7faf980c5640 2023-12-19T19:00:52.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.877+0000 7faf86ffd640 1 --2- 172.21.15.133:0/1450338898 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf780664a0 0x7faf78068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:52.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.877+0000 7faf86ffd640 1 -- 172.21.15.133:0/1450338898 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7faf8c084860 con 0x7faf980c5640 2023-12-19T19:00:52.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.881+0000 7faf9659c640 1 --2- 172.21.15.133:0/1450338898 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf780664a0 0x7faf78068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:52.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.881+0000 7faf9659c640 1 --2- 172.21.15.133:0/1450338898 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf780664a0 0x7faf78068960 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7faf880ae000 tx=0x7faf880a6070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:52.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:52.885+0000 7faf86ffd640 1 -- 172.21.15.133:0/1450338898 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7faf980bacf0 con 0x7faf980c5640 2023-12-19T19:00:53.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.065+0000 7faf9ca17640 1 -- 172.21.15.133:0/1450338898 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf980bacf0 con 0x7faf980c5640 2023-12-19T19:00:53.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.065+0000 7faf86ffd640 1 -- 172.21.15.133:0/1450338898 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6194 (secure 0 0 0) 0x7faf980bacf0 con 0x7faf980c5640 2023-12-19T19:00:53.069 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:53.069 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3200335051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3200335051},{"type":"v1","addr":"172.21.15.133:6833","nonce":3200335051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2114705112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":2114705112},{"type":"v1","addr":"172.21.15.138:6835","nonce":2114705112}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:00:31.342186+0000","modified":"2023-12-19T19:00:34.368238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5763},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5763":{"gid":5763,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6835/1203400706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1203400706},{"type":"v1","addr":"172.21.15.133:6835","nonce":1203400706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:00:49.053498+0000","modified":"2023-12-19T19:00:52.071868+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5258":{"gid":5258,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6837/3661017926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3661017926},{"type":"v1","addr":"172.21.15.138:6837","nonce":3661017926}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T19:00:53.069 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 37 2023-12-19T19:00:53.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.065+0000 7faf9ca17640 1 -- 172.21.15.133:0/1450338898 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf780664a0 msgr2=0x7faf78068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:53.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.065+0000 7faf9ca17640 1 --2- 172.21.15.133:0/1450338898 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf780664a0 0x7faf78068960 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7faf880ae000 tx=0x7faf880a6070 comp rx=0 tx=0).stop 2023-12-19T19:00:53.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.065+0000 7faf9ca17640 1 -- 172.21.15.133:0/1450338898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf980c5640 msgr2=0x7faf98153880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:53.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.065+0000 7faf9ca17640 1 --2- 172.21.15.133:0/1450338898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf980c5640 0x7faf98153880 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7faf8c00d7d0 tx=0x7faf8c00dc90 comp rx=0 tx=0).stop 2023-12-19T19:00:53.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.069+0000 7faf9ca17640 1 -- 172.21.15.133:0/1450338898 shutdown_connections 2023-12-19T19:00:53.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.069+0000 7faf9ca17640 1 --2- 172.21.15.133:0/1450338898 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf780664a0 0x7faf78068960 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.069+0000 7faf9ca17640 1 --2- 172.21.15.133:0/1450338898 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7faf980c60f0 0x7faf980bb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.069+0000 7faf9ca17640 1 --2- 172.21.15.133:0/1450338898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7faf980c5640 0x7faf98153880 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.069+0000 7faf9ca17640 1 --2- 172.21.15.133:0/1450338898 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7faf980c5260 0x7faf981eba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.069+0000 7faf9ca17640 1 -- 172.21.15.133:0/1450338898 >> 172.21.15.133:0/1450338898 conn(0x7faf9806a5b0 msgr2=0x7faf98066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:53.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.069+0000 7faf9ca17640 1 -- 172.21.15.133:0/1450338898 shutdown_connections 2023-12-19T19:00:53.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.069+0000 7faf9ca17640 1 -- 172.21.15.133:0/1450338898 wait complete. 2023-12-19T19:00:53.090 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:00:53.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.225+0000 7f61f5f96640 1 Processor -- start 2023-12-19T19:00:53.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.225+0000 7f61f5f96640 1 -- start start 2023-12-19T19:00:53.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.225+0000 7f61f5f96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61f00c0450 0x7f61f015dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:53.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.225+0000 7f61f5f96640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f0071e90 con 0x7f61f014f800 2023-12-19T19:00:53.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.225+0000 7f61f5f96640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f00a5110 con 0x7f61f00c1010 2023-12-19T19:00:53.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.225+0000 7f61f5f96640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f0152d70 con 0x7f61f00c0450 2023-12-19T19:00:53.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.225+0000 7f61f4f94640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f61f014f800 0x7f61f0072320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59578/0 (socket says 172.21.15.133:59578) 2023-12-19T19:00:53.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.225+0000 7f61f4f94640 1 -- 172.21.15.133:0/1640100512 learned_addr learned my addr 172.21.15.133:0/1640100512 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:53.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.225+0000 7f61f5795640 1 --2- 172.21.15.133:0/1640100512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61f00c0450 0x7f61f015dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:53.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.225+0000 7f61e77fe640 1 -- 172.21.15.133:0/1640100512 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445658850 0 0) 0x7f61f0071e90 con 0x7f61f014f800 2023-12-19T19:00:53.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.225+0000 7f61e77fe640 1 -- 172.21.15.133:0/1640100512 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61d8003530 con 0x7f61f014f800 2023-12-19T19:00:53.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.225+0000 7f61e77fe640 1 -- 172.21.15.133:0/1640100512 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282442377 0 0) 0x7f61f00a5110 con 0x7f61f00c1010 2023-12-19T19:00:53.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.225+0000 7f61e77fe640 1 -- 172.21.15.133:0/1640100512 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61f0071e90 con 0x7f61f00c1010 2023-12-19T19:00:53.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.225+0000 7f61f5795640 1 -- 172.21.15.133:0/1640100512 >> v1:172.21.15.138:6789/0 conn(0x7f61f00c1010 legacy=0x7f61f006fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:53.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.225+0000 7f61e77fe640 1 -- 172.21.15.133:0/1640100512 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2520601085 0 0) 0x7f61d8003530 con 0x7f61f014f800 2023-12-19T19:00:53.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.225+0000 7f61f5795640 1 -- 172.21.15.133:0/1640100512 >> v1:172.21.15.133:6789/0 conn(0x7f61f014f800 legacy=0x7f61f0072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:53.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.225+0000 7f61f5795640 1 -- 172.21.15.133:0/1640100512 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f0153050 con 0x7f61f00c0450 2023-12-19T19:00:53.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.229+0000 7f61f5795640 1 --2- 172.21.15.133:0/1640100512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61f00c0450 0x7f61f015dbe0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f61e8009dc0 tx=0x7f61e801c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6becfd6c78317dd0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:53.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.229+0000 7f61e77fe640 1 -- 172.21.15.133:0/1640100512 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61ec001680 con 0x7f61f00c0450 2023-12-19T19:00:53.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.229+0000 7f61e77fe640 1 -- 172.21.15.133:0/1640100512 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e80a5630 con 0x7f61f00c0450 2023-12-19T19:00:53.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.229+0000 7f61e77fe640 1 -- 172.21.15.133:0/1640100512 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e80a59a0 con 0x7f61f00c0450 2023-12-19T19:00:53.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.229+0000 7f61f5f96640 1 -- 172.21.15.133:0/1640100512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61f00c0450 msgr2=0x7f61f015dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:53.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.229+0000 7f61f5f96640 1 --2- 172.21.15.133:0/1640100512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61f00c0450 0x7f61f015dbe0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f61e8009dc0 tx=0x7f61e801c7d0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.229+0000 7f61f5f96640 1 -- 172.21.15.133:0/1640100512 shutdown_connections 2023-12-19T19:00:53.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.229+0000 7f61f5f96640 1 --2- 172.21.15.133:0/1640100512 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61f00c0450 0x7f61f015dbe0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.229+0000 7f61f5f96640 1 -- 172.21.15.133:0/1640100512 >> 172.21.15.133:0/1640100512 conn(0x7f61f00a7800 msgr2=0x7f61f00a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:53.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.229+0000 7f61f5f96640 1 -- 172.21.15.133:0/1640100512 shutdown_connections 2023-12-19T19:00:53.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.229+0000 7f61f5f96640 1 -- 172.21.15.133:0/1640100512 wait complete. 2023-12-19T19:00:53.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.229+0000 7f61f5f96640 1 Processor -- start 2023-12-19T19:00:53.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61f5f96640 1 -- start start 2023-12-19T19:00:53.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61f5f96640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61f00c0450 0x7f61f01562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:53.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61f5f96640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61f00c1010 0x7f61f006cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:53.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61f5f96640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61f014f800 0x7f61f01eca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:53.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61f5f96640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f006dfd0 con 0x7f61f00c1010 2023-12-19T19:00:53.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61f5f96640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f0155f00 con 0x7f61f00c0450 2023-12-19T19:00:53.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61f5f96640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f01f0f10 con 0x7f61f014f800 2023-12-19T19:00:53.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61e7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61f00c1010 0x7f61f006cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:53.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61e7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61f00c1010 0x7f61f006cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43032/0 (socket says 172.21.15.133:43032) 2023-12-19T19:00:53.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61e7fff640 1 -- 172.21.15.133:0/3296780384 learned_addr learned my addr 172.21.15.133:0/3296780384 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:53.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61f5795640 1 --2- 172.21.15.133:0/3296780384 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61f014f800 0x7f61f01eca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:53.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61f4f94640 1 --2- 172.21.15.133:0/3296780384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61f00c0450 0x7f61f01562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:53.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61e7fff640 1 -- 172.21.15.133:0/3296780384 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61f014f800 msgr2=0x7f61f01eca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:53.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61e7fff640 1 --2- 172.21.15.133:0/3296780384 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61f014f800 0x7f61f01eca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61e7fff640 1 -- 172.21.15.133:0/3296780384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61f00c0450 msgr2=0x7f61f01562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:53.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61e7fff640 1 --2- 172.21.15.133:0/3296780384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61f00c0450 0x7f61f01562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61e7fff640 1 -- 172.21.15.133:0/3296780384 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e8009a70 con 0x7f61f00c1010 2023-12-19T19:00:53.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61e7fff640 1 --2- 172.21.15.133:0/3296780384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61f00c1010 0x7f61f006cc30 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f61e000c430 tx=0x7f61e000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:53.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61e57fa640 1 -- 172.21.15.133:0/3296780384 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e00052d0 con 0x7f61f00c1010 2023-12-19T19:00:53.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61e57fa640 1 -- 172.21.15.133:0/3296780384 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e0005450 con 0x7f61f00c1010 2023-12-19T19:00:53.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61f5f96640 1 -- 172.21.15.133:0/3296780384 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f01f0a80 con 0x7f61f00c1010 2023-12-19T19:00:53.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61e57fa640 1 -- 172.21.15.133:0/3296780384 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0003840 con 0x7f61f00c1010 2023-12-19T19:00:53.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61f5f96640 1 -- 172.21.15.133:0/3296780384 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f01f0430 con 0x7f61f00c1010 2023-12-19T19:00:53.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.233+0000 7f61f5f96640 1 -- 172.21.15.133:0/3296780384 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f004e850 con 0x7f61f00c1010 2023-12-19T19:00:53.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.237+0000 7f61e57fa640 1 -- 172.21.15.133:0/3296780384 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f61e00039a0 con 0x7f61f00c1010 2023-12-19T19:00:53.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.237+0000 7f61e57fa640 1 --2- 172.21.15.133:0/3296780384 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f61dc066470 0x7f61dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:53.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.237+0000 7f61e57fa640 1 -- 172.21.15.133:0/3296780384 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f61e00835e0 con 0x7f61f00c1010 2023-12-19T19:00:53.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.237+0000 7f61f4f94640 1 --2- 172.21.15.133:0/3296780384 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f61dc066470 0x7f61dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:53.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.237+0000 7f61f4f94640 1 --2- 172.21.15.133:0/3296780384 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f61dc066470 0x7f61dc068930 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f61ec001ec0 tx=0x7f61ec0019c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:53.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.241+0000 7f61e57fa640 1 -- 172.21.15.133:0/3296780384 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f61e0050840 con 0x7f61f00c1010 2023-12-19T19:00:53.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.393+0000 7f61f5f96640 1 -- 172.21.15.133:0/3296780384 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61f00c5370 con 0x7f61f00c1010 2023-12-19T19:00:53.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.397+0000 7f61e57fa640 1 -- 172.21.15.133:0/3296780384 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20316 (secure 0 0 0) 0x7f61e0053e60 con 0x7f61f00c1010 2023-12-19T19:00:53.399 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:53.400 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":54,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:00:50.680936+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:00:29.085029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T19:00:30.359577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:00:46.784805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:00:48.051355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:00:53.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.397+0000 7f61f5f96640 1 -- 172.21.15.133:0/3296780384 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f61dc066470 msgr2=0x7f61dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:53.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.397+0000 7f61f5f96640 1 --2- 172.21.15.133:0/3296780384 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f61dc066470 0x7f61dc068930 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f61ec001ec0 tx=0x7f61ec0019c0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.397+0000 7f61f5f96640 1 -- 172.21.15.133:0/3296780384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61f00c1010 msgr2=0x7f61f006cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:53.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.397+0000 7f61f5f96640 1 --2- 172.21.15.133:0/3296780384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61f00c1010 0x7f61f006cc30 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f61e000c430 tx=0x7f61e000c8f0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.397+0000 7f61f5f96640 1 -- 172.21.15.133:0/3296780384 shutdown_connections 2023-12-19T19:00:53.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.397+0000 7f61f5f96640 1 --2- 172.21.15.133:0/3296780384 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f61dc066470 0x7f61dc068930 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.397+0000 7f61f5f96640 1 --2- 172.21.15.133:0/3296780384 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f61f014f800 0x7f61f01eca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.397+0000 7f61f5f96640 1 --2- 172.21.15.133:0/3296780384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61f00c1010 0x7f61f006cc30 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.397+0000 7f61f5f96640 1 --2- 172.21.15.133:0/3296780384 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f61f00c0450 0x7f61f01562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.397+0000 7f61f5f96640 1 -- 172.21.15.133:0/3296780384 >> 172.21.15.133:0/3296780384 conn(0x7f61f00a7800 msgr2=0x7f61f014e060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:53.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.397+0000 7f61f5f96640 1 -- 172.21.15.133:0/3296780384 shutdown_connections 2023-12-19T19:00:53.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.397+0000 7f61f5f96640 1 -- 172.21.15.133:0/3296780384 wait complete. 2023-12-19T19:00:53.420 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T19:00:53.420 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T19:00:53.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.553+0000 7f13bb59e640 1 Processor -- start 2023-12-19T19:00:53.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.553+0000 7f13bb59e640 1 -- start start 2023-12-19T19:00:53.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.557+0000 7f13bb59e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f13bc151cd0 0x7f13bc0ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:53.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.557+0000 7f13bb59e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13bc154be0 0x7f13bc15ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:53.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.557+0000 7f13bb59e640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13bc0c8160 con 0x7f13bc0c7c50 2023-12-19T19:00:53.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.557+0000 7f13bb59e640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13bc157b40 con 0x7f13bc151cd0 2023-12-19T19:00:53.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.557+0000 7f13bb59e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc157e20 con 0x7f13bc154be0 2023-12-19T19:00:53.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.557+0000 7f13b1d9b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f13bc0c7c50 0x7f13bc1544d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:59592/0 (socket says 172.21.15.133:59592) 2023-12-19T19:00:53.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.557+0000 7f13ba59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f13bc151cd0 0x7f13bc0ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:53.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.557+0000 7f13b1d9b640 1 -- 172.21.15.133:0/43428644 learned_addr learned my addr 172.21.15.133:0/43428644 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:53.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.557+0000 7f13bad9d640 1 --2- 172.21.15.133:0/43428644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13bc154be0 0x7f13bc15ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:53.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.557+0000 7f13ba59c640 1 -- 172.21.15.133:0/43428644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13bc154be0 msgr2=0x7f13bc15ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:53.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.557+0000 7f13ba59c640 1 --2- 172.21.15.133:0/43428644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13bc154be0 0x7f13bc15ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.557+0000 7f13b9d9b640 1 -- 172.21.15.133:0/43428644 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255087471 0 0) 0x7f13bc0c8160 con 0x7f13bc0c7c50 2023-12-19T19:00:53.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.557+0000 7f13ba59c640 1 -- 172.21.15.133:0/43428644 >> v1:172.21.15.133:6789/0 conn(0x7f13bc0c7c50 legacy=0x7f13bc1544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:53.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.557+0000 7f13ba59c640 1 -- 172.21.15.133:0/43428644 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc158100 con 0x7f13bc151cd0 2023-12-19T19:00:53.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.561+0000 7f13ba59c640 1 --2- 172.21.15.133:0/43428644 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13bc151cd0 0x7f13bc0ca460 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f13a40097c0 tx=0x7f13a401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76dc909339bf074e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:53.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.561+0000 7f13b9d9b640 1 -- 172.21.15.133:0/43428644 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a40ab670 con 0x7f13bc151cd0 2023-12-19T19:00:53.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.561+0000 7f13b9d9b640 1 -- 172.21.15.133:0/43428644 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a40ab7d0 con 0x7f13bc151cd0 2023-12-19T19:00:53.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.561+0000 7f13b9d9b640 1 -- 172.21.15.133:0/43428644 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a40abb60 con 0x7f13bc151cd0 2023-12-19T19:00:53.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.561+0000 7f13bb59e640 1 -- 172.21.15.133:0/43428644 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13bc151cd0 msgr2=0x7f13bc0ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:53.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.561+0000 7f13bb59e640 1 --2- 172.21.15.133:0/43428644 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13bc151cd0 0x7f13bc0ca460 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f13a40097c0 tx=0x7f13a401c450 comp rx=0 tx=0).stop 2023-12-19T19:00:53.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.561+0000 7f13bb59e640 1 -- 172.21.15.133:0/43428644 shutdown_connections 2023-12-19T19:00:53.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.561+0000 7f13bb59e640 1 --2- 172.21.15.133:0/43428644 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13bc154be0 0x7f13bc15ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.561+0000 7f13bb59e640 1 --2- 172.21.15.133:0/43428644 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13bc151cd0 0x7f13bc0ca460 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.561+0000 7f13bb59e640 1 -- 172.21.15.133:0/43428644 >> 172.21.15.133:0/43428644 conn(0x7f13bc0abee0 msgr2=0x7f13bc0c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:53.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.561+0000 7f13bb59e640 1 -- 172.21.15.133:0/43428644 shutdown_connections 2023-12-19T19:00:53.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.561+0000 7f13bb59e640 1 -- 172.21.15.133:0/43428644 wait complete. 2023-12-19T19:00:53.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.561+0000 7f13bb59e640 1 Processor -- start 2023-12-19T19:00:53.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.561+0000 7f13bb59e640 1 -- start start 2023-12-19T19:00:53.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13bb59e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13bc0c7c50 0x7f13bc152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:53.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13bb59e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13bc151cd0 0x7f13bc153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:53.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13bb59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13bc154be0 0x7f13bc1560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:53.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13bb59e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc146e80 con 0x7f13bc154be0 2023-12-19T19:00:53.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13bb59e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc14fbf0 con 0x7f13bc0c7c50 2023-12-19T19:00:53.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13bb59e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13bc1f0940 con 0x7f13bc151cd0 2023-12-19T19:00:53.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13bad9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13bc154be0 0x7f13bc1560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:53.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13bad9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13bc154be0 0x7f13bc1560b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43056/0 (socket says 172.21.15.133:43056) 2023-12-19T19:00:53.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13bad9d640 1 -- 172.21.15.133:0/66363169 learned_addr learned my addr 172.21.15.133:0/66363169 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:53.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13b1d9b640 1 --2- 172.21.15.133:0/66363169 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13bc151cd0 0x7f13bc153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:53.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13ba59c640 1 --2- 172.21.15.133:0/66363169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13bc0c7c50 0x7f13bc152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:53.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13bad9d640 1 -- 172.21.15.133:0/66363169 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13bc151cd0 msgr2=0x7f13bc153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:53.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13bad9d640 1 --2- 172.21.15.133:0/66363169 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13bc151cd0 0x7f13bc153150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13bad9d640 1 -- 172.21.15.133:0/66363169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13bc0c7c50 msgr2=0x7f13bc152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:53.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13bad9d640 1 --2- 172.21.15.133:0/66363169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13bc0c7c50 0x7f13bc152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13bad9d640 1 -- 172.21.15.133:0/66363169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a4009420 con 0x7f13bc154be0 2023-12-19T19:00:53.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13bad9d640 1 --2- 172.21.15.133:0/66363169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13bc154be0 0x7f13bc1560b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f13b400efc0 tx=0x7f13b400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:53.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13b37fe640 1 -- 172.21.15.133:0/66363169 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b4014480 con 0x7f13bc154be0 2023-12-19T19:00:53.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13b37fe640 1 -- 172.21.15.133:0/66363169 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b400f040 con 0x7f13bc154be0 2023-12-19T19:00:53.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13bb59e640 1 -- 172.21.15.133:0/66363169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13bc1f0c20 con 0x7f13bc154be0 2023-12-19T19:00:53.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13b37fe640 1 -- 172.21.15.133:0/66363169 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b4014820 con 0x7f13bc154be0 2023-12-19T19:00:53.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13bb59e640 1 -- 172.21.15.133:0/66363169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13bc155b90 con 0x7f13bc154be0 2023-12-19T19:00:53.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13bb59e640 1 -- 172.21.15.133:0/66363169 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13bc155710 con 0x7f13bc154be0 2023-12-19T19:00:53.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.565+0000 7f13b37fe640 1 -- 172.21.15.133:0/66363169 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f13b4014980 con 0x7f13bc154be0 2023-12-19T19:00:53.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.569+0000 7f13b37fe640 1 --2- 172.21.15.133:0/66363169 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f139c066470 0x7f139c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:53.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.569+0000 7f13b37fe640 1 -- 172.21.15.133:0/66363169 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f13b40850b0 con 0x7f13bc154be0 2023-12-19T19:00:53.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.569+0000 7f13ba59c640 1 --2- 172.21.15.133:0/66363169 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f139c066470 0x7f139c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:53.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.569+0000 7f13ba59c640 1 --2- 172.21.15.133:0/66363169 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f139c066470 0x7f139c068930 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f13a40af000 tx=0x7f13a40a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:53.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.573+0000 7f13b37fe640 1 -- 172.21.15.133:0/66363169 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f13bc155710 con 0x7f13bc154be0 2023-12-19T19:00:53.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.721+0000 7f13bb59e640 1 -- 172.21.15.133:0/66363169 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13bc0c83b0 con 0x7f139c066470 2023-12-19T19:00:53.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.733+0000 7f13b37fe640 1 -- 172.21.15.133:0/66363169 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+528016 (secure 0 0 0) 0x7f13a4004040 con 0x7f139c066470 2023-12-19T19:00:53.744 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:53.748 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T19:00:53.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.741+0000 7f13bb59e640 1 -- 172.21.15.133:0/66363169 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f139c066470 msgr2=0x7f139c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:53.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.741+0000 7f13bb59e640 1 --2- 172.21.15.133:0/66363169 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f139c066470 0x7f139c068930 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f13a40af000 tx=0x7f13a40a7000 comp rx=0 tx=0).stop 2023-12-19T19:00:53.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.741+0000 7f13bb59e640 1 -- 172.21.15.133:0/66363169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13bc154be0 msgr2=0x7f13bc1560b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:53.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.741+0000 7f13bb59e640 1 --2- 172.21.15.133:0/66363169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13bc154be0 0x7f13bc1560b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f13b400efc0 tx=0x7f13b400c490 comp rx=0 tx=0).stop 2023-12-19T19:00:53.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.741+0000 7f13bb59e640 1 -- 172.21.15.133:0/66363169 shutdown_connections 2023-12-19T19:00:53.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.741+0000 7f13bb59e640 1 --2- 172.21.15.133:0/66363169 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f139c066470 0x7f139c068930 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.741+0000 7f13bb59e640 1 --2- 172.21.15.133:0/66363169 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f13bc154be0 0x7f13bc1560b0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.741+0000 7f13bb59e640 1 --2- 172.21.15.133:0/66363169 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f13bc151cd0 0x7f13bc153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.741+0000 7f13bb59e640 1 --2- 172.21.15.133:0/66363169 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f13bc0c7c50 0x7f13bc152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.741+0000 7f13bb59e640 1 -- 172.21.15.133:0/66363169 >> 172.21.15.133:0/66363169 conn(0x7f13bc0abee0 msgr2=0x7f13bc14de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:53.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.741+0000 7f13bb59e640 1 -- 172.21.15.133:0/66363169 shutdown_connections 2023-12-19T19:00:53.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.741+0000 7f13bb59e640 1 -- 172.21.15.133:0/66363169 wait complete. 2023-12-19T19:00:53.763 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2023-12-19T19:00:52.865315+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":296,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239044,"kb_used_data":6244,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735676,"statfs":{"total":773094113280,"available":772849332224,"internally_reserved":0,"allocated":6393856,"data_stored":3380547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.206272"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.698723+0000","last_change":"2023-12-19T19:00:49.693869+0000","last_active":"2023-12-19T19:00:49.698723+0000","last_peered":"2023-12-19T19:00:49.698723+0000","last_clean":"2023-12-19T19:00:49.698723+0000","last_became_active":"2023-12-19T19:00:49.693560+0000","last_became_peered":"2023-12-19T19:00:49.693560+0000","last_unstale":"2023-12-19T19:00:49.698723+0000","last_undegraded":"2023-12-19T19:00:49.698723+0000","last_fullsized":"2023-12-19T19:00:49.698723+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:25.823608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.683642+0000","last_change":"2023-12-19T19:00:31.998328+0000","last_active":"2023-12-19T19:00:48.683642+0000","last_peered":"2023-12-19T19:00:48.683642+0000","last_clean":"2023-12-19T19:00:48.683642+0000","last_became_active":"2023-12-19T19:00:31.998072+0000","last_became_peered":"2023-12-19T19:00:31.998072+0000","last_unstale":"2023-12-19T19:00:48.683642+0000","last_undegraded":"2023-12-19T19:00:48.683642+0000","last_fullsized":"2023-12-19T19:00:48.683642+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:11:16.755757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686791+0000","last_change":"2023-12-19T19:00:49.704168+0000","last_active":"2023-12-19T19:00:50.686791+0000","last_peered":"2023-12-19T19:00:50.686791+0000","last_clean":"2023-12-19T19:00:50.686791+0000","last_became_active":"2023-12-19T19:00:49.703829+0000","last_became_peered":"2023-12-19T19:00:49.703829+0000","last_unstale":"2023-12-19T19:00:50.686791+0000","last_undegraded":"2023-12-19T19:00:50.686791+0000","last_fullsized":"2023-12-19T19:00:50.686791+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:48.631905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679859+0000","last_change":"2023-12-19T19:00:31.988596+0000","last_active":"2023-12-19T19:00:48.679859+0000","last_peered":"2023-12-19T19:00:48.679859+0000","last_clean":"2023-12-19T19:00:48.679859+0000","last_became_active":"2023-12-19T19:00:31.988327+0000","last_became_peered":"2023-12-19T19:00:31.988327+0000","last_unstale":"2023-12-19T19:00:48.679859+0000","last_undegraded":"2023-12-19T19:00:48.679859+0000","last_fullsized":"2023-12-19T19:00:48.679859+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:05:42.607715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.688783+0000","last_change":"2023-12-19T19:00:49.691140+0000","last_active":"2023-12-19T19:00:50.688783+0000","last_peered":"2023-12-19T19:00:50.688783+0000","last_clean":"2023-12-19T19:00:50.688783+0000","last_became_active":"2023-12-19T19:00:49.690831+0000","last_became_peered":"2023-12-19T19:00:49.690831+0000","last_unstale":"2023-12-19T19:00:50.688783+0000","last_undegraded":"2023-12-19T19:00:50.688783+0000","last_fullsized":"2023-12-19T19:00:50.688783+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:30:51.465735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.679012+0000","last_change":"2023-12-19T19:00:31.987245+0000","last_active":"2023-12-19T19:00:49.679012+0000","last_peered":"2023-12-19T19:00:49.679012+0000","last_clean":"2023-12-19T19:00:49.679012+0000","last_became_active":"2023-12-19T19:00:31.986953+0000","last_became_peered":"2023-12-19T19:00:31.986953+0000","last_unstale":"2023-12-19T19:00:49.679012+0000","last_undegraded":"2023-12-19T19:00:49.679012+0000","last_fullsized":"2023-12-19T19:00:49.679012+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:34.630792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.715749+0000","last_change":"2023-12-19T19:00:49.708858+0000","last_active":"2023-12-19T19:00:49.715749+0000","last_peered":"2023-12-19T19:00:49.715749+0000","last_clean":"2023-12-19T19:00:49.715749+0000","last_became_active":"2023-12-19T19:00:49.707507+0000","last_became_peered":"2023-12-19T19:00:49.707507+0000","last_unstale":"2023-12-19T19:00:49.715749+0000","last_undegraded":"2023-12-19T19:00:49.715749+0000","last_fullsized":"2023-12-19T19:00:49.715749+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:35:17.219218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.684262+0000","last_change":"2023-12-19T19:00:32.009662+0000","last_active":"2023-12-19T19:00:49.684262+0000","last_peered":"2023-12-19T19:00:49.684262+0000","last_clean":"2023-12-19T19:00:49.684262+0000","last_became_active":"2023-12-19T19:00:32.009345+0000","last_became_peered":"2023-12-19T19:00:32.009345+0000","last_unstale":"2023-12-19T19:00:49.684262+0000","last_undegraded":"2023-12-19T19:00:49.684262+0000","last_fullsized":"2023-12-19T19:00:49.684262+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:27:21.821975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.687585+0000","last_change":"2023-12-19T19:00:49.694094+0000","last_active":"2023-12-19T19:00:50.687585+0000","last_peered":"2023-12-19T19:00:50.687585+0000","last_clean":"2023-12-19T19:00:50.687585+0000","last_became_active":"2023-12-19T19:00:49.693811+0000","last_became_peered":"2023-12-19T19:00:49.693811+0000","last_unstale":"2023-12-19T19:00:50.687585+0000","last_undegraded":"2023-12-19T19:00:50.687585+0000","last_fullsized":"2023-12-19T19:00:50.687585+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:24:12.796825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.682781+0000","last_change":"2023-12-19T19:00:32.008158+0000","last_active":"2023-12-19T19:00:48.682781+0000","last_peered":"2023-12-19T19:00:48.682781+0000","last_clean":"2023-12-19T19:00:48.682781+0000","last_became_active":"2023-12-19T19:00:32.005772+0000","last_became_peered":"2023-12-19T19:00:32.005772+0000","last_unstale":"2023-12-19T19:00:48.682781+0000","last_undegraded":"2023-12-19T19:00:48.682781+0000","last_fullsized":"2023-12-19T19:00:48.682781+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:34.376469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.715129+0000","last_change":"2023-12-19T19:00:49.707418+0000","last_active":"2023-12-19T19:00:49.715129+0000","last_peered":"2023-12-19T19:00:49.715129+0000","last_clean":"2023-12-19T19:00:49.715129+0000","last_became_active":"2023-12-19T19:00:49.707022+0000","last_became_peered":"2023-12-19T19:00:49.707022+0000","last_unstale":"2023-12-19T19:00:49.715129+0000","last_undegraded":"2023-12-19T19:00:49.715129+0000","last_fullsized":"2023-12-19T19:00:49.715129+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:27:39.523366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.695174+0000","last_change":"2023-12-19T19:00:31.995665+0000","last_active":"2023-12-19T19:00:48.695174+0000","last_peered":"2023-12-19T19:00:48.695174+0000","last_clean":"2023-12-19T19:00:48.695174+0000","last_became_active":"2023-12-19T19:00:31.995407+0000","last_became_peered":"2023-12-19T19:00:31.995407+0000","last_unstale":"2023-12-19T19:00:48.695174+0000","last_undegraded":"2023-12-19T19:00:48.695174+0000","last_fullsized":"2023-12-19T19:00:48.695174+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:34.630792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.692591+0000","last_change":"2023-12-19T19:00:49.690296+0000","last_active":"2023-12-19T19:00:49.692591+0000","last_peered":"2023-12-19T19:00:49.692591+0000","last_clean":"2023-12-19T19:00:49.692591+0000","last_became_active":"2023-12-19T19:00:49.689936+0000","last_became_peered":"2023-12-19T19:00:49.689936+0000","last_unstale":"2023-12-19T19:00:49.692591+0000","last_undegraded":"2023-12-19T19:00:49.692591+0000","last_fullsized":"2023-12-19T19:00:49.692591+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:04:10.900001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679527+0000","last_change":"2023-12-19T19:00:31.987493+0000","last_active":"2023-12-19T19:00:48.679527+0000","last_peered":"2023-12-19T19:00:48.679527+0000","last_clean":"2023-12-19T19:00:48.679527+0000","last_became_active":"2023-12-19T19:00:31.987252+0000","last_became_peered":"2023-12-19T19:00:31.987252+0000","last_unstale":"2023-12-19T19:00:48.679527+0000","last_undegraded":"2023-12-19T19:00:48.679527+0000","last_fullsized":"2023-12-19T19:00:48.679527+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:07:48.132861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.715990+0000","last_change":"2023-12-19T19:00:49.709889+0000","last_active":"2023-12-19T19:00:49.715990+0000","last_peered":"2023-12-19T19:00:49.715990+0000","last_clean":"2023-12-19T19:00:49.715990+0000","last_became_active":"2023-12-19T19:00:49.707946+0000","last_became_peered":"2023-12-19T19:00:49.707946+0000","last_unstale":"2023-12-19T19:00:49.715990+0000","last_undegraded":"2023-12-19T19:00:49.715990+0000","last_fullsized":"2023-12-19T19:00:49.715990+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:39:54.810520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679376+0000","last_change":"2023-12-19T19:00:31.995216+0000","last_active":"2023-12-19T19:00:48.679376+0000","last_peered":"2023-12-19T19:00:48.679376+0000","last_clean":"2023-12-19T19:00:48.679376+0000","last_became_active":"2023-12-19T19:00:31.994879+0000","last_became_peered":"2023-12-19T19:00:31.994879+0000","last_unstale":"2023-12-19T19:00:48.679376+0000","last_undegraded":"2023-12-19T19:00:48.679376+0000","last_fullsized":"2023-12-19T19:00:48.679376+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:50.358908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.688232+0000","last_change":"2023-12-19T19:00:49.696527+0000","last_active":"2023-12-19T19:00:50.688232+0000","last_peered":"2023-12-19T19:00:50.688232+0000","last_clean":"2023-12-19T19:00:50.688232+0000","last_became_active":"2023-12-19T19:00:49.695865+0000","last_became_peered":"2023-12-19T19:00:49.695865+0000","last_unstale":"2023-12-19T19:00:50.688232+0000","last_undegraded":"2023-12-19T19:00:50.688232+0000","last_fullsized":"2023-12-19T19:00:50.688232+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:55:25.865584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.681152+0000","last_change":"2023-12-19T19:00:32.007195+0000","last_active":"2023-12-19T19:00:48.681152+0000","last_peered":"2023-12-19T19:00:48.681152+0000","last_clean":"2023-12-19T19:00:48.681152+0000","last_became_active":"2023-12-19T19:00:32.006848+0000","last_became_peered":"2023-12-19T19:00:32.006848+0000","last_unstale":"2023-12-19T19:00:48.681152+0000","last_undegraded":"2023-12-19T19:00:48.681152+0000","last_fullsized":"2023-12-19T19:00:48.681152+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:03.755019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686585+0000","last_change":"2023-12-19T19:00:49.696927+0000","last_active":"2023-12-19T19:00:50.686585+0000","last_peered":"2023-12-19T19:00:50.686585+0000","last_clean":"2023-12-19T19:00:50.686585+0000","last_became_active":"2023-12-19T19:00:49.694423+0000","last_became_peered":"2023-12-19T19:00:49.694423+0000","last_unstale":"2023-12-19T19:00:50.686585+0000","last_undegraded":"2023-12-19T19:00:50.686585+0000","last_fullsized":"2023-12-19T19:00:50.686585+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:47.463525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.675487+0000","last_change":"2023-12-19T19:00:31.996387+0000","last_active":"2023-12-19T19:00:49.675487+0000","last_peered":"2023-12-19T19:00:49.675487+0000","last_clean":"2023-12-19T19:00:49.675487+0000","last_became_active":"2023-12-19T19:00:31.996111+0000","last_became_peered":"2023-12-19T19:00:31.996111+0000","last_unstale":"2023-12-19T19:00:49.675487+0000","last_undegraded":"2023-12-19T19:00:49.675487+0000","last_fullsized":"2023-12-19T19:00:49.675487+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:07:14.048441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.702319+0000","last_change":"2023-12-19T19:00:49.697994+0000","last_active":"2023-12-19T19:00:49.702319+0000","last_peered":"2023-12-19T19:00:49.702319+0000","last_clean":"2023-12-19T19:00:49.702319+0000","last_became_active":"2023-12-19T19:00:49.696339+0000","last_became_peered":"2023-12-19T19:00:49.696339+0000","last_unstale":"2023-12-19T19:00:49.702319+0000","last_undegraded":"2023-12-19T19:00:49.702319+0000","last_fullsized":"2023-12-19T19:00:49.702319+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:21:24.638950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.675539+0000","last_change":"2023-12-19T19:00:31.998530+0000","last_active":"2023-12-19T19:00:49.675539+0000","last_peered":"2023-12-19T19:00:49.675539+0000","last_clean":"2023-12-19T19:00:49.675539+0000","last_became_active":"2023-12-19T19:00:31.998192+0000","last_became_peered":"2023-12-19T19:00:31.998192+0000","last_unstale":"2023-12-19T19:00:49.675539+0000","last_undegraded":"2023-12-19T19:00:49.675539+0000","last_fullsized":"2023-12-19T19:00:49.675539+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:04:28.425713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.700779+0000","last_change":"2023-12-19T19:00:49.694606+0000","last_active":"2023-12-19T19:00:49.700779+0000","last_peered":"2023-12-19T19:00:49.700779+0000","last_clean":"2023-12-19T19:00:49.700779+0000","last_became_active":"2023-12-19T19:00:49.694289+0000","last_became_peered":"2023-12-19T19:00:49.694289+0000","last_unstale":"2023-12-19T19:00:49.700779+0000","last_undegraded":"2023-12-19T19:00:49.700779+0000","last_fullsized":"2023-12-19T19:00:49.700779+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:27:09.787292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.684355+0000","last_change":"2023-12-19T19:00:31.996756+0000","last_active":"2023-12-19T19:00:49.684355+0000","last_peered":"2023-12-19T19:00:49.684355+0000","last_clean":"2023-12-19T19:00:49.684355+0000","last_became_active":"2023-12-19T19:00:31.996480+0000","last_became_peered":"2023-12-19T19:00:31.996480+0000","last_unstale":"2023-12-19T19:00:49.684355+0000","last_undegraded":"2023-12-19T19:00:49.684355+0000","last_fullsized":"2023-12-19T19:00:49.684355+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:36.947100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.698857+0000","last_change":"2023-12-19T19:00:49.694019+0000","last_active":"2023-12-19T19:00:49.698857+0000","last_peered":"2023-12-19T19:00:49.698857+0000","last_clean":"2023-12-19T19:00:49.698857+0000","last_became_active":"2023-12-19T19:00:49.693752+0000","last_became_peered":"2023-12-19T19:00:49.693752+0000","last_unstale":"2023-12-19T19:00:49.698857+0000","last_undegraded":"2023-12-19T19:00:49.698857+0000","last_fullsized":"2023-12-19T19:00:49.698857+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:01:05.024259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.692892+0000","last_change":"2023-12-19T19:00:32.013269+0000","last_active":"2023-12-19T19:00:48.692892+0000","last_peered":"2023-12-19T19:00:48.692892+0000","last_clean":"2023-12-19T19:00:48.692892+0000","last_became_active":"2023-12-19T19:00:32.012808+0000","last_became_peered":"2023-12-19T19:00:32.012808+0000","last_unstale":"2023-12-19T19:00:48.692892+0000","last_undegraded":"2023-12-19T19:00:48.692892+0000","last_fullsized":"2023-12-19T19:00:48.692892+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:38:03.773877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.704574+0000","last_change":"2023-12-19T19:00:49.698711+0000","last_active":"2023-12-19T19:00:49.704574+0000","last_peered":"2023-12-19T19:00:49.704574+0000","last_clean":"2023-12-19T19:00:49.704574+0000","last_became_active":"2023-12-19T19:00:49.698418+0000","last_became_peered":"2023-12-19T19:00:49.698418+0000","last_unstale":"2023-12-19T19:00:49.704574+0000","last_undegraded":"2023-12-19T19:00:49.704574+0000","last_fullsized":"2023-12-19T19:00:49.704574+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:57.849352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679981+0000","last_change":"2023-12-19T19:00:31.994520+0000","last_active":"2023-12-19T19:00:48.679981+0000","last_peered":"2023-12-19T19:00:48.679981+0000","last_clean":"2023-12-19T19:00:48.679981+0000","last_became_active":"2023-12-19T19:00:31.994221+0000","last_became_peered":"2023-12-19T19:00:31.994221+0000","last_unstale":"2023-12-19T19:00:48.679981+0000","last_undegraded":"2023-12-19T19:00:48.679981+0000","last_fullsized":"2023-12-19T19:00:48.679981+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:27.267758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.706557+0000","last_change":"2023-12-19T19:00:49.705300+0000","last_active":"2023-12-19T19:00:49.706557+0000","last_peered":"2023-12-19T19:00:49.706557+0000","last_clean":"2023-12-19T19:00:49.706557+0000","last_became_active":"2023-12-19T19:00:49.704913+0000","last_became_peered":"2023-12-19T19:00:49.704913+0000","last_unstale":"2023-12-19T19:00:49.706557+0000","last_undegraded":"2023-12-19T19:00:49.706557+0000","last_fullsized":"2023-12-19T19:00:49.706557+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:23.122873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679712+0000","last_change":"2023-12-19T19:00:31.993938+0000","last_active":"2023-12-19T19:00:48.679712+0000","last_peered":"2023-12-19T19:00:48.679712+0000","last_clean":"2023-12-19T19:00:48.679712+0000","last_became_active":"2023-12-19T19:00:31.993647+0000","last_became_peered":"2023-12-19T19:00:31.993647+0000","last_unstale":"2023-12-19T19:00:48.679712+0000","last_undegraded":"2023-12-19T19:00:48.679712+0000","last_fullsized":"2023-12-19T19:00:48.679712+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:34.112789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.698351+0000","last_change":"2023-12-19T19:00:49.694425+0000","last_active":"2023-12-19T19:00:49.698351+0000","last_peered":"2023-12-19T19:00:49.698351+0000","last_clean":"2023-12-19T19:00:49.698351+0000","last_became_active":"2023-12-19T19:00:49.693968+0000","last_became_peered":"2023-12-19T19:00:49.693968+0000","last_unstale":"2023-12-19T19:00:49.698351+0000","last_undegraded":"2023-12-19T19:00:49.698351+0000","last_fullsized":"2023-12-19T19:00:49.698351+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:11.065167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.695144+0000","last_change":"2023-12-19T19:00:31.993839+0000","last_active":"2023-12-19T19:00:48.695144+0000","last_peered":"2023-12-19T19:00:48.695144+0000","last_clean":"2023-12-19T19:00:48.695144+0000","last_became_active":"2023-12-19T19:00:31.989969+0000","last_became_peered":"2023-12-19T19:00:31.989969+0000","last_unstale":"2023-12-19T19:00:48.695144+0000","last_undegraded":"2023-12-19T19:00:48.695144+0000","last_fullsized":"2023-12-19T19:00:48.695144+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:30.930514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.710813+0000","last_change":"2023-12-19T19:00:49.706894+0000","last_active":"2023-12-19T19:00:49.710813+0000","last_peered":"2023-12-19T19:00:49.710813+0000","last_clean":"2023-12-19T19:00:49.710813+0000","last_became_active":"2023-12-19T19:00:49.703054+0000","last_became_peered":"2023-12-19T19:00:49.703054+0000","last_unstale":"2023-12-19T19:00:49.710813+0000","last_undegraded":"2023-12-19T19:00:49.710813+0000","last_fullsized":"2023-12-19T19:00:49.710813+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:54.648491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.681183+0000","last_change":"2023-12-19T19:00:31.992695+0000","last_active":"2023-12-19T19:00:48.681183+0000","last_peered":"2023-12-19T19:00:48.681183+0000","last_clean":"2023-12-19T19:00:48.681183+0000","last_became_active":"2023-12-19T19:00:31.992420+0000","last_became_peered":"2023-12-19T19:00:31.992420+0000","last_unstale":"2023-12-19T19:00:48.681183+0000","last_undegraded":"2023-12-19T19:00:48.681183+0000","last_fullsized":"2023-12-19T19:00:48.681183+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:15:06.831796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.700408+0000","last_change":"2023-12-19T19:00:49.695699+0000","last_active":"2023-12-19T19:00:49.700408+0000","last_peered":"2023-12-19T19:00:49.700408+0000","last_clean":"2023-12-19T19:00:49.700408+0000","last_became_active":"2023-12-19T19:00:49.695440+0000","last_became_peered":"2023-12-19T19:00:49.695440+0000","last_unstale":"2023-12-19T19:00:49.700408+0000","last_undegraded":"2023-12-19T19:00:49.700408+0000","last_fullsized":"2023-12-19T19:00:49.700408+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:36:18.379135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.677320+0000","last_change":"2023-12-19T19:00:32.004815+0000","last_active":"2023-12-19T19:00:49.677320+0000","last_peered":"2023-12-19T19:00:49.677320+0000","last_clean":"2023-12-19T19:00:49.677320+0000","last_became_active":"2023-12-19T19:00:32.004530+0000","last_became_peered":"2023-12-19T19:00:32.004530+0000","last_unstale":"2023-12-19T19:00:49.677320+0000","last_undegraded":"2023-12-19T19:00:49.677320+0000","last_fullsized":"2023-12-19T19:00:49.677320+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:12:29.382064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.700638+0000","last_change":"2023-12-19T19:00:49.696644+0000","last_active":"2023-12-19T19:00:49.700638+0000","last_peered":"2023-12-19T19:00:49.700638+0000","last_clean":"2023-12-19T19:00:49.700638+0000","last_became_active":"2023-12-19T19:00:49.694814+0000","last_became_peered":"2023-12-19T19:00:49.694814+0000","last_unstale":"2023-12-19T19:00:49.700638+0000","last_undegraded":"2023-12-19T19:00:49.700638+0000","last_fullsized":"2023-12-19T19:00:49.700638+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:21.424753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.684029+0000","last_change":"2023-12-19T19:00:31.994588+0000","last_active":"2023-12-19T19:00:48.684029+0000","last_peered":"2023-12-19T19:00:48.684029+0000","last_clean":"2023-12-19T19:00:48.684029+0000","last_became_active":"2023-12-19T19:00:31.994303+0000","last_became_peered":"2023-12-19T19:00:31.994303+0000","last_unstale":"2023-12-19T19:00:48.684029+0000","last_undegraded":"2023-12-19T19:00:48.684029+0000","last_fullsized":"2023-12-19T19:00:48.684029+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:38:25.957034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686987+0000","last_change":"2023-12-19T19:00:49.708055+0000","last_active":"2023-12-19T19:00:50.686987+0000","last_peered":"2023-12-19T19:00:50.686987+0000","last_clean":"2023-12-19T19:00:50.686987+0000","last_became_active":"2023-12-19T19:00:49.707689+0000","last_became_peered":"2023-12-19T19:00:49.707689+0000","last_unstale":"2023-12-19T19:00:50.686987+0000","last_undegraded":"2023-12-19T19:00:50.686987+0000","last_fullsized":"2023-12-19T19:00:50.686987+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:06.329455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679669+0000","last_change":"2023-12-19T19:00:32.003503+0000","last_active":"2023-12-19T19:00:48.679669+0000","last_peered":"2023-12-19T19:00:48.679669+0000","last_clean":"2023-12-19T19:00:48.679669+0000","last_became_active":"2023-12-19T19:00:32.002889+0000","last_became_peered":"2023-12-19T19:00:32.002889+0000","last_unstale":"2023-12-19T19:00:48.679669+0000","last_undegraded":"2023-12-19T19:00:48.679669+0000","last_fullsized":"2023-12-19T19:00:48.679669+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:06:56.288379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.687008+0000","last_change":"2023-12-19T19:00:49.697540+0000","last_active":"2023-12-19T19:00:50.687008+0000","last_peered":"2023-12-19T19:00:50.687008+0000","last_clean":"2023-12-19T19:00:50.687008+0000","last_became_active":"2023-12-19T19:00:49.697276+0000","last_became_peered":"2023-12-19T19:00:49.697276+0000","last_unstale":"2023-12-19T19:00:50.687008+0000","last_undegraded":"2023-12-19T19:00:50.687008+0000","last_fullsized":"2023-12-19T19:00:50.687008+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:37:30.469791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.677239+0000","last_change":"2023-12-19T19:00:31.995238+0000","last_active":"2023-12-19T19:00:49.677239+0000","last_peered":"2023-12-19T19:00:49.677239+0000","last_clean":"2023-12-19T19:00:49.677239+0000","last_became_active":"2023-12-19T19:00:31.994950+0000","last_became_peered":"2023-12-19T19:00:31.994950+0000","last_unstale":"2023-12-19T19:00:49.677239+0000","last_undegraded":"2023-12-19T19:00:49.677239+0000","last_fullsized":"2023-12-19T19:00:49.677239+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:36.947100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686381+0000","last_change":"2023-12-19T19:00:49.710352+0000","last_active":"2023-12-19T19:00:50.686381+0000","last_peered":"2023-12-19T19:00:50.686381+0000","last_clean":"2023-12-19T19:00:50.686381+0000","last_became_active":"2023-12-19T19:00:49.710065+0000","last_became_peered":"2023-12-19T19:00:49.710065+0000","last_unstale":"2023-12-19T19:00:50.686381+0000","last_undegraded":"2023-12-19T19:00:50.686381+0000","last_fullsized":"2023-12-19T19:00:50.686381+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:10:42.200620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679453+0000","last_change":"2023-12-19T19:00:31.998862+0000","last_active":"2023-12-19T19:00:48.679453+0000","last_peered":"2023-12-19T19:00:48.679453+0000","last_clean":"2023-12-19T19:00:48.679453+0000","last_became_active":"2023-12-19T19:00:31.996848+0000","last_became_peered":"2023-12-19T19:00:31.996848+0000","last_unstale":"2023-12-19T19:00:48.679453+0000","last_undegraded":"2023-12-19T19:00:48.679453+0000","last_fullsized":"2023-12-19T19:00:48.679453+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:52:36.347842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.694969+0000","last_change":"2023-12-19T19:00:49.689226+0000","last_active":"2023-12-19T19:00:49.694969+0000","last_peered":"2023-12-19T19:00:49.694969+0000","last_clean":"2023-12-19T19:00:49.694969+0000","last_became_active":"2023-12-19T19:00:49.688834+0000","last_became_peered":"2023-12-19T19:00:49.688834+0000","last_unstale":"2023-12-19T19:00:49.694969+0000","last_undegraded":"2023-12-19T19:00:49.694969+0000","last_fullsized":"2023-12-19T19:00:49.694969+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:54.546461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.676161+0000","last_change":"2023-12-19T19:00:31.986797+0000","last_active":"2023-12-19T19:00:49.676161+0000","last_peered":"2023-12-19T19:00:49.676161+0000","last_clean":"2023-12-19T19:00:49.676161+0000","last_became_active":"2023-12-19T19:00:31.986522+0000","last_became_peered":"2023-12-19T19:00:31.986522+0000","last_unstale":"2023-12-19T19:00:49.676161+0000","last_undegraded":"2023-12-19T19:00:49.676161+0000","last_fullsized":"2023-12-19T19:00:49.676161+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:34:59.517827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.695795+0000","last_change":"2023-12-19T19:00:49.693333+0000","last_active":"2023-12-19T19:00:49.695795+0000","last_peered":"2023-12-19T19:00:49.695795+0000","last_clean":"2023-12-19T19:00:49.695795+0000","last_became_active":"2023-12-19T19:00:49.693039+0000","last_became_peered":"2023-12-19T19:00:49.693039+0000","last_unstale":"2023-12-19T19:00:49.695795+0000","last_undegraded":"2023-12-19T19:00:49.695795+0000","last_fullsized":"2023-12-19T19:00:49.695795+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:52.332183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.693427+0000","last_change":"2023-12-19T19:00:32.003120+0000","last_active":"2023-12-19T19:00:48.693427+0000","last_peered":"2023-12-19T19:00:48.693427+0000","last_clean":"2023-12-19T19:00:48.693427+0000","last_became_active":"2023-12-19T19:00:32.002670+0000","last_became_peered":"2023-12-19T19:00:32.002670+0000","last_unstale":"2023-12-19T19:00:48.693427+0000","last_undegraded":"2023-12-19T19:00:48.693427+0000","last_fullsized":"2023-12-19T19:00:48.693427+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:56:49.821008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.703330+0000","last_change":"2023-12-19T19:00:49.701440+0000","last_active":"2023-12-19T19:00:49.703330+0000","last_peered":"2023-12-19T19:00:49.703330+0000","last_clean":"2023-12-19T19:00:49.703330+0000","last_became_active":"2023-12-19T19:00:49.701186+0000","last_became_peered":"2023-12-19T19:00:49.701186+0000","last_unstale":"2023-12-19T19:00:49.703330+0000","last_undegraded":"2023-12-19T19:00:49.703330+0000","last_fullsized":"2023-12-19T19:00:49.703330+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:01:51.384923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.683714+0000","last_change":"2023-12-19T19:00:32.006868+0000","last_active":"2023-12-19T19:00:48.683714+0000","last_peered":"2023-12-19T19:00:48.683714+0000","last_clean":"2023-12-19T19:00:48.683714+0000","last_became_active":"2023-12-19T19:00:32.004570+0000","last_became_peered":"2023-12-19T19:00:32.004570+0000","last_unstale":"2023-12-19T19:00:48.683714+0000","last_undegraded":"2023-12-19T19:00:48.683714+0000","last_fullsized":"2023-12-19T19:00:48.683714+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:00.659446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.700724+0000","last_change":"2023-12-19T19:00:49.693550+0000","last_active":"2023-12-19T19:00:49.700724+0000","last_peered":"2023-12-19T19:00:49.700724+0000","last_clean":"2023-12-19T19:00:49.700724+0000","last_became_active":"2023-12-19T19:00:49.693267+0000","last_became_peered":"2023-12-19T19:00:49.693267+0000","last_unstale":"2023-12-19T19:00:49.700724+0000","last_undegraded":"2023-12-19T19:00:49.700724+0000","last_fullsized":"2023-12-19T19:00:49.700724+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:06.329455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.682993+0000","last_change":"2023-12-19T19:00:31.995715+0000","last_active":"2023-12-19T19:00:49.682993+0000","last_peered":"2023-12-19T19:00:49.682993+0000","last_clean":"2023-12-19T19:00:49.682993+0000","last_became_active":"2023-12-19T19:00:31.995368+0000","last_became_peered":"2023-12-19T19:00:31.995368+0000","last_unstale":"2023-12-19T19:00:49.682993+0000","last_undegraded":"2023-12-19T19:00:49.682993+0000","last_fullsized":"2023-12-19T19:00:49.682993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:30.930514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.689006+0000","last_change":"2023-12-19T19:00:49.686349+0000","last_active":"2023-12-19T19:00:49.689006+0000","last_peered":"2023-12-19T19:00:49.689006+0000","last_clean":"2023-12-19T19:00:49.689006+0000","last_became_active":"2023-12-19T19:00:49.685984+0000","last_became_peered":"2023-12-19T19:00:49.685984+0000","last_unstale":"2023-12-19T19:00:49.689006+0000","last_undegraded":"2023-12-19T19:00:49.689006+0000","last_fullsized":"2023-12-19T19:00:49.689006+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:11:00.378718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.696396+0000","last_change":"2023-12-19T19:00:32.003346+0000","last_active":"2023-12-19T19:00:48.696396+0000","last_peered":"2023-12-19T19:00:48.696396+0000","last_clean":"2023-12-19T19:00:48.696396+0000","last_became_active":"2023-12-19T19:00:32.003084+0000","last_became_peered":"2023-12-19T19:00:32.003084+0000","last_unstale":"2023-12-19T19:00:48.696396+0000","last_undegraded":"2023-12-19T19:00:48.696396+0000","last_fullsized":"2023-12-19T19:00:48.696396+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:22:03.749312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.687381+0000","last_change":"2023-12-19T19:00:49.706818+0000","last_active":"2023-12-19T19:00:50.687381+0000","last_peered":"2023-12-19T19:00:50.687381+0000","last_clean":"2023-12-19T19:00:50.687381+0000","last_became_active":"2023-12-19T19:00:49.706537+0000","last_became_peered":"2023-12-19T19:00:49.706537+0000","last_unstale":"2023-12-19T19:00:50.687381+0000","last_undegraded":"2023-12-19T19:00:50.687381+0000","last_fullsized":"2023-12-19T19:00:50.687381+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:29:36.310628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.683122+0000","last_change":"2023-12-19T19:00:32.000999+0000","last_active":"2023-12-19T19:00:48.683122+0000","last_peered":"2023-12-19T19:00:48.683122+0000","last_clean":"2023-12-19T19:00:48.683122+0000","last_became_active":"2023-12-19T19:00:32.000704+0000","last_became_peered":"2023-12-19T19:00:32.000704+0000","last_unstale":"2023-12-19T19:00:48.683122+0000","last_undegraded":"2023-12-19T19:00:48.683122+0000","last_fullsized":"2023-12-19T19:00:48.683122+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:17:19.297149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686810+0000","last_change":"2023-12-19T19:00:49.692638+0000","last_active":"2023-12-19T19:00:50.686810+0000","last_peered":"2023-12-19T19:00:50.686810+0000","last_clean":"2023-12-19T19:00:50.686810+0000","last_became_active":"2023-12-19T19:00:49.692161+0000","last_became_peered":"2023-12-19T19:00:49.692161+0000","last_unstale":"2023-12-19T19:00:50.686810+0000","last_undegraded":"2023-12-19T19:00:50.686810+0000","last_fullsized":"2023-12-19T19:00:50.686810+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:36:18.379135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.680050+0000","last_change":"2023-12-19T19:00:32.000428+0000","last_active":"2023-12-19T19:00:48.680050+0000","last_peered":"2023-12-19T19:00:48.680050+0000","last_clean":"2023-12-19T19:00:48.680050+0000","last_became_active":"2023-12-19T19:00:31.996129+0000","last_became_peered":"2023-12-19T19:00:31.996129+0000","last_unstale":"2023-12-19T19:00:48.680050+0000","last_undegraded":"2023-12-19T19:00:48.680050+0000","last_fullsized":"2023-12-19T19:00:48.680050+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:37:12.617236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.709522+0000","last_change":"2023-12-19T19:00:49.697800+0000","last_active":"2023-12-19T19:00:49.709522+0000","last_peered":"2023-12-19T19:00:49.709522+0000","last_clean":"2023-12-19T19:00:49.709522+0000","last_became_active":"2023-12-19T19:00:49.697400+0000","last_became_peered":"2023-12-19T19:00:49.697400+0000","last_unstale":"2023-12-19T19:00:49.709522+0000","last_undegraded":"2023-12-19T19:00:49.709522+0000","last_fullsized":"2023-12-19T19:00:49.709522+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:49.307770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.676025+0000","last_change":"2023-12-19T19:00:31.996533+0000","last_active":"2023-12-19T19:00:49.676025+0000","last_peered":"2023-12-19T19:00:49.676025+0000","last_clean":"2023-12-19T19:00:49.676025+0000","last_became_active":"2023-12-19T19:00:31.996157+0000","last_became_peered":"2023-12-19T19:00:31.996157+0000","last_unstale":"2023-12-19T19:00:49.676025+0000","last_undegraded":"2023-12-19T19:00:49.676025+0000","last_fullsized":"2023-12-19T19:00:49.676025+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:29.762134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.699053+0000","last_change":"2023-12-19T19:00:49.694054+0000","last_active":"2023-12-19T19:00:49.699053+0000","last_peered":"2023-12-19T19:00:49.699053+0000","last_clean":"2023-12-19T19:00:49.699053+0000","last_became_active":"2023-12-19T19:00:49.693676+0000","last_became_peered":"2023-12-19T19:00:49.693676+0000","last_unstale":"2023-12-19T19:00:49.699053+0000","last_undegraded":"2023-12-19T19:00:49.699053+0000","last_fullsized":"2023-12-19T19:00:49.699053+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:44:44.303299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.682614+0000","last_change":"2023-12-19T19:00:32.004191+0000","last_active":"2023-12-19T19:00:48.682614+0000","last_peered":"2023-12-19T19:00:48.682614+0000","last_clean":"2023-12-19T19:00:48.682614+0000","last_became_active":"2023-12-19T19:00:32.003858+0000","last_became_peered":"2023-12-19T19:00:32.003858+0000","last_unstale":"2023-12-19T19:00:48.682614+0000","last_undegraded":"2023-12-19T19:00:48.682614+0000","last_fullsized":"2023-12-19T19:00:48.682614+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:27:46.472889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686808+0000","last_change":"2023-12-19T19:00:49.708514+0000","last_active":"2023-12-19T19:00:50.686808+0000","last_peered":"2023-12-19T19:00:50.686808+0000","last_clean":"2023-12-19T19:00:50.686808+0000","last_became_active":"2023-12-19T19:00:49.708130+0000","last_became_peered":"2023-12-19T19:00:49.708130+0000","last_unstale":"2023-12-19T19:00:50.686808+0000","last_undegraded":"2023-12-19T19:00:50.686808+0000","last_fullsized":"2023-12-19T19:00:50.686808+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:23.122873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.695249+0000","last_change":"2023-12-19T19:00:31.989937+0000","last_active":"2023-12-19T19:00:48.695249+0000","last_peered":"2023-12-19T19:00:48.695249+0000","last_clean":"2023-12-19T19:00:48.695249+0000","last_became_active":"2023-12-19T19:00:31.989530+0000","last_became_peered":"2023-12-19T19:00:31.989530+0000","last_unstale":"2023-12-19T19:00:48.695249+0000","last_undegraded":"2023-12-19T19:00:48.695249+0000","last_fullsized":"2023-12-19T19:00:48.695249+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:13:48.628064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.717156+0000","last_change":"2023-12-19T19:00:49.712815+0000","last_active":"2023-12-19T19:00:49.717156+0000","last_peered":"2023-12-19T19:00:49.717156+0000","last_clean":"2023-12-19T19:00:49.717156+0000","last_became_active":"2023-12-19T19:00:49.712524+0000","last_became_peered":"2023-12-19T19:00:49.712524+0000","last_unstale":"2023-12-19T19:00:49.717156+0000","last_undegraded":"2023-12-19T19:00:49.717156+0000","last_fullsized":"2023-12-19T19:00:49.717156+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:18.666010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.722636+0000","last_change":"2023-12-19T19:00:48.699016+0000","last_active":"2023-12-19T19:00:49.722636+0000","last_peered":"2023-12-19T19:00:49.722636+0000","last_clean":"2023-12-19T19:00:49.722636+0000","last_became_active":"2023-12-19T19:00:48.698702+0000","last_became_peered":"2023-12-19T19:00:48.698702+0000","last_unstale":"2023-12-19T19:00:49.722636+0000","last_undegraded":"2023-12-19T19:00:49.722636+0000","last_fullsized":"2023-12-19T19:00:49.722636+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:09:52.119249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.697139+0000","last_change":"2023-12-19T19:00:31.993377+0000","last_active":"2023-12-19T19:00:48.697139+0000","last_peered":"2023-12-19T19:00:48.697139+0000","last_clean":"2023-12-19T19:00:48.697139+0000","last_became_active":"2023-12-19T19:00:31.993093+0000","last_became_peered":"2023-12-19T19:00:31.993093+0000","last_unstale":"2023-12-19T19:00:48.697139+0000","last_undegraded":"2023-12-19T19:00:48.697139+0000","last_fullsized":"2023-12-19T19:00:48.697139+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:12.475407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.697398+0000","last_change":"2023-12-19T19:00:30.991662+0000","last_active":"2023-12-19T19:00:48.697398+0000","last_peered":"2023-12-19T19:00:48.697398+0000","last_clean":"2023-12-19T19:00:48.697398+0000","last_became_active":"2023-12-19T19:00:30.990025+0000","last_became_peered":"2023-12-19T19:00:30.990025+0000","last_unstale":"2023-12-19T19:00:48.697398+0000","last_undegraded":"2023-12-19T19:00:48.697398+0000","last_fullsized":"2023-12-19T19:00:48.697398+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:39:36.100774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.688357+0000","last_change":"2023-12-19T19:00:49.696750+0000","last_active":"2023-12-19T19:00:50.688357+0000","last_peered":"2023-12-19T19:00:50.688357+0000","last_clean":"2023-12-19T19:00:50.688357+0000","last_became_active":"2023-12-19T19:00:49.696213+0000","last_became_peered":"2023-12-19T19:00:49.696213+0000","last_unstale":"2023-12-19T19:00:50.688357+0000","last_undegraded":"2023-12-19T19:00:50.688357+0000","last_fullsized":"2023-12-19T19:00:50.688357+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:21:46.996407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.720363+0000","last_change":"2023-12-19T19:00:48.699087+0000","last_active":"2023-12-19T19:00:49.720363+0000","last_peered":"2023-12-19T19:00:49.720363+0000","last_clean":"2023-12-19T19:00:49.720363+0000","last_became_active":"2023-12-19T19:00:48.697912+0000","last_became_peered":"2023-12-19T19:00:48.697912+0000","last_unstale":"2023-12-19T19:00:49.720363+0000","last_undegraded":"2023-12-19T19:00:49.720363+0000","last_fullsized":"2023-12-19T19:00:49.720363+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:51.325614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.675732+0000","last_change":"2023-12-19T19:00:31.994303+0000","last_active":"2023-12-19T19:00:49.675732+0000","last_peered":"2023-12-19T19:00:49.675732+0000","last_clean":"2023-12-19T19:00:49.675732+0000","last_became_active":"2023-12-19T19:00:31.993980+0000","last_became_peered":"2023-12-19T19:00:31.993980+0000","last_unstale":"2023-12-19T19:00:49.675732+0000","last_undegraded":"2023-12-19T19:00:49.675732+0000","last_fullsized":"2023-12-19T19:00:49.675732+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:43:14.293623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679958+0000","last_change":"2023-12-19T19:00:30.982126+0000","last_active":"2023-12-19T19:00:48.679958+0000","last_peered":"2023-12-19T19:00:48.679958+0000","last_clean":"2023-12-19T19:00:48.679958+0000","last_became_active":"2023-12-19T19:00:30.981838+0000","last_became_peered":"2023-12-19T19:00:30.981838+0000","last_unstale":"2023-12-19T19:00:48.679958+0000","last_undegraded":"2023-12-19T19:00:48.679958+0000","last_fullsized":"2023-12-19T19:00:48.679958+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:22.410919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.688268+0000","last_change":"2023-12-19T19:00:49.710022+0000","last_active":"2023-12-19T19:00:50.688268+0000","last_peered":"2023-12-19T19:00:50.688268+0000","last_clean":"2023-12-19T19:00:50.688268+0000","last_became_active":"2023-12-19T19:00:49.708002+0000","last_became_peered":"2023-12-19T19:00:49.708002+0000","last_unstale":"2023-12-19T19:00:50.688268+0000","last_undegraded":"2023-12-19T19:00:50.688268+0000","last_fullsized":"2023-12-19T19:00:50.688268+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:47:42.192040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"53'4","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.688405+0000","last_change":"2023-12-19T19:00:48.694865+0000","last_active":"2023-12-19T19:00:50.688405+0000","last_peered":"2023-12-19T19:00:50.688405+0000","last_clean":"2023-12-19T19:00:50.688405+0000","last_became_active":"2023-12-19T19:00:48.694550+0000","last_became_peered":"2023-12-19T19:00:48.694550+0000","last_unstale":"2023-12-19T19:00:50.688405+0000","last_undegraded":"2023-12-19T19:00:50.688405+0000","last_fullsized":"2023-12-19T19:00:50.688405+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:12.983201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.696705+0000","last_change":"2023-12-19T19:00:32.012177+0000","last_active":"2023-12-19T19:00:48.696705+0000","last_peered":"2023-12-19T19:00:48.696705+0000","last_clean":"2023-12-19T19:00:48.696705+0000","last_became_active":"2023-12-19T19:00:32.009090+0000","last_became_peered":"2023-12-19T19:00:32.009090+0000","last_unstale":"2023-12-19T19:00:48.696705+0000","last_undegraded":"2023-12-19T19:00:48.696705+0000","last_fullsized":"2023-12-19T19:00:48.696705+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:12:29.382064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.696910+0000","last_change":"2023-12-19T19:00:30.989448+0000","last_active":"2023-12-19T19:00:48.696910+0000","last_peered":"2023-12-19T19:00:48.696910+0000","last_clean":"2023-12-19T19:00:48.696910+0000","last_became_active":"2023-12-19T19:00:30.989187+0000","last_became_peered":"2023-12-19T19:00:30.989187+0000","last_unstale":"2023-12-19T19:00:48.696910+0000","last_undegraded":"2023-12-19T19:00:48.696910+0000","last_fullsized":"2023-12-19T19:00:48.696910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:34:58.509471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.702339+0000","last_change":"2023-12-19T19:00:49.698570+0000","last_active":"2023-12-19T19:00:49.702339+0000","last_peered":"2023-12-19T19:00:49.702339+0000","last_clean":"2023-12-19T19:00:49.702339+0000","last_became_active":"2023-12-19T19:00:49.695758+0000","last_became_peered":"2023-12-19T19:00:49.695758+0000","last_unstale":"2023-12-19T19:00:49.702339+0000","last_undegraded":"2023-12-19T19:00:49.702339+0000","last_fullsized":"2023-12-19T19:00:49.702339+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:10.329325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.718950+0000","last_change":"2023-12-19T19:00:48.699905+0000","last_active":"2023-12-19T19:00:49.718950+0000","last_peered":"2023-12-19T19:00:49.718950+0000","last_clean":"2023-12-19T19:00:49.718950+0000","last_became_active":"2023-12-19T19:00:48.699564+0000","last_became_peered":"2023-12-19T19:00:48.699564+0000","last_unstale":"2023-12-19T19:00:49.718950+0000","last_undegraded":"2023-12-19T19:00:49.718950+0000","last_fullsized":"2023-12-19T19:00:49.718950+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:12.983201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.696487+0000","last_change":"2023-12-19T19:00:31.993032+0000","last_active":"2023-12-19T19:00:48.696487+0000","last_peered":"2023-12-19T19:00:48.696487+0000","last_clean":"2023-12-19T19:00:48.696487+0000","last_became_active":"2023-12-19T19:00:31.992397+0000","last_became_peered":"2023-12-19T19:00:31.992397+0000","last_unstale":"2023-12-19T19:00:48.696487+0000","last_undegraded":"2023-12-19T19:00:48.696487+0000","last_fullsized":"2023-12-19T19:00:48.696487+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:26:52.085902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.684455+0000","last_change":"2023-12-19T19:00:30.987551+0000","last_active":"2023-12-19T19:00:49.684455+0000","last_peered":"2023-12-19T19:00:49.684455+0000","last_clean":"2023-12-19T19:00:49.684455+0000","last_became_active":"2023-12-19T19:00:30.987118+0000","last_became_peered":"2023-12-19T19:00:30.987118+0000","last_unstale":"2023-12-19T19:00:49.684455+0000","last_undegraded":"2023-12-19T19:00:49.684455+0000","last_fullsized":"2023-12-19T19:00:49.684455+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:39:48.045336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.690140+0000","last_change":"2023-12-19T19:00:49.683919+0000","last_active":"2023-12-19T19:00:49.690140+0000","last_peered":"2023-12-19T19:00:49.690140+0000","last_clean":"2023-12-19T19:00:49.690140+0000","last_became_active":"2023-12-19T19:00:49.683643+0000","last_became_peered":"2023-12-19T19:00:49.683643+0000","last_unstale":"2023-12-19T19:00:49.690140+0000","last_undegraded":"2023-12-19T19:00:49.690140+0000","last_fullsized":"2023-12-19T19:00:49.690140+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:24:52.995090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686022+0000","last_change":"2023-12-19T19:00:48.686021+0000","last_active":"2023-12-19T19:00:50.686022+0000","last_peered":"2023-12-19T19:00:50.686022+0000","last_clean":"2023-12-19T19:00:50.686022+0000","last_became_active":"2023-12-19T19:00:48.685708+0000","last_became_peered":"2023-12-19T19:00:48.685708+0000","last_unstale":"2023-12-19T19:00:50.686022+0000","last_undegraded":"2023-12-19T19:00:50.686022+0000","last_fullsized":"2023-12-19T19:00:50.686022+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:33:27.498607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679572+0000","last_change":"2023-12-19T19:00:31.992097+0000","last_active":"2023-12-19T19:00:48.679572+0000","last_peered":"2023-12-19T19:00:48.679572+0000","last_clean":"2023-12-19T19:00:48.679572+0000","last_became_active":"2023-12-19T19:00:31.991760+0000","last_became_peered":"2023-12-19T19:00:31.991760+0000","last_unstale":"2023-12-19T19:00:48.679572+0000","last_undegraded":"2023-12-19T19:00:48.679572+0000","last_fullsized":"2023-12-19T19:00:48.679572+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:25:47.564222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679755+0000","last_change":"2023-12-19T19:00:30.993158+0000","last_active":"2023-12-19T19:00:48.679755+0000","last_peered":"2023-12-19T19:00:48.679755+0000","last_clean":"2023-12-19T19:00:48.679755+0000","last_became_active":"2023-12-19T19:00:30.992878+0000","last_became_peered":"2023-12-19T19:00:30.992878+0000","last_unstale":"2023-12-19T19:00:48.679755+0000","last_undegraded":"2023-12-19T19:00:48.679755+0000","last_fullsized":"2023-12-19T19:00:48.679755+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:15:13.218056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.691708+0000","last_change":"2023-12-19T19:00:49.685825+0000","last_active":"2023-12-19T19:00:49.691708+0000","last_peered":"2023-12-19T19:00:49.691708+0000","last_clean":"2023-12-19T19:00:49.691708+0000","last_became_active":"2023-12-19T19:00:49.685558+0000","last_became_peered":"2023-12-19T19:00:49.685558+0000","last_unstale":"2023-12-19T19:00:49.691708+0000","last_undegraded":"2023-12-19T19:00:49.691708+0000","last_fullsized":"2023-12-19T19:00:49.691708+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:25:33.897940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.680566+0000","last_change":"2023-12-19T19:00:48.688773+0000","last_active":"2023-12-19T19:00:49.680566+0000","last_peered":"2023-12-19T19:00:49.680566+0000","last_clean":"2023-12-19T19:00:49.680566+0000","last_became_active":"2023-12-19T19:00:48.688422+0000","last_became_peered":"2023-12-19T19:00:48.688422+0000","last_unstale":"2023-12-19T19:00:49.680566+0000","last_undegraded":"2023-12-19T19:00:49.680566+0000","last_fullsized":"2023-12-19T19:00:49.680566+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:50:55.590060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679712+0000","last_change":"2023-12-19T19:00:32.013474+0000","last_active":"2023-12-19T19:00:48.679712+0000","last_peered":"2023-12-19T19:00:48.679712+0000","last_clean":"2023-12-19T19:00:48.679712+0000","last_became_active":"2023-12-19T19:00:32.013185+0000","last_became_peered":"2023-12-19T19:00:32.013185+0000","last_unstale":"2023-12-19T19:00:48.679712+0000","last_undegraded":"2023-12-19T19:00:48.679712+0000","last_fullsized":"2023-12-19T19:00:48.679712+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:05.421482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.696133+0000","last_change":"2023-12-19T19:00:30.988798+0000","last_active":"2023-12-19T19:00:48.696133+0000","last_peered":"2023-12-19T19:00:48.696133+0000","last_clean":"2023-12-19T19:00:48.696133+0000","last_became_active":"2023-12-19T19:00:30.988493+0000","last_became_peered":"2023-12-19T19:00:30.988493+0000","last_unstale":"2023-12-19T19:00:48.696133+0000","last_undegraded":"2023-12-19T19:00:48.696133+0000","last_fullsized":"2023-12-19T19:00:48.696133+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:02.746664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686939+0000","last_change":"2023-12-19T19:00:49.693750+0000","last_active":"2023-12-19T19:00:50.686939+0000","last_peered":"2023-12-19T19:00:50.686939+0000","last_clean":"2023-12-19T19:00:50.686939+0000","last_became_active":"2023-12-19T19:00:49.693471+0000","last_became_peered":"2023-12-19T19:00:49.693471+0000","last_unstale":"2023-12-19T19:00:50.686939+0000","last_undegraded":"2023-12-19T19:00:50.686939+0000","last_fullsized":"2023-12-19T19:00:50.686939+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:37:30.318626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.722546+0000","last_change":"2023-12-19T19:00:48.687434+0000","last_active":"2023-12-19T19:00:49.722546+0000","last_peered":"2023-12-19T19:00:49.722546+0000","last_clean":"2023-12-19T19:00:49.722546+0000","last_became_active":"2023-12-19T19:00:48.687077+0000","last_became_peered":"2023-12-19T19:00:48.687077+0000","last_unstale":"2023-12-19T19:00:49.722546+0000","last_undegraded":"2023-12-19T19:00:49.722546+0000","last_fullsized":"2023-12-19T19:00:49.722546+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:30:42.842550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.692244+0000","last_change":"2023-12-19T19:00:31.998669+0000","last_active":"2023-12-19T19:00:48.692244+0000","last_peered":"2023-12-19T19:00:48.692244+0000","last_clean":"2023-12-19T19:00:48.692244+0000","last_became_active":"2023-12-19T19:00:31.997493+0000","last_became_peered":"2023-12-19T19:00:31.997493+0000","last_unstale":"2023-12-19T19:00:48.692244+0000","last_undegraded":"2023-12-19T19:00:48.692244+0000","last_fullsized":"2023-12-19T19:00:48.692244+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:28.740800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.682806+0000","last_change":"2023-12-19T19:00:30.987264+0000","last_active":"2023-12-19T19:00:49.682806+0000","last_peered":"2023-12-19T19:00:49.682806+0000","last_clean":"2023-12-19T19:00:49.682806+0000","last_became_active":"2023-12-19T19:00:30.986365+0000","last_became_peered":"2023-12-19T19:00:30.986365+0000","last_unstale":"2023-12-19T19:00:49.682806+0000","last_undegraded":"2023-12-19T19:00:49.682806+0000","last_fullsized":"2023-12-19T19:00:49.682806+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:14.427919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.695136+0000","last_change":"2023-12-19T19:00:49.691769+0000","last_active":"2023-12-19T19:00:49.695136+0000","last_peered":"2023-12-19T19:00:49.695136+0000","last_clean":"2023-12-19T19:00:49.695136+0000","last_became_active":"2023-12-19T19:00:49.691418+0000","last_became_peered":"2023-12-19T19:00:49.691418+0000","last_unstale":"2023-12-19T19:00:49.695136+0000","last_undegraded":"2023-12-19T19:00:49.695136+0000","last_fullsized":"2023-12-19T19:00:49.695136+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:48.631905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.719319+0000","last_change":"2023-12-19T19:00:48.703048+0000","last_active":"2023-12-19T19:00:49.719319+0000","last_peered":"2023-12-19T19:00:49.719319+0000","last_clean":"2023-12-19T19:00:49.719319+0000","last_became_active":"2023-12-19T19:00:48.702758+0000","last_became_peered":"2023-12-19T19:00:48.702758+0000","last_unstale":"2023-12-19T19:00:49.719319+0000","last_undegraded":"2023-12-19T19:00:49.719319+0000","last_fullsized":"2023-12-19T19:00:49.719319+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:53.539893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679531+0000","last_change":"2023-12-19T19:00:31.992961+0000","last_active":"2023-12-19T19:00:48.679531+0000","last_peered":"2023-12-19T19:00:48.679531+0000","last_clean":"2023-12-19T19:00:48.679531+0000","last_became_active":"2023-12-19T19:00:31.992515+0000","last_became_peered":"2023-12-19T19:00:31.992515+0000","last_unstale":"2023-12-19T19:00:48.679531+0000","last_undegraded":"2023-12-19T19:00:48.679531+0000","last_fullsized":"2023-12-19T19:00:48.679531+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:25:16.196549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.680877+0000","last_change":"2023-12-19T19:00:30.984169+0000","last_active":"2023-12-19T19:00:48.680877+0000","last_peered":"2023-12-19T19:00:48.680877+0000","last_clean":"2023-12-19T19:00:48.680877+0000","last_became_active":"2023-12-19T19:00:30.982847+0000","last_became_peered":"2023-12-19T19:00:30.982847+0000","last_unstale":"2023-12-19T19:00:48.680877+0000","last_undegraded":"2023-12-19T19:00:48.680877+0000","last_fullsized":"2023-12-19T19:00:48.680877+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:56:39.717560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.709056+0000","last_change":"2023-12-19T19:00:49.696138+0000","last_active":"2023-12-19T19:00:49.709056+0000","last_peered":"2023-12-19T19:00:49.709056+0000","last_clean":"2023-12-19T19:00:49.709056+0000","last_became_active":"2023-12-19T19:00:49.695777+0000","last_became_peered":"2023-12-19T19:00:49.695777+0000","last_unstale":"2023-12-19T19:00:49.709056+0000","last_undegraded":"2023-12-19T19:00:49.709056+0000","last_fullsized":"2023-12-19T19:00:49.709056+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:40:06.755083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"53'3","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.720902+0000","last_change":"2023-12-19T19:00:48.692918+0000","last_active":"2023-12-19T19:00:49.720902+0000","last_peered":"2023-12-19T19:00:49.720902+0000","last_clean":"2023-12-19T19:00:49.720902+0000","last_became_active":"2023-12-19T19:00:48.692629+0000","last_became_peered":"2023-12-19T19:00:48.692629+0000","last_unstale":"2023-12-19T19:00:49.720902+0000","last_undegraded":"2023-12-19T19:00:49.720902+0000","last_fullsized":"2023-12-19T19:00:49.720902+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:32:19.135099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.681390+0000","last_change":"2023-12-19T19:00:31.995512+0000","last_active":"2023-12-19T19:00:48.681390+0000","last_peered":"2023-12-19T19:00:48.681390+0000","last_clean":"2023-12-19T19:00:48.681390+0000","last_became_active":"2023-12-19T19:00:31.994458+0000","last_became_peered":"2023-12-19T19:00:31.994458+0000","last_unstale":"2023-12-19T19:00:48.681390+0000","last_undegraded":"2023-12-19T19:00:48.681390+0000","last_fullsized":"2023-12-19T19:00:48.681390+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:33:10.803785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.678706+0000","last_change":"2023-12-19T19:00:30.992474+0000","last_active":"2023-12-19T19:00:49.678706+0000","last_peered":"2023-12-19T19:00:49.678706+0000","last_clean":"2023-12-19T19:00:49.678706+0000","last_became_active":"2023-12-19T19:00:30.992125+0000","last_became_peered":"2023-12-19T19:00:30.992125+0000","last_unstale":"2023-12-19T19:00:49.678706+0000","last_undegraded":"2023-12-19T19:00:49.678706+0000","last_fullsized":"2023-12-19T19:00:49.678706+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:26.259403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.694770+0000","last_change":"2023-12-19T19:00:49.689929+0000","last_active":"2023-12-19T19:00:49.694770+0000","last_peered":"2023-12-19T19:00:49.694770+0000","last_clean":"2023-12-19T19:00:49.694770+0000","last_became_active":"2023-12-19T19:00:49.689624+0000","last_became_peered":"2023-12-19T19:00:49.689624+0000","last_unstale":"2023-12-19T19:00:49.694770+0000","last_undegraded":"2023-12-19T19:00:49.694770+0000","last_fullsized":"2023-12-19T19:00:49.694770+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:06.103802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"53'6","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686667+0000","last_change":"2023-12-19T19:00:48.685932+0000","last_active":"2023-12-19T19:00:50.686667+0000","last_peered":"2023-12-19T19:00:50.686667+0000","last_clean":"2023-12-19T19:00:50.686667+0000","last_became_active":"2023-12-19T19:00:48.685445+0000","last_became_peered":"2023-12-19T19:00:48.685445+0000","last_unstale":"2023-12-19T19:00:50.686667+0000","last_undegraded":"2023-12-19T19:00:50.686667+0000","last_fullsized":"2023-12-19T19:00:50.686667+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:39:53.803952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.678589+0000","last_change":"2023-12-19T19:00:31.999958+0000","last_active":"2023-12-19T19:00:49.678589+0000","last_peered":"2023-12-19T19:00:49.678589+0000","last_clean":"2023-12-19T19:00:49.678589+0000","last_became_active":"2023-12-19T19:00:31.999674+0000","last_became_peered":"2023-12-19T19:00:31.999674+0000","last_unstale":"2023-12-19T19:00:49.678589+0000","last_undegraded":"2023-12-19T19:00:49.678589+0000","last_fullsized":"2023-12-19T19:00:49.678589+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:40.147962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.680051+0000","last_change":"2023-12-19T19:00:30.992655+0000","last_active":"2023-12-19T19:00:48.680051+0000","last_peered":"2023-12-19T19:00:48.680051+0000","last_clean":"2023-12-19T19:00:48.680051+0000","last_became_active":"2023-12-19T19:00:30.992388+0000","last_became_peered":"2023-12-19T19:00:30.992388+0000","last_unstale":"2023-12-19T19:00:48.680051+0000","last_undegraded":"2023-12-19T19:00:48.680051+0000","last_fullsized":"2023-12-19T19:00:48.680051+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:29:24.264763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.687506+0000","last_change":"2023-12-19T19:00:49.702369+0000","last_active":"2023-12-19T19:00:50.687506+0000","last_peered":"2023-12-19T19:00:50.687506+0000","last_clean":"2023-12-19T19:00:50.687506+0000","last_became_active":"2023-12-19T19:00:49.701432+0000","last_became_peered":"2023-12-19T19:00:49.701432+0000","last_unstale":"2023-12-19T19:00:50.687506+0000","last_undegraded":"2023-12-19T19:00:50.687506+0000","last_fullsized":"2023-12-19T19:00:50.687506+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:49:53.095935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.692954+0000","last_change":"2023-12-19T19:00:48.685838+0000","last_active":"2023-12-19T19:00:49.692954+0000","last_peered":"2023-12-19T19:00:49.692954+0000","last_clean":"2023-12-19T19:00:49.692954+0000","last_became_active":"2023-12-19T19:00:48.685520+0000","last_became_peered":"2023-12-19T19:00:48.685520+0000","last_unstale":"2023-12-19T19:00:49.692954+0000","last_undegraded":"2023-12-19T19:00:49.692954+0000","last_fullsized":"2023-12-19T19:00:49.692954+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:29:41.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.674865+0000","last_change":"2023-12-19T19:00:31.999476+0000","last_active":"2023-12-19T19:00:49.674865+0000","last_peered":"2023-12-19T19:00:49.674865+0000","last_clean":"2023-12-19T19:00:49.674865+0000","last_became_active":"2023-12-19T19:00:31.998991+0000","last_became_peered":"2023-12-19T19:00:31.998991+0000","last_unstale":"2023-12-19T19:00:49.674865+0000","last_undegraded":"2023-12-19T19:00:49.674865+0000","last_fullsized":"2023-12-19T19:00:49.674865+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:50:25.706371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.679311+0000","last_change":"2023-12-19T19:00:30.986780+0000","last_active":"2023-12-19T19:00:49.679311+0000","last_peered":"2023-12-19T19:00:49.679311+0000","last_clean":"2023-12-19T19:00:49.679311+0000","last_became_active":"2023-12-19T19:00:30.986477+0000","last_became_peered":"2023-12-19T19:00:30.986477+0000","last_unstale":"2023-12-19T19:00:49.679311+0000","last_undegraded":"2023-12-19T19:00:49.679311+0000","last_fullsized":"2023-12-19T19:00:49.679311+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:40:24.990216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.688316+0000","last_change":"2023-12-19T19:00:49.704508+0000","last_active":"2023-12-19T19:00:50.688316+0000","last_peered":"2023-12-19T19:00:50.688316+0000","last_clean":"2023-12-19T19:00:50.688316+0000","last_became_active":"2023-12-19T19:00:49.704231+0000","last_became_peered":"2023-12-19T19:00:49.704231+0000","last_unstale":"2023-12-19T19:00:50.688316+0000","last_undegraded":"2023-12-19T19:00:50.688316+0000","last_fullsized":"2023-12-19T19:00:50.688316+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:44:44.303299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.700201+0000","last_change":"2023-12-19T19:00:48.697401+0000","last_active":"2023-12-19T19:00:49.700201+0000","last_peered":"2023-12-19T19:00:49.700201+0000","last_clean":"2023-12-19T19:00:49.700201+0000","last_became_active":"2023-12-19T19:00:48.697020+0000","last_became_peered":"2023-12-19T19:00:48.697020+0000","last_unstale":"2023-12-19T19:00:49.700201+0000","last_undegraded":"2023-12-19T19:00:49.700201+0000","last_fullsized":"2023-12-19T19:00:49.700201+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:22:20.444135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.679105+0000","last_change":"2023-12-19T19:00:32.000825+0000","last_active":"2023-12-19T19:00:49.679105+0000","last_peered":"2023-12-19T19:00:49.679105+0000","last_clean":"2023-12-19T19:00:49.679105+0000","last_became_active":"2023-12-19T19:00:32.000565+0000","last_became_peered":"2023-12-19T19:00:32.000565+0000","last_unstale":"2023-12-19T19:00:49.679105+0000","last_undegraded":"2023-12-19T19:00:49.679105+0000","last_fullsized":"2023-12-19T19:00:49.679105+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:22:03.749312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'9","reported_seq":24,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.680509+0000","last_change":"2023-12-19T19:00:30.990334+0000","last_active":"2023-12-19T19:00:48.680509+0000","last_peered":"2023-12-19T19:00:48.680509+0000","last_clean":"2023-12-19T19:00:48.680509+0000","last_became_active":"2023-12-19T19:00:30.989993+0000","last_became_peered":"2023-12-19T19:00:30.989993+0000","last_unstale":"2023-12-19T19:00:48.680509+0000","last_undegraded":"2023-12-19T19:00:48.680509+0000","last_fullsized":"2023-12-19T19:00:48.680509+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:04:27.417357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.711720+0000","last_change":"2023-12-19T19:00:49.710541+0000","last_active":"2023-12-19T19:00:49.711720+0000","last_peered":"2023-12-19T19:00:49.711720+0000","last_clean":"2023-12-19T19:00:49.711720+0000","last_became_active":"2023-12-19T19:00:49.710281+0000","last_became_peered":"2023-12-19T19:00:49.710281+0000","last_unstale":"2023-12-19T19:00:49.711720+0000","last_undegraded":"2023-12-19T19:00:49.711720+0000","last_fullsized":"2023-12-19T19:00:49.711720+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:26:05.265613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.687037+0000","last_change":"2023-12-19T19:00:48.696405+0000","last_active":"2023-12-19T19:00:50.687037+0000","last_peered":"2023-12-19T19:00:50.687037+0000","last_clean":"2023-12-19T19:00:50.687037+0000","last_became_active":"2023-12-19T19:00:48.695230+0000","last_became_peered":"2023-12-19T19:00:48.695230+0000","last_unstale":"2023-12-19T19:00:50.687037+0000","last_undegraded":"2023-12-19T19:00:50.687037+0000","last_fullsized":"2023-12-19T19:00:50.687037+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:26:04.259045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.683036+0000","last_change":"2023-12-19T19:00:32.011251+0000","last_active":"2023-12-19T19:00:49.683036+0000","last_peered":"2023-12-19T19:00:49.683036+0000","last_clean":"2023-12-19T19:00:49.683036+0000","last_became_active":"2023-12-19T19:00:32.010982+0000","last_became_peered":"2023-12-19T19:00:32.010982+0000","last_unstale":"2023-12-19T19:00:49.683036+0000","last_undegraded":"2023-12-19T19:00:49.683036+0000","last_fullsized":"2023-12-19T19:00:49.683036+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:34:59.517827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679862+0000","last_change":"2023-12-19T19:00:30.993444+0000","last_active":"2023-12-19T19:00:48.679862+0000","last_peered":"2023-12-19T19:00:48.679862+0000","last_clean":"2023-12-19T19:00:48.679862+0000","last_became_active":"2023-12-19T19:00:30.993163+0000","last_became_peered":"2023-12-19T19:00:30.993163+0000","last_unstale":"2023-12-19T19:00:48.679862+0000","last_undegraded":"2023-12-19T19:00:48.679862+0000","last_fullsized":"2023-12-19T19:00:48.679862+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:11.467052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.690758+0000","last_change":"2023-12-19T19:00:49.688841+0000","last_active":"2023-12-19T19:00:49.690758+0000","last_peered":"2023-12-19T19:00:49.690758+0000","last_clean":"2023-12-19T19:00:49.690758+0000","last_became_active":"2023-12-19T19:00:49.688562+0000","last_became_peered":"2023-12-19T19:00:49.688562+0000","last_unstale":"2023-12-19T19:00:49.690758+0000","last_undegraded":"2023-12-19T19:00:49.690758+0000","last_fullsized":"2023-12-19T19:00:49.690758+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:06:25.347465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"53'8","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.723513+0000","last_change":"2023-12-19T19:00:48.689236+0000","last_active":"2023-12-19T19:00:49.723513+0000","last_peered":"2023-12-19T19:00:49.723513+0000","last_clean":"2023-12-19T19:00:49.723513+0000","last_became_active":"2023-12-19T19:00:48.688907+0000","last_became_peered":"2023-12-19T19:00:48.688907+0000","last_unstale":"2023-12-19T19:00:49.723513+0000","last_undegraded":"2023-12-19T19:00:49.723513+0000","last_fullsized":"2023-12-19T19:00:49.723513+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:29.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.677345+0000","last_change":"2023-12-19T19:00:31.990491+0000","last_active":"2023-12-19T19:00:49.677345+0000","last_peered":"2023-12-19T19:00:49.677345+0000","last_clean":"2023-12-19T19:00:49.677345+0000","last_became_active":"2023-12-19T19:00:31.990211+0000","last_became_peered":"2023-12-19T19:00:31.990211+0000","last_unstale":"2023-12-19T19:00:49.677345+0000","last_undegraded":"2023-12-19T19:00:49.677345+0000","last_fullsized":"2023-12-19T19:00:49.677345+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:30.930514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.692806+0000","last_change":"2023-12-19T19:00:30.982775+0000","last_active":"2023-12-19T19:00:48.692806+0000","last_peered":"2023-12-19T19:00:48.692806+0000","last_clean":"2023-12-19T19:00:48.692806+0000","last_became_active":"2023-12-19T19:00:30.982471+0000","last_became_peered":"2023-12-19T19:00:30.982471+0000","last_unstale":"2023-12-19T19:00:48.692806+0000","last_undegraded":"2023-12-19T19:00:48.692806+0000","last_fullsized":"2023-12-19T19:00:48.692806+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:55:52.355420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686998+0000","last_change":"2023-12-19T19:00:49.690530+0000","last_active":"2023-12-19T19:00:50.686998+0000","last_peered":"2023-12-19T19:00:50.686998+0000","last_clean":"2023-12-19T19:00:50.686998+0000","last_became_active":"2023-12-19T19:00:49.690037+0000","last_became_peered":"2023-12-19T19:00:49.690037+0000","last_unstale":"2023-12-19T19:00:50.686998+0000","last_undegraded":"2023-12-19T19:00:50.686998+0000","last_fullsized":"2023-12-19T19:00:50.686998+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:33:53.071370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686363+0000","last_change":"2023-12-19T19:00:48.684086+0000","last_active":"2023-12-19T19:00:50.686363+0000","last_peered":"2023-12-19T19:00:50.686363+0000","last_clean":"2023-12-19T19:00:50.686363+0000","last_became_active":"2023-12-19T19:00:48.683767+0000","last_became_peered":"2023-12-19T19:00:48.683767+0000","last_unstale":"2023-12-19T19:00:50.686363+0000","last_undegraded":"2023-12-19T19:00:50.686363+0000","last_fullsized":"2023-12-19T19:00:50.686363+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:40:42.693394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.680789+0000","last_change":"2023-12-19T19:00:31.990882+0000","last_active":"2023-12-19T19:00:48.680789+0000","last_peered":"2023-12-19T19:00:48.680789+0000","last_clean":"2023-12-19T19:00:48.680789+0000","last_became_active":"2023-12-19T19:00:31.990571+0000","last_became_peered":"2023-12-19T19:00:31.990571+0000","last_unstale":"2023-12-19T19:00:48.680789+0000","last_undegraded":"2023-12-19T19:00:48.680789+0000","last_fullsized":"2023-12-19T19:00:48.680789+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:21:56.040888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.682901+0000","last_change":"2023-12-19T19:00:30.987616+0000","last_active":"2023-12-19T19:00:49.682901+0000","last_peered":"2023-12-19T19:00:49.682901+0000","last_clean":"2023-12-19T19:00:49.682901+0000","last_became_active":"2023-12-19T19:00:30.987300+0000","last_became_peered":"2023-12-19T19:00:30.987300+0000","last_unstale":"2023-12-19T19:00:49.682901+0000","last_undegraded":"2023-12-19T19:00:49.682901+0000","last_fullsized":"2023-12-19T19:00:49.682901+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:30.598024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.687361+0000","last_change":"2023-12-19T19:00:49.691367+0000","last_active":"2023-12-19T19:00:50.687361+0000","last_peered":"2023-12-19T19:00:50.687361+0000","last_clean":"2023-12-19T19:00:50.687361+0000","last_became_active":"2023-12-19T19:00:49.690887+0000","last_became_peered":"2023-12-19T19:00:49.690887+0000","last_unstale":"2023-12-19T19:00:50.687361+0000","last_undegraded":"2023-12-19T19:00:50.687361+0000","last_fullsized":"2023-12-19T19:00:50.687361+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:13.989770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.699046+0000","last_change":"2023-12-19T19:00:48.698784+0000","last_active":"2023-12-19T19:00:49.699046+0000","last_peered":"2023-12-19T19:00:49.699046+0000","last_clean":"2023-12-19T19:00:49.699046+0000","last_became_active":"2023-12-19T19:00:48.698506+0000","last_became_peered":"2023-12-19T19:00:48.698506+0000","last_unstale":"2023-12-19T19:00:49.699046+0000","last_undegraded":"2023-12-19T19:00:49.699046+0000","last_fullsized":"2023-12-19T19:00:49.699046+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:47.625337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.676335+0000","last_change":"2023-12-19T19:00:31.986177+0000","last_active":"2023-12-19T19:00:49.676335+0000","last_peered":"2023-12-19T19:00:49.676335+0000","last_clean":"2023-12-19T19:00:49.676335+0000","last_became_active":"2023-12-19T19:00:31.985896+0000","last_became_peered":"2023-12-19T19:00:31.985896+0000","last_unstale":"2023-12-19T19:00:49.676335+0000","last_undegraded":"2023-12-19T19:00:49.676335+0000","last_fullsized":"2023-12-19T19:00:49.676335+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:36.845071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.675722+0000","last_change":"2023-12-19T19:00:30.990218+0000","last_active":"2023-12-19T19:00:49.675722+0000","last_peered":"2023-12-19T19:00:49.675722+0000","last_clean":"2023-12-19T19:00:49.675722+0000","last_became_active":"2023-12-19T19:00:30.989907+0000","last_became_peered":"2023-12-19T19:00:30.989907+0000","last_unstale":"2023-12-19T19:00:49.675722+0000","last_undegraded":"2023-12-19T19:00:49.675722+0000","last_fullsized":"2023-12-19T19:00:49.675722+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:32:52.108796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686644+0000","last_change":"2023-12-19T19:00:49.688589+0000","last_active":"2023-12-19T19:00:50.686644+0000","last_peered":"2023-12-19T19:00:50.686644+0000","last_clean":"2023-12-19T19:00:50.686644+0000","last_became_active":"2023-12-19T19:00:49.688316+0000","last_became_peered":"2023-12-19T19:00:49.688316+0000","last_unstale":"2023-12-19T19:00:50.686644+0000","last_undegraded":"2023-12-19T19:00:50.686644+0000","last_fullsized":"2023-12-19T19:00:50.686644+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:54.546461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.720383+0000","last_change":"2023-12-19T19:00:48.698936+0000","last_active":"2023-12-19T19:00:49.720383+0000","last_peered":"2023-12-19T19:00:49.720383+0000","last_clean":"2023-12-19T19:00:49.720383+0000","last_became_active":"2023-12-19T19:00:48.698635+0000","last_became_peered":"2023-12-19T19:00:48.698635+0000","last_unstale":"2023-12-19T19:00:49.720383+0000","last_undegraded":"2023-12-19T19:00:49.720383+0000","last_fullsized":"2023-12-19T19:00:49.720383+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:27:08.780724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.677409+0000","last_change":"2023-12-19T19:00:31.996849+0000","last_active":"2023-12-19T19:00:49.677409+0000","last_peered":"2023-12-19T19:00:49.677409+0000","last_clean":"2023-12-19T19:00:49.677409+0000","last_became_active":"2023-12-19T19:00:31.996575+0000","last_became_peered":"2023-12-19T19:00:31.996575+0000","last_unstale":"2023-12-19T19:00:49.677409+0000","last_undegraded":"2023-12-19T19:00:49.677409+0000","last_fullsized":"2023-12-19T19:00:49.677409+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:26:52.085902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.681401+0000","last_change":"2023-12-19T19:00:30.991150+0000","last_active":"2023-12-19T19:00:48.681401+0000","last_peered":"2023-12-19T19:00:48.681401+0000","last_clean":"2023-12-19T19:00:48.681401+0000","last_became_active":"2023-12-19T19:00:30.990867+0000","last_became_peered":"2023-12-19T19:00:30.990867+0000","last_unstale":"2023-12-19T19:00:48.681401+0000","last_undegraded":"2023-12-19T19:00:48.681401+0000","last_fullsized":"2023-12-19T19:00:48.681401+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:32.181776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.700252+0000","last_change":"2023-12-19T19:00:49.695365+0000","last_active":"2023-12-19T19:00:49.700252+0000","last_peered":"2023-12-19T19:00:49.700252+0000","last_clean":"2023-12-19T19:00:49.700252+0000","last_became_active":"2023-12-19T19:00:49.695102+0000","last_became_peered":"2023-12-19T19:00:49.695102+0000","last_unstale":"2023-12-19T19:00:49.700252+0000","last_undegraded":"2023-12-19T19:00:49.700252+0000","last_fullsized":"2023-12-19T19:00:49.700252+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:38:53.288959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.688117+0000","last_change":"2023-12-19T19:00:48.697714+0000","last_active":"2023-12-19T19:00:50.688117+0000","last_peered":"2023-12-19T19:00:50.688117+0000","last_clean":"2023-12-19T19:00:50.688117+0000","last_became_active":"2023-12-19T19:00:48.696871+0000","last_became_peered":"2023-12-19T19:00:48.696871+0000","last_unstale":"2023-12-19T19:00:50.688117+0000","last_undegraded":"2023-12-19T19:00:50.688117+0000","last_fullsized":"2023-12-19T19:00:50.688117+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:05:59.302537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.684695+0000","last_change":"2023-12-19T19:00:32.012118+0000","last_active":"2023-12-19T19:00:49.684695+0000","last_peered":"2023-12-19T19:00:49.684695+0000","last_clean":"2023-12-19T19:00:49.684695+0000","last_became_active":"2023-12-19T19:00:32.011853+0000","last_became_peered":"2023-12-19T19:00:32.011853+0000","last_unstale":"2023-12-19T19:00:49.684695+0000","last_undegraded":"2023-12-19T19:00:49.684695+0000","last_fullsized":"2023-12-19T19:00:49.684695+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:29.762134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.697211+0000","last_change":"2023-12-19T19:00:30.990317+0000","last_active":"2023-12-19T19:00:48.697211+0000","last_peered":"2023-12-19T19:00:48.697211+0000","last_clean":"2023-12-19T19:00:48.697211+0000","last_became_active":"2023-12-19T19:00:30.990062+0000","last_became_peered":"2023-12-19T19:00:30.990062+0000","last_unstale":"2023-12-19T19:00:48.697211+0000","last_undegraded":"2023-12-19T19:00:48.697211+0000","last_fullsized":"2023-12-19T19:00:48.697211+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:35.938744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.694474+0000","last_change":"2023-12-19T19:00:49.687903+0000","last_active":"2023-12-19T19:00:49.694474+0000","last_peered":"2023-12-19T19:00:49.694474+0000","last_clean":"2023-12-19T19:00:49.694474+0000","last_became_active":"2023-12-19T19:00:49.687589+0000","last_became_peered":"2023-12-19T19:00:49.687589+0000","last_unstale":"2023-12-19T19:00:49.694474+0000","last_undegraded":"2023-12-19T19:00:49.694474+0000","last_fullsized":"2023-12-19T19:00:49.694474+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:12:47.083455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.721198+0000","last_change":"2023-12-19T19:00:48.701514+0000","last_active":"2023-12-19T19:00:49.721198+0000","last_peered":"2023-12-19T19:00:49.721198+0000","last_clean":"2023-12-19T19:00:49.721198+0000","last_became_active":"2023-12-19T19:00:48.701201+0000","last_became_peered":"2023-12-19T19:00:48.701201+0000","last_unstale":"2023-12-19T19:00:49.721198+0000","last_undegraded":"2023-12-19T19:00:49.721198+0000","last_fullsized":"2023-12-19T19:00:49.721198+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:10:59.372150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679696+0000","last_change":"2023-12-19T19:00:31.995086+0000","last_active":"2023-12-19T19:00:48.679696+0000","last_peered":"2023-12-19T19:00:48.679696+0000","last_clean":"2023-12-19T19:00:48.679696+0000","last_became_active":"2023-12-19T19:00:31.993887+0000","last_became_peered":"2023-12-19T19:00:31.993887+0000","last_unstale":"2023-12-19T19:00:48.679696+0000","last_undegraded":"2023-12-19T19:00:48.679696+0000","last_fullsized":"2023-12-19T19:00:48.679696+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:36:00.677744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.681864+0000","last_change":"2023-12-19T19:00:30.987882+0000","last_active":"2023-12-19T19:00:49.681864+0000","last_peered":"2023-12-19T19:00:49.681864+0000","last_clean":"2023-12-19T19:00:49.681864+0000","last_became_active":"2023-12-19T19:00:30.987654+0000","last_became_peered":"2023-12-19T19:00:30.987654+0000","last_unstale":"2023-12-19T19:00:49.681864+0000","last_undegraded":"2023-12-19T19:00:49.681864+0000","last_fullsized":"2023-12-19T19:00:49.681864+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:40:24.990216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.688614+0000","last_change":"2023-12-19T19:00:49.693197+0000","last_active":"2023-12-19T19:00:50.688614+0000","last_peered":"2023-12-19T19:00:50.688614+0000","last_clean":"2023-12-19T19:00:50.688614+0000","last_became_active":"2023-12-19T19:00:49.692888+0000","last_became_peered":"2023-12-19T19:00:49.692888+0000","last_unstale":"2023-12-19T19:00:50.688614+0000","last_undegraded":"2023-12-19T19:00:50.688614+0000","last_fullsized":"2023-12-19T19:00:50.688614+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:25.823608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.722614+0000","last_change":"2023-12-19T19:00:48.699056+0000","last_active":"2023-12-19T19:00:49.722614+0000","last_peered":"2023-12-19T19:00:49.722614+0000","last_clean":"2023-12-19T19:00:49.722614+0000","last_became_active":"2023-12-19T19:00:48.698759+0000","last_became_peered":"2023-12-19T19:00:48.698759+0000","last_unstale":"2023-12-19T19:00:49.722614+0000","last_undegraded":"2023-12-19T19:00:49.722614+0000","last_fullsized":"2023-12-19T19:00:49.722614+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:40.114097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.679197+0000","last_change":"2023-12-19T19:00:32.002709+0000","last_active":"2023-12-19T19:00:49.679197+0000","last_peered":"2023-12-19T19:00:49.679197+0000","last_clean":"2023-12-19T19:00:49.679197+0000","last_became_active":"2023-12-19T19:00:32.002313+0000","last_became_peered":"2023-12-19T19:00:32.002313+0000","last_unstale":"2023-12-19T19:00:49.679197+0000","last_undegraded":"2023-12-19T19:00:49.679197+0000","last_fullsized":"2023-12-19T19:00:49.679197+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:10:42.677327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.696817+0000","last_change":"2023-12-19T19:00:30.989148+0000","last_active":"2023-12-19T19:00:48.696817+0000","last_peered":"2023-12-19T19:00:48.696817+0000","last_clean":"2023-12-19T19:00:48.696817+0000","last_became_active":"2023-12-19T19:00:30.988771+0000","last_became_peered":"2023-12-19T19:00:30.988771+0000","last_unstale":"2023-12-19T19:00:48.696817+0000","last_undegraded":"2023-12-19T19:00:48.696817+0000","last_fullsized":"2023-12-19T19:00:48.696817+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:40:24.990216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.711217+0000","last_change":"2023-12-19T19:00:49.709761+0000","last_active":"2023-12-19T19:00:49.711217+0000","last_peered":"2023-12-19T19:00:49.711217+0000","last_clean":"2023-12-19T19:00:49.711217+0000","last_became_active":"2023-12-19T19:00:49.709451+0000","last_became_peered":"2023-12-19T19:00:49.709451+0000","last_unstale":"2023-12-19T19:00:49.711217+0000","last_undegraded":"2023-12-19T19:00:49.711217+0000","last_fullsized":"2023-12-19T19:00:49.711217+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:55:25.865584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686897+0000","last_change":"2023-12-19T19:00:48.690235+0000","last_active":"2023-12-19T19:00:50.686897+0000","last_peered":"2023-12-19T19:00:50.686897+0000","last_clean":"2023-12-19T19:00:50.686897+0000","last_became_active":"2023-12-19T19:00:48.689942+0000","last_became_peered":"2023-12-19T19:00:48.689942+0000","last_unstale":"2023-12-19T19:00:50.686897+0000","last_undegraded":"2023-12-19T19:00:50.686897+0000","last_fullsized":"2023-12-19T19:00:50.686897+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:52:53.042665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.683129+0000","last_change":"2023-12-19T19:00:32.011171+0000","last_active":"2023-12-19T19:00:49.683129+0000","last_peered":"2023-12-19T19:00:49.683129+0000","last_clean":"2023-12-19T19:00:49.683129+0000","last_became_active":"2023-12-19T19:00:32.010974+0000","last_became_peered":"2023-12-19T19:00:32.010974+0000","last_unstale":"2023-12-19T19:00:49.683129+0000","last_undegraded":"2023-12-19T19:00:49.683129+0000","last_fullsized":"2023-12-19T19:00:49.683129+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:39:37.109129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679958+0000","last_change":"2023-12-19T19:00:30.982999+0000","last_active":"2023-12-19T19:00:48.679958+0000","last_peered":"2023-12-19T19:00:48.679958+0000","last_clean":"2023-12-19T19:00:48.679958+0000","last_became_active":"2023-12-19T19:00:30.982708+0000","last_became_peered":"2023-12-19T19:00:30.982708+0000","last_unstale":"2023-12-19T19:00:48.679958+0000","last_undegraded":"2023-12-19T19:00:48.679958+0000","last_fullsized":"2023-12-19T19:00:48.679958+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:09:34.416071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.708781+0000","last_change":"2023-12-19T19:00:49.707234+0000","last_active":"2023-12-19T19:00:49.708781+0000","last_peered":"2023-12-19T19:00:49.708781+0000","last_clean":"2023-12-19T19:00:49.708781+0000","last_became_active":"2023-12-19T19:00:49.706928+0000","last_became_peered":"2023-12-19T19:00:49.706928+0000","last_unstale":"2023-12-19T19:00:49.708781+0000","last_undegraded":"2023-12-19T19:00:49.708781+0000","last_fullsized":"2023-12-19T19:00:49.708781+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:47:42.192040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.680133+0000","last_change":"2023-12-19T19:00:48.702209+0000","last_active":"2023-12-19T19:00:49.680133+0000","last_peered":"2023-12-19T19:00:49.680133+0000","last_clean":"2023-12-19T19:00:49.680133+0000","last_became_active":"2023-12-19T19:00:48.701937+0000","last_became_peered":"2023-12-19T19:00:48.701937+0000","last_unstale":"2023-12-19T19:00:49.680133+0000","last_undegraded":"2023-12-19T19:00:49.680133+0000","last_fullsized":"2023-12-19T19:00:49.680133+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:37:29.312058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.697698+0000","last_change":"2023-12-19T19:00:32.001553+0000","last_active":"2023-12-19T19:00:48.697698+0000","last_peered":"2023-12-19T19:00:48.697698+0000","last_clean":"2023-12-19T19:00:48.697698+0000","last_became_active":"2023-12-19T19:00:32.001282+0000","last_became_peered":"2023-12-19T19:00:32.001282+0000","last_unstale":"2023-12-19T19:00:48.697698+0000","last_undegraded":"2023-12-19T19:00:48.697698+0000","last_fullsized":"2023-12-19T19:00:48.697698+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:10:42.677327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.673392+0000","last_change":"2023-12-19T19:00:30.991975+0000","last_active":"2023-12-19T19:00:49.673392+0000","last_peered":"2023-12-19T19:00:49.673392+0000","last_clean":"2023-12-19T19:00:49.673392+0000","last_became_active":"2023-12-19T19:00:30.991624+0000","last_became_peered":"2023-12-19T19:00:30.991624+0000","last_unstale":"2023-12-19T19:00:49.673392+0000","last_undegraded":"2023-12-19T19:00:49.673392+0000","last_fullsized":"2023-12-19T19:00:49.673392+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:56:48.812653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.698572+0000","last_change":"2023-12-19T19:00:49.691020+0000","last_active":"2023-12-19T19:00:49.698572+0000","last_peered":"2023-12-19T19:00:49.698572+0000","last_clean":"2023-12-19T19:00:49.698572+0000","last_became_active":"2023-12-19T19:00:49.690742+0000","last_became_peered":"2023-12-19T19:00:49.690742+0000","last_unstale":"2023-12-19T19:00:49.698572+0000","last_undegraded":"2023-12-19T19:00:49.698572+0000","last_fullsized":"2023-12-19T19:00:49.698572+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:21:46.996407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.700882+0000","last_change":"2023-12-19T19:00:48.697757+0000","last_active":"2023-12-19T19:00:49.700882+0000","last_peered":"2023-12-19T19:00:49.700882+0000","last_clean":"2023-12-19T19:00:49.700882+0000","last_became_active":"2023-12-19T19:00:48.697471+0000","last_became_peered":"2023-12-19T19:00:48.697471+0000","last_unstale":"2023-12-19T19:00:49.700882+0000","last_undegraded":"2023-12-19T19:00:49.700882+0000","last_fullsized":"2023-12-19T19:00:49.700882+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:56.842784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.695132+0000","last_change":"2023-12-19T19:00:31.993747+0000","last_active":"2023-12-19T19:00:48.695132+0000","last_peered":"2023-12-19T19:00:48.695132+0000","last_clean":"2023-12-19T19:00:48.695132+0000","last_became_active":"2023-12-19T19:00:31.993287+0000","last_became_peered":"2023-12-19T19:00:31.993287+0000","last_unstale":"2023-12-19T19:00:48.695132+0000","last_undegraded":"2023-12-19T19:00:48.695132+0000","last_fullsized":"2023-12-19T19:00:48.695132+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:36.845071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.680996+0000","last_change":"2023-12-19T19:00:30.992699+0000","last_active":"2023-12-19T19:00:49.680996+0000","last_peered":"2023-12-19T19:00:49.680996+0000","last_clean":"2023-12-19T19:00:49.680996+0000","last_became_active":"2023-12-19T19:00:30.992392+0000","last_became_peered":"2023-12-19T19:00:30.992392+0000","last_unstale":"2023-12-19T19:00:49.680996+0000","last_undegraded":"2023-12-19T19:00:49.680996+0000","last_fullsized":"2023-12-19T19:00:49.680996+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:02.746664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.688105+0000","last_change":"2023-12-19T19:00:49.708638+0000","last_active":"2023-12-19T19:00:50.688105+0000","last_peered":"2023-12-19T19:00:50.688105+0000","last_clean":"2023-12-19T19:00:50.688105+0000","last_became_active":"2023-12-19T19:00:49.708357+0000","last_became_peered":"2023-12-19T19:00:49.708357+0000","last_unstale":"2023-12-19T19:00:50.688105+0000","last_undegraded":"2023-12-19T19:00:50.688105+0000","last_fullsized":"2023-12-19T19:00:50.688105+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:32:45.876313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.682852+0000","last_change":"2023-12-19T19:00:48.702622+0000","last_active":"2023-12-19T19:00:49.682852+0000","last_peered":"2023-12-19T19:00:49.682852+0000","last_clean":"2023-12-19T19:00:49.682852+0000","last_became_active":"2023-12-19T19:00:48.702303+0000","last_became_peered":"2023-12-19T19:00:48.702303+0000","last_unstale":"2023-12-19T19:00:49.682852+0000","last_undegraded":"2023-12-19T19:00:49.682852+0000","last_fullsized":"2023-12-19T19:00:49.682852+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:10:19.062588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.683149+0000","last_change":"2023-12-19T19:00:31.991312+0000","last_active":"2023-12-19T19:00:49.683149+0000","last_peered":"2023-12-19T19:00:49.683149+0000","last_clean":"2023-12-19T19:00:49.683149+0000","last_became_active":"2023-12-19T19:00:31.991010+0000","last_became_peered":"2023-12-19T19:00:31.991010+0000","last_unstale":"2023-12-19T19:00:49.683149+0000","last_undegraded":"2023-12-19T19:00:49.683149+0000","last_fullsized":"2023-12-19T19:00:49.683149+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:13:48.628064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.675847+0000","last_change":"2023-12-19T19:00:30.984710+0000","last_active":"2023-12-19T19:00:49.675847+0000","last_peered":"2023-12-19T19:00:49.675847+0000","last_clean":"2023-12-19T19:00:49.675847+0000","last_became_active":"2023-12-19T19:00:30.984405+0000","last_became_peered":"2023-12-19T19:00:30.984405+0000","last_unstale":"2023-12-19T19:00:49.675847+0000","last_undegraded":"2023-12-19T19:00:49.675847+0000","last_fullsized":"2023-12-19T19:00:49.675847+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:27.732444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.688512+0000","last_change":"2023-12-19T19:00:49.700387+0000","last_active":"2023-12-19T19:00:50.688512+0000","last_peered":"2023-12-19T19:00:50.688512+0000","last_clean":"2023-12-19T19:00:50.688512+0000","last_became_active":"2023-12-19T19:00:49.700098+0000","last_became_peered":"2023-12-19T19:00:49.700098+0000","last_unstale":"2023-12-19T19:00:50.688512+0000","last_undegraded":"2023-12-19T19:00:50.688512+0000","last_fullsized":"2023-12-19T19:00:50.688512+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:01:51.384923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.680596+0000","last_change":"2023-12-19T19:00:48.699323+0000","last_active":"2023-12-19T19:00:49.680596+0000","last_peered":"2023-12-19T19:00:49.680596+0000","last_clean":"2023-12-19T19:00:49.680596+0000","last_became_active":"2023-12-19T19:00:48.698913+0000","last_became_peered":"2023-12-19T19:00:48.698913+0000","last_unstale":"2023-12-19T19:00:49.680596+0000","last_undegraded":"2023-12-19T19:00:49.680596+0000","last_fullsized":"2023-12-19T19:00:49.680596+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:15:23.526618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.684849+0000","last_change":"2023-12-19T19:00:31.994005+0000","last_active":"2023-12-19T19:00:49.684849+0000","last_peered":"2023-12-19T19:00:49.684849+0000","last_clean":"2023-12-19T19:00:49.684849+0000","last_became_active":"2023-12-19T19:00:31.993709+0000","last_became_peered":"2023-12-19T19:00:31.993709+0000","last_unstale":"2023-12-19T19:00:49.684849+0000","last_undegraded":"2023-12-19T19:00:49.684849+0000","last_fullsized":"2023-12-19T19:00:49.684849+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:36.845071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.697232+0000","last_change":"2023-12-19T19:00:30.988721+0000","last_active":"2023-12-19T19:00:48.697232+0000","last_peered":"2023-12-19T19:00:48.697232+0000","last_clean":"2023-12-19T19:00:48.697232+0000","last_became_active":"2023-12-19T19:00:30.988432+0000","last_became_peered":"2023-12-19T19:00:30.988432+0000","last_unstale":"2023-12-19T19:00:48.697232+0000","last_undegraded":"2023-12-19T19:00:48.697232+0000","last_fullsized":"2023-12-19T19:00:48.697232+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:28.753779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.698810+0000","last_change":"2023-12-19T19:00:49.693539+0000","last_active":"2023-12-19T19:00:49.698810+0000","last_peered":"2023-12-19T19:00:49.698810+0000","last_clean":"2023-12-19T19:00:49.698810+0000","last_became_active":"2023-12-19T19:00:49.693264+0000","last_became_peered":"2023-12-19T19:00:49.693264+0000","last_unstale":"2023-12-19T19:00:49.698810+0000","last_undegraded":"2023-12-19T19:00:49.698810+0000","last_fullsized":"2023-12-19T19:00:49.698810+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:06:00.309106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.721107+0000","last_change":"2023-12-19T19:00:48.698221+0000","last_active":"2023-12-19T19:00:49.721107+0000","last_peered":"2023-12-19T19:00:49.721107+0000","last_clean":"2023-12-19T19:00:49.721107+0000","last_became_active":"2023-12-19T19:00:48.697909+0000","last_became_peered":"2023-12-19T19:00:48.697909+0000","last_unstale":"2023-12-19T19:00:49.721107+0000","last_undegraded":"2023-12-19T19:00:49.721107+0000","last_fullsized":"2023-12-19T19:00:49.721107+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:12:46.076887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.674968+0000","last_change":"2023-12-19T19:00:31.999271+0000","last_active":"2023-12-19T19:00:49.674968+0000","last_peered":"2023-12-19T19:00:49.674968+0000","last_clean":"2023-12-19T19:00:49.674968+0000","last_became_active":"2023-12-19T19:00:31.998645+0000","last_became_peered":"2023-12-19T19:00:31.998645+0000","last_unstale":"2023-12-19T19:00:49.674968+0000","last_undegraded":"2023-12-19T19:00:49.674968+0000","last_fullsized":"2023-12-19T19:00:49.674968+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:05:19.291688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.693184+0000","last_change":"2023-12-19T19:00:30.981887+0000","last_active":"2023-12-19T19:00:48.693184+0000","last_peered":"2023-12-19T19:00:48.693184+0000","last_clean":"2023-12-19T19:00:48.693184+0000","last_became_active":"2023-12-19T19:00:30.981538+0000","last_became_peered":"2023-12-19T19:00:30.981538+0000","last_unstale":"2023-12-19T19:00:48.693184+0000","last_undegraded":"2023-12-19T19:00:48.693184+0000","last_fullsized":"2023-12-19T19:00:48.693184+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:50:37.886882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.687084+0000","last_change":"2023-12-19T19:00:49.696603+0000","last_active":"2023-12-19T19:00:50.687084+0000","last_peered":"2023-12-19T19:00:50.687084+0000","last_clean":"2023-12-19T19:00:50.687084+0000","last_became_active":"2023-12-19T19:00:49.696287+0000","last_became_peered":"2023-12-19T19:00:49.696287+0000","last_unstale":"2023-12-19T19:00:50.687084+0000","last_undegraded":"2023-12-19T19:00:50.687084+0000","last_fullsized":"2023-12-19T19:00:50.687084+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:15:24.533186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.687510+0000","last_change":"2023-12-19T19:00:48.704050+0000","last_active":"2023-12-19T19:00:50.687510+0000","last_peered":"2023-12-19T19:00:50.687510+0000","last_clean":"2023-12-19T19:00:50.687510+0000","last_became_active":"2023-12-19T19:00:48.703764+0000","last_became_peered":"2023-12-19T19:00:48.703764+0000","last_unstale":"2023-12-19T19:00:50.687510+0000","last_undegraded":"2023-12-19T19:00:50.687510+0000","last_fullsized":"2023-12-19T19:00:50.687510+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:25:32.891371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.696815+0000","last_change":"2023-12-19T19:00:31.993214+0000","last_active":"2023-12-19T19:00:48.696815+0000","last_peered":"2023-12-19T19:00:48.696815+0000","last_clean":"2023-12-19T19:00:48.696815+0000","last_became_active":"2023-12-19T19:00:31.992758+0000","last_became_peered":"2023-12-19T19:00:31.992758+0000","last_unstale":"2023-12-19T19:00:48.696815+0000","last_undegraded":"2023-12-19T19:00:48.696815+0000","last_fullsized":"2023-12-19T19:00:48.696815+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:40.147962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.684547+0000","last_change":"2023-12-19T19:00:30.992052+0000","last_active":"2023-12-19T19:00:49.684547+0000","last_peered":"2023-12-19T19:00:49.684547+0000","last_clean":"2023-12-19T19:00:49.684547+0000","last_became_active":"2023-12-19T19:00:30.991738+0000","last_became_peered":"2023-12-19T19:00:30.991738+0000","last_unstale":"2023-12-19T19:00:49.684547+0000","last_undegraded":"2023-12-19T19:00:49.684547+0000","last_fullsized":"2023-12-19T19:00:49.684547+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:31:59.956264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686152+0000","last_change":"2023-12-19T19:00:49.694938+0000","last_active":"2023-12-19T19:00:50.686152+0000","last_peered":"2023-12-19T19:00:50.686152+0000","last_clean":"2023-12-19T19:00:50.686152+0000","last_became_active":"2023-12-19T19:00:49.694579+0000","last_became_peered":"2023-12-19T19:00:49.694579+0000","last_unstale":"2023-12-19T19:00:50.686152+0000","last_undegraded":"2023-12-19T19:00:50.686152+0000","last_fullsized":"2023-12-19T19:00:50.686152+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:35:17.219218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.675199+0000","last_change":"2023-12-19T19:00:48.687844+0000","last_active":"2023-12-19T19:00:49.675199+0000","last_peered":"2023-12-19T19:00:49.675199+0000","last_clean":"2023-12-19T19:00:49.675199+0000","last_became_active":"2023-12-19T19:00:48.685621+0000","last_became_peered":"2023-12-19T19:00:48.685621+0000","last_unstale":"2023-12-19T19:00:49.675199+0000","last_undegraded":"2023-12-19T19:00:49.675199+0000","last_fullsized":"2023-12-19T19:00:49.675199+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:22:20.444135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679688+0000","last_change":"2023-12-19T19:00:31.998634+0000","last_active":"2023-12-19T19:00:48.679688+0000","last_peered":"2023-12-19T19:00:48.679688+0000","last_clean":"2023-12-19T19:00:48.679688+0000","last_became_active":"2023-12-19T19:00:31.996473+0000","last_became_peered":"2023-12-19T19:00:31.996473+0000","last_unstale":"2023-12-19T19:00:48.679688+0000","last_undegraded":"2023-12-19T19:00:48.679688+0000","last_fullsized":"2023-12-19T19:00:48.679688+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:00:47.322868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.673414+0000","last_change":"2023-12-19T19:00:30.990963+0000","last_active":"2023-12-19T19:00:49.673414+0000","last_peered":"2023-12-19T19:00:49.673414+0000","last_clean":"2023-12-19T19:00:49.673414+0000","last_became_active":"2023-12-19T19:00:30.990686+0000","last_became_peered":"2023-12-19T19:00:30.990686+0000","last_unstale":"2023-12-19T19:00:49.673414+0000","last_undegraded":"2023-12-19T19:00:49.673414+0000","last_fullsized":"2023-12-19T19:00:49.673414+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:49:29.844694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.709489+0000","last_change":"2023-12-19T19:00:49.698222+0000","last_active":"2023-12-19T19:00:49.709489+0000","last_peered":"2023-12-19T19:00:49.709489+0000","last_clean":"2023-12-19T19:00:49.709489+0000","last_became_active":"2023-12-19T19:00:49.697855+0000","last_became_peered":"2023-12-19T19:00:49.697855+0000","last_unstale":"2023-12-19T19:00:49.709489+0000","last_undegraded":"2023-12-19T19:00:49.709489+0000","last_fullsized":"2023-12-19T19:00:49.709489+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:40:43.699962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.697287+0000","last_change":"2023-12-19T19:00:48.696117+0000","last_active":"2023-12-19T19:00:49.697287+0000","last_peered":"2023-12-19T19:00:49.697287+0000","last_clean":"2023-12-19T19:00:49.697287+0000","last_became_active":"2023-12-19T19:00:48.695832+0000","last_became_peered":"2023-12-19T19:00:48.695832+0000","last_unstale":"2023-12-19T19:00:49.697287+0000","last_undegraded":"2023-12-19T19:00:49.697287+0000","last_fullsized":"2023-12-19T19:00:49.697287+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:46.456957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.677437+0000","last_change":"2023-12-19T19:00:31.987546+0000","last_active":"2023-12-19T19:00:49.677437+0000","last_peered":"2023-12-19T19:00:49.677437+0000","last_clean":"2023-12-19T19:00:49.677437+0000","last_became_active":"2023-12-19T19:00:31.987153+0000","last_became_peered":"2023-12-19T19:00:31.987153+0000","last_unstale":"2023-12-19T19:00:49.677437+0000","last_undegraded":"2023-12-19T19:00:49.677437+0000","last_fullsized":"2023-12-19T19:00:49.677437+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:13:48.628064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.680070+0000","last_change":"2023-12-19T19:00:30.989522+0000","last_active":"2023-12-19T19:00:48.680070+0000","last_peered":"2023-12-19T19:00:48.680070+0000","last_clean":"2023-12-19T19:00:48.680070+0000","last_became_active":"2023-12-19T19:00:30.988571+0000","last_became_peered":"2023-12-19T19:00:30.988571+0000","last_unstale":"2023-12-19T19:00:48.680070+0000","last_undegraded":"2023-12-19T19:00:48.680070+0000","last_fullsized":"2023-12-19T19:00:48.680070+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:10:42.744434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.698332+0000","last_change":"2023-12-19T19:00:49.693607+0000","last_active":"2023-12-19T19:00:49.698332+0000","last_peered":"2023-12-19T19:00:49.698332+0000","last_clean":"2023-12-19T19:00:49.698332+0000","last_became_active":"2023-12-19T19:00:49.692226+0000","last_became_peered":"2023-12-19T19:00:49.692226+0000","last_unstale":"2023-12-19T19:00:49.698332+0000","last_undegraded":"2023-12-19T19:00:49.698332+0000","last_fullsized":"2023-12-19T19:00:49.698332+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:52:23.622537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.681044+0000","last_change":"2023-12-19T19:00:48.696809+0000","last_active":"2023-12-19T19:00:49.681044+0000","last_peered":"2023-12-19T19:00:49.681044+0000","last_clean":"2023-12-19T19:00:49.681044+0000","last_became_active":"2023-12-19T19:00:48.696497+0000","last_became_peered":"2023-12-19T19:00:48.696497+0000","last_unstale":"2023-12-19T19:00:49.681044+0000","last_undegraded":"2023-12-19T19:00:49.681044+0000","last_fullsized":"2023-12-19T19:00:49.681044+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:49:47.547872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.673102+0000","last_change":"2023-12-19T19:00:32.001673+0000","last_active":"2023-12-19T19:00:49.673102+0000","last_peered":"2023-12-19T19:00:49.673102+0000","last_clean":"2023-12-19T19:00:49.673102+0000","last_became_active":"2023-12-19T19:00:32.001362+0000","last_became_peered":"2023-12-19T19:00:32.001362+0000","last_unstale":"2023-12-19T19:00:49.673102+0000","last_undegraded":"2023-12-19T19:00:49.673102+0000","last_fullsized":"2023-12-19T19:00:49.673102+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:57:25.004342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.673222+0000","last_change":"2023-12-19T19:00:30.989018+0000","last_active":"2023-12-19T19:00:49.673222+0000","last_peered":"2023-12-19T19:00:49.673222+0000","last_clean":"2023-12-19T19:00:49.673222+0000","last_became_active":"2023-12-19T19:00:30.988742+0000","last_became_peered":"2023-12-19T19:00:30.988742+0000","last_unstale":"2023-12-19T19:00:49.673222+0000","last_undegraded":"2023-12-19T19:00:49.673222+0000","last_fullsized":"2023-12-19T19:00:49.673222+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:10:01.359410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.717926+0000","last_change":"2023-12-19T19:00:49.708769+0000","last_active":"2023-12-19T19:00:49.717926+0000","last_peered":"2023-12-19T19:00:49.717926+0000","last_clean":"2023-12-19T19:00:49.717926+0000","last_became_active":"2023-12-19T19:00:49.708452+0000","last_became_peered":"2023-12-19T19:00:49.708452+0000","last_unstale":"2023-12-19T19:00:49.717926+0000","last_undegraded":"2023-12-19T19:00:49.717926+0000","last_fullsized":"2023-12-19T19:00:49.717926+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:33.137665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686095+0000","last_change":"2023-12-19T19:00:48.687559+0000","last_active":"2023-12-19T19:00:50.686095+0000","last_peered":"2023-12-19T19:00:50.686095+0000","last_clean":"2023-12-19T19:00:50.686095+0000","last_became_active":"2023-12-19T19:00:48.687286+0000","last_became_peered":"2023-12-19T19:00:48.687286+0000","last_unstale":"2023-12-19T19:00:50.686095+0000","last_undegraded":"2023-12-19T19:00:50.686095+0000","last_fullsized":"2023-12-19T19:00:50.686095+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:48.301202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679835+0000","last_change":"2023-12-19T19:00:31.992787+0000","last_active":"2023-12-19T19:00:48.679835+0000","last_peered":"2023-12-19T19:00:48.679835+0000","last_clean":"2023-12-19T19:00:48.679835+0000","last_became_active":"2023-12-19T19:00:31.992110+0000","last_became_peered":"2023-12-19T19:00:31.992110+0000","last_unstale":"2023-12-19T19:00:48.679835+0000","last_undegraded":"2023-12-19T19:00:48.679835+0000","last_fullsized":"2023-12-19T19:00:48.679835+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:43:46.671588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679850+0000","last_change":"2023-12-19T19:00:30.987505+0000","last_active":"2023-12-19T19:00:48.679850+0000","last_peered":"2023-12-19T19:00:48.679850+0000","last_clean":"2023-12-19T19:00:48.679850+0000","last_became_active":"2023-12-19T19:00:30.987202+0000","last_became_peered":"2023-12-19T19:00:30.987202+0000","last_unstale":"2023-12-19T19:00:48.679850+0000","last_undegraded":"2023-12-19T19:00:48.679850+0000","last_fullsized":"2023-12-19T19:00:48.679850+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:39.139606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.711232+0000","last_change":"2023-12-19T19:00:49.709628+0000","last_active":"2023-12-19T19:00:49.711232+0000","last_peered":"2023-12-19T19:00:49.711232+0000","last_clean":"2023-12-19T19:00:49.711232+0000","last_became_active":"2023-12-19T19:00:49.709336+0000","last_became_peered":"2023-12-19T19:00:49.709336+0000","last_unstale":"2023-12-19T19:00:49.711232+0000","last_undegraded":"2023-12-19T19:00:49.711232+0000","last_fullsized":"2023-12-19T19:00:49.711232+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:30:51.465735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.722093+0000","last_change":"2023-12-19T19:00:48.699504+0000","last_active":"2023-12-19T19:00:49.722093+0000","last_peered":"2023-12-19T19:00:49.722093+0000","last_clean":"2023-12-19T19:00:49.722093+0000","last_became_active":"2023-12-19T19:00:48.699126+0000","last_became_peered":"2023-12-19T19:00:48.699126+0000","last_unstale":"2023-12-19T19:00:49.722093+0000","last_undegraded":"2023-12-19T19:00:49.722093+0000","last_fullsized":"2023-12-19T19:00:49.722093+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:05.322886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679470+0000","last_change":"2023-12-19T19:00:32.003139+0000","last_active":"2023-12-19T19:00:48.679470+0000","last_peered":"2023-12-19T19:00:48.679470+0000","last_clean":"2023-12-19T19:00:48.679470+0000","last_became_active":"2023-12-19T19:00:32.002764+0000","last_became_peered":"2023-12-19T19:00:32.002764+0000","last_unstale":"2023-12-19T19:00:48.679470+0000","last_undegraded":"2023-12-19T19:00:48.679470+0000","last_fullsized":"2023-12-19T19:00:48.679470+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:49:14.764281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.692338+0000","last_change":"2023-12-19T19:00:30.990667+0000","last_active":"2023-12-19T19:00:48.692338+0000","last_peered":"2023-12-19T19:00:48.692338+0000","last_clean":"2023-12-19T19:00:48.692338+0000","last_became_active":"2023-12-19T19:00:30.989615+0000","last_became_peered":"2023-12-19T19:00:30.989615+0000","last_unstale":"2023-12-19T19:00:48.692338+0000","last_undegraded":"2023-12-19T19:00:48.692338+0000","last_fullsized":"2023-12-19T19:00:48.692338+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:49:29.844694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.676764+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T19:00:49.676764+0000","last_peered":"2023-12-19T19:00:49.676764+0000","last_clean":"2023-12-19T19:00:49.676764+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T19:00:49.676764+0000","last_undegraded":"2023-12-19T19:00:49.676764+0000","last_fullsized":"2023-12-19T19:00:49.676764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1245184,"data_stored":864669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68600000000000005,"15min":0.69099999999999995},"min":{"1min":0.434,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83399999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72399999999999998,"15min":0.72599999999999998},"min":{"1min":0.54400000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.91200000000000003,"5min":1.117,"15min":1.117},"last":0.61399999999999999}]},{"osd":1,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95699999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.54200000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85699999999999998,"5min":1.01,"15min":1.01},"last":0.64100000000000001}]},{"osd":2,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68400000000000005,"15min":0.68600000000000005},"min":{"1min":0.50900000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92700000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.54600000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94699999999999995,"5min":1.089,"15min":1.089},"last":0.58299999999999996}]},{"osd":3,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72399999999999998,"15min":0.73099999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89300000000000002,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.505},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.56899999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.55600000000000005}]},{"osd":4,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65600000000000003,"15min":0.66000000000000003},"min":{"1min":0.434,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68000000000000005,"15min":0.67800000000000005},"min":{"1min":0.49299999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.93400000000000005,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.42099999999999999}]},{"osd":5,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69899999999999995,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92500000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.52300000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91900000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.56899999999999995}]},{"osd":6,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.59699999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.96399999999999997,"5min":1.069,"15min":1.069},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.52200000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.91700000000000004,"5min":1.026,"15min":1.026},"last":0.60099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":643072,"data_stored":273617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.627,"15min":0.629},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86299999999999999,"5min":1.022,"15min":1.022},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98299999999999998,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.59099999999999997}]},{"osd":1,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.52100000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92600000000000005,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88700000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.73799999999999999}]},{"osd":2,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.83899999999999997,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71399999999999997,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94899999999999995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.76300000000000001}]},{"osd":3,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.50900000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92700000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.496},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72799999999999998,"15min":0.72899999999999998},"min":{"1min":0.59099999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.90200000000000002,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.623}]},{"osd":4,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.66100000000000003,"15min":0.67100000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90600000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.52800000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88900000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.67100000000000004}]},{"osd":5,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.47299999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.73599999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96499999999999997,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.64800000000000002}]},{"osd":7,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76200000000000001,"15min":0.76500000000000001},"min":{"1min":0.502,"5min":0.437,"15min":0.437},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76900000000000002,"15min":0.76800000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.78600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":647168,"data_stored":274267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.90500000000000003,"15min":0.94899999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0880000000000001,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.434},{"interface":"front","average":{"1min":0.68000000000000005,"5min":1.3420000000000001,"15min":1.452},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1180000000000001,"5min":16.951000000000001,"15min":16.951000000000001},"last":0.60399999999999998}]},{"osd":1,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":1.411,"15min":1.5429999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0700000000000001,"5min":19.823,"15min":19.823},"last":0.624},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.44500000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.216,"5min":1.657,"15min":1.657},"last":0.55700000000000005}]},{"osd":2,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.74199999999999999,"15min":0.755},"min":{"1min":0.48799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.163,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1020000000000001,"5min":1.585,"15min":1.585},"last":0.67000000000000004}]},{"osd":3,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.78000000000000003,"15min":0.79100000000000004},"min":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0589999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.97299999999999998,"15min":1.0149999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0740000000000001,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":0.70299999999999996}]},{"osd":4,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.45200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0049999999999999,"5min":1.716,"15min":1.716},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.504,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97899999999999998,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":0.54200000000000004}]},{"osd":6,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.82799999999999996,"15min":0.85099999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.86599999999999999,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.82999999999999996,"15min":0.84599999999999997},"min":{"1min":0.51100000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90600000000000003,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.58299999999999996}]},{"osd":7,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82899999999999996,"15min":0.83899999999999997},"min":{"1min":0.60599999999999998,"5min":0.498,"15min":0.498},"max":{"1min":1.0900000000000001,"5min":2.371,"15min":2.371},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0369999999999999,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.56499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":651264,"data_stored":276702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.84299999999999997,"15min":0.875},"min":{"1min":0.46800000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86899999999999999,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78500000000000003,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.72199999999999998}]},{"osd":1,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.51800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88200000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.79200000000000004,"15min":0.80700000000000005},"min":{"1min":0.56699999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94599999999999995,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":0.747}]},{"osd":2,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69199999999999995,"15min":0.69299999999999995},"min":{"1min":0.53800000000000003,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.80300000000000005,"15min":0.81999999999999995},"min":{"1min":0.56000000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.88,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.82999999999999996}]},{"osd":3,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.84999999999999998,"5min":3.641,"15min":3.641},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.872,"15min":0.89800000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.85399999999999998,"5min":3.194,"15min":3.194},"last":0.76700000000000002}]},{"osd":5,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":1.0269999999999999,"15min":1.089},"min":{"1min":0.42699999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0449999999999999,"5min":9.3040000000000003,"15min":9.3040000000000003},"last":0.628},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.71999999999999997,"15min":0.73999999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94099999999999995,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.64200000000000002}]},{"osd":6,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.81799999999999995,"15min":0.84199999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97699999999999998,"5min":3.097,"15min":3.097},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.86599999999999999,"15min":0.89100000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97899999999999998,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.79000000000000004}]},{"osd":7,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.94199999999999995,"15min":0.97999999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0409999999999999,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":1.0289999999999999,"15min":1.077},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98699999999999999,"5min":6.3449999999999998,"15min":6.3449999999999998},"last":0.81399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":651264,"data_stored":273693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45600000000000002,"15min":0.45800000000000002},"min":{"1min":0.30099999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.44400000000000001,"15min":0.44600000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58299999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.36099999999999999}]},{"osd":1,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.47899999999999998,"15min":0.48899999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60699999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.63100000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47699999999999998}]},{"osd":2,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65700000000000003,"5min":0.75,"15min":0.75},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.54300000000000004,"15min":0.55100000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70999999999999996,"5min":0.875,"15min":0.875},"last":0.42999999999999999}]},{"osd":4,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78900000000000003,"15min":0.79100000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.99199999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.80600000000000005,"15min":0.81499999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.90900000000000003,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.68500000000000005}]},{"osd":5,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.75,"15min":0.755},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97599999999999998,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.91800000000000004,"5min":1.202,"15min":1.202},"last":0.60299999999999998}]},{"osd":6,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82099999999999995,"15min":0.82999999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.95599999999999996,"5min":1.298,"15min":1.298},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80100000000000005,"15min":0.80700000000000005},"min":{"1min":0.61599999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.93300000000000005,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.622}]},{"osd":7,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79200000000000004,"15min":0.79600000000000004},"min":{"1min":0.60399999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.95299999999999996,"5min":1.155,"15min":1.155},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77700000000000002,"15min":0.78300000000000003},"min":{"1min":0.56499999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.90600000000000003,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.58299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":275193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.497,"15min":0.50700000000000001},"min":{"1min":0.313,"5min":0.31,"15min":0.31},"max":{"1min":0.57899999999999996,"5min":1.458,"15min":1.458},"last":0.441},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.627,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.57899999999999996,"15min":0.59899999999999998},"min":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.58499999999999996,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.60399999999999998,"15min":0.624},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.61799999999999999,"5min":2.444,"15min":2.444},"last":0.379}]},{"osd":3,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.59599999999999997,"15min":0.62},"min":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65300000000000002,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.625,"15min":0.64300000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.69199999999999995,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.495}]},{"osd":4,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.93899999999999995,"15min":0.97499999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.94399999999999995,"5min":1.968,"15min":1.968},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.89500000000000002,"15min":0.92500000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.90700000000000003,"5min":2.835,"15min":2.835},"last":0.66400000000000003}]},{"osd":5,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.91600000000000004,"15min":0.94999999999999996},"min":{"1min":0.56000000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.94599999999999995,"5min":3.5,"15min":3.5},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.91100000000000003,"15min":0.93999999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.99099999999999999,"5min":1.996,"15min":1.996},"last":0.70999999999999996}]},{"osd":6,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.91200000000000003,"15min":0.94699999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.97599999999999998,"5min":2.903,"15min":2.903},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.99199999999999999,"15min":1.034},"min":{"1min":0.53700000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.92800000000000005,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.74399999999999999}]},{"osd":7,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.94999999999999996,"15min":0.98599999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.0049999999999999,"5min":2.875,"15min":2.875},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.94299999999999995,"15min":0.98099999999999998},"min":{"1min":0.59399999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.91900000000000004,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.59399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":659456,"data_stored":275843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.55200000000000005,"15min":0.58099999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.51600000000000001,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.748,"15min":0.80100000000000005},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.70399999999999996,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.42899999999999999}]},{"osd":2,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.57199999999999995,"15min":0.59599999999999997},"min":{"1min":0.316,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.63,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.65600000000000003,"15min":0.68899999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65300000000000002,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.47499999999999998}]},{"osd":3,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.79300000000000004,"15min":0.84199999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.629,"5min":7.8399999999999999,"15min":7.8399999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.81200000000000006,"15min":0.85999999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72499999999999998,"5min":7.7949999999999999,"15min":7.7949999999999999},"last":0.83699999999999997}]},{"osd":4,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.86799999999999999,"15min":0.89900000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0900000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.89900000000000002,"15min":0.93000000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0289999999999999,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.64400000000000002}]},{"osd":5,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.879,"15min":0.90900000000000003},"min":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92600000000000005,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.624},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.88500000000000001,"15min":0.91800000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98899999999999999,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.56799999999999995}]},{"osd":6,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.88300000000000001,"15min":0.90800000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94699999999999995,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.93100000000000005,"15min":0.96899999999999997},"min":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0469999999999999,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.747}]},{"osd":7,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.93600000000000005,"15min":0.96799999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1180000000000001,"5min":4.3310000000000004,"15min":4.3310000000000004},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.89200000000000002,"15min":0.92000000000000004},"min":{"1min":0.55200000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.97599999999999998,"5min":4.226,"15min":4.226},"last":0.86899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1241088,"data_stored":866563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.44700000000000001,"15min":0.45200000000000001},"min":{"1min":0.29199999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63100000000000001,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.65700000000000003}]},{"osd":2,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.35799999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79600000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.746,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.62}]},{"osd":3,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70699999999999996,"5min":0.747,"15min":0.747},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86899999999999999,"5min":1.264,"15min":1.264},"last":0.69299999999999995}]},{"osd":4,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0589999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.018,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.89900000000000002}]},{"osd":5,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.91200000000000003,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.876},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.81100000000000005,"15min":0.82299999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97899999999999998,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.91000000000000003}]},{"osd":6,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.81999999999999995,"15min":0.83299999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.024,"5min":1.349,"15min":1.349},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.88400000000000001,"5min":1.115,"15min":1.115},"last":1.0189999999999999}]},{"osd":7,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.78500000000000003,"15min":0.79900000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.89400000000000002,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.80700000000000005,"15min":0.81699999999999995},"min":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.997,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.92200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T19:00:53.771 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T19:00:53.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.941+0000 7f9909809640 1 Processor -- start 2023-12-19T19:00:53.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.941+0000 7f9909809640 1 -- start start 2023-12-19T19:00:53.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.941+0000 7f9909809640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f990406a5b0 0x7f990406a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:53.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.941+0000 7f9909809640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f990406dfe0 0x7f99040c2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:53.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.941+0000 7f9909809640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f990406b1e0 0x7f99040c25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:53.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.941+0000 7f9909809640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f990406ef50 con 0x7f990406dfe0 2023-12-19T19:00:53.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.941+0000 7f9909809640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99040720b0 con 0x7f990406a5b0 2023-12-19T19:00:53.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.941+0000 7f9909809640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9904072500 con 0x7f990406b1e0 2023-12-19T19:00:53.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.941+0000 7f98fa7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f990406dfe0 0x7f99040c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:53.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.941+0000 7f98fa7fc640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f990406dfe0 0x7f99040c2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43066/0 (socket says 172.21.15.133:43066) 2023-12-19T19:00:53.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.941+0000 7f98fa7fc640 1 -- 172.21.15.133:0/851718268 learned_addr learned my addr 172.21.15.133:0/851718268 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:53.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.941+0000 7f9902ffd640 1 --2- 172.21.15.133:0/851718268 >> v2:172.21.15.138:3300/0 conn(0x7f990406a5b0 0x7f990406a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:53.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.941+0000 7f99037fe640 1 --2- 172.21.15.133:0/851718268 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f990406b1e0 0x7f99040c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:53.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.941+0000 7f98fa7fc640 1 -- 172.21.15.133:0/851718268 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f990406b1e0 msgr2=0x7f99040c25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:53.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.941+0000 7f98fa7fc640 1 --2- 172.21.15.133:0/851718268 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f990406b1e0 0x7f99040c25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.941+0000 7f98fa7fc640 1 -- 172.21.15.133:0/851718268 >> v2:172.21.15.138:3300/0 conn(0x7f990406a5b0 msgr2=0x7f990406a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:53.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.941+0000 7f98fa7fc640 1 --2- 172.21.15.133:0/851718268 >> v2:172.21.15.138:3300/0 conn(0x7f990406a5b0 0x7f990406a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.941+0000 7f98fa7fc640 1 -- 172.21.15.133:0/851718268 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9904070f60 con 0x7f990406dfe0 2023-12-19T19:00:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.945+0000 7f98fa7fc640 1 --2- 172.21.15.133:0/851718268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f990406dfe0 0x7f99040c2090 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f99040c39c0 tx=0x7f98f401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b57adb1253d6af server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.945+0000 7f99027fc640 1 -- 172.21.15.133:0/851718268 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f40ab600 con 0x7f990406dfe0 2023-12-19T19:00:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.945+0000 7f99027fc640 1 -- 172.21.15.133:0/851718268 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98f40a7050 con 0x7f990406dfe0 2023-12-19T19:00:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.945+0000 7f99027fc640 1 -- 172.21.15.133:0/851718268 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f40ab980 con 0x7f990406dfe0 2023-12-19T19:00:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.945+0000 7f9909809640 1 -- 172.21.15.133:0/851718268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f990406dfe0 msgr2=0x7f99040c2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.945+0000 7f9909809640 1 --2- 172.21.15.133:0/851718268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f990406dfe0 0x7f99040c2090 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f99040c39c0 tx=0x7f98f401c470 comp rx=0 tx=0).stop 2023-12-19T19:00:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.945+0000 7f9909809640 1 -- 172.21.15.133:0/851718268 shutdown_connections 2023-12-19T19:00:53.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.945+0000 7f9909809640 1 --2- 172.21.15.133:0/851718268 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f990406b1e0 0x7f99040c25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.945+0000 7f9909809640 1 --2- 172.21.15.133:0/851718268 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f990406dfe0 0x7f99040c2090 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.945+0000 7f9909809640 1 --2- 172.21.15.133:0/851718268 >> v2:172.21.15.138:3300/0 conn(0x7f990406a5b0 0x7f990406a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.945+0000 7f9909809640 1 -- 172.21.15.133:0/851718268 >> 172.21.15.133:0/851718268 conn(0x7f99040c6ef0 msgr2=0x7f99040c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:53.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.945+0000 7f9909809640 1 -- 172.21.15.133:0/851718268 shutdown_connections 2023-12-19T19:00:53.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.945+0000 7f9909809640 1 -- 172.21.15.133:0/851718268 wait complete. 2023-12-19T19:00:53.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f9909809640 1 Processor -- start 2023-12-19T19:00:53.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f9909809640 1 -- start start 2023-12-19T19:00:53.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f9909809640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f990406a5b0 0x7f990414baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:53.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f9909809640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f990406b1e0 0x7f99040c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:53.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f9909809640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f990406dfe0 0x7f9904149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f9909809640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990414a710 con 0x7f990406dfe0 2023-12-19T19:00:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f9909809640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99040c1570 con 0x7f990406b1e0 2023-12-19T19:00:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f9909809640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99041edb30 con 0x7f990406a5b0 2023-12-19T19:00:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f99037fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f990406dfe0 0x7f9904149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f99037fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f990406dfe0 0x7f9904149430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:43078/0 (socket says 172.21.15.133:43078) 2023-12-19T19:00:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f99037fe640 1 -- 172.21.15.133:0/3866168531 learned_addr learned my addr 172.21.15.133:0/3866168531 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f9902ffd640 1 --2- 172.21.15.133:0/3866168531 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f990406a5b0 0x7f990414baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f98fa7fc640 1 --2- 172.21.15.133:0/3866168531 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f990406b1e0 0x7f99040c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f99037fe640 1 -- 172.21.15.133:0/3866168531 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f990406a5b0 msgr2=0x7f990414baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f99037fe640 1 --2- 172.21.15.133:0/3866168531 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f990406a5b0 0x7f990414baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f99037fe640 1 -- 172.21.15.133:0/3866168531 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f990406b1e0 msgr2=0x7f99040c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:53.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f99037fe640 1 --2- 172.21.15.133:0/3866168531 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f990406b1e0 0x7f99040c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:53.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f99037fe640 1 -- 172.21.15.133:0/3866168531 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f40094d0 con 0x7f990406dfe0 2023-12-19T19:00:53.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f99037fe640 1 --2- 172.21.15.133:0/3866168531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f990406dfe0 0x7f9904149430 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f98fc007e40 tx=0x7f98fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:53.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f9900ff9640 1 -- 172.21.15.133:0/3866168531 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc014620 con 0x7f990406dfe0 2023-12-19T19:00:53.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f9900ff9640 1 -- 172.21.15.133:0/3866168531 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98fc00ee90 con 0x7f990406dfe0 2023-12-19T19:00:53.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f9900ff9640 1 -- 172.21.15.133:0/3866168531 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc0149e0 con 0x7f990406dfe0 2023-12-19T19:00:53.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f9909809640 1 -- 172.21.15.133:0/3866168531 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99041ede10 con 0x7f990406dfe0 2023-12-19T19:00:53.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.949+0000 7f9909809640 1 -- 172.21.15.133:0/3866168531 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99040c6ac0 con 0x7f990406dfe0 2023-12-19T19:00:53.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.953+0000 7f9909809640 1 -- 172.21.15.133:0/3866168531 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9904068400 con 0x7f990406dfe0 2023-12-19T19:00:53.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.953+0000 7f9900ff9640 1 -- 172.21.15.133:0/3866168531 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f98fc014b40 con 0x7f990406dfe0 2023-12-19T19:00:53.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.953+0000 7f9900ff9640 1 --2- 172.21.15.133:0/3866168531 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f98e4066470 0x7f98e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:53.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.953+0000 7f9900ff9640 1 -- 172.21.15.133:0/3866168531 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f98fc084ad0 con 0x7f990406dfe0 2023-12-19T19:00:53.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.953+0000 7f9902ffd640 1 --2- 172.21.15.133:0/3866168531 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f98e4066470 0x7f98e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:53.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.953+0000 7f9902ffd640 1 --2- 172.21.15.133:0/3866168531 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f98e4066470 0x7f98e4068930 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f98ec007a60 tx=0x7f98ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:53.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:53.957+0000 7f9900ff9640 1 -- 172.21.15.133:0/3866168531 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f98fc051c00 con 0x7f990406dfe0 2023-12-19T19:00:54.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.105+0000 7f9909809640 1 -- 172.21.15.133:0/3866168531 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99040c6660 con 0x7f98e4066470 2023-12-19T19:00:54.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.117+0000 7f9900ff9640 1 -- 172.21.15.133:0/3866168531 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+528016 (secure 0 0 0) 0x7f98ec010990 con 0x7f98e4066470 2023-12-19T19:00:54.126 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:54.131 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T19:00:54.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.121+0000 7f9909809640 1 -- 172.21.15.133:0/3866168531 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f98e4066470 msgr2=0x7f98e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:54.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.121+0000 7f9909809640 1 --2- 172.21.15.133:0/3866168531 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f98e4066470 0x7f98e4068930 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f98ec007a60 tx=0x7f98ec008040 comp rx=0 tx=0).stop 2023-12-19T19:00:54.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.121+0000 7f9909809640 1 -- 172.21.15.133:0/3866168531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f990406dfe0 msgr2=0x7f9904149430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:54.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.121+0000 7f9909809640 1 --2- 172.21.15.133:0/3866168531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f990406dfe0 0x7f9904149430 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f98fc007e40 tx=0x7f98fc00e4b0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.121+0000 7f9909809640 1 -- 172.21.15.133:0/3866168531 shutdown_connections 2023-12-19T19:00:54.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.121+0000 7f9909809640 1 --2- 172.21.15.133:0/3866168531 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f98e4066470 0x7f98e4068930 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.121+0000 7f9909809640 1 --2- 172.21.15.133:0/3866168531 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f990406dfe0 0x7f9904149430 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.121+0000 7f9909809640 1 --2- 172.21.15.133:0/3866168531 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f990406b1e0 0x7f99040c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.121+0000 7f9909809640 1 --2- 172.21.15.133:0/3866168531 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f990406a5b0 0x7f990414baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.121+0000 7f9909809640 1 -- 172.21.15.133:0/3866168531 >> 172.21.15.133:0/3866168531 conn(0x7f99040c6ef0 msgr2=0x7f99040c0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:54.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.121+0000 7f9909809640 1 -- 172.21.15.133:0/3866168531 shutdown_connections 2023-12-19T19:00:54.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.121+0000 7f9909809640 1 -- 172.21.15.133:0/3866168531 wait complete. 2023-12-19T19:00:54.146 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":118,"stamp":"2023-12-19T19:00:52.865315+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":296,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239044,"kb_used_data":6244,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754735676,"statfs":{"total":773094113280,"available":772849332224,"internally_reserved":0,"allocated":6393856,"data_stored":3380547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.206272"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.698723+0000","last_change":"2023-12-19T19:00:49.693869+0000","last_active":"2023-12-19T19:00:49.698723+0000","last_peered":"2023-12-19T19:00:49.698723+0000","last_clean":"2023-12-19T19:00:49.698723+0000","last_became_active":"2023-12-19T19:00:49.693560+0000","last_became_peered":"2023-12-19T19:00:49.693560+0000","last_unstale":"2023-12-19T19:00:49.698723+0000","last_undegraded":"2023-12-19T19:00:49.698723+0000","last_fullsized":"2023-12-19T19:00:49.698723+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:25.823608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.683642+0000","last_change":"2023-12-19T19:00:31.998328+0000","last_active":"2023-12-19T19:00:48.683642+0000","last_peered":"2023-12-19T19:00:48.683642+0000","last_clean":"2023-12-19T19:00:48.683642+0000","last_became_active":"2023-12-19T19:00:31.998072+0000","last_became_peered":"2023-12-19T19:00:31.998072+0000","last_unstale":"2023-12-19T19:00:48.683642+0000","last_undegraded":"2023-12-19T19:00:48.683642+0000","last_fullsized":"2023-12-19T19:00:48.683642+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:11:16.755757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686791+0000","last_change":"2023-12-19T19:00:49.704168+0000","last_active":"2023-12-19T19:00:50.686791+0000","last_peered":"2023-12-19T19:00:50.686791+0000","last_clean":"2023-12-19T19:00:50.686791+0000","last_became_active":"2023-12-19T19:00:49.703829+0000","last_became_peered":"2023-12-19T19:00:49.703829+0000","last_unstale":"2023-12-19T19:00:50.686791+0000","last_undegraded":"2023-12-19T19:00:50.686791+0000","last_fullsized":"2023-12-19T19:00:50.686791+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:48.631905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679859+0000","last_change":"2023-12-19T19:00:31.988596+0000","last_active":"2023-12-19T19:00:48.679859+0000","last_peered":"2023-12-19T19:00:48.679859+0000","last_clean":"2023-12-19T19:00:48.679859+0000","last_became_active":"2023-12-19T19:00:31.988327+0000","last_became_peered":"2023-12-19T19:00:31.988327+0000","last_unstale":"2023-12-19T19:00:48.679859+0000","last_undegraded":"2023-12-19T19:00:48.679859+0000","last_fullsized":"2023-12-19T19:00:48.679859+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:05:42.607715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.688783+0000","last_change":"2023-12-19T19:00:49.691140+0000","last_active":"2023-12-19T19:00:50.688783+0000","last_peered":"2023-12-19T19:00:50.688783+0000","last_clean":"2023-12-19T19:00:50.688783+0000","last_became_active":"2023-12-19T19:00:49.690831+0000","last_became_peered":"2023-12-19T19:00:49.690831+0000","last_unstale":"2023-12-19T19:00:50.688783+0000","last_undegraded":"2023-12-19T19:00:50.688783+0000","last_fullsized":"2023-12-19T19:00:50.688783+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:30:51.465735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.679012+0000","last_change":"2023-12-19T19:00:31.987245+0000","last_active":"2023-12-19T19:00:49.679012+0000","last_peered":"2023-12-19T19:00:49.679012+0000","last_clean":"2023-12-19T19:00:49.679012+0000","last_became_active":"2023-12-19T19:00:31.986953+0000","last_became_peered":"2023-12-19T19:00:31.986953+0000","last_unstale":"2023-12-19T19:00:49.679012+0000","last_undegraded":"2023-12-19T19:00:49.679012+0000","last_fullsized":"2023-12-19T19:00:49.679012+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:34.630792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.715749+0000","last_change":"2023-12-19T19:00:49.708858+0000","last_active":"2023-12-19T19:00:49.715749+0000","last_peered":"2023-12-19T19:00:49.715749+0000","last_clean":"2023-12-19T19:00:49.715749+0000","last_became_active":"2023-12-19T19:00:49.707507+0000","last_became_peered":"2023-12-19T19:00:49.707507+0000","last_unstale":"2023-12-19T19:00:49.715749+0000","last_undegraded":"2023-12-19T19:00:49.715749+0000","last_fullsized":"2023-12-19T19:00:49.715749+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:35:17.219218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.684262+0000","last_change":"2023-12-19T19:00:32.009662+0000","last_active":"2023-12-19T19:00:49.684262+0000","last_peered":"2023-12-19T19:00:49.684262+0000","last_clean":"2023-12-19T19:00:49.684262+0000","last_became_active":"2023-12-19T19:00:32.009345+0000","last_became_peered":"2023-12-19T19:00:32.009345+0000","last_unstale":"2023-12-19T19:00:49.684262+0000","last_undegraded":"2023-12-19T19:00:49.684262+0000","last_fullsized":"2023-12-19T19:00:49.684262+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:27:21.821975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.687585+0000","last_change":"2023-12-19T19:00:49.694094+0000","last_active":"2023-12-19T19:00:50.687585+0000","last_peered":"2023-12-19T19:00:50.687585+0000","last_clean":"2023-12-19T19:00:50.687585+0000","last_became_active":"2023-12-19T19:00:49.693811+0000","last_became_peered":"2023-12-19T19:00:49.693811+0000","last_unstale":"2023-12-19T19:00:50.687585+0000","last_undegraded":"2023-12-19T19:00:50.687585+0000","last_fullsized":"2023-12-19T19:00:50.687585+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:24:12.796825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.682781+0000","last_change":"2023-12-19T19:00:32.008158+0000","last_active":"2023-12-19T19:00:48.682781+0000","last_peered":"2023-12-19T19:00:48.682781+0000","last_clean":"2023-12-19T19:00:48.682781+0000","last_became_active":"2023-12-19T19:00:32.005772+0000","last_became_peered":"2023-12-19T19:00:32.005772+0000","last_unstale":"2023-12-19T19:00:48.682781+0000","last_undegraded":"2023-12-19T19:00:48.682781+0000","last_fullsized":"2023-12-19T19:00:48.682781+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:34.376469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.715129+0000","last_change":"2023-12-19T19:00:49.707418+0000","last_active":"2023-12-19T19:00:49.715129+0000","last_peered":"2023-12-19T19:00:49.715129+0000","last_clean":"2023-12-19T19:00:49.715129+0000","last_became_active":"2023-12-19T19:00:49.707022+0000","last_became_peered":"2023-12-19T19:00:49.707022+0000","last_unstale":"2023-12-19T19:00:49.715129+0000","last_undegraded":"2023-12-19T19:00:49.715129+0000","last_fullsized":"2023-12-19T19:00:49.715129+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:27:39.523366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.695174+0000","last_change":"2023-12-19T19:00:31.995665+0000","last_active":"2023-12-19T19:00:48.695174+0000","last_peered":"2023-12-19T19:00:48.695174+0000","last_clean":"2023-12-19T19:00:48.695174+0000","last_became_active":"2023-12-19T19:00:31.995407+0000","last_became_peered":"2023-12-19T19:00:31.995407+0000","last_unstale":"2023-12-19T19:00:48.695174+0000","last_undegraded":"2023-12-19T19:00:48.695174+0000","last_fullsized":"2023-12-19T19:00:48.695174+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:34.630792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.692591+0000","last_change":"2023-12-19T19:00:49.690296+0000","last_active":"2023-12-19T19:00:49.692591+0000","last_peered":"2023-12-19T19:00:49.692591+0000","last_clean":"2023-12-19T19:00:49.692591+0000","last_became_active":"2023-12-19T19:00:49.689936+0000","last_became_peered":"2023-12-19T19:00:49.689936+0000","last_unstale":"2023-12-19T19:00:49.692591+0000","last_undegraded":"2023-12-19T19:00:49.692591+0000","last_fullsized":"2023-12-19T19:00:49.692591+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:04:10.900001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679527+0000","last_change":"2023-12-19T19:00:31.987493+0000","last_active":"2023-12-19T19:00:48.679527+0000","last_peered":"2023-12-19T19:00:48.679527+0000","last_clean":"2023-12-19T19:00:48.679527+0000","last_became_active":"2023-12-19T19:00:31.987252+0000","last_became_peered":"2023-12-19T19:00:31.987252+0000","last_unstale":"2023-12-19T19:00:48.679527+0000","last_undegraded":"2023-12-19T19:00:48.679527+0000","last_fullsized":"2023-12-19T19:00:48.679527+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:07:48.132861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.715990+0000","last_change":"2023-12-19T19:00:49.709889+0000","last_active":"2023-12-19T19:00:49.715990+0000","last_peered":"2023-12-19T19:00:49.715990+0000","last_clean":"2023-12-19T19:00:49.715990+0000","last_became_active":"2023-12-19T19:00:49.707946+0000","last_became_peered":"2023-12-19T19:00:49.707946+0000","last_unstale":"2023-12-19T19:00:49.715990+0000","last_undegraded":"2023-12-19T19:00:49.715990+0000","last_fullsized":"2023-12-19T19:00:49.715990+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:39:54.810520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679376+0000","last_change":"2023-12-19T19:00:31.995216+0000","last_active":"2023-12-19T19:00:48.679376+0000","last_peered":"2023-12-19T19:00:48.679376+0000","last_clean":"2023-12-19T19:00:48.679376+0000","last_became_active":"2023-12-19T19:00:31.994879+0000","last_became_peered":"2023-12-19T19:00:31.994879+0000","last_unstale":"2023-12-19T19:00:48.679376+0000","last_undegraded":"2023-12-19T19:00:48.679376+0000","last_fullsized":"2023-12-19T19:00:48.679376+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:50.358908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.688232+0000","last_change":"2023-12-19T19:00:49.696527+0000","last_active":"2023-12-19T19:00:50.688232+0000","last_peered":"2023-12-19T19:00:50.688232+0000","last_clean":"2023-12-19T19:00:50.688232+0000","last_became_active":"2023-12-19T19:00:49.695865+0000","last_became_peered":"2023-12-19T19:00:49.695865+0000","last_unstale":"2023-12-19T19:00:50.688232+0000","last_undegraded":"2023-12-19T19:00:50.688232+0000","last_fullsized":"2023-12-19T19:00:50.688232+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:55:25.865584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.681152+0000","last_change":"2023-12-19T19:00:32.007195+0000","last_active":"2023-12-19T19:00:48.681152+0000","last_peered":"2023-12-19T19:00:48.681152+0000","last_clean":"2023-12-19T19:00:48.681152+0000","last_became_active":"2023-12-19T19:00:32.006848+0000","last_became_peered":"2023-12-19T19:00:32.006848+0000","last_unstale":"2023-12-19T19:00:48.681152+0000","last_undegraded":"2023-12-19T19:00:48.681152+0000","last_fullsized":"2023-12-19T19:00:48.681152+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:03.755019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686585+0000","last_change":"2023-12-19T19:00:49.696927+0000","last_active":"2023-12-19T19:00:50.686585+0000","last_peered":"2023-12-19T19:00:50.686585+0000","last_clean":"2023-12-19T19:00:50.686585+0000","last_became_active":"2023-12-19T19:00:49.694423+0000","last_became_peered":"2023-12-19T19:00:49.694423+0000","last_unstale":"2023-12-19T19:00:50.686585+0000","last_undegraded":"2023-12-19T19:00:50.686585+0000","last_fullsized":"2023-12-19T19:00:50.686585+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:47.463525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.675487+0000","last_change":"2023-12-19T19:00:31.996387+0000","last_active":"2023-12-19T19:00:49.675487+0000","last_peered":"2023-12-19T19:00:49.675487+0000","last_clean":"2023-12-19T19:00:49.675487+0000","last_became_active":"2023-12-19T19:00:31.996111+0000","last_became_peered":"2023-12-19T19:00:31.996111+0000","last_unstale":"2023-12-19T19:00:49.675487+0000","last_undegraded":"2023-12-19T19:00:49.675487+0000","last_fullsized":"2023-12-19T19:00:49.675487+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:07:14.048441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.702319+0000","last_change":"2023-12-19T19:00:49.697994+0000","last_active":"2023-12-19T19:00:49.702319+0000","last_peered":"2023-12-19T19:00:49.702319+0000","last_clean":"2023-12-19T19:00:49.702319+0000","last_became_active":"2023-12-19T19:00:49.696339+0000","last_became_peered":"2023-12-19T19:00:49.696339+0000","last_unstale":"2023-12-19T19:00:49.702319+0000","last_undegraded":"2023-12-19T19:00:49.702319+0000","last_fullsized":"2023-12-19T19:00:49.702319+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:21:24.638950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.675539+0000","last_change":"2023-12-19T19:00:31.998530+0000","last_active":"2023-12-19T19:00:49.675539+0000","last_peered":"2023-12-19T19:00:49.675539+0000","last_clean":"2023-12-19T19:00:49.675539+0000","last_became_active":"2023-12-19T19:00:31.998192+0000","last_became_peered":"2023-12-19T19:00:31.998192+0000","last_unstale":"2023-12-19T19:00:49.675539+0000","last_undegraded":"2023-12-19T19:00:49.675539+0000","last_fullsized":"2023-12-19T19:00:49.675539+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:04:28.425713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.700779+0000","last_change":"2023-12-19T19:00:49.694606+0000","last_active":"2023-12-19T19:00:49.700779+0000","last_peered":"2023-12-19T19:00:49.700779+0000","last_clean":"2023-12-19T19:00:49.700779+0000","last_became_active":"2023-12-19T19:00:49.694289+0000","last_became_peered":"2023-12-19T19:00:49.694289+0000","last_unstale":"2023-12-19T19:00:49.700779+0000","last_undegraded":"2023-12-19T19:00:49.700779+0000","last_fullsized":"2023-12-19T19:00:49.700779+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:27:09.787292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.684355+0000","last_change":"2023-12-19T19:00:31.996756+0000","last_active":"2023-12-19T19:00:49.684355+0000","last_peered":"2023-12-19T19:00:49.684355+0000","last_clean":"2023-12-19T19:00:49.684355+0000","last_became_active":"2023-12-19T19:00:31.996480+0000","last_became_peered":"2023-12-19T19:00:31.996480+0000","last_unstale":"2023-12-19T19:00:49.684355+0000","last_undegraded":"2023-12-19T19:00:49.684355+0000","last_fullsized":"2023-12-19T19:00:49.684355+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:36.947100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.698857+0000","last_change":"2023-12-19T19:00:49.694019+0000","last_active":"2023-12-19T19:00:49.698857+0000","last_peered":"2023-12-19T19:00:49.698857+0000","last_clean":"2023-12-19T19:00:49.698857+0000","last_became_active":"2023-12-19T19:00:49.693752+0000","last_became_peered":"2023-12-19T19:00:49.693752+0000","last_unstale":"2023-12-19T19:00:49.698857+0000","last_undegraded":"2023-12-19T19:00:49.698857+0000","last_fullsized":"2023-12-19T19:00:49.698857+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:01:05.024259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.692892+0000","last_change":"2023-12-19T19:00:32.013269+0000","last_active":"2023-12-19T19:00:48.692892+0000","last_peered":"2023-12-19T19:00:48.692892+0000","last_clean":"2023-12-19T19:00:48.692892+0000","last_became_active":"2023-12-19T19:00:32.012808+0000","last_became_peered":"2023-12-19T19:00:32.012808+0000","last_unstale":"2023-12-19T19:00:48.692892+0000","last_undegraded":"2023-12-19T19:00:48.692892+0000","last_fullsized":"2023-12-19T19:00:48.692892+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:38:03.773877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.704574+0000","last_change":"2023-12-19T19:00:49.698711+0000","last_active":"2023-12-19T19:00:49.704574+0000","last_peered":"2023-12-19T19:00:49.704574+0000","last_clean":"2023-12-19T19:00:49.704574+0000","last_became_active":"2023-12-19T19:00:49.698418+0000","last_became_peered":"2023-12-19T19:00:49.698418+0000","last_unstale":"2023-12-19T19:00:49.704574+0000","last_undegraded":"2023-12-19T19:00:49.704574+0000","last_fullsized":"2023-12-19T19:00:49.704574+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:57.849352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679981+0000","last_change":"2023-12-19T19:00:31.994520+0000","last_active":"2023-12-19T19:00:48.679981+0000","last_peered":"2023-12-19T19:00:48.679981+0000","last_clean":"2023-12-19T19:00:48.679981+0000","last_became_active":"2023-12-19T19:00:31.994221+0000","last_became_peered":"2023-12-19T19:00:31.994221+0000","last_unstale":"2023-12-19T19:00:48.679981+0000","last_undegraded":"2023-12-19T19:00:48.679981+0000","last_fullsized":"2023-12-19T19:00:48.679981+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:27.267758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.706557+0000","last_change":"2023-12-19T19:00:49.705300+0000","last_active":"2023-12-19T19:00:49.706557+0000","last_peered":"2023-12-19T19:00:49.706557+0000","last_clean":"2023-12-19T19:00:49.706557+0000","last_became_active":"2023-12-19T19:00:49.704913+0000","last_became_peered":"2023-12-19T19:00:49.704913+0000","last_unstale":"2023-12-19T19:00:49.706557+0000","last_undegraded":"2023-12-19T19:00:49.706557+0000","last_fullsized":"2023-12-19T19:00:49.706557+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:23.122873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679712+0000","last_change":"2023-12-19T19:00:31.993938+0000","last_active":"2023-12-19T19:00:48.679712+0000","last_peered":"2023-12-19T19:00:48.679712+0000","last_clean":"2023-12-19T19:00:48.679712+0000","last_became_active":"2023-12-19T19:00:31.993647+0000","last_became_peered":"2023-12-19T19:00:31.993647+0000","last_unstale":"2023-12-19T19:00:48.679712+0000","last_undegraded":"2023-12-19T19:00:48.679712+0000","last_fullsized":"2023-12-19T19:00:48.679712+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:34.112789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.698351+0000","last_change":"2023-12-19T19:00:49.694425+0000","last_active":"2023-12-19T19:00:49.698351+0000","last_peered":"2023-12-19T19:00:49.698351+0000","last_clean":"2023-12-19T19:00:49.698351+0000","last_became_active":"2023-12-19T19:00:49.693968+0000","last_became_peered":"2023-12-19T19:00:49.693968+0000","last_unstale":"2023-12-19T19:00:49.698351+0000","last_undegraded":"2023-12-19T19:00:49.698351+0000","last_fullsized":"2023-12-19T19:00:49.698351+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:11.065167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.695144+0000","last_change":"2023-12-19T19:00:31.993839+0000","last_active":"2023-12-19T19:00:48.695144+0000","last_peered":"2023-12-19T19:00:48.695144+0000","last_clean":"2023-12-19T19:00:48.695144+0000","last_became_active":"2023-12-19T19:00:31.989969+0000","last_became_peered":"2023-12-19T19:00:31.989969+0000","last_unstale":"2023-12-19T19:00:48.695144+0000","last_undegraded":"2023-12-19T19:00:48.695144+0000","last_fullsized":"2023-12-19T19:00:48.695144+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:30.930514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.710813+0000","last_change":"2023-12-19T19:00:49.706894+0000","last_active":"2023-12-19T19:00:49.710813+0000","last_peered":"2023-12-19T19:00:49.710813+0000","last_clean":"2023-12-19T19:00:49.710813+0000","last_became_active":"2023-12-19T19:00:49.703054+0000","last_became_peered":"2023-12-19T19:00:49.703054+0000","last_unstale":"2023-12-19T19:00:49.710813+0000","last_undegraded":"2023-12-19T19:00:49.710813+0000","last_fullsized":"2023-12-19T19:00:49.710813+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:54.648491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.681183+0000","last_change":"2023-12-19T19:00:31.992695+0000","last_active":"2023-12-19T19:00:48.681183+0000","last_peered":"2023-12-19T19:00:48.681183+0000","last_clean":"2023-12-19T19:00:48.681183+0000","last_became_active":"2023-12-19T19:00:31.992420+0000","last_became_peered":"2023-12-19T19:00:31.992420+0000","last_unstale":"2023-12-19T19:00:48.681183+0000","last_undegraded":"2023-12-19T19:00:48.681183+0000","last_fullsized":"2023-12-19T19:00:48.681183+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:15:06.831796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.700408+0000","last_change":"2023-12-19T19:00:49.695699+0000","last_active":"2023-12-19T19:00:49.700408+0000","last_peered":"2023-12-19T19:00:49.700408+0000","last_clean":"2023-12-19T19:00:49.700408+0000","last_became_active":"2023-12-19T19:00:49.695440+0000","last_became_peered":"2023-12-19T19:00:49.695440+0000","last_unstale":"2023-12-19T19:00:49.700408+0000","last_undegraded":"2023-12-19T19:00:49.700408+0000","last_fullsized":"2023-12-19T19:00:49.700408+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:36:18.379135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.677320+0000","last_change":"2023-12-19T19:00:32.004815+0000","last_active":"2023-12-19T19:00:49.677320+0000","last_peered":"2023-12-19T19:00:49.677320+0000","last_clean":"2023-12-19T19:00:49.677320+0000","last_became_active":"2023-12-19T19:00:32.004530+0000","last_became_peered":"2023-12-19T19:00:32.004530+0000","last_unstale":"2023-12-19T19:00:49.677320+0000","last_undegraded":"2023-12-19T19:00:49.677320+0000","last_fullsized":"2023-12-19T19:00:49.677320+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:12:29.382064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.700638+0000","last_change":"2023-12-19T19:00:49.696644+0000","last_active":"2023-12-19T19:00:49.700638+0000","last_peered":"2023-12-19T19:00:49.700638+0000","last_clean":"2023-12-19T19:00:49.700638+0000","last_became_active":"2023-12-19T19:00:49.694814+0000","last_became_peered":"2023-12-19T19:00:49.694814+0000","last_unstale":"2023-12-19T19:00:49.700638+0000","last_undegraded":"2023-12-19T19:00:49.700638+0000","last_fullsized":"2023-12-19T19:00:49.700638+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:21.424753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.684029+0000","last_change":"2023-12-19T19:00:31.994588+0000","last_active":"2023-12-19T19:00:48.684029+0000","last_peered":"2023-12-19T19:00:48.684029+0000","last_clean":"2023-12-19T19:00:48.684029+0000","last_became_active":"2023-12-19T19:00:31.994303+0000","last_became_peered":"2023-12-19T19:00:31.994303+0000","last_unstale":"2023-12-19T19:00:48.684029+0000","last_undegraded":"2023-12-19T19:00:48.684029+0000","last_fullsized":"2023-12-19T19:00:48.684029+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:38:25.957034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686987+0000","last_change":"2023-12-19T19:00:49.708055+0000","last_active":"2023-12-19T19:00:50.686987+0000","last_peered":"2023-12-19T19:00:50.686987+0000","last_clean":"2023-12-19T19:00:50.686987+0000","last_became_active":"2023-12-19T19:00:49.707689+0000","last_became_peered":"2023-12-19T19:00:49.707689+0000","last_unstale":"2023-12-19T19:00:50.686987+0000","last_undegraded":"2023-12-19T19:00:50.686987+0000","last_fullsized":"2023-12-19T19:00:50.686987+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:06.329455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679669+0000","last_change":"2023-12-19T19:00:32.003503+0000","last_active":"2023-12-19T19:00:48.679669+0000","last_peered":"2023-12-19T19:00:48.679669+0000","last_clean":"2023-12-19T19:00:48.679669+0000","last_became_active":"2023-12-19T19:00:32.002889+0000","last_became_peered":"2023-12-19T19:00:32.002889+0000","last_unstale":"2023-12-19T19:00:48.679669+0000","last_undegraded":"2023-12-19T19:00:48.679669+0000","last_fullsized":"2023-12-19T19:00:48.679669+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:06:56.288379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.687008+0000","last_change":"2023-12-19T19:00:49.697540+0000","last_active":"2023-12-19T19:00:50.687008+0000","last_peered":"2023-12-19T19:00:50.687008+0000","last_clean":"2023-12-19T19:00:50.687008+0000","last_became_active":"2023-12-19T19:00:49.697276+0000","last_became_peered":"2023-12-19T19:00:49.697276+0000","last_unstale":"2023-12-19T19:00:50.687008+0000","last_undegraded":"2023-12-19T19:00:50.687008+0000","last_fullsized":"2023-12-19T19:00:50.687008+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:37:30.469791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.677239+0000","last_change":"2023-12-19T19:00:31.995238+0000","last_active":"2023-12-19T19:00:49.677239+0000","last_peered":"2023-12-19T19:00:49.677239+0000","last_clean":"2023-12-19T19:00:49.677239+0000","last_became_active":"2023-12-19T19:00:31.994950+0000","last_became_peered":"2023-12-19T19:00:31.994950+0000","last_unstale":"2023-12-19T19:00:49.677239+0000","last_undegraded":"2023-12-19T19:00:49.677239+0000","last_fullsized":"2023-12-19T19:00:49.677239+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:36.947100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686381+0000","last_change":"2023-12-19T19:00:49.710352+0000","last_active":"2023-12-19T19:00:50.686381+0000","last_peered":"2023-12-19T19:00:50.686381+0000","last_clean":"2023-12-19T19:00:50.686381+0000","last_became_active":"2023-12-19T19:00:49.710065+0000","last_became_peered":"2023-12-19T19:00:49.710065+0000","last_unstale":"2023-12-19T19:00:50.686381+0000","last_undegraded":"2023-12-19T19:00:50.686381+0000","last_fullsized":"2023-12-19T19:00:50.686381+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:10:42.200620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679453+0000","last_change":"2023-12-19T19:00:31.998862+0000","last_active":"2023-12-19T19:00:48.679453+0000","last_peered":"2023-12-19T19:00:48.679453+0000","last_clean":"2023-12-19T19:00:48.679453+0000","last_became_active":"2023-12-19T19:00:31.996848+0000","last_became_peered":"2023-12-19T19:00:31.996848+0000","last_unstale":"2023-12-19T19:00:48.679453+0000","last_undegraded":"2023-12-19T19:00:48.679453+0000","last_fullsized":"2023-12-19T19:00:48.679453+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:52:36.347842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.694969+0000","last_change":"2023-12-19T19:00:49.689226+0000","last_active":"2023-12-19T19:00:49.694969+0000","last_peered":"2023-12-19T19:00:49.694969+0000","last_clean":"2023-12-19T19:00:49.694969+0000","last_became_active":"2023-12-19T19:00:49.688834+0000","last_became_peered":"2023-12-19T19:00:49.688834+0000","last_unstale":"2023-12-19T19:00:49.694969+0000","last_undegraded":"2023-12-19T19:00:49.694969+0000","last_fullsized":"2023-12-19T19:00:49.694969+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:54.546461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.676161+0000","last_change":"2023-12-19T19:00:31.986797+0000","last_active":"2023-12-19T19:00:49.676161+0000","last_peered":"2023-12-19T19:00:49.676161+0000","last_clean":"2023-12-19T19:00:49.676161+0000","last_became_active":"2023-12-19T19:00:31.986522+0000","last_became_peered":"2023-12-19T19:00:31.986522+0000","last_unstale":"2023-12-19T19:00:49.676161+0000","last_undegraded":"2023-12-19T19:00:49.676161+0000","last_fullsized":"2023-12-19T19:00:49.676161+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:34:59.517827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.695795+0000","last_change":"2023-12-19T19:00:49.693333+0000","last_active":"2023-12-19T19:00:49.695795+0000","last_peered":"2023-12-19T19:00:49.695795+0000","last_clean":"2023-12-19T19:00:49.695795+0000","last_became_active":"2023-12-19T19:00:49.693039+0000","last_became_peered":"2023-12-19T19:00:49.693039+0000","last_unstale":"2023-12-19T19:00:49.695795+0000","last_undegraded":"2023-12-19T19:00:49.695795+0000","last_fullsized":"2023-12-19T19:00:49.695795+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:52.332183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.693427+0000","last_change":"2023-12-19T19:00:32.003120+0000","last_active":"2023-12-19T19:00:48.693427+0000","last_peered":"2023-12-19T19:00:48.693427+0000","last_clean":"2023-12-19T19:00:48.693427+0000","last_became_active":"2023-12-19T19:00:32.002670+0000","last_became_peered":"2023-12-19T19:00:32.002670+0000","last_unstale":"2023-12-19T19:00:48.693427+0000","last_undegraded":"2023-12-19T19:00:48.693427+0000","last_fullsized":"2023-12-19T19:00:48.693427+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:56:49.821008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.703330+0000","last_change":"2023-12-19T19:00:49.701440+0000","last_active":"2023-12-19T19:00:49.703330+0000","last_peered":"2023-12-19T19:00:49.703330+0000","last_clean":"2023-12-19T19:00:49.703330+0000","last_became_active":"2023-12-19T19:00:49.701186+0000","last_became_peered":"2023-12-19T19:00:49.701186+0000","last_unstale":"2023-12-19T19:00:49.703330+0000","last_undegraded":"2023-12-19T19:00:49.703330+0000","last_fullsized":"2023-12-19T19:00:49.703330+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:01:51.384923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.683714+0000","last_change":"2023-12-19T19:00:32.006868+0000","last_active":"2023-12-19T19:00:48.683714+0000","last_peered":"2023-12-19T19:00:48.683714+0000","last_clean":"2023-12-19T19:00:48.683714+0000","last_became_active":"2023-12-19T19:00:32.004570+0000","last_became_peered":"2023-12-19T19:00:32.004570+0000","last_unstale":"2023-12-19T19:00:48.683714+0000","last_undegraded":"2023-12-19T19:00:48.683714+0000","last_fullsized":"2023-12-19T19:00:48.683714+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:00.659446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.700724+0000","last_change":"2023-12-19T19:00:49.693550+0000","last_active":"2023-12-19T19:00:49.700724+0000","last_peered":"2023-12-19T19:00:49.700724+0000","last_clean":"2023-12-19T19:00:49.700724+0000","last_became_active":"2023-12-19T19:00:49.693267+0000","last_became_peered":"2023-12-19T19:00:49.693267+0000","last_unstale":"2023-12-19T19:00:49.700724+0000","last_undegraded":"2023-12-19T19:00:49.700724+0000","last_fullsized":"2023-12-19T19:00:49.700724+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:06.329455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.682993+0000","last_change":"2023-12-19T19:00:31.995715+0000","last_active":"2023-12-19T19:00:49.682993+0000","last_peered":"2023-12-19T19:00:49.682993+0000","last_clean":"2023-12-19T19:00:49.682993+0000","last_became_active":"2023-12-19T19:00:31.995368+0000","last_became_peered":"2023-12-19T19:00:31.995368+0000","last_unstale":"2023-12-19T19:00:49.682993+0000","last_undegraded":"2023-12-19T19:00:49.682993+0000","last_fullsized":"2023-12-19T19:00:49.682993+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:30.930514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.689006+0000","last_change":"2023-12-19T19:00:49.686349+0000","last_active":"2023-12-19T19:00:49.689006+0000","last_peered":"2023-12-19T19:00:49.689006+0000","last_clean":"2023-12-19T19:00:49.689006+0000","last_became_active":"2023-12-19T19:00:49.685984+0000","last_became_peered":"2023-12-19T19:00:49.685984+0000","last_unstale":"2023-12-19T19:00:49.689006+0000","last_undegraded":"2023-12-19T19:00:49.689006+0000","last_fullsized":"2023-12-19T19:00:49.689006+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:11:00.378718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.696396+0000","last_change":"2023-12-19T19:00:32.003346+0000","last_active":"2023-12-19T19:00:48.696396+0000","last_peered":"2023-12-19T19:00:48.696396+0000","last_clean":"2023-12-19T19:00:48.696396+0000","last_became_active":"2023-12-19T19:00:32.003084+0000","last_became_peered":"2023-12-19T19:00:32.003084+0000","last_unstale":"2023-12-19T19:00:48.696396+0000","last_undegraded":"2023-12-19T19:00:48.696396+0000","last_fullsized":"2023-12-19T19:00:48.696396+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:22:03.749312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.687381+0000","last_change":"2023-12-19T19:00:49.706818+0000","last_active":"2023-12-19T19:00:50.687381+0000","last_peered":"2023-12-19T19:00:50.687381+0000","last_clean":"2023-12-19T19:00:50.687381+0000","last_became_active":"2023-12-19T19:00:49.706537+0000","last_became_peered":"2023-12-19T19:00:49.706537+0000","last_unstale":"2023-12-19T19:00:50.687381+0000","last_undegraded":"2023-12-19T19:00:50.687381+0000","last_fullsized":"2023-12-19T19:00:50.687381+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:29:36.310628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.683122+0000","last_change":"2023-12-19T19:00:32.000999+0000","last_active":"2023-12-19T19:00:48.683122+0000","last_peered":"2023-12-19T19:00:48.683122+0000","last_clean":"2023-12-19T19:00:48.683122+0000","last_became_active":"2023-12-19T19:00:32.000704+0000","last_became_peered":"2023-12-19T19:00:32.000704+0000","last_unstale":"2023-12-19T19:00:48.683122+0000","last_undegraded":"2023-12-19T19:00:48.683122+0000","last_fullsized":"2023-12-19T19:00:48.683122+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:17:19.297149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686810+0000","last_change":"2023-12-19T19:00:49.692638+0000","last_active":"2023-12-19T19:00:50.686810+0000","last_peered":"2023-12-19T19:00:50.686810+0000","last_clean":"2023-12-19T19:00:50.686810+0000","last_became_active":"2023-12-19T19:00:49.692161+0000","last_became_peered":"2023-12-19T19:00:49.692161+0000","last_unstale":"2023-12-19T19:00:50.686810+0000","last_undegraded":"2023-12-19T19:00:50.686810+0000","last_fullsized":"2023-12-19T19:00:50.686810+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:36:18.379135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.680050+0000","last_change":"2023-12-19T19:00:32.000428+0000","last_active":"2023-12-19T19:00:48.680050+0000","last_peered":"2023-12-19T19:00:48.680050+0000","last_clean":"2023-12-19T19:00:48.680050+0000","last_became_active":"2023-12-19T19:00:31.996129+0000","last_became_peered":"2023-12-19T19:00:31.996129+0000","last_unstale":"2023-12-19T19:00:48.680050+0000","last_undegraded":"2023-12-19T19:00:48.680050+0000","last_fullsized":"2023-12-19T19:00:48.680050+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:37:12.617236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.709522+0000","last_change":"2023-12-19T19:00:49.697800+0000","last_active":"2023-12-19T19:00:49.709522+0000","last_peered":"2023-12-19T19:00:49.709522+0000","last_clean":"2023-12-19T19:00:49.709522+0000","last_became_active":"2023-12-19T19:00:49.697400+0000","last_became_peered":"2023-12-19T19:00:49.697400+0000","last_unstale":"2023-12-19T19:00:49.709522+0000","last_undegraded":"2023-12-19T19:00:49.709522+0000","last_fullsized":"2023-12-19T19:00:49.709522+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:49.307770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.676025+0000","last_change":"2023-12-19T19:00:31.996533+0000","last_active":"2023-12-19T19:00:49.676025+0000","last_peered":"2023-12-19T19:00:49.676025+0000","last_clean":"2023-12-19T19:00:49.676025+0000","last_became_active":"2023-12-19T19:00:31.996157+0000","last_became_peered":"2023-12-19T19:00:31.996157+0000","last_unstale":"2023-12-19T19:00:49.676025+0000","last_undegraded":"2023-12-19T19:00:49.676025+0000","last_fullsized":"2023-12-19T19:00:49.676025+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:29.762134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.699053+0000","last_change":"2023-12-19T19:00:49.694054+0000","last_active":"2023-12-19T19:00:49.699053+0000","last_peered":"2023-12-19T19:00:49.699053+0000","last_clean":"2023-12-19T19:00:49.699053+0000","last_became_active":"2023-12-19T19:00:49.693676+0000","last_became_peered":"2023-12-19T19:00:49.693676+0000","last_unstale":"2023-12-19T19:00:49.699053+0000","last_undegraded":"2023-12-19T19:00:49.699053+0000","last_fullsized":"2023-12-19T19:00:49.699053+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:44:44.303299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.682614+0000","last_change":"2023-12-19T19:00:32.004191+0000","last_active":"2023-12-19T19:00:48.682614+0000","last_peered":"2023-12-19T19:00:48.682614+0000","last_clean":"2023-12-19T19:00:48.682614+0000","last_became_active":"2023-12-19T19:00:32.003858+0000","last_became_peered":"2023-12-19T19:00:32.003858+0000","last_unstale":"2023-12-19T19:00:48.682614+0000","last_undegraded":"2023-12-19T19:00:48.682614+0000","last_fullsized":"2023-12-19T19:00:48.682614+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:27:46.472889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686808+0000","last_change":"2023-12-19T19:00:49.708514+0000","last_active":"2023-12-19T19:00:50.686808+0000","last_peered":"2023-12-19T19:00:50.686808+0000","last_clean":"2023-12-19T19:00:50.686808+0000","last_became_active":"2023-12-19T19:00:49.708130+0000","last_became_peered":"2023-12-19T19:00:49.708130+0000","last_unstale":"2023-12-19T19:00:50.686808+0000","last_undegraded":"2023-12-19T19:00:50.686808+0000","last_fullsized":"2023-12-19T19:00:50.686808+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:23.122873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.695249+0000","last_change":"2023-12-19T19:00:31.989937+0000","last_active":"2023-12-19T19:00:48.695249+0000","last_peered":"2023-12-19T19:00:48.695249+0000","last_clean":"2023-12-19T19:00:48.695249+0000","last_became_active":"2023-12-19T19:00:31.989530+0000","last_became_peered":"2023-12-19T19:00:31.989530+0000","last_unstale":"2023-12-19T19:00:48.695249+0000","last_undegraded":"2023-12-19T19:00:48.695249+0000","last_fullsized":"2023-12-19T19:00:48.695249+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:13:48.628064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.717156+0000","last_change":"2023-12-19T19:00:49.712815+0000","last_active":"2023-12-19T19:00:49.717156+0000","last_peered":"2023-12-19T19:00:49.717156+0000","last_clean":"2023-12-19T19:00:49.717156+0000","last_became_active":"2023-12-19T19:00:49.712524+0000","last_became_peered":"2023-12-19T19:00:49.712524+0000","last_unstale":"2023-12-19T19:00:49.717156+0000","last_undegraded":"2023-12-19T19:00:49.717156+0000","last_fullsized":"2023-12-19T19:00:49.717156+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:18.666010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.722636+0000","last_change":"2023-12-19T19:00:48.699016+0000","last_active":"2023-12-19T19:00:49.722636+0000","last_peered":"2023-12-19T19:00:49.722636+0000","last_clean":"2023-12-19T19:00:49.722636+0000","last_became_active":"2023-12-19T19:00:48.698702+0000","last_became_peered":"2023-12-19T19:00:48.698702+0000","last_unstale":"2023-12-19T19:00:49.722636+0000","last_undegraded":"2023-12-19T19:00:49.722636+0000","last_fullsized":"2023-12-19T19:00:49.722636+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:09:52.119249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.697139+0000","last_change":"2023-12-19T19:00:31.993377+0000","last_active":"2023-12-19T19:00:48.697139+0000","last_peered":"2023-12-19T19:00:48.697139+0000","last_clean":"2023-12-19T19:00:48.697139+0000","last_became_active":"2023-12-19T19:00:31.993093+0000","last_became_peered":"2023-12-19T19:00:31.993093+0000","last_unstale":"2023-12-19T19:00:48.697139+0000","last_undegraded":"2023-12-19T19:00:48.697139+0000","last_fullsized":"2023-12-19T19:00:48.697139+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:12.475407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"49'4","reported_seq":19,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.697398+0000","last_change":"2023-12-19T19:00:30.991662+0000","last_active":"2023-12-19T19:00:48.697398+0000","last_peered":"2023-12-19T19:00:48.697398+0000","last_clean":"2023-12-19T19:00:48.697398+0000","last_became_active":"2023-12-19T19:00:30.990025+0000","last_became_peered":"2023-12-19T19:00:30.990025+0000","last_unstale":"2023-12-19T19:00:48.697398+0000","last_undegraded":"2023-12-19T19:00:48.697398+0000","last_fullsized":"2023-12-19T19:00:48.697398+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:39:36.100774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.688357+0000","last_change":"2023-12-19T19:00:49.696750+0000","last_active":"2023-12-19T19:00:50.688357+0000","last_peered":"2023-12-19T19:00:50.688357+0000","last_clean":"2023-12-19T19:00:50.688357+0000","last_became_active":"2023-12-19T19:00:49.696213+0000","last_became_peered":"2023-12-19T19:00:49.696213+0000","last_unstale":"2023-12-19T19:00:50.688357+0000","last_undegraded":"2023-12-19T19:00:50.688357+0000","last_fullsized":"2023-12-19T19:00:50.688357+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:21:46.996407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.720363+0000","last_change":"2023-12-19T19:00:48.699087+0000","last_active":"2023-12-19T19:00:49.720363+0000","last_peered":"2023-12-19T19:00:49.720363+0000","last_clean":"2023-12-19T19:00:49.720363+0000","last_became_active":"2023-12-19T19:00:48.697912+0000","last_became_peered":"2023-12-19T19:00:48.697912+0000","last_unstale":"2023-12-19T19:00:49.720363+0000","last_undegraded":"2023-12-19T19:00:49.720363+0000","last_fullsized":"2023-12-19T19:00:49.720363+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:51.325614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.675732+0000","last_change":"2023-12-19T19:00:31.994303+0000","last_active":"2023-12-19T19:00:49.675732+0000","last_peered":"2023-12-19T19:00:49.675732+0000","last_clean":"2023-12-19T19:00:49.675732+0000","last_became_active":"2023-12-19T19:00:31.993980+0000","last_became_peered":"2023-12-19T19:00:31.993980+0000","last_unstale":"2023-12-19T19:00:49.675732+0000","last_undegraded":"2023-12-19T19:00:49.675732+0000","last_fullsized":"2023-12-19T19:00:49.675732+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:43:14.293623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"49'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679958+0000","last_change":"2023-12-19T19:00:30.982126+0000","last_active":"2023-12-19T19:00:48.679958+0000","last_peered":"2023-12-19T19:00:48.679958+0000","last_clean":"2023-12-19T19:00:48.679958+0000","last_became_active":"2023-12-19T19:00:30.981838+0000","last_became_peered":"2023-12-19T19:00:30.981838+0000","last_unstale":"2023-12-19T19:00:48.679958+0000","last_undegraded":"2023-12-19T19:00:48.679958+0000","last_fullsized":"2023-12-19T19:00:48.679958+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:22.410919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.688268+0000","last_change":"2023-12-19T19:00:49.710022+0000","last_active":"2023-12-19T19:00:50.688268+0000","last_peered":"2023-12-19T19:00:50.688268+0000","last_clean":"2023-12-19T19:00:50.688268+0000","last_became_active":"2023-12-19T19:00:49.708002+0000","last_became_peered":"2023-12-19T19:00:49.708002+0000","last_unstale":"2023-12-19T19:00:50.688268+0000","last_undegraded":"2023-12-19T19:00:50.688268+0000","last_fullsized":"2023-12-19T19:00:50.688268+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:47:42.192040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"53'4","reported_seq":16,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.688405+0000","last_change":"2023-12-19T19:00:48.694865+0000","last_active":"2023-12-19T19:00:50.688405+0000","last_peered":"2023-12-19T19:00:50.688405+0000","last_clean":"2023-12-19T19:00:50.688405+0000","last_became_active":"2023-12-19T19:00:48.694550+0000","last_became_peered":"2023-12-19T19:00:48.694550+0000","last_unstale":"2023-12-19T19:00:50.688405+0000","last_undegraded":"2023-12-19T19:00:50.688405+0000","last_fullsized":"2023-12-19T19:00:50.688405+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:12.983201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.696705+0000","last_change":"2023-12-19T19:00:32.012177+0000","last_active":"2023-12-19T19:00:48.696705+0000","last_peered":"2023-12-19T19:00:48.696705+0000","last_clean":"2023-12-19T19:00:48.696705+0000","last_became_active":"2023-12-19T19:00:32.009090+0000","last_became_peered":"2023-12-19T19:00:32.009090+0000","last_unstale":"2023-12-19T19:00:48.696705+0000","last_undegraded":"2023-12-19T19:00:48.696705+0000","last_fullsized":"2023-12-19T19:00:48.696705+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:12:29.382064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"49'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.696910+0000","last_change":"2023-12-19T19:00:30.989448+0000","last_active":"2023-12-19T19:00:48.696910+0000","last_peered":"2023-12-19T19:00:48.696910+0000","last_clean":"2023-12-19T19:00:48.696910+0000","last_became_active":"2023-12-19T19:00:30.989187+0000","last_became_peered":"2023-12-19T19:00:30.989187+0000","last_unstale":"2023-12-19T19:00:48.696910+0000","last_undegraded":"2023-12-19T19:00:48.696910+0000","last_fullsized":"2023-12-19T19:00:48.696910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:34:58.509471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.702339+0000","last_change":"2023-12-19T19:00:49.698570+0000","last_active":"2023-12-19T19:00:49.702339+0000","last_peered":"2023-12-19T19:00:49.702339+0000","last_clean":"2023-12-19T19:00:49.702339+0000","last_became_active":"2023-12-19T19:00:49.695758+0000","last_became_peered":"2023-12-19T19:00:49.695758+0000","last_unstale":"2023-12-19T19:00:49.702339+0000","last_undegraded":"2023-12-19T19:00:49.702339+0000","last_fullsized":"2023-12-19T19:00:49.702339+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:29:10.329325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.718950+0000","last_change":"2023-12-19T19:00:48.699905+0000","last_active":"2023-12-19T19:00:49.718950+0000","last_peered":"2023-12-19T19:00:49.718950+0000","last_clean":"2023-12-19T19:00:49.718950+0000","last_became_active":"2023-12-19T19:00:48.699564+0000","last_became_peered":"2023-12-19T19:00:48.699564+0000","last_unstale":"2023-12-19T19:00:49.718950+0000","last_undegraded":"2023-12-19T19:00:49.718950+0000","last_fullsized":"2023-12-19T19:00:49.718950+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:12.983201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.696487+0000","last_change":"2023-12-19T19:00:31.993032+0000","last_active":"2023-12-19T19:00:48.696487+0000","last_peered":"2023-12-19T19:00:48.696487+0000","last_clean":"2023-12-19T19:00:48.696487+0000","last_became_active":"2023-12-19T19:00:31.992397+0000","last_became_peered":"2023-12-19T19:00:31.992397+0000","last_unstale":"2023-12-19T19:00:48.696487+0000","last_undegraded":"2023-12-19T19:00:48.696487+0000","last_fullsized":"2023-12-19T19:00:48.696487+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:26:52.085902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.684455+0000","last_change":"2023-12-19T19:00:30.987551+0000","last_active":"2023-12-19T19:00:49.684455+0000","last_peered":"2023-12-19T19:00:49.684455+0000","last_clean":"2023-12-19T19:00:49.684455+0000","last_became_active":"2023-12-19T19:00:30.987118+0000","last_became_peered":"2023-12-19T19:00:30.987118+0000","last_unstale":"2023-12-19T19:00:49.684455+0000","last_undegraded":"2023-12-19T19:00:49.684455+0000","last_fullsized":"2023-12-19T19:00:49.684455+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:39:48.045336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.690140+0000","last_change":"2023-12-19T19:00:49.683919+0000","last_active":"2023-12-19T19:00:49.690140+0000","last_peered":"2023-12-19T19:00:49.690140+0000","last_clean":"2023-12-19T19:00:49.690140+0000","last_became_active":"2023-12-19T19:00:49.683643+0000","last_became_peered":"2023-12-19T19:00:49.683643+0000","last_unstale":"2023-12-19T19:00:49.690140+0000","last_undegraded":"2023-12-19T19:00:49.690140+0000","last_fullsized":"2023-12-19T19:00:49.690140+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:24:52.995090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686022+0000","last_change":"2023-12-19T19:00:48.686021+0000","last_active":"2023-12-19T19:00:50.686022+0000","last_peered":"2023-12-19T19:00:50.686022+0000","last_clean":"2023-12-19T19:00:50.686022+0000","last_became_active":"2023-12-19T19:00:48.685708+0000","last_became_peered":"2023-12-19T19:00:48.685708+0000","last_unstale":"2023-12-19T19:00:50.686022+0000","last_undegraded":"2023-12-19T19:00:50.686022+0000","last_fullsized":"2023-12-19T19:00:50.686022+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:33:27.498607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679572+0000","last_change":"2023-12-19T19:00:31.992097+0000","last_active":"2023-12-19T19:00:48.679572+0000","last_peered":"2023-12-19T19:00:48.679572+0000","last_clean":"2023-12-19T19:00:48.679572+0000","last_became_active":"2023-12-19T19:00:31.991760+0000","last_became_peered":"2023-12-19T19:00:31.991760+0000","last_unstale":"2023-12-19T19:00:48.679572+0000","last_undegraded":"2023-12-19T19:00:48.679572+0000","last_fullsized":"2023-12-19T19:00:48.679572+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:25:47.564222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"49'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679755+0000","last_change":"2023-12-19T19:00:30.993158+0000","last_active":"2023-12-19T19:00:48.679755+0000","last_peered":"2023-12-19T19:00:48.679755+0000","last_clean":"2023-12-19T19:00:48.679755+0000","last_became_active":"2023-12-19T19:00:30.992878+0000","last_became_peered":"2023-12-19T19:00:30.992878+0000","last_unstale":"2023-12-19T19:00:48.679755+0000","last_undegraded":"2023-12-19T19:00:48.679755+0000","last_fullsized":"2023-12-19T19:00:48.679755+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:15:13.218056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.691708+0000","last_change":"2023-12-19T19:00:49.685825+0000","last_active":"2023-12-19T19:00:49.691708+0000","last_peered":"2023-12-19T19:00:49.691708+0000","last_clean":"2023-12-19T19:00:49.691708+0000","last_became_active":"2023-12-19T19:00:49.685558+0000","last_became_peered":"2023-12-19T19:00:49.685558+0000","last_unstale":"2023-12-19T19:00:49.691708+0000","last_undegraded":"2023-12-19T19:00:49.691708+0000","last_fullsized":"2023-12-19T19:00:49.691708+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:25:33.897940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.680566+0000","last_change":"2023-12-19T19:00:48.688773+0000","last_active":"2023-12-19T19:00:49.680566+0000","last_peered":"2023-12-19T19:00:49.680566+0000","last_clean":"2023-12-19T19:00:49.680566+0000","last_became_active":"2023-12-19T19:00:48.688422+0000","last_became_peered":"2023-12-19T19:00:48.688422+0000","last_unstale":"2023-12-19T19:00:49.680566+0000","last_undegraded":"2023-12-19T19:00:49.680566+0000","last_fullsized":"2023-12-19T19:00:49.680566+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:50:55.590060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679712+0000","last_change":"2023-12-19T19:00:32.013474+0000","last_active":"2023-12-19T19:00:48.679712+0000","last_peered":"2023-12-19T19:00:48.679712+0000","last_clean":"2023-12-19T19:00:48.679712+0000","last_became_active":"2023-12-19T19:00:32.013185+0000","last_became_peered":"2023-12-19T19:00:32.013185+0000","last_unstale":"2023-12-19T19:00:48.679712+0000","last_undegraded":"2023-12-19T19:00:48.679712+0000","last_fullsized":"2023-12-19T19:00:48.679712+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:05.421482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"49'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.696133+0000","last_change":"2023-12-19T19:00:30.988798+0000","last_active":"2023-12-19T19:00:48.696133+0000","last_peered":"2023-12-19T19:00:48.696133+0000","last_clean":"2023-12-19T19:00:48.696133+0000","last_became_active":"2023-12-19T19:00:30.988493+0000","last_became_peered":"2023-12-19T19:00:30.988493+0000","last_unstale":"2023-12-19T19:00:48.696133+0000","last_undegraded":"2023-12-19T19:00:48.696133+0000","last_fullsized":"2023-12-19T19:00:48.696133+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:02.746664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686939+0000","last_change":"2023-12-19T19:00:49.693750+0000","last_active":"2023-12-19T19:00:50.686939+0000","last_peered":"2023-12-19T19:00:50.686939+0000","last_clean":"2023-12-19T19:00:50.686939+0000","last_became_active":"2023-12-19T19:00:49.693471+0000","last_became_peered":"2023-12-19T19:00:49.693471+0000","last_unstale":"2023-12-19T19:00:50.686939+0000","last_undegraded":"2023-12-19T19:00:50.686939+0000","last_fullsized":"2023-12-19T19:00:50.686939+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:37:30.318626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.722546+0000","last_change":"2023-12-19T19:00:48.687434+0000","last_active":"2023-12-19T19:00:49.722546+0000","last_peered":"2023-12-19T19:00:49.722546+0000","last_clean":"2023-12-19T19:00:49.722546+0000","last_became_active":"2023-12-19T19:00:48.687077+0000","last_became_peered":"2023-12-19T19:00:48.687077+0000","last_unstale":"2023-12-19T19:00:49.722546+0000","last_undegraded":"2023-12-19T19:00:49.722546+0000","last_fullsized":"2023-12-19T19:00:49.722546+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:30:42.842550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.692244+0000","last_change":"2023-12-19T19:00:31.998669+0000","last_active":"2023-12-19T19:00:48.692244+0000","last_peered":"2023-12-19T19:00:48.692244+0000","last_clean":"2023-12-19T19:00:48.692244+0000","last_became_active":"2023-12-19T19:00:31.997493+0000","last_became_peered":"2023-12-19T19:00:31.997493+0000","last_unstale":"2023-12-19T19:00:48.692244+0000","last_undegraded":"2023-12-19T19:00:48.692244+0000","last_fullsized":"2023-12-19T19:00:48.692244+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:28.740800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.682806+0000","last_change":"2023-12-19T19:00:30.987264+0000","last_active":"2023-12-19T19:00:49.682806+0000","last_peered":"2023-12-19T19:00:49.682806+0000","last_clean":"2023-12-19T19:00:49.682806+0000","last_became_active":"2023-12-19T19:00:30.986365+0000","last_became_peered":"2023-12-19T19:00:30.986365+0000","last_unstale":"2023-12-19T19:00:49.682806+0000","last_undegraded":"2023-12-19T19:00:49.682806+0000","last_fullsized":"2023-12-19T19:00:49.682806+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:14.427919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.695136+0000","last_change":"2023-12-19T19:00:49.691769+0000","last_active":"2023-12-19T19:00:49.695136+0000","last_peered":"2023-12-19T19:00:49.695136+0000","last_clean":"2023-12-19T19:00:49.695136+0000","last_became_active":"2023-12-19T19:00:49.691418+0000","last_became_peered":"2023-12-19T19:00:49.691418+0000","last_unstale":"2023-12-19T19:00:49.695136+0000","last_undegraded":"2023-12-19T19:00:49.695136+0000","last_fullsized":"2023-12-19T19:00:49.695136+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:48.631905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.719319+0000","last_change":"2023-12-19T19:00:48.703048+0000","last_active":"2023-12-19T19:00:49.719319+0000","last_peered":"2023-12-19T19:00:49.719319+0000","last_clean":"2023-12-19T19:00:49.719319+0000","last_became_active":"2023-12-19T19:00:48.702758+0000","last_became_peered":"2023-12-19T19:00:48.702758+0000","last_unstale":"2023-12-19T19:00:49.719319+0000","last_undegraded":"2023-12-19T19:00:49.719319+0000","last_fullsized":"2023-12-19T19:00:49.719319+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:53.539893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679531+0000","last_change":"2023-12-19T19:00:31.992961+0000","last_active":"2023-12-19T19:00:48.679531+0000","last_peered":"2023-12-19T19:00:48.679531+0000","last_clean":"2023-12-19T19:00:48.679531+0000","last_became_active":"2023-12-19T19:00:31.992515+0000","last_became_peered":"2023-12-19T19:00:31.992515+0000","last_unstale":"2023-12-19T19:00:48.679531+0000","last_undegraded":"2023-12-19T19:00:48.679531+0000","last_fullsized":"2023-12-19T19:00:48.679531+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:25:16.196549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.680877+0000","last_change":"2023-12-19T19:00:30.984169+0000","last_active":"2023-12-19T19:00:48.680877+0000","last_peered":"2023-12-19T19:00:48.680877+0000","last_clean":"2023-12-19T19:00:48.680877+0000","last_became_active":"2023-12-19T19:00:30.982847+0000","last_became_peered":"2023-12-19T19:00:30.982847+0000","last_unstale":"2023-12-19T19:00:48.680877+0000","last_undegraded":"2023-12-19T19:00:48.680877+0000","last_fullsized":"2023-12-19T19:00:48.680877+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:56:39.717560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.709056+0000","last_change":"2023-12-19T19:00:49.696138+0000","last_active":"2023-12-19T19:00:49.709056+0000","last_peered":"2023-12-19T19:00:49.709056+0000","last_clean":"2023-12-19T19:00:49.709056+0000","last_became_active":"2023-12-19T19:00:49.695777+0000","last_became_peered":"2023-12-19T19:00:49.695777+0000","last_unstale":"2023-12-19T19:00:49.709056+0000","last_undegraded":"2023-12-19T19:00:49.709056+0000","last_fullsized":"2023-12-19T19:00:49.709056+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:40:06.755083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"53'3","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.720902+0000","last_change":"2023-12-19T19:00:48.692918+0000","last_active":"2023-12-19T19:00:49.720902+0000","last_peered":"2023-12-19T19:00:49.720902+0000","last_clean":"2023-12-19T19:00:49.720902+0000","last_became_active":"2023-12-19T19:00:48.692629+0000","last_became_peered":"2023-12-19T19:00:48.692629+0000","last_unstale":"2023-12-19T19:00:49.720902+0000","last_undegraded":"2023-12-19T19:00:49.720902+0000","last_fullsized":"2023-12-19T19:00:49.720902+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:32:19.135099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.681390+0000","last_change":"2023-12-19T19:00:31.995512+0000","last_active":"2023-12-19T19:00:48.681390+0000","last_peered":"2023-12-19T19:00:48.681390+0000","last_clean":"2023-12-19T19:00:48.681390+0000","last_became_active":"2023-12-19T19:00:31.994458+0000","last_became_peered":"2023-12-19T19:00:31.994458+0000","last_unstale":"2023-12-19T19:00:48.681390+0000","last_undegraded":"2023-12-19T19:00:48.681390+0000","last_fullsized":"2023-12-19T19:00:48.681390+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:33:10.803785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.678706+0000","last_change":"2023-12-19T19:00:30.992474+0000","last_active":"2023-12-19T19:00:49.678706+0000","last_peered":"2023-12-19T19:00:49.678706+0000","last_clean":"2023-12-19T19:00:49.678706+0000","last_became_active":"2023-12-19T19:00:30.992125+0000","last_became_peered":"2023-12-19T19:00:30.992125+0000","last_unstale":"2023-12-19T19:00:49.678706+0000","last_undegraded":"2023-12-19T19:00:49.678706+0000","last_fullsized":"2023-12-19T19:00:49.678706+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:53:26.259403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.694770+0000","last_change":"2023-12-19T19:00:49.689929+0000","last_active":"2023-12-19T19:00:49.694770+0000","last_peered":"2023-12-19T19:00:49.694770+0000","last_clean":"2023-12-19T19:00:49.694770+0000","last_became_active":"2023-12-19T19:00:49.689624+0000","last_became_peered":"2023-12-19T19:00:49.689624+0000","last_unstale":"2023-12-19T19:00:49.694770+0000","last_undegraded":"2023-12-19T19:00:49.694770+0000","last_fullsized":"2023-12-19T19:00:49.694770+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:06.103802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"53'6","reported_seq":18,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686667+0000","last_change":"2023-12-19T19:00:48.685932+0000","last_active":"2023-12-19T19:00:50.686667+0000","last_peered":"2023-12-19T19:00:50.686667+0000","last_clean":"2023-12-19T19:00:50.686667+0000","last_became_active":"2023-12-19T19:00:48.685445+0000","last_became_peered":"2023-12-19T19:00:48.685445+0000","last_unstale":"2023-12-19T19:00:50.686667+0000","last_undegraded":"2023-12-19T19:00:50.686667+0000","last_fullsized":"2023-12-19T19:00:50.686667+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:39:53.803952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.678589+0000","last_change":"2023-12-19T19:00:31.999958+0000","last_active":"2023-12-19T19:00:49.678589+0000","last_peered":"2023-12-19T19:00:49.678589+0000","last_clean":"2023-12-19T19:00:49.678589+0000","last_became_active":"2023-12-19T19:00:31.999674+0000","last_became_peered":"2023-12-19T19:00:31.999674+0000","last_unstale":"2023-12-19T19:00:49.678589+0000","last_undegraded":"2023-12-19T19:00:49.678589+0000","last_fullsized":"2023-12-19T19:00:49.678589+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:40.147962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.680051+0000","last_change":"2023-12-19T19:00:30.992655+0000","last_active":"2023-12-19T19:00:48.680051+0000","last_peered":"2023-12-19T19:00:48.680051+0000","last_clean":"2023-12-19T19:00:48.680051+0000","last_became_active":"2023-12-19T19:00:30.992388+0000","last_became_peered":"2023-12-19T19:00:30.992388+0000","last_unstale":"2023-12-19T19:00:48.680051+0000","last_undegraded":"2023-12-19T19:00:48.680051+0000","last_fullsized":"2023-12-19T19:00:48.680051+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:29:24.264763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.687506+0000","last_change":"2023-12-19T19:00:49.702369+0000","last_active":"2023-12-19T19:00:50.687506+0000","last_peered":"2023-12-19T19:00:50.687506+0000","last_clean":"2023-12-19T19:00:50.687506+0000","last_became_active":"2023-12-19T19:00:49.701432+0000","last_became_peered":"2023-12-19T19:00:49.701432+0000","last_unstale":"2023-12-19T19:00:50.687506+0000","last_undegraded":"2023-12-19T19:00:50.687506+0000","last_fullsized":"2023-12-19T19:00:50.687506+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:49:53.095935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.692954+0000","last_change":"2023-12-19T19:00:48.685838+0000","last_active":"2023-12-19T19:00:49.692954+0000","last_peered":"2023-12-19T19:00:49.692954+0000","last_clean":"2023-12-19T19:00:49.692954+0000","last_became_active":"2023-12-19T19:00:48.685520+0000","last_became_peered":"2023-12-19T19:00:48.685520+0000","last_unstale":"2023-12-19T19:00:49.692954+0000","last_undegraded":"2023-12-19T19:00:49.692954+0000","last_fullsized":"2023-12-19T19:00:49.692954+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:29:41.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.674865+0000","last_change":"2023-12-19T19:00:31.999476+0000","last_active":"2023-12-19T19:00:49.674865+0000","last_peered":"2023-12-19T19:00:49.674865+0000","last_clean":"2023-12-19T19:00:49.674865+0000","last_became_active":"2023-12-19T19:00:31.998991+0000","last_became_peered":"2023-12-19T19:00:31.998991+0000","last_unstale":"2023-12-19T19:00:49.674865+0000","last_undegraded":"2023-12-19T19:00:49.674865+0000","last_fullsized":"2023-12-19T19:00:49.674865+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:50:25.706371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"49'3","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.679311+0000","last_change":"2023-12-19T19:00:30.986780+0000","last_active":"2023-12-19T19:00:49.679311+0000","last_peered":"2023-12-19T19:00:49.679311+0000","last_clean":"2023-12-19T19:00:49.679311+0000","last_became_active":"2023-12-19T19:00:30.986477+0000","last_became_peered":"2023-12-19T19:00:30.986477+0000","last_unstale":"2023-12-19T19:00:49.679311+0000","last_undegraded":"2023-12-19T19:00:49.679311+0000","last_fullsized":"2023-12-19T19:00:49.679311+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:40:24.990216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.688316+0000","last_change":"2023-12-19T19:00:49.704508+0000","last_active":"2023-12-19T19:00:50.688316+0000","last_peered":"2023-12-19T19:00:50.688316+0000","last_clean":"2023-12-19T19:00:50.688316+0000","last_became_active":"2023-12-19T19:00:49.704231+0000","last_became_peered":"2023-12-19T19:00:49.704231+0000","last_unstale":"2023-12-19T19:00:50.688316+0000","last_undegraded":"2023-12-19T19:00:50.688316+0000","last_fullsized":"2023-12-19T19:00:50.688316+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:44:44.303299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.700201+0000","last_change":"2023-12-19T19:00:48.697401+0000","last_active":"2023-12-19T19:00:49.700201+0000","last_peered":"2023-12-19T19:00:49.700201+0000","last_clean":"2023-12-19T19:00:49.700201+0000","last_became_active":"2023-12-19T19:00:48.697020+0000","last_became_peered":"2023-12-19T19:00:48.697020+0000","last_unstale":"2023-12-19T19:00:49.700201+0000","last_undegraded":"2023-12-19T19:00:49.700201+0000","last_fullsized":"2023-12-19T19:00:49.700201+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:22:20.444135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.679105+0000","last_change":"2023-12-19T19:00:32.000825+0000","last_active":"2023-12-19T19:00:49.679105+0000","last_peered":"2023-12-19T19:00:49.679105+0000","last_clean":"2023-12-19T19:00:49.679105+0000","last_became_active":"2023-12-19T19:00:32.000565+0000","last_became_peered":"2023-12-19T19:00:32.000565+0000","last_unstale":"2023-12-19T19:00:49.679105+0000","last_undegraded":"2023-12-19T19:00:49.679105+0000","last_fullsized":"2023-12-19T19:00:49.679105+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:22:03.749312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'9","reported_seq":24,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.680509+0000","last_change":"2023-12-19T19:00:30.990334+0000","last_active":"2023-12-19T19:00:48.680509+0000","last_peered":"2023-12-19T19:00:48.680509+0000","last_clean":"2023-12-19T19:00:48.680509+0000","last_became_active":"2023-12-19T19:00:30.989993+0000","last_became_peered":"2023-12-19T19:00:30.989993+0000","last_unstale":"2023-12-19T19:00:48.680509+0000","last_undegraded":"2023-12-19T19:00:48.680509+0000","last_fullsized":"2023-12-19T19:00:48.680509+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:04:27.417357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.711720+0000","last_change":"2023-12-19T19:00:49.710541+0000","last_active":"2023-12-19T19:00:49.711720+0000","last_peered":"2023-12-19T19:00:49.711720+0000","last_clean":"2023-12-19T19:00:49.711720+0000","last_became_active":"2023-12-19T19:00:49.710281+0000","last_became_peered":"2023-12-19T19:00:49.710281+0000","last_unstale":"2023-12-19T19:00:49.711720+0000","last_undegraded":"2023-12-19T19:00:49.711720+0000","last_fullsized":"2023-12-19T19:00:49.711720+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:26:05.265613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.687037+0000","last_change":"2023-12-19T19:00:48.696405+0000","last_active":"2023-12-19T19:00:50.687037+0000","last_peered":"2023-12-19T19:00:50.687037+0000","last_clean":"2023-12-19T19:00:50.687037+0000","last_became_active":"2023-12-19T19:00:48.695230+0000","last_became_peered":"2023-12-19T19:00:48.695230+0000","last_unstale":"2023-12-19T19:00:50.687037+0000","last_undegraded":"2023-12-19T19:00:50.687037+0000","last_fullsized":"2023-12-19T19:00:50.687037+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:26:04.259045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.683036+0000","last_change":"2023-12-19T19:00:32.011251+0000","last_active":"2023-12-19T19:00:49.683036+0000","last_peered":"2023-12-19T19:00:49.683036+0000","last_clean":"2023-12-19T19:00:49.683036+0000","last_became_active":"2023-12-19T19:00:32.010982+0000","last_became_peered":"2023-12-19T19:00:32.010982+0000","last_unstale":"2023-12-19T19:00:49.683036+0000","last_undegraded":"2023-12-19T19:00:49.683036+0000","last_fullsized":"2023-12-19T19:00:49.683036+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:34:59.517827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"49'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679862+0000","last_change":"2023-12-19T19:00:30.993444+0000","last_active":"2023-12-19T19:00:48.679862+0000","last_peered":"2023-12-19T19:00:48.679862+0000","last_clean":"2023-12-19T19:00:48.679862+0000","last_became_active":"2023-12-19T19:00:30.993163+0000","last_became_peered":"2023-12-19T19:00:30.993163+0000","last_unstale":"2023-12-19T19:00:48.679862+0000","last_undegraded":"2023-12-19T19:00:48.679862+0000","last_fullsized":"2023-12-19T19:00:48.679862+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:11.467052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.690758+0000","last_change":"2023-12-19T19:00:49.688841+0000","last_active":"2023-12-19T19:00:49.690758+0000","last_peered":"2023-12-19T19:00:49.690758+0000","last_clean":"2023-12-19T19:00:49.690758+0000","last_became_active":"2023-12-19T19:00:49.688562+0000","last_became_peered":"2023-12-19T19:00:49.688562+0000","last_unstale":"2023-12-19T19:00:49.690758+0000","last_undegraded":"2023-12-19T19:00:49.690758+0000","last_fullsized":"2023-12-19T19:00:49.690758+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:06:25.347465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"53'8","reported_seq":19,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.723513+0000","last_change":"2023-12-19T19:00:48.689236+0000","last_active":"2023-12-19T19:00:49.723513+0000","last_peered":"2023-12-19T19:00:49.723513+0000","last_clean":"2023-12-19T19:00:49.723513+0000","last_became_active":"2023-12-19T19:00:48.688907+0000","last_became_peered":"2023-12-19T19:00:48.688907+0000","last_unstale":"2023-12-19T19:00:49.723513+0000","last_undegraded":"2023-12-19T19:00:49.723513+0000","last_fullsized":"2023-12-19T19:00:49.723513+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:29.170230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.677345+0000","last_change":"2023-12-19T19:00:31.990491+0000","last_active":"2023-12-19T19:00:49.677345+0000","last_peered":"2023-12-19T19:00:49.677345+0000","last_clean":"2023-12-19T19:00:49.677345+0000","last_became_active":"2023-12-19T19:00:31.990211+0000","last_became_peered":"2023-12-19T19:00:31.990211+0000","last_unstale":"2023-12-19T19:00:49.677345+0000","last_undegraded":"2023-12-19T19:00:49.677345+0000","last_fullsized":"2023-12-19T19:00:49.677345+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:30.930514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.692806+0000","last_change":"2023-12-19T19:00:30.982775+0000","last_active":"2023-12-19T19:00:48.692806+0000","last_peered":"2023-12-19T19:00:48.692806+0000","last_clean":"2023-12-19T19:00:48.692806+0000","last_became_active":"2023-12-19T19:00:30.982471+0000","last_became_peered":"2023-12-19T19:00:30.982471+0000","last_unstale":"2023-12-19T19:00:48.692806+0000","last_undegraded":"2023-12-19T19:00:48.692806+0000","last_fullsized":"2023-12-19T19:00:48.692806+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:55:52.355420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686998+0000","last_change":"2023-12-19T19:00:49.690530+0000","last_active":"2023-12-19T19:00:50.686998+0000","last_peered":"2023-12-19T19:00:50.686998+0000","last_clean":"2023-12-19T19:00:50.686998+0000","last_became_active":"2023-12-19T19:00:49.690037+0000","last_became_peered":"2023-12-19T19:00:49.690037+0000","last_unstale":"2023-12-19T19:00:50.686998+0000","last_undegraded":"2023-12-19T19:00:50.686998+0000","last_fullsized":"2023-12-19T19:00:50.686998+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:33:53.071370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"53'2","reported_seq":14,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686363+0000","last_change":"2023-12-19T19:00:48.684086+0000","last_active":"2023-12-19T19:00:50.686363+0000","last_peered":"2023-12-19T19:00:50.686363+0000","last_clean":"2023-12-19T19:00:50.686363+0000","last_became_active":"2023-12-19T19:00:48.683767+0000","last_became_peered":"2023-12-19T19:00:48.683767+0000","last_unstale":"2023-12-19T19:00:50.686363+0000","last_undegraded":"2023-12-19T19:00:50.686363+0000","last_fullsized":"2023-12-19T19:00:50.686363+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:40:42.693394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.680789+0000","last_change":"2023-12-19T19:00:31.990882+0000","last_active":"2023-12-19T19:00:48.680789+0000","last_peered":"2023-12-19T19:00:48.680789+0000","last_clean":"2023-12-19T19:00:48.680789+0000","last_became_active":"2023-12-19T19:00:31.990571+0000","last_became_peered":"2023-12-19T19:00:31.990571+0000","last_unstale":"2023-12-19T19:00:48.680789+0000","last_undegraded":"2023-12-19T19:00:48.680789+0000","last_fullsized":"2023-12-19T19:00:48.680789+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:21:56.040888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.682901+0000","last_change":"2023-12-19T19:00:30.987616+0000","last_active":"2023-12-19T19:00:49.682901+0000","last_peered":"2023-12-19T19:00:49.682901+0000","last_clean":"2023-12-19T19:00:49.682901+0000","last_became_active":"2023-12-19T19:00:30.987300+0000","last_became_peered":"2023-12-19T19:00:30.987300+0000","last_unstale":"2023-12-19T19:00:49.682901+0000","last_undegraded":"2023-12-19T19:00:49.682901+0000","last_fullsized":"2023-12-19T19:00:49.682901+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:30.598024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.687361+0000","last_change":"2023-12-19T19:00:49.691367+0000","last_active":"2023-12-19T19:00:50.687361+0000","last_peered":"2023-12-19T19:00:50.687361+0000","last_clean":"2023-12-19T19:00:50.687361+0000","last_became_active":"2023-12-19T19:00:49.690887+0000","last_became_peered":"2023-12-19T19:00:49.690887+0000","last_unstale":"2023-12-19T19:00:50.687361+0000","last_undegraded":"2023-12-19T19:00:50.687361+0000","last_fullsized":"2023-12-19T19:00:50.687361+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:13.989770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.699046+0000","last_change":"2023-12-19T19:00:48.698784+0000","last_active":"2023-12-19T19:00:49.699046+0000","last_peered":"2023-12-19T19:00:49.699046+0000","last_clean":"2023-12-19T19:00:49.699046+0000","last_became_active":"2023-12-19T19:00:48.698506+0000","last_became_peered":"2023-12-19T19:00:48.698506+0000","last_unstale":"2023-12-19T19:00:49.699046+0000","last_undegraded":"2023-12-19T19:00:49.699046+0000","last_fullsized":"2023-12-19T19:00:49.699046+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:47.625337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.676335+0000","last_change":"2023-12-19T19:00:31.986177+0000","last_active":"2023-12-19T19:00:49.676335+0000","last_peered":"2023-12-19T19:00:49.676335+0000","last_clean":"2023-12-19T19:00:49.676335+0000","last_became_active":"2023-12-19T19:00:31.985896+0000","last_became_peered":"2023-12-19T19:00:31.985896+0000","last_unstale":"2023-12-19T19:00:49.676335+0000","last_undegraded":"2023-12-19T19:00:49.676335+0000","last_fullsized":"2023-12-19T19:00:49.676335+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:36.845071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"49'8","reported_seq":24,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.675722+0000","last_change":"2023-12-19T19:00:30.990218+0000","last_active":"2023-12-19T19:00:49.675722+0000","last_peered":"2023-12-19T19:00:49.675722+0000","last_clean":"2023-12-19T19:00:49.675722+0000","last_became_active":"2023-12-19T19:00:30.989907+0000","last_became_peered":"2023-12-19T19:00:30.989907+0000","last_unstale":"2023-12-19T19:00:49.675722+0000","last_undegraded":"2023-12-19T19:00:49.675722+0000","last_fullsized":"2023-12-19T19:00:49.675722+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:32:52.108796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686644+0000","last_change":"2023-12-19T19:00:49.688589+0000","last_active":"2023-12-19T19:00:50.686644+0000","last_peered":"2023-12-19T19:00:50.686644+0000","last_clean":"2023-12-19T19:00:50.686644+0000","last_became_active":"2023-12-19T19:00:49.688316+0000","last_became_peered":"2023-12-19T19:00:49.688316+0000","last_unstale":"2023-12-19T19:00:50.686644+0000","last_undegraded":"2023-12-19T19:00:50.686644+0000","last_fullsized":"2023-12-19T19:00:50.686644+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:54.546461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.720383+0000","last_change":"2023-12-19T19:00:48.698936+0000","last_active":"2023-12-19T19:00:49.720383+0000","last_peered":"2023-12-19T19:00:49.720383+0000","last_clean":"2023-12-19T19:00:49.720383+0000","last_became_active":"2023-12-19T19:00:48.698635+0000","last_became_peered":"2023-12-19T19:00:48.698635+0000","last_unstale":"2023-12-19T19:00:49.720383+0000","last_undegraded":"2023-12-19T19:00:49.720383+0000","last_fullsized":"2023-12-19T19:00:49.720383+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:27:08.780724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.677409+0000","last_change":"2023-12-19T19:00:31.996849+0000","last_active":"2023-12-19T19:00:49.677409+0000","last_peered":"2023-12-19T19:00:49.677409+0000","last_clean":"2023-12-19T19:00:49.677409+0000","last_became_active":"2023-12-19T19:00:31.996575+0000","last_became_peered":"2023-12-19T19:00:31.996575+0000","last_unstale":"2023-12-19T19:00:49.677409+0000","last_undegraded":"2023-12-19T19:00:49.677409+0000","last_fullsized":"2023-12-19T19:00:49.677409+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:26:52.085902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"49'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.681401+0000","last_change":"2023-12-19T19:00:30.991150+0000","last_active":"2023-12-19T19:00:48.681401+0000","last_peered":"2023-12-19T19:00:48.681401+0000","last_clean":"2023-12-19T19:00:48.681401+0000","last_became_active":"2023-12-19T19:00:30.990867+0000","last_became_peered":"2023-12-19T19:00:30.990867+0000","last_unstale":"2023-12-19T19:00:48.681401+0000","last_undegraded":"2023-12-19T19:00:48.681401+0000","last_fullsized":"2023-12-19T19:00:48.681401+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:32.181776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.700252+0000","last_change":"2023-12-19T19:00:49.695365+0000","last_active":"2023-12-19T19:00:49.700252+0000","last_peered":"2023-12-19T19:00:49.700252+0000","last_clean":"2023-12-19T19:00:49.700252+0000","last_became_active":"2023-12-19T19:00:49.695102+0000","last_became_peered":"2023-12-19T19:00:49.695102+0000","last_unstale":"2023-12-19T19:00:49.700252+0000","last_undegraded":"2023-12-19T19:00:49.700252+0000","last_fullsized":"2023-12-19T19:00:49.700252+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:38:53.288959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.688117+0000","last_change":"2023-12-19T19:00:48.697714+0000","last_active":"2023-12-19T19:00:50.688117+0000","last_peered":"2023-12-19T19:00:50.688117+0000","last_clean":"2023-12-19T19:00:50.688117+0000","last_became_active":"2023-12-19T19:00:48.696871+0000","last_became_peered":"2023-12-19T19:00:48.696871+0000","last_unstale":"2023-12-19T19:00:50.688117+0000","last_undegraded":"2023-12-19T19:00:50.688117+0000","last_fullsized":"2023-12-19T19:00:50.688117+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:05:59.302537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.684695+0000","last_change":"2023-12-19T19:00:32.012118+0000","last_active":"2023-12-19T19:00:49.684695+0000","last_peered":"2023-12-19T19:00:49.684695+0000","last_clean":"2023-12-19T19:00:49.684695+0000","last_became_active":"2023-12-19T19:00:32.011853+0000","last_became_peered":"2023-12-19T19:00:32.011853+0000","last_unstale":"2023-12-19T19:00:49.684695+0000","last_undegraded":"2023-12-19T19:00:49.684695+0000","last_fullsized":"2023-12-19T19:00:49.684695+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:29.762134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"49'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.697211+0000","last_change":"2023-12-19T19:00:30.990317+0000","last_active":"2023-12-19T19:00:48.697211+0000","last_peered":"2023-12-19T19:00:48.697211+0000","last_clean":"2023-12-19T19:00:48.697211+0000","last_became_active":"2023-12-19T19:00:30.990062+0000","last_became_peered":"2023-12-19T19:00:30.990062+0000","last_unstale":"2023-12-19T19:00:48.697211+0000","last_undegraded":"2023-12-19T19:00:48.697211+0000","last_fullsized":"2023-12-19T19:00:48.697211+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:35.938744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.694474+0000","last_change":"2023-12-19T19:00:49.687903+0000","last_active":"2023-12-19T19:00:49.694474+0000","last_peered":"2023-12-19T19:00:49.694474+0000","last_clean":"2023-12-19T19:00:49.694474+0000","last_became_active":"2023-12-19T19:00:49.687589+0000","last_became_peered":"2023-12-19T19:00:49.687589+0000","last_unstale":"2023-12-19T19:00:49.694474+0000","last_undegraded":"2023-12-19T19:00:49.694474+0000","last_fullsized":"2023-12-19T19:00:49.694474+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:12:47.083455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"53'1","reported_seq":12,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.721198+0000","last_change":"2023-12-19T19:00:48.701514+0000","last_active":"2023-12-19T19:00:49.721198+0000","last_peered":"2023-12-19T19:00:49.721198+0000","last_clean":"2023-12-19T19:00:49.721198+0000","last_became_active":"2023-12-19T19:00:48.701201+0000","last_became_peered":"2023-12-19T19:00:48.701201+0000","last_unstale":"2023-12-19T19:00:49.721198+0000","last_undegraded":"2023-12-19T19:00:49.721198+0000","last_fullsized":"2023-12-19T19:00:49.721198+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:10:59.372150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679696+0000","last_change":"2023-12-19T19:00:31.995086+0000","last_active":"2023-12-19T19:00:48.679696+0000","last_peered":"2023-12-19T19:00:48.679696+0000","last_clean":"2023-12-19T19:00:48.679696+0000","last_became_active":"2023-12-19T19:00:31.993887+0000","last_became_peered":"2023-12-19T19:00:31.993887+0000","last_unstale":"2023-12-19T19:00:48.679696+0000","last_undegraded":"2023-12-19T19:00:48.679696+0000","last_fullsized":"2023-12-19T19:00:48.679696+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:36:00.677744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"49'1","reported_seq":17,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.681864+0000","last_change":"2023-12-19T19:00:30.987882+0000","last_active":"2023-12-19T19:00:49.681864+0000","last_peered":"2023-12-19T19:00:49.681864+0000","last_clean":"2023-12-19T19:00:49.681864+0000","last_became_active":"2023-12-19T19:00:30.987654+0000","last_became_peered":"2023-12-19T19:00:30.987654+0000","last_unstale":"2023-12-19T19:00:49.681864+0000","last_undegraded":"2023-12-19T19:00:49.681864+0000","last_fullsized":"2023-12-19T19:00:49.681864+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:40:24.990216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.688614+0000","last_change":"2023-12-19T19:00:49.693197+0000","last_active":"2023-12-19T19:00:50.688614+0000","last_peered":"2023-12-19T19:00:50.688614+0000","last_clean":"2023-12-19T19:00:50.688614+0000","last_became_active":"2023-12-19T19:00:49.692888+0000","last_became_peered":"2023-12-19T19:00:49.692888+0000","last_unstale":"2023-12-19T19:00:50.688614+0000","last_undegraded":"2023-12-19T19:00:50.688614+0000","last_fullsized":"2023-12-19T19:00:50.688614+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:25.823608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.722614+0000","last_change":"2023-12-19T19:00:48.699056+0000","last_active":"2023-12-19T19:00:49.722614+0000","last_peered":"2023-12-19T19:00:49.722614+0000","last_clean":"2023-12-19T19:00:49.722614+0000","last_became_active":"2023-12-19T19:00:48.698759+0000","last_became_peered":"2023-12-19T19:00:48.698759+0000","last_unstale":"2023-12-19T19:00:49.722614+0000","last_undegraded":"2023-12-19T19:00:49.722614+0000","last_fullsized":"2023-12-19T19:00:49.722614+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:40.114097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.679197+0000","last_change":"2023-12-19T19:00:32.002709+0000","last_active":"2023-12-19T19:00:49.679197+0000","last_peered":"2023-12-19T19:00:49.679197+0000","last_clean":"2023-12-19T19:00:49.679197+0000","last_became_active":"2023-12-19T19:00:32.002313+0000","last_became_peered":"2023-12-19T19:00:32.002313+0000","last_unstale":"2023-12-19T19:00:49.679197+0000","last_undegraded":"2023-12-19T19:00:49.679197+0000","last_fullsized":"2023-12-19T19:00:49.679197+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:10:42.677327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.696817+0000","last_change":"2023-12-19T19:00:30.989148+0000","last_active":"2023-12-19T19:00:48.696817+0000","last_peered":"2023-12-19T19:00:48.696817+0000","last_clean":"2023-12-19T19:00:48.696817+0000","last_became_active":"2023-12-19T19:00:30.988771+0000","last_became_peered":"2023-12-19T19:00:30.988771+0000","last_unstale":"2023-12-19T19:00:48.696817+0000","last_undegraded":"2023-12-19T19:00:48.696817+0000","last_fullsized":"2023-12-19T19:00:48.696817+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:40:24.990216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.711217+0000","last_change":"2023-12-19T19:00:49.709761+0000","last_active":"2023-12-19T19:00:49.711217+0000","last_peered":"2023-12-19T19:00:49.711217+0000","last_clean":"2023-12-19T19:00:49.711217+0000","last_became_active":"2023-12-19T19:00:49.709451+0000","last_became_peered":"2023-12-19T19:00:49.709451+0000","last_unstale":"2023-12-19T19:00:49.711217+0000","last_undegraded":"2023-12-19T19:00:49.711217+0000","last_fullsized":"2023-12-19T19:00:49.711217+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:55:25.865584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686897+0000","last_change":"2023-12-19T19:00:48.690235+0000","last_active":"2023-12-19T19:00:50.686897+0000","last_peered":"2023-12-19T19:00:50.686897+0000","last_clean":"2023-12-19T19:00:50.686897+0000","last_became_active":"2023-12-19T19:00:48.689942+0000","last_became_peered":"2023-12-19T19:00:48.689942+0000","last_unstale":"2023-12-19T19:00:50.686897+0000","last_undegraded":"2023-12-19T19:00:50.686897+0000","last_fullsized":"2023-12-19T19:00:50.686897+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:52:53.042665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.683129+0000","last_change":"2023-12-19T19:00:32.011171+0000","last_active":"2023-12-19T19:00:49.683129+0000","last_peered":"2023-12-19T19:00:49.683129+0000","last_clean":"2023-12-19T19:00:49.683129+0000","last_became_active":"2023-12-19T19:00:32.010974+0000","last_became_peered":"2023-12-19T19:00:32.010974+0000","last_unstale":"2023-12-19T19:00:49.683129+0000","last_undegraded":"2023-12-19T19:00:49.683129+0000","last_fullsized":"2023-12-19T19:00:49.683129+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:39:37.109129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"49'2","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679958+0000","last_change":"2023-12-19T19:00:30.982999+0000","last_active":"2023-12-19T19:00:48.679958+0000","last_peered":"2023-12-19T19:00:48.679958+0000","last_clean":"2023-12-19T19:00:48.679958+0000","last_became_active":"2023-12-19T19:00:30.982708+0000","last_became_peered":"2023-12-19T19:00:30.982708+0000","last_unstale":"2023-12-19T19:00:48.679958+0000","last_undegraded":"2023-12-19T19:00:48.679958+0000","last_fullsized":"2023-12-19T19:00:48.679958+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:09:34.416071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.708781+0000","last_change":"2023-12-19T19:00:49.707234+0000","last_active":"2023-12-19T19:00:49.708781+0000","last_peered":"2023-12-19T19:00:49.708781+0000","last_clean":"2023-12-19T19:00:49.708781+0000","last_became_active":"2023-12-19T19:00:49.706928+0000","last_became_peered":"2023-12-19T19:00:49.706928+0000","last_unstale":"2023-12-19T19:00:49.708781+0000","last_undegraded":"2023-12-19T19:00:49.708781+0000","last_fullsized":"2023-12-19T19:00:49.708781+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:47:42.192040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.680133+0000","last_change":"2023-12-19T19:00:48.702209+0000","last_active":"2023-12-19T19:00:49.680133+0000","last_peered":"2023-12-19T19:00:49.680133+0000","last_clean":"2023-12-19T19:00:49.680133+0000","last_became_active":"2023-12-19T19:00:48.701937+0000","last_became_peered":"2023-12-19T19:00:48.701937+0000","last_unstale":"2023-12-19T19:00:49.680133+0000","last_undegraded":"2023-12-19T19:00:49.680133+0000","last_fullsized":"2023-12-19T19:00:49.680133+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:37:29.312058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.697698+0000","last_change":"2023-12-19T19:00:32.001553+0000","last_active":"2023-12-19T19:00:48.697698+0000","last_peered":"2023-12-19T19:00:48.697698+0000","last_clean":"2023-12-19T19:00:48.697698+0000","last_became_active":"2023-12-19T19:00:32.001282+0000","last_became_peered":"2023-12-19T19:00:32.001282+0000","last_unstale":"2023-12-19T19:00:48.697698+0000","last_undegraded":"2023-12-19T19:00:48.697698+0000","last_fullsized":"2023-12-19T19:00:48.697698+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:10:42.677327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.673392+0000","last_change":"2023-12-19T19:00:30.991975+0000","last_active":"2023-12-19T19:00:49.673392+0000","last_peered":"2023-12-19T19:00:49.673392+0000","last_clean":"2023-12-19T19:00:49.673392+0000","last_became_active":"2023-12-19T19:00:30.991624+0000","last_became_peered":"2023-12-19T19:00:30.991624+0000","last_unstale":"2023-12-19T19:00:49.673392+0000","last_undegraded":"2023-12-19T19:00:49.673392+0000","last_fullsized":"2023-12-19T19:00:49.673392+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:56:48.812653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.698572+0000","last_change":"2023-12-19T19:00:49.691020+0000","last_active":"2023-12-19T19:00:49.698572+0000","last_peered":"2023-12-19T19:00:49.698572+0000","last_clean":"2023-12-19T19:00:49.698572+0000","last_became_active":"2023-12-19T19:00:49.690742+0000","last_became_peered":"2023-12-19T19:00:49.690742+0000","last_unstale":"2023-12-19T19:00:49.698572+0000","last_undegraded":"2023-12-19T19:00:49.698572+0000","last_fullsized":"2023-12-19T19:00:49.698572+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:21:46.996407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.700882+0000","last_change":"2023-12-19T19:00:48.697757+0000","last_active":"2023-12-19T19:00:49.700882+0000","last_peered":"2023-12-19T19:00:49.700882+0000","last_clean":"2023-12-19T19:00:49.700882+0000","last_became_active":"2023-12-19T19:00:48.697471+0000","last_became_peered":"2023-12-19T19:00:48.697471+0000","last_unstale":"2023-12-19T19:00:49.700882+0000","last_undegraded":"2023-12-19T19:00:49.700882+0000","last_fullsized":"2023-12-19T19:00:49.700882+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:56.842784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.695132+0000","last_change":"2023-12-19T19:00:31.993747+0000","last_active":"2023-12-19T19:00:48.695132+0000","last_peered":"2023-12-19T19:00:48.695132+0000","last_clean":"2023-12-19T19:00:48.695132+0000","last_became_active":"2023-12-19T19:00:31.993287+0000","last_became_peered":"2023-12-19T19:00:31.993287+0000","last_unstale":"2023-12-19T19:00:48.695132+0000","last_undegraded":"2023-12-19T19:00:48.695132+0000","last_fullsized":"2023-12-19T19:00:48.695132+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:36.845071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.680996+0000","last_change":"2023-12-19T19:00:30.992699+0000","last_active":"2023-12-19T19:00:49.680996+0000","last_peered":"2023-12-19T19:00:49.680996+0000","last_clean":"2023-12-19T19:00:49.680996+0000","last_became_active":"2023-12-19T19:00:30.992392+0000","last_became_peered":"2023-12-19T19:00:30.992392+0000","last_unstale":"2023-12-19T19:00:49.680996+0000","last_undegraded":"2023-12-19T19:00:49.680996+0000","last_fullsized":"2023-12-19T19:00:49.680996+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:02.746664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.688105+0000","last_change":"2023-12-19T19:00:49.708638+0000","last_active":"2023-12-19T19:00:50.688105+0000","last_peered":"2023-12-19T19:00:50.688105+0000","last_clean":"2023-12-19T19:00:50.688105+0000","last_became_active":"2023-12-19T19:00:49.708357+0000","last_became_peered":"2023-12-19T19:00:49.708357+0000","last_unstale":"2023-12-19T19:00:50.688105+0000","last_undegraded":"2023-12-19T19:00:50.688105+0000","last_fullsized":"2023-12-19T19:00:50.688105+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:32:45.876313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.682852+0000","last_change":"2023-12-19T19:00:48.702622+0000","last_active":"2023-12-19T19:00:49.682852+0000","last_peered":"2023-12-19T19:00:49.682852+0000","last_clean":"2023-12-19T19:00:49.682852+0000","last_became_active":"2023-12-19T19:00:48.702303+0000","last_became_peered":"2023-12-19T19:00:48.702303+0000","last_unstale":"2023-12-19T19:00:49.682852+0000","last_undegraded":"2023-12-19T19:00:49.682852+0000","last_fullsized":"2023-12-19T19:00:49.682852+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:10:19.062588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.683149+0000","last_change":"2023-12-19T19:00:31.991312+0000","last_active":"2023-12-19T19:00:49.683149+0000","last_peered":"2023-12-19T19:00:49.683149+0000","last_clean":"2023-12-19T19:00:49.683149+0000","last_became_active":"2023-12-19T19:00:31.991010+0000","last_became_peered":"2023-12-19T19:00:31.991010+0000","last_unstale":"2023-12-19T19:00:49.683149+0000","last_undegraded":"2023-12-19T19:00:49.683149+0000","last_fullsized":"2023-12-19T19:00:49.683149+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:13:48.628064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"49'2","reported_seq":18,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.675847+0000","last_change":"2023-12-19T19:00:30.984710+0000","last_active":"2023-12-19T19:00:49.675847+0000","last_peered":"2023-12-19T19:00:49.675847+0000","last_clean":"2023-12-19T19:00:49.675847+0000","last_became_active":"2023-12-19T19:00:30.984405+0000","last_became_peered":"2023-12-19T19:00:30.984405+0000","last_unstale":"2023-12-19T19:00:49.675847+0000","last_undegraded":"2023-12-19T19:00:49.675847+0000","last_fullsized":"2023-12-19T19:00:49.675847+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:27.732444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.688512+0000","last_change":"2023-12-19T19:00:49.700387+0000","last_active":"2023-12-19T19:00:50.688512+0000","last_peered":"2023-12-19T19:00:50.688512+0000","last_clean":"2023-12-19T19:00:50.688512+0000","last_became_active":"2023-12-19T19:00:49.700098+0000","last_became_peered":"2023-12-19T19:00:49.700098+0000","last_unstale":"2023-12-19T19:00:50.688512+0000","last_undegraded":"2023-12-19T19:00:50.688512+0000","last_fullsized":"2023-12-19T19:00:50.688512+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:01:51.384923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.680596+0000","last_change":"2023-12-19T19:00:48.699323+0000","last_active":"2023-12-19T19:00:49.680596+0000","last_peered":"2023-12-19T19:00:49.680596+0000","last_clean":"2023-12-19T19:00:49.680596+0000","last_became_active":"2023-12-19T19:00:48.698913+0000","last_became_peered":"2023-12-19T19:00:48.698913+0000","last_unstale":"2023-12-19T19:00:49.680596+0000","last_undegraded":"2023-12-19T19:00:49.680596+0000","last_fullsized":"2023-12-19T19:00:49.680596+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:15:23.526618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.684849+0000","last_change":"2023-12-19T19:00:31.994005+0000","last_active":"2023-12-19T19:00:49.684849+0000","last_peered":"2023-12-19T19:00:49.684849+0000","last_clean":"2023-12-19T19:00:49.684849+0000","last_became_active":"2023-12-19T19:00:31.993709+0000","last_became_peered":"2023-12-19T19:00:31.993709+0000","last_unstale":"2023-12-19T19:00:49.684849+0000","last_undegraded":"2023-12-19T19:00:49.684849+0000","last_fullsized":"2023-12-19T19:00:49.684849+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:36.845071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"50'1","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.697232+0000","last_change":"2023-12-19T19:00:30.988721+0000","last_active":"2023-12-19T19:00:48.697232+0000","last_peered":"2023-12-19T19:00:48.697232+0000","last_clean":"2023-12-19T19:00:48.697232+0000","last_became_active":"2023-12-19T19:00:30.988432+0000","last_became_peered":"2023-12-19T19:00:30.988432+0000","last_unstale":"2023-12-19T19:00:48.697232+0000","last_undegraded":"2023-12-19T19:00:48.697232+0000","last_fullsized":"2023-12-19T19:00:48.697232+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:28.753779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.698810+0000","last_change":"2023-12-19T19:00:49.693539+0000","last_active":"2023-12-19T19:00:49.698810+0000","last_peered":"2023-12-19T19:00:49.698810+0000","last_clean":"2023-12-19T19:00:49.698810+0000","last_became_active":"2023-12-19T19:00:49.693264+0000","last_became_peered":"2023-12-19T19:00:49.693264+0000","last_unstale":"2023-12-19T19:00:49.698810+0000","last_undegraded":"2023-12-19T19:00:49.698810+0000","last_fullsized":"2023-12-19T19:00:49.698810+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:06:00.309106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.721107+0000","last_change":"2023-12-19T19:00:48.698221+0000","last_active":"2023-12-19T19:00:49.721107+0000","last_peered":"2023-12-19T19:00:49.721107+0000","last_clean":"2023-12-19T19:00:49.721107+0000","last_became_active":"2023-12-19T19:00:48.697909+0000","last_became_peered":"2023-12-19T19:00:48.697909+0000","last_unstale":"2023-12-19T19:00:49.721107+0000","last_undegraded":"2023-12-19T19:00:49.721107+0000","last_fullsized":"2023-12-19T19:00:49.721107+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:12:46.076887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.674968+0000","last_change":"2023-12-19T19:00:31.999271+0000","last_active":"2023-12-19T19:00:49.674968+0000","last_peered":"2023-12-19T19:00:49.674968+0000","last_clean":"2023-12-19T19:00:49.674968+0000","last_became_active":"2023-12-19T19:00:31.998645+0000","last_became_peered":"2023-12-19T19:00:31.998645+0000","last_unstale":"2023-12-19T19:00:49.674968+0000","last_undegraded":"2023-12-19T19:00:49.674968+0000","last_fullsized":"2023-12-19T19:00:49.674968+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:05:19.291688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.693184+0000","last_change":"2023-12-19T19:00:30.981887+0000","last_active":"2023-12-19T19:00:48.693184+0000","last_peered":"2023-12-19T19:00:48.693184+0000","last_clean":"2023-12-19T19:00:48.693184+0000","last_became_active":"2023-12-19T19:00:30.981538+0000","last_became_peered":"2023-12-19T19:00:30.981538+0000","last_unstale":"2023-12-19T19:00:48.693184+0000","last_undegraded":"2023-12-19T19:00:48.693184+0000","last_fullsized":"2023-12-19T19:00:48.693184+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:50:37.886882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.687084+0000","last_change":"2023-12-19T19:00:49.696603+0000","last_active":"2023-12-19T19:00:50.687084+0000","last_peered":"2023-12-19T19:00:50.687084+0000","last_clean":"2023-12-19T19:00:50.687084+0000","last_became_active":"2023-12-19T19:00:49.696287+0000","last_became_peered":"2023-12-19T19:00:49.696287+0000","last_unstale":"2023-12-19T19:00:50.687084+0000","last_undegraded":"2023-12-19T19:00:50.687084+0000","last_fullsized":"2023-12-19T19:00:50.687084+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:15:24.533186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.687510+0000","last_change":"2023-12-19T19:00:48.704050+0000","last_active":"2023-12-19T19:00:50.687510+0000","last_peered":"2023-12-19T19:00:50.687510+0000","last_clean":"2023-12-19T19:00:50.687510+0000","last_became_active":"2023-12-19T19:00:48.703764+0000","last_became_peered":"2023-12-19T19:00:48.703764+0000","last_unstale":"2023-12-19T19:00:50.687510+0000","last_undegraded":"2023-12-19T19:00:50.687510+0000","last_fullsized":"2023-12-19T19:00:50.687510+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:25:32.891371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.696815+0000","last_change":"2023-12-19T19:00:31.993214+0000","last_active":"2023-12-19T19:00:48.696815+0000","last_peered":"2023-12-19T19:00:48.696815+0000","last_clean":"2023-12-19T19:00:48.696815+0000","last_became_active":"2023-12-19T19:00:31.992758+0000","last_became_peered":"2023-12-19T19:00:31.992758+0000","last_unstale":"2023-12-19T19:00:48.696815+0000","last_undegraded":"2023-12-19T19:00:48.696815+0000","last_fullsized":"2023-12-19T19:00:48.696815+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:40.147962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.684547+0000","last_change":"2023-12-19T19:00:30.992052+0000","last_active":"2023-12-19T19:00:49.684547+0000","last_peered":"2023-12-19T19:00:49.684547+0000","last_clean":"2023-12-19T19:00:49.684547+0000","last_became_active":"2023-12-19T19:00:30.991738+0000","last_became_peered":"2023-12-19T19:00:30.991738+0000","last_unstale":"2023-12-19T19:00:49.684547+0000","last_undegraded":"2023-12-19T19:00:49.684547+0000","last_fullsized":"2023-12-19T19:00:49.684547+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:31:59.956264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686152+0000","last_change":"2023-12-19T19:00:49.694938+0000","last_active":"2023-12-19T19:00:50.686152+0000","last_peered":"2023-12-19T19:00:50.686152+0000","last_clean":"2023-12-19T19:00:50.686152+0000","last_became_active":"2023-12-19T19:00:49.694579+0000","last_became_peered":"2023-12-19T19:00:49.694579+0000","last_unstale":"2023-12-19T19:00:50.686152+0000","last_undegraded":"2023-12-19T19:00:50.686152+0000","last_fullsized":"2023-12-19T19:00:50.686152+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:35:17.219218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.675199+0000","last_change":"2023-12-19T19:00:48.687844+0000","last_active":"2023-12-19T19:00:49.675199+0000","last_peered":"2023-12-19T19:00:49.675199+0000","last_clean":"2023-12-19T19:00:49.675199+0000","last_became_active":"2023-12-19T19:00:48.685621+0000","last_became_peered":"2023-12-19T19:00:48.685621+0000","last_unstale":"2023-12-19T19:00:49.675199+0000","last_undegraded":"2023-12-19T19:00:49.675199+0000","last_fullsized":"2023-12-19T19:00:49.675199+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:22:20.444135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679688+0000","last_change":"2023-12-19T19:00:31.998634+0000","last_active":"2023-12-19T19:00:48.679688+0000","last_peered":"2023-12-19T19:00:48.679688+0000","last_clean":"2023-12-19T19:00:48.679688+0000","last_became_active":"2023-12-19T19:00:31.996473+0000","last_became_peered":"2023-12-19T19:00:31.996473+0000","last_unstale":"2023-12-19T19:00:48.679688+0000","last_undegraded":"2023-12-19T19:00:48.679688+0000","last_fullsized":"2023-12-19T19:00:48.679688+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:00:47.322868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.673414+0000","last_change":"2023-12-19T19:00:30.990963+0000","last_active":"2023-12-19T19:00:49.673414+0000","last_peered":"2023-12-19T19:00:49.673414+0000","last_clean":"2023-12-19T19:00:49.673414+0000","last_became_active":"2023-12-19T19:00:30.990686+0000","last_became_peered":"2023-12-19T19:00:30.990686+0000","last_unstale":"2023-12-19T19:00:49.673414+0000","last_undegraded":"2023-12-19T19:00:49.673414+0000","last_fullsized":"2023-12-19T19:00:49.673414+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:49:29.844694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.709489+0000","last_change":"2023-12-19T19:00:49.698222+0000","last_active":"2023-12-19T19:00:49.709489+0000","last_peered":"2023-12-19T19:00:49.709489+0000","last_clean":"2023-12-19T19:00:49.709489+0000","last_became_active":"2023-12-19T19:00:49.697855+0000","last_became_peered":"2023-12-19T19:00:49.697855+0000","last_unstale":"2023-12-19T19:00:49.709489+0000","last_undegraded":"2023-12-19T19:00:49.709489+0000","last_fullsized":"2023-12-19T19:00:49.709489+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:40:43.699962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.697287+0000","last_change":"2023-12-19T19:00:48.696117+0000","last_active":"2023-12-19T19:00:49.697287+0000","last_peered":"2023-12-19T19:00:49.697287+0000","last_clean":"2023-12-19T19:00:49.697287+0000","last_became_active":"2023-12-19T19:00:48.695832+0000","last_became_peered":"2023-12-19T19:00:48.695832+0000","last_unstale":"2023-12-19T19:00:49.697287+0000","last_undegraded":"2023-12-19T19:00:49.697287+0000","last_fullsized":"2023-12-19T19:00:49.697287+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:46.456957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.677437+0000","last_change":"2023-12-19T19:00:31.987546+0000","last_active":"2023-12-19T19:00:49.677437+0000","last_peered":"2023-12-19T19:00:49.677437+0000","last_clean":"2023-12-19T19:00:49.677437+0000","last_became_active":"2023-12-19T19:00:31.987153+0000","last_became_peered":"2023-12-19T19:00:31.987153+0000","last_unstale":"2023-12-19T19:00:49.677437+0000","last_undegraded":"2023-12-19T19:00:49.677437+0000","last_fullsized":"2023-12-19T19:00:49.677437+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:13:48.628064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.680070+0000","last_change":"2023-12-19T19:00:30.989522+0000","last_active":"2023-12-19T19:00:48.680070+0000","last_peered":"2023-12-19T19:00:48.680070+0000","last_clean":"2023-12-19T19:00:48.680070+0000","last_became_active":"2023-12-19T19:00:30.988571+0000","last_became_peered":"2023-12-19T19:00:30.988571+0000","last_unstale":"2023-12-19T19:00:48.680070+0000","last_undegraded":"2023-12-19T19:00:48.680070+0000","last_fullsized":"2023-12-19T19:00:48.680070+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:10:42.744434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.698332+0000","last_change":"2023-12-19T19:00:49.693607+0000","last_active":"2023-12-19T19:00:49.698332+0000","last_peered":"2023-12-19T19:00:49.698332+0000","last_clean":"2023-12-19T19:00:49.698332+0000","last_became_active":"2023-12-19T19:00:49.692226+0000","last_became_peered":"2023-12-19T19:00:49.692226+0000","last_unstale":"2023-12-19T19:00:49.698332+0000","last_undegraded":"2023-12-19T19:00:49.698332+0000","last_fullsized":"2023-12-19T19:00:49.698332+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:52:23.622537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.681044+0000","last_change":"2023-12-19T19:00:48.696809+0000","last_active":"2023-12-19T19:00:49.681044+0000","last_peered":"2023-12-19T19:00:49.681044+0000","last_clean":"2023-12-19T19:00:49.681044+0000","last_became_active":"2023-12-19T19:00:48.696497+0000","last_became_peered":"2023-12-19T19:00:48.696497+0000","last_unstale":"2023-12-19T19:00:49.681044+0000","last_undegraded":"2023-12-19T19:00:49.681044+0000","last_fullsized":"2023-12-19T19:00:49.681044+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:49:47.547872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":15,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.673102+0000","last_change":"2023-12-19T19:00:32.001673+0000","last_active":"2023-12-19T19:00:49.673102+0000","last_peered":"2023-12-19T19:00:49.673102+0000","last_clean":"2023-12-19T19:00:49.673102+0000","last_became_active":"2023-12-19T19:00:32.001362+0000","last_became_peered":"2023-12-19T19:00:32.001362+0000","last_unstale":"2023-12-19T19:00:49.673102+0000","last_undegraded":"2023-12-19T19:00:49.673102+0000","last_fullsized":"2023-12-19T19:00:49.673102+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:57:25.004342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":16,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.673222+0000","last_change":"2023-12-19T19:00:30.989018+0000","last_active":"2023-12-19T19:00:49.673222+0000","last_peered":"2023-12-19T19:00:49.673222+0000","last_clean":"2023-12-19T19:00:49.673222+0000","last_became_active":"2023-12-19T19:00:30.988742+0000","last_became_peered":"2023-12-19T19:00:30.988742+0000","last_unstale":"2023-12-19T19:00:49.673222+0000","last_undegraded":"2023-12-19T19:00:49.673222+0000","last_fullsized":"2023-12-19T19:00:49.673222+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:10:01.359410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.717926+0000","last_change":"2023-12-19T19:00:49.708769+0000","last_active":"2023-12-19T19:00:49.717926+0000","last_peered":"2023-12-19T19:00:49.717926+0000","last_clean":"2023-12-19T19:00:49.717926+0000","last_became_active":"2023-12-19T19:00:49.708452+0000","last_became_peered":"2023-12-19T19:00:49.708452+0000","last_unstale":"2023-12-19T19:00:49.717926+0000","last_undegraded":"2023-12-19T19:00:49.717926+0000","last_fullsized":"2023-12-19T19:00:49.717926+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:33.137665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":54,"state":"active+clean","last_fresh":"2023-12-19T19:00:50.686095+0000","last_change":"2023-12-19T19:00:48.687559+0000","last_active":"2023-12-19T19:00:50.686095+0000","last_peered":"2023-12-19T19:00:50.686095+0000","last_clean":"2023-12-19T19:00:50.686095+0000","last_became_active":"2023-12-19T19:00:48.687286+0000","last_became_peered":"2023-12-19T19:00:48.687286+0000","last_unstale":"2023-12-19T19:00:50.686095+0000","last_undegraded":"2023-12-19T19:00:50.686095+0000","last_fullsized":"2023-12-19T19:00:50.686095+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:17:48.301202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679835+0000","last_change":"2023-12-19T19:00:31.992787+0000","last_active":"2023-12-19T19:00:48.679835+0000","last_peered":"2023-12-19T19:00:48.679835+0000","last_clean":"2023-12-19T19:00:48.679835+0000","last_became_active":"2023-12-19T19:00:31.992110+0000","last_became_peered":"2023-12-19T19:00:31.992110+0000","last_unstale":"2023-12-19T19:00:48.679835+0000","last_undegraded":"2023-12-19T19:00:48.679835+0000","last_fullsized":"2023-12-19T19:00:48.679835+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:43:46.671588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679850+0000","last_change":"2023-12-19T19:00:30.987505+0000","last_active":"2023-12-19T19:00:48.679850+0000","last_peered":"2023-12-19T19:00:48.679850+0000","last_clean":"2023-12-19T19:00:48.679850+0000","last_became_active":"2023-12-19T19:00:30.987202+0000","last_became_peered":"2023-12-19T19:00:30.987202+0000","last_unstale":"2023-12-19T19:00:48.679850+0000","last_undegraded":"2023-12-19T19:00:48.679850+0000","last_fullsized":"2023-12-19T19:00:48.679850+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:39.139606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.711232+0000","last_change":"2023-12-19T19:00:49.709628+0000","last_active":"2023-12-19T19:00:49.711232+0000","last_peered":"2023-12-19T19:00:49.711232+0000","last_clean":"2023-12-19T19:00:49.711232+0000","last_became_active":"2023-12-19T19:00:49.709336+0000","last_became_peered":"2023-12-19T19:00:49.709336+0000","last_unstale":"2023-12-19T19:00:49.711232+0000","last_undegraded":"2023-12-19T19:00:49.711232+0000","last_fullsized":"2023-12-19T19:00:49.711232+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:48.656469+0000","last_clean_scrub_stamp":"2023-12-19T19:00:48.656469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:30:51.465735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"53'2","reported_seq":13,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.722093+0000","last_change":"2023-12-19T19:00:48.699504+0000","last_active":"2023-12-19T19:00:49.722093+0000","last_peered":"2023-12-19T19:00:49.722093+0000","last_clean":"2023-12-19T19:00:49.722093+0000","last_became_active":"2023-12-19T19:00:48.699126+0000","last_became_peered":"2023-12-19T19:00:48.699126+0000","last_unstale":"2023-12-19T19:00:49.722093+0000","last_undegraded":"2023-12-19T19:00:49.722093+0000","last_fullsized":"2023-12-19T19:00:49.722093+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:47.649901+0000","last_clean_scrub_stamp":"2023-12-19T19:00:47.649901+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:05.322886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.679470+0000","last_change":"2023-12-19T19:00:32.003139+0000","last_active":"2023-12-19T19:00:48.679470+0000","last_peered":"2023-12-19T19:00:48.679470+0000","last_clean":"2023-12-19T19:00:48.679470+0000","last_became_active":"2023-12-19T19:00:32.002764+0000","last_became_peered":"2023-12-19T19:00:32.002764+0000","last_unstale":"2023-12-19T19:00:48.679470+0000","last_undegraded":"2023-12-19T19:00:48.679470+0000","last_fullsized":"2023-12-19T19:00:48.679470+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:30.955078+0000","last_clean_scrub_stamp":"2023-12-19T19:00:30.955078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:49:14.764281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2023-12-19T19:00:48.692338+0000","last_change":"2023-12-19T19:00:30.990667+0000","last_active":"2023-12-19T19:00:48.692338+0000","last_peered":"2023-12-19T19:00:48.692338+0000","last_clean":"2023-12-19T19:00:48.692338+0000","last_became_active":"2023-12-19T19:00:30.989615+0000","last_became_peered":"2023-12-19T19:00:30.989615+0000","last_unstale":"2023-12-19T19:00:48.692338+0000","last_undegraded":"2023-12-19T19:00:48.692338+0000","last_fullsized":"2023-12-19T19:00:48.692338+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:00:29.946723+0000","last_clean_scrub_stamp":"2023-12-19T19:00:29.946723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:49:29.844694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":53,"state":"active+clean","last_fresh":"2023-12-19T19:00:49.676764+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T19:00:49.676764+0000","last_peered":"2023-12-19T19:00:49.676764+0000","last_clean":"2023-12-19T19:00:49.676764+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T19:00:49.676764+0000","last_undegraded":"2023-12-19T19:00:49.676764+0000","last_fullsized":"2023-12-19T19:00:49.676764+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1245184,"data_stored":864669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68600000000000005,"15min":0.69099999999999995},"min":{"1min":0.434,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83399999999999996,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.72399999999999998,"15min":0.72599999999999998},"min":{"1min":0.54400000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.91200000000000003,"5min":1.117,"15min":1.117},"last":0.61399999999999999}]},{"osd":1,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95699999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68700000000000006,"15min":0.68899999999999995},"min":{"1min":0.54200000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.85699999999999998,"5min":1.01,"15min":1.01},"last":0.64100000000000001}]},{"osd":2,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68400000000000005,"15min":0.68600000000000005},"min":{"1min":0.50900000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.92700000000000005,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.71399999999999997,"15min":0.70999999999999996},"min":{"1min":0.54600000000000004,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.94699999999999995,"5min":1.089,"15min":1.089},"last":0.58299999999999996}]},{"osd":3,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.72399999999999998,"15min":0.73099999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89300000000000002,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.505},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.56899999999999995,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.55600000000000005}]},{"osd":4,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.65600000000000003,"15min":0.66000000000000003},"min":{"1min":0.434,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68000000000000005,"15min":0.67800000000000005},"min":{"1min":0.49299999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.93400000000000005,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.42099999999999999}]},{"osd":5,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69899999999999995,"15min":0.69999999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92500000000000004,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.70999999999999996,"15min":0.71199999999999997},"min":{"1min":0.52300000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.91900000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.56899999999999995}]},{"osd":6,"last update":"Tue Dec 19 19:00:34 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81499999999999995,"15min":0.81899999999999995},"min":{"1min":0.59699999999999998,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.96399999999999997,"5min":1.069,"15min":1.069},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.79700000000000004,"15min":0.80200000000000005},"min":{"1min":0.52200000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.91700000000000004,"5min":1.026,"15min":1.026},"last":0.60099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":643072,"data_stored":273617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.627,"15min":0.629},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86299999999999999,"5min":1.022,"15min":1.022},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98299999999999998,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.59099999999999997}]},{"osd":1,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.66200000000000003,"15min":0.65400000000000003},"min":{"1min":0.52100000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92600000000000005,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88700000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.73799999999999999}]},{"osd":2,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.83899999999999997,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.71399999999999997,"15min":0.71499999999999997},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94899999999999995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.76300000000000001}]},{"osd":3,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.69899999999999995,"15min":0.69099999999999995},"min":{"1min":0.50900000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.92700000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.496},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72799999999999998,"15min":0.72899999999999998},"min":{"1min":0.59099999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.90200000000000002,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.623}]},{"osd":4,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.66100000000000003,"15min":0.67100000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90600000000000003,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.75600000000000001,"15min":0.76000000000000001},"min":{"1min":0.52800000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88900000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.67100000000000004}]},{"osd":5,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.47299999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.73099999999999998,"15min":0.73599999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.96499999999999997,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.64800000000000002}]},{"osd":7,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.76200000000000001,"15min":0.76500000000000001},"min":{"1min":0.502,"5min":0.437,"15min":0.437},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76900000000000002,"15min":0.76800000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.78600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":647168,"data_stored":274267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.90500000000000003,"15min":0.94899999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0880000000000001,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.434},{"interface":"front","average":{"1min":0.68000000000000005,"5min":1.3420000000000001,"15min":1.452},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1180000000000001,"5min":16.951000000000001,"15min":16.951000000000001},"last":0.60399999999999998}]},{"osd":1,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":1.411,"15min":1.5429999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0700000000000001,"5min":19.823,"15min":19.823},"last":0.624},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.44500000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.216,"5min":1.657,"15min":1.657},"last":0.55700000000000005}]},{"osd":2,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.74199999999999999,"15min":0.755},"min":{"1min":0.48799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.163,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1020000000000001,"5min":1.585,"15min":1.585},"last":0.67000000000000004}]},{"osd":3,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.78000000000000003,"15min":0.79100000000000004},"min":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0589999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.97299999999999998,"15min":1.0149999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0740000000000001,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":0.70299999999999996}]},{"osd":4,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.45200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0049999999999999,"5min":1.716,"15min":1.716},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.504,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97899999999999998,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":0.54200000000000004}]},{"osd":6,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.82799999999999996,"15min":0.85099999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.86599999999999999,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.82999999999999996,"15min":0.84599999999999997},"min":{"1min":0.51100000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90600000000000003,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.58299999999999996}]},{"osd":7,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82899999999999996,"15min":0.83899999999999997},"min":{"1min":0.60599999999999998,"5min":0.498,"15min":0.498},"max":{"1min":1.0900000000000001,"5min":2.371,"15min":2.371},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0369999999999999,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.56499999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":651264,"data_stored":276702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.84299999999999997,"15min":0.875},"min":{"1min":0.46800000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86899999999999999,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78500000000000003,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.72199999999999998}]},{"osd":1,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.51800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88200000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.79200000000000004,"15min":0.80700000000000005},"min":{"1min":0.56699999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94599999999999995,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":0.747}]},{"osd":2,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69199999999999995,"15min":0.69299999999999995},"min":{"1min":0.53800000000000003,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.80300000000000005,"15min":0.81999999999999995},"min":{"1min":0.56000000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.88,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.82999999999999996}]},{"osd":3,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.84999999999999998,"5min":3.641,"15min":3.641},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.872,"15min":0.89800000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.85399999999999998,"5min":3.194,"15min":3.194},"last":0.76700000000000002}]},{"osd":5,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":1.0269999999999999,"15min":1.089},"min":{"1min":0.42699999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0449999999999999,"5min":9.3040000000000003,"15min":9.3040000000000003},"last":0.628},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.71999999999999997,"15min":0.73999999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94099999999999995,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.64200000000000002}]},{"osd":6,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.81799999999999995,"15min":0.84199999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97699999999999998,"5min":3.097,"15min":3.097},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.86599999999999999,"15min":0.89100000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97899999999999998,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.79000000000000004}]},{"osd":7,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.94199999999999995,"15min":0.97999999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0409999999999999,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":1.0289999999999999,"15min":1.077},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98699999999999999,"5min":6.3449999999999998,"15min":6.3449999999999998},"last":0.81399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31816,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340024,"statfs":{"total":96636764160,"available":96604184576,"internally_reserved":0,"allocated":651264,"data_stored":273693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.45600000000000002,"15min":0.45800000000000002},"min":{"1min":0.30099999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.44400000000000001,"15min":0.44600000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.58299999999999996,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.36099999999999999}]},{"osd":1,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.47899999999999998,"15min":0.48899999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.60699999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.51000000000000001,"15min":0.51900000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.63100000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47699999999999998}]},{"osd":2,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51100000000000001,"15min":0.51500000000000001},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.65700000000000003,"5min":0.75,"15min":0.75},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.54300000000000004,"15min":0.55100000000000005},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70999999999999996,"5min":0.875,"15min":0.875},"last":0.42999999999999999}]},{"osd":4,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78900000000000003,"15min":0.79100000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":0.99199999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.80600000000000005,"15min":0.81499999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.90900000000000003,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.68500000000000005}]},{"osd":5,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.75,"15min":0.755},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.97599999999999998,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.76700000000000002,"15min":0.77500000000000002},"min":{"1min":0.57399999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.91800000000000004,"5min":1.202,"15min":1.202},"last":0.60299999999999998}]},{"osd":6,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82099999999999995,"15min":0.82999999999999996},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.95599999999999996,"5min":1.298,"15min":1.298},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80100000000000005,"15min":0.80700000000000005},"min":{"1min":0.61599999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":0.93300000000000005,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.622}]},{"osd":7,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.79200000000000004,"15min":0.79600000000000004},"min":{"1min":0.60399999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.95299999999999996,"5min":1.155,"15min":1.155},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.77700000000000002,"15min":0.78300000000000003},"min":{"1min":0.56499999999999995,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.90600000000000003,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.58299999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27660,"kb_used_data":640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344180,"statfs":{"total":96636764160,"available":96608440320,"internally_reserved":0,"allocated":655360,"data_stored":275193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.497,"15min":0.50700000000000001},"min":{"1min":0.313,"5min":0.31,"15min":0.31},"max":{"1min":0.57899999999999996,"5min":1.458,"15min":1.458},"last":0.441},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.627,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.33700000000000002}]},{"osd":1,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.57899999999999996,"15min":0.59899999999999998},"min":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.58499999999999996,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.60399999999999998,"15min":0.624},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.61799999999999999,"5min":2.444,"15min":2.444},"last":0.379}]},{"osd":3,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.59599999999999997,"15min":0.62},"min":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65300000000000002,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.625,"15min":0.64300000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.69199999999999995,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.495}]},{"osd":4,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.93899999999999995,"15min":0.97499999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.94399999999999995,"5min":1.968,"15min":1.968},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.89500000000000002,"15min":0.92500000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.90700000000000003,"5min":2.835,"15min":2.835},"last":0.66400000000000003}]},{"osd":5,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.91600000000000004,"15min":0.94999999999999996},"min":{"1min":0.56000000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.94599999999999995,"5min":3.5,"15min":3.5},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.91100000000000003,"15min":0.93999999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.99099999999999999,"5min":1.996,"15min":1.996},"last":0.70999999999999996}]},{"osd":6,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.91200000000000003,"15min":0.94699999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.97599999999999998,"5min":2.903,"15min":2.903},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.99199999999999999,"15min":1.034},"min":{"1min":0.53700000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.92800000000000005,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.74399999999999999}]},{"osd":7,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.94999999999999996,"15min":0.98599999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.0049999999999999,"5min":2.875,"15min":2.875},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.94299999999999995,"15min":0.98099999999999998},"min":{"1min":0.59399999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.91900000000000004,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.59399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":659456,"data_stored":275843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.55200000000000005,"15min":0.58099999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.51600000000000001,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.748,"15min":0.80100000000000005},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.70399999999999996,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.42899999999999999}]},{"osd":2,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.57199999999999995,"15min":0.59599999999999997},"min":{"1min":0.316,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.63,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.65600000000000003,"15min":0.68899999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65300000000000002,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.47499999999999998}]},{"osd":3,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.79300000000000004,"15min":0.84199999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.629,"5min":7.8399999999999999,"15min":7.8399999999999999},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.81200000000000006,"15min":0.85999999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72499999999999998,"5min":7.7949999999999999,"15min":7.7949999999999999},"last":0.83699999999999997}]},{"osd":4,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.86799999999999999,"15min":0.89900000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0900000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.89900000000000002,"15min":0.93000000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0289999999999999,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.64400000000000002}]},{"osd":5,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.879,"15min":0.90900000000000003},"min":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92600000000000005,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.624},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.88500000000000001,"15min":0.91800000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98899999999999999,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.56799999999999995}]},{"osd":6,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.88300000000000001,"15min":0.90800000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94699999999999995,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.93100000000000005,"15min":0.96899999999999997},"min":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0469999999999999,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.747}]},{"osd":7,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.93600000000000005,"15min":0.96799999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1180000000000001,"5min":4.3310000000000004,"15min":4.3310000000000004},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.89200000000000002,"15min":0.92000000000000004},"min":{"1min":0.55200000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.97599999999999998,"5min":4.226,"15min":4.226},"last":0.86899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574879,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32392,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339448,"statfs":{"total":96636764160,"available":96603594752,"internally_reserved":0,"allocated":1241088,"data_stored":866563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.44700000000000001,"15min":0.45200000000000001},"min":{"1min":0.29199999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.45500000000000002,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63100000000000001,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.65700000000000003}]},{"osd":2,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.35799999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79600000000000004,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.50900000000000001,"15min":0.51100000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.746,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.62}]},{"osd":3,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70699999999999996,"5min":0.747,"15min":0.747},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.59699999999999998,"15min":0.60499999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86899999999999999,"5min":1.264,"15min":1.264},"last":0.69299999999999995}]},{"osd":4,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0589999999999999,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.018,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.89900000000000002}]},{"osd":5,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.73999999999999999,"15min":0.751},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.91200000000000003,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.876},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.81100000000000005,"15min":0.82299999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97899999999999998,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.91000000000000003}]},{"osd":6,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.81999999999999995,"15min":0.83299999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.024,"5min":1.349,"15min":1.349},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.76900000000000002,"15min":0.78200000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.88400000000000001,"5min":1.115,"15min":1.115},"last":1.0189999999999999}]},{"osd":7,"last update":"Tue Dec 19 19:00:31 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.78500000000000003,"15min":0.79900000000000004},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.89400000000000002,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.80700000000000005,"15min":0.81699999999999995},"min":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":0.997,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.92200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T19:00:54.154 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T19:00:54.155 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-12-19T19:00:54.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.325+0000 7fc249b57640 1 Processor -- start 2023-12-19T19:00:54.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.325+0000 7fc249b57640 1 -- start start 2023-12-19T19:00:54.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc249b57640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc2440c63c0 0x7fc2440c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:54.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc249b57640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2440c31c0 con 0x7fc2440c2bb0 2023-12-19T19:00:54.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc249b57640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2440c34a0 con 0x7fc2440c4100 2023-12-19T19:00:54.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc249b57640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2440c1030 con 0x7fc2440c63c0 2023-12-19T19:00:54.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc243fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc2440c2bb0 0x7fc2440a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58370/0 (socket says 172.21.15.133:58370) 2023-12-19T19:00:54.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc243fff640 1 -- 172.21.15.133:0/2667051916 learned_addr learned my addr 172.21.15.133:0/2667051916 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:54.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc2437fe640 1 --2- 172.21.15.133:0/2667051916 >> v2:172.21.15.138:3300/0 conn(0x7fc2440c63c0 0x7fc2440c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:54.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc242ffd640 1 -- 172.21.15.133:0/2667051916 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3367994831 0 0) 0x7fc2440c31c0 con 0x7fc2440c2bb0 2023-12-19T19:00:54.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc242ffd640 1 -- 172.21.15.133:0/2667051916 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc230003530 con 0x7fc2440c2bb0 2023-12-19T19:00:54.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc242ffd640 1 -- 172.21.15.133:0/2667051916 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 188247344 0 0) 0x7fc230003530 con 0x7fc2440c2bb0 2023-12-19T19:00:54.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc242ffd640 1 -- 172.21.15.133:0/2667051916 >> v2:172.21.15.138:3300/0 conn(0x7fc2440c63c0 msgr2=0x7fc2440c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:54.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc242ffd640 1 --2- 172.21.15.133:0/2667051916 >> v2:172.21.15.138:3300/0 conn(0x7fc2440c63c0 0x7fc2440c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc242ffd640 1 -- 172.21.15.133:0/2667051916 >> v1:172.21.15.138:6789/0 conn(0x7fc2440c4100 legacy=0x7fc2440c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:54.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc242ffd640 1 -- 172.21.15.133:0/2667051916 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2440c1310 con 0x7fc2440c2bb0 2023-12-19T19:00:54.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc242ffd640 1 -- 172.21.15.133:0/2667051916 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7fc23c001a00 con 0x7fc2440c2bb0 2023-12-19T19:00:54.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc242ffd640 1 -- 172.21.15.133:0/2667051916 >> v1:172.21.15.133:6789/0 conn(0x7fc2440c2bb0 legacy=0x7fc2440a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:54.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc242ffd640 1 --2- 172.21.15.133:0/2667051916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc230003980 0x7fc230003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:54.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc242ffd640 1 --2- 172.21.15.133:0/2667051916 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2300047d0 0x7fc230004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:54.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc242ffd640 1 --2- 172.21.15.133:0/2667051916 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2300051e0 0x7fc23000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:54.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc242ffd640 1 -- 172.21.15.133:0/2667051916 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440c1030 con 0x7fc230003980 2023-12-19T19:00:54.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc242ffd640 1 -- 172.21.15.133:0/2667051916 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23000c130 con 0x7fc2300047d0 2023-12-19T19:00:54.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc242ffd640 1 -- 172.21.15.133:0/2667051916 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23000e500 con 0x7fc2300051e0 2023-12-19T19:00:54.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc2437fe640 1 --2- 172.21.15.133:0/2667051916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc230003980 0x7fc230003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:54.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc23bfff640 1 --2- 172.21.15.133:0/2667051916 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2300047d0 0x7fc230004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:54.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc243fff640 1 --2- 172.21.15.133:0/2667051916 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2300051e0 0x7fc23000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:54.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc2437fe640 1 -- 172.21.15.133:0/2667051916 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2300051e0 msgr2=0x7fc23000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:54.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc2437fe640 1 --2- 172.21.15.133:0/2667051916 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2300051e0 0x7fc23000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc2437fe640 1 -- 172.21.15.133:0/2667051916 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2300047d0 msgr2=0x7fc230004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:54.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc2437fe640 1 --2- 172.21.15.133:0/2667051916 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2300047d0 0x7fc230004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc2437fe640 1 -- 172.21.15.133:0/2667051916 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc230003530 con 0x7fc230003980 2023-12-19T19:00:54.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc23bfff640 1 --2- 172.21.15.133:0/2667051916 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc2300047d0 0x7fc230004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:54.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.329+0000 7fc243fff640 1 -- 172.21.15.133:0/2667051916 reap_dead start 2023-12-19T19:00:54.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.333+0000 7fc2437fe640 1 --2- 172.21.15.133:0/2667051916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc230003980 0x7fc230003d60 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fc234009ae0 tx=0x7fc23401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e94af280cc27f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:54.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.333+0000 7fc242ffd640 1 -- 172.21.15.133:0/2667051916 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340a5530 con 0x7fc230003980 2023-12-19T19:00:54.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.333+0000 7fc242ffd640 1 -- 172.21.15.133:0/2667051916 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2340a5690 con 0x7fc230003980 2023-12-19T19:00:54.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.333+0000 7fc242ffd640 1 -- 172.21.15.133:0/2667051916 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340a5a40 con 0x7fc230003980 2023-12-19T19:00:54.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.333+0000 7fc249b57640 1 -- 172.21.15.133:0/2667051916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc230003980 msgr2=0x7fc230003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:54.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.333+0000 7fc249b57640 1 --2- 172.21.15.133:0/2667051916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc230003980 0x7fc230003d60 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fc234009ae0 tx=0x7fc23401ca50 comp rx=0 tx=0).stop 2023-12-19T19:00:54.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.333+0000 7fc249b57640 1 -- 172.21.15.133:0/2667051916 shutdown_connections 2023-12-19T19:00:54.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.333+0000 7fc249b57640 1 --2- 172.21.15.133:0/2667051916 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc230003980 0x7fc230003d60 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.333+0000 7fc249b57640 1 -- 172.21.15.133:0/2667051916 >> 172.21.15.133:0/2667051916 conn(0x7fc24406a5b0 msgr2=0x7fc24406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:54.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.333+0000 7fc249b57640 1 -- 172.21.15.133:0/2667051916 shutdown_connections 2023-12-19T19:00:54.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.333+0000 7fc249b57640 1 -- 172.21.15.133:0/2667051916 wait complete. 2023-12-19T19:00:54.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.333+0000 7fc249b57640 1 Processor -- start 2023-12-19T19:00:54.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.333+0000 7fc249b57640 1 -- start start 2023-12-19T19:00:54.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc249b57640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc230003980 0x7fc244152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:54.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc249b57640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2440bb340 0x7fc2440bb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:54.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc249b57640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2440bd440 0x7fc2440bd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:54.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc249b57640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440bed60 con 0x7fc2440bb340 2023-12-19T19:00:54.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc249b57640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440bfdf0 con 0x7fc230003980 2023-12-19T19:00:54.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc249b57640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2440bf5b0 con 0x7fc2440bd440 2023-12-19T19:00:54.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc23bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2440bb340 0x7fc2440bb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:54.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc2437fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc230003980 0x7fc244152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:54.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc243fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2440bd440 0x7fc2440bd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:54.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc23bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2440bb340 0x7fc2440bb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39220/0 (socket says 172.21.15.133:39220) 2023-12-19T19:00:54.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc23bfff640 1 -- 172.21.15.133:0/2122577464 learned_addr learned my addr 172.21.15.133:0/2122577464 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:54.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc2437fe640 1 -- 172.21.15.133:0/2122577464 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2440bd440 msgr2=0x7fc2440bd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:54.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc2437fe640 1 --2- 172.21.15.133:0/2122577464 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2440bd440 0x7fc2440bd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc2437fe640 1 -- 172.21.15.133:0/2122577464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2440bb340 msgr2=0x7fc2440bb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:54.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc2437fe640 1 --2- 172.21.15.133:0/2122577464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2440bb340 0x7fc2440bb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc2437fe640 1 -- 172.21.15.133:0/2122577464 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2440c69b0 con 0x7fc230003980 2023-12-19T19:00:54.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc23bfff640 1 --2- 172.21.15.133:0/2122577464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2440bb340 0x7fc2440bb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:00:54.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc2437fe640 1 --2- 172.21.15.133:0/2122577464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc230003980 0x7fc244152af0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc2340ac000 tx=0x7fc2340197f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:54.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc240ff9640 1 -- 172.21.15.133:0/2122577464 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340a5530 con 0x7fc230003980 2023-12-19T19:00:54.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc240ff9640 1 -- 172.21.15.133:0/2122577464 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23400f000 con 0x7fc230003980 2023-12-19T19:00:54.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc240ff9640 1 -- 172.21.15.133:0/2122577464 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc234004240 con 0x7fc230003980 2023-12-19T19:00:54.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc249b57640 1 -- 172.21.15.133:0/2122577464 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2440bf7c0 con 0x7fc230003980 2023-12-19T19:00:54.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc249b57640 1 -- 172.21.15.133:0/2122577464 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2440bfa80 con 0x7fc230003980 2023-12-19T19:00:54.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.337+0000 7fc249b57640 1 -- 172.21.15.133:0/2122577464 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc244068400 con 0x7fc230003980 2023-12-19T19:00:54.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.341+0000 7fc240ff9640 1 -- 172.21.15.133:0/2122577464 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc2340b4070 con 0x7fc230003980 2023-12-19T19:00:54.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.341+0000 7fc240ff9640 1 --2- 172.21.15.133:0/2122577464 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2240664a0 0x7fc224068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:54.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.341+0000 7fc240ff9640 1 -- 172.21.15.133:0/2122577464 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc23411eb40 con 0x7fc230003980 2023-12-19T19:00:54.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.341+0000 7fc23bfff640 1 --2- 172.21.15.133:0/2122577464 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2240664a0 0x7fc224068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:54.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.341+0000 7fc23bfff640 1 --2- 172.21.15.133:0/2122577464 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2240664a0 0x7fc224068960 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc2440bf330 tx=0x7fc22c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:54.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.345+0000 7fc240ff9640 1 -- 172.21.15.133:0/2122577464 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc2340ebd80 con 0x7fc230003980 2023-12-19T19:00:54.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.545+0000 7fc249b57640 1 -- 172.21.15.133:0/2122577464 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7fc2440c3e70 con 0x7fc230003980 2023-12-19T19:00:54.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.553+0000 7fc240ff9640 1 -- 172.21.15.133:0/2122577464 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v16) v1 ==== 185+0+142 (secure 0 0 0) 0x7fc2340ef3a0 con 0x7fc230003980 2023-12-19T19:00:54.557 INFO:teuthology.orchestra.run.smithi133.stdout:[client.1] 2023-12-19T19:00:54.557 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCn54Fl4bbAOhAA4WXKbT5uizIcy0OTOKIaag== 2023-12-19T19:00:54.557 INFO:teuthology.orchestra.run.smithi133.stdout: caps mds = "allow" 2023-12-19T19:00:54.557 INFO:teuthology.orchestra.run.smithi133.stdout: caps mon = "allow r" 2023-12-19T19:00:54.557 INFO:teuthology.orchestra.run.smithi133.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-12-19T19:00:54.557 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.1 2023-12-19T19:00:54.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.553+0000 7fc249b57640 1 -- 172.21.15.133:0/2122577464 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2240664a0 msgr2=0x7fc224068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:54.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.553+0000 7fc249b57640 1 --2- 172.21.15.133:0/2122577464 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2240664a0 0x7fc224068960 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc2440bf330 tx=0x7fc22c009040 comp rx=0 tx=0).stop 2023-12-19T19:00:54.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.553+0000 7fc249b57640 1 -- 172.21.15.133:0/2122577464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc230003980 msgr2=0x7fc244152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:54.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.553+0000 7fc249b57640 1 --2- 172.21.15.133:0/2122577464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc230003980 0x7fc244152af0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc2340ac000 tx=0x7fc2340197f0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.553+0000 7fc249b57640 1 -- 172.21.15.133:0/2122577464 shutdown_connections 2023-12-19T19:00:54.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.553+0000 7fc249b57640 1 --2- 172.21.15.133:0/2122577464 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2240664a0 0x7fc224068960 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.553+0000 7fc249b57640 1 --2- 172.21.15.133:0/2122577464 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc2440bd440 0x7fc2440bd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.553+0000 7fc249b57640 1 --2- 172.21.15.133:0/2122577464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2440bb340 0x7fc2440bb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.553+0000 7fc249b57640 1 --2- 172.21.15.133:0/2122577464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc230003980 0x7fc244152af0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.553+0000 7fc249b57640 1 -- 172.21.15.133:0/2122577464 >> 172.21.15.133:0/2122577464 conn(0x7fc24406a5b0 msgr2=0x7fc24406ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:54.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.553+0000 7fc249b57640 1 -- 172.21.15.133:0/2122577464 shutdown_connections 2023-12-19T19:00:54.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.553+0000 7fc249b57640 1 -- 172.21.15.133:0/2122577464 wait complete. 2023-12-19T19:00:54.578 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:00:54.578 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:00:54.589 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:00:54.589 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:00:54.640 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:00:54.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.773+0000 7f0cb691d640 1 Processor -- start 2023-12-19T19:00:54.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.773+0000 7f0cb691d640 1 -- start start 2023-12-19T19:00:54.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.777+0000 7f0cb691d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0cb00c4100 0x7f0cb00c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:54.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.777+0000 7f0cb691d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cb00c06d0 0x7f0cb00a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.777+0000 7f0cb691d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb00c31c0 con 0x7f0cb00c63c0 2023-12-19T19:00:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.777+0000 7f0cb691d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb00c34a0 con 0x7f0cb00c4100 2023-12-19T19:00:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.777+0000 7f0cb691d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb00c1030 con 0x7f0cb00c06d0 2023-12-19T19:00:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.777+0000 7f0caffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0cb00c63c0 0x7f0cb00c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58384/0 (socket says 172.21.15.133:58384) 2023-12-19T19:00:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.777+0000 7f0caffff640 1 -- 172.21.15.133:0/3808693720 learned_addr learned my addr 172.21.15.133:0/3808693720 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.777+0000 7f0caf7fe640 1 --2- 172.21.15.133:0/3808693720 >> v2:172.21.15.133:3300/0 conn(0x7f0cb00c4100 0x7f0cb00c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.777+0000 7f0cb4eba640 1 --2- 172.21.15.133:0/3808693720 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cb00c06d0 0x7f0cb00a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.777+0000 7f0caeffd640 1 -- 172.21.15.133:0/3808693720 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1061715362 0 0) 0x7f0cb00c31c0 con 0x7f0cb00c63c0 2023-12-19T19:00:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.777+0000 7f0caeffd640 1 -- 172.21.15.133:0/3808693720 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c98003530 con 0x7f0cb00c63c0 2023-12-19T19:00:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.777+0000 7f0caf7fe640 1 -- 172.21.15.133:0/3808693720 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cb00c06d0 msgr2=0x7f0cb00a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.777+0000 7f0caf7fe640 1 --2- 172.21.15.133:0/3808693720 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cb00c06d0 0x7f0cb00a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.777+0000 7f0caf7fe640 1 -- 172.21.15.133:0/3808693720 >> v1:172.21.15.133:6789/0 conn(0x7f0cb00c63c0 legacy=0x7f0cb00c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:54.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.777+0000 7f0caf7fe640 1 -- 172.21.15.133:0/3808693720 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb00c1310 con 0x7f0cb00c4100 2023-12-19T19:00:54.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.781+0000 7f0caf7fe640 1 --2- 172.21.15.133:0/3808693720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cb00c4100 0x7f0cb00c2bb0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40097c0 tx=0x7f0ca401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c64a6347625a9ec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:54.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.781+0000 7f0caeffd640 1 -- 172.21.15.133:0/3808693720 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb00aa3d0 con 0x7f0cb00c4100 2023-12-19T19:00:54.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.781+0000 7f0caeffd640 1 -- 172.21.15.133:0/3808693720 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca40a7050 con 0x7f0cb00c4100 2023-12-19T19:00:54.783 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.781+0000 7f0caeffd640 1 -- 172.21.15.133:0/3808693720 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca40ab800 con 0x7f0cb00c4100 2023-12-19T19:00:54.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.781+0000 7f0cb691d640 1 -- 172.21.15.133:0/3808693720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cb00c4100 msgr2=0x7f0cb00c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:54.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.781+0000 7f0cb691d640 1 --2- 172.21.15.133:0/3808693720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cb00c4100 0x7f0cb00c2bb0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40097c0 tx=0x7f0ca401c360 comp rx=0 tx=0).stop 2023-12-19T19:00:54.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.781+0000 7f0cb691d640 1 -- 172.21.15.133:0/3808693720 shutdown_connections 2023-12-19T19:00:54.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.781+0000 7f0cb691d640 1 --2- 172.21.15.133:0/3808693720 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cb00c06d0 0x7f0cb00a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.781+0000 7f0cb691d640 1 --2- 172.21.15.133:0/3808693720 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cb00c4100 0x7f0cb00c2bb0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.781+0000 7f0cb691d640 1 -- 172.21.15.133:0/3808693720 >> 172.21.15.133:0/3808693720 conn(0x7f0cb006a5b0 msgr2=0x7f0cb006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:54.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.781+0000 7f0cb691d640 1 -- 172.21.15.133:0/3808693720 shutdown_connections 2023-12-19T19:00:54.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.781+0000 7f0cb691d640 1 -- 172.21.15.133:0/3808693720 wait complete. 2023-12-19T19:00:54.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.781+0000 7f0cb691d640 1 Processor -- start 2023-12-19T19:00:54.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.781+0000 7f0cb691d640 1 -- start start 2023-12-19T19:00:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.781+0000 7f0cb691d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cb00c06d0 0x7f0cb00bfd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.781+0000 7f0cb691d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cb00c4100 0x7f0cb015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.781+0000 7f0cb691d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cb00c63c0 0x7f0cb014dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.781+0000 7f0cb691d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb014e9d0 con 0x7f0cb00c4100 2023-12-19T19:00:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.781+0000 7f0cb691d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb01ed000 con 0x7f0cb00c06d0 2023-12-19T19:00:54.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.781+0000 7f0cb691d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb00c03b0 con 0x7f0cb00c63c0 2023-12-19T19:00:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.785+0000 7f0caf7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cb00c4100 0x7f0cb015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.785+0000 7f0caf7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cb00c4100 0x7f0cb015a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39242/0 (socket says 172.21.15.133:39242) 2023-12-19T19:00:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.785+0000 7f0caf7fe640 1 -- 172.21.15.133:0/2484369162 learned_addr learned my addr 172.21.15.133:0/2484369162 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.785+0000 7f0caffff640 1 --2- 172.21.15.133:0/2484369162 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cb00c06d0 0x7f0cb00bfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.785+0000 7f0cb4eba640 1 --2- 172.21.15.133:0/2484369162 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cb00c63c0 0x7f0cb014dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.785+0000 7f0caf7fe640 1 -- 172.21.15.133:0/2484369162 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cb00c63c0 msgr2=0x7f0cb014dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.785+0000 7f0caf7fe640 1 --2- 172.21.15.133:0/2484369162 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cb00c63c0 0x7f0cb014dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.785+0000 7f0caf7fe640 1 -- 172.21.15.133:0/2484369162 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cb00c06d0 msgr2=0x7f0cb00bfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.785+0000 7f0caf7fe640 1 --2- 172.21.15.133:0/2484369162 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cb00c06d0 0x7f0cb00bfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.785+0000 7f0caf7fe640 1 -- 172.21.15.133:0/2484369162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca4009420 con 0x7f0cb00c4100 2023-12-19T19:00:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.785+0000 7f0caf7fe640 1 --2- 172.21.15.133:0/2484369162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cb00c4100 0x7f0cb015a1f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4019f90 tx=0x7f0ca4019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.785+0000 7f0cacff9640 1 -- 172.21.15.133:0/2484369162 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca40b4400 con 0x7f0cb00c4100 2023-12-19T19:00:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.785+0000 7f0cacff9640 1 -- 172.21.15.133:0/2484369162 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca40b4560 con 0x7f0cb00c4100 2023-12-19T19:00:54.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.785+0000 7f0cacff9640 1 -- 172.21.15.133:0/2484369162 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca40b48d0 con 0x7f0cb00c4100 2023-12-19T19:00:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.785+0000 7f0cb691d640 1 -- 172.21.15.133:0/2484369162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb01ec9b0 con 0x7f0cb00c4100 2023-12-19T19:00:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.785+0000 7f0cb691d640 1 -- 172.21.15.133:0/2484369162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb01ec6a0 con 0x7f0cb00c4100 2023-12-19T19:00:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.785+0000 7f0cb691d640 1 -- 172.21.15.133:0/2484369162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb00aa7a0 con 0x7f0cb00c4100 2023-12-19T19:00:54.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.785+0000 7f0cacff9640 1 -- 172.21.15.133:0/2484369162 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0ca40b2040 con 0x7f0cb00c4100 2023-12-19T19:00:54.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.789+0000 7f0cacff9640 1 --2- 172.21.15.133:0/2484369162 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0c9c066470 0x7f0c9c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:54.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.789+0000 7f0cacff9640 1 -- 172.21.15.133:0/2484369162 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0ca411e210 con 0x7f0cb00c4100 2023-12-19T19:00:54.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.789+0000 7f0caffff640 1 --2- 172.21.15.133:0/2484369162 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0c9c066470 0x7f0c9c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:54.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.789+0000 7f0caffff640 1 --2- 172.21.15.133:0/2484369162 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0c9c066470 0x7f0c9c068930 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0005890 tx=0x7f0ca0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:54.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.793+0000 7f0cacff9640 1 -- 172.21.15.133:0/2484369162 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0ca40eb320 con 0x7f0cb00c4100 2023-12-19T19:00:54.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.945+0000 7f0cb691d640 1 -- 172.21.15.133:0/2484369162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cb01ed170 con 0x7f0cb00c4100 2023-12-19T19:00:54.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.945+0000 7f0cacff9640 1 -- 172.21.15.133:0/2484369162 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20316 (secure 0 0 0) 0x7f0ca40ee940 con 0x7f0cb00c4100 2023-12-19T19:00:54.950 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:54.950 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":54,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:00:50.680936+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:00:29.085029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T19:00:30.359577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:00:46.784805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:00:48.051355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:00:54.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.949+0000 7f0cb691d640 1 -- 172.21.15.133:0/2484369162 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0c9c066470 msgr2=0x7f0c9c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:54.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.949+0000 7f0cb691d640 1 --2- 172.21.15.133:0/2484369162 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0c9c066470 0x7f0c9c068930 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0005890 tx=0x7f0ca0009040 comp rx=0 tx=0).stop 2023-12-19T19:00:54.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.949+0000 7f0cb691d640 1 -- 172.21.15.133:0/2484369162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cb00c4100 msgr2=0x7f0cb015a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:54.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.949+0000 7f0cb691d640 1 --2- 172.21.15.133:0/2484369162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cb00c4100 0x7f0cb015a1f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4019f90 tx=0x7f0ca4019100 comp rx=0 tx=0).stop 2023-12-19T19:00:54.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.949+0000 7f0cb691d640 1 -- 172.21.15.133:0/2484369162 shutdown_connections 2023-12-19T19:00:54.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.949+0000 7f0cb691d640 1 --2- 172.21.15.133:0/2484369162 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0c9c066470 0x7f0c9c068930 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.949+0000 7f0cb691d640 1 --2- 172.21.15.133:0/2484369162 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0cb00c63c0 0x7f0cb014dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.949+0000 7f0cb691d640 1 --2- 172.21.15.133:0/2484369162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0cb00c4100 0x7f0cb015a1f0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.949+0000 7f0cb691d640 1 --2- 172.21.15.133:0/2484369162 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0cb00c06d0 0x7f0cb00bfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:54.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.949+0000 7f0cb691d640 1 -- 172.21.15.133:0/2484369162 >> 172.21.15.133:0/2484369162 conn(0x7f0cb006a5b0 msgr2=0x7f0cb006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:54.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.949+0000 7f0cb691d640 1 -- 172.21.15.133:0/2484369162 shutdown_connections 2023-12-19T19:00:54.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:54.949+0000 7f0cb691d640 1 -- 172.21.15.133:0/2484369162 wait complete. 2023-12-19T19:00:54.971 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T19:00:29.085029+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T19:00:30.359577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-19T19:00:46.784805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-19T19:00:48.051355+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T19:00:54.971 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T19:00:55.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.109+0000 7fcd4e65a640 1 Processor -- start 2023-12-19T19:00:55.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.109+0000 7fcd4e65a640 1 -- start start 2023-12-19T19:00:55.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.109+0000 7fcd4e65a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcd4814c600 0x7fcd480abf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:55.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.109+0000 7fcd4e65a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcd480a9670 0x7fcd480aae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:55.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.109+0000 7fcd4e65a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd480ac4a0 0x7fcd480ab350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:55.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.109+0000 7fcd4e65a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd480c0d10 con 0x7fcd4814c600 2023-12-19T19:00:55.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.109+0000 7fcd4e65a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd480c2cb0 con 0x7fcd480a9670 2023-12-19T19:00:55.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.109+0000 7fcd4e65a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd48073d10 con 0x7fcd480ac4a0 2023-12-19T19:00:55.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.109+0000 7fcd47fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcd4814c600 0x7fcd480abf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:55.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.109+0000 7fcd47fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcd4814c600 0x7fcd480abf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39244/0 (socket says 172.21.15.133:39244) 2023-12-19T19:00:55.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.109+0000 7fcd47fff640 1 -- 172.21.15.133:0/2048743970 learned_addr learned my addr 172.21.15.133:0/2048743970 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:55.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.113+0000 7fcd4cbf7640 1 --2- 172.21.15.133:0/2048743970 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd480ac4a0 0x7fcd480ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:55.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.113+0000 7fcd477fe640 1 --2- 172.21.15.133:0/2048743970 >> v2:172.21.15.138:3300/0 conn(0x7fcd480a9670 0x7fcd480aae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:55.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.113+0000 7fcd47fff640 1 -- 172.21.15.133:0/2048743970 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd480ac4a0 msgr2=0x7fcd480ab350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:55.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.113+0000 7fcd47fff640 1 --2- 172.21.15.133:0/2048743970 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd480ac4a0 0x7fcd480ab350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.113+0000 7fcd47fff640 1 -- 172.21.15.133:0/2048743970 >> v2:172.21.15.138:3300/0 conn(0x7fcd480a9670 msgr2=0x7fcd480aae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:55.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.113+0000 7fcd47fff640 1 --2- 172.21.15.133:0/2048743970 >> v2:172.21.15.138:3300/0 conn(0x7fcd480a9670 0x7fcd480aae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.113+0000 7fcd47fff640 1 -- 172.21.15.133:0/2048743970 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd48152fd0 con 0x7fcd4814c600 2023-12-19T19:00:55.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.113+0000 7fcd477fe640 1 --2- 172.21.15.133:0/2048743970 >> v2:172.21.15.138:3300/0 conn(0x7fcd480a9670 0x7fcd480aae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:55.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.113+0000 7fcd47fff640 1 --2- 172.21.15.133:0/2048743970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd4814c600 0x7fcd480abf60 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcd480729f0 tx=0x7fcd3801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5ccdddc82c3529f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:55.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.113+0000 7fcd46ffd640 1 -- 172.21.15.133:0/2048743970 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd380ab600 con 0x7fcd4814c600 2023-12-19T19:00:55.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.113+0000 7fcd46ffd640 1 -- 172.21.15.133:0/2048743970 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd380ab760 con 0x7fcd4814c600 2023-12-19T19:00:55.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.113+0000 7fcd46ffd640 1 -- 172.21.15.133:0/2048743970 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd380abaf0 con 0x7fcd4814c600 2023-12-19T19:00:55.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd4e65a640 1 -- 172.21.15.133:0/2048743970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd4814c600 msgr2=0x7fcd480abf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:55.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd4e65a640 1 --2- 172.21.15.133:0/2048743970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd4814c600 0x7fcd480abf60 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fcd480729f0 tx=0x7fcd3801c440 comp rx=0 tx=0).stop 2023-12-19T19:00:55.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd4e65a640 1 -- 172.21.15.133:0/2048743970 shutdown_connections 2023-12-19T19:00:55.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd4e65a640 1 --2- 172.21.15.133:0/2048743970 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd480ac4a0 0x7fcd480ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd4e65a640 1 --2- 172.21.15.133:0/2048743970 >> v2:172.21.15.138:3300/0 conn(0x7fcd480a9670 0x7fcd480aae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd4e65a640 1 --2- 172.21.15.133:0/2048743970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd4814c600 0x7fcd480abf60 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd4e65a640 1 -- 172.21.15.133:0/2048743970 >> 172.21.15.133:0/2048743970 conn(0x7fcd480c30c0 msgr2=0x7fcd480c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:55.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd4e65a640 1 -- 172.21.15.133:0/2048743970 shutdown_connections 2023-12-19T19:00:55.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd4e65a640 1 -- 172.21.15.133:0/2048743970 wait complete. 2023-12-19T19:00:55.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd4e65a640 1 Processor -- start 2023-12-19T19:00:55.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd4e65a640 1 -- start start 2023-12-19T19:00:55.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd4e65a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd480a9670 0x7fcd4815b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:55.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd4e65a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd480ac4a0 0x7fcd48154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:55.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd4e65a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd4814c600 0x7fcd481ed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:55.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd4e65a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd480c62d0 con 0x7fcd480ac4a0 2023-12-19T19:00:55.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd4e65a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd480c5a30 con 0x7fcd4814c600 2023-12-19T19:00:55.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd4e65a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd480c5d10 con 0x7fcd480a9670 2023-12-19T19:00:55.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd477fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd480ac4a0 0x7fcd48154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:55.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd477fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd480ac4a0 0x7fcd48154a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39250/0 (socket says 172.21.15.133:39250) 2023-12-19T19:00:55.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd477fe640 1 -- 172.21.15.133:0/2604686477 learned_addr learned my addr 172.21.15.133:0/2604686477 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:55.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd47fff640 1 --2- 172.21.15.133:0/2604686477 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd480a9670 0x7fcd4815b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:55.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd4cbf7640 1 --2- 172.21.15.133:0/2604686477 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd4814c600 0x7fcd481ed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:55.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd477fe640 1 -- 172.21.15.133:0/2604686477 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd480a9670 msgr2=0x7fcd4815b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:55.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd477fe640 1 --2- 172.21.15.133:0/2604686477 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd480a9670 0x7fcd4815b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd477fe640 1 -- 172.21.15.133:0/2604686477 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd4814c600 msgr2=0x7fcd481ed7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:55.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd477fe640 1 --2- 172.21.15.133:0/2604686477 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd4814c600 0x7fcd481ed7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd477fe640 1 -- 172.21.15.133:0/2604686477 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd380094d0 con 0x7fcd480ac4a0 2023-12-19T19:00:55.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd47fff640 1 --2- 172.21.15.133:0/2604686477 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd480a9670 0x7fcd4815b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:00:55.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.117+0000 7fcd4cbf7640 1 --2- 172.21.15.133:0/2604686477 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd4814c600 0x7fcd481ed7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:00:55.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.121+0000 7fcd477fe640 1 --2- 172.21.15.133:0/2604686477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd480ac4a0 0x7fcd48154a20 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c00d800 tx=0x7fcd3c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:55.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.121+0000 7fcd44ff9640 1 -- 172.21.15.133:0/2604686477 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c0096a0 con 0x7fcd480ac4a0 2023-12-19T19:00:55.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.121+0000 7fcd44ff9640 1 -- 172.21.15.133:0/2604686477 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3c009800 con 0x7fcd480ac4a0 2023-12-19T19:00:55.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.121+0000 7fcd44ff9640 1 -- 172.21.15.133:0/2604686477 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c009990 con 0x7fcd480ac4a0 2023-12-19T19:00:55.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.121+0000 7fcd4e65a640 1 -- 172.21.15.133:0/2604686477 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd480c5ff0 con 0x7fcd480ac4a0 2023-12-19T19:00:55.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.121+0000 7fcd4e65a640 1 -- 172.21.15.133:0/2604686477 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd48154f60 con 0x7fcd480ac4a0 2023-12-19T19:00:55.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.121+0000 7fcd4e65a640 1 -- 172.21.15.133:0/2604686477 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd480c28e0 con 0x7fcd480ac4a0 2023-12-19T19:00:55.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.121+0000 7fcd44ff9640 1 -- 172.21.15.133:0/2604686477 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fcd3c009af0 con 0x7fcd480ac4a0 2023-12-19T19:00:55.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.121+0000 7fcd44ff9640 1 --2- 172.21.15.133:0/2604686477 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd34066470 0x7fcd34068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:55.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.121+0000 7fcd44ff9640 1 -- 172.21.15.133:0/2604686477 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcd3c084550 con 0x7fcd480ac4a0 2023-12-19T19:00:55.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.121+0000 7fcd47fff640 1 --2- 172.21.15.133:0/2604686477 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd34066470 0x7fcd34068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:55.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.125+0000 7fcd47fff640 1 --2- 172.21.15.133:0/2604686477 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd34066470 0x7fcd34068930 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcd380af000 tx=0x7fcd38008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:55.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.125+0000 7fcd44ff9640 1 -- 172.21.15.133:0/2604686477 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fcd3c051660 con 0x7fcd480ac4a0 2023-12-19T19:00:55.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.277+0000 7fcd4e65a640 1 -- 172.21.15.133:0/2604686477 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd48068400 con 0x7fcd480ac4a0 2023-12-19T19:00:55.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.277+0000 7fcd44ff9640 1 -- 172.21.15.133:0/2604686477 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd3c00b390 con 0x7fcd480ac4a0 2023-12-19T19:00:55.282 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T19:00:55.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.281+0000 7fcd4e65a640 1 -- 172.21.15.133:0/2604686477 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd34066470 msgr2=0x7fcd34068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:55.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.281+0000 7fcd4e65a640 1 --2- 172.21.15.133:0/2604686477 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd34066470 0x7fcd34068930 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fcd380af000 tx=0x7fcd38008040 comp rx=0 tx=0).stop 2023-12-19T19:00:55.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.281+0000 7fcd4e65a640 1 -- 172.21.15.133:0/2604686477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd480ac4a0 msgr2=0x7fcd48154a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:55.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.281+0000 7fcd4e65a640 1 --2- 172.21.15.133:0/2604686477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd480ac4a0 0x7fcd48154a20 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c00d800 tx=0x7fcd3c00dcc0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.281+0000 7fcd4e65a640 1 -- 172.21.15.133:0/2604686477 shutdown_connections 2023-12-19T19:00:55.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.281+0000 7fcd4e65a640 1 --2- 172.21.15.133:0/2604686477 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd34066470 0x7fcd34068930 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.281+0000 7fcd4e65a640 1 --2- 172.21.15.133:0/2604686477 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd4814c600 0x7fcd481ed7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.281+0000 7fcd4e65a640 1 --2- 172.21.15.133:0/2604686477 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd480ac4a0 0x7fcd48154a20 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.281+0000 7fcd4e65a640 1 --2- 172.21.15.133:0/2604686477 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd480a9670 0x7fcd4815b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.281+0000 7fcd4e65a640 1 -- 172.21.15.133:0/2604686477 >> 172.21.15.133:0/2604686477 conn(0x7fcd480c30c0 msgr2=0x7fcd480c34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:55.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.281+0000 7fcd4e65a640 1 -- 172.21.15.133:0/2604686477 shutdown_connections 2023-12-19T19:00:55.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.281+0000 7fcd4e65a640 1 -- 172.21.15.133:0/2604686477 wait complete. 2023-12-19T19:00:55.303 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T19:00:55.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.437+0000 7f2360fd0640 1 Processor -- start 2023-12-19T19:00:55.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.437+0000 7f2360fd0640 1 -- start start 2023-12-19T19:00:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.441+0000 7f2360fd0640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f235c0bd3c0 0x7f235c0c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.441+0000 7f2360fd0640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f235c0c8400 con 0x7f235c151bb0 2023-12-19T19:00:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.441+0000 7f2360fd0640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f235c1545f0 con 0x7f235c0c7c30 2023-12-19T19:00:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.441+0000 7f2360fd0640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235c0c86e0 con 0x7f235c0bd3c0 2023-12-19T19:00:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.441+0000 7f235b7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f235c151bb0 0x7f235c06ba40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58398/0 (socket says 172.21.15.133:58398) 2023-12-19T19:00:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.441+0000 7f235b7fe640 1 -- 172.21.15.133:0/2291661159 learned_addr learned my addr 172.21.15.133:0/2291661159 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.441+0000 7f235affd640 1 --2- 172.21.15.133:0/2291661159 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f235c0bd3c0 0x7f235c0c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.441+0000 7f235a7fc640 1 -- 172.21.15.133:0/2291661159 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 730034346 0 0) 0x7f235c0c8400 con 0x7f235c151bb0 2023-12-19T19:00:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.441+0000 7f235a7fc640 1 -- 172.21.15.133:0/2291661159 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2344003530 con 0x7f235c151bb0 2023-12-19T19:00:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.441+0000 7f235a7fc640 1 -- 172.21.15.133:0/2291661159 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530537144 0 0) 0x7f235c1545f0 con 0x7f235c0c7c30 2023-12-19T19:00:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.441+0000 7f235a7fc640 1 -- 172.21.15.133:0/2291661159 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f235c0c8400 con 0x7f235c0c7c30 2023-12-19T19:00:55.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.441+0000 7f235affd640 1 -- 172.21.15.133:0/2291661159 >> v1:172.21.15.138:6789/0 conn(0x7f235c0c7c30 legacy=0x7f235c15ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.441+0000 7f235a7fc640 1 -- 172.21.15.133:0/2291661159 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2927462264 0 0) 0x7f2344003530 con 0x7f235c151bb0 2023-12-19T19:00:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.441+0000 7f235affd640 1 -- 172.21.15.133:0/2291661159 >> v1:172.21.15.133:6789/0 conn(0x7f235c151bb0 legacy=0x7f235c06ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.441+0000 7f235affd640 1 -- 172.21.15.133:0/2291661159 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235c1548d0 con 0x7f235c0bd3c0 2023-12-19T19:00:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.445+0000 7f235affd640 1 --2- 172.21.15.133:0/2291661159 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f235c0bd3c0 0x7f235c0c46b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f23500097f0 tx=0x7f235001c2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16c504256612bc59 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.445+0000 7f235a7fc640 1 -- 172.21.15.133:0/2291661159 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234c001680 con 0x7f235c0bd3c0 2023-12-19T19:00:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.445+0000 7f235a7fc640 1 -- 172.21.15.133:0/2291661159 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23500a7050 con 0x7f235c0bd3c0 2023-12-19T19:00:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.445+0000 7f235a7fc640 1 -- 172.21.15.133:0/2291661159 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23500ab600 con 0x7f235c0bd3c0 2023-12-19T19:00:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.445+0000 7f2360fd0640 1 -- 172.21.15.133:0/2291661159 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f235c0bd3c0 msgr2=0x7f235c0c46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.445+0000 7f2360fd0640 1 --2- 172.21.15.133:0/2291661159 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f235c0bd3c0 0x7f235c0c46b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f23500097f0 tx=0x7f235001c2c0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.445+0000 7f2360fd0640 1 -- 172.21.15.133:0/2291661159 shutdown_connections 2023-12-19T19:00:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.445+0000 7f2360fd0640 1 --2- 172.21.15.133:0/2291661159 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f235c0bd3c0 0x7f235c0c46b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.445+0000 7f2360fd0640 1 -- 172.21.15.133:0/2291661159 >> 172.21.15.133:0/2291661159 conn(0x7f235c0abcc0 msgr2=0x7f235c0ac0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.445+0000 7f2360fd0640 1 -- 172.21.15.133:0/2291661159 shutdown_connections 2023-12-19T19:00:55.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.445+0000 7f2360fd0640 1 -- 172.21.15.133:0/2291661159 wait complete. 2023-12-19T19:00:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.445+0000 7f2360fd0640 1 Processor -- start 2023-12-19T19:00:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.445+0000 7f2360fd0640 1 -- start start 2023-12-19T19:00:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f2360fd0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f235c0bd3c0 0x7f235c1f1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f2360fd0640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f235c0c7c30 0x7f235c1ed450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f2360fd0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f235c151bb0 0x7f235c0a9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f2360fd0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c149010 con 0x7f235c151bb0 2023-12-19T19:00:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f2360fd0640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c14b860 con 0x7f235c0bd3c0 2023-12-19T19:00:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f2360fd0640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f235c1f09c0 con 0x7f235c0c7c30 2023-12-19T19:00:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f235bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f235c151bb0 0x7f235c0a9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f235bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f235c151bb0 0x7f235c0a9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39256/0 (socket says 172.21.15.133:39256) 2023-12-19T19:00:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f235bfff640 1 -- 172.21.15.133:0/2354457542 learned_addr learned my addr 172.21.15.133:0/2354457542 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f235affd640 1 --2- 172.21.15.133:0/2354457542 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f235c0c7c30 0x7f235c1ed450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f235b7fe640 1 --2- 172.21.15.133:0/2354457542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f235c0bd3c0 0x7f235c1f1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f235bfff640 1 -- 172.21.15.133:0/2354457542 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f235c0c7c30 msgr2=0x7f235c1ed450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:55.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f235bfff640 1 --2- 172.21.15.133:0/2354457542 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f235c0c7c30 0x7f235c1ed450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f235bfff640 1 -- 172.21.15.133:0/2354457542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f235c0bd3c0 msgr2=0x7f235c1f1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f235bfff640 1 --2- 172.21.15.133:0/2354457542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f235c0bd3c0 0x7f235c1f1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f235bfff640 1 -- 172.21.15.133:0/2354457542 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2350009420 con 0x7f235c151bb0 2023-12-19T19:00:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f235b7fe640 1 --2- 172.21.15.133:0/2354457542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f235c0bd3c0 0x7f235c1f1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f235bfff640 1 --2- 172.21.15.133:0/2354457542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f235c151bb0 0x7f235c0a9f60 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f235400c730 tx=0x7f235400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f2343fff640 1 -- 172.21.15.133:0/2354457542 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2354003b80 con 0x7f235c151bb0 2023-12-19T19:00:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f2343fff640 1 -- 172.21.15.133:0/2354457542 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2354003ce0 con 0x7f235c151bb0 2023-12-19T19:00:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f2360fd0640 1 -- 172.21.15.133:0/2354457542 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f235c1f0f80 con 0x7f235c151bb0 2023-12-19T19:00:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f2343fff640 1 -- 172.21.15.133:0/2354457542 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235400aa90 con 0x7f235c151bb0 2023-12-19T19:00:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f2360fd0640 1 -- 172.21.15.133:0/2354457542 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f235c06bf20 con 0x7f235c151bb0 2023-12-19T19:00:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f2360fd0640 1 -- 172.21.15.133:0/2354457542 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f235c067e90 con 0x7f235c151bb0 2023-12-19T19:00:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.449+0000 7f2343fff640 1 -- 172.21.15.133:0/2354457542 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f235400abf0 con 0x7f235c151bb0 2023-12-19T19:00:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.453+0000 7f2343fff640 1 --2- 172.21.15.133:0/2354457542 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2348066470 0x7f2348068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.453+0000 7f2343fff640 1 -- 172.21.15.133:0/2354457542 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2354083f10 con 0x7f235c151bb0 2023-12-19T19:00:55.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.453+0000 7f235b7fe640 1 --2- 172.21.15.133:0/2354457542 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2348066470 0x7f2348068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:55.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.453+0000 7f235b7fe640 1 --2- 172.21.15.133:0/2354457542 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2348066470 0x7f2348068930 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f234c0011f0 tx=0x7f234c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:55.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.457+0000 7f2343fff640 1 -- 172.21.15.133:0/2354457542 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f23540510c0 con 0x7f235c151bb0 2023-12-19T19:00:55.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.601+0000 7f2360fd0640 1 -- 172.21.15.133:0/2354457542 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f235c1f1110 con 0x7f235c151bb0 2023-12-19T19:00:55.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.605+0000 7f2343fff640 1 -- 172.21.15.133:0/2354457542 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f23540546e0 con 0x7f235c151bb0 2023-12-19T19:00:55.608 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:00:55.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.605+0000 7f2360fd0640 1 -- 172.21.15.133:0/2354457542 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2348066470 msgr2=0x7f2348068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:55.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.605+0000 7f2360fd0640 1 --2- 172.21.15.133:0/2354457542 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2348066470 0x7f2348068930 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f234c0011f0 tx=0x7f234c009040 comp rx=0 tx=0).stop 2023-12-19T19:00:55.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.605+0000 7f2360fd0640 1 -- 172.21.15.133:0/2354457542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f235c151bb0 msgr2=0x7f235c0a9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:55.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.605+0000 7f2360fd0640 1 --2- 172.21.15.133:0/2354457542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f235c151bb0 0x7f235c0a9f60 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f235400c730 tx=0x7f235400cbf0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.605+0000 7f2360fd0640 1 -- 172.21.15.133:0/2354457542 shutdown_connections 2023-12-19T19:00:55.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.605+0000 7f2360fd0640 1 --2- 172.21.15.133:0/2354457542 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2348066470 0x7f2348068930 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.605+0000 7f2360fd0640 1 --2- 172.21.15.133:0/2354457542 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f235c151bb0 0x7f235c0a9f60 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.605+0000 7f2360fd0640 1 --2- 172.21.15.133:0/2354457542 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f235c0c7c30 0x7f235c1ed450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.605+0000 7f2360fd0640 1 --2- 172.21.15.133:0/2354457542 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f235c0bd3c0 0x7f235c1f1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.605+0000 7f2360fd0640 1 -- 172.21.15.133:0/2354457542 >> 172.21.15.133:0/2354457542 conn(0x7f235c0abcc0 msgr2=0x7f235c14f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:55.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.605+0000 7f2360fd0640 1 -- 172.21.15.133:0/2354457542 shutdown_connections 2023-12-19T19:00:55.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.605+0000 7f2360fd0640 1 -- 172.21.15.133:0/2354457542 wait complete. 2023-12-19T19:00:55.628 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T19:00:55.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.769+0000 7f3308ec9640 1 Processor -- start 2023-12-19T19:00:55.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.769+0000 7f3308ec9640 1 -- start start 2023-12-19T19:00:55.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.769+0000 7f3308ec9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33040c5260 0x7f330406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:55.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.769+0000 7f3308ec9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3304155de0 0x7f3304156250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:55.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.769+0000 7f3308ec9640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33040c2580 con 0x7f33040c5640 2023-12-19T19:00:55.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.769+0000 7f3308ec9640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3304153510 con 0x7f3304155de0 2023-12-19T19:00:55.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.769+0000 7f3308ec9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33040c17f0 con 0x7f33040c5260 2023-12-19T19:00:55.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.769+0000 7f3302d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3304155de0 0x7f3304156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:55.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.769+0000 7f3302d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3304155de0 0x7f3304156250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39262/0 (socket says 172.21.15.133:39262) 2023-12-19T19:00:55.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.769+0000 7f3302d9d640 1 -- 172.21.15.133:0/2463964808 learned_addr learned my addr 172.21.15.133:0/2463964808 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:55.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.773+0000 7f330259c640 1 --2- 172.21.15.133:0/2463964808 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33040c5260 0x7f330406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:55.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.773+0000 7f3302d9d640 1 -- 172.21.15.133:0/2463964808 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33040c5260 msgr2=0x7f330406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:55.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.773+0000 7f3302d9d640 1 --2- 172.21.15.133:0/2463964808 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33040c5260 0x7f330406d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.773+0000 7f3302d9d640 1 -- 172.21.15.133:0/2463964808 >> v1:172.21.15.138:6789/0 conn(0x7f33040c5640 legacy=0x7f33040c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:55.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.773+0000 7f3302d9d640 1 -- 172.21.15.133:0/2463964808 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33040c1a00 con 0x7f3304155de0 2023-12-19T19:00:55.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.773+0000 7f330259c640 1 --2- 172.21.15.133:0/2463964808 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33040c5260 0x7f330406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:55.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.773+0000 7f3302d9d640 1 --2- 172.21.15.133:0/2463964808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3304155de0 0x7f3304156250 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f33040c1930 tx=0x7f32fc01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1560b7802bdc243a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:55.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.773+0000 7f3301d9b640 1 -- 172.21.15.133:0/2463964808 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc0a57f0 con 0x7f3304155de0 2023-12-19T19:00:55.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.773+0000 7f3301d9b640 1 -- 172.21.15.133:0/2463964808 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32fc0a5950 con 0x7f3304155de0 2023-12-19T19:00:55.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.773+0000 7f3301d9b640 1 -- 172.21.15.133:0/2463964808 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc0a5ce0 con 0x7f3304155de0 2023-12-19T19:00:55.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3308ec9640 1 -- 172.21.15.133:0/2463964808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3304155de0 msgr2=0x7f3304156250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:55.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3308ec9640 1 --2- 172.21.15.133:0/2463964808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3304155de0 0x7f3304156250 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f33040c1930 tx=0x7f32fc01c930 comp rx=0 tx=0).stop 2023-12-19T19:00:55.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3308ec9640 1 -- 172.21.15.133:0/2463964808 shutdown_connections 2023-12-19T19:00:55.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3308ec9640 1 --2- 172.21.15.133:0/2463964808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3304155de0 0x7f3304156250 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3308ec9640 1 --2- 172.21.15.133:0/2463964808 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33040c5260 0x7f330406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3308ec9640 1 -- 172.21.15.133:0/2463964808 >> 172.21.15.133:0/2463964808 conn(0x7f330406a5b0 msgr2=0x7f330406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:55.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3308ec9640 1 -- 172.21.15.133:0/2463964808 shutdown_connections 2023-12-19T19:00:55.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3308ec9640 1 -- 172.21.15.133:0/2463964808 wait complete. 2023-12-19T19:00:55.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3308ec9640 1 Processor -- start 2023-12-19T19:00:55.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3308ec9640 1 -- start start 2023-12-19T19:00:55.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3308ec9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33040c5260 0x7f3304157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:55.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3308ec9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33040c5640 0x7f33040c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:55.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3308ec9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3304155de0 0x7f33040a96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:55.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3308ec9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3304158120 con 0x7f3304155de0 2023-12-19T19:00:55.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3308ec9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330414f240 con 0x7f33040c5640 2023-12-19T19:00:55.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3308ec9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33041515b0 con 0x7f33040c5260 2023-12-19T19:00:55.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3302d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3304155de0 0x7f33040a96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:55.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3302d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3304155de0 0x7f33040a96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39272/0 (socket says 172.21.15.133:39272) 2023-12-19T19:00:55.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3302d9d640 1 -- 172.21.15.133:0/675178825 learned_addr learned my addr 172.21.15.133:0/675178825 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:55.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f330259c640 1 --2- 172.21.15.133:0/675178825 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33040c5260 0x7f3304157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:55.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f32fbfff640 1 --2- 172.21.15.133:0/675178825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33040c5640 0x7f33040c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:55.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3302d9d640 1 -- 172.21.15.133:0/675178825 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33040c5260 msgr2=0x7f3304157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3302d9d640 1 --2- 172.21.15.133:0/675178825 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33040c5260 0x7f3304157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3302d9d640 1 -- 172.21.15.133:0/675178825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33040c5640 msgr2=0x7f33040c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3302d9d640 1 --2- 172.21.15.133:0/675178825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33040c5640 0x7f33040c3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3302d9d640 1 -- 172.21.15.133:0/675178825 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32fc009b30 con 0x7f3304155de0 2023-12-19T19:00:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.777+0000 7f3302d9d640 1 --2- 172.21.15.133:0/675178825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3304155de0 0x7f33040a96a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f32fc01a560 tx=0x7f32fc0196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.781+0000 7f32faffd640 1 -- 172.21.15.133:0/675178825 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc0b8670 con 0x7f3304155de0 2023-12-19T19:00:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.781+0000 7f32faffd640 1 -- 172.21.15.133:0/675178825 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32fc0b87f0 con 0x7f3304155de0 2023-12-19T19:00:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.781+0000 7f32faffd640 1 -- 172.21.15.133:0/675178825 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32fc0b8ba0 con 0x7f3304155de0 2023-12-19T19:00:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.781+0000 7f3308ec9640 1 -- 172.21.15.133:0/675178825 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33041f0c00 con 0x7f3304155de0 2023-12-19T19:00:55.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.781+0000 7f3308ec9640 1 -- 172.21.15.133:0/675178825 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33041f0ee0 con 0x7f3304155de0 2023-12-19T19:00:55.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.781+0000 7f3308ec9640 1 -- 172.21.15.133:0/675178825 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3304068400 con 0x7f3304155de0 2023-12-19T19:00:55.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.781+0000 7f32faffd640 1 -- 172.21.15.133:0/675178825 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f32fc0b8d00 con 0x7f3304155de0 2023-12-19T19:00:55.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.781+0000 7f32faffd640 1 --2- 172.21.15.133:0/675178825 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f32e40664a0 0x7f32e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:55.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.781+0000 7f32faffd640 1 -- 172.21.15.133:0/675178825 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f32fc11f5a0 con 0x7f3304155de0 2023-12-19T19:00:55.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.781+0000 7f330259c640 1 --2- 172.21.15.133:0/675178825 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f32e40664a0 0x7f32e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:55.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.785+0000 7f330259c640 1 --2- 172.21.15.133:0/675178825 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f32e40664a0 0x7f32e4068960 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f32f40045f0 tx=0x7f32f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:55.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.785+0000 7f32faffd640 1 -- 172.21.15.133:0/675178825 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f32fc0ec880 con 0x7f3304155de0 2023-12-19T19:00:55.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.937+0000 7f3308ec9640 1 -- 172.21.15.133:0/675178825 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f330406d390 con 0x7f3304155de0 2023-12-19T19:00:55.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.937+0000 7f32faffd640 1 -- 172.21.15.133:0/675178825 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f32fc0efea0 con 0x7f3304155de0 2023-12-19T19:00:55.940 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:00:55.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.937+0000 7f3308ec9640 1 -- 172.21.15.133:0/675178825 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f32e40664a0 msgr2=0x7f32e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:55.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.937+0000 7f3308ec9640 1 --2- 172.21.15.133:0/675178825 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f32e40664a0 0x7f32e4068960 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f32f40045f0 tx=0x7f32f4008040 comp rx=0 tx=0).stop 2023-12-19T19:00:55.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.937+0000 7f3308ec9640 1 -- 172.21.15.133:0/675178825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3304155de0 msgr2=0x7f33040a96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:55.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.937+0000 7f3308ec9640 1 --2- 172.21.15.133:0/675178825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3304155de0 0x7f33040a96a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f32fc01a560 tx=0x7f32fc0196d0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.937+0000 7f3308ec9640 1 -- 172.21.15.133:0/675178825 shutdown_connections 2023-12-19T19:00:55.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.937+0000 7f3308ec9640 1 --2- 172.21.15.133:0/675178825 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f32e40664a0 0x7f32e4068960 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.937+0000 7f3308ec9640 1 --2- 172.21.15.133:0/675178825 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3304155de0 0x7f33040a96a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.937+0000 7f3308ec9640 1 --2- 172.21.15.133:0/675178825 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f33040c5640 0x7f33040c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.937+0000 7f3308ec9640 1 --2- 172.21.15.133:0/675178825 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f33040c5260 0x7f3304157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:55.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.937+0000 7f3308ec9640 1 -- 172.21.15.133:0/675178825 >> 172.21.15.133:0/675178825 conn(0x7f330406a5b0 msgr2=0x7f330406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:55.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.937+0000 7f3308ec9640 1 -- 172.21.15.133:0/675178825 shutdown_connections 2023-12-19T19:00:55.943 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:55.937+0000 7f3308ec9640 1 -- 172.21.15.133:0/675178825 wait complete. 2023-12-19T19:00:55.961 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-19T19:00:56.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.101+0000 7f9632d0f640 1 Processor -- start 2023-12-19T19:00:56.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.101+0000 7f9632d0f640 1 -- start start 2023-12-19T19:00:56.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.101+0000 7f9632d0f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f962c0a6df0 0x7f962c0c1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:56.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.101+0000 7f9632d0f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f962c0c1ec0 con 0x7f962c1555c0 2023-12-19T19:00:56.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.101+0000 7f9632d0f640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f962c0c28e0 con 0x7f962c0c61e0 2023-12-19T19:00:56.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.101+0000 7f9632d0f640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f962c0c3680 con 0x7f962c0a6df0 2023-12-19T19:00:56.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.101+0000 7f9630aab640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f962c1555c0 0x7f962c0c6730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58408/0 (socket says 172.21.15.133:58408) 2023-12-19T19:00:56.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.101+0000 7f9630aab640 1 -- 172.21.15.133:0/2322327455 learned_addr learned my addr 172.21.15.133:0/2322327455 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:56.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.101+0000 7f96312ac640 1 --2- 172.21.15.133:0/2322327455 >> v2:172.21.15.133:3300/0 conn(0x7f962c0a6df0 0x7f962c0c1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:56.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.105+0000 7f962b7fe640 1 -- 172.21.15.133:0/2322327455 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 812362222 0 0) 0x7f962c0c1ec0 con 0x7f962c1555c0 2023-12-19T19:00:56.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.105+0000 7f962b7fe640 1 -- 172.21.15.133:0/2322327455 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f961c003530 con 0x7f962c1555c0 2023-12-19T19:00:56.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.105+0000 7f96312ac640 1 -- 172.21.15.133:0/2322327455 >> v1:172.21.15.138:6789/0 conn(0x7f962c0c61e0 legacy=0x7f962c0c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:56.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.105+0000 7f96312ac640 1 -- 172.21.15.133:0/2322327455 >> v1:172.21.15.133:6789/0 conn(0x7f962c1555c0 legacy=0x7f962c0c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:56.108 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.105+0000 7f96312ac640 1 -- 172.21.15.133:0/2322327455 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f962c0c2b80 con 0x7f962c0a6df0 2023-12-19T19:00:56.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.105+0000 7f96312ac640 1 --2- 172.21.15.133:0/2322327455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f962c0a6df0 0x7f962c0c1980 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9624009d90 tx=0x7f962401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1166d0dd2499ca62 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:56.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.105+0000 7f962b7fe640 1 -- 172.21.15.133:0/2322327455 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96240a5890 con 0x7f962c0a6df0 2023-12-19T19:00:56.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.105+0000 7f962b7fe640 1 -- 172.21.15.133:0/2322327455 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96240a59f0 con 0x7f962c0a6df0 2023-12-19T19:00:56.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.105+0000 7f962b7fe640 1 -- 172.21.15.133:0/2322327455 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96240a5d80 con 0x7f962c0a6df0 2023-12-19T19:00:56.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9632d0f640 1 -- 172.21.15.133:0/2322327455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f962c0a6df0 msgr2=0x7f962c0c1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:56.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9632d0f640 1 --2- 172.21.15.133:0/2322327455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f962c0a6df0 0x7f962c0c1980 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9624009d90 tx=0x7f962401c950 comp rx=0 tx=0).stop 2023-12-19T19:00:56.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9632d0f640 1 -- 172.21.15.133:0/2322327455 shutdown_connections 2023-12-19T19:00:56.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9632d0f640 1 --2- 172.21.15.133:0/2322327455 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f962c0a6df0 0x7f962c0c1980 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9632d0f640 1 -- 172.21.15.133:0/2322327455 >> 172.21.15.133:0/2322327455 conn(0x7f962c0c7e40 msgr2=0x7f962c0c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:56.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9632d0f640 1 -- 172.21.15.133:0/2322327455 shutdown_connections 2023-12-19T19:00:56.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9632d0f640 1 -- 172.21.15.133:0/2322327455 wait complete. 2023-12-19T19:00:56.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9632d0f640 1 Processor -- start 2023-12-19T19:00:56.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9632d0f640 1 -- start start 2023-12-19T19:00:56.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9632d0f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f962c0a6df0 0x7f962c1585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:56.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9632d0f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f962c0c61e0 0x7f962c1ed180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:56.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9632d0f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f962c1555c0 0x7f962c1ed6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:56.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9632d0f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c145bf0 con 0x7f962c0a6df0 2023-12-19T19:00:56.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9632d0f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962c145e40 con 0x7f962c1555c0 2023-12-19T19:00:56.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9632d0f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962c146120 con 0x7f962c0c61e0 2023-12-19T19:00:56.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9630aab640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f962c0a6df0 0x7f962c1585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:56.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9630aab640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f962c0a6df0 0x7f962c1585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39300/0 (socket says 172.21.15.133:39300) 2023-12-19T19:00:56.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9630aab640 1 -- 172.21.15.133:0/804003142 learned_addr learned my addr 172.21.15.133:0/804003142 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:56.115 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9630aab640 1 -- 172.21.15.133:0/804003142 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f962c0c61e0 msgr2=0x7f962c1ed180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:56.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9630aab640 1 --2- 172.21.15.133:0/804003142 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f962c0c61e0 0x7f962c1ed180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9630aab640 1 -- 172.21.15.133:0/804003142 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f962c1555c0 msgr2=0x7f962c1ed6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:56.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9630aab640 1 --2- 172.21.15.133:0/804003142 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f962c1555c0 0x7f962c1ed6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9630aab640 1 -- 172.21.15.133:0/804003142 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9624009a70 con 0x7f962c0a6df0 2023-12-19T19:00:56.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9630aab640 1 --2- 172.21.15.133:0/804003142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f962c0a6df0 0x7f962c1585c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f962000c4d0 tx=0x7f962000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:56.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f96297fa640 1 -- 172.21.15.133:0/804003142 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9620005cf0 con 0x7f962c0a6df0 2023-12-19T19:00:56.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f96297fa640 1 -- 172.21.15.133:0/804003142 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9620005e50 con 0x7f962c0a6df0 2023-12-19T19:00:56.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.109+0000 7f9632d0f640 1 -- 172.21.15.133:0/804003142 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f962c146400 con 0x7f962c0a6df0 2023-12-19T19:00:56.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.113+0000 7f96297fa640 1 -- 172.21.15.133:0/804003142 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9620007270 con 0x7f962c0a6df0 2023-12-19T19:00:56.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.113+0000 7f9632d0f640 1 -- 172.21.15.133:0/804003142 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f962c1469c0 con 0x7f962c0a6df0 2023-12-19T19:00:56.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.113+0000 7f9632d0f640 1 -- 172.21.15.133:0/804003142 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962c0676f0 con 0x7f962c0a6df0 2023-12-19T19:00:56.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.113+0000 7f96297fa640 1 -- 172.21.15.133:0/804003142 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f96200073d0 con 0x7f962c0a6df0 2023-12-19T19:00:56.117 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.113+0000 7f96297fa640 1 --2- 172.21.15.133:0/804003142 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9610066470 0x7f9610068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:56.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.113+0000 7f96297fa640 1 -- 172.21.15.133:0/804003142 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9620083730 con 0x7f962c0a6df0 2023-12-19T19:00:56.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.113+0000 7f962bfff640 1 --2- 172.21.15.133:0/804003142 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9610066470 0x7f9610068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:56.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.113+0000 7f962bfff640 1 --2- 172.21.15.133:0/804003142 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9610066470 0x7f9610068930 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9618000f70 tx=0x7f96180079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:56.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.117+0000 7f96297fa640 1 -- 172.21.15.133:0/804003142 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9620050860 con 0x7f962c0a6df0 2023-12-19T19:00:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.269+0000 7f9632d0f640 1 -- 172.21.15.133:0/804003142 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f962c068400 con 0x7f962c0a6df0 2023-12-19T19:00:56.275 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.273+0000 7f96297fa640 1 -- 172.21.15.133:0/804003142 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7f9620053e80 con 0x7f962c0a6df0 2023-12-19T19:00:56.276 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:00:56.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.273+0000 7f9632d0f640 1 -- 172.21.15.133:0/804003142 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9610066470 msgr2=0x7f9610068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:56.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.273+0000 7f9632d0f640 1 --2- 172.21.15.133:0/804003142 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9610066470 0x7f9610068930 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9618000f70 tx=0x7f96180079c0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.273+0000 7f9632d0f640 1 -- 172.21.15.133:0/804003142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f962c0a6df0 msgr2=0x7f962c1585c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.273+0000 7f9632d0f640 1 --2- 172.21.15.133:0/804003142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f962c0a6df0 0x7f962c1585c0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f962000c4d0 tx=0x7f962000c990 comp rx=0 tx=0).stop 2023-12-19T19:00:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.273+0000 7f9632d0f640 1 -- 172.21.15.133:0/804003142 shutdown_connections 2023-12-19T19:00:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.273+0000 7f9632d0f640 1 --2- 172.21.15.133:0/804003142 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9610066470 0x7f9610068930 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.273+0000 7f9632d0f640 1 --2- 172.21.15.133:0/804003142 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f962c1555c0 0x7f962c1ed6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.273+0000 7f9632d0f640 1 --2- 172.21.15.133:0/804003142 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f962c0c61e0 0x7f962c1ed180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.273+0000 7f9632d0f640 1 --2- 172.21.15.133:0/804003142 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f962c0a6df0 0x7f962c1585c0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.273+0000 7f9632d0f640 1 -- 172.21.15.133:0/804003142 >> 172.21.15.133:0/804003142 conn(0x7f962c0c7e40 msgr2=0x7f962c0c1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.273+0000 7f9632d0f640 1 -- 172.21.15.133:0/804003142 shutdown_connections 2023-12-19T19:00:56.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.273+0000 7f9632d0f640 1 -- 172.21.15.133:0/804003142 wait complete. 2023-12-19T19:00:56.297 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-19T19:00:56.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.433+0000 7f38ae05a640 1 Processor -- start 2023-12-19T19:00:56.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.433+0000 7f38ae05a640 1 -- start start 2023-12-19T19:00:56.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.433+0000 7f38ae05a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f38a80a5370 0x7f38a80c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:56.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.437+0000 7f38ae05a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a80c2760 con 0x7f38a80c4110 2023-12-19T19:00:56.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.437+0000 7f38ae05a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a80a5750 con 0x7f38a8072090 2023-12-19T19:00:56.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.437+0000 7f38ae05a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38a80c3070 con 0x7f38a80a5370 2023-12-19T19:00:56.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.437+0000 7f38a77fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f38a80a5370 0x7f38a80c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:56.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.437+0000 7f38a6ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f38a80c4110 0x7f38a8150fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58424/0 (socket says 172.21.15.133:58424) 2023-12-19T19:00:56.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.437+0000 7f38a6ffd640 1 -- 172.21.15.133:0/351108756 learned_addr learned my addr 172.21.15.133:0/351108756 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:56.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.437+0000 7f38a77fe640 1 -- 172.21.15.133:0/351108756 >> v1:172.21.15.138:6789/0 conn(0x7f38a8072090 legacy=0x7f38a815b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:56.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.437+0000 7f38a77fe640 1 -- 172.21.15.133:0/351108756 >> v1:172.21.15.133:6789/0 conn(0x7f38a80c4110 legacy=0x7f38a8150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:56.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.437+0000 7f38a77fe640 1 -- 172.21.15.133:0/351108756 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a80aad20 con 0x7f38a80a5370 2023-12-19T19:00:56.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.437+0000 7f38a77fe640 1 --2- 172.21.15.133:0/351108756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a80a5370 0x7f38a80c3bd0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f38980097c0 tx=0x7f389801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e9bb2afe5730e1b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:56.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.437+0000 7f38a67fc640 1 -- 172.21.15.133:0/351108756 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38980ab600 con 0x7f38a80a5370 2023-12-19T19:00:56.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.437+0000 7f38a67fc640 1 -- 172.21.15.133:0/351108756 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38980a7050 con 0x7f38a80a5370 2023-12-19T19:00:56.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.437+0000 7f38a67fc640 1 -- 172.21.15.133:0/351108756 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38980ab980 con 0x7f38a80a5370 2023-12-19T19:00:56.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.441+0000 7f38ae05a640 1 -- 172.21.15.133:0/351108756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a80a5370 msgr2=0x7f38a80c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:56.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.441+0000 7f38ae05a640 1 --2- 172.21.15.133:0/351108756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a80a5370 0x7f38a80c3bd0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f38980097c0 tx=0x7f389801c330 comp rx=0 tx=0).stop 2023-12-19T19:00:56.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.441+0000 7f38ae05a640 1 -- 172.21.15.133:0/351108756 shutdown_connections 2023-12-19T19:00:56.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.441+0000 7f38ae05a640 1 --2- 172.21.15.133:0/351108756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a80a5370 0x7f38a80c3bd0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.441+0000 7f38ae05a640 1 -- 172.21.15.133:0/351108756 >> 172.21.15.133:0/351108756 conn(0x7f38a806a5b0 msgr2=0x7f38a806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:56.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.441+0000 7f38ae05a640 1 -- 172.21.15.133:0/351108756 shutdown_connections 2023-12-19T19:00:56.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.441+0000 7f38ae05a640 1 -- 172.21.15.133:0/351108756 wait complete. 2023-12-19T19:00:56.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.441+0000 7f38ae05a640 1 Processor -- start 2023-12-19T19:00:56.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.441+0000 7f38ae05a640 1 -- start start 2023-12-19T19:00:56.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.441+0000 7f38ae05a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38a8072090 0x7f38a8071230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:56.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.441+0000 7f38ae05a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38a80a5370 0x7f38a814baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:56.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.441+0000 7f38ae05a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a80c4110 0x7f38a814bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:56.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.441+0000 7f38ae05a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a814b3f0 con 0x7f38a80c4110 2023-12-19T19:00:56.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.441+0000 7f38ae05a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a814b880 con 0x7f38a80a5370 2023-12-19T19:00:56.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.441+0000 7f38ae05a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a814c520 con 0x7f38a8072090 2023-12-19T19:00:56.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.441+0000 7f38a7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a80c4110 0x7f38a814bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:56.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.441+0000 7f38a7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a80c4110 0x7f38a814bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39322/0 (socket says 172.21.15.133:39322) 2023-12-19T19:00:56.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.441+0000 7f38a7fff640 1 -- 172.21.15.133:0/2034251096 learned_addr learned my addr 172.21.15.133:0/2034251096 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:56.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.441+0000 7f38a77fe640 1 --2- 172.21.15.133:0/2034251096 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38a8072090 0x7f38a8071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:56.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.441+0000 7f38a6ffd640 1 --2- 172.21.15.133:0/2034251096 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38a80a5370 0x7f38a814baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:56.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.445+0000 7f38a7fff640 1 -- 172.21.15.133:0/2034251096 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38a8072090 msgr2=0x7f38a8071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:56.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.445+0000 7f38a7fff640 1 --2- 172.21.15.133:0/2034251096 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38a8072090 0x7f38a8071230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.445+0000 7f38a7fff640 1 -- 172.21.15.133:0/2034251096 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38a80a5370 msgr2=0x7f38a814baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:56.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.445+0000 7f38a7fff640 1 --2- 172.21.15.133:0/2034251096 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38a80a5370 0x7f38a814baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.445+0000 7f38a7fff640 1 -- 172.21.15.133:0/2034251096 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3898009420 con 0x7f38a80c4110 2023-12-19T19:00:56.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.445+0000 7f38a7fff640 1 --2- 172.21.15.133:0/2034251096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a80c4110 0x7f38a814bfe0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f38a000c730 tx=0x7f38a000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:56.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.445+0000 7f388ffff640 1 -- 172.21.15.133:0/2034251096 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0003b80 con 0x7f38a80c4110 2023-12-19T19:00:56.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.445+0000 7f388ffff640 1 -- 172.21.15.133:0/2034251096 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38a0003ce0 con 0x7f38a80c4110 2023-12-19T19:00:56.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.445+0000 7f388ffff640 1 -- 172.21.15.133:0/2034251096 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a000aa30 con 0x7f38a80c4110 2023-12-19T19:00:56.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.445+0000 7f38ae05a640 1 -- 172.21.15.133:0/2034251096 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a815c820 con 0x7f38a80c4110 2023-12-19T19:00:56.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.445+0000 7f38ae05a640 1 -- 172.21.15.133:0/2034251096 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a814ada0 con 0x7f38a80c4110 2023-12-19T19:00:56.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.445+0000 7f38ae05a640 1 -- 172.21.15.133:0/2034251096 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a814ac00 con 0x7f38a80c4110 2023-12-19T19:00:56.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.445+0000 7f388ffff640 1 -- 172.21.15.133:0/2034251096 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f38a000ab90 con 0x7f38a80c4110 2023-12-19T19:00:56.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.445+0000 7f388ffff640 1 --2- 172.21.15.133:0/2034251096 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f38940664a0 0x7f3894068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:56.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.445+0000 7f388ffff640 1 -- 172.21.15.133:0/2034251096 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f38a0083d80 con 0x7f38a80c4110 2023-12-19T19:00:56.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.445+0000 7f38a77fe640 1 --2- 172.21.15.133:0/2034251096 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f38940664a0 0x7f3894068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:56.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.449+0000 7f38a77fe640 1 --2- 172.21.15.133:0/2034251096 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f38940664a0 0x7f3894068960 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f38980ad000 tx=0x7f3898008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:56.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.449+0000 7f388ffff640 1 -- 172.21.15.133:0/2034251096 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f38a814ac00 con 0x7f38a80c4110 2023-12-19T19:00:56.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.597+0000 7f38ae05a640 1 -- 172.21.15.133:0/2034251096 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f38a814b5a0 con 0x7f38a80c4110 2023-12-19T19:00:56.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.597+0000 7f388ffff640 1 -- 172.21.15.133:0/2034251096 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7f38a814b5a0 con 0x7f38a80c4110 2023-12-19T19:00:56.603 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:00:56.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.601+0000 7f38ae05a640 1 -- 172.21.15.133:0/2034251096 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f38940664a0 msgr2=0x7f3894068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:56.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.601+0000 7f38ae05a640 1 --2- 172.21.15.133:0/2034251096 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f38940664a0 0x7f3894068960 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f38980ad000 tx=0x7f3898008040 comp rx=0 tx=0).stop 2023-12-19T19:00:56.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.601+0000 7f38ae05a640 1 -- 172.21.15.133:0/2034251096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a80c4110 msgr2=0x7f38a814bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:56.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.601+0000 7f38ae05a640 1 --2- 172.21.15.133:0/2034251096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a80c4110 0x7f38a814bfe0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f38a000c730 tx=0x7f38a000cbf0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.601+0000 7f38ae05a640 1 -- 172.21.15.133:0/2034251096 shutdown_connections 2023-12-19T19:00:56.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.601+0000 7f38ae05a640 1 --2- 172.21.15.133:0/2034251096 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f38940664a0 0x7f3894068960 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.601+0000 7f38ae05a640 1 --2- 172.21.15.133:0/2034251096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f38a80c4110 0x7f38a814bfe0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.601+0000 7f38ae05a640 1 --2- 172.21.15.133:0/2034251096 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f38a80a5370 0x7f38a814baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.601+0000 7f38ae05a640 1 --2- 172.21.15.133:0/2034251096 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f38a8072090 0x7f38a8071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.601+0000 7f38ae05a640 1 -- 172.21.15.133:0/2034251096 >> 172.21.15.133:0/2034251096 conn(0x7f38a806a5b0 msgr2=0x7f38a814e320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:56.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.601+0000 7f38ae05a640 1 -- 172.21.15.133:0/2034251096 shutdown_connections 2023-12-19T19:00:56.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.601+0000 7f38ae05a640 1 -- 172.21.15.133:0/2034251096 wait complete. 2023-12-19T19:00:56.625 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T19:00:56.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1b1957640 1 Processor -- start 2023-12-19T19:00:56.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1b1957640 1 -- start start 2023-12-19T19:00:56.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1b1957640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb1ac072090 0x7fb1ac150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:56.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1b1957640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac0c2760 con 0x7fb1ac0725c0 2023-12-19T19:00:56.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1b1957640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac0a5750 con 0x7fb1ac0a5370 2023-12-19T19:00:56.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1b1957640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ac0c3070 con 0x7fb1ac072090 2023-12-19T19:00:56.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1ab7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb1ac0725c0 0x7fb1ac1514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58434/0 (socket says 172.21.15.133:58434) 2023-12-19T19:00:56.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1ab7fe640 1 -- 172.21.15.133:0/3683208317 learned_addr learned my addr 172.21.15.133:0/3683208317 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:56.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1aa7fc640 1 --2- 172.21.15.133:0/3683208317 >> v2:172.21.15.138:3300/0 conn(0x7fb1ac072090 0x7fb1ac150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:56.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1a9ffb640 1 -- 172.21.15.133:0/3683208317 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134025577 0 0) 0x7fb1ac0c2760 con 0x7fb1ac0725c0 2023-12-19T19:00:56.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1a9ffb640 1 -- 172.21.15.133:0/3683208317 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb194003530 con 0x7fb1ac0725c0 2023-12-19T19:00:56.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1a9ffb640 1 -- 172.21.15.133:0/3683208317 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629870345 0 0) 0x7fb1ac0a5750 con 0x7fb1ac0a5370 2023-12-19T19:00:56.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1a9ffb640 1 -- 172.21.15.133:0/3683208317 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1ac0c2760 con 0x7fb1ac0a5370 2023-12-19T19:00:56.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1a9ffb640 1 -- 172.21.15.133:0/3683208317 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2369148128 0 0) 0x7fb194003530 con 0x7fb1ac0725c0 2023-12-19T19:00:56.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1a9ffb640 1 -- 172.21.15.133:0/3683208317 >> v2:172.21.15.138:3300/0 conn(0x7fb1ac072090 msgr2=0x7fb1ac150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:56.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1a9ffb640 1 --2- 172.21.15.133:0/3683208317 >> v2:172.21.15.138:3300/0 conn(0x7fb1ac072090 0x7fb1ac150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1a9ffb640 1 -- 172.21.15.133:0/3683208317 >> v1:172.21.15.138:6789/0 conn(0x7fb1ac0a5370 legacy=0x7fb1ac0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:56.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1a9ffb640 1 -- 172.21.15.133:0/3683208317 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac0aad20 con 0x7fb1ac0725c0 2023-12-19T19:00:56.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1a9ffb640 1 -- 172.21.15.133:0/3683208317 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7fb1a4001980 con 0x7fb1ac0725c0 2023-12-19T19:00:56.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1a9ffb640 1 -- 172.21.15.133:0/3683208317 >> v1:172.21.15.133:6789/0 conn(0x7fb1ac0725c0 legacy=0x7fb1ac1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:56.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1a9ffb640 1 --2- 172.21.15.133:0/3683208317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb194003b60 0x7fb194003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:56.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1a9ffb640 1 --2- 172.21.15.133:0/3683208317 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1940047d0 0x7fb194004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:56.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1a9ffb640 1 --2- 172.21.15.133:0/3683208317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb194005250 0x7fb19400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:56.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1a9ffb640 1 -- 172.21.15.133:0/3683208317 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac0c3070 con 0x7fb194003b60 2023-12-19T19:00:56.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1a9ffb640 1 -- 172.21.15.133:0/3683208317 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19400c190 con 0x7fb194005250 2023-12-19T19:00:56.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1a9ffb640 1 -- 172.21.15.133:0/3683208317 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19400c350 con 0x7fb1940047d0 2023-12-19T19:00:56.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1aaffd640 1 --2- 172.21.15.133:0/3683208317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb194003b60 0x7fb194003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:56.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1ab7fe640 1 --2- 172.21.15.133:0/3683208317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb194005250 0x7fb19400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:56.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1aa7fc640 1 --2- 172.21.15.133:0/3683208317 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1940047d0 0x7fb194004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:56.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1aaffd640 1 -- 172.21.15.133:0/3683208317 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1940047d0 msgr2=0x7fb194004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:56.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1aaffd640 1 --2- 172.21.15.133:0/3683208317 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1940047d0 0x7fb194004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1aaffd640 1 -- 172.21.15.133:0/3683208317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb194005250 msgr2=0x7fb19400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:56.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1aaffd640 1 --2- 172.21.15.133:0/3683208317 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb194005250 0x7fb19400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1aaffd640 1 -- 172.21.15.133:0/3683208317 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb194003530 con 0x7fb194003b60 2023-12-19T19:00:56.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.765+0000 7fb1ab7fe640 1 -- 172.21.15.133:0/3683208317 reap_dead start 2023-12-19T19:00:56.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.769+0000 7fb1aaffd640 1 --2- 172.21.15.133:0/3683208317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb194003b60 0x7fb194003f60 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0018d0 tx=0x7fb19c01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e33be227549d70 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:56.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.769+0000 7fb1a9ffb640 1 -- 172.21.15.133:0/3683208317 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c0052d0 con 0x7fb194003b60 2023-12-19T19:00:56.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.769+0000 7fb1a9ffb640 1 -- 172.21.15.133:0/3683208317 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c005450 con 0x7fb194003b60 2023-12-19T19:00:56.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.769+0000 7fb1a9ffb640 1 -- 172.21.15.133:0/3683208317 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c003840 con 0x7fb194003b60 2023-12-19T19:00:56.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.769+0000 7fb1b1957640 1 -- 172.21.15.133:0/3683208317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb194003b60 msgr2=0x7fb194003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:56.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.769+0000 7fb1b1957640 1 --2- 172.21.15.133:0/3683208317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb194003b60 0x7fb194003f60 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0018d0 tx=0x7fb19c01c510 comp rx=0 tx=0).stop 2023-12-19T19:00:56.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.769+0000 7fb1b1957640 1 -- 172.21.15.133:0/3683208317 shutdown_connections 2023-12-19T19:00:56.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.769+0000 7fb1b1957640 1 --2- 172.21.15.133:0/3683208317 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb194003b60 0x7fb194003f60 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.769+0000 7fb1b1957640 1 -- 172.21.15.133:0/3683208317 >> 172.21.15.133:0/3683208317 conn(0x7fb1ac06a5b0 msgr2=0x7fb1ac06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:56.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.769+0000 7fb1b1957640 1 -- 172.21.15.133:0/3683208317 shutdown_connections 2023-12-19T19:00:56.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.769+0000 7fb1b1957640 1 -- 172.21.15.133:0/3683208317 wait complete. 2023-12-19T19:00:56.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb1b1957640 1 Processor -- start 2023-12-19T19:00:56.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb1b1957640 1 -- start start 2023-12-19T19:00:56.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb1b1957640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb194003b60 0x7fb1ac1473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:56.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb1b1957640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1ac143c70 0x7fb1ac071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:56.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb1b1957640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1ac0716b0 0x7fb1ac142770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:56.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb1b1957640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac071b30 con 0x7fb1ac0716b0 2023-12-19T19:00:56.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb1b1957640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac147fe0 con 0x7fb194003b60 2023-12-19T19:00:56.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb1b1957640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac1ed220 con 0x7fb1ac143c70 2023-12-19T19:00:56.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb1ab7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1ac0716b0 0x7fb1ac142770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:56.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb1ab7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1ac0716b0 0x7fb1ac142770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39328/0 (socket says 172.21.15.133:39328) 2023-12-19T19:00:56.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb1ab7fe640 1 -- 172.21.15.133:0/3745493344 learned_addr learned my addr 172.21.15.133:0/3745493344 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:56.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb1aaffd640 1 --2- 172.21.15.133:0/3745493344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb194003b60 0x7fb1ac1473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:56.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb1aa7fc640 1 --2- 172.21.15.133:0/3745493344 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1ac143c70 0x7fb1ac071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:56.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb1ab7fe640 1 -- 172.21.15.133:0/3745493344 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1ac143c70 msgr2=0x7fb1ac071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:56.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb1ab7fe640 1 --2- 172.21.15.133:0/3745493344 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1ac143c70 0x7fb1ac071170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb1ab7fe640 1 -- 172.21.15.133:0/3745493344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb194003b60 msgr2=0x7fb1ac1473f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:56.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb1ab7fe640 1 --2- 172.21.15.133:0/3745493344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb194003b60 0x7fb1ac1473f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb1ab7fe640 1 -- 172.21.15.133:0/3745493344 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac1ed500 con 0x7fb1ac0716b0 2023-12-19T19:00:56.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb1ab7fe640 1 --2- 172.21.15.133:0/3745493344 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1ac0716b0 0x7fb1ac142770 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4001340 tx=0x7fb1a4007a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:56.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb193fff640 1 -- 172.21.15.133:0/3745493344 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a400f970 con 0x7fb1ac0716b0 2023-12-19T19:00:56.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb193fff640 1 -- 172.21.15.133:0/3745493344 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a400faf0 con 0x7fb1ac0716b0 2023-12-19T19:00:56.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb193fff640 1 -- 172.21.15.133:0/3745493344 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a400fea0 con 0x7fb1ac0716b0 2023-12-19T19:00:56.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb1b1957640 1 -- 172.21.15.133:0/3745493344 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ac1ed7e0 con 0x7fb1ac0716b0 2023-12-19T19:00:56.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.773+0000 7fb1b1957640 1 -- 172.21.15.133:0/3745493344 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ac147930 con 0x7fb1ac0716b0 2023-12-19T19:00:56.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.777+0000 7fb1b1957640 1 -- 172.21.15.133:0/3745493344 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1ac068400 con 0x7fb1ac0716b0 2023-12-19T19:00:56.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.777+0000 7fb193fff640 1 -- 172.21.15.133:0/3745493344 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb1a401d460 con 0x7fb1ac0716b0 2023-12-19T19:00:56.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.777+0000 7fb193fff640 1 --2- 172.21.15.133:0/3745493344 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb1980664a0 0x7fb198068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:56.784 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.777+0000 7fb193fff640 1 -- 172.21.15.133:0/3745493344 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb1a40841d0 con 0x7fb1ac0716b0 2023-12-19T19:00:56.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.777+0000 7fb1aaffd640 1 --2- 172.21.15.133:0/3745493344 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb1980664a0 0x7fb198068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:56.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.777+0000 7fb1aaffd640 1 --2- 172.21.15.133:0/3745493344 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb1980664a0 0x7fb198068960 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0ad000 tx=0x7fb19c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:56.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.781+0000 7fb193fff640 1 -- 172.21.15.133:0/3745493344 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb1a4051380 con 0x7fb1ac0716b0 2023-12-19T19:00:56.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.945+0000 7fb1b1957640 1 -- 172.21.15.133:0/3745493344 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb1ac0c6780 con 0x7fb1ac0716b0 2023-12-19T19:00:56.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.945+0000 7fb193fff640 1 -- 172.21.15.133:0/3745493344 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb1a40549a0 con 0x7fb1ac0716b0 2023-12-19T19:00:56.949 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-19T19:00:56.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.949+0000 7fb1b1957640 1 -- 172.21.15.133:0/3745493344 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb1980664a0 msgr2=0x7fb198068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:56.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.949+0000 7fb1b1957640 1 --2- 172.21.15.133:0/3745493344 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb1980664a0 0x7fb198068960 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0ad000 tx=0x7fb19c0a7000 comp rx=0 tx=0).stop 2023-12-19T19:00:56.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.949+0000 7fb1b1957640 1 -- 172.21.15.133:0/3745493344 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1ac0716b0 msgr2=0x7fb1ac142770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:56.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.949+0000 7fb1b1957640 1 --2- 172.21.15.133:0/3745493344 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1ac0716b0 0x7fb1ac142770 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4001340 tx=0x7fb1a4007a60 comp rx=0 tx=0).stop 2023-12-19T19:00:56.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.949+0000 7fb1b1957640 1 -- 172.21.15.133:0/3745493344 shutdown_connections 2023-12-19T19:00:56.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.949+0000 7fb1b1957640 1 --2- 172.21.15.133:0/3745493344 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb1980664a0 0x7fb198068960 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.949+0000 7fb1b1957640 1 --2- 172.21.15.133:0/3745493344 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1ac0716b0 0x7fb1ac142770 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.949+0000 7fb1b1957640 1 --2- 172.21.15.133:0/3745493344 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1ac143c70 0x7fb1ac071170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.949+0000 7fb1b1957640 1 --2- 172.21.15.133:0/3745493344 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb194003b60 0x7fb1ac1473f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:56.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.949+0000 7fb1b1957640 1 -- 172.21.15.133:0/3745493344 >> 172.21.15.133:0/3745493344 conn(0x7fb1ac06a5b0 msgr2=0x7fb1ac1447e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:56.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.949+0000 7fb1b1957640 1 -- 172.21.15.133:0/3745493344 shutdown_connections 2023-12-19T19:00:56.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:56.949+0000 7fb1b1957640 1 -- 172.21.15.133:0/3745493344 wait complete. 2023-12-19T19:00:56.971 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T19:00:56.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:56.971 DEBUG:teuthology.orchestra.run.smithi138:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T19:00:57.002 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi138.front.sepia.ceph.com 2023-12-19T19:00:57.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:57.002 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T19:00:57.053 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:00:57.053 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:00:57.104 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3612 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-19T19:00:57.104 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T19:00:57.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.237+0000 7f529f7c4640 1 Processor -- start 2023-12-19T19:00:57.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.237+0000 7f529f7c4640 1 -- start start 2023-12-19T19:00:57.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.237+0000 7f529f7c4640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f52980c5640 0x7f52980c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:57.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.237+0000 7f529f7c4640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52980c2580 con 0x7f52980c5260 2023-12-19T19:00:57.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.237+0000 7f529f7c4640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52980c1a00 con 0x7f52980c60f0 2023-12-19T19:00:57.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.237+0000 7f529f7c4640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5298153510 con 0x7f52980c5640 2023-12-19T19:00:57.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.237+0000 7f529d560640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f52980c5260 0x7f529806d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58436/0 (socket says 172.21.15.133:58436) 2023-12-19T19:00:57.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.237+0000 7f529d560640 1 -- 172.21.15.133:0/2881253165 learned_addr learned my addr 172.21.15.133:0/2881253165 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:57.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f528ffff640 1 -- 172.21.15.133:0/2881253165 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189026757 0 0) 0x7f52980c2580 con 0x7f52980c5260 2023-12-19T19:00:57.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f528ffff640 1 -- 172.21.15.133:0/2881253165 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5284003530 con 0x7f52980c5260 2023-12-19T19:00:57.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f529cd5f640 1 --2- 172.21.15.133:0/2881253165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f52980c5640 0x7f52980c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:57.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f528ffff640 1 -- 172.21.15.133:0/2881253165 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 770325888 0 0) 0x7f5284003530 con 0x7f52980c5260 2023-12-19T19:00:57.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f528ffff640 1 -- 172.21.15.133:0/2881253165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f52980c5640 msgr2=0x7f52980c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:57.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f528ffff640 1 --2- 172.21.15.133:0/2881253165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f52980c5640 0x7f52980c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:57.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f528ffff640 1 -- 172.21.15.133:0/2881253165 >> v1:172.21.15.138:6789/0 conn(0x7f52980c60f0 legacy=0x7f5298155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f528ffff640 1 -- 172.21.15.133:0/2881253165 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52980c1ce0 con 0x7f52980c5260 2023-12-19T19:00:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f528ffff640 1 -- 172.21.15.133:0/2881253165 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f5294001680 con 0x7f52980c5260 2023-12-19T19:00:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f528ffff640 1 -- 172.21.15.133:0/2881253165 >> v1:172.21.15.133:6789/0 conn(0x7f52980c5260 legacy=0x7f529806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f528ffff640 1 --2- 172.21.15.133:0/2881253165 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52840039b0 0x7f5284003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f528ffff640 1 --2- 172.21.15.133:0/2881253165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f52980c5640 0x7f52840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f528ffff640 1 --2- 172.21.15.133:0/2881253165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5284004d10 0x7f5284005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f528ffff640 1 -- 172.21.15.133:0/2881253165 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528400bbe0 con 0x7f5284004d10 2023-12-19T19:00:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f528ffff640 1 -- 172.21.15.133:0/2881253165 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f528400bd50 con 0x7f52840039b0 2023-12-19T19:00:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f528ffff640 1 -- 172.21.15.133:0/2881253165 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f528400bf10 con 0x7f52980c5640 2023-12-19T19:00:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f529dd61640 1 --2- 172.21.15.133:0/2881253165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5284004d10 0x7f5284005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f529d560640 1 --2- 172.21.15.133:0/2881253165 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52840039b0 0x7f5284003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f529cd5f640 1 --2- 172.21.15.133:0/2881253165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f52980c5640 0x7f52840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f529dd61640 1 -- 172.21.15.133:0/2881253165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f52980c5640 msgr2=0x7f52840047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f529dd61640 1 --2- 172.21.15.133:0/2881253165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f52980c5640 0x7f52840047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:57.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f529dd61640 1 -- 172.21.15.133:0/2881253165 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52840039b0 msgr2=0x7f5284003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:57.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f529dd61640 1 --2- 172.21.15.133:0/2881253165 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f52840039b0 0x7f5284003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:57.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.241+0000 7f529dd61640 1 -- 172.21.15.133:0/2881253165 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5284003530 con 0x7f5284004d10 2023-12-19T19:00:57.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.245+0000 7f529dd61640 1 --2- 172.21.15.133:0/2881253165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5284004d10 0x7f5284005190 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5290001e70 tx=0x7f529001c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f3039c8719e405 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:57.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.245+0000 7f528ffff640 1 -- 172.21.15.133:0/2881253165 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5290003b80 con 0x7f5284004d10 2023-12-19T19:00:57.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.245+0000 7f528ffff640 1 -- 172.21.15.133:0/2881253165 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5290003ce0 con 0x7f5284004d10 2023-12-19T19:00:57.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.245+0000 7f528ffff640 1 -- 172.21.15.133:0/2881253165 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5290005310 con 0x7f5284004d10 2023-12-19T19:00:57.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.245+0000 7f529f7c4640 1 -- 172.21.15.133:0/2881253165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5284004d10 msgr2=0x7f5284005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:57.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.245+0000 7f529f7c4640 1 --2- 172.21.15.133:0/2881253165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5284004d10 0x7f5284005190 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5290001e70 tx=0x7f529001c580 comp rx=0 tx=0).stop 2023-12-19T19:00:57.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.245+0000 7f529dd61640 1 -- 172.21.15.133:0/2881253165 reap_dead start 2023-12-19T19:00:57.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.245+0000 7f529f7c4640 1 -- 172.21.15.133:0/2881253165 shutdown_connections 2023-12-19T19:00:57.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.245+0000 7f529f7c4640 1 -- 172.21.15.133:0/2881253165 >> 172.21.15.133:0/2881253165 conn(0x7f529806a5b0 msgr2=0x7f529806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:57.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.245+0000 7f529f7c4640 1 -- 172.21.15.133:0/2881253165 shutdown_connections 2023-12-19T19:00:57.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.245+0000 7f529f7c4640 1 -- 172.21.15.133:0/2881253165 wait complete. 2023-12-19T19:00:57.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.245+0000 7f529f7c4640 1 Processor -- start 2023-12-19T19:00:57.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.245+0000 7f529f7c4640 1 -- start start 2023-12-19T19:00:57.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.245+0000 7f529f7c4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5284004d10 0x7f52981ed970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:57.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.245+0000 7f529f7c4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52981531b0 0x7f5298155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:57.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.245+0000 7f529f7c4640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5298156220 0x7f5298150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:57.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.245+0000 7f529f7c4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52981edeb0 con 0x7f52981531b0 2023-12-19T19:00:57.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.245+0000 7f529f7c4640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5298150ed0 con 0x7f5284004d10 2023-12-19T19:00:57.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.245+0000 7f529f7c4640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52980aae60 con 0x7f5298156220 2023-12-19T19:00:57.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.249+0000 7f529cd5f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52981531b0 0x7f5298155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:57.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.249+0000 7f529cd5f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52981531b0 0x7f5298155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39336/0 (socket says 172.21.15.133:39336) 2023-12-19T19:00:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.249+0000 7f529cd5f640 1 -- 172.21.15.133:0/3862181207 learned_addr learned my addr 172.21.15.133:0/3862181207 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.249+0000 7f529d560640 1 --2- 172.21.15.133:0/3862181207 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5284004d10 0x7f52981ed970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.249+0000 7f529dd61640 1 --2- 172.21.15.133:0/3862181207 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5298156220 0x7f5298150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.249+0000 7f529cd5f640 1 -- 172.21.15.133:0/3862181207 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5298156220 msgr2=0x7f5298150370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.249+0000 7f529cd5f640 1 --2- 172.21.15.133:0/3862181207 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5298156220 0x7f5298150370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.249+0000 7f529cd5f640 1 -- 172.21.15.133:0/3862181207 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5284004d10 msgr2=0x7f52981ed970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.249+0000 7f529cd5f640 1 --2- 172.21.15.133:0/3862181207 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5284004d10 0x7f52981ed970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.249+0000 7f529cd5f640 1 -- 172.21.15.133:0/3862181207 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52980aa8a0 con 0x7f52981531b0 2023-12-19T19:00:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.249+0000 7f529d560640 1 --2- 172.21.15.133:0/3862181207 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5284004d10 0x7f52981ed970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.249+0000 7f529cd5f640 1 --2- 172.21.15.133:0/3862181207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52981531b0 0x7f5298155ce0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f528800b7f0 tx=0x7f528800bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.249+0000 7f528dffb640 1 -- 172.21.15.133:0/3862181207 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5288010830 con 0x7f52981531b0 2023-12-19T19:00:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.249+0000 7f528dffb640 1 -- 172.21.15.133:0/3862181207 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5288010990 con 0x7f52981531b0 2023-12-19T19:00:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.249+0000 7f528dffb640 1 -- 172.21.15.133:0/3862181207 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5288010d20 con 0x7f52981531b0 2023-12-19T19:00:57.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.249+0000 7f529f7c4640 1 -- 172.21.15.133:0/3862181207 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52980aab80 con 0x7f52981531b0 2023-12-19T19:00:57.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.249+0000 7f529f7c4640 1 -- 172.21.15.133:0/3862181207 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52980a9c80 con 0x7f52981531b0 2023-12-19T19:00:57.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.249+0000 7f529f7c4640 1 -- 172.21.15.133:0/3862181207 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52980a9e40 con 0x7f52981531b0 2023-12-19T19:00:57.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.249+0000 7f528dffb640 1 -- 172.21.15.133:0/3862181207 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5288014430 con 0x7f52981531b0 2023-12-19T19:00:57.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.253+0000 7f528dffb640 1 --2- 172.21.15.133:0/3862181207 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f527c066470 0x7f527c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:57.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.253+0000 7f528dffb640 1 -- 172.21.15.133:0/3862181207 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5288084a20 con 0x7f52981531b0 2023-12-19T19:00:57.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.253+0000 7f529d560640 1 --2- 172.21.15.133:0/3862181207 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f527c066470 0x7f527c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:57.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.253+0000 7f529d560640 1 --2- 172.21.15.133:0/3862181207 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f527c066470 0x7f527c068930 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5294005180 tx=0x7f5294009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:57.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.253+0000 7f528dffb640 1 -- 172.21.15.133:0/3862181207 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5288051ac0 con 0x7f52981531b0 2023-12-19T19:00:57.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.437+0000 7f529f7c4640 1 -- 172.21.15.133:0/3862181207 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5298068400 con 0x7f52981531b0 2023-12-19T19:00:57.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.437+0000 7f528dffb640 1 -- 172.21.15.133:0/3862181207 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) v1 ==== 53+0+149 (secure 0 0 0) 0x7f5288022070 con 0x7f52981531b0 2023-12-19T19:00:57.442 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T19:00:57.442 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-19T19:00:57.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.441+0000 7f529f7c4640 1 -- 172.21.15.133:0/3862181207 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f527c066470 msgr2=0x7f527c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:57.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.441+0000 7f529f7c4640 1 --2- 172.21.15.133:0/3862181207 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f527c066470 0x7f527c068930 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f5294005180 tx=0x7f5294009040 comp rx=0 tx=0).stop 2023-12-19T19:00:57.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.441+0000 7f529f7c4640 1 -- 172.21.15.133:0/3862181207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52981531b0 msgr2=0x7f5298155ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:57.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.441+0000 7f529f7c4640 1 --2- 172.21.15.133:0/3862181207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52981531b0 0x7f5298155ce0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f528800b7f0 tx=0x7f528800bcb0 comp rx=0 tx=0).stop 2023-12-19T19:00:57.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.441+0000 7f529f7c4640 1 -- 172.21.15.133:0/3862181207 shutdown_connections 2023-12-19T19:00:57.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.441+0000 7f529f7c4640 1 --2- 172.21.15.133:0/3862181207 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f527c066470 0x7f527c068930 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:57.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.441+0000 7f529f7c4640 1 --2- 172.21.15.133:0/3862181207 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5298156220 0x7f5298150370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:57.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.441+0000 7f529f7c4640 1 --2- 172.21.15.133:0/3862181207 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52981531b0 0x7f5298155ce0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:57.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.441+0000 7f529f7c4640 1 --2- 172.21.15.133:0/3862181207 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5284004d10 0x7f52981ed970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:57.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.441+0000 7f529f7c4640 1 -- 172.21.15.133:0/3862181207 >> 172.21.15.133:0/3862181207 conn(0x7f529806a5b0 msgr2=0x7f529806d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:57.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.441+0000 7f529f7c4640 1 -- 172.21.15.133:0/3862181207 shutdown_connections 2023-12-19T19:00:57.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:57.441+0000 7f529f7c4640 1 -- 172.21.15.133:0/3862181207 wait complete. 2023-12-19T19:00:57.463 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-19T19:00:57.463 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T19:00:57.463 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi138.front.sepia.ceph.com 2023-12-19T19:00:57.463 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T19:00:57.463 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T19:00:57.463 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-19T19:00:57.464 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T19:00:57.464 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T19:00:57.464 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T19:00:57.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:57.464 DEBUG:teuthology.orchestra.run.smithi138:> ip addr 2023-12-19T19:00:57.474 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T19:00:57.474 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T19:00:57.474 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T19:00:57.474 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:00:57.474 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2023-12-19T19:00:57.474 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:00:57.474 INFO:teuthology.orchestra.run.smithi138.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:00:57.474 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7a brd ff:ff:ff:ff:ff:ff 2023-12-19T19:00:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f0 2023-12-19T19:00:57.475 INFO:teuthology.orchestra.run.smithi138.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:00:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7b brd ff:ff:ff:ff:ff:ff 2023-12-19T19:00:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f1 2023-12-19T19:00:57.475 INFO:teuthology.orchestra.run.smithi138.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:00:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:70 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:00:57.475 INFO:teuthology.orchestra.run.smithi138.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T19:00:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:71 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:00:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.21.15.138/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T19:00:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft 42296sec preferred_lft 42296sec 2023-12-19T19:00:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::ec4:7aff:fe88:6f71/64 scope link 2023-12-19T19:00:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:00:57.475 INFO:teuthology.orchestra.run.smithi138.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T19:00:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 02:42:5b:f5:51:87 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:00:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T19:00:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:00:57.476 INFO:teuthology.orchestra.run.smithi138.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T19:00:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T19:00:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T19:00:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:00:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-19T19:00:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:00:57.476 INFO:teuthology.orchestra.run.smithi138.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T19:00:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T19:00:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-19T19:00:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:00:57.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:57.477 DEBUG:teuthology.orchestra.run.smithi138:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T19:00:57.540 INFO:teuthology.orchestra.run.smithi138.stdout:1 2023-12-19T19:00:57.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:57.542 DEBUG:teuthology.orchestra.run.smithi138:> route 2023-12-19T19:00:57.594 INFO:teuthology.orchestra.run.smithi138.stdout:Kernel IP routing table 2023-12-19T19:00:57.594 INFO:teuthology.orchestra.run.smithi138.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T19:00:57.595 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T19:00:57.595 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T19:00:57.595 INFO:teuthology.orchestra.run.smithi138.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T19:00:57.595 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T19:00:57.595 INFO:teuthology.orchestra.run.smithi138.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:00:57.595 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:00:57.595 INFO:teuthology.orchestra.run.smithi138.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:00:57.595 INFO:teuthology.orchestra.run.smithi138.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T19:00:57.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:57.596 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-12-19T19:00:57.596 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-12-19T19:00:57.596 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T19:00:57.596 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T19:00:57.596 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T19:00:57.596 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-12-19T19:00:57.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:57.691 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2023-12-19T19:00:57.700 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T19:00:57.701 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T19:00:57.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:57.702 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set brx.0 up 2023-12-19T19:00:57.764 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T19:00:57.764 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T19:00:57.819 INFO:teuthology.orchestra.run.smithi138.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T19:00:57.820 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T19:00:57.820 DEBUG:teuthology.orchestra.run.smithi138:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T19:00:57.871 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-12-19T19:00:57.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:57.871 DEBUG:teuthology.orchestra.run.smithi138:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:00:57.961 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:00:57.961 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T19:00:57.974 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:00:57.974 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T19:00:57.974 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-12-19T19:00:57.974 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: trying mount with new device syntax: 1@03e63958-005e-4bf2-ae5b-291aceb6fbbf.cephfs2=/ 2023-12-19T19:00:57.974 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.133:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-12-19T19:00:57.978 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T19:00:57.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:57.978 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T19:00:57.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:00:57.999 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T19:00:58.060 INFO:teuthology.orchestra.run.smithi138.stdout:client6135 2023-12-19T19:00:58.060 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:00:58.060 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:00:58.111 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow rw fsname=cephfs, allow rw fsname=cephfs2' osd 'allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2' mds 'allow rw fsname=cephfs' 2023-12-19T19:00:58.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.253+0000 7f07ccdd1640 1 Processor -- start 2023-12-19T19:00:58.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.253+0000 7f07ccdd1640 1 -- start start 2023-12-19T19:00:58.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.253+0000 7f07ccdd1640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f07c80c5260 0x7f07c806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:58.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.253+0000 7f07ccdd1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c80c2580 con 0x7f07c80c5640 2023-12-19T19:00:58.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.253+0000 7f07ccdd1640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c8156940 con 0x7f07c8155de0 2023-12-19T19:00:58.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.253+0000 7f07ccdd1640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c8153510 con 0x7f07c80c5260 2023-12-19T19:00:58.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.253+0000 7f07c5d9b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f07c80c5640 0x7f07c80c5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58450/0 (socket says 172.21.15.133:58450) 2023-12-19T19:00:58.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.253+0000 7f07c5d9b640 1 -- 172.21.15.133:0/1373920201 learned_addr learned my addr 172.21.15.133:0/1373920201 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:58.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.253+0000 7f07c659c640 1 --2- 172.21.15.133:0/1373920201 >> v2:172.21.15.138:3300/0 conn(0x7f07c80c5260 0x7f07c806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:58.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.253+0000 7f07c559a640 1 -- 172.21.15.133:0/1373920201 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1084903935 0 0) 0x7f07c80c2580 con 0x7f07c80c5640 2023-12-19T19:00:58.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.253+0000 7f07c559a640 1 -- 172.21.15.133:0/1373920201 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07b0003530 con 0x7f07c80c5640 2023-12-19T19:00:58.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.253+0000 7f07c559a640 1 -- 172.21.15.133:0/1373920201 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366168038 0 0) 0x7f07c8156940 con 0x7f07c8155de0 2023-12-19T19:00:58.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.253+0000 7f07c559a640 1 -- 172.21.15.133:0/1373920201 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07c80c2580 con 0x7f07c8155de0 2023-12-19T19:00:58.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.253+0000 7f07c659c640 1 -- 172.21.15.133:0/1373920201 >> v1:172.21.15.138:6789/0 conn(0x7f07c8155de0 legacy=0x7f07c8156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:58.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.253+0000 7f07c659c640 1 -- 172.21.15.133:0/1373920201 >> v1:172.21.15.133:6789/0 conn(0x7f07c80c5640 legacy=0x7f07c80c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:58.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.253+0000 7f07c659c640 1 -- 172.21.15.133:0/1373920201 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c80c1a00 con 0x7f07c80c5260 2023-12-19T19:00:58.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.257+0000 7f07c659c640 1 --2- 172.21.15.133:0/1373920201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07c80c5260 0x7f07c806d5b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f07b80097c0 tx=0x7f07b801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3030a90cd4d0c52 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:58.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.257+0000 7f07c559a640 1 -- 172.21.15.133:0/1373920201 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b80ab600 con 0x7f07c80c5260 2023-12-19T19:00:58.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.257+0000 7f07c559a640 1 -- 172.21.15.133:0/1373920201 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b80a7050 con 0x7f07c80c5260 2023-12-19T19:00:58.262 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.257+0000 7f07c559a640 1 -- 172.21.15.133:0/1373920201 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b80ab980 con 0x7f07c80c5260 2023-12-19T19:00:58.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.257+0000 7f07ccdd1640 1 -- 172.21.15.133:0/1373920201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07c80c5260 msgr2=0x7f07c806d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:58.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.257+0000 7f07ccdd1640 1 --2- 172.21.15.133:0/1373920201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07c80c5260 0x7f07c806d5b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f07b80097c0 tx=0x7f07b801c3f0 comp rx=0 tx=0).stop 2023-12-19T19:00:58.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.257+0000 7f07ccdd1640 1 -- 172.21.15.133:0/1373920201 shutdown_connections 2023-12-19T19:00:58.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.257+0000 7f07ccdd1640 1 --2- 172.21.15.133:0/1373920201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07c80c5260 0x7f07c806d5b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:58.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.257+0000 7f07ccdd1640 1 -- 172.21.15.133:0/1373920201 >> 172.21.15.133:0/1373920201 conn(0x7f07c806a5b0 msgr2=0x7f07c806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:58.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.257+0000 7f07ccdd1640 1 -- 172.21.15.133:0/1373920201 shutdown_connections 2023-12-19T19:00:58.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.257+0000 7f07ccdd1640 1 -- 172.21.15.133:0/1373920201 wait complete. 2023-12-19T19:00:58.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.261+0000 7f07ccdd1640 1 Processor -- start 2023-12-19T19:00:58.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.261+0000 7f07ccdd1640 1 -- start start 2023-12-19T19:00:58.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.261+0000 7f07ccdd1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07c80c5260 0x7f07c8147a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:58.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.261+0000 7f07ccdd1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07c80c5640 0x7f07c815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:58.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.261+0000 7f07ccdd1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07c8155de0 0x7f07c8150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:58.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.261+0000 7f07ccdd1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c8151f70 con 0x7f07c80c5640 2023-12-19T19:00:58.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.261+0000 7f07ccdd1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c81efae0 con 0x7f07c80c5260 2023-12-19T19:00:58.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.261+0000 7f07ccdd1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c80aac30 con 0x7f07c8155de0 2023-12-19T19:00:58.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.261+0000 7f07c5d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07c80c5640 0x7f07c815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:58.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.261+0000 7f07c5d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07c80c5640 0x7f07c815cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39340/0 (socket says 172.21.15.133:39340) 2023-12-19T19:00:58.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.261+0000 7f07c5d9b640 1 -- 172.21.15.133:0/1316918333 learned_addr learned my addr 172.21.15.133:0/1316918333 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:58.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.261+0000 7f07c659c640 1 --2- 172.21.15.133:0/1316918333 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07c80c5260 0x7f07c8147a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:58.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.261+0000 7f07c6d9d640 1 --2- 172.21.15.133:0/1316918333 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07c8155de0 0x7f07c8150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:58.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.261+0000 7f07c5d9b640 1 -- 172.21.15.133:0/1316918333 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07c8155de0 msgr2=0x7f07c8150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:58.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.261+0000 7f07c5d9b640 1 --2- 172.21.15.133:0/1316918333 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07c8155de0 0x7f07c8150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:58.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.261+0000 7f07c5d9b640 1 -- 172.21.15.133:0/1316918333 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07c80c5260 msgr2=0x7f07c8147a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:58.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.261+0000 7f07c5d9b640 1 --2- 172.21.15.133:0/1316918333 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07c80c5260 0x7f07c8147a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:58.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.261+0000 7f07c5d9b640 1 -- 172.21.15.133:0/1316918333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b8009420 con 0x7f07c80c5640 2023-12-19T19:00:58.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.261+0000 7f07c659c640 1 --2- 172.21.15.133:0/1316918333 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07c80c5260 0x7f07c8147a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:00:58.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.261+0000 7f07c5d9b640 1 --2- 172.21.15.133:0/1316918333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07c80c5640 0x7f07c815cfe0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00c420 tx=0x7f07bc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:58.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.265+0000 7f07b6ffd640 1 -- 172.21.15.133:0/1316918333 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc005cf0 con 0x7f07c80c5640 2023-12-19T19:00:58.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.265+0000 7f07b6ffd640 1 -- 172.21.15.133:0/1316918333 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07bc005e50 con 0x7f07c80c5640 2023-12-19T19:00:58.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.265+0000 7f07ccdd1640 1 -- 172.21.15.133:0/1316918333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c80aa620 con 0x7f07c80c5640 2023-12-19T19:00:58.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.265+0000 7f07b6ffd640 1 -- 172.21.15.133:0/1316918333 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc007310 con 0x7f07c80c5640 2023-12-19T19:00:58.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.265+0000 7f07ccdd1640 1 -- 172.21.15.133:0/1316918333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c8151870 con 0x7f07c80c5640 2023-12-19T19:00:58.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.265+0000 7f07ccdd1640 1 -- 172.21.15.133:0/1316918333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c80aadc0 con 0x7f07c80c5640 2023-12-19T19:00:58.269 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.265+0000 7f07b6ffd640 1 -- 172.21.15.133:0/1316918333 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f07bc007470 con 0x7f07c80c5640 2023-12-19T19:00:58.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.265+0000 7f07b6ffd640 1 --2- 172.21.15.133:0/1316918333 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f07a8066470 0x7f07a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:58.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.265+0000 7f07b6ffd640 1 -- 172.21.15.133:0/1316918333 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f07bc083860 con 0x7f07c80c5640 2023-12-19T19:00:58.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.265+0000 7f07c659c640 1 --2- 172.21.15.133:0/1316918333 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f07a8066470 0x7f07a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:58.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.269+0000 7f07c659c640 1 --2- 172.21.15.133:0/1316918333 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f07a8066470 0x7f07a8068930 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f07b80ad000 tx=0x7f07b80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:58.274 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.269+0000 7f07b6ffd640 1 -- 172.21.15.133:0/1316918333 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f07bc0508e0 con 0x7f07c80c5640 2023-12-19T19:00:58.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.473+0000 7f07ccdd1640 1 -- 172.21.15.133:0/1316918333 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]} v 0) v1 -- 0x7f07c8068400 con 0x7f07c80c5640 2023-12-19T19:00:58.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.477+0000 7f07b6ffd640 1 -- 172.21.15.133:0/1316918333 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]}]=0 added key for client.testuser v17) v1 ==== 291+0+0 (secure 0 0 0) 0x7f07bc053f00 con 0x7f07c80c5640 2023-12-19T19:00:58.480 INFO:teuthology.orchestra.run.smithi133.stderr:added key for client.testuser 2023-12-19T19:00:58.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.481+0000 7f07ccdd1640 1 -- 172.21.15.133:0/1316918333 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f07a8066470 msgr2=0x7f07a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.481+0000 7f07ccdd1640 1 --2- 172.21.15.133:0/1316918333 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f07a8066470 0x7f07a8068930 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f07b80ad000 tx=0x7f07b80a6000 comp rx=0 tx=0).stop 2023-12-19T19:00:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.481+0000 7f07ccdd1640 1 -- 172.21.15.133:0/1316918333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07c80c5640 msgr2=0x7f07c815cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.481+0000 7f07ccdd1640 1 --2- 172.21.15.133:0/1316918333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07c80c5640 0x7f07c815cfe0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00c420 tx=0x7f07bc00c8e0 comp rx=0 tx=0).stop 2023-12-19T19:00:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.481+0000 7f07ccdd1640 1 -- 172.21.15.133:0/1316918333 shutdown_connections 2023-12-19T19:00:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.481+0000 7f07ccdd1640 1 --2- 172.21.15.133:0/1316918333 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f07a8066470 0x7f07a8068930 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.481+0000 7f07ccdd1640 1 --2- 172.21.15.133:0/1316918333 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07c8155de0 0x7f07c8150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.481+0000 7f07ccdd1640 1 --2- 172.21.15.133:0/1316918333 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07c80c5640 0x7f07c815cfe0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.481+0000 7f07ccdd1640 1 --2- 172.21.15.133:0/1316918333 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07c80c5260 0x7f07c8147a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.481+0000 7f07ccdd1640 1 -- 172.21.15.133:0/1316918333 >> 172.21.15.133:0/1316918333 conn(0x7f07c806a5b0 msgr2=0x7f07c806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.481+0000 7f07ccdd1640 1 -- 172.21.15.133:0/1316918333 shutdown_connections 2023-12-19T19:00:58.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.481+0000 7f07ccdd1640 1 -- 172.21.15.133:0/1316918333 wait complete. 2023-12-19T19:00:58.502 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-12-19T19:00:58.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.637+0000 7ff9e570f640 1 Processor -- start 2023-12-19T19:00:58.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.637+0000 7ff9e570f640 1 -- start start 2023-12-19T19:00:58.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.637+0000 7ff9e570f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9e00c7770 0x7ff9e006bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:58.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.637+0000 7ff9e570f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff9e006c1e0 0x7ff9e006c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:58.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.637+0000 7ff9e570f640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e00c3480 con 0x7ff9e0155500 2023-12-19T19:00:58.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.637+0000 7ff9e570f640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e00c2cb0 con 0x7ff9e006c1e0 2023-12-19T19:00:58.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.637+0000 7ff9e570f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e00c26f0 con 0x7ff9e00c7770 2023-12-19T19:00:58.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.637+0000 7ff9de7fc640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9e00c7770 0x7ff9e006bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:58.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.637+0000 7ff9df7fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff9e006c1e0 0x7ff9e006c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:58.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.637+0000 7ff9de7fc640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9e00c7770 0x7ff9e006bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:34840/0 (socket says 172.21.15.133:34840) 2023-12-19T19:00:58.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.637+0000 7ff9de7fc640 1 -- 172.21.15.133:0/3836676656 learned_addr learned my addr 172.21.15.133:0/3836676656 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:58.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.637+0000 7ff9de7fc640 1 -- 172.21.15.133:0/3836676656 >> v2:172.21.15.138:3300/0 conn(0x7ff9e006c1e0 msgr2=0x7ff9e006c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:58.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.637+0000 7ff9de7fc640 1 --2- 172.21.15.133:0/3836676656 >> v2:172.21.15.138:3300/0 conn(0x7ff9e006c1e0 0x7ff9e006c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:58.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.637+0000 7ff9de7fc640 1 -- 172.21.15.133:0/3836676656 >> v1:172.21.15.138:6789/0 conn(0x7ff9e0155500 legacy=0x7ff9e00c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:58.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.637+0000 7ff9de7fc640 1 -- 172.21.15.133:0/3836676656 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e00c29d0 con 0x7ff9e00c7770 2023-12-19T19:00:58.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.641+0000 7ff9de7fc640 1 --2- 172.21.15.133:0/3836676656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9e00c7770 0x7ff9e006bca0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4009870 tx=0x7ff9d401c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf3e8437c5bdb18c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:58.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.641+0000 7ff9ddffb640 1 -- 172.21.15.133:0/3836676656 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d40ab600 con 0x7ff9e00c7770 2023-12-19T19:00:58.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.641+0000 7ff9ddffb640 1 -- 172.21.15.133:0/3836676656 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d40a7050 con 0x7ff9e00c7770 2023-12-19T19:00:58.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.641+0000 7ff9ddffb640 1 -- 172.21.15.133:0/3836676656 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d40ab980 con 0x7ff9e00c7770 2023-12-19T19:00:58.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.641+0000 7ff9e570f640 1 -- 172.21.15.133:0/3836676656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9e00c7770 msgr2=0x7ff9e006bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:58.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.641+0000 7ff9e570f640 1 --2- 172.21.15.133:0/3836676656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9e00c7770 0x7ff9e006bca0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4009870 tx=0x7ff9d401c420 comp rx=0 tx=0).stop 2023-12-19T19:00:58.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.641+0000 7ff9e570f640 1 -- 172.21.15.133:0/3836676656 shutdown_connections 2023-12-19T19:00:58.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.641+0000 7ff9e570f640 1 --2- 172.21.15.133:0/3836676656 >> v2:172.21.15.138:3300/0 conn(0x7ff9e006c1e0 0x7ff9e006c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:58.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.641+0000 7ff9e570f640 1 --2- 172.21.15.133:0/3836676656 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9e00c7770 0x7ff9e006bca0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:58.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.641+0000 7ff9e570f640 1 -- 172.21.15.133:0/3836676656 >> 172.21.15.133:0/3836676656 conn(0x7ff9e00c7cf0 msgr2=0x7ff9e00c8100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:58.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.641+0000 7ff9e570f640 1 -- 172.21.15.133:0/3836676656 shutdown_connections 2023-12-19T19:00:58.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.641+0000 7ff9e570f640 1 -- 172.21.15.133:0/3836676656 wait complete. 2023-12-19T19:00:58.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9e570f640 1 Processor -- start 2023-12-19T19:00:58.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9e570f640 1 -- start start 2023-12-19T19:00:58.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9e570f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9e006c1e0 0x7ff9e01f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:58.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9e570f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9e00c7770 0x7ff9e014c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:58.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9e570f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9e0155500 0x7ff9e01ed370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:58.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9e570f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e01f12a0 con 0x7ff9e006c1e0 2023-12-19T19:00:58.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9e570f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e006dd70 con 0x7ff9e00c7770 2023-12-19T19:00:58.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9e570f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e01ecee0 con 0x7ff9e0155500 2023-12-19T19:00:58.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9deffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9e006c1e0 0x7ff9e01f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:58.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9df7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9e0155500 0x7ff9e01ed370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:58.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9de7fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9e00c7770 0x7ff9e014c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:58.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9deffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9e006c1e0 0x7ff9e01f0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39342/0 (socket says 172.21.15.133:39342) 2023-12-19T19:00:58.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9deffd640 1 -- 172.21.15.133:0/1702141442 learned_addr learned my addr 172.21.15.133:0/1702141442 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:58.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9de7fc640 1 -- 172.21.15.133:0/1702141442 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9e0155500 msgr2=0x7ff9e01ed370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:58.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9de7fc640 1 --2- 172.21.15.133:0/1702141442 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9e0155500 0x7ff9e01ed370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:58.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9de7fc640 1 -- 172.21.15.133:0/1702141442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9e006c1e0 msgr2=0x7ff9e01f0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:58.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9de7fc640 1 --2- 172.21.15.133:0/1702141442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9e006c1e0 0x7ff9e01f0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:58.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9de7fc640 1 -- 172.21.15.133:0/1702141442 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d40094d0 con 0x7ff9e00c7770 2023-12-19T19:00:58.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9deffd640 1 --2- 172.21.15.133:0/1702141442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9e006c1e0 0x7ff9e01f0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:00:58.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9df7fe640 1 --2- 172.21.15.133:0/1702141442 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9e0155500 0x7ff9e01ed370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:00:58.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9de7fc640 1 --2- 172.21.15.133:0/1702141442 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9e00c7770 0x7ff9e014c260 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff9e006d8a0 tx=0x7ff9d40191c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:58.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9c77fe640 1 -- 172.21.15.133:0/1702141442 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d40b4660 con 0x7ff9e00c7770 2023-12-19T19:00:58.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9c77fe640 1 -- 172.21.15.133:0/1702141442 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d40b47c0 con 0x7ff9e00c7770 2023-12-19T19:00:58.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9e570f640 1 -- 172.21.15.133:0/1702141442 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e006ea50 con 0x7ff9e00c7770 2023-12-19T19:00:58.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9c77fe640 1 -- 172.21.15.133:0/1702141442 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d40b4b70 con 0x7ff9e00c7770 2023-12-19T19:00:58.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.645+0000 7ff9e570f640 1 -- 172.21.15.133:0/1702141442 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e006f010 con 0x7ff9e00c7770 2023-12-19T19:00:58.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.649+0000 7ff9e570f640 1 -- 172.21.15.133:0/1702141442 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e00743b0 con 0x7ff9e00c7770 2023-12-19T19:00:58.652 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.649+0000 7ff9c77fe640 1 -- 172.21.15.133:0/1702141442 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff9d40b2070 con 0x7ff9e00c7770 2023-12-19T19:00:58.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.649+0000 7ff9c77fe640 1 --2- 172.21.15.133:0/1702141442 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff9cc066470 0x7ff9cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:58.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.649+0000 7ff9c77fe640 1 -- 172.21.15.133:0/1702141442 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff9d411db10 con 0x7ff9e00c7770 2023-12-19T19:00:58.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.649+0000 7ff9deffd640 1 --2- 172.21.15.133:0/1702141442 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff9cc066470 0x7ff9cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:58.654 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.649+0000 7ff9deffd640 1 --2- 172.21.15.133:0/1702141442 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff9cc066470 0x7ff9cc068930 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff9e01541b0 tx=0x7ff9d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:58.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.653+0000 7ff9c77fe640 1 -- 172.21.15.133:0/1702141442 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff9d40eacd0 con 0x7ff9e00c7770 2023-12-19T19:00:58.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.857+0000 7ff9e570f640 1 -- 172.21.15.133:0/1702141442 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7ff9e004e850 con 0x7ff9e00c7770 2023-12-19T19:00:58.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.857+0000 7ff9c77fe640 1 -- 172.21.15.133:0/1702141442 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v17) v1 ==== 85+0+245 (secure 0 0 0) 0x7ff9d40b9110 con 0x7ff9e00c7770 2023-12-19T19:00:58.860 INFO:teuthology.orchestra.run.smithi133.stdout:[client.testuser] 2023-12-19T19:00:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQBq6IFlpct9HBAAVlWsnsW19o1QudHAjzvr7w== 2023-12-19T19:00:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: caps mds = "allow rw fsname=cephfs" 2023-12-19T19:00:58.860 INFO:teuthology.orchestra.run.smithi133.stdout: caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" 2023-12-19T19:00:58.861 INFO:teuthology.orchestra.run.smithi133.stdout: caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-12-19T19:00:58.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.857+0000 7ff9e570f640 1 -- 172.21.15.133:0/1702141442 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff9cc066470 msgr2=0x7ff9cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:58.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.857+0000 7ff9e570f640 1 --2- 172.21.15.133:0/1702141442 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff9cc066470 0x7ff9cc068930 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff9e01541b0 tx=0x7ff9d0009040 comp rx=0 tx=0).stop 2023-12-19T19:00:58.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.857+0000 7ff9e570f640 1 -- 172.21.15.133:0/1702141442 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9e00c7770 msgr2=0x7ff9e014c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:58.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.857+0000 7ff9e570f640 1 --2- 172.21.15.133:0/1702141442 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9e00c7770 0x7ff9e014c260 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff9e006d8a0 tx=0x7ff9d40191c0 comp rx=0 tx=0).stop 2023-12-19T19:00:58.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.857+0000 7ff9e570f640 1 -- 172.21.15.133:0/1702141442 shutdown_connections 2023-12-19T19:00:58.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.857+0000 7ff9e570f640 1 --2- 172.21.15.133:0/1702141442 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff9cc066470 0x7ff9cc068930 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:58.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.857+0000 7ff9e570f640 1 --2- 172.21.15.133:0/1702141442 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff9e0155500 0x7ff9e01ed370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:58.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.857+0000 7ff9e570f640 1 --2- 172.21.15.133:0/1702141442 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff9e00c7770 0x7ff9e014c260 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:58.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.857+0000 7ff9e570f640 1 --2- 172.21.15.133:0/1702141442 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff9e006c1e0 0x7ff9e01f0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:58.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.857+0000 7ff9e570f640 1 -- 172.21.15.133:0/1702141442 >> 172.21.15.133:0/1702141442 conn(0x7ff9e00c7cf0 msgr2=0x7ff9e00c80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:58.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.857+0000 7ff9e570f640 1 -- 172.21.15.133:0/1702141442 shutdown_connections 2023-12-19T19:00:58.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:58.857+0000 7ff9e570f640 1 -- 172.21.15.133:0/1702141442 wait complete. 2023-12-19T19:00:58.882 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2023-12-19T19:00:58.890 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.S5IIr693ah 2023-12-19T19:00:58.890 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T19:00:58.890 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/tmp/tmp.S5IIr693ah 2023-12-19T19:00:58.942 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T19:00:58.942 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:00:58.995 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T19:00:58.995 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:00:59.047 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:00:59.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.221+0000 7f2001384640 1 Processor -- start 2023-12-19T19:00:59.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.221+0000 7f2001384640 1 -- start start 2023-12-19T19:00:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.225+0000 7f2001384640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1ffc0c1010 0x7f1ffc0aa830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.225+0000 7f2001384640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ffc06e360 0x7f1ffc157b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.225+0000 7f2001384640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ffc0c01f0 con 0x7f1ffc0ab4b0 2023-12-19T19:00:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.225+0000 7f2001384640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ffc0c04d0 con 0x7f1ffc0c1010 2023-12-19T19:00:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.225+0000 7f2001384640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc154850 con 0x7f1ffc06e360 2023-12-19T19:00:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.225+0000 7f1ffbfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1ffc0c1010 0x7f1ffc0aa830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.225+0000 7f1ffbfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1ffc0c1010 0x7f1ffc0aa830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39346/0 (socket says 172.21.15.133:39346) 2023-12-19T19:00:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.225+0000 7f1ffbfff640 1 -- 172.21.15.133:0/2990564252 learned_addr learned my addr 172.21.15.133:0/2990564252 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.225+0000 7f1ffb7fe640 1 --2- 172.21.15.133:0/2990564252 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ffc06e360 0x7f1ffc157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:59.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.225+0000 7f1ffbfff640 1 -- 172.21.15.133:0/2990564252 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ffc06e360 msgr2=0x7f1ffc157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:59.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.225+0000 7f1ffbfff640 1 --2- 172.21.15.133:0/2990564252 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ffc06e360 0x7f1ffc157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.225+0000 7f1ffbfff640 1 -- 172.21.15.133:0/2990564252 >> v1:172.21.15.138:6789/0 conn(0x7f1ffc0ab4b0 legacy=0x7f1ffc06d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:59.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.225+0000 7f1ffbfff640 1 -- 172.21.15.133:0/2990564252 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc154b30 con 0x7f1ffc0c1010 2023-12-19T19:00:59.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.225+0000 7f1ffb7fe640 1 --2- 172.21.15.133:0/2990564252 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ffc06e360 0x7f1ffc157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:00:59.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.229+0000 7f1ffbfff640 1 --2- 172.21.15.133:0/2990564252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ffc0c1010 0x7f1ffc0aa830 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1fec009870 tx=0x7f1fec01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=201080a8b69c0e65 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:59.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.229+0000 7f1ffaffd640 1 -- 172.21.15.133:0/2990564252 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec0ac620 con 0x7f1ffc0c1010 2023-12-19T19:00:59.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.229+0000 7f1ffaffd640 1 -- 172.21.15.133:0/2990564252 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fec0ac780 con 0x7f1ffc0c1010 2023-12-19T19:00:59.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.229+0000 7f1ffaffd640 1 -- 172.21.15.133:0/2990564252 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fec0acb10 con 0x7f1ffc0c1010 2023-12-19T19:00:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.229+0000 7f2001384640 1 -- 172.21.15.133:0/2990564252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ffc0c1010 msgr2=0x7f1ffc0aa830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.229+0000 7f2001384640 1 --2- 172.21.15.133:0/2990564252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ffc0c1010 0x7f1ffc0aa830 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1fec009870 tx=0x7f1fec01c3e0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.229+0000 7f2001384640 1 -- 172.21.15.133:0/2990564252 shutdown_connections 2023-12-19T19:00:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.229+0000 7f2001384640 1 --2- 172.21.15.133:0/2990564252 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ffc06e360 0x7f1ffc157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.229+0000 7f2001384640 1 --2- 172.21.15.133:0/2990564252 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ffc0c1010 0x7f1ffc0aa830 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.229+0000 7f2001384640 1 -- 172.21.15.133:0/2990564252 >> 172.21.15.133:0/2990564252 conn(0x7f1ffc0c63b0 msgr2=0x7f1ffc0c67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.229+0000 7f2001384640 1 -- 172.21.15.133:0/2990564252 shutdown_connections 2023-12-19T19:00:59.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.229+0000 7f2001384640 1 -- 172.21.15.133:0/2990564252 wait complete. 2023-12-19T19:00:59.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.229+0000 7f2001384640 1 Processor -- start 2023-12-19T19:00:59.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.229+0000 7f2001384640 1 -- start start 2023-12-19T19:00:59.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f2001384640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ffc06e360 0x7f1ffc157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:59.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f2001384640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ffc0ab4b0 0x7f1ffc14ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:59.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f2001384640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ffc0c1010 0x7f1ffc147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:59.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f2001384640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc1f0c20 con 0x7f1ffc0c1010 2023-12-19T19:00:59.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f2001384640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc1f0f00 con 0x7f1ffc06e360 2023-12-19T19:00:59.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f2001384640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc1f11e0 con 0x7f1ffc0ab4b0 2023-12-19T19:00:59.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f2000b83640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ffc0c1010 0x7f1ffc147ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:59.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f1ffbfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ffc06e360 0x7f1ffc157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:59.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f1ffb7fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ffc0ab4b0 0x7f1ffc14ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:59.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f1ffbfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ffc06e360 0x7f1ffc157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:55058/0 (socket says 172.21.15.133:55058) 2023-12-19T19:00:59.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f2000b83640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ffc0c1010 0x7f1ffc147ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39354/0 (socket says 172.21.15.133:39354) 2023-12-19T19:00:59.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f1ffbfff640 1 -- 172.21.15.133:0/1907333319 learned_addr learned my addr 172.21.15.133:0/1907333319 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:59.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f2000b83640 1 -- 172.21.15.133:0/1907333319 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ffc0ab4b0 msgr2=0x7f1ffc14ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:59.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f2000b83640 1 --2- 172.21.15.133:0/1907333319 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ffc0ab4b0 0x7f1ffc14ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f2000b83640 1 -- 172.21.15.133:0/1907333319 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ffc06e360 msgr2=0x7f1ffc157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:59.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f2000b83640 1 --2- 172.21.15.133:0/1907333319 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ffc06e360 0x7f1ffc157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f2000b83640 1 -- 172.21.15.133:0/1907333319 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec0094d0 con 0x7f1ffc0c1010 2023-12-19T19:00:59.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f1ffbfff640 1 --2- 172.21.15.133:0/1907333319 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ffc06e360 0x7f1ffc157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:00:59.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f2000b83640 1 --2- 172.21.15.133:0/1907333319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ffc0c1010 0x7f1ffc147ec0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400be00 tx=0x7f1ff400bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:59.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f1ff8ff9640 1 -- 172.21.15.133:0/1907333319 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff400ce70 con 0x7f1ffc0c1010 2023-12-19T19:00:59.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f1ff8ff9640 1 -- 172.21.15.133:0/1907333319 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff4003980 con 0x7f1ffc0c1010 2023-12-19T19:00:59.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f1ff8ff9640 1 -- 172.21.15.133:0/1907333319 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4003d70 con 0x7f1ffc0c1010 2023-12-19T19:00:59.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f2001384640 1 -- 172.21.15.133:0/1907333319 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ffc1f14c0 con 0x7f1ffc0c1010 2023-12-19T19:00:59.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f2001384640 1 -- 172.21.15.133:0/1907333319 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ffc157d60 con 0x7f1ffc0c1010 2023-12-19T19:00:59.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.233+0000 7f2001384640 1 -- 172.21.15.133:0/1907333319 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ffc04e850 con 0x7f1ffc0c1010 2023-12-19T19:00:59.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.237+0000 7f1ff8ff9640 1 -- 172.21.15.133:0/1907333319 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1ff4003ed0 con 0x7f1ffc0c1010 2023-12-19T19:00:59.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.237+0000 7f1ff8ff9640 1 --2- 172.21.15.133:0/1907333319 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fe80664a0 0x7f1fe8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:59.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.237+0000 7f1ff8ff9640 1 -- 172.21.15.133:0/1907333319 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1ff4084090 con 0x7f1ffc0c1010 2023-12-19T19:00:59.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.237+0000 7f1ffbfff640 1 --2- 172.21.15.133:0/1907333319 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fe80664a0 0x7f1fe8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:59.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.237+0000 7f1ffbfff640 1 --2- 172.21.15.133:0/1907333319 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fe80664a0 0x7f1fe8068960 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1fec009870 tx=0x7f1fec0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:59.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.241+0000 7f1ff8ff9640 1 -- 172.21.15.133:0/1907333319 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1ff4051250 con 0x7f1ffc0c1010 2023-12-19T19:00:59.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.389+0000 7f2001384640 1 -- 172.21.15.133:0/1907333319 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ffc1f1970 con 0x7f1ffc0c1010 2023-12-19T19:00:59.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.393+0000 7f1ff8ff9640 1 -- 172.21.15.133:0/1907333319 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20316 (secure 0 0 0) 0x7f1ff4054870 con 0x7f1ffc0c1010 2023-12-19T19:00:59.396 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:00:59.396 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":54,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:00:50.680936+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:00:29.085029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T19:00:30.359577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:00:46.784805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:00:48.051355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:00:59.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.393+0000 7f2001384640 1 -- 172.21.15.133:0/1907333319 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fe80664a0 msgr2=0x7f1fe8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:59.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.393+0000 7f2001384640 1 --2- 172.21.15.133:0/1907333319 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fe80664a0 0x7f1fe8068960 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f1fec009870 tx=0x7f1fec0a7000 comp rx=0 tx=0).stop 2023-12-19T19:00:59.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.393+0000 7f2001384640 1 -- 172.21.15.133:0/1907333319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ffc0c1010 msgr2=0x7f1ffc147ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:59.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.393+0000 7f2001384640 1 --2- 172.21.15.133:0/1907333319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ffc0c1010 0x7f1ffc147ec0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400be00 tx=0x7f1ff400bef0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.393+0000 7f2001384640 1 -- 172.21.15.133:0/1907333319 shutdown_connections 2023-12-19T19:00:59.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.393+0000 7f2001384640 1 --2- 172.21.15.133:0/1907333319 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1fe80664a0 0x7f1fe8068960 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.393+0000 7f2001384640 1 --2- 172.21.15.133:0/1907333319 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ffc0c1010 0x7f1ffc147ec0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.393+0000 7f2001384640 1 --2- 172.21.15.133:0/1907333319 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ffc0ab4b0 0x7f1ffc14ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.393+0000 7f2001384640 1 --2- 172.21.15.133:0/1907333319 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ffc06e360 0x7f1ffc157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.393+0000 7f2001384640 1 -- 172.21.15.133:0/1907333319 >> 172.21.15.133:0/1907333319 conn(0x7f1ffc0c63b0 msgr2=0x7f1ffc06d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:59.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.393+0000 7f2001384640 1 -- 172.21.15.133:0/1907333319 shutdown_connections 2023-12-19T19:00:59.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.393+0000 7f2001384640 1 -- 172.21.15.133:0/1907333319 wait complete. 2023-12-19T19:00:59.418 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T19:00:29.085029+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T19:00:30.359577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-19T19:00:46.784805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-19T19:00:48.051355+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T19:00:59.418 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T19:00:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.553+0000 7f67eabd0640 1 Processor -- start 2023-12-19T19:00:59.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.553+0000 7f67eabd0640 1 -- start start 2023-12-19T19:00:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67eabd0640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f67e406d990 0x7f67e40c5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67eabd0640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67e41546c0 0x7f67e4154b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67eabd0640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67e40c1e30 con 0x7f67e406c070 2023-12-19T19:00:59.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67eabd0640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67e406dd70 con 0x7f67e406d990 2023-12-19T19:00:59.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67eabd0640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e40c1220 con 0x7f67e41546c0 2023-12-19T19:00:59.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67ea3cf640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f67e406c070 0x7f67e406c500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58466/0 (socket says 172.21.15.133:58466) 2023-12-19T19:00:59.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67ea3cf640 1 -- 172.21.15.133:0/445503709 learned_addr learned my addr 172.21.15.133:0/445503709 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e93cd640 1 --2- 172.21.15.133:0/445503709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67e41546c0 0x7f67e4154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e9bce640 1 --2- 172.21.15.133:0/445503709 >> v2:172.21.15.138:3300/0 conn(0x7f67e406d990 0x7f67e40c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e8bcc640 1 -- 172.21.15.133:0/445503709 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 949746415 0 0) 0x7f67e40c1e30 con 0x7f67e406c070 2023-12-19T19:00:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e8bcc640 1 -- 172.21.15.133:0/445503709 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67d0003530 con 0x7f67e406c070 2023-12-19T19:00:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e8bcc640 1 -- 172.21.15.133:0/445503709 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2876005486 0 0) 0x7f67d0003530 con 0x7f67e406c070 2023-12-19T19:00:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e8bcc640 1 -- 172.21.15.133:0/445503709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67e41546c0 msgr2=0x7f67e4154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e8bcc640 1 --2- 172.21.15.133:0/445503709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67e41546c0 0x7f67e4154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e8bcc640 1 -- 172.21.15.133:0/445503709 >> v2:172.21.15.138:3300/0 conn(0x7f67e406d990 msgr2=0x7f67e40c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e8bcc640 1 --2- 172.21.15.133:0/445503709 >> v2:172.21.15.138:3300/0 conn(0x7f67e406d990 0x7f67e40c5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e8bcc640 1 -- 172.21.15.133:0/445503709 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e40c1500 con 0x7f67e406c070 2023-12-19T19:00:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e8bcc640 1 -- 172.21.15.133:0/445503709 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f67dc001a00 con 0x7f67e406c070 2023-12-19T19:00:59.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e8bcc640 1 -- 172.21.15.133:0/445503709 >> v1:172.21.15.133:6789/0 conn(0x7f67e406c070 legacy=0x7f67e406c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e8bcc640 1 --2- 172.21.15.133:0/445503709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67e41546c0 0x7f67d0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e8bcc640 1 --2- 172.21.15.133:0/445503709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67d0003f00 0x7f67d00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e8bcc640 1 --2- 172.21.15.133:0/445503709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67d0004d10 0x7f67d0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e8bcc640 1 -- 172.21.15.133:0/445503709 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e406dd70 con 0x7f67d0003f00 2023-12-19T19:00:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e8bcc640 1 -- 172.21.15.133:0/445503709 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e40c1220 con 0x7f67d0004d10 2023-12-19T19:00:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e8bcc640 1 -- 172.21.15.133:0/445503709 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d000b990 con 0x7f67e41546c0 2023-12-19T19:00:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e93cd640 1 --2- 172.21.15.133:0/445503709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67d0003f00 0x7f67d00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e9bce640 1 --2- 172.21.15.133:0/445503709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67e41546c0 0x7f67d0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67ea3cf640 1 --2- 172.21.15.133:0/445503709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67d0004d10 0x7f67d0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e93cd640 1 -- 172.21.15.133:0/445503709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67e41546c0 msgr2=0x7f67d0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e93cd640 1 --2- 172.21.15.133:0/445503709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67e41546c0 0x7f67d0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e93cd640 1 -- 172.21.15.133:0/445503709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67d0004d10 msgr2=0x7f67d0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e93cd640 1 --2- 172.21.15.133:0/445503709 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67d0004d10 0x7f67d0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.557+0000 7f67e93cd640 1 -- 172.21.15.133:0/445503709 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d0003530 con 0x7f67d0003f00 2023-12-19T19:00:59.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.561+0000 7f67e93cd640 1 --2- 172.21.15.133:0/445503709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67d0003f00 0x7f67d00047d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f67d4009ae0 tx=0x7f67d401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a515b68854b111d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:59.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.561+0000 7f67e8bcc640 1 -- 172.21.15.133:0/445503709 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d40a5530 con 0x7f67d0003f00 2023-12-19T19:00:59.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.561+0000 7f67e8bcc640 1 -- 172.21.15.133:0/445503709 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67d40a5690 con 0x7f67d0003f00 2023-12-19T19:00:59.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.561+0000 7f67e8bcc640 1 -- 172.21.15.133:0/445503709 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67d40a5a40 con 0x7f67d0003f00 2023-12-19T19:00:59.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.561+0000 7f67eabd0640 1 -- 172.21.15.133:0/445503709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67d0003f00 msgr2=0x7f67d00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:59.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.561+0000 7f67eabd0640 1 --2- 172.21.15.133:0/445503709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67d0003f00 0x7f67d00047d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f67d4009ae0 tx=0x7f67d401c9f0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.561+0000 7f67ea3cf640 1 -- 172.21.15.133:0/445503709 reap_dead start 2023-12-19T19:00:59.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.561+0000 7f67eabd0640 1 -- 172.21.15.133:0/445503709 shutdown_connections 2023-12-19T19:00:59.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.561+0000 7f67eabd0640 1 -- 172.21.15.133:0/445503709 >> 172.21.15.133:0/445503709 conn(0x7f67e40a7800 msgr2=0x7f67e40a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:59.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.561+0000 7f67eabd0640 1 -- 172.21.15.133:0/445503709 shutdown_connections 2023-12-19T19:00:59.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.561+0000 7f67eabd0640 1 -- 172.21.15.133:0/445503709 wait complete. 2023-12-19T19:00:59.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.561+0000 7f67eabd0640 1 Processor -- start 2023-12-19T19:00:59.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.561+0000 7f67eabd0640 1 -- start start 2023-12-19T19:00:59.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.565+0000 7f67eabd0640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67d0003f00 0x7f67e4146090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:59.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.565+0000 7f67eabd0640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67e4151380 0x7f67e4071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:59.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.565+0000 7f67eabd0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67e4071f50 0x7f67e41e5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:59.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.565+0000 7f67eabd0640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e41481c0 con 0x7f67e4071f50 2023-12-19T19:00:59.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.565+0000 7f67eabd0640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67e41e9280 con 0x7f67d0003f00 2023-12-19T19:00:59.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.565+0000 7f67eabd0640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67e41e9560 con 0x7f67e4151380 2023-12-19T19:00:59.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.565+0000 7f67ea3cf640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67e4071f50 0x7f67e41e5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:59.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.565+0000 7f67ea3cf640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67e4071f50 0x7f67e41e5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39376/0 (socket says 172.21.15.133:39376) 2023-12-19T19:00:59.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.565+0000 7f67ea3cf640 1 -- 172.21.15.133:0/4237269946 learned_addr learned my addr 172.21.15.133:0/4237269946 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:59.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.565+0000 7f67e9bce640 1 --2- 172.21.15.133:0/4237269946 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67d0003f00 0x7f67e4146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:59.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.565+0000 7f67e93cd640 1 --2- 172.21.15.133:0/4237269946 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67e4151380 0x7f67e4071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:59.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.565+0000 7f67ea3cf640 1 -- 172.21.15.133:0/4237269946 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67e4151380 msgr2=0x7f67e4071a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:59.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.565+0000 7f67ea3cf640 1 --2- 172.21.15.133:0/4237269946 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67e4151380 0x7f67e4071a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.565+0000 7f67ea3cf640 1 -- 172.21.15.133:0/4237269946 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67d0003f00 msgr2=0x7f67e4146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:59.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.565+0000 7f67ea3cf640 1 --2- 172.21.15.133:0/4237269946 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67d0003f00 0x7f67e4146090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.565+0000 7f67ea3cf640 1 -- 172.21.15.133:0/4237269946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e406cd90 con 0x7f67e4071f50 2023-12-19T19:00:59.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.565+0000 7f67ea3cf640 1 --2- 172.21.15.133:0/4237269946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67e4071f50 0x7f67e41e5c70 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f67e40c1360 tx=0x7f67dc007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:59.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.565+0000 7f67da7fc640 1 -- 172.21.15.133:0/4237269946 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc0119e0 con 0x7f67e4071f50 2023-12-19T19:00:59.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.565+0000 7f67da7fc640 1 -- 172.21.15.133:0/4237269946 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67dc011b40 con 0x7f67e4071f50 2023-12-19T19:00:59.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.565+0000 7f67eabd0640 1 -- 172.21.15.133:0/4237269946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67e41e9840 con 0x7f67e4071f50 2023-12-19T19:00:59.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.565+0000 7f67da7fc640 1 -- 172.21.15.133:0/4237269946 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67dc004e40 con 0x7f67e4071f50 2023-12-19T19:00:59.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.565+0000 7f67eabd0640 1 -- 172.21.15.133:0/4237269946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67e41465d0 con 0x7f67e4071f50 2023-12-19T19:00:59.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.565+0000 7f67eabd0640 1 -- 172.21.15.133:0/4237269946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67e404e850 con 0x7f67e4071f50 2023-12-19T19:00:59.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.569+0000 7f67da7fc640 1 -- 172.21.15.133:0/4237269946 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f67dc006110 con 0x7f67e4071f50 2023-12-19T19:00:59.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.569+0000 7f67da7fc640 1 --2- 172.21.15.133:0/4237269946 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f67c80664a0 0x7f67c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:59.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.569+0000 7f67da7fc640 1 -- 172.21.15.133:0/4237269946 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f67dc086f70 con 0x7f67e4071f50 2023-12-19T19:00:59.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.569+0000 7f67e9bce640 1 --2- 172.21.15.133:0/4237269946 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f67c80664a0 0x7f67c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:59.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.569+0000 7f67e9bce640 1 --2- 172.21.15.133:0/4237269946 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f67c80664a0 0x7f67c8068960 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f67e0009c60 tx=0x7f67e0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:59.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.573+0000 7f67da7fc640 1 -- 172.21.15.133:0/4237269946 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f67dc0541d0 con 0x7f67e4071f50 2023-12-19T19:00:59.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.721+0000 7f67eabd0640 1 -- 172.21.15.133:0/4237269946 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67e40c21b0 con 0x7f67e4071f50 2023-12-19T19:00:59.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.721+0000 7f67da7fc640 1 -- 172.21.15.133:0/4237269946 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f67dc01c020 con 0x7f67e4071f50 2023-12-19T19:00:59.726 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T19:00:59.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.725+0000 7f67eabd0640 1 -- 172.21.15.133:0/4237269946 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f67c80664a0 msgr2=0x7f67c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.725+0000 7f67eabd0640 1 --2- 172.21.15.133:0/4237269946 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f67c80664a0 0x7f67c8068960 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f67e0009c60 tx=0x7f67e0009190 comp rx=0 tx=0).stop 2023-12-19T19:00:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.725+0000 7f67eabd0640 1 -- 172.21.15.133:0/4237269946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67e4071f50 msgr2=0x7f67e41e5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.725+0000 7f67eabd0640 1 --2- 172.21.15.133:0/4237269946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67e4071f50 0x7f67e41e5c70 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f67e40c1360 tx=0x7f67dc007af0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.725+0000 7f67eabd0640 1 -- 172.21.15.133:0/4237269946 shutdown_connections 2023-12-19T19:00:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.725+0000 7f67eabd0640 1 --2- 172.21.15.133:0/4237269946 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f67c80664a0 0x7f67c8068960 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.725+0000 7f67eabd0640 1 --2- 172.21.15.133:0/4237269946 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67e4071f50 0x7f67e41e5c70 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.725+0000 7f67eabd0640 1 --2- 172.21.15.133:0/4237269946 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67e4151380 0x7f67e4071a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.725+0000 7f67eabd0640 1 --2- 172.21.15.133:0/4237269946 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67d0003f00 0x7f67e4146090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.725+0000 7f67eabd0640 1 -- 172.21.15.133:0/4237269946 >> 172.21.15.133:0/4237269946 conn(0x7f67e40a7800 msgr2=0x7f67e40a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.725+0000 7f67eabd0640 1 -- 172.21.15.133:0/4237269946 shutdown_connections 2023-12-19T19:00:59.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.725+0000 7f67eabd0640 1 -- 172.21.15.133:0/4237269946 wait complete. 2023-12-19T19:00:59.748 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T19:00:59.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.885+0000 7f7d8946b640 1 Processor -- start 2023-12-19T19:00:59.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.885+0000 7f7d8946b640 1 -- start start 2023-12-19T19:00:59.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.885+0000 7f7d8946b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d84151e90 0x7f7d840c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:59.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.885+0000 7f7d8946b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7d840c7ea0 0x7f7d8406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:59.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.885+0000 7f7d8946b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8406c860 con 0x7f7d840c4e60 2023-12-19T19:00:59.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.885+0000 7f7d8946b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d840c8750 con 0x7f7d840c7ea0 2023-12-19T19:00:59.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.885+0000 7f7d8946b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d841552d0 con 0x7f7d84151e90 2023-12-19T19:00:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.885+0000 7f7d837fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7d840c4e60 0x7f7d8406b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58470/0 (socket says 172.21.15.133:58470) 2023-12-19T19:00:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.885+0000 7f7d837fe640 1 -- 172.21.15.133:0/3453502124 learned_addr learned my addr 172.21.15.133:0/3453502124 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:00:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.885+0000 7f7d7a7fc640 1 --2- 172.21.15.133:0/3453502124 >> v2:172.21.15.138:3300/0 conn(0x7f7d840c7ea0 0x7f7d8406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.885+0000 7f7d82ffd640 1 --2- 172.21.15.133:0/3453502124 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d84151e90 0x7f7d840c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.885+0000 7f7d827fc640 1 -- 172.21.15.133:0/3453502124 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650654389 0 0) 0x7f7d8406c860 con 0x7f7d840c4e60 2023-12-19T19:00:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.885+0000 7f7d827fc640 1 -- 172.21.15.133:0/3453502124 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d70003530 con 0x7f7d840c4e60 2023-12-19T19:00:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.885+0000 7f7d7a7fc640 1 -- 172.21.15.133:0/3453502124 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d84151e90 msgr2=0x7f7d840c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:00:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.885+0000 7f7d7a7fc640 1 --2- 172.21.15.133:0/3453502124 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d84151e90 0x7f7d840c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.885+0000 7f7d7a7fc640 1 -- 172.21.15.133:0/3453502124 >> v1:172.21.15.133:6789/0 conn(0x7f7d840c4e60 legacy=0x7f7d8406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.885+0000 7f7d7a7fc640 1 -- 172.21.15.133:0/3453502124 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d84154930 con 0x7f7d840c7ea0 2023-12-19T19:00:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.885+0000 7f7d82ffd640 1 --2- 172.21.15.133:0/3453502124 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d84151e90 0x7f7d840c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:00:59.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.889+0000 7f7d7a7fc640 1 --2- 172.21.15.133:0/3453502124 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d840c7ea0 0x7f7d8406b4a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c0097c0 tx=0x7f7d6c01c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d47a6f1c124880d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:59.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.889+0000 7f7d827fc640 1 -- 172.21.15.133:0/3453502124 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c0ab600 con 0x7f7d840c7ea0 2023-12-19T19:00:59.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.889+0000 7f7d827fc640 1 -- 172.21.15.133:0/3453502124 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6c0a7050 con 0x7f7d840c7ea0 2023-12-19T19:00:59.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.889+0000 7f7d827fc640 1 -- 172.21.15.133:0/3453502124 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c0ab980 con 0x7f7d840c7ea0 2023-12-19T19:00:59.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.889+0000 7f7d8946b640 1 -- 172.21.15.133:0/3453502124 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d840c7ea0 msgr2=0x7f7d8406b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:59.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.889+0000 7f7d8946b640 1 --2- 172.21.15.133:0/3453502124 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d840c7ea0 0x7f7d8406b4a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c0097c0 tx=0x7f7d6c01c360 comp rx=0 tx=0).stop 2023-12-19T19:00:59.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.889+0000 7f7d8946b640 1 -- 172.21.15.133:0/3453502124 shutdown_connections 2023-12-19T19:00:59.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.889+0000 7f7d8946b640 1 --2- 172.21.15.133:0/3453502124 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d840c7ea0 0x7f7d8406b4a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.889+0000 7f7d8946b640 1 --2- 172.21.15.133:0/3453502124 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d84151e90 0x7f7d840c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.889+0000 7f7d8946b640 1 -- 172.21.15.133:0/3453502124 >> 172.21.15.133:0/3453502124 conn(0x7f7d840ca170 msgr2=0x7f7d840ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:00:59.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.889+0000 7f7d8946b640 1 -- 172.21.15.133:0/3453502124 shutdown_connections 2023-12-19T19:00:59.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.889+0000 7f7d8946b640 1 -- 172.21.15.133:0/3453502124 wait complete. 2023-12-19T19:00:59.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d8946b640 1 Processor -- start 2023-12-19T19:00:59.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d8946b640 1 -- start start 2023-12-19T19:00:59.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d8946b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d840c4e60 0x7f7d841f04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:59.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d8946b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d840c7ea0 0x7f7d841ef6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:59.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d8946b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d84151e90 0x7f7d841efc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:59.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d8946b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d841f1180 con 0x7f7d84151e90 2023-12-19T19:00:59.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d8946b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d84154010 con 0x7f7d840c7ea0 2023-12-19T19:00:59.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d8946b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d84145490 con 0x7f7d840c4e60 2023-12-19T19:00:59.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d837fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d84151e90 0x7f7d841efc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:59.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d837fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d84151e90 0x7f7d841efc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39390/0 (socket says 172.21.15.133:39390) 2023-12-19T19:00:59.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d837fe640 1 -- 172.21.15.133:0/1754524939 learned_addr learned my addr 172.21.15.133:0/1754524939 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:00:59.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d82ffd640 1 --2- 172.21.15.133:0/1754524939 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d840c4e60 0x7f7d841f04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:59.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d7a7fc640 1 --2- 172.21.15.133:0/1754524939 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d840c7ea0 0x7f7d841ef6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:59.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d837fe640 1 -- 172.21.15.133:0/1754524939 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d840c4e60 msgr2=0x7f7d841f04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:59.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d837fe640 1 --2- 172.21.15.133:0/1754524939 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d840c4e60 0x7f7d841f04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d837fe640 1 -- 172.21.15.133:0/1754524939 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d840c7ea0 msgr2=0x7f7d841ef6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:00:59.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d837fe640 1 --2- 172.21.15.133:0/1754524939 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d840c7ea0 0x7f7d841ef6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:00:59.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d837fe640 1 -- 172.21.15.133:0/1754524939 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d74009420 con 0x7f7d84151e90 2023-12-19T19:00:59.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d837fe640 1 --2- 172.21.15.133:0/1754524939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d84151e90 0x7f7d841efc00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00caa0 tx=0x7f7d7c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:59.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d7bfff640 1 -- 172.21.15.133:0/1754524939 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c00ac00 con 0x7f7d84151e90 2023-12-19T19:00:59.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d7bfff640 1 -- 172.21.15.133:0/1754524939 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c00ad60 con 0x7f7d84151e90 2023-12-19T19:00:59.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d8946b640 1 -- 172.21.15.133:0/1754524939 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d6c009420 con 0x7f7d84151e90 2023-12-19T19:00:59.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d7bfff640 1 -- 172.21.15.133:0/1754524939 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c012620 con 0x7f7d84151e90 2023-12-19T19:00:59.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.893+0000 7f7d8946b640 1 -- 172.21.15.133:0/1754524939 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d841543d0 con 0x7f7d84151e90 2023-12-19T19:00:59.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.897+0000 7f7d8946b640 1 -- 172.21.15.133:0/1754524939 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d84068400 con 0x7f7d84151e90 2023-12-19T19:00:59.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.897+0000 7f7d7bfff640 1 -- 172.21.15.133:0/1754524939 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7d7c007070 con 0x7f7d84151e90 2023-12-19T19:00:59.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.897+0000 7f7d7bfff640 1 --2- 172.21.15.133:0/1754524939 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7d64066470 0x7f7d64068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:00:59.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.897+0000 7f7d7bfff640 1 -- 172.21.15.133:0/1754524939 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7d7c0841d0 con 0x7f7d84151e90 2023-12-19T19:00:59.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.897+0000 7f7d82ffd640 1 --2- 172.21.15.133:0/1754524939 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7d64066470 0x7f7d64068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:00:59.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.897+0000 7f7d82ffd640 1 --2- 172.21.15.133:0/1754524939 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7d64066470 0x7f7d64068930 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009cf0 tx=0x7f7d74009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:00:59.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:00:59.901+0000 7f7d7bfff640 1 -- 172.21.15.133:0/1754524939 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7d7c051310 con 0x7f7d84151e90 2023-12-19T19:01:00.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.049+0000 7f7d8946b640 1 -- 172.21.15.133:0/1754524939 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7d84144230 con 0x7f7d84151e90 2023-12-19T19:01:00.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.053+0000 7f7d7bfff640 1 -- 172.21.15.133:0/1754524939 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7d7c054930 con 0x7f7d84151e90 2023-12-19T19:01:00.057 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:01:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.053+0000 7f7d8946b640 1 -- 172.21.15.133:0/1754524939 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7d64066470 msgr2=0x7f7d64068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.053+0000 7f7d8946b640 1 --2- 172.21.15.133:0/1754524939 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7d64066470 0x7f7d64068930 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7d74009cf0 tx=0x7f7d74009190 comp rx=0 tx=0).stop 2023-12-19T19:01:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.053+0000 7f7d8946b640 1 -- 172.21.15.133:0/1754524939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d84151e90 msgr2=0x7f7d841efc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.053+0000 7f7d8946b640 1 --2- 172.21.15.133:0/1754524939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d84151e90 0x7f7d841efc00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00caa0 tx=0x7f7d7c00cf60 comp rx=0 tx=0).stop 2023-12-19T19:01:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.053+0000 7f7d8946b640 1 -- 172.21.15.133:0/1754524939 shutdown_connections 2023-12-19T19:01:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.053+0000 7f7d8946b640 1 --2- 172.21.15.133:0/1754524939 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7d64066470 0x7f7d64068930 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.053+0000 7f7d8946b640 1 --2- 172.21.15.133:0/1754524939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7d84151e90 0x7f7d841efc00 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.053+0000 7f7d8946b640 1 --2- 172.21.15.133:0/1754524939 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7d840c7ea0 0x7f7d841ef6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.053+0000 7f7d8946b640 1 --2- 172.21.15.133:0/1754524939 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7d840c4e60 0x7f7d841f04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.053+0000 7f7d8946b640 1 -- 172.21.15.133:0/1754524939 >> 172.21.15.133:0/1754524939 conn(0x7f7d840ca170 msgr2=0x7f7d8415e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:00.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.053+0000 7f7d8946b640 1 -- 172.21.15.133:0/1754524939 shutdown_connections 2023-12-19T19:01:00.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.053+0000 7f7d8946b640 1 -- 172.21.15.133:0/1754524939 wait complete. 2023-12-19T19:01:00.076 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T19:01:00.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.213+0000 7f1a26b9d640 1 Processor -- start 2023-12-19T19:01:00.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.213+0000 7f1a26b9d640 1 -- start start 2023-12-19T19:01:00.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a26b9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a2006bbb0 0x7f1a201600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:00.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a26b9d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2006c860 con 0x7f1a200c7ea0 2023-12-19T19:01:00.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a26b9d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2006c040 con 0x7f1a20151e90 2023-12-19T19:01:00.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a26b9d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a200c8750 con 0x7f1a2006bbb0 2023-12-19T19:01:00.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a1ffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1a200c7ea0 0x7f1a2006b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58482/0 (socket says 172.21.15.133:58482) 2023-12-19T19:01:00.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a1ffff640 1 -- 172.21.15.133:0/1808742808 learned_addr learned my addr 172.21.15.133:0/1808742808 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:00.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a2513a640 1 --2- 172.21.15.133:0/1808742808 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a2006bbb0 0x7f1a201600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:00.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a1f7fe640 1 -- 172.21.15.133:0/1808742808 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1921165773 0 0) 0x7f1a2006c860 con 0x7f1a200c7ea0 2023-12-19T19:01:00.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a1f7fe640 1 -- 172.21.15.133:0/1808742808 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a10003530 con 0x7f1a200c7ea0 2023-12-19T19:01:00.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a1f7fe640 1 -- 172.21.15.133:0/1808742808 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 385149259 0 0) 0x7f1a10003530 con 0x7f1a200c7ea0 2023-12-19T19:01:00.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a1f7fe640 1 -- 172.21.15.133:0/1808742808 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a2006bbb0 msgr2=0x7f1a201600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:00.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a1f7fe640 1 --2- 172.21.15.133:0/1808742808 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a2006bbb0 0x7f1a201600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a1f7fe640 1 -- 172.21.15.133:0/1808742808 >> v1:172.21.15.138:6789/0 conn(0x7f1a20151e90 legacy=0x7f1a200c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:00.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a1f7fe640 1 -- 172.21.15.133:0/1808742808 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a20154930 con 0x7f1a200c7ea0 2023-12-19T19:01:00.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a1f7fe640 1 -- 172.21.15.133:0/1808742808 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f1a0c001680 con 0x7f1a200c7ea0 2023-12-19T19:01:00.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a1f7fe640 1 -- 172.21.15.133:0/1808742808 >> v1:172.21.15.133:6789/0 conn(0x7f1a200c7ea0 legacy=0x7f1a2006b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:00.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a1f7fe640 1 --2- 172.21.15.133:0/1808742808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a100039b0 0x7f1a10003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:00.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a1f7fe640 1 --2- 172.21.15.133:0/1808742808 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a100047d0 0x7f1a10004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:00.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a1f7fe640 1 --2- 172.21.15.133:0/1808742808 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a10005190 0x7f1a1000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:00.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a1f7fe640 1 -- 172.21.15.133:0/1808742808 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a200c8750 con 0x7f1a100039b0 2023-12-19T19:01:00.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a1f7fe640 1 -- 172.21.15.133:0/1808742808 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1000c060 con 0x7f1a10005190 2023-12-19T19:01:00.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a1f7fe640 1 -- 172.21.15.133:0/1808742808 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a1000c220 con 0x7f1a100047d0 2023-12-19T19:01:00.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a2513a640 1 --2- 172.21.15.133:0/1808742808 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a2006bbb0 0x7f1a201600b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:01:00.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a24939640 1 --2- 172.21.15.133:0/1808742808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a100039b0 0x7f1a10003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:00.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a2513a640 1 --2- 172.21.15.133:0/1808742808 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a10005190 0x7f1a1000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:00.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a1ffff640 1 --2- 172.21.15.133:0/1808742808 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a100047d0 0x7f1a10004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:00.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a24939640 1 -- 172.21.15.133:0/1808742808 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a100047d0 msgr2=0x7f1a10004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:00.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a24939640 1 --2- 172.21.15.133:0/1808742808 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a100047d0 0x7f1a10004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a24939640 1 -- 172.21.15.133:0/1808742808 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a10005190 msgr2=0x7f1a1000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:00.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a24939640 1 --2- 172.21.15.133:0/1808742808 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a10005190 0x7f1a1000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.217+0000 7f1a24939640 1 -- 172.21.15.133:0/1808742808 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a10003530 con 0x7f1a100039b0 2023-12-19T19:01:00.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.221+0000 7f1a24939640 1 --2- 172.21.15.133:0/1808742808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a100039b0 0x7f1a10003d90 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f1a14001860 tx=0x7f1a1401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c0c6491b347844 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:00.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.221+0000 7f1a1f7fe640 1 -- 172.21.15.133:0/1808742808 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a140ab600 con 0x7f1a100039b0 2023-12-19T19:01:00.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.221+0000 7f1a1f7fe640 1 -- 172.21.15.133:0/1808742808 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a140a7050 con 0x7f1a100039b0 2023-12-19T19:01:00.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.221+0000 7f1a1f7fe640 1 -- 172.21.15.133:0/1808742808 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a140ab9a0 con 0x7f1a100039b0 2023-12-19T19:01:00.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.221+0000 7f1a26b9d640 1 -- 172.21.15.133:0/1808742808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a100039b0 msgr2=0x7f1a10003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:00.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.221+0000 7f1a26b9d640 1 --2- 172.21.15.133:0/1808742808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a100039b0 0x7f1a10003d90 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f1a14001860 tx=0x7f1a1401c500 comp rx=0 tx=0).stop 2023-12-19T19:01:00.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.221+0000 7f1a2513a640 1 -- 172.21.15.133:0/1808742808 reap_dead start 2023-12-19T19:01:00.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.221+0000 7f1a26b9d640 1 -- 172.21.15.133:0/1808742808 shutdown_connections 2023-12-19T19:01:00.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.221+0000 7f1a26b9d640 1 -- 172.21.15.133:0/1808742808 >> 172.21.15.133:0/1808742808 conn(0x7f1a200ca170 msgr2=0x7f1a200ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:00.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.221+0000 7f1a26b9d640 1 -- 172.21.15.133:0/1808742808 shutdown_connections 2023-12-19T19:01:00.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.221+0000 7f1a26b9d640 1 -- 172.21.15.133:0/1808742808 wait complete. 2023-12-19T19:01:00.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a26b9d640 1 Processor -- start 2023-12-19T19:01:00.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a26b9d640 1 -- start start 2023-12-19T19:01:00.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a26b9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a100039b0 0x7f1a200c20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:00.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a26b9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a200ab520 0x7f1a200a9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:00.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a26b9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a200ac2c0 0x7f1a201f0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:00.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a26b9d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a201552d0 con 0x7f1a200ab520 2023-12-19T19:01:00.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a26b9d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a200c26a0 con 0x7f1a200ac2c0 2023-12-19T19:01:00.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a26b9d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a200c2980 con 0x7f1a100039b0 2023-12-19T19:01:00.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a1ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a200ab520 0x7f1a200a9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:00.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a1ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a200ab520 0x7f1a200a9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39410/0 (socket says 172.21.15.133:39410) 2023-12-19T19:01:00.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a24939640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a100039b0 0x7f1a200c20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:00.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a1ffff640 1 -- 172.21.15.133:0/1349295370 learned_addr learned my addr 172.21.15.133:0/1349295370 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:00.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a2513a640 1 --2- 172.21.15.133:0/1349295370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a200ac2c0 0x7f1a201f0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:00.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a1ffff640 1 -- 172.21.15.133:0/1349295370 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a100039b0 msgr2=0x7f1a200c20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:00.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a1ffff640 1 --2- 172.21.15.133:0/1349295370 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a100039b0 0x7f1a200c20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a1ffff640 1 -- 172.21.15.133:0/1349295370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a200ac2c0 msgr2=0x7f1a201f0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:00.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a1ffff640 1 --2- 172.21.15.133:0/1349295370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a200ac2c0 0x7f1a201f0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a1ffff640 1 -- 172.21.15.133:0/1349295370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a200c2c60 con 0x7f1a200ab520 2023-12-19T19:01:00.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a1ffff640 1 --2- 172.21.15.133:0/1349295370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a200ab520 0x7f1a200a9960 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c0072c0 tx=0x7f1a0c007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:00.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a1d7fa640 1 -- 172.21.15.133:0/1349295370 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c0015f0 con 0x7f1a200ab520 2023-12-19T19:01:00.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a1d7fa640 1 -- 172.21.15.133:0/1349295370 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0c00f9c0 con 0x7f1a200ab520 2023-12-19T19:01:00.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a1d7fa640 1 -- 172.21.15.133:0/1349295370 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0c00fd70 con 0x7f1a200ab520 2023-12-19T19:01:00.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a26b9d640 1 -- 172.21.15.133:0/1349295370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a201eff30 con 0x7f1a200ab520 2023-12-19T19:01:00.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.225+0000 7f1a26b9d640 1 -- 172.21.15.133:0/1349295370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a200c3740 con 0x7f1a200ab520 2023-12-19T19:01:00.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.229+0000 7f1a26b9d640 1 -- 172.21.15.133:0/1349295370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a20068400 con 0x7f1a200ab520 2023-12-19T19:01:00.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.229+0000 7f1a1d7fa640 1 -- 172.21.15.133:0/1349295370 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1a0c01c410 con 0x7f1a200ab520 2023-12-19T19:01:00.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.229+0000 7f1a1d7fa640 1 --2- 172.21.15.133:0/1349295370 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1a040664a0 0x7f1a04068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:00.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.229+0000 7f1a1d7fa640 1 -- 172.21.15.133:0/1349295370 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1a0c083d80 con 0x7f1a200ab520 2023-12-19T19:01:00.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.229+0000 7f1a24939640 1 --2- 172.21.15.133:0/1349295370 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1a040664a0 0x7f1a04068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:00.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.229+0000 7f1a24939640 1 --2- 172.21.15.133:0/1349295370 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1a040664a0 0x7f1a04068960 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1a14001860 tx=0x7f1a140a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:00.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.233+0000 7f1a1d7fa640 1 -- 172.21.15.133:0/1349295370 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1a0c050eb0 con 0x7f1a200ab520 2023-12-19T19:01:00.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.385+0000 7f1a26b9d640 1 -- 172.21.15.133:0/1349295370 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1a2006ca50 con 0x7f1a200ab520 2023-12-19T19:01:00.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.385+0000 7f1a1d7fa640 1 -- 172.21.15.133:0/1349295370 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1a0c0544d0 con 0x7f1a200ab520 2023-12-19T19:01:00.390 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:01:00.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.389+0000 7f1a26b9d640 1 -- 172.21.15.133:0/1349295370 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1a040664a0 msgr2=0x7f1a04068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:00.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.389+0000 7f1a26b9d640 1 --2- 172.21.15.133:0/1349295370 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1a040664a0 0x7f1a04068960 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1a14001860 tx=0x7f1a140a6000 comp rx=0 tx=0).stop 2023-12-19T19:01:00.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.389+0000 7f1a26b9d640 1 -- 172.21.15.133:0/1349295370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a200ab520 msgr2=0x7f1a200a9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:00.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.389+0000 7f1a26b9d640 1 --2- 172.21.15.133:0/1349295370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a200ab520 0x7f1a200a9960 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c0072c0 tx=0x7f1a0c007780 comp rx=0 tx=0).stop 2023-12-19T19:01:00.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.389+0000 7f1a26b9d640 1 -- 172.21.15.133:0/1349295370 shutdown_connections 2023-12-19T19:01:00.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.389+0000 7f1a26b9d640 1 --2- 172.21.15.133:0/1349295370 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1a040664a0 0x7f1a04068960 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.389+0000 7f1a26b9d640 1 --2- 172.21.15.133:0/1349295370 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1a200ac2c0 0x7f1a201f0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.389+0000 7f1a26b9d640 1 --2- 172.21.15.133:0/1349295370 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1a200ab520 0x7f1a200a9960 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.389+0000 7f1a26b9d640 1 --2- 172.21.15.133:0/1349295370 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1a100039b0 0x7f1a200c20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.389+0000 7f1a26b9d640 1 -- 172.21.15.133:0/1349295370 >> 172.21.15.133:0/1349295370 conn(0x7f1a200ca170 msgr2=0x7f1a201500f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:00.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.389+0000 7f1a26b9d640 1 -- 172.21.15.133:0/1349295370 shutdown_connections 2023-12-19T19:01:00.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.389+0000 7f1a26b9d640 1 -- 172.21.15.133:0/1349295370 wait complete. 2023-12-19T19:01:00.412 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-19T19:01:00.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.549+0000 7f296ed80640 1 Processor -- start 2023-12-19T19:01:00.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.549+0000 7f296ed80640 1 -- start start 2023-12-19T19:01:00.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.549+0000 7f296ed80640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29680c4e80 0x7f29680c5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:00.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.549+0000 7f296ed80640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f29680724c0 0x7f2968152490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:00.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.549+0000 7f296ed80640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29680a57d0 con 0x7f296806d150 2023-12-19T19:01:00.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.549+0000 7f296ed80640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29680c3540 con 0x7f29680724c0 2023-12-19T19:01:00.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.549+0000 7f296ed80640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29680c5de0 con 0x7f29680c4e80 2023-12-19T19:01:00.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f295ffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f296806d150 0x7f29680c1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58494/0 (socket says 172.21.15.133:58494) 2023-12-19T19:01:00.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f295ffff640 1 -- 172.21.15.133:0/4119776745 learned_addr learned my addr 172.21.15.133:0/4119776745 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:00.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f296cb1c640 1 --2- 172.21.15.133:0/4119776745 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29680c4e80 0x7f29680c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:00.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f296d31d640 1 --2- 172.21.15.133:0/4119776745 >> v2:172.21.15.138:3300/0 conn(0x7f29680724c0 0x7f2968152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:00.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f295f7fe640 1 -- 172.21.15.133:0/4119776745 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161896902 0 0) 0x7f29680a57d0 con 0x7f296806d150 2023-12-19T19:01:00.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f295f7fe640 1 -- 172.21.15.133:0/4119776745 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2950003530 con 0x7f296806d150 2023-12-19T19:01:00.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f295f7fe640 1 -- 172.21.15.133:0/4119776745 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3777364400 0 0) 0x7f2950003530 con 0x7f296806d150 2023-12-19T19:01:00.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f295f7fe640 1 -- 172.21.15.133:0/4119776745 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29680c4e80 msgr2=0x7f29680c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:00.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f295f7fe640 1 --2- 172.21.15.133:0/4119776745 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29680c4e80 0x7f29680c5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f295f7fe640 1 -- 172.21.15.133:0/4119776745 >> v2:172.21.15.138:3300/0 conn(0x7f29680724c0 msgr2=0x7f2968152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:00.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f295f7fe640 1 --2- 172.21.15.133:0/4119776745 >> v2:172.21.15.138:3300/0 conn(0x7f29680724c0 0x7f2968152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f295f7fe640 1 -- 172.21.15.133:0/4119776745 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29680c60c0 con 0x7f296806d150 2023-12-19T19:01:00.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f295f7fe640 1 -- 172.21.15.133:0/4119776745 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f2958001680 con 0x7f296806d150 2023-12-19T19:01:00.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f296d31d640 1 --2- 172.21.15.133:0/4119776745 >> v2:172.21.15.138:3300/0 conn(0x7f29680724c0 0x7f2968152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:01:00.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f295f7fe640 1 -- 172.21.15.133:0/4119776745 >> v1:172.21.15.133:6789/0 conn(0x7f296806d150 legacy=0x7f29680c1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:00.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f295f7fe640 1 --2- 172.21.15.133:0/4119776745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2950003980 0x7f2950003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:00.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f295f7fe640 1 --2- 172.21.15.133:0/4119776745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29500047d0 0x7f2950004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:00.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f295f7fe640 1 --2- 172.21.15.133:0/4119776745 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29680c4e80 0x7f2950005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:00.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f295f7fe640 1 -- 172.21.15.133:0/4119776745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29680c3540 con 0x7f2950003980 2023-12-19T19:01:00.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f295f7fe640 1 -- 172.21.15.133:0/4119776745 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29680c5de0 con 0x7f29500047d0 2023-12-19T19:01:00.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f295f7fe640 1 -- 172.21.15.133:0/4119776745 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f295000b990 con 0x7f29680c4e80 2023-12-19T19:01:00.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f296cb1c640 1 --2- 172.21.15.133:0/4119776745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2950003980 0x7f2950003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:00.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f295ffff640 1 --2- 172.21.15.133:0/4119776745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29500047d0 0x7f2950004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:00.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f296d31d640 1 --2- 172.21.15.133:0/4119776745 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29680c4e80 0x7f2950005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:00.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f296cb1c640 1 -- 172.21.15.133:0/4119776745 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29680c4e80 msgr2=0x7f2950005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:00.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f296cb1c640 1 --2- 172.21.15.133:0/4119776745 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29680c4e80 0x7f2950005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f296cb1c640 1 -- 172.21.15.133:0/4119776745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29500047d0 msgr2=0x7f2950004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:00.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f296cb1c640 1 --2- 172.21.15.133:0/4119776745 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f29500047d0 0x7f2950004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f296cb1c640 1 -- 172.21.15.133:0/4119776745 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2950003530 con 0x7f2950003980 2023-12-19T19:01:00.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.553+0000 7f296d31d640 1 --2- 172.21.15.133:0/4119776745 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29680c4e80 0x7f2950005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:00.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.557+0000 7f296cb1c640 1 --2- 172.21.15.133:0/4119776745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2950003980 0x7f2950003da0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f2964009b10 tx=0x7f296401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18eff12dfdfec59 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:00.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.557+0000 7f295f7fe640 1 -- 172.21.15.133:0/4119776745 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29640a5560 con 0x7f2950003980 2023-12-19T19:01:00.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.557+0000 7f295f7fe640 1 -- 172.21.15.133:0/4119776745 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29640a56c0 con 0x7f2950003980 2023-12-19T19:01:00.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.557+0000 7f295f7fe640 1 -- 172.21.15.133:0/4119776745 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29640a5a70 con 0x7f2950003980 2023-12-19T19:01:00.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.557+0000 7f296ed80640 1 -- 172.21.15.133:0/4119776745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2950003980 msgr2=0x7f2950003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:00.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.557+0000 7f296ed80640 1 --2- 172.21.15.133:0/4119776745 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2950003980 0x7f2950003da0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f2964009b10 tx=0x7f296401ca50 comp rx=0 tx=0).stop 2023-12-19T19:01:00.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.557+0000 7f296d31d640 1 -- 172.21.15.133:0/4119776745 reap_dead start 2023-12-19T19:01:00.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.557+0000 7f296ed80640 1 -- 172.21.15.133:0/4119776745 shutdown_connections 2023-12-19T19:01:00.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.557+0000 7f296ed80640 1 -- 172.21.15.133:0/4119776745 >> 172.21.15.133:0/4119776745 conn(0x7f296806a5b0 msgr2=0x7f296806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:00.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.557+0000 7f296ed80640 1 -- 172.21.15.133:0/4119776745 shutdown_connections 2023-12-19T19:01:00.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.557+0000 7f296ed80640 1 -- 172.21.15.133:0/4119776745 wait complete. 2023-12-19T19:01:00.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.557+0000 7f296ed80640 1 Processor -- start 2023-12-19T19:01:00.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.557+0000 7f296ed80640 1 -- start start 2023-12-19T19:01:00.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f296ed80640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2950003980 0x7f29680a8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:00.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f296ed80640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29681ed900 0x7f2968152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:00.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f296ed80640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f296814cdf0 0x7f296814d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:00.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f296ed80640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296815bab0 con 0x7f2950003980 2023-12-19T19:01:00.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f296ed80640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296815a680 con 0x7f296814cdf0 2023-12-19T19:01:00.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f296ed80640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296815b4f0 con 0x7f29681ed900 2023-12-19T19:01:00.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f296cb1c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2950003980 0x7f29680a8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:00.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f296cb1c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2950003980 0x7f29680a8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39426/0 (socket says 172.21.15.133:39426) 2023-12-19T19:01:00.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f296cb1c640 1 -- 172.21.15.133:0/3768638286 learned_addr learned my addr 172.21.15.133:0/3768638286 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:00.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f295ffff640 1 --2- 172.21.15.133:0/3768638286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29681ed900 0x7f2968152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:00.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f296d31d640 1 --2- 172.21.15.133:0/3768638286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f296814cdf0 0x7f296814d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:00.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f296cb1c640 1 -- 172.21.15.133:0/3768638286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29681ed900 msgr2=0x7f2968152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:00.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f296cb1c640 1 --2- 172.21.15.133:0/3768638286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29681ed900 0x7f2968152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f296cb1c640 1 -- 172.21.15.133:0/3768638286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f296814cdf0 msgr2=0x7f296814d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:00.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f296cb1c640 1 --2- 172.21.15.133:0/3768638286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f296814cdf0 0x7f296814d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f296cb1c640 1 -- 172.21.15.133:0/3768638286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296815b7d0 con 0x7f2950003980 2023-12-19T19:01:00.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f296d31d640 1 --2- 172.21.15.133:0/3768638286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f296814cdf0 0x7f296814d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:00.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f296cb1c640 1 --2- 172.21.15.133:0/3768638286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2950003980 0x7f29680a8320 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2964009b10 tx=0x7f2950005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:00.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f295d7fa640 1 -- 172.21.15.133:0/3768638286 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2964004220 con 0x7f2950003980 2023-12-19T19:01:00.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f295d7fa640 1 -- 172.21.15.133:0/3768638286 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2964004380 con 0x7f2950003980 2023-12-19T19:01:00.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f295d7fa640 1 -- 172.21.15.133:0/3768638286 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2964003860 con 0x7f2950003980 2023-12-19T19:01:00.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f296ed80640 1 -- 172.21.15.133:0/3768638286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f296815a310 con 0x7f2950003980 2023-12-19T19:01:00.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f296ed80640 1 -- 172.21.15.133:0/3768638286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2968153290 con 0x7f2950003980 2023-12-19T19:01:00.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f296ed80640 1 -- 172.21.15.133:0/3768638286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f296815a4d0 con 0x7f2950003980 2023-12-19T19:01:00.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.561+0000 7f295d7fa640 1 -- 172.21.15.133:0/3768638286 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f29640b4040 con 0x7f2950003980 2023-12-19T19:01:00.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.565+0000 7f295d7fa640 1 --2- 172.21.15.133:0/3768638286 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f29540664a0 0x7f2954068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:00.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.565+0000 7f295d7fa640 1 -- 172.21.15.133:0/3768638286 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f296411dc60 con 0x7f2950003980 2023-12-19T19:01:00.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.565+0000 7f295ffff640 1 --2- 172.21.15.133:0/3768638286 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f29540664a0 0x7f2954068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:00.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.565+0000 7f295ffff640 1 --2- 172.21.15.133:0/3768638286 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f29540664a0 0x7f2954068960 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f29680a8860 tx=0x7f2958007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:00.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.565+0000 7f295d7fa640 1 -- 172.21.15.133:0/3768638286 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f29640ead90 con 0x7f2950003980 2023-12-19T19:01:00.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.717+0000 7f296ed80640 1 -- 172.21.15.133:0/3768638286 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2968068400 con 0x7f2950003980 2023-12-19T19:01:00.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.717+0000 7f295d7fa640 1 -- 172.21.15.133:0/3768638286 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7f29640044f0 con 0x7f2950003980 2023-12-19T19:01:00.721 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:01:00.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.717+0000 7f296ed80640 1 -- 172.21.15.133:0/3768638286 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f29540664a0 msgr2=0x7f2954068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:00.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.717+0000 7f296ed80640 1 --2- 172.21.15.133:0/3768638286 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f29540664a0 0x7f2954068960 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f29680a8860 tx=0x7f2958007900 comp rx=0 tx=0).stop 2023-12-19T19:01:00.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.717+0000 7f296ed80640 1 -- 172.21.15.133:0/3768638286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2950003980 msgr2=0x7f29680a8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:00.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.717+0000 7f296ed80640 1 --2- 172.21.15.133:0/3768638286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2950003980 0x7f29680a8320 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2964009b10 tx=0x7f2950005800 comp rx=0 tx=0).stop 2023-12-19T19:01:00.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.717+0000 7f296ed80640 1 -- 172.21.15.133:0/3768638286 shutdown_connections 2023-12-19T19:01:00.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.717+0000 7f296ed80640 1 --2- 172.21.15.133:0/3768638286 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f29540664a0 0x7f2954068960 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.717+0000 7f296ed80640 1 --2- 172.21.15.133:0/3768638286 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f296814cdf0 0x7f296814d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.717+0000 7f296ed80640 1 --2- 172.21.15.133:0/3768638286 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f29681ed900 0x7f2968152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.717+0000 7f296ed80640 1 --2- 172.21.15.133:0/3768638286 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2950003980 0x7f29680a8320 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.717+0000 7f296ed80640 1 -- 172.21.15.133:0/3768638286 >> 172.21.15.133:0/3768638286 conn(0x7f296806a5b0 msgr2=0x7f296806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:00.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.717+0000 7f296ed80640 1 -- 172.21.15.133:0/3768638286 shutdown_connections 2023-12-19T19:01:00.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.717+0000 7f296ed80640 1 -- 172.21.15.133:0/3768638286 wait complete. 2023-12-19T19:01:00.744 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-19T19:01:00.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.881+0000 7f21f5c9c640 1 Processor -- start 2023-12-19T19:01:00.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.881+0000 7f21f5c9c640 1 -- start start 2023-12-19T19:01:00.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.881+0000 7f21f5c9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21f0154be0 0x7f21f015fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:00.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.881+0000 7f21f5c9c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f00c8160 con 0x7f21f00c7c50 2023-12-19T19:01:00.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.881+0000 7f21f5c9c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f0157b40 con 0x7f21f0151cd0 2023-12-19T19:01:00.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.881+0000 7f21f5c9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f0157e20 con 0x7f21f0154be0 2023-12-19T19:01:00.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.881+0000 7f21e7fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f21f00c7c50 0x7f21f01544d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58502/0 (socket says 172.21.15.133:58502) 2023-12-19T19:01:00.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.881+0000 7f21e7fff640 1 -- 172.21.15.133:0/1076295169 learned_addr learned my addr 172.21.15.133:0/1076295169 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:00.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.881+0000 7f21f549b640 1 --2- 172.21.15.133:0/1076295169 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21f0154be0 0x7f21f015fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:00.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.881+0000 7f21e77fe640 1 -- 172.21.15.133:0/1076295169 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2805060745 0 0) 0x7f21f00c8160 con 0x7f21f00c7c50 2023-12-19T19:01:00.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.881+0000 7f21e77fe640 1 -- 172.21.15.133:0/1076295169 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21d8003530 con 0x7f21f00c7c50 2023-12-19T19:01:00.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.881+0000 7f21e77fe640 1 -- 172.21.15.133:0/1076295169 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2487831443 0 0) 0x7f21f0157b40 con 0x7f21f0151cd0 2023-12-19T19:01:00.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.881+0000 7f21e77fe640 1 -- 172.21.15.133:0/1076295169 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21f00c8160 con 0x7f21f0151cd0 2023-12-19T19:01:00.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.881+0000 7f21f549b640 1 -- 172.21.15.133:0/1076295169 >> v1:172.21.15.138:6789/0 conn(0x7f21f0151cd0 legacy=0x7f21f00ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:00.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.881+0000 7f21f549b640 1 -- 172.21.15.133:0/1076295169 >> v1:172.21.15.133:6789/0 conn(0x7f21f00c7c50 legacy=0x7f21f01544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:00.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.881+0000 7f21e77fe640 1 -- 172.21.15.133:0/1076295169 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 216602431 0 0) 0x7f21d8003530 con 0x7f21f00c7c50 2023-12-19T19:01:00.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.881+0000 7f21f549b640 1 -- 172.21.15.133:0/1076295169 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f0158100 con 0x7f21f0154be0 2023-12-19T19:01:00.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.885+0000 7f21f549b640 1 --2- 172.21.15.133:0/1076295169 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21f0154be0 0x7f21f015fe40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009dc0 tx=0x7f21e801c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1be3f0d1b459a73 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:00.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.885+0000 7f21e77fe640 1 -- 172.21.15.133:0/1076295169 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e0001680 con 0x7f21f0154be0 2023-12-19T19:01:00.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.885+0000 7f21e77fe640 1 -- 172.21.15.133:0/1076295169 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e80a56c0 con 0x7f21f0154be0 2023-12-19T19:01:00.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.885+0000 7f21e77fe640 1 -- 172.21.15.133:0/1076295169 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e80a5a30 con 0x7f21f0154be0 2023-12-19T19:01:00.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.885+0000 7f21f5c9c640 1 -- 172.21.15.133:0/1076295169 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21f0154be0 msgr2=0x7f21f015fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:00.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.885+0000 7f21f5c9c640 1 --2- 172.21.15.133:0/1076295169 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21f0154be0 0x7f21f015fe40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009dc0 tx=0x7f21e801c860 comp rx=0 tx=0).stop 2023-12-19T19:01:00.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.885+0000 7f21f5c9c640 1 -- 172.21.15.133:0/1076295169 shutdown_connections 2023-12-19T19:01:00.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.885+0000 7f21f5c9c640 1 --2- 172.21.15.133:0/1076295169 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21f0154be0 0x7f21f015fe40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.885+0000 7f21f5c9c640 1 -- 172.21.15.133:0/1076295169 >> 172.21.15.133:0/1076295169 conn(0x7f21f00abee0 msgr2=0x7f21f00c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:00.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.885+0000 7f21f5c9c640 1 -- 172.21.15.133:0/1076295169 shutdown_connections 2023-12-19T19:01:00.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.885+0000 7f21f5c9c640 1 -- 172.21.15.133:0/1076295169 wait complete. 2023-12-19T19:01:00.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21f5c9c640 1 Processor -- start 2023-12-19T19:01:00.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21f5c9c640 1 -- start start 2023-12-19T19:01:00.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21f5c9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21f00c7c50 0x7f21f0142e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:00.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21f5c9c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21f0151cd0 0x7f21f01f03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:00.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21f5c9c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21f0154be0 0x7f21f01f0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:00.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21f5c9c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f01edf10 con 0x7f21f0151cd0 2023-12-19T19:01:00.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21f5c9c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f01572e0 con 0x7f21f0154be0 2023-12-19T19:01:00.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21f5c9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f01575c0 con 0x7f21f00c7c50 2023-12-19T19:01:00.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21e7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21f0151cd0 0x7f21f01f03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:00.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21e7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21f0151cd0 0x7f21f01f03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39438/0 (socket says 172.21.15.133:39438) 2023-12-19T19:01:00.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21e7fff640 1 -- 172.21.15.133:0/2991765820 learned_addr learned my addr 172.21.15.133:0/2991765820 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:00.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21f4c9a640 1 --2- 172.21.15.133:0/2991765820 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21f00c7c50 0x7f21f0142e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:00.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21f549b640 1 --2- 172.21.15.133:0/2991765820 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21f0154be0 0x7f21f01f0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:00.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21e7fff640 1 -- 172.21.15.133:0/2991765820 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21f00c7c50 msgr2=0x7f21f0142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:00.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21e7fff640 1 --2- 172.21.15.133:0/2991765820 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21f00c7c50 0x7f21f0142e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21e7fff640 1 -- 172.21.15.133:0/2991765820 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21f0154be0 msgr2=0x7f21f01f0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:00.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21e7fff640 1 --2- 172.21.15.133:0/2991765820 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21f0154be0 0x7f21f01f0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:00.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21e7fff640 1 -- 172.21.15.133:0/2991765820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e8009a70 con 0x7f21f0151cd0 2023-12-19T19:01:00.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21e7fff640 1 --2- 172.21.15.133:0/2991765820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21f0151cd0 0x7f21f01f03f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f21e0000fe0 tx=0x7f21e000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:00.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21e57fa640 1 -- 172.21.15.133:0/2991765820 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e0005ae0 con 0x7f21f0151cd0 2023-12-19T19:01:00.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21e57fa640 1 -- 172.21.15.133:0/2991765820 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e0005c40 con 0x7f21f0151cd0 2023-12-19T19:01:00.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21e57fa640 1 -- 172.21.15.133:0/2991765820 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e0007070 con 0x7f21f0151cd0 2023-12-19T19:01:00.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21f5c9c640 1 -- 172.21.15.133:0/2991765820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f01578a0 con 0x7f21f0151cd0 2023-12-19T19:01:00.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.889+0000 7f21f5c9c640 1 -- 172.21.15.133:0/2991765820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f01f0e70 con 0x7f21f0151cd0 2023-12-19T19:01:00.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.893+0000 7f21f5c9c640 1 -- 172.21.15.133:0/2991765820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f0157a90 con 0x7f21f0151cd0 2023-12-19T19:01:00.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.893+0000 7f21e57fa640 1 -- 172.21.15.133:0/2991765820 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f21e00071d0 con 0x7f21f0151cd0 2023-12-19T19:01:00.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.893+0000 7f21e57fa640 1 --2- 172.21.15.133:0/2991765820 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f21dc066470 0x7f21dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:00.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.893+0000 7f21e57fa640 1 -- 172.21.15.133:0/2991765820 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f21e00838a0 con 0x7f21f0151cd0 2023-12-19T19:01:00.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.893+0000 7f21f4c9a640 1 --2- 172.21.15.133:0/2991765820 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f21dc066470 0x7f21dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:00.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.893+0000 7f21f4c9a640 1 --2- 172.21.15.133:0/2991765820 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f21dc066470 0x7f21dc068930 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f21ec0011f0 tx=0x7f21ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:00.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:00.897+0000 7f21e57fa640 1 -- 172.21.15.133:0/2991765820 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f21e0050a70 con 0x7f21f0151cd0 2023-12-19T19:01:01.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.045+0000 7f21f5c9c640 1 -- 172.21.15.133:0/2991765820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f21f0152180 con 0x7f21f0151cd0 2023-12-19T19:01:01.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.045+0000 7f21e57fa640 1 -- 172.21.15.133:0/2991765820 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7f21f0152180 con 0x7f21f0151cd0 2023-12-19T19:01:01.051 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:01:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.049+0000 7f21f5c9c640 1 -- 172.21.15.133:0/2991765820 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f21dc066470 msgr2=0x7f21dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.049+0000 7f21f5c9c640 1 --2- 172.21.15.133:0/2991765820 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f21dc066470 0x7f21dc068930 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f21ec0011f0 tx=0x7f21ec009040 comp rx=0 tx=0).stop 2023-12-19T19:01:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.049+0000 7f21f5c9c640 1 -- 172.21.15.133:0/2991765820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21f0151cd0 msgr2=0x7f21f01f03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.049+0000 7f21f5c9c640 1 --2- 172.21.15.133:0/2991765820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21f0151cd0 0x7f21f01f03f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f21e0000fe0 tx=0x7f21e000cbc0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.049+0000 7f21f5c9c640 1 -- 172.21.15.133:0/2991765820 shutdown_connections 2023-12-19T19:01:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.049+0000 7f21f5c9c640 1 --2- 172.21.15.133:0/2991765820 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f21dc066470 0x7f21dc068930 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.049+0000 7f21f5c9c640 1 --2- 172.21.15.133:0/2991765820 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21f0154be0 0x7f21f01f0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.049+0000 7f21f5c9c640 1 --2- 172.21.15.133:0/2991765820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21f0151cd0 0x7f21f01f03f0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.049+0000 7f21f5c9c640 1 --2- 172.21.15.133:0/2991765820 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21f00c7c50 0x7f21f0142e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.049+0000 7f21f5c9c640 1 -- 172.21.15.133:0/2991765820 >> 172.21.15.133:0/2991765820 conn(0x7f21f00abee0 msgr2=0x7f21f00ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:01.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.049+0000 7f21f5c9c640 1 -- 172.21.15.133:0/2991765820 shutdown_connections 2023-12-19T19:01:01.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.049+0000 7f21f5c9c640 1 -- 172.21.15.133:0/2991765820 wait complete. 2023-12-19T19:01:01.072 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T19:01:01.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.205+0000 7f216d8fe640 1 Processor -- start 2023-12-19T19:01:01.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.205+0000 7f216d8fe640 1 -- start start 2023-12-19T19:01:01.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.209+0000 7f216d8fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2168151dc0 0x7f21680c4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:01.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.209+0000 7f216d8fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21680c7ed0 0x7f2168154650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:01.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.209+0000 7f216d8fe640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21680ac4f0 con 0x7f21680bd660 2023-12-19T19:01:01.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.209+0000 7f216d8fe640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2168158780 con 0x7f2168151dc0 2023-12-19T19:01:01.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.209+0000 7f216d8fe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2168158a60 con 0x7f21680c7ed0 2023-12-19T19:01:01.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.209+0000 7f21677fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f21680bd660 0x7f2168154b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58514/0 (socket says 172.21.15.133:58514) 2023-12-19T19:01:01.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.209+0000 7f21677fe640 1 -- 172.21.15.133:0/3080220155 learned_addr learned my addr 172.21.15.133:0/3080220155 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:01.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.209+0000 7f215e7fc640 1 --2- 172.21.15.133:0/3080220155 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21680c7ed0 0x7f2168154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:01.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.209+0000 7f2166ffd640 1 --2- 172.21.15.133:0/3080220155 >> v2:172.21.15.138:3300/0 conn(0x7f2168151dc0 0x7f21680c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:01.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.209+0000 7f21667fc640 1 -- 172.21.15.133:0/3080220155 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273920372 0 0) 0x7f21680ac4f0 con 0x7f21680bd660 2023-12-19T19:01:01.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.209+0000 7f21667fc640 1 -- 172.21.15.133:0/3080220155 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2154003530 con 0x7f21680bd660 2023-12-19T19:01:01.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.209+0000 7f21667fc640 1 -- 172.21.15.133:0/3080220155 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 498770375 0 0) 0x7f2154003530 con 0x7f21680bd660 2023-12-19T19:01:01.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.209+0000 7f215e7fc640 1 -- 172.21.15.133:0/3080220155 >> v2:172.21.15.138:3300/0 conn(0x7f2168151dc0 msgr2=0x7f21680c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:01.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.209+0000 7f215e7fc640 1 --2- 172.21.15.133:0/3080220155 >> v2:172.21.15.138:3300/0 conn(0x7f2168151dc0 0x7f21680c4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.209+0000 7f215e7fc640 1 -- 172.21.15.133:0/3080220155 >> v1:172.21.15.133:6789/0 conn(0x7f21680bd660 legacy=0x7f2168154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:01.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.209+0000 7f215e7fc640 1 -- 172.21.15.133:0/3080220155 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21680ac180 con 0x7f21680c7ed0 2023-12-19T19:01:01.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.209+0000 7f2166ffd640 1 --2- 172.21.15.133:0/3080220155 >> v2:172.21.15.138:3300/0 conn(0x7f2168151dc0 0x7f21680c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:01:01.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.213+0000 7f215e7fc640 1 --2- 172.21.15.133:0/3080220155 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21680c7ed0 0x7f2168154650 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f21580097c0 tx=0x7f215801c280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64bb344de9e27678 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:01.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.213+0000 7f21667fc640 1 -- 172.21.15.133:0/3080220155 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2160001a00 con 0x7f21680c7ed0 2023-12-19T19:01:01.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.213+0000 7f21667fc640 1 -- 172.21.15.133:0/3080220155 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21580a7050 con 0x7f21680c7ed0 2023-12-19T19:01:01.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.213+0000 7f21667fc640 1 -- 172.21.15.133:0/3080220155 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21580ab620 con 0x7f21680c7ed0 2023-12-19T19:01:01.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.213+0000 7f216d8fe640 1 -- 172.21.15.133:0/3080220155 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21680c7ed0 msgr2=0x7f2168154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:01.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.213+0000 7f216d8fe640 1 --2- 172.21.15.133:0/3080220155 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21680c7ed0 0x7f2168154650 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f21580097c0 tx=0x7f215801c280 comp rx=0 tx=0).stop 2023-12-19T19:01:01.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.213+0000 7f216d8fe640 1 -- 172.21.15.133:0/3080220155 shutdown_connections 2023-12-19T19:01:01.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.213+0000 7f216d8fe640 1 --2- 172.21.15.133:0/3080220155 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21680c7ed0 0x7f2168154650 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.213+0000 7f216d8fe640 1 --2- 172.21.15.133:0/3080220155 >> v2:172.21.15.138:3300/0 conn(0x7f2168151dc0 0x7f21680c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.213+0000 7f216d8fe640 1 -- 172.21.15.133:0/3080220155 >> 172.21.15.133:0/3080220155 conn(0x7f2168071eb0 msgr2=0x7f21680722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:01.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.213+0000 7f216d8fe640 1 -- 172.21.15.133:0/3080220155 shutdown_connections 2023-12-19T19:01:01.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.213+0000 7f216d8fe640 1 -- 172.21.15.133:0/3080220155 wait complete. 2023-12-19T19:01:01.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.213+0000 7f216d8fe640 1 Processor -- start 2023-12-19T19:01:01.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f216d8fe640 1 -- start start 2023-12-19T19:01:01.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f216d8fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21680bd660 0x7f216814b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:01.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f216d8fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21680c7ed0 0x7f21680c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:01.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f216d8fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2168151dc0 0x7f21681ecae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:01.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f216d8fe640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216815ec30 con 0x7f2168151dc0 2023-12-19T19:01:01.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f216d8fe640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21681f0a60 con 0x7f21680c7ed0 2023-12-19T19:01:01.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f216d8fe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21681f0f90 con 0x7f21680bd660 2023-12-19T19:01:01.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f21677fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2168151dc0 0x7f21681ecae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:01.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f21677fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2168151dc0 0x7f21681ecae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39452/0 (socket says 172.21.15.133:39452) 2023-12-19T19:01:01.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f21677fe640 1 -- 172.21.15.133:0/298928756 learned_addr learned my addr 172.21.15.133:0/298928756 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:01.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f215e7fc640 1 --2- 172.21.15.133:0/298928756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21680c7ed0 0x7f21680c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:01.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f2166ffd640 1 --2- 172.21.15.133:0/298928756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21680bd660 0x7f216814b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:01.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f21677fe640 1 -- 172.21.15.133:0/298928756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21680bd660 msgr2=0x7f216814b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:01.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f21677fe640 1 --2- 172.21.15.133:0/298928756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21680bd660 0x7f216814b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f21677fe640 1 -- 172.21.15.133:0/298928756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21680c7ed0 msgr2=0x7f21680c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:01.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f21677fe640 1 --2- 172.21.15.133:0/298928756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21680c7ed0 0x7f21680c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f21677fe640 1 -- 172.21.15.133:0/298928756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2150009420 con 0x7f2168151dc0 2023-12-19T19:01:01.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f21677fe640 1 --2- 172.21.15.133:0/298928756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2168151dc0 0x7f21681ecae0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2160001570 tx=0x7f216000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:01.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f2164ff9640 1 -- 172.21.15.133:0/298928756 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2160012400 con 0x7f2168151dc0 2023-12-19T19:01:01.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f2164ff9640 1 -- 172.21.15.133:0/298928756 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2160012560 con 0x7f2168151dc0 2023-12-19T19:01:01.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f216d8fe640 1 -- 172.21.15.133:0/298928756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2158009420 con 0x7f2168151dc0 2023-12-19T19:01:01.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f2164ff9640 1 -- 172.21.15.133:0/298928756 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2160012910 con 0x7f2168151dc0 2023-12-19T19:01:01.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f216d8fe640 1 -- 172.21.15.133:0/298928756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2168156840 con 0x7f2168151dc0 2023-12-19T19:01:01.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.217+0000 7f216d8fe640 1 -- 172.21.15.133:0/298928756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2168068400 con 0x7f2168151dc0 2023-12-19T19:01:01.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.221+0000 7f2164ff9640 1 -- 172.21.15.133:0/298928756 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2160012a70 con 0x7f2168151dc0 2023-12-19T19:01:01.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.221+0000 7f2164ff9640 1 --2- 172.21.15.133:0/298928756 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2148066470 0x7f2148068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:01.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.221+0000 7f2164ff9640 1 -- 172.21.15.133:0/298928756 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2160084800 con 0x7f2168151dc0 2023-12-19T19:01:01.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.221+0000 7f2166ffd640 1 --2- 172.21.15.133:0/298928756 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2148066470 0x7f2148068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:01.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.221+0000 7f2166ffd640 1 --2- 172.21.15.133:0/298928756 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2148066470 0x7f2148068930 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f21680ca600 tx=0x7f2150009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:01.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.225+0000 7f2164ff9640 1 -- 172.21.15.133:0/298928756 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2160051a60 con 0x7f2168151dc0 2023-12-19T19:01:01.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.385+0000 7f216d8fe640 1 -- 172.21.15.133:0/298928756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f216815edb0 con 0x7f2168151dc0 2023-12-19T19:01:01.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.385+0000 7f2164ff9640 1 -- 172.21.15.133:0/298928756 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2160055080 con 0x7f2168151dc0 2023-12-19T19:01:01.390 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-19T19:01:01.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.389+0000 7f216d8fe640 1 -- 172.21.15.133:0/298928756 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2148066470 msgr2=0x7f2148068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:01.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.389+0000 7f216d8fe640 1 --2- 172.21.15.133:0/298928756 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2148066470 0x7f2148068930 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f21680ca600 tx=0x7f2150009190 comp rx=0 tx=0).stop 2023-12-19T19:01:01.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.389+0000 7f216d8fe640 1 -- 172.21.15.133:0/298928756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2168151dc0 msgr2=0x7f21681ecae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:01.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.389+0000 7f216d8fe640 1 --2- 172.21.15.133:0/298928756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2168151dc0 0x7f21681ecae0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f2160001570 tx=0x7f216000a430 comp rx=0 tx=0).stop 2023-12-19T19:01:01.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.389+0000 7f216d8fe640 1 -- 172.21.15.133:0/298928756 shutdown_connections 2023-12-19T19:01:01.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.389+0000 7f216d8fe640 1 --2- 172.21.15.133:0/298928756 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2148066470 0x7f2148068930 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.389+0000 7f216d8fe640 1 --2- 172.21.15.133:0/298928756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2168151dc0 0x7f21681ecae0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.389+0000 7f216d8fe640 1 --2- 172.21.15.133:0/298928756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21680c7ed0 0x7f21680c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.389+0000 7f216d8fe640 1 --2- 172.21.15.133:0/298928756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21680bd660 0x7f216814b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.389+0000 7f216d8fe640 1 -- 172.21.15.133:0/298928756 >> 172.21.15.133:0/298928756 conn(0x7f2168071eb0 msgr2=0x7f2168072290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:01.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.389+0000 7f216d8fe640 1 -- 172.21.15.133:0/298928756 shutdown_connections 2023-12-19T19:01:01.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.389+0000 7f216d8fe640 1 -- 172.21.15.133:0/298928756 wait complete. 2023-12-19T19:01:01.411 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T19:01:01.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:01.412 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T19:01:01.439 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-19T19:01:01.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:01.440 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T19:01:01.492 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T19:01:01.492 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:01:01.543 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3517 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-19T19:01:01.543 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T19:01:01.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.721+0000 7f9294c3a640 1 Processor -- start 2023-12-19T19:01:01.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.721+0000 7f9294c3a640 1 -- start start 2023-12-19T19:01:01.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.721+0000 7f9294c3a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f92900bd3c0 0x7f92900c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:01.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.721+0000 7f9294c3a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f92900c7c30 0x7f929015ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:01.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.721+0000 7f9294c3a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92900c8400 con 0x7f9290151bb0 2023-12-19T19:01:01.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.721+0000 7f9294c3a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92900c86e0 con 0x7f92900bd3c0 2023-12-19T19:01:01.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.721+0000 7f9294c3a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92901543e0 con 0x7f92900c7c30 2023-12-19T19:01:01.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.721+0000 7f928effd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f92900bd3c0 0x7f92900c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:01.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.721+0000 7f928effd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f92900bd3c0 0x7f92900c46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39462/0 (socket says 172.21.15.133:39462) 2023-12-19T19:01:01.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.721+0000 7f928effd640 1 -- 172.21.15.133:0/2677197059 learned_addr learned my addr 172.21.15.133:0/2677197059 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:01.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.721+0000 7f928ffff640 1 --2- 172.21.15.133:0/2677197059 >> v2:172.21.15.138:3300/0 conn(0x7f92900c7c30 0x7f929015ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:01.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.721+0000 7f928effd640 1 -- 172.21.15.133:0/2677197059 >> v2:172.21.15.138:3300/0 conn(0x7f92900c7c30 msgr2=0x7f929015ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:01.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.721+0000 7f928effd640 1 --2- 172.21.15.133:0/2677197059 >> v2:172.21.15.138:3300/0 conn(0x7f92900c7c30 0x7f929015ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.721+0000 7f928effd640 1 -- 172.21.15.133:0/2677197059 >> v1:172.21.15.138:6789/0 conn(0x7f9290151bb0 legacy=0x7f929006ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:01.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.721+0000 7f928effd640 1 -- 172.21.15.133:0/2677197059 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92901545f0 con 0x7f92900bd3c0 2023-12-19T19:01:01.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.721+0000 7f928ffff640 1 --2- 172.21.15.133:0/2677197059 >> v2:172.21.15.138:3300/0 conn(0x7f92900c7c30 0x7f929015ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:01.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.725+0000 7f928effd640 1 --2- 172.21.15.133:0/2677197059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92900bd3c0 0x7f92900c46b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9290154520 tx=0x7f928401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc72109697798343 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:01.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.725+0000 7f928e7fc640 1 -- 172.21.15.133:0/2677197059 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92840ac410 con 0x7f92900bd3c0 2023-12-19T19:01:01.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.725+0000 7f928e7fc640 1 -- 172.21.15.133:0/2677197059 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92840ac570 con 0x7f92900bd3c0 2023-12-19T19:01:01.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.725+0000 7f928e7fc640 1 -- 172.21.15.133:0/2677197059 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92840ac900 con 0x7f92900bd3c0 2023-12-19T19:01:01.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.725+0000 7f9294c3a640 1 -- 172.21.15.133:0/2677197059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92900bd3c0 msgr2=0x7f92900c46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:01.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.725+0000 7f9294c3a640 1 --2- 172.21.15.133:0/2677197059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92900bd3c0 0x7f92900c46b0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9290154520 tx=0x7f928401c3b0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.725+0000 7f9294c3a640 1 -- 172.21.15.133:0/2677197059 shutdown_connections 2023-12-19T19:01:01.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.725+0000 7f9294c3a640 1 --2- 172.21.15.133:0/2677197059 >> v2:172.21.15.138:3300/0 conn(0x7f92900c7c30 0x7f929015ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.725+0000 7f9294c3a640 1 --2- 172.21.15.133:0/2677197059 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92900bd3c0 0x7f92900c46b0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.725+0000 7f9294c3a640 1 -- 172.21.15.133:0/2677197059 >> 172.21.15.133:0/2677197059 conn(0x7f92900abcc0 msgr2=0x7f92900ac0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:01.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.725+0000 7f9294c3a640 1 -- 172.21.15.133:0/2677197059 shutdown_connections 2023-12-19T19:01:01.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.725+0000 7f9294c3a640 1 -- 172.21.15.133:0/2677197059 wait complete. 2023-12-19T19:01:01.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.725+0000 7f9294c3a640 1 Processor -- start 2023-12-19T19:01:01.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.725+0000 7f9294c3a640 1 -- start start 2023-12-19T19:01:01.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.729+0000 7f9294c3a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92900bd3c0 0x7f9290156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:01.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.729+0000 7f9294c3a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92900c7c30 0x7f92901ed990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:01.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.729+0000 7f9294c3a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9290151bb0 0x7f92900a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:01.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.729+0000 7f9294c3a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92901eded0 con 0x7f9290151bb0 2023-12-19T19:01:01.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.729+0000 7f9294c3a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92901f0480 con 0x7f92900c7c30 2023-12-19T19:01:01.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.729+0000 7f9294c3a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92901f0760 con 0x7f92900bd3c0 2023-12-19T19:01:01.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.729+0000 7f928ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9290151bb0 0x7f92900a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:01.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.729+0000 7f928ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9290151bb0 0x7f92900a9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39466/0 (socket says 172.21.15.133:39466) 2023-12-19T19:01:01.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.729+0000 7f928ffff640 1 -- 172.21.15.133:0/300445099 learned_addr learned my addr 172.21.15.133:0/300445099 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:01.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.729+0000 7f928effd640 1 --2- 172.21.15.133:0/300445099 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92900c7c30 0x7f92901ed990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:01.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.729+0000 7f928f7fe640 1 --2- 172.21.15.133:0/300445099 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92900bd3c0 0x7f9290156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:01.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.729+0000 7f928ffff640 1 -- 172.21.15.133:0/300445099 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92900bd3c0 msgr2=0x7f9290156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:01.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.729+0000 7f928ffff640 1 --2- 172.21.15.133:0/300445099 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92900bd3c0 0x7f9290156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.729+0000 7f928ffff640 1 -- 172.21.15.133:0/300445099 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92900c7c30 msgr2=0x7f92901ed990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:01.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.729+0000 7f928ffff640 1 --2- 172.21.15.133:0/300445099 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92900c7c30 0x7f92901ed990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.729+0000 7f928ffff640 1 -- 172.21.15.133:0/300445099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92840094d0 con 0x7f9290151bb0 2023-12-19T19:01:01.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.729+0000 7f928ffff640 1 --2- 172.21.15.133:0/300445099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9290151bb0 0x7f92900a9c90 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9288007f20 tx=0x7f928800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:01.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.729+0000 7f9277fff640 1 -- 172.21.15.133:0/300445099 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928800dee0 con 0x7f9290151bb0 2023-12-19T19:01:01.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.729+0000 7f9277fff640 1 -- 172.21.15.133:0/300445099 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f928800f040 con 0x7f9290151bb0 2023-12-19T19:01:01.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.729+0000 7f9277fff640 1 -- 172.21.15.133:0/300445099 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9288003de0 con 0x7f9290151bb0 2023-12-19T19:01:01.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.729+0000 7f9294c3a640 1 -- 172.21.15.133:0/300445099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9290148830 con 0x7f9290151bb0 2023-12-19T19:01:01.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.729+0000 7f9294c3a640 1 -- 172.21.15.133:0/300445099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9290148df0 con 0x7f9290151bb0 2023-12-19T19:01:01.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.729+0000 7f9294c3a640 1 -- 172.21.15.133:0/300445099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9290067e90 con 0x7f9290151bb0 2023-12-19T19:01:01.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.733+0000 7f9277fff640 1 -- 172.21.15.133:0/300445099 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9288004030 con 0x7f9290151bb0 2023-12-19T19:01:01.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.733+0000 7f9277fff640 1 --2- 172.21.15.133:0/300445099 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f927c066470 0x7f927c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:01.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.733+0000 7f9277fff640 1 -- 172.21.15.133:0/300445099 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f92880844e0 con 0x7f9290151bb0 2023-12-19T19:01:01.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.733+0000 7f928f7fe640 1 --2- 172.21.15.133:0/300445099 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f927c066470 0x7f927c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:01.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.733+0000 7f928f7fe640 1 --2- 172.21.15.133:0/300445099 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f927c066470 0x7f927c068930 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9280000f70 tx=0x7f9280009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:01.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.737+0000 7f9277fff640 1 -- 172.21.15.133:0/300445099 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9288051690 con 0x7f9290151bb0 2023-12-19T19:01:01.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.921+0000 7f9294c3a640 1 -- 172.21.15.133:0/300445099 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f929004e850 con 0x7f9290151bb0 2023-12-19T19:01:01.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.921+0000 7f9277fff640 1 -- 172.21.15.133:0/300445099 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) v1 ==== 53+0+149 (secure 0 0 0) 0x7f9288054cb0 con 0x7f9290151bb0 2023-12-19T19:01:01.925 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T19:01:01.926 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-19T19:01:01.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.925+0000 7f9294c3a640 1 -- 172.21.15.133:0/300445099 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f927c066470 msgr2=0x7f927c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:01.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.925+0000 7f9294c3a640 1 --2- 172.21.15.133:0/300445099 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f927c066470 0x7f927c068930 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9280000f70 tx=0x7f9280009040 comp rx=0 tx=0).stop 2023-12-19T19:01:01.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.925+0000 7f9294c3a640 1 -- 172.21.15.133:0/300445099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9290151bb0 msgr2=0x7f92900a9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:01.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.925+0000 7f9294c3a640 1 --2- 172.21.15.133:0/300445099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9290151bb0 0x7f92900a9c90 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9288007f20 tx=0x7f928800d560 comp rx=0 tx=0).stop 2023-12-19T19:01:01.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.925+0000 7f9294c3a640 1 -- 172.21.15.133:0/300445099 shutdown_connections 2023-12-19T19:01:01.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.925+0000 7f9294c3a640 1 --2- 172.21.15.133:0/300445099 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f927c066470 0x7f927c068930 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.925+0000 7f9294c3a640 1 --2- 172.21.15.133:0/300445099 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9290151bb0 0x7f92900a9c90 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.925+0000 7f9294c3a640 1 --2- 172.21.15.133:0/300445099 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92900c7c30 0x7f92901ed990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.925+0000 7f9294c3a640 1 --2- 172.21.15.133:0/300445099 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92900bd3c0 0x7f9290156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:01.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.925+0000 7f9294c3a640 1 -- 172.21.15.133:0/300445099 >> 172.21.15.133:0/300445099 conn(0x7f92900abcc0 msgr2=0x7f929014ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:01.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.925+0000 7f9294c3a640 1 -- 172.21.15.133:0/300445099 shutdown_connections 2023-12-19T19:01:01.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:01.925+0000 7f9294c3a640 1 -- 172.21.15.133:0/300445099 wait complete. 2023-12-19T19:01:01.947 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-19T19:01:01.947 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T19:01:01.947 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-19T19:01:01.947 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-19T19:01:01.947 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T19:01:01.947 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-19T19:01:01.947 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T19:01:01.947 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.S5IIr693ah 2023-12-19T19:01:01.947 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2023-12-19T19:01:01.956 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.geHyd5BSxz 2023-12-19T19:01:01.956 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /tmp/tmp.S5IIr693ah /tmp/tmp.geHyd5BSxz 2023-12-19T19:01:02.018 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.geHyd5BSxz 2023-12-19T19:01:02.144 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.geHyd5BSxz is 245B 2023-12-19T19:01:02.160 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.geHyd5BSxz 2023-12-19T19:01:02.169 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQBq6IFlpct9HBAAVlWsnsW19o1QudHAjzvr7w== caps mds = "allow rw fsname=cephfs" caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-12-19T19:01:02.169 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T19:01:02.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:02.169 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-19T19:01:02.224 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T19:01:02.224 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T19:01:02.224 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T19:01:02.224 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:01:02.224 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-19T19:01:02.224 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:01:02.224 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:01:02.224 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:01:02.225 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-19T19:01:02.225 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:01:02.225 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:01:02.225 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-19T19:01:02.225 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:01:02.225 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:01:02.225 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T19:01:02.225 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:01:02.225 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T19:01:02.225 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42298sec preferred_lft 42298sec 2023-12-19T19:01:02.225 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-12-19T19:01:02.225 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:01:02.225 INFO:teuthology.orchestra.run.smithi133.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T19:01:02.226 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 02:42:26:2c:b4:18 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:01:02.226 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T19:01:02.226 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:01:02.226 INFO:teuthology.orchestra.run.smithi133.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T19:01:02.226 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T19:01:02.226 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T19:01:02.226 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:01:02.226 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-19T19:01:02.226 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:01:02.226 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T19:01:02.226 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T19:01:02.226 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-19T19:01:02.226 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:01:02.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:02.227 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T19:01:02.289 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-19T19:01:02.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:02.291 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-19T19:01:02.349 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-19T19:01:02.349 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T19:01:02.349 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T19:01:02.349 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T19:01:02.349 INFO:teuthology.orchestra.run.smithi133.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T19:01:02.350 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T19:01:02.350 INFO:teuthology.orchestra.run.smithi133.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:01:02.350 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:01:02.350 INFO:teuthology.orchestra.run.smithi133.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:01:02.350 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T19:01:02.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:02.350 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-19T19:01:02.350 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-19T19:01:02.350 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T19:01:02.350 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T19:01:02.350 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T19:01:02.350 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-19T19:01:02.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:02.445 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-19T19:01:02.454 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T19:01:02.455 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T19:01:02.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:02.455 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-19T19:01:02.519 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T19:01:02.519 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T19:01:02.571 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T19:01:02.572 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T19:01:02.572 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T19:01:02.623 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T19:01:02.623 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/tmp/tmp.S5IIr693ah of=/dev/stdout 2023-12-19T19:01:02.675 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-12-19T19:01:02.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:02.675 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQBq6IFlpct9HBAAVlWsnsW19o1QudHAjzvr7w==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:01:02.770 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,secret=AQBq6IFlpct9HBAAVlWsnsW19o1QudHAjzvr7w==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:01:02.770 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T19:01:02.770 INFO:teuthology.orchestra.run.smithi133.stdout:keyring.get_secret failed 2023-12-19T19:01:02.781 INFO:teuthology.orchestra.run.smithi133.stderr:mount.ceph: kernel BUG! 2023-12-19T19:01:02.781 INFO:teuthology.orchestra.run.smithi133.stderr:mount error 13 = Permission denied 2023-12-19T19:01:02.781 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,secret=AQBq6IFlpct9HBAAVlWsnsW19o1QudHAjzvr7w==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:01:02.781 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T19:01:02.781 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-12-19T19:01:02.782 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: testuser@03e63958-005e-4bf2-ae5b-291aceb6fbbf.cephfs2=/ 2023-12-19T19:01:02.782 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.133:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-12-19T19:01:02.785 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T19:01:02.786 INFO:tasks.cephfs.kernel_mount:mount command failed 2023-12-19T19:01:02.786 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T19:01:02.786 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T19:01:02.874 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T19:01:02.935 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T19:01:02.935 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T19:01:02.935 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:01:02.944 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3517 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-19T19:01:02.945 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:01:02.945 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:01:02.954 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:01:02.954 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:01:03.009 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:01:03.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.141+0000 7f053089c640 1 Processor -- start 2023-12-19T19:01:03.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.141+0000 7f053089c640 1 -- start start 2023-12-19T19:01:03.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f053089c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f052c0725c0 0x7f052c1516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:03.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f053089c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f052c0c2760 con 0x7f052c0a5370 2023-12-19T19:01:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f053089c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f052c0a5750 con 0x7f052c072090 2023-12-19T19:01:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f053089c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052c0c3070 con 0x7f052c0725c0 2023-12-19T19:01:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f052a59c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f052c0a5370 0x7f052c0c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58520/0 (socket says 172.21.15.133:58520) 2023-12-19T19:01:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f052a59c640 1 -- 172.21.15.133:0/3457579698 learned_addr learned my addr 172.21.15.133:0/3457579698 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f052ad9d640 1 --2- 172.21.15.133:0/3457579698 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f052c0725c0 0x7f052c1516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f0529d9b640 1 -- 172.21.15.133:0/3457579698 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598231565 0 0) 0x7f052c0c2760 con 0x7f052c0a5370 2023-12-19T19:01:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f0529d9b640 1 -- 172.21.15.133:0/3457579698 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0518003450 con 0x7f052c0a5370 2023-12-19T19:01:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f0529d9b640 1 -- 172.21.15.133:0/3457579698 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 362728425 0 0) 0x7f0518003450 con 0x7f052c0a5370 2023-12-19T19:01:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f0529d9b640 1 -- 172.21.15.133:0/3457579698 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f052c0725c0 msgr2=0x7f052c1516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f0529d9b640 1 --2- 172.21.15.133:0/3457579698 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f052c0725c0 0x7f052c1516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f0529d9b640 1 -- 172.21.15.133:0/3457579698 >> v1:172.21.15.138:6789/0 conn(0x7f052c072090 legacy=0x7f052c150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f0529d9b640 1 -- 172.21.15.133:0/3457579698 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c0aad20 con 0x7f052c0a5370 2023-12-19T19:01:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f0529d9b640 1 -- 172.21.15.133:0/3457579698 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f051c001680 con 0x7f052c0a5370 2023-12-19T19:01:03.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f0529d9b640 1 -- 172.21.15.133:0/3457579698 >> v1:172.21.15.133:6789/0 conn(0x7f052c0a5370 legacy=0x7f052c0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:03.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f0529d9b640 1 --2- 172.21.15.133:0/3457579698 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f052c0725c0 0x7f0518003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:03.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f0529d9b640 1 --2- 172.21.15.133:0/3457579698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0518003fe0 0x7f051800a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:03.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f0529d9b640 1 --2- 172.21.15.133:0/3457579698 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f051800afe0 0x7f051800d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:03.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f0529d9b640 1 -- 172.21.15.133:0/3457579698 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c0c3070 con 0x7f0518003fe0 2023-12-19T19:01:03.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f0529d9b640 1 -- 172.21.15.133:0/3457579698 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051800dd30 con 0x7f051800afe0 2023-12-19T19:01:03.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f0529d9b640 1 -- 172.21.15.133:0/3457579698 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f051800def0 con 0x7f052c0725c0 2023-12-19T19:01:03.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f0523fff640 1 --2- 172.21.15.133:0/3457579698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0518003fe0 0x7f051800a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:03.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f052a59c640 1 --2- 172.21.15.133:0/3457579698 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f052c0725c0 0x7f0518003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:03.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f052ad9d640 1 --2- 172.21.15.133:0/3457579698 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f051800afe0 0x7f051800d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:03.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f0523fff640 1 -- 172.21.15.133:0/3457579698 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f052c0725c0 msgr2=0x7f0518003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:03.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f0523fff640 1 --2- 172.21.15.133:0/3457579698 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f052c0725c0 0x7f0518003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f0523fff640 1 -- 172.21.15.133:0/3457579698 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f051800afe0 msgr2=0x7f051800d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:03.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f0523fff640 1 --2- 172.21.15.133:0/3457579698 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f051800afe0 0x7f051800d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f0523fff640 1 -- 172.21.15.133:0/3457579698 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0518003450 con 0x7f0518003fe0 2023-12-19T19:01:03.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.145+0000 7f052ad9d640 1 --2- 172.21.15.133:0/3457579698 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f051800afe0 0x7f051800d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:03.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.149+0000 7f0523fff640 1 --2- 172.21.15.133:0/3457579698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0518003fe0 0x7f051800a870 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0514001860 tx=0x7f051401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5484334e15f9c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:03.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.149+0000 7f0529d9b640 1 -- 172.21.15.133:0/3457579698 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05140ab600 con 0x7f0518003fe0 2023-12-19T19:01:03.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.149+0000 7f0529d9b640 1 -- 172.21.15.133:0/3457579698 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05140a7050 con 0x7f0518003fe0 2023-12-19T19:01:03.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.149+0000 7f0529d9b640 1 -- 172.21.15.133:0/3457579698 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05140ab9e0 con 0x7f0518003fe0 2023-12-19T19:01:03.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.149+0000 7f053089c640 1 -- 172.21.15.133:0/3457579698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0518003fe0 msgr2=0x7f051800a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:03.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.149+0000 7f053089c640 1 --2- 172.21.15.133:0/3457579698 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0518003fe0 0x7f051800a870 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f0514001860 tx=0x7f051401c4b0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.149+0000 7f052ad9d640 1 -- 172.21.15.133:0/3457579698 reap_dead start 2023-12-19T19:01:03.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.149+0000 7f053089c640 1 -- 172.21.15.133:0/3457579698 shutdown_connections 2023-12-19T19:01:03.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.149+0000 7f053089c640 1 -- 172.21.15.133:0/3457579698 >> 172.21.15.133:0/3457579698 conn(0x7f052c06a5b0 msgr2=0x7f052c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:03.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.149+0000 7f053089c640 1 -- 172.21.15.133:0/3457579698 shutdown_connections 2023-12-19T19:01:03.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.149+0000 7f053089c640 1 -- 172.21.15.133:0/3457579698 wait complete. 2023-12-19T19:01:03.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.149+0000 7f053089c640 1 Processor -- start 2023-12-19T19:01:03.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.149+0000 7f053089c640 1 -- start start 2023-12-19T19:01:03.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.153+0000 7f053089c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0518003fe0 0x7f052c1475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:03.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.153+0000 7f053089c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f052c146c30 0x7f052c14bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:03.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.153+0000 7f053089c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f052c1ed650 0x7f052c145f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:03.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.153+0000 7f053089c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c1f0c50 con 0x7f052c146c30 2023-12-19T19:01:03.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.153+0000 7f053089c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052c1f1180 con 0x7f0518003fe0 2023-12-19T19:01:03.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.153+0000 7f053089c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052c147b20 con 0x7f052c1ed650 2023-12-19T19:01:03.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.153+0000 7f0523fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f052c146c30 0x7f052c14bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:03.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.153+0000 7f0523fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f052c146c30 0x7f052c14bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39484/0 (socket says 172.21.15.133:39484) 2023-12-19T19:01:03.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.153+0000 7f0523fff640 1 -- 172.21.15.133:0/3077469540 learned_addr learned my addr 172.21.15.133:0/3077469540 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:03.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.153+0000 7f052a59c640 1 --2- 172.21.15.133:0/3077469540 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0518003fe0 0x7f052c1475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:03.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.153+0000 7f052ad9d640 1 --2- 172.21.15.133:0/3077469540 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f052c1ed650 0x7f052c145f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:03.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.153+0000 7f0523fff640 1 -- 172.21.15.133:0/3077469540 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f052c1ed650 msgr2=0x7f052c145f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:03.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.153+0000 7f0523fff640 1 --2- 172.21.15.133:0/3077469540 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f052c1ed650 0x7f052c145f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.153+0000 7f0523fff640 1 -- 172.21.15.133:0/3077469540 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0518003fe0 msgr2=0x7f052c1475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:03.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.153+0000 7f0523fff640 1 --2- 172.21.15.133:0/3077469540 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0518003fe0 0x7f052c1475e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.153+0000 7f0523fff640 1 -- 172.21.15.133:0/3077469540 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f052c1f0ea0 con 0x7f052c146c30 2023-12-19T19:01:03.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.153+0000 7f0523fff640 1 --2- 172.21.15.133:0/3077469540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f052c146c30 0x7f052c14bab0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f051401c2e0 tx=0x7f0518003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:03.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.153+0000 7f0522ffd640 1 -- 172.21.15.133:0/3077469540 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0514005390 con 0x7f052c146c30 2023-12-19T19:01:03.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.153+0000 7f0522ffd640 1 -- 172.21.15.133:0/3077469540 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05140aba40 con 0x7f052c146c30 2023-12-19T19:01:03.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.153+0000 7f053089c640 1 -- 172.21.15.133:0/3077469540 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052c1ece70 con 0x7f052c146c30 2023-12-19T19:01:03.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.153+0000 7f0522ffd640 1 -- 172.21.15.133:0/3077469540 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05140abdb0 con 0x7f052c146c30 2023-12-19T19:01:03.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.153+0000 7f053089c640 1 -- 172.21.15.133:0/3077469540 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f052c14bff0 con 0x7f052c146c30 2023-12-19T19:01:03.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.153+0000 7f053089c640 1 -- 172.21.15.133:0/3077469540 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f052c1eccd0 con 0x7f052c146c30 2023-12-19T19:01:03.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.157+0000 7f0522ffd640 1 -- 172.21.15.133:0/3077469540 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f05140b2050 con 0x7f052c146c30 2023-12-19T19:01:03.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.157+0000 7f0522ffd640 1 --2- 172.21.15.133:0/3077469540 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f050c066470 0x7f050c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:03.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.157+0000 7f0522ffd640 1 -- 172.21.15.133:0/3077469540 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f051411d5b0 con 0x7f052c146c30 2023-12-19T19:01:03.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.157+0000 7f052a59c640 1 --2- 172.21.15.133:0/3077469540 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f050c066470 0x7f050c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:03.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.157+0000 7f052a59c640 1 --2- 172.21.15.133:0/3077469540 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f050c066470 0x7f050c068930 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f051c000fc0 tx=0x7f051c000f00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:03.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.161+0000 7f0522ffd640 1 -- 172.21.15.133:0/3077469540 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f052c1eccd0 con 0x7f052c146c30 2023-12-19T19:01:03.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.313+0000 7f053089c640 1 -- 172.21.15.133:0/3077469540 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f052c1eccd0 con 0x7f052c146c30 2023-12-19T19:01:03.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.313+0000 7f0522ffd640 1 -- 172.21.15.133:0/3077469540 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20316 (secure 0 0 0) 0x7f052c1eccd0 con 0x7f052c146c30 2023-12-19T19:01:03.318 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:03.318 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":54,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:00:50.680936+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:00:29.085029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T19:00:30.359577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:00:46.784805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:00:48.051355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:01:03.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.317+0000 7f053089c640 1 -- 172.21.15.133:0/3077469540 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f050c066470 msgr2=0x7f050c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:03.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.317+0000 7f053089c640 1 --2- 172.21.15.133:0/3077469540 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f050c066470 0x7f050c068930 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f051c000fc0 tx=0x7f051c000f00 comp rx=0 tx=0).stop 2023-12-19T19:01:03.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.317+0000 7f053089c640 1 -- 172.21.15.133:0/3077469540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f052c146c30 msgr2=0x7f052c14bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:03.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.317+0000 7f053089c640 1 --2- 172.21.15.133:0/3077469540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f052c146c30 0x7f052c14bab0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f051401c2e0 tx=0x7f0518003700 comp rx=0 tx=0).stop 2023-12-19T19:01:03.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.317+0000 7f053089c640 1 -- 172.21.15.133:0/3077469540 shutdown_connections 2023-12-19T19:01:03.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.317+0000 7f053089c640 1 --2- 172.21.15.133:0/3077469540 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f050c066470 0x7f050c068930 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.317+0000 7f053089c640 1 --2- 172.21.15.133:0/3077469540 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f052c1ed650 0x7f052c145f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.320 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.317+0000 7f053089c640 1 --2- 172.21.15.133:0/3077469540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f052c146c30 0x7f052c14bab0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.317+0000 7f053089c640 1 --2- 172.21.15.133:0/3077469540 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0518003fe0 0x7f052c1475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.317+0000 7f053089c640 1 -- 172.21.15.133:0/3077469540 >> 172.21.15.133:0/3077469540 conn(0x7f052c06a5b0 msgr2=0x7f052c0c05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:03.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.317+0000 7f053089c640 1 -- 172.21.15.133:0/3077469540 shutdown_connections 2023-12-19T19:01:03.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.317+0000 7f053089c640 1 -- 172.21.15.133:0/3077469540 wait complete. 2023-12-19T19:01:03.339 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T19:00:29.085029+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T19:00:30.359577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-19T19:00:46.784805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-19T19:00:48.051355+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T19:01:03.340 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T19:01:03.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.477+0000 7f2a1ea9c640 1 Processor -- start 2023-12-19T19:01:03.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.477+0000 7f2a1ea9c640 1 -- start start 2023-12-19T19:01:03.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.477+0000 7f2a1ea9c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2a180c5640 0x7f2a180c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:03.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.477+0000 7f2a1ea9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2a180c60f0 0x7f2a18155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:03.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.477+0000 7f2a1ea9c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a180c2580 con 0x7f2a180c5260 2023-12-19T19:01:03.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.477+0000 7f2a1ea9c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a18153510 con 0x7f2a180c5640 2023-12-19T19:01:03.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.477+0000 7f2a1ea9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a180c17f0 con 0x7f2a180c60f0 2023-12-19T19:01:03.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.477+0000 7f2a0ffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2a180c5640 0x7f2a180c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:03.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.477+0000 7f2a0ffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2a180c5640 0x7f2a180c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39490/0 (socket says 172.21.15.133:39490) 2023-12-19T19:01:03.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.477+0000 7f2a0ffff640 1 -- 172.21.15.133:0/3803760355 learned_addr learned my addr 172.21.15.133:0/3803760355 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:03.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.477+0000 7f2a1d039640 1 --2- 172.21.15.133:0/3803760355 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2a180c60f0 0x7f2a18155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:03.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.481+0000 7f2a0ffff640 1 -- 172.21.15.133:0/3803760355 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2a180c60f0 msgr2=0x7f2a18155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:03.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.481+0000 7f2a0ffff640 1 --2- 172.21.15.133:0/3803760355 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2a180c60f0 0x7f2a18155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.481+0000 7f2a0ffff640 1 -- 172.21.15.133:0/3803760355 >> v1:172.21.15.138:6789/0 conn(0x7f2a180c5260 legacy=0x7f2a1806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:03.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.481+0000 7f2a0ffff640 1 -- 172.21.15.133:0/3803760355 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a180c1a00 con 0x7f2a180c5640 2023-12-19T19:01:03.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.481+0000 7f2a1d039640 1 --2- 172.21.15.133:0/3803760355 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2a180c60f0 0x7f2a18155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:03.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.481+0000 7f2a0ffff640 1 --2- 172.21.15.133:0/3803760355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a180c5640 0x7f2a180c5bb0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f2a180c1930 tx=0x7f2a0801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84240bbfa470b6f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:03.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.481+0000 7f2a0f7fe640 1 -- 172.21.15.133:0/3803760355 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a080ab600 con 0x7f2a180c5640 2023-12-19T19:01:03.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.481+0000 7f2a0f7fe640 1 -- 172.21.15.133:0/3803760355 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a080a7050 con 0x7f2a180c5640 2023-12-19T19:01:03.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.481+0000 7f2a0f7fe640 1 -- 172.21.15.133:0/3803760355 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a080ab980 con 0x7f2a180c5640 2023-12-19T19:01:03.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.481+0000 7f2a1ea9c640 1 -- 172.21.15.133:0/3803760355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a180c5640 msgr2=0x7f2a180c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:03.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.481+0000 7f2a1ea9c640 1 --2- 172.21.15.133:0/3803760355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a180c5640 0x7f2a180c5bb0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f2a180c1930 tx=0x7f2a0801c460 comp rx=0 tx=0).stop 2023-12-19T19:01:03.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.481+0000 7f2a1ea9c640 1 -- 172.21.15.133:0/3803760355 shutdown_connections 2023-12-19T19:01:03.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.481+0000 7f2a1ea9c640 1 --2- 172.21.15.133:0/3803760355 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2a180c60f0 0x7f2a18155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.481+0000 7f2a1ea9c640 1 --2- 172.21.15.133:0/3803760355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a180c5640 0x7f2a180c5bb0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.481+0000 7f2a1ea9c640 1 -- 172.21.15.133:0/3803760355 >> 172.21.15.133:0/3803760355 conn(0x7f2a1806a5b0 msgr2=0x7f2a1806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:03.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.481+0000 7f2a1ea9c640 1 -- 172.21.15.133:0/3803760355 shutdown_connections 2023-12-19T19:01:03.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.481+0000 7f2a1ea9c640 1 -- 172.21.15.133:0/3803760355 wait complete. 2023-12-19T19:01:03.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a1ea9c640 1 Processor -- start 2023-12-19T19:01:03.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a1ea9c640 1 -- start start 2023-12-19T19:01:03.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a1ea9c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a180c5260 0x7f2a1814f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:03.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a1ea9c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2a180c5640 0x7f2a18071220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:03.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a1ea9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2a180c60f0 0x7f2a181eb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:03.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a1ea9c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a18153910 con 0x7f2a180c5260 2023-12-19T19:01:03.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a1ea9c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a18155370 con 0x7f2a180c5640 2023-12-19T19:01:03.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a1ea9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a18155650 con 0x7f2a180c60f0 2023-12-19T19:01:03.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a1c838640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a180c5260 0x7f2a1814f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:03.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a1c838640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a180c5260 0x7f2a1814f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39500/0 (socket says 172.21.15.133:39500) 2023-12-19T19:01:03.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a1c838640 1 -- 172.21.15.133:0/2798668801 learned_addr learned my addr 172.21.15.133:0/2798668801 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:03.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a1d039640 1 --2- 172.21.15.133:0/2798668801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2a180c60f0 0x7f2a181eb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:03.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a0ffff640 1 --2- 172.21.15.133:0/2798668801 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2a180c5640 0x7f2a18071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:03.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a1c838640 1 -- 172.21.15.133:0/2798668801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2a180c60f0 msgr2=0x7f2a181eb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:03.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a1c838640 1 --2- 172.21.15.133:0/2798668801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2a180c60f0 0x7f2a181eb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a1c838640 1 -- 172.21.15.133:0/2798668801 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2a180c5640 msgr2=0x7f2a18071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:03.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a1c838640 1 --2- 172.21.15.133:0/2798668801 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2a180c5640 0x7f2a18071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a1c838640 1 -- 172.21.15.133:0/2798668801 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a080094d0 con 0x7f2a180c5260 2023-12-19T19:01:03.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a1d039640 1 --2- 172.21.15.133:0/2798668801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2a180c60f0 0x7f2a181eb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:03.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a0ffff640 1 --2- 172.21.15.133:0/2798668801 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2a180c5640 0x7f2a18071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:03.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a1c838640 1 --2- 172.21.15.133:0/2798668801 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a180c5260 0x7f2a1814f3e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400c3c0 tx=0x7f2a1400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:03.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a0d7fa640 1 -- 172.21.15.133:0/2798668801 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a140052d0 con 0x7f2a180c5260 2023-12-19T19:01:03.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a0d7fa640 1 -- 172.21.15.133:0/2798668801 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a14005430 con 0x7f2a180c5260 2023-12-19T19:01:03.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a0d7fa640 1 -- 172.21.15.133:0/2798668801 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14003840 con 0x7f2a180c5260 2023-12-19T19:01:03.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a1ea9c640 1 -- 172.21.15.133:0/2798668801 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a1814f920 con 0x7f2a180c5260 2023-12-19T19:01:03.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.485+0000 7f2a1ea9c640 1 -- 172.21.15.133:0/2798668801 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a18153bf0 con 0x7f2a180c5260 2023-12-19T19:01:03.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.489+0000 7f2a1ea9c640 1 -- 172.21.15.133:0/2798668801 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a18068400 con 0x7f2a180c5260 2023-12-19T19:01:03.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.489+0000 7f2a0d7fa640 1 -- 172.21.15.133:0/2798668801 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2a140039a0 con 0x7f2a180c5260 2023-12-19T19:01:03.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.489+0000 7f2a0d7fa640 1 --2- 172.21.15.133:0/2798668801 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2a04066470 0x7f2a04068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:03.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.489+0000 7f2a0d7fa640 1 -- 172.21.15.133:0/2798668801 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2a140836a0 con 0x7f2a180c5260 2023-12-19T19:01:03.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.489+0000 7f2a0ffff640 1 --2- 172.21.15.133:0/2798668801 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2a04066470 0x7f2a04068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:03.495 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.489+0000 7f2a0ffff640 1 --2- 172.21.15.133:0/2798668801 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2a04066470 0x7f2a04068930 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2a080ad000 tx=0x7f2a08008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:03.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.493+0000 7f2a0d7fa640 1 -- 172.21.15.133:0/2798668801 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2a14050850 con 0x7f2a180c5260 2023-12-19T19:01:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.645+0000 7f2a1ea9c640 1 -- 172.21.15.133:0/2798668801 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2a1806d390 con 0x7f2a180c5260 2023-12-19T19:01:03.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.645+0000 7f2a0d7fa640 1 -- 172.21.15.133:0/2798668801 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a14053e70 con 0x7f2a180c5260 2023-12-19T19:01:03.649 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T19:01:03.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.645+0000 7f2a1ea9c640 1 -- 172.21.15.133:0/2798668801 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2a04066470 msgr2=0x7f2a04068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:03.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.645+0000 7f2a1ea9c640 1 --2- 172.21.15.133:0/2798668801 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2a04066470 0x7f2a04068930 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2a080ad000 tx=0x7f2a08008040 comp rx=0 tx=0).stop 2023-12-19T19:01:03.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.645+0000 7f2a1ea9c640 1 -- 172.21.15.133:0/2798668801 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a180c5260 msgr2=0x7f2a1814f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:03.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.645+0000 7f2a1ea9c640 1 --2- 172.21.15.133:0/2798668801 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a180c5260 0x7f2a1814f3e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f2a1400c3c0 tx=0x7f2a1400c880 comp rx=0 tx=0).stop 2023-12-19T19:01:03.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.645+0000 7f2a1ea9c640 1 -- 172.21.15.133:0/2798668801 shutdown_connections 2023-12-19T19:01:03.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.645+0000 7f2a1ea9c640 1 --2- 172.21.15.133:0/2798668801 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2a04066470 0x7f2a04068930 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.645+0000 7f2a1ea9c640 1 --2- 172.21.15.133:0/2798668801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2a180c60f0 0x7f2a181eb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.645+0000 7f2a1ea9c640 1 --2- 172.21.15.133:0/2798668801 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2a180c5640 0x7f2a18071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.645+0000 7f2a1ea9c640 1 --2- 172.21.15.133:0/2798668801 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2a180c5260 0x7f2a1814f3e0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.645+0000 7f2a1ea9c640 1 -- 172.21.15.133:0/2798668801 >> 172.21.15.133:0/2798668801 conn(0x7f2a1806a5b0 msgr2=0x7f2a1806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.645+0000 7f2a1ea9c640 1 -- 172.21.15.133:0/2798668801 shutdown_connections 2023-12-19T19:01:03.651 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.645+0000 7f2a1ea9c640 1 -- 172.21.15.133:0/2798668801 wait complete. 2023-12-19T19:01:03.670 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T19:01:03.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.805+0000 7f165f59e640 1 Processor -- start 2023-12-19T19:01:03.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.805+0000 7f165f59e640 1 -- start start 2023-12-19T19:01:03.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.809+0000 7f165f59e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16600c1010 0x7f166006fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:03.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.809+0000 7f165f59e640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1660071e90 con 0x7f166014f800 2023-12-19T19:01:03.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.809+0000 7f165f59e640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16600a5110 con 0x7f1660070280 2023-12-19T19:01:03.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.809+0000 7f165f59e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1660152d70 con 0x7f16600c1010 2023-12-19T19:01:03.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.809+0000 7f165e59c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f166014f800 0x7f1660072320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58534/0 (socket says 172.21.15.133:58534) 2023-12-19T19:01:03.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.809+0000 7f165e59c640 1 -- 172.21.15.133:0/1310836312 learned_addr learned my addr 172.21.15.133:0/1310836312 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:03.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.809+0000 7f1657fff640 1 --2- 172.21.15.133:0/1310836312 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16600c1010 0x7f166006fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:03.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.809+0000 7f165dd9b640 1 -- 172.21.15.133:0/1310836312 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198978100 0 0) 0x7f1660071e90 con 0x7f166014f800 2023-12-19T19:01:03.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.809+0000 7f165dd9b640 1 -- 172.21.15.133:0/1310836312 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f164c003530 con 0x7f166014f800 2023-12-19T19:01:03.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.809+0000 7f165dd9b640 1 -- 172.21.15.133:0/1310836312 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2312373199 0 0) 0x7f16600a5110 con 0x7f1660070280 2023-12-19T19:01:03.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.809+0000 7f165dd9b640 1 -- 172.21.15.133:0/1310836312 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1660071e90 con 0x7f1660070280 2023-12-19T19:01:03.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.809+0000 7f1657fff640 1 -- 172.21.15.133:0/1310836312 >> v1:172.21.15.138:6789/0 conn(0x7f1660070280 legacy=0x7f166015cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:03.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.809+0000 7f1657fff640 1 -- 172.21.15.133:0/1310836312 >> v1:172.21.15.133:6789/0 conn(0x7f166014f800 legacy=0x7f1660072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:03.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.809+0000 7f165dd9b640 1 -- 172.21.15.133:0/1310836312 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 684970208 0 0) 0x7f164c003530 con 0x7f166014f800 2023-12-19T19:01:03.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.809+0000 7f1657fff640 1 -- 172.21.15.133:0/1310836312 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1660153050 con 0x7f16600c1010 2023-12-19T19:01:03.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.813+0000 7f1657fff640 1 --2- 172.21.15.133:0/1310836312 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16600c1010 0x7f166006fd40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f16480097f0 tx=0x7f164801c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=195b75bba1af9802 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:03.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.813+0000 7f165dd9b640 1 -- 172.21.15.133:0/1310836312 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1650001680 con 0x7f16600c1010 2023-12-19T19:01:03.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.813+0000 7f165dd9b640 1 -- 172.21.15.133:0/1310836312 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16480a7050 con 0x7f16600c1010 2023-12-19T19:01:03.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.813+0000 7f165dd9b640 1 -- 172.21.15.133:0/1310836312 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16480ab620 con 0x7f16600c1010 2023-12-19T19:01:03.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.813+0000 7f165f59e640 1 -- 172.21.15.133:0/1310836312 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16600c1010 msgr2=0x7f166006fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:03.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.813+0000 7f165f59e640 1 --2- 172.21.15.133:0/1310836312 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16600c1010 0x7f166006fd40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f16480097f0 tx=0x7f164801c320 comp rx=0 tx=0).stop 2023-12-19T19:01:03.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.813+0000 7f165f59e640 1 -- 172.21.15.133:0/1310836312 shutdown_connections 2023-12-19T19:01:03.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.813+0000 7f165f59e640 1 --2- 172.21.15.133:0/1310836312 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f16600c1010 0x7f166006fd40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.813+0000 7f165f59e640 1 -- 172.21.15.133:0/1310836312 >> 172.21.15.133:0/1310836312 conn(0x7f16600a7800 msgr2=0x7f16600a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:03.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.813+0000 7f165f59e640 1 -- 172.21.15.133:0/1310836312 shutdown_connections 2023-12-19T19:01:03.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.813+0000 7f165f59e640 1 -- 172.21.15.133:0/1310836312 wait complete. 2023-12-19T19:01:03.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.813+0000 7f165f59e640 1 Processor -- start 2023-12-19T19:01:03.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.813+0000 7f165f59e640 1 -- start start 2023-12-19T19:01:03.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f165f59e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1660070280 0x7f166014e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:03.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f165f59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16600c1010 0x7f16601f06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:03.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f165f59e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f166014f800 0x7f16601f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:03.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f165f59e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16601f1150 con 0x7f16600c1010 2023-12-19T19:01:03.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f165f59e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1660148a70 con 0x7f166014f800 2023-12-19T19:01:03.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f165f59e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f166006c980 con 0x7f1660070280 2023-12-19T19:01:03.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f1657fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16600c1010 0x7f16601f06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:03.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f1657fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16600c1010 0x7f16601f06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39504/0 (socket says 172.21.15.133:39504) 2023-12-19T19:01:03.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f1657fff640 1 -- 172.21.15.133:0/2925943160 learned_addr learned my addr 172.21.15.133:0/2925943160 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:03.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f165e59c640 1 --2- 172.21.15.133:0/2925943160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1660070280 0x7f166014e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f165ed9d640 1 --2- 172.21.15.133:0/2925943160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f166014f800 0x7f16601f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f1657fff640 1 -- 172.21.15.133:0/2925943160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1660070280 msgr2=0x7f166014e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f1657fff640 1 --2- 172.21.15.133:0/2925943160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1660070280 0x7f166014e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f1657fff640 1 -- 172.21.15.133:0/2925943160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f166014f800 msgr2=0x7f16601f0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f1657fff640 1 --2- 172.21.15.133:0/2925943160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f166014f800 0x7f16601f0c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f1657fff640 1 -- 172.21.15.133:0/2925943160 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1648009420 con 0x7f16600c1010 2023-12-19T19:01:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f165e59c640 1 --2- 172.21.15.133:0/2925943160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1660070280 0x7f166014e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:01:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f1657fff640 1 --2- 172.21.15.133:0/2925943160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16600c1010 0x7f16601f06d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f16480ae040 tx=0x7f164801ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f1656ffd640 1 -- 172.21.15.133:0/2925943160 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1648004020 con 0x7f16600c1010 2023-12-19T19:01:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f1656ffd640 1 -- 172.21.15.133:0/2925943160 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16480041a0 con 0x7f16600c1010 2023-12-19T19:01:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f1656ffd640 1 -- 172.21.15.133:0/2925943160 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1648003620 con 0x7f16600c1010 2023-12-19T19:01:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f165f59e640 1 -- 172.21.15.133:0/2925943160 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f166006cc60 con 0x7f16600c1010 2023-12-19T19:01:03.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f165f59e640 1 -- 172.21.15.133:0/2925943160 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1660147270 con 0x7f16600c1010 2023-12-19T19:01:03.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f165f59e640 1 -- 172.21.15.133:0/2925943160 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f166004e850 con 0x7f16600c1010 2023-12-19T19:01:03.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.817+0000 7f1656ffd640 1 -- 172.21.15.133:0/2925943160 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1648003780 con 0x7f16600c1010 2023-12-19T19:01:03.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.821+0000 7f1656ffd640 1 --2- 172.21.15.133:0/2925943160 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1640066470 0x7f1640068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:03.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.821+0000 7f1656ffd640 1 -- 172.21.15.133:0/2925943160 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f164811daa0 con 0x7f16600c1010 2023-12-19T19:01:03.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.821+0000 7f165e59c640 1 --2- 172.21.15.133:0/2925943160 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1640066470 0x7f1640068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:03.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.821+0000 7f165e59c640 1 --2- 172.21.15.133:0/2925943160 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1640066470 0x7f1640068930 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1650001ec0 tx=0x7f1650000ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:03.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.825+0000 7f1656ffd640 1 -- 172.21.15.133:0/2925943160 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f16480eabd0 con 0x7f16600c1010 2023-12-19T19:01:03.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.973+0000 7f165f59e640 1 -- 172.21.15.133:0/2925943160 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f16600c5370 con 0x7f16600c1010 2023-12-19T19:01:03.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.973+0000 7f1656ffd640 1 -- 172.21.15.133:0/2925943160 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7f16480ee1f0 con 0x7f16600c1010 2023-12-19T19:01:03.977 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:01:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.973+0000 7f165f59e640 1 -- 172.21.15.133:0/2925943160 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1640066470 msgr2=0x7f1640068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.973+0000 7f165f59e640 1 --2- 172.21.15.133:0/2925943160 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1640066470 0x7f1640068930 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f1650001ec0 tx=0x7f1650000ee0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.973+0000 7f165f59e640 1 -- 172.21.15.133:0/2925943160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16600c1010 msgr2=0x7f16601f06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.973+0000 7f165f59e640 1 --2- 172.21.15.133:0/2925943160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16600c1010 0x7f16601f06d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f16480ae040 tx=0x7f164801ab60 comp rx=0 tx=0).stop 2023-12-19T19:01:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.973+0000 7f165f59e640 1 -- 172.21.15.133:0/2925943160 shutdown_connections 2023-12-19T19:01:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.973+0000 7f165f59e640 1 --2- 172.21.15.133:0/2925943160 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1640066470 0x7f1640068930 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.973+0000 7f165f59e640 1 --2- 172.21.15.133:0/2925943160 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f166014f800 0x7f16601f0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.973+0000 7f165f59e640 1 --2- 172.21.15.133:0/2925943160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f16600c1010 0x7f16601f06d0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.973+0000 7f165f59e640 1 --2- 172.21.15.133:0/2925943160 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1660070280 0x7f166014e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.973+0000 7f165f59e640 1 -- 172.21.15.133:0/2925943160 >> 172.21.15.133:0/2925943160 conn(0x7f16600a7800 msgr2=0x7f166014d010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.973+0000 7f165f59e640 1 -- 172.21.15.133:0/2925943160 shutdown_connections 2023-12-19T19:01:03.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:03.973+0000 7f165f59e640 1 -- 172.21.15.133:0/2925943160 wait complete. 2023-12-19T19:01:03.999 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T19:01:04.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.137+0000 7f770be54640 1 Processor -- start 2023-12-19T19:01:04.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.137+0000 7f770be54640 1 -- start start 2023-12-19T19:01:04.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.137+0000 7f770be54640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f77040c5260 0x7f770406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:04.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.137+0000 7f770be54640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f77040c5640 0x7f77040c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:04.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.137+0000 7f770be54640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77040c2580 con 0x7f77040c60f0 2023-12-19T19:01:04.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.137+0000 7f770be54640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7704153510 con 0x7f77040c5640 2023-12-19T19:01:04.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.137+0000 7f770be54640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77040c17f0 con 0x7f77040c5260 2023-12-19T19:01:04.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.141+0000 7f77093ef640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f77040c5640 0x7f77040c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:04.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.141+0000 7f7709bf0640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f77040c5260 0x7f770406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:04.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.141+0000 7f770a3f1640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f77040c60f0 0x7f7704155de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:49140/0 (socket says 172.21.15.133:49140) 2023-12-19T19:01:04.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.141+0000 7f770a3f1640 1 -- 172.21.15.133:0/813764643 learned_addr learned my addr 172.21.15.133:0/813764643 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:04.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.141+0000 7f77093ef640 1 -- 172.21.15.133:0/813764643 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f77040c5260 msgr2=0x7f770406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:04.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.141+0000 7f77093ef640 1 --2- 172.21.15.133:0/813764643 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f77040c5260 0x7f770406d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.141+0000 7f77093ef640 1 -- 172.21.15.133:0/813764643 >> v1:172.21.15.138:6789/0 conn(0x7f77040c60f0 legacy=0x7f7704155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:04.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.141+0000 7f77093ef640 1 -- 172.21.15.133:0/813764643 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77040c1a00 con 0x7f77040c5640 2023-12-19T19:01:04.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.141+0000 7f77093ef640 1 --2- 172.21.15.133:0/813764643 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77040c5640 0x7f77040c5bb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f77040c1930 tx=0x7f76f401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4d61e3eb762766e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.141+0000 7f7708bee640 1 -- 172.21.15.133:0/813764643 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f40ab600 con 0x7f77040c5640 2023-12-19T19:01:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.141+0000 7f7708bee640 1 -- 172.21.15.133:0/813764643 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f40a7050 con 0x7f77040c5640 2023-12-19T19:01:04.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.141+0000 7f7708bee640 1 -- 172.21.15.133:0/813764643 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f40ab980 con 0x7f77040c5640 2023-12-19T19:01:04.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f770be54640 1 -- 172.21.15.133:0/813764643 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77040c5640 msgr2=0x7f77040c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:04.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f770be54640 1 --2- 172.21.15.133:0/813764643 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77040c5640 0x7f77040c5bb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f77040c1930 tx=0x7f76f401c3c0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f770be54640 1 -- 172.21.15.133:0/813764643 shutdown_connections 2023-12-19T19:01:04.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f770be54640 1 --2- 172.21.15.133:0/813764643 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77040c5640 0x7f77040c5bb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f770be54640 1 --2- 172.21.15.133:0/813764643 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f77040c5260 0x7f770406d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f770be54640 1 -- 172.21.15.133:0/813764643 >> 172.21.15.133:0/813764643 conn(0x7f770406a5b0 msgr2=0x7f770406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:04.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f770be54640 1 -- 172.21.15.133:0/813764643 shutdown_connections 2023-12-19T19:01:04.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f770be54640 1 -- 172.21.15.133:0/813764643 wait complete. 2023-12-19T19:01:04.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f770be54640 1 Processor -- start 2023-12-19T19:01:04.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f770be54640 1 -- start start 2023-12-19T19:01:04.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f770be54640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77040c5260 0x7f77040a8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:04.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f770be54640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f77040c5640 0x7f77040bf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:04.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f770be54640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77040c60f0 0x7f7704146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:04.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f770be54640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77041f1870 con 0x7f77040c5260 2023-12-19T19:01:04.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f770be54640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770414f7b0 con 0x7f77040c60f0 2023-12-19T19:01:04.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f770be54640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770414f480 con 0x7f77040c5640 2023-12-19T19:01:04.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f7709bf0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77040c5260 0x7f77040a8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:04.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f7709bf0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77040c5260 0x7f77040a8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39514/0 (socket says 172.21.15.133:39514) 2023-12-19T19:01:04.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f7709bf0640 1 -- 172.21.15.133:0/3786661298 learned_addr learned my addr 172.21.15.133:0/3786661298 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:04.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f770a3f1640 1 --2- 172.21.15.133:0/3786661298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77040c60f0 0x7f7704146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:04.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f77093ef640 1 --2- 172.21.15.133:0/3786661298 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f77040c5640 0x7f77040bf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:04.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f7709bf0640 1 -- 172.21.15.133:0/3786661298 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f77040c5640 msgr2=0x7f77040bf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:04.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f7709bf0640 1 --2- 172.21.15.133:0/3786661298 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f77040c5640 0x7f77040bf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f7709bf0640 1 -- 172.21.15.133:0/3786661298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77040c60f0 msgr2=0x7f7704146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:04.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f7709bf0640 1 --2- 172.21.15.133:0/3786661298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77040c60f0 0x7f7704146a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f7709bf0640 1 -- 172.21.15.133:0/3786661298 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f4009420 con 0x7f77040c5260 2023-12-19T19:01:04.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.145+0000 7f7709bf0640 1 --2- 172.21.15.133:0/3786661298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77040c5260 0x7f77040a8ef0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f770000e870 tx=0x7f770000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:04.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.149+0000 7f76fa7fc640 1 -- 172.21.15.133:0/3786661298 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7700009510 con 0x7f77040c5260 2023-12-19T19:01:04.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.149+0000 7f76fa7fc640 1 -- 172.21.15.133:0/3786661298 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770000eec0 con 0x7f77040c5260 2023-12-19T19:01:04.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.149+0000 7f76fa7fc640 1 -- 172.21.15.133:0/3786661298 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770000cb40 con 0x7f77040c5260 2023-12-19T19:01:04.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.149+0000 7f770be54640 1 -- 172.21.15.133:0/3786661298 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77041f1a50 con 0x7f77040c5260 2023-12-19T19:01:04.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.149+0000 7f770be54640 1 -- 172.21.15.133:0/3786661298 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77041f1d30 con 0x7f77040c5260 2023-12-19T19:01:04.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.149+0000 7f770be54640 1 -- 172.21.15.133:0/3786661298 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7704068400 con 0x7f77040c5260 2023-12-19T19:01:04.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.149+0000 7f76fa7fc640 1 -- 172.21.15.133:0/3786661298 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f770000cca0 con 0x7f77040c5260 2023-12-19T19:01:04.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.149+0000 7f76fa7fc640 1 --2- 172.21.15.133:0/3786661298 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f76e80664a0 0x7f76e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:04.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.149+0000 7f76fa7fc640 1 -- 172.21.15.133:0/3786661298 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7700084350 con 0x7f77040c5260 2023-12-19T19:01:04.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.149+0000 7f77093ef640 1 --2- 172.21.15.133:0/3786661298 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f76e80664a0 0x7f76e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:04.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.153+0000 7f77093ef640 1 --2- 172.21.15.133:0/3786661298 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f76e80664a0 0x7f76e8068960 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f76f40ad000 tx=0x7f76f4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:04.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.153+0000 7f76fa7fc640 1 -- 172.21.15.133:0/3786661298 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f77000513d0 con 0x7f77040c5260 2023-12-19T19:01:04.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.305+0000 7f770be54640 1 -- 172.21.15.133:0/3786661298 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77040725d0 con 0x7f77040c5260 2023-12-19T19:01:04.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.305+0000 7f76fa7fc640 1 -- 172.21.15.133:0/3786661298 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f77000549f0 con 0x7f77040c5260 2023-12-19T19:01:04.310 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:01:04.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.309+0000 7f770be54640 1 -- 172.21.15.133:0/3786661298 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f76e80664a0 msgr2=0x7f76e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:04.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.309+0000 7f770be54640 1 --2- 172.21.15.133:0/3786661298 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f76e80664a0 0x7f76e8068960 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f76f40ad000 tx=0x7f76f4008040 comp rx=0 tx=0).stop 2023-12-19T19:01:04.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.309+0000 7f770be54640 1 -- 172.21.15.133:0/3786661298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77040c5260 msgr2=0x7f77040a8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:04.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.309+0000 7f770be54640 1 --2- 172.21.15.133:0/3786661298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77040c5260 0x7f77040a8ef0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f770000e870 tx=0x7f770000ec70 comp rx=0 tx=0).stop 2023-12-19T19:01:04.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.309+0000 7f770be54640 1 -- 172.21.15.133:0/3786661298 shutdown_connections 2023-12-19T19:01:04.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.309+0000 7f770be54640 1 --2- 172.21.15.133:0/3786661298 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f76e80664a0 0x7f76e8068960 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.309+0000 7f770be54640 1 --2- 172.21.15.133:0/3786661298 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77040c60f0 0x7f7704146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.309+0000 7f770be54640 1 --2- 172.21.15.133:0/3786661298 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f77040c5640 0x7f77040bf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.309+0000 7f770be54640 1 --2- 172.21.15.133:0/3786661298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f77040c5260 0x7f77040a8ef0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.309+0000 7f770be54640 1 -- 172.21.15.133:0/3786661298 >> 172.21.15.133:0/3786661298 conn(0x7f770406a5b0 msgr2=0x7f7704150370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:04.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.309+0000 7f770be54640 1 -- 172.21.15.133:0/3786661298 shutdown_connections 2023-12-19T19:01:04.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.309+0000 7f770be54640 1 -- 172.21.15.133:0/3786661298 wait complete. 2023-12-19T19:01:04.331 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-19T19:01:04.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6f5e09640 1 Processor -- start 2023-12-19T19:01:04.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6f5e09640 1 -- start start 2023-12-19T19:01:04.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6f5e09640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6f00c5260 0x7fa6f006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:04.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6f5e09640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f0156960 con 0x7fa6f0155de0 2023-12-19T19:01:04.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6f5e09640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f00c2580 con 0x7fa6f00c5640 2023-12-19T19:01:04.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6f5e09640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f0153510 con 0x7fa6f00c5260 2023-12-19T19:01:04.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6effff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa6f0155de0 0x7fa6f0156250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38104/0 (socket says 172.21.15.133:38104) 2023-12-19T19:01:04.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6effff640 1 -- 172.21.15.133:0/2995054701 learned_addr learned my addr 172.21.15.133:0/2995054701 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:04.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6ef7fe640 1 --2- 172.21.15.133:0/2995054701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6f00c5260 0x7fa6f006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:04.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6eeffd640 1 -- 172.21.15.133:0/2995054701 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223948607 0 0) 0x7fa6e80014a0 con 0x7fa6f0155de0 2023-12-19T19:01:04.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6eeffd640 1 -- 172.21.15.133:0/2995054701 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6dc003530 con 0x7fa6f0155de0 2023-12-19T19:01:04.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6eeffd640 1 -- 172.21.15.133:0/2995054701 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 40727671 0 0) 0x7fa6dc003530 con 0x7fa6f0155de0 2023-12-19T19:01:04.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6eeffd640 1 -- 172.21.15.133:0/2995054701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6f00c5260 msgr2=0x7fa6f006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:04.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6eeffd640 1 --2- 172.21.15.133:0/2995054701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6f00c5260 0x7fa6f006d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6eeffd640 1 -- 172.21.15.133:0/2995054701 >> v1:172.21.15.138:6789/0 conn(0x7fa6f00c5640 legacy=0x7fa6f00c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:04.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6eeffd640 1 -- 172.21.15.133:0/2995054701 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f00c1a00 con 0x7fa6f0155de0 2023-12-19T19:01:04.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6eeffd640 1 -- 172.21.15.133:0/2995054701 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7fa6e8001bb0 con 0x7fa6f0155de0 2023-12-19T19:01:04.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6eeffd640 1 -- 172.21.15.133:0/2995054701 >> v1:172.21.15.133:6789/0 conn(0x7fa6f0155de0 legacy=0x7fa6f0156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:04.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6eeffd640 1 --2- 172.21.15.133:0/2995054701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6f00c5260 0x7fa6dc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:04.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6eeffd640 1 --2- 172.21.15.133:0/2995054701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6dc003f80 0x7fa6dc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:04.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6eeffd640 1 --2- 172.21.15.133:0/2995054701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6dc004d10 0x7fa6dc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:04.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6eeffd640 1 -- 172.21.15.133:0/2995054701 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc00bb50 con 0x7fa6dc003f80 2023-12-19T19:01:04.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6eeffd640 1 -- 172.21.15.133:0/2995054701 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc00bcc0 con 0x7fa6dc004d10 2023-12-19T19:01:04.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6eeffd640 1 -- 172.21.15.133:0/2995054701 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc00be80 con 0x7fa6f00c5260 2023-12-19T19:01:04.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6e7fff640 1 --2- 172.21.15.133:0/2995054701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6dc003f80 0x7fa6dc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:04.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6ef7fe640 1 --2- 172.21.15.133:0/2995054701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6f00c5260 0x7fa6dc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:04.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6effff640 1 --2- 172.21.15.133:0/2995054701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6dc004d10 0x7fa6dc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:04.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6e7fff640 1 -- 172.21.15.133:0/2995054701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6f00c5260 msgr2=0x7fa6dc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:04.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6e7fff640 1 --2- 172.21.15.133:0/2995054701 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6f00c5260 0x7fa6dc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6e7fff640 1 -- 172.21.15.133:0/2995054701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6dc004d10 msgr2=0x7fa6dc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:04.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6e7fff640 1 --2- 172.21.15.133:0/2995054701 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6dc004d10 0x7fa6dc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.469+0000 7fa6e7fff640 1 -- 172.21.15.133:0/2995054701 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6dc003530 con 0x7fa6dc003f80 2023-12-19T19:01:04.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.473+0000 7fa6e7fff640 1 --2- 172.21.15.133:0/2995054701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6dc003f80 0x7fa6dc0047d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8001750 tx=0x7fa6d801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f062649ed5f23bac server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:04.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.473+0000 7fa6eeffd640 1 -- 172.21.15.133:0/2995054701 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d80052d0 con 0x7fa6dc003f80 2023-12-19T19:01:04.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.473+0000 7fa6eeffd640 1 -- 172.21.15.133:0/2995054701 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6d80a7050 con 0x7fa6dc003f80 2023-12-19T19:01:04.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.473+0000 7fa6eeffd640 1 -- 172.21.15.133:0/2995054701 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6d8003600 con 0x7fa6dc003f80 2023-12-19T19:01:04.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.473+0000 7fa6f5e09640 1 -- 172.21.15.133:0/2995054701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6dc003f80 msgr2=0x7fa6dc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:04.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.473+0000 7fa6f5e09640 1 --2- 172.21.15.133:0/2995054701 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6dc003f80 0x7fa6dc0047d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8001750 tx=0x7fa6d801c3c0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.473+0000 7fa6effff640 1 -- 172.21.15.133:0/2995054701 reap_dead start 2023-12-19T19:01:04.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.473+0000 7fa6f5e09640 1 -- 172.21.15.133:0/2995054701 shutdown_connections 2023-12-19T19:01:04.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.473+0000 7fa6f5e09640 1 -- 172.21.15.133:0/2995054701 >> 172.21.15.133:0/2995054701 conn(0x7fa6f006a5b0 msgr2=0x7fa6f006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:04.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.473+0000 7fa6f5e09640 1 -- 172.21.15.133:0/2995054701 shutdown_connections 2023-12-19T19:01:04.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.473+0000 7fa6f5e09640 1 -- 172.21.15.133:0/2995054701 wait complete. 2023-12-19T19:01:04.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6f5e09640 1 Processor -- start 2023-12-19T19:01:04.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6f5e09640 1 -- start start 2023-12-19T19:01:04.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6f5e09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6dc003f80 0x7fa6f014a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:04.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6f5e09640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6f0070160 0x7fa6f01e5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:04.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6f5e09640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6f00a8350 0x7fa6f01e6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:04.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6f5e09640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f0070660 con 0x7fa6dc003f80 2023-12-19T19:01:04.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6f5e09640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f01e9900 con 0x7fa6f0070160 2023-12-19T19:01:04.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6f5e09640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f01e8b40 con 0x7fa6f00a8350 2023-12-19T19:01:04.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6ef7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6dc003f80 0x7fa6f014a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:04.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6ef7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6dc003f80 0x7fa6f014a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38396/0 (socket says 172.21.15.133:38396) 2023-12-19T19:01:04.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6ef7fe640 1 -- 172.21.15.133:0/2162030869 learned_addr learned my addr 172.21.15.133:0/2162030869 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:04.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6e7fff640 1 --2- 172.21.15.133:0/2162030869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6f0070160 0x7fa6f01e5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:04.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6effff640 1 --2- 172.21.15.133:0/2162030869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6f00a8350 0x7fa6f01e6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:04.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6ef7fe640 1 -- 172.21.15.133:0/2162030869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6f00a8350 msgr2=0x7fa6f01e6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:04.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6ef7fe640 1 --2- 172.21.15.133:0/2162030869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6f00a8350 0x7fa6f01e6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6ef7fe640 1 -- 172.21.15.133:0/2162030869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6f0070160 msgr2=0x7fa6f01e5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:04.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6ef7fe640 1 --2- 172.21.15.133:0/2162030869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6f0070160 0x7fa6f01e5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6ef7fe640 1 -- 172.21.15.133:0/2162030869 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f01e8e20 con 0x7fa6dc003f80 2023-12-19T19:01:04.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6ef7fe640 1 --2- 172.21.15.133:0/2162030869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6dc003f80 0x7fa6f014a000 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa6e00119d0 tx=0x7fa6e0011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:04.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6ecff9640 1 -- 172.21.15.133:0/2162030869 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e000fb50 con 0x7fa6dc003f80 2023-12-19T19:01:04.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6ecff9640 1 -- 172.21.15.133:0/2162030869 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e000fcb0 con 0x7fa6dc003f80 2023-12-19T19:01:04.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6f5e09640 1 -- 172.21.15.133:0/2162030869 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f01e9100 con 0x7fa6dc003f80 2023-12-19T19:01:04.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6ecff9640 1 -- 172.21.15.133:0/2162030869 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e0014440 con 0x7fa6dc003f80 2023-12-19T19:01:04.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.477+0000 7fa6f5e09640 1 -- 172.21.15.133:0/2162030869 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f014a540 con 0x7fa6dc003f80 2023-12-19T19:01:04.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.481+0000 7fa6f5e09640 1 -- 172.21.15.133:0/2162030869 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f00c0440 con 0x7fa6dc003f80 2023-12-19T19:01:04.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.481+0000 7fa6ecff9640 1 -- 172.21.15.133:0/2162030869 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa6e00145a0 con 0x7fa6dc003f80 2023-12-19T19:01:04.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.481+0000 7fa6ecff9640 1 --2- 172.21.15.133:0/2162030869 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa6d00664a0 0x7fa6d0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:04.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.481+0000 7fa6ecff9640 1 -- 172.21.15.133:0/2162030869 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa6e0084ac0 con 0x7fa6dc003f80 2023-12-19T19:01:04.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.481+0000 7fa6e7fff640 1 --2- 172.21.15.133:0/2162030869 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa6d00664a0 0x7fa6d0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:04.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.481+0000 7fa6e7fff640 1 --2- 172.21.15.133:0/2162030869 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa6d00664a0 0x7fa6d0068960 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00c5aa0 tx=0x7fa6d80011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:04.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.485+0000 7fa6ecff9640 1 -- 172.21.15.133:0/2162030869 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa6e0051c90 con 0x7fa6dc003f80 2023-12-19T19:01:04.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.633+0000 7fa6f5e09640 1 -- 172.21.15.133:0/2162030869 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa6f0068400 con 0x7fa6dc003f80 2023-12-19T19:01:04.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.633+0000 7fa6ecff9640 1 -- 172.21.15.133:0/2162030869 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7fa6e00552b0 con 0x7fa6dc003f80 2023-12-19T19:01:04.637 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:01:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.633+0000 7fa6f5e09640 1 -- 172.21.15.133:0/2162030869 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa6d00664a0 msgr2=0x7fa6d0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.633+0000 7fa6f5e09640 1 --2- 172.21.15.133:0/2162030869 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa6d00664a0 0x7fa6d0068960 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00c5aa0 tx=0x7fa6d80011a0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.633+0000 7fa6f5e09640 1 -- 172.21.15.133:0/2162030869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6dc003f80 msgr2=0x7fa6f014a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.633+0000 7fa6f5e09640 1 --2- 172.21.15.133:0/2162030869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6dc003f80 0x7fa6f014a000 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa6e00119d0 tx=0x7fa6e0011e90 comp rx=0 tx=0).stop 2023-12-19T19:01:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.633+0000 7fa6f5e09640 1 -- 172.21.15.133:0/2162030869 shutdown_connections 2023-12-19T19:01:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.633+0000 7fa6f5e09640 1 --2- 172.21.15.133:0/2162030869 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa6d00664a0 0x7fa6d0068960 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.637+0000 7fa6f5e09640 1 --2- 172.21.15.133:0/2162030869 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa6f00a8350 0x7fa6f01e6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.637+0000 7fa6f5e09640 1 --2- 172.21.15.133:0/2162030869 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa6f0070160 0x7fa6f01e5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.637+0000 7fa6f5e09640 1 --2- 172.21.15.133:0/2162030869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa6dc003f80 0x7fa6f014a000 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.637+0000 7fa6f5e09640 1 -- 172.21.15.133:0/2162030869 >> 172.21.15.133:0/2162030869 conn(0x7fa6f006a5b0 msgr2=0x7fa6f00c47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:04.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.637+0000 7fa6f5e09640 1 -- 172.21.15.133:0/2162030869 shutdown_connections 2023-12-19T19:01:04.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.637+0000 7fa6f5e09640 1 -- 172.21.15.133:0/2162030869 wait complete. 2023-12-19T19:01:04.658 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-19T19:01:04.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.797+0000 7f40bfedd640 1 Processor -- start 2023-12-19T19:01:04.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.797+0000 7f40bfedd640 1 -- start start 2023-12-19T19:01:04.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.797+0000 7f40bfedd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f40b80c63c0 0x7f40b80c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:04.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.801+0000 7f40bfedd640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b80c31c0 con 0x7f40b80c4100 2023-12-19T19:01:04.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.801+0000 7f40bfedd640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b80c34a0 con 0x7f40b80c2bb0 2023-12-19T19:01:04.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.801+0000 7f40bfedd640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b80c1030 con 0x7f40b80c63c0 2023-12-19T19:01:04.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.801+0000 7f40bdc79640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f40b80c63c0 0x7f40b80c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:04.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.801+0000 7f40bdc79640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f40b80c63c0 0x7f40b80c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38408/0 (socket says 172.21.15.133:38408) 2023-12-19T19:01:04.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.801+0000 7f40bdc79640 1 -- 172.21.15.133:0/2477936379 learned_addr learned my addr 172.21.15.133:0/2477936379 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:04.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.801+0000 7f40bdc79640 1 -- 172.21.15.133:0/2477936379 >> v1:172.21.15.138:6789/0 conn(0x7f40b80c2bb0 legacy=0x7f40b80a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:04.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.801+0000 7f40bdc79640 1 -- 172.21.15.133:0/2477936379 >> v1:172.21.15.133:6789/0 conn(0x7f40b80c4100 legacy=0x7f40b80c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:04.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.801+0000 7f40bdc79640 1 -- 172.21.15.133:0/2477936379 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b80c1310 con 0x7f40b80c63c0 2023-12-19T19:01:04.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.801+0000 7f40bdc79640 1 --2- 172.21.15.133:0/2477936379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40b80c63c0 0x7f40b80c06d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f40b4009870 tx=0x7f40b401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f57dced858578c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:04.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.801+0000 7f40bcc77640 1 -- 172.21.15.133:0/2477936379 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b40ab600 con 0x7f40b80c63c0 2023-12-19T19:01:04.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.801+0000 7f40bcc77640 1 -- 172.21.15.133:0/2477936379 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b40ab760 con 0x7f40b80c63c0 2023-12-19T19:01:04.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.801+0000 7f40bcc77640 1 -- 172.21.15.133:0/2477936379 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b40abaf0 con 0x7f40b80c63c0 2023-12-19T19:01:04.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.805+0000 7f40bfedd640 1 -- 172.21.15.133:0/2477936379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40b80c63c0 msgr2=0x7f40b80c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:04.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.805+0000 7f40bfedd640 1 --2- 172.21.15.133:0/2477936379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40b80c63c0 0x7f40b80c06d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f40b4009870 tx=0x7f40b401c3e0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.805+0000 7f40bfedd640 1 -- 172.21.15.133:0/2477936379 shutdown_connections 2023-12-19T19:01:04.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.805+0000 7f40bfedd640 1 --2- 172.21.15.133:0/2477936379 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40b80c63c0 0x7f40b80c06d0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.805+0000 7f40bfedd640 1 -- 172.21.15.133:0/2477936379 >> 172.21.15.133:0/2477936379 conn(0x7f40b806a5b0 msgr2=0x7f40b806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:04.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.805+0000 7f40bfedd640 1 -- 172.21.15.133:0/2477936379 shutdown_connections 2023-12-19T19:01:04.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.805+0000 7f40bfedd640 1 -- 172.21.15.133:0/2477936379 wait complete. 2023-12-19T19:01:04.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.805+0000 7f40bfedd640 1 Processor -- start 2023-12-19T19:01:04.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.805+0000 7f40bfedd640 1 -- start start 2023-12-19T19:01:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.805+0000 7f40bfedd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f40b80c2bb0 0x7f40b81edcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.805+0000 7f40bfedd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40b80c4100 0x7f40b8151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.805+0000 7f40bfedd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f40b80c63c0 0x7f40b81f0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.805+0000 7f40bfedd640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b8157550 con 0x7f40b80c4100 2023-12-19T19:01:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.805+0000 7f40bfedd640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b8070d70 con 0x7f40b80c63c0 2023-12-19T19:01:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.805+0000 7f40bfedd640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b8071050 con 0x7f40b80c2bb0 2023-12-19T19:01:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.805+0000 7f40bd478640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40b80c4100 0x7f40b8151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.805+0000 7f40bd478640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40b80c4100 0x7f40b8151300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38416/0 (socket says 172.21.15.133:38416) 2023-12-19T19:01:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.805+0000 7f40bd478640 1 -- 172.21.15.133:0/1707832670 learned_addr learned my addr 172.21.15.133:0/1707832670 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.805+0000 7f40bdc79640 1 --2- 172.21.15.133:0/1707832670 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f40b80c2bb0 0x7f40b81edcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:04.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.805+0000 7f40be47a640 1 --2- 172.21.15.133:0/1707832670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f40b80c63c0 0x7f40b81f0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:04.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.809+0000 7f40bd478640 1 -- 172.21.15.133:0/1707832670 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f40b80c2bb0 msgr2=0x7f40b81edcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:04.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.809+0000 7f40bd478640 1 --2- 172.21.15.133:0/1707832670 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f40b80c2bb0 0x7f40b81edcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.809+0000 7f40bd478640 1 -- 172.21.15.133:0/1707832670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f40b80c63c0 msgr2=0x7f40b81f0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:04.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.809+0000 7f40bd478640 1 --2- 172.21.15.133:0/1707832670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f40b80c63c0 0x7f40b81f0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.809+0000 7f40bd478640 1 -- 172.21.15.133:0/1707832670 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b40094d0 con 0x7f40b80c4100 2023-12-19T19:01:04.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.809+0000 7f40be47a640 1 --2- 172.21.15.133:0/1707832670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f40b80c63c0 0x7f40b81f0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:04.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.809+0000 7f40bd478640 1 --2- 172.21.15.133:0/1707832670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40b80c4100 0x7f40b8151300 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f40a800c500 tx=0x7f40a800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:04.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.809+0000 7f40ae7fc640 1 -- 172.21.15.133:0/1707832670 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8005220 con 0x7f40b80c4100 2023-12-19T19:01:04.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.809+0000 7f40ae7fc640 1 -- 172.21.15.133:0/1707832670 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a8005380 con 0x7f40b80c4100 2023-12-19T19:01:04.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.809+0000 7f40ae7fc640 1 -- 172.21.15.133:0/1707832670 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8007270 con 0x7f40b80c4100 2023-12-19T19:01:04.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.809+0000 7f40bfedd640 1 -- 172.21.15.133:0/1707832670 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b81ed4c0 con 0x7f40b80c4100 2023-12-19T19:01:04.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.809+0000 7f40bfedd640 1 -- 172.21.15.133:0/1707832670 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b8151840 con 0x7f40b80c4100 2023-12-19T19:01:04.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.809+0000 7f40bfedd640 1 -- 172.21.15.133:0/1707832670 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b815bd10 con 0x7f40b80c4100 2023-12-19T19:01:04.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.809+0000 7f40ae7fc640 1 -- 172.21.15.133:0/1707832670 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f40a80073d0 con 0x7f40b80c4100 2023-12-19T19:01:04.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.809+0000 7f40ae7fc640 1 --2- 172.21.15.133:0/1707832670 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f409c066470 0x7f409c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:04.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.809+0000 7f40ae7fc640 1 -- 172.21.15.133:0/1707832670 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f40a8083a80 con 0x7f40b80c4100 2023-12-19T19:01:04.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.813+0000 7f40bdc79640 1 --2- 172.21.15.133:0/1707832670 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f409c066470 0x7f409c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:04.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.813+0000 7f40bdc79640 1 --2- 172.21.15.133:0/1707832670 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f409c066470 0x7f409c068930 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f40b40af000 tx=0x7f40b40b6040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:04.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.813+0000 7f40ae7fc640 1 -- 172.21.15.133:0/1707832670 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f40a8050bb0 con 0x7f40b80c4100 2023-12-19T19:01:04.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.965+0000 7f40bfedd640 1 -- 172.21.15.133:0/1707832670 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f40b81ed9e0 con 0x7f40b80c4100 2023-12-19T19:01:04.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.965+0000 7f40ae7fc640 1 -- 172.21.15.133:0/1707832670 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7f40b81ed9e0 con 0x7f40b80c4100 2023-12-19T19:01:04.970 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:01:04.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.969+0000 7f40bfedd640 1 -- 172.21.15.133:0/1707832670 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f409c066470 msgr2=0x7f409c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:04.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.969+0000 7f40bfedd640 1 --2- 172.21.15.133:0/1707832670 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f409c066470 0x7f409c068930 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f40b40af000 tx=0x7f40b40b6040 comp rx=0 tx=0).stop 2023-12-19T19:01:04.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.969+0000 7f40bfedd640 1 -- 172.21.15.133:0/1707832670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40b80c4100 msgr2=0x7f40b8151300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:04.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.969+0000 7f40bfedd640 1 --2- 172.21.15.133:0/1707832670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40b80c4100 0x7f40b8151300 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f40a800c500 tx=0x7f40a800c9c0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.969+0000 7f40bfedd640 1 -- 172.21.15.133:0/1707832670 shutdown_connections 2023-12-19T19:01:04.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.969+0000 7f40bfedd640 1 --2- 172.21.15.133:0/1707832670 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f409c066470 0x7f409c068930 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.969+0000 7f40bfedd640 1 --2- 172.21.15.133:0/1707832670 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f40b80c63c0 0x7f40b81f0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.969+0000 7f40bfedd640 1 --2- 172.21.15.133:0/1707832670 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f40b80c4100 0x7f40b8151300 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.969+0000 7f40bfedd640 1 --2- 172.21.15.133:0/1707832670 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f40b80c2bb0 0x7f40b81edcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:04.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.969+0000 7f40bfedd640 1 -- 172.21.15.133:0/1707832670 >> 172.21.15.133:0/1707832670 conn(0x7f40b806a5b0 msgr2=0x7f40b806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:04.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.969+0000 7f40bfedd640 1 -- 172.21.15.133:0/1707832670 shutdown_connections 2023-12-19T19:01:04.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:04.969+0000 7f40bfedd640 1 -- 172.21.15.133:0/1707832670 wait complete. 2023-12-19T19:01:04.991 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T19:01:05.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.125+0000 7f19b29c1640 1 Processor -- start 2023-12-19T19:01:05.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.125+0000 7f19b29c1640 1 -- start start 2023-12-19T19:01:05.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.125+0000 7f19b29c1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f19ac0c5260 0x7f19ac06d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:05.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.125+0000 7f19b29c1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ac0c2580 con 0x7f19ac0c5640 2023-12-19T19:01:05.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.125+0000 7f19b29c1640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ac156940 con 0x7f19ac155de0 2023-12-19T19:01:05.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.125+0000 7f19b29c1640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19ac153510 con 0x7f19ac0c5260 2023-12-19T19:01:05.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.125+0000 7f19abfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f19ac0c5260 0x7f19ac06d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:05.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.125+0000 7f19abfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f19ac0c5260 0x7f19ac06d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38428/0 (socket says 172.21.15.133:38428) 2023-12-19T19:01:05.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.125+0000 7f19abfff640 1 -- 172.21.15.133:0/2061539298 learned_addr learned my addr 172.21.15.133:0/2061539298 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:05.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.129+0000 7f19abfff640 1 -- 172.21.15.133:0/2061539298 >> v1:172.21.15.138:6789/0 conn(0x7f19ac155de0 legacy=0x7f19ac156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:05.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.129+0000 7f19abfff640 1 -- 172.21.15.133:0/2061539298 >> v1:172.21.15.133:6789/0 conn(0x7f19ac0c5640 legacy=0x7f19ac0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:05.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.129+0000 7f19abfff640 1 -- 172.21.15.133:0/2061539298 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ac0c1a00 con 0x7f19ac0c5260 2023-12-19T19:01:05.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.129+0000 7f19abfff640 1 --2- 172.21.15.133:0/2061539298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19ac0c5260 0x7f19ac06d5b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f199c009870 tx=0x7f199c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d3e31d5079a31 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:05.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.129+0000 7f19aaffd640 1 -- 172.21.15.133:0/2061539298 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c0ad660 con 0x7f19ac0c5260 2023-12-19T19:01:05.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.129+0000 7f19aaffd640 1 -- 172.21.15.133:0/2061539298 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c0ad7c0 con 0x7f19ac0c5260 2023-12-19T19:01:05.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.129+0000 7f19aaffd640 1 -- 172.21.15.133:0/2061539298 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c0adb50 con 0x7f19ac0c5260 2023-12-19T19:01:05.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.129+0000 7f19b29c1640 1 -- 172.21.15.133:0/2061539298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19ac0c5260 msgr2=0x7f19ac06d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:05.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.129+0000 7f19b29c1640 1 --2- 172.21.15.133:0/2061539298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19ac0c5260 0x7f19ac06d5b0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f199c009870 tx=0x7f199c01c470 comp rx=0 tx=0).stop 2023-12-19T19:01:05.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.129+0000 7f19b29c1640 1 -- 172.21.15.133:0/2061539298 shutdown_connections 2023-12-19T19:01:05.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.129+0000 7f19b29c1640 1 --2- 172.21.15.133:0/2061539298 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19ac0c5260 0x7f19ac06d5b0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:05.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.129+0000 7f19b29c1640 1 -- 172.21.15.133:0/2061539298 >> 172.21.15.133:0/2061539298 conn(0x7f19ac06a5b0 msgr2=0x7f19ac06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:05.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.133+0000 7f19b29c1640 1 -- 172.21.15.133:0/2061539298 shutdown_connections 2023-12-19T19:01:05.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.133+0000 7f19b29c1640 1 -- 172.21.15.133:0/2061539298 wait complete. 2023-12-19T19:01:05.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.133+0000 7f19b29c1640 1 Processor -- start 2023-12-19T19:01:05.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.133+0000 7f19b29c1640 1 -- start start 2023-12-19T19:01:05.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.133+0000 7f19b29c1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19ac0c5260 0x7f19ac1f09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:05.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.133+0000 7f19b29c1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19ac0c5640 0x7f19ac152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:05.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.133+0000 7f19b29c1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19ac155de0 0x7f19ac1eca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:05.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.133+0000 7f19b29c1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac0a8150 con 0x7f19ac0c5640 2023-12-19T19:01:05.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.133+0000 7f19b29c1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac0aa190 con 0x7f19ac0c5260 2023-12-19T19:01:05.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.133+0000 7f19b29c1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ac152d60 con 0x7f19ac155de0 2023-12-19T19:01:05.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.133+0000 7f19ab7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19ac0c5640 0x7f19ac152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:05.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.133+0000 7f19abfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19ac0c5260 0x7f19ac1f09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:05.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.133+0000 7f19abfff640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19ac0c5260 0x7f19ac1f09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:45150/0 (socket says 172.21.15.133:45150) 2023-12-19T19:01:05.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.133+0000 7f19abfff640 1 -- 172.21.15.133:0/1942480797 learned_addr learned my addr 172.21.15.133:0/1942480797 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:05.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.133+0000 7f19ab7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19ac0c5640 0x7f19ac152820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38440/0 (socket says 172.21.15.133:38440) 2023-12-19T19:01:05.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.133+0000 7f19b0f5e640 1 --2- 172.21.15.133:0/1942480797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19ac155de0 0x7f19ac1eca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:05.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.133+0000 7f19ab7fe640 1 -- 172.21.15.133:0/1942480797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19ac155de0 msgr2=0x7f19ac1eca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:05.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.133+0000 7f19ab7fe640 1 --2- 172.21.15.133:0/1942480797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19ac155de0 0x7f19ac1eca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:05.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.133+0000 7f19ab7fe640 1 -- 172.21.15.133:0/1942480797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19ac0c5260 msgr2=0x7f19ac1f09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:05.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.133+0000 7f19ab7fe640 1 --2- 172.21.15.133:0/1942480797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19ac0c5260 0x7f19ac1f09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:05.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.133+0000 7f19ab7fe640 1 -- 172.21.15.133:0/1942480797 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c0094d0 con 0x7f19ac0c5640 2023-12-19T19:01:05.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.133+0000 7f19abfff640 1 --2- 172.21.15.133:0/1942480797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19ac0c5260 0x7f19ac1f09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:01:05.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.133+0000 7f19ab7fe640 1 --2- 172.21.15.133:0/1942480797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19ac0c5640 0x7f19ac152820 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f19a0000f70 tx=0x7f19a000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:05.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.137+0000 7f19a8ff9640 1 -- 172.21.15.133:0/1942480797 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a00052d0 con 0x7f19ac0c5640 2023-12-19T19:01:05.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.137+0000 7f19a8ff9640 1 -- 172.21.15.133:0/1942480797 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a0005430 con 0x7f19ac0c5640 2023-12-19T19:01:05.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.137+0000 7f19a8ff9640 1 -- 172.21.15.133:0/1942480797 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0003840 con 0x7f19ac0c5640 2023-12-19T19:01:05.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.137+0000 7f19b29c1640 1 -- 172.21.15.133:0/1942480797 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ac0a61a0 con 0x7f19ac0c5640 2023-12-19T19:01:05.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.137+0000 7f19b29c1640 1 -- 172.21.15.133:0/1942480797 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ac0a8360 con 0x7f19ac0c5640 2023-12-19T19:01:05.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.137+0000 7f19b29c1640 1 -- 172.21.15.133:0/1942480797 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19ac0a6330 con 0x7f19ac0c5640 2023-12-19T19:01:05.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.137+0000 7f19a8ff9640 1 -- 172.21.15.133:0/1942480797 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f19a00039a0 con 0x7f19ac0c5640 2023-12-19T19:01:05.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.137+0000 7f19a8ff9640 1 --2- 172.21.15.133:0/1942480797 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1998066470 0x7f1998068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:05.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.137+0000 7f19a8ff9640 1 -- 172.21.15.133:0/1942480797 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f19a00835f0 con 0x7f19ac0c5640 2023-12-19T19:01:05.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.137+0000 7f19abfff640 1 --2- 172.21.15.133:0/1942480797 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1998066470 0x7f1998068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:05.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.141+0000 7f19abfff640 1 --2- 172.21.15.133:0/1942480797 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1998066470 0x7f1998068930 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f199c009870 tx=0x7f199c0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:05.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.141+0000 7f19a8ff9640 1 -- 172.21.15.133:0/1942480797 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f19a00507b0 con 0x7f19ac0c5640 2023-12-19T19:01:05.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.301+0000 7f19b29c1640 1 -- 172.21.15.133:0/1942480797 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f19ac068400 con 0x7f19ac0c5640 2023-12-19T19:01:05.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.305+0000 7f19a8ff9640 1 -- 172.21.15.133:0/1942480797 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v54) v1 ==== 80+0+0 (secure 0 0 0) 0x7f19a0053dd0 con 0x7f19ac0c5640 2023-12-19T19:01:05.307 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-19T19:01:05.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.305+0000 7f19b29c1640 1 -- 172.21.15.133:0/1942480797 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1998066470 msgr2=0x7f1998068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:05.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.305+0000 7f19b29c1640 1 --2- 172.21.15.133:0/1942480797 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1998066470 0x7f1998068930 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f199c009870 tx=0x7f199c0a7000 comp rx=0 tx=0).stop 2023-12-19T19:01:05.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.305+0000 7f19b29c1640 1 -- 172.21.15.133:0/1942480797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19ac0c5640 msgr2=0x7f19ac152820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:05.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.305+0000 7f19b29c1640 1 --2- 172.21.15.133:0/1942480797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19ac0c5640 0x7f19ac152820 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f19a0000f70 tx=0x7f19a000c820 comp rx=0 tx=0).stop 2023-12-19T19:01:05.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.305+0000 7f19b29c1640 1 -- 172.21.15.133:0/1942480797 shutdown_connections 2023-12-19T19:01:05.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.305+0000 7f19b29c1640 1 --2- 172.21.15.133:0/1942480797 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1998066470 0x7f1998068930 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:05.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.305+0000 7f19b29c1640 1 --2- 172.21.15.133:0/1942480797 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19ac155de0 0x7f19ac1eca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:05.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.305+0000 7f19b29c1640 1 --2- 172.21.15.133:0/1942480797 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19ac0c5640 0x7f19ac152820 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:05.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.305+0000 7f19b29c1640 1 --2- 172.21.15.133:0/1942480797 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19ac0c5260 0x7f19ac1f09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:05.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.305+0000 7f19b29c1640 1 -- 172.21.15.133:0/1942480797 >> 172.21.15.133:0/1942480797 conn(0x7f19ac06a5b0 msgr2=0x7f19ac14f440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:05.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.305+0000 7f19b29c1640 1 -- 172.21.15.133:0/1942480797 shutdown_connections 2023-12-19T19:01:05.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.305+0000 7f19b29c1640 1 -- 172.21.15.133:0/1942480797 wait complete. 2023-12-19T19:01:05.328 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T19:01:05.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:05.329 DEBUG:teuthology.orchestra.run.smithi138:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T19:01:05.359 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi138.front.sepia.ceph.com 2023-12-19T19:01:05.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:05.360 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T19:01:05.413 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:01:05.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.549+0000 7f4c995df640 1 Processor -- start 2023-12-19T19:01:05.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.549+0000 7f4c995df640 1 -- start start 2023-12-19T19:01:05.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.549+0000 7f4c995df640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c94157f50 0x7f4c94158330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:05.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.549+0000 7f4c995df640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4c940c50e0 0x7f4c940c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:05.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.549+0000 7f4c995df640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c940c4980 con 0x7f4c940bf660 2023-12-19T19:01:05.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.549+0000 7f4c995df640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c940bfd10 con 0x7f4c940c50e0 2023-12-19T19:01:05.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.549+0000 7f4c995df640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c94158870 con 0x7f4c94157f50 2023-12-19T19:01:05.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.549+0000 7f4c937fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4c940c50e0 0x7f4c940c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:05.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.549+0000 7f4c937fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4c940c50e0 0x7f4c940c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38446/0 (socket says 172.21.15.133:38446) 2023-12-19T19:01:05.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.549+0000 7f4c937fe640 1 -- 172.21.15.133:0/2060946154 learned_addr learned my addr 172.21.15.133:0/2060946154 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:05.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.549+0000 7f4c92ffd640 1 --2- 172.21.15.133:0/2060946154 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c94157f50 0x7f4c94158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:05.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.549+0000 7f4c937fe640 1 -- 172.21.15.133:0/2060946154 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c94157f50 msgr2=0x7f4c94158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:05.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.549+0000 7f4c937fe640 1 --2- 172.21.15.133:0/2060946154 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c94157f50 0x7f4c94158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:05.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.549+0000 7f4c937fe640 1 -- 172.21.15.133:0/2060946154 >> v1:172.21.15.138:6789/0 conn(0x7f4c940bf660 legacy=0x7f4c940c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:05.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.549+0000 7f4c937fe640 1 -- 172.21.15.133:0/2060946154 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c940c4eb0 con 0x7f4c940c50e0 2023-12-19T19:01:05.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.553+0000 7f4c937fe640 1 --2- 172.21.15.133:0/2060946154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c940c50e0 0x7f4c940c86b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009e80 tx=0x7f4c8c01c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af892d7c6ff09cbc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:05.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.553+0000 7f4c91ffb640 1 -- 172.21.15.133:0/2060946154 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c0a5590 con 0x7f4c940c50e0 2023-12-19T19:01:05.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.553+0000 7f4c91ffb640 1 -- 172.21.15.133:0/2060946154 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c0a56f0 con 0x7f4c940c50e0 2023-12-19T19:01:05.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.553+0000 7f4c91ffb640 1 -- 172.21.15.133:0/2060946154 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c0a5a80 con 0x7f4c940c50e0 2023-12-19T19:01:05.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.553+0000 7f4c995df640 1 -- 172.21.15.133:0/2060946154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c940c50e0 msgr2=0x7f4c940c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:05.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.553+0000 7f4c995df640 1 --2- 172.21.15.133:0/2060946154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c940c50e0 0x7f4c940c86b0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c009e80 tx=0x7f4c8c01c8d0 comp rx=0 tx=0).stop 2023-12-19T19:01:05.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.553+0000 7f4c995df640 1 -- 172.21.15.133:0/2060946154 shutdown_connections 2023-12-19T19:01:05.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.553+0000 7f4c995df640 1 --2- 172.21.15.133:0/2060946154 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c940c50e0 0x7f4c940c86b0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:05.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.553+0000 7f4c995df640 1 --2- 172.21.15.133:0/2060946154 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c94157f50 0x7f4c94158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:05.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.553+0000 7f4c995df640 1 -- 172.21.15.133:0/2060946154 >> 172.21.15.133:0/2060946154 conn(0x7f4c940c6870 msgr2=0x7f4c940c6c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:05.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.553+0000 7f4c995df640 1 -- 172.21.15.133:0/2060946154 shutdown_connections 2023-12-19T19:01:05.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.553+0000 7f4c995df640 1 -- 172.21.15.133:0/2060946154 wait complete. 2023-12-19T19:01:05.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.553+0000 7f4c995df640 1 Processor -- start 2023-12-19T19:01:05.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.553+0000 7f4c995df640 1 -- start start 2023-12-19T19:01:05.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.557+0000 7f4c995df640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c940bf660 0x7f4c94148fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:05.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.557+0000 7f4c995df640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c940c50e0 0x7f4c94155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:05.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.557+0000 7f4c995df640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c94157f50 0x7f4c941eca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:05.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.557+0000 7f4c995df640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9406b8e0 con 0x7f4c940bf660 2023-12-19T19:01:05.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.557+0000 7f4c995df640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c941f0ef0 con 0x7f4c94157f50 2023-12-19T19:01:05.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.557+0000 7f4c995df640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9414c4b0 con 0x7f4c940c50e0 2023-12-19T19:01:05.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.557+0000 7f4c92ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c940bf660 0x7f4c94148fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:05.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.557+0000 7f4c92ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c940bf660 0x7f4c94148fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38456/0 (socket says 172.21.15.133:38456) 2023-12-19T19:01:05.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.557+0000 7f4c92ffd640 1 -- 172.21.15.133:0/3072076970 learned_addr learned my addr 172.21.15.133:0/3072076970 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:05.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.557+0000 7f4c937fe640 1 --2- 172.21.15.133:0/3072076970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c94157f50 0x7f4c941eca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:05.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.557+0000 7f4c927fc640 1 --2- 172.21.15.133:0/3072076970 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c940c50e0 0x7f4c94155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:05.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.557+0000 7f4c92ffd640 1 -- 172.21.15.133:0/3072076970 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c940c50e0 msgr2=0x7f4c94155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:05.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.557+0000 7f4c92ffd640 1 --2- 172.21.15.133:0/3072076970 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c940c50e0 0x7f4c94155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:05.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.557+0000 7f4c92ffd640 1 -- 172.21.15.133:0/3072076970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c94157f50 msgr2=0x7f4c941eca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:05.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.557+0000 7f4c92ffd640 1 --2- 172.21.15.133:0/3072076970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c94157f50 0x7f4c941eca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:05.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.557+0000 7f4c92ffd640 1 -- 172.21.15.133:0/3072076970 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c009b30 con 0x7f4c940bf660 2023-12-19T19:01:05.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.557+0000 7f4c92ffd640 1 --2- 172.21.15.133:0/3072076970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c940bf660 0x7f4c94148fb0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4c8400e870 tx=0x7f4c8400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:05.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.557+0000 7f4c7b7fe640 1 -- 172.21.15.133:0/3072076970 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c84009510 con 0x7f4c940bf660 2023-12-19T19:01:05.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.557+0000 7f4c7b7fe640 1 -- 172.21.15.133:0/3072076970 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8400eec0 con 0x7f4c940bf660 2023-12-19T19:01:05.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.557+0000 7f4c7b7fe640 1 -- 172.21.15.133:0/3072076970 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8400cb40 con 0x7f4c940bf660 2023-12-19T19:01:05.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.557+0000 7f4c995df640 1 -- 172.21.15.133:0/3072076970 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c941494f0 con 0x7f4c940bf660 2023-12-19T19:01:05.563 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.557+0000 7f4c995df640 1 -- 172.21.15.133:0/3072076970 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9406c920 con 0x7f4c940bf660 2023-12-19T19:01:05.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.557+0000 7f4c995df640 1 -- 172.21.15.133:0/3072076970 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9414c280 con 0x7f4c940bf660 2023-12-19T19:01:05.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.561+0000 7f4c7b7fe640 1 -- 172.21.15.133:0/3072076970 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4c8400cca0 con 0x7f4c940bf660 2023-12-19T19:01:05.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.561+0000 7f4c7b7fe640 1 --2- 172.21.15.133:0/3072076970 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4c800664a0 0x7f4c80068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:05.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.561+0000 7f4c7b7fe640 1 -- 172.21.15.133:0/3072076970 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4c840841a0 con 0x7f4c940bf660 2023-12-19T19:01:05.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.561+0000 7f4c927fc640 1 --2- 172.21.15.133:0/3072076970 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4c800664a0 0x7f4c80068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:05.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.561+0000 7f4c927fc640 1 --2- 172.21.15.133:0/3072076970 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4c800664a0 0x7f4c80068960 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4c94157c10 tx=0x7f4c88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:05.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.565+0000 7f4c7b7fe640 1 -- 172.21.15.133:0/3072076970 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4c9414c280 con 0x7f4c940bf660 2023-12-19T19:01:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.749+0000 7f4c995df640 1 -- 172.21.15.133:0/3072076970 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c9414c280 con 0x7f4c940bf660 2023-12-19T19:01:05.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.749+0000 7f4c7b7fe640 1 -- 172.21.15.133:0/3072076970 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6194 (secure 0 0 0) 0x7f4c9414c280 con 0x7f4c940bf660 2023-12-19T19:01:05.755 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:05.755 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3200335051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3200335051},{"type":"v1","addr":"172.21.15.133:6833","nonce":3200335051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2114705112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":2114705112},{"type":"v1","addr":"172.21.15.138:6835","nonce":2114705112}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:00:31.342186+0000","modified":"2023-12-19T19:00:34.368238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5763},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5763":{"gid":5763,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6835/1203400706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1203400706},{"type":"v1","addr":"172.21.15.133:6835","nonce":1203400706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:00:49.053498+0000","modified":"2023-12-19T19:00:52.071868+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5258":{"gid":5258,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6837/3661017926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3661017926},{"type":"v1","addr":"172.21.15.138:6837","nonce":3661017926}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T19:01:05.755 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 37 2023-12-19T19:01:05.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.753+0000 7f4c995df640 1 -- 172.21.15.133:0/3072076970 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4c800664a0 msgr2=0x7f4c80068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:05.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.753+0000 7f4c995df640 1 --2- 172.21.15.133:0/3072076970 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4c800664a0 0x7f4c80068960 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4c94157c10 tx=0x7f4c88009040 comp rx=0 tx=0).stop 2023-12-19T19:01:05.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.753+0000 7f4c995df640 1 -- 172.21.15.133:0/3072076970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c940bf660 msgr2=0x7f4c94148fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:05.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.753+0000 7f4c995df640 1 --2- 172.21.15.133:0/3072076970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c940bf660 0x7f4c94148fb0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4c8400e870 tx=0x7f4c8400ec70 comp rx=0 tx=0).stop 2023-12-19T19:01:05.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.753+0000 7f4c995df640 1 -- 172.21.15.133:0/3072076970 shutdown_connections 2023-12-19T19:01:05.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.753+0000 7f4c995df640 1 --2- 172.21.15.133:0/3072076970 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4c800664a0 0x7f4c80068960 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:05.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.753+0000 7f4c995df640 1 --2- 172.21.15.133:0/3072076970 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4c94157f50 0x7f4c941eca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:05.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.753+0000 7f4c995df640 1 --2- 172.21.15.133:0/3072076970 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4c940c50e0 0x7f4c94155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:05.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.753+0000 7f4c995df640 1 --2- 172.21.15.133:0/3072076970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4c940bf660 0x7f4c94148fb0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:05.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.753+0000 7f4c995df640 1 -- 172.21.15.133:0/3072076970 >> 172.21.15.133:0/3072076970 conn(0x7f4c940c6870 msgr2=0x7f4c94150040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:05.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.753+0000 7f4c995df640 1 -- 172.21.15.133:0/3072076970 shutdown_connections 2023-12-19T19:01:05.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.753+0000 7f4c995df640 1 -- 172.21.15.133:0/3072076970 wait complete. 2023-12-19T19:01:05.777 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:01:05.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.909+0000 7f344d29a640 1 Processor -- start 2023-12-19T19:01:05.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.909+0000 7f344d29a640 1 -- start start 2023-12-19T19:01:05.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.913+0000 7f344d29a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f34480a4d30 0x7f34480a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:05.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.913+0000 7f344d29a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f34480c0f70 0x7f34480c1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:05.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.913+0000 7f344d29a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34480c3c00 con 0x7f344806dba0 2023-12-19T19:01:05.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.913+0000 7f344d29a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f344806df80 con 0x7f34480a4d30 2023-12-19T19:01:05.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.913+0000 7f344d29a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34480c0560 con 0x7f34480c0f70 2023-12-19T19:01:05.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.913+0000 7f3446ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f344806dba0 0x7f3448151c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38134/0 (socket says 172.21.15.133:38134) 2023-12-19T19:01:05.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.913+0000 7f3446ffd640 1 -- 172.21.15.133:0/1383144115 learned_addr learned my addr 172.21.15.133:0/1383144115 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:05.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.913+0000 7f343e7fc640 1 --2- 172.21.15.133:0/1383144115 >> v2:172.21.15.133:3300/0 conn(0x7f34480a4d30 0x7f34480a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:05.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.913+0000 7f34467fc640 1 -- 172.21.15.133:0/1383144115 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839657354 0 0) 0x7f34480c3c00 con 0x7f344806dba0 2023-12-19T19:01:05.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.913+0000 7f34477fe640 1 --2- 172.21.15.133:0/1383144115 >> v2:172.21.15.138:3300/0 conn(0x7f34480c0f70 0x7f34480c1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:05.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.913+0000 7f34467fc640 1 -- 172.21.15.133:0/1383144115 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3428005740 con 0x7f344806dba0 2023-12-19T19:01:05.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.913+0000 7f343e7fc640 1 -- 172.21.15.133:0/1383144115 >> v2:172.21.15.138:3300/0 conn(0x7f34480c0f70 msgr2=0x7f34480c1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:05.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.913+0000 7f343e7fc640 1 --2- 172.21.15.133:0/1383144115 >> v2:172.21.15.138:3300/0 conn(0x7f34480c0f70 0x7f34480c1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:05.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.913+0000 7f343e7fc640 1 -- 172.21.15.133:0/1383144115 >> v1:172.21.15.133:6789/0 conn(0x7f344806dba0 legacy=0x7f3448151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:05.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.913+0000 7f343e7fc640 1 -- 172.21.15.133:0/1383144115 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34480c3ee0 con 0x7f34480a4d30 2023-12-19T19:01:05.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.917+0000 7f343e7fc640 1 --2- 172.21.15.133:0/1383144115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34480a4d30 0x7f34480a51e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f34480c23e0 tx=0x7f343001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24df6daefde3064 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:05.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.917+0000 7f34467fc640 1 -- 172.21.15.133:0/1383144115 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34300ab600 con 0x7f34480a4d30 2023-12-19T19:01:05.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.917+0000 7f34467fc640 1 -- 172.21.15.133:0/1383144115 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34300a7050 con 0x7f34480a4d30 2023-12-19T19:01:05.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.917+0000 7f34467fc640 1 -- 172.21.15.133:0/1383144115 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34300ab960 con 0x7f34480a4d30 2023-12-19T19:01:05.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.917+0000 7f344d29a640 1 -- 172.21.15.133:0/1383144115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34480a4d30 msgr2=0x7f34480a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:05.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.917+0000 7f344d29a640 1 --2- 172.21.15.133:0/1383144115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34480a4d30 0x7f34480a51e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f34480c23e0 tx=0x7f343001c3d0 comp rx=0 tx=0).stop 2023-12-19T19:01:05.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.917+0000 7f344d29a640 1 -- 172.21.15.133:0/1383144115 shutdown_connections 2023-12-19T19:01:05.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.917+0000 7f344d29a640 1 --2- 172.21.15.133:0/1383144115 >> v2:172.21.15.138:3300/0 conn(0x7f34480c0f70 0x7f34480c1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:05.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.917+0000 7f344d29a640 1 --2- 172.21.15.133:0/1383144115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34480a4d30 0x7f34480a51e0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:05.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.917+0000 7f344d29a640 1 -- 172.21.15.133:0/1383144115 >> 172.21.15.133:0/1383144115 conn(0x7f34480a7910 msgr2=0x7f34480a7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:05.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.917+0000 7f344d29a640 1 -- 172.21.15.133:0/1383144115 shutdown_connections 2023-12-19T19:01:05.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.917+0000 7f344d29a640 1 -- 172.21.15.133:0/1383144115 wait complete. 2023-12-19T19:01:05.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.917+0000 7f344d29a640 1 Processor -- start 2023-12-19T19:01:05.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.917+0000 7f344d29a640 1 -- start start 2023-12-19T19:01:05.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f344d29a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f344806dba0 0x7f34480bf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:05.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f344d29a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34480a4d30 0x7f34480ab200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f344d29a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34480c0f70 0x7f34481ecb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f344d29a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34480bef90 con 0x7f34480a4d30 2023-12-19T19:01:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f344d29a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34480aba20 con 0x7f34480c0f70 2023-12-19T19:01:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f344d29a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34481443a0 con 0x7f344806dba0 2023-12-19T19:01:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f343e7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34480a4d30 0x7f34480ab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f343e7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34480a4d30 0x7f34480ab200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38482/0 (socket says 172.21.15.133:38482) 2023-12-19T19:01:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f343e7fc640 1 -- 172.21.15.133:0/789204186 learned_addr learned my addr 172.21.15.133:0/789204186 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f3446ffd640 1 --2- 172.21.15.133:0/789204186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f344806dba0 0x7f34480bf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f34477fe640 1 --2- 172.21.15.133:0/789204186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34480c0f70 0x7f34481ecb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f343e7fc640 1 -- 172.21.15.133:0/789204186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f344806dba0 msgr2=0x7f34480bf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f343e7fc640 1 --2- 172.21.15.133:0/789204186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f344806dba0 0x7f34480bf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f343e7fc640 1 -- 172.21.15.133:0/789204186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34480c0f70 msgr2=0x7f34481ecb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f343e7fc640 1 --2- 172.21.15.133:0/789204186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34480c0f70 0x7f34481ecb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:05.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f343e7fc640 1 -- 172.21.15.133:0/789204186 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3430009420 con 0x7f34480a4d30 2023-12-19T19:01:05.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f343e7fc640 1 --2- 172.21.15.133:0/789204186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34480a4d30 0x7f34480ab200 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f3430000c10 tx=0x7f3430019170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:05.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f343ffff640 1 -- 172.21.15.133:0/789204186 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34300b4400 con 0x7f34480a4d30 2023-12-19T19:01:05.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f343ffff640 1 -- 172.21.15.133:0/789204186 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34300b4580 con 0x7f34480a4d30 2023-12-19T19:01:05.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f344d29a640 1 -- 172.21.15.133:0/789204186 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34480bf1a0 con 0x7f34480a4d30 2023-12-19T19:01:05.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f343ffff640 1 -- 172.21.15.133:0/789204186 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34300b4930 con 0x7f34480a4d30 2023-12-19T19:01:05.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f344d29a640 1 -- 172.21.15.133:0/789204186 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34480ab740 con 0x7f34480a4d30 2023-12-19T19:01:05.926 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f344d29a640 1 -- 172.21.15.133:0/789204186 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34480bf6c0 con 0x7f34480a4d30 2023-12-19T19:01:05.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.921+0000 7f343ffff640 1 -- 172.21.15.133:0/789204186 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f34300b2040 con 0x7f34480a4d30 2023-12-19T19:01:05.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.925+0000 7f343ffff640 1 --2- 172.21.15.133:0/789204186 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f342c066470 0x7f342c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:05.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.925+0000 7f343ffff640 1 -- 172.21.15.133:0/789204186 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f343011dff0 con 0x7f34480a4d30 2023-12-19T19:01:05.927 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.925+0000 7f3446ffd640 1 --2- 172.21.15.133:0/789204186 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f342c066470 0x7f342c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:05.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.925+0000 7f3446ffd640 1 --2- 172.21.15.133:0/789204186 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f342c066470 0x7f342c068930 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3438007fd0 tx=0x7f3438009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:05.931 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:05.929+0000 7f343ffff640 1 -- 172.21.15.133:0/789204186 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f34480bf6c0 con 0x7f34480a4d30 2023-12-19T19:01:06.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.077+0000 7f344d29a640 1 -- 172.21.15.133:0/789204186 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34480bf6c0 con 0x7f34480a4d30 2023-12-19T19:01:06.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.077+0000 7f343ffff640 1 -- 172.21.15.133:0/789204186 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20316 (secure 0 0 0) 0x7f34480bf6c0 con 0x7f34480a4d30 2023-12-19T19:01:06.082 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:06.082 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":54,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:00:50.680936+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:00:29.085029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T19:00:30.359577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:00:46.784805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:00:48.051355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:01:06.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.081+0000 7f344d29a640 1 -- 172.21.15.133:0/789204186 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f342c066470 msgr2=0x7f342c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:06.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.081+0000 7f344d29a640 1 --2- 172.21.15.133:0/789204186 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f342c066470 0x7f342c068930 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f3438007fd0 tx=0x7f3438009040 comp rx=0 tx=0).stop 2023-12-19T19:01:06.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.081+0000 7f344d29a640 1 -- 172.21.15.133:0/789204186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34480a4d30 msgr2=0x7f34480ab200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:06.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.081+0000 7f344d29a640 1 --2- 172.21.15.133:0/789204186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34480a4d30 0x7f34480ab200 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f3430000c10 tx=0x7f3430019170 comp rx=0 tx=0).stop 2023-12-19T19:01:06.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.081+0000 7f344d29a640 1 -- 172.21.15.133:0/789204186 shutdown_connections 2023-12-19T19:01:06.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.081+0000 7f344d29a640 1 --2- 172.21.15.133:0/789204186 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f342c066470 0x7f342c068930 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.081+0000 7f344d29a640 1 --2- 172.21.15.133:0/789204186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34480c0f70 0x7f34481ecb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.081+0000 7f344d29a640 1 --2- 172.21.15.133:0/789204186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34480a4d30 0x7f34480ab200 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.081+0000 7f344d29a640 1 --2- 172.21.15.133:0/789204186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f344806dba0 0x7f34480bf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.081+0000 7f344d29a640 1 -- 172.21.15.133:0/789204186 >> 172.21.15.133:0/789204186 conn(0x7f34480a7910 msgr2=0x7f344806c700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:06.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.081+0000 7f344d29a640 1 -- 172.21.15.133:0/789204186 shutdown_connections 2023-12-19T19:01:06.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.081+0000 7f344d29a640 1 -- 172.21.15.133:0/789204186 wait complete. 2023-12-19T19:01:06.103 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T19:00:29.085029+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '49', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T19:00:30.359577+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-19T19:00:46.784805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-19T19:00:48.051355+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T19:01:06.104 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T19:01:06.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9b529a640 1 Processor -- start 2023-12-19T19:01:06.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9b529a640 1 -- start start 2023-12-19T19:01:06.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9b529a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa9b0151dc0 0x7fa9b00c4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:06.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9b529a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9b00bd660 0x7fa9b0154d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:06.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9b529a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b00ac4f0 con 0x7fa9b00c7ed0 2023-12-19T19:01:06.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9b529a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b0158780 con 0x7fa9b0151dc0 2023-12-19T19:01:06.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9b529a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b0158a60 con 0x7fa9b00bd660 2023-12-19T19:01:06.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9ae7fc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa9b00c7ed0 0x7fa9b0154650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38138/0 (socket says 172.21.15.133:38138) 2023-12-19T19:01:06.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9ae7fc640 1 -- 172.21.15.133:0/1864869595 learned_addr learned my addr 172.21.15.133:0/1864869595 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:06.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9aeffd640 1 --2- 172.21.15.133:0/1864869595 >> v2:172.21.15.138:3300/0 conn(0x7fa9b0151dc0 0x7fa9b00c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:06.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9af7fe640 1 --2- 172.21.15.133:0/1864869595 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9b00bd660 0x7fa9b0154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:06.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9adffb640 1 -- 172.21.15.133:0/1864869595 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3989564436 0 0) 0x7fa9b00ac4f0 con 0x7fa9b00c7ed0 2023-12-19T19:01:06.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9adffb640 1 -- 172.21.15.133:0/1864869595 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa998003530 con 0x7fa9b00c7ed0 2023-12-19T19:01:06.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9adffb640 1 -- 172.21.15.133:0/1864869595 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 424938679 0 0) 0x7fa998003530 con 0x7fa9b00c7ed0 2023-12-19T19:01:06.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9adffb640 1 -- 172.21.15.133:0/1864869595 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9b00bd660 msgr2=0x7fa9b0154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:06.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9adffb640 1 --2- 172.21.15.133:0/1864869595 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9b00bd660 0x7fa9b0154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9adffb640 1 -- 172.21.15.133:0/1864869595 >> v2:172.21.15.138:3300/0 conn(0x7fa9b0151dc0 msgr2=0x7fa9b00c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:06.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9adffb640 1 --2- 172.21.15.133:0/1864869595 >> v2:172.21.15.138:3300/0 conn(0x7fa9b0151dc0 0x7fa9b00c4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9adffb640 1 -- 172.21.15.133:0/1864869595 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b00ac180 con 0x7fa9b00c7ed0 2023-12-19T19:01:06.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9adffb640 1 -- 172.21.15.133:0/1864869595 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7fa9a4001680 con 0x7fa9b00c7ed0 2023-12-19T19:01:06.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9adffb640 1 -- 172.21.15.133:0/1864869595 >> v1:172.21.15.133:6789/0 conn(0x7fa9b00c7ed0 legacy=0x7fa9b0154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:06.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9adffb640 1 --2- 172.21.15.133:0/1864869595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa998003980 0x7fa998003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:06.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9adffb640 1 --2- 172.21.15.133:0/1864869595 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9b00bd660 0x7fa9980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:06.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9adffb640 1 --2- 172.21.15.133:0/1864869595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa998004d10 0x7fa998005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:06.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9adffb640 1 -- 172.21.15.133:0/1864869595 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b0158780 con 0x7fa998003980 2023-12-19T19:01:06.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9adffb640 1 -- 172.21.15.133:0/1864869595 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b0158a60 con 0x7fa998004d10 2023-12-19T19:01:06.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9adffb640 1 -- 172.21.15.133:0/1864869595 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99800ba10 con 0x7fa9b00bd660 2023-12-19T19:01:06.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9aeffd640 1 --2- 172.21.15.133:0/1864869595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa998003980 0x7fa998003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:06.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9ae7fc640 1 --2- 172.21.15.133:0/1864869595 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9b00bd660 0x7fa9980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:06.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9af7fe640 1 --2- 172.21.15.133:0/1864869595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa998004d10 0x7fa998005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:06.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9aeffd640 1 -- 172.21.15.133:0/1864869595 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9b00bd660 msgr2=0x7fa9980047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:06.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9aeffd640 1 --2- 172.21.15.133:0/1864869595 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa9b00bd660 0x7fa9980047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9aeffd640 1 -- 172.21.15.133:0/1864869595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa998004d10 msgr2=0x7fa998005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:06.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9aeffd640 1 --2- 172.21.15.133:0/1864869595 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa998004d10 0x7fa998005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.241+0000 7fa9aeffd640 1 -- 172.21.15.133:0/1864869595 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa998003530 con 0x7fa998003980 2023-12-19T19:01:06.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.245+0000 7fa9aeffd640 1 --2- 172.21.15.133:0/1864869595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa998003980 0x7fa998003da0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009ae0 tx=0x7fa9a001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f746405bed417e5f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:06.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.245+0000 7fa9adffb640 1 -- 172.21.15.133:0/1864869595 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a00a6490 con 0x7fa998003980 2023-12-19T19:01:06.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.245+0000 7fa9adffb640 1 -- 172.21.15.133:0/1864869595 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a00a65f0 con 0x7fa998003980 2023-12-19T19:01:06.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.245+0000 7fa9adffb640 1 -- 172.21.15.133:0/1864869595 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a00a69a0 con 0x7fa998003980 2023-12-19T19:01:06.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.245+0000 7fa9b529a640 1 -- 172.21.15.133:0/1864869595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa998003980 msgr2=0x7fa998003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:06.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.245+0000 7fa9b529a640 1 --2- 172.21.15.133:0/1864869595 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa998003980 0x7fa998003da0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009ae0 tx=0x7fa9a001ca90 comp rx=0 tx=0).stop 2023-12-19T19:01:06.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.245+0000 7fa9af7fe640 1 -- 172.21.15.133:0/1864869595 reap_dead start 2023-12-19T19:01:06.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.245+0000 7fa9b529a640 1 -- 172.21.15.133:0/1864869595 shutdown_connections 2023-12-19T19:01:06.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.245+0000 7fa9b529a640 1 -- 172.21.15.133:0/1864869595 >> 172.21.15.133:0/1864869595 conn(0x7fa9b0071eb0 msgr2=0x7fa9b00722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:06.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.245+0000 7fa9b529a640 1 -- 172.21.15.133:0/1864869595 shutdown_connections 2023-12-19T19:01:06.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.245+0000 7fa9b529a640 1 -- 172.21.15.133:0/1864869595 wait complete. 2023-12-19T19:01:06.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.249+0000 7fa9b529a640 1 Processor -- start 2023-12-19T19:01:06.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.249+0000 7fa9b529a640 1 -- start start 2023-12-19T19:01:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.249+0000 7fa9b529a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa998003980 0x7fa9b015ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.249+0000 7fa9b529a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9b01f0a80 0x7fa9b01539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.249+0000 7fa9b529a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9b0159d00 0x7fa9b00bfe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.249+0000 7fa9b529a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b014eba0 con 0x7fa9b0159d00 2023-12-19T19:01:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.249+0000 7fa9b529a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b015a470 con 0x7fa9b01f0a80 2023-12-19T19:01:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.249+0000 7fa9b529a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b015a190 con 0x7fa998003980 2023-12-19T19:01:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.249+0000 7fa9af7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9b0159d00 0x7fa9b00bfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.249+0000 7fa9af7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9b0159d00 0x7fa9b00bfe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38510/0 (socket says 172.21.15.133:38510) 2023-12-19T19:01:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.249+0000 7fa9af7fe640 1 -- 172.21.15.133:0/1964690187 learned_addr learned my addr 172.21.15.133:0/1964690187 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.249+0000 7fa9af7fe640 1 -- 172.21.15.133:0/1964690187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa998003980 msgr2=0x7fa9b015ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.249+0000 7fa9af7fe640 1 --2- 172.21.15.133:0/1964690187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa998003980 0x7fa9b015ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.249+0000 7fa9af7fe640 1 -- 172.21.15.133:0/1964690187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9b01f0a80 msgr2=0x7fa9b01539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:06.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.249+0000 7fa9af7fe640 1 --2- 172.21.15.133:0/1964690187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9b01f0a80 0x7fa9b01539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.249+0000 7fa9af7fe640 1 -- 172.21.15.133:0/1964690187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b00bf110 con 0x7fa9b0159d00 2023-12-19T19:01:06.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.249+0000 7fa9af7fe640 1 --2- 172.21.15.133:0/1964690187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9b0159d00 0x7fa9b00bfe00 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00c7ab0 tx=0x7fa9a800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:06.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.249+0000 7fa9977fe640 1 -- 172.21.15.133:0/1964690187 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a800e040 con 0x7fa9b0159d00 2023-12-19T19:01:06.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.249+0000 7fa9977fe640 1 -- 172.21.15.133:0/1964690187 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a800f040 con 0x7fa9b0159d00 2023-12-19T19:01:06.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.249+0000 7fa9977fe640 1 -- 172.21.15.133:0/1964690187 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8015430 con 0x7fa9b0159d00 2023-12-19T19:01:06.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.249+0000 7fa9b529a640 1 -- 172.21.15.133:0/1964690187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b00bf3f0 con 0x7fa9b0159d00 2023-12-19T19:01:06.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.249+0000 7fa9b529a640 1 -- 172.21.15.133:0/1964690187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b0153f00 con 0x7fa9b0159d00 2023-12-19T19:01:06.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.253+0000 7fa9b529a640 1 -- 172.21.15.133:0/1964690187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b0068400 con 0x7fa9b0159d00 2023-12-19T19:01:06.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.253+0000 7fa9977fe640 1 -- 172.21.15.133:0/1964690187 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa9a8015590 con 0x7fa9b0159d00 2023-12-19T19:01:06.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.253+0000 7fa9977fe640 1 --2- 172.21.15.133:0/1964690187 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa99c066470 0x7fa99c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:06.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.253+0000 7fa9977fe640 1 -- 172.21.15.133:0/1964690187 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa9a8084960 con 0x7fa9b0159d00 2023-12-19T19:01:06.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.253+0000 7fa9aeffd640 1 --2- 172.21.15.133:0/1964690187 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa99c066470 0x7fa99c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:06.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.253+0000 7fa9aeffd640 1 --2- 172.21.15.133:0/1964690187 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa99c066470 0x7fa99c068930 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00ad000 tx=0x7fa9a0004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:06.261 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.257+0000 7fa9977fe640 1 -- 172.21.15.133:0/1964690187 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa9a8051a70 con 0x7fa9b0159d00 2023-12-19T19:01:06.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.409+0000 7fa9b529a640 1 -- 172.21.15.133:0/1964690187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa9b006c9a0 con 0x7fa9b0159d00 2023-12-19T19:01:06.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.409+0000 7fa9977fe640 1 -- 172.21.15.133:0/1964690187 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa9a8055090 con 0x7fa9b0159d00 2023-12-19T19:01:06.413 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T19:01:06.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.409+0000 7fa9b529a640 1 -- 172.21.15.133:0/1964690187 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa99c066470 msgr2=0x7fa99c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:06.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.409+0000 7fa9b529a640 1 --2- 172.21.15.133:0/1964690187 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa99c066470 0x7fa99c068930 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa9a00ad000 tx=0x7fa9a0004740 comp rx=0 tx=0).stop 2023-12-19T19:01:06.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.409+0000 7fa9b529a640 1 -- 172.21.15.133:0/1964690187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9b0159d00 msgr2=0x7fa9b00bfe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:06.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.409+0000 7fa9b529a640 1 --2- 172.21.15.133:0/1964690187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9b0159d00 0x7fa9b00bfe00 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fa9b00c7ab0 tx=0x7fa9a800f580 comp rx=0 tx=0).stop 2023-12-19T19:01:06.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.409+0000 7fa9b529a640 1 -- 172.21.15.133:0/1964690187 shutdown_connections 2023-12-19T19:01:06.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.409+0000 7fa9b529a640 1 --2- 172.21.15.133:0/1964690187 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa99c066470 0x7fa99c068930 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.409+0000 7fa9b529a640 1 --2- 172.21.15.133:0/1964690187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa9b0159d00 0x7fa9b00bfe00 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.409+0000 7fa9b529a640 1 --2- 172.21.15.133:0/1964690187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa9b01f0a80 0x7fa9b01539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.409+0000 7fa9b529a640 1 --2- 172.21.15.133:0/1964690187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa998003980 0x7fa9b015ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.409+0000 7fa9b529a640 1 -- 172.21.15.133:0/1964690187 >> 172.21.15.133:0/1964690187 conn(0x7fa9b0071eb0 msgr2=0x7fa9b015c810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:06.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.409+0000 7fa9b529a640 1 -- 172.21.15.133:0/1964690187 shutdown_connections 2023-12-19T19:01:06.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.413+0000 7fa9b529a640 1 -- 172.21.15.133:0/1964690187 wait complete. 2023-12-19T19:01:06.434 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T19:01:06.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.569+0000 7fcd39157640 1 Processor -- start 2023-12-19T19:01:06.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.569+0000 7fcd39157640 1 -- start start 2023-12-19T19:01:06.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.569+0000 7fcd39157640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcd340c4100 0x7fcd340c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:06.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.569+0000 7fcd39157640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd340c06d0 0x7fcd340a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:06.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.569+0000 7fcd39157640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd340c31c0 con 0x7fcd340c63c0 2023-12-19T19:01:06.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.569+0000 7fcd39157640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd340c34a0 con 0x7fcd340c4100 2023-12-19T19:01:06.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.569+0000 7fcd39157640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd340c1030 con 0x7fcd340c06d0 2023-12-19T19:01:06.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.573+0000 7fcd3359e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd340c06d0 0x7fcd340a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:06.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.573+0000 7fcd2bfff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcd340c4100 0x7fcd340c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:06.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.573+0000 7fcd3359e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd340c06d0 0x7fcd340a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:50024/0 (socket says 172.21.15.133:50024) 2023-12-19T19:01:06.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.573+0000 7fcd2bfff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcd340c4100 0x7fcd340c2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:45222/0 (socket says 172.21.15.133:45222) 2023-12-19T19:01:06.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.573+0000 7fcd3359e640 1 -- 172.21.15.133:0/1436624092 learned_addr learned my addr 172.21.15.133:0/1436624092 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:06.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.573+0000 7fcd3359e640 1 -- 172.21.15.133:0/1436624092 >> v2:172.21.15.138:3300/0 conn(0x7fcd340c4100 msgr2=0x7fcd340c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:06.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.573+0000 7fcd3359e640 1 --2- 172.21.15.133:0/1436624092 >> v2:172.21.15.138:3300/0 conn(0x7fcd340c4100 0x7fcd340c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.573+0000 7fcd3359e640 1 -- 172.21.15.133:0/1436624092 >> v1:172.21.15.138:6789/0 conn(0x7fcd340c63c0 legacy=0x7fcd340c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:06.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.573+0000 7fcd3359e640 1 -- 172.21.15.133:0/1436624092 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd340c1310 con 0x7fcd340c06d0 2023-12-19T19:01:06.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.573+0000 7fcd3359e640 1 --2- 172.21.15.133:0/1436624092 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd340c06d0 0x7fcd340a9680 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009e50 tx=0x7fcd2c01eb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c13df5189070993 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:06.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.573+0000 7fcd3259c640 1 -- 172.21.15.133:0/1436624092 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd340aa3d0 con 0x7fcd340c06d0 2023-12-19T19:01:06.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.573+0000 7fcd3259c640 1 -- 172.21.15.133:0/1436624092 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2c0a78e0 con 0x7fcd340c06d0 2023-12-19T19:01:06.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.573+0000 7fcd3259c640 1 -- 172.21.15.133:0/1436624092 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c0a7c70 con 0x7fcd340c06d0 2023-12-19T19:01:06.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.577+0000 7fcd39157640 1 -- 172.21.15.133:0/1436624092 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd340c06d0 msgr2=0x7fcd340a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:06.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.577+0000 7fcd39157640 1 --2- 172.21.15.133:0/1436624092 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd340c06d0 0x7fcd340a9680 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c009e50 tx=0x7fcd2c01eb00 comp rx=0 tx=0).stop 2023-12-19T19:01:06.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.577+0000 7fcd39157640 1 -- 172.21.15.133:0/1436624092 shutdown_connections 2023-12-19T19:01:06.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.577+0000 7fcd39157640 1 --2- 172.21.15.133:0/1436624092 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd340c06d0 0x7fcd340a9680 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.577+0000 7fcd39157640 1 --2- 172.21.15.133:0/1436624092 >> v2:172.21.15.138:3300/0 conn(0x7fcd340c4100 0x7fcd340c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.577+0000 7fcd39157640 1 -- 172.21.15.133:0/1436624092 >> 172.21.15.133:0/1436624092 conn(0x7fcd3406a5b0 msgr2=0x7fcd3406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:06.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.577+0000 7fcd39157640 1 -- 172.21.15.133:0/1436624092 shutdown_connections 2023-12-19T19:01:06.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.577+0000 7fcd39157640 1 -- 172.21.15.133:0/1436624092 wait complete. 2023-12-19T19:01:06.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.577+0000 7fcd39157640 1 Processor -- start 2023-12-19T19:01:06.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.577+0000 7fcd39157640 1 -- start start 2023-12-19T19:01:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.577+0000 7fcd39157640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd340c06d0 0x7fcd340a46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.577+0000 7fcd39157640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd340c4100 0x7fcd341594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.577+0000 7fcd39157640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd340c63c0 0x7fcd34159a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.577+0000 7fcd39157640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd341550e0 con 0x7fcd340c4100 2023-12-19T19:01:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.577+0000 7fcd39157640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd340bfdb0 con 0x7fcd340c06d0 2023-12-19T19:01:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.577+0000 7fcd39157640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd34159040 con 0x7fcd340c63c0 2023-12-19T19:01:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.577+0000 7fcd2bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd340c4100 0x7fcd341594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.577+0000 7fcd2bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd340c4100 0x7fcd341594d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38514/0 (socket says 172.21.15.133:38514) 2023-12-19T19:01:06.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.577+0000 7fcd2bfff640 1 -- 172.21.15.133:0/3001315444 learned_addr learned my addr 172.21.15.133:0/3001315444 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:06.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.577+0000 7fcd3359e640 1 --2- 172.21.15.133:0/3001315444 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd340c63c0 0x7fcd34159a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:06.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.577+0000 7fcd32d9d640 1 --2- 172.21.15.133:0/3001315444 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd340c06d0 0x7fcd340a46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:06.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.581+0000 7fcd2bfff640 1 -- 172.21.15.133:0/3001315444 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd340c63c0 msgr2=0x7fcd34159a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:06.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.581+0000 7fcd2bfff640 1 --2- 172.21.15.133:0/3001315444 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd340c63c0 0x7fcd34159a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.581+0000 7fcd2bfff640 1 -- 172.21.15.133:0/3001315444 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd340c06d0 msgr2=0x7fcd340a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:06.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.581+0000 7fcd2bfff640 1 --2- 172.21.15.133:0/3001315444 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd340c06d0 0x7fcd340a46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.581+0000 7fcd2bfff640 1 -- 172.21.15.133:0/3001315444 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c009b30 con 0x7fcd340c4100 2023-12-19T19:01:06.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.581+0000 7fcd32d9d640 1 --2- 172.21.15.133:0/3001315444 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd340c06d0 0x7fcd340a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:06.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.581+0000 7fcd2bfff640 1 --2- 172.21.15.133:0/3001315444 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd340c4100 0x7fcd341594d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00e930 tx=0x7fcd1c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:06.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.581+0000 7fcd2b7fe640 1 -- 172.21.15.133:0/3001315444 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c009690 con 0x7fcd340c4100 2023-12-19T19:01:06.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.581+0000 7fcd2b7fe640 1 -- 172.21.15.133:0/3001315444 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1c00ca00 con 0x7fcd340c4100 2023-12-19T19:01:06.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.581+0000 7fcd39157640 1 -- 172.21.15.133:0/3001315444 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd340bffe0 con 0x7fcd340c4100 2023-12-19T19:01:06.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.581+0000 7fcd2b7fe640 1 -- 172.21.15.133:0/3001315444 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1c00cd90 con 0x7fcd340c4100 2023-12-19T19:01:06.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.581+0000 7fcd39157640 1 -- 172.21.15.133:0/3001315444 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd340a6960 con 0x7fcd340c4100 2023-12-19T19:01:06.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.581+0000 7fcd39157640 1 -- 172.21.15.133:0/3001315444 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd340c0500 con 0x7fcd340c4100 2023-12-19T19:01:06.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.581+0000 7fcd2b7fe640 1 -- 172.21.15.133:0/3001315444 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fcd1c013470 con 0x7fcd340c4100 2023-12-19T19:01:06.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.585+0000 7fcd2b7fe640 1 --2- 172.21.15.133:0/3001315444 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd14066470 0x7fcd14068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:06.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.585+0000 7fcd2b7fe640 1 -- 172.21.15.133:0/3001315444 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcd1c084320 con 0x7fcd340c4100 2023-12-19T19:01:06.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.585+0000 7fcd32d9d640 1 --2- 172.21.15.133:0/3001315444 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd14066470 0x7fcd14068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:06.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.585+0000 7fcd32d9d640 1 --2- 172.21.15.133:0/3001315444 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd14066470 0x7fcd14068930 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcd24000f70 tx=0x7fcd24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:06.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.589+0000 7fcd2b7fe640 1 -- 172.21.15.133:0/3001315444 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fcd340c0500 con 0x7fcd340c4100 2023-12-19T19:01:06.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.741+0000 7fcd39157640 1 -- 172.21.15.133:0/3001315444 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd340c0500 con 0x7fcd340c4100 2023-12-19T19:01:06.744 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.741+0000 7fcd2b7fe640 1 -- 172.21.15.133:0/3001315444 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd340c0500 con 0x7fcd340c4100 2023-12-19T19:01:06.744 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:01:06.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.741+0000 7fcd39157640 1 -- 172.21.15.133:0/3001315444 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd14066470 msgr2=0x7fcd14068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:06.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.741+0000 7fcd39157640 1 --2- 172.21.15.133:0/3001315444 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd14066470 0x7fcd14068930 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcd24000f70 tx=0x7fcd24009040 comp rx=0 tx=0).stop 2023-12-19T19:01:06.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.741+0000 7fcd39157640 1 -- 172.21.15.133:0/3001315444 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd340c4100 msgr2=0x7fcd341594d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:06.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.741+0000 7fcd39157640 1 --2- 172.21.15.133:0/3001315444 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd340c4100 0x7fcd341594d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c00e930 tx=0x7fcd1c00edf0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.741+0000 7fcd39157640 1 -- 172.21.15.133:0/3001315444 shutdown_connections 2023-12-19T19:01:06.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.741+0000 7fcd39157640 1 --2- 172.21.15.133:0/3001315444 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcd14066470 0x7fcd14068930 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.741+0000 7fcd39157640 1 --2- 172.21.15.133:0/3001315444 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcd340c63c0 0x7fcd34159a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.741+0000 7fcd39157640 1 --2- 172.21.15.133:0/3001315444 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd340c4100 0x7fcd341594d0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.741+0000 7fcd39157640 1 --2- 172.21.15.133:0/3001315444 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcd340c06d0 0x7fcd340a46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.741+0000 7fcd39157640 1 -- 172.21.15.133:0/3001315444 >> 172.21.15.133:0/3001315444 conn(0x7fcd3406a5b0 msgr2=0x7fcd3406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:06.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.741+0000 7fcd39157640 1 -- 172.21.15.133:0/3001315444 shutdown_connections 2023-12-19T19:01:06.747 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.741+0000 7fcd39157640 1 -- 172.21.15.133:0/3001315444 wait complete. 2023-12-19T19:01:06.765 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T19:01:06.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.905+0000 7f2e91357640 1 Processor -- start 2023-12-19T19:01:06.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.905+0000 7f2e91357640 1 -- start start 2023-12-19T19:01:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.905+0000 7f2e91357640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2e8c151e90 0x7f2e8c0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.905+0000 7f2e91357640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e8c0c4e60 0x7f2e8c06bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.905+0000 7f2e91357640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e8c06c860 con 0x7f2e8c0c7ea0 2023-12-19T19:01:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.905+0000 7f2e91357640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e8c0c8750 con 0x7f2e8c151e90 2023-12-19T19:01:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.905+0000 7f2e91357640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c1552d0 con 0x7f2e8c0c4e60 2023-12-19T19:01:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.905+0000 7f2e8affd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2e8c151e90 0x7f2e8c0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:06.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.905+0000 7f2e8affd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2e8c151e90 0x7f2e8c0c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38526/0 (socket says 172.21.15.133:38526) 2023-12-19T19:01:06.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.905+0000 7f2e8affd640 1 -- 172.21.15.133:0/2634984852 learned_addr learned my addr 172.21.15.133:0/2634984852 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:06.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.905+0000 7f2e8affd640 1 -- 172.21.15.133:0/2634984852 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e8c0c4e60 msgr2=0x7f2e8c06bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:06.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.905+0000 7f2e8b7fe640 1 --2- 172.21.15.133:0/2634984852 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e8c0c4e60 0x7f2e8c06bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:06.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.905+0000 7f2e8affd640 1 --2- 172.21.15.133:0/2634984852 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e8c0c4e60 0x7f2e8c06bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.905+0000 7f2e8affd640 1 -- 172.21.15.133:0/2634984852 >> v1:172.21.15.138:6789/0 conn(0x7f2e8c0c7ea0 legacy=0x7f2e8c06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:06.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.905+0000 7f2e8affd640 1 -- 172.21.15.133:0/2634984852 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c154930 con 0x7f2e8c151e90 2023-12-19T19:01:06.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.905+0000 7f2e8b7fe640 1 --2- 172.21.15.133:0/2634984852 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e8c0c4e60 0x7f2e8c06bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:06.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.909+0000 7f2e8affd640 1 --2- 172.21.15.133:0/2634984852 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e8c151e90 0x7f2e8c0c4920 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009870 tx=0x7f2e7c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606f8374f082cbb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:06.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.909+0000 7f2e89ffb640 1 -- 172.21.15.133:0/2634984852 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c0ab600 con 0x7f2e8c151e90 2023-12-19T19:01:06.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.909+0000 7f2e89ffb640 1 -- 172.21.15.133:0/2634984852 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7c0a7050 con 0x7f2e8c151e90 2023-12-19T19:01:06.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.909+0000 7f2e89ffb640 1 -- 172.21.15.133:0/2634984852 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c0ab980 con 0x7f2e8c151e90 2023-12-19T19:01:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.909+0000 7f2e91357640 1 -- 172.21.15.133:0/2634984852 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e8c151e90 msgr2=0x7f2e8c0c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.909+0000 7f2e91357640 1 --2- 172.21.15.133:0/2634984852 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e8c151e90 0x7f2e8c0c4920 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c009870 tx=0x7f2e7c01c3e0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.909+0000 7f2e91357640 1 -- 172.21.15.133:0/2634984852 shutdown_connections 2023-12-19T19:01:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.909+0000 7f2e91357640 1 --2- 172.21.15.133:0/2634984852 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e8c0c4e60 0x7f2e8c06bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.909+0000 7f2e91357640 1 --2- 172.21.15.133:0/2634984852 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e8c151e90 0x7f2e8c0c4920 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.909+0000 7f2e91357640 1 -- 172.21.15.133:0/2634984852 >> 172.21.15.133:0/2634984852 conn(0x7f2e8c0ca170 msgr2=0x7f2e8c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:06.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.909+0000 7f2e91357640 1 -- 172.21.15.133:0/2634984852 shutdown_connections 2023-12-19T19:01:06.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.909+0000 7f2e91357640 1 -- 172.21.15.133:0/2634984852 wait complete. 2023-12-19T19:01:06.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e91357640 1 Processor -- start 2023-12-19T19:01:06.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e91357640 1 -- start start 2023-12-19T19:01:06.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e91357640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e8c0c4e60 0x7f2e8c1f0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:06.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e91357640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e8c0c7ea0 0x7f2e8c1536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:06.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e91357640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e8c151e90 0x7f2e8c1431b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:06.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e91357640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c1f0960 con 0x7f2e8c151e90 2023-12-19T19:01:06.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e91357640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c1f0c40 con 0x7f2e8c0c4e60 2023-12-19T19:01:06.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e91357640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c1f0f20 con 0x7f2e8c0c7ea0 2023-12-19T19:01:06.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e8affd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e8c0c4e60 0x7f2e8c1f0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:06.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e8b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e8c151e90 0x7f2e8c1431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e8a7fc640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e8c0c7ea0 0x7f2e8c1536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e8affd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e8c0c4e60 0x7f2e8c1f0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:45234/0 (socket says 172.21.15.133:45234) 2023-12-19T19:01:06.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e8affd640 1 -- 172.21.15.133:0/83590070 learned_addr learned my addr 172.21.15.133:0/83590070 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e8affd640 1 -- 172.21.15.133:0/83590070 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e8c0c7ea0 msgr2=0x7f2e8c1536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e8affd640 1 --2- 172.21.15.133:0/83590070 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e8c0c7ea0 0x7f2e8c1536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e8affd640 1 -- 172.21.15.133:0/83590070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e8c151e90 msgr2=0x7f2e8c1431b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e8affd640 1 --2- 172.21.15.133:0/83590070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e8c151e90 0x7f2e8c1431b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e8affd640 1 -- 172.21.15.133:0/83590070 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7c0094d0 con 0x7f2e8c0c4e60 2023-12-19T19:01:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e8b7fe640 1 --2- 172.21.15.133:0/83590070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e8c151e90 0x7f2e8c1431b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:01:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e8affd640 1 --2- 172.21.15.133:0/83590070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e8c0c4e60 0x7f2e8c1f0380 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c0ae040 tx=0x7f2e7c01ac20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e737fe640 1 -- 172.21.15.133:0/83590070 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c0b6620 con 0x7f2e8c0c4e60 2023-12-19T19:01:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e737fe640 1 -- 172.21.15.133:0/83590070 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7c0b67a0 con 0x7f2e8c0c4e60 2023-12-19T19:01:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e737fe640 1 -- 172.21.15.133:0/83590070 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c0b6b50 con 0x7f2e8c0c4e60 2023-12-19T19:01:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e91357640 1 -- 172.21.15.133:0/83590070 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e8c1f1200 con 0x7f2e8c0c4e60 2023-12-19T19:01:06.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.913+0000 7f2e91357640 1 -- 172.21.15.133:0/83590070 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e8c0c0d60 con 0x7f2e8c0c4e60 2023-12-19T19:01:06.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.917+0000 7f2e91357640 1 -- 172.21.15.133:0/83590070 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e8c0c7b50 con 0x7f2e8c0c4e60 2023-12-19T19:01:06.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.917+0000 7f2e737fe640 1 -- 172.21.15.133:0/83590070 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2e7c0b2040 con 0x7f2e8c0c4e60 2023-12-19T19:01:06.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.917+0000 7f2e737fe640 1 --2- 172.21.15.133:0/83590070 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2e780664a0 0x7f2e78068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:06.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.917+0000 7f2e737fe640 1 -- 172.21.15.133:0/83590070 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2e7c11eb50 con 0x7f2e8c0c4e60 2023-12-19T19:01:06.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.917+0000 7f2e8a7fc640 1 --2- 172.21.15.133:0/83590070 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2e780664a0 0x7f2e78068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:06.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.917+0000 7f2e8a7fc640 1 --2- 172.21.15.133:0/83590070 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2e780664a0 0x7f2e78068960 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c1eac50 tx=0x7f2e80009060 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:06.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:06.921+0000 7f2e737fe640 1 -- 172.21.15.133:0/83590070 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2e7c0ebd00 con 0x7f2e8c0c4e60 2023-12-19T19:01:07.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.073+0000 7f2e91357640 1 -- 172.21.15.133:0/83590070 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2e8c1f0d80 con 0x7f2e8c0c4e60 2023-12-19T19:01:07.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.073+0000 7f2e737fe640 1 -- 172.21.15.133:0/83590070 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2e8c1f0d80 con 0x7f2e8c0c4e60 2023-12-19T19:01:07.079 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:01:07.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.077+0000 7f2e91357640 1 -- 172.21.15.133:0/83590070 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2e780664a0 msgr2=0x7f2e78068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:07.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.077+0000 7f2e91357640 1 --2- 172.21.15.133:0/83590070 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2e780664a0 0x7f2e78068960 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c1eac50 tx=0x7f2e80009060 comp rx=0 tx=0).stop 2023-12-19T19:01:07.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.077+0000 7f2e91357640 1 -- 172.21.15.133:0/83590070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e8c0c4e60 msgr2=0x7f2e8c1f0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:07.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.077+0000 7f2e91357640 1 --2- 172.21.15.133:0/83590070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e8c0c4e60 0x7f2e8c1f0380 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f2e7c0ae040 tx=0x7f2e7c01ac20 comp rx=0 tx=0).stop 2023-12-19T19:01:07.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.077+0000 7f2e91357640 1 -- 172.21.15.133:0/83590070 shutdown_connections 2023-12-19T19:01:07.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.077+0000 7f2e91357640 1 --2- 172.21.15.133:0/83590070 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2e780664a0 0x7f2e78068960 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.077+0000 7f2e91357640 1 --2- 172.21.15.133:0/83590070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e8c151e90 0x7f2e8c1431b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.077+0000 7f2e91357640 1 --2- 172.21.15.133:0/83590070 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e8c0c7ea0 0x7f2e8c1536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.077+0000 7f2e91357640 1 --2- 172.21.15.133:0/83590070 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e8c0c4e60 0x7f2e8c1f0380 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.077+0000 7f2e91357640 1 -- 172.21.15.133:0/83590070 >> 172.21.15.133:0/83590070 conn(0x7f2e8c0ca170 msgr2=0x7f2e8c06b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:07.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.077+0000 7f2e91357640 1 -- 172.21.15.133:0/83590070 shutdown_connections 2023-12-19T19:01:07.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.077+0000 7f2e91357640 1 -- 172.21.15.133:0/83590070 wait complete. 2023-12-19T19:01:07.100 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-19T19:01:07.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.237+0000 7f42884dd640 1 Processor -- start 2023-12-19T19:01:07.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.237+0000 7f42884dd640 1 -- start start 2023-12-19T19:01:07.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.237+0000 7f42884dd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f428014b010 0x7f42800bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:07.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.237+0000 7f42884dd640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4280073a70 0x7f428006b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:07.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.237+0000 7f42884dd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f428006b540 0x7f4280157c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:07.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.237+0000 7f42884dd640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f428006a5b0 con 0x7f428006b540 2023-12-19T19:01:07.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.237+0000 7f42884dd640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42800c1d60 con 0x7f4280073a70 2023-12-19T19:01:07.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.237+0000 7f42884dd640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42800c2040 con 0x7f428014b010 2023-12-19T19:01:07.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.241+0000 7f4286a7a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f428006b540 0x7f4280157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:07.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.241+0000 7f4286a7a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f428006b540 0x7f4280157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38544/0 (socket says 172.21.15.133:38544) 2023-12-19T19:01:07.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.241+0000 7f4286a7a640 1 -- 172.21.15.133:0/2191624711 learned_addr learned my addr 172.21.15.133:0/2191624711 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:07.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.241+0000 7f4286279640 1 --2- 172.21.15.133:0/2191624711 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f428014b010 0x7f42800bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:07.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.241+0000 7f4286a7a640 1 -- 172.21.15.133:0/2191624711 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f428014b010 msgr2=0x7f42800bf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:07.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.241+0000 7f4285a78640 1 --2- 172.21.15.133:0/2191624711 >> v2:172.21.15.138:3300/0 conn(0x7f4280073a70 0x7f428006b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:07.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.241+0000 7f4286a7a640 1 --2- 172.21.15.133:0/2191624711 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f428014b010 0x7f42800bf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.241+0000 7f4286a7a640 1 -- 172.21.15.133:0/2191624711 >> v2:172.21.15.138:3300/0 conn(0x7f4280073a70 msgr2=0x7f428006b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:07.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.241+0000 7f4286a7a640 1 --2- 172.21.15.133:0/2191624711 >> v2:172.21.15.138:3300/0 conn(0x7f4280073a70 0x7f428006b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.241+0000 7f4286a7a640 1 -- 172.21.15.133:0/2191624711 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428006a800 con 0x7f428006b540 2023-12-19T19:01:07.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.241+0000 7f4285a78640 1 --2- 172.21.15.133:0/2191624711 >> v2:172.21.15.138:3300/0 conn(0x7f4280073a70 0x7f428006b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:07.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.241+0000 7f4286279640 1 --2- 172.21.15.133:0/2191624711 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f428014b010 0x7f42800bf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:07.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.241+0000 7f4286a7a640 1 --2- 172.21.15.133:0/2191624711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f428006b540 0x7f4280157c20 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4280066e40 tx=0x7f427801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6d5826c9bb486a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:07.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.241+0000 7f4285277640 1 -- 172.21.15.133:0/2191624711 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780af400 con 0x7f428006b540 2023-12-19T19:01:07.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.241+0000 7f4285277640 1 -- 172.21.15.133:0/2191624711 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42780ab050 con 0x7f428006b540 2023-12-19T19:01:07.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.241+0000 7f4285277640 1 -- 172.21.15.133:0/2191624711 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780af780 con 0x7f428006b540 2023-12-19T19:01:07.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f42884dd640 1 -- 172.21.15.133:0/2191624711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f428006b540 msgr2=0x7f4280157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:07.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f42884dd640 1 --2- 172.21.15.133:0/2191624711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f428006b540 0x7f4280157c20 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f4280066e40 tx=0x7f427801f1c0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f42884dd640 1 -- 172.21.15.133:0/2191624711 shutdown_connections 2023-12-19T19:01:07.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f42884dd640 1 --2- 172.21.15.133:0/2191624711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f428006b540 0x7f4280157c20 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f42884dd640 1 --2- 172.21.15.133:0/2191624711 >> v2:172.21.15.138:3300/0 conn(0x7f4280073a70 0x7f428006b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f42884dd640 1 --2- 172.21.15.133:0/2191624711 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f428014b010 0x7f42800bf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f42884dd640 1 -- 172.21.15.133:0/2191624711 >> 172.21.15.133:0/2191624711 conn(0x7f42800c30c0 msgr2=0x7f42800c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:07.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f42884dd640 1 -- 172.21.15.133:0/2191624711 shutdown_connections 2023-12-19T19:01:07.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f42884dd640 1 -- 172.21.15.133:0/2191624711 wait complete. 2023-12-19T19:01:07.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f42884dd640 1 Processor -- start 2023-12-19T19:01:07.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f42884dd640 1 -- start start 2023-12-19T19:01:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f42884dd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4280073a70 0x7f42801ed040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f42884dd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f428014b010 0x7f42801500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f42884dd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42800ac530 0x7f42801505f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f42884dd640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42800ac9c0 con 0x7f428014b010 2023-12-19T19:01:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f42884dd640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42801edc00 con 0x7f4280073a70 2023-12-19T19:01:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f42884dd640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4280155560 con 0x7f42800ac530 2023-12-19T19:01:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f4285a78640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f428014b010 0x7f42801500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f4285a78640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f428014b010 0x7f42801500b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38556/0 (socket says 172.21.15.133:38556) 2023-12-19T19:01:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f4285a78640 1 -- 172.21.15.133:0/2855505488 learned_addr learned my addr 172.21.15.133:0/2855505488 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f4286279640 1 --2- 172.21.15.133:0/2855505488 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4280073a70 0x7f42801ed040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f4286a7a640 1 --2- 172.21.15.133:0/2855505488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42800ac530 0x7f42801505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f4285a78640 1 -- 172.21.15.133:0/2855505488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42800ac530 msgr2=0x7f42801505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f4285a78640 1 --2- 172.21.15.133:0/2855505488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42800ac530 0x7f42801505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f4285a78640 1 -- 172.21.15.133:0/2855505488 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4280073a70 msgr2=0x7f42801ed040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:07.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f4285a78640 1 --2- 172.21.15.133:0/2855505488 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4280073a70 0x7f42801ed040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.245+0000 7f4285a78640 1 -- 172.21.15.133:0/2855505488 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4278009b30 con 0x7f428014b010 2023-12-19T19:01:07.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.249+0000 7f4285a78640 1 --2- 172.21.15.133:0/2855505488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f428014b010 0x7f42801500b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f427000c7c0 tx=0x7f427000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:07.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.249+0000 7f4276ffd640 1 -- 172.21.15.133:0/2855505488 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4270007a30 con 0x7f428014b010 2023-12-19T19:01:07.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.249+0000 7f4276ffd640 1 -- 172.21.15.133:0/2855505488 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4270007b90 con 0x7f428014b010 2023-12-19T19:01:07.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.249+0000 7f42884dd640 1 -- 172.21.15.133:0/2855505488 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4280150b30 con 0x7f428014b010 2023-12-19T19:01:07.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.249+0000 7f4276ffd640 1 -- 172.21.15.133:0/2855505488 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427000ce70 con 0x7f428014b010 2023-12-19T19:01:07.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.249+0000 7f42884dd640 1 -- 172.21.15.133:0/2855505488 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4280151480 con 0x7f428014b010 2023-12-19T19:01:07.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.249+0000 7f42884dd640 1 -- 172.21.15.133:0/2855505488 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4280068400 con 0x7f428014b010 2023-12-19T19:01:07.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.249+0000 7f4276ffd640 1 -- 172.21.15.133:0/2855505488 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f42700113f0 con 0x7f428014b010 2023-12-19T19:01:07.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.249+0000 7f4276ffd640 1 --2- 172.21.15.133:0/2855505488 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f42640664a0 0x7f4264068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:07.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.249+0000 7f4276ffd640 1 -- 172.21.15.133:0/2855505488 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f42700841d0 con 0x7f428014b010 2023-12-19T19:01:07.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.249+0000 7f4286279640 1 --2- 172.21.15.133:0/2855505488 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f42640664a0 0x7f4264068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:07.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.253+0000 7f4286279640 1 --2- 172.21.15.133:0/2855505488 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f42640664a0 0x7f4264068960 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f427c006fd0 tx=0x7f427c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:07.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.253+0000 7f4276ffd640 1 -- 172.21.15.133:0/2855505488 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4270051390 con 0x7f428014b010 2023-12-19T19:01:07.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.405+0000 7f42884dd640 1 -- 172.21.15.133:0/2855505488 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f42801edd70 con 0x7f428014b010 2023-12-19T19:01:07.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.405+0000 7f4276ffd640 1 -- 172.21.15.133:0/2855505488 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v54) v1 ==== 105+0+11 (secure 0 0 0) 0x7f42700549b0 con 0x7f428014b010 2023-12-19T19:01:07.409 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:01:07.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.405+0000 7f42884dd640 1 -- 172.21.15.133:0/2855505488 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f42640664a0 msgr2=0x7f4264068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:07.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.405+0000 7f42884dd640 1 --2- 172.21.15.133:0/2855505488 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f42640664a0 0x7f4264068960 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f427c006fd0 tx=0x7f427c008040 comp rx=0 tx=0).stop 2023-12-19T19:01:07.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.405+0000 7f42884dd640 1 -- 172.21.15.133:0/2855505488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f428014b010 msgr2=0x7f42801500b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:07.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.405+0000 7f42884dd640 1 --2- 172.21.15.133:0/2855505488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f428014b010 0x7f42801500b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f427000c7c0 tx=0x7f427000cc80 comp rx=0 tx=0).stop 2023-12-19T19:01:07.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.405+0000 7f42884dd640 1 -- 172.21.15.133:0/2855505488 shutdown_connections 2023-12-19T19:01:07.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.405+0000 7f42884dd640 1 --2- 172.21.15.133:0/2855505488 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f42640664a0 0x7f4264068960 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.405+0000 7f42884dd640 1 --2- 172.21.15.133:0/2855505488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42800ac530 0x7f42801505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.405+0000 7f42884dd640 1 --2- 172.21.15.133:0/2855505488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f428014b010 0x7f42801500b0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.405+0000 7f42884dd640 1 --2- 172.21.15.133:0/2855505488 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4280073a70 0x7f42801ed040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.405+0000 7f42884dd640 1 -- 172.21.15.133:0/2855505488 >> 172.21.15.133:0/2855505488 conn(0x7f42800c30c0 msgr2=0x7f42800c0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:07.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.405+0000 7f42884dd640 1 -- 172.21.15.133:0/2855505488 shutdown_connections 2023-12-19T19:01:07.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.405+0000 7f42884dd640 1 -- 172.21.15.133:0/2855505488 wait complete. 2023-12-19T19:01:07.430 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-19T19:01:07.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.565+0000 7fae5fdd1640 1 Processor -- start 2023-12-19T19:01:07.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.565+0000 7fae5fdd1640 1 -- start start 2023-12-19T19:01:07.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.569+0000 7fae5fdd1640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fae580a5370 0x7fae580c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:07.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.569+0000 7fae5fdd1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae580c4110 0x7fae58150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:07.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.569+0000 7fae5fdd1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae580c2760 con 0x7fae58072090 2023-12-19T19:01:07.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.569+0000 7fae5fdd1640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae580c3070 con 0x7fae580a5370 2023-12-19T19:01:07.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.569+0000 7fae5fdd1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae58151bf0 con 0x7fae580c4110 2023-12-19T19:01:07.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.569+0000 7fae5e36e640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fae58072090 0x7fae581514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38146/0 (socket says 172.21.15.133:38146) 2023-12-19T19:01:07.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.569+0000 7fae5e36e640 1 -- 172.21.15.133:0/2685663381 learned_addr learned my addr 172.21.15.133:0/2685663381 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:07.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.569+0000 7fae5d36c640 1 --2- 172.21.15.133:0/2685663381 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae580c4110 0x7fae58150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:07.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.569+0000 7fae5db6d640 1 --2- 172.21.15.133:0/2685663381 >> v2:172.21.15.138:3300/0 conn(0x7fae580a5370 0x7fae580c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:07.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.569+0000 7fae5cb6b640 1 -- 172.21.15.133:0/2685663381 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2266387375 0 0) 0x7fae580c2760 con 0x7fae58072090 2023-12-19T19:01:07.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.569+0000 7fae5cb6b640 1 -- 172.21.15.133:0/2685663381 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae44003530 con 0x7fae58072090 2023-12-19T19:01:07.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.569+0000 7fae5cb6b640 1 -- 172.21.15.133:0/2685663381 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1494096145 0 0) 0x7fae44003530 con 0x7fae58072090 2023-12-19T19:01:07.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.569+0000 7fae5d36c640 1 -- 172.21.15.133:0/2685663381 >> v2:172.21.15.138:3300/0 conn(0x7fae580a5370 msgr2=0x7fae580c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:07.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.569+0000 7fae5d36c640 1 --2- 172.21.15.133:0/2685663381 >> v2:172.21.15.138:3300/0 conn(0x7fae580a5370 0x7fae580c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.569+0000 7fae5d36c640 1 -- 172.21.15.133:0/2685663381 >> v1:172.21.15.133:6789/0 conn(0x7fae58072090 legacy=0x7fae581514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:07.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.569+0000 7fae5d36c640 1 -- 172.21.15.133:0/2685663381 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae580a5750 con 0x7fae580c4110 2023-12-19T19:01:07.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.573+0000 7fae5d36c640 1 --2- 172.21.15.133:0/2685663381 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae580c4110 0x7fae58150fa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fae480097c0 tx=0x7fae4801c250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93dc63f684de6bf7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:07.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.573+0000 7fae5cb6b640 1 -- 172.21.15.133:0/2685663381 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae50001a00 con 0x7fae580c4110 2023-12-19T19:01:07.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.573+0000 7fae5cb6b640 1 -- 172.21.15.133:0/2685663381 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae480a7050 con 0x7fae580c4110 2023-12-19T19:01:07.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.573+0000 7fae5cb6b640 1 -- 172.21.15.133:0/2685663381 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae480ab600 con 0x7fae580c4110 2023-12-19T19:01:07.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.573+0000 7fae5fdd1640 1 -- 172.21.15.133:0/2685663381 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae580c4110 msgr2=0x7fae58150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:07.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.573+0000 7fae5fdd1640 1 --2- 172.21.15.133:0/2685663381 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae580c4110 0x7fae58150fa0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fae480097c0 tx=0x7fae4801c250 comp rx=0 tx=0).stop 2023-12-19T19:01:07.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.573+0000 7fae5fdd1640 1 -- 172.21.15.133:0/2685663381 shutdown_connections 2023-12-19T19:01:07.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.573+0000 7fae5fdd1640 1 --2- 172.21.15.133:0/2685663381 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae580c4110 0x7fae58150fa0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.573+0000 7fae5fdd1640 1 --2- 172.21.15.133:0/2685663381 >> v2:172.21.15.138:3300/0 conn(0x7fae580a5370 0x7fae580c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.573+0000 7fae5fdd1640 1 -- 172.21.15.133:0/2685663381 >> 172.21.15.133:0/2685663381 conn(0x7fae5806a5b0 msgr2=0x7fae5806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:07.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.573+0000 7fae5fdd1640 1 -- 172.21.15.133:0/2685663381 shutdown_connections 2023-12-19T19:01:07.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.573+0000 7fae5fdd1640 1 -- 172.21.15.133:0/2685663381 wait complete. 2023-12-19T19:01:07.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.573+0000 7fae5fdd1640 1 Processor -- start 2023-12-19T19:01:07.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.573+0000 7fae5fdd1640 1 -- start start 2023-12-19T19:01:07.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae5fdd1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae58072090 0x7fae58150760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:07.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae5fdd1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae580a5370 0x7fae580c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:07.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae5fdd1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae580c4110 0x7fae5814d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:07.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae5fdd1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae580a73b0 con 0x7fae58072090 2023-12-19T19:01:07.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae5fdd1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae580a7690 con 0x7fae580a5370 2023-12-19T19:01:07.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae5fdd1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae58149ec0 con 0x7fae580c4110 2023-12-19T19:01:07.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae5db6d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae58072090 0x7fae58150760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:07.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae5db6d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae58072090 0x7fae58150760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38568/0 (socket says 172.21.15.133:38568) 2023-12-19T19:01:07.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae5db6d640 1 -- 172.21.15.133:0/516777798 learned_addr learned my addr 172.21.15.133:0/516777798 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:07.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae5d36c640 1 --2- 172.21.15.133:0/516777798 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae580a5370 0x7fae580c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:07.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae5e36e640 1 --2- 172.21.15.133:0/516777798 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae580c4110 0x7fae5814d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:07.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae5db6d640 1 -- 172.21.15.133:0/516777798 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae580c4110 msgr2=0x7fae5814d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:07.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae5db6d640 1 --2- 172.21.15.133:0/516777798 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae580c4110 0x7fae5814d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae5db6d640 1 -- 172.21.15.133:0/516777798 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae580a5370 msgr2=0x7fae580c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:07.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae5db6d640 1 --2- 172.21.15.133:0/516777798 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae580a5370 0x7fae580c4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae5db6d640 1 -- 172.21.15.133:0/516777798 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae48009420 con 0x7fae58072090 2023-12-19T19:01:07.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae5db6d640 1 --2- 172.21.15.133:0/516777798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae58072090 0x7fae58150760 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fae5400e930 tx=0x7fae5400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:07.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae4e7fc640 1 -- 172.21.15.133:0/516777798 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae54009690 con 0x7fae58072090 2023-12-19T19:01:07.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae4e7fc640 1 -- 172.21.15.133:0/516777798 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5400ca00 con 0x7fae58072090 2023-12-19T19:01:07.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae4e7fc640 1 -- 172.21.15.133:0/516777798 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5400cd70 con 0x7fae58072090 2023-12-19T19:01:07.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae5fdd1640 1 -- 172.21.15.133:0/516777798 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae5814a1a0 con 0x7fae58072090 2023-12-19T19:01:07.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae5fdd1640 1 -- 172.21.15.133:0/516777798 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5814d980 con 0x7fae58072090 2023-12-19T19:01:07.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae5fdd1640 1 -- 172.21.15.133:0/516777798 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae581503a0 con 0x7fae58072090 2023-12-19T19:01:07.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.577+0000 7fae4e7fc640 1 -- 172.21.15.133:0/516777798 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fae54013470 con 0x7fae58072090 2023-12-19T19:01:07.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.581+0000 7fae4e7fc640 1 --2- 172.21.15.133:0/516777798 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fae3c066470 0x7fae3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:07.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.581+0000 7fae4e7fc640 1 -- 172.21.15.133:0/516777798 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fae54084420 con 0x7fae58072090 2023-12-19T19:01:07.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.581+0000 7fae5d36c640 1 --2- 172.21.15.133:0/516777798 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fae3c066470 0x7fae3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:07.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.581+0000 7fae5d36c640 1 --2- 172.21.15.133:0/516777798 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fae3c066470 0x7fae3c068930 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fae480097c0 tx=0x7fae48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:07.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.585+0000 7fae4e7fc640 1 -- 172.21.15.133:0/516777798 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fae54051690 con 0x7fae58072090 2023-12-19T19:01:07.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.733+0000 7fae5fdd1640 1 -- 172.21.15.133:0/516777798 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fae58068400 con 0x7fae58072090 2023-12-19T19:01:07.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.733+0000 7fae4e7fc640 1 -- 172.21.15.133:0/516777798 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v54) v1 ==== 101+0+11 (secure 0 0 0) 0x7fae54054cb0 con 0x7fae58072090 2023-12-19T19:01:07.738 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:01:07.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.737+0000 7fae5fdd1640 1 -- 172.21.15.133:0/516777798 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fae3c066470 msgr2=0x7fae3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:07.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.737+0000 7fae5fdd1640 1 --2- 172.21.15.133:0/516777798 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fae3c066470 0x7fae3c068930 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fae480097c0 tx=0x7fae48008040 comp rx=0 tx=0).stop 2023-12-19T19:01:07.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.737+0000 7fae5fdd1640 1 -- 172.21.15.133:0/516777798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae58072090 msgr2=0x7fae58150760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:07.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.737+0000 7fae5fdd1640 1 --2- 172.21.15.133:0/516777798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae58072090 0x7fae58150760 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fae5400e930 tx=0x7fae5400edf0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.737+0000 7fae5fdd1640 1 -- 172.21.15.133:0/516777798 shutdown_connections 2023-12-19T19:01:07.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.737+0000 7fae5fdd1640 1 --2- 172.21.15.133:0/516777798 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fae3c066470 0x7fae3c068930 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.737+0000 7fae5fdd1640 1 --2- 172.21.15.133:0/516777798 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fae580c4110 0x7fae5814d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.737+0000 7fae5fdd1640 1 --2- 172.21.15.133:0/516777798 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fae580a5370 0x7fae580c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.737+0000 7fae5fdd1640 1 --2- 172.21.15.133:0/516777798 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fae58072090 0x7fae58150760 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.737+0000 7fae5fdd1640 1 -- 172.21.15.133:0/516777798 >> 172.21.15.133:0/516777798 conn(0x7fae5806a5b0 msgr2=0x7fae58151230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:07.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.737+0000 7fae5fdd1640 1 -- 172.21.15.133:0/516777798 shutdown_connections 2023-12-19T19:01:07.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.737+0000 7fae5fdd1640 1 -- 172.21.15.133:0/516777798 wait complete. 2023-12-19T19:01:07.759 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:01:07.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.893+0000 7f7c78e5a640 1 Processor -- start 2023-12-19T19:01:07.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.893+0000 7f7c78e5a640 1 -- start start 2023-12-19T19:01:07.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.893+0000 7f7c78e5a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7c74158670 0x7f7c74155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:07.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.893+0000 7f7c78e5a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c740c53f0 con 0x7f7c74151ba0 2023-12-19T19:01:07.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.893+0000 7f7c78e5a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c74154670 con 0x7f7c740c48d0 2023-12-19T19:01:07.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.893+0000 7f7c78e5a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c74158c30 con 0x7f7c74158670 2023-12-19T19:01:07.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.893+0000 7f7c7259c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7c74151ba0 0x7f7c7406afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38150/0 (socket says 172.21.15.133:38150) 2023-12-19T19:01:07.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.893+0000 7f7c7259c640 1 -- 172.21.15.133:0/2362823184 learned_addr learned my addr 172.21.15.133:0/2362823184 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:07.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.893+0000 7f7c72d9d640 1 --2- 172.21.15.133:0/2362823184 >> v2:172.21.15.133:3300/0 conn(0x7f7c74158670 0x7f7c74155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:07.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.893+0000 7f7c71d9b640 1 -- 172.21.15.133:0/2362823184 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3866825100 0 0) 0x7f7c740c53f0 con 0x7f7c74151ba0 2023-12-19T19:01:07.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.893+0000 7f7c71d9b640 1 -- 172.21.15.133:0/2362823184 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c60003530 con 0x7f7c74151ba0 2023-12-19T19:01:07.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.893+0000 7f7c72d9d640 1 -- 172.21.15.133:0/2362823184 >> v1:172.21.15.138:6789/0 conn(0x7f7c740c48d0 legacy=0x7f7c74154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:07.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.893+0000 7f7c72d9d640 1 -- 172.21.15.133:0/2362823184 >> v1:172.21.15.133:6789/0 conn(0x7f7c74151ba0 legacy=0x7f7c7406afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:07.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.893+0000 7f7c72d9d640 1 -- 172.21.15.133:0/2362823184 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c740c6b00 con 0x7f7c74158670 2023-12-19T19:01:07.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.897+0000 7f7c72d9d640 1 --2- 172.21.15.133:0/2362823184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c74158670 0x7f7c74155240 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009d90 tx=0x7f7c6c01c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2d8a6db100510f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:07.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.897+0000 7f7c71d9b640 1 -- 172.21.15.133:0/2362823184 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c0a58c0 con 0x7f7c74158670 2023-12-19T19:01:07.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.897+0000 7f7c71d9b640 1 -- 172.21.15.133:0/2362823184 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6c0a5a20 con 0x7f7c74158670 2023-12-19T19:01:07.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.897+0000 7f7c71d9b640 1 -- 172.21.15.133:0/2362823184 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c0a5db0 con 0x7f7c74158670 2023-12-19T19:01:07.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.897+0000 7f7c78e5a640 1 -- 172.21.15.133:0/2362823184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c74158670 msgr2=0x7f7c74155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:07.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.897+0000 7f7c78e5a640 1 --2- 172.21.15.133:0/2362823184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c74158670 0x7f7c74155240 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009d90 tx=0x7f7c6c01c800 comp rx=0 tx=0).stop 2023-12-19T19:01:07.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.897+0000 7f7c78e5a640 1 -- 172.21.15.133:0/2362823184 shutdown_connections 2023-12-19T19:01:07.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.897+0000 7f7c78e5a640 1 --2- 172.21.15.133:0/2362823184 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c74158670 0x7f7c74155240 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.897+0000 7f7c78e5a640 1 -- 172.21.15.133:0/2362823184 >> 172.21.15.133:0/2362823184 conn(0x7f7c740c9f50 msgr2=0x7f7c740ca360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:07.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.897+0000 7f7c78e5a640 1 -- 172.21.15.133:0/2362823184 shutdown_connections 2023-12-19T19:01:07.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.897+0000 7f7c78e5a640 1 -- 172.21.15.133:0/2362823184 wait complete. 2023-12-19T19:01:07.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c78e5a640 1 Processor -- start 2023-12-19T19:01:07.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c78e5a640 1 -- start start 2023-12-19T19:01:07.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c78e5a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c740c48d0 0x7f7c741438a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:07.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c78e5a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c74151ba0 0x7f7c741573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:07.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c78e5a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c74158670 0x7f7c741475a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:07.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c78e5a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7414ba70 con 0x7f7c74151ba0 2023-12-19T19:01:07.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c78e5a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c741f0e50 con 0x7f7c74158670 2023-12-19T19:01:07.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c78e5a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c74145cb0 con 0x7f7c740c48d0 2023-12-19T19:01:07.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c69d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c74151ba0 0x7f7c741573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:07.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c69d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c74151ba0 0x7f7c741573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38586/0 (socket says 172.21.15.133:38586) 2023-12-19T19:01:07.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c69d9b640 1 -- 172.21.15.133:0/3656267749 learned_addr learned my addr 172.21.15.133:0/3656267749 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:07.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c7259c640 1 --2- 172.21.15.133:0/3656267749 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c740c48d0 0x7f7c741438a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:07.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c72d9d640 1 --2- 172.21.15.133:0/3656267749 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c74158670 0x7f7c741475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:07.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c69d9b640 1 -- 172.21.15.133:0/3656267749 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c740c48d0 msgr2=0x7f7c741438a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:07.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c69d9b640 1 --2- 172.21.15.133:0/3656267749 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c740c48d0 0x7f7c741438a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c69d9b640 1 -- 172.21.15.133:0/3656267749 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c74158670 msgr2=0x7f7c741475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:07.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c69d9b640 1 --2- 172.21.15.133:0/3656267749 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c74158670 0x7f7c741475a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:07.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c69d9b640 1 -- 172.21.15.133:0/3656267749 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c009a70 con 0x7f7c74151ba0 2023-12-19T19:01:07.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c7259c640 1 --2- 172.21.15.133:0/3656267749 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c740c48d0 0x7f7c741438a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:07.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c69d9b640 1 --2- 172.21.15.133:0/3656267749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c74151ba0 0x7f7c741573a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400c3c0 tx=0x7f7c6400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:07.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c6b7fe640 1 -- 172.21.15.133:0/3656267749 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c640052d0 con 0x7f7c74151ba0 2023-12-19T19:01:07.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c6b7fe640 1 -- 172.21.15.133:0/3656267749 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c64005430 con 0x7f7c74151ba0 2023-12-19T19:01:07.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c6b7fe640 1 -- 172.21.15.133:0/3656267749 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c64003840 con 0x7f7c74151ba0 2023-12-19T19:01:07.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c78e5a640 1 -- 172.21.15.133:0/3656267749 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c74151190 con 0x7f7c74151ba0 2023-12-19T19:01:07.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.901+0000 7f7c78e5a640 1 -- 172.21.15.133:0/3656267749 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c74145f90 con 0x7f7c74151ba0 2023-12-19T19:01:07.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.905+0000 7f7c78e5a640 1 -- 172.21.15.133:0/3656267749 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c741513d0 con 0x7f7c74151ba0 2023-12-19T19:01:07.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.905+0000 7f7c6b7fe640 1 -- 172.21.15.133:0/3656267749 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7c640039a0 con 0x7f7c74151ba0 2023-12-19T19:01:07.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.905+0000 7f7c6b7fe640 1 --2- 172.21.15.133:0/3656267749 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7c540664a0 0x7f7c54068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:07.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.905+0000 7f7c6b7fe640 1 -- 172.21.15.133:0/3656267749 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7c64083760 con 0x7f7c74151ba0 2023-12-19T19:01:07.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.905+0000 7f7c7259c640 1 --2- 172.21.15.133:0/3656267749 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7c540664a0 0x7f7c54068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:07.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.905+0000 7f7c7259c640 1 --2- 172.21.15.133:0/3656267749 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7c540664a0 0x7f7c54068960 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0011f0 tx=0x7f7c5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:07.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:07.909+0000 7f7c6b7fe640 1 -- 172.21.15.133:0/3656267749 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7c741513d0 con 0x7f7c74151ba0 2023-12-19T19:01:08.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.089+0000 7f7c78e5a640 1 -- 172.21.15.133:0/3656267749 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c74140a40 con 0x7f7c74151ba0 2023-12-19T19:01:08.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.089+0000 7f7c6b7fe640 1 -- 172.21.15.133:0/3656267749 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6194 (secure 0 0 0) 0x7f7c74140a40 con 0x7f7c74151ba0 2023-12-19T19:01:08.094 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:08.094 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3200335051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3200335051},{"type":"v1","addr":"172.21.15.133:6833","nonce":3200335051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2114705112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":2114705112},{"type":"v1","addr":"172.21.15.138:6835","nonce":2114705112}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:00:31.342186+0000","modified":"2023-12-19T19:00:34.368238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5763},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5763":{"gid":5763,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6835/1203400706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1203400706},{"type":"v1","addr":"172.21.15.133:6835","nonce":1203400706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:00:49.053498+0000","modified":"2023-12-19T19:00:52.071868+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5258":{"gid":5258,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6837/3661017926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3661017926},{"type":"v1","addr":"172.21.15.138:6837","nonce":3661017926}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T19:01:08.094 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 37 2023-12-19T19:01:08.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.089+0000 7f7c78e5a640 1 -- 172.21.15.133:0/3656267749 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7c540664a0 msgr2=0x7f7c54068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:08.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.089+0000 7f7c78e5a640 1 --2- 172.21.15.133:0/3656267749 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7c540664a0 0x7f7c54068960 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0011f0 tx=0x7f7c5c009040 comp rx=0 tx=0).stop 2023-12-19T19:01:08.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.089+0000 7f7c78e5a640 1 -- 172.21.15.133:0/3656267749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c74151ba0 msgr2=0x7f7c741573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:08.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.089+0000 7f7c78e5a640 1 --2- 172.21.15.133:0/3656267749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c74151ba0 0x7f7c741573a0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400c3c0 tx=0x7f7c6400c880 comp rx=0 tx=0).stop 2023-12-19T19:01:08.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.093+0000 7f7c78e5a640 1 -- 172.21.15.133:0/3656267749 shutdown_connections 2023-12-19T19:01:08.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.093+0000 7f7c78e5a640 1 --2- 172.21.15.133:0/3656267749 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7c540664a0 0x7f7c54068960 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.093+0000 7f7c78e5a640 1 --2- 172.21.15.133:0/3656267749 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c74158670 0x7f7c741475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.093+0000 7f7c78e5a640 1 --2- 172.21.15.133:0/3656267749 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c74151ba0 0x7f7c741573a0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.093+0000 7f7c78e5a640 1 --2- 172.21.15.133:0/3656267749 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c740c48d0 0x7f7c741438a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.093+0000 7f7c78e5a640 1 -- 172.21.15.133:0/3656267749 >> 172.21.15.133:0/3656267749 conn(0x7f7c740c9f50 msgr2=0x7f7c741524e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:08.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.093+0000 7f7c78e5a640 1 -- 172.21.15.133:0/3656267749 shutdown_connections 2023-12-19T19:01:08.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.093+0000 7f7c78e5a640 1 -- 172.21.15.133:0/3656267749 wait complete. 2023-12-19T19:01:08.115 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:01:08.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.249+0000 7f81a61f5640 1 Processor -- start 2023-12-19T19:01:08.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.249+0000 7f81a61f5640 1 -- start start 2023-12-19T19:01:08.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.249+0000 7f81a61f5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f81a00c4100 0x7f81a00c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:08.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.249+0000 7f81a61f5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f81a00c06d0 0x7f81a00a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:08.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.249+0000 7f81a61f5640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a00c31c0 con 0x7f81a00c63c0 2023-12-19T19:01:08.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.249+0000 7f81a61f5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a00c34a0 con 0x7f81a00c06d0 2023-12-19T19:01:08.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.249+0000 7f81a61f5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a00c1030 con 0x7f81a00c4100 2023-12-19T19:01:08.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.249+0000 7f819f7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f81a00c63c0 0x7f81a00c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38156/0 (socket says 172.21.15.133:38156) 2023-12-19T19:01:08.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.249+0000 7f819f7fe640 1 -- 172.21.15.133:0/3720747017 learned_addr learned my addr 172.21.15.133:0/3720747017 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:08.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.249+0000 7f819ffff640 1 --2- 172.21.15.133:0/3720747017 >> v2:172.21.15.133:3300/0 conn(0x7f81a00c06d0 0x7f81a00a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:08.255 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.249+0000 7f8196ffd640 1 --2- 172.21.15.133:0/3720747017 >> v2:172.21.15.138:3300/0 conn(0x7f81a00c4100 0x7f81a00c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:08.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.249+0000 7f819ffff640 1 -- 172.21.15.133:0/3720747017 >> v2:172.21.15.138:3300/0 conn(0x7f81a00c4100 msgr2=0x7f81a00c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:08.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.249+0000 7f819ffff640 1 --2- 172.21.15.133:0/3720747017 >> v2:172.21.15.138:3300/0 conn(0x7f81a00c4100 0x7f81a00c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.249+0000 7f819ffff640 1 -- 172.21.15.133:0/3720747017 >> v1:172.21.15.133:6789/0 conn(0x7f81a00c63c0 legacy=0x7f81a00c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:08.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.249+0000 7f819ffff640 1 -- 172.21.15.133:0/3720747017 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a00c1310 con 0x7f81a00c06d0 2023-12-19T19:01:08.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.253+0000 7f8196ffd640 1 --2- 172.21.15.133:0/3720747017 >> v2:172.21.15.138:3300/0 conn(0x7f81a00c4100 0x7f81a00c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:08.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.253+0000 7f819ffff640 1 --2- 172.21.15.133:0/3720747017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a00c06d0 0x7f81a00a9680 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f81a00a8b40 tx=0x7f819801ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8c4d3ccc185fd2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:08.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.253+0000 7f819effd640 1 -- 172.21.15.133:0/3720747017 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a00aa3d0 con 0x7f81a00c06d0 2023-12-19T19:01:08.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.253+0000 7f819effd640 1 -- 172.21.15.133:0/3720747017 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81980a79e0 con 0x7f81a00c06d0 2023-12-19T19:01:08.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.253+0000 7f819effd640 1 -- 172.21.15.133:0/3720747017 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81980a7d70 con 0x7f81a00c06d0 2023-12-19T19:01:08.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.253+0000 7f81a61f5640 1 -- 172.21.15.133:0/3720747017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a00c06d0 msgr2=0x7f81a00a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:08.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.253+0000 7f81a61f5640 1 --2- 172.21.15.133:0/3720747017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a00c06d0 0x7f81a00a9680 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f81a00a8b40 tx=0x7f819801ea00 comp rx=0 tx=0).stop 2023-12-19T19:01:08.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.253+0000 7f81a61f5640 1 -- 172.21.15.133:0/3720747017 shutdown_connections 2023-12-19T19:01:08.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.253+0000 7f81a61f5640 1 --2- 172.21.15.133:0/3720747017 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a00c06d0 0x7f81a00a9680 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.253+0000 7f81a61f5640 1 --2- 172.21.15.133:0/3720747017 >> v2:172.21.15.138:3300/0 conn(0x7f81a00c4100 0x7f81a00c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.253+0000 7f81a61f5640 1 -- 172.21.15.133:0/3720747017 >> 172.21.15.133:0/3720747017 conn(0x7f81a006a5b0 msgr2=0x7f81a006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:08.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.253+0000 7f81a61f5640 1 -- 172.21.15.133:0/3720747017 shutdown_connections 2023-12-19T19:01:08.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.253+0000 7f81a61f5640 1 -- 172.21.15.133:0/3720747017 wait complete. 2023-12-19T19:01:08.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f81a61f5640 1 Processor -- start 2023-12-19T19:01:08.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f81a61f5640 1 -- start start 2023-12-19T19:01:08.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f81a61f5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81a00c06d0 0x7f81a015a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:08.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f81a61f5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a00c4100 0x7f81a015a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:08.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f81a61f5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81a00c63c0 0x7f81a01544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:08.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f81a61f5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a00c0270 con 0x7f81a00c4100 2023-12-19T19:01:08.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f81a61f5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a00a4880 con 0x7f81a00c63c0 2023-12-19T19:01:08.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f81a61f5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a00677c0 con 0x7f81a00c06d0 2023-12-19T19:01:08.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f8196ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a00c4100 0x7f81a015a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:08.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f8196ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a00c4100 0x7f81a015a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38594/0 (socket says 172.21.15.133:38594) 2023-12-19T19:01:08.265 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f8196ffd640 1 -- 172.21.15.133:0/3310670737 learned_addr learned my addr 172.21.15.133:0/3310670737 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:08.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f819ffff640 1 --2- 172.21.15.133:0/3310670737 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81a00c63c0 0x7f81a01544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:08.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f819f7fe640 1 --2- 172.21.15.133:0/3310670737 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81a00c06d0 0x7f81a015a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:08.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f8196ffd640 1 -- 172.21.15.133:0/3310670737 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81a00c06d0 msgr2=0x7f81a015a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:08.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f8196ffd640 1 --2- 172.21.15.133:0/3310670737 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81a00c06d0 0x7f81a015a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f8196ffd640 1 -- 172.21.15.133:0/3310670737 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81a00c63c0 msgr2=0x7f81a01544b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:08.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f8196ffd640 1 --2- 172.21.15.133:0/3310670737 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81a00c63c0 0x7f81a01544b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f8196ffd640 1 -- 172.21.15.133:0/3310670737 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8198009a70 con 0x7f81a00c4100 2023-12-19T19:01:08.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f819f7fe640 1 --2- 172.21.15.133:0/3310670737 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81a00c06d0 0x7f81a015a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:08.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f8196ffd640 1 --2- 172.21.15.133:0/3310670737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a00c4100 0x7f81a015a730 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f818800c7f0 tx=0x7f818800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:08.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f819cff9640 1 -- 172.21.15.133:0/3310670737 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818800cea0 con 0x7f81a00c4100 2023-12-19T19:01:08.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f819cff9640 1 -- 172.21.15.133:0/3310670737 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8188007a30 con 0x7f81a00c4100 2023-12-19T19:01:08.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f819cff9640 1 -- 172.21.15.133:0/3310670737 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8188007de0 con 0x7f81a00c4100 2023-12-19T19:01:08.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.257+0000 7f81a61f5640 1 -- 172.21.15.133:0/3310670737 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a00674e0 con 0x7f81a00c4100 2023-12-19T19:01:08.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.261+0000 7f81a61f5640 1 -- 172.21.15.133:0/3310670737 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a00bff90 con 0x7f81a00c4100 2023-12-19T19:01:08.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.261+0000 7f81a61f5640 1 -- 172.21.15.133:0/3310670737 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a00a4650 con 0x7f81a00c4100 2023-12-19T19:01:08.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.261+0000 7f819cff9640 1 -- 172.21.15.133:0/3310670737 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f81880113f0 con 0x7f81a00c4100 2023-12-19T19:01:08.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.261+0000 7f819cff9640 1 --2- 172.21.15.133:0/3310670737 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f81800664a0 0x7f8180068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:08.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.261+0000 7f819cff9640 1 -- 172.21.15.133:0/3310670737 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8188083fe0 con 0x7f81a00c4100 2023-12-19T19:01:08.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.261+0000 7f819f7fe640 1 --2- 172.21.15.133:0/3310670737 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f81800664a0 0x7f8180068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:08.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.265+0000 7f819f7fe640 1 --2- 172.21.15.133:0/3310670737 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f81800664a0 0x7f8180068960 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8190000f70 tx=0x7f8190009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:08.270 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.265+0000 7f819cff9640 1 -- 172.21.15.133:0/3310670737 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f81a00a4650 con 0x7f81a00c4100 2023-12-19T19:01:08.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.417+0000 7f81a61f5640 1 -- 172.21.15.133:0/3310670737 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81a00a4650 con 0x7f81a00c4100 2023-12-19T19:01:08.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.417+0000 7f819cff9640 1 -- 172.21.15.133:0/3310670737 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20316 (secure 0 0 0) 0x7f81a00a4650 con 0x7f81a00c4100 2023-12-19T19:01:08.422 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:08.422 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":54,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:00:50.680936+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:00:29.085029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T19:00:30.359577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:00:46.784805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:00:48.051355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:01:08.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.421+0000 7f81a61f5640 1 -- 172.21.15.133:0/3310670737 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f81800664a0 msgr2=0x7f8180068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:08.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.421+0000 7f81a61f5640 1 --2- 172.21.15.133:0/3310670737 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f81800664a0 0x7f8180068960 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8190000f70 tx=0x7f8190009040 comp rx=0 tx=0).stop 2023-12-19T19:01:08.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.421+0000 7f81a61f5640 1 -- 172.21.15.133:0/3310670737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a00c4100 msgr2=0x7f81a015a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:08.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.421+0000 7f81a61f5640 1 --2- 172.21.15.133:0/3310670737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a00c4100 0x7f81a015a730 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f818800c7f0 tx=0x7f818800ccb0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.421+0000 7f81a61f5640 1 -- 172.21.15.133:0/3310670737 shutdown_connections 2023-12-19T19:01:08.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.421+0000 7f81a61f5640 1 --2- 172.21.15.133:0/3310670737 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f81800664a0 0x7f8180068960 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.421+0000 7f81a61f5640 1 --2- 172.21.15.133:0/3310670737 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81a00c63c0 0x7f81a01544b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.421+0000 7f81a61f5640 1 --2- 172.21.15.133:0/3310670737 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81a00c4100 0x7f81a015a730 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.421+0000 7f81a61f5640 1 --2- 172.21.15.133:0/3310670737 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81a00c06d0 0x7f81a015a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.421+0000 7f81a61f5640 1 -- 172.21.15.133:0/3310670737 >> 172.21.15.133:0/3310670737 conn(0x7f81a006a5b0 msgr2=0x7f81a006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:08.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.421+0000 7f81a61f5640 1 -- 172.21.15.133:0/3310670737 shutdown_connections 2023-12-19T19:01:08.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.421+0000 7f81a61f5640 1 -- 172.21.15.133:0/3310670737 wait complete. 2023-12-19T19:01:08.443 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T19:01:08.444 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:01:08.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.577+0000 7f35455d1640 1 Processor -- start 2023-12-19T19:01:08.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.577+0000 7f35455d1640 1 -- start start 2023-12-19T19:01:08.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.577+0000 7f35455d1640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f35400bf9f0 0x7f3540158330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:08.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.577+0000 7f35455d1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f354006a5b0 con 0x7f3540073a70 2023-12-19T19:01:08.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.577+0000 7f35455d1640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f354006b710 con 0x7f354014b010 2023-12-19T19:01:08.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.577+0000 7f35455d1640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35400bfe10 con 0x7f35400bf9f0 2023-12-19T19:01:08.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.577+0000 7f35367fc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3540073a70 0x7f3540157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38158/0 (socket says 172.21.15.133:38158) 2023-12-19T19:01:08.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.577+0000 7f35367fc640 1 -- 172.21.15.133:0/2664400162 learned_addr learned my addr 172.21.15.133:0/2664400162 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:08.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.577+0000 7f353f7fe640 1 --2- 172.21.15.133:0/2664400162 >> v2:172.21.15.138:3300/0 conn(0x7f35400bf9f0 0x7f3540158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:08.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.577+0000 7f353e7fc640 1 -- 172.21.15.133:0/2664400162 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 222707510 0 0) 0x7f354006a5b0 con 0x7f3540073a70 2023-12-19T19:01:08.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.577+0000 7f353e7fc640 1 -- 172.21.15.133:0/2664400162 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3520003530 con 0x7f3540073a70 2023-12-19T19:01:08.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.577+0000 7f353e7fc640 1 -- 172.21.15.133:0/2664400162 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1837899646 0 0) 0x7f354006b710 con 0x7f354014b010 2023-12-19T19:01:08.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.577+0000 7f353e7fc640 1 -- 172.21.15.133:0/2664400162 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f354006a5b0 con 0x7f354014b010 2023-12-19T19:01:08.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.577+0000 7f353e7fc640 1 -- 172.21.15.133:0/2664400162 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3678036364 0 0) 0x7f3520003530 con 0x7f3540073a70 2023-12-19T19:01:08.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.577+0000 7f353f7fe640 1 -- 172.21.15.133:0/2664400162 >> v1:172.21.15.138:6789/0 conn(0x7f354014b010 legacy=0x7f354006b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:08.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.577+0000 7f353f7fe640 1 -- 172.21.15.133:0/2664400162 >> v1:172.21.15.133:6789/0 conn(0x7f3540073a70 legacy=0x7f3540157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:08.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.577+0000 7f353f7fe640 1 -- 172.21.15.133:0/2664400162 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35400c1d60 con 0x7f35400bf9f0 2023-12-19T19:01:08.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.581+0000 7f353f7fe640 1 --2- 172.21.15.133:0/2664400162 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35400bf9f0 0x7f3540158330 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3538009d90 tx=0x7f353801f060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d78c5e4722eda16 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:08.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.581+0000 7f353e7fc640 1 -- 172.21.15.133:0/2664400162 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3528001680 con 0x7f35400bf9f0 2023-12-19T19:01:08.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.581+0000 7f353e7fc640 1 -- 172.21.15.133:0/2664400162 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35380a8bf0 con 0x7f35400bf9f0 2023-12-19T19:01:08.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.581+0000 7f353e7fc640 1 -- 172.21.15.133:0/2664400162 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35380b0440 con 0x7f35400bf9f0 2023-12-19T19:01:08.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.581+0000 7f35455d1640 1 -- 172.21.15.133:0/2664400162 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35400bf9f0 msgr2=0x7f3540158330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:08.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.581+0000 7f35455d1640 1 --2- 172.21.15.133:0/2664400162 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35400bf9f0 0x7f3540158330 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3538009d90 tx=0x7f353801f060 comp rx=0 tx=0).stop 2023-12-19T19:01:08.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.581+0000 7f35455d1640 1 -- 172.21.15.133:0/2664400162 shutdown_connections 2023-12-19T19:01:08.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.581+0000 7f35455d1640 1 --2- 172.21.15.133:0/2664400162 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35400bf9f0 0x7f3540158330 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.581+0000 7f35455d1640 1 -- 172.21.15.133:0/2664400162 >> 172.21.15.133:0/2664400162 conn(0x7f35400c30c0 msgr2=0x7f35400c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:08.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.581+0000 7f35455d1640 1 -- 172.21.15.133:0/2664400162 shutdown_connections 2023-12-19T19:01:08.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.581+0000 7f35455d1640 1 -- 172.21.15.133:0/2664400162 wait complete. 2023-12-19T19:01:08.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.585+0000 7f35455d1640 1 Processor -- start 2023-12-19T19:01:08.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.585+0000 7f35455d1640 1 -- start start 2023-12-19T19:01:08.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.585+0000 7f35455d1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3540073a70 0x7f3540147140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:08.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.585+0000 7f35455d1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35400bf9f0 0x7f3540157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:08.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.585+0000 7f35455d1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f354014b010 0x7f35401579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:08.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.585+0000 7f35455d1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35400aab90 con 0x7f354014b010 2023-12-19T19:01:08.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.585+0000 7f35455d1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35400aa8f0 con 0x7f35400bf9f0 2023-12-19T19:01:08.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.585+0000 7f35455d1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35401f1e00 con 0x7f3540073a70 2023-12-19T19:01:08.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.585+0000 7f353f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f354014b010 0x7f35401579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:08.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.585+0000 7f353f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f354014b010 0x7f35401579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38608/0 (socket says 172.21.15.133:38608) 2023-12-19T19:01:08.591 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.585+0000 7f353f7fe640 1 -- 172.21.15.133:0/2906185515 learned_addr learned my addr 172.21.15.133:0/2906185515 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:08.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.585+0000 7f353f7fe640 1 -- 172.21.15.133:0/2906185515 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3540073a70 msgr2=0x7f3540147140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:08.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.585+0000 7f35367fc640 1 --2- 172.21.15.133:0/2906185515 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35400bf9f0 0x7f3540157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:08.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.585+0000 7f353effd640 1 --2- 172.21.15.133:0/2906185515 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3540073a70 0x7f3540147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:08.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.585+0000 7f353f7fe640 1 --2- 172.21.15.133:0/2906185515 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3540073a70 0x7f3540147140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.585+0000 7f353f7fe640 1 -- 172.21.15.133:0/2906185515 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35400bf9f0 msgr2=0x7f3540157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:08.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.585+0000 7f353f7fe640 1 --2- 172.21.15.133:0/2906185515 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35400bf9f0 0x7f3540157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.585+0000 7f353f7fe640 1 -- 172.21.15.133:0/2906185515 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3538009a70 con 0x7f354014b010 2023-12-19T19:01:08.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.585+0000 7f353effd640 1 --2- 172.21.15.133:0/2906185515 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3540073a70 0x7f3540147140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:08.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.585+0000 7f35367fc640 1 --2- 172.21.15.133:0/2906185515 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35400bf9f0 0x7f3540157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:08.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.585+0000 7f353f7fe640 1 --2- 172.21.15.133:0/2906185515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f354014b010 0x7f35401579c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f35380b3040 tx=0x7f353801be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:08.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.585+0000 7f3537fff640 1 -- 172.21.15.133:0/2906185515 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35380b0e90 con 0x7f354014b010 2023-12-19T19:01:08.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.589+0000 7f3537fff640 1 -- 172.21.15.133:0/2906185515 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3538009450 con 0x7f354014b010 2023-12-19T19:01:08.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.589+0000 7f35455d1640 1 -- 172.21.15.133:0/2906185515 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35400a9c80 con 0x7f354014b010 2023-12-19T19:01:08.592 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.589+0000 7f3537fff640 1 -- 172.21.15.133:0/2906185515 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538003be0 con 0x7f354014b010 2023-12-19T19:01:08.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.589+0000 7f35455d1640 1 -- 172.21.15.133:0/2906185515 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35401f20e0 con 0x7f354014b010 2023-12-19T19:01:08.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.589+0000 7f35455d1640 1 -- 172.21.15.133:0/2906185515 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3540068400 con 0x7f354014b010 2023-12-19T19:01:08.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.589+0000 7f3537fff640 1 -- 172.21.15.133:0/2906185515 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f35380c5450 con 0x7f354014b010 2023-12-19T19:01:08.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.589+0000 7f3537fff640 1 --2- 172.21.15.133:0/2906185515 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3524066470 0x7f3524068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:08.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.589+0000 7f3537fff640 1 -- 172.21.15.133:0/2906185515 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3538122940 con 0x7f354014b010 2023-12-19T19:01:08.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.589+0000 7f353effd640 1 --2- 172.21.15.133:0/2906185515 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3524066470 0x7f3524068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:08.594 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.589+0000 7f353effd640 1 --2- 172.21.15.133:0/2906185515 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3524066470 0x7f3524068930 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f35300011f0 tx=0x7f3530009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:08.597 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.593+0000 7f3537fff640 1 -- 172.21.15.133:0/2906185515 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f35380efb70 con 0x7f354014b010 2023-12-19T19:01:08.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.773+0000 7f35455d1640 1 -- 172.21.15.133:0/2906185515 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35400bf7d0 con 0x7f354014b010 2023-12-19T19:01:08.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.773+0000 7f3537fff640 1 -- 172.21.15.133:0/2906185515 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6194 (secure 0 0 0) 0x7f35380f3190 con 0x7f354014b010 2023-12-19T19:01:08.778 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:08.778 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3200335051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3200335051},{"type":"v1","addr":"172.21.15.133:6833","nonce":3200335051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2114705112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":2114705112},{"type":"v1","addr":"172.21.15.138:6835","nonce":2114705112}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:00:31.342186+0000","modified":"2023-12-19T19:00:34.368238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5763},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5763":{"gid":5763,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6835/1203400706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1203400706},{"type":"v1","addr":"172.21.15.133:6835","nonce":1203400706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:00:49.053498+0000","modified":"2023-12-19T19:00:52.071868+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5258":{"gid":5258,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6837/3661017926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3661017926},{"type":"v1","addr":"172.21.15.138:6837","nonce":3661017926}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T19:01:08.778 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 37 2023-12-19T19:01:08.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.777+0000 7f35455d1640 1 -- 172.21.15.133:0/2906185515 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3524066470 msgr2=0x7f3524068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:08.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.777+0000 7f35455d1640 1 --2- 172.21.15.133:0/2906185515 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3524066470 0x7f3524068930 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f35300011f0 tx=0x7f3530009040 comp rx=0 tx=0).stop 2023-12-19T19:01:08.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.777+0000 7f35455d1640 1 -- 172.21.15.133:0/2906185515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f354014b010 msgr2=0x7f35401579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:08.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.777+0000 7f35455d1640 1 --2- 172.21.15.133:0/2906185515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f354014b010 0x7f35401579c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f35380b3040 tx=0x7f353801be00 comp rx=0 tx=0).stop 2023-12-19T19:01:08.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.777+0000 7f35455d1640 1 -- 172.21.15.133:0/2906185515 shutdown_connections 2023-12-19T19:01:08.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.777+0000 7f35455d1640 1 --2- 172.21.15.133:0/2906185515 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3524066470 0x7f3524068930 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.777+0000 7f35455d1640 1 --2- 172.21.15.133:0/2906185515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f354014b010 0x7f35401579c0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.777+0000 7f35455d1640 1 --2- 172.21.15.133:0/2906185515 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f35400bf9f0 0x7f3540157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.777+0000 7f35455d1640 1 --2- 172.21.15.133:0/2906185515 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3540073a70 0x7f3540147140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.777+0000 7f35455d1640 1 -- 172.21.15.133:0/2906185515 >> 172.21.15.133:0/2906185515 conn(0x7f35400c30c0 msgr2=0x7f3540154dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:08.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.777+0000 7f35455d1640 1 -- 172.21.15.133:0/2906185515 shutdown_connections 2023-12-19T19:01:08.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.777+0000 7f35455d1640 1 -- 172.21.15.133:0/2906185515 wait complete. 2023-12-19T19:01:08.800 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:01:08.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.933+0000 7f47feafe640 1 Processor -- start 2023-12-19T19:01:08.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.937+0000 7f47feafe640 1 -- start start 2023-12-19T19:01:08.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.937+0000 7f47feafe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f47f8072090 0x7f47f8150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:08.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.937+0000 7f47feafe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47f80725c0 0x7f47f81514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:08.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.937+0000 7f47feafe640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f80c2760 con 0x7f47f80a5370 2023-12-19T19:01:08.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.937+0000 7f47feafe640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f80c3070 con 0x7f47f8072090 2023-12-19T19:01:08.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.937+0000 7f47feafe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f80a5750 con 0x7f47f80725c0 2023-12-19T19:01:08.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.937+0000 7f47effff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f47f8072090 0x7f47f8150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:08.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.937+0000 7f47fd09b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47f80725c0 0x7f47f81514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:08.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.937+0000 7f47effff640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f47f8072090 0x7f47f8150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:45340/0 (socket says 172.21.15.133:45340) 2023-12-19T19:01:08.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.937+0000 7f47effff640 1 -- 172.21.15.133:0/3328502441 learned_addr learned my addr 172.21.15.133:0/3328502441 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:08.941 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.937+0000 7f47effff640 1 -- 172.21.15.133:0/3328502441 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47f80725c0 msgr2=0x7f47f81514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:08.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.937+0000 7f47effff640 1 --2- 172.21.15.133:0/3328502441 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47f80725c0 0x7f47f81514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.937+0000 7f47effff640 1 -- 172.21.15.133:0/3328502441 >> v1:172.21.15.138:6789/0 conn(0x7f47f80a5370 legacy=0x7f47f80c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:08.942 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.937+0000 7f47effff640 1 -- 172.21.15.133:0/3328502441 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f80aad20 con 0x7f47f8072090 2023-12-19T19:01:08.944 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.941+0000 7f47effff640 1 --2- 172.21.15.133:0/3328502441 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47f8072090 0x7f47f8150fa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f47e8009870 tx=0x7f47e801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a081d7c1d6f31443 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:08.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.941+0000 7f47ef7fe640 1 -- 172.21.15.133:0/3328502441 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e80ab600 con 0x7f47f8072090 2023-12-19T19:01:08.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.941+0000 7f47ef7fe640 1 -- 172.21.15.133:0/3328502441 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e80a7050 con 0x7f47f8072090 2023-12-19T19:01:08.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.941+0000 7f47ef7fe640 1 -- 172.21.15.133:0/3328502441 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e80ab980 con 0x7f47f8072090 2023-12-19T19:01:08.945 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.941+0000 7f47feafe640 1 -- 172.21.15.133:0/3328502441 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47f8072090 msgr2=0x7f47f8150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:08.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.941+0000 7f47feafe640 1 --2- 172.21.15.133:0/3328502441 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47f8072090 0x7f47f8150fa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f47e8009870 tx=0x7f47e801c3f0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.941+0000 7f47feafe640 1 -- 172.21.15.133:0/3328502441 shutdown_connections 2023-12-19T19:01:08.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.941+0000 7f47feafe640 1 --2- 172.21.15.133:0/3328502441 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47f80725c0 0x7f47f81514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.941+0000 7f47feafe640 1 --2- 172.21.15.133:0/3328502441 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47f8072090 0x7f47f8150fa0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.941+0000 7f47feafe640 1 -- 172.21.15.133:0/3328502441 >> 172.21.15.133:0/3328502441 conn(0x7f47f806a5b0 msgr2=0x7f47f806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:08.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.941+0000 7f47feafe640 1 -- 172.21.15.133:0/3328502441 shutdown_connections 2023-12-19T19:01:08.946 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.941+0000 7f47feafe640 1 -- 172.21.15.133:0/3328502441 wait complete. 2023-12-19T19:01:08.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.941+0000 7f47feafe640 1 Processor -- start 2023-12-19T19:01:08.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47feafe640 1 -- start start 2023-12-19T19:01:08.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47feafe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47f8072090 0x7f47f8145c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:08.948 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47feafe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47f80725c0 0x7f47f8148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:08.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47feafe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47f80a5370 0x7f47f815e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:08.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47feafe640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f80a5930 con 0x7f47f8072090 2023-12-19T19:01:08.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47feafe640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f81f15a0 con 0x7f47f80725c0 2023-12-19T19:01:08.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47feafe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f815e550 con 0x7f47f80a5370 2023-12-19T19:01:08.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47fc89a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47f8072090 0x7f47f8145c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:08.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47fc89a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47f8072090 0x7f47f8145c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38618/0 (socket says 172.21.15.133:38618) 2023-12-19T19:01:08.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47fc89a640 1 -- 172.21.15.133:0/3182272520 learned_addr learned my addr 172.21.15.133:0/3182272520 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:08.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47fd09b640 1 --2- 172.21.15.133:0/3182272520 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47f80a5370 0x7f47f815e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:08.949 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47effff640 1 --2- 172.21.15.133:0/3182272520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47f80725c0 0x7f47f8148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:08.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47fc89a640 1 -- 172.21.15.133:0/3182272520 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47f80a5370 msgr2=0x7f47f815e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:08.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47fc89a640 1 --2- 172.21.15.133:0/3182272520 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47f80a5370 0x7f47f815e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47fc89a640 1 -- 172.21.15.133:0/3182272520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47f80725c0 msgr2=0x7f47f8148fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:08.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47fc89a640 1 --2- 172.21.15.133:0/3182272520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47f80725c0 0x7f47f8148fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:08.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47fc89a640 1 -- 172.21.15.133:0/3182272520 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e80094d0 con 0x7f47f8072090 2023-12-19T19:01:08.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47fc89a640 1 --2- 172.21.15.133:0/3182272520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47f8072090 0x7f47f8145c60 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f47f400c420 tx=0x7f47f400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:08.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47ed7fa640 1 -- 172.21.15.133:0/3182272520 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f40052d0 con 0x7f47f8072090 2023-12-19T19:01:08.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47ed7fa640 1 -- 172.21.15.133:0/3182272520 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f4005430 con 0x7f47f8072090 2023-12-19T19:01:08.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47ed7fa640 1 -- 172.21.15.133:0/3182272520 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f4003840 con 0x7f47f8072090 2023-12-19T19:01:08.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47feafe640 1 -- 172.21.15.133:0/3182272520 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f80a70a0 con 0x7f47f8072090 2023-12-19T19:01:08.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47feafe640 1 -- 172.21.15.133:0/3182272520 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f80a7660 con 0x7f47f8072090 2023-12-19T19:01:08.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.945+0000 7f47feafe640 1 -- 172.21.15.133:0/3182272520 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f8068400 con 0x7f47f8072090 2023-12-19T19:01:08.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.949+0000 7f47ed7fa640 1 -- 172.21.15.133:0/3182272520 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f47f40039a0 con 0x7f47f8072090 2023-12-19T19:01:08.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.949+0000 7f47ed7fa640 1 --2- 172.21.15.133:0/3182272520 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f47e40664a0 0x7f47e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:08.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.949+0000 7f47ed7fa640 1 -- 172.21.15.133:0/3182272520 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f47f40836b0 con 0x7f47f8072090 2023-12-19T19:01:08.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.949+0000 7f47effff640 1 --2- 172.21.15.133:0/3182272520 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f47e40664a0 0x7f47e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:08.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.949+0000 7f47effff640 1 --2- 172.21.15.133:0/3182272520 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f47e40664a0 0x7f47e4068960 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f47e80ad000 tx=0x7f47e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:08.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:08.953+0000 7f47ed7fa640 1 -- 172.21.15.133:0/3182272520 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f47f40507e0 con 0x7f47f8072090 2023-12-19T19:01:09.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.133+0000 7f47feafe640 1 -- 172.21.15.133:0/3182272520 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47f815ab60 con 0x7f47f8072090 2023-12-19T19:01:09.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.133+0000 7f47ed7fa640 1 -- 172.21.15.133:0/3182272520 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6194 (secure 0 0 0) 0x7f47f4053e00 con 0x7f47f8072090 2023-12-19T19:01:09.137 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:09.137 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3200335051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3200335051},{"type":"v1","addr":"172.21.15.133:6833","nonce":3200335051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2114705112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":2114705112},{"type":"v1","addr":"172.21.15.138:6835","nonce":2114705112}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:00:31.342186+0000","modified":"2023-12-19T19:00:34.368238+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5763},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5763":{"gid":5763,"name":"c","rank":0,"incarnation":29,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6835/1203400706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1203400706},{"type":"v1","addr":"172.21.15.133:6835","nonce":1203400706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:00:49.053498+0000","modified":"2023-12-19T19:00:52.071868+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5258":{"gid":5258,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6837/3661017926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3661017926},{"type":"v1","addr":"172.21.15.138:6837","nonce":3661017926}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T19:01:09.137 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 37 2023-12-19T19:01:09.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.133+0000 7f47feafe640 1 -- 172.21.15.133:0/3182272520 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f47e40664a0 msgr2=0x7f47e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:09.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.133+0000 7f47feafe640 1 --2- 172.21.15.133:0/3182272520 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f47e40664a0 0x7f47e4068960 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f47e80ad000 tx=0x7f47e8008040 comp rx=0 tx=0).stop 2023-12-19T19:01:09.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.133+0000 7f47feafe640 1 -- 172.21.15.133:0/3182272520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47f8072090 msgr2=0x7f47f8145c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:09.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.133+0000 7f47feafe640 1 --2- 172.21.15.133:0/3182272520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47f8072090 0x7f47f8145c60 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f47f400c420 tx=0x7f47f400c8e0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.133+0000 7f47feafe640 1 -- 172.21.15.133:0/3182272520 shutdown_connections 2023-12-19T19:01:09.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.133+0000 7f47feafe640 1 --2- 172.21.15.133:0/3182272520 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f47e40664a0 0x7f47e4068960 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.133+0000 7f47feafe640 1 --2- 172.21.15.133:0/3182272520 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f47f80a5370 0x7f47f815e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.133+0000 7f47feafe640 1 --2- 172.21.15.133:0/3182272520 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f47f80725c0 0x7f47f8148fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.133+0000 7f47feafe640 1 --2- 172.21.15.133:0/3182272520 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47f8072090 0x7f47f8145c60 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.133+0000 7f47feafe640 1 -- 172.21.15.133:0/3182272520 >> 172.21.15.133:0/3182272520 conn(0x7f47f806a5b0 msgr2=0x7f47f80c0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:09.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.133+0000 7f47feafe640 1 -- 172.21.15.133:0/3182272520 shutdown_connections 2023-12-19T19:01:09.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.133+0000 7f47feafe640 1 -- 172.21.15.133:0/3182272520 wait complete. 2023-12-19T19:01:09.158 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:01:09.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.293+0000 7fd8a2980640 1 Processor -- start 2023-12-19T19:01:09.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.293+0000 7fd8a2980640 1 -- start start 2023-12-19T19:01:09.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.293+0000 7fd8a2980640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd89c151e90 0x7fd89c0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:09.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.293+0000 7fd8a2980640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd89c0c7ea0 0x7fd89c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:09.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.293+0000 7fd8a2980640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89c06c860 con 0x7fd89c0c4e60 2023-12-19T19:01:09.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.293+0000 7fd8a2980640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89c0c8750 con 0x7fd89c151e90 2023-12-19T19:01:09.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.293+0000 7fd8a2980640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89c1552d0 con 0x7fd89c0c7ea0 2023-12-19T19:01:09.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.293+0000 7fd89bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd89c151e90 0x7fd89c0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:09.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.293+0000 7fd8a0f1d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd89c0c4e60 0x7fd89c06b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38174/0 (socket says 172.21.15.133:38174) 2023-12-19T19:01:09.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.293+0000 7fd8a0f1d640 1 -- 172.21.15.133:0/489242601 learned_addr learned my addr 172.21.15.133:0/489242601 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:09.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.293+0000 7fd89b7fe640 1 --2- 172.21.15.133:0/489242601 >> v2:172.21.15.138:3300/0 conn(0x7fd89c0c7ea0 0x7fd89c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:09.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.293+0000 7fd89bfff640 1 -- 172.21.15.133:0/489242601 >> v2:172.21.15.138:3300/0 conn(0x7fd89c0c7ea0 msgr2=0x7fd89c06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:09.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.293+0000 7fd89bfff640 1 --2- 172.21.15.133:0/489242601 >> v2:172.21.15.138:3300/0 conn(0x7fd89c0c7ea0 0x7fd89c06b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.293+0000 7fd89bfff640 1 -- 172.21.15.133:0/489242601 >> v1:172.21.15.133:6789/0 conn(0x7fd89c0c4e60 legacy=0x7fd89c06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:09.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.293+0000 7fd89affd640 1 -- 172.21.15.133:0/489242601 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229334841 0 0) 0x7fd89c06c860 con 0x7fd89c0c4e60 2023-12-19T19:01:09.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.293+0000 7fd89bfff640 1 -- 172.21.15.133:0/489242601 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c154930 con 0x7fd89c151e90 2023-12-19T19:01:09.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.297+0000 7fd89bfff640 1 --2- 172.21.15.133:0/489242601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd89c151e90 0x7fd89c0c4920 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd89c0a9a70 tx=0x7fd88c01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec4a27443fb640c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:09.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.297+0000 7fd89affd640 1 -- 172.21.15.133:0/489242601 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c0ab600 con 0x7fd89c151e90 2023-12-19T19:01:09.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.297+0000 7fd89affd640 1 -- 172.21.15.133:0/489242601 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88c0a7050 con 0x7fd89c151e90 2023-12-19T19:01:09.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.297+0000 7fd89affd640 1 -- 172.21.15.133:0/489242601 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c0ab980 con 0x7fd89c151e90 2023-12-19T19:01:09.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.297+0000 7fd8a2980640 1 -- 172.21.15.133:0/489242601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd89c151e90 msgr2=0x7fd89c0c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:09.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.297+0000 7fd8a2980640 1 --2- 172.21.15.133:0/489242601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd89c151e90 0x7fd89c0c4920 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd89c0a9a70 tx=0x7fd88c01c340 comp rx=0 tx=0).stop 2023-12-19T19:01:09.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.297+0000 7fd8a2980640 1 -- 172.21.15.133:0/489242601 shutdown_connections 2023-12-19T19:01:09.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.297+0000 7fd8a2980640 1 --2- 172.21.15.133:0/489242601 >> v2:172.21.15.138:3300/0 conn(0x7fd89c0c7ea0 0x7fd89c06b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.297+0000 7fd8a2980640 1 --2- 172.21.15.133:0/489242601 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd89c151e90 0x7fd89c0c4920 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.297+0000 7fd8a2980640 1 -- 172.21.15.133:0/489242601 >> 172.21.15.133:0/489242601 conn(0x7fd89c0ca170 msgr2=0x7fd89c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:09.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.297+0000 7fd8a2980640 1 -- 172.21.15.133:0/489242601 shutdown_connections 2023-12-19T19:01:09.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.297+0000 7fd8a2980640 1 -- 172.21.15.133:0/489242601 wait complete. 2023-12-19T19:01:09.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd8a2980640 1 Processor -- start 2023-12-19T19:01:09.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd8a2980640 1 -- start start 2023-12-19T19:01:09.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd8a2980640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd89c0c4e60 0x7fd89c0aa9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:09.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd8a2980640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd89c0c7ea0 0x7fd89c14b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:09.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd8a2980640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd89c151e90 0x7fd89c1ed8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:09.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd8a2980640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c14e910 con 0x7fd89c0c4e60 2023-12-19T19:01:09.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd8a2980640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c0c3cd0 con 0x7fd89c0c7ea0 2023-12-19T19:01:09.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd8a2980640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c0aaef0 con 0x7fd89c151e90 2023-12-19T19:01:09.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd89bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd89c0c4e60 0x7fd89c0aa9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:09.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd89bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd89c0c4e60 0x7fd89c0aa9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38640/0 (socket says 172.21.15.133:38640) 2023-12-19T19:01:09.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd89bfff640 1 -- 172.21.15.133:0/1345418165 learned_addr learned my addr 172.21.15.133:0/1345418165 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:09.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd89b7fe640 1 --2- 172.21.15.133:0/1345418165 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd89c0c7ea0 0x7fd89c14b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:09.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd8a0f1d640 1 --2- 172.21.15.133:0/1345418165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd89c151e90 0x7fd89c1ed8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:09.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd89bfff640 1 -- 172.21.15.133:0/1345418165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd89c151e90 msgr2=0x7fd89c1ed8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:09.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd89bfff640 1 --2- 172.21.15.133:0/1345418165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd89c151e90 0x7fd89c1ed8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd89bfff640 1 -- 172.21.15.133:0/1345418165 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd89c0c7ea0 msgr2=0x7fd89c14b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:09.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd89bfff640 1 --2- 172.21.15.133:0/1345418165 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd89c0c7ea0 0x7fd89c14b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd89bfff640 1 -- 172.21.15.133:0/1345418165 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88c009420 con 0x7fd89c0c4e60 2023-12-19T19:01:09.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd8a0f1d640 1 --2- 172.21.15.133:0/1345418165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd89c151e90 0x7fd89c1ed8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:09.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd89b7fe640 1 --2- 172.21.15.133:0/1345418165 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd89c0c7ea0 0x7fd89c14b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:09.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd89bfff640 1 --2- 172.21.15.133:0/1345418165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd89c0c4e60 0x7fd89c0aa9b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0ae040 tx=0x7fd88c01ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:09.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd898ff9640 1 -- 172.21.15.133:0/1345418165 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c0b7450 con 0x7fd89c0c4e60 2023-12-19T19:01:09.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd898ff9640 1 -- 172.21.15.133:0/1345418165 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88c0b75d0 con 0x7fd89c0c4e60 2023-12-19T19:01:09.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd8a2980640 1 -- 172.21.15.133:0/1345418165 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89c14c2c0 con 0x7fd89c0c4e60 2023-12-19T19:01:09.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd898ff9640 1 -- 172.21.15.133:0/1345418165 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c0b7980 con 0x7fd89c0c4e60 2023-12-19T19:01:09.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.301+0000 7fd8a2980640 1 -- 172.21.15.133:0/1345418165 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd89c14bfe0 con 0x7fd89c0c4e60 2023-12-19T19:01:09.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.305+0000 7fd8a2980640 1 -- 172.21.15.133:0/1345418165 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd89c1ecf60 con 0x7fd89c0c4e60 2023-12-19T19:01:09.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.305+0000 7fd898ff9640 1 -- 172.21.15.133:0/1345418165 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd88c0b7ae0 con 0x7fd89c0c4e60 2023-12-19T19:01:09.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.305+0000 7fd898ff9640 1 --2- 172.21.15.133:0/1345418165 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd888066470 0x7fd888068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:09.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.305+0000 7fd898ff9640 1 -- 172.21.15.133:0/1345418165 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd88c11eb70 con 0x7fd89c0c4e60 2023-12-19T19:01:09.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.305+0000 7fd89b7fe640 1 --2- 172.21.15.133:0/1345418165 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd888066470 0x7fd888068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:09.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.305+0000 7fd89b7fe640 1 --2- 172.21.15.133:0/1345418165 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd888066470 0x7fd888068930 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd89c1512a0 tx=0x7fd890008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:09.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.309+0000 7fd898ff9640 1 -- 172.21.15.133:0/1345418165 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd89c1ecf60 con 0x7fd89c0c4e60 2023-12-19T19:01:09.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.461+0000 7fd8a2980640 1 -- 172.21.15.133:0/1345418165 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd89c1ecf60 con 0x7fd89c0c4e60 2023-12-19T19:01:09.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.465+0000 7fd898ff9640 1 -- 172.21.15.133:0/1345418165 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+20316 (secure 0 0 0) 0x7fd89c1ecf60 con 0x7fd89c0c4e60 2023-12-19T19:01:09.467 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:09.467 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":54,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:00:50.680936+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:00:29.085029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T19:00:30.359577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:00:46.784805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:00:48.051355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:01:09.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.465+0000 7fd8a2980640 1 -- 172.21.15.133:0/1345418165 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd888066470 msgr2=0x7fd888068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:09.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.465+0000 7fd8a2980640 1 --2- 172.21.15.133:0/1345418165 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd888066470 0x7fd888068930 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd89c1512a0 tx=0x7fd890008040 comp rx=0 tx=0).stop 2023-12-19T19:01:09.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.465+0000 7fd8a2980640 1 -- 172.21.15.133:0/1345418165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd89c0c4e60 msgr2=0x7fd89c0aa9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:09.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.465+0000 7fd8a2980640 1 --2- 172.21.15.133:0/1345418165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd89c0c4e60 0x7fd89c0aa9b0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0ae040 tx=0x7fd88c01ab80 comp rx=0 tx=0).stop 2023-12-19T19:01:09.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.465+0000 7fd8a2980640 1 -- 172.21.15.133:0/1345418165 shutdown_connections 2023-12-19T19:01:09.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.465+0000 7fd8a2980640 1 --2- 172.21.15.133:0/1345418165 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd888066470 0x7fd888068930 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.465+0000 7fd8a2980640 1 --2- 172.21.15.133:0/1345418165 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd89c151e90 0x7fd89c1ed8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.465+0000 7fd8a2980640 1 --2- 172.21.15.133:0/1345418165 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd89c0c7ea0 0x7fd89c14b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.465+0000 7fd8a2980640 1 --2- 172.21.15.133:0/1345418165 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd89c0c4e60 0x7fd89c0aa9b0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.465+0000 7fd8a2980640 1 -- 172.21.15.133:0/1345418165 >> 172.21.15.133:0/1345418165 conn(0x7fd89c0ca170 msgr2=0x7fd89c15e360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:09.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.465+0000 7fd8a2980640 1 -- 172.21.15.133:0/1345418165 shutdown_connections 2023-12-19T19:01:09.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.465+0000 7fd8a2980640 1 -- 172.21.15.133:0/1345418165 wait complete. 2023-12-19T19:01:09.489 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T19:01:09.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.625+0000 7f42d97f8640 1 Processor -- start 2023-12-19T19:01:09.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.625+0000 7f42d97f8640 1 -- start start 2023-12-19T19:01:09.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.625+0000 7f42d97f8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d4151dc0 0x7f42d40c4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:09.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.625+0000 7f42d97f8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f42d40c7ed0 0x7f42d4154650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:09.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.625+0000 7f42d97f8640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d40ac4f0 con 0x7f42d40bd660 2023-12-19T19:01:09.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.625+0000 7f42d97f8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d4158780 con 0x7f42d40c7ed0 2023-12-19T19:01:09.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.625+0000 7f42d97f8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d4158a60 con 0x7f42d4151dc0 2023-12-19T19:01:09.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.625+0000 7f42d37fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f42d40bd660 0x7f42d4154b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38180/0 (socket says 172.21.15.133:38180) 2023-12-19T19:01:09.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.625+0000 7f42d37fe640 1 -- 172.21.15.133:0/919806481 learned_addr learned my addr 172.21.15.133:0/919806481 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:09.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.625+0000 7f42d27fc640 1 --2- 172.21.15.133:0/919806481 >> v2:172.21.15.138:3300/0 conn(0x7f42d40c7ed0 0x7f42d4154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:09.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.625+0000 7f42d2ffd640 1 --2- 172.21.15.133:0/919806481 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d4151dc0 0x7f42d40c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:09.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.625+0000 7f42d1ffb640 1 -- 172.21.15.133:0/919806481 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1783033449 0 0) 0x7f42d40ac4f0 con 0x7f42d40bd660 2023-12-19T19:01:09.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.625+0000 7f42d1ffb640 1 -- 172.21.15.133:0/919806481 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42bc003530 con 0x7f42d40bd660 2023-12-19T19:01:09.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.625+0000 7f42d1ffb640 1 -- 172.21.15.133:0/919806481 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3646777335 0 0) 0x7f42bc003530 con 0x7f42d40bd660 2023-12-19T19:01:09.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.625+0000 7f42d27fc640 1 -- 172.21.15.133:0/919806481 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d4151dc0 msgr2=0x7f42d40c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:09.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.625+0000 7f42d27fc640 1 --2- 172.21.15.133:0/919806481 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d4151dc0 0x7f42d40c4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.625+0000 7f42d27fc640 1 -- 172.21.15.133:0/919806481 >> v1:172.21.15.133:6789/0 conn(0x7f42d40bd660 legacy=0x7f42d4154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:09.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.625+0000 7f42d27fc640 1 -- 172.21.15.133:0/919806481 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d40ac180 con 0x7f42d40c7ed0 2023-12-19T19:01:09.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.629+0000 7f42d27fc640 1 --2- 172.21.15.133:0/919806481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d40c7ed0 0x7f42d4154650 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f42c80097c0 tx=0x7f42c801c280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2695dcee576051ac server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:09.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.629+0000 7f42d1ffb640 1 -- 172.21.15.133:0/919806481 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc001a00 con 0x7f42d40c7ed0 2023-12-19T19:01:09.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.629+0000 7f42d1ffb640 1 -- 172.21.15.133:0/919806481 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c80a7050 con 0x7f42d40c7ed0 2023-12-19T19:01:09.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.629+0000 7f42d1ffb640 1 -- 172.21.15.133:0/919806481 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c80ab620 con 0x7f42d40c7ed0 2023-12-19T19:01:09.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.629+0000 7f42d97f8640 1 -- 172.21.15.133:0/919806481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d40c7ed0 msgr2=0x7f42d4154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:09.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.629+0000 7f42d97f8640 1 --2- 172.21.15.133:0/919806481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d40c7ed0 0x7f42d4154650 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f42c80097c0 tx=0x7f42c801c280 comp rx=0 tx=0).stop 2023-12-19T19:01:09.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.629+0000 7f42d97f8640 1 -- 172.21.15.133:0/919806481 shutdown_connections 2023-12-19T19:01:09.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.629+0000 7f42d97f8640 1 --2- 172.21.15.133:0/919806481 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d40c7ed0 0x7f42d4154650 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.629+0000 7f42d97f8640 1 --2- 172.21.15.133:0/919806481 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d4151dc0 0x7f42d40c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.629+0000 7f42d97f8640 1 -- 172.21.15.133:0/919806481 >> 172.21.15.133:0/919806481 conn(0x7f42d4071eb0 msgr2=0x7f42d40722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:09.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.629+0000 7f42d97f8640 1 -- 172.21.15.133:0/919806481 shutdown_connections 2023-12-19T19:01:09.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.629+0000 7f42d97f8640 1 -- 172.21.15.133:0/919806481 wait complete. 2023-12-19T19:01:09.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42d97f8640 1 Processor -- start 2023-12-19T19:01:09.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42d97f8640 1 -- start start 2023-12-19T19:01:09.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42d97f8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d40bd660 0x7f42d4153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:09.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42d97f8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d40c7ed0 0x7f42d40c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:09.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42d97f8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42d4151dc0 0x7f42d414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:09.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42d97f8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d41f0c30 con 0x7f42d4151dc0 2023-12-19T19:01:09.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42d97f8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40c4050 con 0x7f42d40bd660 2023-12-19T19:01:09.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42d97f8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d41f0300 con 0x7f42d40c7ed0 2023-12-19T19:01:09.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42d37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42d4151dc0 0x7f42d414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:09.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42d37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42d4151dc0 0x7f42d414b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38644/0 (socket says 172.21.15.133:38644) 2023-12-19T19:01:09.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42d37fe640 1 -- 172.21.15.133:0/1373477919 learned_addr learned my addr 172.21.15.133:0/1373477919 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:09.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42d2ffd640 1 --2- 172.21.15.133:0/1373477919 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d40bd660 0x7f42d4153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:09.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42d27fc640 1 --2- 172.21.15.133:0/1373477919 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d40c7ed0 0x7f42d40c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:09.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42d37fe640 1 -- 172.21.15.133:0/1373477919 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d40c7ed0 msgr2=0x7f42d40c37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:09.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42d37fe640 1 --2- 172.21.15.133:0/1373477919 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d40c7ed0 0x7f42d40c37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42d37fe640 1 -- 172.21.15.133:0/1373477919 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d40bd660 msgr2=0x7f42d4153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:09.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42d37fe640 1 --2- 172.21.15.133:0/1373477919 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d40bd660 0x7f42d4153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42d37fe640 1 -- 172.21.15.133:0/1373477919 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c8009420 con 0x7f42d4151dc0 2023-12-19T19:01:09.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42d37fe640 1 --2- 172.21.15.133:0/1373477919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42d4151dc0 0x7f42d414b2f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00cc90 tx=0x7f42cc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:09.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42bb7fe640 1 -- 172.21.15.133:0/1373477919 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc00cea0 con 0x7f42d4151dc0 2023-12-19T19:01:09.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42bb7fe640 1 -- 172.21.15.133:0/1373477919 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42cc012400 con 0x7f42d4151dc0 2023-12-19T19:01:09.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42d97f8640 1 -- 172.21.15.133:0/1373477919 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d41f05e0 con 0x7f42d4151dc0 2023-12-19T19:01:09.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42bb7fe640 1 -- 172.21.15.133:0/1373477919 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42cc0127b0 con 0x7f42d4151dc0 2023-12-19T19:01:09.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42d97f8640 1 -- 172.21.15.133:0/1373477919 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d4153cb0 con 0x7f42d4151dc0 2023-12-19T19:01:09.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.633+0000 7f42d97f8640 1 -- 172.21.15.133:0/1373477919 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d4068400 con 0x7f42d4151dc0 2023-12-19T19:01:09.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.637+0000 7f42bb7fe640 1 -- 172.21.15.133:0/1373477919 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f42cc007070 con 0x7f42d4151dc0 2023-12-19T19:01:09.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.637+0000 7f42bb7fe640 1 --2- 172.21.15.133:0/1373477919 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f42c0066470 0x7f42c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:09.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.637+0000 7f42bb7fe640 1 -- 172.21.15.133:0/1373477919 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f42cc0842f0 con 0x7f42d4151dc0 2023-12-19T19:01:09.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.637+0000 7f42d2ffd640 1 --2- 172.21.15.133:0/1373477919 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f42c0066470 0x7f42c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:09.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.637+0000 7f42d2ffd640 1 --2- 172.21.15.133:0/1373477919 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f42c0066470 0x7f42c0068930 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f42d40c3560 tx=0x7f42c4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:09.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.641+0000 7f42bb7fe640 1 -- 172.21.15.133:0/1373477919 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f42cc0514b0 con 0x7f42d4151dc0 2023-12-19T19:01:09.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.821+0000 7f42d97f8640 1 -- 172.21.15.133:0/1373477919 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f42d41f0d70 con 0x7f42d4151dc0 2023-12-19T19:01:09.827 INFO:tasks.ceph.mon.a.smithi133.stderr:2023-12-19T19:01:09.825+0000 7f5189f85640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T19:01:09.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.825+0000 7f42bb7fe640 1 -- 172.21.15.133:0/1373477919 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) v1 ==== 161+0+0 (secure 0 0 0) 0x7f42cc054ad0 con 0x7f42d4151dc0 2023-12-19T19:01:09.830 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T19:01:09.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.829+0000 7f42d97f8640 1 -- 172.21.15.133:0/1373477919 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f42c0066470 msgr2=0x7f42c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:09.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.829+0000 7f42d97f8640 1 --2- 172.21.15.133:0/1373477919 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f42c0066470 0x7f42c0068930 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f42d40c3560 tx=0x7f42c4009190 comp rx=0 tx=0).stop 2023-12-19T19:01:09.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.829+0000 7f42d97f8640 1 -- 172.21.15.133:0/1373477919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42d4151dc0 msgr2=0x7f42d414b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:09.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.829+0000 7f42d97f8640 1 --2- 172.21.15.133:0/1373477919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42d4151dc0 0x7f42d414b2f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00cc90 tx=0x7f42cc00a430 comp rx=0 tx=0).stop 2023-12-19T19:01:09.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.829+0000 7f42d97f8640 1 -- 172.21.15.133:0/1373477919 shutdown_connections 2023-12-19T19:01:09.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.829+0000 7f42d97f8640 1 --2- 172.21.15.133:0/1373477919 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f42c0066470 0x7f42c0068930 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.829+0000 7f42d97f8640 1 --2- 172.21.15.133:0/1373477919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f42d4151dc0 0x7f42d414b2f0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.829+0000 7f42d97f8640 1 --2- 172.21.15.133:0/1373477919 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f42d40c7ed0 0x7f42d40c37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.829+0000 7f42d97f8640 1 --2- 172.21.15.133:0/1373477919 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f42d40bd660 0x7f42d4153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.829+0000 7f42d97f8640 1 -- 172.21.15.133:0/1373477919 >> 172.21.15.133:0/1373477919 conn(0x7f42d4071eb0 msgr2=0x7f42d40ab3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:09.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.829+0000 7f42d97f8640 1 -- 172.21.15.133:0/1373477919 shutdown_connections 2023-12-19T19:01:09.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.829+0000 7f42d97f8640 1 -- 172.21.15.133:0/1373477919 wait complete. 2023-12-19T19:01:09.840 INFO:tasks.ceph.mds.c.smithi133.stderr: -2831> 2023-12-19T19:00:35.150+0000 7f58d758b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T19:01:09.854 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T19:01:09.887 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2023-12-19T19:01:09.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.989+0000 7f84cd409640 1 Processor -- start 2023-12-19T19:01:09.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.989+0000 7f84cd409640 1 -- start start 2023-12-19T19:01:09.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.993+0000 7f84cd409640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84c80a5370 0x7f84c80c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:09.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.993+0000 7f84cd409640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f84c80c4110 0x7f84c8150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:09.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.993+0000 7f84cd409640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c80c2760 con 0x7f84c8072090 2023-12-19T19:01:09.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.993+0000 7f84cd409640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c80c3070 con 0x7f84c80c4110 2023-12-19T19:01:09.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.993+0000 7f84cd409640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c8151bf0 con 0x7f84c80a5370 2023-12-19T19:01:09.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.993+0000 7f84c67fc640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f84c80c4110 0x7f84c8150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:09.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.993+0000 7f84c6ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84c80a5370 0x7f84c80c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:09.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.993+0000 7f84c67fc640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f84c80c4110 0x7f84c8150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:45408/0 (socket says 172.21.15.133:45408) 2023-12-19T19:01:09.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.993+0000 7f84c67fc640 1 -- 172.21.15.133:0/878346916 learned_addr learned my addr 172.21.15.133:0/878346916 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:09.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.993+0000 7f84c67fc640 1 -- 172.21.15.133:0/878346916 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84c80a5370 msgr2=0x7f84c80c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:09.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.993+0000 7f84c67fc640 1 --2- 172.21.15.133:0/878346916 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84c80a5370 0x7f84c80c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:09.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.993+0000 7f84c67fc640 1 -- 172.21.15.133:0/878346916 >> v1:172.21.15.138:6789/0 conn(0x7f84c8072090 legacy=0x7f84c81514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:09.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.993+0000 7f84c67fc640 1 -- 172.21.15.133:0/878346916 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c80a5750 con 0x7f84c80c4110 2023-12-19T19:01:09.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.997+0000 7f84c67fc640 1 --2- 172.21.15.133:0/878346916 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84c80c4110 0x7f84c8150fa0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00b930 tx=0x7f84bc01ca90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ad42f9e35b4f106 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:10.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.997+0000 7f84c5ffb640 1 -- 172.21.15.133:0/878346916 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc004230 con 0x7f84c80c4110 2023-12-19T19:01:10.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.997+0000 7f84c5ffb640 1 -- 172.21.15.133:0/878346916 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84bc0a9070 con 0x7f84c80c4110 2023-12-19T19:01:10.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.997+0000 7f84c5ffb640 1 -- 172.21.15.133:0/878346916 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc0a58e0 con 0x7f84c80c4110 2023-12-19T19:01:10.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.997+0000 7f84cd409640 1 -- 172.21.15.133:0/878346916 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84c80c4110 msgr2=0x7f84c8150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:10.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.997+0000 7f84cd409640 1 --2- 172.21.15.133:0/878346916 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84c80c4110 0x7f84c8150fa0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00b930 tx=0x7f84bc01ca90 comp rx=0 tx=0).stop 2023-12-19T19:01:10.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.997+0000 7f84cd409640 1 -- 172.21.15.133:0/878346916 shutdown_connections 2023-12-19T19:01:10.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.997+0000 7f84cd409640 1 --2- 172.21.15.133:0/878346916 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84c80c4110 0x7f84c8150fa0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:10.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.997+0000 7f84cd409640 1 --2- 172.21.15.133:0/878346916 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84c80a5370 0x7f84c80c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:10.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.997+0000 7f84cd409640 1 -- 172.21.15.133:0/878346916 >> 172.21.15.133:0/878346916 conn(0x7f84c806a5b0 msgr2=0x7f84c806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:10.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.997+0000 7f84cd409640 1 -- 172.21.15.133:0/878346916 shutdown_connections 2023-12-19T19:01:10.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.997+0000 7f84cd409640 1 -- 172.21.15.133:0/878346916 wait complete. 2023-12-19T19:01:10.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.997+0000 7f84cd409640 1 Processor -- start 2023-12-19T19:01:10.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:09.997+0000 7f84cd409640 1 -- start start 2023-12-19T19:01:10.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.001+0000 7f84cd409640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84c8072090 0x7f84c814fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:10.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.001+0000 7f84cd409640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84c80a5370 0x7f84c8071610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:10.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.001+0000 7f84cd409640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84c80c4110 0x7f84c814d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:10.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.001+0000 7f84cd409640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c8153630 con 0x7f84c80c4110 2023-12-19T19:01:10.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.001+0000 7f84cd409640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c8154200 con 0x7f84c8072090 2023-12-19T19:01:10.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.001+0000 7f84cd409640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c81538d0 con 0x7f84c80a5370 2023-12-19T19:01:10.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.001+0000 7f84c6ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84c8072090 0x7f84c814fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:10.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.001+0000 7f84c77fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84c80c4110 0x7f84c814d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:10.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.001+0000 7f84c6ffd640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84c8072090 0x7f84c814fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:45414/0 (socket says 172.21.15.133:45414) 2023-12-19T19:01:10.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.001+0000 7f84c6ffd640 1 -- 172.21.15.133:0/4047403826 learned_addr learned my addr 172.21.15.133:0/4047403826 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:10.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.001+0000 7f84c67fc640 1 --2- 172.21.15.133:0/4047403826 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84c80a5370 0x7f84c8071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:10.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.001+0000 7f84c6ffd640 1 -- 172.21.15.133:0/4047403826 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84c80a5370 msgr2=0x7f84c8071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:10.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.001+0000 7f84c6ffd640 1 --2- 172.21.15.133:0/4047403826 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84c80a5370 0x7f84c8071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:10.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.001+0000 7f84c6ffd640 1 -- 172.21.15.133:0/4047403826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84c80c4110 msgr2=0x7f84c814d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:10.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.001+0000 7f84c6ffd640 1 --2- 172.21.15.133:0/4047403826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84c80c4110 0x7f84c814d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:10.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.001+0000 7f84c6ffd640 1 -- 172.21.15.133:0/4047403826 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc00b590 con 0x7f84c8072090 2023-12-19T19:01:10.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.001+0000 7f84c6ffd640 1 --2- 172.21.15.133:0/4047403826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84c8072090 0x7f84c814fcd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f84b8012fc0 tx=0x7f84b8010490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:10.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.001+0000 7f84af7fe640 1 -- 172.21.15.133:0/4047403826 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b800db30 con 0x7f84c8072090 2023-12-19T19:01:10.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.001+0000 7f84af7fe640 1 -- 172.21.15.133:0/4047403826 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b8013040 con 0x7f84c8072090 2023-12-19T19:01:10.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.001+0000 7f84af7fe640 1 -- 172.21.15.133:0/4047403826 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b800de70 con 0x7f84c8072090 2023-12-19T19:01:10.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.001+0000 7f84cd409640 1 -- 172.21.15.133:0/4047403826 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c8153bb0 con 0x7f84c8072090 2023-12-19T19:01:10.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.001+0000 7f84cd409640 1 -- 172.21.15.133:0/4047403826 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c8150210 con 0x7f84c8072090 2023-12-19T19:01:10.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.001+0000 7f84cd409640 1 -- 172.21.15.133:0/4047403826 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c8068400 con 0x7f84c8072090 2023-12-19T19:01:10.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.005+0000 7f84af7fe640 1 -- 172.21.15.133:0/4047403826 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f84b8018480 con 0x7f84c8072090 2023-12-19T19:01:10.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.005+0000 7f84af7fe640 1 --2- 172.21.15.133:0/4047403826 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f84b4066470 0x7f84b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:10.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.005+0000 7f84af7fe640 1 -- 172.21.15.133:0/4047403826 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f84b8088d10 con 0x7f84c8072090 2023-12-19T19:01:10.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.005+0000 7f84c67fc640 1 --2- 172.21.15.133:0/4047403826 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f84b4066470 0x7f84b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:10.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.005+0000 7f84c67fc640 1 --2- 172.21.15.133:0/4047403826 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f84b4066470 0x7f84b4068930 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0af000 tx=0x7f84bc0b1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:10.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.009+0000 7f84af7fe640 1 -- 172.21.15.133:0/4047403826 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f84b8055e80 con 0x7f84c8072090 2023-12-19T19:01:10.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.193+0000 7f84cd409640 1 -- 172.21.15.133:0/4047403826 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f84c81498c0 con 0x7f84c8072090 2023-12-19T19:01:10.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.829+0000 7f84af7fe640 1 -- 172.21.15.133:0/4047403826 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) v1 ==== 104+0+0 (secure 0 0 0) 0x7f84b80594a0 con 0x7f84c8072090 2023-12-19T19:01:10.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.833+0000 7f84cd409640 1 -- 172.21.15.133:0/4047403826 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f84b4066470 msgr2=0x7f84b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:10.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.833+0000 7f84cd409640 1 --2- 172.21.15.133:0/4047403826 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f84b4066470 0x7f84b4068930 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0af000 tx=0x7f84bc0b1040 comp rx=0 tx=0).stop 2023-12-19T19:01:10.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.833+0000 7f84cd409640 1 -- 172.21.15.133:0/4047403826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84c8072090 msgr2=0x7f84c814fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:10.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.833+0000 7f84cd409640 1 --2- 172.21.15.133:0/4047403826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84c8072090 0x7f84c814fcd0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f84b8012fc0 tx=0x7f84b8010490 comp rx=0 tx=0).stop 2023-12-19T19:01:10.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.833+0000 7f84cd409640 1 -- 172.21.15.133:0/4047403826 shutdown_connections 2023-12-19T19:01:10.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.833+0000 7f84cd409640 1 --2- 172.21.15.133:0/4047403826 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f84b4066470 0x7f84b4068930 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:10.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.833+0000 7f84cd409640 1 --2- 172.21.15.133:0/4047403826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f84c80c4110 0x7f84c814d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:10.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.833+0000 7f84cd409640 1 --2- 172.21.15.133:0/4047403826 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f84c80a5370 0x7f84c8071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:10.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.833+0000 7f84cd409640 1 --2- 172.21.15.133:0/4047403826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f84c8072090 0x7f84c814fcd0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:10.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.833+0000 7f84cd409640 1 -- 172.21.15.133:0/4047403826 >> 172.21.15.133:0/4047403826 conn(0x7f84c806a5b0 msgr2=0x7f84c80c5490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:10.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.833+0000 7f84cd409640 1 -- 172.21.15.133:0/4047403826 shutdown_connections 2023-12-19T19:01:10.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:10.833+0000 7f84cd409640 1 -- 172.21.15.133:0/4047403826 wait complete. 2023-12-19T19:01:10.870 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T19:01:11.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.053+0000 7f6e9391d640 1 Processor -- start 2023-12-19T19:01:11.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e9391d640 1 -- start start 2023-12-19T19:01:11.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e9391d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c14f9f0 0x7f6e8c0c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:11.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e9391d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c0c5ba0 con 0x7f6e8c0c2d10 2023-12-19T19:01:11.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e9391d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c06c160 con 0x7f6e8c0c07b0 2023-12-19T19:01:11.060 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e9391d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0c5410 con 0x7f6e8c14f9f0 2023-12-19T19:01:11.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e91eba640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6e8c0c2d10 0x7f6e8c15cec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38188/0 (socket says 172.21.15.133:38188) 2023-12-19T19:01:11.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e91eba640 1 -- 172.21.15.133:0/1917753888 learned_addr learned my addr 172.21.15.133:0/1917753888 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:11.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e916b9640 1 --2- 172.21.15.133:0/1917753888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c14f9f0 0x7f6e8c0c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:11.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e83fff640 1 -- 172.21.15.133:0/1917753888 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277538753 0 0) 0x7f6e840014a0 con 0x7f6e8c0c2d10 2023-12-19T19:01:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e83fff640 1 -- 172.21.15.133:0/1917753888 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e78003530 con 0x7f6e8c0c2d10 2023-12-19T19:01:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e83fff640 1 -- 172.21.15.133:0/1917753888 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3786786340 0 0) 0x7f6e78003530 con 0x7f6e8c0c2d10 2023-12-19T19:01:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e83fff640 1 -- 172.21.15.133:0/1917753888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c14f9f0 msgr2=0x7f6e8c0c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e83fff640 1 --2- 172.21.15.133:0/1917753888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c14f9f0 0x7f6e8c0c27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e83fff640 1 -- 172.21.15.133:0/1917753888 >> v1:172.21.15.138:6789/0 conn(0x7f6e8c0c07b0 legacy=0x7f6e8c06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e83fff640 1 -- 172.21.15.133:0/1917753888 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c0c2210 con 0x7f6e8c0c2d10 2023-12-19T19:01:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e83fff640 1 -- 172.21.15.133:0/1917753888 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f6e84001b90 con 0x7f6e8c0c2d10 2023-12-19T19:01:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e83fff640 1 -- 172.21.15.133:0/1917753888 >> v1:172.21.15.133:6789/0 conn(0x7f6e8c0c2d10 legacy=0x7f6e8c15cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e83fff640 1 --2- 172.21.15.133:0/1917753888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e780039b0 0x7f6e78003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e83fff640 1 --2- 172.21.15.133:0/1917753888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c14f9f0 0x7f6e780047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e83fff640 1 --2- 172.21.15.133:0/1917753888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e78004d10 0x7f6e78005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e83fff640 1 -- 172.21.15.133:0/1917753888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0c5410 con 0x7f6e780039b0 2023-12-19T19:01:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e83fff640 1 -- 172.21.15.133:0/1917753888 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7800ba70 con 0x7f6e78004d10 2023-12-19T19:01:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e83fff640 1 -- 172.21.15.133:0/1917753888 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7800bc30 con 0x7f6e8c14f9f0 2023-12-19T19:01:11.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e916b9640 1 --2- 172.21.15.133:0/1917753888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e780039b0 0x7f6e78003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:11.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e91eba640 1 --2- 172.21.15.133:0/1917753888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e78004d10 0x7f6e78005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:11.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e90eb8640 1 --2- 172.21.15.133:0/1917753888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c14f9f0 0x7f6e780047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:11.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e916b9640 1 -- 172.21.15.133:0/1917753888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c14f9f0 msgr2=0x7f6e780047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:11.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e916b9640 1 --2- 172.21.15.133:0/1917753888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e8c14f9f0 0x7f6e780047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:11.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e916b9640 1 -- 172.21.15.133:0/1917753888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e78004d10 msgr2=0x7f6e78005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:11.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e916b9640 1 --2- 172.21.15.133:0/1917753888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e78004d10 0x7f6e78005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:11.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.057+0000 7f6e916b9640 1 -- 172.21.15.133:0/1917753888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e78003530 con 0x7f6e780039b0 2023-12-19T19:01:11.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.061+0000 7f6e916b9640 1 --2- 172.21.15.133:0/1917753888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e780039b0 0x7f6e78003d90 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f6e88009ae0 tx=0x7f6e8801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8c9643fb889b9e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:11.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.061+0000 7f6e83fff640 1 -- 172.21.15.133:0/1917753888 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e880a5610 con 0x7f6e780039b0 2023-12-19T19:01:11.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.061+0000 7f6e83fff640 1 -- 172.21.15.133:0/1917753888 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e880a5770 con 0x7f6e780039b0 2023-12-19T19:01:11.065 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.061+0000 7f6e83fff640 1 -- 172.21.15.133:0/1917753888 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e880a5b20 con 0x7f6e780039b0 2023-12-19T19:01:11.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.061+0000 7f6e9391d640 1 -- 172.21.15.133:0/1917753888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e780039b0 msgr2=0x7f6e78003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:11.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.061+0000 7f6e9391d640 1 --2- 172.21.15.133:0/1917753888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e780039b0 0x7f6e78003d90 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f6e88009ae0 tx=0x7f6e8801ca20 comp rx=0 tx=0).stop 2023-12-19T19:01:11.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.061+0000 7f6e91eba640 1 -- 172.21.15.133:0/1917753888 reap_dead start 2023-12-19T19:01:11.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.061+0000 7f6e9391d640 1 -- 172.21.15.133:0/1917753888 shutdown_connections 2023-12-19T19:01:11.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.061+0000 7f6e9391d640 1 -- 172.21.15.133:0/1917753888 >> 172.21.15.133:0/1917753888 conn(0x7f6e8c0c5d40 msgr2=0x7f6e8c0c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:11.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.061+0000 7f6e9391d640 1 -- 172.21.15.133:0/1917753888 shutdown_connections 2023-12-19T19:01:11.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.061+0000 7f6e9391d640 1 -- 172.21.15.133:0/1917753888 wait complete. 2023-12-19T19:01:11.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e9391d640 1 Processor -- start 2023-12-19T19:01:11.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e9391d640 1 -- start start 2023-12-19T19:01:11.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e9391d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e780039b0 0x7f6e8c1e9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:11.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e9391d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e8c14d980 0x7f6e8c14e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:11.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e9391d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c14e8b0 0x7f6e8c1453c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:11.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e9391d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0a7620 con 0x7f6e8c14e8b0 2023-12-19T19:01:11.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e9391d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c14d3c0 con 0x7f6e8c14d980 2023-12-19T19:01:11.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e9391d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c14d6a0 con 0x7f6e780039b0 2023-12-19T19:01:11.070 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e91eba640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c14e8b0 0x7f6e8c1453c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:11.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e91eba640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c14e8b0 0x7f6e8c1453c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38690/0 (socket says 172.21.15.133:38690) 2023-12-19T19:01:11.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e91eba640 1 -- 172.21.15.133:0/4078899808 learned_addr learned my addr 172.21.15.133:0/4078899808 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:11.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e90eb8640 1 --2- 172.21.15.133:0/4078899808 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e8c14d980 0x7f6e8c14e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:11.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e916b9640 1 --2- 172.21.15.133:0/4078899808 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e780039b0 0x7f6e8c1e9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:11.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e91eba640 1 -- 172.21.15.133:0/4078899808 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e780039b0 msgr2=0x7f6e8c1e9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:11.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e91eba640 1 --2- 172.21.15.133:0/4078899808 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e780039b0 0x7f6e8c1e9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:11.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e91eba640 1 -- 172.21.15.133:0/4078899808 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e8c14d980 msgr2=0x7f6e8c14e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:11.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e91eba640 1 --2- 172.21.15.133:0/4078899808 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e8c14d980 0x7f6e8c14e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:11.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e91eba640 1 -- 172.21.15.133:0/4078899808 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c146b90 con 0x7f6e8c14e8b0 2023-12-19T19:01:11.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e916b9640 1 --2- 172.21.15.133:0/4078899808 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e780039b0 0x7f6e8c1e9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:11.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e91eba640 1 --2- 172.21.15.133:0/4078899808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c14e8b0 0x7f6e8c1453c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c0c6a60 tx=0x7f6e840079e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:11.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e81ffb640 1 -- 172.21.15.133:0/4078899808 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8400aac0 con 0x7f6e8c14e8b0 2023-12-19T19:01:11.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e81ffb640 1 -- 172.21.15.133:0/4078899808 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8400ac40 con 0x7f6e8c14e8b0 2023-12-19T19:01:11.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e9391d640 1 -- 172.21.15.133:0/4078899808 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e8c14de00 con 0x7f6e8c14e8b0 2023-12-19T19:01:11.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e81ffb640 1 -- 172.21.15.133:0/4078899808 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e840133f0 con 0x7f6e8c14e8b0 2023-12-19T19:01:11.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.065+0000 7f6e9391d640 1 -- 172.21.15.133:0/4078899808 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e8c145ad0 con 0x7f6e8c14e8b0 2023-12-19T19:01:11.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.069+0000 7f6e9391d640 1 -- 172.21.15.133:0/4078899808 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8c146d80 con 0x7f6e8c14e8b0 2023-12-19T19:01:11.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.069+0000 7f6e81ffb640 1 -- 172.21.15.133:0/4078899808 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6e84013570 con 0x7f6e8c14e8b0 2023-12-19T19:01:11.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.069+0000 7f6e81ffb640 1 --2- 172.21.15.133:0/4078899808 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6e70066470 0x7f6e70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:11.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.069+0000 7f6e81ffb640 1 -- 172.21.15.133:0/4078899808 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f6e840849c0 con 0x7f6e8c14e8b0 2023-12-19T19:01:11.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.069+0000 7f6e916b9640 1 --2- 172.21.15.133:0/4078899808 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6e70066470 0x7f6e70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:11.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.069+0000 7f6e916b9640 1 --2- 172.21.15.133:0/4078899808 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6e70066470 0x7f6e70068930 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6e880af000 tx=0x7f6e880046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:11.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.073+0000 7f6e81ffb640 1 -- 172.21.15.133:0/4078899808 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6e84051a80 con 0x7f6e8c14e8b0 2023-12-19T19:01:11.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.225+0000 7f6e9391d640 1 -- 172.21.15.133:0/4078899808 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6e8c0c5ba0 con 0x7f6e8c14e8b0 2023-12-19T19:01:11.665 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T19:01:11.669 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T19:01:11.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.833+0000 7f6e81ffb640 1 -- 172.21.15.133:0/4078899808 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v56) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6e8c0c5ba0 con 0x7f6e8c14e8b0 2023-12-19T19:01:11.839 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2023-12-19T19:01:11.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.837+0000 7f6e9391d640 1 -- 172.21.15.133:0/4078899808 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6e70066470 msgr2=0x7f6e70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:11.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.837+0000 7f6e9391d640 1 --2- 172.21.15.133:0/4078899808 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6e70066470 0x7f6e70068930 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f6e880af000 tx=0x7f6e880046d0 comp rx=0 tx=0).stop 2023-12-19T19:01:11.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.837+0000 7f6e9391d640 1 -- 172.21.15.133:0/4078899808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c14e8b0 msgr2=0x7f6e8c1453c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:11.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.837+0000 7f6e9391d640 1 --2- 172.21.15.133:0/4078899808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c14e8b0 0x7f6e8c1453c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c0c6a60 tx=0x7f6e840079e0 comp rx=0 tx=0).stop 2023-12-19T19:01:11.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.837+0000 7f6e9391d640 1 -- 172.21.15.133:0/4078899808 shutdown_connections 2023-12-19T19:01:11.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.837+0000 7f6e9391d640 1 --2- 172.21.15.133:0/4078899808 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6e70066470 0x7f6e70068930 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:11.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.837+0000 7f6e9391d640 1 --2- 172.21.15.133:0/4078899808 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e8c14e8b0 0x7f6e8c1453c0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:11.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.837+0000 7f6e9391d640 1 --2- 172.21.15.133:0/4078899808 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e8c14d980 0x7f6e8c14e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:11.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.837+0000 7f6e9391d640 1 --2- 172.21.15.133:0/4078899808 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e780039b0 0x7f6e8c1e9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:11.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.837+0000 7f6e9391d640 1 -- 172.21.15.133:0/4078899808 >> 172.21.15.133:0/4078899808 conn(0x7f6e8c0c5d40 msgr2=0x7f6e8c0a9790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:11.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.841+0000 7f6e9391d640 1 -- 172.21.15.133:0/4078899808 shutdown_connections 2023-12-19T19:01:11.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:11.841+0000 7f6e9391d640 1 -- 172.21.15.133:0/4078899808 wait complete. 2023-12-19T19:01:11.867 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T19:01:12.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.009+0000 7f29a1e9c640 1 Processor -- start 2023-12-19T19:01:12.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.009+0000 7f29a1e9c640 1 -- start start 2023-12-19T19:01:12.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.009+0000 7f29a1e9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f299c151bc0 0x7f299c0c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:12.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.009+0000 7f29a1e9c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299c1544e0 con 0x7f299c0c4be0 2023-12-19T19:01:12.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.009+0000 7f29a1e9c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299c1547a0 con 0x7f299c0c4760 2023-12-19T19:01:12.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.009+0000 7f29a1e9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c151fa0 con 0x7f299c151bc0 2023-12-19T19:01:12.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.009+0000 7f29a169b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f299c0c4be0 0x7f299c06c260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38194/0 (socket says 172.21.15.133:38194) 2023-12-19T19:01:12.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.009+0000 7f29a169b640 1 -- 172.21.15.133:0/3884480067 learned_addr learned my addr 172.21.15.133:0/3884480067 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:12.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.009+0000 7f29a0e9a640 1 --2- 172.21.15.133:0/3884480067 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f299c151bc0 0x7f299c0c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:12.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.009+0000 7f299b7fe640 1 -- 172.21.15.133:0/3884480067 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369801854 0 0) 0x7f299c1544e0 con 0x7f299c0c4be0 2023-12-19T19:01:12.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.009+0000 7f299b7fe640 1 -- 172.21.15.133:0/3884480067 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f298c003530 con 0x7f299c0c4be0 2023-12-19T19:01:12.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.009+0000 7f29a0e9a640 1 -- 172.21.15.133:0/3884480067 >> v1:172.21.15.138:6789/0 conn(0x7f299c0c4760 legacy=0x7f299c06bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:12.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.009+0000 7f299b7fe640 1 -- 172.21.15.133:0/3884480067 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103202710 0 0) 0x7f299c1547a0 con 0x7f299c0c4760 2023-12-19T19:01:12.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.009+0000 7f29a0e9a640 1 -- 172.21.15.133:0/3884480067 >> v1:172.21.15.133:6789/0 conn(0x7f299c0c4be0 legacy=0x7f299c06c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:12.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.009+0000 7f29a0e9a640 1 -- 172.21.15.133:0/3884480067 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c154a80 con 0x7f299c151bc0 2023-12-19T19:01:12.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.013+0000 7f29a0e9a640 1 --2- 172.21.15.133:0/3884480067 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f299c151bc0 0x7f299c0c7ce0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f29900097f0 tx=0x7f299001c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a38bbe4048c27372 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:12.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.013+0000 7f299b7fe640 1 -- 172.21.15.133:0/3884480067 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29900ab600 con 0x7f299c151bc0 2023-12-19T19:01:12.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.013+0000 7f299b7fe640 1 -- 172.21.15.133:0/3884480067 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29900a7050 con 0x7f299c151bc0 2023-12-19T19:01:12.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.013+0000 7f299b7fe640 1 -- 172.21.15.133:0/3884480067 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29900ab980 con 0x7f299c151bc0 2023-12-19T19:01:12.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.013+0000 7f29a1e9c640 1 -- 172.21.15.133:0/3884480067 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f299c151bc0 msgr2=0x7f299c0c7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:12.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.013+0000 7f29a1e9c640 1 --2- 172.21.15.133:0/3884480067 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f299c151bc0 0x7f299c0c7ce0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f29900097f0 tx=0x7f299001c3a0 comp rx=0 tx=0).stop 2023-12-19T19:01:12.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.013+0000 7f29a1e9c640 1 -- 172.21.15.133:0/3884480067 shutdown_connections 2023-12-19T19:01:12.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.013+0000 7f29a1e9c640 1 --2- 172.21.15.133:0/3884480067 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f299c151bc0 0x7f299c0c7ce0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:12.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.013+0000 7f29a1e9c640 1 -- 172.21.15.133:0/3884480067 >> 172.21.15.133:0/3884480067 conn(0x7f299c0ab970 msgr2=0x7f299c0abd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:12.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.013+0000 7f29a1e9c640 1 -- 172.21.15.133:0/3884480067 shutdown_connections 2023-12-19T19:01:12.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.013+0000 7f29a1e9c640 1 -- 172.21.15.133:0/3884480067 wait complete. 2023-12-19T19:01:12.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.013+0000 7f29a1e9c640 1 Processor -- start 2023-12-19T19:01:12.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f29a1e9c640 1 -- start start 2023-12-19T19:01:12.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f29a1e9c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f299c0c4760 0x7f299c147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:12.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f29a1e9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f299c0c4be0 0x7f299c0bbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:12.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f29a1e9c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f299c151bc0 0x7f299c0bc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:12.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f29a1e9c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c14cec0 con 0x7f299c151bc0 2023-12-19T19:01:12.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f29a1e9c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299c1ed160 con 0x7f299c0c4760 2023-12-19T19:01:12.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f29a1e9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299c1ed440 con 0x7f299c0c4be0 2023-12-19T19:01:12.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f29a169b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f299c151bc0 0x7f299c0bc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:12.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f29a169b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f299c151bc0 0x7f299c0bc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38700/0 (socket says 172.21.15.133:38700) 2023-12-19T19:01:12.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f29a169b640 1 -- 172.21.15.133:0/2687875198 learned_addr learned my addr 172.21.15.133:0/2687875198 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:12.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f29a0e9a640 1 --2- 172.21.15.133:0/2687875198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f299c0c4760 0x7f299c147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:12.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f299bfff640 1 --2- 172.21.15.133:0/2687875198 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f299c0c4be0 0x7f299c0bbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:12.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f29a169b640 1 -- 172.21.15.133:0/2687875198 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f299c0c4be0 msgr2=0x7f299c0bbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:12.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f29a169b640 1 --2- 172.21.15.133:0/2687875198 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f299c0c4be0 0x7f299c0bbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:12.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f29a169b640 1 -- 172.21.15.133:0/2687875198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f299c0c4760 msgr2=0x7f299c147190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:12.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f29a169b640 1 --2- 172.21.15.133:0/2687875198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f299c0c4760 0x7f299c147190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:12.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f29a169b640 1 -- 172.21.15.133:0/2687875198 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2990009420 con 0x7f299c151bc0 2023-12-19T19:01:12.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f29a169b640 1 --2- 172.21.15.133:0/2687875198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f299c151bc0 0x7f299c0bc470 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f299400caa0 tx=0x7f299400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:12.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f29997fa640 1 -- 172.21.15.133:0/2687875198 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299400ac00 con 0x7f299c151bc0 2023-12-19T19:01:12.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f29997fa640 1 -- 172.21.15.133:0/2687875198 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299400ad60 con 0x7f299c151bc0 2023-12-19T19:01:12.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f29a1e9c640 1 -- 172.21.15.133:0/2687875198 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f299c14d0b0 con 0x7f299c151bc0 2023-12-19T19:01:12.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f29997fa640 1 -- 172.21.15.133:0/2687875198 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2994012620 con 0x7f299c151bc0 2023-12-19T19:01:12.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f29a1e9c640 1 -- 172.21.15.133:0/2687875198 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299c14d670 con 0x7f299c151bc0 2023-12-19T19:01:12.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.017+0000 7f29a1e9c640 1 -- 172.21.15.133:0/2687875198 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299c0c0eb0 con 0x7f299c151bc0 2023-12-19T19:01:12.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.021+0000 7f29997fa640 1 -- 172.21.15.133:0/2687875198 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2994007070 con 0x7f299c151bc0 2023-12-19T19:01:12.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.021+0000 7f29997fa640 1 --2- 172.21.15.133:0/2687875198 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f29800664a0 0x7f2980068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:12.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.021+0000 7f29997fa640 1 -- 172.21.15.133:0/2687875198 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6213+0+0 (secure 0 0 0) 0x7f2994083f10 con 0x7f299c151bc0 2023-12-19T19:01:12.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.021+0000 7f29a0e9a640 1 --2- 172.21.15.133:0/2687875198 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f29800664a0 0x7f2980068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:12.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.021+0000 7f29a0e9a640 1 --2- 172.21.15.133:0/2687875198 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f29800664a0 0x7f2980068960 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f29900ad000 tx=0x7f29900a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:12.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.025+0000 7f29997fa640 1 -- 172.21.15.133:0/2687875198 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f299c0c0eb0 con 0x7f299c151bc0 2023-12-19T19:01:12.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.173+0000 7f29a1e9c640 1 -- 172.21.15.133:0/2687875198 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f299c0c0eb0 con 0x7f299c151bc0 2023-12-19T19:01:12.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.837+0000 7f29997fa640 1 -- 172.21.15.133:0/2687875198 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v57) v1 ==== 169+0+0 (secure 0 0 0) 0x7f299c0c0eb0 con 0x7f299c151bc0 2023-12-19T19:01:12.841 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2023-12-19T19:01:12.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.841+0000 7f29a1e9c640 1 -- 172.21.15.133:0/2687875198 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f29800664a0 msgr2=0x7f2980068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:12.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.841+0000 7f29a1e9c640 1 --2- 172.21.15.133:0/2687875198 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f29800664a0 0x7f2980068960 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f29900ad000 tx=0x7f29900a6000 comp rx=0 tx=0).stop 2023-12-19T19:01:12.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.841+0000 7f29a1e9c640 1 -- 172.21.15.133:0/2687875198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f299c151bc0 msgr2=0x7f299c0bc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:12.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.841+0000 7f29a1e9c640 1 --2- 172.21.15.133:0/2687875198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f299c151bc0 0x7f299c0bc470 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f299400caa0 tx=0x7f299400cf60 comp rx=0 tx=0).stop 2023-12-19T19:01:12.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.841+0000 7f29a1e9c640 1 -- 172.21.15.133:0/2687875198 shutdown_connections 2023-12-19T19:01:12.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.841+0000 7f29a1e9c640 1 --2- 172.21.15.133:0/2687875198 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f29800664a0 0x7f2980068960 secure :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f29900ad000 tx=0x7f29900a6000 comp rx=0 tx=0).stop 2023-12-19T19:01:12.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.841+0000 7f29a1e9c640 1 --2- 172.21.15.133:0/2687875198 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f299c151bc0 0x7f299c0bc470 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:12.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.841+0000 7f29a1e9c640 1 --2- 172.21.15.133:0/2687875198 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f299c0c4be0 0x7f299c0bbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:12.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.841+0000 7f29a1e9c640 1 --2- 172.21.15.133:0/2687875198 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f299c0c4760 0x7f299c147190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:12.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.841+0000 7f29a1e9c640 1 -- 172.21.15.133:0/2687875198 >> 172.21.15.133:0/2687875198 conn(0x7f299c0ab970 msgr2=0x7f299c0abd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:12.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.841+0000 7f29a1e9c640 1 -- 172.21.15.133:0/2687875198 shutdown_connections 2023-12-19T19:01:12.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:12.841+0000 7f29a1e9c640 1 -- 172.21.15.133:0/2687875198 wait complete. 2023-12-19T19:01:12.871 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:01:13.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.009+0000 7f9b53268640 1 Processor -- start 2023-12-19T19:01:13.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.009+0000 7f9b53268640 1 -- start start 2023-12-19T19:01:13.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.013+0000 7f9b53268640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9b4c0a5370 0x7f9b4c150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:13.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.013+0000 7f9b53268640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4c0c2760 con 0x7f9b4c072090 2023-12-19T19:01:13.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.013+0000 7f9b53268640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4c0a57c0 con 0x7f9b4c0725c0 2023-12-19T19:01:13.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.013+0000 7f9b53268640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4c0c3070 con 0x7f9b4c0a5370 2023-12-19T19:01:13.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.013+0000 7f9b51004640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9b4c072090 0x7f9b4c0c5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38196/0 (socket says 172.21.15.133:38196) 2023-12-19T19:01:13.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.013+0000 7f9b51004640 1 -- 172.21.15.133:0/3055973993 learned_addr learned my addr 172.21.15.133:0/3055973993 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:13.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.013+0000 7f9b51805640 1 --2- 172.21.15.133:0/3055973993 >> v2:172.21.15.133:3300/0 conn(0x7f9b4c0a5370 0x7f9b4c150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:13.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.013+0000 7f9b43fff640 1 -- 172.21.15.133:0/3055973993 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2735124951 0 0) 0x7f9b4c0c2760 con 0x7f9b4c072090 2023-12-19T19:01:13.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.013+0000 7f9b43fff640 1 -- 172.21.15.133:0/3055973993 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b38003530 con 0x7f9b4c072090 2023-12-19T19:01:13.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.013+0000 7f9b51805640 1 -- 172.21.15.133:0/3055973993 >> v1:172.21.15.138:6789/0 conn(0x7f9b4c0725c0 legacy=0x7f9b4c0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:13.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.013+0000 7f9b51805640 1 -- 172.21.15.133:0/3055973993 >> v1:172.21.15.133:6789/0 conn(0x7f9b4c072090 legacy=0x7f9b4c0c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:13.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.013+0000 7f9b51805640 1 -- 172.21.15.133:0/3055973993 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c0aad20 con 0x7f9b4c0a5370 2023-12-19T19:01:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.017+0000 7f9b51805640 1 --2- 172.21.15.133:0/3055973993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b4c0a5370 0x7f9b4c150fa0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f9b44009d90 tx=0x7f9b4401c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f2e5226d773caa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:13.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.017+0000 7f9b43fff640 1 -- 172.21.15.133:0/3055973993 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b440a5780 con 0x7f9b4c0a5370 2023-12-19T19:01:13.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.017+0000 7f9b43fff640 1 -- 172.21.15.133:0/3055973993 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b440a58e0 con 0x7f9b4c0a5370 2023-12-19T19:01:13.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.017+0000 7f9b43fff640 1 -- 172.21.15.133:0/3055973993 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b440a5c70 con 0x7f9b4c0a5370 2023-12-19T19:01:13.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.017+0000 7f9b53268640 1 -- 172.21.15.133:0/3055973993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b4c0a5370 msgr2=0x7f9b4c150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:13.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.017+0000 7f9b53268640 1 --2- 172.21.15.133:0/3055973993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b4c0a5370 0x7f9b4c150fa0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f9b44009d90 tx=0x7f9b4401c830 comp rx=0 tx=0).stop 2023-12-19T19:01:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.017+0000 7f9b53268640 1 -- 172.21.15.133:0/3055973993 shutdown_connections 2023-12-19T19:01:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.017+0000 7f9b53268640 1 --2- 172.21.15.133:0/3055973993 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b4c0a5370 0x7f9b4c150fa0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.017+0000 7f9b53268640 1 -- 172.21.15.133:0/3055973993 >> 172.21.15.133:0/3055973993 conn(0x7f9b4c06a5b0 msgr2=0x7f9b4c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.017+0000 7f9b53268640 1 -- 172.21.15.133:0/3055973993 shutdown_connections 2023-12-19T19:01:13.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.017+0000 7f9b53268640 1 -- 172.21.15.133:0/3055973993 wait complete. 2023-12-19T19:01:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.017+0000 7f9b53268640 1 Processor -- start 2023-12-19T19:01:13.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.017+0000 7f9b53268640 1 -- start start 2023-12-19T19:01:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b53268640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b4c072090 0x7f9b4c14e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b53268640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b4c0725c0 0x7f9b4c148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b53268640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9b4c0a5370 0x7f9b4c148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:13.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b53268640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c152ff0 con 0x7f9b4c0725c0 2023-12-19T19:01:13.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b53268640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c1f0110 con 0x7f9b4c072090 2023-12-19T19:01:13.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b53268640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c1f03f0 con 0x7f9b4c0a5370 2023-12-19T19:01:13.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b50803640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b4c0725c0 0x7f9b4c148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:13.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b51004640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b4c072090 0x7f9b4c14e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:13.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b50803640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b4c0725c0 0x7f9b4c148a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38720/0 (socket says 172.21.15.133:38720) 2023-12-19T19:01:13.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b50803640 1 -- 172.21.15.133:0/2863865416 learned_addr learned my addr 172.21.15.133:0/2863865416 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:13.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b51805640 1 --2- 172.21.15.133:0/2863865416 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9b4c0a5370 0x7f9b4c148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:13.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b50803640 1 -- 172.21.15.133:0/2863865416 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9b4c0a5370 msgr2=0x7f9b4c148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:13.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b50803640 1 --2- 172.21.15.133:0/2863865416 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9b4c0a5370 0x7f9b4c148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b50803640 1 -- 172.21.15.133:0/2863865416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b4c072090 msgr2=0x7f9b4c14e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:13.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b50803640 1 --2- 172.21.15.133:0/2863865416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b4c072090 0x7f9b4c14e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b50803640 1 -- 172.21.15.133:0/2863865416 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b44009a70 con 0x7f9b4c0725c0 2023-12-19T19:01:13.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b50803640 1 --2- 172.21.15.133:0/2863865416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b4c0725c0 0x7f9b4c148a60 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00c500 tx=0x7f9b3c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b41ffb640 1 -- 172.21.15.133:0/2863865416 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c005220 con 0x7f9b4c0725c0 2023-12-19T19:01:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b41ffb640 1 -- 172.21.15.133:0/2863865416 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3c005380 con 0x7f9b4c0725c0 2023-12-19T19:01:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b53268640 1 -- 172.21.15.133:0/2863865416 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4c1f06d0 con 0x7f9b4c0725c0 2023-12-19T19:01:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b41ffb640 1 -- 172.21.15.133:0/2863865416 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c007270 con 0x7f9b4c0725c0 2023-12-19T19:01:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b53268640 1 -- 172.21.15.133:0/2863865416 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4c1f0c90 con 0x7f9b4c0725c0 2023-12-19T19:01:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b53268640 1 -- 172.21.15.133:0/2863865416 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b4c068400 con 0x7f9b4c0725c0 2023-12-19T19:01:13.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.021+0000 7f9b41ffb640 1 -- 172.21.15.133:0/2863865416 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9b3c0073d0 con 0x7f9b4c0725c0 2023-12-19T19:01:13.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.025+0000 7f9b41ffb640 1 --2- 172.21.15.133:0/2863865416 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9b300664a0 0x7f9b30068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:13.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.025+0000 7f9b41ffb640 1 -- 172.21.15.133:0/2863865416 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f9b3c0836c0 con 0x7f9b4c0725c0 2023-12-19T19:01:13.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.025+0000 7f9b51004640 1 --2- 172.21.15.133:0/2863865416 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9b300664a0 0x7f9b30068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:13.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.025+0000 7f9b51004640 1 --2- 172.21.15.133:0/2863865416 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9b300664a0 0x7f9b30068960 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9b480011f0 tx=0x7f9b48007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:13.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.029+0000 7f9b41ffb640 1 -- 172.21.15.133:0/2863865416 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9b3c050b00 con 0x7f9b4c0725c0 2023-12-19T19:01:13.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.185+0000 7f9b53268640 1 -- 172.21.15.133:0/2863865416 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b4c0c6780 con 0x7f9b4c0725c0 2023-12-19T19:01:13.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.185+0000 7f9b41ffb640 1 -- 172.21.15.133:0/2863865416 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16739 (secure 0 0 0) 0x7f9b3c054120 con 0x7f9b4c0725c0 2023-12-19T19:01:13.193 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:13.194 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":57,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:01:12.838534+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:00:46.784805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:00:48.051355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6835/1203400706":"2023-12-20T19:01:09.827034+0000","172.21.15.133:6834/1203400706":"2023-12-20T19:01:09.827034+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:01:13.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.189+0000 7f9b53268640 1 -- 172.21.15.133:0/2863865416 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9b300664a0 msgr2=0x7f9b30068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:13.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.189+0000 7f9b53268640 1 --2- 172.21.15.133:0/2863865416 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9b300664a0 0x7f9b30068960 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9b480011f0 tx=0x7f9b48007d40 comp rx=0 tx=0).stop 2023-12-19T19:01:13.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.189+0000 7f9b53268640 1 -- 172.21.15.133:0/2863865416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b4c0725c0 msgr2=0x7f9b4c148a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:13.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.189+0000 7f9b53268640 1 --2- 172.21.15.133:0/2863865416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b4c0725c0 0x7f9b4c148a60 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00c500 tx=0x7f9b3c00c9c0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.189+0000 7f9b53268640 1 -- 172.21.15.133:0/2863865416 shutdown_connections 2023-12-19T19:01:13.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.189+0000 7f9b53268640 1 --2- 172.21.15.133:0/2863865416 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9b300664a0 0x7f9b30068960 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.189+0000 7f9b53268640 1 --2- 172.21.15.133:0/2863865416 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9b4c0a5370 0x7f9b4c148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.189+0000 7f9b53268640 1 --2- 172.21.15.133:0/2863865416 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b4c0725c0 0x7f9b4c148a60 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.189+0000 7f9b53268640 1 --2- 172.21.15.133:0/2863865416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b4c072090 0x7f9b4c14e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.189+0000 7f9b53268640 1 -- 172.21.15.133:0/2863865416 >> 172.21.15.133:0/2863865416 conn(0x7f9b4c06a5b0 msgr2=0x7f9b4c0c05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:13.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.189+0000 7f9b53268640 1 -- 172.21.15.133:0/2863865416 shutdown_connections 2023-12-19T19:01:13.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.189+0000 7f9b53268640 1 -- 172.21.15.133:0/2863865416 wait complete. 2023-12-19T19:01:13.213 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-19T19:00:46.784805+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-19T19:00:48.051355+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T19:01:13.213 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T19:01:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.349+0000 7fdfc4b1d640 1 Processor -- start 2023-12-19T19:01:13.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.349+0000 7fdfc4b1d640 1 -- start start 2023-12-19T19:01:13.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.349+0000 7fdfc4b1d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdfc00c5640 0x7fdfc00c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:13.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.353+0000 7fdfc4b1d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc00c2580 con 0x7fdfc00c60f0 2023-12-19T19:01:13.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.353+0000 7fdfc4b1d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc00c1a00 con 0x7fdfc00c5260 2023-12-19T19:01:13.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.353+0000 7fdfc4b1d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc0153510 con 0x7fdfc00c5640 2023-12-19T19:01:13.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.353+0000 7fdfb5d9b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdfc00c5640 0x7fdfc00c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:13.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.353+0000 7fdfbed9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdfc00c60f0 0x7fdfc0155de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38208/0 (socket says 172.21.15.133:38208) 2023-12-19T19:01:13.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.353+0000 7fdfbed9d640 1 -- 172.21.15.133:0/1518354736 learned_addr learned my addr 172.21.15.133:0/1518354736 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:13.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.353+0000 7fdfb5d9b640 1 -- 172.21.15.133:0/1518354736 >> v1:172.21.15.138:6789/0 conn(0x7fdfc00c5260 legacy=0x7fdfc006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:13.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.353+0000 7fdfb5d9b640 1 -- 172.21.15.133:0/1518354736 >> v1:172.21.15.133:6789/0 conn(0x7fdfc00c60f0 legacy=0x7fdfc0155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:13.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.353+0000 7fdfb5d9b640 1 -- 172.21.15.133:0/1518354736 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc00c1ce0 con 0x7fdfc00c5640 2023-12-19T19:01:13.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.353+0000 7fdfbdd9b640 1 -- 172.21.15.133:0/1518354736 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3322215188 0 0) 0x7fdfc00c2580 con 0x7fdfc00c60f0 2023-12-19T19:01:13.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.353+0000 7fdfb5d9b640 1 --2- 172.21.15.133:0/1518354736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc00c5640 0x7fdfc00c5bb0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80097c0 tx=0x7fdfa801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dabcdafbdeb476f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:13.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.353+0000 7fdfbdd9b640 1 -- 172.21.15.133:0/1518354736 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa80ab600 con 0x7fdfc00c5640 2023-12-19T19:01:13.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.353+0000 7fdfbdd9b640 1 -- 172.21.15.133:0/1518354736 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfa80a7050 con 0x7fdfc00c5640 2023-12-19T19:01:13.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.353+0000 7fdfbdd9b640 1 -- 172.21.15.133:0/1518354736 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa80ab980 con 0x7fdfc00c5640 2023-12-19T19:01:13.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.357+0000 7fdfc4b1d640 1 -- 172.21.15.133:0/1518354736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc00c5640 msgr2=0x7fdfc00c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:13.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.357+0000 7fdfc4b1d640 1 --2- 172.21.15.133:0/1518354736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc00c5640 0x7fdfc00c5bb0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80097c0 tx=0x7fdfa801c3f0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.357+0000 7fdfc4b1d640 1 -- 172.21.15.133:0/1518354736 shutdown_connections 2023-12-19T19:01:13.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.357+0000 7fdfc4b1d640 1 --2- 172.21.15.133:0/1518354736 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc00c5640 0x7fdfc00c5bb0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.357+0000 7fdfc4b1d640 1 -- 172.21.15.133:0/1518354736 >> 172.21.15.133:0/1518354736 conn(0x7fdfc006a5b0 msgr2=0x7fdfc006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:13.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.357+0000 7fdfc4b1d640 1 -- 172.21.15.133:0/1518354736 shutdown_connections 2023-12-19T19:01:13.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.357+0000 7fdfc4b1d640 1 -- 172.21.15.133:0/1518354736 wait complete. 2023-12-19T19:01:13.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.357+0000 7fdfc4b1d640 1 Processor -- start 2023-12-19T19:01:13.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.357+0000 7fdfc4b1d640 1 -- start start 2023-12-19T19:01:13.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.357+0000 7fdfc4b1d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfc00c5260 0x7fdfc014cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:13.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.357+0000 7fdfc4b1d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfc00c5640 0x7fdfc0153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:13.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.357+0000 7fdfc4b1d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc00c60f0 0x7fdfc0071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:13.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.357+0000 7fdfc4b1d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc01ed440 con 0x7fdfc00c60f0 2023-12-19T19:01:13.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.357+0000 7fdfc4b1d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc01ed720 con 0x7fdfc00c5640 2023-12-19T19:01:13.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.357+0000 7fdfc4b1d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc01eda00 con 0x7fdfc00c5260 2023-12-19T19:01:13.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.357+0000 7fdfbed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc00c60f0 0x7fdfc0071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:13.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.357+0000 7fdfbed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc00c60f0 0x7fdfc0071190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38732/0 (socket says 172.21.15.133:38732) 2023-12-19T19:01:13.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.357+0000 7fdfbed9d640 1 -- 172.21.15.133:0/359821162 learned_addr learned my addr 172.21.15.133:0/359821162 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:13.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.357+0000 7fdfb5d9b640 1 --2- 172.21.15.133:0/359821162 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfc00c5640 0x7fdfc0153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:13.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.357+0000 7fdfbe59c640 1 --2- 172.21.15.133:0/359821162 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfc00c5260 0x7fdfc014cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:13.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.361+0000 7fdfbed9d640 1 -- 172.21.15.133:0/359821162 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfc00c5260 msgr2=0x7fdfc014cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:13.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.361+0000 7fdfbed9d640 1 --2- 172.21.15.133:0/359821162 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfc00c5260 0x7fdfc014cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.361+0000 7fdfbed9d640 1 -- 172.21.15.133:0/359821162 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfc00c5640 msgr2=0x7fdfc0153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:13.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.361+0000 7fdfbed9d640 1 --2- 172.21.15.133:0/359821162 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfc00c5640 0x7fdfc0153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.361+0000 7fdfbed9d640 1 -- 172.21.15.133:0/359821162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa8009420 con 0x7fdfc00c60f0 2023-12-19T19:01:13.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.361+0000 7fdfbed9d640 1 --2- 172.21.15.133:0/359821162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc00c60f0 0x7fdfc0071190 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800c3e0 tx=0x7fdfb800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:13.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.361+0000 7fdfb77fe640 1 -- 172.21.15.133:0/359821162 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80074e0 con 0x7fdfc00c60f0 2023-12-19T19:01:13.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.361+0000 7fdfb77fe640 1 -- 172.21.15.133:0/359821162 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb8007660 con 0x7fdfc00c60f0 2023-12-19T19:01:13.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.361+0000 7fdfc4b1d640 1 -- 172.21.15.133:0/359821162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc01edce0 con 0x7fdfc00c60f0 2023-12-19T19:01:13.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.361+0000 7fdfb77fe640 1 -- 172.21.15.133:0/359821162 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8004a30 con 0x7fdfc00c60f0 2023-12-19T19:01:13.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.361+0000 7fdfc4b1d640 1 -- 172.21.15.133:0/359821162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc014d060 con 0x7fdfc00c60f0 2023-12-19T19:01:13.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.361+0000 7fdfc4b1d640 1 -- 172.21.15.133:0/359821162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc01edf20 con 0x7fdfc00c60f0 2023-12-19T19:01:13.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.361+0000 7fdfb77fe640 1 -- 172.21.15.133:0/359821162 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fdfb8004b90 con 0x7fdfc00c60f0 2023-12-19T19:01:13.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.361+0000 7fdfb77fe640 1 --2- 172.21.15.133:0/359821162 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdfa00664a0 0x7fdfa0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:13.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.361+0000 7fdfb77fe640 1 -- 172.21.15.133:0/359821162 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fdfb8083ae0 con 0x7fdfc00c60f0 2023-12-19T19:01:13.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.365+0000 7fdfbe59c640 1 --2- 172.21.15.133:0/359821162 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdfa00664a0 0x7fdfa0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:13.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.365+0000 7fdfbe59c640 1 --2- 172.21.15.133:0/359821162 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdfa00664a0 0x7fdfa0068960 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00012f0 tx=0x7fdfb0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:13.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.365+0000 7fdfb77fe640 1 -- 172.21.15.133:0/359821162 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fdfc01edf20 con 0x7fdfc00c60f0 2023-12-19T19:01:13.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.517+0000 7fdfc4b1d640 1 -- 172.21.15.133:0/359821162 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdfc01ed580 con 0x7fdfc00c60f0 2023-12-19T19:01:13.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.517+0000 7fdfb77fe640 1 -- 172.21.15.133:0/359821162 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v57) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdfc01ed580 con 0x7fdfc00c60f0 2023-12-19T19:01:13.521 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T19:01:13.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.517+0000 7fdfc4b1d640 1 -- 172.21.15.133:0/359821162 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdfa00664a0 msgr2=0x7fdfa0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:13.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.517+0000 7fdfc4b1d640 1 --2- 172.21.15.133:0/359821162 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdfa00664a0 0x7fdfa0068960 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00012f0 tx=0x7fdfb0009040 comp rx=0 tx=0).stop 2023-12-19T19:01:13.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.517+0000 7fdfc4b1d640 1 -- 172.21.15.133:0/359821162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc00c60f0 msgr2=0x7fdfc0071190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:13.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.517+0000 7fdfc4b1d640 1 --2- 172.21.15.133:0/359821162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc00c60f0 0x7fdfc0071190 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800c3e0 tx=0x7fdfb800c8a0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.517+0000 7fdfc4b1d640 1 -- 172.21.15.133:0/359821162 shutdown_connections 2023-12-19T19:01:13.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.517+0000 7fdfc4b1d640 1 --2- 172.21.15.133:0/359821162 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdfa00664a0 0x7fdfa0068960 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.517+0000 7fdfc4b1d640 1 --2- 172.21.15.133:0/359821162 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc00c60f0 0x7fdfc0071190 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.517+0000 7fdfc4b1d640 1 --2- 172.21.15.133:0/359821162 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfc00c5640 0x7fdfc0153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.517+0000 7fdfc4b1d640 1 --2- 172.21.15.133:0/359821162 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfc00c5260 0x7fdfc014cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.517+0000 7fdfc4b1d640 1 -- 172.21.15.133:0/359821162 >> 172.21.15.133:0/359821162 conn(0x7fdfc006a5b0 msgr2=0x7fdfc014f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:13.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.517+0000 7fdfc4b1d640 1 -- 172.21.15.133:0/359821162 shutdown_connections 2023-12-19T19:01:13.524 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.517+0000 7fdfc4b1d640 1 -- 172.21.15.133:0/359821162 wait complete. 2023-12-19T19:01:13.542 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-19T19:01:13.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.677+0000 7fd1ba46b640 1 Processor -- start 2023-12-19T19:01:13.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.677+0000 7fd1ba46b640 1 -- start start 2023-12-19T19:01:13.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.681+0000 7fd1ba46b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd1b40a5370 0x7fd1b40c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:13.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.681+0000 7fd1ba46b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd1b4072090 0x7fd1b41516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:13.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.681+0000 7fd1ba46b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1b40c2760 con 0x7fd1b40c4110 2023-12-19T19:01:13.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.681+0000 7fd1ba46b640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b40c3070 con 0x7fd1b40a5370 2023-12-19T19:01:13.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.681+0000 7fd1ba46b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1b4151bf0 con 0x7fd1b4072090 2023-12-19T19:01:13.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.681+0000 7fd1b3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd1b40a5370 0x7fd1b40c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:13.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.681+0000 7fd1b3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd1b40a5370 0x7fd1b40c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38736/0 (socket says 172.21.15.133:38736) 2023-12-19T19:01:13.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.681+0000 7fd1b3fff640 1 -- 172.21.15.133:0/3207826725 learned_addr learned my addr 172.21.15.133:0/3207826725 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:13.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.681+0000 7fd1b8a08640 1 --2- 172.21.15.133:0/3207826725 >> v2:172.21.15.138:3300/0 conn(0x7fd1b4072090 0x7fd1b41516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:13.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.681+0000 7fd1b3fff640 1 -- 172.21.15.133:0/3207826725 >> v2:172.21.15.138:3300/0 conn(0x7fd1b4072090 msgr2=0x7fd1b41516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:13.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.681+0000 7fd1b3fff640 1 --2- 172.21.15.133:0/3207826725 >> v2:172.21.15.138:3300/0 conn(0x7fd1b4072090 0x7fd1b41516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.681+0000 7fd1b3fff640 1 -- 172.21.15.133:0/3207826725 >> v1:172.21.15.138:6789/0 conn(0x7fd1b40c4110 legacy=0x7fd1b4150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:13.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.681+0000 7fd1b3fff640 1 -- 172.21.15.133:0/3207826725 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b40a5750 con 0x7fd1b40a5370 2023-12-19T19:01:13.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.681+0000 7fd1b8a08640 1 --2- 172.21.15.133:0/3207826725 >> v2:172.21.15.138:3300/0 conn(0x7fd1b4072090 0x7fd1b41516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:13.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.685+0000 7fd1b3fff640 1 --2- 172.21.15.133:0/3207826725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1b40a5370 0x7fd1b40c3bd0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4072020 tx=0x7fd1a401c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1158e361000cb07c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:13.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.685+0000 7fd1b2ffd640 1 -- 172.21.15.133:0/3207826725 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a40ab600 con 0x7fd1b40a5370 2023-12-19T19:01:13.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.685+0000 7fd1b2ffd640 1 -- 172.21.15.133:0/3207826725 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a40a7050 con 0x7fd1b40a5370 2023-12-19T19:01:13.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.685+0000 7fd1b2ffd640 1 -- 172.21.15.133:0/3207826725 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a40ab980 con 0x7fd1b40a5370 2023-12-19T19:01:13.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.685+0000 7fd1ba46b640 1 -- 172.21.15.133:0/3207826725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1b40a5370 msgr2=0x7fd1b40c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:13.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.685+0000 7fd1ba46b640 1 --2- 172.21.15.133:0/3207826725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1b40a5370 0x7fd1b40c3bd0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fd1b4072020 tx=0x7fd1a401c370 comp rx=0 tx=0).stop 2023-12-19T19:01:13.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.685+0000 7fd1ba46b640 1 -- 172.21.15.133:0/3207826725 shutdown_connections 2023-12-19T19:01:13.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.685+0000 7fd1ba46b640 1 --2- 172.21.15.133:0/3207826725 >> v2:172.21.15.138:3300/0 conn(0x7fd1b4072090 0x7fd1b41516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.685+0000 7fd1ba46b640 1 --2- 172.21.15.133:0/3207826725 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1b40a5370 0x7fd1b40c3bd0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.685+0000 7fd1ba46b640 1 -- 172.21.15.133:0/3207826725 >> 172.21.15.133:0/3207826725 conn(0x7fd1b406a5b0 msgr2=0x7fd1b406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:13.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.685+0000 7fd1ba46b640 1 -- 172.21.15.133:0/3207826725 shutdown_connections 2023-12-19T19:01:13.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.685+0000 7fd1ba46b640 1 -- 172.21.15.133:0/3207826725 wait complete. 2023-12-19T19:01:13.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.685+0000 7fd1ba46b640 1 Processor -- start 2023-12-19T19:01:13.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.685+0000 7fd1ba46b640 1 -- start start 2023-12-19T19:01:13.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1ba46b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd1b4072090 0x7fd1b40bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:13.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1ba46b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1b40a5370 0x7fd1b41ed570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:13.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1ba46b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1b40c4110 0x7fd1b41f0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:13.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1ba46b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b4153a20 con 0x7fd1b40a5370 2023-12-19T19:01:13.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1ba46b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b4152960 con 0x7fd1b40c4110 2023-12-19T19:01:13.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1ba46b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b4152dd0 con 0x7fd1b4072090 2023-12-19T19:01:13.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1b37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1b40a5370 0x7fd1b41ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:13.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1b3fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd1b4072090 0x7fd1b40bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:13.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1b37fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1b40a5370 0x7fd1b41ed570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38746/0 (socket says 172.21.15.133:38746) 2023-12-19T19:01:13.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1b37fe640 1 -- 172.21.15.133:0/3914105244 learned_addr learned my addr 172.21.15.133:0/3914105244 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:13.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1b8a08640 1 --2- 172.21.15.133:0/3914105244 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1b40c4110 0x7fd1b41f0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:13.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1b37fe640 1 -- 172.21.15.133:0/3914105244 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd1b4072090 msgr2=0x7fd1b40bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:13.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1b37fe640 1 --2- 172.21.15.133:0/3914105244 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd1b4072090 0x7fd1b40bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1b37fe640 1 -- 172.21.15.133:0/3914105244 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1b40c4110 msgr2=0x7fd1b41f0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:13.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1b37fe640 1 --2- 172.21.15.133:0/3914105244 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1b40c4110 0x7fd1b41f0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1b37fe640 1 -- 172.21.15.133:0/3914105244 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a40094d0 con 0x7fd1b40a5370 2023-12-19T19:01:13.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1b8a08640 1 --2- 172.21.15.133:0/3914105244 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1b40c4110 0x7fd1b41f0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:13.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1b37fe640 1 --2- 172.21.15.133:0/3914105244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1b40a5370 0x7fd1b41ed570 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd1a800b410 tx=0x7fd1a800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:13.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1b0ff9640 1 -- 172.21.15.133:0/3914105244 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a8004020 con 0x7fd1b40a5370 2023-12-19T19:01:13.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1b0ff9640 1 -- 172.21.15.133:0/3914105244 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1a8004180 con 0x7fd1b40a5370 2023-12-19T19:01:13.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1b0ff9640 1 -- 172.21.15.133:0/3914105244 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a8011630 con 0x7fd1b40a5370 2023-12-19T19:01:13.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1ba46b640 1 -- 172.21.15.133:0/3914105244 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b4152fe0 con 0x7fd1b40a5370 2023-12-19T19:01:13.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1ba46b640 1 -- 172.21.15.133:0/3914105244 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b41f0500 con 0x7fd1b40a5370 2023-12-19T19:01:13.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.689+0000 7fd1ba46b640 1 -- 172.21.15.133:0/3914105244 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b4068400 con 0x7fd1b40a5370 2023-12-19T19:01:13.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.693+0000 7fd1b0ff9640 1 -- 172.21.15.133:0/3914105244 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd1a8011790 con 0x7fd1b40a5370 2023-12-19T19:01:13.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.693+0000 7fd1b0ff9640 1 --2- 172.21.15.133:0/3914105244 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd1a0066470 0x7fd1a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:13.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.693+0000 7fd1b0ff9640 1 -- 172.21.15.133:0/3914105244 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fd1a8083b60 con 0x7fd1b40a5370 2023-12-19T19:01:13.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.693+0000 7fd1b3fff640 1 --2- 172.21.15.133:0/3914105244 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd1a0066470 0x7fd1a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:13.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.693+0000 7fd1b3fff640 1 --2- 172.21.15.133:0/3914105244 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd1a0066470 0x7fd1a0068930 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd1a40ad000 tx=0x7fd1a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:13.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.697+0000 7fd1b0ff9640 1 -- 172.21.15.133:0/3914105244 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd1a8050f70 con 0x7fd1b40a5370 2023-12-19T19:01:13.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.849+0000 7fd1ba46b640 1 -- 172.21.15.133:0/3914105244 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd1b41519d0 con 0x7fd1b40a5370 2023-12-19T19:01:13.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.849+0000 7fd1b0ff9640 1 -- 172.21.15.133:0/3914105244 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v57) v1 ==== 105+0+11 (secure 0 0 0) 0x7fd1a80150b0 con 0x7fd1b40a5370 2023-12-19T19:01:13.853 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:01:13.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.853+0000 7fd1ba46b640 1 -- 172.21.15.133:0/3914105244 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd1a0066470 msgr2=0x7fd1a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:13.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.853+0000 7fd1ba46b640 1 --2- 172.21.15.133:0/3914105244 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd1a0066470 0x7fd1a0068930 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fd1a40ad000 tx=0x7fd1a4008040 comp rx=0 tx=0).stop 2023-12-19T19:01:13.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.853+0000 7fd1ba46b640 1 -- 172.21.15.133:0/3914105244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1b40a5370 msgr2=0x7fd1b41ed570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:13.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.853+0000 7fd1ba46b640 1 --2- 172.21.15.133:0/3914105244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1b40a5370 0x7fd1b41ed570 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fd1a800b410 tx=0x7fd1a800b8d0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.853+0000 7fd1ba46b640 1 -- 172.21.15.133:0/3914105244 shutdown_connections 2023-12-19T19:01:13.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.853+0000 7fd1ba46b640 1 --2- 172.21.15.133:0/3914105244 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd1a0066470 0x7fd1a0068930 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.853+0000 7fd1ba46b640 1 --2- 172.21.15.133:0/3914105244 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd1b40c4110 0x7fd1b41f0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.853+0000 7fd1ba46b640 1 --2- 172.21.15.133:0/3914105244 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd1b40a5370 0x7fd1b41ed570 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.853+0000 7fd1ba46b640 1 --2- 172.21.15.133:0/3914105244 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd1b4072090 0x7fd1b40bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:13.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.853+0000 7fd1ba46b640 1 -- 172.21.15.133:0/3914105244 >> 172.21.15.133:0/3914105244 conn(0x7fd1b406a5b0 msgr2=0x7fd1b414d320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:13.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.853+0000 7fd1ba46b640 1 -- 172.21.15.133:0/3914105244 shutdown_connections 2023-12-19T19:01:13.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:13.853+0000 7fd1ba46b640 1 -- 172.21.15.133:0/3914105244 wait complete. 2023-12-19T19:01:13.876 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-19T19:01:14.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f240a26b640 1 Processor -- start 2023-12-19T19:01:14.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f240a26b640 1 -- start start 2023-12-19T19:01:14.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f240a26b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24040c5640 0x7f24040c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:14.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f240a26b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24040c2580 con 0x7f24040c60f0 2023-12-19T19:01:14.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f240a26b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24040c1a00 con 0x7f24040c5260 2023-12-19T19:01:14.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f240a26b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2404153510 con 0x7f24040c5640 2023-12-19T19:01:14.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2408808640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f24040c60f0 0x7f2404155de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:38218/0 (socket says 172.21.15.133:38218) 2023-12-19T19:01:14.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2408808640 1 -- 172.21.15.133:0/1257099756 learned_addr learned my addr 172.21.15.133:0/1257099756 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:14.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f24037fe640 1 --2- 172.21.15.133:0/1257099756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24040c5640 0x7f24040c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:14.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2402ffd640 1 -- 172.21.15.133:0/1257099756 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2856124082 0 0) 0x7f24040c2580 con 0x7f24040c60f0 2023-12-19T19:01:14.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2402ffd640 1 -- 172.21.15.133:0/1257099756 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23ec003530 con 0x7f24040c60f0 2023-12-19T19:01:14.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2402ffd640 1 -- 172.21.15.133:0/1257099756 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2561507312 0 0) 0x7f23ec003530 con 0x7f24040c60f0 2023-12-19T19:01:14.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2402ffd640 1 -- 172.21.15.133:0/1257099756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24040c5640 msgr2=0x7f24040c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:14.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2402ffd640 1 --2- 172.21.15.133:0/1257099756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24040c5640 0x7f24040c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2402ffd640 1 -- 172.21.15.133:0/1257099756 >> v1:172.21.15.138:6789/0 conn(0x7f24040c5260 legacy=0x7f240406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:14.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2402ffd640 1 -- 172.21.15.133:0/1257099756 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24040c1ce0 con 0x7f24040c60f0 2023-12-19T19:01:14.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2402ffd640 1 -- 172.21.15.133:0/1257099756 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f23fc001a00 con 0x7f24040c60f0 2023-12-19T19:01:14.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2402ffd640 1 -- 172.21.15.133:0/1257099756 >> v1:172.21.15.133:6789/0 conn(0x7f24040c60f0 legacy=0x7f2404155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:14.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2402ffd640 1 --2- 172.21.15.133:0/1257099756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23ec0039b0 0x7f23ec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:14.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2402ffd640 1 --2- 172.21.15.133:0/1257099756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23ec004360 0x7f23ec004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:14.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2402ffd640 1 --2- 172.21.15.133:0/1257099756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24040c5640 0x7f23ec005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:14.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2402ffd640 1 -- 172.21.15.133:0/1257099756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec00ba40 con 0x7f23ec0039b0 2023-12-19T19:01:14.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2402ffd640 1 -- 172.21.15.133:0/1257099756 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec00bb80 con 0x7f23ec004360 2023-12-19T19:01:14.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2402ffd640 1 -- 172.21.15.133:0/1257099756 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ec00bd40 con 0x7f24040c5640 2023-12-19T19:01:14.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2403fff640 1 --2- 172.21.15.133:0/1257099756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23ec0039b0 0x7f23ec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:14.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f24037fe640 1 --2- 172.21.15.133:0/1257099756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23ec004360 0x7f23ec004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:14.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2408808640 1 --2- 172.21.15.133:0/1257099756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24040c5640 0x7f23ec005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:14.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2403fff640 1 -- 172.21.15.133:0/1257099756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24040c5640 msgr2=0x7f23ec005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:14.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2403fff640 1 --2- 172.21.15.133:0/1257099756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24040c5640 0x7f23ec005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2403fff640 1 -- 172.21.15.133:0/1257099756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23ec004360 msgr2=0x7f23ec004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:14.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2403fff640 1 --2- 172.21.15.133:0/1257099756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f23ec004360 0x7f23ec004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2403fff640 1 -- 172.21.15.133:0/1257099756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ec003530 con 0x7f23ec0039b0 2023-12-19T19:01:14.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.013+0000 7f2408808640 1 --2- 172.21.15.133:0/1257099756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f24040c5640 0x7f23ec005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:14.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.017+0000 7f2403fff640 1 --2- 172.21.15.133:0/1257099756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23ec0039b0 0x7f23ec003d90 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f23f4001860 tx=0x7f23f401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39565b5bc3dfbf3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:14.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.017+0000 7f2402ffd640 1 -- 172.21.15.133:0/1257099756 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f40ab600 con 0x7f23ec0039b0 2023-12-19T19:01:14.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.017+0000 7f2402ffd640 1 -- 172.21.15.133:0/1257099756 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f40a7050 con 0x7f23ec0039b0 2023-12-19T19:01:14.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.017+0000 7f2402ffd640 1 -- 172.21.15.133:0/1257099756 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f40ab9a0 con 0x7f23ec0039b0 2023-12-19T19:01:14.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.017+0000 7f240a26b640 1 -- 172.21.15.133:0/1257099756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23ec0039b0 msgr2=0x7f23ec003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:14.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.017+0000 7f240a26b640 1 --2- 172.21.15.133:0/1257099756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23ec0039b0 0x7f23ec003d90 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f23f4001860 tx=0x7f23f401c500 comp rx=0 tx=0).stop 2023-12-19T19:01:14.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.017+0000 7f2408808640 1 -- 172.21.15.133:0/1257099756 reap_dead start 2023-12-19T19:01:14.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.017+0000 7f240a26b640 1 -- 172.21.15.133:0/1257099756 shutdown_connections 2023-12-19T19:01:14.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.017+0000 7f240a26b640 1 -- 172.21.15.133:0/1257099756 >> 172.21.15.133:0/1257099756 conn(0x7f240406a5b0 msgr2=0x7f240406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:14.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.017+0000 7f240a26b640 1 -- 172.21.15.133:0/1257099756 shutdown_connections 2023-12-19T19:01:14.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.017+0000 7f240a26b640 1 -- 172.21.15.133:0/1257099756 wait complete. 2023-12-19T19:01:14.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f240a26b640 1 Processor -- start 2023-12-19T19:01:14.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f240a26b640 1 -- start start 2023-12-19T19:01:14.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f240a26b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23ec0039b0 0x7f24040700b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:14.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f240a26b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24040a8670 0x7f24040a7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:14.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f240a26b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24040aaac0 0x7f24041ed170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:14.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f240a26b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24040a9aa0 con 0x7f24040a8670 2023-12-19T19:01:14.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f240a26b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2404072060 con 0x7f24040aaac0 2023-12-19T19:01:14.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f240a26b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24040aa880 con 0x7f23ec0039b0 2023-12-19T19:01:14.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f24037fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24040a8670 0x7f24040a7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:14.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f24037fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24040a8670 0x7f24040a7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38762/0 (socket says 172.21.15.133:38762) 2023-12-19T19:01:14.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f24037fe640 1 -- 172.21.15.133:0/3977180756 learned_addr learned my addr 172.21.15.133:0/3977180756 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:14.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f2403fff640 1 --2- 172.21.15.133:0/3977180756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23ec0039b0 0x7f24040700b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:14.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f2408808640 1 --2- 172.21.15.133:0/3977180756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24040aaac0 0x7f24041ed170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:14.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f24037fe640 1 -- 172.21.15.133:0/3977180756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23ec0039b0 msgr2=0x7f24040700b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:14.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f24037fe640 1 --2- 172.21.15.133:0/3977180756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23ec0039b0 0x7f24040700b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f24037fe640 1 -- 172.21.15.133:0/3977180756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24040aaac0 msgr2=0x7f24041ed170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:14.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f24037fe640 1 --2- 172.21.15.133:0/3977180756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24040aaac0 0x7f24041ed170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f24037fe640 1 -- 172.21.15.133:0/3977180756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24040aa2c0 con 0x7f24040a8670 2023-12-19T19:01:14.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f2408808640 1 --2- 172.21.15.133:0/3977180756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24040aaac0 0x7f24041ed170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:14.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f24037fe640 1 --2- 172.21.15.133:0/3977180756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24040a8670 0x7f24040a7650 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f23f8011970 tx=0x7f23f8011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:14.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f2400ff9640 1 -- 172.21.15.133:0/3977180756 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f8004240 con 0x7f24040a8670 2023-12-19T19:01:14.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f2400ff9640 1 -- 172.21.15.133:0/3977180756 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23f80043a0 con 0x7f24040a8670 2023-12-19T19:01:14.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f240a26b640 1 -- 172.21.15.133:0/3977180756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24040aa5a0 con 0x7f24040a8670 2023-12-19T19:01:14.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f2400ff9640 1 -- 172.21.15.133:0/3977180756 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23f800fb00 con 0x7f24040a8670 2023-12-19T19:01:14.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.021+0000 7f240a26b640 1 -- 172.21.15.133:0/3977180756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24040705f0 con 0x7f24040a8670 2023-12-19T19:01:14.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.025+0000 7f240a26b640 1 -- 172.21.15.133:0/3977180756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24040a9c10 con 0x7f24040a8670 2023-12-19T19:01:14.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.025+0000 7f2400ff9640 1 -- 172.21.15.133:0/3977180756 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f23f800fc60 con 0x7f24040a8670 2023-12-19T19:01:14.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.025+0000 7f2400ff9640 1 --2- 172.21.15.133:0/3977180756 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f23f00664a0 0x7f23f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:14.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.025+0000 7f2400ff9640 1 -- 172.21.15.133:0/3977180756 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f23f8084440 con 0x7f24040a8670 2023-12-19T19:01:14.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.025+0000 7f2403fff640 1 --2- 172.21.15.133:0/3977180756 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f23f00664a0 0x7f23f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:14.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.025+0000 7f2403fff640 1 --2- 172.21.15.133:0/3977180756 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f23f00664a0 0x7f23f0068960 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f23f40ad000 tx=0x7f23f4005040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:14.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.029+0000 7f2400ff9640 1 -- 172.21.15.133:0/3977180756 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f23f80518f0 con 0x7f24040a8670 2023-12-19T19:01:14.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.177+0000 7f240a26b640 1 -- 172.21.15.133:0/3977180756 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f2404068400 con 0x7f24040a8670 2023-12-19T19:01:14.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.177+0000 7f2400ff9640 1 -- 172.21.15.133:0/3977180756 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v57) v1 ==== 101+0+11 (secure 0 0 0) 0x7f23f8054f10 con 0x7f24040a8670 2023-12-19T19:01:14.182 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:01:14.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.181+0000 7f240a26b640 1 -- 172.21.15.133:0/3977180756 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f23f00664a0 msgr2=0x7f23f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:14.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.181+0000 7f240a26b640 1 --2- 172.21.15.133:0/3977180756 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f23f00664a0 0x7f23f0068960 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f23f40ad000 tx=0x7f23f4005040 comp rx=0 tx=0).stop 2023-12-19T19:01:14.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.181+0000 7f240a26b640 1 -- 172.21.15.133:0/3977180756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24040a8670 msgr2=0x7f24040a7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:14.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.181+0000 7f240a26b640 1 --2- 172.21.15.133:0/3977180756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24040a8670 0x7f24040a7650 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f23f8011970 tx=0x7f23f8011e30 comp rx=0 tx=0).stop 2023-12-19T19:01:14.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.181+0000 7f240a26b640 1 -- 172.21.15.133:0/3977180756 shutdown_connections 2023-12-19T19:01:14.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.181+0000 7f240a26b640 1 --2- 172.21.15.133:0/3977180756 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f23f00664a0 0x7f23f0068960 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.181+0000 7f240a26b640 1 --2- 172.21.15.133:0/3977180756 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f24040aaac0 0x7f24041ed170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.181+0000 7f240a26b640 1 --2- 172.21.15.133:0/3977180756 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f24040a8670 0x7f24040a7650 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.181+0000 7f240a26b640 1 --2- 172.21.15.133:0/3977180756 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f23ec0039b0 0x7f24040700b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.181+0000 7f240a26b640 1 -- 172.21.15.133:0/3977180756 >> 172.21.15.133:0/3977180756 conn(0x7f240406a5b0 msgr2=0x7f240415d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:14.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.181+0000 7f240a26b640 1 -- 172.21.15.133:0/3977180756 shutdown_connections 2023-12-19T19:01:14.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.181+0000 7f240a26b640 1 -- 172.21.15.133:0/3977180756 wait complete. 2023-12-19T19:01:14.204 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:01:14.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.337+0000 7f018ce17640 1 Processor -- start 2023-12-19T19:01:14.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.337+0000 7f018ce17640 1 -- start start 2023-12-19T19:01:14.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.337+0000 7f018ce17640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0188072090 0x7f0188150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:14.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.337+0000 7f018ce17640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f01880725c0 0x7f01881514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:14.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.337+0000 7f018ce17640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01880c2760 con 0x7f01880a5370 2023-12-19T19:01:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.337+0000 7f018ce17640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01880c3070 con 0x7f01880725c0 2023-12-19T19:01:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.337+0000 7f018ce17640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01880a5750 con 0x7f0188072090 2023-12-19T19:01:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.341+0000 7f0186d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f01880725c0 0x7f01881514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.341+0000 7f0186d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f01880725c0 0x7f01881514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37462/0 (socket says 172.21.15.133:37462) 2023-12-19T19:01:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.341+0000 7f0186d9d640 1 -- 172.21.15.133:0/1349853862 learned_addr learned my addr 172.21.15.133:0/1349853862 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.341+0000 7f017ffff640 1 --2- 172.21.15.133:0/1349853862 >> v2:172.21.15.138:3300/0 conn(0x7f0188072090 0x7f0188150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.341+0000 7f0186d9d640 1 -- 172.21.15.133:0/1349853862 >> v2:172.21.15.138:3300/0 conn(0x7f0188072090 msgr2=0x7f0188150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.341+0000 7f0186d9d640 1 --2- 172.21.15.133:0/1349853862 >> v2:172.21.15.138:3300/0 conn(0x7f0188072090 0x7f0188150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.341+0000 7f0186d9d640 1 -- 172.21.15.133:0/1349853862 >> v1:172.21.15.138:6789/0 conn(0x7f01880a5370 legacy=0x7f01880c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:14.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.341+0000 7f0186d9d640 1 -- 172.21.15.133:0/1349853862 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01880aad20 con 0x7f01880725c0 2023-12-19T19:01:14.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.341+0000 7f0186d9d640 1 --2- 172.21.15.133:0/1349853862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01880725c0 0x7f01881514e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f018806b360 tx=0x7f018001d940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e490f45a3ef9cf4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:14.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.341+0000 7f0185d9b640 1 -- 172.21.15.133:0/1349853862 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018000a2d0 con 0x7f01880725c0 2023-12-19T19:01:14.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.341+0000 7f0185d9b640 1 -- 172.21.15.133:0/1349853862 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01800a67c0 con 0x7f01880725c0 2023-12-19T19:01:14.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.341+0000 7f0185d9b640 1 -- 172.21.15.133:0/1349853862 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01800a6b50 con 0x7f01880725c0 2023-12-19T19:01:14.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f018ce17640 1 -- 172.21.15.133:0/1349853862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01880725c0 msgr2=0x7f01881514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:14.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f018ce17640 1 --2- 172.21.15.133:0/1349853862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01880725c0 0x7f01881514e0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f018806b360 tx=0x7f018001d940 comp rx=0 tx=0).stop 2023-12-19T19:01:14.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f018ce17640 1 -- 172.21.15.133:0/1349853862 shutdown_connections 2023-12-19T19:01:14.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f018ce17640 1 --2- 172.21.15.133:0/1349853862 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01880725c0 0x7f01881514e0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f018ce17640 1 --2- 172.21.15.133:0/1349853862 >> v2:172.21.15.138:3300/0 conn(0x7f0188072090 0x7f0188150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f018ce17640 1 -- 172.21.15.133:0/1349853862 >> 172.21.15.133:0/1349853862 conn(0x7f018806a5b0 msgr2=0x7f018806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:14.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f018ce17640 1 -- 172.21.15.133:0/1349853862 shutdown_connections 2023-12-19T19:01:14.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f018ce17640 1 -- 172.21.15.133:0/1349853862 wait complete. 2023-12-19T19:01:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f018ce17640 1 Processor -- start 2023-12-19T19:01:14.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f018ce17640 1 -- start start 2023-12-19T19:01:14.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f018ce17640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0188072090 0x7f018814d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:14.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f018ce17640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01880725c0 0x7f0188145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:14.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f018ce17640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01880a5370 0x7f0188145f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:14.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f018ce17640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0188070320 con 0x7f01880725c0 2023-12-19T19:01:14.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f018ce17640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01880a7840 con 0x7f01880a5370 2023-12-19T19:01:14.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f018ce17640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01881f0a10 con 0x7f0188072090 2023-12-19T19:01:14.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f017ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01880725c0 0x7f0188145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:14.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f017ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01880725c0 0x7f0188145a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37468/0 (socket says 172.21.15.133:37468) 2023-12-19T19:01:14.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f017ffff640 1 -- 172.21.15.133:0/1576780014 learned_addr learned my addr 172.21.15.133:0/1576780014 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:14.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f018659c640 1 --2- 172.21.15.133:0/1576780014 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0188072090 0x7f018814d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:14.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f0186d9d640 1 --2- 172.21.15.133:0/1576780014 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01880a5370 0x7f0188145f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:14.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f017ffff640 1 -- 172.21.15.133:0/1576780014 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0188072090 msgr2=0x7f018814d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:14.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f017ffff640 1 --2- 172.21.15.133:0/1576780014 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0188072090 0x7f018814d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f017ffff640 1 -- 172.21.15.133:0/1576780014 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01880a5370 msgr2=0x7f0188145f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:14.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f017ffff640 1 --2- 172.21.15.133:0/1576780014 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01880a5370 0x7f0188145f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.345+0000 7f017ffff640 1 -- 172.21.15.133:0/1576780014 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018000ac40 con 0x7f01880725c0 2023-12-19T19:01:14.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.349+0000 7f017ffff640 1 --2- 172.21.15.133:0/1576780014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01880725c0 0x7f0188145a30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f017000d620 tx=0x7f017000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:14.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.349+0000 7f017effd640 1 -- 172.21.15.133:0/1576780014 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017000b620 con 0x7f01880725c0 2023-12-19T19:01:14.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.349+0000 7f017effd640 1 -- 172.21.15.133:0/1576780014 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017000b780 con 0x7f01880725c0 2023-12-19T19:01:14.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.349+0000 7f017effd640 1 -- 172.21.15.133:0/1576780014 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017000bb10 con 0x7f01880725c0 2023-12-19T19:01:14.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.349+0000 7f018ce17640 1 -- 172.21.15.133:0/1576780014 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0188071bd0 con 0x7f01880725c0 2023-12-19T19:01:14.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.349+0000 7f018ce17640 1 -- 172.21.15.133:0/1576780014 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01880715c0 con 0x7f01880725c0 2023-12-19T19:01:14.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.349+0000 7f018ce17640 1 -- 172.21.15.133:0/1576780014 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0188068400 con 0x7f01880725c0 2023-12-19T19:01:14.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.349+0000 7f017effd640 1 -- 172.21.15.133:0/1576780014 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f017000bc70 con 0x7f01880725c0 2023-12-19T19:01:14.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.349+0000 7f017effd640 1 --2- 172.21.15.133:0/1576780014 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0168066470 0x7f0168068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:14.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.349+0000 7f017effd640 1 -- 172.21.15.133:0/1576780014 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f0170084390 con 0x7f01880725c0 2023-12-19T19:01:14.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.349+0000 7f018659c640 1 --2- 172.21.15.133:0/1576780014 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0168066470 0x7f0168068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:14.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.353+0000 7f018659c640 1 --2- 172.21.15.133:0/1576780014 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0168066470 0x7f0168068930 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0178007fd0 tx=0x7f0178007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:14.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.353+0000 7f017effd640 1 -- 172.21.15.133:0/1576780014 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0170051730 con 0x7f01880725c0 2023-12-19T19:01:14.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.533+0000 7f018ce17640 1 -- 172.21.15.133:0/1576780014 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01880c6780 con 0x7f01880725c0 2023-12-19T19:01:14.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.533+0000 7f017effd640 1 -- 172.21.15.133:0/1576780014 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4954 (secure 0 0 0) 0x7f0170007380 con 0x7f01880725c0 2023-12-19T19:01:14.538 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:14.538 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3200335051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3200335051},{"type":"v1","addr":"172.21.15.133:6833","nonce":3200335051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2114705112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":2114705112},{"type":"v1","addr":"172.21.15.138:6835","nonce":2114705112}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1768735780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1768735780},{"type":"v1","addr":"172.21.15.133:6835","nonce":1768735780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:00:49.053498+0000","modified":"2023-12-19T19:00:52.071868+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5258":{"gid":5258,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6837/3661017926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3661017926},{"type":"v1","addr":"172.21.15.138:6837","nonce":3661017926}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T19:01:14.538 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 39 2023-12-19T19:01:14.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.537+0000 7f018ce17640 1 -- 172.21.15.133:0/1576780014 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0168066470 msgr2=0x7f0168068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:14.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.537+0000 7f018ce17640 1 --2- 172.21.15.133:0/1576780014 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0168066470 0x7f0168068930 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0178007fd0 tx=0x7f0178007e40 comp rx=0 tx=0).stop 2023-12-19T19:01:14.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.537+0000 7f018ce17640 1 -- 172.21.15.133:0/1576780014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01880725c0 msgr2=0x7f0188145a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:14.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.537+0000 7f018ce17640 1 --2- 172.21.15.133:0/1576780014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01880725c0 0x7f0188145a30 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f017000d620 tx=0x7f017000dae0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.537+0000 7f018ce17640 1 -- 172.21.15.133:0/1576780014 shutdown_connections 2023-12-19T19:01:14.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.537+0000 7f018ce17640 1 --2- 172.21.15.133:0/1576780014 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0168066470 0x7f0168068930 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.537+0000 7f018ce17640 1 --2- 172.21.15.133:0/1576780014 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01880a5370 0x7f0188145f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.537+0000 7f018ce17640 1 --2- 172.21.15.133:0/1576780014 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01880725c0 0x7f0188145a30 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.537+0000 7f018ce17640 1 --2- 172.21.15.133:0/1576780014 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0188072090 0x7f018814d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.537+0000 7f018ce17640 1 -- 172.21.15.133:0/1576780014 >> 172.21.15.133:0/1576780014 conn(0x7f018806a5b0 msgr2=0x7f01880c3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:14.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.537+0000 7f018ce17640 1 -- 172.21.15.133:0/1576780014 shutdown_connections 2023-12-19T19:01:14.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.537+0000 7f018ce17640 1 -- 172.21.15.133:0/1576780014 wait complete. 2023-12-19T19:01:14.559 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:01:14.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.693+0000 7f9e04e46640 1 Processor -- start 2023-12-19T19:01:14.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.693+0000 7f9e04e46640 1 -- start start 2023-12-19T19:01:14.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.693+0000 7f9e04e46640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9e00151e90 0x7f9e000c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.693+0000 7f9e04e46640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e000c7ea0 0x7f9e0006b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.693+0000 7f9e04e46640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0006c860 con 0x7f9e000c4e60 2023-12-19T19:01:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.693+0000 7f9e04e46640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e000c8750 con 0x7f9e00151e90 2023-12-19T19:01:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.693+0000 7f9e04e46640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e001552d0 con 0x7f9e000c7ea0 2023-12-19T19:01:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.693+0000 7f9dfe59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9e00151e90 0x7f9e000c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.693+0000 7f9dfed9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9e000c4e60 0x7f9e0006b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47344/0 (socket says 172.21.15.133:47344) 2023-12-19T19:01:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.693+0000 7f9dfed9d640 1 -- 172.21.15.133:0/3568320262 learned_addr learned my addr 172.21.15.133:0/3568320262 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.693+0000 7f9df5d9b640 1 --2- 172.21.15.133:0/3568320262 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e000c7ea0 0x7f9e0006b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.693+0000 7f9dfe59c640 1 -- 172.21.15.133:0/3568320262 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e000c7ea0 msgr2=0x7f9e0006b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.693+0000 7f9dfe59c640 1 --2- 172.21.15.133:0/3568320262 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e000c7ea0 0x7f9e0006b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.693+0000 7f9dfe59c640 1 -- 172.21.15.133:0/3568320262 >> v1:172.21.15.133:6789/0 conn(0x7f9e000c4e60 legacy=0x7f9e0006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.693+0000 7f9dfe59c640 1 -- 172.21.15.133:0/3568320262 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e00154930 con 0x7f9e00151e90 2023-12-19T19:01:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.693+0000 7f9dfdd9b640 1 -- 172.21.15.133:0/3568320262 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3721604249 0 0) 0x7f9e0006c860 con 0x7f9e000c4e60 2023-12-19T19:01:14.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.693+0000 7f9df5d9b640 1 --2- 172.21.15.133:0/3568320262 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e000c7ea0 0x7f9e0006b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:14.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.697+0000 7f9dfe59c640 1 --2- 172.21.15.133:0/3568320262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e00151e90 0x7f9e000c4920 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f9df00097c0 tx=0x7f9df001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d9d530e9126a7a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:14.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.697+0000 7f9dfdd9b640 1 -- 172.21.15.133:0/3568320262 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df00ab600 con 0x7f9e00151e90 2023-12-19T19:01:14.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.697+0000 7f9dfdd9b640 1 -- 172.21.15.133:0/3568320262 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df00a7050 con 0x7f9e00151e90 2023-12-19T19:01:14.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.697+0000 7f9dfdd9b640 1 -- 172.21.15.133:0/3568320262 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df00ab980 con 0x7f9e00151e90 2023-12-19T19:01:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.697+0000 7f9e04e46640 1 -- 172.21.15.133:0/3568320262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e00151e90 msgr2=0x7f9e000c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.697+0000 7f9e04e46640 1 --2- 172.21.15.133:0/3568320262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e00151e90 0x7f9e000c4920 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f9df00097c0 tx=0x7f9df001c360 comp rx=0 tx=0).stop 2023-12-19T19:01:14.702 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.697+0000 7f9e04e46640 1 -- 172.21.15.133:0/3568320262 shutdown_connections 2023-12-19T19:01:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.697+0000 7f9e04e46640 1 --2- 172.21.15.133:0/3568320262 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e000c7ea0 0x7f9e0006b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.697+0000 7f9e04e46640 1 --2- 172.21.15.133:0/3568320262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e00151e90 0x7f9e000c4920 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.697+0000 7f9e04e46640 1 -- 172.21.15.133:0/3568320262 >> 172.21.15.133:0/3568320262 conn(0x7f9e000ca170 msgr2=0x7f9e000ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.697+0000 7f9e04e46640 1 -- 172.21.15.133:0/3568320262 shutdown_connections 2023-12-19T19:01:14.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.697+0000 7f9e04e46640 1 -- 172.21.15.133:0/3568320262 wait complete. 2023-12-19T19:01:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9e04e46640 1 Processor -- start 2023-12-19T19:01:14.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9e04e46640 1 -- start start 2023-12-19T19:01:14.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9e04e46640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e000c4e60 0x7f9e000abcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:14.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9e04e46640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e000c7ea0 0x7f9e000aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:14.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9e04e46640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e00151e90 0x7f9e000ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9e04e46640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e000ad260 con 0x7f9e000c7ea0 2023-12-19T19:01:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9e04e46640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e000ae050 con 0x7f9e000c4e60 2023-12-19T19:01:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9e04e46640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e000c25b0 con 0x7f9e00151e90 2023-12-19T19:01:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9df5d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e000c7ea0 0x7f9e000aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9df5d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e000c7ea0 0x7f9e000aaba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37484/0 (socket says 172.21.15.133:37484) 2023-12-19T19:01:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9df5d9b640 1 -- 172.21.15.133:0/2092375201 learned_addr learned my addr 172.21.15.133:0/2092375201 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9dfe59c640 1 --2- 172.21.15.133:0/2092375201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e000c4e60 0x7f9e000abcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9dfed9d640 1 --2- 172.21.15.133:0/2092375201 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e00151e90 0x7f9e000ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9df5d9b640 1 -- 172.21.15.133:0/2092375201 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e00151e90 msgr2=0x7f9e000ab0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9df5d9b640 1 --2- 172.21.15.133:0/2092375201 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e00151e90 0x7f9e000ab0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9df5d9b640 1 -- 172.21.15.133:0/2092375201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e000c4e60 msgr2=0x7f9e000abcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9df5d9b640 1 --2- 172.21.15.133:0/2092375201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e000c4e60 0x7f9e000abcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9df5d9b640 1 -- 172.21.15.133:0/2092375201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df0009420 con 0x7f9e000c7ea0 2023-12-19T19:01:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9df5d9b640 1 --2- 172.21.15.133:0/2092375201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e000c7ea0 0x7f9e000aaba0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9de8007e40 tx=0x7f9de800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9df77fe640 1 -- 172.21.15.133:0/2092375201 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de8014620 con 0x7f9e000c7ea0 2023-12-19T19:01:14.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9df77fe640 1 -- 172.21.15.133:0/2092375201 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de800ee90 con 0x7f9e000c7ea0 2023-12-19T19:01:14.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9df77fe640 1 -- 172.21.15.133:0/2092375201 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de80149c0 con 0x7f9e000c7ea0 2023-12-19T19:01:14.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9e04e46640 1 -- 172.21.15.133:0/2092375201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e000c2890 con 0x7f9e000c7ea0 2023-12-19T19:01:14.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.701+0000 7f9e04e46640 1 -- 172.21.15.133:0/2092375201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e000ac1f0 con 0x7f9e000c7ea0 2023-12-19T19:01:14.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.705+0000 7f9e04e46640 1 -- 172.21.15.133:0/2092375201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e000c2ab0 con 0x7f9e000c7ea0 2023-12-19T19:01:14.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.705+0000 7f9df77fe640 1 -- 172.21.15.133:0/2092375201 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9de8014b20 con 0x7f9e000c7ea0 2023-12-19T19:01:14.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.705+0000 7f9df77fe640 1 --2- 172.21.15.133:0/2092375201 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9de0066470 0x7f9de0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:14.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.705+0000 7f9df77fe640 1 -- 172.21.15.133:0/2092375201 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f9de80846d0 con 0x7f9e000c7ea0 2023-12-19T19:01:14.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.705+0000 7f9dfe59c640 1 --2- 172.21.15.133:0/2092375201 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9de0066470 0x7f9de0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:14.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.705+0000 7f9dfe59c640 1 --2- 172.21.15.133:0/2092375201 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9de0066470 0x7f9de0068930 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9df00ad000 tx=0x7f9df0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:14.713 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.709+0000 7f9df77fe640 1 -- 172.21.15.133:0/2092375201 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9de8051b80 con 0x7f9e000c7ea0 2023-12-19T19:01:14.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.861+0000 7f9e04e46640 1 -- 172.21.15.133:0/2092375201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e000adb20 con 0x7f9e000c7ea0 2023-12-19T19:01:14.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.865+0000 7f9df77fe640 1 -- 172.21.15.133:0/2092375201 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16739 (secure 0 0 0) 0x7f9de8009a00 con 0x7f9e000c7ea0 2023-12-19T19:01:14.867 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:14.867 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":57,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:01:12.838534+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:00:46.784805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:00:48.051355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6835/1203400706":"2023-12-20T19:01:09.827034+0000","172.21.15.133:6834/1203400706":"2023-12-20T19:01:09.827034+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:01:14.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.865+0000 7f9e04e46640 1 -- 172.21.15.133:0/2092375201 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9de0066470 msgr2=0x7f9de0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:14.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.865+0000 7f9e04e46640 1 --2- 172.21.15.133:0/2092375201 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9de0066470 0x7f9de0068930 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f9df00ad000 tx=0x7f9df0008040 comp rx=0 tx=0).stop 2023-12-19T19:01:14.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.865+0000 7f9e04e46640 1 -- 172.21.15.133:0/2092375201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e000c7ea0 msgr2=0x7f9e000aaba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:14.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.865+0000 7f9e04e46640 1 --2- 172.21.15.133:0/2092375201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e000c7ea0 0x7f9e000aaba0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f9de8007e40 tx=0x7f9de800e4b0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.865+0000 7f9e04e46640 1 -- 172.21.15.133:0/2092375201 shutdown_connections 2023-12-19T19:01:14.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.865+0000 7f9e04e46640 1 --2- 172.21.15.133:0/2092375201 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9de0066470 0x7f9de0068930 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.865+0000 7f9e04e46640 1 --2- 172.21.15.133:0/2092375201 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e00151e90 0x7f9e000ab0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.865+0000 7f9e04e46640 1 --2- 172.21.15.133:0/2092375201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e000c7ea0 0x7f9e000aaba0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.865+0000 7f9e04e46640 1 --2- 172.21.15.133:0/2092375201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e000c4e60 0x7f9e000abcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:14.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.865+0000 7f9e04e46640 1 -- 172.21.15.133:0/2092375201 >> 172.21.15.133:0/2092375201 conn(0x7f9e000ca170 msgr2=0x7f9e0006c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:14.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.865+0000 7f9e04e46640 1 -- 172.21.15.133:0/2092375201 shutdown_connections 2023-12-19T19:01:14.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:14.865+0000 7f9e04e46640 1 -- 172.21.15.133:0/2092375201 wait complete. 2023-12-19T19:01:14.890 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-12-19T19:01:14.890 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:01:15.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.025+0000 7f9d89868640 1 Processor -- start 2023-12-19T19:01:15.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.025+0000 7f9d89868640 1 -- start start 2023-12-19T19:01:15.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.025+0000 7f9d89868640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9d84151e90 0x7f9d840c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:15.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.025+0000 7f9d89868640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9d840c7ea0 0x7f9d8406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:15.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.025+0000 7f9d89868640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d8406c860 con 0x7f9d840c4e60 2023-12-19T19:01:15.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.025+0000 7f9d89868640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d840c8750 con 0x7f9d84151e90 2023-12-19T19:01:15.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.025+0000 7f9d89868640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d841552d0 con 0x7f9d840c7ea0 2023-12-19T19:01:15.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.025+0000 7f9d82ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9d84151e90 0x7f9d840c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:15.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.025+0000 7f9d82ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9d84151e90 0x7f9d840c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37490/0 (socket says 172.21.15.133:37490) 2023-12-19T19:01:15.031 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.025+0000 7f9d82ffd640 1 -- 172.21.15.133:0/1297055396 learned_addr learned my addr 172.21.15.133:0/1297055396 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:15.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.025+0000 7f9d82ffd640 1 -- 172.21.15.133:0/1297055396 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9d840c7ea0 msgr2=0x7f9d8406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:15.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.025+0000 7f9d7a7fc640 1 --2- 172.21.15.133:0/1297055396 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9d840c7ea0 0x7f9d8406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:15.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.025+0000 7f9d82ffd640 1 --2- 172.21.15.133:0/1297055396 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9d840c7ea0 0x7f9d8406b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.025+0000 7f9d82ffd640 1 -- 172.21.15.133:0/1297055396 >> v1:172.21.15.138:6789/0 conn(0x7f9d840c4e60 legacy=0x7f9d8406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:15.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.025+0000 7f9d82ffd640 1 -- 172.21.15.133:0/1297055396 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d84154930 con 0x7f9d84151e90 2023-12-19T19:01:15.032 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.025+0000 7f9d7a7fc640 1 --2- 172.21.15.133:0/1297055396 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9d840c7ea0 0x7f9d8406b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:15.036 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.029+0000 7f9d82ffd640 1 --2- 172.21.15.133:0/1297055396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d84151e90 0x7f9d840c4920 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009870 tx=0x7f9d7401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a721db902326e040 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:15.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.029+0000 7f9d827fc640 1 -- 172.21.15.133:0/1297055396 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d740ab600 con 0x7f9d84151e90 2023-12-19T19:01:15.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.029+0000 7f9d827fc640 1 -- 172.21.15.133:0/1297055396 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d740a7050 con 0x7f9d84151e90 2023-12-19T19:01:15.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.029+0000 7f9d827fc640 1 -- 172.21.15.133:0/1297055396 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d740ab980 con 0x7f9d84151e90 2023-12-19T19:01:15.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.029+0000 7f9d89868640 1 -- 172.21.15.133:0/1297055396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d84151e90 msgr2=0x7f9d840c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:15.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.029+0000 7f9d89868640 1 --2- 172.21.15.133:0/1297055396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d84151e90 0x7f9d840c4920 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009870 tx=0x7f9d7401c3e0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.029+0000 7f9d89868640 1 -- 172.21.15.133:0/1297055396 shutdown_connections 2023-12-19T19:01:15.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.029+0000 7f9d89868640 1 --2- 172.21.15.133:0/1297055396 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9d840c7ea0 0x7f9d8406b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.029+0000 7f9d89868640 1 --2- 172.21.15.133:0/1297055396 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d84151e90 0x7f9d840c4920 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.029+0000 7f9d89868640 1 -- 172.21.15.133:0/1297055396 >> 172.21.15.133:0/1297055396 conn(0x7f9d840ca170 msgr2=0x7f9d840ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:15.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.029+0000 7f9d89868640 1 -- 172.21.15.133:0/1297055396 shutdown_connections 2023-12-19T19:01:15.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.029+0000 7f9d89868640 1 -- 172.21.15.133:0/1297055396 wait complete. 2023-12-19T19:01:15.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d89868640 1 Processor -- start 2023-12-19T19:01:15.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d89868640 1 -- start start 2023-12-19T19:01:15.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d89868640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9d840c4e60 0x7f9d841f0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:15.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d89868640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d840c7ea0 0x7f9d840abe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:15.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d89868640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d84151e90 0x7f9d840ac340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:15.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d89868640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d841f1980 con 0x7f9d84151e90 2023-12-19T19:01:15.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d89868640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d840c1430 con 0x7f9d840c7ea0 2023-12-19T19:01:15.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d89868640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d84146380 con 0x7f9d840c4e60 2023-12-19T19:01:15.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d837fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d84151e90 0x7f9d840ac340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:15.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d82ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9d840c4e60 0x7f9d841f0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:15.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d7a7fc640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d840c7ea0 0x7f9d840abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:15.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d82ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9d840c4e60 0x7f9d841f0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:45358/0 (socket says 172.21.15.133:45358) 2023-12-19T19:01:15.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d82ffd640 1 -- 172.21.15.133:0/3529993023 learned_addr learned my addr 172.21.15.133:0/3529993023 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:15.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d837fe640 1 -- 172.21.15.133:0/3529993023 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9d840c4e60 msgr2=0x7f9d841f0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:15.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d837fe640 1 --2- 172.21.15.133:0/3529993023 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9d840c4e60 0x7f9d841f0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d837fe640 1 -- 172.21.15.133:0/3529993023 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d840c7ea0 msgr2=0x7f9d840abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:15.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d837fe640 1 --2- 172.21.15.133:0/3529993023 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d840c7ea0 0x7f9d840abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d837fe640 1 -- 172.21.15.133:0/3529993023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d740094d0 con 0x7f9d84151e90 2023-12-19T19:01:15.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d82ffd640 1 --2- 172.21.15.133:0/3529993023 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9d840c4e60 0x7f9d841f0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:01:15.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d837fe640 1 --2- 172.21.15.133:0/3529993023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d84151e90 0x7f9d840ac340 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c00b3e0 tx=0x7f9d7c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:15.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d80ff9640 1 -- 172.21.15.133:0/3529993023 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c011830 con 0x7f9d84151e90 2023-12-19T19:01:15.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d80ff9640 1 -- 172.21.15.133:0/3529993023 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c011990 con 0x7f9d84151e90 2023-12-19T19:01:15.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d80ff9640 1 -- 172.21.15.133:0/3529993023 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c011d80 con 0x7f9d84151e90 2023-12-19T19:01:15.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d89868640 1 -- 172.21.15.133:0/3529993023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d841f1610 con 0x7f9d84151e90 2023-12-19T19:01:15.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.033+0000 7f9d89868640 1 -- 172.21.15.133:0/3529993023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d840a9960 con 0x7f9d84151e90 2023-12-19T19:01:15.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.037+0000 7f9d89868640 1 -- 172.21.15.133:0/3529993023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d84146540 con 0x7f9d84151e90 2023-12-19T19:01:15.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.037+0000 7f9d80ff9640 1 -- 172.21.15.133:0/3529993023 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9d7c01a400 con 0x7f9d84151e90 2023-12-19T19:01:15.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.037+0000 7f9d80ff9640 1 --2- 172.21.15.133:0/3529993023 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9d64066470 0x7f9d64068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:15.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.037+0000 7f9d80ff9640 1 -- 172.21.15.133:0/3529993023 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f9d7c083b20 con 0x7f9d84151e90 2023-12-19T19:01:15.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.037+0000 7f9d82ffd640 1 --2- 172.21.15.133:0/3529993023 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9d64066470 0x7f9d64068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:15.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.037+0000 7f9d82ffd640 1 --2- 172.21.15.133:0/3529993023 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9d64066470 0x7f9d64068930 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009870 tx=0x7f9d740a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:15.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.041+0000 7f9d80ff9640 1 -- 172.21.15.133:0/3529993023 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9d7c050fe0 con 0x7f9d84151e90 2023-12-19T19:01:15.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.225+0000 7f9d89868640 1 -- 172.21.15.133:0/3529993023 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d84068400 con 0x7f9d84151e90 2023-12-19T19:01:15.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.225+0000 7f9d80ff9640 1 -- 172.21.15.133:0/3529993023 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4954 (secure 0 0 0) 0x7f9d7c015090 con 0x7f9d84151e90 2023-12-19T19:01:15.229 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:15.229 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3200335051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3200335051},{"type":"v1","addr":"172.21.15.133:6833","nonce":3200335051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2114705112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":2114705112},{"type":"v1","addr":"172.21.15.138:6835","nonce":2114705112}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1768735780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1768735780},{"type":"v1","addr":"172.21.15.133:6835","nonce":1768735780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:00:49.053498+0000","modified":"2023-12-19T19:00:52.071868+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5258":{"gid":5258,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6837/3661017926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3661017926},{"type":"v1","addr":"172.21.15.138:6837","nonce":3661017926}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T19:01:15.229 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 39 2023-12-19T19:01:15.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.225+0000 7f9d89868640 1 -- 172.21.15.133:0/3529993023 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9d64066470 msgr2=0x7f9d64068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:15.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.225+0000 7f9d89868640 1 --2- 172.21.15.133:0/3529993023 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9d64066470 0x7f9d64068930 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9d74009870 tx=0x7f9d740a6000 comp rx=0 tx=0).stop 2023-12-19T19:01:15.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.225+0000 7f9d89868640 1 -- 172.21.15.133:0/3529993023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d84151e90 msgr2=0x7f9d840ac340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:15.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.225+0000 7f9d89868640 1 --2- 172.21.15.133:0/3529993023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d84151e90 0x7f9d840ac340 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c00b3e0 tx=0x7f9d7c00b8a0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.225+0000 7f9d89868640 1 -- 172.21.15.133:0/3529993023 shutdown_connections 2023-12-19T19:01:15.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.225+0000 7f9d89868640 1 --2- 172.21.15.133:0/3529993023 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9d64066470 0x7f9d64068930 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.225+0000 7f9d89868640 1 --2- 172.21.15.133:0/3529993023 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d84151e90 0x7f9d840ac340 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.225+0000 7f9d89868640 1 --2- 172.21.15.133:0/3529993023 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9d840c7ea0 0x7f9d840abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.225+0000 7f9d89868640 1 --2- 172.21.15.133:0/3529993023 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9d840c4e60 0x7f9d841f0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.225+0000 7f9d89868640 1 -- 172.21.15.133:0/3529993023 >> 172.21.15.133:0/3529993023 conn(0x7f9d840ca170 msgr2=0x7f9d84149180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:15.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.225+0000 7f9d89868640 1 -- 172.21.15.133:0/3529993023 shutdown_connections 2023-12-19T19:01:15.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.225+0000 7f9d89868640 1 -- 172.21.15.133:0/3529993023 wait complete. 2023-12-19T19:01:15.250 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:01:15.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.385+0000 7f76b1fc1640 1 Processor -- start 2023-12-19T19:01:15.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.385+0000 7f76b1fc1640 1 -- start start 2023-12-19T19:01:15.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.385+0000 7f76b1fc1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f76ac0c7ea0 0x7f76ac06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:15.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.385+0000 7f76b1fc1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76ac06c860 con 0x7f76ac06b9e0 2023-12-19T19:01:15.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.385+0000 7f76b1fc1640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76ac154930 con 0x7f76ac151e90 2023-12-19T19:01:15.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.385+0000 7f76b1fc1640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76ac0c8750 con 0x7f76ac0c7ea0 2023-12-19T19:01:15.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.385+0000 7f76a3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f76ac0c7ea0 0x7f76ac06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:15.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.385+0000 7f76abfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f76ac06b9e0 0x7f76ac15f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47346/0 (socket says 172.21.15.133:47346) 2023-12-19T19:01:15.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.385+0000 7f76abfff640 1 -- 172.21.15.133:0/276075068 learned_addr learned my addr 172.21.15.133:0/276075068 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:15.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.385+0000 7f76a3fff640 1 -- 172.21.15.133:0/276075068 >> v1:172.21.15.138:6789/0 conn(0x7f76ac151e90 legacy=0x7f76ac0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:15.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.385+0000 7f76a3fff640 1 -- 172.21.15.133:0/276075068 >> v1:172.21.15.133:6789/0 conn(0x7f76ac06b9e0 legacy=0x7f76ac15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:15.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.385+0000 7f76a3fff640 1 -- 172.21.15.133:0/276075068 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ac154c10 con 0x7f76ac0c7ea0 2023-12-19T19:01:15.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.389+0000 7f76a3fff640 1 --2- 172.21.15.133:0/276075068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ac0c7ea0 0x7f76ac06b4a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f76940097c0 tx=0x7f769401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b838345a04d88b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:15.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.389+0000 7f76aaffd640 1 -- 172.21.15.133:0/276075068 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76940ab600 con 0x7f76ac0c7ea0 2023-12-19T19:01:15.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.389+0000 7f76aaffd640 1 -- 172.21.15.133:0/276075068 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76940a7050 con 0x7f76ac0c7ea0 2023-12-19T19:01:15.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.389+0000 7f76aaffd640 1 -- 172.21.15.133:0/276075068 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76940ab980 con 0x7f76ac0c7ea0 2023-12-19T19:01:15.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.389+0000 7f76b1fc1640 1 -- 172.21.15.133:0/276075068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ac0c7ea0 msgr2=0x7f76ac06b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:15.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.389+0000 7f76b1fc1640 1 --2- 172.21.15.133:0/276075068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ac0c7ea0 0x7f76ac06b4a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f76940097c0 tx=0x7f769401c360 comp rx=0 tx=0).stop 2023-12-19T19:01:15.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.389+0000 7f76b1fc1640 1 -- 172.21.15.133:0/276075068 shutdown_connections 2023-12-19T19:01:15.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.389+0000 7f76b1fc1640 1 --2- 172.21.15.133:0/276075068 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ac0c7ea0 0x7f76ac06b4a0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.389+0000 7f76b1fc1640 1 -- 172.21.15.133:0/276075068 >> 172.21.15.133:0/276075068 conn(0x7f76ac0ca170 msgr2=0x7f76ac0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:15.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.389+0000 7f76b1fc1640 1 -- 172.21.15.133:0/276075068 shutdown_connections 2023-12-19T19:01:15.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.389+0000 7f76b1fc1640 1 -- 172.21.15.133:0/276075068 wait complete. 2023-12-19T19:01:15.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76b1fc1640 1 Processor -- start 2023-12-19T19:01:15.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76b1fc1640 1 -- start start 2023-12-19T19:01:15.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76b1fc1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76ac06b9e0 0x7f76ac153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:15.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76b1fc1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76ac0c7ea0 0x7f76ac148000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:15.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76b1fc1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ac151e90 0x7f76ac148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:15.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76b1fc1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac1552d0 con 0x7f76ac151e90 2023-12-19T19:01:15.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76b1fc1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac0ac170 con 0x7f76ac0c7ea0 2023-12-19T19:01:15.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76b1fc1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac153cc0 con 0x7f76ac06b9e0 2023-12-19T19:01:15.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76abfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ac151e90 0x7f76ac148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:15.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76abfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ac151e90 0x7f76ac148540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37518/0 (socket says 172.21.15.133:37518) 2023-12-19T19:01:15.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76abfff640 1 -- 172.21.15.133:0/4092476355 learned_addr learned my addr 172.21.15.133:0/4092476355 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:15.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76a3fff640 1 --2- 172.21.15.133:0/4092476355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76ac0c7ea0 0x7f76ac148000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:15.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76abfff640 1 -- 172.21.15.133:0/4092476355 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76ac06b9e0 msgr2=0x7f76ac153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:15.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76abfff640 1 --2- 172.21.15.133:0/4092476355 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76ac06b9e0 0x7f76ac153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76abfff640 1 -- 172.21.15.133:0/4092476355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76ac0c7ea0 msgr2=0x7f76ac148000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:15.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76abfff640 1 --2- 172.21.15.133:0/4092476355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76ac0c7ea0 0x7f76ac148000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76abfff640 1 -- 172.21.15.133:0/4092476355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7694009420 con 0x7f76ac151e90 2023-12-19T19:01:15.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76a3fff640 1 --2- 172.21.15.133:0/4092476355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76ac0c7ea0 0x7f76ac148000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:15.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76abfff640 1 --2- 172.21.15.133:0/4092476355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ac151e90 0x7f76ac148540 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f76a400cab0 tx=0x7f76a400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:15.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76a8ff9640 1 -- 172.21.15.133:0/4092476355 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a400ac30 con 0x7f76ac151e90 2023-12-19T19:01:15.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76a8ff9640 1 -- 172.21.15.133:0/4092476355 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a400ad90 con 0x7f76ac151e90 2023-12-19T19:01:15.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76a8ff9640 1 -- 172.21.15.133:0/4092476355 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a4012600 con 0x7f76ac151e90 2023-12-19T19:01:15.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76b1fc1640 1 -- 172.21.15.133:0/4092476355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76ac148a80 con 0x7f76ac151e90 2023-12-19T19:01:15.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76b1fc1640 1 -- 172.21.15.133:0/4092476355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ac1ee8b0 con 0x7f76ac151e90 2023-12-19T19:01:15.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.393+0000 7f76b1fc1640 1 -- 172.21.15.133:0/4092476355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76ac068400 con 0x7f76ac151e90 2023-12-19T19:01:15.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.397+0000 7f76a8ff9640 1 -- 172.21.15.133:0/4092476355 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f76a4012760 con 0x7f76ac151e90 2023-12-19T19:01:15.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.397+0000 7f76a8ff9640 1 --2- 172.21.15.133:0/4092476355 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f768c0664a0 0x7f768c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:15.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.397+0000 7f76a8ff9640 1 -- 172.21.15.133:0/4092476355 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f76a4083d00 con 0x7f76ac151e90 2023-12-19T19:01:15.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.397+0000 7f76ab7fe640 1 --2- 172.21.15.133:0/4092476355 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f768c0664a0 0x7f768c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:15.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.397+0000 7f76ab7fe640 1 --2- 172.21.15.133:0/4092476355 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f768c0664a0 0x7f768c068960 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f769c000f70 tx=0x7f769c0079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:15.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.401+0000 7f76a8ff9640 1 -- 172.21.15.133:0/4092476355 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f76a4051140 con 0x7f76ac151e90 2023-12-19T19:01:15.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.581+0000 7f76b1fc1640 1 -- 172.21.15.133:0/4092476355 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76ac06b4a0 con 0x7f76ac151e90 2023-12-19T19:01:15.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.581+0000 7f76a8ff9640 1 -- 172.21.15.133:0/4092476355 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4954 (secure 0 0 0) 0x7f76a4017020 con 0x7f76ac151e90 2023-12-19T19:01:15.584 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:15.584 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3200335051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3200335051},{"type":"v1","addr":"172.21.15.133:6833","nonce":3200335051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2114705112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":2114705112},{"type":"v1","addr":"172.21.15.138:6835","nonce":2114705112}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":6330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1768735780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1768735780},{"type":"v1","addr":"172.21.15.133:6835","nonce":1768735780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:00:49.053498+0000","modified":"2023-12-19T19:00:52.071868+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5258":{"gid":5258,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6837/3661017926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":3661017926},{"type":"v1","addr":"172.21.15.138:6837","nonce":3661017926}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T19:01:15.584 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 39 2023-12-19T19:01:15.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.581+0000 7f76b1fc1640 1 -- 172.21.15.133:0/4092476355 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f768c0664a0 msgr2=0x7f768c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:15.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.581+0000 7f76b1fc1640 1 --2- 172.21.15.133:0/4092476355 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f768c0664a0 0x7f768c068960 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f769c000f70 tx=0x7f769c0079c0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.581+0000 7f76b1fc1640 1 -- 172.21.15.133:0/4092476355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ac151e90 msgr2=0x7f76ac148540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:15.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.581+0000 7f76b1fc1640 1 --2- 172.21.15.133:0/4092476355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ac151e90 0x7f76ac148540 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f76a400cab0 tx=0x7f76a400cf70 comp rx=0 tx=0).stop 2023-12-19T19:01:15.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.581+0000 7f76b1fc1640 1 -- 172.21.15.133:0/4092476355 shutdown_connections 2023-12-19T19:01:15.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.581+0000 7f76b1fc1640 1 --2- 172.21.15.133:0/4092476355 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f768c0664a0 0x7f768c068960 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.581+0000 7f76b1fc1640 1 --2- 172.21.15.133:0/4092476355 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f76ac151e90 0x7f76ac148540 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.581+0000 7f76b1fc1640 1 --2- 172.21.15.133:0/4092476355 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f76ac0c7ea0 0x7f76ac148000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.581+0000 7f76b1fc1640 1 --2- 172.21.15.133:0/4092476355 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f76ac06b9e0 0x7f76ac153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.581+0000 7f76b1fc1640 1 -- 172.21.15.133:0/4092476355 >> 172.21.15.133:0/4092476355 conn(0x7f76ac0ca170 msgr2=0x7f76ac0ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:15.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.581+0000 7f76b1fc1640 1 -- 172.21.15.133:0/4092476355 shutdown_connections 2023-12-19T19:01:15.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.581+0000 7f76b1fc1640 1 -- 172.21.15.133:0/4092476355 wait complete. 2023-12-19T19:01:15.606 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:01:15.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.741+0000 7fa585867640 1 Processor -- start 2023-12-19T19:01:15.743 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.741+0000 7fa585867640 1 -- start start 2023-12-19T19:01:15.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.741+0000 7fa585867640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa58014f800 0x7fa580072320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:15.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.741+0000 7fa585867640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa580072860 0x7fa58006fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:15.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.741+0000 7fa585867640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa5800c1010 0x7fa580155840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:15.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.741+0000 7fa585867640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa580071e90 con 0x7fa58014f800 2023-12-19T19:01:15.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.741+0000 7fa585867640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5800a5110 con 0x7fa5800c1010 2023-12-19T19:01:15.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.741+0000 7fa585867640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa580152d70 con 0x7fa580072860 2023-12-19T19:01:15.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.741+0000 7fa584865640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa58014f800 0x7fa580072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:15.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.741+0000 7fa584865640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa58014f800 0x7fa580072320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37532/0 (socket says 172.21.15.133:37532) 2023-12-19T19:01:15.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.741+0000 7fa584865640 1 -- 172.21.15.133:0/3461203432 learned_addr learned my addr 172.21.15.133:0/3461203432 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:15.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.741+0000 7fa585066640 1 --2- 172.21.15.133:0/3461203432 >> v2:172.21.15.138:3300/0 conn(0x7fa5800c1010 0x7fa580155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:15.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.741+0000 7fa57ffff640 1 --2- 172.21.15.133:0/3461203432 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa580072860 0x7fa58006fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:15.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.741+0000 7fa584865640 1 -- 172.21.15.133:0/3461203432 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa580072860 msgr2=0x7fa58006fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:15.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.741+0000 7fa584865640 1 --2- 172.21.15.133:0/3461203432 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa580072860 0x7fa58006fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.741+0000 7fa584865640 1 -- 172.21.15.133:0/3461203432 >> v2:172.21.15.138:3300/0 conn(0x7fa5800c1010 msgr2=0x7fa580155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:15.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.741+0000 7fa584865640 1 --2- 172.21.15.133:0/3461203432 >> v2:172.21.15.138:3300/0 conn(0x7fa5800c1010 0x7fa580155840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.741+0000 7fa584865640 1 -- 172.21.15.133:0/3461203432 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa580153050 con 0x7fa58014f800 2023-12-19T19:01:15.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.745+0000 7fa584865640 1 --2- 172.21.15.133:0/3461203432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa58014f800 0x7fa580072320 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fa58006b7b0 tx=0x7fa57401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50106d9f8cd9a754 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:15.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.745+0000 7fa57f7fe640 1 -- 172.21.15.133:0/3461203432 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5740ab620 con 0x7fa58014f800 2023-12-19T19:01:15.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.745+0000 7fa57f7fe640 1 -- 172.21.15.133:0/3461203432 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5740ab780 con 0x7fa58014f800 2023-12-19T19:01:15.748 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.745+0000 7fa57f7fe640 1 -- 172.21.15.133:0/3461203432 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5740abb10 con 0x7fa58014f800 2023-12-19T19:01:15.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.745+0000 7fa585867640 1 -- 172.21.15.133:0/3461203432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa58014f800 msgr2=0x7fa580072320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:15.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.745+0000 7fa585867640 1 --2- 172.21.15.133:0/3461203432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa58014f800 0x7fa580072320 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fa58006b7b0 tx=0x7fa57401c440 comp rx=0 tx=0).stop 2023-12-19T19:01:15.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.745+0000 7fa585867640 1 -- 172.21.15.133:0/3461203432 shutdown_connections 2023-12-19T19:01:15.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.745+0000 7fa585867640 1 --2- 172.21.15.133:0/3461203432 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa580072860 0x7fa58006fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.749 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.745+0000 7fa585867640 1 --2- 172.21.15.133:0/3461203432 >> v2:172.21.15.138:3300/0 conn(0x7fa5800c1010 0x7fa580155840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.745+0000 7fa585867640 1 --2- 172.21.15.133:0/3461203432 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa58014f800 0x7fa580072320 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.745+0000 7fa585867640 1 -- 172.21.15.133:0/3461203432 >> 172.21.15.133:0/3461203432 conn(0x7fa5800a7800 msgr2=0x7fa5800a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:15.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.745+0000 7fa585867640 1 -- 172.21.15.133:0/3461203432 shutdown_connections 2023-12-19T19:01:15.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.745+0000 7fa585867640 1 -- 172.21.15.133:0/3461203432 wait complete. 2023-12-19T19:01:15.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.745+0000 7fa585867640 1 Processor -- start 2023-12-19T19:01:15.750 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.745+0000 7fa585867640 1 -- start start 2023-12-19T19:01:15.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa585867640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa580072860 0x7fa5801467c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:15.752 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa585867640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800c1010 0x7fa58014adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:15.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa585867640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa58014f800 0x7fa5801f0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:15.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa585867640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5801f0800 con 0x7fa5800c1010 2023-12-19T19:01:15.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa585867640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5801535f0 con 0x7fa58014f800 2023-12-19T19:01:15.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa585867640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa580153b20 con 0x7fa580072860 2023-12-19T19:01:15.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa57ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800c1010 0x7fa58014adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:15.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa57ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800c1010 0x7fa58014adb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37534/0 (socket says 172.21.15.133:37534) 2023-12-19T19:01:15.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa57ffff640 1 -- 172.21.15.133:0/1804831735 learned_addr learned my addr 172.21.15.133:0/1804831735 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:15.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa584865640 1 --2- 172.21.15.133:0/1804831735 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa580072860 0x7fa5801467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:15.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa585066640 1 --2- 172.21.15.133:0/1804831735 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa58014f800 0x7fa5801f0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:15.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa57ffff640 1 -- 172.21.15.133:0/1804831735 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa580072860 msgr2=0x7fa5801467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:15.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa57ffff640 1 --2- 172.21.15.133:0/1804831735 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa580072860 0x7fa5801467c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa57ffff640 1 -- 172.21.15.133:0/1804831735 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa58014f800 msgr2=0x7fa5801f0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:15.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa57ffff640 1 --2- 172.21.15.133:0/1804831735 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa58014f800 0x7fa5801f0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.753 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa57ffff640 1 -- 172.21.15.133:0/1804831735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5740094d0 con 0x7fa5800c1010 2023-12-19T19:01:15.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa584865640 1 --2- 172.21.15.133:0/1804831735 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa580072860 0x7fa5801467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:15.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa57ffff640 1 --2- 172.21.15.133:0/1804831735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800c1010 0x7fa58014adb0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00d620 tx=0x7fa56c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:15.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa57d7fa640 1 -- 172.21.15.133:0/1804831735 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c00b620 con 0x7fa5800c1010 2023-12-19T19:01:15.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa585867640 1 -- 172.21.15.133:0/1804831735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5800c3410 con 0x7fa5800c1010 2023-12-19T19:01:15.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa57d7fa640 1 -- 172.21.15.133:0/1804831735 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56c00b780 con 0x7fa5800c1010 2023-12-19T19:01:15.754 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa57d7fa640 1 -- 172.21.15.133:0/1804831735 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56c00bb10 con 0x7fa5800c1010 2023-12-19T19:01:15.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa585867640 1 -- 172.21.15.133:0/1804831735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa580153840 con 0x7fa5800c1010 2023-12-19T19:01:15.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.749+0000 7fa585867640 1 -- 172.21.15.133:0/1804831735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5801f0a70 con 0x7fa5800c1010 2023-12-19T19:01:15.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.753+0000 7fa57d7fa640 1 -- 172.21.15.133:0/1804831735 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa56c00bc70 con 0x7fa5800c1010 2023-12-19T19:01:15.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.753+0000 7fa57d7fa640 1 --2- 172.21.15.133:0/1804831735 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa564066470 0x7fa564068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:15.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.753+0000 7fa57d7fa640 1 -- 172.21.15.133:0/1804831735 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fa56c084490 con 0x7fa5800c1010 2023-12-19T19:01:15.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.753+0000 7fa584865640 1 --2- 172.21.15.133:0/1804831735 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa564066470 0x7fa564068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:15.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.753+0000 7fa584865640 1 --2- 172.21.15.133:0/1804831735 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa564066470 0x7fa564068930 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa5740af000 tx=0x7fa5740a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:15.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.757+0000 7fa57d7fa640 1 -- 172.21.15.133:0/1804831735 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa56c051820 con 0x7fa5800c1010 2023-12-19T19:01:15.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.909+0000 7fa585867640 1 -- 172.21.15.133:0/1804831735 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa58004e850 con 0x7fa5800c1010 2023-12-19T19:01:15.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.909+0000 7fa57d7fa640 1 -- 172.21.15.133:0/1804831735 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) v1 ==== 74+0+16739 (secure 0 0 0) 0x7fa56c007380 con 0x7fa5800c1010 2023-12-19T19:01:15.915 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:15.915 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":57,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:01:12.838534+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:00:46.784805+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:00:48.051355+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6835/1203400706":"2023-12-20T19:01:09.827034+0000","172.21.15.133:6834/1203400706":"2023-12-20T19:01:09.827034+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:01:15.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.913+0000 7fa585867640 1 -- 172.21.15.133:0/1804831735 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa564066470 msgr2=0x7fa564068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:15.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.913+0000 7fa585867640 1 --2- 172.21.15.133:0/1804831735 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa564066470 0x7fa564068930 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa5740af000 tx=0x7fa5740a7000 comp rx=0 tx=0).stop 2023-12-19T19:01:15.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.913+0000 7fa585867640 1 -- 172.21.15.133:0/1804831735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800c1010 msgr2=0x7fa58014adb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:15.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.913+0000 7fa585867640 1 --2- 172.21.15.133:0/1804831735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800c1010 0x7fa58014adb0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00d620 tx=0x7fa56c00dae0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.913+0000 7fa585867640 1 -- 172.21.15.133:0/1804831735 shutdown_connections 2023-12-19T19:01:15.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.913+0000 7fa585867640 1 --2- 172.21.15.133:0/1804831735 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa564066470 0x7fa564068930 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.913+0000 7fa585867640 1 --2- 172.21.15.133:0/1804831735 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa58014f800 0x7fa5801f0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.913+0000 7fa585867640 1 --2- 172.21.15.133:0/1804831735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5800c1010 0x7fa58014adb0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.913+0000 7fa585867640 1 --2- 172.21.15.133:0/1804831735 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa580072860 0x7fa5801467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:15.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.913+0000 7fa585867640 1 -- 172.21.15.133:0/1804831735 >> 172.21.15.133:0/1804831735 conn(0x7fa5800a7800 msgr2=0x7fa58014e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:15.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.913+0000 7fa585867640 1 -- 172.21.15.133:0/1804831735 shutdown_connections 2023-12-19T19:01:15.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:15.913+0000 7fa585867640 1 -- 172.21.15.133:0/1804831735 wait complete. 2023-12-19T19:01:15.937 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-12-19T19:01:16.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.073+0000 7f9304380640 1 Processor -- start 2023-12-19T19:01:16.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.073+0000 7f9304380640 1 -- start start 2023-12-19T19:01:16.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.073+0000 7f9304380640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f92fc0a5240 0x7f92fc0bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:16.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.073+0000 7f9304380640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f92fc0c01c0 0x7f92fc0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:16.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.073+0000 7f9304380640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92fc0c61a0 0x7f92fc1561f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:16.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.073+0000 7f9304380640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92fc0c3bd0 con 0x7f92fc0a5240 2023-12-19T19:01:16.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.073+0000 7f9304380640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92fc0bf1e0 con 0x7f92fc0c01c0 2023-12-19T19:01:16.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.073+0000 7f9304380640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc0c3e20 con 0x7f92fc0c61a0 2023-12-19T19:01:16.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.073+0000 7f930211c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f92fc0a5240 0x7f92fc0bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:16.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.073+0000 7f930211c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f92fc0a5240 0x7f92fc0bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37550/0 (socket says 172.21.15.133:37550) 2023-12-19T19:01:16.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.073+0000 7f930211c640 1 -- 172.21.15.133:0/634843008 learned_addr learned my addr 172.21.15.133:0/634843008 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:16.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.073+0000 7f930291d640 1 --2- 172.21.15.133:0/634843008 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92fc0c61a0 0x7f92fc1561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:16.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.073+0000 7f930191b640 1 --2- 172.21.15.133:0/634843008 >> v2:172.21.15.138:3300/0 conn(0x7f92fc0c01c0 0x7f92fc0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:16.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.073+0000 7f930211c640 1 -- 172.21.15.133:0/634843008 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92fc0c61a0 msgr2=0x7f92fc1561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:16.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.073+0000 7f930211c640 1 --2- 172.21.15.133:0/634843008 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92fc0c61a0 0x7f92fc1561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:16.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.073+0000 7f930211c640 1 -- 172.21.15.133:0/634843008 >> v2:172.21.15.138:3300/0 conn(0x7f92fc0c01c0 msgr2=0x7f92fc0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:16.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.073+0000 7f930211c640 1 --2- 172.21.15.133:0/634843008 >> v2:172.21.15.138:3300/0 conn(0x7f92fc0c01c0 0x7f92fc0c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:16.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.073+0000 7f930211c640 1 -- 172.21.15.133:0/634843008 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc0c4100 con 0x7f92fc0a5240 2023-12-19T19:01:16.080 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.077+0000 7f930211c640 1 --2- 172.21.15.133:0/634843008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92fc0a5240 0x7f92fc0bfc80 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f92fc06b390 tx=0x7f92f801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c4acd0cd4c5641 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:16.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.077+0000 7f930111a640 1 -- 172.21.15.133:0/634843008 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc156f40 con 0x7f92fc0a5240 2023-12-19T19:01:16.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.077+0000 7f930111a640 1 -- 172.21.15.133:0/634843008 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f80ab600 con 0x7f92fc0a5240 2023-12-19T19:01:16.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.077+0000 7f930111a640 1 -- 172.21.15.133:0/634843008 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f80ab990 con 0x7f92fc0a5240 2023-12-19T19:01:16.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.077+0000 7f9304380640 1 -- 172.21.15.133:0/634843008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92fc0a5240 msgr2=0x7f92fc0bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:16.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.077+0000 7f9304380640 1 --2- 172.21.15.133:0/634843008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92fc0a5240 0x7f92fc0bfc80 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f92fc06b390 tx=0x7f92f801c440 comp rx=0 tx=0).stop 2023-12-19T19:01:16.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.077+0000 7f9304380640 1 -- 172.21.15.133:0/634843008 shutdown_connections 2023-12-19T19:01:16.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.077+0000 7f9304380640 1 --2- 172.21.15.133:0/634843008 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92fc0c61a0 0x7f92fc1561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:16.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.077+0000 7f9304380640 1 --2- 172.21.15.133:0/634843008 >> v2:172.21.15.138:3300/0 conn(0x7f92fc0c01c0 0x7f92fc0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:16.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.077+0000 7f9304380640 1 --2- 172.21.15.133:0/634843008 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92fc0a5240 0x7f92fc0bfc80 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:16.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.077+0000 7f9304380640 1 -- 172.21.15.133:0/634843008 >> 172.21.15.133:0/634843008 conn(0x7f92fc06a5b0 msgr2=0x7f92fc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:16.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.077+0000 7f9304380640 1 -- 172.21.15.133:0/634843008 shutdown_connections 2023-12-19T19:01:16.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.077+0000 7f9304380640 1 -- 172.21.15.133:0/634843008 wait complete. 2023-12-19T19:01:16.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f9304380640 1 Processor -- start 2023-12-19T19:01:16.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f9304380640 1 -- start start 2023-12-19T19:01:16.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f9304380640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92fc0a5240 0x7f92fc071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:16.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f9304380640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92fc0c01c0 0x7f92fc14b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:16.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f9304380640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92fc0c61a0 0x7f92fc14ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:16.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f9304380640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc153f00 con 0x7f92fc0c61a0 2023-12-19T19:01:16.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f9304380640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc152320 con 0x7f92fc0c01c0 2023-12-19T19:01:16.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f9304380640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc14c5d0 con 0x7f92fc0a5240 2023-12-19T19:01:16.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f930291d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92fc0c61a0 0x7f92fc14ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:16.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f930291d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92fc0c61a0 0x7f92fc14ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37566/0 (socket says 172.21.15.133:37566) 2023-12-19T19:01:16.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f930291d640 1 -- 172.21.15.133:0/2200375201 learned_addr learned my addr 172.21.15.133:0/2200375201 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f930191b640 1 --2- 172.21.15.133:0/2200375201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92fc0c01c0 0x7f92fc14b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f930291d640 1 -- 172.21.15.133:0/2200375201 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92fc0a5240 msgr2=0x7f92fc071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f930211c640 1 --2- 172.21.15.133:0/2200375201 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92fc0a5240 0x7f92fc071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f930291d640 1 --2- 172.21.15.133:0/2200375201 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92fc0a5240 0x7f92fc071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f930291d640 1 -- 172.21.15.133:0/2200375201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92fc0c01c0 msgr2=0x7f92fc14b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f930291d640 1 --2- 172.21.15.133:0/2200375201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92fc0c01c0 0x7f92fc14b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f930291d640 1 -- 172.21.15.133:0/2200375201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f80094d0 con 0x7f92fc0c61a0 2023-12-19T19:01:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f930191b640 1 --2- 172.21.15.133:0/2200375201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92fc0c01c0 0x7f92fc14b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f930211c640 1 --2- 172.21.15.133:0/2200375201 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92fc0a5240 0x7f92fc071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f930291d640 1 --2- 172.21.15.133:0/2200375201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92fc0c61a0 0x7f92fc14ba90 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f92f400efc0 tx=0x7f92f400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:16.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f92f2ffd640 1 -- 172.21.15.133:0/2200375201 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f4009ba0 con 0x7f92fc0c61a0 2023-12-19T19:01:16.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f92f2ffd640 1 -- 172.21.15.133:0/2200375201 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f400f040 con 0x7f92fc0c61a0 2023-12-19T19:01:16.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f92f2ffd640 1 -- 172.21.15.133:0/2200375201 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f40146c0 con 0x7f92fc0c61a0 2023-12-19T19:01:16.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f9304380640 1 -- 172.21.15.133:0/2200375201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92fc14c310 con 0x7f92fc0c61a0 2023-12-19T19:01:16.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f9304380640 1 -- 172.21.15.133:0/2200375201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92fc151b20 con 0x7f92fc0c61a0 2023-12-19T19:01:16.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.081+0000 7f9304380640 1 -- 172.21.15.133:0/2200375201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92fc0c52e0 con 0x7f92fc0c61a0 2023-12-19T19:01:16.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.085+0000 7f92f2ffd640 1 -- 172.21.15.133:0/2200375201 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f92f4014820 con 0x7f92fc0c61a0 2023-12-19T19:01:16.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.085+0000 7f92f2ffd640 1 --2- 172.21.15.133:0/2200375201 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f92e0066470 0x7f92e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:16.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.085+0000 7f92f2ffd640 1 -- 172.21.15.133:0/2200375201 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f92f40849b0 con 0x7f92fc0c61a0 2023-12-19T19:01:16.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.085+0000 7f930211c640 1 --2- 172.21.15.133:0/2200375201 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f92e0066470 0x7f92e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:16.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.085+0000 7f930211c640 1 --2- 172.21.15.133:0/2200375201 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f92e0066470 0x7f92e0068930 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f92f80af000 tx=0x7f92f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:16.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.089+0000 7f92f2ffd640 1 -- 172.21.15.133:0/2200375201 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f92f4051dc0 con 0x7f92fc0c61a0 2023-12-19T19:01:16.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.277+0000 7f9304380640 1 -- 172.21.15.133:0/2200375201 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f92fc068400 con 0x7f92fc0c61a0 2023-12-19T19:01:16.279 INFO:tasks.ceph.mon.a.smithi133.stderr:2023-12-19T19:01:16.277+0000 7f5189f85640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T19:01:16.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.281+0000 7f92f2ffd640 1 -- 172.21.15.133:0/2200375201 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) v1 ==== 163+0+0 (secure 0 0 0) 0x7f92f4018090 con 0x7f92fc0c61a0 2023-12-19T19:01:16.283 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T19:01:16.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.281+0000 7f9304380640 1 -- 172.21.15.133:0/2200375201 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f92e0066470 msgr2=0x7f92e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:16.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.281+0000 7f9304380640 1 --2- 172.21.15.133:0/2200375201 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f92e0066470 0x7f92e0068930 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f92f80af000 tx=0x7f92f8008040 comp rx=0 tx=0).stop 2023-12-19T19:01:16.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.281+0000 7f9304380640 1 -- 172.21.15.133:0/2200375201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92fc0c61a0 msgr2=0x7f92fc14ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:16.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.281+0000 7f9304380640 1 --2- 172.21.15.133:0/2200375201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92fc0c61a0 0x7f92fc14ba90 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f92f400efc0 tx=0x7f92f400c490 comp rx=0 tx=0).stop 2023-12-19T19:01:16.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.281+0000 7f9304380640 1 -- 172.21.15.133:0/2200375201 shutdown_connections 2023-12-19T19:01:16.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.281+0000 7f9304380640 1 --2- 172.21.15.133:0/2200375201 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f92e0066470 0x7f92e0068930 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:16.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.281+0000 7f9304380640 1 --2- 172.21.15.133:0/2200375201 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92fc0c61a0 0x7f92fc14ba90 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:16.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.281+0000 7f9304380640 1 --2- 172.21.15.133:0/2200375201 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92fc0c01c0 0x7f92fc14b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:16.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.281+0000 7f9304380640 1 --2- 172.21.15.133:0/2200375201 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92fc0a5240 0x7f92fc071100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:16.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.281+0000 7f9304380640 1 -- 172.21.15.133:0/2200375201 >> 172.21.15.133:0/2200375201 conn(0x7f92fc06a5b0 msgr2=0x7f92fc15f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:16.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.281+0000 7f9304380640 1 -- 172.21.15.133:0/2200375201 shutdown_connections 2023-12-19T19:01:16.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.281+0000 7f9304380640 1 -- 172.21.15.133:0/2200375201 wait complete. 2023-12-19T19:01:16.294 INFO:tasks.ceph.mds.b.smithi138.stderr: -2100> 2023-12-19T19:00:50.941+0000 7fc3fd19e640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T19:01:16.306 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-12-19T19:01:16.343 INFO:tasks.ceph.mds.b.smithi138.stdout:starting mds.b at 2023-12-19T19:01:16.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.441+0000 7f31c891d640 1 Processor -- start 2023-12-19T19:01:16.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.441+0000 7f31c891d640 1 -- start start 2023-12-19T19:01:16.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.441+0000 7f31c891d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31c40c5640 0x7f31c40c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:16.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c891d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c40c2580 con 0x7f31c40c60f0 2023-12-19T19:01:16.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c891d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31c40c1a00 con 0x7f31c40c5260 2023-12-19T19:01:16.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c891d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c4153510 con 0x7f31c40c5640 2023-12-19T19:01:16.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c2d9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f31c40c60f0 0x7f31c4155de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47356/0 (socket says 172.21.15.133:47356) 2023-12-19T19:01:16.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c2d9d640 1 -- 172.21.15.133:0/1305812102 learned_addr learned my addr 172.21.15.133:0/1305812102 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:16.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31bbfff640 1 --2- 172.21.15.133:0/1305812102 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31c40c5640 0x7f31c40c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:16.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c1d9b640 1 -- 172.21.15.133:0/1305812102 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644875743 0 0) 0x7f31c40c2580 con 0x7f31c40c60f0 2023-12-19T19:01:16.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c1d9b640 1 -- 172.21.15.133:0/1305812102 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31b0003530 con 0x7f31c40c60f0 2023-12-19T19:01:16.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c1d9b640 1 -- 172.21.15.133:0/1305812102 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2468393790 0 0) 0x7f31c40c1a00 con 0x7f31c40c5260 2023-12-19T19:01:16.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c1d9b640 1 -- 172.21.15.133:0/1305812102 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31c40c2580 con 0x7f31c40c5260 2023-12-19T19:01:16.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c1d9b640 1 -- 172.21.15.133:0/1305812102 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 884979962 0 0) 0x7f31b0003530 con 0x7f31c40c60f0 2023-12-19T19:01:16.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c1d9b640 1 -- 172.21.15.133:0/1305812102 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31c40c5640 msgr2=0x7f31c40c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:16.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c1d9b640 1 --2- 172.21.15.133:0/1305812102 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31c40c5640 0x7f31c40c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:16.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c1d9b640 1 -- 172.21.15.133:0/1305812102 >> v1:172.21.15.138:6789/0 conn(0x7f31c40c5260 legacy=0x7f31c406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:16.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c1d9b640 1 -- 172.21.15.133:0/1305812102 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c40c1ce0 con 0x7f31c40c60f0 2023-12-19T19:01:16.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c1d9b640 1 -- 172.21.15.133:0/1305812102 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f31bc001a00 con 0x7f31c40c60f0 2023-12-19T19:01:16.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c1d9b640 1 -- 172.21.15.133:0/1305812102 >> v1:172.21.15.133:6789/0 conn(0x7f31c40c60f0 legacy=0x7f31c4155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:16.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c1d9b640 1 --2- 172.21.15.133:0/1305812102 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31b0003b40 0x7f31b0003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:16.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c1d9b640 1 --2- 172.21.15.133:0/1305812102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b00047d0 0x7f31b0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:16.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c1d9b640 1 --2- 172.21.15.133:0/1305812102 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31c40c5640 0x7f31b00051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:16.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c1d9b640 1 -- 172.21.15.133:0/1305812102 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b000ba70 con 0x7f31b00047d0 2023-12-19T19:01:16.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c1d9b640 1 -- 172.21.15.133:0/1305812102 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b000bbe0 con 0x7f31b0003b40 2023-12-19T19:01:16.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c1d9b640 1 -- 172.21.15.133:0/1305812102 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b000bda0 con 0x7f31c40c5640 2023-12-19T19:01:16.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31bbfff640 1 --2- 172.21.15.133:0/1305812102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b00047d0 0x7f31b0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:16.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c259c640 1 --2- 172.21.15.133:0/1305812102 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31b0003b40 0x7f31b0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:16.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31c2d9d640 1 --2- 172.21.15.133:0/1305812102 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31c40c5640 0x7f31b00051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:16.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31bbfff640 1 -- 172.21.15.133:0/1305812102 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31c40c5640 msgr2=0x7f31b00051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:16.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31bbfff640 1 --2- 172.21.15.133:0/1305812102 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31c40c5640 0x7f31b00051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:16.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31bbfff640 1 -- 172.21.15.133:0/1305812102 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31b0003b40 msgr2=0x7f31b0003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:16.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31bbfff640 1 --2- 172.21.15.133:0/1305812102 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31b0003b40 0x7f31b0003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:16.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.445+0000 7f31bbfff640 1 -- 172.21.15.133:0/1305812102 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b0003530 con 0x7f31b00047d0 2023-12-19T19:01:16.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.449+0000 7f31bbfff640 1 --2- 172.21.15.133:0/1305812102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b00047d0 0x7f31b0004c50 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009ab0 tx=0x7f31ac01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40f4cd060bdaba8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:16.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.449+0000 7f31c1d9b640 1 -- 172.21.15.133:0/1305812102 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac0a6410 con 0x7f31b00047d0 2023-12-19T19:01:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.449+0000 7f31c1d9b640 1 -- 172.21.15.133:0/1305812102 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ac0a6570 con 0x7f31b00047d0 2023-12-19T19:01:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.449+0000 7f31c1d9b640 1 -- 172.21.15.133:0/1305812102 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ac0a6920 con 0x7f31b00047d0 2023-12-19T19:01:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.449+0000 7f31c891d640 1 -- 172.21.15.133:0/1305812102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b00047d0 msgr2=0x7f31b0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.449+0000 7f31c891d640 1 --2- 172.21.15.133:0/1305812102 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b00047d0 0x7f31b0004c50 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f31ac009ab0 tx=0x7f31ac01ca30 comp rx=0 tx=0).stop 2023-12-19T19:01:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.449+0000 7f31c2d9d640 1 -- 172.21.15.133:0/1305812102 reap_dead start 2023-12-19T19:01:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.449+0000 7f31c891d640 1 -- 172.21.15.133:0/1305812102 shutdown_connections 2023-12-19T19:01:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.449+0000 7f31c891d640 1 -- 172.21.15.133:0/1305812102 >> 172.21.15.133:0/1305812102 conn(0x7f31c406a5b0 msgr2=0x7f31c406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.449+0000 7f31c891d640 1 -- 172.21.15.133:0/1305812102 shutdown_connections 2023-12-19T19:01:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.449+0000 7f31c891d640 1 -- 172.21.15.133:0/1305812102 wait complete. 2023-12-19T19:01:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.449+0000 7f31c891d640 1 Processor -- start 2023-12-19T19:01:16.455 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.449+0000 7f31c891d640 1 -- start start 2023-12-19T19:01:16.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31c891d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b00047d0 0x7f31c414d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:16.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31c891d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31c40bf360 0x7f31c4158270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:16.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31c891d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31c40a92d0 0x7f31c40a9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:16.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31c891d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c4158dc0 con 0x7f31b00047d0 2023-12-19T19:01:16.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31c891d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c4158ae0 con 0x7f31c40a92d0 2023-12-19T19:01:16.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31c891d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c414cdc0 con 0x7f31c40bf360 2023-12-19T19:01:16.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31c259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b00047d0 0x7f31c414d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:16.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31c259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b00047d0 0x7f31c414d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37582/0 (socket says 172.21.15.133:37582) 2023-12-19T19:01:16.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31c259c640 1 -- 172.21.15.133:0/2652173246 learned_addr learned my addr 172.21.15.133:0/2652173246 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:16.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31c259c640 1 -- 172.21.15.133:0/2652173246 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31c40bf360 msgr2=0x7f31c4158270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:16.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31bbfff640 1 --2- 172.21.15.133:0/2652173246 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31c40bf360 0x7f31c4158270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:16.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31c2d9d640 1 --2- 172.21.15.133:0/2652173246 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31c40a92d0 0x7f31c40a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:16.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31c259c640 1 --2- 172.21.15.133:0/2652173246 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31c40bf360 0x7f31c4158270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:16.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31c259c640 1 -- 172.21.15.133:0/2652173246 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31c40a92d0 msgr2=0x7f31c40a9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:16.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31c259c640 1 --2- 172.21.15.133:0/2652173246 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31c40a92d0 0x7f31c40a9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:16.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31c259c640 1 -- 172.21.15.133:0/2652173246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c414d0a0 con 0x7f31b00047d0 2023-12-19T19:01:16.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31bbfff640 1 --2- 172.21.15.133:0/2652173246 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31c40bf360 0x7f31c4158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:16.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31c2d9d640 1 --2- 172.21.15.133:0/2652173246 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31c40a92d0 0x7f31c40a9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:16.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31c259c640 1 --2- 172.21.15.133:0/2652173246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b00047d0 0x7f31c414d8a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f31b400f730 tx=0x7f31b400fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:16.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31baffd640 1 -- 172.21.15.133:0/2652173246 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b400fe40 con 0x7f31b00047d0 2023-12-19T19:01:16.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31baffd640 1 -- 172.21.15.133:0/2652173246 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b40052e0 con 0x7f31b00047d0 2023-12-19T19:01:16.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31baffd640 1 -- 172.21.15.133:0/2652173246 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b400d970 con 0x7f31b00047d0 2023-12-19T19:01:16.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31c891d640 1 -- 172.21.15.133:0/2652173246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c414d380 con 0x7f31b00047d0 2023-12-19T19:01:16.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31c891d640 1 -- 172.21.15.133:0/2652173246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c41587b0 con 0x7f31b00047d0 2023-12-19T19:01:16.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31c891d640 1 -- 172.21.15.133:0/2652173246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c4068400 con 0x7f31b00047d0 2023-12-19T19:01:16.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.453+0000 7f31baffd640 1 -- 172.21.15.133:0/2652173246 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f31b400dad0 con 0x7f31b00047d0 2023-12-19T19:01:16.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.457+0000 7f31baffd640 1 --2- 172.21.15.133:0/2652173246 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f31a40664a0 0x7f31a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:16.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.457+0000 7f31baffd640 1 -- 172.21.15.133:0/2652173246 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f31b40840c0 con 0x7f31b00047d0 2023-12-19T19:01:16.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.457+0000 7f31bbfff640 1 --2- 172.21.15.133:0/2652173246 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f31a40664a0 0x7f31a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:16.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.457+0000 7f31bbfff640 1 --2- 172.21.15.133:0/2652173246 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f31a40664a0 0x7f31a4068960 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0ad000 tx=0x7f31ac0046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:16.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.461+0000 7f31baffd640 1 -- 172.21.15.133:0/2652173246 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f31b4051360 con 0x7f31b00047d0 2023-12-19T19:01:16.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:16.641+0000 7f31c891d640 1 -- 172.21.15.133:0/2652173246 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f31c406d390 con 0x7f31b00047d0 2023-12-19T19:01:17.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.281+0000 7f31baffd640 1 -- 172.21.15.133:0/2652173246 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 105+0+0 (secure 0 0 0) 0x7f31b4054980 con 0x7f31b00047d0 2023-12-19T19:01:17.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.285+0000 7f31c891d640 1 -- 172.21.15.133:0/2652173246 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f31a40664a0 msgr2=0x7f31a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:17.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.285+0000 7f31c891d640 1 --2- 172.21.15.133:0/2652173246 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f31a40664a0 0x7f31a4068960 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f31ac0ad000 tx=0x7f31ac0046d0 comp rx=0 tx=0).stop 2023-12-19T19:01:17.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.285+0000 7f31c891d640 1 -- 172.21.15.133:0/2652173246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b00047d0 msgr2=0x7f31c414d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:17.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.285+0000 7f31c891d640 1 --2- 172.21.15.133:0/2652173246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b00047d0 0x7f31c414d8a0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f31b400f730 tx=0x7f31b400fbf0 comp rx=0 tx=0).stop 2023-12-19T19:01:17.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.285+0000 7f31c891d640 1 -- 172.21.15.133:0/2652173246 shutdown_connections 2023-12-19T19:01:17.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.285+0000 7f31c891d640 1 --2- 172.21.15.133:0/2652173246 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f31a40664a0 0x7f31a4068960 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:17.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.285+0000 7f31c891d640 1 --2- 172.21.15.133:0/2652173246 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f31c40a92d0 0x7f31c40a9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:17.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.285+0000 7f31c891d640 1 --2- 172.21.15.133:0/2652173246 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f31c40bf360 0x7f31c4158270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:17.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.285+0000 7f31c891d640 1 --2- 172.21.15.133:0/2652173246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f31b00047d0 0x7f31c414d8a0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:17.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.285+0000 7f31c891d640 1 -- 172.21.15.133:0/2652173246 >> 172.21.15.133:0/2652173246 conn(0x7f31c406a5b0 msgr2=0x7f31c415d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:17.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.285+0000 7f31c891d640 1 -- 172.21.15.133:0/2652173246 shutdown_connections 2023-12-19T19:01:17.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.285+0000 7f31c891d640 1 -- 172.21.15.133:0/2652173246 wait complete. 2023-12-19T19:01:17.312 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-12-19T19:01:17.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.453+0000 7f095b66b640 1 Processor -- start 2023-12-19T19:01:17.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.453+0000 7f095b66b640 1 -- start start 2023-12-19T19:01:17.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.453+0000 7f095b66b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f09540c07b0 0x7f095406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:17.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.453+0000 7f095b66b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09540724c0 0x7f095406dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:17.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.453+0000 7f095b66b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09540c5ba0 con 0x7f095414f9f0 2023-12-19T19:01:17.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.453+0000 7f095b66b640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f095406c160 con 0x7f09540c07b0 2023-12-19T19:01:17.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.453+0000 7f095b66b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09540c5410 con 0x7f09540724c0 2023-12-19T19:01:17.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.453+0000 7f0959407640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f095414f9f0 0x7f09540c27d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47364/0 (socket says 172.21.15.133:47364) 2023-12-19T19:01:17.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.453+0000 7f0959407640 1 -- 172.21.15.133:0/4026679488 learned_addr learned my addr 172.21.15.133:0/4026679488 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:17.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.453+0000 7f0958c06640 1 --2- 172.21.15.133:0/4026679488 >> v2:172.21.15.133:3300/0 conn(0x7f09540c07b0 0x7f095406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:17.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.453+0000 7f0959c08640 1 --2- 172.21.15.133:0/4026679488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09540724c0 0x7f095406dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:17.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.453+0000 7f094bfff640 1 -- 172.21.15.133:0/4026679488 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394257336 0 0) 0x7f0950001120 con 0x7f095414f9f0 2023-12-19T19:01:17.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.453+0000 7f0958c06640 1 -- 172.21.15.133:0/4026679488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09540724c0 msgr2=0x7f095406dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:17.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.453+0000 7f0958c06640 1 --2- 172.21.15.133:0/4026679488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09540724c0 0x7f095406dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:17.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.453+0000 7f0958c06640 1 -- 172.21.15.133:0/4026679488 >> v1:172.21.15.133:6789/0 conn(0x7f095414f9f0 legacy=0x7f09540c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:17.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.453+0000 7f0958c06640 1 -- 172.21.15.133:0/4026679488 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09540c2210 con 0x7f09540c07b0 2023-12-19T19:01:17.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.457+0000 7f0958c06640 1 --2- 172.21.15.133:0/4026679488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09540c07b0 0x7f095406d6d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f09440097f0 tx=0x7f094401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c57cc61fef770050 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:17.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.457+0000 7f094bfff640 1 -- 172.21.15.133:0/4026679488 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09440ac640 con 0x7f09540c07b0 2023-12-19T19:01:17.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.457+0000 7f094bfff640 1 -- 172.21.15.133:0/4026679488 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09440ac7a0 con 0x7f09540c07b0 2023-12-19T19:01:17.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.457+0000 7f094bfff640 1 -- 172.21.15.133:0/4026679488 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09440acb30 con 0x7f09540c07b0 2023-12-19T19:01:17.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.457+0000 7f095b66b640 1 -- 172.21.15.133:0/4026679488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09540c07b0 msgr2=0x7f095406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:17.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.457+0000 7f095b66b640 1 --2- 172.21.15.133:0/4026679488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09540c07b0 0x7f095406d6d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f09440097f0 tx=0x7f094401c3c0 comp rx=0 tx=0).stop 2023-12-19T19:01:17.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.457+0000 7f095b66b640 1 -- 172.21.15.133:0/4026679488 shutdown_connections 2023-12-19T19:01:17.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.457+0000 7f095b66b640 1 --2- 172.21.15.133:0/4026679488 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09540724c0 0x7f095406dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:17.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.457+0000 7f095b66b640 1 --2- 172.21.15.133:0/4026679488 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09540c07b0 0x7f095406d6d0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:17.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.457+0000 7f095b66b640 1 -- 172.21.15.133:0/4026679488 >> 172.21.15.133:0/4026679488 conn(0x7f09540c5d40 msgr2=0x7f09540c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:17.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.457+0000 7f095b66b640 1 -- 172.21.15.133:0/4026679488 shutdown_connections 2023-12-19T19:01:17.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.457+0000 7f095b66b640 1 -- 172.21.15.133:0/4026679488 wait complete. 2023-12-19T19:01:17.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.461+0000 7f095b66b640 1 Processor -- start 2023-12-19T19:01:17.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.461+0000 7f095b66b640 1 -- start start 2023-12-19T19:01:17.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.461+0000 7f095b66b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09540724c0 0x7f095414ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:17.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.461+0000 7f095b66b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09540c07b0 0x7f095414d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:17.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.461+0000 7f095b66b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f095414f9f0 0x7f095414dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:17.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.461+0000 7f095b66b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09540714c0 con 0x7f09540c07b0 2023-12-19T19:01:17.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.461+0000 7f095b66b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0954149350 con 0x7f095414f9f0 2023-12-19T19:01:17.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.461+0000 7f095b66b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0954149c90 con 0x7f09540724c0 2023-12-19T19:01:17.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.461+0000 7f0958c06640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09540c07b0 0x7f095414d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:17.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.461+0000 7f0958c06640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09540c07b0 0x7f095414d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37608/0 (socket says 172.21.15.133:37608) 2023-12-19T19:01:17.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.461+0000 7f0958c06640 1 -- 172.21.15.133:0/3376470507 learned_addr learned my addr 172.21.15.133:0/3376470507 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:17.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.461+0000 7f0959407640 1 --2- 172.21.15.133:0/3376470507 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09540724c0 0x7f095414ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:17.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.461+0000 7f0959c08640 1 --2- 172.21.15.133:0/3376470507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f095414f9f0 0x7f095414dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:17.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.461+0000 7f0958c06640 1 -- 172.21.15.133:0/3376470507 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09540724c0 msgr2=0x7f095414ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:17.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.461+0000 7f0958c06640 1 --2- 172.21.15.133:0/3376470507 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09540724c0 0x7f095414ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:17.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.461+0000 7f0958c06640 1 -- 172.21.15.133:0/3376470507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f095414f9f0 msgr2=0x7f095414dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:17.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.461+0000 7f0958c06640 1 --2- 172.21.15.133:0/3376470507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f095414f9f0 0x7f095414dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:17.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.461+0000 7f0958c06640 1 -- 172.21.15.133:0/3376470507 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0944009420 con 0x7f09540c07b0 2023-12-19T19:01:17.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.461+0000 7f0958c06640 1 --2- 172.21.15.133:0/3376470507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09540c07b0 0x7f095414d7e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f09440af040 tx=0x7f0944019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:17.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.461+0000 7f0949ffb640 1 -- 172.21.15.133:0/3376470507 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09440b5820 con 0x7f09540c07b0 2023-12-19T19:01:17.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.461+0000 7f0949ffb640 1 -- 172.21.15.133:0/3376470507 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09440b5980 con 0x7f09540c07b0 2023-12-19T19:01:17.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.461+0000 7f095b66b640 1 -- 172.21.15.133:0/3376470507 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0954144ea0 con 0x7f09540c07b0 2023-12-19T19:01:17.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.461+0000 7f0949ffb640 1 -- 172.21.15.133:0/3376470507 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09440b5d30 con 0x7f09540c07b0 2023-12-19T19:01:17.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.465+0000 7f095b66b640 1 -- 172.21.15.133:0/3376470507 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0954149840 con 0x7f09540c07b0 2023-12-19T19:01:17.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.465+0000 7f095b66b640 1 -- 172.21.15.133:0/3376470507 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09540c35a0 con 0x7f09540c07b0 2023-12-19T19:01:17.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.465+0000 7f0949ffb640 1 -- 172.21.15.133:0/3376470507 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f09440b3040 con 0x7f09540c07b0 2023-12-19T19:01:17.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.465+0000 7f0949ffb640 1 --2- 172.21.15.133:0/3376470507 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0938066470 0x7f0938068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:17.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.465+0000 7f0949ffb640 1 -- 172.21.15.133:0/3376470507 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f094411e200 con 0x7f09540c07b0 2023-12-19T19:01:17.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.465+0000 7f0959407640 1 --2- 172.21.15.133:0/3376470507 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0938066470 0x7f0938068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:17.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.465+0000 7f0959407640 1 --2- 172.21.15.133:0/3376470507 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0938066470 0x7f0938068930 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0950007fd0 tx=0x7f0950007ba0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:17.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.469+0000 7f0949ffb640 1 -- 172.21.15.133:0/3376470507 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f09440eb5e0 con 0x7f09540c07b0 2023-12-19T19:01:17.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:17.621+0000 7f095b66b640 1 -- 172.21.15.133:0/3376470507 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0954068400 con 0x7f09540c07b0 2023-12-19T19:01:18.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.285+0000 7f0949ffb640 1 -- 172.21.15.133:0/3376470507 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v59) v1 ==== 184+0+0 (secure 0 0 0) 0x7f09440ac600 con 0x7f09540c07b0 2023-12-19T19:01:18.290 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs2_metadata' removed 2023-12-19T19:01:18.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.289+0000 7f095b66b640 1 -- 172.21.15.133:0/3376470507 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0938066470 msgr2=0x7f0938068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:18.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.289+0000 7f095b66b640 1 --2- 172.21.15.133:0/3376470507 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0938066470 0x7f0938068930 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0950007fd0 tx=0x7f0950007ba0 comp rx=0 tx=0).stop 2023-12-19T19:01:18.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.289+0000 7f095b66b640 1 -- 172.21.15.133:0/3376470507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09540c07b0 msgr2=0x7f095414d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:18.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.289+0000 7f095b66b640 1 --2- 172.21.15.133:0/3376470507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09540c07b0 0x7f095414d7e0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f09440af040 tx=0x7f0944019160 comp rx=0 tx=0).stop 2023-12-19T19:01:18.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.289+0000 7f095b66b640 1 -- 172.21.15.133:0/3376470507 shutdown_connections 2023-12-19T19:01:18.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.289+0000 7f095b66b640 1 --2- 172.21.15.133:0/3376470507 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0938066470 0x7f0938068930 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:18.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.289+0000 7f095b66b640 1 --2- 172.21.15.133:0/3376470507 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f095414f9f0 0x7f095414dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:18.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.289+0000 7f095b66b640 1 --2- 172.21.15.133:0/3376470507 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f09540c07b0 0x7f095414d7e0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:18.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.289+0000 7f095b66b640 1 --2- 172.21.15.133:0/3376470507 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f09540724c0 0x7f095414ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:18.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.289+0000 7f095b66b640 1 -- 172.21.15.133:0/3376470507 >> 172.21.15.133:0/3376470507 conn(0x7f09540c5d40 msgr2=0x7f095414b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:18.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.289+0000 7f095b66b640 1 -- 172.21.15.133:0/3376470507 shutdown_connections 2023-12-19T19:01:18.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.289+0000 7f095b66b640 1 -- 172.21.15.133:0/3376470507 wait complete. 2023-12-19T19:01:18.316 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-12-19T19:01:18.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.457+0000 7f26fb417640 1 Processor -- start 2023-12-19T19:01:18.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.457+0000 7f26fb417640 1 -- start start 2023-12-19T19:01:18.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.457+0000 7f26fb417640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f26f40c1b10 0x7f26f41546f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:18.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.457+0000 7f26fb417640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f40c0f40 con 0x7f26f414e990 2023-12-19T19:01:18.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.457+0000 7f26fb417640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26f4155490 con 0x7f26f40a4d30 2023-12-19T19:01:18.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.457+0000 7f26fb417640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26f40c3a60 con 0x7f26f40c1b10 2023-12-19T19:01:18.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.457+0000 7f26fa415640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f26f414e990 0x7f26f40c1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47380/0 (socket says 172.21.15.133:47380) 2023-12-19T19:01:18.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.457+0000 7f26fa415640 1 -- 172.21.15.133:0/1753441251 learned_addr learned my addr 172.21.15.133:0/1753441251 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:18.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.457+0000 7f26f9c14640 1 --2- 172.21.15.133:0/1753441251 >> v2:172.21.15.138:3300/0 conn(0x7f26f40c1b10 0x7f26f41546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:18.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.457+0000 7f26f9413640 1 -- 172.21.15.133:0/1753441251 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910185998 0 0) 0x7f26f40c0f40 con 0x7f26f414e990 2023-12-19T19:01:18.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.457+0000 7f26f9413640 1 -- 172.21.15.133:0/1753441251 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26e0005740 con 0x7f26f414e990 2023-12-19T19:01:18.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.457+0000 7f26f9c14640 1 -- 172.21.15.133:0/1753441251 >> v1:172.21.15.138:6789/0 conn(0x7f26f40a4d30 legacy=0x7f26f4154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:18.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.457+0000 7f26f9413640 1 -- 172.21.15.133:0/1753441251 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 574835346 0 0) 0x7f26e0005740 con 0x7f26f414e990 2023-12-19T19:01:18.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.457+0000 7f26f9c14640 1 -- 172.21.15.133:0/1753441251 >> v1:172.21.15.133:6789/0 conn(0x7f26f414e990 legacy=0x7f26f40c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:18.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.457+0000 7f26f9c14640 1 -- 172.21.15.133:0/1753441251 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f40c3c70 con 0x7f26f40c1b10 2023-12-19T19:01:18.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.461+0000 7f26f9c14640 1 --2- 172.21.15.133:0/1753441251 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26f40c1b10 0x7f26f41546f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f26e40097c0 tx=0x7f26e401c250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29c6b87843d768d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:18.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.461+0000 7f26f9413640 1 -- 172.21.15.133:0/1753441251 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f0001680 con 0x7f26f40c1b10 2023-12-19T19:01:18.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.461+0000 7f26f9413640 1 -- 172.21.15.133:0/1753441251 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26e40a7050 con 0x7f26f40c1b10 2023-12-19T19:01:18.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.461+0000 7f26f9413640 1 -- 172.21.15.133:0/1753441251 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26e40ab620 con 0x7f26f40c1b10 2023-12-19T19:01:18.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.461+0000 7f26fb417640 1 -- 172.21.15.133:0/1753441251 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26f40c1b10 msgr2=0x7f26f41546f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:18.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.461+0000 7f26fb417640 1 --2- 172.21.15.133:0/1753441251 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26f40c1b10 0x7f26f41546f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f26e40097c0 tx=0x7f26e401c250 comp rx=0 tx=0).stop 2023-12-19T19:01:18.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.461+0000 7f26fb417640 1 -- 172.21.15.133:0/1753441251 shutdown_connections 2023-12-19T19:01:18.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.461+0000 7f26fb417640 1 --2- 172.21.15.133:0/1753441251 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26f40c1b10 0x7f26f41546f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:18.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.461+0000 7f26fb417640 1 -- 172.21.15.133:0/1753441251 >> 172.21.15.133:0/1753441251 conn(0x7f26f40c2660 msgr2=0x7f26f40c2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:18.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.461+0000 7f26fb417640 1 -- 172.21.15.133:0/1753441251 shutdown_connections 2023-12-19T19:01:18.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.461+0000 7f26fb417640 1 -- 172.21.15.133:0/1753441251 wait complete. 2023-12-19T19:01:18.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26fb417640 1 Processor -- start 2023-12-19T19:01:18.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26fb417640 1 -- start start 2023-12-19T19:01:18.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26fb417640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26f40a4d30 0x7f26f413f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:18.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26fb417640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f26f40c1b10 0x7f26f41ec8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:18.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26fb417640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26f414e990 0x7f26f41ecdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:18.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26fb417640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f40a6ce0 con 0x7f26f414e990 2023-12-19T19:01:18.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26fb417640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26f414d9f0 con 0x7f26f40a4d30 2023-12-19T19:01:18.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26fb417640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26f406daa0 con 0x7f26f40c1b10 2023-12-19T19:01:18.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26fac16640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26f414e990 0x7f26f41ecdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:18.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26fac16640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26f414e990 0x7f26f41ecdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37624/0 (socket says 172.21.15.133:37624) 2023-12-19T19:01:18.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26fac16640 1 -- 172.21.15.133:0/215303674 learned_addr learned my addr 172.21.15.133:0/215303674 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:18.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26f9c14640 1 --2- 172.21.15.133:0/215303674 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f26f40c1b10 0x7f26f41ec8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:18.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26fa415640 1 --2- 172.21.15.133:0/215303674 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26f40a4d30 0x7f26f413f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:18.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26fac16640 1 -- 172.21.15.133:0/215303674 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f26f40c1b10 msgr2=0x7f26f41ec8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:18.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26fac16640 1 --2- 172.21.15.133:0/215303674 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f26f40c1b10 0x7f26f41ec8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:18.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26fac16640 1 -- 172.21.15.133:0/215303674 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26f40a4d30 msgr2=0x7f26f413f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:18.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26fac16640 1 --2- 172.21.15.133:0/215303674 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26f40a4d30 0x7f26f413f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:18.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26fac16640 1 -- 172.21.15.133:0/215303674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e4009420 con 0x7f26f414e990 2023-12-19T19:01:18.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26fac16640 1 --2- 172.21.15.133:0/215303674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26f414e990 0x7f26f41ecdf0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f26ec00c770 tx=0x7f26ec00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:18.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26eaffd640 1 -- 172.21.15.133:0/215303674 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ec003b80 con 0x7f26f414e990 2023-12-19T19:01:18.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26eaffd640 1 -- 172.21.15.133:0/215303674 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26ec003ce0 con 0x7f26f414e990 2023-12-19T19:01:18.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26fb417640 1 -- 172.21.15.133:0/215303674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26f41ed330 con 0x7f26f414e990 2023-12-19T19:01:18.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26eaffd640 1 -- 172.21.15.133:0/215303674 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26ec00aa90 con 0x7f26f414e990 2023-12-19T19:01:18.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26fb417640 1 -- 172.21.15.133:0/215303674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26f41f0bb0 con 0x7f26f414e990 2023-12-19T19:01:18.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.465+0000 7f26fb417640 1 -- 172.21.15.133:0/215303674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26f414d7c0 con 0x7f26f414e990 2023-12-19T19:01:18.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.469+0000 7f26eaffd640 1 -- 172.21.15.133:0/215303674 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f26ec00abf0 con 0x7f26f414e990 2023-12-19T19:01:18.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.469+0000 7f26eaffd640 1 --2- 172.21.15.133:0/215303674 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f26d8066470 0x7f26d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:18.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.469+0000 7f26eaffd640 1 -- 172.21.15.133:0/215303674 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5445+0+0 (secure 0 0 0) 0x7f26ec083b50 con 0x7f26f414e990 2023-12-19T19:01:18.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.469+0000 7f26fa415640 1 --2- 172.21.15.133:0/215303674 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f26d8066470 0x7f26d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:18.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.469+0000 7f26fa415640 1 --2- 172.21.15.133:0/215303674 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f26d8066470 0x7f26d8068930 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f26f0000f70 tx=0x7f26f0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:18.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.473+0000 7f26eaffd640 1 -- 172.21.15.133:0/215303674 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f26f414d7c0 con 0x7f26f414e990 2023-12-19T19:01:18.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:18.629+0000 7f26fb417640 1 -- 172.21.15.133:0/215303674 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f26f414d7c0 con 0x7f26f414e990 2023-12-19T19:01:19.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.293+0000 7f26eaffd640 1 -- 172.21.15.133:0/215303674 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v60) v1 ==== 172+0+0 (secure 0 0 0) 0x7f26f414d7c0 con 0x7f26f414e990 2023-12-19T19:01:19.299 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs2_data' removed 2023-12-19T19:01:19.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.297+0000 7f26fb417640 1 -- 172.21.15.133:0/215303674 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f26d8066470 msgr2=0x7f26d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:19.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.297+0000 7f26fb417640 1 --2- 172.21.15.133:0/215303674 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f26d8066470 0x7f26d8068930 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f26f0000f70 tx=0x7f26f0009040 comp rx=0 tx=0).stop 2023-12-19T19:01:19.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.297+0000 7f26fb417640 1 -- 172.21.15.133:0/215303674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26f414e990 msgr2=0x7f26f41ecdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:19.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.297+0000 7f26fb417640 1 --2- 172.21.15.133:0/215303674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26f414e990 0x7f26f41ecdf0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f26ec00c770 tx=0x7f26ec00cc30 comp rx=0 tx=0).stop 2023-12-19T19:01:19.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.297+0000 7f26fb417640 1 -- 172.21.15.133:0/215303674 shutdown_connections 2023-12-19T19:01:19.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.297+0000 7f26fb417640 1 --2- 172.21.15.133:0/215303674 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f26d8066470 0x7f26d8068930 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:19.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.297+0000 7f26fb417640 1 --2- 172.21.15.133:0/215303674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26f414e990 0x7f26f41ecdf0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:19.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.297+0000 7f26fb417640 1 --2- 172.21.15.133:0/215303674 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f26f40c1b10 0x7f26f41ec8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:19.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.297+0000 7f26fb417640 1 --2- 172.21.15.133:0/215303674 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f26f40a4d30 0x7f26f413f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:19.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.297+0000 7f26fb417640 1 -- 172.21.15.133:0/215303674 >> 172.21.15.133:0/215303674 conn(0x7f26f40c2660 msgr2=0x7f26f41481d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:19.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.301+0000 7f26fb417640 1 -- 172.21.15.133:0/215303674 shutdown_connections 2023-12-19T19:01:19.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.301+0000 7f26fb417640 1 -- 172.21.15.133:0/215303674 wait complete. 2023-12-19T19:01:19.328 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T19:01:19.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.465+0000 7f5843dc4640 1 Processor -- start 2023-12-19T19:01:19.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.465+0000 7f5843dc4640 1 -- start start 2023-12-19T19:01:19.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.469+0000 7f5843dc4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f583c06d520 0x7f583c15ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:19.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.469+0000 7f5843dc4640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f583c0bffc0 0x7f583c0c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:19.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.469+0000 7f5843dc4640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f583c15c600 con 0x7f583c1560e0 2023-12-19T19:01:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.469+0000 7f5843dc4640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f583c15a5c0 con 0x7f583c06d520 2023-12-19T19:01:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.469+0000 7f5843dc4640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c1594e0 con 0x7f583c0bffc0 2023-12-19T19:01:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.469+0000 7f584135f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f583c06d520 0x7f583c15ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.469+0000 7f5841b60640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f583c1560e0 0x7f583c159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47388/0 (socket says 172.21.15.133:47388) 2023-12-19T19:01:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.469+0000 7f5841b60640 1 -- 172.21.15.133:0/2304521246 learned_addr learned my addr 172.21.15.133:0/2304521246 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.469+0000 7f5842361640 1 --2- 172.21.15.133:0/2304521246 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f583c0bffc0 0x7f583c0c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.469+0000 7f584135f640 1 -- 172.21.15.133:0/2304521246 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f583c0bffc0 msgr2=0x7f583c0c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.469+0000 7f584135f640 1 --2- 172.21.15.133:0/2304521246 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f583c0bffc0 0x7f583c0c1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.469+0000 7f584135f640 1 -- 172.21.15.133:0/2304521246 >> v1:172.21.15.133:6789/0 conn(0x7f583c1560e0 legacy=0x7f583c159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.469+0000 7f584135f640 1 -- 172.21.15.133:0/2304521246 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f583c1597c0 con 0x7f583c06d520 2023-12-19T19:01:19.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.469+0000 7f5840b5e640 1 -- 172.21.15.133:0/2304521246 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865691204 0 0) 0x7f583c15c600 con 0x7f583c1560e0 2023-12-19T19:01:19.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.473+0000 7f584135f640 1 --2- 172.21.15.133:0/2304521246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f583c06d520 0x7f583c15ca90 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f582c0097c0 tx=0x7f582c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce7ac668830fa7d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:19.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.473+0000 7f5840b5e640 1 -- 172.21.15.133:0/2304521246 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c0ad660 con 0x7f583c06d520 2023-12-19T19:01:19.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.473+0000 7f5840b5e640 1 -- 172.21.15.133:0/2304521246 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582c0ad7c0 con 0x7f583c06d520 2023-12-19T19:01:19.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.473+0000 7f5840b5e640 1 -- 172.21.15.133:0/2304521246 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c0adb50 con 0x7f583c06d520 2023-12-19T19:01:19.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.473+0000 7f5843dc4640 1 -- 172.21.15.133:0/2304521246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f583c06d520 msgr2=0x7f583c15ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.473+0000 7f5843dc4640 1 --2- 172.21.15.133:0/2304521246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f583c06d520 0x7f583c15ca90 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f582c0097c0 tx=0x7f582c01c450 comp rx=0 tx=0).stop 2023-12-19T19:01:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.473+0000 7f5843dc4640 1 -- 172.21.15.133:0/2304521246 shutdown_connections 2023-12-19T19:01:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.473+0000 7f5843dc4640 1 --2- 172.21.15.133:0/2304521246 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f583c0bffc0 0x7f583c0c1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.473+0000 7f5843dc4640 1 --2- 172.21.15.133:0/2304521246 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f583c06d520 0x7f583c15ca90 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.473+0000 7f5843dc4640 1 -- 172.21.15.133:0/2304521246 >> 172.21.15.133:0/2304521246 conn(0x7f583c06a5b0 msgr2=0x7f583c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.473+0000 7f5843dc4640 1 -- 172.21.15.133:0/2304521246 shutdown_connections 2023-12-19T19:01:19.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.473+0000 7f5843dc4640 1 -- 172.21.15.133:0/2304521246 wait complete. 2023-12-19T19:01:19.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.473+0000 7f5843dc4640 1 Processor -- start 2023-12-19T19:01:19.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.473+0000 7f5843dc4640 1 -- start start 2023-12-19T19:01:19.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f5843dc4640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f583c06d520 0x7f583c1f4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:19.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f5843dc4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f583c0bffc0 0x7f583c1553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:19.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f5843dc4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f583c1560e0 0x7f583c0c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:19.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f5843dc4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c0aa610 con 0x7f583c0bffc0 2023-12-19T19:01:19.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f5843dc4640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f583c0c3190 con 0x7f583c1560e0 2023-12-19T19:01:19.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f5843dc4640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583c0aa800 con 0x7f583c06d520 2023-12-19T19:01:19.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f584135f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f583c0bffc0 0x7f583c1553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:19.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f5841b60640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f583c06d520 0x7f583c1f4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:19.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f584135f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f583c0bffc0 0x7f583c1553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37648/0 (socket says 172.21.15.133:37648) 2023-12-19T19:01:19.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f584135f640 1 -- 172.21.15.133:0/2266663623 learned_addr learned my addr 172.21.15.133:0/2266663623 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:19.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f5842361640 1 --2- 172.21.15.133:0/2266663623 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f583c1560e0 0x7f583c0c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:19.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f584135f640 1 -- 172.21.15.133:0/2266663623 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f583c06d520 msgr2=0x7f583c1f4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:19.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f584135f640 1 --2- 172.21.15.133:0/2266663623 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f583c06d520 0x7f583c1f4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:19.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f584135f640 1 -- 172.21.15.133:0/2266663623 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f583c1560e0 msgr2=0x7f583c0c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:19.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f584135f640 1 --2- 172.21.15.133:0/2266663623 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f583c1560e0 0x7f583c0c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:19.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f584135f640 1 -- 172.21.15.133:0/2266663623 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c009420 con 0x7f583c0bffc0 2023-12-19T19:01:19.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f584135f640 1 --2- 172.21.15.133:0/2266663623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f583c0bffc0 0x7f583c1553b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f582c0b0040 tx=0x7f582c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:19.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f58327fc640 1 -- 172.21.15.133:0/2266663623 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c0b6610 con 0x7f583c0bffc0 2023-12-19T19:01:19.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f58327fc640 1 -- 172.21.15.133:0/2266663623 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582c0b67b0 con 0x7f583c0bffc0 2023-12-19T19:01:19.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f58327fc640 1 -- 172.21.15.133:0/2266663623 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c0b6b60 con 0x7f583c0bffc0 2023-12-19T19:01:19.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f5843dc4640 1 -- 172.21.15.133:0/2266663623 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583c0aaae0 con 0x7f583c0bffc0 2023-12-19T19:01:19.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f5843dc4640 1 -- 172.21.15.133:0/2266663623 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583c0c57b0 con 0x7f583c0bffc0 2023-12-19T19:01:19.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f5843dc4640 1 -- 172.21.15.133:0/2266663623 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583c0c59a0 con 0x7f583c0bffc0 2023-12-19T19:01:19.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.477+0000 7f58327fc640 1 -- 172.21.15.133:0/2266663623 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f582c0b4040 con 0x7f583c0bffc0 2023-12-19T19:01:19.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.481+0000 7f58327fc640 1 --2- 172.21.15.133:0/2266663623 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5820066470 0x7f5820068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:19.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.481+0000 7f58327fc640 1 -- 172.21.15.133:0/2266663623 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f582c11dfe0 con 0x7f583c0bffc0 2023-12-19T19:01:19.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.481+0000 7f5841b60640 1 --2- 172.21.15.133:0/2266663623 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5820066470 0x7f5820068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:19.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.481+0000 7f5841b60640 1 --2- 172.21.15.133:0/2266663623 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5820066470 0x7f5820068930 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5838000f70 tx=0x7f5838007df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:19.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.485+0000 7f58327fc640 1 -- 172.21.15.133:0/2266663623 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f582c0eb7e0 con 0x7f583c0bffc0 2023-12-19T19:01:19.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.653+0000 7f5843dc4640 1 -- 172.21.15.133:0/2266663623 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f583c068400 con 0x7f583c0bffc0 2023-12-19T19:01:19.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.657+0000 7f58327fc640 1 -- 172.21.15.133:0/2266663623 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f582c0eee00 con 0x7f583c0bffc0 2023-12-19T19:01:19.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.661+0000 7f5843dc4640 1 -- 172.21.15.133:0/2266663623 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5820066470 msgr2=0x7f5820068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:19.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.661+0000 7f5843dc4640 1 --2- 172.21.15.133:0/2266663623 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5820066470 0x7f5820068930 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5838000f70 tx=0x7f5838007df0 comp rx=0 tx=0).stop 2023-12-19T19:01:19.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.661+0000 7f5843dc4640 1 -- 172.21.15.133:0/2266663623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f583c0bffc0 msgr2=0x7f583c1553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:19.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.661+0000 7f5843dc4640 1 --2- 172.21.15.133:0/2266663623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f583c0bffc0 0x7f583c1553b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f582c0b0040 tx=0x7f582c0191f0 comp rx=0 tx=0).stop 2023-12-19T19:01:19.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.661+0000 7f5843dc4640 1 -- 172.21.15.133:0/2266663623 shutdown_connections 2023-12-19T19:01:19.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.661+0000 7f5843dc4640 1 --2- 172.21.15.133:0/2266663623 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5820066470 0x7f5820068930 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:19.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.661+0000 7f5843dc4640 1 --2- 172.21.15.133:0/2266663623 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f583c1560e0 0x7f583c0c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:19.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.661+0000 7f5843dc4640 1 --2- 172.21.15.133:0/2266663623 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f583c0bffc0 0x7f583c1553b0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:19.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.661+0000 7f5843dc4640 1 --2- 172.21.15.133:0/2266663623 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f583c06d520 0x7f583c1f4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:19.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.661+0000 7f5843dc4640 1 -- 172.21.15.133:0/2266663623 >> 172.21.15.133:0/2266663623 conn(0x7f583c06a5b0 msgr2=0x7f583c152da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:19.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.661+0000 7f5843dc4640 1 -- 172.21.15.133:0/2266663623 shutdown_connections 2023-12-19T19:01:19.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.661+0000 7f5843dc4640 1 -- 172.21.15.133:0/2266663623 wait complete. 2023-12-19T19:01:19.684 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2023-12-19T19:01:19.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.817+0000 7f89ffd8d640 1 Processor -- start 2023-12-19T19:01:19.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.817+0000 7f89ffd8d640 1 -- start start 2023-12-19T19:01:19.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.817+0000 7f89ffd8d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f89f8072090 0x7f89f80a5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:19.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.817+0000 7f89ffd8d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f89f80725c0 0x7f89f80c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:19.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.817+0000 7f89ffd8d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f80c2760 con 0x7f89f80c3bd0 2023-12-19T19:01:19.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.817+0000 7f89ffd8d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f80c3070 con 0x7f89f80725c0 2023-12-19T19:01:19.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.817+0000 7f89ffd8d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f80aad20 con 0x7f89f8072090 2023-12-19T19:01:19.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.817+0000 7f89fd328640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f89f80725c0 0x7f89f80c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:19.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.817+0000 7f89fd328640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f89f80725c0 0x7f89f80c5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37662/0 (socket says 172.21.15.133:37662) 2023-12-19T19:01:19.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.817+0000 7f89fd328640 1 -- 172.21.15.133:0/2656282405 learned_addr learned my addr 172.21.15.133:0/2656282405 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:19.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.821+0000 7f89fdb29640 1 --2- 172.21.15.133:0/2656282405 >> v2:172.21.15.138:3300/0 conn(0x7f89f8072090 0x7f89f80a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:19.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.821+0000 7f89fd328640 1 -- 172.21.15.133:0/2656282405 >> v2:172.21.15.138:3300/0 conn(0x7f89f8072090 msgr2=0x7f89f80a5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:19.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.821+0000 7f89fd328640 1 --2- 172.21.15.133:0/2656282405 >> v2:172.21.15.138:3300/0 conn(0x7f89f8072090 0x7f89f80a5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:19.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.821+0000 7f89fd328640 1 -- 172.21.15.133:0/2656282405 >> v1:172.21.15.138:6789/0 conn(0x7f89f80c3bd0 legacy=0x7f89f8150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:19.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.821+0000 7f89fd328640 1 -- 172.21.15.133:0/2656282405 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f80ab000 con 0x7f89f80725c0 2023-12-19T19:01:19.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.821+0000 7f89fd328640 1 --2- 172.21.15.133:0/2656282405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89f80725c0 0x7f89f80c5cd0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f89f80a8af0 tx=0x7f89e801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c9628d6fa4f284e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:19.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.821+0000 7f89fcb27640 1 -- 172.21.15.133:0/2656282405 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e80ab600 con 0x7f89f80725c0 2023-12-19T19:01:19.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.821+0000 7f89fcb27640 1 -- 172.21.15.133:0/2656282405 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e80a7050 con 0x7f89f80725c0 2023-12-19T19:01:19.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.821+0000 7f89fcb27640 1 -- 172.21.15.133:0/2656282405 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e80ab980 con 0x7f89f80725c0 2023-12-19T19:01:19.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.821+0000 7f89ffd8d640 1 -- 172.21.15.133:0/2656282405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89f80725c0 msgr2=0x7f89f80c5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:19.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.821+0000 7f89ffd8d640 1 --2- 172.21.15.133:0/2656282405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89f80725c0 0x7f89f80c5cd0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f89f80a8af0 tx=0x7f89e801c3a0 comp rx=0 tx=0).stop 2023-12-19T19:01:19.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89ffd8d640 1 -- 172.21.15.133:0/2656282405 shutdown_connections 2023-12-19T19:01:19.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89ffd8d640 1 --2- 172.21.15.133:0/2656282405 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89f80725c0 0x7f89f80c5cd0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:19.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89ffd8d640 1 --2- 172.21.15.133:0/2656282405 >> v2:172.21.15.138:3300/0 conn(0x7f89f8072090 0x7f89f80a5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:19.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89ffd8d640 1 -- 172.21.15.133:0/2656282405 >> 172.21.15.133:0/2656282405 conn(0x7f89f806a5b0 msgr2=0x7f89f806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:19.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89ffd8d640 1 -- 172.21.15.133:0/2656282405 shutdown_connections 2023-12-19T19:01:19.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89ffd8d640 1 -- 172.21.15.133:0/2656282405 wait complete. 2023-12-19T19:01:19.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89ffd8d640 1 Processor -- start 2023-12-19T19:01:19.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89ffd8d640 1 -- start start 2023-12-19T19:01:19.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89ffd8d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89f8072090 0x7f89f81ef500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:19.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89ffd8d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89f80725c0 0x7f89f8071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:19.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89ffd8d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89f80c3bd0 0x7f89f81470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:19.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89ffd8d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f81efd40 con 0x7f89f8072090 2023-12-19T19:01:19.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89ffd8d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f81f01d0 con 0x7f89f80725c0 2023-12-19T19:01:19.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89ffd8d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f8147fc0 con 0x7f89f80c3bd0 2023-12-19T19:01:19.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89fdb29640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89f8072090 0x7f89f81ef500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:19.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89fdb29640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89f8072090 0x7f89f81ef500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37668/0 (socket says 172.21.15.133:37668) 2023-12-19T19:01:19.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89fdb29640 1 -- 172.21.15.133:0/294082658 learned_addr learned my addr 172.21.15.133:0/294082658 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:19.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89fd328640 1 --2- 172.21.15.133:0/294082658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89f80725c0 0x7f89f8071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:19.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89fe32a640 1 --2- 172.21.15.133:0/294082658 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89f80c3bd0 0x7f89f81470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:19.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89fdb29640 1 -- 172.21.15.133:0/294082658 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89f80c3bd0 msgr2=0x7f89f81470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:19.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89fdb29640 1 --2- 172.21.15.133:0/294082658 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89f80c3bd0 0x7f89f81470c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:19.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89fdb29640 1 -- 172.21.15.133:0/294082658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89f80725c0 msgr2=0x7f89f8071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:19.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89fdb29640 1 --2- 172.21.15.133:0/294082658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89f80725c0 0x7f89f8071520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:19.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89fdb29640 1 -- 172.21.15.133:0/294082658 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e80094d0 con 0x7f89f8072090 2023-12-19T19:01:19.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89fd328640 1 --2- 172.21.15.133:0/294082658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89f80725c0 0x7f89f8071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:19.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89fdb29640 1 --2- 172.21.15.133:0/294082658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89f8072090 0x7f89f81ef500 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f89f400d5f0 tx=0x7f89f400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:19.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89ee7fc640 1 -- 172.21.15.133:0/294082658 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f40125f0 con 0x7f89f8072090 2023-12-19T19:01:19.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89ee7fc640 1 -- 172.21.15.133:0/294082658 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f4012750 con 0x7f89f8072090 2023-12-19T19:01:19.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89ee7fc640 1 -- 172.21.15.133:0/294082658 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f4012ae0 con 0x7f89f8072090 2023-12-19T19:01:19.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.825+0000 7f89ffd8d640 1 -- 172.21.15.133:0/294082658 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f8147ce0 con 0x7f89f8072090 2023-12-19T19:01:19.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.829+0000 7f89ffd8d640 1 -- 172.21.15.133:0/294082658 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f8070950 con 0x7f89f8072090 2023-12-19T19:01:19.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.829+0000 7f89ffd8d640 1 -- 172.21.15.133:0/294082658 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f8068400 con 0x7f89f8072090 2023-12-19T19:01:19.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.829+0000 7f89ee7fc640 1 -- 172.21.15.133:0/294082658 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f89f4012c40 con 0x7f89f8072090 2023-12-19T19:01:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.829+0000 7f89ee7fc640 1 --2- 172.21.15.133:0/294082658 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f89dc066470 0x7f89dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.829+0000 7f89ee7fc640 1 -- 172.21.15.133:0/294082658 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f89f40840f0 con 0x7f89f8072090 2023-12-19T19:01:19.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.829+0000 7f89fd328640 1 --2- 172.21.15.133:0/294082658 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f89dc066470 0x7f89dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:19.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.829+0000 7f89fd328640 1 --2- 172.21.15.133:0/294082658 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f89dc066470 0x7f89dc068930 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f89e80ad000 tx=0x7f89e8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:19.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:19.833+0000 7f89ee7fc640 1 -- 172.21.15.133:0/294082658 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f89f4051800 con 0x7f89f8072090 2023-12-19T19:01:20.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.037+0000 7f89ffd8d640 1 -- 172.21.15.133:0/294082658 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7f89f80a7330 con 0x7f89f8072090 2023-12-19T19:01:20.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.297+0000 7f89ee7fc640 1 -- 172.21.15.133:0/294082658 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v174) v1 ==== 184+0+0 (secure 0 0 0) 0x7f89f4007380 con 0x7f89f8072090 2023-12-19T19:01:20.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.301+0000 7f89ffd8d640 1 -- 172.21.15.133:0/294082658 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f89dc066470 msgr2=0x7f89dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:20.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.301+0000 7f89ffd8d640 1 --2- 172.21.15.133:0/294082658 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f89dc066470 0x7f89dc068930 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f89e80ad000 tx=0x7f89e8008040 comp rx=0 tx=0).stop 2023-12-19T19:01:20.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.301+0000 7f89ffd8d640 1 -- 172.21.15.133:0/294082658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89f8072090 msgr2=0x7f89f81ef500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:20.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.301+0000 7f89ffd8d640 1 --2- 172.21.15.133:0/294082658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89f8072090 0x7f89f81ef500 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f89f400d5f0 tx=0x7f89f400dab0 comp rx=0 tx=0).stop 2023-12-19T19:01:20.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.301+0000 7f89ffd8d640 1 -- 172.21.15.133:0/294082658 shutdown_connections 2023-12-19T19:01:20.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.301+0000 7f89ffd8d640 1 --2- 172.21.15.133:0/294082658 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f89dc066470 0x7f89dc068930 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:20.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.301+0000 7f89ffd8d640 1 --2- 172.21.15.133:0/294082658 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f89f80c3bd0 0x7f89f81470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:20.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.301+0000 7f89ffd8d640 1 --2- 172.21.15.133:0/294082658 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f89f80725c0 0x7f89f8071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:20.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.301+0000 7f89ffd8d640 1 --2- 172.21.15.133:0/294082658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89f8072090 0x7f89f81ef500 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:20.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.301+0000 7f89ffd8d640 1 -- 172.21.15.133:0/294082658 >> 172.21.15.133:0/294082658 conn(0x7f89f806a5b0 msgr2=0x7f89f8150ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:20.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.301+0000 7f89ffd8d640 1 -- 172.21.15.133:0/294082658 shutdown_connections 2023-12-19T19:01:20.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.301+0000 7f89ffd8d640 1 -- 172.21.15.133:0/294082658 wait complete. 2023-12-19T19:01:20.323 INFO:tasks.cephfs_test_runner:test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2023-12-19T19:01:20.323 INFO:tasks.cephfs_test_runner:Starting test: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-19T19:01:20.324 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:01:20.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.457+0000 7fc3209d1640 1 Processor -- start 2023-12-19T19:01:20.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.457+0000 7fc3209d1640 1 -- start start 2023-12-19T19:01:20.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.461+0000 7fc3209d1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc31c0c63c0 0x7fc31c0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:20.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.461+0000 7fc3209d1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc31c0c4100 0x7fc31c0c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:20.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.461+0000 7fc3209d1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31c0c31c0 con 0x7fc31c0c29e0 2023-12-19T19:01:20.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.461+0000 7fc3209d1640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31c0c34a0 con 0x7fc31c0c63c0 2023-12-19T19:01:20.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.461+0000 7fc3209d1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0c1030 con 0x7fc31c0c4100 2023-12-19T19:01:20.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.461+0000 7fc31ad9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc31c0c29e0 0x7fc31c0a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47390/0 (socket says 172.21.15.133:47390) 2023-12-19T19:01:20.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.461+0000 7fc31a59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc31c0c63c0 0x7fc31c0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:20.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.461+0000 7fc31ad9d640 1 -- 172.21.15.133:0/1764058652 learned_addr learned my addr 172.21.15.133:0/1764058652 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:20.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.461+0000 7fc313fff640 1 --2- 172.21.15.133:0/1764058652 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc31c0c4100 0x7fc31c0c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:20.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.461+0000 7fc31a59c640 1 -- 172.21.15.133:0/1764058652 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc31c0c4100 msgr2=0x7fc31c0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:20.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.461+0000 7fc31a59c640 1 --2- 172.21.15.133:0/1764058652 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc31c0c4100 0x7fc31c0c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:20.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.461+0000 7fc31a59c640 1 -- 172.21.15.133:0/1764058652 >> v1:172.21.15.133:6789/0 conn(0x7fc31c0c29e0 legacy=0x7fc31c0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:20.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.461+0000 7fc319d9b640 1 -- 172.21.15.133:0/1764058652 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104285961 0 0) 0x7fc31c0c31c0 con 0x7fc31c0c29e0 2023-12-19T19:01:20.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.461+0000 7fc31a59c640 1 -- 172.21.15.133:0/1764058652 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c0c1310 con 0x7fc31c0c63c0 2023-12-19T19:01:20.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.461+0000 7fc313fff640 1 --2- 172.21.15.133:0/1764058652 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc31c0c4100 0x7fc31c0c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:20.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.465+0000 7fc31a59c640 1 --2- 172.21.15.133:0/1764058652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc31c0c63c0 0x7fc31c0c06d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0097c0 tx=0x7fc30c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5b2eba5146b830 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:20.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.465+0000 7fc319d9b640 1 -- 172.21.15.133:0/1764058652 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c004230 con 0x7fc31c0c63c0 2023-12-19T19:01:20.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.465+0000 7fc319d9b640 1 -- 172.21.15.133:0/1764058652 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c0a7050 con 0x7fc31c0c63c0 2023-12-19T19:01:20.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.465+0000 7fc319d9b640 1 -- 172.21.15.133:0/1764058652 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c003620 con 0x7fc31c0c63c0 2023-12-19T19:01:20.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.465+0000 7fc3209d1640 1 -- 172.21.15.133:0/1764058652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc31c0c63c0 msgr2=0x7fc31c0c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:20.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.465+0000 7fc3209d1640 1 --2- 172.21.15.133:0/1764058652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc31c0c63c0 0x7fc31c0c06d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0097c0 tx=0x7fc30c01c330 comp rx=0 tx=0).stop 2023-12-19T19:01:20.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.465+0000 7fc3209d1640 1 -- 172.21.15.133:0/1764058652 shutdown_connections 2023-12-19T19:01:20.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.465+0000 7fc3209d1640 1 --2- 172.21.15.133:0/1764058652 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc31c0c4100 0x7fc31c0c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:20.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.465+0000 7fc3209d1640 1 --2- 172.21.15.133:0/1764058652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc31c0c63c0 0x7fc31c0c06d0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:20.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.465+0000 7fc3209d1640 1 -- 172.21.15.133:0/1764058652 >> 172.21.15.133:0/1764058652 conn(0x7fc31c06a5b0 msgr2=0x7fc31c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:20.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.465+0000 7fc3209d1640 1 -- 172.21.15.133:0/1764058652 shutdown_connections 2023-12-19T19:01:20.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.465+0000 7fc3209d1640 1 -- 172.21.15.133:0/1764058652 wait complete. 2023-12-19T19:01:20.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.465+0000 7fc3209d1640 1 Processor -- start 2023-12-19T19:01:20.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.465+0000 7fc3209d1640 1 -- start start 2023-12-19T19:01:20.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.465+0000 7fc3209d1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc31c0c29e0 0x7fc31c06d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:20.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.465+0000 7fc3209d1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc31c0c4100 0x7fc31c1f0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:20.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.465+0000 7fc3209d1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc31c0c63c0 0x7fc31c1f0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:20.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.465+0000 7fc3209d1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0a4250 con 0x7fc31c0c63c0 2023-12-19T19:01:20.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.465+0000 7fc3209d1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c1f0320 con 0x7fc31c0c29e0 2023-12-19T19:01:20.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.465+0000 7fc3209d1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c1f11f0 con 0x7fc31c0c4100 2023-12-19T19:01:20.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.465+0000 7fc31ad9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc31c0c63c0 0x7fc31c1f0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:20.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.469+0000 7fc31ad9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc31c0c63c0 0x7fc31c1f0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37688/0 (socket says 172.21.15.133:37688) 2023-12-19T19:01:20.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.469+0000 7fc31ad9d640 1 -- 172.21.15.133:0/2611638888 learned_addr learned my addr 172.21.15.133:0/2611638888 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:20.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.469+0000 7fc313fff640 1 --2- 172.21.15.133:0/2611638888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc31c0c4100 0x7fc31c1f0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:20.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.469+0000 7fc31a59c640 1 --2- 172.21.15.133:0/2611638888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc31c0c29e0 0x7fc31c06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:20.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.469+0000 7fc31ad9d640 1 -- 172.21.15.133:0/2611638888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc31c0c4100 msgr2=0x7fc31c1f0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:20.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.469+0000 7fc31ad9d640 1 --2- 172.21.15.133:0/2611638888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc31c0c4100 0x7fc31c1f0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:20.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.469+0000 7fc31ad9d640 1 -- 172.21.15.133:0/2611638888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc31c0c29e0 msgr2=0x7fc31c06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:20.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.469+0000 7fc31ad9d640 1 --2- 172.21.15.133:0/2611638888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc31c0c29e0 0x7fc31c06d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:20.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.469+0000 7fc31ad9d640 1 -- 172.21.15.133:0/2611638888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c009420 con 0x7fc31c0c63c0 2023-12-19T19:01:20.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.469+0000 7fc31ad9d640 1 --2- 172.21.15.133:0/2611638888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc31c0c63c0 0x7fc31c1f0cb0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fc314001570 tx=0x7fc31400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:20.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.469+0000 7fc312ffd640 1 -- 172.21.15.133:0/2611638888 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31400a640 con 0x7fc31c0c63c0 2023-12-19T19:01:20.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.469+0000 7fc312ffd640 1 -- 172.21.15.133:0/2611638888 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31400a7c0 con 0x7fc31c0c63c0 2023-12-19T19:01:20.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.469+0000 7fc312ffd640 1 -- 172.21.15.133:0/2611638888 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31400ab70 con 0x7fc31c0c63c0 2023-12-19T19:01:20.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.469+0000 7fc3209d1640 1 -- 172.21.15.133:0/2611638888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31c06ab90 con 0x7fc31c0c63c0 2023-12-19T19:01:20.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.469+0000 7fc3209d1640 1 -- 172.21.15.133:0/2611638888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31c0a4c30 con 0x7fc31c0c63c0 2023-12-19T19:01:20.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.469+0000 7fc3209d1640 1 -- 172.21.15.133:0/2611638888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31c1f0490 con 0x7fc31c0c63c0 2023-12-19T19:01:20.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.469+0000 7fc312ffd640 1 -- 172.21.15.133:0/2611638888 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc31400acd0 con 0x7fc31c0c63c0 2023-12-19T19:01:20.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.469+0000 7fc312ffd640 1 --2- 172.21.15.133:0/2611638888 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2fc066470 0x7fc2fc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:20.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.473+0000 7fc312ffd640 1 -- 172.21.15.133:0/2611638888 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc314083120 con 0x7fc31c0c63c0 2023-12-19T19:01:20.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.473+0000 7fc31a59c640 1 --2- 172.21.15.133:0/2611638888 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2fc066470 0x7fc2fc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:20.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.473+0000 7fc31a59c640 1 --2- 172.21.15.133:0/2611638888 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2fc066470 0x7fc2fc068930 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0ad000 tx=0x7fc30c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:20.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.477+0000 7fc312ffd640 1 -- 172.21.15.133:0/2611638888 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc31c1f0490 con 0x7fc31c0c63c0 2023-12-19T19:01:20.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.625+0000 7fc3209d1640 1 -- 172.21.15.133:0/2611638888 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc31c1f0490 con 0x7fc31c0c63c0 2023-12-19T19:01:20.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.629+0000 7fc312ffd640 1 -- 172.21.15.133:0/2611638888 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+13157 (secure 0 0 0) 0x7fc31c1f0490 con 0x7fc31c0c63c0 2023-12-19T19:01:20.632 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:20.632 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":60,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:01:19.289573+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.138:6837/3661017926":"2023-12-20T19:01:16.279278+0000","172.21.15.138:6836/3661017926":"2023-12-20T19:01:16.279278+0000","172.21.15.133:6835/1203400706":"2023-12-20T19:01:09.827034+0000","172.21.15.133:6834/1203400706":"2023-12-20T19:01:09.827034+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:01:20.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.629+0000 7fc3209d1640 1 -- 172.21.15.133:0/2611638888 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2fc066470 msgr2=0x7fc2fc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:20.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.629+0000 7fc3209d1640 1 --2- 172.21.15.133:0/2611638888 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2fc066470 0x7fc2fc068930 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0ad000 tx=0x7fc30c008040 comp rx=0 tx=0).stop 2023-12-19T19:01:20.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.629+0000 7fc3209d1640 1 -- 172.21.15.133:0/2611638888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc31c0c63c0 msgr2=0x7fc31c1f0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:20.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.629+0000 7fc3209d1640 1 --2- 172.21.15.133:0/2611638888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc31c0c63c0 0x7fc31c1f0cb0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fc314001570 tx=0x7fc31400cca0 comp rx=0 tx=0).stop 2023-12-19T19:01:20.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.629+0000 7fc3209d1640 1 -- 172.21.15.133:0/2611638888 shutdown_connections 2023-12-19T19:01:20.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.629+0000 7fc3209d1640 1 --2- 172.21.15.133:0/2611638888 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc2fc066470 0x7fc2fc068930 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:20.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.629+0000 7fc3209d1640 1 --2- 172.21.15.133:0/2611638888 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc31c0c63c0 0x7fc31c1f0cb0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:20.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.629+0000 7fc3209d1640 1 --2- 172.21.15.133:0/2611638888 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc31c0c4100 0x7fc31c1f0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:20.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.629+0000 7fc3209d1640 1 --2- 172.21.15.133:0/2611638888 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc31c0c29e0 0x7fc31c06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:20.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.629+0000 7fc3209d1640 1 -- 172.21.15.133:0/2611638888 >> 172.21.15.133:0/2611638888 conn(0x7fc31c06a5b0 msgr2=0x7fc31c071e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:20.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.629+0000 7fc3209d1640 1 -- 172.21.15.133:0/2611638888 shutdown_connections 2023-12-19T19:01:20.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.629+0000 7fc3209d1640 1 -- 172.21.15.133:0/2611638888 wait complete. 2023-12-19T19:01:20.653 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T19:01:20.653 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T19:01:20.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.793+0000 7f6c1911d640 1 Processor -- start 2023-12-19T19:01:20.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.793+0000 7f6c1911d640 1 -- start start 2023-12-19T19:01:20.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.793+0000 7f6c1911d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6c140a5370 0x7f6c14150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:20.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.793+0000 7f6c1911d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c140c2760 con 0x7f6c140725c0 2023-12-19T19:01:20.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.793+0000 7f6c1911d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c140a57c0 con 0x7f6c14072090 2023-12-19T19:01:20.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.793+0000 7f6c1911d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c140c3070 con 0x7f6c140a5370 2023-12-19T19:01:20.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.793+0000 7f6c1359e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6c140a5370 0x7f6c14150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:20.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.793+0000 7f6c0a59c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6c140725c0 0x7f6c140c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47402/0 (socket says 172.21.15.133:47402) 2023-12-19T19:01:20.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.793+0000 7f6c0a59c640 1 -- 172.21.15.133:0/2309693183 learned_addr learned my addr 172.21.15.133:0/2309693183 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:20.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.793+0000 7f6c1359e640 1 -- 172.21.15.133:0/2309693183 >> v1:172.21.15.138:6789/0 conn(0x7f6c14072090 legacy=0x7f6c140c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:20.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.793+0000 7f6c1359e640 1 -- 172.21.15.133:0/2309693183 >> v1:172.21.15.133:6789/0 conn(0x7f6c140725c0 legacy=0x7f6c140c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:20.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.793+0000 7f6c1359e640 1 -- 172.21.15.133:0/2309693183 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c140aad20 con 0x7f6c140a5370 2023-12-19T19:01:20.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.793+0000 7f6c1259c640 1 -- 172.21.15.133:0/2309693183 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1623334975 0 0) 0x7f6c140c2760 con 0x7f6c140725c0 2023-12-19T19:01:20.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.797+0000 7f6c1359e640 1 --2- 172.21.15.133:0/2309693183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c140a5370 0x7f6c14150fa0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009d90 tx=0x7f6c0c01c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b152754173d92c83 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:20.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.797+0000 7f6c1259c640 1 -- 172.21.15.133:0/2309693183 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c0a5740 con 0x7f6c140a5370 2023-12-19T19:01:20.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.797+0000 7f6c1259c640 1 -- 172.21.15.133:0/2309693183 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0c0a58a0 con 0x7f6c140a5370 2023-12-19T19:01:20.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.797+0000 7f6c1259c640 1 -- 172.21.15.133:0/2309693183 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c0a5c30 con 0x7f6c140a5370 2023-12-19T19:01:20.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.797+0000 7f6c1911d640 1 -- 172.21.15.133:0/2309693183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c140a5370 msgr2=0x7f6c14150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:20.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.797+0000 7f6c1911d640 1 --2- 172.21.15.133:0/2309693183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c140a5370 0x7f6c14150fa0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009d90 tx=0x7f6c0c01c7f0 comp rx=0 tx=0).stop 2023-12-19T19:01:20.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.797+0000 7f6c1911d640 1 -- 172.21.15.133:0/2309693183 shutdown_connections 2023-12-19T19:01:20.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.797+0000 7f6c1911d640 1 --2- 172.21.15.133:0/2309693183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c140a5370 0x7f6c14150fa0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:20.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.797+0000 7f6c1911d640 1 -- 172.21.15.133:0/2309693183 >> 172.21.15.133:0/2309693183 conn(0x7f6c1406a5b0 msgr2=0x7f6c1406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:20.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.797+0000 7f6c1911d640 1 -- 172.21.15.133:0/2309693183 shutdown_connections 2023-12-19T19:01:20.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.797+0000 7f6c1911d640 1 -- 172.21.15.133:0/2309693183 wait complete. 2023-12-19T19:01:20.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c1911d640 1 Processor -- start 2023-12-19T19:01:20.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c1911d640 1 -- start start 2023-12-19T19:01:20.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c1911d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c14072090 0x7f6c141ece60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:20.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c1911d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6c140725c0 0x7f6c140bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:20.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c1911d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c140a5370 0x7f6c14144670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:20.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c1911d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c141f0460 con 0x7f6c14072090 2023-12-19T19:01:20.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c1911d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c141ed440 con 0x7f6c140a5370 2023-12-19T19:01:20.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c1911d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c141ed720 con 0x7f6c140725c0 2023-12-19T19:01:20.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c12d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c14072090 0x7f6c141ece60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:20.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c12d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c14072090 0x7f6c141ece60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37696/0 (socket says 172.21.15.133:37696) 2023-12-19T19:01:20.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c12d9d640 1 -- 172.21.15.133:0/2483207540 learned_addr learned my addr 172.21.15.133:0/2483207540 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:20.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c1359e640 1 --2- 172.21.15.133:0/2483207540 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c140a5370 0x7f6c14144670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:20.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c0a59c640 1 --2- 172.21.15.133:0/2483207540 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6c140725c0 0x7f6c140bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:20.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c12d9d640 1 -- 172.21.15.133:0/2483207540 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6c140725c0 msgr2=0x7f6c140bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:20.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c12d9d640 1 --2- 172.21.15.133:0/2483207540 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6c140725c0 0x7f6c140bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:20.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c12d9d640 1 -- 172.21.15.133:0/2483207540 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c140a5370 msgr2=0x7f6c14144670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:20.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c12d9d640 1 --2- 172.21.15.133:0/2483207540 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c140a5370 0x7f6c14144670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:20.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c12d9d640 1 -- 172.21.15.133:0/2483207540 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c009a70 con 0x7f6c14072090 2023-12-19T19:01:20.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c12d9d640 1 --2- 172.21.15.133:0/2483207540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c14072090 0x7f6c141ece60 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00c450 tx=0x7f6bfc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:20.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c0bfff640 1 -- 172.21.15.133:0/2483207540 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc012830 con 0x7f6c14072090 2023-12-19T19:01:20.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c0bfff640 1 -- 172.21.15.133:0/2483207540 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bfc0129b0 con 0x7f6c14072090 2023-12-19T19:01:20.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c1911d640 1 -- 172.21.15.133:0/2483207540 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c141eda00 con 0x7f6c14072090 2023-12-19T19:01:20.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c0bfff640 1 -- 172.21.15.133:0/2483207540 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc012d60 con 0x7f6c14072090 2023-12-19T19:01:20.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.801+0000 7f6c1911d640 1 -- 172.21.15.133:0/2483207540 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c140bf8a0 con 0x7f6c14072090 2023-12-19T19:01:20.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.805+0000 7f6c1911d640 1 -- 172.21.15.133:0/2483207540 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c14068400 con 0x7f6c14072090 2023-12-19T19:01:20.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.805+0000 7f6c0bfff640 1 -- 172.21.15.133:0/2483207540 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6bfc01c460 con 0x7f6c14072090 2023-12-19T19:01:20.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.805+0000 7f6c0bfff640 1 --2- 172.21.15.133:0/2483207540 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6bf4066470 0x7f6bf4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:20.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.805+0000 7f6c0bfff640 1 -- 172.21.15.133:0/2483207540 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f6bfc0837b0 con 0x7f6c14072090 2023-12-19T19:01:20.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.805+0000 7f6c0a59c640 1 --2- 172.21.15.133:0/2483207540 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6bf4066470 0x7f6bf4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:20.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.809+0000 7f6c0a59c640 1 --2- 172.21.15.133:0/2483207540 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6bf4066470 0x7f6bf4068930 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6c140a99c0 tx=0x7f6c04007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:20.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.809+0000 7f6c0bfff640 1 -- 172.21.15.133:0/2483207540 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6bfc051010 con 0x7f6c14072090 2023-12-19T19:01:20.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.961+0000 7f6c1911d640 1 -- 172.21.15.133:0/2483207540 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c140c6780 con 0x7f6c14072090 2023-12-19T19:01:20.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.961+0000 7f6c0bfff640 1 -- 172.21.15.133:0/2483207540 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6bfc054630 con 0x7f6c14072090 2023-12-19T19:01:20.966 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T19:01:20.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.965+0000 7f6c1911d640 1 -- 172.21.15.133:0/2483207540 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6bf4066470 msgr2=0x7f6bf4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:20.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.965+0000 7f6c1911d640 1 --2- 172.21.15.133:0/2483207540 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6bf4066470 0x7f6bf4068930 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6c140a99c0 tx=0x7f6c04007d60 comp rx=0 tx=0).stop 2023-12-19T19:01:20.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.965+0000 7f6c1911d640 1 -- 172.21.15.133:0/2483207540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c14072090 msgr2=0x7f6c141ece60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:20.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.965+0000 7f6c1911d640 1 --2- 172.21.15.133:0/2483207540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c14072090 0x7f6c141ece60 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00c450 tx=0x7f6bfc00c910 comp rx=0 tx=0).stop 2023-12-19T19:01:20.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.965+0000 7f6c1911d640 1 -- 172.21.15.133:0/2483207540 shutdown_connections 2023-12-19T19:01:20.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.965+0000 7f6c1911d640 1 --2- 172.21.15.133:0/2483207540 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6bf4066470 0x7f6bf4068930 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:20.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.965+0000 7f6c1911d640 1 --2- 172.21.15.133:0/2483207540 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c140a5370 0x7f6c14144670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:20.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.965+0000 7f6c1911d640 1 --2- 172.21.15.133:0/2483207540 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6c140725c0 0x7f6c140bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:20.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.965+0000 7f6c1911d640 1 --2- 172.21.15.133:0/2483207540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c14072090 0x7f6c141ece60 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:20.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.965+0000 7f6c1911d640 1 -- 172.21.15.133:0/2483207540 >> 172.21.15.133:0/2483207540 conn(0x7f6c1406a5b0 msgr2=0x7f6c141472c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:20.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.965+0000 7f6c1911d640 1 -- 172.21.15.133:0/2483207540 shutdown_connections 2023-12-19T19:01:20.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:20.965+0000 7f6c1911d640 1 -- 172.21.15.133:0/2483207540 wait complete. 2023-12-19T19:01:20.987 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2023-12-19T19:01:21.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.121+0000 7f817a7d1640 1 Processor -- start 2023-12-19T19:01:21.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.121+0000 7f817a7d1640 1 -- start start 2023-12-19T19:01:21.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.121+0000 7f817a7d1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8174151e90 0x7f81740c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:21.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.121+0000 7f817a7d1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f81740c4e60 0x7f817406bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:21.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.121+0000 7f817a7d1640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f817406c860 con 0x7f81740c7ea0 2023-12-19T19:01:21.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.121+0000 7f817a7d1640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81740c8750 con 0x7f81740c4e60 2023-12-19T19:01:21.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.121+0000 7f817a7d1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81741552d0 con 0x7f8174151e90 2023-12-19T19:01:21.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.121+0000 7f8178d6e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f81740c4e60 0x7f817406bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:21.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.121+0000 7f8178d6e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f81740c4e60 0x7f817406bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37702/0 (socket says 172.21.15.133:37702) 2023-12-19T19:01:21.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.121+0000 7f8178d6e640 1 -- 172.21.15.133:0/1938255158 learned_addr learned my addr 172.21.15.133:0/1938255158 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:21.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.121+0000 7f8178d6e640 1 -- 172.21.15.133:0/1938255158 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8174151e90 msgr2=0x7f81740c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:21.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.121+0000 7f8178d6e640 1 --2- 172.21.15.133:0/1938255158 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8174151e90 0x7f81740c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:21.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.121+0000 7f8178d6e640 1 -- 172.21.15.133:0/1938255158 >> v1:172.21.15.138:6789/0 conn(0x7f81740c7ea0 legacy=0x7f817406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:21.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.121+0000 7f8178d6e640 1 -- 172.21.15.133:0/1938255158 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8174154930 con 0x7f81740c4e60 2023-12-19T19:01:21.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.125+0000 7f8178d6e640 1 --2- 172.21.15.133:0/1938255158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81740c4e60 0x7f817406bbb0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f816c009e50 tx=0x7f816c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507584006485c2c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:21.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.125+0000 7f8172ffd640 1 -- 172.21.15.133:0/1938255158 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c0a5530 con 0x7f81740c4e60 2023-12-19T19:01:21.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.125+0000 7f8172ffd640 1 -- 172.21.15.133:0/1938255158 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816c0a5690 con 0x7f81740c4e60 2023-12-19T19:01:21.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.125+0000 7f8172ffd640 1 -- 172.21.15.133:0/1938255158 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c0a5a20 con 0x7f81740c4e60 2023-12-19T19:01:21.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.125+0000 7f817a7d1640 1 -- 172.21.15.133:0/1938255158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81740c4e60 msgr2=0x7f817406bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:21.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.125+0000 7f817a7d1640 1 --2- 172.21.15.133:0/1938255158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81740c4e60 0x7f817406bbb0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f816c009e50 tx=0x7f816c01c8b0 comp rx=0 tx=0).stop 2023-12-19T19:01:21.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.125+0000 7f817a7d1640 1 -- 172.21.15.133:0/1938255158 shutdown_connections 2023-12-19T19:01:21.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.125+0000 7f817a7d1640 1 --2- 172.21.15.133:0/1938255158 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81740c4e60 0x7f817406bbb0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:21.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.125+0000 7f817a7d1640 1 --2- 172.21.15.133:0/1938255158 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8174151e90 0x7f81740c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:21.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.125+0000 7f817a7d1640 1 -- 172.21.15.133:0/1938255158 >> 172.21.15.133:0/1938255158 conn(0x7f81740ca170 msgr2=0x7f81740ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:21.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.125+0000 7f817a7d1640 1 -- 172.21.15.133:0/1938255158 shutdown_connections 2023-12-19T19:01:21.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.125+0000 7f817a7d1640 1 -- 172.21.15.133:0/1938255158 wait complete. 2023-12-19T19:01:21.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f817a7d1640 1 Processor -- start 2023-12-19T19:01:21.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f817a7d1640 1 -- start start 2023-12-19T19:01:21.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f817a7d1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81740c4e60 0x7f81741ec9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:21.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f817a7d1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81740c7ea0 0x7f817414b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:21.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f817a7d1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8174151e90 0x7f81740aa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:21.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f817a7d1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817414bc90 con 0x7f8174151e90 2023-12-19T19:01:21.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f817a7d1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81740c21f0 con 0x7f81740c7ea0 2023-12-19T19:01:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f817a7d1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81740c24d0 con 0x7f81740c4e60 2023-12-19T19:01:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f8178d6e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8174151e90 0x7f81740aa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f8178d6e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8174151e90 0x7f81740aa7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37714/0 (socket says 172.21.15.133:37714) 2023-12-19T19:01:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f8178d6e640 1 -- 172.21.15.133:0/1766724499 learned_addr learned my addr 172.21.15.133:0/1766724499 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f8173fff640 1 --2- 172.21.15.133:0/1766724499 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81740c4e60 0x7f81741ec9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f81737fe640 1 --2- 172.21.15.133:0/1766724499 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81740c7ea0 0x7f817414b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f8178d6e640 1 -- 172.21.15.133:0/1766724499 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81740c4e60 msgr2=0x7f81741ec9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f8178d6e640 1 --2- 172.21.15.133:0/1766724499 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81740c4e60 0x7f81741ec9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f8178d6e640 1 -- 172.21.15.133:0/1766724499 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81740c7ea0 msgr2=0x7f817414b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f8178d6e640 1 --2- 172.21.15.133:0/1766724499 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81740c7ea0 0x7f817414b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f8178d6e640 1 -- 172.21.15.133:0/1766724499 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816c009b30 con 0x7f8174151e90 2023-12-19T19:01:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f8173fff640 1 --2- 172.21.15.133:0/1766724499 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81740c4e60 0x7f81741ec9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f8178d6e640 1 --2- 172.21.15.133:0/1766724499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8174151e90 0x7f81740aa7a0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f816c0af040 tx=0x7f816c019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:21.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f8170ff9640 1 -- 172.21.15.133:0/1766724499 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c0b8670 con 0x7f8174151e90 2023-12-19T19:01:21.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f8170ff9640 1 -- 172.21.15.133:0/1766724499 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816c0b87d0 con 0x7f8174151e90 2023-12-19T19:01:21.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f8170ff9640 1 -- 172.21.15.133:0/1766724499 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c0b8b80 con 0x7f8174151e90 2023-12-19T19:01:21.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f817a7d1640 1 -- 172.21.15.133:0/1766724499 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81740c27b0 con 0x7f8174151e90 2023-12-19T19:01:21.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.129+0000 7f817a7d1640 1 -- 172.21.15.133:0/1766724499 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81740c2d70 con 0x7f8174151e90 2023-12-19T19:01:21.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.133+0000 7f817a7d1640 1 -- 172.21.15.133:0/1766724499 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81740c2f60 con 0x7f8174151e90 2023-12-19T19:01:21.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.133+0000 7f8170ff9640 1 -- 172.21.15.133:0/1766724499 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f816c0b8ce0 con 0x7f8174151e90 2023-12-19T19:01:21.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.133+0000 7f8170ff9640 1 --2- 172.21.15.133:0/1766724499 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8160066470 0x7f8160068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:21.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.133+0000 7f8170ff9640 1 -- 172.21.15.133:0/1766724499 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f816c11efd0 con 0x7f8174151e90 2023-12-19T19:01:21.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.133+0000 7f8173fff640 1 --2- 172.21.15.133:0/1766724499 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8160066470 0x7f8160068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:21.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.133+0000 7f8173fff640 1 --2- 172.21.15.133:0/1766724499 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8160066470 0x7f8160068930 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8164006fd0 tx=0x7f8164008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:21.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.137+0000 7f8170ff9640 1 -- 172.21.15.133:0/1766724499 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f816c0ec800 con 0x7f8174151e90 2023-12-19T19:01:21.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:21.341+0000 7f817a7d1640 1 -- 172.21.15.133:0/1766724499 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7f8174068400 con 0x7f8174151e90 2023-12-19T19:01:22.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.305+0000 7f8170ff9640 1 -- 172.21.15.133:0/1766724499 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v176) v1 ==== 162+0+0 (secure 0 0 0) 0x7f816c0bc0e0 con 0x7f8174151e90 2023-12-19T19:01:22.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.309+0000 7f817a7d1640 1 -- 172.21.15.133:0/1766724499 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8160066470 msgr2=0x7f8160068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:22.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.309+0000 7f817a7d1640 1 --2- 172.21.15.133:0/1766724499 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8160066470 0x7f8160068930 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8164006fd0 tx=0x7f8164008040 comp rx=0 tx=0).stop 2023-12-19T19:01:22.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.309+0000 7f817a7d1640 1 -- 172.21.15.133:0/1766724499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8174151e90 msgr2=0x7f81740aa7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:22.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.309+0000 7f817a7d1640 1 --2- 172.21.15.133:0/1766724499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8174151e90 0x7f81740aa7a0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f816c0af040 tx=0x7f816c019650 comp rx=0 tx=0).stop 2023-12-19T19:01:22.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.309+0000 7f817a7d1640 1 -- 172.21.15.133:0/1766724499 shutdown_connections 2023-12-19T19:01:22.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.309+0000 7f817a7d1640 1 --2- 172.21.15.133:0/1766724499 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8160066470 0x7f8160068930 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:22.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.309+0000 7f817a7d1640 1 --2- 172.21.15.133:0/1766724499 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8174151e90 0x7f81740aa7a0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:22.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.309+0000 7f817a7d1640 1 --2- 172.21.15.133:0/1766724499 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81740c7ea0 0x7f817414b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:22.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.309+0000 7f817a7d1640 1 --2- 172.21.15.133:0/1766724499 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81740c4e60 0x7f81741ec9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:22.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.309+0000 7f817a7d1640 1 -- 172.21.15.133:0/1766724499 >> 172.21.15.133:0/1766724499 conn(0x7f81740ca170 msgr2=0x7f81740c92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:22.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.309+0000 7f817a7d1640 1 -- 172.21.15.133:0/1766724499 shutdown_connections 2023-12-19T19:01:22.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.309+0000 7f817a7d1640 1 -- 172.21.15.133:0/1766724499 wait complete. 2023-12-19T19:01:22.336 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T19:01:22.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.477+0000 7f67bb380640 1 Processor -- start 2023-12-19T19:01:22.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.477+0000 7f67bb380640 1 -- start start 2023-12-19T19:01:22.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.477+0000 7f67bb380640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f67b40c63c0 0x7f67b40c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:22.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.477+0000 7f67bb380640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f67b40c2bb0 0x7f67b40a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:22.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.477+0000 7f67bb380640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b40c31c0 con 0x7f67b40c4100 2023-12-19T19:01:22.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.477+0000 7f67bb380640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b40c34a0 con 0x7f67b40c63c0 2023-12-19T19:01:22.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.477+0000 7f67bb380640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b40c1030 con 0x7f67b40c2bb0 2023-12-19T19:01:22.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.477+0000 7f67b911c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f67b40c63c0 0x7f67b40c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:22.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.477+0000 7f67b911c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f67b40c63c0 0x7f67b40c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37718/0 (socket says 172.21.15.133:37718) 2023-12-19T19:01:22.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.477+0000 7f67b911c640 1 -- 172.21.15.133:0/1336346132 learned_addr learned my addr 172.21.15.133:0/1336346132 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:22.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.477+0000 7f67b991d640 1 --2- 172.21.15.133:0/1336346132 >> v2:172.21.15.138:3300/0 conn(0x7f67b40c2bb0 0x7f67b40a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:22.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.477+0000 7f67b911c640 1 -- 172.21.15.133:0/1336346132 >> v2:172.21.15.138:3300/0 conn(0x7f67b40c2bb0 msgr2=0x7f67b40a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:22.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.477+0000 7f67b911c640 1 --2- 172.21.15.133:0/1336346132 >> v2:172.21.15.138:3300/0 conn(0x7f67b40c2bb0 0x7f67b40a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:22.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.477+0000 7f67b911c640 1 -- 172.21.15.133:0/1336346132 >> v1:172.21.15.138:6789/0 conn(0x7f67b40c4100 legacy=0x7f67b40c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:22.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.477+0000 7f67b911c640 1 -- 172.21.15.133:0/1336346132 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b40c1310 con 0x7f67b40c63c0 2023-12-19T19:01:22.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.481+0000 7f67b911c640 1 --2- 172.21.15.133:0/1336346132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67b40c63c0 0x7f67b40c06d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f67b40c4550 tx=0x7f67b001eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0e5209da1f8668 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:22.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.481+0000 7f67abfff640 1 -- 172.21.15.133:0/1336346132 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b40aa3d0 con 0x7f67b40c63c0 2023-12-19T19:01:22.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.481+0000 7f67abfff640 1 -- 172.21.15.133:0/1336346132 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b00a7ba0 con 0x7f67b40c63c0 2023-12-19T19:01:22.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.481+0000 7f67abfff640 1 -- 172.21.15.133:0/1336346132 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b00af440 con 0x7f67b40c63c0 2023-12-19T19:01:22.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.481+0000 7f67bb380640 1 -- 172.21.15.133:0/1336346132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67b40c63c0 msgr2=0x7f67b40c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:22.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.481+0000 7f67bb380640 1 --2- 172.21.15.133:0/1336346132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67b40c63c0 0x7f67b40c06d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f67b40c4550 tx=0x7f67b001eab0 comp rx=0 tx=0).stop 2023-12-19T19:01:22.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.481+0000 7f67bb380640 1 -- 172.21.15.133:0/1336346132 shutdown_connections 2023-12-19T19:01:22.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.481+0000 7f67bb380640 1 --2- 172.21.15.133:0/1336346132 >> v2:172.21.15.138:3300/0 conn(0x7f67b40c2bb0 0x7f67b40a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:22.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.481+0000 7f67bb380640 1 --2- 172.21.15.133:0/1336346132 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67b40c63c0 0x7f67b40c06d0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:22.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.481+0000 7f67bb380640 1 -- 172.21.15.133:0/1336346132 >> 172.21.15.133:0/1336346132 conn(0x7f67b406a5b0 msgr2=0x7f67b406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:22.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.481+0000 7f67bb380640 1 -- 172.21.15.133:0/1336346132 shutdown_connections 2023-12-19T19:01:22.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.481+0000 7f67bb380640 1 -- 172.21.15.133:0/1336346132 wait complete. 2023-12-19T19:01:22.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67bb380640 1 Processor -- start 2023-12-19T19:01:22.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67bb380640 1 -- start start 2023-12-19T19:01:22.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67bb380640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67b40c2bb0 0x7f67b41560f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:22.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67bb380640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67b40c4100 0x7f67b4157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:22.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67bb380640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67b40c63c0 0x7f67b414fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:22.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67bb380640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b4151f60 con 0x7f67b40c2bb0 2023-12-19T19:01:22.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67bb380640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b40c06a0 con 0x7f67b40c4100 2023-12-19T19:01:22.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67bb380640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b40c0980 con 0x7f67b40c63c0 2023-12-19T19:01:22.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67b911c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67b40c2bb0 0x7f67b41560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:22.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67b911c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67b40c2bb0 0x7f67b41560f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37728/0 (socket says 172.21.15.133:37728) 2023-12-19T19:01:22.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67b911c640 1 -- 172.21.15.133:0/2314757989 learned_addr learned my addr 172.21.15.133:0/2314757989 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:22.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67b891b640 1 --2- 172.21.15.133:0/2314757989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67b40c4100 0x7f67b4157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:22.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67b991d640 1 --2- 172.21.15.133:0/2314757989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67b40c63c0 0x7f67b414fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:22.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67b911c640 1 -- 172.21.15.133:0/2314757989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67b40c63c0 msgr2=0x7f67b414fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:22.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67b911c640 1 --2- 172.21.15.133:0/2314757989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67b40c63c0 0x7f67b414fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:22.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67b911c640 1 -- 172.21.15.133:0/2314757989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67b40c4100 msgr2=0x7f67b4157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:22.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67b911c640 1 --2- 172.21.15.133:0/2314757989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67b40c4100 0x7f67b4157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:22.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67b911c640 1 -- 172.21.15.133:0/2314757989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b000b770 con 0x7f67b40c2bb0 2023-12-19T19:01:22.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67b911c640 1 --2- 172.21.15.133:0/2314757989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67b40c2bb0 0x7f67b41560f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f67b000b2c0 tx=0x7f67b001b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:22.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67a9ffb640 1 -- 172.21.15.133:0/2314757989 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b00ba440 con 0x7f67b40c2bb0 2023-12-19T19:01:22.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67a9ffb640 1 -- 172.21.15.133:0/2314757989 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b00ba5a0 con 0x7f67b40c2bb0 2023-12-19T19:01:22.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67a9ffb640 1 -- 172.21.15.133:0/2314757989 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b00ba950 con 0x7f67b40c2bb0 2023-12-19T19:01:22.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67bb380640 1 -- 172.21.15.133:0/2314757989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b41ed940 con 0x7f67b40c2bb0 2023-12-19T19:01:22.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67bb380640 1 -- 172.21.15.133:0/2314757989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b4156630 con 0x7f67b40c2bb0 2023-12-19T19:01:22.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.485+0000 7f67bb380640 1 -- 172.21.15.133:0/2314757989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b4068400 con 0x7f67b40c2bb0 2023-12-19T19:01:22.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.489+0000 7f67a9ffb640 1 -- 172.21.15.133:0/2314757989 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f67b00b93e0 con 0x7f67b40c2bb0 2023-12-19T19:01:22.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.489+0000 7f67a9ffb640 1 --2- 172.21.15.133:0/2314757989 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6798066470 0x7f6798068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:22.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.489+0000 7f67a9ffb640 1 -- 172.21.15.133:0/2314757989 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f67b011e310 con 0x7f67b40c2bb0 2023-12-19T19:01:22.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.489+0000 7f67b891b640 1 --2- 172.21.15.133:0/2314757989 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6798066470 0x7f6798068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:22.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.489+0000 7f67b891b640 1 --2- 172.21.15.133:0/2314757989 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6798066470 0x7f6798068930 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f67b40a69d0 tx=0x7f67a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:22.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.493+0000 7f67a9ffb640 1 -- 172.21.15.133:0/2314757989 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f67b00ebb40 con 0x7f67b40c2bb0 2023-12-19T19:01:22.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.641+0000 7f67bb380640 1 -- 172.21.15.133:0/2314757989 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f67b4071e70 con 0x7f67b40c2bb0 2023-12-19T19:01:22.656 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.653+0000 7f67a9ffb640 1 -- 172.21.15.133:0/2314757989 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f67b00b40c0 con 0x7f67b40c2bb0 2023-12-19T19:01:22.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.653+0000 7f67bb380640 1 -- 172.21.15.133:0/2314757989 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6798066470 msgr2=0x7f6798068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:22.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.653+0000 7f67bb380640 1 --2- 172.21.15.133:0/2314757989 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6798066470 0x7f6798068930 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f67b40a69d0 tx=0x7f67a4009040 comp rx=0 tx=0).stop 2023-12-19T19:01:22.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.653+0000 7f67bb380640 1 -- 172.21.15.133:0/2314757989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67b40c2bb0 msgr2=0x7f67b41560f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:22.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.653+0000 7f67bb380640 1 --2- 172.21.15.133:0/2314757989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67b40c2bb0 0x7f67b41560f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f67b000b2c0 tx=0x7f67b001b850 comp rx=0 tx=0).stop 2023-12-19T19:01:22.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.653+0000 7f67bb380640 1 -- 172.21.15.133:0/2314757989 shutdown_connections 2023-12-19T19:01:22.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.653+0000 7f67bb380640 1 --2- 172.21.15.133:0/2314757989 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6798066470 0x7f6798068930 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:22.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.653+0000 7f67bb380640 1 --2- 172.21.15.133:0/2314757989 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f67b40c63c0 0x7f67b414fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:22.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.653+0000 7f67bb380640 1 --2- 172.21.15.133:0/2314757989 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f67b40c4100 0x7f67b4157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:22.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.653+0000 7f67bb380640 1 --2- 172.21.15.133:0/2314757989 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f67b40c2bb0 0x7f67b41560f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:22.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.653+0000 7f67bb380640 1 -- 172.21.15.133:0/2314757989 >> 172.21.15.133:0/2314757989 conn(0x7f67b406a5b0 msgr2=0x7f67b406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:22.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.653+0000 7f67bb380640 1 -- 172.21.15.133:0/2314757989 shutdown_connections 2023-12-19T19:01:22.660 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:22.653+0000 7f67bb380640 1 -- 172.21.15.133:0/2314757989 wait complete. 2023-12-19T19:01:22.678 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T19:01:22.678 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T19:01:22.793 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T19:01:22.882 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T19:01:22.882 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T19:01:22.883 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:01:22.892 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3517 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-19T19:01:22.892 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:01:22.892 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:01:22.902 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3612 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-19T19:01:22.902 INFO:tasks.cephfs.cephfs_test_case:[, ] 2023-12-19T19:01:22.902 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:01:23.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.069+0000 7fa273980640 1 Processor -- start 2023-12-19T19:01:23.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.069+0000 7fa273980640 1 -- start start 2023-12-19T19:01:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.069+0000 7fa273980640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa26c0c69c0 0x7fa26c155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.069+0000 7fa273980640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26c1521b0 con 0x7fa26c0c7eb0 2023-12-19T19:01:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.069+0000 7fa273980640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa26c0c6e40 con 0x7fa26c0af730 2023-12-19T19:01:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.069+0000 7fa273980640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c0c73d0 con 0x7fa26c0c69c0 2023-12-19T19:01:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.069+0000 7fa271f1d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa26c0c7eb0 0x7fa26c0c4930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47418/0 (socket says 172.21.15.133:47418) 2023-12-19T19:01:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.069+0000 7fa271f1d640 1 -- 172.21.15.133:0/2755327574 learned_addr learned my addr 172.21.15.133:0/2755327574 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:23.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.069+0000 7fa270f1b640 1 --2- 172.21.15.133:0/2755327574 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa26c0c69c0 0x7fa26c155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:23.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.069+0000 7fa263fff640 1 -- 172.21.15.133:0/2755327574 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1950792489 0 0) 0x7fa26c1521b0 con 0x7fa26c0c7eb0 2023-12-19T19:01:23.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.069+0000 7fa263fff640 1 -- 172.21.15.133:0/2755327574 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa258003530 con 0x7fa26c0c7eb0 2023-12-19T19:01:23.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.069+0000 7fa263fff640 1 -- 172.21.15.133:0/2755327574 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4137852340 0 0) 0x7fa26c0c6e40 con 0x7fa26c0af730 2023-12-19T19:01:23.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.069+0000 7fa263fff640 1 -- 172.21.15.133:0/2755327574 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa26c1521b0 con 0x7fa26c0af730 2023-12-19T19:01:23.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.069+0000 7fa270f1b640 1 -- 172.21.15.133:0/2755327574 >> v1:172.21.15.138:6789/0 conn(0x7fa26c0af730 legacy=0x7fa26c06c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:23.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.069+0000 7fa270f1b640 1 -- 172.21.15.133:0/2755327574 >> v1:172.21.15.133:6789/0 conn(0x7fa26c0c7eb0 legacy=0x7fa26c0c4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:23.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.069+0000 7fa270f1b640 1 -- 172.21.15.133:0/2755327574 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26c0c70f0 con 0x7fa26c0c69c0 2023-12-19T19:01:23.076 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.073+0000 7fa270f1b640 1 --2- 172.21.15.133:0/2755327574 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa26c0c69c0 0x7fa26c155240 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0097f0 tx=0x7fa25c01c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d04be6fa8d265a0f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:23.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.073+0000 7fa263fff640 1 -- 172.21.15.133:0/2755327574 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c0ab600 con 0x7fa26c0c69c0 2023-12-19T19:01:23.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.073+0000 7fa263fff640 1 -- 172.21.15.133:0/2755327574 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25c0a7050 con 0x7fa26c0c69c0 2023-12-19T19:01:23.077 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.073+0000 7fa263fff640 1 -- 172.21.15.133:0/2755327574 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c0ab960 con 0x7fa26c0c69c0 2023-12-19T19:01:23.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.073+0000 7fa273980640 1 -- 172.21.15.133:0/2755327574 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa26c0c69c0 msgr2=0x7fa26c155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:23.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.073+0000 7fa273980640 1 --2- 172.21.15.133:0/2755327574 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa26c0c69c0 0x7fa26c155240 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0097f0 tx=0x7fa25c01c3a0 comp rx=0 tx=0).stop 2023-12-19T19:01:23.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.073+0000 7fa273980640 1 -- 172.21.15.133:0/2755327574 shutdown_connections 2023-12-19T19:01:23.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.073+0000 7fa273980640 1 --2- 172.21.15.133:0/2755327574 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa26c0c69c0 0x7fa26c155240 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:23.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.073+0000 7fa273980640 1 -- 172.21.15.133:0/2755327574 >> 172.21.15.133:0/2755327574 conn(0x7fa26c0ca180 msgr2=0x7fa26c0ca590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:23.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.073+0000 7fa273980640 1 -- 172.21.15.133:0/2755327574 shutdown_connections 2023-12-19T19:01:23.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.073+0000 7fa273980640 1 -- 172.21.15.133:0/2755327574 wait complete. 2023-12-19T19:01:23.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa273980640 1 Processor -- start 2023-12-19T19:01:23.079 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa273980640 1 -- start start 2023-12-19T19:01:23.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa273980640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa26c0af730 0x7fa26c150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:23.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa273980640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa26c0c69c0 0x7fa26c147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:23.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa273980640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa26c0c7eb0 0x7fa26c148290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:23.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa273980640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c1588a0 con 0x7fa26c0c69c0 2023-12-19T19:01:23.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa273980640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c0aa310 con 0x7fa26c0c7eb0 2023-12-19T19:01:23.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa273980640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c14d7e0 con 0x7fa26c0af730 2023-12-19T19:01:23.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa270f1b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa26c0c69c0 0x7fa26c147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:23.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa270f1b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa26c0c69c0 0x7fa26c147d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37732/0 (socket says 172.21.15.133:37732) 2023-12-19T19:01:23.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa270f1b640 1 -- 172.21.15.133:0/1603161706 learned_addr learned my addr 172.21.15.133:0/1603161706 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:23.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa27171c640 1 --2- 172.21.15.133:0/1603161706 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa26c0af730 0x7fa26c150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:23.081 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa271f1d640 1 --2- 172.21.15.133:0/1603161706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa26c0c7eb0 0x7fa26c148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:23.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa270f1b640 1 -- 172.21.15.133:0/1603161706 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa26c0af730 msgr2=0x7fa26c150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:23.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa270f1b640 1 --2- 172.21.15.133:0/1603161706 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa26c0af730 0x7fa26c150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:23.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa270f1b640 1 -- 172.21.15.133:0/1603161706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa26c0c7eb0 msgr2=0x7fa26c148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:23.082 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa270f1b640 1 --2- 172.21.15.133:0/1603161706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa26c0c7eb0 0x7fa26c148290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:23.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa270f1b640 1 -- 172.21.15.133:0/1603161706 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25c009420 con 0x7fa26c0c69c0 2023-12-19T19:01:23.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa270f1b640 1 --2- 172.21.15.133:0/1603161706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa26c0c69c0 0x7fa26c147d50 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0097f0 tx=0x7fa25c019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:23.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa261ffb640 1 -- 172.21.15.133:0/1603161706 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c0b4400 con 0x7fa26c0c69c0 2023-12-19T19:01:23.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa261ffb640 1 -- 172.21.15.133:0/1603161706 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25c0b4580 con 0x7fa26c0c69c0 2023-12-19T19:01:23.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa261ffb640 1 -- 172.21.15.133:0/1603161706 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c0b4930 con 0x7fa26c0c69c0 2023-12-19T19:01:23.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa273980640 1 -- 172.21.15.133:0/1603161706 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa26c14dac0 con 0x7fa26c0c69c0 2023-12-19T19:01:23.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.077+0000 7fa273980640 1 -- 172.21.15.133:0/1603161706 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa26c0a9fa0 con 0x7fa26c0c69c0 2023-12-19T19:01:23.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.081+0000 7fa273980640 1 -- 172.21.15.133:0/1603161706 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa26c066df0 con 0x7fa26c0c69c0 2023-12-19T19:01:23.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.081+0000 7fa261ffb640 1 -- 172.21.15.133:0/1603161706 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa25c0b2040 con 0x7fa26c0c69c0 2023-12-19T19:01:23.084 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.081+0000 7fa261ffb640 1 --2- 172.21.15.133:0/1603161706 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa250066470 0x7fa250068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:23.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.081+0000 7fa261ffb640 1 -- 172.21.15.133:0/1603161706 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa25c11da00 con 0x7fa26c0c69c0 2023-12-19T19:01:23.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.081+0000 7fa27171c640 1 --2- 172.21.15.133:0/1603161706 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa250066470 0x7fa250068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:23.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.081+0000 7fa27171c640 1 --2- 172.21.15.133:0/1603161706 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa250066470 0x7fa250068930 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa26c152340 tx=0x7fa268009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:23.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.085+0000 7fa261ffb640 1 -- 172.21.15.133:0/1603161706 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa25c0eb1c0 con 0x7fa26c0c69c0 2023-12-19T19:01:23.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.265+0000 7fa273980640 1 -- 172.21.15.133:0/1603161706 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa26c04e930 con 0x7fa26c0c69c0 2023-12-19T19:01:23.268 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.265+0000 7fa261ffb640 1 -- 172.21.15.133:0/1603161706 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+3711 (secure 0 0 0) 0x7fa25c0b9e90 con 0x7fa26c0c69c0 2023-12-19T19:01:23.269 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:23.269 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":41,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5243,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6833/3200335051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3200335051},{"type":"v1","addr":"172.21.15.133:6833","nonce":3200335051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/2114705112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":2114705112},{"type":"v1","addr":"172.21.15.138:6835","nonce":2114705112}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5705,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/2356031154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":2356031154},{"type":"v1","addr":"172.21.15.138:6837","nonce":2356031154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":6330,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/1768735780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6834","nonce":1768735780},{"type":"v1","addr":"172.21.15.133:6835","nonce":1768735780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39}],"filesystems":[]} 2023-12-19T19:01:23.269 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 41 2023-12-19T19:01:23.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.265+0000 7fa273980640 1 -- 172.21.15.133:0/1603161706 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa250066470 msgr2=0x7fa250068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:23.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.265+0000 7fa273980640 1 --2- 172.21.15.133:0/1603161706 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa250066470 0x7fa250068930 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fa26c152340 tx=0x7fa268009040 comp rx=0 tx=0).stop 2023-12-19T19:01:23.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.265+0000 7fa273980640 1 -- 172.21.15.133:0/1603161706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa26c0c69c0 msgr2=0x7fa26c147d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:23.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.265+0000 7fa273980640 1 --2- 172.21.15.133:0/1603161706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa26c0c69c0 0x7fa26c147d50 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fa25c0097f0 tx=0x7fa25c019140 comp rx=0 tx=0).stop 2023-12-19T19:01:23.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.265+0000 7fa273980640 1 -- 172.21.15.133:0/1603161706 shutdown_connections 2023-12-19T19:01:23.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.265+0000 7fa273980640 1 --2- 172.21.15.133:0/1603161706 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa250066470 0x7fa250068930 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:23.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.265+0000 7fa273980640 1 --2- 172.21.15.133:0/1603161706 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa26c0c7eb0 0x7fa26c148290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:23.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.265+0000 7fa273980640 1 --2- 172.21.15.133:0/1603161706 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa26c0c69c0 0x7fa26c147d50 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:23.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.265+0000 7fa273980640 1 --2- 172.21.15.133:0/1603161706 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa26c0af730 0x7fa26c150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:23.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.265+0000 7fa273980640 1 -- 172.21.15.133:0/1603161706 >> 172.21.15.133:0/1603161706 conn(0x7fa26c0ca180 msgr2=0x7fa26c0c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:23.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.265+0000 7fa273980640 1 -- 172.21.15.133:0/1603161706 shutdown_connections 2023-12-19T19:01:23.271 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:23.265+0000 7fa273980640 1 -- 172.21.15.133:0/1603161706 wait complete. 2023-12-19T19:01:23.290 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T19:01:23.290 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T19:01:23.290 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T19:01:23.290 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:01:23.291 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T19:01:23.291 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T19:01:23.291 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T19:01:23.291 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:01:23.291 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T19:01:23.291 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T19:01:23.292 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T19:01:23.292 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:01:23.292 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T19:01:23.292 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T19:01:23.292 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T19:01:23.292 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:01:23.305 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T19:01:23.306 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T19:01:23.306 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T19:01:23.306 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T19:01:23.308 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T19:01:23.308 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T19:01:23.354 INFO:tasks.ceph.mds.a:Started 2023-12-19T19:01:23.354 DEBUG:teuthology.parallel:result is None 2023-12-19T19:01:23.355 INFO:tasks.ceph.mds.b:Started 2023-12-19T19:01:23.355 DEBUG:teuthology.parallel:result is None 2023-12-19T19:01:23.356 INFO:tasks.ceph.mds.c:Started 2023-12-19T19:01:23.356 DEBUG:teuthology.parallel:result is None 2023-12-19T19:01:23.439 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2023-12-19T19:01:23.439 INFO:tasks.ceph.mds.a.smithi133.stdout:starting mds.a at 2023-12-19T19:01:23.445 INFO:tasks.ceph.mds.b.smithi138.stdout:starting mds.b at 2023-12-19T19:01:23.953 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-12-19T19:01:29.308 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T19:01:29.308 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T19:01:29.312 INFO:tasks.ceph.mds.d:Started 2023-12-19T19:01:29.312 DEBUG:teuthology.parallel:result is None 2023-12-19T19:01:29.313 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T19:01:29.405 INFO:tasks.ceph.mds.d.smithi138.stdout:starting mds.d at 2023-12-19T19:01:29.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.457+0000 7f3e1b5b8640 1 Processor -- start 2023-12-19T19:01:29.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.457+0000 7f3e1b5b8640 1 -- start start 2023-12-19T19:01:29.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.457+0000 7f3e1b5b8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e14155de0 0x7f3e14156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:29.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.457+0000 7f3e1b5b8640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e140c2580 con 0x7f3e140c5260 2023-12-19T19:01:29.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.457+0000 7f3e1b5b8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e140c1a00 con 0x7f3e140c5640 2023-12-19T19:01:29.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.457+0000 7f3e1b5b8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e14153510 con 0x7f3e14155de0 2023-12-19T19:01:29.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e19354640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3e140c5260 0x7f3e1406d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43112/0 (socket says 172.21.15.133:43112) 2023-12-19T19:01:29.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e19354640 1 -- 172.21.15.133:0/3271088771 learned_addr learned my addr 172.21.15.133:0/3271088771 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:29.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e19b55640 1 --2- 172.21.15.133:0/3271088771 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e14155de0 0x7f3e14156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:29.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e0bfff640 1 -- 172.21.15.133:0/3271088771 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894391323 0 0) 0x7f3e140c2580 con 0x7f3e140c5260 2023-12-19T19:01:29.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e0bfff640 1 -- 172.21.15.133:0/3271088771 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e00003530 con 0x7f3e140c5260 2023-12-19T19:01:29.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e0bfff640 1 -- 172.21.15.133:0/3271088771 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 322370247 0 0) 0x7f3e140c1a00 con 0x7f3e140c5640 2023-12-19T19:01:29.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e0bfff640 1 -- 172.21.15.133:0/3271088771 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e140c2580 con 0x7f3e140c5640 2023-12-19T19:01:29.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e0bfff640 1 -- 172.21.15.133:0/3271088771 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1508904798 0 0) 0x7f3e00003530 con 0x7f3e140c5260 2023-12-19T19:01:29.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e0bfff640 1 -- 172.21.15.133:0/3271088771 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e14155de0 msgr2=0x7f3e14156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:29.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e0bfff640 1 --2- 172.21.15.133:0/3271088771 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e14155de0 0x7f3e14156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:29.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e0bfff640 1 -- 172.21.15.133:0/3271088771 >> v1:172.21.15.138:6789/0 conn(0x7f3e140c5640 legacy=0x7f3e140c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:29.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e0bfff640 1 -- 172.21.15.133:0/3271088771 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e140c1ce0 con 0x7f3e140c5260 2023-12-19T19:01:29.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e0bfff640 1 -- 172.21.15.133:0/3271088771 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f3e10001680 con 0x7f3e140c5260 2023-12-19T19:01:29.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e0bfff640 1 -- 172.21.15.133:0/3271088771 >> v1:172.21.15.133:6789/0 conn(0x7f3e140c5260 legacy=0x7f3e1406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:29.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e0bfff640 1 --2- 172.21.15.133:0/3271088771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e00003b40 0x7f3e00003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:29.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e0bfff640 1 --2- 172.21.15.133:0/3271088771 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e000047d0 0x7f3e00004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:29.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e0bfff640 1 --2- 172.21.15.133:0/3271088771 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e14155de0 0x7f3e000051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:29.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e0bfff640 1 -- 172.21.15.133:0/3271088771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0000baa0 con 0x7f3e00003b40 2023-12-19T19:01:29.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e0bfff640 1 -- 172.21.15.133:0/3271088771 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0000bc10 con 0x7f3e000047d0 2023-12-19T19:01:29.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e0bfff640 1 -- 172.21.15.133:0/3271088771 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0000bdd0 con 0x7f3e14155de0 2023-12-19T19:01:29.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e19354640 1 --2- 172.21.15.133:0/3271088771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e00003b40 0x7f3e00003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:29.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e18b53640 1 --2- 172.21.15.133:0/3271088771 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e000047d0 0x7f3e00004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:29.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e19b55640 1 --2- 172.21.15.133:0/3271088771 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e14155de0 0x7f3e000051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:29.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e19354640 1 -- 172.21.15.133:0/3271088771 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e14155de0 msgr2=0x7f3e000051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:29.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e19354640 1 --2- 172.21.15.133:0/3271088771 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e14155de0 0x7f3e000051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:29.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e19354640 1 -- 172.21.15.133:0/3271088771 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e000047d0 msgr2=0x7f3e00004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:29.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e19354640 1 --2- 172.21.15.133:0/3271088771 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e000047d0 0x7f3e00004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:29.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.461+0000 7f3e19354640 1 -- 172.21.15.133:0/3271088771 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e00003530 con 0x7f3e00003b40 2023-12-19T19:01:29.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.465+0000 7f3e19354640 1 --2- 172.21.15.133:0/3271088771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e00003b40 0x7f3e00003f40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000c190 tx=0x7f3e1001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e374e8d012f17793 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:29.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.465+0000 7f3e0bfff640 1 -- 172.21.15.133:0/3271088771 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e100058e0 con 0x7f3e00003b40 2023-12-19T19:01:29.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.465+0000 7f3e0bfff640 1 -- 172.21.15.133:0/3271088771 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e10005a40 con 0x7f3e00003b40 2023-12-19T19:01:29.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.465+0000 7f3e0bfff640 1 -- 172.21.15.133:0/3271088771 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e10005df0 con 0x7f3e00003b40 2023-12-19T19:01:29.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.465+0000 7f3e1b5b8640 1 -- 172.21.15.133:0/3271088771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e00003b40 msgr2=0x7f3e00003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:29.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.465+0000 7f3e1b5b8640 1 --2- 172.21.15.133:0/3271088771 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e00003b40 0x7f3e00003f40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000c190 tx=0x7f3e1001cbc0 comp rx=0 tx=0).stop 2023-12-19T19:01:29.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.465+0000 7f3e19b55640 1 -- 172.21.15.133:0/3271088771 reap_dead start 2023-12-19T19:01:29.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.465+0000 7f3e1b5b8640 1 -- 172.21.15.133:0/3271088771 shutdown_connections 2023-12-19T19:01:29.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.465+0000 7f3e1b5b8640 1 -- 172.21.15.133:0/3271088771 >> 172.21.15.133:0/3271088771 conn(0x7f3e1406a5b0 msgr2=0x7f3e1406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:29.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.465+0000 7f3e1b5b8640 1 -- 172.21.15.133:0/3271088771 shutdown_connections 2023-12-19T19:01:29.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.465+0000 7f3e1b5b8640 1 -- 172.21.15.133:0/3271088771 wait complete. 2023-12-19T19:01:29.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.465+0000 7f3e1b5b8640 1 Processor -- start 2023-12-19T19:01:29.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.465+0000 7f3e1b5b8640 1 -- start start 2023-12-19T19:01:29.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e1b5b8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e00003b40 0x7f3e140a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:29.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e1b5b8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e140bf100 0x7f3e140bf580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:29.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e1b5b8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e14153890 0x7f3e14153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:29.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e1b5b8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1414ac90 con 0x7f3e00003b40 2023-12-19T19:01:29.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e1b5b8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e140c0170 con 0x7f3e140bf100 2023-12-19T19:01:29.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e1b5b8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e14155250 con 0x7f3e14153890 2023-12-19T19:01:29.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e19354640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e00003b40 0x7f3e140a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:29.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e19354640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e00003b40 0x7f3e140a8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51610/0 (socket says 172.21.15.133:51610) 2023-12-19T19:01:29.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e19354640 1 -- 172.21.15.133:0/2590677734 learned_addr learned my addr 172.21.15.133:0/2590677734 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:29.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e18b53640 1 --2- 172.21.15.133:0/2590677734 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e140bf100 0x7f3e140bf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:29.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e19b55640 1 --2- 172.21.15.133:0/2590677734 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e14153890 0x7f3e14153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:29.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e19354640 1 -- 172.21.15.133:0/2590677734 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e14153890 msgr2=0x7f3e14153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:29.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e19354640 1 --2- 172.21.15.133:0/2590677734 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e14153890 0x7f3e14153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:29.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e19354640 1 -- 172.21.15.133:0/2590677734 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e140bf100 msgr2=0x7f3e140bf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:29.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e19354640 1 --2- 172.21.15.133:0/2590677734 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e140bf100 0x7f3e140bf580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:29.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e19354640 1 -- 172.21.15.133:0/2590677734 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1414b120 con 0x7f3e00003b40 2023-12-19T19:01:29.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e19354640 1 --2- 172.21.15.133:0/2590677734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e00003b40 0x7f3e140a8e80 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3e100ab040 tx=0x7f3e00005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:29.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e09ffb640 1 -- 172.21.15.133:0/2590677734 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e10001680 con 0x7f3e00003b40 2023-12-19T19:01:29.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e09ffb640 1 -- 172.21.15.133:0/2590677734 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e100010b0 con 0x7f3e00003b40 2023-12-19T19:01:29.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e09ffb640 1 -- 172.21.15.133:0/2590677734 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e100049f0 con 0x7f3e00003b40 2023-12-19T19:01:29.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e1b5b8640 1 -- 172.21.15.133:0/2590677734 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e141554f0 con 0x7f3e00003b40 2023-12-19T19:01:29.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e1b5b8640 1 -- 172.21.15.133:0/2590677734 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e141edbe0 con 0x7f3e00003b40 2023-12-19T19:01:29.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e1b5b8640 1 -- 172.21.15.133:0/2590677734 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e14068400 con 0x7f3e00003b40 2023-12-19T19:01:29.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.469+0000 7f3e09ffb640 1 -- 172.21.15.133:0/2590677734 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3e10004b50 con 0x7f3e00003b40 2023-12-19T19:01:29.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.473+0000 7f3e09ffb640 1 --2- 172.21.15.133:0/2590677734 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3df8066470 0x7f3df8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:29.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.473+0000 7f3e09ffb640 1 -- 172.21.15.133:0/2590677734 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3e1011d180 con 0x7f3e00003b40 2023-12-19T19:01:29.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.473+0000 7f3e18b53640 1 --2- 172.21.15.133:0/2590677734 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3df8066470 0x7f3df8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:29.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.473+0000 7f3e18b53640 1 --2- 172.21.15.133:0/2590677734 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3df8066470 0x7f3df8068930 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3e14155960 tx=0x7f3e04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:29.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.477+0000 7f3e09ffb640 1 -- 172.21.15.133:0/2590677734 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f3e100ea890 con 0x7f3e00003b40 2023-12-19T19:01:29.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:29.637+0000 7f3e1b5b8640 1 -- 172.21.15.133:0/2590677734 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f3e1406d390 con 0x7f3e00003b40 2023-12-19T19:01:30.666 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-12-19T19:01:30.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:30.945+0000 7f3e09ffb640 1 -- 172.21.15.133:0/2590677734 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v65) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3e100edeb0 con 0x7f3e00003b40 2023-12-19T19:01:30.951 INFO:teuthology.orchestra.run.smithi133.stderr: removed all blocklist entries 2023-12-19T19:01:30.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:30.949+0000 7f3e1b5b8640 1 -- 172.21.15.133:0/2590677734 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3df8066470 msgr2=0x7f3df8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:30.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:30.949+0000 7f3e1b5b8640 1 --2- 172.21.15.133:0/2590677734 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3df8066470 0x7f3df8068930 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3e14155960 tx=0x7f3e04009040 comp rx=0 tx=0).stop 2023-12-19T19:01:30.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:30.949+0000 7f3e1b5b8640 1 -- 172.21.15.133:0/2590677734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e00003b40 msgr2=0x7f3e140a8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:30.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:30.949+0000 7f3e1b5b8640 1 --2- 172.21.15.133:0/2590677734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e00003b40 0x7f3e140a8e80 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3e100ab040 tx=0x7f3e00005800 comp rx=0 tx=0).stop 2023-12-19T19:01:30.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:30.949+0000 7f3e1b5b8640 1 -- 172.21.15.133:0/2590677734 shutdown_connections 2023-12-19T19:01:30.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:30.949+0000 7f3e1b5b8640 1 --2- 172.21.15.133:0/2590677734 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3df8066470 0x7f3df8068930 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:30.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:30.949+0000 7f3e1b5b8640 1 --2- 172.21.15.133:0/2590677734 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3e14153890 0x7f3e14153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:30.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:30.949+0000 7f3e1b5b8640 1 --2- 172.21.15.133:0/2590677734 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3e140bf100 0x7f3e140bf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:30.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:30.949+0000 7f3e1b5b8640 1 --2- 172.21.15.133:0/2590677734 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3e00003b40 0x7f3e140a8e80 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:30.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:30.949+0000 7f3e1b5b8640 1 -- 172.21.15.133:0/2590677734 >> 172.21.15.133:0/2590677734 conn(0x7f3e1406a5b0 msgr2=0x7f3e140706f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:30.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:30.949+0000 7f3e1b5b8640 1 -- 172.21.15.133:0/2590677734 shutdown_connections 2023-12-19T19:01:30.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:30.949+0000 7f3e1b5b8640 1 -- 172.21.15.133:0/2590677734 wait complete. 2023-12-19T19:01:30.977 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T19:01:31.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.113+0000 7fa751c9a640 1 Processor -- start 2023-12-19T19:01:31.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.113+0000 7fa751c9a640 1 -- start start 2023-12-19T19:01:31.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.113+0000 7fa751c9a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa74c072090 0x7fa74c0a5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:31.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.117+0000 7fa751c9a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa74c0c2760 con 0x7fa74c0725c0 2023-12-19T19:01:31.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.117+0000 7fa751c9a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa74c0aad20 con 0x7fa74c0c3bd0 2023-12-19T19:01:31.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.117+0000 7fa751c9a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa74c0c3070 con 0x7fa74c072090 2023-12-19T19:01:31.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.117+0000 7fa74affd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa74c0725c0 0x7fa74c0c5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43118/0 (socket says 172.21.15.133:43118) 2023-12-19T19:01:31.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.117+0000 7fa74affd640 1 -- 172.21.15.133:0/1058918422 learned_addr learned my addr 172.21.15.133:0/1058918422 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:31.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.117+0000 7fa74b7fe640 1 --2- 172.21.15.133:0/1058918422 >> v2:172.21.15.138:3300/0 conn(0x7fa74c072090 0x7fa74c0a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:31.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.117+0000 7fa74a7fc640 1 -- 172.21.15.133:0/1058918422 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040784215 0 0) 0x7fa74c0c2760 con 0x7fa74c0725c0 2023-12-19T19:01:31.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.117+0000 7fa74a7fc640 1 -- 172.21.15.133:0/1058918422 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa734005740 con 0x7fa74c0725c0 2023-12-19T19:01:31.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.117+0000 7fa74b7fe640 1 -- 172.21.15.133:0/1058918422 >> v1:172.21.15.138:6789/0 conn(0x7fa74c0c3bd0 legacy=0x7fa74c150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:31.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.117+0000 7fa74b7fe640 1 -- 172.21.15.133:0/1058918422 >> v1:172.21.15.133:6789/0 conn(0x7fa74c0725c0 legacy=0x7fa74c0c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:31.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.117+0000 7fa74a7fc640 1 -- 172.21.15.133:0/1058918422 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 708069452 0 0) 0x7fa734005740 con 0x7fa74c0725c0 2023-12-19T19:01:31.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.117+0000 7fa74b7fe640 1 -- 172.21.15.133:0/1058918422 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c0ab000 con 0x7fa74c072090 2023-12-19T19:01:31.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.121+0000 7fa74b7fe640 1 --2- 172.21.15.133:0/1058918422 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa74c072090 0x7fa74c0a5370 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0097c0 tx=0x7fa73c01c280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4012639bee7d2a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:31.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.121+0000 7fa74a7fc640 1 -- 172.21.15.133:0/1058918422 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa740001680 con 0x7fa74c072090 2023-12-19T19:01:31.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.121+0000 7fa74a7fc640 1 -- 172.21.15.133:0/1058918422 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c0a7050 con 0x7fa74c072090 2023-12-19T19:01:31.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.121+0000 7fa74a7fc640 1 -- 172.21.15.133:0/1058918422 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0ab620 con 0x7fa74c072090 2023-12-19T19:01:31.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.121+0000 7fa751c9a640 1 -- 172.21.15.133:0/1058918422 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa74c072090 msgr2=0x7fa74c0a5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:31.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.121+0000 7fa751c9a640 1 --2- 172.21.15.133:0/1058918422 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa74c072090 0x7fa74c0a5370 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0097c0 tx=0x7fa73c01c280 comp rx=0 tx=0).stop 2023-12-19T19:01:31.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.121+0000 7fa751c9a640 1 -- 172.21.15.133:0/1058918422 shutdown_connections 2023-12-19T19:01:31.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.121+0000 7fa751c9a640 1 --2- 172.21.15.133:0/1058918422 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa74c072090 0x7fa74c0a5370 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:31.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.121+0000 7fa751c9a640 1 -- 172.21.15.133:0/1058918422 >> 172.21.15.133:0/1058918422 conn(0x7fa74c06a5b0 msgr2=0x7fa74c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:31.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.121+0000 7fa751c9a640 1 -- 172.21.15.133:0/1058918422 shutdown_connections 2023-12-19T19:01:31.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.121+0000 7fa751c9a640 1 -- 172.21.15.133:0/1058918422 wait complete. 2023-12-19T19:01:31.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.121+0000 7fa751c9a640 1 Processor -- start 2023-12-19T19:01:31.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.121+0000 7fa751c9a640 1 -- start start 2023-12-19T19:01:31.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.121+0000 7fa751c9a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa74c072090 0x7fa74c0bf1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:31.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.121+0000 7fa751c9a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa74c0725c0 0x7fa74c0baf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:31.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.121+0000 7fa751c9a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa74c0c3bd0 0x7fa74c14f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:31.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.121+0000 7fa751c9a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c152f50 con 0x7fa74c0c3bd0 2023-12-19T19:01:31.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.121+0000 7fa751c9a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c1e9ce0 con 0x7fa74c0725c0 2023-12-19T19:01:31.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.121+0000 7fa751c9a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c1e9fc0 con 0x7fa74c072090 2023-12-19T19:01:31.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.125+0000 7fa74bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa74c0c3bd0 0x7fa74c14f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:31.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.125+0000 7fa74bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa74c0c3bd0 0x7fa74c14f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51626/0 (socket says 172.21.15.133:51626) 2023-12-19T19:01:31.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.125+0000 7fa74bfff640 1 -- 172.21.15.133:0/3983778999 learned_addr learned my addr 172.21.15.133:0/3983778999 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:31.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.125+0000 7fa74b7fe640 1 --2- 172.21.15.133:0/3983778999 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa74c072090 0x7fa74c0bf1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:31.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.125+0000 7fa74affd640 1 --2- 172.21.15.133:0/3983778999 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa74c0725c0 0x7fa74c0baf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:31.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.125+0000 7fa74bfff640 1 -- 172.21.15.133:0/3983778999 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa74c072090 msgr2=0x7fa74c0bf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:31.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.125+0000 7fa74bfff640 1 --2- 172.21.15.133:0/3983778999 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa74c072090 0x7fa74c0bf1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:31.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.125+0000 7fa74bfff640 1 -- 172.21.15.133:0/3983778999 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa74c0725c0 msgr2=0x7fa74c0baf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:31.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.125+0000 7fa74bfff640 1 --2- 172.21.15.133:0/3983778999 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa74c0725c0 0x7fa74c0baf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:31.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.125+0000 7fa74bfff640 1 -- 172.21.15.133:0/3983778999 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c009420 con 0x7fa74c0c3bd0 2023-12-19T19:01:31.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.125+0000 7fa74affd640 1 --2- 172.21.15.133:0/3983778999 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa74c0725c0 0x7fa74c0baf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:31.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.125+0000 7fa74bfff640 1 --2- 172.21.15.133:0/3983778999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa74c0c3bd0 0x7fa74c14f000 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fa74400c730 tx=0x7fa74400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:31.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.125+0000 7fa733fff640 1 -- 172.21.15.133:0/3983778999 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa744003b80 con 0x7fa74c0c3bd0 2023-12-19T19:01:31.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.125+0000 7fa733fff640 1 -- 172.21.15.133:0/3983778999 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa744003ce0 con 0x7fa74c0c3bd0 2023-12-19T19:01:31.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.125+0000 7fa733fff640 1 -- 172.21.15.133:0/3983778999 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74400aa30 con 0x7fa74c0c3bd0 2023-12-19T19:01:31.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.125+0000 7fa751c9a640 1 -- 172.21.15.133:0/3983778999 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74c1ea2a0 con 0x7fa74c0c3bd0 2023-12-19T19:01:31.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.125+0000 7fa751c9a640 1 -- 172.21.15.133:0/3983778999 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa74c0bb490 con 0x7fa74c0c3bd0 2023-12-19T19:01:31.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.125+0000 7fa751c9a640 1 -- 172.21.15.133:0/3983778999 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa74c1530c0 con 0x7fa74c0c3bd0 2023-12-19T19:01:31.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.125+0000 7fa733fff640 1 -- 172.21.15.133:0/3983778999 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa74400ab90 con 0x7fa74c0c3bd0 2023-12-19T19:01:31.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.125+0000 7fa733fff640 1 --2- 172.21.15.133:0/3983778999 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa738066470 0x7fa738068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:31.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.129+0000 7fa733fff640 1 -- 172.21.15.133:0/3983778999 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa744083a00 con 0x7fa74c0c3bd0 2023-12-19T19:01:31.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.129+0000 7fa74b7fe640 1 --2- 172.21.15.133:0/3983778999 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa738066470 0x7fa738068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:31.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.129+0000 7fa74b7fe640 1 --2- 172.21.15.133:0/3983778999 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa738066470 0x7fa738068930 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0ad000 tx=0x7fa73c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:31.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.133+0000 7fa733fff640 1 -- 172.21.15.133:0/3983778999 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa7440510a0 con 0x7fa74c0c3bd0 2023-12-19T19:01:31.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.333+0000 7fa751c9a640 1 -- 172.21.15.133:0/3983778999 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa74c068400 con 0x7fa74c0c3bd0 2023-12-19T19:01:31.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.333+0000 7fa733fff640 1 -- 172.21.15.133:0/3983778999 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5081 (secure 0 0 0) 0x7fa7440546c0 con 0x7fa74c0c3bd0 2023-12-19T19:01:31.337 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:31.337 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-19T19:01:31.337 INFO:teuthology.orchestra.run.smithi133.stdout: "auth_dump": [ 2023-12-19T19:01:31.337 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:01:31.337 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.a", 2023-12-19T19:01:31.337 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54FlwoplHxAAVjcRzu+wQdwT5Mzra21oYw==", 2023-12-19T19:01:31.337 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:01:31.337 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-19T19:01:31.337 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-19T19:01:31.337 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-19T19:01:31.338 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:01:31.338 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:01:31.338 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:01:31.338 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:01:31.338 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.b", 2023-12-19T19:01:31.338 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54Fl5g/pKxAA/I3R1pRmk8mQOBa4FoGj8g==", 2023-12-19T19:01:31.338 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:01:31.338 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-19T19:01:31.338 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-19T19:01:31.338 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-19T19:01:31.338 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:01:31.338 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:01:31.338 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:01:31.338 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:01:31.338 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.c", 2023-12-19T19:01:31.339 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54FlWEW0JhAAMd5FSzdRUAJgoSga/f0RCw==", 2023-12-19T19:01:31.339 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:01:31.339 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-19T19:01:31.339 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-19T19:01:31.339 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-19T19:01:31.339 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:01:31.339 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:01:31.339 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:01:31.339 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:01:31.339 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mds.d", 2023-12-19T19:01:31.339 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54FllCg0MxAAwWY3wtGD5Om88qWPkpzVhw==", 2023-12-19T19:01:31.339 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:01:31.339 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-19T19:01:31.339 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-19T19:01:31.339 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-19T19:01:31.339 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:01:31.339 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:01:31.339 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:01:31.340 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:01:31.340 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.0", 2023-12-19T19:01:31.340 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCr54FlMNpECRAAMTwNBHtXhYqqZ2BjCRh9MQ==", 2023-12-19T19:01:31.340 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:01:31.340 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T19:01:31.340 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T19:01:31.340 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:01:31.340 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:01:31.340 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:01:31.340 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:01:31.340 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.1", 2023-12-19T19:01:31.340 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCu54FlebMLERAADuy4l18uDpuzQTlHxpa6vg==", 2023-12-19T19:01:31.340 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:01:31.340 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T19:01:31.340 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T19:01:31.340 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:01:31.341 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:01:31.341 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:01:31.341 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:01:31.341 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.2", 2023-12-19T19:01:31.341 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCx54FlIGE0FxAAH1d5WYGkA6lc9/1uQ08+vw==", 2023-12-19T19:01:31.341 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:01:31.341 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T19:01:31.341 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T19:01:31.341 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:01:31.341 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:01:31.341 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:01:31.341 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:01:31.341 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.3", 2023-12-19T19:01:31.341 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQC054Fl6lBFHhAAezVECb7AsJH7i7o805mKYA==", 2023-12-19T19:01:31.341 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:01:31.341 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T19:01:31.342 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T19:01:31.342 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:01:31.342 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:01:31.342 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:01:31.342 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:01:31.342 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.4", 2023-12-19T19:01:31.342 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQC654Fl2Hw1JBAAFb/W356pK2UkqTbL3k+rgg==", 2023-12-19T19:01:31.342 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:01:31.342 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T19:01:31.342 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T19:01:31.342 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:01:31.342 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:01:31.342 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:01:31.343 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:01:31.343 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.5", 2023-12-19T19:01:31.343 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQC954FlDNTYKxAAOdTpUouNeNyeKWV4rSkfHA==", 2023-12-19T19:01:31.343 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:01:31.343 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T19:01:31.343 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T19:01:31.343 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:01:31.343 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:01:31.343 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:01:31.343 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:01:31.343 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.6", 2023-12-19T19:01:31.343 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDA54Fl8V0WMhAAurXUfZDjwkFUcN0/0AvCRA==", 2023-12-19T19:01:31.343 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:01:31.343 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T19:01:31.343 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T19:01:31.343 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:01:31.344 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:01:31.344 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:01:31.344 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:01:31.344 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "osd.7", 2023-12-19T19:01:31.344 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQDD54FlLS76ORAAjLklJxdnUAoGK7D7NMOuQA==", 2023-12-19T19:01:31.344 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:01:31.344 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow profile osd", 2023-12-19T19:01:31.344 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile osd", 2023-12-19T19:01:31.344 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:01:31.344 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:01:31.344 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:01:31.344 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:01:31.344 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.0", 2023-12-19T19:01:31.344 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54FllfQwNxAAyKIESQDxKvDHfaewx+v88w==", 2023-12-19T19:01:31.344 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:01:31.345 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-19T19:01:31.345 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2023-12-19T19:01:31.345 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T19:01:31.345 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:01:31.345 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:01:31.345 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:01:31.345 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.1", 2023-12-19T19:01:31.345 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54Fl4bbAOhAA4WXKbT5uizIcy0OTOKIaag==", 2023-12-19T19:01:31.345 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:01:31.345 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow", 2023-12-19T19:01:31.345 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow r", 2023-12-19T19:01:31.345 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw pool=cephfs2_data" 2023-12-19T19:01:31.345 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:01:31.346 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:01:31.346 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:01:31.346 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.admin", 2023-12-19T19:01:31.346 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54FlrcDgAhAARPWdoItsNLlu+aiRPCG6Tg==", 2023-12-19T19:01:31.346 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:01:31.346 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-19T19:01:31.346 INFO:teuthology.orchestra.run.smithi133.stdout: "mgr": "allow *", 2023-12-19T19:01:31.346 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow *", 2023-12-19T19:01:31.346 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:01:31.346 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:01:31.346 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:01:31.346 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:01:31.346 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "client.testuser", 2023-12-19T19:01:31.346 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQBq6IFlpct9HBAAVlWsnsW19o1QudHAjzvr7w==", 2023-12-19T19:01:31.346 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:01:31.347 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow rw fsname=cephfs", 2023-12-19T19:01:31.347 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow rw fsname=cephfs, allow rw fsname=cephfs2", 2023-12-19T19:01:31.347 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2023-12-19T19:01:31.347 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:01:31.347 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:01:31.347 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:01:31.347 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.x", 2023-12-19T19:01:31.347 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54FlEyVGGxAAleA1zB0F6jgR7QOYMr55Bg==", 2023-12-19T19:01:31.347 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:01:31.347 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-19T19:01:31.347 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2023-12-19T19:01:31.347 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:01:31.347 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:01:31.347 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:01:31.347 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:01:31.348 INFO:teuthology.orchestra.run.smithi133.stdout: "entity": "mgr.y", 2023-12-19T19:01:31.348 INFO:teuthology.orchestra.run.smithi133.stdout: "key": "AQCn54Fl9H5OFxAARCZdZbwW/Mw/x2X1zAvzqg==", 2023-12-19T19:01:31.348 INFO:teuthology.orchestra.run.smithi133.stdout: "caps": { 2023-12-19T19:01:31.348 INFO:teuthology.orchestra.run.smithi133.stdout: "mds": "allow *", 2023-12-19T19:01:31.348 INFO:teuthology.orchestra.run.smithi133.stdout: "mon": "allow profile mgr", 2023-12-19T19:01:31.348 INFO:teuthology.orchestra.run.smithi133.stdout: "osd": "allow *" 2023-12-19T19:01:31.348 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:01:31.348 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:01:31.348 INFO:teuthology.orchestra.run.smithi133.stdout: ] 2023-12-19T19:01:31.348 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-19T19:01:31.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.333+0000 7fa751c9a640 1 -- 172.21.15.133:0/3983778999 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa738066470 msgr2=0x7fa738068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:31.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.333+0000 7fa751c9a640 1 --2- 172.21.15.133:0/3983778999 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa738066470 0x7fa738068930 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0ad000 tx=0x7fa73c008040 comp rx=0 tx=0).stop 2023-12-19T19:01:31.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.333+0000 7fa751c9a640 1 -- 172.21.15.133:0/3983778999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa74c0c3bd0 msgr2=0x7fa74c14f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:31.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.333+0000 7fa751c9a640 1 --2- 172.21.15.133:0/3983778999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa74c0c3bd0 0x7fa74c14f000 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fa74400c730 tx=0x7fa74400cbf0 comp rx=0 tx=0).stop 2023-12-19T19:01:31.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.333+0000 7fa751c9a640 1 -- 172.21.15.133:0/3983778999 shutdown_connections 2023-12-19T19:01:31.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.333+0000 7fa751c9a640 1 --2- 172.21.15.133:0/3983778999 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa738066470 0x7fa738068930 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:31.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.333+0000 7fa751c9a640 1 --2- 172.21.15.133:0/3983778999 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa74c0c3bd0 0x7fa74c14f000 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:31.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.333+0000 7fa751c9a640 1 --2- 172.21.15.133:0/3983778999 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa74c0725c0 0x7fa74c0baf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:31.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.333+0000 7fa751c9a640 1 --2- 172.21.15.133:0/3983778999 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa74c072090 0x7fa74c0bf1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:31.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.333+0000 7fa751c9a640 1 -- 172.21.15.133:0/3983778999 >> 172.21.15.133:0/3983778999 conn(0x7fa74c06a5b0 msgr2=0x7fa74c0a8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:31.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.333+0000 7fa751c9a640 1 -- 172.21.15.133:0/3983778999 shutdown_connections 2023-12-19T19:01:31.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.333+0000 7fa751c9a640 1 -- 172.21.15.133:0/3983778999 wait complete. 2023-12-19T19:01:31.358 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2023-12-19T19:01:31.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.493+0000 7ff7810fe640 1 Processor -- start 2023-12-19T19:01:31.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.493+0000 7ff7810fe640 1 -- start start 2023-12-19T19:01:31.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.493+0000 7ff7810fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff77c072090 0x7ff77c150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:31.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.493+0000 7ff7810fe640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77c0c2760 con 0x7ff77c0725c0 2023-12-19T19:01:31.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.493+0000 7ff7810fe640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff77c0a5750 con 0x7ff77c0a5370 2023-12-19T19:01:31.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.493+0000 7ff7810fe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c0c3070 con 0x7ff77c072090 2023-12-19T19:01:31.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.493+0000 7ff77b59e640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff77c0725c0 0x7ff77c1514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43126/0 (socket says 172.21.15.133:43126) 2023-12-19T19:01:31.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.493+0000 7ff77b59e640 1 -- 172.21.15.133:0/421394212 learned_addr learned my addr 172.21.15.133:0/421394212 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:31.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.493+0000 7ff77259c640 1 --2- 172.21.15.133:0/421394212 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff77c072090 0x7ff77c150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:31.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.493+0000 7ff77a59c640 1 -- 172.21.15.133:0/421394212 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2362829057 0 0) 0x7ff77c0c2760 con 0x7ff77c0725c0 2023-12-19T19:01:31.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.493+0000 7ff77a59c640 1 -- 172.21.15.133:0/421394212 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff768003450 con 0x7ff77c0725c0 2023-12-19T19:01:31.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.497+0000 7ff77a59c640 1 -- 172.21.15.133:0/421394212 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1331774038 0 0) 0x7ff77c0a5750 con 0x7ff77c0a5370 2023-12-19T19:01:31.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.497+0000 7ff77a59c640 1 -- 172.21.15.133:0/421394212 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff77c0c2760 con 0x7ff77c0a5370 2023-12-19T19:01:31.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.497+0000 7ff77a59c640 1 -- 172.21.15.133:0/421394212 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3380042335 0 0) 0x7ff768003450 con 0x7ff77c0725c0 2023-12-19T19:01:31.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.497+0000 7ff77259c640 1 -- 172.21.15.133:0/421394212 >> v1:172.21.15.138:6789/0 conn(0x7ff77c0a5370 legacy=0x7ff77c0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:31.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.497+0000 7ff77259c640 1 -- 172.21.15.133:0/421394212 >> v1:172.21.15.133:6789/0 conn(0x7ff77c0725c0 legacy=0x7ff77c1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:31.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.497+0000 7ff77259c640 1 -- 172.21.15.133:0/421394212 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77c0aad20 con 0x7ff77c072090 2023-12-19T19:01:31.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.497+0000 7ff77259c640 1 --2- 172.21.15.133:0/421394212 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff77c072090 0x7ff77c150fa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff7640097f0 tx=0x7ff76401c2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da82e7622641ba9a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:31.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.497+0000 7ff77a59c640 1 -- 172.21.15.133:0/421394212 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774001a00 con 0x7ff77c072090 2023-12-19T19:01:31.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.497+0000 7ff77a59c640 1 -- 172.21.15.133:0/421394212 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7640a7050 con 0x7ff77c072090 2023-12-19T19:01:31.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.497+0000 7ff77a59c640 1 -- 172.21.15.133:0/421394212 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7640ab620 con 0x7ff77c072090 2023-12-19T19:01:31.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.497+0000 7ff7810fe640 1 -- 172.21.15.133:0/421394212 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff77c072090 msgr2=0x7ff77c150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:31.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.497+0000 7ff7810fe640 1 --2- 172.21.15.133:0/421394212 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff77c072090 0x7ff77c150fa0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff7640097f0 tx=0x7ff76401c2c0 comp rx=0 tx=0).stop 2023-12-19T19:01:31.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff7810fe640 1 -- 172.21.15.133:0/421394212 shutdown_connections 2023-12-19T19:01:31.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff7810fe640 1 --2- 172.21.15.133:0/421394212 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff77c072090 0x7ff77c150fa0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:31.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff7810fe640 1 -- 172.21.15.133:0/421394212 >> 172.21.15.133:0/421394212 conn(0x7ff77c06a5b0 msgr2=0x7ff77c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:31.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff7810fe640 1 -- 172.21.15.133:0/421394212 shutdown_connections 2023-12-19T19:01:31.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff7810fe640 1 -- 172.21.15.133:0/421394212 wait complete. 2023-12-19T19:01:31.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff7810fe640 1 Processor -- start 2023-12-19T19:01:31.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff7810fe640 1 -- start start 2023-12-19T19:01:31.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff7810fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff77c072090 0x7ff77c15af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:31.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff7810fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff77c0725c0 0x7ff77c14f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:31.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff7810fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff77c0a5370 0x7ff77c1f0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:31.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff7810fe640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c155170 con 0x7ff77c0a5370 2023-12-19T19:01:31.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff7810fe640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c153800 con 0x7ff77c0725c0 2023-12-19T19:01:31.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff7810fe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77c150bf0 con 0x7ff77c072090 2023-12-19T19:01:31.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff77b59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff77c0a5370 0x7ff77c1f0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:31.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff77b59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff77c0a5370 0x7ff77c1f0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51630/0 (socket says 172.21.15.133:51630) 2023-12-19T19:01:31.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff77b59e640 1 -- 172.21.15.133:0/2659734651 learned_addr learned my addr 172.21.15.133:0/2659734651 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:31.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff77ad9d640 1 --2- 172.21.15.133:0/2659734651 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff77c072090 0x7ff77c15af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:31.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff77259c640 1 --2- 172.21.15.133:0/2659734651 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff77c0725c0 0x7ff77c14f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:31.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff77b59e640 1 -- 172.21.15.133:0/2659734651 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff77c072090 msgr2=0x7ff77c15af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:31.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff77b59e640 1 --2- 172.21.15.133:0/2659734651 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff77c072090 0x7ff77c15af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:31.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff77b59e640 1 -- 172.21.15.133:0/2659734651 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff77c0725c0 msgr2=0x7ff77c14f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:31.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff77b59e640 1 --2- 172.21.15.133:0/2659734651 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff77c0725c0 0x7ff77c14f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:31.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff77b59e640 1 -- 172.21.15.133:0/2659734651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff764009420 con 0x7ff77c0a5370 2023-12-19T19:01:31.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.501+0000 7ff77b59e640 1 --2- 172.21.15.133:0/2659734651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff77c0a5370 0x7ff77c1f0b30 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7ff774002010 tx=0x7ff77400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:31.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.505+0000 7ff773fff640 1 -- 172.21.15.133:0/2659734651 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774012400 con 0x7ff77c0a5370 2023-12-19T19:01:31.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.505+0000 7ff773fff640 1 -- 172.21.15.133:0/2659734651 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff774012580 con 0x7ff77c0a5370 2023-12-19T19:01:31.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.505+0000 7ff773fff640 1 -- 172.21.15.133:0/2659734651 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff774012970 con 0x7ff77c0a5370 2023-12-19T19:01:31.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.505+0000 7ff7810fe640 1 -- 172.21.15.133:0/2659734651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77c150630 con 0x7ff77c0a5370 2023-12-19T19:01:31.508 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.505+0000 7ff7810fe640 1 -- 172.21.15.133:0/2659734651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77c154ab0 con 0x7ff77c0a5370 2023-12-19T19:01:31.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.505+0000 7ff7810fe640 1 -- 172.21.15.133:0/2659734651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff77c1548f0 con 0x7ff77c0a5370 2023-12-19T19:01:31.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.505+0000 7ff773fff640 1 -- 172.21.15.133:0/2659734651 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff774012ad0 con 0x7ff77c0a5370 2023-12-19T19:01:31.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.505+0000 7ff773fff640 1 --2- 172.21.15.133:0/2659734651 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff75c066470 0x7ff75c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:31.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.505+0000 7ff773fff640 1 -- 172.21.15.133:0/2659734651 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff774084130 con 0x7ff77c0a5370 2023-12-19T19:01:31.510 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.505+0000 7ff77ad9d640 1 --2- 172.21.15.133:0/2659734651 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff75c066470 0x7ff75c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:31.511 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.509+0000 7ff77ad9d640 1 --2- 172.21.15.133:0/2659734651 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff75c066470 0x7ff75c068930 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0011f0 tx=0x7ff76c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:31.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.509+0000 7ff773fff640 1 -- 172.21.15.133:0/2659734651 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff774051a40 con 0x7ff77c0a5370 2023-12-19T19:01:31.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.713+0000 7ff7810fe640 1 -- 172.21.15.133:0/2659734651 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7ff77c068400 con 0x7ff77c0a5370 2023-12-19T19:01:31.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.713+0000 7ff773fff640 1 -- 172.21.15.133:0/2659734651 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v18) v1 ==== 85+0+0 (secure 0 0 0) 0x7ff774055060 con 0x7ff77c0a5370 2023-12-19T19:01:31.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.717+0000 7ff7810fe640 1 -- 172.21.15.133:0/2659734651 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff75c066470 msgr2=0x7ff75c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:31.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.717+0000 7ff7810fe640 1 --2- 172.21.15.133:0/2659734651 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff75c066470 0x7ff75c068930 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0011f0 tx=0x7ff76c009040 comp rx=0 tx=0).stop 2023-12-19T19:01:31.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.717+0000 7ff7810fe640 1 -- 172.21.15.133:0/2659734651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff77c0a5370 msgr2=0x7ff77c1f0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:31.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.717+0000 7ff7810fe640 1 --2- 172.21.15.133:0/2659734651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff77c0a5370 0x7ff77c1f0b30 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7ff774002010 tx=0x7ff77400a430 comp rx=0 tx=0).stop 2023-12-19T19:01:31.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.717+0000 7ff7810fe640 1 -- 172.21.15.133:0/2659734651 shutdown_connections 2023-12-19T19:01:31.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.717+0000 7ff7810fe640 1 --2- 172.21.15.133:0/2659734651 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff75c066470 0x7ff75c068930 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:31.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.717+0000 7ff7810fe640 1 --2- 172.21.15.133:0/2659734651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff77c0a5370 0x7ff77c1f0b30 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:31.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.717+0000 7ff7810fe640 1 --2- 172.21.15.133:0/2659734651 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff77c0725c0 0x7ff77c14f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:31.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.717+0000 7ff7810fe640 1 --2- 172.21.15.133:0/2659734651 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff77c072090 0x7ff77c15af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:31.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.717+0000 7ff7810fe640 1 -- 172.21.15.133:0/2659734651 >> 172.21.15.133:0/2659734651 conn(0x7ff77c06a5b0 msgr2=0x7ff77c0c0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:31.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.717+0000 7ff7810fe640 1 -- 172.21.15.133:0/2659734651 shutdown_connections 2023-12-19T19:01:31.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.717+0000 7ff7810fe640 1 -- 172.21.15.133:0/2659734651 wait complete. 2023-12-19T19:01:31.740 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:01:31.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.873+0000 7fecdae32640 1 Processor -- start 2023-12-19T19:01:31.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.873+0000 7fecdae32640 1 -- start start 2023-12-19T19:01:31.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.873+0000 7fecdae32640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fecd40a5370 0x7fecd40c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:31.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.873+0000 7fecdae32640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecd40c4110 0x7fecd4150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:31.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.873+0000 7fecdae32640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd40c2760 con 0x7fecd4072090 2023-12-19T19:01:31.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.873+0000 7fecdae32640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd40c3070 con 0x7fecd40a5370 2023-12-19T19:01:31.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.873+0000 7fecdae32640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd4151bf0 con 0x7fecd40c4110 2023-12-19T19:01:31.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.873+0000 7fecd93cf640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fecd4072090 0x7fecd41514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43136/0 (socket says 172.21.15.133:43136) 2023-12-19T19:01:31.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.873+0000 7fecd8bce640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fecd40a5370 0x7fecd40c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:31.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.873+0000 7fecd93cf640 1 -- 172.21.15.133:0/566532873 learned_addr learned my addr 172.21.15.133:0/566532873 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:31.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.877+0000 7fecd3fff640 1 --2- 172.21.15.133:0/566532873 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecd40c4110 0x7fecd4150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:31.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.877+0000 7fecd8bce640 1 -- 172.21.15.133:0/566532873 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecd40c4110 msgr2=0x7fecd4150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:31.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.877+0000 7fecd8bce640 1 --2- 172.21.15.133:0/566532873 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecd40c4110 0x7fecd4150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:31.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.877+0000 7fecd8bce640 1 -- 172.21.15.133:0/566532873 >> v1:172.21.15.133:6789/0 conn(0x7fecd4072090 legacy=0x7fecd41514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:31.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.877+0000 7fecd8bce640 1 -- 172.21.15.133:0/566532873 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd40a5750 con 0x7fecd40a5370 2023-12-19T19:01:31.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.877+0000 7fecd37fe640 1 -- 172.21.15.133:0/566532873 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1624166797 0 0) 0x7fecd40c2760 con 0x7fecd4072090 2023-12-19T19:01:31.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.877+0000 7fecd8bce640 1 --2- 172.21.15.133:0/566532873 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecd40a5370 0x7fecd40c3bd0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fecc80097f0 tx=0x7fecc801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12836d4b9aeb8ef7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:31.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.877+0000 7fecd37fe640 1 -- 172.21.15.133:0/566532873 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc80ab600 con 0x7fecd40a5370 2023-12-19T19:01:31.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.877+0000 7fecd37fe640 1 -- 172.21.15.133:0/566532873 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc80a7050 con 0x7fecd40a5370 2023-12-19T19:01:31.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.877+0000 7fecd37fe640 1 -- 172.21.15.133:0/566532873 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc80ab980 con 0x7fecd40a5370 2023-12-19T19:01:31.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecdae32640 1 -- 172.21.15.133:0/566532873 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecd40a5370 msgr2=0x7fecd40c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:31.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecdae32640 1 --2- 172.21.15.133:0/566532873 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecd40a5370 0x7fecd40c3bd0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fecc80097f0 tx=0x7fecc801c330 comp rx=0 tx=0).stop 2023-12-19T19:01:31.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecdae32640 1 -- 172.21.15.133:0/566532873 shutdown_connections 2023-12-19T19:01:31.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecdae32640 1 --2- 172.21.15.133:0/566532873 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecd40c4110 0x7fecd4150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:31.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecdae32640 1 --2- 172.21.15.133:0/566532873 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecd40a5370 0x7fecd40c3bd0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:31.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecdae32640 1 -- 172.21.15.133:0/566532873 >> 172.21.15.133:0/566532873 conn(0x7fecd406a5b0 msgr2=0x7fecd406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:31.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecdae32640 1 -- 172.21.15.133:0/566532873 shutdown_connections 2023-12-19T19:01:31.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecdae32640 1 -- 172.21.15.133:0/566532873 wait complete. 2023-12-19T19:01:31.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecdae32640 1 Processor -- start 2023-12-19T19:01:31.885 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecdae32640 1 -- start start 2023-12-19T19:01:31.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecdae32640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecd4072090 0x7fecd414aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:31.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecdae32640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecd40a5370 0x7fecd4145010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:31.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecdae32640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fecd40c4110 0x7fecd4145550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:31.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecdae32640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd41e2d00 con 0x7fecd4072090 2023-12-19T19:01:31.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecdae32640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd41e32c0 con 0x7fecd40c4110 2023-12-19T19:01:31.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecdae32640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd4145a90 con 0x7fecd40a5370 2023-12-19T19:01:31.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecd8bce640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecd4072090 0x7fecd414aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:31.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecd8bce640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecd4072090 0x7fecd414aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51652/0 (socket says 172.21.15.133:51652) 2023-12-19T19:01:31.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecd8bce640 1 -- 172.21.15.133:0/604811979 learned_addr learned my addr 172.21.15.133:0/604811979 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:31.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecd93cf640 1 --2- 172.21.15.133:0/604811979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fecd40c4110 0x7fecd4145550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:31.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecd8bce640 1 -- 172.21.15.133:0/604811979 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecd40a5370 msgr2=0x7fecd4145010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:31.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecd3fff640 1 --2- 172.21.15.133:0/604811979 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecd40a5370 0x7fecd4145010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:31.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecd8bce640 1 --2- 172.21.15.133:0/604811979 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecd40a5370 0x7fecd4145010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:31.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecd8bce640 1 -- 172.21.15.133:0/604811979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fecd40c4110 msgr2=0x7fecd4145550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:31.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecd8bce640 1 --2- 172.21.15.133:0/604811979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fecd40c4110 0x7fecd4145550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:31.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.881+0000 7fecd8bce640 1 -- 172.21.15.133:0/604811979 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc8009420 con 0x7fecd4072090 2023-12-19T19:01:31.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.885+0000 7fecd93cf640 1 --2- 172.21.15.133:0/604811979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fecd40c4110 0x7fecd4145550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:31.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.885+0000 7fecd3fff640 1 --2- 172.21.15.133:0/604811979 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecd40a5370 0x7fecd4145010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:31.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.885+0000 7fecd8bce640 1 --2- 172.21.15.133:0/604811979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecd4072090 0x7fecd414aaa0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fecc8009740 tx=0x7fecc801ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:31.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.885+0000 7fecd17fa640 1 -- 172.21.15.133:0/604811979 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc8006e20 con 0x7fecd4072090 2023-12-19T19:01:31.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.885+0000 7fecd17fa640 1 -- 172.21.15.133:0/604811979 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc8004030 con 0x7fecd4072090 2023-12-19T19:01:31.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.885+0000 7fecd17fa640 1 -- 172.21.15.133:0/604811979 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc80043a0 con 0x7fecd4072090 2023-12-19T19:01:31.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.885+0000 7fecdae32640 1 -- 172.21.15.133:0/604811979 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd41f1080 con 0x7fecd4072090 2023-12-19T19:01:31.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.885+0000 7fecdae32640 1 -- 172.21.15.133:0/604811979 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd41e2f50 con 0x7fecd4072090 2023-12-19T19:01:31.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.885+0000 7fecdae32640 1 -- 172.21.15.133:0/604811979 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd4068400 con 0x7fecd4072090 2023-12-19T19:01:31.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.885+0000 7fecd17fa640 1 -- 172.21.15.133:0/604811979 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fecc8003620 con 0x7fecd4072090 2023-12-19T19:01:31.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.885+0000 7fecd17fa640 1 --2- 172.21.15.133:0/604811979 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fecb80664a0 0x7fecb8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:31.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.885+0000 7fecd17fa640 1 -- 172.21.15.133:0/604811979 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fecc811e260 con 0x7fecd4072090 2023-12-19T19:01:31.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.889+0000 7fecd3fff640 1 --2- 172.21.15.133:0/604811979 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fecb80664a0 0x7fecb8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:31.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.889+0000 7fecd3fff640 1 --2- 172.21.15.133:0/604811979 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fecb80664a0 0x7fecb8068960 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fecd41e2830 tx=0x7fecc0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:31.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:31.889+0000 7fecd17fa640 1 -- 172.21.15.133:0/604811979 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fecc80eba20 con 0x7fecd4072090 2023-12-19T19:01:32.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.041+0000 7fecdae32640 1 -- 172.21.15.133:0/604811979 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecd40c0f80 con 0x7fecd4072090 2023-12-19T19:01:32.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.045+0000 7fecd17fa640 1 -- 172.21.15.133:0/604811979 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+12894 (secure 0 0 0) 0x7fecc80ba090 con 0x7fecd4072090 2023-12-19T19:01:32.047 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:32.047 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":65,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:01:30.943348+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:01:32.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.045+0000 7fecdae32640 1 -- 172.21.15.133:0/604811979 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fecb80664a0 msgr2=0x7fecb8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:32.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.045+0000 7fecdae32640 1 --2- 172.21.15.133:0/604811979 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fecb80664a0 0x7fecb8068960 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fecd41e2830 tx=0x7fecc0008040 comp rx=0 tx=0).stop 2023-12-19T19:01:32.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.045+0000 7fecdae32640 1 -- 172.21.15.133:0/604811979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecd4072090 msgr2=0x7fecd414aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:32.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.045+0000 7fecdae32640 1 --2- 172.21.15.133:0/604811979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecd4072090 0x7fecd414aaa0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fecc8009740 tx=0x7fecc801ab70 comp rx=0 tx=0).stop 2023-12-19T19:01:32.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.045+0000 7fecdae32640 1 -- 172.21.15.133:0/604811979 shutdown_connections 2023-12-19T19:01:32.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.045+0000 7fecdae32640 1 --2- 172.21.15.133:0/604811979 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fecb80664a0 0x7fecb8068960 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.045+0000 7fecdae32640 1 --2- 172.21.15.133:0/604811979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fecd40c4110 0x7fecd4145550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.045+0000 7fecdae32640 1 --2- 172.21.15.133:0/604811979 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fecd40a5370 0x7fecd4145010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.045+0000 7fecdae32640 1 --2- 172.21.15.133:0/604811979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecd4072090 0x7fecd414aaa0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.045+0000 7fecdae32640 1 -- 172.21.15.133:0/604811979 >> 172.21.15.133:0/604811979 conn(0x7fecd406a5b0 msgr2=0x7fecd4150fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:32.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.045+0000 7fecdae32640 1 -- 172.21.15.133:0/604811979 shutdown_connections 2023-12-19T19:01:32.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.045+0000 7fecdae32640 1 -- 172.21.15.133:0/604811979 wait complete. 2023-12-19T19:01:32.068 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T19:01:32.069 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T19:01:32.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.205+0000 7fd103279640 1 Processor -- start 2023-12-19T19:01:32.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.205+0000 7fd103279640 1 -- start start 2023-12-19T19:01:32.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.205+0000 7fd103279640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd0fc0c63c0 0x7fd0fc0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:32.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.205+0000 7fd103279640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0fc0c31c0 con 0x7fd0fc0c2bb0 2023-12-19T19:01:32.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.205+0000 7fd103279640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0fc0c34a0 con 0x7fd0fc0c4100 2023-12-19T19:01:32.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.205+0000 7fd103279640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0fc0c1030 con 0x7fd0fc0c63c0 2023-12-19T19:01:32.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.205+0000 7fd101816640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd0fc0c2bb0 0x7fd0fc0a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43140/0 (socket says 172.21.15.133:43140) 2023-12-19T19:01:32.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.205+0000 7fd101816640 1 -- 172.21.15.133:0/58631185 learned_addr learned my addr 172.21.15.133:0/58631185 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:32.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.205+0000 7fd101015640 1 --2- 172.21.15.133:0/58631185 >> v2:172.21.15.138:3300/0 conn(0x7fd0fc0c63c0 0x7fd0fc0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:32.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.209+0000 7fd0f3fff640 1 -- 172.21.15.133:0/58631185 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2426466451 0 0) 0x7fd0fc0c31c0 con 0x7fd0fc0c2bb0 2023-12-19T19:01:32.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.209+0000 7fd0f3fff640 1 -- 172.21.15.133:0/58631185 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0e8003530 con 0x7fd0fc0c2bb0 2023-12-19T19:01:32.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.209+0000 7fd0f3fff640 1 -- 172.21.15.133:0/58631185 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934467286 0 0) 0x7fd0fc0c34a0 con 0x7fd0fc0c4100 2023-12-19T19:01:32.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.209+0000 7fd0f3fff640 1 -- 172.21.15.133:0/58631185 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0fc0c31c0 con 0x7fd0fc0c4100 2023-12-19T19:01:32.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.209+0000 7fd101015640 1 -- 172.21.15.133:0/58631185 >> v1:172.21.15.138:6789/0 conn(0x7fd0fc0c4100 legacy=0x7fd0fc0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:32.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.209+0000 7fd101015640 1 -- 172.21.15.133:0/58631185 >> v1:172.21.15.133:6789/0 conn(0x7fd0fc0c2bb0 legacy=0x7fd0fc0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:32.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.209+0000 7fd101015640 1 -- 172.21.15.133:0/58631185 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc0c1310 con 0x7fd0fc0c63c0 2023-12-19T19:01:32.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.209+0000 7fd101015640 1 --2- 172.21.15.133:0/58631185 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0fc0c63c0 0x7fd0fc0c06d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd0f80097c0 tx=0x7fd0f801c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1414c756700338c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:32.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.209+0000 7fd0f3fff640 1 -- 172.21.15.133:0/58631185 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f80ad680 con 0x7fd0fc0c63c0 2023-12-19T19:01:32.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.209+0000 7fd0f3fff640 1 -- 172.21.15.133:0/58631185 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f80ad7e0 con 0x7fd0fc0c63c0 2023-12-19T19:01:32.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.209+0000 7fd0f3fff640 1 -- 172.21.15.133:0/58631185 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f80adb70 con 0x7fd0fc0c63c0 2023-12-19T19:01:32.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd103279640 1 -- 172.21.15.133:0/58631185 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0fc0c63c0 msgr2=0x7fd0fc0c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:32.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd103279640 1 --2- 172.21.15.133:0/58631185 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0fc0c63c0 0x7fd0fc0c06d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd0f80097c0 tx=0x7fd0f801c360 comp rx=0 tx=0).stop 2023-12-19T19:01:32.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd103279640 1 -- 172.21.15.133:0/58631185 shutdown_connections 2023-12-19T19:01:32.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd103279640 1 --2- 172.21.15.133:0/58631185 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0fc0c63c0 0x7fd0fc0c06d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd103279640 1 -- 172.21.15.133:0/58631185 >> 172.21.15.133:0/58631185 conn(0x7fd0fc06a5b0 msgr2=0x7fd0fc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:32.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd103279640 1 -- 172.21.15.133:0/58631185 shutdown_connections 2023-12-19T19:01:32.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd103279640 1 -- 172.21.15.133:0/58631185 wait complete. 2023-12-19T19:01:32.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd103279640 1 Processor -- start 2023-12-19T19:01:32.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd103279640 1 -- start start 2023-12-19T19:01:32.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd103279640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0fc0c2bb0 0x7fd0fc0c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:32.219 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd103279640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0fc0c4100 0x7fd0fc156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:32.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd103279640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0fc0c63c0 0x7fd0fc156870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:32.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd103279640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc1ed7e0 con 0x7fd0fc0c2bb0 2023-12-19T19:01:32.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd103279640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc1edac0 con 0x7fd0fc0c4100 2023-12-19T19:01:32.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd103279640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc1edda0 con 0x7fd0fc0c63c0 2023-12-19T19:01:32.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd101015640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0fc0c2bb0 0x7fd0fc0c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:32.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd101015640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0fc0c2bb0 0x7fd0fc0c5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51668/0 (socket says 172.21.15.133:51668) 2023-12-19T19:01:32.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd101015640 1 -- 172.21.15.133:0/1405689096 learned_addr learned my addr 172.21.15.133:0/1405689096 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:32.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd100814640 1 --2- 172.21.15.133:0/1405689096 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0fc0c4100 0x7fd0fc156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:32.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd101015640 1 -- 172.21.15.133:0/1405689096 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0fc0c63c0 msgr2=0x7fd0fc156870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:32.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd101816640 1 --2- 172.21.15.133:0/1405689096 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0fc0c63c0 0x7fd0fc156870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:32.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd101015640 1 --2- 172.21.15.133:0/1405689096 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0fc0c63c0 0x7fd0fc156870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd101015640 1 -- 172.21.15.133:0/1405689096 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0fc0c4100 msgr2=0x7fd0fc156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:32.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd101015640 1 --2- 172.21.15.133:0/1405689096 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0fc0c4100 0x7fd0fc156330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd101015640 1 -- 172.21.15.133:0/1405689096 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f8009420 con 0x7fd0fc0c2bb0 2023-12-19T19:01:32.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd100814640 1 --2- 172.21.15.133:0/1405689096 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0fc0c4100 0x7fd0fc156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:32.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.213+0000 7fd101816640 1 --2- 172.21.15.133:0/1405689096 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0fc0c63c0 0x7fd0fc156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:32.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.217+0000 7fd101015640 1 --2- 172.21.15.133:0/1405689096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0fc0c2bb0 0x7fd0fc0c5250 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fd0f80097c0 tx=0x7fd0f801aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:32.221 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.217+0000 7fd0f1ffb640 1 -- 172.21.15.133:0/1405689096 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f80add60 con 0x7fd0fc0c2bb0 2023-12-19T19:01:32.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.217+0000 7fd0f1ffb640 1 -- 172.21.15.133:0/1405689096 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f80b8420 con 0x7fd0fc0c2bb0 2023-12-19T19:01:32.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.217+0000 7fd0f1ffb640 1 -- 172.21.15.133:0/1405689096 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f80b8790 con 0x7fd0fc0c2bb0 2023-12-19T19:01:32.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.217+0000 7fd103279640 1 -- 172.21.15.133:0/1405689096 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0fc0c69b0 con 0x7fd0fc0c2bb0 2023-12-19T19:01:32.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.217+0000 7fd103279640 1 -- 172.21.15.133:0/1405689096 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0fc157fa0 con 0x7fd0fc0c2bb0 2023-12-19T19:01:32.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.217+0000 7fd103279640 1 -- 172.21.15.133:0/1405689096 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0fc068400 con 0x7fd0fc0c2bb0 2023-12-19T19:01:32.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.217+0000 7fd0f1ffb640 1 -- 172.21.15.133:0/1405689096 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd0f80b4040 con 0x7fd0fc0c2bb0 2023-12-19T19:01:32.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.217+0000 7fd0f1ffb640 1 --2- 172.21.15.133:0/1405689096 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd0e0066470 0x7fd0e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:32.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.217+0000 7fd0f1ffb640 1 -- 172.21.15.133:0/1405689096 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd0f811dd80 con 0x7fd0fc0c2bb0 2023-12-19T19:01:32.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.221+0000 7fd100814640 1 --2- 172.21.15.133:0/1405689096 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd0e0066470 0x7fd0e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:32.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.221+0000 7fd100814640 1 --2- 172.21.15.133:0/1405689096 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd0e0066470 0x7fd0e0068930 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc06ad50 tx=0x7fd0ec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:32.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.221+0000 7fd0f1ffb640 1 -- 172.21.15.133:0/1405689096 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd0f80eb690 con 0x7fd0fc0c2bb0 2023-12-19T19:01:32.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.373+0000 7fd103279640 1 -- 172.21.15.133:0/1405689096 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd0fc0c3e70 con 0x7fd0fc0c2bb0 2023-12-19T19:01:32.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.373+0000 7fd0f1ffb640 1 -- 172.21.15.133:0/1405689096 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd0f80eecb0 con 0x7fd0fc0c2bb0 2023-12-19T19:01:32.376 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T19:01:32.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.373+0000 7fd103279640 1 -- 172.21.15.133:0/1405689096 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd0e0066470 msgr2=0x7fd0e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:32.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.373+0000 7fd103279640 1 --2- 172.21.15.133:0/1405689096 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd0e0066470 0x7fd0e0068930 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc06ad50 tx=0x7fd0ec009040 comp rx=0 tx=0).stop 2023-12-19T19:01:32.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.373+0000 7fd103279640 1 -- 172.21.15.133:0/1405689096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0fc0c2bb0 msgr2=0x7fd0fc0c5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:32.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.373+0000 7fd103279640 1 --2- 172.21.15.133:0/1405689096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0fc0c2bb0 0x7fd0fc0c5250 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fd0f80097c0 tx=0x7fd0f801aba0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.373+0000 7fd103279640 1 -- 172.21.15.133:0/1405689096 shutdown_connections 2023-12-19T19:01:32.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.373+0000 7fd103279640 1 --2- 172.21.15.133:0/1405689096 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd0e0066470 0x7fd0e0068930 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.373+0000 7fd103279640 1 --2- 172.21.15.133:0/1405689096 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0fc0c63c0 0x7fd0fc156870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.373+0000 7fd103279640 1 --2- 172.21.15.133:0/1405689096 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0fc0c4100 0x7fd0fc156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.373+0000 7fd103279640 1 --2- 172.21.15.133:0/1405689096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0fc0c2bb0 0x7fd0fc0c5250 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.373+0000 7fd103279640 1 -- 172.21.15.133:0/1405689096 >> 172.21.15.133:0/1405689096 conn(0x7fd0fc06a5b0 msgr2=0x7fd0fc0a6890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:32.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.373+0000 7fd103279640 1 -- 172.21.15.133:0/1405689096 shutdown_connections 2023-12-19T19:01:32.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.373+0000 7fd103279640 1 -- 172.21.15.133:0/1405689096 wait complete. 2023-12-19T19:01:32.398 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T19:01:32.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4aa4d6640 1 Processor -- start 2023-12-19T19:01:32.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4aa4d6640 1 -- start start 2023-12-19T19:01:32.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4aa4d6640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff4a406bbb0 0x7ff4a41600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:32.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4aa4d6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a406c860 con 0x7ff4a4151e90 2023-12-19T19:01:32.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4aa4d6640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4a406c000 con 0x7ff4a40c7ea0 2023-12-19T19:01:32.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4aa4d6640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4a40c8750 con 0x7ff4a406bbb0 2023-12-19T19:01:32.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4a3fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff4a4151e90 0x7ff4a40c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43154/0 (socket says 172.21.15.133:43154) 2023-12-19T19:01:32.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4a3fff640 1 -- 172.21.15.133:0/3671277836 learned_addr learned my addr 172.21.15.133:0/3671277836 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:32.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4a8a73640 1 --2- 172.21.15.133:0/3671277836 >> v2:172.21.15.138:3300/0 conn(0x7ff4a406bbb0 0x7ff4a41600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:32.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4a2ffd640 1 -- 172.21.15.133:0/3671277836 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328144760 0 0) 0x7ff4a406c860 con 0x7ff4a4151e90 2023-12-19T19:01:32.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4a2ffd640 1 -- 172.21.15.133:0/3671277836 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff48c003530 con 0x7ff4a4151e90 2023-12-19T19:01:32.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4a2ffd640 1 -- 172.21.15.133:0/3671277836 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 112993335 0 0) 0x7ff48c003530 con 0x7ff4a4151e90 2023-12-19T19:01:32.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4a2ffd640 1 -- 172.21.15.133:0/3671277836 >> v2:172.21.15.138:3300/0 conn(0x7ff4a406bbb0 msgr2=0x7ff4a41600b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:32.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4a2ffd640 1 --2- 172.21.15.133:0/3671277836 >> v2:172.21.15.138:3300/0 conn(0x7ff4a406bbb0 0x7ff4a41600b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4a2ffd640 1 -- 172.21.15.133:0/3671277836 >> v1:172.21.15.138:6789/0 conn(0x7ff4a40c7ea0 legacy=0x7ff4a406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:32.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4a2ffd640 1 -- 172.21.15.133:0/3671277836 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a4154930 con 0x7ff4a4151e90 2023-12-19T19:01:32.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4a2ffd640 1 -- 172.21.15.133:0/3671277836 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7ff494001680 con 0x7ff4a4151e90 2023-12-19T19:01:32.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4a2ffd640 1 -- 172.21.15.133:0/3671277836 >> v1:172.21.15.133:6789/0 conn(0x7ff4a4151e90 legacy=0x7ff4a40c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:32.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4a2ffd640 1 --2- 172.21.15.133:0/3671277836 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff48c003980 0x7ff48c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:32.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4a2ffd640 1 --2- 172.21.15.133:0/3671277836 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff48c0047d0 0x7ff48c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:32.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4a2ffd640 1 --2- 172.21.15.133:0/3671277836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff48c0052b0 0x7ff48c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:32.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4a2ffd640 1 -- 172.21.15.133:0/3671277836 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a40c8750 con 0x7ff48c0052b0 2023-12-19T19:01:32.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4a2ffd640 1 -- 172.21.15.133:0/3671277836 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c00c180 con 0x7ff48c0047d0 2023-12-19T19:01:32.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4a2ffd640 1 -- 172.21.15.133:0/3671277836 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48c00c340 con 0x7ff48c003980 2023-12-19T19:01:32.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4a8a73640 1 --2- 172.21.15.133:0/3671277836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff48c0052b0 0x7ff48c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:32.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4a3fff640 1 --2- 172.21.15.133:0/3671277836 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff48c003980 0x7ff48c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:32.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.533+0000 7ff4a37fe640 1 --2- 172.21.15.133:0/3671277836 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff48c0047d0 0x7ff48c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:32.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.537+0000 7ff4a8a73640 1 -- 172.21.15.133:0/3671277836 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff48c003980 msgr2=0x7ff48c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:32.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.537+0000 7ff4a8a73640 1 --2- 172.21.15.133:0/3671277836 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff48c003980 0x7ff48c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.537+0000 7ff4a8a73640 1 -- 172.21.15.133:0/3671277836 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff48c0047d0 msgr2=0x7ff48c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:32.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.537+0000 7ff4a8a73640 1 --2- 172.21.15.133:0/3671277836 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff48c0047d0 0x7ff48c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.537+0000 7ff4a8a73640 1 -- 172.21.15.133:0/3671277836 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff48c003530 con 0x7ff48c0052b0 2023-12-19T19:01:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.537+0000 7ff4a8a73640 1 -- 172.21.15.133:0/3671277836 reap_dead start 2023-12-19T19:01:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.537+0000 7ff4a8a73640 1 --2- 172.21.15.133:0/3671277836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff48c0052b0 0x7ff48c00b990 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff49c009f90 tx=0x7ff49c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39de2a1a69c479d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.537+0000 7ff4a2ffd640 1 -- 172.21.15.133:0/3671277836 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c003ba0 con 0x7ff48c0052b0 2023-12-19T19:01:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.537+0000 7ff4a2ffd640 1 -- 172.21.15.133:0/3671277836 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49c00f040 con 0x7ff48c0052b0 2023-12-19T19:01:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.537+0000 7ff4a2ffd640 1 -- 172.21.15.133:0/3671277836 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c0a5850 con 0x7ff48c0052b0 2023-12-19T19:01:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.537+0000 7ff4aa4d6640 1 -- 172.21.15.133:0/3671277836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff48c0052b0 msgr2=0x7ff48c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.537+0000 7ff4aa4d6640 1 --2- 172.21.15.133:0/3671277836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff48c0052b0 0x7ff48c00b990 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7ff49c009f90 tx=0x7ff49c01cc60 comp rx=0 tx=0).stop 2023-12-19T19:01:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.537+0000 7ff4aa4d6640 1 -- 172.21.15.133:0/3671277836 shutdown_connections 2023-12-19T19:01:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.537+0000 7ff4aa4d6640 1 --2- 172.21.15.133:0/3671277836 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff48c0052b0 0x7ff48c00b990 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.537+0000 7ff4aa4d6640 1 -- 172.21.15.133:0/3671277836 >> 172.21.15.133:0/3671277836 conn(0x7ff4a40ca170 msgr2=0x7ff4a40ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:32.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.537+0000 7ff4aa4d6640 1 -- 172.21.15.133:0/3671277836 shutdown_connections 2023-12-19T19:01:32.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.537+0000 7ff4aa4d6640 1 -- 172.21.15.133:0/3671277836 wait complete. 2023-12-19T19:01:32.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4aa4d6640 1 Processor -- start 2023-12-19T19:01:32.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4aa4d6640 1 -- start start 2023-12-19T19:01:32.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4aa4d6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff48c0052b0 0x7ff4a4145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:32.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4aa4d6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a41ee150 0x7ff4a41ef600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:32.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4aa4d6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4a4145c70 0x7ff4a41efb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:32.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4aa4d6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a41552d0 con 0x7ff4a4145c70 2023-12-19T19:01:32.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4aa4d6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a41f0080 con 0x7ff4a41ee150 2023-12-19T19:01:32.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4aa4d6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a41467f0 con 0x7ff48c0052b0 2023-12-19T19:01:32.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4a8a73640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4a4145c70 0x7ff4a41efb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:32.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4a8a73640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4a4145c70 0x7ff4a41efb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51674/0 (socket says 172.21.15.133:51674) 2023-12-19T19:01:32.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4a8a73640 1 -- 172.21.15.133:0/3397772544 learned_addr learned my addr 172.21.15.133:0/3397772544 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:32.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4a3fff640 1 --2- 172.21.15.133:0/3397772544 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff48c0052b0 0x7ff4a4145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:32.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4a37fe640 1 --2- 172.21.15.133:0/3397772544 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a41ee150 0x7ff4a41ef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:32.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4a8a73640 1 -- 172.21.15.133:0/3397772544 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff48c0052b0 msgr2=0x7ff4a4145730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:32.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4a8a73640 1 --2- 172.21.15.133:0/3397772544 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff48c0052b0 0x7ff4a4145730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4a8a73640 1 -- 172.21.15.133:0/3397772544 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a41ee150 msgr2=0x7ff4a41ef600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:32.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4a8a73640 1 --2- 172.21.15.133:0/3397772544 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a41ee150 0x7ff4a41ef600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4a8a73640 1 -- 172.21.15.133:0/3397772544 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a41452a0 con 0x7ff4a4145c70 2023-12-19T19:01:32.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4a37fe640 1 --2- 172.21.15.133:0/3397772544 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a41ee150 0x7ff4a41ef600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:32.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4a3fff640 1 --2- 172.21.15.133:0/3397772544 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff48c0052b0 0x7ff4a4145730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:32.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4a8a73640 1 --2- 172.21.15.133:0/3397772544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4a4145c70 0x7ff4a41efb40 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ff49c01c6d0 tx=0x7ff49c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:32.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4a0ff9640 1 -- 172.21.15.133:0/3397772544 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c0a5a50 con 0x7ff4a4145c70 2023-12-19T19:01:32.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4a0ff9640 1 -- 172.21.15.133:0/3397772544 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff49c0a5bb0 con 0x7ff4a4145c70 2023-12-19T19:01:32.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4aa4d6640 1 -- 172.21.15.133:0/3397772544 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a4147000 con 0x7ff4a4145c70 2023-12-19T19:01:32.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4a0ff9640 1 -- 172.21.15.133:0/3397772544 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff49c004020 con 0x7ff4a4145c70 2023-12-19T19:01:32.549 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.541+0000 7ff4aa4d6640 1 -- 172.21.15.133:0/3397772544 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a4146d20 con 0x7ff4a4145c70 2023-12-19T19:01:32.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.545+0000 7ff4aa4d6640 1 -- 172.21.15.133:0/3397772544 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a4145430 con 0x7ff4a4145c70 2023-12-19T19:01:32.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.545+0000 7ff4a0ff9640 1 -- 172.21.15.133:0/3397772544 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff49c004180 con 0x7ff4a4145c70 2023-12-19T19:01:32.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.545+0000 7ff4a0ff9640 1 --2- 172.21.15.133:0/3397772544 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff490066470 0x7ff490068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:32.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.545+0000 7ff4a0ff9640 1 -- 172.21.15.133:0/3397772544 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff49c11e540 con 0x7ff4a4145c70 2023-12-19T19:01:32.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.545+0000 7ff4a3fff640 1 --2- 172.21.15.133:0/3397772544 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff490066470 0x7ff490068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:32.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.545+0000 7ff4a3fff640 1 --2- 172.21.15.133:0/3397772544 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff490066470 0x7ff490068930 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff494007bb0 tx=0x7ff494009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:32.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.549+0000 7ff4a0ff9640 1 -- 172.21.15.133:0/3397772544 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff49c0ebe20 con 0x7ff4a4145c70 2023-12-19T19:01:32.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.701+0000 7ff4aa4d6640 1 -- 172.21.15.133:0/3397772544 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff4a40c8330 con 0x7ff4a4145c70 2023-12-19T19:01:32.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.701+0000 7ff4a0ff9640 1 -- 172.21.15.133:0/3397772544 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v65) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff49c0ef440 con 0x7ff4a4145c70 2023-12-19T19:01:32.707 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:32.707 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2023-12-19T19:01:32.707 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:01:32.707 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2023-12-19T19:01:32.707 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": ".mgr" 2023-12-19T19:01:32.707 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:01:32.708 INFO:teuthology.orchestra.run.smithi133.stdout:] 2023-12-19T19:01:32.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.705+0000 7ff4aa4d6640 1 -- 172.21.15.133:0/3397772544 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff490066470 msgr2=0x7ff490068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:32.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.705+0000 7ff4aa4d6640 1 --2- 172.21.15.133:0/3397772544 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff490066470 0x7ff490068930 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff494007bb0 tx=0x7ff494009040 comp rx=0 tx=0).stop 2023-12-19T19:01:32.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.705+0000 7ff4aa4d6640 1 -- 172.21.15.133:0/3397772544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4a4145c70 msgr2=0x7ff4a41efb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:32.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.705+0000 7ff4aa4d6640 1 --2- 172.21.15.133:0/3397772544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4a4145c70 0x7ff4a41efb40 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ff49c01c6d0 tx=0x7ff49c009750 comp rx=0 tx=0).stop 2023-12-19T19:01:32.709 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.705+0000 7ff4aa4d6640 1 -- 172.21.15.133:0/3397772544 shutdown_connections 2023-12-19T19:01:32.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.705+0000 7ff4aa4d6640 1 --2- 172.21.15.133:0/3397772544 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff490066470 0x7ff490068930 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.705+0000 7ff4aa4d6640 1 --2- 172.21.15.133:0/3397772544 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff4a4145c70 0x7ff4a41efb40 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.705+0000 7ff4aa4d6640 1 --2- 172.21.15.133:0/3397772544 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff4a41ee150 0x7ff4a41ef600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.705+0000 7ff4aa4d6640 1 --2- 172.21.15.133:0/3397772544 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff48c0052b0 0x7ff4a4145730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.705+0000 7ff4aa4d6640 1 -- 172.21.15.133:0/3397772544 >> 172.21.15.133:0/3397772544 conn(0x7ff4a40ca170 msgr2=0x7ff4a4143090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:32.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.705+0000 7ff4aa4d6640 1 -- 172.21.15.133:0/3397772544 shutdown_connections 2023-12-19T19:01:32.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.705+0000 7ff4aa4d6640 1 -- 172.21.15.133:0/3397772544 wait complete. 2023-12-19T19:01:32.729 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T19:01:32.729 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T19:01:32.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.865+0000 7fce4fa32640 1 Processor -- start 2023-12-19T19:01:32.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.865+0000 7fce4fa32640 1 -- start start 2023-12-19T19:01:32.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.865+0000 7fce4fa32640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fce480c4fb0 0x7fce480c1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:32.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.865+0000 7fce4fa32640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4806db90 0x7fce4806dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:32.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.865+0000 7fce4fa32640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce480aa750 con 0x7fce4806c840 2023-12-19T19:01:32.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce4fa32640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce4806e530 con 0x7fce480c4fb0 2023-12-19T19:01:32.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce4fa32640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce480a8f90 con 0x7fce4806db90 2023-12-19T19:01:32.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce4dfcf640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fce4806c840 0x7fce4806ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43164/0 (socket says 172.21.15.133:43164) 2023-12-19T19:01:32.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce4dfcf640 1 -- 172.21.15.133:0/2287265490 learned_addr learned my addr 172.21.15.133:0/2287265490 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:32.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce4cfcd640 1 --2- 172.21.15.133:0/2287265490 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4806db90 0x7fce4806dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:32.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce4d7ce640 1 --2- 172.21.15.133:0/2287265490 >> v2:172.21.15.138:3300/0 conn(0x7fce480c4fb0 0x7fce480c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:32.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce3ffff640 1 -- 172.21.15.133:0/2287265490 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24714175 0 0) 0x7fce480aa750 con 0x7fce4806c840 2023-12-19T19:01:32.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce3ffff640 1 -- 172.21.15.133:0/2287265490 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce34003530 con 0x7fce4806c840 2023-12-19T19:01:32.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce3ffff640 1 -- 172.21.15.133:0/2287265490 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2892497504 0 0) 0x7fce34003530 con 0x7fce4806c840 2023-12-19T19:01:32.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce3ffff640 1 -- 172.21.15.133:0/2287265490 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4806db90 msgr2=0x7fce4806dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:32.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce3ffff640 1 --2- 172.21.15.133:0/2287265490 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4806db90 0x7fce4806dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce3ffff640 1 -- 172.21.15.133:0/2287265490 >> v2:172.21.15.138:3300/0 conn(0x7fce480c4fb0 msgr2=0x7fce480c1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:32.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce3ffff640 1 --2- 172.21.15.133:0/2287265490 >> v2:172.21.15.138:3300/0 conn(0x7fce480c4fb0 0x7fce480c1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce3ffff640 1 -- 172.21.15.133:0/2287265490 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce480a9270 con 0x7fce4806c840 2023-12-19T19:01:32.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce3ffff640 1 -- 172.21.15.133:0/2287265490 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7fce40001a00 con 0x7fce4806c840 2023-12-19T19:01:32.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce3ffff640 1 -- 172.21.15.133:0/2287265490 >> v1:172.21.15.133:6789/0 conn(0x7fce4806c840 legacy=0x7fce4806ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:32.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce3ffff640 1 --2- 172.21.15.133:0/2287265490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce34003980 0x7fce34003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:32.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce3ffff640 1 --2- 172.21.15.133:0/2287265490 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4806db90 0x7fce340047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:32.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce3ffff640 1 --2- 172.21.15.133:0/2287265490 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce34004d10 0x7fce34005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:32.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce3ffff640 1 -- 172.21.15.133:0/2287265490 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4806e530 con 0x7fce34003980 2023-12-19T19:01:32.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce3ffff640 1 -- 172.21.15.133:0/2287265490 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce480a8f90 con 0x7fce34004d10 2023-12-19T19:01:32.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce3ffff640 1 -- 172.21.15.133:0/2287265490 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3400ba10 con 0x7fce4806db90 2023-12-19T19:01:32.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce4d7ce640 1 --2- 172.21.15.133:0/2287265490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce34003980 0x7fce34003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:32.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce4cfcd640 1 --2- 172.21.15.133:0/2287265490 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4806db90 0x7fce340047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:32.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce4dfcf640 1 --2- 172.21.15.133:0/2287265490 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce34004d10 0x7fce34005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:32.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce4d7ce640 1 -- 172.21.15.133:0/2287265490 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4806db90 msgr2=0x7fce340047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:32.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce4d7ce640 1 --2- 172.21.15.133:0/2287265490 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4806db90 0x7fce340047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce4d7ce640 1 -- 172.21.15.133:0/2287265490 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce34004d10 msgr2=0x7fce34005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:32.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce4d7ce640 1 --2- 172.21.15.133:0/2287265490 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce34004d10 0x7fce34005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.876 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.869+0000 7fce4d7ce640 1 -- 172.21.15.133:0/2287265490 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce34003530 con 0x7fce34003980 2023-12-19T19:01:32.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.873+0000 7fce4d7ce640 1 --2- 172.21.15.133:0/2287265490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce34003980 0x7fce34003da0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fce44009ae0 tx=0x7fce4401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ace572f76443808 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:32.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.873+0000 7fce3ffff640 1 -- 172.21.15.133:0/2287265490 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce440a5660 con 0x7fce34003980 2023-12-19T19:01:32.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.873+0000 7fce3ffff640 1 -- 172.21.15.133:0/2287265490 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce440a57c0 con 0x7fce34003980 2023-12-19T19:01:32.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.873+0000 7fce3ffff640 1 -- 172.21.15.133:0/2287265490 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce440a5b70 con 0x7fce34003980 2023-12-19T19:01:32.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.873+0000 7fce4fa32640 1 -- 172.21.15.133:0/2287265490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce34003980 msgr2=0x7fce34003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:32.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.873+0000 7fce4fa32640 1 --2- 172.21.15.133:0/2287265490 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce34003980 0x7fce34003da0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fce44009ae0 tx=0x7fce4401ca90 comp rx=0 tx=0).stop 2023-12-19T19:01:32.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.873+0000 7fce4dfcf640 1 -- 172.21.15.133:0/2287265490 reap_dead start 2023-12-19T19:01:32.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.873+0000 7fce4fa32640 1 -- 172.21.15.133:0/2287265490 shutdown_connections 2023-12-19T19:01:32.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.873+0000 7fce4fa32640 1 -- 172.21.15.133:0/2287265490 >> 172.21.15.133:0/2287265490 conn(0x7fce480c5d40 msgr2=0x7fce480c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:32.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.873+0000 7fce4fa32640 1 -- 172.21.15.133:0/2287265490 shutdown_connections 2023-12-19T19:01:32.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.873+0000 7fce4fa32640 1 -- 172.21.15.133:0/2287265490 wait complete. 2023-12-19T19:01:32.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.873+0000 7fce4fa32640 1 Processor -- start 2023-12-19T19:01:32.879 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.873+0000 7fce4fa32640 1 -- start start 2023-12-19T19:01:32.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce4fa32640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce34003980 0x7fce481ef1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:32.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce4fa32640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4814c730 0x7fce4814e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:32.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce4fa32640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce481eb880 0x7fce481ebd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:32.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce4fa32640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce481ec270 con 0x7fce481eb880 2023-12-19T19:01:32.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce4fa32640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce481ef710 con 0x7fce34003980 2023-12-19T19:01:32.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce4fa32640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce481eb3f0 con 0x7fce4814c730 2023-12-19T19:01:32.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce4dfcf640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce481eb880 0x7fce481ebd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:32.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce4dfcf640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce481eb880 0x7fce481ebd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51694/0 (socket says 172.21.15.133:51694) 2023-12-19T19:01:32.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce4dfcf640 1 -- 172.21.15.133:0/3730586815 learned_addr learned my addr 172.21.15.133:0/3730586815 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:32.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce4d7ce640 1 --2- 172.21.15.133:0/3730586815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce34003980 0x7fce481ef1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:32.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce4cfcd640 1 --2- 172.21.15.133:0/3730586815 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4814c730 0x7fce4814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:32.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce4dfcf640 1 -- 172.21.15.133:0/3730586815 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4814c730 msgr2=0x7fce4814e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:32.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce4dfcf640 1 --2- 172.21.15.133:0/3730586815 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4814c730 0x7fce4814e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce4dfcf640 1 -- 172.21.15.133:0/3730586815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce34003980 msgr2=0x7fce481ef1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:32.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce4dfcf640 1 --2- 172.21.15.133:0/3730586815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce34003980 0x7fce481ef1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:32.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce4dfcf640 1 -- 172.21.15.133:0/3730586815 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce48157940 con 0x7fce481eb880 2023-12-19T19:01:32.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce4cfcd640 1 --2- 172.21.15.133:0/3730586815 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4814c730 0x7fce4814e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:32.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce4dfcf640 1 --2- 172.21.15.133:0/3730586815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce481eb880 0x7fce481ebd30 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fce480c10d0 tx=0x7fce40007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:32.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce3dffb640 1 -- 172.21.15.133:0/3730586815 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4000eaa0 con 0x7fce481eb880 2023-12-19T19:01:32.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce3dffb640 1 -- 172.21.15.133:0/3730586815 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4000ec20 con 0x7fce481eb880 2023-12-19T19:01:32.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce4fa32640 1 -- 172.21.15.133:0/3730586815 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce48155090 con 0x7fce481eb880 2023-12-19T19:01:32.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce3dffb640 1 -- 172.21.15.133:0/3730586815 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40014430 con 0x7fce481eb880 2023-12-19T19:01:32.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce4fa32640 1 -- 172.21.15.133:0/3730586815 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce48155650 con 0x7fce481eb880 2023-12-19T19:01:32.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce4fa32640 1 -- 172.21.15.133:0/3730586815 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce48068400 con 0x7fce481eb880 2023-12-19T19:01:32.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.877+0000 7fce3dffb640 1 -- 172.21.15.133:0/3730586815 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fce40014590 con 0x7fce481eb880 2023-12-19T19:01:32.883 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.881+0000 7fce3dffb640 1 --2- 172.21.15.133:0/3730586815 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fce2c066470 0x7fce2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:32.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.881+0000 7fce3dffb640 1 -- 172.21.15.133:0/3730586815 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fce400836c0 con 0x7fce481eb880 2023-12-19T19:01:32.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.881+0000 7fce4d7ce640 1 --2- 172.21.15.133:0/3730586815 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fce2c066470 0x7fce2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:32.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.881+0000 7fce4d7ce640 1 --2- 172.21.15.133:0/3730586815 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fce2c066470 0x7fce2c068930 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fce440af000 tx=0x7fce440046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:32.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:32.885+0000 7fce3dffb640 1 -- 172.21.15.133:0/3730586815 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fce40050f30 con 0x7fce481eb880 2023-12-19T19:01:33.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:33.033+0000 7fce4fa32640 1 -- 172.21.15.133:0/3730586815 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fce480c1100 con 0x7fce481eb880 2023-12-19T19:01:33.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:33.956+0000 7fce3dffb640 1 -- 172.21.15.133:0/3730586815 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v66) v1 ==== 138+0+0 (secure 0 0 0) 0x7fce40054550 con 0x7fce481eb880 2023-12-19T19:01:33.962 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' created 2023-12-19T19:01:33.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:33.960+0000 7fce4fa32640 1 -- 172.21.15.133:0/3730586815 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fce2c066470 msgr2=0x7fce2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:33.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:33.960+0000 7fce4fa32640 1 --2- 172.21.15.133:0/3730586815 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fce2c066470 0x7fce2c068930 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fce440af000 tx=0x7fce440046d0 comp rx=0 tx=0).stop 2023-12-19T19:01:33.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:33.960+0000 7fce4fa32640 1 -- 172.21.15.133:0/3730586815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce481eb880 msgr2=0x7fce481ebd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:33.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:33.960+0000 7fce4fa32640 1 --2- 172.21.15.133:0/3730586815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce481eb880 0x7fce481ebd30 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fce480c10d0 tx=0x7fce40007bc0 comp rx=0 tx=0).stop 2023-12-19T19:01:33.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:33.960+0000 7fce4fa32640 1 -- 172.21.15.133:0/3730586815 shutdown_connections 2023-12-19T19:01:33.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:33.960+0000 7fce4fa32640 1 --2- 172.21.15.133:0/3730586815 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fce2c066470 0x7fce2c068930 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:33.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:33.960+0000 7fce4fa32640 1 --2- 172.21.15.133:0/3730586815 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fce481eb880 0x7fce481ebd30 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:33.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:33.960+0000 7fce4fa32640 1 --2- 172.21.15.133:0/3730586815 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fce4814c730 0x7fce4814e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:33.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:33.960+0000 7fce4fa32640 1 --2- 172.21.15.133:0/3730586815 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fce34003980 0x7fce481ef1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:33.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:33.960+0000 7fce4fa32640 1 -- 172.21.15.133:0/3730586815 >> 172.21.15.133:0/3730586815 conn(0x7fce480c5d40 msgr2=0x7fce4806ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:33.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:33.960+0000 7fce4fa32640 1 -- 172.21.15.133:0/3730586815 shutdown_connections 2023-12-19T19:01:33.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:33.960+0000 7fce4fa32640 1 -- 172.21.15.133:0/3730586815 wait complete. 2023-12-19T19:01:33.991 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T19:01:34.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.132+0000 7f92ce572640 1 Processor -- start 2023-12-19T19:01:34.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.132+0000 7f92ce572640 1 -- start start 2023-12-19T19:01:34.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.132+0000 7f92ce572640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c80c7ea0 0x7f92c806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:34.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.132+0000 7f92ce572640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f92c806b9e0 0x7f92c815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:34.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.132+0000 7f92ce572640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c806c860 con 0x7f92c8151e90 2023-12-19T19:01:34.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.132+0000 7f92ce572640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c80c8750 con 0x7f92c806b9e0 2023-12-19T19:01:34.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.132+0000 7f92ce572640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c81552d0 con 0x7f92c80c7ea0 2023-12-19T19:01:34.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.132+0000 7f92c7fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f92c8151e90 0x7f92c80c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43172/0 (socket says 172.21.15.133:43172) 2023-12-19T19:01:34.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.132+0000 7f92c7fff640 1 -- 172.21.15.133:0/1652504417 learned_addr learned my addr 172.21.15.133:0/1652504417 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:34.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.132+0000 7f92c77fe640 1 --2- 172.21.15.133:0/1652504417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c80c7ea0 0x7f92c806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:34.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.132+0000 7f92ccb0f640 1 --2- 172.21.15.133:0/1652504417 >> v2:172.21.15.138:3300/0 conn(0x7f92c806b9e0 0x7f92c815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:34.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.132+0000 7f92c6ffd640 1 -- 172.21.15.133:0/1652504417 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 398983244 0 0) 0x7f92c806c860 con 0x7f92c8151e90 2023-12-19T19:01:34.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.132+0000 7f92c6ffd640 1 -- 172.21.15.133:0/1652504417 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92b0003530 con 0x7f92c8151e90 2023-12-19T19:01:34.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.132+0000 7f92c6ffd640 1 -- 172.21.15.133:0/1652504417 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3137456203 0 0) 0x7f92b0003530 con 0x7f92c8151e90 2023-12-19T19:01:34.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.132+0000 7f92c6ffd640 1 -- 172.21.15.133:0/1652504417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c80c7ea0 msgr2=0x7f92c806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:34.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.132+0000 7f92c6ffd640 1 --2- 172.21.15.133:0/1652504417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c80c7ea0 0x7f92c806b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:34.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.132+0000 7f92c6ffd640 1 -- 172.21.15.133:0/1652504417 >> v2:172.21.15.138:3300/0 conn(0x7f92c806b9e0 msgr2=0x7f92c815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:34.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.132+0000 7f92c6ffd640 1 --2- 172.21.15.133:0/1652504417 >> v2:172.21.15.138:3300/0 conn(0x7f92c806b9e0 0x7f92c815f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:34.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.132+0000 7f92c6ffd640 1 -- 172.21.15.133:0/1652504417 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c8154930 con 0x7f92c8151e90 2023-12-19T19:01:34.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.132+0000 7f92c6ffd640 1 -- 172.21.15.133:0/1652504417 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f92b8001680 con 0x7f92c8151e90 2023-12-19T19:01:34.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.132+0000 7f92c6ffd640 1 -- 172.21.15.133:0/1652504417 >> v1:172.21.15.133:6789/0 conn(0x7f92c8151e90 legacy=0x7f92c80c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:34.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.132+0000 7f92c6ffd640 1 --2- 172.21.15.133:0/1652504417 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92b0003980 0x7f92b0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:34.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.136+0000 7f92c6ffd640 1 --2- 172.21.15.133:0/1652504417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92b00047d0 0x7f92b0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:34.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.136+0000 7f92c6ffd640 1 --2- 172.21.15.133:0/1652504417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c80c7ea0 0x7f92b0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:34.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.136+0000 7f92c6ffd640 1 -- 172.21.15.133:0/1652504417 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c80c8750 con 0x7f92b00047d0 2023-12-19T19:01:34.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.136+0000 7f92c6ffd640 1 -- 172.21.15.133:0/1652504417 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c81552d0 con 0x7f92b0003980 2023-12-19T19:01:34.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.136+0000 7f92c6ffd640 1 -- 172.21.15.133:0/1652504417 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b000ba10 con 0x7f92c80c7ea0 2023-12-19T19:01:34.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.136+0000 7f92ccb0f640 1 --2- 172.21.15.133:0/1652504417 >> v2:172.21.15.138:3300/0 conn(0x7f92c806b9e0 0x7f92c815f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:01:34.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.136+0000 7f92c77fe640 1 --2- 172.21.15.133:0/1652504417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92b00047d0 0x7f92b0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:34.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.136+0000 7f92c7fff640 1 --2- 172.21.15.133:0/1652504417 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92b0003980 0x7f92b0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:34.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.136+0000 7f92ccb0f640 1 --2- 172.21.15.133:0/1652504417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c80c7ea0 0x7f92b0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:34.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.136+0000 7f92c77fe640 1 -- 172.21.15.133:0/1652504417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c80c7ea0 msgr2=0x7f92b0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:34.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.136+0000 7f92c77fe640 1 --2- 172.21.15.133:0/1652504417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c80c7ea0 0x7f92b0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:34.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.136+0000 7f92c77fe640 1 -- 172.21.15.133:0/1652504417 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92b0003980 msgr2=0x7f92b0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:34.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.136+0000 7f92c77fe640 1 --2- 172.21.15.133:0/1652504417 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92b0003980 0x7f92b0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:34.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.136+0000 7f92c77fe640 1 -- 172.21.15.133:0/1652504417 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b0003530 con 0x7f92b00047d0 2023-12-19T19:01:34.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.136+0000 7f92ccb0f640 1 --2- 172.21.15.133:0/1652504417 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c80c7ea0 0x7f92b0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:34.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.136+0000 7f92c77fe640 1 --2- 172.21.15.133:0/1652504417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92b00047d0 0x7f92b0004c50 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009ab0 tx=0x7f92bc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a332de2436a2cb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:34.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.136+0000 7f92c6ffd640 1 -- 172.21.15.133:0/1652504417 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0a6410 con 0x7f92b00047d0 2023-12-19T19:01:34.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.136+0000 7f92c6ffd640 1 -- 172.21.15.133:0/1652504417 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92bc0a6570 con 0x7f92b00047d0 2023-12-19T19:01:34.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.136+0000 7f92c6ffd640 1 -- 172.21.15.133:0/1652504417 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0a68e0 con 0x7f92b00047d0 2023-12-19T19:01:34.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.140+0000 7f92ce572640 1 -- 172.21.15.133:0/1652504417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92b00047d0 msgr2=0x7f92b0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:34.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.140+0000 7f92ce572640 1 --2- 172.21.15.133:0/1652504417 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92b00047d0 0x7f92b0004c50 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f92bc009ab0 tx=0x7f92bc01ca30 comp rx=0 tx=0).stop 2023-12-19T19:01:34.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.140+0000 7f92ccb0f640 1 -- 172.21.15.133:0/1652504417 reap_dead start 2023-12-19T19:01:34.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.140+0000 7f92ce572640 1 -- 172.21.15.133:0/1652504417 shutdown_connections 2023-12-19T19:01:34.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.140+0000 7f92ce572640 1 -- 172.21.15.133:0/1652504417 >> 172.21.15.133:0/1652504417 conn(0x7f92c80ca170 msgr2=0x7f92c80ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:34.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.140+0000 7f92ce572640 1 -- 172.21.15.133:0/1652504417 shutdown_connections 2023-12-19T19:01:34.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.140+0000 7f92ce572640 1 -- 172.21.15.133:0/1652504417 wait complete. 2023-12-19T19:01:34.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.140+0000 7f92ce572640 1 Processor -- start 2023-12-19T19:01:34.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.140+0000 7f92ce572640 1 -- start start 2023-12-19T19:01:34.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.140+0000 7f92ce572640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92b00047d0 0x7f92c81562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:34.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.140+0000 7f92ce572640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92c814b300 0x7f92c81ed260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:34.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.140+0000 7f92ce572640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c81ed7a0 0x7f92c814a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:34.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.140+0000 7f92ce572640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c8157120 con 0x7f92b00047d0 2023-12-19T19:01:34.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.140+0000 7f92ce572640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c8155d90 con 0x7f92c814b300 2023-12-19T19:01:34.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.140+0000 7f92ce572640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c8156800 con 0x7f92c81ed7a0 2023-12-19T19:01:34.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.140+0000 7f92c7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92b00047d0 0x7f92c81562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:34.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.140+0000 7f92c7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92b00047d0 0x7f92c81562c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:51722/0 (socket says 172.21.15.133:51722) 2023-12-19T19:01:34.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.140+0000 7f92c7fff640 1 -- 172.21.15.133:0/315171762 learned_addr learned my addr 172.21.15.133:0/315171762 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:34.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.140+0000 7f92c77fe640 1 --2- 172.21.15.133:0/315171762 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92c814b300 0x7f92c81ed260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:34.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.140+0000 7f92ccb0f640 1 --2- 172.21.15.133:0/315171762 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c81ed7a0 0x7f92c814a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:34.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.144+0000 7f92c7fff640 1 -- 172.21.15.133:0/315171762 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c81ed7a0 msgr2=0x7f92c814a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:34.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.144+0000 7f92c7fff640 1 --2- 172.21.15.133:0/315171762 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c81ed7a0 0x7f92c814a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:34.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.144+0000 7f92c7fff640 1 -- 172.21.15.133:0/315171762 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92c814b300 msgr2=0x7f92c81ed260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:34.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.144+0000 7f92c7fff640 1 --2- 172.21.15.133:0/315171762 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92c814b300 0x7f92c81ed260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:34.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.144+0000 7f92c7fff640 1 -- 172.21.15.133:0/315171762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c8155fe0 con 0x7f92b00047d0 2023-12-19T19:01:34.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.144+0000 7f92c7fff640 1 --2- 172.21.15.133:0/315171762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92b00047d0 0x7f92c81562c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f92b8007340 tx=0x7f92b8007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:34.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.144+0000 7f92c4ff9640 1 -- 172.21.15.133:0/315171762 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b800f9c0 con 0x7f92b00047d0 2023-12-19T19:01:34.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.144+0000 7f92c4ff9640 1 -- 172.21.15.133:0/315171762 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b800fb20 con 0x7f92b00047d0 2023-12-19T19:01:34.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.144+0000 7f92c4ff9640 1 -- 172.21.15.133:0/315171762 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b800feb0 con 0x7f92b00047d0 2023-12-19T19:01:34.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.144+0000 7f92ce572640 1 -- 172.21.15.133:0/315171762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c80abd60 con 0x7f92b00047d0 2023-12-19T19:01:34.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.144+0000 7f92ce572640 1 -- 172.21.15.133:0/315171762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c80ac320 con 0x7f92b00047d0 2023-12-19T19:01:34.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.144+0000 7f92ce572640 1 -- 172.21.15.133:0/315171762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c8068400 con 0x7f92b00047d0 2023-12-19T19:01:34.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.144+0000 7f92c4ff9640 1 -- 172.21.15.133:0/315171762 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f92b8014450 con 0x7f92b00047d0 2023-12-19T19:01:34.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.144+0000 7f92c4ff9640 1 --2- 172.21.15.133:0/315171762 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f92b40664a0 0x7f92b4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:34.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.148+0000 7f92c4ff9640 1 -- 172.21.15.133:0/315171762 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f92b8083bc0 con 0x7f92b00047d0 2023-12-19T19:01:34.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.148+0000 7f92c77fe640 1 --2- 172.21.15.133:0/315171762 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f92b40664a0 0x7f92b4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:34.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.148+0000 7f92c77fe640 1 --2- 172.21.15.133:0/315171762 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f92b40664a0 0x7f92b4068960 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0ad000 tx=0x7f92bc0b2040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:34.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.148+0000 7f92c4ff9640 1 -- 172.21.15.133:0/315171762 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f92b8051440 con 0x7f92b00047d0 2023-12-19T19:01:34.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.300+0000 7f92ce572640 1 -- 172.21.15.133:0/315171762 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f92c80bd440 con 0x7f92b00047d0 2023-12-19T19:01:34.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.964+0000 7f92c4ff9640 1 -- 172.21.15.133:0/315171762 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v67) v1 ==== 170+0+0 (secure 0 0 0) 0x7f92b801a0d0 con 0x7f92b00047d0 2023-12-19T19:01:34.971 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' created 2023-12-19T19:01:34.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.968+0000 7f92ce572640 1 -- 172.21.15.133:0/315171762 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f92b40664a0 msgr2=0x7f92b4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:34.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.968+0000 7f92ce572640 1 --2- 172.21.15.133:0/315171762 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f92b40664a0 0x7f92b4068960 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0ad000 tx=0x7f92bc0b2040 comp rx=0 tx=0).stop 2023-12-19T19:01:34.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.968+0000 7f92ce572640 1 -- 172.21.15.133:0/315171762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92b00047d0 msgr2=0x7f92c81562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:34.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.968+0000 7f92ce572640 1 --2- 172.21.15.133:0/315171762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92b00047d0 0x7f92c81562c0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f92b8007340 tx=0x7f92b8007800 comp rx=0 tx=0).stop 2023-12-19T19:01:34.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.968+0000 7f92ce572640 1 -- 172.21.15.133:0/315171762 shutdown_connections 2023-12-19T19:01:34.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.968+0000 7f92ce572640 1 --2- 172.21.15.133:0/315171762 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f92b40664a0 0x7f92b4068960 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:34.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.968+0000 7f92ce572640 1 --2- 172.21.15.133:0/315171762 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f92c81ed7a0 0x7f92c814a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:34.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.968+0000 7f92ce572640 1 --2- 172.21.15.133:0/315171762 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f92c814b300 0x7f92c81ed260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:34.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.968+0000 7f92ce572640 1 --2- 172.21.15.133:0/315171762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f92b00047d0 0x7f92c81562c0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:34.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.968+0000 7f92ce572640 1 -- 172.21.15.133:0/315171762 >> 172.21.15.133:0/315171762 conn(0x7f92c80ca170 msgr2=0x7f92c80c4900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:34.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.968+0000 7f92ce572640 1 -- 172.21.15.133:0/315171762 shutdown_connections 2023-12-19T19:01:34.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:34.968+0000 7f92ce572640 1 -- 172.21.15.133:0/315171762 wait complete. 2023-12-19T19:01:35.011 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T19:01:35.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.148+0000 7f1fb2bd8640 1 Processor -- start 2023-12-19T19:01:35.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.152+0000 7f1fb2bd8640 1 -- start start 2023-12-19T19:01:35.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.152+0000 7f1fb2bd8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fac0c63c0 0x7f1fac0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:35.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.152+0000 7f1fb2bd8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1fac0c2bb0 0x7f1fac0a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:35.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.152+0000 7f1fb2bd8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fac0c31c0 con 0x7f1fac0c4100 2023-12-19T19:01:35.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.152+0000 7f1fb2bd8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fac0c34a0 con 0x7f1fac0c2bb0 2023-12-19T19:01:35.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.152+0000 7f1fb2bd8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac0c1030 con 0x7f1fac0c63c0 2023-12-19T19:01:35.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.152+0000 7f1fb0974640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fac0c63c0 0x7f1fac0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:35.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.152+0000 7f1fb1175640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1fac0c2bb0 0x7f1fac0a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:35.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.152+0000 7f1fb1175640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f1fac0c2bb0 0x7f1fac0a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:60836/0 (socket says 172.21.15.133:60836) 2023-12-19T19:01:35.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.152+0000 7f1fb1175640 1 -- 172.21.15.133:0/2910094750 learned_addr learned my addr 172.21.15.133:0/2910094750 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:35.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.152+0000 7f1fb0974640 1 -- 172.21.15.133:0/2910094750 >> v2:172.21.15.138:3300/0 conn(0x7f1fac0c2bb0 msgr2=0x7f1fac0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:35.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.152+0000 7f1fb0974640 1 --2- 172.21.15.133:0/2910094750 >> v2:172.21.15.138:3300/0 conn(0x7f1fac0c2bb0 0x7f1fac0a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:35.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.152+0000 7f1fb0974640 1 -- 172.21.15.133:0/2910094750 >> v1:172.21.15.138:6789/0 conn(0x7f1fac0c4100 legacy=0x7f1fac0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:35.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.152+0000 7f1fb0974640 1 -- 172.21.15.133:0/2910094750 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fac0c1310 con 0x7f1fac0c63c0 2023-12-19T19:01:35.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.152+0000 7f1fb1175640 1 --2- 172.21.15.133:0/2910094750 >> v2:172.21.15.138:3300/0 conn(0x7f1fac0c2bb0 0x7f1fac0a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:01:35.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.156+0000 7f1fb0974640 1 --2- 172.21.15.133:0/2910094750 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fac0c63c0 0x7f1fac0c06d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00097c0 tx=0x7f1fa001c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31ecd1729da5280 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:35.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.156+0000 7f1fab7fe640 1 -- 172.21.15.133:0/2910094750 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac0aa3d0 con 0x7f1fac0c63c0 2023-12-19T19:01:35.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.156+0000 7f1fab7fe640 1 -- 172.21.15.133:0/2910094750 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa00a7050 con 0x7f1fac0c63c0 2023-12-19T19:01:35.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.156+0000 7f1fab7fe640 1 -- 172.21.15.133:0/2910094750 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa00ab820 con 0x7f1fac0c63c0 2023-12-19T19:01:35.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.156+0000 7f1fb2bd8640 1 -- 172.21.15.133:0/2910094750 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fac0c63c0 msgr2=0x7f1fac0c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:35.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.156+0000 7f1fb2bd8640 1 --2- 172.21.15.133:0/2910094750 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fac0c63c0 0x7f1fac0c06d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00097c0 tx=0x7f1fa001c330 comp rx=0 tx=0).stop 2023-12-19T19:01:35.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.156+0000 7f1fb2bd8640 1 -- 172.21.15.133:0/2910094750 shutdown_connections 2023-12-19T19:01:35.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.156+0000 7f1fb2bd8640 1 --2- 172.21.15.133:0/2910094750 >> v2:172.21.15.138:3300/0 conn(0x7f1fac0c2bb0 0x7f1fac0a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:35.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.156+0000 7f1fb2bd8640 1 --2- 172.21.15.133:0/2910094750 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fac0c63c0 0x7f1fac0c06d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:35.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.156+0000 7f1fb2bd8640 1 -- 172.21.15.133:0/2910094750 >> 172.21.15.133:0/2910094750 conn(0x7f1fac06a5b0 msgr2=0x7f1fac06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:35.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.156+0000 7f1fb2bd8640 1 -- 172.21.15.133:0/2910094750 shutdown_connections 2023-12-19T19:01:35.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.156+0000 7f1fb2bd8640 1 -- 172.21.15.133:0/2910094750 wait complete. 2023-12-19T19:01:35.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.156+0000 7f1fb2bd8640 1 Processor -- start 2023-12-19T19:01:35.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.156+0000 7f1fb2bd8640 1 -- start start 2023-12-19T19:01:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fb2bd8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fac0c2bb0 0x7f1fac1ed880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fb2bd8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fac0c4100 0x7f1fac14dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fb2bd8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fac0c63c0 0x7f1fac150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fb2bd8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac1eddc0 con 0x7f1fac0c63c0 2023-12-19T19:01:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fb2bd8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac06fe50 con 0x7f1fac0c2bb0 2023-12-19T19:01:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fb2bd8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fac070380 con 0x7f1fac0c4100 2023-12-19T19:01:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fb1175640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fac0c63c0 0x7f1fac150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fb1175640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fac0c63c0 0x7f1fac150f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53536/0 (socket says 172.21.15.133:53536) 2023-12-19T19:01:35.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fb1175640 1 -- 172.21.15.133:0/1365308796 learned_addr learned my addr 172.21.15.133:0/1365308796 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fb0974640 1 --2- 172.21.15.133:0/1365308796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fac0c2bb0 0x7f1fac1ed880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fabfff640 1 --2- 172.21.15.133:0/1365308796 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fac0c4100 0x7f1fac14dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fb1175640 1 -- 172.21.15.133:0/1365308796 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fac0c4100 msgr2=0x7f1fac14dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fb1175640 1 --2- 172.21.15.133:0/1365308796 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fac0c4100 0x7f1fac14dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fb1175640 1 -- 172.21.15.133:0/1365308796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fac0c2bb0 msgr2=0x7f1fac1ed880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fb1175640 1 --2- 172.21.15.133:0/1365308796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fac0c2bb0 0x7f1fac1ed880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fb1175640 1 -- 172.21.15.133:0/1365308796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa4009b30 con 0x7f1fac0c63c0 2023-12-19T19:01:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fb0974640 1 --2- 172.21.15.133:0/1365308796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fac0c2bb0 0x7f1fac1ed880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fabfff640 1 --2- 172.21.15.133:0/1365308796 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fac0c4100 0x7f1fac14dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fb1175640 1 --2- 172.21.15.133:0/1365308796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fac0c63c0 0x7f1fac150f80 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400efc0 tx=0x7f1fa400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fa97fa640 1 -- 172.21.15.133:0/1365308796 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4018070 con 0x7f1fac0c63c0 2023-12-19T19:01:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fa97fa640 1 -- 172.21.15.133:0/1365308796 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa400f040 con 0x7f1fac0c63c0 2023-12-19T19:01:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fb2bd8640 1 -- 172.21.15.133:0/1365308796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa0009420 con 0x7f1fac0c63c0 2023-12-19T19:01:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fa97fa640 1 -- 172.21.15.133:0/1365308796 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa400ce00 con 0x7f1fac0c63c0 2023-12-19T19:01:35.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fb2bd8640 1 -- 172.21.15.133:0/1365308796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fac155db0 con 0x7f1fac0c63c0 2023-12-19T19:01:35.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.160+0000 7f1fb2bd8640 1 -- 172.21.15.133:0/1365308796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fac155f40 con 0x7f1fac0c63c0 2023-12-19T19:01:35.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.164+0000 7f1fa97fa640 1 -- 172.21.15.133:0/1365308796 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1fa4014480 con 0x7f1fac0c63c0 2023-12-19T19:01:35.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.164+0000 7f1fa97fa640 1 --2- 172.21.15.133:0/1365308796 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f90066470 0x7f1f90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:35.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.164+0000 7f1fa97fa640 1 -- 172.21.15.133:0/1365308796 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f1fa4084180 con 0x7f1fac0c63c0 2023-12-19T19:01:35.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.164+0000 7f1fb0974640 1 --2- 172.21.15.133:0/1365308796 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f90066470 0x7f1f90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:35.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.164+0000 7f1fb0974640 1 --2- 172.21.15.133:0/1365308796 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f90066470 0x7f1f90068930 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00ad000 tx=0x7f1fa00a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:35.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.168+0000 7f1fa97fa640 1 -- 172.21.15.133:0/1365308796 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1fa4051650 con 0x7f1fac0c63c0 2023-12-19T19:01:35.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.352+0000 7f1fb2bd8640 1 -- 172.21.15.133:0/1365308796 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1fac068400 con 0x7f1fac0c63c0 2023-12-19T19:01:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.968+0000 7f1fa97fa640 1 -- 172.21.15.133:0/1365308796 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v44) v1 ==== 174+0+0 (secure 0 0 0) 0x7f1fa4054c70 con 0x7f1fac0c63c0 2023-12-19T19:01:35.973 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 12 and data pool 13 2023-12-19T19:01:35.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.972+0000 7f1fb2bd8640 1 -- 172.21.15.133:0/1365308796 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f90066470 msgr2=0x7f1f90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:35.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.972+0000 7f1fb2bd8640 1 --2- 172.21.15.133:0/1365308796 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f90066470 0x7f1f90068930 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1fa00ad000 tx=0x7f1fa00a6000 comp rx=0 tx=0).stop 2023-12-19T19:01:35.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.972+0000 7f1fb2bd8640 1 -- 172.21.15.133:0/1365308796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fac0c63c0 msgr2=0x7f1fac150f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:35.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.972+0000 7f1fb2bd8640 1 --2- 172.21.15.133:0/1365308796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fac0c63c0 0x7f1fac150f80 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400efc0 tx=0x7f1fa400c490 comp rx=0 tx=0).stop 2023-12-19T19:01:35.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.972+0000 7f1fb2bd8640 1 -- 172.21.15.133:0/1365308796 shutdown_connections 2023-12-19T19:01:35.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.972+0000 7f1fb2bd8640 1 --2- 172.21.15.133:0/1365308796 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1f90066470 0x7f1f90068930 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:35.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.972+0000 7f1fb2bd8640 1 --2- 172.21.15.133:0/1365308796 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1fac0c63c0 0x7f1fac150f80 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:35.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.972+0000 7f1fb2bd8640 1 --2- 172.21.15.133:0/1365308796 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1fac0c4100 0x7f1fac14dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:35.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.972+0000 7f1fb2bd8640 1 --2- 172.21.15.133:0/1365308796 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1fac0c2bb0 0x7f1fac1ed880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:35.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.972+0000 7f1fb2bd8640 1 -- 172.21.15.133:0/1365308796 >> 172.21.15.133:0/1365308796 conn(0x7f1fac06a5b0 msgr2=0x7f1fac0c23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.972+0000 7f1fb2bd8640 1 -- 172.21.15.133:0/1365308796 shutdown_connections 2023-12-19T19:01:35.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:35.972+0000 7f1fb2bd8640 1 -- 172.21.15.133:0/1365308796 wait complete. 2023-12-19T19:01:36.026 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:01:36.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.160+0000 7f9e7c7d1640 1 Processor -- start 2023-12-19T19:01:36.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.160+0000 7f9e7c7d1640 1 -- start start 2023-12-19T19:01:36.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.160+0000 7f9e7c7d1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9e74151e90 0x7f9e740c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:36.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.160+0000 7f9e7c7d1640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9e740c7ea0 0x7f9e7406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:36.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.160+0000 7f9e7c7d1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e740c4e60 0x7f9e7406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:36.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.160+0000 7f9e7c7d1640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e740c8750 con 0x7f9e74151e90 2023-12-19T19:01:36.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.160+0000 7f9e7c7d1640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e741552d0 con 0x7f9e740c7ea0 2023-12-19T19:01:36.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.160+0000 7f9e7c7d1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e740c5c60 con 0x7f9e740c4e60 2023-12-19T19:01:36.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.160+0000 7f9e7a56d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9e74151e90 0x7f9e740c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:36.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.160+0000 7f9e7a56d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9e74151e90 0x7f9e740c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53542/0 (socket says 172.21.15.133:53542) 2023-12-19T19:01:36.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.160+0000 7f9e7a56d640 1 -- 172.21.15.133:0/783921816 learned_addr learned my addr 172.21.15.133:0/783921816 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:36.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.160+0000 7f9e79d6c640 1 --2- 172.21.15.133:0/783921816 >> v2:172.21.15.138:3300/0 conn(0x7f9e740c7ea0 0x7f9e7406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:36.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.160+0000 7f9e7ad6e640 1 --2- 172.21.15.133:0/783921816 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e740c4e60 0x7f9e7406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:36.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.160+0000 7f9e7a56d640 1 -- 172.21.15.133:0/783921816 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e740c4e60 msgr2=0x7f9e7406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:36.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.160+0000 7f9e7a56d640 1 --2- 172.21.15.133:0/783921816 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e740c4e60 0x7f9e7406b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.160+0000 7f9e7a56d640 1 -- 172.21.15.133:0/783921816 >> v2:172.21.15.138:3300/0 conn(0x7f9e740c7ea0 msgr2=0x7f9e7406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:36.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.160+0000 7f9e7a56d640 1 --2- 172.21.15.133:0/783921816 >> v2:172.21.15.138:3300/0 conn(0x7f9e740c7ea0 0x7f9e7406b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.160+0000 7f9e7a56d640 1 -- 172.21.15.133:0/783921816 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7406c860 con 0x7f9e74151e90 2023-12-19T19:01:36.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.160+0000 7f9e79d6c640 1 --2- 172.21.15.133:0/783921816 >> v2:172.21.15.138:3300/0 conn(0x7f9e740c7ea0 0x7f9e7406b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:36.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.164+0000 7f9e7a56d640 1 --2- 172.21.15.133:0/783921816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e74151e90 0x7f9e740c4920 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f9e740a9a70 tx=0x7f9e7001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942d0d3662cb18ca server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:36.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.164+0000 7f9e7956b640 1 -- 172.21.15.133:0/783921816 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e700ab600 con 0x7f9e74151e90 2023-12-19T19:01:36.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.164+0000 7f9e7956b640 1 -- 172.21.15.133:0/783921816 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e700a7050 con 0x7f9e74151e90 2023-12-19T19:01:36.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.164+0000 7f9e7956b640 1 -- 172.21.15.133:0/783921816 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e700ab980 con 0x7f9e74151e90 2023-12-19T19:01:36.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.164+0000 7f9e7c7d1640 1 -- 172.21.15.133:0/783921816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e74151e90 msgr2=0x7f9e740c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:36.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.164+0000 7f9e7c7d1640 1 --2- 172.21.15.133:0/783921816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e74151e90 0x7f9e740c4920 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f9e740a9a70 tx=0x7f9e7001c3e0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.164+0000 7f9e7c7d1640 1 -- 172.21.15.133:0/783921816 shutdown_connections 2023-12-19T19:01:36.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.164+0000 7f9e7c7d1640 1 --2- 172.21.15.133:0/783921816 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e740c4e60 0x7f9e7406b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.164+0000 7f9e7c7d1640 1 --2- 172.21.15.133:0/783921816 >> v2:172.21.15.138:3300/0 conn(0x7f9e740c7ea0 0x7f9e7406b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.164+0000 7f9e7c7d1640 1 --2- 172.21.15.133:0/783921816 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e74151e90 0x7f9e740c4920 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.164+0000 7f9e7c7d1640 1 -- 172.21.15.133:0/783921816 >> 172.21.15.133:0/783921816 conn(0x7f9e740ca170 msgr2=0x7f9e740ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:36.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.164+0000 7f9e7c7d1640 1 -- 172.21.15.133:0/783921816 shutdown_connections 2023-12-19T19:01:36.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.164+0000 7f9e7c7d1640 1 -- 172.21.15.133:0/783921816 wait complete. 2023-12-19T19:01:36.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e7c7d1640 1 Processor -- start 2023-12-19T19:01:36.171 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e7c7d1640 1 -- start start 2023-12-19T19:01:36.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e7c7d1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e740c4e60 0x7f9e741527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:36.172 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e7c7d1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e740c7ea0 0x7f9e740ab810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:36.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e7c7d1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e74151e90 0x7f9e741431b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:36.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e7c7d1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e740ab3a0 con 0x7f9e740c7ea0 2023-12-19T19:01:36.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e7c7d1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e740a9e90 con 0x7f9e74151e90 2023-12-19T19:01:36.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e7c7d1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e74145ab0 con 0x7f9e740c4e60 2023-12-19T19:01:36.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e79d6c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e740c7ea0 0x7f9e740ab810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:36.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e79d6c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e740c7ea0 0x7f9e740ab810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53556/0 (socket says 172.21.15.133:53556) 2023-12-19T19:01:36.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e79d6c640 1 -- 172.21.15.133:0/1666277757 learned_addr learned my addr 172.21.15.133:0/1666277757 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:36.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e7a56d640 1 --2- 172.21.15.133:0/1666277757 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e740c4e60 0x7f9e741527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:36.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e7ad6e640 1 --2- 172.21.15.133:0/1666277757 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e74151e90 0x7f9e741431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:36.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e79d6c640 1 -- 172.21.15.133:0/1666277757 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e740c4e60 msgr2=0x7f9e741527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:36.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e79d6c640 1 --2- 172.21.15.133:0/1666277757 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e740c4e60 0x7f9e741527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e79d6c640 1 -- 172.21.15.133:0/1666277757 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e74151e90 msgr2=0x7f9e741431b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:36.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e79d6c640 1 --2- 172.21.15.133:0/1666277757 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e74151e90 0x7f9e741431b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e79d6c640 1 -- 172.21.15.133:0/1666277757 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e700094d0 con 0x7f9e740c7ea0 2023-12-19T19:01:36.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e79d6c640 1 --2- 172.21.15.133:0/1666277757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e740c7ea0 0x7f9e740ab810 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f9e6400d800 tx=0x7f9e6400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:36.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e6affd640 1 -- 172.21.15.133:0/1666277757 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e64009660 con 0x7f9e740c7ea0 2023-12-19T19:01:36.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e6affd640 1 -- 172.21.15.133:0/1666277757 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e640097c0 con 0x7f9e740c7ea0 2023-12-19T19:01:36.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e7c7d1640 1 -- 172.21.15.133:0/1666277757 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e74145d90 con 0x7f9e740c7ea0 2023-12-19T19:01:36.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e6affd640 1 -- 172.21.15.133:0/1666277757 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e64009b70 con 0x7f9e740c7ea0 2023-12-19T19:01:36.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e7c7d1640 1 -- 172.21.15.133:0/1666277757 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e74152d30 con 0x7f9e740c7ea0 2023-12-19T19:01:36.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.168+0000 7f9e7c7d1640 1 -- 172.21.15.133:0/1666277757 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e74068400 con 0x7f9e740c7ea0 2023-12-19T19:01:36.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.172+0000 7f9e6affd640 1 -- 172.21.15.133:0/1666277757 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9e64009cd0 con 0x7f9e740c7ea0 2023-12-19T19:01:36.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.172+0000 7f9e6affd640 1 --2- 172.21.15.133:0/1666277757 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9e58066470 0x7f9e58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:36.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.172+0000 7f9e6affd640 1 -- 172.21.15.133:0/1666277757 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e64084ad0 con 0x7f9e740c7ea0 2023-12-19T19:01:36.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.172+0000 7f9e7a56d640 1 --2- 172.21.15.133:0/1666277757 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9e58066470 0x7f9e58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:36.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.172+0000 7f9e7a56d640 1 --2- 172.21.15.133:0/1666277757 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9e58066470 0x7f9e58068930 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9e700ad000 tx=0x7f9e700a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:36.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.176+0000 7f9e6affd640 1 -- 172.21.15.133:0/1666277757 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9e64051fe0 con 0x7f9e740c7ea0 2023-12-19T19:01:36.331 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.328+0000 7f9e7c7d1640 1 -- 172.21.15.133:0/1666277757 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e7406ca50 con 0x7f9e740c7ea0 2023-12-19T19:01:36.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.328+0000 7f9e6affd640 1 -- 172.21.15.133:0/1666277757 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16609 (secure 0 0 0) 0x7f9e64055600 con 0x7f9e740c7ea0 2023-12-19T19:01:36.333 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:36.333 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":68,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:01:35.355680+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:01:33.082188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T19:01:34.349092+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:01:36.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.328+0000 7f9e7c7d1640 1 -- 172.21.15.133:0/1666277757 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9e58066470 msgr2=0x7f9e58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:36.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.328+0000 7f9e7c7d1640 1 --2- 172.21.15.133:0/1666277757 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9e58066470 0x7f9e58068930 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9e700ad000 tx=0x7f9e700a6000 comp rx=0 tx=0).stop 2023-12-19T19:01:36.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.328+0000 7f9e7c7d1640 1 -- 172.21.15.133:0/1666277757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e740c7ea0 msgr2=0x7f9e740ab810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:36.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.328+0000 7f9e7c7d1640 1 --2- 172.21.15.133:0/1666277757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e740c7ea0 0x7f9e740ab810 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f9e6400d800 tx=0x7f9e6400dcc0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.328+0000 7f9e7c7d1640 1 -- 172.21.15.133:0/1666277757 shutdown_connections 2023-12-19T19:01:36.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.328+0000 7f9e7c7d1640 1 --2- 172.21.15.133:0/1666277757 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9e58066470 0x7f9e58068930 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.328+0000 7f9e7c7d1640 1 --2- 172.21.15.133:0/1666277757 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9e74151e90 0x7f9e741431b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.328+0000 7f9e7c7d1640 1 --2- 172.21.15.133:0/1666277757 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e740c7ea0 0x7f9e740ab810 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.328+0000 7f9e7c7d1640 1 --2- 172.21.15.133:0/1666277757 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9e740c4e60 0x7f9e741527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.328+0000 7f9e7c7d1640 1 -- 172.21.15.133:0/1666277757 >> 172.21.15.133:0/1666277757 conn(0x7f9e740ca170 msgr2=0x7f9e7414f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:36.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.328+0000 7f9e7c7d1640 1 -- 172.21.15.133:0/1666277757 shutdown_connections 2023-12-19T19:01:36.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.328+0000 7f9e7c7d1640 1 -- 172.21.15.133:0/1666277757 wait complete. 2023-12-19T19:01:36.354 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:01:36.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.488+0000 7f1c88079640 1 Processor -- start 2023-12-19T19:01:36.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.488+0000 7f1c88079640 1 -- start start 2023-12-19T19:01:36.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.488+0000 7f1c88079640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c80072090 0x7f1c80150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:36.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.488+0000 7f1c88079640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c800c2760 con 0x7f1c800a5370 2023-12-19T19:01:36.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.488+0000 7f1c88079640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c800a5750 con 0x7f1c800725c0 2023-12-19T19:01:36.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.488+0000 7f1c88079640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c800c3070 con 0x7f1c80072090 2023-12-19T19:01:36.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.488+0000 7f1c85614640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c80072090 0x7f1c80150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:36.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.488+0000 7f1c85e15640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1c800a5370 0x7f1c800c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47970/0 (socket says 172.21.15.133:47970) 2023-12-19T19:01:36.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.488+0000 7f1c85e15640 1 -- 172.21.15.133:0/3913217693 learned_addr learned my addr 172.21.15.133:0/3913217693 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:36.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.488+0000 7f1c85614640 1 -- 172.21.15.133:0/3913217693 >> v1:172.21.15.138:6789/0 conn(0x7f1c800725c0 legacy=0x7f1c801514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:36.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.488+0000 7f1c85614640 1 -- 172.21.15.133:0/3913217693 >> v1:172.21.15.133:6789/0 conn(0x7f1c800a5370 legacy=0x7f1c800c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:36.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.488+0000 7f1c85614640 1 -- 172.21.15.133:0/3913217693 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c800aad20 con 0x7f1c80072090 2023-12-19T19:01:36.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.492+0000 7f1c85614640 1 --2- 172.21.15.133:0/3913217693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c80072090 0x7f1c80150fa0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f1c700097c0 tx=0x7f1c7001d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773be94d1fb599ce server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:36.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.492+0000 7f1c84e13640 1 -- 172.21.15.133:0/3913217693 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c700ac600 con 0x7f1c80072090 2023-12-19T19:01:36.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.492+0000 7f1c84e13640 1 -- 172.21.15.133:0/3913217693 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c700a8050 con 0x7f1c80072090 2023-12-19T19:01:36.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.492+0000 7f1c84e13640 1 -- 172.21.15.133:0/3913217693 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c700ac980 con 0x7f1c80072090 2023-12-19T19:01:36.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.492+0000 7f1c88079640 1 -- 172.21.15.133:0/3913217693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c80072090 msgr2=0x7f1c80150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:36.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.492+0000 7f1c88079640 1 --2- 172.21.15.133:0/3913217693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c80072090 0x7f1c80150fa0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f1c700097c0 tx=0x7f1c7001d430 comp rx=0 tx=0).stop 2023-12-19T19:01:36.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.492+0000 7f1c88079640 1 -- 172.21.15.133:0/3913217693 shutdown_connections 2023-12-19T19:01:36.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.492+0000 7f1c88079640 1 --2- 172.21.15.133:0/3913217693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c80072090 0x7f1c80150fa0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.492+0000 7f1c88079640 1 -- 172.21.15.133:0/3913217693 >> 172.21.15.133:0/3913217693 conn(0x7f1c8006a5b0 msgr2=0x7f1c8006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:36.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.492+0000 7f1c88079640 1 -- 172.21.15.133:0/3913217693 shutdown_connections 2023-12-19T19:01:36.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.492+0000 7f1c88079640 1 -- 172.21.15.133:0/3913217693 wait complete. 2023-12-19T19:01:36.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.496+0000 7f1c88079640 1 Processor -- start 2023-12-19T19:01:36.499 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.496+0000 7f1c88079640 1 -- start start 2023-12-19T19:01:36.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.496+0000 7f1c88079640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c80072090 0x7f1c801eebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:36.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.496+0000 7f1c88079640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c800725c0 0x7f1c8014e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:36.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.496+0000 7f1c88079640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1c800a5370 0x7f1c80148f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:36.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.496+0000 7f1c88079640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c80149f70 con 0x7f1c80072090 2023-12-19T19:01:36.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.496+0000 7f1c88079640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c801ef4d0 con 0x7f1c800725c0 2023-12-19T19:01:36.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.496+0000 7f1c88079640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c801ef7b0 con 0x7f1c800a5370 2023-12-19T19:01:36.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.496+0000 7f1c85e15640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c80072090 0x7f1c801eebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:36.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.496+0000 7f1c85e15640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c80072090 0x7f1c801eebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53568/0 (socket says 172.21.15.133:53568) 2023-12-19T19:01:36.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.496+0000 7f1c85e15640 1 -- 172.21.15.133:0/1489767485 learned_addr learned my addr 172.21.15.133:0/1489767485 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:36.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.496+0000 7f1c85e15640 1 -- 172.21.15.133:0/1489767485 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1c800a5370 msgr2=0x7f1c80148f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:36.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.496+0000 7f1c85e15640 1 --2- 172.21.15.133:0/1489767485 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1c800a5370 0x7f1c80148f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.496+0000 7f1c85e15640 1 -- 172.21.15.133:0/1489767485 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c800725c0 msgr2=0x7f1c8014e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:36.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.496+0000 7f1c85e15640 1 --2- 172.21.15.133:0/1489767485 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c800725c0 0x7f1c8014e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.496+0000 7f1c85e15640 1 -- 172.21.15.133:0/1489767485 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c70009420 con 0x7f1c80072090 2023-12-19T19:01:36.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.496+0000 7f1c85e15640 1 --2- 172.21.15.133:0/1489767485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c80072090 0x7f1c801eebf0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c00c400 tx=0x7f1c7c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:36.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.496+0000 7f1c767fc640 1 -- 172.21.15.133:0/1489767485 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c005cf0 con 0x7f1c80072090 2023-12-19T19:01:36.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.496+0000 7f1c767fc640 1 -- 172.21.15.133:0/1489767485 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7c005e50 con 0x7f1c80072090 2023-12-19T19:01:36.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.496+0000 7f1c767fc640 1 -- 172.21.15.133:0/1489767485 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7c0072d0 con 0x7f1c80072090 2023-12-19T19:01:36.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.496+0000 7f1c88079640 1 -- 172.21.15.133:0/1489767485 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c800bad90 con 0x7f1c80072090 2023-12-19T19:01:36.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.496+0000 7f1c88079640 1 -- 172.21.15.133:0/1489767485 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c800bc1f0 con 0x7f1c80072090 2023-12-19T19:01:36.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.496+0000 7f1c88079640 1 -- 172.21.15.133:0/1489767485 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c80068400 con 0x7f1c80072090 2023-12-19T19:01:36.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.500+0000 7f1c767fc640 1 -- 172.21.15.133:0/1489767485 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1c7c007430 con 0x7f1c80072090 2023-12-19T19:01:36.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.500+0000 7f1c767fc640 1 --2- 172.21.15.133:0/1489767485 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1c64066470 0x7f1c64068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:36.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.500+0000 7f1c767fc640 1 -- 172.21.15.133:0/1489767485 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c7c083350 con 0x7f1c80072090 2023-12-19T19:01:36.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.500+0000 7f1c85614640 1 --2- 172.21.15.133:0/1489767485 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1c64066470 0x7f1c64068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:36.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.500+0000 7f1c85614640 1 --2- 172.21.15.133:0/1489767485 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1c64066470 0x7f1c64068930 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1c700ae000 tx=0x7f1c70004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:36.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.504+0000 7f1c767fc640 1 -- 172.21.15.133:0/1489767485 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1c7c050870 con 0x7f1c80072090 2023-12-19T19:01:36.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.656+0000 7f1c88079640 1 -- 172.21.15.133:0/1489767485 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c800c11a0 con 0x7f1c80072090 2023-12-19T19:01:36.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.656+0000 7f1c767fc640 1 -- 172.21.15.133:0/1489767485 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+16609 (secure 0 0 0) 0x7f1c7c053e90 con 0x7f1c80072090 2023-12-19T19:01:36.663 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:36.663 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":68,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:01:35.355680+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:01:33.082188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T19:01:34.349092+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:01:36.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.660+0000 7f1c88079640 1 -- 172.21.15.133:0/1489767485 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1c64066470 msgr2=0x7f1c64068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:36.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.660+0000 7f1c88079640 1 --2- 172.21.15.133:0/1489767485 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1c64066470 0x7f1c64068930 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f1c700ae000 tx=0x7f1c70004740 comp rx=0 tx=0).stop 2023-12-19T19:01:36.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.660+0000 7f1c88079640 1 -- 172.21.15.133:0/1489767485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c80072090 msgr2=0x7f1c801eebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:36.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.660+0000 7f1c88079640 1 --2- 172.21.15.133:0/1489767485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c80072090 0x7f1c801eebf0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f1c7c00c400 tx=0x7f1c7c00c8c0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.660+0000 7f1c88079640 1 -- 172.21.15.133:0/1489767485 shutdown_connections 2023-12-19T19:01:36.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.660+0000 7f1c88079640 1 --2- 172.21.15.133:0/1489767485 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1c64066470 0x7f1c64068930 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.660+0000 7f1c88079640 1 --2- 172.21.15.133:0/1489767485 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1c800a5370 0x7f1c80148f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.660+0000 7f1c88079640 1 --2- 172.21.15.133:0/1489767485 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1c800725c0 0x7f1c8014e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.660+0000 7f1c88079640 1 --2- 172.21.15.133:0/1489767485 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c80072090 0x7f1c801eebf0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.660+0000 7f1c88079640 1 -- 172.21.15.133:0/1489767485 >> 172.21.15.133:0/1489767485 conn(0x7f1c8006a5b0 msgr2=0x7f1c800a9510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:36.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.660+0000 7f1c88079640 1 -- 172.21.15.133:0/1489767485 shutdown_connections 2023-12-19T19:01:36.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.660+0000 7f1c88079640 1 -- 172.21.15.133:0/1489767485 wait complete. 2023-12-19T19:01:36.684 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T19:01:36.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.820+0000 7fc0d0372640 1 Processor -- start 2023-12-19T19:01:36.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.820+0000 7fc0d0372640 1 -- start start 2023-12-19T19:01:36.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.820+0000 7fc0d0372640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc0c8151e90 0x7fc0c80c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:36.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.820+0000 7fc0d0372640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc0c80c7ea0 0x7fc0c806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:36.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.820+0000 7fc0d0372640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0c80c4e60 0x7fc0c806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:36.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.820+0000 7fc0d0372640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c80c8750 con 0x7fc0c80c7ea0 2023-12-19T19:01:36.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.820+0000 7fc0d0372640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c81552d0 con 0x7fc0c8151e90 2023-12-19T19:01:36.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.820+0000 7fc0d0372640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c80c5c60 con 0x7fc0c80c4e60 2023-12-19T19:01:36.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.820+0000 7fc0cd90d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc0c80c7ea0 0x7fc0c806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:36.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.820+0000 7fc0cd90d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc0c80c7ea0 0x7fc0c806b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53578/0 (socket says 172.21.15.133:53578) 2023-12-19T19:01:36.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.820+0000 7fc0cd90d640 1 -- 172.21.15.133:0/1888110115 learned_addr learned my addr 172.21.15.133:0/1888110115 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:36.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.820+0000 7fc0ce90f640 1 --2- 172.21.15.133:0/1888110115 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0c80c4e60 0x7fc0c806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:36.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.820+0000 7fc0ce10e640 1 --2- 172.21.15.133:0/1888110115 >> v2:172.21.15.138:3300/0 conn(0x7fc0c8151e90 0x7fc0c80c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:36.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.820+0000 7fc0cd90d640 1 -- 172.21.15.133:0/1888110115 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0c80c4e60 msgr2=0x7fc0c806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:36.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.820+0000 7fc0cd90d640 1 --2- 172.21.15.133:0/1888110115 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0c80c4e60 0x7fc0c806b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.820+0000 7fc0cd90d640 1 -- 172.21.15.133:0/1888110115 >> v2:172.21.15.138:3300/0 conn(0x7fc0c8151e90 msgr2=0x7fc0c80c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:36.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.820+0000 7fc0cd90d640 1 --2- 172.21.15.133:0/1888110115 >> v2:172.21.15.138:3300/0 conn(0x7fc0c8151e90 0x7fc0c80c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.820+0000 7fc0cd90d640 1 -- 172.21.15.133:0/1888110115 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c806c860 con 0x7fc0c80c7ea0 2023-12-19T19:01:36.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.820+0000 7fc0ce90f640 1 --2- 172.21.15.133:0/1888110115 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0c80c4e60 0x7fc0c806b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:36.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.820+0000 7fc0ce10e640 1 --2- 172.21.15.133:0/1888110115 >> v2:172.21.15.138:3300/0 conn(0x7fc0c8151e90 0x7fc0c80c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:36.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.824+0000 7fc0cd90d640 1 --2- 172.21.15.133:0/1888110115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0c80c7ea0 0x7fc0c806b4a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc0c808b410 tx=0x7fc0b801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2b033a731837ae server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:36.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.824+0000 7fc0cd10c640 1 -- 172.21.15.133:0/1888110115 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b80ab600 con 0x7fc0c80c7ea0 2023-12-19T19:01:36.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.824+0000 7fc0cd10c640 1 -- 172.21.15.133:0/1888110115 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b80a7050 con 0x7fc0c80c7ea0 2023-12-19T19:01:36.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.824+0000 7fc0cd10c640 1 -- 172.21.15.133:0/1888110115 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b80ab980 con 0x7fc0c80c7ea0 2023-12-19T19:01:36.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.824+0000 7fc0d0372640 1 -- 172.21.15.133:0/1888110115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0c80c7ea0 msgr2=0x7fc0c806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:36.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.824+0000 7fc0d0372640 1 --2- 172.21.15.133:0/1888110115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0c80c7ea0 0x7fc0c806b4a0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fc0c808b410 tx=0x7fc0b801c3e0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.824+0000 7fc0d0372640 1 -- 172.21.15.133:0/1888110115 shutdown_connections 2023-12-19T19:01:36.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.824+0000 7fc0d0372640 1 --2- 172.21.15.133:0/1888110115 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0c80c4e60 0x7fc0c806b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.824+0000 7fc0d0372640 1 --2- 172.21.15.133:0/1888110115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0c80c7ea0 0x7fc0c806b4a0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.824+0000 7fc0d0372640 1 --2- 172.21.15.133:0/1888110115 >> v2:172.21.15.138:3300/0 conn(0x7fc0c8151e90 0x7fc0c80c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.824+0000 7fc0d0372640 1 -- 172.21.15.133:0/1888110115 >> 172.21.15.133:0/1888110115 conn(0x7fc0c80ca170 msgr2=0x7fc0c80ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:36.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.824+0000 7fc0d0372640 1 -- 172.21.15.133:0/1888110115 shutdown_connections 2023-12-19T19:01:36.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.824+0000 7fc0d0372640 1 -- 172.21.15.133:0/1888110115 wait complete. 2023-12-19T19:01:36.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0d0372640 1 Processor -- start 2023-12-19T19:01:36.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0d0372640 1 -- start start 2023-12-19T19:01:36.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0d0372640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0c80c4e60 0x7fc0c80ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:36.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0d0372640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0c80c7ea0 0x7fc0c814d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:36.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0d0372640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0c8151e90 0x7fc0c814ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:36.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0d0372640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c80c39c0 con 0x7fc0c80c4e60 2023-12-19T19:01:36.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0d0372640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c814ce80 con 0x7fc0c8151e90 2023-12-19T19:01:36.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0d0372640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c814cb30 con 0x7fc0c80c7ea0 2023-12-19T19:01:36.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0ce10e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0c80c4e60 0x7fc0c80ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:36.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0ce10e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0c80c4e60 0x7fc0c80ad7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53588/0 (socket says 172.21.15.133:53588) 2023-12-19T19:01:36.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0ce10e640 1 -- 172.21.15.133:0/2088533176 learned_addr learned my addr 172.21.15.133:0/2088533176 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:36.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0ce90f640 1 --2- 172.21.15.133:0/2088533176 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0c8151e90 0x7fc0c814ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:36.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0cd90d640 1 --2- 172.21.15.133:0/2088533176 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0c80c7ea0 0x7fc0c814d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:36.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0ce10e640 1 -- 172.21.15.133:0/2088533176 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0c80c7ea0 msgr2=0x7fc0c814d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:36.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0ce10e640 1 --2- 172.21.15.133:0/2088533176 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0c80c7ea0 0x7fc0c814d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0ce10e640 1 -- 172.21.15.133:0/2088533176 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0c8151e90 msgr2=0x7fc0c814ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:36.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0ce10e640 1 --2- 172.21.15.133:0/2088533176 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0c8151e90 0x7fc0c814ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:36.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0ce10e640 1 -- 172.21.15.133:0/2088533176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b80094d0 con 0x7fc0c80c4e60 2023-12-19T19:01:36.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0ce10e640 1 --2- 172.21.15.133:0/2088533176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0c80c4e60 0x7fc0c80ad7d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400c7c0 tx=0x7fc0c400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:36.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0beffd640 1 -- 172.21.15.133:0/2088533176 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c4007a30 con 0x7fc0c80c4e60 2023-12-19T19:01:36.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0beffd640 1 -- 172.21.15.133:0/2088533176 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c4007b90 con 0x7fc0c80c4e60 2023-12-19T19:01:36.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0d0372640 1 -- 172.21.15.133:0/2088533176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c814ba40 con 0x7fc0c80c4e60 2023-12-19T19:01:36.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0beffd640 1 -- 172.21.15.133:0/2088533176 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c400ce70 con 0x7fc0c80c4e60 2023-12-19T19:01:36.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.828+0000 7fc0d0372640 1 -- 172.21.15.133:0/2088533176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c814df70 con 0x7fc0c80c4e60 2023-12-19T19:01:36.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.832+0000 7fc0d0372640 1 -- 172.21.15.133:0/2088533176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c8068400 con 0x7fc0c80c4e60 2023-12-19T19:01:36.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.832+0000 7fc0beffd640 1 -- 172.21.15.133:0/2088533176 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc0c40113f0 con 0x7fc0c80c4e60 2023-12-19T19:01:36.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.832+0000 7fc0beffd640 1 --2- 172.21.15.133:0/2088533176 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc0ac066470 0x7fc0ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:36.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.832+0000 7fc0beffd640 1 -- 172.21.15.133:0/2088533176 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0c4084370 con 0x7fc0c80c4e60 2023-12-19T19:01:36.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.832+0000 7fc0cd90d640 1 --2- 172.21.15.133:0/2088533176 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc0ac066470 0x7fc0ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:36.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.836+0000 7fc0cd90d640 1 --2- 172.21.15.133:0/2088533176 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc0ac066470 0x7fc0ac068930 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80ad000 tx=0x7fc0b80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:36.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:36.836+0000 7fc0beffd640 1 -- 172.21.15.133:0/2088533176 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc0c4051800 con 0x7fc0c80c4e60 2023-12-19T19:01:37.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:37.024+0000 7fc0d0372640 1 -- 172.21.15.133:0/2088533176 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc0c80674e0 con 0x7fc0c80c4e60 2023-12-19T19:01:38.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.000+0000 7fc0beffd640 1 -- 172.21.15.133:0/2088533176 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc0c4054e20 con 0x7fc0c80c4e60 2023-12-19T19:01:38.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.000+0000 7fc0d0372640 1 -- 172.21.15.133:0/2088533176 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc0ac066470 msgr2=0x7fc0ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:38.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.000+0000 7fc0d0372640 1 --2- 172.21.15.133:0/2088533176 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc0ac066470 0x7fc0ac068930 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fc0b80ad000 tx=0x7fc0b80a6000 comp rx=0 tx=0).stop 2023-12-19T19:01:38.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.000+0000 7fc0d0372640 1 -- 172.21.15.133:0/2088533176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0c80c4e60 msgr2=0x7fc0c80ad7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:38.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.000+0000 7fc0d0372640 1 --2- 172.21.15.133:0/2088533176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0c80c4e60 0x7fc0c80ad7d0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fc0c400c7c0 tx=0x7fc0c400cc80 comp rx=0 tx=0).stop 2023-12-19T19:01:38.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.000+0000 7fc0d0372640 1 -- 172.21.15.133:0/2088533176 shutdown_connections 2023-12-19T19:01:38.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.000+0000 7fc0d0372640 1 --2- 172.21.15.133:0/2088533176 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc0ac066470 0x7fc0ac068930 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:38.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.000+0000 7fc0d0372640 1 --2- 172.21.15.133:0/2088533176 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc0c8151e90 0x7fc0c814ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:38.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.000+0000 7fc0d0372640 1 --2- 172.21.15.133:0/2088533176 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc0c80c7ea0 0x7fc0c814d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:38.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.000+0000 7fc0d0372640 1 --2- 172.21.15.133:0/2088533176 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc0c80c4e60 0x7fc0c80ad7d0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:38.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.000+0000 7fc0d0372640 1 -- 172.21.15.133:0/2088533176 >> 172.21.15.133:0/2088533176 conn(0x7fc0c80ca170 msgr2=0x7fc0c8155b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:38.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.000+0000 7fc0d0372640 1 -- 172.21.15.133:0/2088533176 shutdown_connections 2023-12-19T19:01:38.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.000+0000 7fc0d0372640 1 -- 172.21.15.133:0/2088533176 wait complete. 2023-12-19T19:01:38.030 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T19:01:38.030 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T19:01:38.173 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.168+0000 7f570f580640 1 Processor -- start 2023-12-19T19:01:38.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.168+0000 7f570f580640 1 -- start start 2023-12-19T19:01:38.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.168+0000 7f570f580640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57080a5240 0x7f57080bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:38.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.168+0000 7f570f580640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57080c01c0 0x7f57080c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.168+0000 7f570f580640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f57080c61a0 0x7f57081561f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.168+0000 7f570f580640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57080c3bd0 con 0x7f57080c01c0 2023-12-19T19:01:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.168+0000 7f570f580640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57080bf1e0 con 0x7f57080c61a0 2023-12-19T19:01:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.168+0000 7f570f580640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57080c3e20 con 0x7f57080a5240 2023-12-19T19:01:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.172+0000 7f570cb1b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57080c01c0 0x7f57080c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.172+0000 7f570cb1b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57080c01c0 0x7f57080c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53602/0 (socket says 172.21.15.133:53602) 2023-12-19T19:01:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.172+0000 7f570cb1b640 1 -- 172.21.15.133:0/4009868216 learned_addr learned my addr 172.21.15.133:0/4009868216 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.172+0000 7f570db1d640 1 --2- 172.21.15.133:0/4009868216 >> v2:172.21.15.138:3300/0 conn(0x7f57080c61a0 0x7f57081561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.172+0000 7f570d31c640 1 --2- 172.21.15.133:0/4009868216 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57080a5240 0x7f57080bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.172+0000 7f570cb1b640 1 -- 172.21.15.133:0/4009868216 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57080a5240 msgr2=0x7f57080bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.172+0000 7f570cb1b640 1 --2- 172.21.15.133:0/4009868216 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57080a5240 0x7f57080bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.172+0000 7f570cb1b640 1 -- 172.21.15.133:0/4009868216 >> v2:172.21.15.138:3300/0 conn(0x7f57080c61a0 msgr2=0x7f57081561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.172+0000 7f570cb1b640 1 --2- 172.21.15.133:0/4009868216 >> v2:172.21.15.138:3300/0 conn(0x7f57080c61a0 0x7f57081561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:38.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.172+0000 7f570cb1b640 1 -- 172.21.15.133:0/4009868216 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57080c4100 con 0x7f57080c01c0 2023-12-19T19:01:38.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.172+0000 7f570cb1b640 1 --2- 172.21.15.133:0/4009868216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57080c01c0 0x7f57080c5c60 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f56f8009870 tx=0x7f56f801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8080c6ce0af730e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:38.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.172+0000 7f56fffff640 1 -- 172.21.15.133:0/4009868216 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5708156f40 con 0x7f57080c01c0 2023-12-19T19:01:38.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.172+0000 7f56fffff640 1 -- 172.21.15.133:0/4009868216 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f80ab600 con 0x7f57080c01c0 2023-12-19T19:01:38.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.172+0000 7f56fffff640 1 -- 172.21.15.133:0/4009868216 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f80ab990 con 0x7f57080c01c0 2023-12-19T19:01:38.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570f580640 1 -- 172.21.15.133:0/4009868216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57080c01c0 msgr2=0x7f57080c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:38.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570f580640 1 --2- 172.21.15.133:0/4009868216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57080c01c0 0x7f57080c5c60 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f56f8009870 tx=0x7f56f801c440 comp rx=0 tx=0).stop 2023-12-19T19:01:38.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570f580640 1 -- 172.21.15.133:0/4009868216 shutdown_connections 2023-12-19T19:01:38.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570f580640 1 --2- 172.21.15.133:0/4009868216 >> v2:172.21.15.138:3300/0 conn(0x7f57080c61a0 0x7f57081561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:38.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570f580640 1 --2- 172.21.15.133:0/4009868216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57080c01c0 0x7f57080c5c60 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:38.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570f580640 1 --2- 172.21.15.133:0/4009868216 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57080a5240 0x7f57080bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:38.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570f580640 1 -- 172.21.15.133:0/4009868216 >> 172.21.15.133:0/4009868216 conn(0x7f570806a5b0 msgr2=0x7f570806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:38.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570f580640 1 -- 172.21.15.133:0/4009868216 shutdown_connections 2023-12-19T19:01:38.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570f580640 1 -- 172.21.15.133:0/4009868216 wait complete. 2023-12-19T19:01:38.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570f580640 1 Processor -- start 2023-12-19T19:01:38.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570f580640 1 -- start start 2023-12-19T19:01:38.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570f580640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57080a5240 0x7f57080a46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:38.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570f580640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57080c01c0 0x7f57080bd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:38.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570f580640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57080c61a0 0x7f5708071230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:38.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570f580640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57080a3420 con 0x7f57080c01c0 2023-12-19T19:01:38.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570f580640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57081f1ac0 con 0x7f57080a5240 2023-12-19T19:01:38.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570f580640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57081f1d60 con 0x7f57080c61a0 2023-12-19T19:01:38.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570cb1b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57080c01c0 0x7f57080bd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:38.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570cb1b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57080c01c0 0x7f57080bd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53612/0 (socket says 172.21.15.133:53612) 2023-12-19T19:01:38.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570cb1b640 1 -- 172.21.15.133:0/2765705112 learned_addr learned my addr 172.21.15.133:0/2765705112 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:38.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570db1d640 1 --2- 172.21.15.133:0/2765705112 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57080c61a0 0x7f5708071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:38.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570d31c640 1 --2- 172.21.15.133:0/2765705112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57080a5240 0x7f57080a46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:38.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570cb1b640 1 -- 172.21.15.133:0/2765705112 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57080c61a0 msgr2=0x7f5708071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:38.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570cb1b640 1 --2- 172.21.15.133:0/2765705112 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57080c61a0 0x7f5708071230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:38.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570cb1b640 1 -- 172.21.15.133:0/2765705112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57080a5240 msgr2=0x7f57080a46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:38.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570cb1b640 1 --2- 172.21.15.133:0/2765705112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57080a5240 0x7f57080a46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:38.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.176+0000 7f570cb1b640 1 -- 172.21.15.133:0/2765705112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f80094d0 con 0x7f57080c01c0 2023-12-19T19:01:38.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.180+0000 7f570cb1b640 1 --2- 172.21.15.133:0/2765705112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57080c01c0 0x7f57080bd320 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f56f801aaf0 tx=0x7f56f801ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:38.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.180+0000 7f56fdffb640 1 -- 172.21.15.133:0/2765705112 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f80b4800 con 0x7f57080c01c0 2023-12-19T19:01:38.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.180+0000 7f56fdffb640 1 -- 172.21.15.133:0/2765705112 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f80b4960 con 0x7f57080c01c0 2023-12-19T19:01:38.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.180+0000 7f56fdffb640 1 -- 172.21.15.133:0/2765705112 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f80b4d10 con 0x7f57080c01c0 2023-12-19T19:01:38.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.180+0000 7f570f580640 1 -- 172.21.15.133:0/2765705112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57080a3670 con 0x7f57080c01c0 2023-12-19T19:01:38.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.180+0000 7f570f580640 1 -- 172.21.15.133:0/2765705112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5708071770 con 0x7f57080c01c0 2023-12-19T19:01:38.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.180+0000 7f570f580640 1 -- 172.21.15.133:0/2765705112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57080c52e0 con 0x7f57080c01c0 2023-12-19T19:01:38.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.180+0000 7f56fdffb640 1 -- 172.21.15.133:0/2765705112 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f56f80c7440 con 0x7f57080c01c0 2023-12-19T19:01:38.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.180+0000 7f56fdffb640 1 --2- 172.21.15.133:0/2765705112 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f56ec066470 0x7f56ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:38.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.184+0000 7f56fdffb640 1 -- 172.21.15.133:0/2765705112 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56f811e860 con 0x7f57080c01c0 2023-12-19T19:01:38.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.184+0000 7f570d31c640 1 --2- 172.21.15.133:0/2765705112 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f56ec066470 0x7f56ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:38.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.184+0000 7f570d31c640 1 --2- 172.21.15.133:0/2765705112 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f56ec066470 0x7f56ec068930 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f57040045f0 tx=0x7f5704008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:38.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.188+0000 7f56fdffb640 1 -- 172.21.15.133:0/2765705112 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f56f80ebd80 con 0x7f57080c01c0 2023-12-19T19:01:38.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:38.372+0000 7f570f580640 1 -- 172.21.15.133:0/2765705112 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f57081f1ea0 con 0x7f57080c01c0 2023-12-19T19:01:39.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.004+0000 7f56fdffb640 1 -- 172.21.15.133:0/2765705112 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v48) v1 ==== 122+0+0 (secure 0 0 0) 0x7f57081f1ea0 con 0x7f57080c01c0 2023-12-19T19:01:39.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.008+0000 7f570f580640 1 -- 172.21.15.133:0/2765705112 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f56ec066470 msgr2=0x7f56ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:39.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.008+0000 7f570f580640 1 --2- 172.21.15.133:0/2765705112 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f56ec066470 0x7f56ec068930 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f57040045f0 tx=0x7f5704008040 comp rx=0 tx=0).stop 2023-12-19T19:01:39.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.008+0000 7f570f580640 1 -- 172.21.15.133:0/2765705112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57080c01c0 msgr2=0x7f57080bd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:39.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.008+0000 7f570f580640 1 --2- 172.21.15.133:0/2765705112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57080c01c0 0x7f57080bd320 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f56f801aaf0 tx=0x7f56f801ac80 comp rx=0 tx=0).stop 2023-12-19T19:01:39.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.008+0000 7f570f580640 1 -- 172.21.15.133:0/2765705112 shutdown_connections 2023-12-19T19:01:39.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.008+0000 7f570f580640 1 --2- 172.21.15.133:0/2765705112 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f56ec066470 0x7f56ec068930 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.008+0000 7f570f580640 1 --2- 172.21.15.133:0/2765705112 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57080c61a0 0x7f5708071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.008+0000 7f570f580640 1 --2- 172.21.15.133:0/2765705112 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57080c01c0 0x7f57080bd320 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.008+0000 7f570f580640 1 --2- 172.21.15.133:0/2765705112 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57080a5240 0x7f57080a46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.008+0000 7f570f580640 1 -- 172.21.15.133:0/2765705112 >> 172.21.15.133:0/2765705112 conn(0x7f570806a5b0 msgr2=0x7f570806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:39.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.008+0000 7f570f580640 1 -- 172.21.15.133:0/2765705112 shutdown_connections 2023-12-19T19:01:39.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.008+0000 7f570f580640 1 -- 172.21.15.133:0/2765705112 wait complete. 2023-12-19T19:01:39.035 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T19:01:39.035 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:01:39.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.168+0000 7f9ade565640 1 Processor -- start 2023-12-19T19:01:39.174 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.168+0000 7f9ade565640 1 -- start start 2023-12-19T19:01:39.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ade565640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ad80c63c0 0x7f9ad80c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:39.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ade565640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad80c31c0 con 0x7f9ad80c4100 2023-12-19T19:01:39.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ade565640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ad80c34a0 con 0x7f9ad80c2bb0 2023-12-19T19:01:39.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ade565640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad80c1030 con 0x7f9ad80c63c0 2023-12-19T19:01:39.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad77fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9ad80c4100 0x7f9ad80c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47972/0 (socket says 172.21.15.133:47972) 2023-12-19T19:01:39.175 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad77fe640 1 -- 172.21.15.133:0/383968719 learned_addr learned my addr 172.21.15.133:0/383968719 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:39.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad7fff640 1 --2- 172.21.15.133:0/383968719 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ad80c63c0 0x7f9ad80c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:39.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad6ffd640 1 -- 172.21.15.133:0/383968719 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734268689 0 0) 0x7f9ad80c31c0 con 0x7f9ad80c4100 2023-12-19T19:01:39.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad6ffd640 1 -- 172.21.15.133:0/383968719 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ac0003530 con 0x7f9ad80c4100 2023-12-19T19:01:39.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad6ffd640 1 -- 172.21.15.133:0/383968719 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1179428473 0 0) 0x7f9ac0003530 con 0x7f9ad80c4100 2023-12-19T19:01:39.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad6ffd640 1 -- 172.21.15.133:0/383968719 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ad80c63c0 msgr2=0x7f9ad80c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:39.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad6ffd640 1 --2- 172.21.15.133:0/383968719 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ad80c63c0 0x7f9ad80c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad6ffd640 1 -- 172.21.15.133:0/383968719 >> v1:172.21.15.138:6789/0 conn(0x7f9ad80c2bb0 legacy=0x7f9ad80a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:39.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad6ffd640 1 -- 172.21.15.133:0/383968719 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad80c1310 con 0x7f9ad80c4100 2023-12-19T19:01:39.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad6ffd640 1 -- 172.21.15.133:0/383968719 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f9acc001680 con 0x7f9ad80c4100 2023-12-19T19:01:39.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad6ffd640 1 -- 172.21.15.133:0/383968719 >> v1:172.21.15.133:6789/0 conn(0x7f9ad80c4100 legacy=0x7f9ad80c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:39.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad6ffd640 1 --2- 172.21.15.133:0/383968719 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ac00039b0 0x7f9ac0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:39.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad6ffd640 1 --2- 172.21.15.133:0/383968719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ac00047d0 0x7f9ac0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:39.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad6ffd640 1 --2- 172.21.15.133:0/383968719 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ad80c63c0 0x7f9ac00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:39.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad6ffd640 1 -- 172.21.15.133:0/383968719 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad80c1030 con 0x7f9ac00047d0 2023-12-19T19:01:39.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad6ffd640 1 -- 172.21.15.133:0/383968719 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac000bac0 con 0x7f9ac00039b0 2023-12-19T19:01:39.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad6ffd640 1 -- 172.21.15.133:0/383968719 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac000bc80 con 0x7f9ad80c63c0 2023-12-19T19:01:39.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad77fe640 1 --2- 172.21.15.133:0/383968719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ac00047d0 0x7f9ac0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:39.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad7fff640 1 --2- 172.21.15.133:0/383968719 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ac00039b0 0x7f9ac0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:39.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9adcb02640 1 --2- 172.21.15.133:0/383968719 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ad80c63c0 0x7f9ac00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:39.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad77fe640 1 -- 172.21.15.133:0/383968719 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ad80c63c0 msgr2=0x7f9ac00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:39.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad77fe640 1 --2- 172.21.15.133:0/383968719 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ad80c63c0 0x7f9ac00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad77fe640 1 -- 172.21.15.133:0/383968719 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ac00039b0 msgr2=0x7f9ac0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:39.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad77fe640 1 --2- 172.21.15.133:0/383968719 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ac00039b0 0x7f9ac0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.172+0000 7f9ad77fe640 1 -- 172.21.15.133:0/383968719 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac0003530 con 0x7f9ac00047d0 2023-12-19T19:01:39.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.176+0000 7f9ad77fe640 1 --2- 172.21.15.133:0/383968719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ac00047d0 0x7f9ac0004c50 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00c210 tx=0x7f9acc01cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4be13a4baff0d0c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:39.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.176+0000 7f9ad6ffd640 1 -- 172.21.15.133:0/383968719 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc005ae0 con 0x7f9ac00047d0 2023-12-19T19:01:39.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.176+0000 7f9ad6ffd640 1 -- 172.21.15.133:0/383968719 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9acc005c60 con 0x7f9ac00047d0 2023-12-19T19:01:39.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.176+0000 7f9ad6ffd640 1 -- 172.21.15.133:0/383968719 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc007070 con 0x7f9ac00047d0 2023-12-19T19:01:39.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.176+0000 7f9ade565640 1 -- 172.21.15.133:0/383968719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ac00047d0 msgr2=0x7f9ac0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:39.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.176+0000 7f9ade565640 1 --2- 172.21.15.133:0/383968719 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ac00047d0 0x7f9ac0004c50 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00c210 tx=0x7f9acc01cc40 comp rx=0 tx=0).stop 2023-12-19T19:01:39.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.176+0000 7f9adcb02640 1 -- 172.21.15.133:0/383968719 reap_dead start 2023-12-19T19:01:39.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.176+0000 7f9ade565640 1 -- 172.21.15.133:0/383968719 shutdown_connections 2023-12-19T19:01:39.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.176+0000 7f9ade565640 1 -- 172.21.15.133:0/383968719 >> 172.21.15.133:0/383968719 conn(0x7f9ad806a5b0 msgr2=0x7f9ad806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:39.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.176+0000 7f9ade565640 1 -- 172.21.15.133:0/383968719 shutdown_connections 2023-12-19T19:01:39.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.176+0000 7f9ade565640 1 -- 172.21.15.133:0/383968719 wait complete. 2023-12-19T19:01:39.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.176+0000 7f9ade565640 1 Processor -- start 2023-12-19T19:01:39.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.176+0000 7f9ade565640 1 -- start start 2023-12-19T19:01:39.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ade565640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ac00047d0 0x7f9ad8152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:39.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ade565640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ad814bdb0 0x7f9ad8071230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:39.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ade565640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ad814c2e0 0x7f9ad815dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:39.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ade565640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad8152390 con 0x7f9ad814bdb0 2023-12-19T19:01:39.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ade565640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad8152670 con 0x7f9ad814c2e0 2023-12-19T19:01:39.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ade565640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad8153190 con 0x7f9ac00047d0 2023-12-19T19:01:39.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ad77fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ad814bdb0 0x7f9ad8071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:39.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ad77fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ad814bdb0 0x7f9ad8071230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53632/0 (socket says 172.21.15.133:53632) 2023-12-19T19:01:39.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ad77fe640 1 -- 172.21.15.133:0/2312315807 learned_addr learned my addr 172.21.15.133:0/2312315807 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:39.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ad7fff640 1 --2- 172.21.15.133:0/2312315807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ac00047d0 0x7f9ad8152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:39.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9adcb02640 1 --2- 172.21.15.133:0/2312315807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ad814c2e0 0x7f9ad815dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:39.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ad77fe640 1 -- 172.21.15.133:0/2312315807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ac00047d0 msgr2=0x7f9ad8152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:39.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ad77fe640 1 --2- 172.21.15.133:0/2312315807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ac00047d0 0x7f9ad8152b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ad77fe640 1 -- 172.21.15.133:0/2312315807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ad814c2e0 msgr2=0x7f9ad815dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:39.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ad77fe640 1 --2- 172.21.15.133:0/2312315807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ad814c2e0 0x7f9ad815dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ad77fe640 1 -- 172.21.15.133:0/2312315807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad80c69b0 con 0x7f9ad814bdb0 2023-12-19T19:01:39.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ad7fff640 1 --2- 172.21.15.133:0/2312315807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ac00047d0 0x7f9ad8152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:01:39.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ad77fe640 1 --2- 172.21.15.133:0/2312315807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ad814bdb0 0x7f9ad8071230 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f9acc01ca70 tx=0x7f9ac0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:39.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ad4ff9640 1 -- 172.21.15.133:0/2312315807 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc0b4070 con 0x7f9ad814bdb0 2023-12-19T19:01:39.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ad4ff9640 1 -- 172.21.15.133:0/2312315807 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9acc005e50 con 0x7f9ad814bdb0 2023-12-19T19:01:39.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ad4ff9640 1 -- 172.21.15.133:0/2312315807 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9acc001660 con 0x7f9ad814bdb0 2023-12-19T19:01:39.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ade565640 1 -- 172.21.15.133:0/2312315807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad8153470 con 0x7f9ad814bdb0 2023-12-19T19:01:39.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ade565640 1 -- 172.21.15.133:0/2312315807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad8071770 con 0x7f9ad814bdb0 2023-12-19T19:01:39.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ade565640 1 -- 172.21.15.133:0/2312315807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad8068400 con 0x7f9ad814bdb0 2023-12-19T19:01:39.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.180+0000 7f9ad4ff9640 1 -- 172.21.15.133:0/2312315807 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9acc007040 con 0x7f9ad814bdb0 2023-12-19T19:01:39.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.184+0000 7f9ad4ff9640 1 --2- 172.21.15.133:0/2312315807 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9ac40664a0 0x7f9ac4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:39.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.184+0000 7f9ad4ff9640 1 -- 172.21.15.133:0/2312315807 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9acc11d6c0 con 0x7f9ad814bdb0 2023-12-19T19:01:39.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.184+0000 7f9ad7fff640 1 --2- 172.21.15.133:0/2312315807 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9ac40664a0 0x7f9ac4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:39.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.184+0000 7f9ad7fff640 1 --2- 172.21.15.133:0/2312315807 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9ac40664a0 0x7f9ac4068960 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8154f90 tx=0x7f9ac8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:39.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.188+0000 7f9ad4ff9640 1 -- 172.21.15.133:0/2312315807 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9acc0eab30 con 0x7f9ad814bdb0 2023-12-19T19:01:39.328 INFO:tasks.ceph.mds.c.smithi133.stderr:2023-12-19T19:01:39.324+0000 7f39be949640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T19:01:39.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.368+0000 7f9ade565640 1 -- 172.21.15.133:0/2312315807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ad80c3e70 con 0x7f9ad814bdb0 2023-12-19T19:01:39.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.368+0000 7f9ad4ff9640 1 -- 172.21.15.133:0/2312315807 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f9acc0ee150 con 0x7f9ad814bdb0 2023-12-19T19:01:39.374 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:39.375 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/2119189888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":2119189888},{"type":"v1","addr":"172.21.15.133:6835","nonce":2119189888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/4005236173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":4005236173},{"type":"v1","addr":"172.21.15.138:6835","nonce":4005236173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5765,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/1466041773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":1466041773},{"type":"v1","addr":"172.21.15.138:6837","nonce":1466041773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:01:35.356022+0000","modified":"2023-12-19T19:01:38.376795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6834/2813206606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2813206606},{"type":"v1","addr":"172.21.15.133:6834","nonce":2813206606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T19:01:39.375 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 48 2023-12-19T19:01:39.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.372+0000 7f9ade565640 1 -- 172.21.15.133:0/2312315807 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9ac40664a0 msgr2=0x7f9ac4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:39.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.372+0000 7f9ade565640 1 --2- 172.21.15.133:0/2312315807 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9ac40664a0 0x7f9ac4068960 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9ad8154f90 tx=0x7f9ac8009190 comp rx=0 tx=0).stop 2023-12-19T19:01:39.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.372+0000 7f9ade565640 1 -- 172.21.15.133:0/2312315807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ad814bdb0 msgr2=0x7f9ad8071230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:39.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.372+0000 7f9ade565640 1 --2- 172.21.15.133:0/2312315807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ad814bdb0 0x7f9ad8071230 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f9acc01ca70 tx=0x7f9ac0005800 comp rx=0 tx=0).stop 2023-12-19T19:01:39.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.372+0000 7f9ade565640 1 -- 172.21.15.133:0/2312315807 shutdown_connections 2023-12-19T19:01:39.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.372+0000 7f9ade565640 1 --2- 172.21.15.133:0/2312315807 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9ac40664a0 0x7f9ac4068960 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.372+0000 7f9ade565640 1 --2- 172.21.15.133:0/2312315807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9ad814c2e0 0x7f9ad815dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.372+0000 7f9ade565640 1 --2- 172.21.15.133:0/2312315807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ad814bdb0 0x7f9ad8071230 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.372+0000 7f9ade565640 1 --2- 172.21.15.133:0/2312315807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9ac00047d0 0x7f9ad8152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.372+0000 7f9ade565640 1 -- 172.21.15.133:0/2312315807 >> 172.21.15.133:0/2312315807 conn(0x7f9ad806a5b0 msgr2=0x7f9ad80c4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:39.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.372+0000 7f9ade565640 1 -- 172.21.15.133:0/2312315807 shutdown_connections 2023-12-19T19:01:39.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.372+0000 7f9ade565640 1 -- 172.21.15.133:0/2312315807 wait complete. 2023-12-19T19:01:39.396 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:01:39.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.528+0000 7fd692f80640 1 Processor -- start 2023-12-19T19:01:39.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.528+0000 7fd692f80640 1 -- start start 2023-12-19T19:01:39.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.528+0000 7fd692f80640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd68c072090 0x7fd68c0a5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:39.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.528+0000 7fd692f80640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd68c0c3bd0 0x7fd68c0c4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:39.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.528+0000 7fd692f80640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd68c0c2760 con 0x7fd68c0725c0 2023-12-19T19:01:39.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.528+0000 7fd692f80640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68c0c3070 con 0x7fd68c072090 2023-12-19T19:01:39.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.528+0000 7fd692f80640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68c0c63e0 con 0x7fd68c0c3bd0 2023-12-19T19:01:39.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.532+0000 7fd690d1c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd68c072090 0x7fd68c0a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:39.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.532+0000 7fd690d1c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd68c072090 0x7fd68c0a5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53642/0 (socket says 172.21.15.133:53642) 2023-12-19T19:01:39.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.532+0000 7fd690d1c640 1 -- 172.21.15.133:0/3786633503 learned_addr learned my addr 172.21.15.133:0/3786633503 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:39.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.532+0000 7fd69151d640 1 --2- 172.21.15.133:0/3786633503 >> v2:172.21.15.138:3300/0 conn(0x7fd68c0c3bd0 0x7fd68c0c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:39.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.532+0000 7fd690d1c640 1 -- 172.21.15.133:0/3786633503 >> v2:172.21.15.138:3300/0 conn(0x7fd68c0c3bd0 msgr2=0x7fd68c0c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:39.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.532+0000 7fd690d1c640 1 --2- 172.21.15.133:0/3786633503 >> v2:172.21.15.138:3300/0 conn(0x7fd68c0c3bd0 0x7fd68c0c4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.532+0000 7fd690d1c640 1 -- 172.21.15.133:0/3786633503 >> v1:172.21.15.138:6789/0 conn(0x7fd68c0725c0 legacy=0x7fd68c0c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:39.536 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.532+0000 7fd690d1c640 1 -- 172.21.15.133:0/3786633503 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68c0aad20 con 0x7fd68c072090 2023-12-19T19:01:39.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.532+0000 7fd690d1c640 1 --2- 172.21.15.133:0/3786633503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd68c072090 0x7fd68c0a5370 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fd68c072020 tx=0x7fd68001eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa8e0e971ebe57e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:39.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.532+0000 7fd68b7fe640 1 -- 172.21.15.133:0/3786633503 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6800a7b80 con 0x7fd68c072090 2023-12-19T19:01:39.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.532+0000 7fd68b7fe640 1 -- 172.21.15.133:0/3786633503 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6800a7ce0 con 0x7fd68c072090 2023-12-19T19:01:39.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.532+0000 7fd68b7fe640 1 -- 172.21.15.133:0/3786633503 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6800af660 con 0x7fd68c072090 2023-12-19T19:01:39.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.536+0000 7fd692f80640 1 -- 172.21.15.133:0/3786633503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd68c072090 msgr2=0x7fd68c0a5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:39.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.536+0000 7fd692f80640 1 --2- 172.21.15.133:0/3786633503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd68c072090 0x7fd68c0a5370 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fd68c072020 tx=0x7fd68001eab0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.536+0000 7fd692f80640 1 -- 172.21.15.133:0/3786633503 shutdown_connections 2023-12-19T19:01:39.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.536+0000 7fd692f80640 1 --2- 172.21.15.133:0/3786633503 >> v2:172.21.15.138:3300/0 conn(0x7fd68c0c3bd0 0x7fd68c0c4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.536+0000 7fd692f80640 1 --2- 172.21.15.133:0/3786633503 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd68c072090 0x7fd68c0a5370 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.536+0000 7fd692f80640 1 -- 172.21.15.133:0/3786633503 >> 172.21.15.133:0/3786633503 conn(0x7fd68c06a5b0 msgr2=0x7fd68c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:39.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.536+0000 7fd692f80640 1 -- 172.21.15.133:0/3786633503 shutdown_connections 2023-12-19T19:01:39.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.536+0000 7fd692f80640 1 -- 172.21.15.133:0/3786633503 wait complete. 2023-12-19T19:01:39.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.536+0000 7fd692f80640 1 Processor -- start 2023-12-19T19:01:39.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.536+0000 7fd692f80640 1 -- start start 2023-12-19T19:01:39.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.536+0000 7fd692f80640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd68c072090 0x7fd68c13fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:39.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.536+0000 7fd692f80640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd68c0725c0 0x7fd68c06d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:39.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.536+0000 7fd692f80640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd68c0c3bd0 0x7fd68c1edd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:39.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.536+0000 7fd692f80640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c14da20 con 0x7fd68c072090 2023-12-19T19:01:39.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.536+0000 7fd692f80640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c1f1340 con 0x7fd68c0c3bd0 2023-12-19T19:01:39.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.536+0000 7fd692f80640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c1f1870 con 0x7fd68c0725c0 2023-12-19T19:01:39.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.536+0000 7fd690d1c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd68c072090 0x7fd68c13fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:39.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.536+0000 7fd690d1c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd68c072090 0x7fd68c13fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53646/0 (socket says 172.21.15.133:53646) 2023-12-19T19:01:39.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.536+0000 7fd690d1c640 1 -- 172.21.15.133:0/2102681061 learned_addr learned my addr 172.21.15.133:0/2102681061 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:39.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.536+0000 7fd68bfff640 1 --2- 172.21.15.133:0/2102681061 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd68c0725c0 0x7fd68c06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:39.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.536+0000 7fd69151d640 1 --2- 172.21.15.133:0/2102681061 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd68c0c3bd0 0x7fd68c1edd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:39.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.540+0000 7fd690d1c640 1 -- 172.21.15.133:0/2102681061 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd68c0725c0 msgr2=0x7fd68c06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:39.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.540+0000 7fd690d1c640 1 --2- 172.21.15.133:0/2102681061 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd68c0725c0 0x7fd68c06d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.540+0000 7fd690d1c640 1 -- 172.21.15.133:0/2102681061 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd68c0c3bd0 msgr2=0x7fd68c1edd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:39.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.540+0000 7fd690d1c640 1 --2- 172.21.15.133:0/2102681061 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd68c0c3bd0 0x7fd68c1edd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.540+0000 7fd690d1c640 1 -- 172.21.15.133:0/2102681061 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68000b770 con 0x7fd68c072090 2023-12-19T19:01:39.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.540+0000 7fd690d1c640 1 --2- 172.21.15.133:0/2102681061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd68c072090 0x7fd68c13fad0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fd68000b2c0 tx=0x7fd68001b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:39.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.540+0000 7fd6897fa640 1 -- 172.21.15.133:0/2102681061 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6800ba660 con 0x7fd68c072090 2023-12-19T19:01:39.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.540+0000 7fd6897fa640 1 -- 172.21.15.133:0/2102681061 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6800ba7c0 con 0x7fd68c072090 2023-12-19T19:01:39.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.540+0000 7fd6897fa640 1 -- 172.21.15.133:0/2102681061 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6800bab70 con 0x7fd68c072090 2023-12-19T19:01:39.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.540+0000 7fd692f80640 1 -- 172.21.15.133:0/2102681061 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68c140010 con 0x7fd68c072090 2023-12-19T19:01:39.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.540+0000 7fd692f80640 1 -- 172.21.15.133:0/2102681061 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68c1ed560 con 0x7fd68c072090 2023-12-19T19:01:39.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.540+0000 7fd692f80640 1 -- 172.21.15.133:0/2102681061 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68c1ed3c0 con 0x7fd68c072090 2023-12-19T19:01:39.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.540+0000 7fd6897fa640 1 -- 172.21.15.133:0/2102681061 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd6800c2360 con 0x7fd68c072090 2023-12-19T19:01:39.546 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.540+0000 7fd6897fa640 1 --2- 172.21.15.133:0/2102681061 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd6700664a0 0x7fd670068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:39.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.540+0000 7fd6897fa640 1 -- 172.21.15.133:0/2102681061 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd68011e9f0 con 0x7fd68c072090 2023-12-19T19:01:39.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.544+0000 7fd68bfff640 1 --2- 172.21.15.133:0/2102681061 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd6700664a0 0x7fd670068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:39.547 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.544+0000 7fd68bfff640 1 --2- 172.21.15.133:0/2102681061 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd6700664a0 0x7fd670068960 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd68c06ac20 tx=0x7fd678009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:39.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.544+0000 7fd6897fa640 1 -- 172.21.15.133:0/2102681061 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd68c1ed3c0 con 0x7fd68c072090 2023-12-19T19:01:39.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.696+0000 7fd692f80640 1 -- 172.21.15.133:0/2102681061 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd68c1ed3c0 con 0x7fd68c072090 2023-12-19T19:01:39.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.696+0000 7fd6897fa640 1 -- 172.21.15.133:0/2102681061 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16596 (secure 0 0 0) 0x7fd68c1ed3c0 con 0x7fd68c072090 2023-12-19T19:01:39.702 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:39.702 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":69,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:01:36.987598+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:01:33.082188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T19:01:34.349092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:01:39.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.700+0000 7fd692f80640 1 -- 172.21.15.133:0/2102681061 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd6700664a0 msgr2=0x7fd670068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:39.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.700+0000 7fd692f80640 1 --2- 172.21.15.133:0/2102681061 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd6700664a0 0x7fd670068960 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd68c06ac20 tx=0x7fd678009040 comp rx=0 tx=0).stop 2023-12-19T19:01:39.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.700+0000 7fd692f80640 1 -- 172.21.15.133:0/2102681061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd68c072090 msgr2=0x7fd68c13fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:39.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.700+0000 7fd692f80640 1 --2- 172.21.15.133:0/2102681061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd68c072090 0x7fd68c13fad0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fd68000b2c0 tx=0x7fd68001b850 comp rx=0 tx=0).stop 2023-12-19T19:01:39.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.700+0000 7fd692f80640 1 -- 172.21.15.133:0/2102681061 shutdown_connections 2023-12-19T19:01:39.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.700+0000 7fd692f80640 1 --2- 172.21.15.133:0/2102681061 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd6700664a0 0x7fd670068960 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.700+0000 7fd692f80640 1 --2- 172.21.15.133:0/2102681061 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd68c0c3bd0 0x7fd68c1edd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.700+0000 7fd692f80640 1 --2- 172.21.15.133:0/2102681061 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd68c0725c0 0x7fd68c06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.700+0000 7fd692f80640 1 --2- 172.21.15.133:0/2102681061 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd68c072090 0x7fd68c13fad0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.700+0000 7fd692f80640 1 -- 172.21.15.133:0/2102681061 >> 172.21.15.133:0/2102681061 conn(0x7fd68c06a5b0 msgr2=0x7fd68c144490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:39.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.700+0000 7fd692f80640 1 -- 172.21.15.133:0/2102681061 shutdown_connections 2023-12-19T19:01:39.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.700+0000 7fd692f80640 1 -- 172.21.15.133:0/2102681061 wait complete. 2023-12-19T19:01:39.723 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T19:01:39.723 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T19:01:39.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.856+0000 7fefcdf9d640 1 Processor -- start 2023-12-19T19:01:39.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.856+0000 7fefcdf9d640 1 -- start start 2023-12-19T19:01:39.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.856+0000 7fefcdf9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fefc80c63c0 0x7fefc80c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:39.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.856+0000 7fefcdf9d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefc80c31c0 con 0x7fefc80c4100 2023-12-19T19:01:39.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.856+0000 7fefcdf9d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefc80c34a0 con 0x7fefc80c2bb0 2023-12-19T19:01:39.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.856+0000 7fefcdf9d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefc80c1030 con 0x7fefc80c63c0 2023-12-19T19:01:39.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.856+0000 7fefc77fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fefc80c63c0 0x7fefc80c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:39.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.856+0000 7fefc6ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fefc80c4100 0x7fefc80c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:47986/0 (socket says 172.21.15.133:47986) 2023-12-19T19:01:39.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.856+0000 7fefc6ffd640 1 -- 172.21.15.133:0/1056084265 learned_addr learned my addr 172.21.15.133:0/1056084265 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:39.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.860+0000 7fefc77fe640 1 -- 172.21.15.133:0/1056084265 >> v1:172.21.15.138:6789/0 conn(0x7fefc80c2bb0 legacy=0x7fefc80a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:39.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.860+0000 7fefc77fe640 1 -- 172.21.15.133:0/1056084265 >> v1:172.21.15.133:6789/0 conn(0x7fefc80c4100 legacy=0x7fefc80c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:39.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.860+0000 7fefc77fe640 1 -- 172.21.15.133:0/1056084265 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc80c1310 con 0x7fefc80c63c0 2023-12-19T19:01:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.860+0000 7fefc77fe640 1 --2- 172.21.15.133:0/1056084265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefc80c63c0 0x7fefc80c06d0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fefb80097c0 tx=0x7fefb801c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feea4ca194f4e472 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.860+0000 7fefc67fc640 1 -- 172.21.15.133:0/1056084265 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb80ab600 con 0x7fefc80c63c0 2023-12-19T19:01:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.860+0000 7fefc67fc640 1 -- 172.21.15.133:0/1056084265 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb80a7050 con 0x7fefc80c63c0 2023-12-19T19:01:39.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.860+0000 7fefc67fc640 1 -- 172.21.15.133:0/1056084265 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb80ab980 con 0x7fefc80c63c0 2023-12-19T19:01:39.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.860+0000 7fefcdf9d640 1 -- 172.21.15.133:0/1056084265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefc80c63c0 msgr2=0x7fefc80c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:39.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.860+0000 7fefcdf9d640 1 --2- 172.21.15.133:0/1056084265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefc80c63c0 0x7fefc80c06d0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fefb80097c0 tx=0x7fefb801c320 comp rx=0 tx=0).stop 2023-12-19T19:01:39.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefcdf9d640 1 -- 172.21.15.133:0/1056084265 shutdown_connections 2023-12-19T19:01:39.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefcdf9d640 1 --2- 172.21.15.133:0/1056084265 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefc80c63c0 0x7fefc80c06d0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefcdf9d640 1 -- 172.21.15.133:0/1056084265 >> 172.21.15.133:0/1056084265 conn(0x7fefc806a5b0 msgr2=0x7fefc806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:39.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefcdf9d640 1 -- 172.21.15.133:0/1056084265 shutdown_connections 2023-12-19T19:01:39.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefcdf9d640 1 -- 172.21.15.133:0/1056084265 wait complete. 2023-12-19T19:01:39.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefcdf9d640 1 Processor -- start 2023-12-19T19:01:39.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefcdf9d640 1 -- start start 2023-12-19T19:01:39.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefcdf9d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fefc80c2bb0 0x7fefc814cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:39.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefcdf9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefc80c4100 0x7fefc81f06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:39.870 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefcdf9d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fefc80c63c0 0x7fefc8154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:39.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefcdf9d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc8152160 con 0x7fefc80c4100 2023-12-19T19:01:39.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefcdf9d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc8152440 con 0x7fefc80c63c0 2023-12-19T19:01:39.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefcdf9d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc8152720 con 0x7fefc80c2bb0 2023-12-19T19:01:39.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefc6ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefc80c4100 0x7fefc81f06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:39.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefc6ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefc80c4100 0x7fefc81f06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53670/0 (socket says 172.21.15.133:53670) 2023-12-19T19:01:39.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefc6ffd640 1 -- 172.21.15.133:0/4265654188 learned_addr learned my addr 172.21.15.133:0/4265654188 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:39.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefc77fe640 1 --2- 172.21.15.133:0/4265654188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fefc80c2bb0 0x7fefc814cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:39.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefc7fff640 1 --2- 172.21.15.133:0/4265654188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fefc80c63c0 0x7fefc8154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:39.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefc6ffd640 1 -- 172.21.15.133:0/4265654188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fefc80c2bb0 msgr2=0x7fefc814cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:39.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefc6ffd640 1 --2- 172.21.15.133:0/4265654188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fefc80c2bb0 0x7fefc814cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefc6ffd640 1 -- 172.21.15.133:0/4265654188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fefc80c63c0 msgr2=0x7fefc8154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:39.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefc6ffd640 1 --2- 172.21.15.133:0/4265654188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fefc80c63c0 0x7fefc8154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:39.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefc6ffd640 1 -- 172.21.15.133:0/4265654188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb8009420 con 0x7fefc80c4100 2023-12-19T19:01:39.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefc7fff640 1 --2- 172.21.15.133:0/4265654188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fefc80c63c0 0x7fefc8154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:39.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.864+0000 7fefc6ffd640 1 --2- 172.21.15.133:0/4265654188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefc80c4100 0x7fefc81f06b0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fefbc00c500 tx=0x7fefbc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:39.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.868+0000 7fefaffff640 1 -- 172.21.15.133:0/4265654188 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc005cf0 con 0x7fefc80c4100 2023-12-19T19:01:39.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.868+0000 7fefaffff640 1 -- 172.21.15.133:0/4265654188 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefbc005e50 con 0x7fefc80c4100 2023-12-19T19:01:39.872 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.868+0000 7fefaffff640 1 -- 172.21.15.133:0/4265654188 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc0072f0 con 0x7fefc80c4100 2023-12-19T19:01:39.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.868+0000 7fefcdf9d640 1 -- 172.21.15.133:0/4265654188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc8152a00 con 0x7fefc80c4100 2023-12-19T19:01:39.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.868+0000 7fefcdf9d640 1 -- 172.21.15.133:0/4265654188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc814f2b0 con 0x7fefc80c4100 2023-12-19T19:01:39.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.868+0000 7fefcdf9d640 1 -- 172.21.15.133:0/4265654188 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc8152bf0 con 0x7fefc80c4100 2023-12-19T19:01:39.873 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.868+0000 7fefaffff640 1 -- 172.21.15.133:0/4265654188 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fefbc007450 con 0x7fefc80c4100 2023-12-19T19:01:39.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.868+0000 7fefaffff640 1 --2- 172.21.15.133:0/4265654188 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fefb4066470 0x7fefb4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:39.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.868+0000 7fefaffff640 1 -- 172.21.15.133:0/4265654188 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fefbc083330 con 0x7fefc80c4100 2023-12-19T19:01:39.874 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.868+0000 7fefc77fe640 1 --2- 172.21.15.133:0/4265654188 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fefb4066470 0x7fefb4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:39.875 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.872+0000 7fefc77fe640 1 --2- 172.21.15.133:0/4265654188 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fefb4066470 0x7fefb4068930 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fefc80a8b40 tx=0x7fefb80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:39.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:39.872+0000 7fefaffff640 1 -- 172.21.15.133:0/4265654188 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fefbc050850 con 0x7fefc80c4100 2023-12-19T19:01:40.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.024+0000 7fefcdf9d640 1 -- 172.21.15.133:0/4265654188 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fefc814f4a0 con 0x7fefb4066470 2023-12-19T19:01:40.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.032+0000 7fefaffff640 1 -- 172.21.15.133:0/4265654188 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284121 (secure 0 0 0) 0x7fefc814f4a0 con 0x7fefb4066470 2023-12-19T19:01:40.040 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:40.042 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T19:01:40.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.036+0000 7fefcdf9d640 1 -- 172.21.15.133:0/4265654188 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fefb4066470 msgr2=0x7fefb4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:40.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.036+0000 7fefcdf9d640 1 --2- 172.21.15.133:0/4265654188 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fefb4066470 0x7fefb4068930 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fefc80a8b40 tx=0x7fefb80a6000 comp rx=0 tx=0).stop 2023-12-19T19:01:40.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.036+0000 7fefcdf9d640 1 -- 172.21.15.133:0/4265654188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefc80c4100 msgr2=0x7fefc81f06b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:40.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.036+0000 7fefcdf9d640 1 --2- 172.21.15.133:0/4265654188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefc80c4100 0x7fefc81f06b0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fefbc00c500 tx=0x7fefbc00c9c0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.036+0000 7fefcdf9d640 1 -- 172.21.15.133:0/4265654188 shutdown_connections 2023-12-19T19:01:40.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.036+0000 7fefcdf9d640 1 --2- 172.21.15.133:0/4265654188 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fefb4066470 0x7fefb4068930 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.036+0000 7fefcdf9d640 1 --2- 172.21.15.133:0/4265654188 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fefc80c63c0 0x7fefc8154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.036+0000 7fefcdf9d640 1 --2- 172.21.15.133:0/4265654188 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fefc80c4100 0x7fefc81f06b0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.036+0000 7fefcdf9d640 1 --2- 172.21.15.133:0/4265654188 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fefc80c2bb0 0x7fefc814cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.036+0000 7fefcdf9d640 1 -- 172.21.15.133:0/4265654188 >> 172.21.15.133:0/4265654188 conn(0x7fefc806a5b0 msgr2=0x7fefc815f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:40.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.036+0000 7fefcdf9d640 1 -- 172.21.15.133:0/4265654188 shutdown_connections 2023-12-19T19:01:40.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.036+0000 7fefcdf9d640 1 -- 172.21.15.133:0/4265654188 wait complete. 2023-12-19T19:01:40.060 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2023-12-19T19:01:38.875838+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248700,"kb_used_data":7576,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754726020,"statfs":{"total":773094113280,"available":772839444480,"internally_reserved":0,"allocated":7757824,"data_stored":4029610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.913240"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.993780+0000","last_change":"2023-12-19T19:01:34.993780+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.993780+0000","last_undegraded":"2023-12-19T19:01:34.993780+0000","last_fullsized":"2023-12-19T19:01:34.993780+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.983586+0000","last_change":"2023-12-19T19:01:34.983586+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.983586+0000","last_undegraded":"2023-12-19T19:01:34.983586+0000","last_fullsized":"2023-12-19T19:01:34.983586+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.981798+0000","last_change":"2023-12-19T19:01:34.981798+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.981798+0000","last_undegraded":"2023-12-19T19:01:34.981798+0000","last_fullsized":"2023-12-19T19:01:34.981798+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980246+0000","last_change":"2023-12-19T19:01:34.980246+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980246+0000","last_undegraded":"2023-12-19T19:01:34.980246+0000","last_fullsized":"2023-12-19T19:01:34.980246+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.983335+0000","last_change":"2023-12-19T19:01:34.983335+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.983335+0000","last_undegraded":"2023-12-19T19:01:34.983335+0000","last_fullsized":"2023-12-19T19:01:34.983335+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.986592+0000","last_change":"2023-12-19T19:01:34.986592+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.986592+0000","last_undegraded":"2023-12-19T19:01:34.986592+0000","last_fullsized":"2023-12-19T19:01:34.986592+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984685+0000","last_change":"2023-12-19T19:01:34.984685+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984685+0000","last_undegraded":"2023-12-19T19:01:34.984685+0000","last_fullsized":"2023-12-19T19:01:34.984685+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984583+0000","last_change":"2023-12-19T19:01:34.984583+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984583+0000","last_undegraded":"2023-12-19T19:01:34.984583+0000","last_fullsized":"2023-12-19T19:01:34.984583+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.987226+0000","last_change":"2023-12-19T19:01:34.987226+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.987226+0000","last_undegraded":"2023-12-19T19:01:34.987226+0000","last_fullsized":"2023-12-19T19:01:34.987226+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.990652+0000","last_change":"2023-12-19T19:01:34.990652+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.990652+0000","last_undegraded":"2023-12-19T19:01:34.990652+0000","last_fullsized":"2023-12-19T19:01:34.990652+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979166+0000","last_change":"2023-12-19T19:01:34.979166+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979166+0000","last_undegraded":"2023-12-19T19:01:34.979166+0000","last_fullsized":"2023-12-19T19:01:34.979166+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.992632+0000","last_change":"2023-12-19T19:01:34.992632+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.992632+0000","last_undegraded":"2023-12-19T19:01:34.992632+0000","last_fullsized":"2023-12-19T19:01:34.992632+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.981312+0000","last_change":"2023-12-19T19:01:34.981312+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.981312+0000","last_undegraded":"2023-12-19T19:01:34.981312+0000","last_fullsized":"2023-12-19T19:01:34.981312+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.983073+0000","last_change":"2023-12-19T19:01:34.983073+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.983073+0000","last_undegraded":"2023-12-19T19:01:34.983073+0000","last_fullsized":"2023-12-19T19:01:34.983073+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979150+0000","last_change":"2023-12-19T19:01:34.979150+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979150+0000","last_undegraded":"2023-12-19T19:01:34.979150+0000","last_fullsized":"2023-12-19T19:01:34.979150+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.983703+0000","last_change":"2023-12-19T19:01:34.983703+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.983703+0000","last_undegraded":"2023-12-19T19:01:34.983703+0000","last_fullsized":"2023-12-19T19:01:34.983703+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.987894+0000","last_change":"2023-12-19T19:01:34.987894+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.987894+0000","last_undegraded":"2023-12-19T19:01:34.987894+0000","last_fullsized":"2023-12-19T19:01:34.987894+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.982203+0000","last_change":"2023-12-19T19:01:34.982203+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.982203+0000","last_undegraded":"2023-12-19T19:01:34.982203+0000","last_fullsized":"2023-12-19T19:01:34.982203+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.981398+0000","last_change":"2023-12-19T19:01:34.981398+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.981398+0000","last_undegraded":"2023-12-19T19:01:34.981398+0000","last_fullsized":"2023-12-19T19:01:34.981398+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979743+0000","last_change":"2023-12-19T19:01:34.979743+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979743+0000","last_undegraded":"2023-12-19T19:01:34.979743+0000","last_fullsized":"2023-12-19T19:01:34.979743+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.982223+0000","last_change":"2023-12-19T19:01:34.982223+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.982223+0000","last_undegraded":"2023-12-19T19:01:34.982223+0000","last_fullsized":"2023-12-19T19:01:34.982223+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980145+0000","last_change":"2023-12-19T19:01:34.980145+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980145+0000","last_undegraded":"2023-12-19T19:01:34.980145+0000","last_fullsized":"2023-12-19T19:01:34.980145+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.992668+0000","last_change":"2023-12-19T19:01:34.992668+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.992668+0000","last_undegraded":"2023-12-19T19:01:34.992668+0000","last_fullsized":"2023-12-19T19:01:34.992668+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979812+0000","last_change":"2023-12-19T19:01:34.979812+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979812+0000","last_undegraded":"2023-12-19T19:01:34.979812+0000","last_fullsized":"2023-12-19T19:01:34.979812+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.978398+0000","last_change":"2023-12-19T19:01:34.978398+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.978398+0000","last_undegraded":"2023-12-19T19:01:34.978398+0000","last_fullsized":"2023-12-19T19:01:34.978398+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980818+0000","last_change":"2023-12-19T19:01:34.980818+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980818+0000","last_undegraded":"2023-12-19T19:01:34.980818+0000","last_fullsized":"2023-12-19T19:01:34.980818+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984987+0000","last_change":"2023-12-19T19:01:34.984987+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984987+0000","last_undegraded":"2023-12-19T19:01:34.984987+0000","last_fullsized":"2023-12-19T19:01:34.984987+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.990456+0000","last_change":"2023-12-19T19:01:34.990456+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.990456+0000","last_undegraded":"2023-12-19T19:01:34.990456+0000","last_fullsized":"2023-12-19T19:01:34.990456+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979065+0000","last_change":"2023-12-19T19:01:34.979065+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979065+0000","last_undegraded":"2023-12-19T19:01:34.979065+0000","last_fullsized":"2023-12-19T19:01:34.979065+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979702+0000","last_change":"2023-12-19T19:01:34.979702+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979702+0000","last_undegraded":"2023-12-19T19:01:34.979702+0000","last_fullsized":"2023-12-19T19:01:34.979702+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.985374+0000","last_change":"2023-12-19T19:01:34.985374+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.985374+0000","last_undegraded":"2023-12-19T19:01:34.985374+0000","last_fullsized":"2023-12-19T19:01:34.985374+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.989863+0000","last_change":"2023-12-19T19:01:34.989863+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.989863+0000","last_undegraded":"2023-12-19T19:01:34.989863+0000","last_fullsized":"2023-12-19T19:01:34.989863+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.987197+0000","last_change":"2023-12-19T19:01:34.987197+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.987197+0000","last_undegraded":"2023-12-19T19:01:34.987197+0000","last_fullsized":"2023-12-19T19:01:34.987197+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.008424+0000","last_change":"2023-12-19T19:01:35.005860+0000","last_active":"2023-12-19T19:01:35.008424+0000","last_peered":"2023-12-19T19:01:35.008424+0000","last_clean":"2023-12-19T19:01:35.008424+0000","last_became_active":"2023-12-19T19:01:35.005458+0000","last_became_peered":"2023-12-19T19:01:35.005458+0000","last_unstale":"2023-12-19T19:01:35.008424+0000","last_undegraded":"2023-12-19T19:01:35.008424+0000","last_fullsized":"2023-12-19T19:01:35.008424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:04:11.121880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.993263+0000","last_change":"2023-12-19T19:01:34.993263+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.993263+0000","last_undegraded":"2023-12-19T19:01:34.993263+0000","last_fullsized":"2023-12-19T19:01:34.993263+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.005337+0000","last_change":"2023-12-19T19:01:35.000000+0000","last_active":"2023-12-19T19:01:35.005337+0000","last_peered":"2023-12-19T19:01:35.005337+0000","last_clean":"2023-12-19T19:01:35.005337+0000","last_became_active":"2023-12-19T19:01:34.999684+0000","last_became_peered":"2023-12-19T19:01:34.999684+0000","last_unstale":"2023-12-19T19:01:35.005337+0000","last_undegraded":"2023-12-19T19:01:35.005337+0000","last_fullsized":"2023-12-19T19:01:35.005337+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:04:11.121880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.989972+0000","last_change":"2023-12-19T19:01:34.989972+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.989972+0000","last_undegraded":"2023-12-19T19:01:34.989972+0000","last_fullsized":"2023-12-19T19:01:34.989972+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.003622+0000","last_change":"2023-12-19T19:01:34.996946+0000","last_active":"2023-12-19T19:01:35.003622+0000","last_peered":"2023-12-19T19:01:35.003622+0000","last_clean":"2023-12-19T19:01:35.003622+0000","last_became_active":"2023-12-19T19:01:34.995689+0000","last_became_peered":"2023-12-19T19:01:34.995689+0000","last_unstale":"2023-12-19T19:01:35.003622+0000","last_undegraded":"2023-12-19T19:01:35.003622+0000","last_fullsized":"2023-12-19T19:01:35.003622+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:32:15.466391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980070+0000","last_change":"2023-12-19T19:01:34.980070+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980070+0000","last_undegraded":"2023-12-19T19:01:34.980070+0000","last_fullsized":"2023-12-19T19:01:34.980070+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.003742+0000","last_change":"2023-12-19T19:01:34.997757+0000","last_active":"2023-12-19T19:01:35.003742+0000","last_peered":"2023-12-19T19:01:35.003742+0000","last_clean":"2023-12-19T19:01:35.003742+0000","last_became_active":"2023-12-19T19:01:34.997458+0000","last_became_peered":"2023-12-19T19:01:34.997458+0000","last_unstale":"2023-12-19T19:01:35.003742+0000","last_undegraded":"2023-12-19T19:01:35.003742+0000","last_fullsized":"2023-12-19T19:01:35.003742+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:48:51.739304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.977533+0000","last_change":"2023-12-19T19:01:34.977533+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.977533+0000","last_undegraded":"2023-12-19T19:01:34.977533+0000","last_fullsized":"2023-12-19T19:01:34.977533+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.001967+0000","last_change":"2023-12-19T19:01:34.994677+0000","last_active":"2023-12-19T19:01:35.001967+0000","last_peered":"2023-12-19T19:01:35.001967+0000","last_clean":"2023-12-19T19:01:35.001967+0000","last_became_active":"2023-12-19T19:01:34.994343+0000","last_became_peered":"2023-12-19T19:01:34.994343+0000","last_unstale":"2023-12-19T19:01:35.001967+0000","last_undegraded":"2023-12-19T19:01:35.001967+0000","last_fullsized":"2023-12-19T19:01:35.001967+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:29.601572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.982664+0000","last_change":"2023-12-19T19:01:34.982664+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.982664+0000","last_undegraded":"2023-12-19T19:01:34.982664+0000","last_fullsized":"2023-12-19T19:01:34.982664+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.005135+0000","last_change":"2023-12-19T19:01:34.998256+0000","last_active":"2023-12-19T19:01:35.005135+0000","last_peered":"2023-12-19T19:01:35.005135+0000","last_clean":"2023-12-19T19:01:35.005135+0000","last_became_active":"2023-12-19T19:01:34.997890+0000","last_became_peered":"2023-12-19T19:01:34.997890+0000","last_unstale":"2023-12-19T19:01:35.005135+0000","last_undegraded":"2023-12-19T19:01:35.005135+0000","last_fullsized":"2023-12-19T19:01:35.005135+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:36.683195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980845+0000","last_change":"2023-12-19T19:01:34.980845+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980845+0000","last_undegraded":"2023-12-19T19:01:34.980845+0000","last_fullsized":"2023-12-19T19:01:34.980845+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.001098+0000","last_change":"2023-12-19T19:01:34.995656+0000","last_active":"2023-12-19T19:01:35.001098+0000","last_peered":"2023-12-19T19:01:35.001098+0000","last_clean":"2023-12-19T19:01:35.001098+0000","last_became_active":"2023-12-19T19:01:34.995357+0000","last_became_peered":"2023-12-19T19:01:34.995357+0000","last_unstale":"2023-12-19T19:01:35.001098+0000","last_undegraded":"2023-12-19T19:01:35.001098+0000","last_fullsized":"2023-12-19T19:01:35.001098+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:06:40.560279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.978636+0000","last_change":"2023-12-19T19:01:34.978636+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.978636+0000","last_undegraded":"2023-12-19T19:01:34.978636+0000","last_fullsized":"2023-12-19T19:01:34.978636+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.006440+0000","last_change":"2023-12-19T19:01:35.000403+0000","last_active":"2023-12-19T19:01:35.006440+0000","last_peered":"2023-12-19T19:01:35.006440+0000","last_clean":"2023-12-19T19:01:35.006440+0000","last_became_active":"2023-12-19T19:01:34.998866+0000","last_became_peered":"2023-12-19T19:01:34.998866+0000","last_unstale":"2023-12-19T19:01:35.006440+0000","last_undegraded":"2023-12-19T19:01:35.006440+0000","last_fullsized":"2023-12-19T19:01:35.006440+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:41:08.421145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979573+0000","last_change":"2023-12-19T19:01:34.979573+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979573+0000","last_undegraded":"2023-12-19T19:01:34.979573+0000","last_fullsized":"2023-12-19T19:01:34.979573+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007157+0000","last_change":"2023-12-19T19:01:35.002076+0000","last_active":"2023-12-19T19:01:35.007157+0000","last_peered":"2023-12-19T19:01:35.007157+0000","last_clean":"2023-12-19T19:01:35.007157+0000","last_became_active":"2023-12-19T19:01:35.001645+0000","last_became_peered":"2023-12-19T19:01:35.001645+0000","last_unstale":"2023-12-19T19:01:35.007157+0000","last_undegraded":"2023-12-19T19:01:35.007157+0000","last_fullsized":"2023-12-19T19:01:35.007157+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:36.683195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984951+0000","last_change":"2023-12-19T19:01:34.984951+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984951+0000","last_undegraded":"2023-12-19T19:01:34.984951+0000","last_fullsized":"2023-12-19T19:01:34.984951+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007231+0000","last_change":"2023-12-19T19:01:35.003678+0000","last_active":"2023-12-19T19:01:35.007231+0000","last_peered":"2023-12-19T19:01:35.007231+0000","last_clean":"2023-12-19T19:01:35.007231+0000","last_became_active":"2023-12-19T19:01:35.003361+0000","last_became_peered":"2023-12-19T19:01:35.003361+0000","last_unstale":"2023-12-19T19:01:35.007231+0000","last_undegraded":"2023-12-19T19:01:35.007231+0000","last_fullsized":"2023-12-19T19:01:35.007231+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:33:31.174586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.982176+0000","last_change":"2023-12-19T19:01:34.982176+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.982176+0000","last_undegraded":"2023-12-19T19:01:34.982176+0000","last_fullsized":"2023-12-19T19:01:34.982176+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007180+0000","last_change":"2023-12-19T19:01:35.002668+0000","last_active":"2023-12-19T19:01:35.007180+0000","last_peered":"2023-12-19T19:01:35.007180+0000","last_clean":"2023-12-19T19:01:35.007180+0000","last_became_active":"2023-12-19T19:01:35.002367+0000","last_became_peered":"2023-12-19T19:01:35.002367+0000","last_unstale":"2023-12-19T19:01:35.007180+0000","last_undegraded":"2023-12-19T19:01:35.007180+0000","last_fullsized":"2023-12-19T19:01:35.007180+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:29.601572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984524+0000","last_change":"2023-12-19T19:01:34.984524+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984524+0000","last_undegraded":"2023-12-19T19:01:34.984524+0000","last_fullsized":"2023-12-19T19:01:34.984524+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.005100+0000","last_change":"2023-12-19T19:01:34.997430+0000","last_active":"2023-12-19T19:01:35.005100+0000","last_peered":"2023-12-19T19:01:35.005100+0000","last_clean":"2023-12-19T19:01:35.005100+0000","last_became_active":"2023-12-19T19:01:34.997110+0000","last_became_peered":"2023-12-19T19:01:34.997110+0000","last_unstale":"2023-12-19T19:01:35.005100+0000","last_undegraded":"2023-12-19T19:01:35.005100+0000","last_fullsized":"2023-12-19T19:01:35.005100+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:23:24.843750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.981922+0000","last_change":"2023-12-19T19:01:34.981922+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.981922+0000","last_undegraded":"2023-12-19T19:01:34.981922+0000","last_fullsized":"2023-12-19T19:01:34.981922+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:34.992237+0000","last_change":"2023-12-19T19:01:34.987868+0000","last_active":"2023-12-19T19:01:34.992237+0000","last_peered":"2023-12-19T19:01:34.992237+0000","last_clean":"2023-12-19T19:01:34.992237+0000","last_became_active":"2023-12-19T19:01:34.987545+0000","last_became_peered":"2023-12-19T19:01:34.987545+0000","last_unstale":"2023-12-19T19:01:34.992237+0000","last_undegraded":"2023-12-19T19:01:34.992237+0000","last_fullsized":"2023-12-19T19:01:34.992237+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:37:03.677408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980097+0000","last_change":"2023-12-19T19:01:34.980097+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980097+0000","last_undegraded":"2023-12-19T19:01:34.980097+0000","last_fullsized":"2023-12-19T19:01:34.980097+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.001401+0000","last_change":"2023-12-19T19:01:34.994756+0000","last_active":"2023-12-19T19:01:35.001401+0000","last_peered":"2023-12-19T19:01:35.001401+0000","last_clean":"2023-12-19T19:01:35.001401+0000","last_became_active":"2023-12-19T19:01:34.994476+0000","last_became_peered":"2023-12-19T19:01:34.994476+0000","last_unstale":"2023-12-19T19:01:35.001401+0000","last_undegraded":"2023-12-19T19:01:35.001401+0000","last_fullsized":"2023-12-19T19:01:35.001401+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:36.470347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.977480+0000","last_change":"2023-12-19T19:01:34.977480+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.977480+0000","last_undegraded":"2023-12-19T19:01:34.977480+0000","last_fullsized":"2023-12-19T19:01:34.977480+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.006124+0000","last_change":"2023-12-19T19:01:35.002999+0000","last_active":"2023-12-19T19:01:35.006124+0000","last_peered":"2023-12-19T19:01:35.006124+0000","last_clean":"2023-12-19T19:01:35.006124+0000","last_became_active":"2023-12-19T19:01:35.002667+0000","last_became_peered":"2023-12-19T19:01:35.002667+0000","last_unstale":"2023-12-19T19:01:35.006124+0000","last_undegraded":"2023-12-19T19:01:35.006124+0000","last_fullsized":"2023-12-19T19:01:35.006124+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:31.382424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.977484+0000","last_change":"2023-12-19T19:01:34.977484+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.977484+0000","last_undegraded":"2023-12-19T19:01:34.977484+0000","last_fullsized":"2023-12-19T19:01:34.977484+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:34.997990+0000","last_change":"2023-12-19T19:01:34.993756+0000","last_active":"2023-12-19T19:01:34.997990+0000","last_peered":"2023-12-19T19:01:34.997990+0000","last_clean":"2023-12-19T19:01:34.997990+0000","last_became_active":"2023-12-19T19:01:34.993466+0000","last_became_peered":"2023-12-19T19:01:34.993466+0000","last_unstale":"2023-12-19T19:01:34.997990+0000","last_undegraded":"2023-12-19T19:01:34.997990+0000","last_fullsized":"2023-12-19T19:01:34.997990+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:46:31.394472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980284+0000","last_change":"2023-12-19T19:01:34.980284+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980284+0000","last_undegraded":"2023-12-19T19:01:34.980284+0000","last_fullsized":"2023-12-19T19:01:34.980284+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007112+0000","last_change":"2023-12-19T19:01:35.001602+0000","last_active":"2023-12-19T19:01:35.007112+0000","last_peered":"2023-12-19T19:01:35.007112+0000","last_clean":"2023-12-19T19:01:35.007112+0000","last_became_active":"2023-12-19T19:01:35.000999+0000","last_became_peered":"2023-12-19T19:01:35.000999+0000","last_unstale":"2023-12-19T19:01:35.007112+0000","last_undegraded":"2023-12-19T19:01:35.007112+0000","last_fullsized":"2023-12-19T19:01:35.007112+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:32.294680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.992557+0000","last_change":"2023-12-19T19:01:34.992557+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.992557+0000","last_undegraded":"2023-12-19T19:01:34.992557+0000","last_fullsized":"2023-12-19T19:01:34.992557+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.003716+0000","last_change":"2023-12-19T19:01:34.999856+0000","last_active":"2023-12-19T19:01:35.003716+0000","last_peered":"2023-12-19T19:01:35.003716+0000","last_clean":"2023-12-19T19:01:35.003716+0000","last_became_active":"2023-12-19T19:01:34.999581+0000","last_became_peered":"2023-12-19T19:01:34.999581+0000","last_unstale":"2023-12-19T19:01:35.003716+0000","last_undegraded":"2023-12-19T19:01:35.003716+0000","last_fullsized":"2023-12-19T19:01:35.003716+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:13:22.016658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984072+0000","last_change":"2023-12-19T19:01:34.984072+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984072+0000","last_undegraded":"2023-12-19T19:01:34.984072+0000","last_fullsized":"2023-12-19T19:01:34.984072+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.000194+0000","last_change":"2023-12-19T19:01:34.992936+0000","last_active":"2023-12-19T19:01:35.000194+0000","last_peered":"2023-12-19T19:01:35.000194+0000","last_clean":"2023-12-19T19:01:35.000194+0000","last_became_active":"2023-12-19T19:01:34.992664+0000","last_became_peered":"2023-12-19T19:01:34.992664+0000","last_unstale":"2023-12-19T19:01:35.000194+0000","last_undegraded":"2023-12-19T19:01:35.000194+0000","last_fullsized":"2023-12-19T19:01:35.000194+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:06:56.928069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.982629+0000","last_change":"2023-12-19T19:01:34.982629+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.982629+0000","last_undegraded":"2023-12-19T19:01:34.982629+0000","last_fullsized":"2023-12-19T19:01:34.982629+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.003526+0000","last_change":"2023-12-19T19:01:35.000039+0000","last_active":"2023-12-19T19:01:35.003526+0000","last_peered":"2023-12-19T19:01:35.003526+0000","last_clean":"2023-12-19T19:01:35.003526+0000","last_became_active":"2023-12-19T19:01:34.999745+0000","last_became_peered":"2023-12-19T19:01:34.999745+0000","last_unstale":"2023-12-19T19:01:35.003526+0000","last_undegraded":"2023-12-19T19:01:35.003526+0000","last_fullsized":"2023-12-19T19:01:35.003526+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:53:02.681430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.985896+0000","last_change":"2023-12-19T19:01:34.985896+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.985896+0000","last_undegraded":"2023-12-19T19:01:34.985896+0000","last_fullsized":"2023-12-19T19:01:34.985896+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.000765+0000","last_change":"2023-12-19T19:01:34.996284+0000","last_active":"2023-12-19T19:01:35.000765+0000","last_peered":"2023-12-19T19:01:35.000765+0000","last_clean":"2023-12-19T19:01:35.000765+0000","last_became_active":"2023-12-19T19:01:34.996012+0000","last_became_peered":"2023-12-19T19:01:34.996012+0000","last_unstale":"2023-12-19T19:01:35.000765+0000","last_undegraded":"2023-12-19T19:01:35.000765+0000","last_fullsized":"2023-12-19T19:01:35.000765+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:33:03.964283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979228+0000","last_change":"2023-12-19T19:01:34.979228+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979228+0000","last_undegraded":"2023-12-19T19:01:34.979228+0000","last_fullsized":"2023-12-19T19:01:34.979228+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.006709+0000","last_change":"2023-12-19T19:01:35.002482+0000","last_active":"2023-12-19T19:01:35.006709+0000","last_peered":"2023-12-19T19:01:35.006709+0000","last_clean":"2023-12-19T19:01:35.006709+0000","last_became_active":"2023-12-19T19:01:35.002110+0000","last_became_peered":"2023-12-19T19:01:35.002110+0000","last_unstale":"2023-12-19T19:01:35.006709+0000","last_undegraded":"2023-12-19T19:01:35.006709+0000","last_fullsized":"2023-12-19T19:01:35.006709+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:40:40.108793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.987437+0000","last_change":"2023-12-19T19:01:34.987437+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.987437+0000","last_undegraded":"2023-12-19T19:01:34.987437+0000","last_fullsized":"2023-12-19T19:01:34.987437+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.001612+0000","last_change":"2023-12-19T19:01:34.997069+0000","last_active":"2023-12-19T19:01:35.001612+0000","last_peered":"2023-12-19T19:01:35.001612+0000","last_clean":"2023-12-19T19:01:35.001612+0000","last_became_active":"2023-12-19T19:01:34.996756+0000","last_became_peered":"2023-12-19T19:01:34.996756+0000","last_unstale":"2023-12-19T19:01:35.001612+0000","last_undegraded":"2023-12-19T19:01:35.001612+0000","last_fullsized":"2023-12-19T19:01:35.001612+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:35.546701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.986763+0000","last_change":"2023-12-19T19:01:34.986763+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.986763+0000","last_undegraded":"2023-12-19T19:01:34.986763+0000","last_fullsized":"2023-12-19T19:01:34.986763+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:34.997281+0000","last_change":"2023-12-19T19:01:34.989700+0000","last_active":"2023-12-19T19:01:34.997281+0000","last_peered":"2023-12-19T19:01:34.997281+0000","last_clean":"2023-12-19T19:01:34.997281+0000","last_became_active":"2023-12-19T19:01:34.989417+0000","last_became_peered":"2023-12-19T19:01:34.989417+0000","last_unstale":"2023-12-19T19:01:34.997281+0000","last_undegraded":"2023-12-19T19:01:34.997281+0000","last_fullsized":"2023-12-19T19:01:34.997281+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:06:45.607378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980782+0000","last_change":"2023-12-19T19:01:34.980782+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980782+0000","last_undegraded":"2023-12-19T19:01:34.980782+0000","last_fullsized":"2023-12-19T19:01:34.980782+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:34.992101+0000","last_change":"2023-12-19T19:01:34.986750+0000","last_active":"2023-12-19T19:01:34.992101+0000","last_peered":"2023-12-19T19:01:34.992101+0000","last_clean":"2023-12-19T19:01:34.992101+0000","last_became_active":"2023-12-19T19:01:34.986455+0000","last_became_peered":"2023-12-19T19:01:34.986455+0000","last_unstale":"2023-12-19T19:01:34.992101+0000","last_undegraded":"2023-12-19T19:01:34.992101+0000","last_fullsized":"2023-12-19T19:01:34.992101+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:01:50.322532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.989455+0000","last_change":"2023-12-19T19:01:34.989455+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.989455+0000","last_undegraded":"2023-12-19T19:01:34.989455+0000","last_fullsized":"2023-12-19T19:01:34.989455+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007075+0000","last_change":"2023-12-19T19:01:35.001204+0000","last_active":"2023-12-19T19:01:35.007075+0000","last_peered":"2023-12-19T19:01:35.007075+0000","last_clean":"2023-12-19T19:01:35.007075+0000","last_became_active":"2023-12-19T19:01:35.000589+0000","last_became_peered":"2023-12-19T19:01:35.000589+0000","last_unstale":"2023-12-19T19:01:35.007075+0000","last_undegraded":"2023-12-19T19:01:35.007075+0000","last_fullsized":"2023-12-19T19:01:35.007075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:48:27.490312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.983538+0000","last_change":"2023-12-19T19:01:34.983538+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.983538+0000","last_undegraded":"2023-12-19T19:01:34.983538+0000","last_fullsized":"2023-12-19T19:01:34.983538+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.005497+0000","last_change":"2023-12-19T19:01:34.999664+0000","last_active":"2023-12-19T19:01:35.005497+0000","last_peered":"2023-12-19T19:01:35.005497+0000","last_clean":"2023-12-19T19:01:35.005497+0000","last_became_active":"2023-12-19T19:01:34.998997+0000","last_became_peered":"2023-12-19T19:01:34.998997+0000","last_unstale":"2023-12-19T19:01:35.005497+0000","last_undegraded":"2023-12-19T19:01:35.005497+0000","last_fullsized":"2023-12-19T19:01:35.005497+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:38:15.768063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.985453+0000","last_change":"2023-12-19T19:01:34.985453+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.985453+0000","last_undegraded":"2023-12-19T19:01:34.985453+0000","last_fullsized":"2023-12-19T19:01:34.985453+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:34.994967+0000","last_change":"2023-12-19T19:01:34.990870+0000","last_active":"2023-12-19T19:01:34.994967+0000","last_peered":"2023-12-19T19:01:34.994967+0000","last_clean":"2023-12-19T19:01:34.994967+0000","last_became_active":"2023-12-19T19:01:34.990513+0000","last_became_peered":"2023-12-19T19:01:34.990513+0000","last_unstale":"2023-12-19T19:01:34.994967+0000","last_undegraded":"2023-12-19T19:01:34.994967+0000","last_fullsized":"2023-12-19T19:01:34.994967+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:27:03.813755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984415+0000","last_change":"2023-12-19T19:01:34.984415+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984415+0000","last_undegraded":"2023-12-19T19:01:34.984415+0000","last_fullsized":"2023-12-19T19:01:34.984415+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.001199+0000","last_change":"2023-12-19T19:01:34.994259+0000","last_active":"2023-12-19T19:01:35.001199+0000","last_peered":"2023-12-19T19:01:35.001199+0000","last_clean":"2023-12-19T19:01:35.001199+0000","last_became_active":"2023-12-19T19:01:34.992784+0000","last_became_peered":"2023-12-19T19:01:34.992784+0000","last_unstale":"2023-12-19T19:01:35.001199+0000","last_undegraded":"2023-12-19T19:01:35.001199+0000","last_fullsized":"2023-12-19T19:01:35.001199+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:32.294680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980169+0000","last_change":"2023-12-19T19:01:34.980169+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980169+0000","last_undegraded":"2023-12-19T19:01:34.980169+0000","last_fullsized":"2023-12-19T19:01:34.980169+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007161+0000","last_change":"2023-12-19T19:01:35.001846+0000","last_active":"2023-12-19T19:01:35.007161+0000","last_peered":"2023-12-19T19:01:35.007161+0000","last_clean":"2023-12-19T19:01:35.007161+0000","last_became_active":"2023-12-19T19:01:35.000362+0000","last_became_peered":"2023-12-19T19:01:35.000362+0000","last_unstale":"2023-12-19T19:01:35.007161+0000","last_undegraded":"2023-12-19T19:01:35.007161+0000","last_fullsized":"2023-12-19T19:01:35.007161+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:11.163857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.991560+0000","last_change":"2023-12-19T19:01:34.991560+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.991560+0000","last_undegraded":"2023-12-19T19:01:34.991560+0000","last_fullsized":"2023-12-19T19:01:34.991560+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.005088+0000","last_change":"2023-12-19T19:01:34.998108+0000","last_active":"2023-12-19T19:01:35.005088+0000","last_peered":"2023-12-19T19:01:35.005088+0000","last_clean":"2023-12-19T19:01:35.005088+0000","last_became_active":"2023-12-19T19:01:34.997738+0000","last_became_peered":"2023-12-19T19:01:34.997738+0000","last_unstale":"2023-12-19T19:01:35.005088+0000","last_undegraded":"2023-12-19T19:01:35.005088+0000","last_fullsized":"2023-12-19T19:01:35.005088+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:48:27.490312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.977470+0000","last_change":"2023-12-19T19:01:34.977470+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.977470+0000","last_undegraded":"2023-12-19T19:01:34.977470+0000","last_fullsized":"2023-12-19T19:01:34.977470+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.002980+0000","last_change":"2023-12-19T19:01:34.999764+0000","last_active":"2023-12-19T19:01:35.002980+0000","last_peered":"2023-12-19T19:01:35.002980+0000","last_clean":"2023-12-19T19:01:35.002980+0000","last_became_active":"2023-12-19T19:01:34.998931+0000","last_became_peered":"2023-12-19T19:01:34.998931+0000","last_unstale":"2023-12-19T19:01:35.002980+0000","last_undegraded":"2023-12-19T19:01:35.002980+0000","last_fullsized":"2023-12-19T19:01:35.002980+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:46:31.394472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":213,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-19T19:01:33.964823+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T19:01:33.964823+0000","last_peered":"2023-12-19T19:01:33.964823+0000","last_clean":"2023-12-19T19:01:33.964823+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T19:01:33.964823+0000","last_undegraded":"2023-12-19T19:01:33.964823+0000","last_fullsized":"2023-12-19T19:01:33.964823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1417216,"data_stored":947389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.68899999999999995},"min":{"1min":0.44,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92500000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.72399999999999998},"min":{"1min":0.50700000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89300000000000002,"5min":1.117,"15min":1.117},"last":0.89300000000000002}]},{"osd":1,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.46700000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83899999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.751},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83399999999999996,"5min":1.01,"15min":1.01},"last":0.82099999999999995}]},{"osd":2,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85499999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.58299999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89500000000000002,"5min":1.089,"15min":1.089},"last":0.80300000000000005}]},{"osd":3,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71299999999999997,"15min":0.72699999999999998},"min":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90900000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73299999999999998,"15min":0.73499999999999999},"min":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91600000000000004,"5min":1.026,"15min":1.026},"last":0.86899999999999999}]},{"osd":4,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64400000000000002,"15min":0.65600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88500000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66700000000000004,"15min":0.67400000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93799999999999994,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.66500000000000004}]},{"osd":5,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93200000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.623},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.70599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91500000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.60799999999999998}]},{"osd":6,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.96799999999999997,"5min":1.069,"15min":1.069},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78000000000000003,"15min":0.79600000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.77800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":357021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.98899999999999999,"5min":1.022,"15min":1.022},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.89800000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.89800000000000002}]},{"osd":1,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67100000000000004,"15min":0.65700000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.871,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.871},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.52300000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91500000000000004,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.81899999999999995}]},{"osd":2,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.443,"5min":0.437,"15min":0.437},"max":{"1min":0.96299999999999997,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.71999999999999997,"15min":0.71699999999999997},"min":{"1min":0.58099999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94899999999999995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.94899999999999995}]},{"osd":3,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83499999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72199999999999998,"15min":0.72699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91900000000000004,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.91900000000000004}]},{"osd":4,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.48599999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.74099999999999999,"15min":0.755},"min":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95999999999999996,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.60999999999999999}]},{"osd":5,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.93700000000000006,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73199999999999998,"15min":0.73599999999999999},"min":{"1min":0.54600000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.65800000000000003}]},{"osd":7,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.52800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.63600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":350746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.90500000000000003,"15min":0.94899999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0880000000000001,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":1.3420000000000001,"15min":1.452},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1180000000000001,"5min":16.951000000000001,"15min":16.951000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":1.411,"15min":1.5429999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0700000000000001,"5min":19.823,"15min":19.823},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.44500000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.216,"5min":1.657,"15min":1.657},"last":0.77300000000000002}]},{"osd":2,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.74199999999999999,"15min":0.755},"min":{"1min":0.48799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.163,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1020000000000001,"5min":1.585,"15min":1.585},"last":0.66600000000000004}]},{"osd":3,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.78000000000000003,"15min":0.79100000000000004},"min":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0589999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.97299999999999998,"15min":1.0149999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0740000000000001,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":0.79000000000000004}]},{"osd":4,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.45200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0049999999999999,"5min":1.716,"15min":1.716},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.504,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97899999999999998,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":0.59499999999999997}]},{"osd":6,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.82799999999999996,"15min":0.85099999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.86599999999999999,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.82999999999999996,"15min":0.84599999999999997},"min":{"1min":0.51100000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90600000000000003,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.83099999999999996}]},{"osd":7,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82899999999999996,"15min":0.83899999999999997},"min":{"1min":0.60599999999999998,"5min":0.498,"15min":0.498},"max":{"1min":1.0900000000000001,"5min":2.371,"15min":2.371},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0369999999999999,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.84999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":357021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.84299999999999997,"15min":0.875},"min":{"1min":0.46800000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86899999999999999,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78500000000000003,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.66900000000000004}]},{"osd":1,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.51800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88200000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.79200000000000004,"15min":0.80700000000000005},"min":{"1min":0.56699999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94599999999999995,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":0.86399999999999999}]},{"osd":2,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69199999999999995,"15min":0.69299999999999995},"min":{"1min":0.53800000000000003,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.80300000000000005,"15min":0.81999999999999995},"min":{"1min":0.56000000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.88,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.751}]},{"osd":3,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.84999999999999998,"5min":3.641,"15min":3.641},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.872,"15min":0.89800000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.85399999999999998,"5min":3.194,"15min":3.194},"last":0.73899999999999999}]},{"osd":5,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":1.0269999999999999,"15min":1.089},"min":{"1min":0.42699999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0449999999999999,"5min":9.3040000000000003,"15min":9.3040000000000003},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.71999999999999997,"15min":0.73999999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94099999999999995,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.84499999999999997}]},{"osd":6,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.81799999999999995,"15min":0.84199999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97699999999999998,"5min":3.097,"15min":3.097},"last":0.88},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.86599999999999999,"15min":0.89100000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97899999999999998,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.89700000000000002}]},{"osd":7,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.94199999999999995,"15min":0.97999999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0409999999999999,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":1.0289999999999999,"15min":1.077},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98699999999999999,"5min":6.3449999999999998,"15min":6.3449999999999998},"last":0.79800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":357021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72699999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.36099999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.41299999999999998}]},{"osd":1,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46700000000000003,"15min":0.48499999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60699999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.64300000000000002}]},{"osd":2,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.74299999999999999,"5min":0.75,"15min":0.75},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.54700000000000004},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77600000000000002,"5min":0.875,"15min":0.875},"last":0.432}]},{"osd":4,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88400000000000001,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98999999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.61299999999999999}]},{"osd":5,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.50600000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94999999999999996,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.752,"15min":0.77000000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.04,"5min":1.202,"15min":1.202},"last":0.59799999999999998}]},{"osd":6,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96399999999999997,"5min":1.298,"15min":1.298},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.98299999999999998,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.68899999999999995}]},{"osd":7,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94999999999999996,"5min":1.155,"15min":1.155},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93000000000000005,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.66400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":357021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.497,"15min":0.50700000000000001},"min":{"1min":0.313,"5min":0.31,"15min":0.31},"max":{"1min":0.57899999999999996,"5min":1.458,"15min":1.458},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.627,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.373}]},{"osd":1,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.57899999999999996,"15min":0.59899999999999998},"min":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.58499999999999996,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.60399999999999998,"15min":0.624},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.61799999999999999,"5min":2.444,"15min":2.444},"last":0.44600000000000001}]},{"osd":3,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.59599999999999997,"15min":0.62},"min":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65300000000000002,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.625,"15min":0.64300000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.69199999999999995,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.46300000000000002}]},{"osd":4,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.93899999999999995,"15min":0.97499999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.94399999999999995,"5min":1.968,"15min":1.968},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.89500000000000002,"15min":0.92500000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.90700000000000003,"5min":2.835,"15min":2.835},"last":0.72799999999999998}]},{"osd":5,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.91600000000000004,"15min":0.94999999999999996},"min":{"1min":0.56000000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.94599999999999995,"5min":3.5,"15min":3.5},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.91100000000000003,"15min":0.93999999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.99099999999999999,"5min":1.996,"15min":1.996},"last":0.60799999999999998}]},{"osd":6,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.91200000000000003,"15min":0.94699999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.97599999999999998,"5min":2.903,"15min":2.903},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.99199999999999999,"15min":1.034},"min":{"1min":0.53700000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.92800000000000005,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.63700000000000001}]},{"osd":7,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.94999999999999996,"15min":0.98599999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.0049999999999999,"5min":2.875,"15min":2.875},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.94299999999999995,"15min":0.98099999999999998},"min":{"1min":0.59399999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.91900000000000004,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.752}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":357021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.55200000000000005,"15min":0.58099999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.51600000000000001,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.309},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.748,"15min":0.80100000000000005},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.70399999999999996,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.503}]},{"osd":2,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.57199999999999995,"15min":0.59599999999999997},"min":{"1min":0.316,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.63,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.65600000000000003,"15min":0.68899999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65300000000000002,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.46100000000000002}]},{"osd":3,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.79300000000000004,"15min":0.84199999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.629,"5min":7.8399999999999999,"15min":7.8399999999999999},"last":0.436},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.81200000000000006,"15min":0.85999999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72499999999999998,"5min":7.7949999999999999,"15min":7.7949999999999999},"last":0.52700000000000002}]},{"osd":4,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.86799999999999999,"15min":0.89900000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0900000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.89900000000000002,"15min":0.93000000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0289999999999999,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.66700000000000004}]},{"osd":5,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.879,"15min":0.90900000000000003},"min":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92600000000000005,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.627},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.88500000000000001,"15min":0.91800000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98899999999999999,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.71199999999999997}]},{"osd":6,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.88300000000000001,"15min":0.90800000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94699999999999995,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.93100000000000005,"15min":0.96899999999999997},"min":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0469999999999999,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.68600000000000005}]},{"osd":7,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.93600000000000005,"15min":0.96799999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1180000000000001,"5min":4.3310000000000004,"15min":4.3310000000000004},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.89200000000000002,"15min":0.92000000000000004},"min":{"1min":0.55200000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.97599999999999998,"5min":4.226,"15min":4.226},"last":0.83299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1413120,"data_stored":946370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.436,"15min":0.44800000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60299999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48899999999999999,"15min":0.503},"min":{"1min":0.29799999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65700000000000003,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.41599999999999998}]},{"osd":2,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.50600000000000001,"15min":0.51300000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63700000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.5},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.51100000000000001},"min":{"1min":0.40799999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.372}]},{"osd":3,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48199999999999998,"15min":0.48699999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.55900000000000005,"5min":0.747,"15min":0.747},"last":0.441},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.57799999999999996,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69299999999999995,"5min":1.264,"15min":1.264},"last":0.46200000000000002}]},{"osd":4,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.74199999999999999,"15min":0.748},"min":{"1min":0.502,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93999999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89900000000000002,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.77400000000000002}]},{"osd":5,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.749},"min":{"1min":0.57299999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.89300000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79200000000000004,"15min":0.81699999999999995},"min":{"1min":0.57199999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.91000000000000003,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.71799999999999997}]},{"osd":6,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.79600000000000004,"15min":0.82499999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92600000000000005,"5min":1.349,"15min":1.349},"last":0.745},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0189999999999999,"5min":1.115,"15min":1.115},"last":0.69599999999999995}]},{"osd":7,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.57499999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94899999999999995,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.79200000000000004,"15min":0.81200000000000006},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.93200000000000005,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.81000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T19:01:40.065 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T19:01:40.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.236+0000 7f9c365e6640 1 Processor -- start 2023-12-19T19:01:40.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.236+0000 7f9c365e6640 1 -- start start 2023-12-19T19:01:40.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.236+0000 7f9c365e6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9c300c7ea0 0x7f9c3006b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:40.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.236+0000 7f9c365e6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c3006b9e0 0x7f9c3015f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:40.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.236+0000 7f9c365e6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3006c860 con 0x7f9c30151e90 2023-12-19T19:01:40.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.236+0000 7f9c365e6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c300c8750 con 0x7f9c300c7ea0 2023-12-19T19:01:40.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.236+0000 7f9c365e6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c301552d0 con 0x7f9c3006b9e0 2023-12-19T19:01:40.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.236+0000 7f9c2ffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9c30151e90 0x7f9c300c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48000/0 (socket says 172.21.15.133:48000) 2023-12-19T19:01:40.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.236+0000 7f9c2ffff640 1 -- 172.21.15.133:0/1755304083 learned_addr learned my addr 172.21.15.133:0/1755304083 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:40.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.236+0000 7f9c2f7fe640 1 --2- 172.21.15.133:0/1755304083 >> v2:172.21.15.133:3300/0 conn(0x7f9c300c7ea0 0x7f9c3006b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:40.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.236+0000 7f9c2effd640 1 -- 172.21.15.133:0/1755304083 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728696309 0 0) 0x7f9c3006c860 con 0x7f9c30151e90 2023-12-19T19:01:40.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.236+0000 7f9c34b83640 1 --2- 172.21.15.133:0/1755304083 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c3006b9e0 0x7f9c3015f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:40.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.236+0000 7f9c2effd640 1 -- 172.21.15.133:0/1755304083 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c18003530 con 0x7f9c30151e90 2023-12-19T19:01:40.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.236+0000 7f9c2f7fe640 1 -- 172.21.15.133:0/1755304083 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c3006b9e0 msgr2=0x7f9c3015f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:40.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.236+0000 7f9c2f7fe640 1 --2- 172.21.15.133:0/1755304083 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c3006b9e0 0x7f9c3015f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.236+0000 7f9c2f7fe640 1 -- 172.21.15.133:0/1755304083 >> v1:172.21.15.133:6789/0 conn(0x7f9c30151e90 legacy=0x7f9c300c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:40.242 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.236+0000 7f9c2f7fe640 1 -- 172.21.15.133:0/1755304083 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c30154930 con 0x7f9c300c7ea0 2023-12-19T19:01:40.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.240+0000 7f9c2f7fe640 1 --2- 172.21.15.133:0/1755304083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c300c7ea0 0x7f9c3006b4a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f9c240097c0 tx=0x7f9c2401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e72e574d8df81d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:40.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.240+0000 7f9c2effd640 1 -- 172.21.15.133:0/1755304083 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c240ab600 con 0x7f9c300c7ea0 2023-12-19T19:01:40.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.240+0000 7f9c2effd640 1 -- 172.21.15.133:0/1755304083 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c240a7050 con 0x7f9c300c7ea0 2023-12-19T19:01:40.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.240+0000 7f9c2effd640 1 -- 172.21.15.133:0/1755304083 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c240ab960 con 0x7f9c300c7ea0 2023-12-19T19:01:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.240+0000 7f9c365e6640 1 -- 172.21.15.133:0/1755304083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c300c7ea0 msgr2=0x7f9c3006b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.240+0000 7f9c365e6640 1 --2- 172.21.15.133:0/1755304083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c300c7ea0 0x7f9c3006b4a0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f9c240097c0 tx=0x7f9c2401c360 comp rx=0 tx=0).stop 2023-12-19T19:01:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.240+0000 7f9c365e6640 1 -- 172.21.15.133:0/1755304083 shutdown_connections 2023-12-19T19:01:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.240+0000 7f9c365e6640 1 --2- 172.21.15.133:0/1755304083 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c3006b9e0 0x7f9c3015f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.240+0000 7f9c365e6640 1 --2- 172.21.15.133:0/1755304083 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c300c7ea0 0x7f9c3006b4a0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.240+0000 7f9c365e6640 1 -- 172.21.15.133:0/1755304083 >> 172.21.15.133:0/1755304083 conn(0x7f9c300ca170 msgr2=0x7f9c300ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.240+0000 7f9c365e6640 1 -- 172.21.15.133:0/1755304083 shutdown_connections 2023-12-19T19:01:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.240+0000 7f9c365e6640 1 -- 172.21.15.133:0/1755304083 wait complete. 2023-12-19T19:01:40.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.240+0000 7f9c365e6640 1 Processor -- start 2023-12-19T19:01:40.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c365e6640 1 -- start start 2023-12-19T19:01:40.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c365e6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c3006b9e0 0x7f9c301eddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:40.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c365e6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c300c7ea0 0x7f9c3014e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:40.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c365e6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c30151e90 0x7f9c301e7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:40.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c365e6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c301ee310 con 0x7f9c300c7ea0 2023-12-19T19:01:40.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c365e6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c301576b0 con 0x7f9c30151e90 2023-12-19T19:01:40.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c365e6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c30157990 con 0x7f9c3006b9e0 2023-12-19T19:01:40.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c2f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c300c7ea0 0x7f9c3014e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:40.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c2f7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c300c7ea0 0x7f9c3014e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53684/0 (socket says 172.21.15.133:53684) 2023-12-19T19:01:40.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c2f7fe640 1 -- 172.21.15.133:0/4072133863 learned_addr learned my addr 172.21.15.133:0/4072133863 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:40.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c2ffff640 1 --2- 172.21.15.133:0/4072133863 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c3006b9e0 0x7f9c301eddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:40.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c34b83640 1 --2- 172.21.15.133:0/4072133863 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c30151e90 0x7f9c301e7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:40.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c2f7fe640 1 -- 172.21.15.133:0/4072133863 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c3006b9e0 msgr2=0x7f9c301eddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:40.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c2f7fe640 1 --2- 172.21.15.133:0/4072133863 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c3006b9e0 0x7f9c301eddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c2f7fe640 1 -- 172.21.15.133:0/4072133863 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c30151e90 msgr2=0x7f9c301e7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:40.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c2f7fe640 1 --2- 172.21.15.133:0/4072133863 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c30151e90 0x7f9c301e7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c2f7fe640 1 -- 172.21.15.133:0/4072133863 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c24009420 con 0x7f9c300c7ea0 2023-12-19T19:01:40.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c34b83640 1 --2- 172.21.15.133:0/4072133863 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c30151e90 0x7f9c301e7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:40.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c2f7fe640 1 --2- 172.21.15.133:0/4072133863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c300c7ea0 0x7f9c3014e560 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f9c24019f90 tx=0x7f9c24019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:40.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c2cff9640 1 -- 172.21.15.133:0/4072133863 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c240abd90 con 0x7f9c300c7ea0 2023-12-19T19:01:40.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c2cff9640 1 -- 172.21.15.133:0/4072133863 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c24006e20 con 0x7f9c300c7ea0 2023-12-19T19:01:40.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c365e6640 1 -- 172.21.15.133:0/4072133863 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c30157c70 con 0x7f9c300c7ea0 2023-12-19T19:01:40.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c2cff9640 1 -- 172.21.15.133:0/4072133863 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c240b4600 con 0x7f9c300c7ea0 2023-12-19T19:01:40.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c365e6640 1 -- 172.21.15.133:0/4072133863 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c301e6df0 con 0x7f9c300c7ea0 2023-12-19T19:01:40.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.244+0000 7f9c365e6640 1 -- 172.21.15.133:0/4072133863 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c30068400 con 0x7f9c300c7ea0 2023-12-19T19:01:40.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.248+0000 7f9c2cff9640 1 -- 172.21.15.133:0/4072133863 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9c240b2040 con 0x7f9c300c7ea0 2023-12-19T19:01:40.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.248+0000 7f9c2cff9640 1 --2- 172.21.15.133:0/4072133863 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9c1c0664a0 0x7f9c1c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:40.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.248+0000 7f9c2cff9640 1 -- 172.21.15.133:0/4072133863 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c2411da50 con 0x7f9c300c7ea0 2023-12-19T19:01:40.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.248+0000 7f9c2ffff640 1 --2- 172.21.15.133:0/4072133863 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9c1c0664a0 0x7f9c1c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:40.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.248+0000 7f9c2ffff640 1 --2- 172.21.15.133:0/4072133863 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9c1c0664a0 0x7f9c1c068960 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9c20007fd0 tx=0x7f9c20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:40.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.252+0000 7f9c2cff9640 1 -- 172.21.15.133:0/4072133863 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9c240eaf60 con 0x7f9c300c7ea0 2023-12-19T19:01:40.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.400+0000 7f9c365e6640 1 -- 172.21.15.133:0/4072133863 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9c300c5a60 con 0x7f9c1c0664a0 2023-12-19T19:01:40.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.408+0000 7f9c2cff9640 1 -- 172.21.15.133:0/4072133863 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284121 (secure 0 0 0) 0x7f9c300c5a60 con 0x7f9c1c0664a0 2023-12-19T19:01:40.414 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:40.416 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T19:01:40.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.408+0000 7f9c365e6640 1 -- 172.21.15.133:0/4072133863 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9c1c0664a0 msgr2=0x7f9c1c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:40.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.408+0000 7f9c365e6640 1 --2- 172.21.15.133:0/4072133863 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9c1c0664a0 0x7f9c1c068960 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9c20007fd0 tx=0x7f9c20009040 comp rx=0 tx=0).stop 2023-12-19T19:01:40.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.408+0000 7f9c365e6640 1 -- 172.21.15.133:0/4072133863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c300c7ea0 msgr2=0x7f9c3014e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:40.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.408+0000 7f9c365e6640 1 --2- 172.21.15.133:0/4072133863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c300c7ea0 0x7f9c3014e560 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f9c24019f90 tx=0x7f9c24019100 comp rx=0 tx=0).stop 2023-12-19T19:01:40.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.408+0000 7f9c365e6640 1 -- 172.21.15.133:0/4072133863 shutdown_connections 2023-12-19T19:01:40.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.408+0000 7f9c365e6640 1 --2- 172.21.15.133:0/4072133863 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9c1c0664a0 0x7f9c1c068960 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.408+0000 7f9c365e6640 1 --2- 172.21.15.133:0/4072133863 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9c30151e90 0x7f9c301e7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.408+0000 7f9c365e6640 1 --2- 172.21.15.133:0/4072133863 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9c300c7ea0 0x7f9c3014e560 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.408+0000 7f9c365e6640 1 --2- 172.21.15.133:0/4072133863 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9c3006b9e0 0x7f9c301eddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.408+0000 7f9c365e6640 1 -- 172.21.15.133:0/4072133863 >> 172.21.15.133:0/4072133863 conn(0x7f9c300ca170 msgr2=0x7f9c301442c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:40.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.408+0000 7f9c365e6640 1 -- 172.21.15.133:0/4072133863 shutdown_connections 2023-12-19T19:01:40.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.408+0000 7f9c365e6640 1 -- 172.21.15.133:0/4072133863 wait complete. 2023-12-19T19:01:40.434 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2023-12-19T19:01:38.875838+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248700,"kb_used_data":7576,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754726020,"statfs":{"total":773094113280,"available":772839444480,"internally_reserved":0,"allocated":7757824,"data_stored":4029610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.913240"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.993780+0000","last_change":"2023-12-19T19:01:34.993780+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.993780+0000","last_undegraded":"2023-12-19T19:01:34.993780+0000","last_fullsized":"2023-12-19T19:01:34.993780+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.983586+0000","last_change":"2023-12-19T19:01:34.983586+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.983586+0000","last_undegraded":"2023-12-19T19:01:34.983586+0000","last_fullsized":"2023-12-19T19:01:34.983586+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.981798+0000","last_change":"2023-12-19T19:01:34.981798+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.981798+0000","last_undegraded":"2023-12-19T19:01:34.981798+0000","last_fullsized":"2023-12-19T19:01:34.981798+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980246+0000","last_change":"2023-12-19T19:01:34.980246+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980246+0000","last_undegraded":"2023-12-19T19:01:34.980246+0000","last_fullsized":"2023-12-19T19:01:34.980246+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.983335+0000","last_change":"2023-12-19T19:01:34.983335+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.983335+0000","last_undegraded":"2023-12-19T19:01:34.983335+0000","last_fullsized":"2023-12-19T19:01:34.983335+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.986592+0000","last_change":"2023-12-19T19:01:34.986592+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.986592+0000","last_undegraded":"2023-12-19T19:01:34.986592+0000","last_fullsized":"2023-12-19T19:01:34.986592+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984685+0000","last_change":"2023-12-19T19:01:34.984685+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984685+0000","last_undegraded":"2023-12-19T19:01:34.984685+0000","last_fullsized":"2023-12-19T19:01:34.984685+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984583+0000","last_change":"2023-12-19T19:01:34.984583+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984583+0000","last_undegraded":"2023-12-19T19:01:34.984583+0000","last_fullsized":"2023-12-19T19:01:34.984583+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.987226+0000","last_change":"2023-12-19T19:01:34.987226+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.987226+0000","last_undegraded":"2023-12-19T19:01:34.987226+0000","last_fullsized":"2023-12-19T19:01:34.987226+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.990652+0000","last_change":"2023-12-19T19:01:34.990652+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.990652+0000","last_undegraded":"2023-12-19T19:01:34.990652+0000","last_fullsized":"2023-12-19T19:01:34.990652+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979166+0000","last_change":"2023-12-19T19:01:34.979166+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979166+0000","last_undegraded":"2023-12-19T19:01:34.979166+0000","last_fullsized":"2023-12-19T19:01:34.979166+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.992632+0000","last_change":"2023-12-19T19:01:34.992632+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.992632+0000","last_undegraded":"2023-12-19T19:01:34.992632+0000","last_fullsized":"2023-12-19T19:01:34.992632+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.981312+0000","last_change":"2023-12-19T19:01:34.981312+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.981312+0000","last_undegraded":"2023-12-19T19:01:34.981312+0000","last_fullsized":"2023-12-19T19:01:34.981312+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.983073+0000","last_change":"2023-12-19T19:01:34.983073+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.983073+0000","last_undegraded":"2023-12-19T19:01:34.983073+0000","last_fullsized":"2023-12-19T19:01:34.983073+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979150+0000","last_change":"2023-12-19T19:01:34.979150+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979150+0000","last_undegraded":"2023-12-19T19:01:34.979150+0000","last_fullsized":"2023-12-19T19:01:34.979150+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.983703+0000","last_change":"2023-12-19T19:01:34.983703+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.983703+0000","last_undegraded":"2023-12-19T19:01:34.983703+0000","last_fullsized":"2023-12-19T19:01:34.983703+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.987894+0000","last_change":"2023-12-19T19:01:34.987894+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.987894+0000","last_undegraded":"2023-12-19T19:01:34.987894+0000","last_fullsized":"2023-12-19T19:01:34.987894+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.982203+0000","last_change":"2023-12-19T19:01:34.982203+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.982203+0000","last_undegraded":"2023-12-19T19:01:34.982203+0000","last_fullsized":"2023-12-19T19:01:34.982203+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.981398+0000","last_change":"2023-12-19T19:01:34.981398+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.981398+0000","last_undegraded":"2023-12-19T19:01:34.981398+0000","last_fullsized":"2023-12-19T19:01:34.981398+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979743+0000","last_change":"2023-12-19T19:01:34.979743+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979743+0000","last_undegraded":"2023-12-19T19:01:34.979743+0000","last_fullsized":"2023-12-19T19:01:34.979743+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.982223+0000","last_change":"2023-12-19T19:01:34.982223+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.982223+0000","last_undegraded":"2023-12-19T19:01:34.982223+0000","last_fullsized":"2023-12-19T19:01:34.982223+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980145+0000","last_change":"2023-12-19T19:01:34.980145+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980145+0000","last_undegraded":"2023-12-19T19:01:34.980145+0000","last_fullsized":"2023-12-19T19:01:34.980145+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.992668+0000","last_change":"2023-12-19T19:01:34.992668+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.992668+0000","last_undegraded":"2023-12-19T19:01:34.992668+0000","last_fullsized":"2023-12-19T19:01:34.992668+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979812+0000","last_change":"2023-12-19T19:01:34.979812+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979812+0000","last_undegraded":"2023-12-19T19:01:34.979812+0000","last_fullsized":"2023-12-19T19:01:34.979812+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.978398+0000","last_change":"2023-12-19T19:01:34.978398+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.978398+0000","last_undegraded":"2023-12-19T19:01:34.978398+0000","last_fullsized":"2023-12-19T19:01:34.978398+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980818+0000","last_change":"2023-12-19T19:01:34.980818+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980818+0000","last_undegraded":"2023-12-19T19:01:34.980818+0000","last_fullsized":"2023-12-19T19:01:34.980818+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984987+0000","last_change":"2023-12-19T19:01:34.984987+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984987+0000","last_undegraded":"2023-12-19T19:01:34.984987+0000","last_fullsized":"2023-12-19T19:01:34.984987+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.990456+0000","last_change":"2023-12-19T19:01:34.990456+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.990456+0000","last_undegraded":"2023-12-19T19:01:34.990456+0000","last_fullsized":"2023-12-19T19:01:34.990456+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979065+0000","last_change":"2023-12-19T19:01:34.979065+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979065+0000","last_undegraded":"2023-12-19T19:01:34.979065+0000","last_fullsized":"2023-12-19T19:01:34.979065+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979702+0000","last_change":"2023-12-19T19:01:34.979702+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979702+0000","last_undegraded":"2023-12-19T19:01:34.979702+0000","last_fullsized":"2023-12-19T19:01:34.979702+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.985374+0000","last_change":"2023-12-19T19:01:34.985374+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.985374+0000","last_undegraded":"2023-12-19T19:01:34.985374+0000","last_fullsized":"2023-12-19T19:01:34.985374+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.989863+0000","last_change":"2023-12-19T19:01:34.989863+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.989863+0000","last_undegraded":"2023-12-19T19:01:34.989863+0000","last_fullsized":"2023-12-19T19:01:34.989863+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.987197+0000","last_change":"2023-12-19T19:01:34.987197+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.987197+0000","last_undegraded":"2023-12-19T19:01:34.987197+0000","last_fullsized":"2023-12-19T19:01:34.987197+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.008424+0000","last_change":"2023-12-19T19:01:35.005860+0000","last_active":"2023-12-19T19:01:35.008424+0000","last_peered":"2023-12-19T19:01:35.008424+0000","last_clean":"2023-12-19T19:01:35.008424+0000","last_became_active":"2023-12-19T19:01:35.005458+0000","last_became_peered":"2023-12-19T19:01:35.005458+0000","last_unstale":"2023-12-19T19:01:35.008424+0000","last_undegraded":"2023-12-19T19:01:35.008424+0000","last_fullsized":"2023-12-19T19:01:35.008424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:04:11.121880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.993263+0000","last_change":"2023-12-19T19:01:34.993263+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.993263+0000","last_undegraded":"2023-12-19T19:01:34.993263+0000","last_fullsized":"2023-12-19T19:01:34.993263+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.005337+0000","last_change":"2023-12-19T19:01:35.000000+0000","last_active":"2023-12-19T19:01:35.005337+0000","last_peered":"2023-12-19T19:01:35.005337+0000","last_clean":"2023-12-19T19:01:35.005337+0000","last_became_active":"2023-12-19T19:01:34.999684+0000","last_became_peered":"2023-12-19T19:01:34.999684+0000","last_unstale":"2023-12-19T19:01:35.005337+0000","last_undegraded":"2023-12-19T19:01:35.005337+0000","last_fullsized":"2023-12-19T19:01:35.005337+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:04:11.121880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.989972+0000","last_change":"2023-12-19T19:01:34.989972+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.989972+0000","last_undegraded":"2023-12-19T19:01:34.989972+0000","last_fullsized":"2023-12-19T19:01:34.989972+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.003622+0000","last_change":"2023-12-19T19:01:34.996946+0000","last_active":"2023-12-19T19:01:35.003622+0000","last_peered":"2023-12-19T19:01:35.003622+0000","last_clean":"2023-12-19T19:01:35.003622+0000","last_became_active":"2023-12-19T19:01:34.995689+0000","last_became_peered":"2023-12-19T19:01:34.995689+0000","last_unstale":"2023-12-19T19:01:35.003622+0000","last_undegraded":"2023-12-19T19:01:35.003622+0000","last_fullsized":"2023-12-19T19:01:35.003622+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:32:15.466391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980070+0000","last_change":"2023-12-19T19:01:34.980070+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980070+0000","last_undegraded":"2023-12-19T19:01:34.980070+0000","last_fullsized":"2023-12-19T19:01:34.980070+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.003742+0000","last_change":"2023-12-19T19:01:34.997757+0000","last_active":"2023-12-19T19:01:35.003742+0000","last_peered":"2023-12-19T19:01:35.003742+0000","last_clean":"2023-12-19T19:01:35.003742+0000","last_became_active":"2023-12-19T19:01:34.997458+0000","last_became_peered":"2023-12-19T19:01:34.997458+0000","last_unstale":"2023-12-19T19:01:35.003742+0000","last_undegraded":"2023-12-19T19:01:35.003742+0000","last_fullsized":"2023-12-19T19:01:35.003742+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:48:51.739304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.977533+0000","last_change":"2023-12-19T19:01:34.977533+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.977533+0000","last_undegraded":"2023-12-19T19:01:34.977533+0000","last_fullsized":"2023-12-19T19:01:34.977533+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.001967+0000","last_change":"2023-12-19T19:01:34.994677+0000","last_active":"2023-12-19T19:01:35.001967+0000","last_peered":"2023-12-19T19:01:35.001967+0000","last_clean":"2023-12-19T19:01:35.001967+0000","last_became_active":"2023-12-19T19:01:34.994343+0000","last_became_peered":"2023-12-19T19:01:34.994343+0000","last_unstale":"2023-12-19T19:01:35.001967+0000","last_undegraded":"2023-12-19T19:01:35.001967+0000","last_fullsized":"2023-12-19T19:01:35.001967+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:29.601572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.982664+0000","last_change":"2023-12-19T19:01:34.982664+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.982664+0000","last_undegraded":"2023-12-19T19:01:34.982664+0000","last_fullsized":"2023-12-19T19:01:34.982664+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.005135+0000","last_change":"2023-12-19T19:01:34.998256+0000","last_active":"2023-12-19T19:01:35.005135+0000","last_peered":"2023-12-19T19:01:35.005135+0000","last_clean":"2023-12-19T19:01:35.005135+0000","last_became_active":"2023-12-19T19:01:34.997890+0000","last_became_peered":"2023-12-19T19:01:34.997890+0000","last_unstale":"2023-12-19T19:01:35.005135+0000","last_undegraded":"2023-12-19T19:01:35.005135+0000","last_fullsized":"2023-12-19T19:01:35.005135+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:36.683195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980845+0000","last_change":"2023-12-19T19:01:34.980845+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980845+0000","last_undegraded":"2023-12-19T19:01:34.980845+0000","last_fullsized":"2023-12-19T19:01:34.980845+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.001098+0000","last_change":"2023-12-19T19:01:34.995656+0000","last_active":"2023-12-19T19:01:35.001098+0000","last_peered":"2023-12-19T19:01:35.001098+0000","last_clean":"2023-12-19T19:01:35.001098+0000","last_became_active":"2023-12-19T19:01:34.995357+0000","last_became_peered":"2023-12-19T19:01:34.995357+0000","last_unstale":"2023-12-19T19:01:35.001098+0000","last_undegraded":"2023-12-19T19:01:35.001098+0000","last_fullsized":"2023-12-19T19:01:35.001098+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:06:40.560279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.978636+0000","last_change":"2023-12-19T19:01:34.978636+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.978636+0000","last_undegraded":"2023-12-19T19:01:34.978636+0000","last_fullsized":"2023-12-19T19:01:34.978636+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.006440+0000","last_change":"2023-12-19T19:01:35.000403+0000","last_active":"2023-12-19T19:01:35.006440+0000","last_peered":"2023-12-19T19:01:35.006440+0000","last_clean":"2023-12-19T19:01:35.006440+0000","last_became_active":"2023-12-19T19:01:34.998866+0000","last_became_peered":"2023-12-19T19:01:34.998866+0000","last_unstale":"2023-12-19T19:01:35.006440+0000","last_undegraded":"2023-12-19T19:01:35.006440+0000","last_fullsized":"2023-12-19T19:01:35.006440+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:41:08.421145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979573+0000","last_change":"2023-12-19T19:01:34.979573+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979573+0000","last_undegraded":"2023-12-19T19:01:34.979573+0000","last_fullsized":"2023-12-19T19:01:34.979573+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007157+0000","last_change":"2023-12-19T19:01:35.002076+0000","last_active":"2023-12-19T19:01:35.007157+0000","last_peered":"2023-12-19T19:01:35.007157+0000","last_clean":"2023-12-19T19:01:35.007157+0000","last_became_active":"2023-12-19T19:01:35.001645+0000","last_became_peered":"2023-12-19T19:01:35.001645+0000","last_unstale":"2023-12-19T19:01:35.007157+0000","last_undegraded":"2023-12-19T19:01:35.007157+0000","last_fullsized":"2023-12-19T19:01:35.007157+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:36.683195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984951+0000","last_change":"2023-12-19T19:01:34.984951+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984951+0000","last_undegraded":"2023-12-19T19:01:34.984951+0000","last_fullsized":"2023-12-19T19:01:34.984951+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007231+0000","last_change":"2023-12-19T19:01:35.003678+0000","last_active":"2023-12-19T19:01:35.007231+0000","last_peered":"2023-12-19T19:01:35.007231+0000","last_clean":"2023-12-19T19:01:35.007231+0000","last_became_active":"2023-12-19T19:01:35.003361+0000","last_became_peered":"2023-12-19T19:01:35.003361+0000","last_unstale":"2023-12-19T19:01:35.007231+0000","last_undegraded":"2023-12-19T19:01:35.007231+0000","last_fullsized":"2023-12-19T19:01:35.007231+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:33:31.174586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.982176+0000","last_change":"2023-12-19T19:01:34.982176+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.982176+0000","last_undegraded":"2023-12-19T19:01:34.982176+0000","last_fullsized":"2023-12-19T19:01:34.982176+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007180+0000","last_change":"2023-12-19T19:01:35.002668+0000","last_active":"2023-12-19T19:01:35.007180+0000","last_peered":"2023-12-19T19:01:35.007180+0000","last_clean":"2023-12-19T19:01:35.007180+0000","last_became_active":"2023-12-19T19:01:35.002367+0000","last_became_peered":"2023-12-19T19:01:35.002367+0000","last_unstale":"2023-12-19T19:01:35.007180+0000","last_undegraded":"2023-12-19T19:01:35.007180+0000","last_fullsized":"2023-12-19T19:01:35.007180+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:29.601572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984524+0000","last_change":"2023-12-19T19:01:34.984524+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984524+0000","last_undegraded":"2023-12-19T19:01:34.984524+0000","last_fullsized":"2023-12-19T19:01:34.984524+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.005100+0000","last_change":"2023-12-19T19:01:34.997430+0000","last_active":"2023-12-19T19:01:35.005100+0000","last_peered":"2023-12-19T19:01:35.005100+0000","last_clean":"2023-12-19T19:01:35.005100+0000","last_became_active":"2023-12-19T19:01:34.997110+0000","last_became_peered":"2023-12-19T19:01:34.997110+0000","last_unstale":"2023-12-19T19:01:35.005100+0000","last_undegraded":"2023-12-19T19:01:35.005100+0000","last_fullsized":"2023-12-19T19:01:35.005100+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:23:24.843750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.981922+0000","last_change":"2023-12-19T19:01:34.981922+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.981922+0000","last_undegraded":"2023-12-19T19:01:34.981922+0000","last_fullsized":"2023-12-19T19:01:34.981922+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:34.992237+0000","last_change":"2023-12-19T19:01:34.987868+0000","last_active":"2023-12-19T19:01:34.992237+0000","last_peered":"2023-12-19T19:01:34.992237+0000","last_clean":"2023-12-19T19:01:34.992237+0000","last_became_active":"2023-12-19T19:01:34.987545+0000","last_became_peered":"2023-12-19T19:01:34.987545+0000","last_unstale":"2023-12-19T19:01:34.992237+0000","last_undegraded":"2023-12-19T19:01:34.992237+0000","last_fullsized":"2023-12-19T19:01:34.992237+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:37:03.677408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980097+0000","last_change":"2023-12-19T19:01:34.980097+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980097+0000","last_undegraded":"2023-12-19T19:01:34.980097+0000","last_fullsized":"2023-12-19T19:01:34.980097+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.001401+0000","last_change":"2023-12-19T19:01:34.994756+0000","last_active":"2023-12-19T19:01:35.001401+0000","last_peered":"2023-12-19T19:01:35.001401+0000","last_clean":"2023-12-19T19:01:35.001401+0000","last_became_active":"2023-12-19T19:01:34.994476+0000","last_became_peered":"2023-12-19T19:01:34.994476+0000","last_unstale":"2023-12-19T19:01:35.001401+0000","last_undegraded":"2023-12-19T19:01:35.001401+0000","last_fullsized":"2023-12-19T19:01:35.001401+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:36.470347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.977480+0000","last_change":"2023-12-19T19:01:34.977480+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.977480+0000","last_undegraded":"2023-12-19T19:01:34.977480+0000","last_fullsized":"2023-12-19T19:01:34.977480+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.006124+0000","last_change":"2023-12-19T19:01:35.002999+0000","last_active":"2023-12-19T19:01:35.006124+0000","last_peered":"2023-12-19T19:01:35.006124+0000","last_clean":"2023-12-19T19:01:35.006124+0000","last_became_active":"2023-12-19T19:01:35.002667+0000","last_became_peered":"2023-12-19T19:01:35.002667+0000","last_unstale":"2023-12-19T19:01:35.006124+0000","last_undegraded":"2023-12-19T19:01:35.006124+0000","last_fullsized":"2023-12-19T19:01:35.006124+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:31.382424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.977484+0000","last_change":"2023-12-19T19:01:34.977484+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.977484+0000","last_undegraded":"2023-12-19T19:01:34.977484+0000","last_fullsized":"2023-12-19T19:01:34.977484+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:34.997990+0000","last_change":"2023-12-19T19:01:34.993756+0000","last_active":"2023-12-19T19:01:34.997990+0000","last_peered":"2023-12-19T19:01:34.997990+0000","last_clean":"2023-12-19T19:01:34.997990+0000","last_became_active":"2023-12-19T19:01:34.993466+0000","last_became_peered":"2023-12-19T19:01:34.993466+0000","last_unstale":"2023-12-19T19:01:34.997990+0000","last_undegraded":"2023-12-19T19:01:34.997990+0000","last_fullsized":"2023-12-19T19:01:34.997990+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:46:31.394472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980284+0000","last_change":"2023-12-19T19:01:34.980284+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980284+0000","last_undegraded":"2023-12-19T19:01:34.980284+0000","last_fullsized":"2023-12-19T19:01:34.980284+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007112+0000","last_change":"2023-12-19T19:01:35.001602+0000","last_active":"2023-12-19T19:01:35.007112+0000","last_peered":"2023-12-19T19:01:35.007112+0000","last_clean":"2023-12-19T19:01:35.007112+0000","last_became_active":"2023-12-19T19:01:35.000999+0000","last_became_peered":"2023-12-19T19:01:35.000999+0000","last_unstale":"2023-12-19T19:01:35.007112+0000","last_undegraded":"2023-12-19T19:01:35.007112+0000","last_fullsized":"2023-12-19T19:01:35.007112+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:32.294680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.992557+0000","last_change":"2023-12-19T19:01:34.992557+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.992557+0000","last_undegraded":"2023-12-19T19:01:34.992557+0000","last_fullsized":"2023-12-19T19:01:34.992557+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.003716+0000","last_change":"2023-12-19T19:01:34.999856+0000","last_active":"2023-12-19T19:01:35.003716+0000","last_peered":"2023-12-19T19:01:35.003716+0000","last_clean":"2023-12-19T19:01:35.003716+0000","last_became_active":"2023-12-19T19:01:34.999581+0000","last_became_peered":"2023-12-19T19:01:34.999581+0000","last_unstale":"2023-12-19T19:01:35.003716+0000","last_undegraded":"2023-12-19T19:01:35.003716+0000","last_fullsized":"2023-12-19T19:01:35.003716+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:13:22.016658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984072+0000","last_change":"2023-12-19T19:01:34.984072+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984072+0000","last_undegraded":"2023-12-19T19:01:34.984072+0000","last_fullsized":"2023-12-19T19:01:34.984072+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.000194+0000","last_change":"2023-12-19T19:01:34.992936+0000","last_active":"2023-12-19T19:01:35.000194+0000","last_peered":"2023-12-19T19:01:35.000194+0000","last_clean":"2023-12-19T19:01:35.000194+0000","last_became_active":"2023-12-19T19:01:34.992664+0000","last_became_peered":"2023-12-19T19:01:34.992664+0000","last_unstale":"2023-12-19T19:01:35.000194+0000","last_undegraded":"2023-12-19T19:01:35.000194+0000","last_fullsized":"2023-12-19T19:01:35.000194+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:06:56.928069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.982629+0000","last_change":"2023-12-19T19:01:34.982629+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.982629+0000","last_undegraded":"2023-12-19T19:01:34.982629+0000","last_fullsized":"2023-12-19T19:01:34.982629+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.003526+0000","last_change":"2023-12-19T19:01:35.000039+0000","last_active":"2023-12-19T19:01:35.003526+0000","last_peered":"2023-12-19T19:01:35.003526+0000","last_clean":"2023-12-19T19:01:35.003526+0000","last_became_active":"2023-12-19T19:01:34.999745+0000","last_became_peered":"2023-12-19T19:01:34.999745+0000","last_unstale":"2023-12-19T19:01:35.003526+0000","last_undegraded":"2023-12-19T19:01:35.003526+0000","last_fullsized":"2023-12-19T19:01:35.003526+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:53:02.681430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.985896+0000","last_change":"2023-12-19T19:01:34.985896+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.985896+0000","last_undegraded":"2023-12-19T19:01:34.985896+0000","last_fullsized":"2023-12-19T19:01:34.985896+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.000765+0000","last_change":"2023-12-19T19:01:34.996284+0000","last_active":"2023-12-19T19:01:35.000765+0000","last_peered":"2023-12-19T19:01:35.000765+0000","last_clean":"2023-12-19T19:01:35.000765+0000","last_became_active":"2023-12-19T19:01:34.996012+0000","last_became_peered":"2023-12-19T19:01:34.996012+0000","last_unstale":"2023-12-19T19:01:35.000765+0000","last_undegraded":"2023-12-19T19:01:35.000765+0000","last_fullsized":"2023-12-19T19:01:35.000765+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:33:03.964283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979228+0000","last_change":"2023-12-19T19:01:34.979228+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979228+0000","last_undegraded":"2023-12-19T19:01:34.979228+0000","last_fullsized":"2023-12-19T19:01:34.979228+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.006709+0000","last_change":"2023-12-19T19:01:35.002482+0000","last_active":"2023-12-19T19:01:35.006709+0000","last_peered":"2023-12-19T19:01:35.006709+0000","last_clean":"2023-12-19T19:01:35.006709+0000","last_became_active":"2023-12-19T19:01:35.002110+0000","last_became_peered":"2023-12-19T19:01:35.002110+0000","last_unstale":"2023-12-19T19:01:35.006709+0000","last_undegraded":"2023-12-19T19:01:35.006709+0000","last_fullsized":"2023-12-19T19:01:35.006709+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:40:40.108793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.987437+0000","last_change":"2023-12-19T19:01:34.987437+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.987437+0000","last_undegraded":"2023-12-19T19:01:34.987437+0000","last_fullsized":"2023-12-19T19:01:34.987437+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.001612+0000","last_change":"2023-12-19T19:01:34.997069+0000","last_active":"2023-12-19T19:01:35.001612+0000","last_peered":"2023-12-19T19:01:35.001612+0000","last_clean":"2023-12-19T19:01:35.001612+0000","last_became_active":"2023-12-19T19:01:34.996756+0000","last_became_peered":"2023-12-19T19:01:34.996756+0000","last_unstale":"2023-12-19T19:01:35.001612+0000","last_undegraded":"2023-12-19T19:01:35.001612+0000","last_fullsized":"2023-12-19T19:01:35.001612+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:35.546701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.986763+0000","last_change":"2023-12-19T19:01:34.986763+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.986763+0000","last_undegraded":"2023-12-19T19:01:34.986763+0000","last_fullsized":"2023-12-19T19:01:34.986763+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:34.997281+0000","last_change":"2023-12-19T19:01:34.989700+0000","last_active":"2023-12-19T19:01:34.997281+0000","last_peered":"2023-12-19T19:01:34.997281+0000","last_clean":"2023-12-19T19:01:34.997281+0000","last_became_active":"2023-12-19T19:01:34.989417+0000","last_became_peered":"2023-12-19T19:01:34.989417+0000","last_unstale":"2023-12-19T19:01:34.997281+0000","last_undegraded":"2023-12-19T19:01:34.997281+0000","last_fullsized":"2023-12-19T19:01:34.997281+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:06:45.607378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980782+0000","last_change":"2023-12-19T19:01:34.980782+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980782+0000","last_undegraded":"2023-12-19T19:01:34.980782+0000","last_fullsized":"2023-12-19T19:01:34.980782+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:34.992101+0000","last_change":"2023-12-19T19:01:34.986750+0000","last_active":"2023-12-19T19:01:34.992101+0000","last_peered":"2023-12-19T19:01:34.992101+0000","last_clean":"2023-12-19T19:01:34.992101+0000","last_became_active":"2023-12-19T19:01:34.986455+0000","last_became_peered":"2023-12-19T19:01:34.986455+0000","last_unstale":"2023-12-19T19:01:34.992101+0000","last_undegraded":"2023-12-19T19:01:34.992101+0000","last_fullsized":"2023-12-19T19:01:34.992101+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:01:50.322532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.989455+0000","last_change":"2023-12-19T19:01:34.989455+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.989455+0000","last_undegraded":"2023-12-19T19:01:34.989455+0000","last_fullsized":"2023-12-19T19:01:34.989455+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007075+0000","last_change":"2023-12-19T19:01:35.001204+0000","last_active":"2023-12-19T19:01:35.007075+0000","last_peered":"2023-12-19T19:01:35.007075+0000","last_clean":"2023-12-19T19:01:35.007075+0000","last_became_active":"2023-12-19T19:01:35.000589+0000","last_became_peered":"2023-12-19T19:01:35.000589+0000","last_unstale":"2023-12-19T19:01:35.007075+0000","last_undegraded":"2023-12-19T19:01:35.007075+0000","last_fullsized":"2023-12-19T19:01:35.007075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:48:27.490312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.983538+0000","last_change":"2023-12-19T19:01:34.983538+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.983538+0000","last_undegraded":"2023-12-19T19:01:34.983538+0000","last_fullsized":"2023-12-19T19:01:34.983538+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.005497+0000","last_change":"2023-12-19T19:01:34.999664+0000","last_active":"2023-12-19T19:01:35.005497+0000","last_peered":"2023-12-19T19:01:35.005497+0000","last_clean":"2023-12-19T19:01:35.005497+0000","last_became_active":"2023-12-19T19:01:34.998997+0000","last_became_peered":"2023-12-19T19:01:34.998997+0000","last_unstale":"2023-12-19T19:01:35.005497+0000","last_undegraded":"2023-12-19T19:01:35.005497+0000","last_fullsized":"2023-12-19T19:01:35.005497+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:38:15.768063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.985453+0000","last_change":"2023-12-19T19:01:34.985453+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.985453+0000","last_undegraded":"2023-12-19T19:01:34.985453+0000","last_fullsized":"2023-12-19T19:01:34.985453+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:34.994967+0000","last_change":"2023-12-19T19:01:34.990870+0000","last_active":"2023-12-19T19:01:34.994967+0000","last_peered":"2023-12-19T19:01:34.994967+0000","last_clean":"2023-12-19T19:01:34.994967+0000","last_became_active":"2023-12-19T19:01:34.990513+0000","last_became_peered":"2023-12-19T19:01:34.990513+0000","last_unstale":"2023-12-19T19:01:34.994967+0000","last_undegraded":"2023-12-19T19:01:34.994967+0000","last_fullsized":"2023-12-19T19:01:34.994967+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:27:03.813755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984415+0000","last_change":"2023-12-19T19:01:34.984415+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984415+0000","last_undegraded":"2023-12-19T19:01:34.984415+0000","last_fullsized":"2023-12-19T19:01:34.984415+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.001199+0000","last_change":"2023-12-19T19:01:34.994259+0000","last_active":"2023-12-19T19:01:35.001199+0000","last_peered":"2023-12-19T19:01:35.001199+0000","last_clean":"2023-12-19T19:01:35.001199+0000","last_became_active":"2023-12-19T19:01:34.992784+0000","last_became_peered":"2023-12-19T19:01:34.992784+0000","last_unstale":"2023-12-19T19:01:35.001199+0000","last_undegraded":"2023-12-19T19:01:35.001199+0000","last_fullsized":"2023-12-19T19:01:35.001199+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:32.294680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980169+0000","last_change":"2023-12-19T19:01:34.980169+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980169+0000","last_undegraded":"2023-12-19T19:01:34.980169+0000","last_fullsized":"2023-12-19T19:01:34.980169+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007161+0000","last_change":"2023-12-19T19:01:35.001846+0000","last_active":"2023-12-19T19:01:35.007161+0000","last_peered":"2023-12-19T19:01:35.007161+0000","last_clean":"2023-12-19T19:01:35.007161+0000","last_became_active":"2023-12-19T19:01:35.000362+0000","last_became_peered":"2023-12-19T19:01:35.000362+0000","last_unstale":"2023-12-19T19:01:35.007161+0000","last_undegraded":"2023-12-19T19:01:35.007161+0000","last_fullsized":"2023-12-19T19:01:35.007161+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:11.163857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.991560+0000","last_change":"2023-12-19T19:01:34.991560+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.991560+0000","last_undegraded":"2023-12-19T19:01:34.991560+0000","last_fullsized":"2023-12-19T19:01:34.991560+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.005088+0000","last_change":"2023-12-19T19:01:34.998108+0000","last_active":"2023-12-19T19:01:35.005088+0000","last_peered":"2023-12-19T19:01:35.005088+0000","last_clean":"2023-12-19T19:01:35.005088+0000","last_became_active":"2023-12-19T19:01:34.997738+0000","last_became_peered":"2023-12-19T19:01:34.997738+0000","last_unstale":"2023-12-19T19:01:35.005088+0000","last_undegraded":"2023-12-19T19:01:35.005088+0000","last_fullsized":"2023-12-19T19:01:35.005088+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:48:27.490312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.977470+0000","last_change":"2023-12-19T19:01:34.977470+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.977470+0000","last_undegraded":"2023-12-19T19:01:34.977470+0000","last_fullsized":"2023-12-19T19:01:34.977470+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.002980+0000","last_change":"2023-12-19T19:01:34.999764+0000","last_active":"2023-12-19T19:01:35.002980+0000","last_peered":"2023-12-19T19:01:35.002980+0000","last_clean":"2023-12-19T19:01:35.002980+0000","last_became_active":"2023-12-19T19:01:34.998931+0000","last_became_peered":"2023-12-19T19:01:34.998931+0000","last_unstale":"2023-12-19T19:01:35.002980+0000","last_undegraded":"2023-12-19T19:01:35.002980+0000","last_fullsized":"2023-12-19T19:01:35.002980+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:46:31.394472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":213,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-19T19:01:33.964823+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T19:01:33.964823+0000","last_peered":"2023-12-19T19:01:33.964823+0000","last_clean":"2023-12-19T19:01:33.964823+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T19:01:33.964823+0000","last_undegraded":"2023-12-19T19:01:33.964823+0000","last_fullsized":"2023-12-19T19:01:33.964823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1417216,"data_stored":947389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.68899999999999995},"min":{"1min":0.44,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92500000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.72399999999999998},"min":{"1min":0.50700000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89300000000000002,"5min":1.117,"15min":1.117},"last":0.89300000000000002}]},{"osd":1,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.46700000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83899999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.751},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83399999999999996,"5min":1.01,"15min":1.01},"last":0.82099999999999995}]},{"osd":2,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85499999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.58299999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89500000000000002,"5min":1.089,"15min":1.089},"last":0.80300000000000005}]},{"osd":3,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71299999999999997,"15min":0.72699999999999998},"min":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90900000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73299999999999998,"15min":0.73499999999999999},"min":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91600000000000004,"5min":1.026,"15min":1.026},"last":0.86899999999999999}]},{"osd":4,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64400000000000002,"15min":0.65600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88500000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66700000000000004,"15min":0.67400000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93799999999999994,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.66500000000000004}]},{"osd":5,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93200000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.623},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.70599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91500000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.60799999999999998}]},{"osd":6,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.96799999999999997,"5min":1.069,"15min":1.069},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78000000000000003,"15min":0.79600000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.77800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":357021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.98899999999999999,"5min":1.022,"15min":1.022},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.89800000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.89800000000000002}]},{"osd":1,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67100000000000004,"15min":0.65700000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.871,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.871},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.52300000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91500000000000004,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.81899999999999995}]},{"osd":2,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.443,"5min":0.437,"15min":0.437},"max":{"1min":0.96299999999999997,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.71999999999999997,"15min":0.71699999999999997},"min":{"1min":0.58099999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94899999999999995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.94899999999999995}]},{"osd":3,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83499999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72199999999999998,"15min":0.72699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91900000000000004,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.91900000000000004}]},{"osd":4,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.48599999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.74099999999999999,"15min":0.755},"min":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95999999999999996,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.60999999999999999}]},{"osd":5,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.93700000000000006,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73199999999999998,"15min":0.73599999999999999},"min":{"1min":0.54600000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.65800000000000003}]},{"osd":7,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.52800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.63600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":350746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.90500000000000003,"15min":0.94899999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0880000000000001,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":1.3420000000000001,"15min":1.452},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1180000000000001,"5min":16.951000000000001,"15min":16.951000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":1.411,"15min":1.5429999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0700000000000001,"5min":19.823,"15min":19.823},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.44500000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.216,"5min":1.657,"15min":1.657},"last":0.77300000000000002}]},{"osd":2,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.74199999999999999,"15min":0.755},"min":{"1min":0.48799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.163,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1020000000000001,"5min":1.585,"15min":1.585},"last":0.66600000000000004}]},{"osd":3,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.78000000000000003,"15min":0.79100000000000004},"min":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0589999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.97299999999999998,"15min":1.0149999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0740000000000001,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":0.79000000000000004}]},{"osd":4,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.45200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0049999999999999,"5min":1.716,"15min":1.716},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.504,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97899999999999998,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":0.59499999999999997}]},{"osd":6,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.82799999999999996,"15min":0.85099999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.86599999999999999,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.82999999999999996,"15min":0.84599999999999997},"min":{"1min":0.51100000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90600000000000003,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.83099999999999996}]},{"osd":7,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82899999999999996,"15min":0.83899999999999997},"min":{"1min":0.60599999999999998,"5min":0.498,"15min":0.498},"max":{"1min":1.0900000000000001,"5min":2.371,"15min":2.371},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0369999999999999,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.84999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":357021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.84299999999999997,"15min":0.875},"min":{"1min":0.46800000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86899999999999999,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78500000000000003,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.66900000000000004}]},{"osd":1,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.51800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88200000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.79200000000000004,"15min":0.80700000000000005},"min":{"1min":0.56699999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94599999999999995,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":0.86399999999999999}]},{"osd":2,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69199999999999995,"15min":0.69299999999999995},"min":{"1min":0.53800000000000003,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.80300000000000005,"15min":0.81999999999999995},"min":{"1min":0.56000000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.88,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.751}]},{"osd":3,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.84999999999999998,"5min":3.641,"15min":3.641},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.872,"15min":0.89800000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.85399999999999998,"5min":3.194,"15min":3.194},"last":0.73899999999999999}]},{"osd":5,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":1.0269999999999999,"15min":1.089},"min":{"1min":0.42699999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0449999999999999,"5min":9.3040000000000003,"15min":9.3040000000000003},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.71999999999999997,"15min":0.73999999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94099999999999995,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.84499999999999997}]},{"osd":6,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.81799999999999995,"15min":0.84199999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97699999999999998,"5min":3.097,"15min":3.097},"last":0.88},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.86599999999999999,"15min":0.89100000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97899999999999998,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.89700000000000002}]},{"osd":7,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.94199999999999995,"15min":0.97999999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0409999999999999,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":1.0289999999999999,"15min":1.077},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98699999999999999,"5min":6.3449999999999998,"15min":6.3449999999999998},"last":0.79800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":357021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72699999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.36099999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.41299999999999998}]},{"osd":1,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46700000000000003,"15min":0.48499999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60699999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.64300000000000002}]},{"osd":2,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.74299999999999999,"5min":0.75,"15min":0.75},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.54700000000000004},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77600000000000002,"5min":0.875,"15min":0.875},"last":0.432}]},{"osd":4,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88400000000000001,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98999999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.61299999999999999}]},{"osd":5,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.50600000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94999999999999996,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.752,"15min":0.77000000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.04,"5min":1.202,"15min":1.202},"last":0.59799999999999998}]},{"osd":6,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96399999999999997,"5min":1.298,"15min":1.298},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.98299999999999998,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.68899999999999995}]},{"osd":7,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94999999999999996,"5min":1.155,"15min":1.155},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93000000000000005,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.66400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":357021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.497,"15min":0.50700000000000001},"min":{"1min":0.313,"5min":0.31,"15min":0.31},"max":{"1min":0.57899999999999996,"5min":1.458,"15min":1.458},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.627,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.373}]},{"osd":1,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.57899999999999996,"15min":0.59899999999999998},"min":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.58499999999999996,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.60399999999999998,"15min":0.624},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.61799999999999999,"5min":2.444,"15min":2.444},"last":0.44600000000000001}]},{"osd":3,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.59599999999999997,"15min":0.62},"min":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65300000000000002,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.625,"15min":0.64300000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.69199999999999995,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.46300000000000002}]},{"osd":4,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.93899999999999995,"15min":0.97499999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.94399999999999995,"5min":1.968,"15min":1.968},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.89500000000000002,"15min":0.92500000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.90700000000000003,"5min":2.835,"15min":2.835},"last":0.72799999999999998}]},{"osd":5,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.91600000000000004,"15min":0.94999999999999996},"min":{"1min":0.56000000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.94599999999999995,"5min":3.5,"15min":3.5},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.91100000000000003,"15min":0.93999999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.99099999999999999,"5min":1.996,"15min":1.996},"last":0.60799999999999998}]},{"osd":6,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.91200000000000003,"15min":0.94699999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.97599999999999998,"5min":2.903,"15min":2.903},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.99199999999999999,"15min":1.034},"min":{"1min":0.53700000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.92800000000000005,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.63700000000000001}]},{"osd":7,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.94999999999999996,"15min":0.98599999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.0049999999999999,"5min":2.875,"15min":2.875},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.94299999999999995,"15min":0.98099999999999998},"min":{"1min":0.59399999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.91900000000000004,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.752}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":357021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.55200000000000005,"15min":0.58099999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.51600000000000001,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.309},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.748,"15min":0.80100000000000005},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.70399999999999996,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.503}]},{"osd":2,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.57199999999999995,"15min":0.59599999999999997},"min":{"1min":0.316,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.63,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.65600000000000003,"15min":0.68899999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65300000000000002,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.46100000000000002}]},{"osd":3,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.79300000000000004,"15min":0.84199999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.629,"5min":7.8399999999999999,"15min":7.8399999999999999},"last":0.436},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.81200000000000006,"15min":0.85999999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72499999999999998,"5min":7.7949999999999999,"15min":7.7949999999999999},"last":0.52700000000000002}]},{"osd":4,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.86799999999999999,"15min":0.89900000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0900000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.89900000000000002,"15min":0.93000000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0289999999999999,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.66700000000000004}]},{"osd":5,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.879,"15min":0.90900000000000003},"min":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92600000000000005,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.627},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.88500000000000001,"15min":0.91800000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98899999999999999,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.71199999999999997}]},{"osd":6,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.88300000000000001,"15min":0.90800000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94699999999999995,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.93100000000000005,"15min":0.96899999999999997},"min":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0469999999999999,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.68600000000000005}]},{"osd":7,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.93600000000000005,"15min":0.96799999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1180000000000001,"5min":4.3310000000000004,"15min":4.3310000000000004},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.89200000000000002,"15min":0.92000000000000004},"min":{"1min":0.55200000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.97599999999999998,"5min":4.226,"15min":4.226},"last":0.83299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1413120,"data_stored":946370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.436,"15min":0.44800000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60299999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48899999999999999,"15min":0.503},"min":{"1min":0.29799999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65700000000000003,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.41599999999999998}]},{"osd":2,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.50600000000000001,"15min":0.51300000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63700000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.5},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.51100000000000001},"min":{"1min":0.40799999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.372}]},{"osd":3,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48199999999999998,"15min":0.48699999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.55900000000000005,"5min":0.747,"15min":0.747},"last":0.441},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.57799999999999996,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69299999999999995,"5min":1.264,"15min":1.264},"last":0.46200000000000002}]},{"osd":4,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.74199999999999999,"15min":0.748},"min":{"1min":0.502,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93999999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89900000000000002,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.77400000000000002}]},{"osd":5,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.749},"min":{"1min":0.57299999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.89300000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79200000000000004,"15min":0.81699999999999995},"min":{"1min":0.57199999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.91000000000000003,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.71799999999999997}]},{"osd":6,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.79600000000000004,"15min":0.82499999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92600000000000005,"5min":1.349,"15min":1.349},"last":0.745},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0189999999999999,"5min":1.115,"15min":1.115},"last":0.69599999999999995}]},{"osd":7,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.57499999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94899999999999995,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.79200000000000004,"15min":0.81200000000000006},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.93200000000000005,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.81000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T19:01:40.441 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T19:01:40.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.608+0000 7f87ccaaa640 1 Processor -- start 2023-12-19T19:01:40.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.608+0000 7f87ccaaa640 1 -- start start 2023-12-19T19:01:40.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.608+0000 7f87ccaaa640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f87c8151e90 0x7f87c80c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:40.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.608+0000 7f87ccaaa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f87c80c7ea0 0x7f87c806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:40.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.608+0000 7f87ccaaa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87c80c4e60 0x7f87c806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:40.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.608+0000 7f87ccaaa640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c80c8750 con 0x7f87c8151e90 2023-12-19T19:01:40.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.608+0000 7f87ccaaa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c81552d0 con 0x7f87c80c7ea0 2023-12-19T19:01:40.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.608+0000 7f87ccaaa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c80c5c60 con 0x7f87c80c4e60 2023-12-19T19:01:40.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.608+0000 7f87c659c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f87c8151e90 0x7f87c80c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:40.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.608+0000 7f87c659c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f87c8151e90 0x7f87c80c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53700/0 (socket says 172.21.15.133:53700) 2023-12-19T19:01:40.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.608+0000 7f87c659c640 1 -- 172.21.15.133:0/1720584611 learned_addr learned my addr 172.21.15.133:0/1720584611 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:40.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.608+0000 7f87c6d9d640 1 --2- 172.21.15.133:0/1720584611 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87c80c4e60 0x7f87c806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:40.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.608+0000 7f87bdd9b640 1 --2- 172.21.15.133:0/1720584611 >> v2:172.21.15.138:3300/0 conn(0x7f87c80c7ea0 0x7f87c806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:40.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.608+0000 7f87c659c640 1 -- 172.21.15.133:0/1720584611 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87c80c4e60 msgr2=0x7f87c806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:40.614 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.608+0000 7f87c659c640 1 --2- 172.21.15.133:0/1720584611 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87c80c4e60 0x7f87c806b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.608+0000 7f87c659c640 1 -- 172.21.15.133:0/1720584611 >> v2:172.21.15.138:3300/0 conn(0x7f87c80c7ea0 msgr2=0x7f87c806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:40.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.608+0000 7f87c659c640 1 --2- 172.21.15.133:0/1720584611 >> v2:172.21.15.138:3300/0 conn(0x7f87c80c7ea0 0x7f87c806b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.608+0000 7f87c659c640 1 -- 172.21.15.133:0/1720584611 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c806c860 con 0x7f87c8151e90 2023-12-19T19:01:40.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.612+0000 7f87c659c640 1 --2- 172.21.15.133:0/1720584611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87c8151e90 0x7f87c80c4920 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f87c80a9a70 tx=0x7f87b801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43152335355ea01 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:40.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.612+0000 7f87c5d9b640 1 -- 172.21.15.133:0/1720584611 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b80a5530 con 0x7f87c8151e90 2023-12-19T19:01:40.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.612+0000 7f87c5d9b640 1 -- 172.21.15.133:0/1720584611 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b80a5690 con 0x7f87c8151e90 2023-12-19T19:01:40.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.612+0000 7f87c5d9b640 1 -- 172.21.15.133:0/1720584611 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b80a5a20 con 0x7f87c8151e90 2023-12-19T19:01:40.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.612+0000 7f87ccaaa640 1 -- 172.21.15.133:0/1720584611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87c8151e90 msgr2=0x7f87c80c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:40.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.612+0000 7f87ccaaa640 1 --2- 172.21.15.133:0/1720584611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87c8151e90 0x7f87c80c4920 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f87c80a9a70 tx=0x7f87b801c8b0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.612+0000 7f87ccaaa640 1 -- 172.21.15.133:0/1720584611 shutdown_connections 2023-12-19T19:01:40.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.612+0000 7f87ccaaa640 1 --2- 172.21.15.133:0/1720584611 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87c80c4e60 0x7f87c806b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.612+0000 7f87ccaaa640 1 --2- 172.21.15.133:0/1720584611 >> v2:172.21.15.138:3300/0 conn(0x7f87c80c7ea0 0x7f87c806b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.612+0000 7f87ccaaa640 1 --2- 172.21.15.133:0/1720584611 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87c8151e90 0x7f87c80c4920 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.612+0000 7f87ccaaa640 1 -- 172.21.15.133:0/1720584611 >> 172.21.15.133:0/1720584611 conn(0x7f87c80ca170 msgr2=0x7f87c80ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:40.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.612+0000 7f87ccaaa640 1 -- 172.21.15.133:0/1720584611 shutdown_connections 2023-12-19T19:01:40.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.612+0000 7f87ccaaa640 1 -- 172.21.15.133:0/1720584611 wait complete. 2023-12-19T19:01:40.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87ccaaa640 1 Processor -- start 2023-12-19T19:01:40.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87ccaaa640 1 -- start start 2023-12-19T19:01:40.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87ccaaa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87c80c4e60 0x7f87c80ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:40.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87ccaaa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87c80c7ea0 0x7f87c81448a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:40.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87ccaaa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87c8151e90 0x7f87c8144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:40.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87ccaaa640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c80abb50 con 0x7f87c80c7ea0 2023-12-19T19:01:40.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87ccaaa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c8143e20 con 0x7f87c80c4e60 2023-12-19T19:01:40.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87ccaaa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c8150220 con 0x7f87c8151e90 2023-12-19T19:01:40.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87bdd9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87c80c7ea0 0x7f87c81448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:40.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87bdd9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87c80c7ea0 0x7f87c81448a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53714/0 (socket says 172.21.15.133:53714) 2023-12-19T19:01:40.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87bdd9b640 1 -- 172.21.15.133:0/1819477582 learned_addr learned my addr 172.21.15.133:0/1819477582 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:40.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87c659c640 1 --2- 172.21.15.133:0/1819477582 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87c80c4e60 0x7f87c80ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:40.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87c6d9d640 1 --2- 172.21.15.133:0/1819477582 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87c8151e90 0x7f87c8144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:40.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87bdd9b640 1 -- 172.21.15.133:0/1819477582 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87c8151e90 msgr2=0x7f87c8144de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:40.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87bdd9b640 1 --2- 172.21.15.133:0/1819477582 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87c8151e90 0x7f87c8144de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87bdd9b640 1 -- 172.21.15.133:0/1819477582 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87c80c4e60 msgr2=0x7f87c80ac1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:40.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87bdd9b640 1 --2- 172.21.15.133:0/1819477582 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87c80c4e60 0x7f87c80ac1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87bdd9b640 1 -- 172.21.15.133:0/1819477582 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b8009b30 con 0x7f87c80c7ea0 2023-12-19T19:01:40.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87c6d9d640 1 --2- 172.21.15.133:0/1819477582 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87c8151e90 0x7f87c8144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:40.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87c659c640 1 --2- 172.21.15.133:0/1819477582 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87c80c4e60 0x7f87c80ac1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:40.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87bdd9b640 1 --2- 172.21.15.133:0/1819477582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87c80c7ea0 0x7f87c81448a0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f87b000d5f0 tx=0x7f87b000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:40.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87bf7fe640 1 -- 172.21.15.133:0/1819477582 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b00125f0 con 0x7f87c80c7ea0 2023-12-19T19:01:40.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87bf7fe640 1 -- 172.21.15.133:0/1819477582 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b0012750 con 0x7f87c80c7ea0 2023-12-19T19:01:40.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87ccaaa640 1 -- 172.21.15.133:0/1819477582 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c8153860 con 0x7f87c80c7ea0 2023-12-19T19:01:40.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87bf7fe640 1 -- 172.21.15.133:0/1819477582 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b0012ae0 con 0x7f87c80c7ea0 2023-12-19T19:01:40.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.616+0000 7f87ccaaa640 1 -- 172.21.15.133:0/1819477582 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c8153e20 con 0x7f87c80c7ea0 2023-12-19T19:01:40.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.620+0000 7f87ccaaa640 1 -- 172.21.15.133:0/1819477582 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c8153fe0 con 0x7f87c80c7ea0 2023-12-19T19:01:40.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.620+0000 7f87bf7fe640 1 -- 172.21.15.133:0/1819477582 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f87b0012c40 con 0x7f87c80c7ea0 2023-12-19T19:01:40.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.620+0000 7f87bf7fe640 1 --2- 172.21.15.133:0/1819477582 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f87a80664a0 0x7f87a8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:40.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.620+0000 7f87bf7fe640 1 -- 172.21.15.133:0/1819477582 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87b00842c0 con 0x7f87c80c7ea0 2023-12-19T19:01:40.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.620+0000 7f87c659c640 1 --2- 172.21.15.133:0/1819477582 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f87a80664a0 0x7f87a8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:40.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.620+0000 7f87c659c640 1 --2- 172.21.15.133:0/1819477582 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f87a80664a0 0x7f87a8068960 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f87b80ae000 tx=0x7f87b80a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:40.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.624+0000 7f87bf7fe640 1 -- 172.21.15.133:0/1819477582 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f87b00517d0 con 0x7f87c80c7ea0 2023-12-19T19:01:40.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.768+0000 7f87ccaaa640 1 -- 172.21.15.133:0/1819477582 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f87c8158520 con 0x7f87a80664a0 2023-12-19T19:01:40.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.776+0000 7f87bf7fe640 1 -- 172.21.15.133:0/1819477582 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284121 (secure 0 0 0) 0x7f87c8158520 con 0x7f87a80664a0 2023-12-19T19:01:40.785 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:40.787 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T19:01:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.780+0000 7f87ccaaa640 1 -- 172.21.15.133:0/1819477582 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f87a80664a0 msgr2=0x7f87a8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.780+0000 7f87ccaaa640 1 --2- 172.21.15.133:0/1819477582 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f87a80664a0 0x7f87a8068960 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f87b80ae000 tx=0x7f87b80a7070 comp rx=0 tx=0).stop 2023-12-19T19:01:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.780+0000 7f87ccaaa640 1 -- 172.21.15.133:0/1819477582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87c80c7ea0 msgr2=0x7f87c81448a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.780+0000 7f87ccaaa640 1 --2- 172.21.15.133:0/1819477582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87c80c7ea0 0x7f87c81448a0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f87b000d5f0 tx=0x7f87b000dab0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.780+0000 7f87ccaaa640 1 -- 172.21.15.133:0/1819477582 shutdown_connections 2023-12-19T19:01:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.780+0000 7f87ccaaa640 1 --2- 172.21.15.133:0/1819477582 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f87a80664a0 0x7f87a8068960 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.780+0000 7f87ccaaa640 1 --2- 172.21.15.133:0/1819477582 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87c8151e90 0x7f87c8144de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.780+0000 7f87ccaaa640 1 --2- 172.21.15.133:0/1819477582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f87c80c7ea0 0x7f87c81448a0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.780+0000 7f87ccaaa640 1 --2- 172.21.15.133:0/1819477582 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f87c80c4e60 0x7f87c80ac1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.780+0000 7f87ccaaa640 1 -- 172.21.15.133:0/1819477582 >> 172.21.15.133:0/1819477582 conn(0x7f87c80ca170 msgr2=0x7f87c814f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:40.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.780+0000 7f87ccaaa640 1 -- 172.21.15.133:0/1819477582 shutdown_connections 2023-12-19T19:01:40.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.780+0000 7f87ccaaa640 1 -- 172.21.15.133:0/1819477582 wait complete. 2023-12-19T19:01:40.805 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2023-12-19T19:01:38.875838+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248700,"kb_used_data":7576,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754726020,"statfs":{"total":773094113280,"available":772839444480,"internally_reserved":0,"allocated":7757824,"data_stored":4029610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.913240"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.993780+0000","last_change":"2023-12-19T19:01:34.993780+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.993780+0000","last_undegraded":"2023-12-19T19:01:34.993780+0000","last_fullsized":"2023-12-19T19:01:34.993780+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.983586+0000","last_change":"2023-12-19T19:01:34.983586+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.983586+0000","last_undegraded":"2023-12-19T19:01:34.983586+0000","last_fullsized":"2023-12-19T19:01:34.983586+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.981798+0000","last_change":"2023-12-19T19:01:34.981798+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.981798+0000","last_undegraded":"2023-12-19T19:01:34.981798+0000","last_fullsized":"2023-12-19T19:01:34.981798+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980246+0000","last_change":"2023-12-19T19:01:34.980246+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980246+0000","last_undegraded":"2023-12-19T19:01:34.980246+0000","last_fullsized":"2023-12-19T19:01:34.980246+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.983335+0000","last_change":"2023-12-19T19:01:34.983335+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.983335+0000","last_undegraded":"2023-12-19T19:01:34.983335+0000","last_fullsized":"2023-12-19T19:01:34.983335+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.986592+0000","last_change":"2023-12-19T19:01:34.986592+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.986592+0000","last_undegraded":"2023-12-19T19:01:34.986592+0000","last_fullsized":"2023-12-19T19:01:34.986592+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984685+0000","last_change":"2023-12-19T19:01:34.984685+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984685+0000","last_undegraded":"2023-12-19T19:01:34.984685+0000","last_fullsized":"2023-12-19T19:01:34.984685+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984583+0000","last_change":"2023-12-19T19:01:34.984583+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984583+0000","last_undegraded":"2023-12-19T19:01:34.984583+0000","last_fullsized":"2023-12-19T19:01:34.984583+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.987226+0000","last_change":"2023-12-19T19:01:34.987226+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.987226+0000","last_undegraded":"2023-12-19T19:01:34.987226+0000","last_fullsized":"2023-12-19T19:01:34.987226+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.990652+0000","last_change":"2023-12-19T19:01:34.990652+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.990652+0000","last_undegraded":"2023-12-19T19:01:34.990652+0000","last_fullsized":"2023-12-19T19:01:34.990652+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979166+0000","last_change":"2023-12-19T19:01:34.979166+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979166+0000","last_undegraded":"2023-12-19T19:01:34.979166+0000","last_fullsized":"2023-12-19T19:01:34.979166+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.992632+0000","last_change":"2023-12-19T19:01:34.992632+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.992632+0000","last_undegraded":"2023-12-19T19:01:34.992632+0000","last_fullsized":"2023-12-19T19:01:34.992632+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.981312+0000","last_change":"2023-12-19T19:01:34.981312+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.981312+0000","last_undegraded":"2023-12-19T19:01:34.981312+0000","last_fullsized":"2023-12-19T19:01:34.981312+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.983073+0000","last_change":"2023-12-19T19:01:34.983073+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.983073+0000","last_undegraded":"2023-12-19T19:01:34.983073+0000","last_fullsized":"2023-12-19T19:01:34.983073+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979150+0000","last_change":"2023-12-19T19:01:34.979150+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979150+0000","last_undegraded":"2023-12-19T19:01:34.979150+0000","last_fullsized":"2023-12-19T19:01:34.979150+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.983703+0000","last_change":"2023-12-19T19:01:34.983703+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.983703+0000","last_undegraded":"2023-12-19T19:01:34.983703+0000","last_fullsized":"2023-12-19T19:01:34.983703+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.987894+0000","last_change":"2023-12-19T19:01:34.987894+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.987894+0000","last_undegraded":"2023-12-19T19:01:34.987894+0000","last_fullsized":"2023-12-19T19:01:34.987894+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.982203+0000","last_change":"2023-12-19T19:01:34.982203+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.982203+0000","last_undegraded":"2023-12-19T19:01:34.982203+0000","last_fullsized":"2023-12-19T19:01:34.982203+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.981398+0000","last_change":"2023-12-19T19:01:34.981398+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.981398+0000","last_undegraded":"2023-12-19T19:01:34.981398+0000","last_fullsized":"2023-12-19T19:01:34.981398+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979743+0000","last_change":"2023-12-19T19:01:34.979743+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979743+0000","last_undegraded":"2023-12-19T19:01:34.979743+0000","last_fullsized":"2023-12-19T19:01:34.979743+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.982223+0000","last_change":"2023-12-19T19:01:34.982223+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.982223+0000","last_undegraded":"2023-12-19T19:01:34.982223+0000","last_fullsized":"2023-12-19T19:01:34.982223+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980145+0000","last_change":"2023-12-19T19:01:34.980145+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980145+0000","last_undegraded":"2023-12-19T19:01:34.980145+0000","last_fullsized":"2023-12-19T19:01:34.980145+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.992668+0000","last_change":"2023-12-19T19:01:34.992668+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.992668+0000","last_undegraded":"2023-12-19T19:01:34.992668+0000","last_fullsized":"2023-12-19T19:01:34.992668+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979812+0000","last_change":"2023-12-19T19:01:34.979812+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979812+0000","last_undegraded":"2023-12-19T19:01:34.979812+0000","last_fullsized":"2023-12-19T19:01:34.979812+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.978398+0000","last_change":"2023-12-19T19:01:34.978398+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.978398+0000","last_undegraded":"2023-12-19T19:01:34.978398+0000","last_fullsized":"2023-12-19T19:01:34.978398+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980818+0000","last_change":"2023-12-19T19:01:34.980818+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980818+0000","last_undegraded":"2023-12-19T19:01:34.980818+0000","last_fullsized":"2023-12-19T19:01:34.980818+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984987+0000","last_change":"2023-12-19T19:01:34.984987+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984987+0000","last_undegraded":"2023-12-19T19:01:34.984987+0000","last_fullsized":"2023-12-19T19:01:34.984987+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.990456+0000","last_change":"2023-12-19T19:01:34.990456+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.990456+0000","last_undegraded":"2023-12-19T19:01:34.990456+0000","last_fullsized":"2023-12-19T19:01:34.990456+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979065+0000","last_change":"2023-12-19T19:01:34.979065+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979065+0000","last_undegraded":"2023-12-19T19:01:34.979065+0000","last_fullsized":"2023-12-19T19:01:34.979065+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979702+0000","last_change":"2023-12-19T19:01:34.979702+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979702+0000","last_undegraded":"2023-12-19T19:01:34.979702+0000","last_fullsized":"2023-12-19T19:01:34.979702+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.985374+0000","last_change":"2023-12-19T19:01:34.985374+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.985374+0000","last_undegraded":"2023-12-19T19:01:34.985374+0000","last_fullsized":"2023-12-19T19:01:34.985374+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.989863+0000","last_change":"2023-12-19T19:01:34.989863+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.989863+0000","last_undegraded":"2023-12-19T19:01:34.989863+0000","last_fullsized":"2023-12-19T19:01:34.989863+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.987197+0000","last_change":"2023-12-19T19:01:34.987197+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.987197+0000","last_undegraded":"2023-12-19T19:01:34.987197+0000","last_fullsized":"2023-12-19T19:01:34.987197+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.008424+0000","last_change":"2023-12-19T19:01:35.005860+0000","last_active":"2023-12-19T19:01:35.008424+0000","last_peered":"2023-12-19T19:01:35.008424+0000","last_clean":"2023-12-19T19:01:35.008424+0000","last_became_active":"2023-12-19T19:01:35.005458+0000","last_became_peered":"2023-12-19T19:01:35.005458+0000","last_unstale":"2023-12-19T19:01:35.008424+0000","last_undegraded":"2023-12-19T19:01:35.008424+0000","last_fullsized":"2023-12-19T19:01:35.008424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:04:11.121880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.993263+0000","last_change":"2023-12-19T19:01:34.993263+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.993263+0000","last_undegraded":"2023-12-19T19:01:34.993263+0000","last_fullsized":"2023-12-19T19:01:34.993263+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.005337+0000","last_change":"2023-12-19T19:01:35.000000+0000","last_active":"2023-12-19T19:01:35.005337+0000","last_peered":"2023-12-19T19:01:35.005337+0000","last_clean":"2023-12-19T19:01:35.005337+0000","last_became_active":"2023-12-19T19:01:34.999684+0000","last_became_peered":"2023-12-19T19:01:34.999684+0000","last_unstale":"2023-12-19T19:01:35.005337+0000","last_undegraded":"2023-12-19T19:01:35.005337+0000","last_fullsized":"2023-12-19T19:01:35.005337+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:04:11.121880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.989972+0000","last_change":"2023-12-19T19:01:34.989972+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.989972+0000","last_undegraded":"2023-12-19T19:01:34.989972+0000","last_fullsized":"2023-12-19T19:01:34.989972+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.003622+0000","last_change":"2023-12-19T19:01:34.996946+0000","last_active":"2023-12-19T19:01:35.003622+0000","last_peered":"2023-12-19T19:01:35.003622+0000","last_clean":"2023-12-19T19:01:35.003622+0000","last_became_active":"2023-12-19T19:01:34.995689+0000","last_became_peered":"2023-12-19T19:01:34.995689+0000","last_unstale":"2023-12-19T19:01:35.003622+0000","last_undegraded":"2023-12-19T19:01:35.003622+0000","last_fullsized":"2023-12-19T19:01:35.003622+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:32:15.466391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980070+0000","last_change":"2023-12-19T19:01:34.980070+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980070+0000","last_undegraded":"2023-12-19T19:01:34.980070+0000","last_fullsized":"2023-12-19T19:01:34.980070+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.003742+0000","last_change":"2023-12-19T19:01:34.997757+0000","last_active":"2023-12-19T19:01:35.003742+0000","last_peered":"2023-12-19T19:01:35.003742+0000","last_clean":"2023-12-19T19:01:35.003742+0000","last_became_active":"2023-12-19T19:01:34.997458+0000","last_became_peered":"2023-12-19T19:01:34.997458+0000","last_unstale":"2023-12-19T19:01:35.003742+0000","last_undegraded":"2023-12-19T19:01:35.003742+0000","last_fullsized":"2023-12-19T19:01:35.003742+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:48:51.739304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.977533+0000","last_change":"2023-12-19T19:01:34.977533+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.977533+0000","last_undegraded":"2023-12-19T19:01:34.977533+0000","last_fullsized":"2023-12-19T19:01:34.977533+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.001967+0000","last_change":"2023-12-19T19:01:34.994677+0000","last_active":"2023-12-19T19:01:35.001967+0000","last_peered":"2023-12-19T19:01:35.001967+0000","last_clean":"2023-12-19T19:01:35.001967+0000","last_became_active":"2023-12-19T19:01:34.994343+0000","last_became_peered":"2023-12-19T19:01:34.994343+0000","last_unstale":"2023-12-19T19:01:35.001967+0000","last_undegraded":"2023-12-19T19:01:35.001967+0000","last_fullsized":"2023-12-19T19:01:35.001967+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:29.601572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.982664+0000","last_change":"2023-12-19T19:01:34.982664+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.982664+0000","last_undegraded":"2023-12-19T19:01:34.982664+0000","last_fullsized":"2023-12-19T19:01:34.982664+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.005135+0000","last_change":"2023-12-19T19:01:34.998256+0000","last_active":"2023-12-19T19:01:35.005135+0000","last_peered":"2023-12-19T19:01:35.005135+0000","last_clean":"2023-12-19T19:01:35.005135+0000","last_became_active":"2023-12-19T19:01:34.997890+0000","last_became_peered":"2023-12-19T19:01:34.997890+0000","last_unstale":"2023-12-19T19:01:35.005135+0000","last_undegraded":"2023-12-19T19:01:35.005135+0000","last_fullsized":"2023-12-19T19:01:35.005135+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:36.683195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980845+0000","last_change":"2023-12-19T19:01:34.980845+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980845+0000","last_undegraded":"2023-12-19T19:01:34.980845+0000","last_fullsized":"2023-12-19T19:01:34.980845+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.001098+0000","last_change":"2023-12-19T19:01:34.995656+0000","last_active":"2023-12-19T19:01:35.001098+0000","last_peered":"2023-12-19T19:01:35.001098+0000","last_clean":"2023-12-19T19:01:35.001098+0000","last_became_active":"2023-12-19T19:01:34.995357+0000","last_became_peered":"2023-12-19T19:01:34.995357+0000","last_unstale":"2023-12-19T19:01:35.001098+0000","last_undegraded":"2023-12-19T19:01:35.001098+0000","last_fullsized":"2023-12-19T19:01:35.001098+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:06:40.560279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.978636+0000","last_change":"2023-12-19T19:01:34.978636+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.978636+0000","last_undegraded":"2023-12-19T19:01:34.978636+0000","last_fullsized":"2023-12-19T19:01:34.978636+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.006440+0000","last_change":"2023-12-19T19:01:35.000403+0000","last_active":"2023-12-19T19:01:35.006440+0000","last_peered":"2023-12-19T19:01:35.006440+0000","last_clean":"2023-12-19T19:01:35.006440+0000","last_became_active":"2023-12-19T19:01:34.998866+0000","last_became_peered":"2023-12-19T19:01:34.998866+0000","last_unstale":"2023-12-19T19:01:35.006440+0000","last_undegraded":"2023-12-19T19:01:35.006440+0000","last_fullsized":"2023-12-19T19:01:35.006440+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:41:08.421145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979573+0000","last_change":"2023-12-19T19:01:34.979573+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979573+0000","last_undegraded":"2023-12-19T19:01:34.979573+0000","last_fullsized":"2023-12-19T19:01:34.979573+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007157+0000","last_change":"2023-12-19T19:01:35.002076+0000","last_active":"2023-12-19T19:01:35.007157+0000","last_peered":"2023-12-19T19:01:35.007157+0000","last_clean":"2023-12-19T19:01:35.007157+0000","last_became_active":"2023-12-19T19:01:35.001645+0000","last_became_peered":"2023-12-19T19:01:35.001645+0000","last_unstale":"2023-12-19T19:01:35.007157+0000","last_undegraded":"2023-12-19T19:01:35.007157+0000","last_fullsized":"2023-12-19T19:01:35.007157+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:36.683195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984951+0000","last_change":"2023-12-19T19:01:34.984951+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984951+0000","last_undegraded":"2023-12-19T19:01:34.984951+0000","last_fullsized":"2023-12-19T19:01:34.984951+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007231+0000","last_change":"2023-12-19T19:01:35.003678+0000","last_active":"2023-12-19T19:01:35.007231+0000","last_peered":"2023-12-19T19:01:35.007231+0000","last_clean":"2023-12-19T19:01:35.007231+0000","last_became_active":"2023-12-19T19:01:35.003361+0000","last_became_peered":"2023-12-19T19:01:35.003361+0000","last_unstale":"2023-12-19T19:01:35.007231+0000","last_undegraded":"2023-12-19T19:01:35.007231+0000","last_fullsized":"2023-12-19T19:01:35.007231+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:33:31.174586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.982176+0000","last_change":"2023-12-19T19:01:34.982176+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.982176+0000","last_undegraded":"2023-12-19T19:01:34.982176+0000","last_fullsized":"2023-12-19T19:01:34.982176+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007180+0000","last_change":"2023-12-19T19:01:35.002668+0000","last_active":"2023-12-19T19:01:35.007180+0000","last_peered":"2023-12-19T19:01:35.007180+0000","last_clean":"2023-12-19T19:01:35.007180+0000","last_became_active":"2023-12-19T19:01:35.002367+0000","last_became_peered":"2023-12-19T19:01:35.002367+0000","last_unstale":"2023-12-19T19:01:35.007180+0000","last_undegraded":"2023-12-19T19:01:35.007180+0000","last_fullsized":"2023-12-19T19:01:35.007180+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:29.601572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984524+0000","last_change":"2023-12-19T19:01:34.984524+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984524+0000","last_undegraded":"2023-12-19T19:01:34.984524+0000","last_fullsized":"2023-12-19T19:01:34.984524+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.005100+0000","last_change":"2023-12-19T19:01:34.997430+0000","last_active":"2023-12-19T19:01:35.005100+0000","last_peered":"2023-12-19T19:01:35.005100+0000","last_clean":"2023-12-19T19:01:35.005100+0000","last_became_active":"2023-12-19T19:01:34.997110+0000","last_became_peered":"2023-12-19T19:01:34.997110+0000","last_unstale":"2023-12-19T19:01:35.005100+0000","last_undegraded":"2023-12-19T19:01:35.005100+0000","last_fullsized":"2023-12-19T19:01:35.005100+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:23:24.843750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.981922+0000","last_change":"2023-12-19T19:01:34.981922+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.981922+0000","last_undegraded":"2023-12-19T19:01:34.981922+0000","last_fullsized":"2023-12-19T19:01:34.981922+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:34.992237+0000","last_change":"2023-12-19T19:01:34.987868+0000","last_active":"2023-12-19T19:01:34.992237+0000","last_peered":"2023-12-19T19:01:34.992237+0000","last_clean":"2023-12-19T19:01:34.992237+0000","last_became_active":"2023-12-19T19:01:34.987545+0000","last_became_peered":"2023-12-19T19:01:34.987545+0000","last_unstale":"2023-12-19T19:01:34.992237+0000","last_undegraded":"2023-12-19T19:01:34.992237+0000","last_fullsized":"2023-12-19T19:01:34.992237+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:37:03.677408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980097+0000","last_change":"2023-12-19T19:01:34.980097+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980097+0000","last_undegraded":"2023-12-19T19:01:34.980097+0000","last_fullsized":"2023-12-19T19:01:34.980097+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.001401+0000","last_change":"2023-12-19T19:01:34.994756+0000","last_active":"2023-12-19T19:01:35.001401+0000","last_peered":"2023-12-19T19:01:35.001401+0000","last_clean":"2023-12-19T19:01:35.001401+0000","last_became_active":"2023-12-19T19:01:34.994476+0000","last_became_peered":"2023-12-19T19:01:34.994476+0000","last_unstale":"2023-12-19T19:01:35.001401+0000","last_undegraded":"2023-12-19T19:01:35.001401+0000","last_fullsized":"2023-12-19T19:01:35.001401+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:36.470347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.977480+0000","last_change":"2023-12-19T19:01:34.977480+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.977480+0000","last_undegraded":"2023-12-19T19:01:34.977480+0000","last_fullsized":"2023-12-19T19:01:34.977480+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.006124+0000","last_change":"2023-12-19T19:01:35.002999+0000","last_active":"2023-12-19T19:01:35.006124+0000","last_peered":"2023-12-19T19:01:35.006124+0000","last_clean":"2023-12-19T19:01:35.006124+0000","last_became_active":"2023-12-19T19:01:35.002667+0000","last_became_peered":"2023-12-19T19:01:35.002667+0000","last_unstale":"2023-12-19T19:01:35.006124+0000","last_undegraded":"2023-12-19T19:01:35.006124+0000","last_fullsized":"2023-12-19T19:01:35.006124+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:31.382424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.977484+0000","last_change":"2023-12-19T19:01:34.977484+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.977484+0000","last_undegraded":"2023-12-19T19:01:34.977484+0000","last_fullsized":"2023-12-19T19:01:34.977484+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:34.997990+0000","last_change":"2023-12-19T19:01:34.993756+0000","last_active":"2023-12-19T19:01:34.997990+0000","last_peered":"2023-12-19T19:01:34.997990+0000","last_clean":"2023-12-19T19:01:34.997990+0000","last_became_active":"2023-12-19T19:01:34.993466+0000","last_became_peered":"2023-12-19T19:01:34.993466+0000","last_unstale":"2023-12-19T19:01:34.997990+0000","last_undegraded":"2023-12-19T19:01:34.997990+0000","last_fullsized":"2023-12-19T19:01:34.997990+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:46:31.394472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980284+0000","last_change":"2023-12-19T19:01:34.980284+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980284+0000","last_undegraded":"2023-12-19T19:01:34.980284+0000","last_fullsized":"2023-12-19T19:01:34.980284+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007112+0000","last_change":"2023-12-19T19:01:35.001602+0000","last_active":"2023-12-19T19:01:35.007112+0000","last_peered":"2023-12-19T19:01:35.007112+0000","last_clean":"2023-12-19T19:01:35.007112+0000","last_became_active":"2023-12-19T19:01:35.000999+0000","last_became_peered":"2023-12-19T19:01:35.000999+0000","last_unstale":"2023-12-19T19:01:35.007112+0000","last_undegraded":"2023-12-19T19:01:35.007112+0000","last_fullsized":"2023-12-19T19:01:35.007112+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:32.294680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.992557+0000","last_change":"2023-12-19T19:01:34.992557+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.992557+0000","last_undegraded":"2023-12-19T19:01:34.992557+0000","last_fullsized":"2023-12-19T19:01:34.992557+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.003716+0000","last_change":"2023-12-19T19:01:34.999856+0000","last_active":"2023-12-19T19:01:35.003716+0000","last_peered":"2023-12-19T19:01:35.003716+0000","last_clean":"2023-12-19T19:01:35.003716+0000","last_became_active":"2023-12-19T19:01:34.999581+0000","last_became_peered":"2023-12-19T19:01:34.999581+0000","last_unstale":"2023-12-19T19:01:35.003716+0000","last_undegraded":"2023-12-19T19:01:35.003716+0000","last_fullsized":"2023-12-19T19:01:35.003716+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:13:22.016658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984072+0000","last_change":"2023-12-19T19:01:34.984072+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984072+0000","last_undegraded":"2023-12-19T19:01:34.984072+0000","last_fullsized":"2023-12-19T19:01:34.984072+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.000194+0000","last_change":"2023-12-19T19:01:34.992936+0000","last_active":"2023-12-19T19:01:35.000194+0000","last_peered":"2023-12-19T19:01:35.000194+0000","last_clean":"2023-12-19T19:01:35.000194+0000","last_became_active":"2023-12-19T19:01:34.992664+0000","last_became_peered":"2023-12-19T19:01:34.992664+0000","last_unstale":"2023-12-19T19:01:35.000194+0000","last_undegraded":"2023-12-19T19:01:35.000194+0000","last_fullsized":"2023-12-19T19:01:35.000194+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:06:56.928069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.982629+0000","last_change":"2023-12-19T19:01:34.982629+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.982629+0000","last_undegraded":"2023-12-19T19:01:34.982629+0000","last_fullsized":"2023-12-19T19:01:34.982629+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.003526+0000","last_change":"2023-12-19T19:01:35.000039+0000","last_active":"2023-12-19T19:01:35.003526+0000","last_peered":"2023-12-19T19:01:35.003526+0000","last_clean":"2023-12-19T19:01:35.003526+0000","last_became_active":"2023-12-19T19:01:34.999745+0000","last_became_peered":"2023-12-19T19:01:34.999745+0000","last_unstale":"2023-12-19T19:01:35.003526+0000","last_undegraded":"2023-12-19T19:01:35.003526+0000","last_fullsized":"2023-12-19T19:01:35.003526+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:53:02.681430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.985896+0000","last_change":"2023-12-19T19:01:34.985896+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.985896+0000","last_undegraded":"2023-12-19T19:01:34.985896+0000","last_fullsized":"2023-12-19T19:01:34.985896+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.000765+0000","last_change":"2023-12-19T19:01:34.996284+0000","last_active":"2023-12-19T19:01:35.000765+0000","last_peered":"2023-12-19T19:01:35.000765+0000","last_clean":"2023-12-19T19:01:35.000765+0000","last_became_active":"2023-12-19T19:01:34.996012+0000","last_became_peered":"2023-12-19T19:01:34.996012+0000","last_unstale":"2023-12-19T19:01:35.000765+0000","last_undegraded":"2023-12-19T19:01:35.000765+0000","last_fullsized":"2023-12-19T19:01:35.000765+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:33:03.964283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979228+0000","last_change":"2023-12-19T19:01:34.979228+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979228+0000","last_undegraded":"2023-12-19T19:01:34.979228+0000","last_fullsized":"2023-12-19T19:01:34.979228+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.006709+0000","last_change":"2023-12-19T19:01:35.002482+0000","last_active":"2023-12-19T19:01:35.006709+0000","last_peered":"2023-12-19T19:01:35.006709+0000","last_clean":"2023-12-19T19:01:35.006709+0000","last_became_active":"2023-12-19T19:01:35.002110+0000","last_became_peered":"2023-12-19T19:01:35.002110+0000","last_unstale":"2023-12-19T19:01:35.006709+0000","last_undegraded":"2023-12-19T19:01:35.006709+0000","last_fullsized":"2023-12-19T19:01:35.006709+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:40:40.108793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.987437+0000","last_change":"2023-12-19T19:01:34.987437+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.987437+0000","last_undegraded":"2023-12-19T19:01:34.987437+0000","last_fullsized":"2023-12-19T19:01:34.987437+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.001612+0000","last_change":"2023-12-19T19:01:34.997069+0000","last_active":"2023-12-19T19:01:35.001612+0000","last_peered":"2023-12-19T19:01:35.001612+0000","last_clean":"2023-12-19T19:01:35.001612+0000","last_became_active":"2023-12-19T19:01:34.996756+0000","last_became_peered":"2023-12-19T19:01:34.996756+0000","last_unstale":"2023-12-19T19:01:35.001612+0000","last_undegraded":"2023-12-19T19:01:35.001612+0000","last_fullsized":"2023-12-19T19:01:35.001612+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:35.546701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.986763+0000","last_change":"2023-12-19T19:01:34.986763+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.986763+0000","last_undegraded":"2023-12-19T19:01:34.986763+0000","last_fullsized":"2023-12-19T19:01:34.986763+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:34.997281+0000","last_change":"2023-12-19T19:01:34.989700+0000","last_active":"2023-12-19T19:01:34.997281+0000","last_peered":"2023-12-19T19:01:34.997281+0000","last_clean":"2023-12-19T19:01:34.997281+0000","last_became_active":"2023-12-19T19:01:34.989417+0000","last_became_peered":"2023-12-19T19:01:34.989417+0000","last_unstale":"2023-12-19T19:01:34.997281+0000","last_undegraded":"2023-12-19T19:01:34.997281+0000","last_fullsized":"2023-12-19T19:01:34.997281+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:06:45.607378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980782+0000","last_change":"2023-12-19T19:01:34.980782+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980782+0000","last_undegraded":"2023-12-19T19:01:34.980782+0000","last_fullsized":"2023-12-19T19:01:34.980782+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:34.992101+0000","last_change":"2023-12-19T19:01:34.986750+0000","last_active":"2023-12-19T19:01:34.992101+0000","last_peered":"2023-12-19T19:01:34.992101+0000","last_clean":"2023-12-19T19:01:34.992101+0000","last_became_active":"2023-12-19T19:01:34.986455+0000","last_became_peered":"2023-12-19T19:01:34.986455+0000","last_unstale":"2023-12-19T19:01:34.992101+0000","last_undegraded":"2023-12-19T19:01:34.992101+0000","last_fullsized":"2023-12-19T19:01:34.992101+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:01:50.322532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.989455+0000","last_change":"2023-12-19T19:01:34.989455+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.989455+0000","last_undegraded":"2023-12-19T19:01:34.989455+0000","last_fullsized":"2023-12-19T19:01:34.989455+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007075+0000","last_change":"2023-12-19T19:01:35.001204+0000","last_active":"2023-12-19T19:01:35.007075+0000","last_peered":"2023-12-19T19:01:35.007075+0000","last_clean":"2023-12-19T19:01:35.007075+0000","last_became_active":"2023-12-19T19:01:35.000589+0000","last_became_peered":"2023-12-19T19:01:35.000589+0000","last_unstale":"2023-12-19T19:01:35.007075+0000","last_undegraded":"2023-12-19T19:01:35.007075+0000","last_fullsized":"2023-12-19T19:01:35.007075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:48:27.490312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.983538+0000","last_change":"2023-12-19T19:01:34.983538+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.983538+0000","last_undegraded":"2023-12-19T19:01:34.983538+0000","last_fullsized":"2023-12-19T19:01:34.983538+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.005497+0000","last_change":"2023-12-19T19:01:34.999664+0000","last_active":"2023-12-19T19:01:35.005497+0000","last_peered":"2023-12-19T19:01:35.005497+0000","last_clean":"2023-12-19T19:01:35.005497+0000","last_became_active":"2023-12-19T19:01:34.998997+0000","last_became_peered":"2023-12-19T19:01:34.998997+0000","last_unstale":"2023-12-19T19:01:35.005497+0000","last_undegraded":"2023-12-19T19:01:35.005497+0000","last_fullsized":"2023-12-19T19:01:35.005497+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:38:15.768063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.985453+0000","last_change":"2023-12-19T19:01:34.985453+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.985453+0000","last_undegraded":"2023-12-19T19:01:34.985453+0000","last_fullsized":"2023-12-19T19:01:34.985453+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:34.994967+0000","last_change":"2023-12-19T19:01:34.990870+0000","last_active":"2023-12-19T19:01:34.994967+0000","last_peered":"2023-12-19T19:01:34.994967+0000","last_clean":"2023-12-19T19:01:34.994967+0000","last_became_active":"2023-12-19T19:01:34.990513+0000","last_became_peered":"2023-12-19T19:01:34.990513+0000","last_unstale":"2023-12-19T19:01:34.994967+0000","last_undegraded":"2023-12-19T19:01:34.994967+0000","last_fullsized":"2023-12-19T19:01:34.994967+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:27:03.813755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984415+0000","last_change":"2023-12-19T19:01:34.984415+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984415+0000","last_undegraded":"2023-12-19T19:01:34.984415+0000","last_fullsized":"2023-12-19T19:01:34.984415+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.001199+0000","last_change":"2023-12-19T19:01:34.994259+0000","last_active":"2023-12-19T19:01:35.001199+0000","last_peered":"2023-12-19T19:01:35.001199+0000","last_clean":"2023-12-19T19:01:35.001199+0000","last_became_active":"2023-12-19T19:01:34.992784+0000","last_became_peered":"2023-12-19T19:01:34.992784+0000","last_unstale":"2023-12-19T19:01:35.001199+0000","last_undegraded":"2023-12-19T19:01:35.001199+0000","last_fullsized":"2023-12-19T19:01:35.001199+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:32.294680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980169+0000","last_change":"2023-12-19T19:01:34.980169+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980169+0000","last_undegraded":"2023-12-19T19:01:34.980169+0000","last_fullsized":"2023-12-19T19:01:34.980169+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007161+0000","last_change":"2023-12-19T19:01:35.001846+0000","last_active":"2023-12-19T19:01:35.007161+0000","last_peered":"2023-12-19T19:01:35.007161+0000","last_clean":"2023-12-19T19:01:35.007161+0000","last_became_active":"2023-12-19T19:01:35.000362+0000","last_became_peered":"2023-12-19T19:01:35.000362+0000","last_unstale":"2023-12-19T19:01:35.007161+0000","last_undegraded":"2023-12-19T19:01:35.007161+0000","last_fullsized":"2023-12-19T19:01:35.007161+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:11.163857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.991560+0000","last_change":"2023-12-19T19:01:34.991560+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.991560+0000","last_undegraded":"2023-12-19T19:01:34.991560+0000","last_fullsized":"2023-12-19T19:01:34.991560+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.005088+0000","last_change":"2023-12-19T19:01:34.998108+0000","last_active":"2023-12-19T19:01:35.005088+0000","last_peered":"2023-12-19T19:01:35.005088+0000","last_clean":"2023-12-19T19:01:35.005088+0000","last_became_active":"2023-12-19T19:01:34.997738+0000","last_became_peered":"2023-12-19T19:01:34.997738+0000","last_unstale":"2023-12-19T19:01:35.005088+0000","last_undegraded":"2023-12-19T19:01:35.005088+0000","last_fullsized":"2023-12-19T19:01:35.005088+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:48:27.490312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.977470+0000","last_change":"2023-12-19T19:01:34.977470+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.977470+0000","last_undegraded":"2023-12-19T19:01:34.977470+0000","last_fullsized":"2023-12-19T19:01:34.977470+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.002980+0000","last_change":"2023-12-19T19:01:34.999764+0000","last_active":"2023-12-19T19:01:35.002980+0000","last_peered":"2023-12-19T19:01:35.002980+0000","last_clean":"2023-12-19T19:01:35.002980+0000","last_became_active":"2023-12-19T19:01:34.998931+0000","last_became_peered":"2023-12-19T19:01:34.998931+0000","last_unstale":"2023-12-19T19:01:35.002980+0000","last_undegraded":"2023-12-19T19:01:35.002980+0000","last_fullsized":"2023-12-19T19:01:35.002980+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:46:31.394472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":213,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-19T19:01:33.964823+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T19:01:33.964823+0000","last_peered":"2023-12-19T19:01:33.964823+0000","last_clean":"2023-12-19T19:01:33.964823+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T19:01:33.964823+0000","last_undegraded":"2023-12-19T19:01:33.964823+0000","last_fullsized":"2023-12-19T19:01:33.964823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1417216,"data_stored":947389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.68899999999999995},"min":{"1min":0.44,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92500000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.72399999999999998},"min":{"1min":0.50700000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89300000000000002,"5min":1.117,"15min":1.117},"last":0.89300000000000002}]},{"osd":1,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.46700000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83899999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.751},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83399999999999996,"5min":1.01,"15min":1.01},"last":0.82099999999999995}]},{"osd":2,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85499999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.58299999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89500000000000002,"5min":1.089,"15min":1.089},"last":0.80300000000000005}]},{"osd":3,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71299999999999997,"15min":0.72699999999999998},"min":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90900000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73299999999999998,"15min":0.73499999999999999},"min":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91600000000000004,"5min":1.026,"15min":1.026},"last":0.86899999999999999}]},{"osd":4,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64400000000000002,"15min":0.65600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88500000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66700000000000004,"15min":0.67400000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93799999999999994,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.66500000000000004}]},{"osd":5,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93200000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.623},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.70599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91500000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.60799999999999998}]},{"osd":6,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.96799999999999997,"5min":1.069,"15min":1.069},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78000000000000003,"15min":0.79600000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.77800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":357021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.98899999999999999,"5min":1.022,"15min":1.022},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.89800000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.89800000000000002}]},{"osd":1,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67100000000000004,"15min":0.65700000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.871,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.871},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.52300000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91500000000000004,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.81899999999999995}]},{"osd":2,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.443,"5min":0.437,"15min":0.437},"max":{"1min":0.96299999999999997,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.71999999999999997,"15min":0.71699999999999997},"min":{"1min":0.58099999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94899999999999995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.94899999999999995}]},{"osd":3,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83499999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72199999999999998,"15min":0.72699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91900000000000004,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.91900000000000004}]},{"osd":4,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.48599999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.74099999999999999,"15min":0.755},"min":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95999999999999996,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.60999999999999999}]},{"osd":5,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.93700000000000006,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73199999999999998,"15min":0.73599999999999999},"min":{"1min":0.54600000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.65800000000000003}]},{"osd":7,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.52800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.63600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":350746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.90500000000000003,"15min":0.94899999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0880000000000001,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":1.3420000000000001,"15min":1.452},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1180000000000001,"5min":16.951000000000001,"15min":16.951000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":1.411,"15min":1.5429999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0700000000000001,"5min":19.823,"15min":19.823},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.44500000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.216,"5min":1.657,"15min":1.657},"last":0.77300000000000002}]},{"osd":2,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.74199999999999999,"15min":0.755},"min":{"1min":0.48799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.163,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1020000000000001,"5min":1.585,"15min":1.585},"last":0.66600000000000004}]},{"osd":3,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.78000000000000003,"15min":0.79100000000000004},"min":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0589999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.97299999999999998,"15min":1.0149999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0740000000000001,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":0.79000000000000004}]},{"osd":4,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.45200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0049999999999999,"5min":1.716,"15min":1.716},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.504,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97899999999999998,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":0.59499999999999997}]},{"osd":6,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.82799999999999996,"15min":0.85099999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.86599999999999999,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.82999999999999996,"15min":0.84599999999999997},"min":{"1min":0.51100000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90600000000000003,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.83099999999999996}]},{"osd":7,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82899999999999996,"15min":0.83899999999999997},"min":{"1min":0.60599999999999998,"5min":0.498,"15min":0.498},"max":{"1min":1.0900000000000001,"5min":2.371,"15min":2.371},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0369999999999999,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.84999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":357021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.84299999999999997,"15min":0.875},"min":{"1min":0.46800000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86899999999999999,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78500000000000003,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.66900000000000004}]},{"osd":1,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.51800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88200000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.79200000000000004,"15min":0.80700000000000005},"min":{"1min":0.56699999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94599999999999995,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":0.86399999999999999}]},{"osd":2,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69199999999999995,"15min":0.69299999999999995},"min":{"1min":0.53800000000000003,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.80300000000000005,"15min":0.81999999999999995},"min":{"1min":0.56000000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.88,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.751}]},{"osd":3,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.84999999999999998,"5min":3.641,"15min":3.641},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.872,"15min":0.89800000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.85399999999999998,"5min":3.194,"15min":3.194},"last":0.73899999999999999}]},{"osd":5,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":1.0269999999999999,"15min":1.089},"min":{"1min":0.42699999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0449999999999999,"5min":9.3040000000000003,"15min":9.3040000000000003},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.71999999999999997,"15min":0.73999999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94099999999999995,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.84499999999999997}]},{"osd":6,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.81799999999999995,"15min":0.84199999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97699999999999998,"5min":3.097,"15min":3.097},"last":0.88},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.86599999999999999,"15min":0.89100000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97899999999999998,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.89700000000000002}]},{"osd":7,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.94199999999999995,"15min":0.97999999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0409999999999999,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":1.0289999999999999,"15min":1.077},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98699999999999999,"5min":6.3449999999999998,"15min":6.3449999999999998},"last":0.79800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":357021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72699999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.36099999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.41299999999999998}]},{"osd":1,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46700000000000003,"15min":0.48499999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60699999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.64300000000000002}]},{"osd":2,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.74299999999999999,"5min":0.75,"15min":0.75},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.54700000000000004},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77600000000000002,"5min":0.875,"15min":0.875},"last":0.432}]},{"osd":4,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88400000000000001,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98999999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.61299999999999999}]},{"osd":5,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.50600000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94999999999999996,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.752,"15min":0.77000000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.04,"5min":1.202,"15min":1.202},"last":0.59799999999999998}]},{"osd":6,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96399999999999997,"5min":1.298,"15min":1.298},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.98299999999999998,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.68899999999999995}]},{"osd":7,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94999999999999996,"5min":1.155,"15min":1.155},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93000000000000005,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.66400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":357021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.497,"15min":0.50700000000000001},"min":{"1min":0.313,"5min":0.31,"15min":0.31},"max":{"1min":0.57899999999999996,"5min":1.458,"15min":1.458},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.627,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.373}]},{"osd":1,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.57899999999999996,"15min":0.59899999999999998},"min":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.58499999999999996,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.60399999999999998,"15min":0.624},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.61799999999999999,"5min":2.444,"15min":2.444},"last":0.44600000000000001}]},{"osd":3,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.59599999999999997,"15min":0.62},"min":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65300000000000002,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.625,"15min":0.64300000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.69199999999999995,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.46300000000000002}]},{"osd":4,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.93899999999999995,"15min":0.97499999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.94399999999999995,"5min":1.968,"15min":1.968},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.89500000000000002,"15min":0.92500000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.90700000000000003,"5min":2.835,"15min":2.835},"last":0.72799999999999998}]},{"osd":5,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.91600000000000004,"15min":0.94999999999999996},"min":{"1min":0.56000000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.94599999999999995,"5min":3.5,"15min":3.5},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.91100000000000003,"15min":0.93999999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.99099999999999999,"5min":1.996,"15min":1.996},"last":0.60799999999999998}]},{"osd":6,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.91200000000000003,"15min":0.94699999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.97599999999999998,"5min":2.903,"15min":2.903},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.99199999999999999,"15min":1.034},"min":{"1min":0.53700000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.92800000000000005,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.63700000000000001}]},{"osd":7,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.94999999999999996,"15min":0.98599999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.0049999999999999,"5min":2.875,"15min":2.875},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.94299999999999995,"15min":0.98099999999999998},"min":{"1min":0.59399999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.91900000000000004,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.752}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":357021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.55200000000000005,"15min":0.58099999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.51600000000000001,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.309},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.748,"15min":0.80100000000000005},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.70399999999999996,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.503}]},{"osd":2,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.57199999999999995,"15min":0.59599999999999997},"min":{"1min":0.316,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.63,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.65600000000000003,"15min":0.68899999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65300000000000002,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.46100000000000002}]},{"osd":3,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.79300000000000004,"15min":0.84199999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.629,"5min":7.8399999999999999,"15min":7.8399999999999999},"last":0.436},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.81200000000000006,"15min":0.85999999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72499999999999998,"5min":7.7949999999999999,"15min":7.7949999999999999},"last":0.52700000000000002}]},{"osd":4,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.86799999999999999,"15min":0.89900000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0900000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.89900000000000002,"15min":0.93000000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0289999999999999,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.66700000000000004}]},{"osd":5,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.879,"15min":0.90900000000000003},"min":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92600000000000005,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.627},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.88500000000000001,"15min":0.91800000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98899999999999999,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.71199999999999997}]},{"osd":6,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.88300000000000001,"15min":0.90800000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94699999999999995,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.93100000000000005,"15min":0.96899999999999997},"min":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0469999999999999,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.68600000000000005}]},{"osd":7,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.93600000000000005,"15min":0.96799999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1180000000000001,"5min":4.3310000000000004,"15min":4.3310000000000004},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.89200000000000002,"15min":0.92000000000000004},"min":{"1min":0.55200000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.97599999999999998,"5min":4.226,"15min":4.226},"last":0.83299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1413120,"data_stored":946370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.436,"15min":0.44800000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60299999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48899999999999999,"15min":0.503},"min":{"1min":0.29799999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65700000000000003,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.41599999999999998}]},{"osd":2,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.50600000000000001,"15min":0.51300000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63700000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.5},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.51100000000000001},"min":{"1min":0.40799999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.372}]},{"osd":3,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48199999999999998,"15min":0.48699999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.55900000000000005,"5min":0.747,"15min":0.747},"last":0.441},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.57799999999999996,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69299999999999995,"5min":1.264,"15min":1.264},"last":0.46200000000000002}]},{"osd":4,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.74199999999999999,"15min":0.748},"min":{"1min":0.502,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93999999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89900000000000002,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.77400000000000002}]},{"osd":5,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.749},"min":{"1min":0.57299999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.89300000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79200000000000004,"15min":0.81699999999999995},"min":{"1min":0.57199999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.91000000000000003,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.71799999999999997}]},{"osd":6,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.79600000000000004,"15min":0.82499999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92600000000000005,"5min":1.349,"15min":1.349},"last":0.745},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0189999999999999,"5min":1.115,"15min":1.115},"last":0.69599999999999995}]},{"osd":7,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.57499999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94899999999999995,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.79200000000000004,"15min":0.81200000000000006},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.93200000000000005,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.81000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T19:01:40.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2023-12-19T19:01:40.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.993780+0000', 'last_change': '2023-12-19T19:01:34.993780+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.993780+0000', 'last_undegraded': '2023-12-19T19:01:34.993780+0000', 'last_fullsized': '2023-12-19T19:01:34.993780+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T19:01:40.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3e is not active+clean 2023-12-19T19:01:40.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.983586+0000', 'last_change': '2023-12-19T19:01:34.983586+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.983586+0000', 'last_undegraded': '2023-12-19T19:01:34.983586+0000', 'last_fullsized': '2023-12-19T19:01:34.983586+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T19:01:40.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2023-12-19T19:01:40.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.981798+0000', 'last_change': '2023-12-19T19:01:34.981798+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.981798+0000', 'last_undegraded': '2023-12-19T19:01:34.981798+0000', 'last_fullsized': '2023-12-19T19:01:34.981798+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T19:01:40.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3c is not active+clean 2023-12-19T19:01:40.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.980246+0000', 'last_change': '2023-12-19T19:01:34.980246+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.980246+0000', 'last_undegraded': '2023-12-19T19:01:34.980246+0000', 'last_fullsized': '2023-12-19T19:01:34.980246+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T19:01:40.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2023-12-19T19:01:40.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.983335+0000', 'last_change': '2023-12-19T19:01:34.983335+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.983335+0000', 'last_undegraded': '2023-12-19T19:01:34.983335+0000', 'last_fullsized': '2023-12-19T19:01:34.983335+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T19:01:40.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2023-12-19T19:01:40.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.986592+0000', 'last_change': '2023-12-19T19:01:34.986592+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.986592+0000', 'last_undegraded': '2023-12-19T19:01:34.986592+0000', 'last_fullsized': '2023-12-19T19:01:34.986592+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T19:01:40.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.39 is not active+clean 2023-12-19T19:01:40.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.984685+0000', 'last_change': '2023-12-19T19:01:34.984685+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.984685+0000', 'last_undegraded': '2023-12-19T19:01:34.984685+0000', 'last_fullsized': '2023-12-19T19:01:34.984685+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T19:01:40.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2023-12-19T19:01:40.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.984583+0000', 'last_change': '2023-12-19T19:01:34.984583+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.984583+0000', 'last_undegraded': '2023-12-19T19:01:34.984583+0000', 'last_fullsized': '2023-12-19T19:01:34.984583+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T19:01:40.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2023-12-19T19:01:40.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.987226+0000', 'last_change': '2023-12-19T19:01:34.987226+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.987226+0000', 'last_undegraded': '2023-12-19T19:01:34.987226+0000', 'last_fullsized': '2023-12-19T19:01:34.987226+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T19:01:40.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2023-12-19T19:01:40.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.990652+0000', 'last_change': '2023-12-19T19:01:34.990652+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.990652+0000', 'last_undegraded': '2023-12-19T19:01:34.990652+0000', 'last_fullsized': '2023-12-19T19:01:34.990652+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T19:01:40.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.35 is not active+clean 2023-12-19T19:01:40.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.979166+0000', 'last_change': '2023-12-19T19:01:34.979166+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.979166+0000', 'last_undegraded': '2023-12-19T19:01:34.979166+0000', 'last_fullsized': '2023-12-19T19:01:34.979166+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T19:01:40.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2023-12-19T19:01:40.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.992632+0000', 'last_change': '2023-12-19T19:01:34.992632+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.992632+0000', 'last_undegraded': '2023-12-19T19:01:34.992632+0000', 'last_fullsized': '2023-12-19T19:01:34.992632+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T19:01:40.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2023-12-19T19:01:40.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.981312+0000', 'last_change': '2023-12-19T19:01:34.981312+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.981312+0000', 'last_undegraded': '2023-12-19T19:01:34.981312+0000', 'last_fullsized': '2023-12-19T19:01:34.981312+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T19:01:40.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.32 is not active+clean 2023-12-19T19:01:40.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.983073+0000', 'last_change': '2023-12-19T19:01:34.983073+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.983073+0000', 'last_undegraded': '2023-12-19T19:01:34.983073+0000', 'last_fullsized': '2023-12-19T19:01:34.983073+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T19:01:40.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.31 is not active+clean 2023-12-19T19:01:40.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.979150+0000', 'last_change': '2023-12-19T19:01:34.979150+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.979150+0000', 'last_undegraded': '2023-12-19T19:01:34.979150+0000', 'last_fullsized': '2023-12-19T19:01:34.979150+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T19:01:40.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2023-12-19T19:01:40.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.983703+0000', 'last_change': '2023-12-19T19:01:34.983703+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.983703+0000', 'last_undegraded': '2023-12-19T19:01:34.983703+0000', 'last_fullsized': '2023-12-19T19:01:34.983703+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T19:01:40.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2023-12-19T19:01:40.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.987894+0000', 'last_change': '2023-12-19T19:01:34.987894+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.987894+0000', 'last_undegraded': '2023-12-19T19:01:34.987894+0000', 'last_fullsized': '2023-12-19T19:01:34.987894+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T19:01:40.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2e is not active+clean 2023-12-19T19:01:40.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.982203+0000', 'last_change': '2023-12-19T19:01:34.982203+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.982203+0000', 'last_undegraded': '2023-12-19T19:01:34.982203+0000', 'last_fullsized': '2023-12-19T19:01:34.982203+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T19:01:40.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2d is not active+clean 2023-12-19T19:01:40.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.981398+0000', 'last_change': '2023-12-19T19:01:34.981398+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.981398+0000', 'last_undegraded': '2023-12-19T19:01:34.981398+0000', 'last_fullsized': '2023-12-19T19:01:34.981398+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T19:01:40.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2c is not active+clean 2023-12-19T19:01:40.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.979743+0000', 'last_change': '2023-12-19T19:01:34.979743+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.979743+0000', 'last_undegraded': '2023-12-19T19:01:34.979743+0000', 'last_fullsized': '2023-12-19T19:01:34.979743+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T19:01:40.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2b is not active+clean 2023-12-19T19:01:40.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.982223+0000', 'last_change': '2023-12-19T19:01:34.982223+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.982223+0000', 'last_undegraded': '2023-12-19T19:01:34.982223+0000', 'last_fullsized': '2023-12-19T19:01:34.982223+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T19:01:40.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2a is not active+clean 2023-12-19T19:01:40.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.980145+0000', 'last_change': '2023-12-19T19:01:34.980145+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.980145+0000', 'last_undegraded': '2023-12-19T19:01:34.980145+0000', 'last_fullsized': '2023-12-19T19:01:34.980145+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T19:01:40.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2023-12-19T19:01:40.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.992668+0000', 'last_change': '2023-12-19T19:01:34.992668+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.992668+0000', 'last_undegraded': '2023-12-19T19:01:34.992668+0000', 'last_fullsized': '2023-12-19T19:01:34.992668+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T19:01:40.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.28 is not active+clean 2023-12-19T19:01:40.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.979812+0000', 'last_change': '2023-12-19T19:01:34.979812+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.979812+0000', 'last_undegraded': '2023-12-19T19:01:34.979812+0000', 'last_fullsized': '2023-12-19T19:01:34.979812+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T19:01:40.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.27 is not active+clean 2023-12-19T19:01:40.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.978398+0000', 'last_change': '2023-12-19T19:01:34.978398+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.978398+0000', 'last_undegraded': '2023-12-19T19:01:34.978398+0000', 'last_fullsized': '2023-12-19T19:01:34.978398+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T19:01:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2023-12-19T19:01:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.980818+0000', 'last_change': '2023-12-19T19:01:34.980818+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.980818+0000', 'last_undegraded': '2023-12-19T19:01:34.980818+0000', 'last_fullsized': '2023-12-19T19:01:34.980818+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T19:01:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2023-12-19T19:01:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.984987+0000', 'last_change': '2023-12-19T19:01:34.984987+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.984987+0000', 'last_undegraded': '2023-12-19T19:01:34.984987+0000', 'last_fullsized': '2023-12-19T19:01:34.984987+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T19:01:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2023-12-19T19:01:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.990456+0000', 'last_change': '2023-12-19T19:01:34.990456+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.990456+0000', 'last_undegraded': '2023-12-19T19:01:34.990456+0000', 'last_fullsized': '2023-12-19T19:01:34.990456+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T19:01:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.23 is not active+clean 2023-12-19T19:01:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.979065+0000', 'last_change': '2023-12-19T19:01:34.979065+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.979065+0000', 'last_undegraded': '2023-12-19T19:01:34.979065+0000', 'last_fullsized': '2023-12-19T19:01:34.979065+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T19:01:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.22 is not active+clean 2023-12-19T19:01:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.979702+0000', 'last_change': '2023-12-19T19:01:34.979702+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.979702+0000', 'last_undegraded': '2023-12-19T19:01:34.979702+0000', 'last_fullsized': '2023-12-19T19:01:34.979702+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T19:01:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2023-12-19T19:01:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.985374+0000', 'last_change': '2023-12-19T19:01:34.985374+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.985374+0000', 'last_undegraded': '2023-12-19T19:01:34.985374+0000', 'last_fullsized': '2023-12-19T19:01:34.985374+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T19:01:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2023-12-19T19:01:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.989863+0000', 'last_change': '2023-12-19T19:01:34.989863+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.989863+0000', 'last_undegraded': '2023-12-19T19:01:34.989863+0000', 'last_fullsized': '2023-12-19T19:01:34.989863+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T19:01:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2023-12-19T19:01:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.987197+0000', 'last_change': '2023-12-19T19:01:34.987197+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.987197+0000', 'last_undegraded': '2023-12-19T19:01:34.987197+0000', 'last_fullsized': '2023-12-19T19:01:34.987197+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T19:01:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2023-12-19T19:01:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.993263+0000', 'last_change': '2023-12-19T19:01:34.993263+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.993263+0000', 'last_undegraded': '2023-12-19T19:01:34.993263+0000', 'last_fullsized': '2023-12-19T19:01:34.993263+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T19:01:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2023-12-19T19:01:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.989972+0000', 'last_change': '2023-12-19T19:01:34.989972+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.989972+0000', 'last_undegraded': '2023-12-19T19:01:34.989972+0000', 'last_fullsized': '2023-12-19T19:01:34.989972+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T19:01:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2023-12-19T19:01:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.980070+0000', 'last_change': '2023-12-19T19:01:34.980070+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.980070+0000', 'last_undegraded': '2023-12-19T19:01:34.980070+0000', 'last_fullsized': '2023-12-19T19:01:34.980070+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T19:01:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2023-12-19T19:01:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.977533+0000', 'last_change': '2023-12-19T19:01:34.977533+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.977533+0000', 'last_undegraded': '2023-12-19T19:01:34.977533+0000', 'last_fullsized': '2023-12-19T19:01:34.977533+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T19:01:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2023-12-19T19:01:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.982664+0000', 'last_change': '2023-12-19T19:01:34.982664+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.982664+0000', 'last_undegraded': '2023-12-19T19:01:34.982664+0000', 'last_fullsized': '2023-12-19T19:01:34.982664+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T19:01:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2023-12-19T19:01:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.980845+0000', 'last_change': '2023-12-19T19:01:34.980845+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.980845+0000', 'last_undegraded': '2023-12-19T19:01:34.980845+0000', 'last_fullsized': '2023-12-19T19:01:34.980845+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T19:01:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2023-12-19T19:01:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.978636+0000', 'last_change': '2023-12-19T19:01:34.978636+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.978636+0000', 'last_undegraded': '2023-12-19T19:01:34.978636+0000', 'last_fullsized': '2023-12-19T19:01:34.978636+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T19:01:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2023-12-19T19:01:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.979573+0000', 'last_change': '2023-12-19T19:01:34.979573+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.979573+0000', 'last_undegraded': '2023-12-19T19:01:34.979573+0000', 'last_fullsized': '2023-12-19T19:01:34.979573+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-19T19:01:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2023-12-19T19:01:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.984951+0000', 'last_change': '2023-12-19T19:01:34.984951+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.984951+0000', 'last_undegraded': '2023-12-19T19:01:34.984951+0000', 'last_fullsized': '2023-12-19T19:01:34.984951+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T19:01:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.14 is not active+clean 2023-12-19T19:01:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.982176+0000', 'last_change': '2023-12-19T19:01:34.982176+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.982176+0000', 'last_undegraded': '2023-12-19T19:01:34.982176+0000', 'last_fullsized': '2023-12-19T19:01:34.982176+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T19:01:40.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2023-12-19T19:01:40.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.984524+0000', 'last_change': '2023-12-19T19:01:34.984524+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.984524+0000', 'last_undegraded': '2023-12-19T19:01:34.984524+0000', 'last_fullsized': '2023-12-19T19:01:34.984524+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T19:01:40.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.12 is not active+clean 2023-12-19T19:01:40.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.981922+0000', 'last_change': '2023-12-19T19:01:34.981922+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.981922+0000', 'last_undegraded': '2023-12-19T19:01:34.981922+0000', 'last_fullsized': '2023-12-19T19:01:34.981922+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T19:01:40.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2023-12-19T19:01:40.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.980097+0000', 'last_change': '2023-12-19T19:01:34.980097+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.980097+0000', 'last_undegraded': '2023-12-19T19:01:34.980097+0000', 'last_fullsized': '2023-12-19T19:01:34.980097+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T19:01:40.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2023-12-19T19:01:40.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.977480+0000', 'last_change': '2023-12-19T19:01:34.977480+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.977480+0000', 'last_undegraded': '2023-12-19T19:01:34.977480+0000', 'last_fullsized': '2023-12-19T19:01:34.977480+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T19:01:40.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2023-12-19T19:01:40.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.977484+0000', 'last_change': '2023-12-19T19:01:34.977484+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.977484+0000', 'last_undegraded': '2023-12-19T19:01:34.977484+0000', 'last_fullsized': '2023-12-19T19:01:34.977484+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T19:01:40.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2023-12-19T19:01:40.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.980284+0000', 'last_change': '2023-12-19T19:01:34.980284+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.980284+0000', 'last_undegraded': '2023-12-19T19:01:34.980284+0000', 'last_fullsized': '2023-12-19T19:01:34.980284+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T19:01:40.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2023-12-19T19:01:40.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.992557+0000', 'last_change': '2023-12-19T19:01:34.992557+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.992557+0000', 'last_undegraded': '2023-12-19T19:01:34.992557+0000', 'last_fullsized': '2023-12-19T19:01:34.992557+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T19:01:40.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2023-12-19T19:01:40.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.984072+0000', 'last_change': '2023-12-19T19:01:34.984072+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.984072+0000', 'last_undegraded': '2023-12-19T19:01:34.984072+0000', 'last_fullsized': '2023-12-19T19:01:34.984072+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T19:01:40.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2023-12-19T19:01:40.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.982629+0000', 'last_change': '2023-12-19T19:01:34.982629+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.982629+0000', 'last_undegraded': '2023-12-19T19:01:34.982629+0000', 'last_fullsized': '2023-12-19T19:01:34.982629+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T19:01:40.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2023-12-19T19:01:40.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.985896+0000', 'last_change': '2023-12-19T19:01:34.985896+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.985896+0000', 'last_undegraded': '2023-12-19T19:01:34.985896+0000', 'last_fullsized': '2023-12-19T19:01:34.985896+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T19:01:40.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2023-12-19T19:01:40.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.979228+0000', 'last_change': '2023-12-19T19:01:34.979228+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.979228+0000', 'last_undegraded': '2023-12-19T19:01:34.979228+0000', 'last_fullsized': '2023-12-19T19:01:34.979228+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-19T19:01:40.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2023-12-19T19:01:40.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.987437+0000', 'last_change': '2023-12-19T19:01:34.987437+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.987437+0000', 'last_undegraded': '2023-12-19T19:01:34.987437+0000', 'last_fullsized': '2023-12-19T19:01:34.987437+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T19:01:40.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2023-12-19T19:01:40.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.986763+0000', 'last_change': '2023-12-19T19:01:34.986763+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.986763+0000', 'last_undegraded': '2023-12-19T19:01:34.986763+0000', 'last_fullsized': '2023-12-19T19:01:34.986763+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T19:01:40.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2023-12-19T19:01:40.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.980782+0000', 'last_change': '2023-12-19T19:01:34.980782+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.980782+0000', 'last_undegraded': '2023-12-19T19:01:34.980782+0000', 'last_fullsized': '2023-12-19T19:01:34.980782+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T19:01:40.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2023-12-19T19:01:40.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.989455+0000', 'last_change': '2023-12-19T19:01:34.989455+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.989455+0000', 'last_undegraded': '2023-12-19T19:01:34.989455+0000', 'last_fullsized': '2023-12-19T19:01:34.989455+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T19:01:40.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2023-12-19T19:01:40.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.983538+0000', 'last_change': '2023-12-19T19:01:34.983538+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.983538+0000', 'last_undegraded': '2023-12-19T19:01:34.983538+0000', 'last_fullsized': '2023-12-19T19:01:34.983538+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-19T19:01:40.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2023-12-19T19:01:40.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.985453+0000', 'last_change': '2023-12-19T19:01:34.985453+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.985453+0000', 'last_undegraded': '2023-12-19T19:01:34.985453+0000', 'last_fullsized': '2023-12-19T19:01:34.985453+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-19T19:01:40.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3 is not active+clean 2023-12-19T19:01:40.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.984415+0000', 'last_change': '2023-12-19T19:01:34.984415+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.984415+0000', 'last_undegraded': '2023-12-19T19:01:34.984415+0000', 'last_fullsized': '2023-12-19T19:01:34.984415+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-19T19:01:40.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2023-12-19T19:01:40.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.980169+0000', 'last_change': '2023-12-19T19:01:34.980169+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.980169+0000', 'last_undegraded': '2023-12-19T19:01:34.980169+0000', 'last_fullsized': '2023-12-19T19:01:34.980169+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-19T19:01:40.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2023-12-19T19:01:40.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.991560+0000', 'last_change': '2023-12-19T19:01:34.991560+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.991560+0000', 'last_undegraded': '2023-12-19T19:01:34.991560+0000', 'last_fullsized': '2023-12-19T19:01:34.991560+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-19T19:01:40.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2023-12-19T19:01:40.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 67, 'state': 'creating+peering', 'last_fresh': '2023-12-19T19:01:34.977470+0000', 'last_change': '2023-12-19T19:01:34.977470+0000', 'last_active': '2023-12-19T19:01:34.962160+0000', 'last_peered': '2023-12-19T19:01:34.962160+0000', 'last_clean': '2023-12-19T19:01:34.962160+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-19T19:01:34.977470+0000', 'last_undegraded': '2023-12-19T19:01:34.977470+0000', 'last_fullsized': '2023-12-19T19:01:34.977470+0000', 'mapping_epoch': 67, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 67, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'last_clean_scrub_stamp': '2023-12-19T19:01:34.962160+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-19T19:01:40.821 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-19T19:01:40.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.980+0000 7f4242f2a640 1 Processor -- start 2023-12-19T19:01:40.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.980+0000 7f4242f2a640 1 -- start start 2023-12-19T19:01:40.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.980+0000 7f4242f2a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f423c06b270 0x7f423c155240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:40.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.980+0000 7f4242f2a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f423c0c6310 0x7f423c0c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:40.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.980+0000 7f4242f2a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f423c0c56d0 con 0x7f423c0c8370 2023-12-19T19:01:40.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.980+0000 7f4242f2a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423c0c8800 con 0x7f423c06b270 2023-12-19T19:01:40.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.980+0000 7f4242f2a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423c0c9d30 con 0x7f423c0c6310 2023-12-19T19:01:40.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.980+0000 7f4240cc6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f423c06b270 0x7f423c155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:40.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.980+0000 7f42414c7640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f423c0c8370 0x7f423c157d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48014/0 (socket says 172.21.15.133:48014) 2023-12-19T19:01:40.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.980+0000 7f42414c7640 1 -- 172.21.15.133:0/61220782 learned_addr learned my addr 172.21.15.133:0/61220782 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:40.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.980+0000 7f4240cc6640 1 -- 172.21.15.133:0/61220782 >> v2:172.21.15.138:3300/0 conn(0x7f423c0c6310 msgr2=0x7f423c0c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:40.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.980+0000 7f4240cc6640 1 --2- 172.21.15.133:0/61220782 >> v2:172.21.15.138:3300/0 conn(0x7f423c0c6310 0x7f423c0c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.980+0000 7f4240cc6640 1 -- 172.21.15.133:0/61220782 >> v1:172.21.15.133:6789/0 conn(0x7f423c0c8370 legacy=0x7f423c157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:40.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.980+0000 7f4240cc6640 1 -- 172.21.15.133:0/61220782 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c0c4da0 con 0x7f423c06b270 2023-12-19T19:01:40.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.980+0000 7f42337fe640 1 -- 172.21.15.133:0/61220782 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403478691 0 0) 0x7f423c0c56d0 con 0x7f423c0c8370 2023-12-19T19:01:40.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.984+0000 7f4240cc6640 1 --2- 172.21.15.133:0/61220782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f423c06b270 0x7f423c155240 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f42380097c0 tx=0x7f423801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d048ec1d05ea7d85 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:40.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.984+0000 7f42337fe640 1 -- 172.21.15.133:0/61220782 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42380ab600 con 0x7f423c06b270 2023-12-19T19:01:40.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.984+0000 7f42337fe640 1 -- 172.21.15.133:0/61220782 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42380a7050 con 0x7f423c06b270 2023-12-19T19:01:40.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.984+0000 7f42337fe640 1 -- 172.21.15.133:0/61220782 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42380ab980 con 0x7f423c06b270 2023-12-19T19:01:40.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.984+0000 7f4242f2a640 1 -- 172.21.15.133:0/61220782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f423c06b270 msgr2=0x7f423c155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:40.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.984+0000 7f4242f2a640 1 --2- 172.21.15.133:0/61220782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f423c06b270 0x7f423c155240 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f42380097c0 tx=0x7f423801c3b0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.984+0000 7f4242f2a640 1 -- 172.21.15.133:0/61220782 shutdown_connections 2023-12-19T19:01:40.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.984+0000 7f4242f2a640 1 --2- 172.21.15.133:0/61220782 >> v2:172.21.15.138:3300/0 conn(0x7f423c0c6310 0x7f423c0c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.984+0000 7f4242f2a640 1 --2- 172.21.15.133:0/61220782 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f423c06b270 0x7f423c155240 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.984+0000 7f4242f2a640 1 -- 172.21.15.133:0/61220782 >> 172.21.15.133:0/61220782 conn(0x7f423c0ca100 msgr2=0x7f423c0ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:40.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.984+0000 7f4242f2a640 1 -- 172.21.15.133:0/61220782 shutdown_connections 2023-12-19T19:01:40.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.984+0000 7f4242f2a640 1 -- 172.21.15.133:0/61220782 wait complete. 2023-12-19T19:01:40.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f4242f2a640 1 Processor -- start 2023-12-19T19:01:40.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f4242f2a640 1 -- start start 2023-12-19T19:01:40.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f4242f2a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f423c06b270 0x7f423c1473d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:40.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f4242f2a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f423c0c6310 0x7f423c14dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:40.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f4242f2a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f423c0c8370 0x7f423c14e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:40.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f4242f2a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c14cb90 con 0x7f423c06b270 2023-12-19T19:01:40.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f4242f2a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c149b90 con 0x7f423c0c6310 2023-12-19T19:01:40.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f4242f2a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c144ca0 con 0x7f423c0c8370 2023-12-19T19:01:40.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f4240cc6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f423c06b270 0x7f423c1473d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:40.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f4240cc6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f423c06b270 0x7f423c1473d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53736/0 (socket says 172.21.15.133:53736) 2023-12-19T19:01:40.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f4240cc6640 1 -- 172.21.15.133:0/278458587 learned_addr learned my addr 172.21.15.133:0/278458587 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:40.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f42414c7640 1 --2- 172.21.15.133:0/278458587 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f423c0c8370 0x7f423c14e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:40.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f4233fff640 1 --2- 172.21.15.133:0/278458587 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f423c0c6310 0x7f423c14dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:40.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f4240cc6640 1 -- 172.21.15.133:0/278458587 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f423c0c8370 msgr2=0x7f423c14e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f4240cc6640 1 --2- 172.21.15.133:0/278458587 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f423c0c8370 0x7f423c14e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f4240cc6640 1 -- 172.21.15.133:0/278458587 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f423c0c6310 msgr2=0x7f423c14dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f4240cc6640 1 --2- 172.21.15.133:0/278458587 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f423c0c6310 0x7f423c14dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f4240cc6640 1 -- 172.21.15.133:0/278458587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4238009420 con 0x7f423c06b270 2023-12-19T19:01:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f42414c7640 1 --2- 172.21.15.133:0/278458587 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f423c0c8370 0x7f423c14e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:40.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f4233fff640 1 --2- 172.21.15.133:0/278458587 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f423c0c6310 0x7f423c14dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f4240cc6640 1 --2- 172.21.15.133:0/278458587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f423c06b270 0x7f423c1473d0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f42380ae040 tx=0x7f423801abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f42317fa640 1 -- 172.21.15.133:0/278458587 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42380b7650 con 0x7f423c06b270 2023-12-19T19:01:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f42317fa640 1 -- 172.21.15.133:0/278458587 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42380b77d0 con 0x7f423c06b270 2023-12-19T19:01:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f42317fa640 1 -- 172.21.15.133:0/278458587 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42380b7b80 con 0x7f423c06b270 2023-12-19T19:01:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f4242f2a640 1 -- 172.21.15.133:0/278458587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f423c144f10 con 0x7f423c06b270 2023-12-19T19:01:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.988+0000 7f4242f2a640 1 -- 172.21.15.133:0/278458587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f423c147910 con 0x7f423c06b270 2023-12-19T19:01:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.992+0000 7f4242f2a640 1 -- 172.21.15.133:0/278458587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423c04e850 con 0x7f423c06b270 2023-12-19T19:01:40.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.992+0000 7f42317fa640 1 -- 172.21.15.133:0/278458587 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f42380b7ce0 con 0x7f423c06b270 2023-12-19T19:01:40.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.992+0000 7f42317fa640 1 --2- 172.21.15.133:0/278458587 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f42280664a0 0x7f4228068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:40.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.992+0000 7f42317fa640 1 -- 172.21.15.133:0/278458587 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f423811e760 con 0x7f423c06b270 2023-12-19T19:01:40.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.992+0000 7f4233fff640 1 --2- 172.21.15.133:0/278458587 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f42280664a0 0x7f4228068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:40.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.992+0000 7f4233fff640 1 --2- 172.21.15.133:0/278458587 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f42280664a0 0x7f4228068960 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f422c006fd0 tx=0x7f422c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:41.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:40.996+0000 7f42317fa640 1 -- 172.21.15.133:0/278458587 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f42380ebd00 con 0x7f423c06b270 2023-12-19T19:01:41.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.200+0000 7f4242f2a640 1 -- 172.21.15.133:0/278458587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f423c068400 con 0x7f423c06b270 2023-12-19T19:01:41.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.204+0000 7f42317fa640 1 -- 172.21.15.133:0/278458587 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1323 (secure 0 0 0) 0x7f42380bb540 con 0x7f423c06b270 2023-12-19T19:01:41.208 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:41.208 INFO:teuthology.orchestra.run.smithi133.stdout:{"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":203,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":69,"num_osds":8,"num_up_osds":8,"osd_up_since":1703012310,"num_in_osds":8,"osd_in_since":1703012300,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":254668800,"bytes_avail":772839444480,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":48,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":6507}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-12-19T19:01:20.872205+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-19T19:01:41.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.204+0000 7f4242f2a640 1 -- 172.21.15.133:0/278458587 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f42280664a0 msgr2=0x7f4228068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:41.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.204+0000 7f4242f2a640 1 --2- 172.21.15.133:0/278458587 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f42280664a0 0x7f4228068960 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f422c006fd0 tx=0x7f422c008040 comp rx=0 tx=0).stop 2023-12-19T19:01:41.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.204+0000 7f4242f2a640 1 -- 172.21.15.133:0/278458587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f423c06b270 msgr2=0x7f423c1473d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:41.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.204+0000 7f4242f2a640 1 --2- 172.21.15.133:0/278458587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f423c06b270 0x7f423c1473d0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f42380ae040 tx=0x7f423801abf0 comp rx=0 tx=0).stop 2023-12-19T19:01:41.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.204+0000 7f4242f2a640 1 -- 172.21.15.133:0/278458587 shutdown_connections 2023-12-19T19:01:41.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.204+0000 7f4242f2a640 1 --2- 172.21.15.133:0/278458587 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f42280664a0 0x7f4228068960 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:41.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.204+0000 7f4242f2a640 1 --2- 172.21.15.133:0/278458587 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f423c0c8370 0x7f423c14e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:41.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.204+0000 7f4242f2a640 1 --2- 172.21.15.133:0/278458587 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f423c0c6310 0x7f423c14dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:41.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.204+0000 7f4242f2a640 1 --2- 172.21.15.133:0/278458587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f423c06b270 0x7f423c1473d0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:41.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.204+0000 7f4242f2a640 1 -- 172.21.15.133:0/278458587 >> 172.21.15.133:0/278458587 conn(0x7f423c0ca100 msgr2=0x7f423c14fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:41.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.204+0000 7f4242f2a640 1 -- 172.21.15.133:0/278458587 shutdown_connections 2023-12-19T19:01:41.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.204+0000 7f4242f2a640 1 -- 172.21.15.133:0/278458587 wait complete. 2023-12-19T19:01:41.229 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-19T19:01:41.229 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T19:01:41.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.360+0000 7f0219b1d640 1 Processor -- start 2023-12-19T19:01:41.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.360+0000 7f0219b1d640 1 -- start start 2023-12-19T19:01:41.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f0219b1d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f02140a5370 0x7f02140c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:41.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f0219b1d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02140c2760 con 0x7f02140c4110 2023-12-19T19:01:41.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f0219b1d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02140a5750 con 0x7f0214072090 2023-12-19T19:01:41.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f0219b1d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02140c3070 con 0x7f02140a5370 2023-12-19T19:01:41.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f0212ffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f02140c4110 0x7f0214150fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48018/0 (socket says 172.21.15.133:48018) 2023-12-19T19:01:41.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f0212ffd640 1 -- 172.21.15.133:0/1586169004 learned_addr learned my addr 172.21.15.133:0/1586169004 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f02137fe640 1 --2- 172.21.15.133:0/1586169004 >> v2:172.21.15.138:3300/0 conn(0x7f02140a5370 0x7f02140c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f02127fc640 1 -- 172.21.15.133:0/1586169004 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827465078 0 0) 0x7f02140c2760 con 0x7f02140c4110 2023-12-19T19:01:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f02127fc640 1 -- 172.21.15.133:0/1586169004 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01fc003530 con 0x7f02140c4110 2023-12-19T19:01:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f02127fc640 1 -- 172.21.15.133:0/1586169004 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1892562429 0 0) 0x7f01fc003530 con 0x7f02140c4110 2023-12-19T19:01:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f02127fc640 1 -- 172.21.15.133:0/1586169004 >> v2:172.21.15.138:3300/0 conn(0x7f02140a5370 msgr2=0x7f02140c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f02127fc640 1 --2- 172.21.15.133:0/1586169004 >> v2:172.21.15.138:3300/0 conn(0x7f02140a5370 0x7f02140c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f02127fc640 1 -- 172.21.15.133:0/1586169004 >> v1:172.21.15.138:6789/0 conn(0x7f0214072090 legacy=0x7f021415b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f02127fc640 1 -- 172.21.15.133:0/1586169004 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02140aad20 con 0x7f02140c4110 2023-12-19T19:01:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f02127fc640 1 -- 172.21.15.133:0/1586169004 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f0208001680 con 0x7f02140c4110 2023-12-19T19:01:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f02127fc640 1 -- 172.21.15.133:0/1586169004 >> v1:172.21.15.133:6789/0 conn(0x7f02140c4110 legacy=0x7f0214150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f02127fc640 1 --2- 172.21.15.133:0/1586169004 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01fc003980 0x7f01fc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f02127fc640 1 --2- 172.21.15.133:0/1586169004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01fc0047d0 0x7f01fc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f02127fc640 1 --2- 172.21.15.133:0/1586169004 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01fc0052b0 0x7f01fc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:41.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f02127fc640 1 -- 172.21.15.133:0/1586169004 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02140c3070 con 0x7f01fc0052b0 2023-12-19T19:01:41.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f02127fc640 1 -- 172.21.15.133:0/1586169004 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc00c180 con 0x7f01fc0047d0 2023-12-19T19:01:41.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f02127fc640 1 -- 172.21.15.133:0/1586169004 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01fc00c340 con 0x7f01fc003980 2023-12-19T19:01:41.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f0213fff640 1 --2- 172.21.15.133:0/1586169004 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01fc0052b0 0x7f01fc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:41.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f0212ffd640 1 --2- 172.21.15.133:0/1586169004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01fc0047d0 0x7f01fc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:41.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f02137fe640 1 --2- 172.21.15.133:0/1586169004 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01fc003980 0x7f01fc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:41.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f0213fff640 1 -- 172.21.15.133:0/1586169004 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01fc003980 msgr2=0x7f01fc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:41.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f0213fff640 1 --2- 172.21.15.133:0/1586169004 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01fc003980 0x7f01fc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:41.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f0213fff640 1 -- 172.21.15.133:0/1586169004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01fc0047d0 msgr2=0x7f01fc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:41.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f0213fff640 1 --2- 172.21.15.133:0/1586169004 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f01fc0047d0 0x7f01fc004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:41.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.364+0000 7f0213fff640 1 -- 172.21.15.133:0/1586169004 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01fc003530 con 0x7f01fc0052b0 2023-12-19T19:01:41.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.368+0000 7f0213fff640 1 -- 172.21.15.133:0/1586169004 reap_dead start 2023-12-19T19:01:41.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.368+0000 7f0213fff640 1 --2- 172.21.15.133:0/1586169004 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01fc0052b0 0x7f01fc00b990 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f020c001e40 tx=0x7f020c01c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c41286b7284def82 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:41.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.368+0000 7f02127fc640 1 -- 172.21.15.133:0/1586169004 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c003b80 con 0x7f01fc0052b0 2023-12-19T19:01:41.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.368+0000 7f02127fc640 1 -- 172.21.15.133:0/1586169004 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020c003ce0 con 0x7f01fc0052b0 2023-12-19T19:01:41.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.368+0000 7f02127fc640 1 -- 172.21.15.133:0/1586169004 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c005310 con 0x7f01fc0052b0 2023-12-19T19:01:41.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.368+0000 7f0219b1d640 1 -- 172.21.15.133:0/1586169004 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01fc0052b0 msgr2=0x7f01fc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:41.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.368+0000 7f0219b1d640 1 --2- 172.21.15.133:0/1586169004 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01fc0052b0 0x7f01fc00b990 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f020c001e40 tx=0x7f020c01c710 comp rx=0 tx=0).stop 2023-12-19T19:01:41.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.368+0000 7f0219b1d640 1 -- 172.21.15.133:0/1586169004 shutdown_connections 2023-12-19T19:01:41.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.368+0000 7f0219b1d640 1 --2- 172.21.15.133:0/1586169004 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01fc0052b0 0x7f01fc00b990 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:41.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.368+0000 7f0219b1d640 1 -- 172.21.15.133:0/1586169004 >> 172.21.15.133:0/1586169004 conn(0x7f021406a5b0 msgr2=0x7f021406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:41.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.368+0000 7f0219b1d640 1 -- 172.21.15.133:0/1586169004 shutdown_connections 2023-12-19T19:01:41.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.368+0000 7f0219b1d640 1 -- 172.21.15.133:0/1586169004 wait complete. 2023-12-19T19:01:41.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.368+0000 7f0219b1d640 1 Processor -- start 2023-12-19T19:01:41.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f0219b1d640 1 -- start start 2023-12-19T19:01:41.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f0219b1d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01fc0052b0 0x7f0214146220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:41.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f0219b1d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0214070ff0 0x7f0214143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:41.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f0219b1d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02141442a0 0x7f0214148c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:41.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f0219b1d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021414a940 con 0x7f0214070ff0 2023-12-19T19:01:41.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f0219b1d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0214071440 con 0x7f02141442a0 2023-12-19T19:01:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f0219b1d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0214148820 con 0x7f01fc0052b0 2023-12-19T19:01:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f0212ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0214070ff0 0x7f0214143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f0212ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0214070ff0 0x7f0214143d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:53756/0 (socket says 172.21.15.133:53756) 2023-12-19T19:01:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f0212ffd640 1 -- 172.21.15.133:0/1743723015 learned_addr learned my addr 172.21.15.133:0/1743723015 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f02137fe640 1 --2- 172.21.15.133:0/1743723015 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01fc0052b0 0x7f0214146220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f0213fff640 1 --2- 172.21.15.133:0/1743723015 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02141442a0 0x7f0214148c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f0212ffd640 1 -- 172.21.15.133:0/1743723015 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01fc0052b0 msgr2=0x7f0214146220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f0212ffd640 1 --2- 172.21.15.133:0/1743723015 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01fc0052b0 0x7f0214146220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f0212ffd640 1 -- 172.21.15.133:0/1743723015 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02141442a0 msgr2=0x7f0214148c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f0212ffd640 1 --2- 172.21.15.133:0/1743723015 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02141442a0 0x7f0214148c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f0212ffd640 1 -- 172.21.15.133:0/1743723015 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0214148540 con 0x7f0214070ff0 2023-12-19T19:01:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f0212ffd640 1 --2- 172.21.15.133:0/1743723015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0214070ff0 0x7f0214143d60 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f02080072f0 tx=0x7f02080076f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f01fbfff640 1 -- 172.21.15.133:0/1743723015 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020800f940 con 0x7f0214070ff0 2023-12-19T19:01:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f0219b1d640 1 -- 172.21.15.133:0/1743723015 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0214144720 con 0x7f0214070ff0 2023-12-19T19:01:41.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f01fbfff640 1 -- 172.21.15.133:0/1743723015 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020800faa0 con 0x7f0214070ff0 2023-12-19T19:01:41.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f01fbfff640 1 -- 172.21.15.133:0/1743723015 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020800fe50 con 0x7f0214070ff0 2023-12-19T19:01:41.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f0219b1d640 1 -- 172.21.15.133:0/1743723015 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0214070860 con 0x7f0214070ff0 2023-12-19T19:01:41.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.372+0000 7f0219b1d640 1 -- 172.21.15.133:0/1743723015 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0214148990 con 0x7f0214070ff0 2023-12-19T19:01:41.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.376+0000 7f01fbfff640 1 -- 172.21.15.133:0/1743723015 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f02080133b0 con 0x7f0214070ff0 2023-12-19T19:01:41.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.376+0000 7f01fbfff640 1 --2- 172.21.15.133:0/1743723015 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0200066470 0x7f0200068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:41.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.376+0000 7f01fbfff640 1 -- 172.21.15.133:0/1743723015 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0208083730 con 0x7f0214070ff0 2023-12-19T19:01:41.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.376+0000 7f02137fe640 1 --2- 172.21.15.133:0/1743723015 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0200066470 0x7f0200068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:41.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.376+0000 7f02137fe640 1 --2- 172.21.15.133:0/1743723015 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0200066470 0x7f0200068930 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0204009b60 tx=0x7f0204009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:41.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.380+0000 7f01fbfff640 1 -- 172.21.15.133:0/1743723015 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0214148990 con 0x7f0214070ff0 2023-12-19T19:01:41.531 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.524+0000 7f0219b1d640 1 -- 172.21.15.133:0/1743723015 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02140c1550 con 0x7f0200066470 2023-12-19T19:01:41.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.532+0000 7f01fbfff640 1 -- 172.21.15.133:0/1743723015 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284121 (secure 0 0 0) 0x7f02140c1550 con 0x7f0200066470 2023-12-19T19:01:41.671 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:41.672 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T19:01:41.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.536+0000 7f0219b1d640 1 -- 172.21.15.133:0/1743723015 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0200066470 msgr2=0x7f0200068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:41.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.536+0000 7f0219b1d640 1 --2- 172.21.15.133:0/1743723015 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0200066470 0x7f0200068930 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0204009b60 tx=0x7f0204009190 comp rx=0 tx=0).stop 2023-12-19T19:01:41.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.536+0000 7f0219b1d640 1 -- 172.21.15.133:0/1743723015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0214070ff0 msgr2=0x7f0214143d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:41.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.536+0000 7f0219b1d640 1 --2- 172.21.15.133:0/1743723015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0214070ff0 0x7f0214143d60 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f02080072f0 tx=0x7f02080076f0 comp rx=0 tx=0).stop 2023-12-19T19:01:41.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.536+0000 7f0219b1d640 1 -- 172.21.15.133:0/1743723015 shutdown_connections 2023-12-19T19:01:41.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.536+0000 7f0219b1d640 1 --2- 172.21.15.133:0/1743723015 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0200066470 0x7f0200068930 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:41.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.536+0000 7f0219b1d640 1 --2- 172.21.15.133:0/1743723015 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02141442a0 0x7f0214148c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:41.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.536+0000 7f0219b1d640 1 --2- 172.21.15.133:0/1743723015 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0214070ff0 0x7f0214143d60 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:41.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.536+0000 7f0219b1d640 1 --2- 172.21.15.133:0/1743723015 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f01fc0052b0 0x7f0214146220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:41.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.536+0000 7f0219b1d640 1 -- 172.21.15.133:0/1743723015 >> 172.21.15.133:0/1743723015 conn(0x7f021406a5b0 msgr2=0x7f021406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:41.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.536+0000 7f0219b1d640 1 -- 172.21.15.133:0/1743723015 shutdown_connections 2023-12-19T19:01:41.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:41.536+0000 7f0219b1d640 1 -- 172.21.15.133:0/1743723015 wait complete. 2023-12-19T19:01:41.675 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2023-12-19T19:01:40.876414+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248700,"kb_used_data":7576,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754726020,"statfs":{"total":773094113280,"available":772839444480,"internally_reserved":0,"allocated":7757824,"data_stored":4029610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001627"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.993780+0000","last_change":"2023-12-19T19:01:34.993780+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.993780+0000","last_undegraded":"2023-12-19T19:01:34.993780+0000","last_fullsized":"2023-12-19T19:01:34.993780+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.983586+0000","last_change":"2023-12-19T19:01:34.983586+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.983586+0000","last_undegraded":"2023-12-19T19:01:34.983586+0000","last_fullsized":"2023-12-19T19:01:34.983586+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.981798+0000","last_change":"2023-12-19T19:01:34.981798+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.981798+0000","last_undegraded":"2023-12-19T19:01:34.981798+0000","last_fullsized":"2023-12-19T19:01:34.981798+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980246+0000","last_change":"2023-12-19T19:01:34.980246+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980246+0000","last_undegraded":"2023-12-19T19:01:34.980246+0000","last_fullsized":"2023-12-19T19:01:34.980246+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.983335+0000","last_change":"2023-12-19T19:01:34.983335+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.983335+0000","last_undegraded":"2023-12-19T19:01:34.983335+0000","last_fullsized":"2023-12-19T19:01:34.983335+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.986592+0000","last_change":"2023-12-19T19:01:34.986592+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.986592+0000","last_undegraded":"2023-12-19T19:01:34.986592+0000","last_fullsized":"2023-12-19T19:01:34.986592+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984685+0000","last_change":"2023-12-19T19:01:34.984685+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984685+0000","last_undegraded":"2023-12-19T19:01:34.984685+0000","last_fullsized":"2023-12-19T19:01:34.984685+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984583+0000","last_change":"2023-12-19T19:01:34.984583+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984583+0000","last_undegraded":"2023-12-19T19:01:34.984583+0000","last_fullsized":"2023-12-19T19:01:34.984583+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.987226+0000","last_change":"2023-12-19T19:01:34.987226+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.987226+0000","last_undegraded":"2023-12-19T19:01:34.987226+0000","last_fullsized":"2023-12-19T19:01:34.987226+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.990652+0000","last_change":"2023-12-19T19:01:34.990652+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.990652+0000","last_undegraded":"2023-12-19T19:01:34.990652+0000","last_fullsized":"2023-12-19T19:01:34.990652+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979166+0000","last_change":"2023-12-19T19:01:34.979166+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979166+0000","last_undegraded":"2023-12-19T19:01:34.979166+0000","last_fullsized":"2023-12-19T19:01:34.979166+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.992632+0000","last_change":"2023-12-19T19:01:34.992632+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.992632+0000","last_undegraded":"2023-12-19T19:01:34.992632+0000","last_fullsized":"2023-12-19T19:01:34.992632+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.981312+0000","last_change":"2023-12-19T19:01:34.981312+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.981312+0000","last_undegraded":"2023-12-19T19:01:34.981312+0000","last_fullsized":"2023-12-19T19:01:34.981312+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.983073+0000","last_change":"2023-12-19T19:01:34.983073+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.983073+0000","last_undegraded":"2023-12-19T19:01:34.983073+0000","last_fullsized":"2023-12-19T19:01:34.983073+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979150+0000","last_change":"2023-12-19T19:01:34.979150+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979150+0000","last_undegraded":"2023-12-19T19:01:34.979150+0000","last_fullsized":"2023-12-19T19:01:34.979150+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.983703+0000","last_change":"2023-12-19T19:01:34.983703+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.983703+0000","last_undegraded":"2023-12-19T19:01:34.983703+0000","last_fullsized":"2023-12-19T19:01:34.983703+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.987894+0000","last_change":"2023-12-19T19:01:34.987894+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.987894+0000","last_undegraded":"2023-12-19T19:01:34.987894+0000","last_fullsized":"2023-12-19T19:01:34.987894+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.982203+0000","last_change":"2023-12-19T19:01:34.982203+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.982203+0000","last_undegraded":"2023-12-19T19:01:34.982203+0000","last_fullsized":"2023-12-19T19:01:34.982203+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.981398+0000","last_change":"2023-12-19T19:01:34.981398+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.981398+0000","last_undegraded":"2023-12-19T19:01:34.981398+0000","last_fullsized":"2023-12-19T19:01:34.981398+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979743+0000","last_change":"2023-12-19T19:01:34.979743+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979743+0000","last_undegraded":"2023-12-19T19:01:34.979743+0000","last_fullsized":"2023-12-19T19:01:34.979743+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.982223+0000","last_change":"2023-12-19T19:01:34.982223+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.982223+0000","last_undegraded":"2023-12-19T19:01:34.982223+0000","last_fullsized":"2023-12-19T19:01:34.982223+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980145+0000","last_change":"2023-12-19T19:01:34.980145+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980145+0000","last_undegraded":"2023-12-19T19:01:34.980145+0000","last_fullsized":"2023-12-19T19:01:34.980145+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.992668+0000","last_change":"2023-12-19T19:01:34.992668+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.992668+0000","last_undegraded":"2023-12-19T19:01:34.992668+0000","last_fullsized":"2023-12-19T19:01:34.992668+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979812+0000","last_change":"2023-12-19T19:01:34.979812+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979812+0000","last_undegraded":"2023-12-19T19:01:34.979812+0000","last_fullsized":"2023-12-19T19:01:34.979812+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.978398+0000","last_change":"2023-12-19T19:01:34.978398+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.978398+0000","last_undegraded":"2023-12-19T19:01:34.978398+0000","last_fullsized":"2023-12-19T19:01:34.978398+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980818+0000","last_change":"2023-12-19T19:01:34.980818+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980818+0000","last_undegraded":"2023-12-19T19:01:34.980818+0000","last_fullsized":"2023-12-19T19:01:34.980818+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984987+0000","last_change":"2023-12-19T19:01:34.984987+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984987+0000","last_undegraded":"2023-12-19T19:01:34.984987+0000","last_fullsized":"2023-12-19T19:01:34.984987+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.990456+0000","last_change":"2023-12-19T19:01:34.990456+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.990456+0000","last_undegraded":"2023-12-19T19:01:34.990456+0000","last_fullsized":"2023-12-19T19:01:34.990456+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979065+0000","last_change":"2023-12-19T19:01:34.979065+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979065+0000","last_undegraded":"2023-12-19T19:01:34.979065+0000","last_fullsized":"2023-12-19T19:01:34.979065+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979702+0000","last_change":"2023-12-19T19:01:34.979702+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979702+0000","last_undegraded":"2023-12-19T19:01:34.979702+0000","last_fullsized":"2023-12-19T19:01:34.979702+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.985374+0000","last_change":"2023-12-19T19:01:34.985374+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.985374+0000","last_undegraded":"2023-12-19T19:01:34.985374+0000","last_fullsized":"2023-12-19T19:01:34.985374+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.989863+0000","last_change":"2023-12-19T19:01:34.989863+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.989863+0000","last_undegraded":"2023-12-19T19:01:34.989863+0000","last_fullsized":"2023-12-19T19:01:34.989863+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.987197+0000","last_change":"2023-12-19T19:01:34.987197+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.987197+0000","last_undegraded":"2023-12-19T19:01:34.987197+0000","last_fullsized":"2023-12-19T19:01:34.987197+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.008424+0000","last_change":"2023-12-19T19:01:35.005860+0000","last_active":"2023-12-19T19:01:35.008424+0000","last_peered":"2023-12-19T19:01:35.008424+0000","last_clean":"2023-12-19T19:01:35.008424+0000","last_became_active":"2023-12-19T19:01:35.005458+0000","last_became_peered":"2023-12-19T19:01:35.005458+0000","last_unstale":"2023-12-19T19:01:35.008424+0000","last_undegraded":"2023-12-19T19:01:35.008424+0000","last_fullsized":"2023-12-19T19:01:35.008424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:04:11.121880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.993263+0000","last_change":"2023-12-19T19:01:34.993263+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.993263+0000","last_undegraded":"2023-12-19T19:01:34.993263+0000","last_fullsized":"2023-12-19T19:01:34.993263+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.005337+0000","last_change":"2023-12-19T19:01:35.000000+0000","last_active":"2023-12-19T19:01:35.005337+0000","last_peered":"2023-12-19T19:01:35.005337+0000","last_clean":"2023-12-19T19:01:35.005337+0000","last_became_active":"2023-12-19T19:01:34.999684+0000","last_became_peered":"2023-12-19T19:01:34.999684+0000","last_unstale":"2023-12-19T19:01:35.005337+0000","last_undegraded":"2023-12-19T19:01:35.005337+0000","last_fullsized":"2023-12-19T19:01:35.005337+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:04:11.121880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.989972+0000","last_change":"2023-12-19T19:01:34.989972+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.989972+0000","last_undegraded":"2023-12-19T19:01:34.989972+0000","last_fullsized":"2023-12-19T19:01:34.989972+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.003622+0000","last_change":"2023-12-19T19:01:34.996946+0000","last_active":"2023-12-19T19:01:35.003622+0000","last_peered":"2023-12-19T19:01:35.003622+0000","last_clean":"2023-12-19T19:01:35.003622+0000","last_became_active":"2023-12-19T19:01:34.995689+0000","last_became_peered":"2023-12-19T19:01:34.995689+0000","last_unstale":"2023-12-19T19:01:35.003622+0000","last_undegraded":"2023-12-19T19:01:35.003622+0000","last_fullsized":"2023-12-19T19:01:35.003622+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:32:15.466391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980070+0000","last_change":"2023-12-19T19:01:34.980070+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980070+0000","last_undegraded":"2023-12-19T19:01:34.980070+0000","last_fullsized":"2023-12-19T19:01:34.980070+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.003742+0000","last_change":"2023-12-19T19:01:34.997757+0000","last_active":"2023-12-19T19:01:35.003742+0000","last_peered":"2023-12-19T19:01:35.003742+0000","last_clean":"2023-12-19T19:01:35.003742+0000","last_became_active":"2023-12-19T19:01:34.997458+0000","last_became_peered":"2023-12-19T19:01:34.997458+0000","last_unstale":"2023-12-19T19:01:35.003742+0000","last_undegraded":"2023-12-19T19:01:35.003742+0000","last_fullsized":"2023-12-19T19:01:35.003742+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:48:51.739304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.977533+0000","last_change":"2023-12-19T19:01:34.977533+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.977533+0000","last_undegraded":"2023-12-19T19:01:34.977533+0000","last_fullsized":"2023-12-19T19:01:34.977533+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.001967+0000","last_change":"2023-12-19T19:01:34.994677+0000","last_active":"2023-12-19T19:01:35.001967+0000","last_peered":"2023-12-19T19:01:35.001967+0000","last_clean":"2023-12-19T19:01:35.001967+0000","last_became_active":"2023-12-19T19:01:34.994343+0000","last_became_peered":"2023-12-19T19:01:34.994343+0000","last_unstale":"2023-12-19T19:01:35.001967+0000","last_undegraded":"2023-12-19T19:01:35.001967+0000","last_fullsized":"2023-12-19T19:01:35.001967+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:29.601572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.982664+0000","last_change":"2023-12-19T19:01:34.982664+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.982664+0000","last_undegraded":"2023-12-19T19:01:34.982664+0000","last_fullsized":"2023-12-19T19:01:34.982664+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.005135+0000","last_change":"2023-12-19T19:01:34.998256+0000","last_active":"2023-12-19T19:01:35.005135+0000","last_peered":"2023-12-19T19:01:35.005135+0000","last_clean":"2023-12-19T19:01:35.005135+0000","last_became_active":"2023-12-19T19:01:34.997890+0000","last_became_peered":"2023-12-19T19:01:34.997890+0000","last_unstale":"2023-12-19T19:01:35.005135+0000","last_undegraded":"2023-12-19T19:01:35.005135+0000","last_fullsized":"2023-12-19T19:01:35.005135+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:36.683195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980845+0000","last_change":"2023-12-19T19:01:34.980845+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980845+0000","last_undegraded":"2023-12-19T19:01:34.980845+0000","last_fullsized":"2023-12-19T19:01:34.980845+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.001098+0000","last_change":"2023-12-19T19:01:34.995656+0000","last_active":"2023-12-19T19:01:35.001098+0000","last_peered":"2023-12-19T19:01:35.001098+0000","last_clean":"2023-12-19T19:01:35.001098+0000","last_became_active":"2023-12-19T19:01:34.995357+0000","last_became_peered":"2023-12-19T19:01:34.995357+0000","last_unstale":"2023-12-19T19:01:35.001098+0000","last_undegraded":"2023-12-19T19:01:35.001098+0000","last_fullsized":"2023-12-19T19:01:35.001098+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:06:40.560279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.978636+0000","last_change":"2023-12-19T19:01:34.978636+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.978636+0000","last_undegraded":"2023-12-19T19:01:34.978636+0000","last_fullsized":"2023-12-19T19:01:34.978636+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.006440+0000","last_change":"2023-12-19T19:01:35.000403+0000","last_active":"2023-12-19T19:01:35.006440+0000","last_peered":"2023-12-19T19:01:35.006440+0000","last_clean":"2023-12-19T19:01:35.006440+0000","last_became_active":"2023-12-19T19:01:34.998866+0000","last_became_peered":"2023-12-19T19:01:34.998866+0000","last_unstale":"2023-12-19T19:01:35.006440+0000","last_undegraded":"2023-12-19T19:01:35.006440+0000","last_fullsized":"2023-12-19T19:01:35.006440+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:41:08.421145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979573+0000","last_change":"2023-12-19T19:01:34.979573+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979573+0000","last_undegraded":"2023-12-19T19:01:34.979573+0000","last_fullsized":"2023-12-19T19:01:34.979573+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007157+0000","last_change":"2023-12-19T19:01:35.002076+0000","last_active":"2023-12-19T19:01:35.007157+0000","last_peered":"2023-12-19T19:01:35.007157+0000","last_clean":"2023-12-19T19:01:35.007157+0000","last_became_active":"2023-12-19T19:01:35.001645+0000","last_became_peered":"2023-12-19T19:01:35.001645+0000","last_unstale":"2023-12-19T19:01:35.007157+0000","last_undegraded":"2023-12-19T19:01:35.007157+0000","last_fullsized":"2023-12-19T19:01:35.007157+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:36.683195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984951+0000","last_change":"2023-12-19T19:01:34.984951+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984951+0000","last_undegraded":"2023-12-19T19:01:34.984951+0000","last_fullsized":"2023-12-19T19:01:34.984951+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007231+0000","last_change":"2023-12-19T19:01:35.003678+0000","last_active":"2023-12-19T19:01:35.007231+0000","last_peered":"2023-12-19T19:01:35.007231+0000","last_clean":"2023-12-19T19:01:35.007231+0000","last_became_active":"2023-12-19T19:01:35.003361+0000","last_became_peered":"2023-12-19T19:01:35.003361+0000","last_unstale":"2023-12-19T19:01:35.007231+0000","last_undegraded":"2023-12-19T19:01:35.007231+0000","last_fullsized":"2023-12-19T19:01:35.007231+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:33:31.174586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.982176+0000","last_change":"2023-12-19T19:01:34.982176+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.982176+0000","last_undegraded":"2023-12-19T19:01:34.982176+0000","last_fullsized":"2023-12-19T19:01:34.982176+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007180+0000","last_change":"2023-12-19T19:01:35.002668+0000","last_active":"2023-12-19T19:01:35.007180+0000","last_peered":"2023-12-19T19:01:35.007180+0000","last_clean":"2023-12-19T19:01:35.007180+0000","last_became_active":"2023-12-19T19:01:35.002367+0000","last_became_peered":"2023-12-19T19:01:35.002367+0000","last_unstale":"2023-12-19T19:01:35.007180+0000","last_undegraded":"2023-12-19T19:01:35.007180+0000","last_fullsized":"2023-12-19T19:01:35.007180+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:29.601572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984524+0000","last_change":"2023-12-19T19:01:34.984524+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984524+0000","last_undegraded":"2023-12-19T19:01:34.984524+0000","last_fullsized":"2023-12-19T19:01:34.984524+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.005100+0000","last_change":"2023-12-19T19:01:34.997430+0000","last_active":"2023-12-19T19:01:35.005100+0000","last_peered":"2023-12-19T19:01:35.005100+0000","last_clean":"2023-12-19T19:01:35.005100+0000","last_became_active":"2023-12-19T19:01:34.997110+0000","last_became_peered":"2023-12-19T19:01:34.997110+0000","last_unstale":"2023-12-19T19:01:35.005100+0000","last_undegraded":"2023-12-19T19:01:35.005100+0000","last_fullsized":"2023-12-19T19:01:35.005100+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:23:24.843750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.981922+0000","last_change":"2023-12-19T19:01:34.981922+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.981922+0000","last_undegraded":"2023-12-19T19:01:34.981922+0000","last_fullsized":"2023-12-19T19:01:34.981922+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:34.992237+0000","last_change":"2023-12-19T19:01:34.987868+0000","last_active":"2023-12-19T19:01:34.992237+0000","last_peered":"2023-12-19T19:01:34.992237+0000","last_clean":"2023-12-19T19:01:34.992237+0000","last_became_active":"2023-12-19T19:01:34.987545+0000","last_became_peered":"2023-12-19T19:01:34.987545+0000","last_unstale":"2023-12-19T19:01:34.992237+0000","last_undegraded":"2023-12-19T19:01:34.992237+0000","last_fullsized":"2023-12-19T19:01:34.992237+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:37:03.677408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980097+0000","last_change":"2023-12-19T19:01:34.980097+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980097+0000","last_undegraded":"2023-12-19T19:01:34.980097+0000","last_fullsized":"2023-12-19T19:01:34.980097+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.001401+0000","last_change":"2023-12-19T19:01:34.994756+0000","last_active":"2023-12-19T19:01:35.001401+0000","last_peered":"2023-12-19T19:01:35.001401+0000","last_clean":"2023-12-19T19:01:35.001401+0000","last_became_active":"2023-12-19T19:01:34.994476+0000","last_became_peered":"2023-12-19T19:01:34.994476+0000","last_unstale":"2023-12-19T19:01:35.001401+0000","last_undegraded":"2023-12-19T19:01:35.001401+0000","last_fullsized":"2023-12-19T19:01:35.001401+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:36.470347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.977480+0000","last_change":"2023-12-19T19:01:34.977480+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.977480+0000","last_undegraded":"2023-12-19T19:01:34.977480+0000","last_fullsized":"2023-12-19T19:01:34.977480+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.006124+0000","last_change":"2023-12-19T19:01:35.002999+0000","last_active":"2023-12-19T19:01:35.006124+0000","last_peered":"2023-12-19T19:01:35.006124+0000","last_clean":"2023-12-19T19:01:35.006124+0000","last_became_active":"2023-12-19T19:01:35.002667+0000","last_became_peered":"2023-12-19T19:01:35.002667+0000","last_unstale":"2023-12-19T19:01:35.006124+0000","last_undegraded":"2023-12-19T19:01:35.006124+0000","last_fullsized":"2023-12-19T19:01:35.006124+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:31.382424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.977484+0000","last_change":"2023-12-19T19:01:34.977484+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.977484+0000","last_undegraded":"2023-12-19T19:01:34.977484+0000","last_fullsized":"2023-12-19T19:01:34.977484+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:34.997990+0000","last_change":"2023-12-19T19:01:34.993756+0000","last_active":"2023-12-19T19:01:34.997990+0000","last_peered":"2023-12-19T19:01:34.997990+0000","last_clean":"2023-12-19T19:01:34.997990+0000","last_became_active":"2023-12-19T19:01:34.993466+0000","last_became_peered":"2023-12-19T19:01:34.993466+0000","last_unstale":"2023-12-19T19:01:34.997990+0000","last_undegraded":"2023-12-19T19:01:34.997990+0000","last_fullsized":"2023-12-19T19:01:34.997990+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:46:31.394472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980284+0000","last_change":"2023-12-19T19:01:34.980284+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980284+0000","last_undegraded":"2023-12-19T19:01:34.980284+0000","last_fullsized":"2023-12-19T19:01:34.980284+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007112+0000","last_change":"2023-12-19T19:01:35.001602+0000","last_active":"2023-12-19T19:01:35.007112+0000","last_peered":"2023-12-19T19:01:35.007112+0000","last_clean":"2023-12-19T19:01:35.007112+0000","last_became_active":"2023-12-19T19:01:35.000999+0000","last_became_peered":"2023-12-19T19:01:35.000999+0000","last_unstale":"2023-12-19T19:01:35.007112+0000","last_undegraded":"2023-12-19T19:01:35.007112+0000","last_fullsized":"2023-12-19T19:01:35.007112+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:32.294680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.992557+0000","last_change":"2023-12-19T19:01:34.992557+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.992557+0000","last_undegraded":"2023-12-19T19:01:34.992557+0000","last_fullsized":"2023-12-19T19:01:34.992557+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.003716+0000","last_change":"2023-12-19T19:01:34.999856+0000","last_active":"2023-12-19T19:01:35.003716+0000","last_peered":"2023-12-19T19:01:35.003716+0000","last_clean":"2023-12-19T19:01:35.003716+0000","last_became_active":"2023-12-19T19:01:34.999581+0000","last_became_peered":"2023-12-19T19:01:34.999581+0000","last_unstale":"2023-12-19T19:01:35.003716+0000","last_undegraded":"2023-12-19T19:01:35.003716+0000","last_fullsized":"2023-12-19T19:01:35.003716+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:13:22.016658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984072+0000","last_change":"2023-12-19T19:01:34.984072+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984072+0000","last_undegraded":"2023-12-19T19:01:34.984072+0000","last_fullsized":"2023-12-19T19:01:34.984072+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.000194+0000","last_change":"2023-12-19T19:01:34.992936+0000","last_active":"2023-12-19T19:01:35.000194+0000","last_peered":"2023-12-19T19:01:35.000194+0000","last_clean":"2023-12-19T19:01:35.000194+0000","last_became_active":"2023-12-19T19:01:34.992664+0000","last_became_peered":"2023-12-19T19:01:34.992664+0000","last_unstale":"2023-12-19T19:01:35.000194+0000","last_undegraded":"2023-12-19T19:01:35.000194+0000","last_fullsized":"2023-12-19T19:01:35.000194+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:06:56.928069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.982629+0000","last_change":"2023-12-19T19:01:34.982629+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.982629+0000","last_undegraded":"2023-12-19T19:01:34.982629+0000","last_fullsized":"2023-12-19T19:01:34.982629+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.003526+0000","last_change":"2023-12-19T19:01:35.000039+0000","last_active":"2023-12-19T19:01:35.003526+0000","last_peered":"2023-12-19T19:01:35.003526+0000","last_clean":"2023-12-19T19:01:35.003526+0000","last_became_active":"2023-12-19T19:01:34.999745+0000","last_became_peered":"2023-12-19T19:01:34.999745+0000","last_unstale":"2023-12-19T19:01:35.003526+0000","last_undegraded":"2023-12-19T19:01:35.003526+0000","last_fullsized":"2023-12-19T19:01:35.003526+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:53:02.681430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.985896+0000","last_change":"2023-12-19T19:01:34.985896+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.985896+0000","last_undegraded":"2023-12-19T19:01:34.985896+0000","last_fullsized":"2023-12-19T19:01:34.985896+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.000765+0000","last_change":"2023-12-19T19:01:34.996284+0000","last_active":"2023-12-19T19:01:35.000765+0000","last_peered":"2023-12-19T19:01:35.000765+0000","last_clean":"2023-12-19T19:01:35.000765+0000","last_became_active":"2023-12-19T19:01:34.996012+0000","last_became_peered":"2023-12-19T19:01:34.996012+0000","last_unstale":"2023-12-19T19:01:35.000765+0000","last_undegraded":"2023-12-19T19:01:35.000765+0000","last_fullsized":"2023-12-19T19:01:35.000765+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:33:03.964283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.979228+0000","last_change":"2023-12-19T19:01:34.979228+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.979228+0000","last_undegraded":"2023-12-19T19:01:34.979228+0000","last_fullsized":"2023-12-19T19:01:34.979228+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.006709+0000","last_change":"2023-12-19T19:01:35.002482+0000","last_active":"2023-12-19T19:01:35.006709+0000","last_peered":"2023-12-19T19:01:35.006709+0000","last_clean":"2023-12-19T19:01:35.006709+0000","last_became_active":"2023-12-19T19:01:35.002110+0000","last_became_peered":"2023-12-19T19:01:35.002110+0000","last_unstale":"2023-12-19T19:01:35.006709+0000","last_undegraded":"2023-12-19T19:01:35.006709+0000","last_fullsized":"2023-12-19T19:01:35.006709+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:40:40.108793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.987437+0000","last_change":"2023-12-19T19:01:34.987437+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.987437+0000","last_undegraded":"2023-12-19T19:01:34.987437+0000","last_fullsized":"2023-12-19T19:01:34.987437+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.001612+0000","last_change":"2023-12-19T19:01:34.997069+0000","last_active":"2023-12-19T19:01:35.001612+0000","last_peered":"2023-12-19T19:01:35.001612+0000","last_clean":"2023-12-19T19:01:35.001612+0000","last_became_active":"2023-12-19T19:01:34.996756+0000","last_became_peered":"2023-12-19T19:01:34.996756+0000","last_unstale":"2023-12-19T19:01:35.001612+0000","last_undegraded":"2023-12-19T19:01:35.001612+0000","last_fullsized":"2023-12-19T19:01:35.001612+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:35.546701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.986763+0000","last_change":"2023-12-19T19:01:34.986763+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.986763+0000","last_undegraded":"2023-12-19T19:01:34.986763+0000","last_fullsized":"2023-12-19T19:01:34.986763+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:34.997281+0000","last_change":"2023-12-19T19:01:34.989700+0000","last_active":"2023-12-19T19:01:34.997281+0000","last_peered":"2023-12-19T19:01:34.997281+0000","last_clean":"2023-12-19T19:01:34.997281+0000","last_became_active":"2023-12-19T19:01:34.989417+0000","last_became_peered":"2023-12-19T19:01:34.989417+0000","last_unstale":"2023-12-19T19:01:34.997281+0000","last_undegraded":"2023-12-19T19:01:34.997281+0000","last_fullsized":"2023-12-19T19:01:34.997281+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:06:45.607378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980782+0000","last_change":"2023-12-19T19:01:34.980782+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980782+0000","last_undegraded":"2023-12-19T19:01:34.980782+0000","last_fullsized":"2023-12-19T19:01:34.980782+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:34.992101+0000","last_change":"2023-12-19T19:01:34.986750+0000","last_active":"2023-12-19T19:01:34.992101+0000","last_peered":"2023-12-19T19:01:34.992101+0000","last_clean":"2023-12-19T19:01:34.992101+0000","last_became_active":"2023-12-19T19:01:34.986455+0000","last_became_peered":"2023-12-19T19:01:34.986455+0000","last_unstale":"2023-12-19T19:01:34.992101+0000","last_undegraded":"2023-12-19T19:01:34.992101+0000","last_fullsized":"2023-12-19T19:01:34.992101+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:01:50.322532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.989455+0000","last_change":"2023-12-19T19:01:34.989455+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.989455+0000","last_undegraded":"2023-12-19T19:01:34.989455+0000","last_fullsized":"2023-12-19T19:01:34.989455+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007075+0000","last_change":"2023-12-19T19:01:35.001204+0000","last_active":"2023-12-19T19:01:35.007075+0000","last_peered":"2023-12-19T19:01:35.007075+0000","last_clean":"2023-12-19T19:01:35.007075+0000","last_became_active":"2023-12-19T19:01:35.000589+0000","last_became_peered":"2023-12-19T19:01:35.000589+0000","last_unstale":"2023-12-19T19:01:35.007075+0000","last_undegraded":"2023-12-19T19:01:35.007075+0000","last_fullsized":"2023-12-19T19:01:35.007075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:48:27.490312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.983538+0000","last_change":"2023-12-19T19:01:34.983538+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.983538+0000","last_undegraded":"2023-12-19T19:01:34.983538+0000","last_fullsized":"2023-12-19T19:01:34.983538+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.005497+0000","last_change":"2023-12-19T19:01:34.999664+0000","last_active":"2023-12-19T19:01:35.005497+0000","last_peered":"2023-12-19T19:01:35.005497+0000","last_clean":"2023-12-19T19:01:35.005497+0000","last_became_active":"2023-12-19T19:01:34.998997+0000","last_became_peered":"2023-12-19T19:01:34.998997+0000","last_unstale":"2023-12-19T19:01:35.005497+0000","last_undegraded":"2023-12-19T19:01:35.005497+0000","last_fullsized":"2023-12-19T19:01:35.005497+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:38:15.768063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.985453+0000","last_change":"2023-12-19T19:01:34.985453+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.985453+0000","last_undegraded":"2023-12-19T19:01:34.985453+0000","last_fullsized":"2023-12-19T19:01:34.985453+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:34.994967+0000","last_change":"2023-12-19T19:01:34.990870+0000","last_active":"2023-12-19T19:01:34.994967+0000","last_peered":"2023-12-19T19:01:34.994967+0000","last_clean":"2023-12-19T19:01:34.994967+0000","last_became_active":"2023-12-19T19:01:34.990513+0000","last_became_peered":"2023-12-19T19:01:34.990513+0000","last_unstale":"2023-12-19T19:01:34.994967+0000","last_undegraded":"2023-12-19T19:01:34.994967+0000","last_fullsized":"2023-12-19T19:01:34.994967+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:27:03.813755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.984415+0000","last_change":"2023-12-19T19:01:34.984415+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.984415+0000","last_undegraded":"2023-12-19T19:01:34.984415+0000","last_fullsized":"2023-12-19T19:01:34.984415+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.001199+0000","last_change":"2023-12-19T19:01:34.994259+0000","last_active":"2023-12-19T19:01:35.001199+0000","last_peered":"2023-12-19T19:01:35.001199+0000","last_clean":"2023-12-19T19:01:35.001199+0000","last_became_active":"2023-12-19T19:01:34.992784+0000","last_became_peered":"2023-12-19T19:01:34.992784+0000","last_unstale":"2023-12-19T19:01:35.001199+0000","last_undegraded":"2023-12-19T19:01:35.001199+0000","last_fullsized":"2023-12-19T19:01:35.001199+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:32.294680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.980169+0000","last_change":"2023-12-19T19:01:34.980169+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.980169+0000","last_undegraded":"2023-12-19T19:01:34.980169+0000","last_fullsized":"2023-12-19T19:01:34.980169+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.007161+0000","last_change":"2023-12-19T19:01:35.001846+0000","last_active":"2023-12-19T19:01:35.007161+0000","last_peered":"2023-12-19T19:01:35.007161+0000","last_clean":"2023-12-19T19:01:35.007161+0000","last_became_active":"2023-12-19T19:01:35.000362+0000","last_became_peered":"2023-12-19T19:01:35.000362+0000","last_unstale":"2023-12-19T19:01:35.007161+0000","last_undegraded":"2023-12-19T19:01:35.007161+0000","last_fullsized":"2023-12-19T19:01:35.007161+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:56:11.163857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.991560+0000","last_change":"2023-12-19T19:01:34.991560+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.991560+0000","last_undegraded":"2023-12-19T19:01:34.991560+0000","last_fullsized":"2023-12-19T19:01:34.991560+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.005088+0000","last_change":"2023-12-19T19:01:34.998108+0000","last_active":"2023-12-19T19:01:35.005088+0000","last_peered":"2023-12-19T19:01:35.005088+0000","last_clean":"2023-12-19T19:01:35.005088+0000","last_became_active":"2023-12-19T19:01:34.997738+0000","last_became_peered":"2023-12-19T19:01:34.997738+0000","last_unstale":"2023-12-19T19:01:35.005088+0000","last_undegraded":"2023-12-19T19:01:35.005088+0000","last_fullsized":"2023-12-19T19:01:35.005088+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:48:27.490312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":67,"state":"creating+peering","last_fresh":"2023-12-19T19:01:34.977470+0000","last_change":"2023-12-19T19:01:34.977470+0000","last_active":"2023-12-19T19:01:34.962160+0000","last_peered":"2023-12-19T19:01:34.962160+0000","last_clean":"2023-12-19T19:01:34.962160+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T19:01:34.977470+0000","last_undegraded":"2023-12-19T19:01:34.977470+0000","last_fullsized":"2023-12-19T19:01:34.977470+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.002980+0000","last_change":"2023-12-19T19:01:34.999764+0000","last_active":"2023-12-19T19:01:35.002980+0000","last_peered":"2023-12-19T19:01:35.002980+0000","last_clean":"2023-12-19T19:01:35.002980+0000","last_became_active":"2023-12-19T19:01:34.998931+0000","last_became_peered":"2023-12-19T19:01:34.998931+0000","last_unstale":"2023-12-19T19:01:35.002980+0000","last_undegraded":"2023-12-19T19:01:35.002980+0000","last_fullsized":"2023-12-19T19:01:35.002980+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:46:31.394472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":213,"reported_epoch":66,"state":"active+clean","last_fresh":"2023-12-19T19:01:33.964823+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T19:01:33.964823+0000","last_peered":"2023-12-19T19:01:33.964823+0000","last_clean":"2023-12-19T19:01:33.964823+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T19:01:33.964823+0000","last_undegraded":"2023-12-19T19:01:33.964823+0000","last_fullsized":"2023-12-19T19:01:33.964823+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1384,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1417216,"data_stored":947389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.68899999999999995},"min":{"1min":0.44,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92500000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.72399999999999998},"min":{"1min":0.50700000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89300000000000002,"5min":1.117,"15min":1.117},"last":0.89300000000000002}]},{"osd":1,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.46700000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83899999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.751},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83399999999999996,"5min":1.01,"15min":1.01},"last":0.82099999999999995}]},{"osd":2,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85499999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.58299999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89500000000000002,"5min":1.089,"15min":1.089},"last":0.80300000000000005}]},{"osd":3,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71299999999999997,"15min":0.72699999999999998},"min":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90900000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73299999999999998,"15min":0.73499999999999999},"min":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91600000000000004,"5min":1.026,"15min":1.026},"last":0.86899999999999999}]},{"osd":4,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64400000000000002,"15min":0.65600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88500000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66700000000000004,"15min":0.67400000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93799999999999994,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.66500000000000004}]},{"osd":5,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93200000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.623},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.70599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91500000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.60799999999999998}]},{"osd":6,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.96799999999999997,"5min":1.069,"15min":1.069},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78000000000000003,"15min":0.79600000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.77800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":357021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.98899999999999999,"5min":1.022,"15min":1.022},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.89800000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.89800000000000002}]},{"osd":1,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67100000000000004,"15min":0.65700000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.871,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.871},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.52300000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91500000000000004,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.81899999999999995}]},{"osd":2,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.443,"5min":0.437,"15min":0.437},"max":{"1min":0.96299999999999997,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.745,"5min":0.71999999999999997,"15min":0.71699999999999997},"min":{"1min":0.58099999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94899999999999995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.94899999999999995}]},{"osd":3,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83499999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72199999999999998,"15min":0.72699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91900000000000004,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.91900000000000004}]},{"osd":4,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.48599999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.74099999999999999,"15min":0.755},"min":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95999999999999996,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.60999999999999999}]},{"osd":5,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.93700000000000006,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73199999999999998,"15min":0.73599999999999999},"min":{"1min":0.54600000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.65800000000000003}]},{"osd":7,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.52800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.63600000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":350746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.90500000000000003,"15min":0.94899999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0880000000000001,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":1.3420000000000001,"15min":1.452},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1180000000000001,"5min":16.951000000000001,"15min":16.951000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":1.411,"15min":1.5429999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0700000000000001,"5min":19.823,"15min":19.823},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.44500000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.216,"5min":1.657,"15min":1.657},"last":0.77300000000000002}]},{"osd":2,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.74199999999999999,"15min":0.755},"min":{"1min":0.48799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.163,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1020000000000001,"5min":1.585,"15min":1.585},"last":0.66600000000000004}]},{"osd":3,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.78000000000000003,"15min":0.79100000000000004},"min":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0589999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.97299999999999998,"15min":1.0149999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0740000000000001,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":0.79000000000000004}]},{"osd":4,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.45200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0049999999999999,"5min":1.716,"15min":1.716},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.504,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97899999999999998,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":0.59499999999999997}]},{"osd":6,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.82799999999999996,"15min":0.85099999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.86599999999999999,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.82999999999999996,"15min":0.84599999999999997},"min":{"1min":0.51100000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90600000000000003,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.83099999999999996}]},{"osd":7,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82899999999999996,"15min":0.83899999999999997},"min":{"1min":0.60599999999999998,"5min":0.498,"15min":0.498},"max":{"1min":1.0900000000000001,"5min":2.371,"15min":2.371},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0369999999999999,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.84999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":357021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.84299999999999997,"15min":0.875},"min":{"1min":0.46800000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86899999999999999,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68600000000000005,"15min":0.69399999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.78500000000000003,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.66900000000000004}]},{"osd":1,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69899999999999995,"15min":0.70299999999999996},"min":{"1min":0.51800000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88200000000000001,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.79200000000000004,"15min":0.80700000000000005},"min":{"1min":0.56699999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.94599999999999995,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":0.86399999999999999}]},{"osd":2,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69199999999999995,"15min":0.69299999999999995},"min":{"1min":0.53800000000000003,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.91300000000000003,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.80300000000000005,"15min":0.81999999999999995},"min":{"1min":0.56000000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.88,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.751}]},{"osd":3,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.82399999999999995,"15min":0.84999999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.84999999999999998,"5min":3.641,"15min":3.641},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.872,"15min":0.89800000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.85399999999999998,"5min":3.194,"15min":3.194},"last":0.73899999999999999}]},{"osd":5,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":1.0269999999999999,"15min":1.089},"min":{"1min":0.42699999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0449999999999999,"5min":9.3040000000000003,"15min":9.3040000000000003},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.71999999999999997,"15min":0.73999999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.94099999999999995,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.84499999999999997}]},{"osd":6,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.81799999999999995,"15min":0.84199999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.97699999999999998,"5min":3.097,"15min":3.097},"last":0.88},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.86599999999999999,"15min":0.89100000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97899999999999998,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.89700000000000002}]},{"osd":7,"last update":"Tue Dec 19 19:00:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.94199999999999995,"15min":0.97999999999999998},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0409999999999999,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.73899999999999999,"5min":1.0289999999999999,"15min":1.077},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.98699999999999999,"5min":6.3449999999999998,"15min":6.3449999999999998},"last":0.79800000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":357021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72699999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.36099999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.41299999999999998}]},{"osd":1,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46700000000000003,"15min":0.48499999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60699999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.64300000000000002}]},{"osd":2,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.74299999999999999,"5min":0.75,"15min":0.75},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.54700000000000004},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77600000000000002,"5min":0.875,"15min":0.875},"last":0.432}]},{"osd":4,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88400000000000001,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98999999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.61299999999999999}]},{"osd":5,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.50600000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94999999999999996,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.752,"15min":0.77000000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.04,"5min":1.202,"15min":1.202},"last":0.59799999999999998}]},{"osd":6,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96399999999999997,"5min":1.298,"15min":1.298},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.98299999999999998,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.68899999999999995}]},{"osd":7,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94999999999999996,"5min":1.155,"15min":1.155},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93000000000000005,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.66400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":823296,"data_stored":357021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.497,"15min":0.50700000000000001},"min":{"1min":0.313,"5min":0.31,"15min":0.31},"max":{"1min":0.57899999999999996,"5min":1.458,"15min":1.458},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.61499999999999999,"15min":0.63700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.627,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.373}]},{"osd":1,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.57899999999999996,"15min":0.59899999999999998},"min":{"1min":0.36099999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.58499999999999996,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.60399999999999998,"15min":0.624},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.61799999999999999,"5min":2.444,"15min":2.444},"last":0.44600000000000001}]},{"osd":3,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.59599999999999997,"15min":0.62},"min":{"1min":0.33700000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.65300000000000002,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.625,"15min":0.64300000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.69199999999999995,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.46300000000000002}]},{"osd":4,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.93899999999999995,"15min":0.97499999999999998},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.94399999999999995,"5min":1.968,"15min":1.968},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.89500000000000002,"15min":0.92500000000000004},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.90700000000000003,"5min":2.835,"15min":2.835},"last":0.72799999999999998}]},{"osd":5,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.91600000000000004,"15min":0.94999999999999996},"min":{"1min":0.56000000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.94599999999999995,"5min":3.5,"15min":3.5},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.91100000000000003,"15min":0.93999999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.99099999999999999,"5min":1.996,"15min":1.996},"last":0.60799999999999998}]},{"osd":6,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.91200000000000003,"15min":0.94699999999999995},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.97599999999999998,"5min":2.903,"15min":2.903},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.99199999999999999,"15min":1.034},"min":{"1min":0.53700000000000003,"5min":0.498,"15min":0.498},"max":{"1min":0.92800000000000005,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.63700000000000001}]},{"osd":7,"last update":"Tue Dec 19 19:00:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.94999999999999996,"15min":0.98599999999999999},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.0049999999999999,"5min":2.875,"15min":2.875},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.94299999999999995,"15min":0.98099999999999998},"min":{"1min":0.59399999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.91900000000000004,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.752}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":357021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.55200000000000005,"15min":0.58099999999999996},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.51600000000000001,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.309},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.748,"15min":0.80100000000000005},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.70399999999999996,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.503}]},{"osd":2,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.57199999999999995,"15min":0.59599999999999997},"min":{"1min":0.316,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.63,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.65600000000000003,"15min":0.68899999999999995},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.65300000000000002,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.46100000000000002}]},{"osd":3,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.79300000000000004,"15min":0.84199999999999997},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.629,"5min":7.8399999999999999,"15min":7.8399999999999999},"last":0.436},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.81200000000000006,"15min":0.85999999999999999},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72499999999999998,"5min":7.7949999999999999,"15min":7.7949999999999999},"last":0.52700000000000002}]},{"osd":4,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.86799999999999999,"15min":0.89900000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0900000000000001,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.89900000000000002,"15min":0.93000000000000005},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0289999999999999,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.66700000000000004}]},{"osd":5,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.879,"15min":0.90900000000000003},"min":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92600000000000005,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.627},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.88500000000000001,"15min":0.91800000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.98899999999999999,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.71199999999999997}]},{"osd":6,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.88300000000000001,"15min":0.90800000000000003},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94699999999999995,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.93100000000000005,"15min":0.96899999999999997},"min":{"1min":0.53900000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0469999999999999,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.68600000000000005}]},{"osd":7,"last update":"Tue Dec 19 19:00:33 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.93600000000000005,"15min":0.96799999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1180000000000001,"5min":4.3310000000000004,"15min":4.3310000000000004},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.89200000000000002,"15min":0.92000000000000004},"min":{"1min":0.55200000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.97599999999999998,"5min":4.226,"15min":4.226},"last":0.83299999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32560,"kb_used_data":1380,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339280,"statfs":{"total":96636764160,"available":96603422720,"internally_reserved":0,"allocated":1413120,"data_stored":946370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.436,"15min":0.44800000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60299999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48899999999999999,"15min":0.503},"min":{"1min":0.29799999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65700000000000003,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.41599999999999998}]},{"osd":2,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.50600000000000001,"15min":0.51300000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63700000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.5},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.51100000000000001},"min":{"1min":0.40799999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.372}]},{"osd":3,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48199999999999998,"15min":0.48699999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.55900000000000005,"5min":0.747,"15min":0.747},"last":0.441},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.57799999999999996,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69299999999999995,"5min":1.264,"15min":1.264},"last":0.46200000000000002}]},{"osd":4,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.74199999999999999,"15min":0.748},"min":{"1min":0.502,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93999999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89900000000000002,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.77400000000000002}]},{"osd":5,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.749},"min":{"1min":0.57299999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.89300000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79200000000000004,"15min":0.81699999999999995},"min":{"1min":0.57199999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.91000000000000003,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.71799999999999997}]},{"osd":6,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.79600000000000004,"15min":0.82499999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92600000000000005,"5min":1.349,"15min":1.349},"last":0.745},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0189999999999999,"5min":1.115,"15min":1.115},"last":0.69599999999999995}]},{"osd":7,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.57499999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94899999999999995,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.79200000000000004,"15min":0.81200000000000006},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.93200000000000005,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.81000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T19:01:41.722 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T19:01:41.726 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T19:01:44.680 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T19:01:44.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.824+0000 7f0fb6d57640 1 Processor -- start 2023-12-19T19:01:44.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.824+0000 7f0fb6d57640 1 -- start start 2023-12-19T19:01:44.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.824+0000 7f0fb6d57640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f0fb00c5260 0x7f0fb006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:44.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.824+0000 7f0fb6d57640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb00c2580 con 0x7f0fb0155de0 2023-12-19T19:01:44.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.824+0000 7f0fb6d57640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb0156940 con 0x7f0fb00c5640 2023-12-19T19:01:44.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.824+0000 7f0fb6d57640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fb0153510 con 0x7f0fb00c5260 2023-12-19T19:01:44.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.824+0000 7f0fb52f4640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0fb0155de0 0x7f0fb0156230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42404/0 (socket says 172.21.15.133:42404) 2023-12-19T19:01:44.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.824+0000 7f0fb52f4640 1 -- 172.21.15.133:0/1262469501 learned_addr learned my addr 172.21.15.133:0/1262469501 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:44.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.824+0000 7f0fb4af3640 1 --2- 172.21.15.133:0/1262469501 >> v2:172.21.15.138:3300/0 conn(0x7f0fb00c5260 0x7f0fb006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:44.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.824+0000 7f0faf7fe640 1 -- 172.21.15.133:0/1262469501 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185647935 0 0) 0x7f0fb00c2580 con 0x7f0fb0155de0 2023-12-19T19:01:44.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.824+0000 7f0faf7fe640 1 -- 172.21.15.133:0/1262469501 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fa0003530 con 0x7f0fb0155de0 2023-12-19T19:01:44.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.824+0000 7f0fb4af3640 1 -- 172.21.15.133:0/1262469501 >> v1:172.21.15.138:6789/0 conn(0x7f0fb00c5640 legacy=0x7f0fb00c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:44.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.824+0000 7f0fb4af3640 1 -- 172.21.15.133:0/1262469501 >> v1:172.21.15.133:6789/0 conn(0x7f0fb0155de0 legacy=0x7f0fb0156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:44.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.824+0000 7f0fb4af3640 1 -- 172.21.15.133:0/1262469501 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb00c1a00 con 0x7f0fb00c5260 2023-12-19T19:01:44.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.828+0000 7f0fb4af3640 1 --2- 172.21.15.133:0/1262469501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fb00c5260 0x7f0fb006d5b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40097c0 tx=0x7f0fa401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39e8bd2f5616bcee server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:44.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.828+0000 7f0faf7fe640 1 -- 172.21.15.133:0/1262469501 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa40ab600 con 0x7f0fb00c5260 2023-12-19T19:01:44.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.828+0000 7f0faf7fe640 1 -- 172.21.15.133:0/1262469501 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa40a7050 con 0x7f0fb00c5260 2023-12-19T19:01:44.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.828+0000 7f0faf7fe640 1 -- 172.21.15.133:0/1262469501 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa40ab980 con 0x7f0fb00c5260 2023-12-19T19:01:44.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.828+0000 7f0fb6d57640 1 -- 172.21.15.133:0/1262469501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fb00c5260 msgr2=0x7f0fb006d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:44.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.828+0000 7f0fb6d57640 1 --2- 172.21.15.133:0/1262469501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fb00c5260 0x7f0fb006d5b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40097c0 tx=0x7f0fa401c3f0 comp rx=0 tx=0).stop 2023-12-19T19:01:44.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.828+0000 7f0fb6d57640 1 -- 172.21.15.133:0/1262469501 shutdown_connections 2023-12-19T19:01:44.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.828+0000 7f0fb6d57640 1 --2- 172.21.15.133:0/1262469501 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fb00c5260 0x7f0fb006d5b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:44.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.828+0000 7f0fb6d57640 1 -- 172.21.15.133:0/1262469501 >> 172.21.15.133:0/1262469501 conn(0x7f0fb006a5b0 msgr2=0x7f0fb006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:44.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.828+0000 7f0fb6d57640 1 -- 172.21.15.133:0/1262469501 shutdown_connections 2023-12-19T19:01:44.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.828+0000 7f0fb6d57640 1 -- 172.21.15.133:0/1262469501 wait complete. 2023-12-19T19:01:44.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0fb6d57640 1 Processor -- start 2023-12-19T19:01:44.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0fb6d57640 1 -- start start 2023-12-19T19:01:44.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0fb6d57640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fb00c5260 0x7f0fb0153ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:44.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0fb6d57640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fb00c5640 0x7f0fb00a9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:44.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0fb6d57640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fb0155de0 0x7f0fb00a9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:44.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0fb6d57640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb0152980 con 0x7f0fb00c5640 2023-12-19T19:01:44.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0fb6d57640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb01ee0f0 con 0x7f0fb0155de0 2023-12-19T19:01:44.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0fb6d57640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb00a8b70 con 0x7f0fb00c5260 2023-12-19T19:01:44.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0faffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fb00c5640 0x7f0fb00a9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:44.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0faffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fb00c5640 0x7f0fb00a9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58330/0 (socket says 172.21.15.133:58330) 2023-12-19T19:01:44.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0faffff640 1 -- 172.21.15.133:0/663363072 learned_addr learned my addr 172.21.15.133:0/663363072 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:44.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0fb52f4640 1 --2- 172.21.15.133:0/663363072 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fb0155de0 0x7f0fb00a9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:44.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0fb4af3640 1 --2- 172.21.15.133:0/663363072 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fb00c5260 0x7f0fb0153ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:44.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0faffff640 1 -- 172.21.15.133:0/663363072 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fb00c5260 msgr2=0x7f0fb0153ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:44.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0faffff640 1 --2- 172.21.15.133:0/663363072 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fb00c5260 0x7f0fb0153ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:44.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0faffff640 1 -- 172.21.15.133:0/663363072 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fb0155de0 msgr2=0x7f0fb00a9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:44.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0faffff640 1 --2- 172.21.15.133:0/663363072 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fb0155de0 0x7f0fb00a9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:44.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0faffff640 1 -- 172.21.15.133:0/663363072 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa4009420 con 0x7f0fb00c5640 2023-12-19T19:01:44.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0faffff640 1 --2- 172.21.15.133:0/663363072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fb00c5640 0x7f0fb00a9fc0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00c390 tx=0x7f0f9c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:44.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0fad7fa640 1 -- 172.21.15.133:0/663363072 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c0052d0 con 0x7f0fb00c5640 2023-12-19T19:01:44.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0fad7fa640 1 -- 172.21.15.133:0/663363072 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c005430 con 0x7f0fb00c5640 2023-12-19T19:01:44.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0fad7fa640 1 -- 172.21.15.133:0/663363072 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c003820 con 0x7f0fb00c5640 2023-12-19T19:01:44.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0fb6d57640 1 -- 172.21.15.133:0/663363072 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb01ed180 con 0x7f0fb00c5640 2023-12-19T19:01:44.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0fb6d57640 1 -- 172.21.15.133:0/663363072 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb01ed740 con 0x7f0fb00c5640 2023-12-19T19:01:44.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.832+0000 7f0fb6d57640 1 -- 172.21.15.133:0/663363072 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb0068400 con 0x7f0fb00c5640 2023-12-19T19:01:44.840 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.836+0000 7f0fad7fa640 1 -- 172.21.15.133:0/663363072 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0f9c003980 con 0x7f0fb00c5640 2023-12-19T19:01:44.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.836+0000 7f0fad7fa640 1 --2- 172.21.15.133:0/663363072 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0f94066470 0x7f0f94068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:44.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.836+0000 7f0fad7fa640 1 -- 172.21.15.133:0/663363072 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f9c083320 con 0x7f0fb00c5640 2023-12-19T19:01:44.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.836+0000 7f0fb4af3640 1 --2- 172.21.15.133:0/663363072 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0f94066470 0x7f0f94068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:44.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.836+0000 7f0fb4af3640 1 --2- 172.21.15.133:0/663363072 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0f94066470 0x7f0f94068930 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40ad000 tx=0x7f0fa40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:44.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.840+0000 7f0fad7fa640 1 -- 172.21.15.133:0/663363072 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0f9c050840 con 0x7f0fb00c5640 2023-12-19T19:01:44.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.988+0000 7f0fb6d57640 1 -- 172.21.15.133:0/663363072 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0fb00c6c50 con 0x7f0f94066470 2023-12-19T19:01:45.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:44.996+0000 7f0fad7fa640 1 -- 172.21.15.133:0/663363072 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289565 (secure 0 0 0) 0x7f0fb00c6c50 con 0x7f0f94066470 2023-12-19T19:01:45.006 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:45.007 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T19:01:45.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.000+0000 7f0fb6d57640 1 -- 172.21.15.133:0/663363072 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0f94066470 msgr2=0x7f0f94068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:45.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.000+0000 7f0fb6d57640 1 --2- 172.21.15.133:0/663363072 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0f94066470 0x7f0f94068930 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0fa40ad000 tx=0x7f0fa40a6000 comp rx=0 tx=0).stop 2023-12-19T19:01:45.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.000+0000 7f0fb6d57640 1 -- 172.21.15.133:0/663363072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fb00c5640 msgr2=0x7f0fb00a9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:45.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.000+0000 7f0fb6d57640 1 --2- 172.21.15.133:0/663363072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fb00c5640 0x7f0fb00a9fc0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00c390 tx=0x7f0f9c00c850 comp rx=0 tx=0).stop 2023-12-19T19:01:45.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.000+0000 7f0fb6d57640 1 -- 172.21.15.133:0/663363072 shutdown_connections 2023-12-19T19:01:45.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.000+0000 7f0fb6d57640 1 --2- 172.21.15.133:0/663363072 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0f94066470 0x7f0f94068930 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.000+0000 7f0fb6d57640 1 --2- 172.21.15.133:0/663363072 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0fb0155de0 0x7f0fb00a9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.000+0000 7f0fb6d57640 1 --2- 172.21.15.133:0/663363072 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0fb00c5640 0x7f0fb00a9fc0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.000+0000 7f0fb6d57640 1 --2- 172.21.15.133:0/663363072 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0fb00c5260 0x7f0fb0153ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.000+0000 7f0fb6d57640 1 -- 172.21.15.133:0/663363072 >> 172.21.15.133:0/663363072 conn(0x7f0fb006a5b0 msgr2=0x7f0fb014f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:45.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.000+0000 7f0fb6d57640 1 -- 172.21.15.133:0/663363072 shutdown_connections 2023-12-19T19:01:45.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.000+0000 7f0fb6d57640 1 -- 172.21.15.133:0/663363072 wait complete. 2023-12-19T19:01:45.025 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2023-12-19T19:01:44.877685+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248996,"kb_used_data":7844,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754725724,"statfs":{"total":773094113280,"available":772839141376,"internally_reserved":0,"allocated":8032256,"data_stored":4145305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":246795824},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.900300"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:37.038526+0000","last_change":"2023-12-19T19:01:35.993269+0000","last_active":"2023-12-19T19:01:37.038526+0000","last_peered":"2023-12-19T19:01:37.038526+0000","last_clean":"2023-12-19T19:01:37.038526+0000","last_became_active":"2023-12-19T19:01:35.992720+0000","last_became_peered":"2023-12-19T19:01:35.992720+0000","last_unstale":"2023-12-19T19:01:37.038526+0000","last_undegraded":"2023-12-19T19:01:37.038526+0000","last_fullsized":"2023-12-19T19:01:37.038526+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:13.026799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:38.202084+0000","last_change":"2023-12-19T19:01:36.008235+0000","last_active":"2023-12-19T19:01:38.202084+0000","last_peered":"2023-12-19T19:01:38.202084+0000","last_clean":"2023-12-19T19:01:38.202084+0000","last_became_active":"2023-12-19T19:01:36.005960+0000","last_became_peered":"2023-12-19T19:01:36.005960+0000","last_unstale":"2023-12-19T19:01:38.202084+0000","last_undegraded":"2023-12-19T19:01:38.202084+0000","last_fullsized":"2023-12-19T19:01:38.202084+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:01:48.212049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.999975+0000","last_change":"2023-12-19T19:01:35.997697+0000","last_active":"2023-12-19T19:01:36.999975+0000","last_peered":"2023-12-19T19:01:36.999975+0000","last_clean":"2023-12-19T19:01:36.999975+0000","last_became_active":"2023-12-19T19:01:35.997425+0000","last_became_peered":"2023-12-19T19:01:35.997425+0000","last_unstale":"2023-12-19T19:01:36.999975+0000","last_undegraded":"2023-12-19T19:01:36.999975+0000","last_fullsized":"2023-12-19T19:01:36.999975+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:59.952872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.997880+0000","last_change":"2023-12-19T19:01:35.997124+0000","last_active":"2023-12-19T19:01:36.997880+0000","last_peered":"2023-12-19T19:01:36.997880+0000","last_clean":"2023-12-19T19:01:36.997880+0000","last_became_active":"2023-12-19T19:01:35.996813+0000","last_became_peered":"2023-12-19T19:01:35.996813+0000","last_unstale":"2023-12-19T19:01:36.997880+0000","last_undegraded":"2023-12-19T19:01:36.997880+0000","last_fullsized":"2023-12-19T19:01:36.997880+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:26:37.197213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.999480+0000","last_change":"2023-12-19T19:01:35.994723+0000","last_active":"2023-12-19T19:01:36.999480+0000","last_peered":"2023-12-19T19:01:36.999480+0000","last_clean":"2023-12-19T19:01:36.999480+0000","last_became_active":"2023-12-19T19:01:35.994225+0000","last_became_peered":"2023-12-19T19:01:35.994225+0000","last_unstale":"2023-12-19T19:01:36.999480+0000","last_undegraded":"2023-12-19T19:01:36.999480+0000","last_fullsized":"2023-12-19T19:01:36.999480+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:16:21.875547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:38.202323+0000","last_change":"2023-12-19T19:01:35.996456+0000","last_active":"2023-12-19T19:01:38.202323+0000","last_peered":"2023-12-19T19:01:38.202323+0000","last_clean":"2023-12-19T19:01:38.202323+0000","last_became_active":"2023-12-19T19:01:35.996173+0000","last_became_peered":"2023-12-19T19:01:35.996173+0000","last_unstale":"2023-12-19T19:01:38.202323+0000","last_undegraded":"2023-12-19T19:01:38.202323+0000","last_fullsized":"2023-12-19T19:01:38.202323+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:39.334276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.997423+0000","last_change":"2023-12-19T19:01:35.991595+0000","last_active":"2023-12-19T19:01:36.997423+0000","last_peered":"2023-12-19T19:01:36.997423+0000","last_clean":"2023-12-19T19:01:36.997423+0000","last_became_active":"2023-12-19T19:01:35.991267+0000","last_became_peered":"2023-12-19T19:01:35.991267+0000","last_unstale":"2023-12-19T19:01:36.997423+0000","last_undegraded":"2023-12-19T19:01:36.997423+0000","last_fullsized":"2023-12-19T19:01:36.997423+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:15:44.155043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:38.202147+0000","last_change":"2023-12-19T19:01:36.012804+0000","last_active":"2023-12-19T19:01:38.202147+0000","last_peered":"2023-12-19T19:01:38.202147+0000","last_clean":"2023-12-19T19:01:38.202147+0000","last_became_active":"2023-12-19T19:01:36.012506+0000","last_became_peered":"2023-12-19T19:01:36.012506+0000","last_unstale":"2023-12-19T19:01:38.202147+0000","last_undegraded":"2023-12-19T19:01:38.202147+0000","last_fullsized":"2023-12-19T19:01:38.202147+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:52:57.735191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:38.202312+0000","last_change":"2023-12-19T19:01:36.008329+0000","last_active":"2023-12-19T19:01:38.202312+0000","last_peered":"2023-12-19T19:01:38.202312+0000","last_clean":"2023-12-19T19:01:38.202312+0000","last_became_active":"2023-12-19T19:01:36.007450+0000","last_became_peered":"2023-12-19T19:01:36.007450+0000","last_unstale":"2023-12-19T19:01:38.202312+0000","last_undegraded":"2023-12-19T19:01:38.202312+0000","last_fullsized":"2023-12-19T19:01:38.202312+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:52:33.062884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:37.038410+0000","last_change":"2023-12-19T19:01:36.012622+0000","last_active":"2023-12-19T19:01:37.038410+0000","last_peered":"2023-12-19T19:01:37.038410+0000","last_clean":"2023-12-19T19:01:37.038410+0000","last_became_active":"2023-12-19T19:01:36.012313+0000","last_became_peered":"2023-12-19T19:01:36.012313+0000","last_unstale":"2023-12-19T19:01:37.038410+0000","last_undegraded":"2023-12-19T19:01:37.038410+0000","last_fullsized":"2023-12-19T19:01:37.038410+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:32.200929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:38.201968+0000","last_change":"2023-12-19T19:01:36.005796+0000","last_active":"2023-12-19T19:01:38.201968+0000","last_peered":"2023-12-19T19:01:38.201968+0000","last_clean":"2023-12-19T19:01:38.201968+0000","last_became_active":"2023-12-19T19:01:36.005526+0000","last_became_peered":"2023-12-19T19:01:36.005526+0000","last_unstale":"2023-12-19T19:01:38.201968+0000","last_undegraded":"2023-12-19T19:01:38.201968+0000","last_fullsized":"2023-12-19T19:01:38.201968+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:23:25.851168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:37.038090+0000","last_change":"2023-12-19T19:01:36.004265+0000","last_active":"2023-12-19T19:01:37.038090+0000","last_peered":"2023-12-19T19:01:37.038090+0000","last_clean":"2023-12-19T19:01:37.038090+0000","last_became_active":"2023-12-19T19:01:36.004006+0000","last_became_peered":"2023-12-19T19:01:36.004006+0000","last_unstale":"2023-12-19T19:01:37.038090+0000","last_undegraded":"2023-12-19T19:01:37.038090+0000","last_fullsized":"2023-12-19T19:01:37.038090+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:37.477766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.999791+0000","last_change":"2023-12-19T19:01:35.998391+0000","last_active":"2023-12-19T19:01:36.999791+0000","last_peered":"2023-12-19T19:01:36.999791+0000","last_clean":"2023-12-19T19:01:36.999791+0000","last_became_active":"2023-12-19T19:01:35.998129+0000","last_became_peered":"2023-12-19T19:01:35.998129+0000","last_unstale":"2023-12-19T19:01:36.999791+0000","last_undegraded":"2023-12-19T19:01:36.999791+0000","last_fullsized":"2023-12-19T19:01:36.999791+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:32.200929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.997702+0000","last_change":"2023-12-19T19:01:36.001234+0000","last_active":"2023-12-19T19:01:36.997702+0000","last_peered":"2023-12-19T19:01:36.997702+0000","last_clean":"2023-12-19T19:01:36.997702+0000","last_became_active":"2023-12-19T19:01:36.000486+0000","last_became_peered":"2023-12-19T19:01:36.000486+0000","last_unstale":"2023-12-19T19:01:36.997702+0000","last_undegraded":"2023-12-19T19:01:36.997702+0000","last_fullsized":"2023-12-19T19:01:36.997702+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:30:29.280200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:37.913808+0000","last_change":"2023-12-19T19:01:36.014917+0000","last_active":"2023-12-19T19:01:37.913808+0000","last_peered":"2023-12-19T19:01:37.913808+0000","last_clean":"2023-12-19T19:01:37.913808+0000","last_became_active":"2023-12-19T19:01:36.011305+0000","last_became_peered":"2023-12-19T19:01:36.011305+0000","last_unstale":"2023-12-19T19:01:37.913808+0000","last_undegraded":"2023-12-19T19:01:37.913808+0000","last_fullsized":"2023-12-19T19:01:37.913808+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:37:40.853246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.998983+0000","last_change":"2023-12-19T19:01:35.997902+0000","last_active":"2023-12-19T19:01:36.998983+0000","last_peered":"2023-12-19T19:01:36.998983+0000","last_clean":"2023-12-19T19:01:36.998983+0000","last_became_active":"2023-12-19T19:01:35.997621+0000","last_became_peered":"2023-12-19T19:01:35.997621+0000","last_unstale":"2023-12-19T19:01:36.998983+0000","last_undegraded":"2023-12-19T19:01:36.998983+0000","last_fullsized":"2023-12-19T19:01:36.998983+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:52:57.735191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:37.000716+0000","last_change":"2023-12-19T19:01:35.993502+0000","last_active":"2023-12-19T19:01:37.000716+0000","last_peered":"2023-12-19T19:01:37.000716+0000","last_clean":"2023-12-19T19:01:37.000716+0000","last_became_active":"2023-12-19T19:01:35.993183+0000","last_became_peered":"2023-12-19T19:01:35.993183+0000","last_unstale":"2023-12-19T19:01:37.000716+0000","last_undegraded":"2023-12-19T19:01:37.000716+0000","last_fullsized":"2023-12-19T19:01:37.000716+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:32.200929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.997943+0000","last_change":"2023-12-19T19:01:35.992492+0000","last_active":"2023-12-19T19:01:36.997943+0000","last_peered":"2023-12-19T19:01:36.997943+0000","last_clean":"2023-12-19T19:01:36.997943+0000","last_became_active":"2023-12-19T19:01:35.992218+0000","last_became_peered":"2023-12-19T19:01:35.992218+0000","last_unstale":"2023-12-19T19:01:36.997943+0000","last_undegraded":"2023-12-19T19:01:36.997943+0000","last_fullsized":"2023-12-19T19:01:36.997943+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:51:54.365989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:38.185487+0000","last_change":"2023-12-19T19:01:36.005018+0000","last_active":"2023-12-19T19:01:38.185487+0000","last_peered":"2023-12-19T19:01:38.185487+0000","last_clean":"2023-12-19T19:01:38.185487+0000","last_became_active":"2023-12-19T19:01:36.004713+0000","last_became_peered":"2023-12-19T19:01:36.004713+0000","last_unstale":"2023-12-19T19:01:38.185487+0000","last_undegraded":"2023-12-19T19:01:38.185487+0000","last_fullsized":"2023-12-19T19:01:38.185487+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:59.952872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.998017+0000","last_change":"2023-12-19T19:01:35.991658+0000","last_active":"2023-12-19T19:01:36.998017+0000","last_peered":"2023-12-19T19:01:36.998017+0000","last_clean":"2023-12-19T19:01:36.998017+0000","last_became_active":"2023-12-19T19:01:35.991237+0000","last_became_peered":"2023-12-19T19:01:35.991237+0000","last_unstale":"2023-12-19T19:01:36.998017+0000","last_undegraded":"2023-12-19T19:01:36.998017+0000","last_fullsized":"2023-12-19T19:01:36.998017+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:50:18.771363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.997702+0000","last_change":"2023-12-19T19:01:35.999313+0000","last_active":"2023-12-19T19:01:36.997702+0000","last_peered":"2023-12-19T19:01:36.997702+0000","last_clean":"2023-12-19T19:01:36.997702+0000","last_became_active":"2023-12-19T19:01:35.999030+0000","last_became_peered":"2023-12-19T19:01:35.999030+0000","last_unstale":"2023-12-19T19:01:36.997702+0000","last_undegraded":"2023-12-19T19:01:36.997702+0000","last_fullsized":"2023-12-19T19:01:36.997702+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:43:01.593581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:38.201673+0000","last_change":"2023-12-19T19:01:36.009794+0000","last_active":"2023-12-19T19:01:38.201673+0000","last_peered":"2023-12-19T19:01:38.201673+0000","last_clean":"2023-12-19T19:01:38.201673+0000","last_became_active":"2023-12-19T19:01:36.008912+0000","last_became_peered":"2023-12-19T19:01:36.008912+0000","last_unstale":"2023-12-19T19:01:38.201673+0000","last_undegraded":"2023-12-19T19:01:38.201673+0000","last_fullsized":"2023-12-19T19:01:38.201673+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:37.771426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:37.038041+0000","last_change":"2023-12-19T19:01:35.998877+0000","last_active":"2023-12-19T19:01:37.038041+0000","last_peered":"2023-12-19T19:01:37.038041+0000","last_clean":"2023-12-19T19:01:37.038041+0000","last_became_active":"2023-12-19T19:01:35.998571+0000","last_became_peered":"2023-12-19T19:01:35.998571+0000","last_unstale":"2023-12-19T19:01:37.038041+0000","last_undegraded":"2023-12-19T19:01:37.038041+0000","last_fullsized":"2023-12-19T19:01:37.038041+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:39.334276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.997423+0000","last_change":"2023-12-19T19:01:35.997800+0000","last_active":"2023-12-19T19:01:36.997423+0000","last_peered":"2023-12-19T19:01:36.997423+0000","last_clean":"2023-12-19T19:01:36.997423+0000","last_became_active":"2023-12-19T19:01:35.997545+0000","last_became_peered":"2023-12-19T19:01:35.997545+0000","last_unstale":"2023-12-19T19:01:36.997423+0000","last_undegraded":"2023-12-19T19:01:36.997423+0000","last_fullsized":"2023-12-19T19:01:36.997423+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:20:16.482489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:38.202112+0000","last_change":"2023-12-19T19:01:36.012530+0000","last_active":"2023-12-19T19:01:38.202112+0000","last_peered":"2023-12-19T19:01:38.202112+0000","last_clean":"2023-12-19T19:01:38.202112+0000","last_became_active":"2023-12-19T19:01:36.000357+0000","last_became_peered":"2023-12-19T19:01:36.000357+0000","last_unstale":"2023-12-19T19:01:38.202112+0000","last_undegraded":"2023-12-19T19:01:38.202112+0000","last_fullsized":"2023-12-19T19:01:38.202112+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:48:37.782606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:37.000048+0000","last_change":"2023-12-19T19:01:36.000335+0000","last_active":"2023-12-19T19:01:37.000048+0000","last_peered":"2023-12-19T19:01:37.000048+0000","last_clean":"2023-12-19T19:01:37.000048+0000","last_became_active":"2023-12-19T19:01:35.999949+0000","last_became_peered":"2023-12-19T19:01:35.999949+0000","last_unstale":"2023-12-19T19:01:37.000048+0000","last_undegraded":"2023-12-19T19:01:37.000048+0000","last_fullsized":"2023-12-19T19:01:37.000048+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:11:15.836065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.999259+0000","last_change":"2023-12-19T19:01:36.004020+0000","last_active":"2023-12-19T19:01:36.999259+0000","last_peered":"2023-12-19T19:01:36.999259+0000","last_clean":"2023-12-19T19:01:36.999259+0000","last_became_active":"2023-12-19T19:01:36.003711+0000","last_became_peered":"2023-12-19T19:01:36.003711+0000","last_unstale":"2023-12-19T19:01:36.999259+0000","last_undegraded":"2023-12-19T19:01:36.999259+0000","last_fullsized":"2023-12-19T19:01:36.999259+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:37:45.790125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:37.038181+0000","last_change":"2023-12-19T19:01:36.002845+0000","last_active":"2023-12-19T19:01:37.038181+0000","last_peered":"2023-12-19T19:01:37.038181+0000","last_clean":"2023-12-19T19:01:37.038181+0000","last_became_active":"2023-12-19T19:01:35.995423+0000","last_became_peered":"2023-12-19T19:01:35.995423+0000","last_unstale":"2023-12-19T19:01:37.038181+0000","last_undegraded":"2023-12-19T19:01:37.038181+0000","last_fullsized":"2023-12-19T19:01:37.038181+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:36.554120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:38.201756+0000","last_change":"2023-12-19T19:01:36.010222+0000","last_active":"2023-12-19T19:01:38.201756+0000","last_peered":"2023-12-19T19:01:38.201756+0000","last_clean":"2023-12-19T19:01:38.201756+0000","last_became_active":"2023-12-19T19:01:36.006880+0000","last_became_peered":"2023-12-19T19:01:36.006880+0000","last_unstale":"2023-12-19T19:01:38.201756+0000","last_undegraded":"2023-12-19T19:01:38.201756+0000","last_fullsized":"2023-12-19T19:01:38.201756+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:33:06.447358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:38.201721+0000","last_change":"2023-12-19T19:01:36.009287+0000","last_active":"2023-12-19T19:01:38.201721+0000","last_peered":"2023-12-19T19:01:38.201721+0000","last_clean":"2023-12-19T19:01:38.201721+0000","last_became_active":"2023-12-19T19:01:36.008143+0000","last_became_peered":"2023-12-19T19:01:36.008143+0000","last_unstale":"2023-12-19T19:01:38.201721+0000","last_undegraded":"2023-12-19T19:01:38.201721+0000","last_fullsized":"2023-12-19T19:01:38.201721+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:31:30.154809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.999471+0000","last_change":"2023-12-19T19:01:35.999308+0000","last_active":"2023-12-19T19:01:36.999471+0000","last_peered":"2023-12-19T19:01:36.999471+0000","last_clean":"2023-12-19T19:01:36.999471+0000","last_became_active":"2023-12-19T19:01:35.998266+0000","last_became_peered":"2023-12-19T19:01:35.998266+0000","last_unstale":"2023-12-19T19:01:36.999471+0000","last_undegraded":"2023-12-19T19:01:36.999471+0000","last_fullsized":"2023-12-19T19:01:36.999471+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:39.334276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:37.037988+0000","last_change":"2023-12-19T19:01:35.997803+0000","last_active":"2023-12-19T19:01:37.037988+0000","last_peered":"2023-12-19T19:01:37.037988+0000","last_clean":"2023-12-19T19:01:37.037988+0000","last_became_active":"2023-12-19T19:01:35.997526+0000","last_became_peered":"2023-12-19T19:01:35.997526+0000","last_unstale":"2023-12-19T19:01:37.037988+0000","last_undegraded":"2023-12-19T19:01:37.037988+0000","last_fullsized":"2023-12-19T19:01:37.037988+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:16:21.875547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.999958+0000","last_change":"2023-12-19T19:01:35.998354+0000","last_active":"2023-12-19T19:01:36.999958+0000","last_peered":"2023-12-19T19:01:36.999958+0000","last_clean":"2023-12-19T19:01:36.999958+0000","last_became_active":"2023-12-19T19:01:35.997004+0000","last_became_peered":"2023-12-19T19:01:35.997004+0000","last_unstale":"2023-12-19T19:01:36.999958+0000","last_undegraded":"2023-12-19T19:01:36.999958+0000","last_fullsized":"2023-12-19T19:01:36.999958+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:53:03.688848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"68'4","reported_seq":16,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.015472+0000","last_change":"2023-12-19T19:01:35.005860+0000","last_active":"2023-12-19T19:01:36.015472+0000","last_peered":"2023-12-19T19:01:36.015472+0000","last_clean":"2023-12-19T19:01:36.015472+0000","last_became_active":"2023-12-19T19:01:35.005458+0000","last_became_peered":"2023-12-19T19:01:35.005458+0000","last_unstale":"2023-12-19T19:01:36.015472+0000","last_undegraded":"2023-12-19T19:01:36.015472+0000","last_fullsized":"2023-12-19T19:01:36.015472+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:13:22.016658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:37.038566+0000","last_change":"2023-12-19T19:01:35.995284+0000","last_active":"2023-12-19T19:01:37.038566+0000","last_peered":"2023-12-19T19:01:37.038566+0000","last_clean":"2023-12-19T19:01:37.038566+0000","last_became_active":"2023-12-19T19:01:35.994915+0000","last_became_peered":"2023-12-19T19:01:35.994915+0000","last_unstale":"2023-12-19T19:01:37.038566+0000","last_undegraded":"2023-12-19T19:01:37.038566+0000","last_fullsized":"2023-12-19T19:01:37.038566+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:59.952872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"68'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.019807+0000","last_change":"2023-12-19T19:01:35.000000+0000","last_active":"2023-12-19T19:01:36.019807+0000","last_peered":"2023-12-19T19:01:36.019807+0000","last_clean":"2023-12-19T19:01:36.019807+0000","last_became_active":"2023-12-19T19:01:34.999684+0000","last_became_peered":"2023-12-19T19:01:34.999684+0000","last_unstale":"2023-12-19T19:01:36.019807+0000","last_undegraded":"2023-12-19T19:01:36.019807+0000","last_fullsized":"2023-12-19T19:01:36.019807+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:27.616001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:37.038241+0000","last_change":"2023-12-19T19:01:36.005109+0000","last_active":"2023-12-19T19:01:37.038241+0000","last_peered":"2023-12-19T19:01:37.038241+0000","last_clean":"2023-12-19T19:01:37.038241+0000","last_became_active":"2023-12-19T19:01:36.003599+0000","last_became_peered":"2023-12-19T19:01:36.003599+0000","last_unstale":"2023-12-19T19:01:37.038241+0000","last_undegraded":"2023-12-19T19:01:37.038241+0000","last_fullsized":"2023-12-19T19:01:37.038241+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:20:14.686881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"68'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.019465+0000","last_change":"2023-12-19T19:01:34.996946+0000","last_active":"2023-12-19T19:01:36.019465+0000","last_peered":"2023-12-19T19:01:36.019465+0000","last_clean":"2023-12-19T19:01:36.019465+0000","last_became_active":"2023-12-19T19:01:34.995689+0000","last_became_peered":"2023-12-19T19:01:34.995689+0000","last_unstale":"2023-12-19T19:01:36.019465+0000","last_undegraded":"2023-12-19T19:01:36.019465+0000","last_fullsized":"2023-12-19T19:01:36.019465+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:52:56.727773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:37.000007+0000","last_change":"2023-12-19T19:01:35.996110+0000","last_active":"2023-12-19T19:01:37.000007+0000","last_peered":"2023-12-19T19:01:37.000007+0000","last_clean":"2023-12-19T19:01:37.000007+0000","last_became_active":"2023-12-19T19:01:35.995850+0000","last_became_peered":"2023-12-19T19:01:35.995850+0000","last_unstale":"2023-12-19T19:01:37.000007+0000","last_undegraded":"2023-12-19T19:01:37.000007+0000","last_fullsized":"2023-12-19T19:01:37.000007+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:06:09.368068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"68'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.019482+0000","last_change":"2023-12-19T19:01:34.997757+0000","last_active":"2023-12-19T19:01:36.019482+0000","last_peered":"2023-12-19T19:01:36.019482+0000","last_clean":"2023-12-19T19:01:36.019482+0000","last_became_active":"2023-12-19T19:01:34.997458+0000","last_became_peered":"2023-12-19T19:01:34.997458+0000","last_unstale":"2023-12-19T19:01:36.019482+0000","last_undegraded":"2023-12-19T19:01:36.019482+0000","last_fullsized":"2023-12-19T19:01:36.019482+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:53:02.681430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:38.201807+0000","last_change":"2023-12-19T19:01:36.004027+0000","last_active":"2023-12-19T19:01:38.201807+0000","last_peered":"2023-12-19T19:01:38.201807+0000","last_clean":"2023-12-19T19:01:38.201807+0000","last_became_active":"2023-12-19T19:01:35.997940+0000","last_became_peered":"2023-12-19T19:01:35.997940+0000","last_unstale":"2023-12-19T19:01:38.201807+0000","last_undegraded":"2023-12-19T19:01:38.201807+0000","last_fullsized":"2023-12-19T19:01:38.201807+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:13:04.402847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"68'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.012920+0000","last_change":"2023-12-19T19:01:34.994677+0000","last_active":"2023-12-19T19:01:36.012920+0000","last_peered":"2023-12-19T19:01:36.012920+0000","last_clean":"2023-12-19T19:01:36.012920+0000","last_became_active":"2023-12-19T19:01:34.994343+0000","last_became_peered":"2023-12-19T19:01:34.994343+0000","last_unstale":"2023-12-19T19:01:36.012920+0000","last_undegraded":"2023-12-19T19:01:36.012920+0000","last_fullsized":"2023-12-19T19:01:36.012920+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:13:22.016658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.999533+0000","last_change":"2023-12-19T19:01:35.993058+0000","last_active":"2023-12-19T19:01:36.999533+0000","last_peered":"2023-12-19T19:01:36.999533+0000","last_clean":"2023-12-19T19:01:36.999533+0000","last_became_active":"2023-12-19T19:01:35.992604+0000","last_became_peered":"2023-12-19T19:01:35.992604+0000","last_unstale":"2023-12-19T19:01:36.999533+0000","last_undegraded":"2023-12-19T19:01:36.999533+0000","last_fullsized":"2023-12-19T19:01:36.999533+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:37.477766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"68'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.019307+0000","last_change":"2023-12-19T19:01:34.998256+0000","last_active":"2023-12-19T19:01:36.019307+0000","last_peered":"2023-12-19T19:01:36.019307+0000","last_clean":"2023-12-19T19:01:36.019307+0000","last_became_active":"2023-12-19T19:01:34.997890+0000","last_became_peered":"2023-12-19T19:01:34.997890+0000","last_unstale":"2023-12-19T19:01:36.019307+0000","last_undegraded":"2023-12-19T19:01:36.019307+0000","last_fullsized":"2023-12-19T19:01:36.019307+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:01:47.204631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.999270+0000","last_change":"2023-12-19T19:01:36.004752+0000","last_active":"2023-12-19T19:01:36.999270+0000","last_peered":"2023-12-19T19:01:36.999270+0000","last_clean":"2023-12-19T19:01:36.999270+0000","last_became_active":"2023-12-19T19:01:36.004424+0000","last_became_peered":"2023-12-19T19:01:36.004424+0000","last_unstale":"2023-12-19T19:01:36.999270+0000","last_undegraded":"2023-12-19T19:01:36.999270+0000","last_fullsized":"2023-12-19T19:01:36.999270+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:39:57.224439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.981581+0000","last_change":"2023-12-19T19:01:34.995656+0000","last_active":"2023-12-19T19:01:35.981581+0000","last_peered":"2023-12-19T19:01:35.981581+0000","last_clean":"2023-12-19T19:01:35.981581+0000","last_became_active":"2023-12-19T19:01:34.995357+0000","last_became_peered":"2023-12-19T19:01:34.995357+0000","last_unstale":"2023-12-19T19:01:35.981581+0000","last_undegraded":"2023-12-19T19:01:35.981581+0000","last_fullsized":"2023-12-19T19:01:35.981581+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:37:44.782707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:37.913981+0000","last_change":"2023-12-19T19:01:36.010420+0000","last_active":"2023-12-19T19:01:37.913981+0000","last_peered":"2023-12-19T19:01:37.913981+0000","last_clean":"2023-12-19T19:01:37.913981+0000","last_became_active":"2023-12-19T19:01:36.007843+0000","last_became_peered":"2023-12-19T19:01:36.007843+0000","last_unstale":"2023-12-19T19:01:37.913981+0000","last_undegraded":"2023-12-19T19:01:37.913981+0000","last_fullsized":"2023-12-19T19:01:37.913981+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:45.276751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.986569+0000","last_change":"2023-12-19T19:01:35.000403+0000","last_active":"2023-12-19T19:01:35.986569+0000","last_peered":"2023-12-19T19:01:35.986569+0000","last_clean":"2023-12-19T19:01:35.986569+0000","last_became_active":"2023-12-19T19:01:34.998866+0000","last_became_peered":"2023-12-19T19:01:34.998866+0000","last_unstale":"2023-12-19T19:01:35.986569+0000","last_undegraded":"2023-12-19T19:01:35.986569+0000","last_fullsized":"2023-12-19T19:01:35.986569+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:11:27.498892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:37.914249+0000","last_change":"2023-12-19T19:01:36.016594+0000","last_active":"2023-12-19T19:01:37.914249+0000","last_peered":"2023-12-19T19:01:37.914249+0000","last_clean":"2023-12-19T19:01:37.914249+0000","last_became_active":"2023-12-19T19:01:36.016338+0000","last_became_peered":"2023-12-19T19:01:36.016338+0000","last_unstale":"2023-12-19T19:01:37.914249+0000","last_undegraded":"2023-12-19T19:01:37.914249+0000","last_fullsized":"2023-12-19T19:01:37.914249+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:05:52.573183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.984085+0000","last_change":"2023-12-19T19:01:35.002076+0000","last_active":"2023-12-19T19:01:35.984085+0000","last_peered":"2023-12-19T19:01:35.984085+0000","last_clean":"2023-12-19T19:01:35.984085+0000","last_became_active":"2023-12-19T19:01:35.001645+0000","last_became_peered":"2023-12-19T19:01:35.001645+0000","last_unstale":"2023-12-19T19:01:35.984085+0000","last_undegraded":"2023-12-19T19:01:35.984085+0000","last_fullsized":"2023-12-19T19:01:35.984085+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:32:15.466391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:38.202349+0000","last_change":"2023-12-19T19:01:36.003506+0000","last_active":"2023-12-19T19:01:38.202349+0000","last_peered":"2023-12-19T19:01:38.202349+0000","last_clean":"2023-12-19T19:01:38.202349+0000","last_became_active":"2023-12-19T19:01:36.003096+0000","last_became_peered":"2023-12-19T19:01:36.003096+0000","last_unstale":"2023-12-19T19:01:38.202349+0000","last_undegraded":"2023-12-19T19:01:38.202349+0000","last_fullsized":"2023-12-19T19:01:38.202349+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:37.477766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.984125+0000","last_change":"2023-12-19T19:01:35.003678+0000","last_active":"2023-12-19T19:01:35.984125+0000","last_peered":"2023-12-19T19:01:35.984125+0000","last_clean":"2023-12-19T19:01:35.984125+0000","last_became_active":"2023-12-19T19:01:35.003361+0000","last_became_peered":"2023-12-19T19:01:35.003361+0000","last_unstale":"2023-12-19T19:01:35.984125+0000","last_undegraded":"2023-12-19T19:01:35.984125+0000","last_fullsized":"2023-12-19T19:01:35.984125+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:48:51.739304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:38.185283+0000","last_change":"2023-12-19T19:01:35.997000+0000","last_active":"2023-12-19T19:01:38.185283+0000","last_peered":"2023-12-19T19:01:38.185283+0000","last_clean":"2023-12-19T19:01:38.185283+0000","last_became_active":"2023-12-19T19:01:35.994590+0000","last_became_peered":"2023-12-19T19:01:35.994590+0000","last_unstale":"2023-12-19T19:01:38.185283+0000","last_undegraded":"2023-12-19T19:01:38.185283+0000","last_fullsized":"2023-12-19T19:01:38.185283+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:13.026799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"68'3","reported_seq":15,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.019011+0000","last_change":"2023-12-19T19:01:35.002668+0000","last_active":"2023-12-19T19:01:36.019011+0000","last_peered":"2023-12-19T19:01:36.019011+0000","last_clean":"2023-12-19T19:01:36.019011+0000","last_became_active":"2023-12-19T19:01:35.002367+0000","last_became_peered":"2023-12-19T19:01:35.002367+0000","last_unstale":"2023-12-19T19:01:36.019011+0000","last_undegraded":"2023-12-19T19:01:36.019011+0000","last_fullsized":"2023-12-19T19:01:36.019011+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:27.616001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.999310+0000","last_change":"2023-12-19T19:01:35.990996+0000","last_active":"2023-12-19T19:01:36.999310+0000","last_peered":"2023-12-19T19:01:36.999310+0000","last_clean":"2023-12-19T19:01:36.999310+0000","last_became_active":"2023-12-19T19:01:35.990358+0000","last_became_peered":"2023-12-19T19:01:35.990358+0000","last_unstale":"2023-12-19T19:01:36.999310+0000","last_undegraded":"2023-12-19T19:01:36.999310+0000","last_fullsized":"2023-12-19T19:01:36.999310+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:52:33.062884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"68'6","reported_seq":18,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.024669+0000","last_change":"2023-12-19T19:01:34.997430+0000","last_active":"2023-12-19T19:01:36.024669+0000","last_peered":"2023-12-19T19:01:36.024669+0000","last_clean":"2023-12-19T19:01:36.024669+0000","last_became_active":"2023-12-19T19:01:34.997110+0000","last_became_peered":"2023-12-19T19:01:34.997110+0000","last_unstale":"2023-12-19T19:01:36.024669+0000","last_undegraded":"2023-12-19T19:01:36.024669+0000","last_fullsized":"2023-12-19T19:01:36.024669+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:06:40.560279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:38.185256+0000","last_change":"2023-12-19T19:01:35.988814+0000","last_active":"2023-12-19T19:01:38.185256+0000","last_peered":"2023-12-19T19:01:38.185256+0000","last_clean":"2023-12-19T19:01:38.185256+0000","last_became_active":"2023-12-19T19:01:35.988546+0000","last_became_peered":"2023-12-19T19:01:35.988546+0000","last_unstale":"2023-12-19T19:01:38.185256+0000","last_undegraded":"2023-12-19T19:01:38.185256+0000","last_fullsized":"2023-12-19T19:01:38.185256+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:32.200929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"68'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.022398+0000","last_change":"2023-12-19T19:01:34.987868+0000","last_active":"2023-12-19T19:01:36.022398+0000","last_peered":"2023-12-19T19:01:36.022398+0000","last_clean":"2023-12-19T19:01:36.022398+0000","last_became_active":"2023-12-19T19:01:34.987545+0000","last_became_peered":"2023-12-19T19:01:34.987545+0000","last_unstale":"2023-12-19T19:01:36.022398+0000","last_undegraded":"2023-12-19T19:01:36.022398+0000","last_fullsized":"2023-12-19T19:01:36.022398+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:34:38.369643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.999829+0000","last_change":"2023-12-19T19:01:36.000560+0000","last_active":"2023-12-19T19:01:36.999829+0000","last_peered":"2023-12-19T19:01:36.999829+0000","last_clean":"2023-12-19T19:01:36.999829+0000","last_became_active":"2023-12-19T19:01:35.999311+0000","last_became_peered":"2023-12-19T19:01:35.999311+0000","last_unstale":"2023-12-19T19:01:36.999829+0000","last_undegraded":"2023-12-19T19:01:36.999829+0000","last_fullsized":"2023-12-19T19:01:36.999829+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:13.026799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.990878+0000","last_change":"2023-12-19T19:01:34.994756+0000","last_active":"2023-12-19T19:01:35.990878+0000","last_peered":"2023-12-19T19:01:35.990878+0000","last_clean":"2023-12-19T19:01:35.990878+0000","last_became_active":"2023-12-19T19:01:34.994476+0000","last_became_peered":"2023-12-19T19:01:34.994476+0000","last_unstale":"2023-12-19T19:01:35.990878+0000","last_undegraded":"2023-12-19T19:01:35.990878+0000","last_fullsized":"2023-12-19T19:01:35.990878+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:31.193511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:38.201586+0000","last_change":"2023-12-19T19:01:35.999708+0000","last_active":"2023-12-19T19:01:38.201586+0000","last_peered":"2023-12-19T19:01:38.201586+0000","last_clean":"2023-12-19T19:01:38.201586+0000","last_became_active":"2023-12-19T19:01:35.999385+0000","last_became_peered":"2023-12-19T19:01:35.999385+0000","last_unstale":"2023-12-19T19:01:38.201586+0000","last_undegraded":"2023-12-19T19:01:38.201586+0000","last_fullsized":"2023-12-19T19:01:38.201586+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:04:12.129299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.988325+0000","last_change":"2023-12-19T19:01:35.002999+0000","last_active":"2023-12-19T19:01:35.988325+0000","last_peered":"2023-12-19T19:01:35.988325+0000","last_clean":"2023-12-19T19:01:35.988325+0000","last_became_active":"2023-12-19T19:01:35.002667+0000","last_became_peered":"2023-12-19T19:01:35.002667+0000","last_unstale":"2023-12-19T19:01:35.988325+0000","last_undegraded":"2023-12-19T19:01:35.988325+0000","last_fullsized":"2023-12-19T19:01:35.988325+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:13:22.016658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:38.201551+0000","last_change":"2023-12-19T19:01:35.998862+0000","last_active":"2023-12-19T19:01:38.201551+0000","last_peered":"2023-12-19T19:01:38.201551+0000","last_clean":"2023-12-19T19:01:38.201551+0000","last_became_active":"2023-12-19T19:01:35.998539+0000","last_became_peered":"2023-12-19T19:01:35.998539+0000","last_unstale":"2023-12-19T19:01:38.201551+0000","last_undegraded":"2023-12-19T19:01:38.201551+0000","last_fullsized":"2023-12-19T19:01:38.201551+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:37.690613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"68'8","reported_seq":20,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.022871+0000","last_change":"2023-12-19T19:01:34.993756+0000","last_active":"2023-12-19T19:01:36.022871+0000","last_peered":"2023-12-19T19:01:36.022871+0000","last_clean":"2023-12-19T19:01:36.022871+0000","last_became_active":"2023-12-19T19:01:34.993466+0000","last_became_peered":"2023-12-19T19:01:34.993466+0000","last_unstale":"2023-12-19T19:01:36.022871+0000","last_undegraded":"2023-12-19T19:01:36.022871+0000","last_fullsized":"2023-12-19T19:01:36.022871+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:38.326858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:37.000176+0000","last_change":"2023-12-19T19:01:35.996677+0000","last_active":"2023-12-19T19:01:37.000176+0000","last_peered":"2023-12-19T19:01:37.000176+0000","last_clean":"2023-12-19T19:01:37.000176+0000","last_became_active":"2023-12-19T19:01:35.996429+0000","last_became_peered":"2023-12-19T19:01:35.996429+0000","last_unstale":"2023-12-19T19:01:37.000176+0000","last_undegraded":"2023-12-19T19:01:37.000176+0000","last_fullsized":"2023-12-19T19:01:37.000176+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:10:55.145501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"68'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.013965+0000","last_change":"2023-12-19T19:01:35.001602+0000","last_active":"2023-12-19T19:01:36.013965+0000","last_peered":"2023-12-19T19:01:36.013965+0000","last_clean":"2023-12-19T19:01:36.013965+0000","last_became_active":"2023-12-19T19:01:35.000999+0000","last_became_peered":"2023-12-19T19:01:35.000999+0000","last_unstale":"2023-12-19T19:01:36.013965+0000","last_undegraded":"2023-12-19T19:01:36.013965+0000","last_fullsized":"2023-12-19T19:01:36.013965+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:46:31.394472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:37.038655+0000","last_change":"2023-12-19T19:01:36.000346+0000","last_active":"2023-12-19T19:01:37.038655+0000","last_peered":"2023-12-19T19:01:37.038655+0000","last_clean":"2023-12-19T19:01:37.038655+0000","last_became_active":"2023-12-19T19:01:35.999742+0000","last_became_peered":"2023-12-19T19:01:35.999742+0000","last_unstale":"2023-12-19T19:01:37.038655+0000","last_undegraded":"2023-12-19T19:01:37.038655+0000","last_fullsized":"2023-12-19T19:01:37.038655+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:06:09.368068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"68'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.017822+0000","last_change":"2023-12-19T19:01:34.999856+0000","last_active":"2023-12-19T19:01:36.017822+0000","last_peered":"2023-12-19T19:01:36.017822+0000","last_clean":"2023-12-19T19:01:36.017822+0000","last_became_active":"2023-12-19T19:01:34.999581+0000","last_became_peered":"2023-12-19T19:01:34.999581+0000","last_unstale":"2023-12-19T19:01:36.017822+0000","last_undegraded":"2023-12-19T19:01:36.017822+0000","last_fullsized":"2023-12-19T19:01:36.017822+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:52:32.055466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:37.000385+0000","last_change":"2023-12-19T19:01:36.000859+0000","last_active":"2023-12-19T19:01:37.000385+0000","last_peered":"2023-12-19T19:01:37.000385+0000","last_clean":"2023-12-19T19:01:37.000385+0000","last_became_active":"2023-12-19T19:01:36.000532+0000","last_became_peered":"2023-12-19T19:01:36.000532+0000","last_unstale":"2023-12-19T19:01:37.000385+0000","last_undegraded":"2023-12-19T19:01:37.000385+0000","last_fullsized":"2023-12-19T19:01:37.000385+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:20:14.686881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.983087+0000","last_change":"2023-12-19T19:01:34.992936+0000","last_active":"2023-12-19T19:01:35.983087+0000","last_peered":"2023-12-19T19:01:35.983087+0000","last_clean":"2023-12-19T19:01:35.983087+0000","last_became_active":"2023-12-19T19:01:34.992664+0000","last_became_peered":"2023-12-19T19:01:34.992664+0000","last_unstale":"2023-12-19T19:01:35.983087+0000","last_undegraded":"2023-12-19T19:01:35.983087+0000","last_fullsized":"2023-12-19T19:01:35.983087+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:35.546701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.997686+0000","last_change":"2023-12-19T19:01:36.000821+0000","last_active":"2023-12-19T19:01:36.997686+0000","last_peered":"2023-12-19T19:01:36.997686+0000","last_clean":"2023-12-19T19:01:36.997686+0000","last_became_active":"2023-12-19T19:01:36.000457+0000","last_became_peered":"2023-12-19T19:01:36.000457+0000","last_unstale":"2023-12-19T19:01:36.997686+0000","last_undegraded":"2023-12-19T19:01:36.997686+0000","last_fullsized":"2023-12-19T19:01:36.997686+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:30:27.426356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"68'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.019524+0000","last_change":"2023-12-19T19:01:35.000039+0000","last_active":"2023-12-19T19:01:36.019524+0000","last_peered":"2023-12-19T19:01:36.019524+0000","last_clean":"2023-12-19T19:01:36.019524+0000","last_became_active":"2023-12-19T19:01:34.999745+0000","last_became_peered":"2023-12-19T19:01:34.999745+0000","last_unstale":"2023-12-19T19:01:36.019524+0000","last_undegraded":"2023-12-19T19:01:36.019524+0000","last_fullsized":"2023-12-19T19:01:36.019524+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:11:14.828647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:38.202083+0000","last_change":"2023-12-19T19:01:36.003671+0000","last_active":"2023-12-19T19:01:38.202083+0000","last_peered":"2023-12-19T19:01:38.202083+0000","last_clean":"2023-12-19T19:01:38.202083+0000","last_became_active":"2023-12-19T19:01:36.003394+0000","last_became_peered":"2023-12-19T19:01:36.003394+0000","last_unstale":"2023-12-19T19:01:38.202083+0000","last_undegraded":"2023-12-19T19:01:38.202083+0000","last_fullsized":"2023-12-19T19:01:38.202083+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:28.623419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.977104+0000","last_change":"2023-12-19T19:01:34.996284+0000","last_active":"2023-12-19T19:01:35.977104+0000","last_peered":"2023-12-19T19:01:35.977104+0000","last_clean":"2023-12-19T19:01:35.977104+0000","last_became_active":"2023-12-19T19:01:34.996012+0000","last_became_peered":"2023-12-19T19:01:34.996012+0000","last_unstale":"2023-12-19T19:01:35.977104+0000","last_undegraded":"2023-12-19T19:01:35.977104+0000","last_fullsized":"2023-12-19T19:01:35.977104+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:11:45.676991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.997433+0000","last_change":"2023-12-19T19:01:35.999651+0000","last_active":"2023-12-19T19:01:36.997433+0000","last_peered":"2023-12-19T19:01:36.997433+0000","last_clean":"2023-12-19T19:01:36.997433+0000","last_became_active":"2023-12-19T19:01:35.999414+0000","last_became_peered":"2023-12-19T19:01:35.999414+0000","last_unstale":"2023-12-19T19:01:36.997433+0000","last_undegraded":"2023-12-19T19:01:36.997433+0000","last_fullsized":"2023-12-19T19:01:36.997433+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:10:39.431508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.976205+0000","last_change":"2023-12-19T19:01:35.002482+0000","last_active":"2023-12-19T19:01:35.976205+0000","last_peered":"2023-12-19T19:01:35.976205+0000","last_clean":"2023-12-19T19:01:35.976205+0000","last_became_active":"2023-12-19T19:01:35.002110+0000","last_became_peered":"2023-12-19T19:01:35.002110+0000","last_unstale":"2023-12-19T19:01:35.976205+0000","last_undegraded":"2023-12-19T19:01:35.976205+0000","last_fullsized":"2023-12-19T19:01:35.976205+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:53:39.946763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:38.202303+0000","last_change":"2023-12-19T19:01:35.997317+0000","last_active":"2023-12-19T19:01:38.202303+0000","last_peered":"2023-12-19T19:01:38.202303+0000","last_clean":"2023-12-19T19:01:38.202303+0000","last_became_active":"2023-12-19T19:01:35.996988+0000","last_became_peered":"2023-12-19T19:01:35.996988+0000","last_unstale":"2023-12-19T19:01:38.202303+0000","last_undegraded":"2023-12-19T19:01:38.202303+0000","last_fullsized":"2023-12-19T19:01:38.202303+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:16:21.875547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.991566+0000","last_change":"2023-12-19T19:01:34.997069+0000","last_active":"2023-12-19T19:01:35.991566+0000","last_peered":"2023-12-19T19:01:35.991566+0000","last_clean":"2023-12-19T19:01:35.991566+0000","last_became_active":"2023-12-19T19:01:34.996756+0000","last_became_peered":"2023-12-19T19:01:34.996756+0000","last_unstale":"2023-12-19T19:01:35.991566+0000","last_undegraded":"2023-12-19T19:01:35.991566+0000","last_fullsized":"2023-12-19T19:01:35.991566+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:58.945454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:37.000084+0000","last_change":"2023-12-19T19:01:35.995384+0000","last_active":"2023-12-19T19:01:37.000084+0000","last_peered":"2023-12-19T19:01:37.000084+0000","last_clean":"2023-12-19T19:01:37.000084+0000","last_became_active":"2023-12-19T19:01:35.995055+0000","last_became_peered":"2023-12-19T19:01:35.995055+0000","last_unstale":"2023-12-19T19:01:37.000084+0000","last_undegraded":"2023-12-19T19:01:37.000084+0000","last_fullsized":"2023-12-19T19:01:37.000084+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:36.554120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"68'2","reported_seq":14,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.022533+0000","last_change":"2023-12-19T19:01:34.989700+0000","last_active":"2023-12-19T19:01:36.022533+0000","last_peered":"2023-12-19T19:01:36.022533+0000","last_clean":"2023-12-19T19:01:36.022533+0000","last_became_active":"2023-12-19T19:01:34.989417+0000","last_became_peered":"2023-12-19T19:01:34.989417+0000","last_unstale":"2023-12-19T19:01:36.022533+0000","last_undegraded":"2023-12-19T19:01:36.022533+0000","last_fullsized":"2023-12-19T19:01:36.022533+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:29.601572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:37.000192+0000","last_change":"2023-12-19T19:01:35.997927+0000","last_active":"2023-12-19T19:01:37.000192+0000","last_peered":"2023-12-19T19:01:37.000192+0000","last_clean":"2023-12-19T19:01:37.000192+0000","last_became_active":"2023-12-19T19:01:35.997596+0000","last_became_peered":"2023-12-19T19:01:35.997596+0000","last_unstale":"2023-12-19T19:01:37.000192+0000","last_undegraded":"2023-12-19T19:01:37.000192+0000","last_fullsized":"2023-12-19T19:01:37.000192+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:37:40.853246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"69'1","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:38.202074+0000","last_change":"2023-12-19T19:01:34.986750+0000","last_active":"2023-12-19T19:01:38.202074+0000","last_peered":"2023-12-19T19:01:38.202074+0000","last_clean":"2023-12-19T19:01:38.202074+0000","last_became_active":"2023-12-19T19:01:34.986455+0000","last_became_peered":"2023-12-19T19:01:34.986455+0000","last_unstale":"2023-12-19T19:01:38.202074+0000","last_undegraded":"2023-12-19T19:01:38.202074+0000","last_fullsized":"2023-12-19T19:01:38.202074+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:32.294680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:37.038357+0000","last_change":"2023-12-19T19:01:35.993025+0000","last_active":"2023-12-19T19:01:37.038357+0000","last_peered":"2023-12-19T19:01:37.038357+0000","last_clean":"2023-12-19T19:01:37.038357+0000","last_became_active":"2023-12-19T19:01:35.991791+0000","last_became_peered":"2023-12-19T19:01:35.991791+0000","last_unstale":"2023-12-19T19:01:37.038357+0000","last_undegraded":"2023-12-19T19:01:37.038357+0000","last_fullsized":"2023-12-19T19:01:37.038357+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:39:57.224439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.984519+0000","last_change":"2023-12-19T19:01:35.001204+0000","last_active":"2023-12-19T19:01:35.984519+0000","last_peered":"2023-12-19T19:01:35.984519+0000","last_clean":"2023-12-19T19:01:35.984519+0000","last_became_active":"2023-12-19T19:01:35.000589+0000","last_became_peered":"2023-12-19T19:01:35.000589+0000","last_unstale":"2023-12-19T19:01:35.984519+0000","last_undegraded":"2023-12-19T19:01:35.984519+0000","last_fullsized":"2023-12-19T19:01:35.984519+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:52:56.727773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:37.000515+0000","last_change":"2023-12-19T19:01:35.986829+0000","last_active":"2023-12-19T19:01:37.000515+0000","last_peered":"2023-12-19T19:01:37.000515+0000","last_clean":"2023-12-19T19:01:37.000515+0000","last_became_active":"2023-12-19T19:01:35.986542+0000","last_became_peered":"2023-12-19T19:01:35.986542+0000","last_unstale":"2023-12-19T19:01:37.000515+0000","last_undegraded":"2023-12-19T19:01:37.000515+0000","last_fullsized":"2023-12-19T19:01:37.000515+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:39:57.224439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.984319+0000","last_change":"2023-12-19T19:01:34.999664+0000","last_active":"2023-12-19T19:01:35.984319+0000","last_peered":"2023-12-19T19:01:35.984319+0000","last_clean":"2023-12-19T19:01:35.984319+0000","last_became_active":"2023-12-19T19:01:34.998997+0000","last_became_peered":"2023-12-19T19:01:34.998997+0000","last_unstale":"2023-12-19T19:01:35.984319+0000","last_undegraded":"2023-12-19T19:01:35.984319+0000","last_fullsized":"2023-12-19T19:01:35.984319+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:08:57.128528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:38.202311+0000","last_change":"2023-12-19T19:01:36.003446+0000","last_active":"2023-12-19T19:01:38.202311+0000","last_peered":"2023-12-19T19:01:38.202311+0000","last_clean":"2023-12-19T19:01:38.202311+0000","last_became_active":"2023-12-19T19:01:36.003111+0000","last_became_peered":"2023-12-19T19:01:36.003111+0000","last_unstale":"2023-12-19T19:01:38.202311+0000","last_undegraded":"2023-12-19T19:01:38.202311+0000","last_fullsized":"2023-12-19T19:01:38.202311+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:37:45.790125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.983688+0000","last_change":"2023-12-19T19:01:34.990870+0000","last_active":"2023-12-19T19:01:35.983688+0000","last_peered":"2023-12-19T19:01:35.983688+0000","last_clean":"2023-12-19T19:01:35.983688+0000","last_became_active":"2023-12-19T19:01:34.990513+0000","last_became_peered":"2023-12-19T19:01:34.990513+0000","last_unstale":"2023-12-19T19:01:35.983688+0000","last_undegraded":"2023-12-19T19:01:35.983688+0000","last_fullsized":"2023-12-19T19:01:35.983688+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:20:13.679462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:38.185484+0000","last_change":"2023-12-19T19:01:35.998133+0000","last_active":"2023-12-19T19:01:38.185484+0000","last_peered":"2023-12-19T19:01:38.185484+0000","last_clean":"2023-12-19T19:01:38.185484+0000","last_became_active":"2023-12-19T19:01:35.997577+0000","last_became_peered":"2023-12-19T19:01:35.997577+0000","last_unstale":"2023-12-19T19:01:38.185484+0000","last_undegraded":"2023-12-19T19:01:38.185484+0000","last_fullsized":"2023-12-19T19:01:38.185484+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:06:09.368068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.979639+0000","last_change":"2023-12-19T19:01:34.994259+0000","last_active":"2023-12-19T19:01:35.979639+0000","last_peered":"2023-12-19T19:01:35.979639+0000","last_clean":"2023-12-19T19:01:35.979639+0000","last_became_active":"2023-12-19T19:01:34.992784+0000","last_became_peered":"2023-12-19T19:01:34.992784+0000","last_unstale":"2023-12-19T19:01:35.979639+0000","last_undegraded":"2023-12-19T19:01:35.979639+0000","last_fullsized":"2023-12-19T19:01:35.979639+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:06:56.928069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.999012+0000","last_change":"2023-12-19T19:01:36.014563+0000","last_active":"2023-12-19T19:01:36.999012+0000","last_peered":"2023-12-19T19:01:36.999012+0000","last_clean":"2023-12-19T19:01:36.999012+0000","last_became_active":"2023-12-19T19:01:36.014224+0000","last_became_peered":"2023-12-19T19:01:36.014224+0000","last_unstale":"2023-12-19T19:01:36.999012+0000","last_undegraded":"2023-12-19T19:01:36.999012+0000","last_fullsized":"2023-12-19T19:01:36.999012+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:20:14.686881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.985007+0000","last_change":"2023-12-19T19:01:35.001846+0000","last_active":"2023-12-19T19:01:35.985007+0000","last_peered":"2023-12-19T19:01:35.985007+0000","last_clean":"2023-12-19T19:01:35.985007+0000","last_became_active":"2023-12-19T19:01:35.000362+0000","last_became_peered":"2023-12-19T19:01:35.000362+0000","last_unstale":"2023-12-19T19:01:35.985007+0000","last_undegraded":"2023-12-19T19:01:35.985007+0000","last_fullsized":"2023-12-19T19:01:35.985007+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:37:44.782707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:37.038107+0000","last_change":"2023-12-19T19:01:35.989740+0000","last_active":"2023-12-19T19:01:37.038107+0000","last_peered":"2023-12-19T19:01:37.038107+0000","last_clean":"2023-12-19T19:01:37.038107+0000","last_became_active":"2023-12-19T19:01:35.989440+0000","last_became_peered":"2023-12-19T19:01:35.989440+0000","last_unstale":"2023-12-19T19:01:37.038107+0000","last_undegraded":"2023-12-19T19:01:37.038107+0000","last_fullsized":"2023-12-19T19:01:37.038107+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:53:03.688848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.980397+0000","last_change":"2023-12-19T19:01:34.998108+0000","last_active":"2023-12-19T19:01:35.980397+0000","last_peered":"2023-12-19T19:01:35.980397+0000","last_clean":"2023-12-19T19:01:35.980397+0000","last_became_active":"2023-12-19T19:01:34.997738+0000","last_became_peered":"2023-12-19T19:01:34.997738+0000","last_unstale":"2023-12-19T19:01:35.980397+0000","last_undegraded":"2023-12-19T19:01:35.980397+0000","last_fullsized":"2023-12-19T19:01:35.980397+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:08:57.128528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-12-19T19:01:38.201933+0000","last_change":"2023-12-19T19:01:35.997204+0000","last_active":"2023-12-19T19:01:38.201933+0000","last_peered":"2023-12-19T19:01:38.201933+0000","last_clean":"2023-12-19T19:01:38.201933+0000","last_became_active":"2023-12-19T19:01:35.996928+0000","last_became_peered":"2023-12-19T19:01:35.996928+0000","last_unstale":"2023-12-19T19:01:38.201933+0000","last_undegraded":"2023-12-19T19:01:38.201933+0000","last_fullsized":"2023-12-19T19:01:38.201933+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:32.389842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"68'1","reported_seq":13,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:36.014189+0000","last_change":"2023-12-19T19:01:34.999764+0000","last_active":"2023-12-19T19:01:36.014189+0000","last_peered":"2023-12-19T19:01:36.014189+0000","last_clean":"2023-12-19T19:01:36.014189+0000","last_became_active":"2023-12-19T19:01:34.998931+0000","last_became_peered":"2023-12-19T19:01:34.998931+0000","last_unstale":"2023-12-19T19:01:36.014189+0000","last_undegraded":"2023-12-19T19:01:36.014189+0000","last_fullsized":"2023-12-19T19:01:36.014189+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:36.470347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":215,"reported_epoch":68,"state":"active+clean","last_fresh":"2023-12-19T19:01:35.984963+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T19:01:35.984963+0000","last_peered":"2023-12-19T19:01:35.984963+0000","last_clean":"2023-12-19T19:01:35.984963+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T19:01:35.984963+0000","last_undegraded":"2023-12-19T19:01:35.984963+0000","last_fullsized":"2023-12-19T19:01:35.984963+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574890,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32600,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339240,"statfs":{"total":96636764160,"available":96603381760,"internally_reserved":0,"allocated":1445888,"data_stored":960534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.68899999999999995},"min":{"1min":0.44,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92500000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.72399999999999998},"min":{"1min":0.50700000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89300000000000002,"5min":1.117,"15min":1.117},"last":0.73899999999999999}]},{"osd":1,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.46700000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83899999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83399999999999996,"5min":1.01,"15min":1.01},"last":1.117}]},{"osd":2,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85499999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.58299999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89500000000000002,"5min":1.089,"15min":1.089},"last":0.77800000000000002}]},{"osd":3,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71299999999999997,"15min":0.72699999999999998},"min":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90900000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73299999999999998,"15min":0.73499999999999999},"min":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91600000000000004,"5min":1.026,"15min":1.026},"last":0.76400000000000001}]},{"osd":4,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64400000000000002,"15min":0.65600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88500000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66700000000000004,"15min":0.67400000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93799999999999994,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.63600000000000001}]},{"osd":5,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93200000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.70599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91500000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.60899999999999999}]},{"osd":6,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.96799999999999997,"5min":1.069,"15min":1.069},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78000000000000003,"15min":0.79600000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.57999999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":860160,"data_stored":370790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.98899999999999999,"5min":1.022,"15min":1.022},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.89800000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.57299999999999995}]},{"osd":1,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67100000000000004,"15min":0.65700000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.871,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.52300000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91500000000000004,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.628}]},{"osd":2,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.443,"5min":0.437,"15min":0.437},"max":{"1min":0.96299999999999997,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.751},{"interface":"front","average":{"1min":0.745,"5min":0.71999999999999997,"15min":0.71699999999999997},"min":{"1min":0.58099999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94899999999999995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68600000000000005}]},{"osd":3,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83499999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72199999999999998,"15min":0.72699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91900000000000004,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.83299999999999996}]},{"osd":4,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.48599999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.74099999999999999,"15min":0.755},"min":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95999999999999996,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.67000000000000004}]},{"osd":5,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.93700000000000006,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73199999999999998,"15min":0.73599999999999999},"min":{"1min":0.54600000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.84799999999999998}]},{"osd":7,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.52800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.86899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":864256,"data_stored":371730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.90500000000000003,"15min":0.94899999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.0880000000000001,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":1.3420000000000001,"15min":1.452},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1180000000000001,"5min":16.951000000000001,"15min":16.951000000000001},"last":0.76600000000000001}]},{"osd":1,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":1.411,"15min":1.5429999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0700000000000001,"5min":19.823,"15min":19.823},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.44500000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.216,"5min":1.657,"15min":1.657},"last":0.79700000000000004}]},{"osd":2,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.74199999999999999,"15min":0.755},"min":{"1min":0.48799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.163,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72999999999999998,"15min":0.73799999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.1020000000000001,"5min":1.585,"15min":1.585},"last":0.73299999999999998}]},{"osd":3,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.78000000000000003,"15min":0.79100000000000004},"min":{"1min":0.52900000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0589999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.97299999999999998,"15min":1.0149999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0740000000000001,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":0.89400000000000002}]},{"osd":4,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67500000000000004,"15min":0.67700000000000005},"min":{"1min":0.45200000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.0049999999999999,"5min":1.716,"15min":1.716},"last":0.75},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.81799999999999995,"15min":0.83399999999999996},"min":{"1min":0.504,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.97899999999999998,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":0.91700000000000004}]},{"osd":6,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.82799999999999996,"15min":0.85099999999999998},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.86599999999999999,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.82999999999999996,"15min":0.84599999999999997},"min":{"1min":0.51100000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90600000000000003,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.86899999999999999}]},{"osd":7,"last update":"Tue Dec 19 19:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.82899999999999996,"15min":0.83899999999999997},"min":{"1min":0.60599999999999998,"5min":0.498,"15min":0.498},"max":{"1min":1.0900000000000001,"5min":2.371,"15min":2.371},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.0369999999999999,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.93500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32016,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339824,"statfs":{"total":96636764160,"available":96603979776,"internally_reserved":0,"allocated":847872,"data_stored":370096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.79300000000000004,"15min":0.85899999999999999},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92600000000000005,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67700000000000005,"15min":0.69099999999999995},"min":{"1min":0.47499999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83599999999999997,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.61499999999999999}]},{"osd":1,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.68600000000000005,"15min":0.69799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85399999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.76500000000000001,"15min":0.79800000000000004},"min":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.86399999999999999,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":0.71299999999999997}]},{"osd":2,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.69199999999999995},"min":{"1min":0.504,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.872,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.76600000000000001,"15min":0.80800000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86399999999999999,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.624}]},{"osd":3,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.78200000000000003,"15min":0.83599999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.874,"5min":3.641,"15min":3.641},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.83299999999999996,"15min":0.88500000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91200000000000003,"5min":3.194,"15min":3.194},"last":0.69699999999999995}]},{"osd":5,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.92200000000000004,"15min":1.054},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89200000000000002,"5min":9.3040000000000003,"15min":9.3040000000000003},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69599999999999995,"15min":0.73199999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90800000000000003,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.54300000000000004}]},{"osd":6,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.78700000000000003,"15min":0.83199999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92700000000000005,"5min":3.097,"15min":3.097},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.82299999999999995,"15min":0.877},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89700000000000002,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.84299999999999997}]},{"osd":7,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.879,"15min":0.95899999999999996},"min":{"1min":0.48399999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93200000000000005,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.95399999999999996,"15min":1.052},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94299999999999995,"5min":6.3449999999999998,"15min":6.3449999999999998},"last":0.77200000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":371708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72699999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.36099999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.59399999999999997}]},{"osd":1,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46700000000000003,"15min":0.48499999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60699999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.55600000000000005}]},{"osd":2,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.74299999999999999,"5min":0.75,"15min":0.75},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.54700000000000004},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77600000000000002,"5min":0.875,"15min":0.875},"last":0.63100000000000001}]},{"osd":4,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88400000000000001,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98999999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.89000000000000001}]},{"osd":5,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.50600000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94999999999999996,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.752,"15min":0.77000000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.04,"5min":1.202,"15min":1.202},"last":0.877}]},{"osd":6,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96399999999999997,"5min":1.298,"15min":1.298},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.98299999999999998,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.85899999999999999}]},{"osd":7,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94999999999999996,"5min":1.155,"15min":1.155},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93000000000000005,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.02}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":851968,"data_stored":370678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.47399999999999998,"15min":0.5},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53700000000000003,"5min":1.458,"15min":1.458},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.56999999999999995,"15min":0.622},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68799999999999994,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.52200000000000002}]},{"osd":1,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.54600000000000004,"15min":0.58799999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.56899999999999995,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.56799999999999995,"15min":0.61199999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.625,"5min":2.444,"15min":2.444},"last":0.46300000000000002}]},{"osd":3,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.55400000000000005,"15min":0.60599999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.60899999999999999,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.58999999999999997,"15min":0.63200000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65500000000000003,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.497}]},{"osd":4,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.88600000000000001,"15min":0.95699999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0189999999999999,"5min":1.968,"15min":1.968},"last":0.877},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.84999999999999998,"15min":0.91000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96899999999999997,"5min":2.835,"15min":2.835},"last":0.755}]},{"osd":5,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.86399999999999999,"15min":0.93300000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.99099999999999999,"5min":3.5,"15min":3.5},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.86499999999999999,"15min":0.92500000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94999999999999996,"5min":1.996,"15min":1.996},"last":0.92600000000000005}]},{"osd":6,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.86699999999999999,"15min":0.93200000000000005},"min":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0740000000000001,"5min":2.903,"15min":2.903},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.93000000000000005,"15min":1.0129999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0569999999999999,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.90400000000000003}]},{"osd":7,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.90300000000000002,"15min":0.97099999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1259999999999999,"5min":2.875,"15min":2.875},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.88200000000000001,"15min":0.96099999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95199999999999996,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.995}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":370290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.51800000000000002,"15min":0.56999999999999995},"min":{"1min":0.29699999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73399999999999999,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.443,"5min":0.67100000000000004,"15min":0.77500000000000002},"min":{"1min":0.31,"5min":0.255,"15min":0.255},"max":{"1min":0.76700000000000002,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.46800000000000003}]},{"osd":2,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.53900000000000003,"15min":0.58499999999999996},"min":{"1min":0.317,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71799999999999997,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.61099999999999999,"15min":0.67400000000000004},"min":{"1min":0.34699999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76800000000000002,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.41299999999999998}]},{"osd":3,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.72299999999999998,"15min":0.81899999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.90700000000000003,"5min":7.8399999999999999,"15min":7.8399999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.746,"15min":0.83799999999999997},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83699999999999997,"5min":7.7949999999999999,"15min":7.7949999999999999},"last":0.53000000000000003}]},{"osd":4,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.81899999999999995,"15min":0.88300000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.871,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.85199999999999998,"15min":0.91400000000000003},"min":{"1min":0.52300000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89300000000000002,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.89100000000000001}]},{"osd":5,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.82999999999999996,"15min":0.89200000000000002},"min":{"1min":0.49399999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93300000000000005,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.84099999999999997,"15min":0.90300000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.996,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.93700000000000006}]},{"osd":6,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.84799999999999998,"15min":0.89600000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95599999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.876,"15min":0.95099999999999996},"min":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.85499999999999998,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.75800000000000001}]},{"osd":7,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.88300000000000001,"15min":0.94999999999999996},"min":{"1min":0.51600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.83299999999999996,"5min":4.3310000000000004,"15min":4.3310000000000004},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.85899999999999999,"15min":0.90900000000000003},"min":{"1min":0.55100000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.92100000000000004,"5min":4.226,"15min":4.226},"last":0.92100000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32588,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339252,"statfs":{"total":96636764160,"available":96603394048,"internally_reserved":0,"allocated":1441792,"data_stored":959479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.436,"15min":0.44800000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60299999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.379},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48899999999999999,"15min":0.503},"min":{"1min":0.29799999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65700000000000003,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.53300000000000003}]},{"osd":2,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.50600000000000001,"15min":0.51300000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63700000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.51100000000000001},"min":{"1min":0.40799999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.67100000000000004}]},{"osd":3,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48199999999999998,"15min":0.48699999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.55900000000000005,"5min":0.747,"15min":0.747},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.57799999999999996,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69299999999999995,"5min":1.264,"15min":1.264},"last":0.79400000000000004}]},{"osd":4,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.74199999999999999,"15min":0.748},"min":{"1min":0.502,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93999999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89900000000000002,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.68799999999999994}]},{"osd":5,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.749},"min":{"1min":0.57299999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.89300000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79200000000000004,"15min":0.81699999999999995},"min":{"1min":0.57199999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.91000000000000003,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.55000000000000004}]},{"osd":6,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.79600000000000004,"15min":0.82499999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92600000000000005,"5min":1.349,"15min":1.349},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0189999999999999,"5min":1.115,"15min":1.115},"last":0.74399999999999999}]},{"osd":7,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.57499999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94899999999999995,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.79200000000000004,"15min":0.81200000000000006},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.93200000000000005,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.73599999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T19:01:45.030 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T19:01:45.031 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T19:01:45.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.204+0000 7f7c2899d640 1 Processor -- start 2023-12-19T19:01:45.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.204+0000 7f7c2899d640 1 -- start start 2023-12-19T19:01:45.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.204+0000 7f7c2899d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7c24073a70 0x7f7c240bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:45.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.204+0000 7f7c2899d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2406a5b0 con 0x7f7c2414b010 2023-12-19T19:01:45.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.204+0000 7f7c2899d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2406b710 con 0x7f7c24157c20 2023-12-19T19:01:45.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c2899d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c240c1d60 con 0x7f7c24073a70 2023-12-19T19:01:45.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c2259c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7c2414b010 0x7f7c2406b000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42412/0 (socket says 172.21.15.133:42412) 2023-12-19T19:01:45.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c2259c640 1 -- 172.21.15.133:0/1515125515 learned_addr learned my addr 172.21.15.133:0/1515125515 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:45.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c19d9b640 1 --2- 172.21.15.133:0/1515125515 >> v2:172.21.15.138:3300/0 conn(0x7f7c24073a70 0x7f7c240bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:45.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c21d9b640 1 -- 172.21.15.133:0/1515125515 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4224895895 0 0) 0x7f7c2406a5b0 con 0x7f7c2414b010 2023-12-19T19:01:45.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c21d9b640 1 -- 172.21.15.133:0/1515125515 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c10003530 con 0x7f7c2414b010 2023-12-19T19:01:45.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c21d9b640 1 -- 172.21.15.133:0/1515125515 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 415044511 0 0) 0x7f7c2406b710 con 0x7f7c24157c20 2023-12-19T19:01:45.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c21d9b640 1 -- 172.21.15.133:0/1515125515 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c2406a5b0 con 0x7f7c24157c20 2023-12-19T19:01:45.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c21d9b640 1 -- 172.21.15.133:0/1515125515 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2460395566 0 0) 0x7f7c10003530 con 0x7f7c2414b010 2023-12-19T19:01:45.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c21d9b640 1 -- 172.21.15.133:0/1515125515 >> v2:172.21.15.138:3300/0 conn(0x7f7c24073a70 msgr2=0x7f7c240bf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:45.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c21d9b640 1 --2- 172.21.15.133:0/1515125515 >> v2:172.21.15.138:3300/0 conn(0x7f7c24073a70 0x7f7c240bf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c21d9b640 1 -- 172.21.15.133:0/1515125515 >> v1:172.21.15.138:6789/0 conn(0x7f7c24157c20 legacy=0x7f7c24158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:45.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c21d9b640 1 -- 172.21.15.133:0/1515125515 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c240c2040 con 0x7f7c2414b010 2023-12-19T19:01:45.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c21d9b640 1 -- 172.21.15.133:0/1515125515 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f7c0c001600 con 0x7f7c2414b010 2023-12-19T19:01:45.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c19d9b640 1 --2- 172.21.15.133:0/1515125515 >> v2:172.21.15.138:3300/0 conn(0x7f7c24073a70 0x7f7c240bf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:01:45.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c21d9b640 1 -- 172.21.15.133:0/1515125515 >> v1:172.21.15.133:6789/0 conn(0x7f7c2414b010 legacy=0x7f7c2406b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:45.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c21d9b640 1 --2- 172.21.15.133:0/1515125515 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c10003b60 0x7f7c10003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:45.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c21d9b640 1 --2- 172.21.15.133:0/1515125515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c100047d0 0x7f7c10004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:45.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c21d9b640 1 --2- 172.21.15.133:0/1515125515 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c10005190 0x7f7c1000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:45.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c21d9b640 1 -- 172.21.15.133:0/1515125515 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c240c1d60 con 0x7f7c100047d0 2023-12-19T19:01:45.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c21d9b640 1 -- 172.21.15.133:0/1515125515 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1000bfb0 con 0x7f7c10003b60 2023-12-19T19:01:45.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c21d9b640 1 -- 172.21.15.133:0/1515125515 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1000c170 con 0x7f7c10005190 2023-12-19T19:01:45.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c19d9b640 1 --2- 172.21.15.133:0/1515125515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c100047d0 0x7f7c10004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:45.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c2259c640 1 --2- 172.21.15.133:0/1515125515 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c10003b60 0x7f7c10003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:45.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c22d9d640 1 --2- 172.21.15.133:0/1515125515 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c10005190 0x7f7c1000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:45.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c19d9b640 1 -- 172.21.15.133:0/1515125515 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c10005190 msgr2=0x7f7c1000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:45.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c19d9b640 1 --2- 172.21.15.133:0/1515125515 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c10005190 0x7f7c1000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c19d9b640 1 -- 172.21.15.133:0/1515125515 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c10003b60 msgr2=0x7f7c10003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:45.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c19d9b640 1 --2- 172.21.15.133:0/1515125515 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c10003b60 0x7f7c10003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c19d9b640 1 -- 172.21.15.133:0/1515125515 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c10003530 con 0x7f7c100047d0 2023-12-19T19:01:45.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c22d9d640 1 --2- 172.21.15.133:0/1515125515 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c10005190 0x7f7c1000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:45.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.208+0000 7f7c22d9d640 1 -- 172.21.15.133:0/1515125515 reap_dead start 2023-12-19T19:01:45.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.212+0000 7f7c19d9b640 1 --2- 172.21.15.133:0/1515125515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c100047d0 0x7f7c10004c50 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f7c14009cb0 tx=0x7f7c1401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1902228d524cc0b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:45.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.212+0000 7f7c21d9b640 1 -- 172.21.15.133:0/1515125515 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c140a55e0 con 0x7f7c100047d0 2023-12-19T19:01:45.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.212+0000 7f7c21d9b640 1 -- 172.21.15.133:0/1515125515 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c140a5740 con 0x7f7c100047d0 2023-12-19T19:01:45.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.212+0000 7f7c21d9b640 1 -- 172.21.15.133:0/1515125515 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c140a5b30 con 0x7f7c100047d0 2023-12-19T19:01:45.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.212+0000 7f7c2899d640 1 -- 172.21.15.133:0/1515125515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c100047d0 msgr2=0x7f7c10004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:45.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.212+0000 7f7c2899d640 1 --2- 172.21.15.133:0/1515125515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c100047d0 0x7f7c10004c50 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f7c14009cb0 tx=0x7f7c1401c930 comp rx=0 tx=0).stop 2023-12-19T19:01:45.217 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.212+0000 7f7c2899d640 1 -- 172.21.15.133:0/1515125515 shutdown_connections 2023-12-19T19:01:45.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.212+0000 7f7c2899d640 1 --2- 172.21.15.133:0/1515125515 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c100047d0 0x7f7c10004c50 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.212+0000 7f7c2899d640 1 -- 172.21.15.133:0/1515125515 >> 172.21.15.133:0/1515125515 conn(0x7f7c240c30c0 msgr2=0x7f7c240c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:45.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.212+0000 7f7c2899d640 1 -- 172.21.15.133:0/1515125515 shutdown_connections 2023-12-19T19:01:45.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.212+0000 7f7c2899d640 1 -- 172.21.15.133:0/1515125515 wait complete. 2023-12-19T19:01:45.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.212+0000 7f7c2899d640 1 Processor -- start 2023-12-19T19:01:45.218 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.212+0000 7f7c2899d640 1 -- start start 2023-12-19T19:01:45.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c2899d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c100047d0 0x7f7c2414b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:45.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c2899d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c241ed520 0x7f7c241ed9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:45.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c2899d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c24146d00 0x7f7c24147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:45.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c2899d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c24155140 con 0x7f7c24146d00 2023-12-19T19:01:45.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c2899d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c240a9ff0 con 0x7f7c100047d0 2023-12-19T19:01:45.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c2899d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c241476c0 con 0x7f7c241ed520 2023-12-19T19:01:45.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c22d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c24146d00 0x7f7c24147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:45.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c19d9b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c241ed520 0x7f7c241ed9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:45.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c22d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c24146d00 0x7f7c24147180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58360/0 (socket says 172.21.15.133:58360) 2023-12-19T19:01:45.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c22d9d640 1 -- 172.21.15.133:0/2638863979 learned_addr learned my addr 172.21.15.133:0/2638863979 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:45.220 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c2259c640 1 --2- 172.21.15.133:0/2638863979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c100047d0 0x7f7c2414b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:45.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c19d9b640 1 -- 172.21.15.133:0/2638863979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c100047d0 msgr2=0x7f7c2414b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:45.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c19d9b640 1 --2- 172.21.15.133:0/2638863979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c100047d0 0x7f7c2414b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c19d9b640 1 -- 172.21.15.133:0/2638863979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c24146d00 msgr2=0x7f7c24147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:45.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c19d9b640 1 --2- 172.21.15.133:0/2638863979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c24146d00 0x7f7c24147180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c19d9b640 1 -- 172.21.15.133:0/2638863979 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c24155320 con 0x7f7c241ed520 2023-12-19T19:01:45.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c22d9d640 1 --2- 172.21.15.133:0/2638863979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c24146d00 0x7f7c24147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:01:45.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c19d9b640 1 --2- 172.21.15.133:0/2638863979 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c241ed520 0x7f7c241ed9a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7c140ac000 tx=0x7f7c140196d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:45.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c1b7fe640 1 -- 172.21.15.133:0/2638863979 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c140b8650 con 0x7f7c241ed520 2023-12-19T19:01:45.222 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c1b7fe640 1 -- 172.21.15.133:0/2638863979 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c140b87d0 con 0x7f7c241ed520 2023-12-19T19:01:45.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c2899d640 1 -- 172.21.15.133:0/2638863979 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c241edfb0 con 0x7f7c241ed520 2023-12-19T19:01:45.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c1b7fe640 1 -- 172.21.15.133:0/2638863979 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c140b8b80 con 0x7f7c241ed520 2023-12-19T19:01:45.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c2899d640 1 -- 172.21.15.133:0/2638863979 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c241566a0 con 0x7f7c241ed520 2023-12-19T19:01:45.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.216+0000 7f7c2899d640 1 -- 172.21.15.133:0/2638863979 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c24072c00 con 0x7f7c241ed520 2023-12-19T19:01:45.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.220+0000 7f7c1b7fe640 1 -- 172.21.15.133:0/2638863979 <== mon.2 v2:172.21.15.138:3301/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7c140b4070 con 0x7f7c241ed520 2023-12-19T19:01:45.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.220+0000 7f7c1b7fe640 1 --2- 172.21.15.133:0/2638863979 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7c04066470 0x7f7c04068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:45.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.220+0000 7f7c1b7fe640 1 -- 172.21.15.133:0/2638863979 <== mon.2 v2:172.21.15.138:3301/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c1411e1c0 con 0x7f7c241ed520 2023-12-19T19:01:45.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.220+0000 7f7c2259c640 1 --2- 172.21.15.133:0/2638863979 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7c04066470 0x7f7c04068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:45.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.220+0000 7f7c2259c640 1 --2- 172.21.15.133:0/2638863979 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7c04066470 0x7f7c04068930 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c000c10 tx=0x7f7c0c001950 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:45.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.224+0000 7f7c1b7fe640 1 -- 172.21.15.133:0/2638863979 <== mon.2 v2:172.21.15.138:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7c140eb710 con 0x7f7c241ed520 2023-12-19T19:01:45.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.428+0000 7f7c2899d640 1 -- 172.21.15.133:0/2638863979 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7c241ee140 con 0x7f7c241ed520 2023-12-19T19:01:45.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.436+0000 7f7c1b7fe640 1 -- 172.21.15.133:0/2638863979 <== mon.2 v2:172.21.15.138:3301/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7f7c140eed30 con 0x7f7c241ed520 2023-12-19T19:01:45.440 INFO:teuthology.orchestra.run.smithi133.stdout:[client.0] 2023-12-19T19:01:45.440 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCn54FllfQwNxAAyKIESQDxKvDHfaewx+v88w== 2023-12-19T19:01:45.440 INFO:teuthology.orchestra.run.smithi133.stdout: caps mds = "allow" 2023-12-19T19:01:45.440 INFO:teuthology.orchestra.run.smithi133.stdout: caps mon = "allow r" 2023-12-19T19:01:45.440 INFO:teuthology.orchestra.run.smithi133.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-19T19:01:45.440 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.0 2023-12-19T19:01:45.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.436+0000 7f7c2899d640 1 -- 172.21.15.133:0/2638863979 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7c04066470 msgr2=0x7f7c04068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:45.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.436+0000 7f7c2899d640 1 --2- 172.21.15.133:0/2638863979 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7c04066470 0x7f7c04068930 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c000c10 tx=0x7f7c0c001950 comp rx=0 tx=0).stop 2023-12-19T19:01:45.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.436+0000 7f7c2899d640 1 -- 172.21.15.133:0/2638863979 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c241ed520 msgr2=0x7f7c241ed9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:45.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.436+0000 7f7c2899d640 1 --2- 172.21.15.133:0/2638863979 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c241ed520 0x7f7c241ed9a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7c140ac000 tx=0x7f7c140196d0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.436+0000 7f7c2899d640 1 -- 172.21.15.133:0/2638863979 shutdown_connections 2023-12-19T19:01:45.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.436+0000 7f7c2899d640 1 --2- 172.21.15.133:0/2638863979 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7c04066470 0x7f7c04068930 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.436+0000 7f7c2899d640 1 --2- 172.21.15.133:0/2638863979 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7c24146d00 0x7f7c24147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.436+0000 7f7c2899d640 1 --2- 172.21.15.133:0/2638863979 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7c241ed520 0x7f7c241ed9a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.436+0000 7f7c2899d640 1 --2- 172.21.15.133:0/2638863979 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7c100047d0 0x7f7c2414b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.436+0000 7f7c2899d640 1 -- 172.21.15.133:0/2638863979 >> 172.21.15.133:0/2638863979 conn(0x7f7c240c30c0 msgr2=0x7f7c240bff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:45.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.436+0000 7f7c2899d640 1 -- 172.21.15.133:0/2638863979 shutdown_connections 2023-12-19T19:01:45.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.436+0000 7f7c2899d640 1 -- 172.21.15.133:0/2638863979 wait complete. 2023-12-19T19:01:45.461 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:01:45.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.596+0000 7f3b27fd1640 1 Processor -- start 2023-12-19T19:01:45.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.596+0000 7f3b27fd1640 1 -- start start 2023-12-19T19:01:45.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.596+0000 7f3b27fd1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3b200c7ed0 0x7f3b20154650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:45.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.596+0000 7f3b27fd1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b200bd660 0x7f3b20154b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:45.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.596+0000 7f3b27fd1640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b200ac4f0 con 0x7f3b20151dc0 2023-12-19T19:01:45.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.596+0000 7f3b27fd1640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b20158780 con 0x7f3b200c7ed0 2023-12-19T19:01:45.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.596+0000 7f3b27fd1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b20158a60 con 0x7f3b200bd660 2023-12-19T19:01:45.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.596+0000 7f3b2556c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3b200c7ed0 0x7f3b20154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:45.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.596+0000 7f3b2556c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3b200c7ed0 0x7f3b20154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58370/0 (socket says 172.21.15.133:58370) 2023-12-19T19:01:45.601 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.596+0000 7f3b2556c640 1 -- 172.21.15.133:0/560457710 learned_addr learned my addr 172.21.15.133:0/560457710 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:45.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.596+0000 7f3b2656e640 1 --2- 172.21.15.133:0/560457710 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b200bd660 0x7f3b20154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:45.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.596+0000 7f3b2556c640 1 -- 172.21.15.133:0/560457710 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b200bd660 msgr2=0x7f3b20154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:45.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.596+0000 7f3b2556c640 1 --2- 172.21.15.133:0/560457710 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b200bd660 0x7f3b20154b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.596+0000 7f3b2556c640 1 -- 172.21.15.133:0/560457710 >> v1:172.21.15.138:6789/0 conn(0x7f3b20151dc0 legacy=0x7f3b200c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:45.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.596+0000 7f3b2556c640 1 -- 172.21.15.133:0/560457710 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b200ac180 con 0x7f3b200c7ed0 2023-12-19T19:01:45.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.596+0000 7f3b2656e640 1 --2- 172.21.15.133:0/560457710 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b200bd660 0x7f3b20154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:45.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.600+0000 7f3b2556c640 1 --2- 172.21.15.133:0/560457710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b200c7ed0 0x7f3b20154650 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3b100098a0 tx=0x7f3b1001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0b788c3a038c31 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:45.604 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.600+0000 7f3b24d6b640 1 -- 172.21.15.133:0/560457710 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b100ab600 con 0x7f3b200c7ed0 2023-12-19T19:01:45.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.600+0000 7f3b24d6b640 1 -- 172.21.15.133:0/560457710 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b100a7050 con 0x7f3b200c7ed0 2023-12-19T19:01:45.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.600+0000 7f3b24d6b640 1 -- 172.21.15.133:0/560457710 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b100ab980 con 0x7f3b200c7ed0 2023-12-19T19:01:45.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.600+0000 7f3b27fd1640 1 -- 172.21.15.133:0/560457710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b200c7ed0 msgr2=0x7f3b20154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:45.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.600+0000 7f3b27fd1640 1 --2- 172.21.15.133:0/560457710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b200c7ed0 0x7f3b20154650 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f3b100098a0 tx=0x7f3b1001c3c0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.600+0000 7f3b27fd1640 1 -- 172.21.15.133:0/560457710 shutdown_connections 2023-12-19T19:01:45.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.600+0000 7f3b27fd1640 1 --2- 172.21.15.133:0/560457710 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b200bd660 0x7f3b20154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.600+0000 7f3b27fd1640 1 --2- 172.21.15.133:0/560457710 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b200c7ed0 0x7f3b20154650 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.600+0000 7f3b27fd1640 1 -- 172.21.15.133:0/560457710 >> 172.21.15.133:0/560457710 conn(0x7f3b20071eb0 msgr2=0x7f3b200722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:45.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.600+0000 7f3b27fd1640 1 -- 172.21.15.133:0/560457710 shutdown_connections 2023-12-19T19:01:45.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.600+0000 7f3b27fd1640 1 -- 172.21.15.133:0/560457710 wait complete. 2023-12-19T19:01:45.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.600+0000 7f3b27fd1640 1 Processor -- start 2023-12-19T19:01:45.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b27fd1640 1 -- start start 2023-12-19T19:01:45.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b27fd1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b200bd660 0x7f3b201eda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:45.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b27fd1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b200c7ed0 0x7f3b200aada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:45.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b27fd1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b20151dc0 0x7f3b201529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:45.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b27fd1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b201edf70 con 0x7f3b200bd660 2023-12-19T19:01:45.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b27fd1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b200c13f0 con 0x7f3b200c7ed0 2023-12-19T19:01:45.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b27fd1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b201539b0 con 0x7f3b20151dc0 2023-12-19T19:01:45.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b25d6d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b200bd660 0x7f3b201eda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:45.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b25d6d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b200bd660 0x7f3b201eda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58386/0 (socket says 172.21.15.133:58386) 2023-12-19T19:01:45.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b25d6d640 1 -- 172.21.15.133:0/4257624879 learned_addr learned my addr 172.21.15.133:0/4257624879 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:45.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b2656e640 1 --2- 172.21.15.133:0/4257624879 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b20151dc0 0x7f3b201529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:45.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b2556c640 1 --2- 172.21.15.133:0/4257624879 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b200c7ed0 0x7f3b200aada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:45.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b25d6d640 1 -- 172.21.15.133:0/4257624879 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b20151dc0 msgr2=0x7f3b201529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:45.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b25d6d640 1 --2- 172.21.15.133:0/4257624879 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b20151dc0 0x7f3b201529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b25d6d640 1 -- 172.21.15.133:0/4257624879 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b200c7ed0 msgr2=0x7f3b200aada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:45.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b25d6d640 1 --2- 172.21.15.133:0/4257624879 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b200c7ed0 0x7f3b200aada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b25d6d640 1 -- 172.21.15.133:0/4257624879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b100094d0 con 0x7f3b200bd660 2023-12-19T19:01:45.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b2556c640 1 --2- 172.21.15.133:0/4257624879 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b200c7ed0 0x7f3b200aada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:45.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b25d6d640 1 --2- 172.21.15.133:0/4257624879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b200bd660 0x7f3b201eda30 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00c480 tx=0x7f3b1c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:45.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b167fc640 1 -- 172.21.15.133:0/4257624879 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c012830 con 0x7f3b200bd660 2023-12-19T19:01:45.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b167fc640 1 -- 172.21.15.133:0/4257624879 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c0129b0 con 0x7f3b200bd660 2023-12-19T19:01:45.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b167fc640 1 -- 172.21.15.133:0/4257624879 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c012d60 con 0x7f3b200bd660 2023-12-19T19:01:45.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b27fd1640 1 -- 172.21.15.133:0/4257624879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b20153c90 con 0x7f3b200bd660 2023-12-19T19:01:45.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b27fd1640 1 -- 172.21.15.133:0/4257624879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b20154250 con 0x7f3b200bd660 2023-12-19T19:01:45.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.604+0000 7f3b27fd1640 1 -- 172.21.15.133:0/4257624879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b20068400 con 0x7f3b200bd660 2023-12-19T19:01:45.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.608+0000 7f3b167fc640 1 -- 172.21.15.133:0/4257624879 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3b1c01c460 con 0x7f3b200bd660 2023-12-19T19:01:45.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.608+0000 7f3b167fc640 1 --2- 172.21.15.133:0/4257624879 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3b04066470 0x7f3b04068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:45.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.608+0000 7f3b167fc640 1 -- 172.21.15.133:0/4257624879 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b1c083d20 con 0x7f3b200bd660 2023-12-19T19:01:45.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.608+0000 7f3b2556c640 1 --2- 172.21.15.133:0/4257624879 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3b04066470 0x7f3b04068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:45.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.608+0000 7f3b2556c640 1 --2- 172.21.15.133:0/4257624879 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3b04066470 0x7f3b04068930 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3b100ad000 tx=0x7f3b100a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:45.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.612+0000 7f3b167fc640 1 -- 172.21.15.133:0/4257624879 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f3b1c051190 con 0x7f3b200bd660 2023-12-19T19:01:45.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.792+0000 7f3b27fd1640 1 -- 172.21.15.133:0/4257624879 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b2006c9a0 con 0x7f3b200bd660 2023-12-19T19:01:45.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.792+0000 7f3b167fc640 1 -- 172.21.15.133:0/4257624879 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4952 (secure 0 0 0) 0x7f3b1c0547b0 con 0x7f3b200bd660 2023-12-19T19:01:45.800 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:45.800 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/2119189888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":2119189888},{"type":"v1","addr":"172.21.15.133:6835","nonce":2119189888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/4005236173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":4005236173},{"type":"v1","addr":"172.21.15.138:6835","nonce":4005236173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5765,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/1466041773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":1466041773},{"type":"v1","addr":"172.21.15.138:6837","nonce":1466041773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:01:35.356022+0000","modified":"2023-12-19T19:01:38.376795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6834/2813206606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2813206606},{"type":"v1","addr":"172.21.15.133:6834","nonce":2813206606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T19:01:45.801 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 48 2023-12-19T19:01:45.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.796+0000 7f3b27fd1640 1 -- 172.21.15.133:0/4257624879 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3b04066470 msgr2=0x7f3b04068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:45.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.796+0000 7f3b27fd1640 1 --2- 172.21.15.133:0/4257624879 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3b04066470 0x7f3b04068930 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f3b100ad000 tx=0x7f3b100a6000 comp rx=0 tx=0).stop 2023-12-19T19:01:45.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.796+0000 7f3b27fd1640 1 -- 172.21.15.133:0/4257624879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b200bd660 msgr2=0x7f3b201eda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:45.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.796+0000 7f3b27fd1640 1 --2- 172.21.15.133:0/4257624879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b200bd660 0x7f3b201eda30 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00c480 tx=0x7f3b1c00c940 comp rx=0 tx=0).stop 2023-12-19T19:01:45.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.796+0000 7f3b27fd1640 1 -- 172.21.15.133:0/4257624879 shutdown_connections 2023-12-19T19:01:45.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.796+0000 7f3b27fd1640 1 --2- 172.21.15.133:0/4257624879 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3b04066470 0x7f3b04068930 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.796+0000 7f3b27fd1640 1 --2- 172.21.15.133:0/4257624879 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3b20151dc0 0x7f3b201529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.796+0000 7f3b27fd1640 1 --2- 172.21.15.133:0/4257624879 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3b200c7ed0 0x7f3b200aada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.796+0000 7f3b27fd1640 1 --2- 172.21.15.133:0/4257624879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3b200bd660 0x7f3b201eda30 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:45.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.796+0000 7f3b27fd1640 1 -- 172.21.15.133:0/4257624879 >> 172.21.15.133:0/4257624879 conn(0x7f3b20071eb0 msgr2=0x7f3b200c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:45.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.796+0000 7f3b27fd1640 1 -- 172.21.15.133:0/4257624879 shutdown_connections 2023-12-19T19:01:45.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:45.796+0000 7f3b27fd1640 1 -- 172.21.15.133:0/4257624879 wait complete. 2023-12-19T19:01:46.222 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T19:01:35.356022+0000', 'modified': '2023-12-19T19:01:38.376795+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6507}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6507': {'gid': 6507, 'name': 'c', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.133:6834/2813206606', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.133:6832', 'nonce': 2813206606}, {'type': 'v1', 'addr': '172.21.15.133:6834', 'nonce': 2813206606}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T19:01:46.222 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T19:01:46.223 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-19T19:01:46.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.356+0000 7f9b707f8640 1 Processor -- start 2023-12-19T19:01:46.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.360+0000 7f9b707f8640 1 -- start start 2023-12-19T19:01:46.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.360+0000 7f9b707f8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9b68151e90 0x7f9b680c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.360+0000 7f9b707f8640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b6806c860 con 0x7f9b680c4e60 2023-12-19T19:01:46.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.360+0000 7f9b707f8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b68154930 con 0x7f9b680c7ea0 2023-12-19T19:01:46.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.360+0000 7f9b707f8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b680c8750 con 0x7f9b68151e90 2023-12-19T19:01:46.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.360+0000 7f9b6ed95640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f9b680c4e60 0x7f9b6815f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42418/0 (socket says 172.21.15.133:42418) 2023-12-19T19:01:46.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.360+0000 7f9b6ed95640 1 -- 172.21.15.133:0/1447214416 learned_addr learned my addr 172.21.15.133:0/1447214416 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:46.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.360+0000 7f9b6e594640 1 --2- 172.21.15.133:0/1447214416 >> v2:172.21.15.138:3300/0 conn(0x7f9b68151e90 0x7f9b680c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.360+0000 7f9b6d592640 1 -- 172.21.15.133:0/1447214416 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107835491 0 0) 0x7f9b6806c860 con 0x7f9b680c4e60 2023-12-19T19:01:46.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.360+0000 7f9b6d592640 1 -- 172.21.15.133:0/1447214416 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b54003530 con 0x7f9b680c4e60 2023-12-19T19:01:46.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.360+0000 7f9b6d592640 1 -- 172.21.15.133:0/1447214416 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969291433 0 0) 0x7f9b68154930 con 0x7f9b680c7ea0 2023-12-19T19:01:46.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.360+0000 7f9b6d592640 1 -- 172.21.15.133:0/1447214416 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b6806c860 con 0x7f9b680c7ea0 2023-12-19T19:01:46.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.360+0000 7f9b6e594640 1 -- 172.21.15.133:0/1447214416 >> v1:172.21.15.138:6789/0 conn(0x7f9b680c7ea0 legacy=0x7f9b6806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:46.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.360+0000 7f9b6e594640 1 -- 172.21.15.133:0/1447214416 >> v1:172.21.15.133:6789/0 conn(0x7f9b680c4e60 legacy=0x7f9b6815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:46.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.360+0000 7f9b6e594640 1 -- 172.21.15.133:0/1447214416 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b68154c10 con 0x7f9b68151e90 2023-12-19T19:01:46.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.364+0000 7f9b6e594640 1 --2- 172.21.15.133:0/1447214416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b68151e90 0x7f9b680c4920 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9b640097c0 tx=0x7f9b6401c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9f3f57ef727af3b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:46.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.364+0000 7f9b6d592640 1 -- 172.21.15.133:0/1447214416 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b640ab600 con 0x7f9b68151e90 2023-12-19T19:01:46.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.364+0000 7f9b6d592640 1 -- 172.21.15.133:0/1447214416 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b640a7050 con 0x7f9b68151e90 2023-12-19T19:01:46.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.364+0000 7f9b6d592640 1 -- 172.21.15.133:0/1447214416 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b640ab980 con 0x7f9b68151e90 2023-12-19T19:01:46.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.364+0000 7f9b707f8640 1 -- 172.21.15.133:0/1447214416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b68151e90 msgr2=0x7f9b680c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:46.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.364+0000 7f9b707f8640 1 --2- 172.21.15.133:0/1447214416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b68151e90 0x7f9b680c4920 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9b640097c0 tx=0x7f9b6401c360 comp rx=0 tx=0).stop 2023-12-19T19:01:46.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.364+0000 7f9b707f8640 1 -- 172.21.15.133:0/1447214416 shutdown_connections 2023-12-19T19:01:46.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.364+0000 7f9b707f8640 1 --2- 172.21.15.133:0/1447214416 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b68151e90 0x7f9b680c4920 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.364+0000 7f9b707f8640 1 -- 172.21.15.133:0/1447214416 >> 172.21.15.133:0/1447214416 conn(0x7f9b680ca170 msgr2=0x7f9b680ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:46.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.364+0000 7f9b707f8640 1 -- 172.21.15.133:0/1447214416 shutdown_connections 2023-12-19T19:01:46.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.364+0000 7f9b707f8640 1 -- 172.21.15.133:0/1447214416 wait complete. 2023-12-19T19:01:46.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.364+0000 7f9b707f8640 1 Processor -- start 2023-12-19T19:01:46.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.368+0000 7f9b707f8640 1 -- start start 2023-12-19T19:01:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.368+0000 7f9b707f8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b680c4e60 0x7f9b680af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.368+0000 7f9b707f8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b680c7ea0 0x7f9b681f0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.368+0000 7f9b707f8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9b68151e90 0x7f9b681f1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.368+0000 7f9b707f8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b681552d0 con 0x7f9b680c4e60 2023-12-19T19:01:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.368+0000 7f9b707f8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6814a010 con 0x7f9b680c7ea0 2023-12-19T19:01:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.368+0000 7f9b707f8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6814ae70 con 0x7f9b68151e90 2023-12-19T19:01:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.368+0000 7f9b6e594640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b680c4e60 0x7f9b680af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.368+0000 7f9b6e594640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b680c4e60 0x7f9b680af390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58398/0 (socket says 172.21.15.133:58398) 2023-12-19T19:01:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.368+0000 7f9b6e594640 1 -- 172.21.15.133:0/3287633458 learned_addr learned my addr 172.21.15.133:0/3287633458 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.368+0000 7f9b6e594640 1 -- 172.21.15.133:0/3287633458 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9b68151e90 msgr2=0x7f9b681f1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.368+0000 7f9b6e594640 1 --2- 172.21.15.133:0/3287633458 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9b68151e90 0x7f9b681f1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.368+0000 7f9b6e594640 1 -- 172.21.15.133:0/3287633458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b680c7ea0 msgr2=0x7f9b681f0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:46.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.368+0000 7f9b6dd93640 1 --2- 172.21.15.133:0/3287633458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b680c7ea0 0x7f9b681f0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.368+0000 7f9b6e594640 1 --2- 172.21.15.133:0/3287633458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b680c7ea0 0x7f9b681f0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.368+0000 7f9b6e594640 1 -- 172.21.15.133:0/3287633458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b64009420 con 0x7f9b680c4e60 2023-12-19T19:01:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.368+0000 7f9b6dd93640 1 --2- 172.21.15.133:0/3287633458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b680c7ea0 0x7f9b681f0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:46.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.368+0000 7f9b6e594640 1 --2- 172.21.15.133:0/3287633458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b680c4e60 0x7f9b680af390 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9b64018f70 tx=0x7f9b6401aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:46.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.368+0000 7f9b5effd640 1 -- 172.21.15.133:0/3287633458 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b640abd20 con 0x7f9b680c4e60 2023-12-19T19:01:46.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.368+0000 7f9b5effd640 1 -- 172.21.15.133:0/3287633458 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b640b7450 con 0x7f9b680c4e60 2023-12-19T19:01:46.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.368+0000 7f9b707f8640 1 -- 172.21.15.133:0/3287633458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b681f1560 con 0x7f9b680c4e60 2023-12-19T19:01:46.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.368+0000 7f9b5effd640 1 -- 172.21.15.133:0/3287633458 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b640abea0 con 0x7f9b680c4e60 2023-12-19T19:01:46.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.368+0000 7f9b707f8640 1 -- 172.21.15.133:0/3287633458 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6814a540 con 0x7f9b680c4e60 2023-12-19T19:01:46.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.372+0000 7f9b5effd640 1 -- 172.21.15.133:0/3287633458 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9b640b7800 con 0x7f9b680c4e60 2023-12-19T19:01:46.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.372+0000 7f9b5effd640 1 --2- 172.21.15.133:0/3287633458 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9b4c066470 0x7f9b4c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.372+0000 7f9b5effd640 1 -- 172.21.15.133:0/3287633458 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b6411e2a0 con 0x7f9b680c4e60 2023-12-19T19:01:46.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.372+0000 7f9b73b6c000 1 Processor -- start 2023-12-19T19:01:46.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.372+0000 7f9b6dd93640 1 --2- 172.21.15.133:0/3287633458 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9b4c066470 0x7f9b4c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.372+0000 7f9b73b6c000 1 -- start start 2023-12-19T19:01:46.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.372+0000 7f9b6dd93640 1 --2- 172.21.15.133:0/3287633458 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9b4c066470 0x7f9b4c068930 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9b681546b0 tx=0x7f9b58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:46.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.372+0000 7f9b73b6c000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564cbc2ef650 0x564cbc2efa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.372+0000 7f9b73b6c000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2eff70 0x564cbc2f0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.372+0000 7f9b73b6c000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564cbc2f0890 0x564cbc339de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.372+0000 7f9b73b6c000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cbc1b9f00 con 0x564cbc2eff70 2023-12-19T19:01:46.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.372+0000 7f9b73b6c000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cbc149dd0 con 0x564cbc2ef650 2023-12-19T19:01:46.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.372+0000 7f9b73b6c000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x564cbc147300 con 0x564cbc2f0890 2023-12-19T19:01:46.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.372+0000 7f9b6dd93640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2eff70 0x564cbc2f0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.372+0000 7f9b6dd93640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2eff70 0x564cbc2f0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58406/0 (socket says 172.21.15.133:58406) 2023-12-19T19:01:46.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.372+0000 7f9b6dd93640 1 -- 172.21.15.133:0/995020880 learned_addr learned my addr 172.21.15.133:0/995020880 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:46.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.372+0000 7f9b6ed95640 1 --2- 172.21.15.133:0/995020880 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564cbc2f0890 0x564cbc339de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.372+0000 7f9b6e594640 1 --2- 172.21.15.133:0/995020880 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564cbc2ef650 0x564cbc2efa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.372+0000 7f9b6dd93640 1 -- 172.21.15.133:0/995020880 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564cbc2f0890 msgr2=0x564cbc339de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:46.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b6dd93640 1 --2- 172.21.15.133:0/995020880 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564cbc2f0890 0x564cbc339de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b6dd93640 1 -- 172.21.15.133:0/995020880 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564cbc2ef650 msgr2=0x564cbc2efa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:46.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b6dd93640 1 --2- 172.21.15.133:0/995020880 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564cbc2ef650 0x564cbc2efa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b6dd93640 1 -- 172.21.15.133:0/995020880 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cbbe3a890 con 0x564cbc2eff70 2023-12-19T19:01:46.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b6dd93640 1 --2- 172.21.15.133:0/995020880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2eff70 0x564cbc2f0350 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f9b58001df0 tx=0x7f9b58010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01b6a490f5369a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:46.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b4bfff640 1 -- 172.21.15.133:0/995020880 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b58014a20 con 0x564cbc2eff70 2023-12-19T19:01:46.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b4bfff640 1 -- 172.21.15.133:0/995020880 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b58014b80 con 0x564cbc2eff70 2023-12-19T19:01:46.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b4bfff640 1 -- 172.21.15.133:0/995020880 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b5801f400 con 0x564cbc2eff70 2023-12-19T19:01:46.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b73b6c000 1 -- 172.21.15.133:0/995020880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2eff70 msgr2=0x564cbc2f0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:46.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b73b6c000 1 --2- 172.21.15.133:0/995020880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2eff70 0x564cbc2f0350 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f9b58001df0 tx=0x7f9b58010000 comp rx=0 tx=0).stop 2023-12-19T19:01:46.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b73b6c000 1 -- 172.21.15.133:0/995020880 shutdown_connections 2023-12-19T19:01:46.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b73b6c000 1 --2- 172.21.15.133:0/995020880 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564cbc2f0890 0x564cbc339de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b73b6c000 1 --2- 172.21.15.133:0/995020880 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2eff70 0x564cbc2f0350 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b73b6c000 1 --2- 172.21.15.133:0/995020880 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564cbc2ef650 0x564cbc2efa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b73b6c000 1 -- 172.21.15.133:0/995020880 >> 172.21.15.133:0/995020880 conn(0x564cbc2f82f0 msgr2=0x564cbc32fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:46.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b73b6c000 1 -- 172.21.15.133:0/995020880 shutdown_connections 2023-12-19T19:01:46.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b73b6c000 1 -- 172.21.15.133:0/995020880 wait complete. 2023-12-19T19:01:46.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b73b6c000 1 -- start start 2023-12-19T19:01:46.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b73b6c000 1 Processor -- start 2023-12-19T19:01:46.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b73b6c000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564cbc2ef650 0x564cbc2f4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b73b6c000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2eff70 0x564cbc2f4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b73b6c000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564cbc2f0890 0x564cbc2f4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b73b6c000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cbc142bf0 con 0x564cbc2eff70 2023-12-19T19:01:46.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b73b6c000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cbc0fac60 con 0x564cbc2f0890 2023-12-19T19:01:46.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b73b6c000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x564cbc100b00 con 0x564cbc2ef650 2023-12-19T19:01:46.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b73b6c000 10 client.0 _ll_register_callbacks cb 0x564cbc2dd710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T19:01:46.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b6dd93640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2eff70 0x564cbc2f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b6dd93640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2eff70 0x564cbc2f4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58410/0 (socket says 172.21.15.133:58410) 2023-12-19T19:01:46.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b6dd93640 1 -- 172.21.15.133:0/2595066740 learned_addr learned my addr 172.21.15.133:0/2595066740 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:46.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b6ed95640 1 --2- 172.21.15.133:0/2595066740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564cbc2f0890 0x564cbc2f4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.376+0000 7f9b6e594640 1 --2- 172.21.15.133:0/2595066740 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564cbc2ef650 0x564cbc2f4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b6dd93640 1 -- 172.21.15.133:0/2595066740 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564cbc2ef650 msgr2=0x564cbc2f4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:46.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b6dd93640 1 --2- 172.21.15.133:0/2595066740 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564cbc2ef650 0x564cbc2f4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b6dd93640 1 -- 172.21.15.133:0/2595066740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564cbc2f0890 msgr2=0x564cbc2f4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:46.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b6dd93640 1 --2- 172.21.15.133:0/2595066740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564cbc2f0890 0x564cbc2f4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b6dd93640 1 -- 172.21.15.133:0/2595066740 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6806c860 con 0x564cbc2eff70 2023-12-19T19:01:46.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b6dd93640 1 --2- 172.21.15.133:0/2595066740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2eff70 0x564cbc2f4940 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f9b58001ec0 tx=0x7f9b58014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd5c1d081fa2536 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:46.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b497fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-19T19:01:46.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b497fa640 1 -- 172.21.15.133:0/2595066740 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b58005070 con 0x564cbc2eff70 2023-12-19T19:01:46.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b497fa640 1 -- 172.21.15.133:0/2595066740 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b580051d0 con 0x564cbc2eff70 2023-12-19T19:01:46.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b73b6c000 1 -- 172.21.15.133:0/2595066740 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564cbc100490 con 0x564cbc2eff70 2023-12-19T19:01:46.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b497fa640 1 -- 172.21.15.133:0/2595066740 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b580053d0 con 0x564cbc2eff70 2023-12-19T19:01:46.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b73b6c000 10 client.6675 fetch_fsmap learned FSMap version 48 2023-12-19T19:01:46.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b73b6c000 1 -- 172.21.15.133:0/2595066740 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x564cbc103200 con 0x564cbc2eff70 2023-12-19T19:01:46.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b497fa640 1 -- 172.21.15.133:0/2595066740 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564cbc100490 con 0x564cbc2eff70 2023-12-19T19:01:46.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b497fa640 1 -- 172.21.15.133:0/2595066740 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 48) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9b58003620 con 0x564cbc2eff70 2023-12-19T19:01:46.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b73b6c000 10 client.6675 fetch_fsmap finished waiting for FSMap version 48 2023-12-19T19:01:46.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b73b6c000 10 client.6675 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T19:01:46.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b73b6c000 20 client.6675 populate_metadata read hostname 'smithi133' 2023-12-19T19:01:46.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b73b6c000 1 --2- 172.21.15.133:0/2595066740 >> [v2:172.21.15.133:6832/2813206606,v1:172.21.15.133:6834/2813206606] conn(0x564cbc342140 0x564cbc344530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b73b6c000 4 client.6675 mds_command: new command op to 6507 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-19T19:01:46.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b73b6c000 1 -- 172.21.15.133:0/2595066740 --> [v2:172.21.15.133:6832/2813206606,v1:172.21.15.133:6834/2813206606] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564cbc141540 con 0x564cbc342140 2023-12-19T19:01:46.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b6e594640 1 --2- 172.21.15.133:0/2595066740 >> [v2:172.21.15.133:6832/2813206606,v1:172.21.15.133:6834/2813206606] conn(0x564cbc342140 0x564cbc344530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b6e594640 1 --2- 172.21.15.133:0/2595066740 >> [v2:172.21.15.133:6832/2813206606,v1:172.21.15.133:6834/2813206606] conn(0x564cbc342140 0x564cbc344530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e545f78113e44b9a server_cookie=c5eee750f770abef in_seq=0 out_seq=0 2023-12-19T19:01:46.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b497fa640 10 client.6675 ms_handle_connect on v2:172.21.15.133:6832/2813206606 2023-12-19T19:01:46.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b497fa640 1 -- 172.21.15.133:0/2595066740 <== mds.0 v2:172.21.15.133:6832/2813206606 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564cbc141540 con 0x564cbc342140 2023-12-19T19:01:46.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b497fa640 10 client.6675 handle_command_reply: tid=0 2023-12-19T19:01:46.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b73b6c000 1 client.6675 shutdown 2023-12-19T19:01:46.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b73b6c000 1 -- 172.21.15.133:0/2595066740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2eff70 msgr2=0x564cbc2f4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:46.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b73b6c000 1 --2- 172.21.15.133:0/2595066740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2eff70 0x564cbc2f4940 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f9b58001ec0 tx=0x7f9b58014000 comp rx=0 tx=0).stop 2023-12-19T19:01:46.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b73b6c000 1 -- 172.21.15.133:0/2595066740 shutdown_connections 2023-12-19T19:01:46.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b73b6c000 1 --2- 172.21.15.133:0/2595066740 >> [v2:172.21.15.133:6832/2813206606,v1:172.21.15.133:6834/2813206606] conn(0x564cbc342140 0x564cbc344530 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b73b6c000 1 --2- 172.21.15.133:0/2595066740 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564cbc2f0890 0x564cbc2f4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b73b6c000 1 --2- 172.21.15.133:0/2595066740 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2eff70 0x564cbc2f4940 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b497fa640 0 client.6675 ms_handle_reset on v2:172.21.15.133:6832/2813206606 2023-12-19T19:01:46.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b73b6c000 1 --2- 172.21.15.133:0/2595066740 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564cbc2ef650 0x564cbc2f4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b73b6c000 1 -- 172.21.15.133:0/2595066740 >> 172.21.15.133:0/2595066740 conn(0x564cbc2f82f0 msgr2=0x564cbc2eed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:46.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b73b6c000 1 -- 172.21.15.133:0/2595066740 shutdown_connections 2023-12-19T19:01:46.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b73b6c000 1 -- 172.21.15.133:0/2595066740 wait complete. 2023-12-19T19:01:46.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.380+0000 7f9b73b6c000 20 client.6675 trim_cache size 0 max 16384 2023-12-19T19:01:46.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.396+0000 7f9b73b6c000 1 Processor -- start 2023-12-19T19:01:46.402 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.396+0000 7f9b73b6c000 1 -- start start 2023-12-19T19:01:46.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.396+0000 7f9b73b6c000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564cbc2ef650 0x564cbc38c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.396+0000 7f9b73b6c000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564cbc2eff70 0x564cbc38c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.396+0000 7f9b73b6c000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2f0890 0x564cbc38cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.396+0000 7f9b73b6c000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cbbdfb940 con 0x564cbc2f0890 2023-12-19T19:01:46.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.396+0000 7f9b73b6c000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cbc13ece0 con 0x564cbc2ef650 2023-12-19T19:01:46.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.396+0000 7f9b73b6c000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x564cbc146bf0 con 0x564cbc2eff70 2023-12-19T19:01:46.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.396+0000 7f9b6ed95640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2f0890 0x564cbc38cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.396+0000 7f9b6ed95640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2f0890 0x564cbc38cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58412/0 (socket says 172.21.15.133:58412) 2023-12-19T19:01:46.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.396+0000 7f9b6ed95640 1 -- 172.21.15.133:0/1945786118 learned_addr learned my addr 172.21.15.133:0/1945786118 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:46.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b6e594640 1 --2- 172.21.15.133:0/1945786118 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564cbc2ef650 0x564cbc38c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b6dd93640 1 --2- 172.21.15.133:0/1945786118 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564cbc2eff70 0x564cbc38c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b6ed95640 1 -- 172.21.15.133:0/1945786118 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564cbc2eff70 msgr2=0x564cbc38c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:46.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b6ed95640 1 --2- 172.21.15.133:0/1945786118 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564cbc2eff70 0x564cbc38c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b6ed95640 1 -- 172.21.15.133:0/1945786118 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564cbc2ef650 msgr2=0x564cbc38c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:46.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b6ed95640 1 --2- 172.21.15.133:0/1945786118 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564cbc2ef650 0x564cbc38c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b6ed95640 1 -- 172.21.15.133:0/1945786118 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564cbc0e9500 con 0x564cbc2f0890 2023-12-19T19:01:46.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b6e594640 1 --2- 172.21.15.133:0/1945786118 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564cbc2ef650 0x564cbc38c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:46.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b6ed95640 1 --2- 172.21.15.133:0/1945786118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2f0890 0x564cbc38cdd0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f9b60001c40 tx=0x7f9b600019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da6d02eb6c04cb1d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:46.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b5cff9640 1 -- 172.21.15.133:0/1945786118 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b60012ec0 con 0x564cbc2f0890 2023-12-19T19:01:46.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b5cff9640 1 -- 172.21.15.133:0/1945786118 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b600070d0 con 0x564cbc2f0890 2023-12-19T19:01:46.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b5cff9640 1 -- 172.21.15.133:0/1945786118 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b60007480 con 0x564cbc2f0890 2023-12-19T19:01:46.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b73b6c000 1 -- 172.21.15.133:0/1945786118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2f0890 msgr2=0x564cbc38cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:46.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b73b6c000 1 --2- 172.21.15.133:0/1945786118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2f0890 0x564cbc38cdd0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f9b60001c40 tx=0x7f9b600019c0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b73b6c000 1 -- 172.21.15.133:0/1945786118 shutdown_connections 2023-12-19T19:01:46.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b73b6c000 1 --2- 172.21.15.133:0/1945786118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2f0890 0x564cbc38cdd0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b73b6c000 1 --2- 172.21.15.133:0/1945786118 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564cbc2eff70 0x564cbc38c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b73b6c000 1 --2- 172.21.15.133:0/1945786118 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564cbc2ef650 0x564cbc38c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b73b6c000 1 -- 172.21.15.133:0/1945786118 >> 172.21.15.133:0/1945786118 conn(0x564cbc2f82f0 msgr2=0x564cbc32b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:46.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b73b6c000 1 -- 172.21.15.133:0/1945786118 shutdown_connections 2023-12-19T19:01:46.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b73b6c000 1 -- 172.21.15.133:0/1945786118 wait complete. 2023-12-19T19:01:46.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b73b6c000 1 -- start start 2023-12-19T19:01:46.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b73b6c000 1 Processor -- start 2023-12-19T19:01:46.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b73b6c000 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2ef650 0x564cbc3907f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b73b6c000 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564cbc2eff70 0x564cbc390d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b73b6c000 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564cbc2f0890 0x564cbc391830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b73b6c000 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cbc184250 con 0x564cbc2ef650 2023-12-19T19:01:46.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b73b6c000 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x564cbc32cda0 con 0x564cbc2f0890 2023-12-19T19:01:46.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b73b6c000 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x564cbc0f7790 con 0x564cbc2eff70 2023-12-19T19:01:46.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b73b6c000 10 client.0 _ll_register_callbacks cb 0x564cbc2bdf60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T19:01:46.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b6e594640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2ef650 0x564cbc3907f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b6e594640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2ef650 0x564cbc3907f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58424/0 (socket says 172.21.15.133:58424) 2023-12-19T19:01:46.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b6e594640 1 -- 172.21.15.133:0/4192829654 learned_addr learned my addr 172.21.15.133:0/4192829654 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:46.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b6dd93640 1 --2- 172.21.15.133:0/4192829654 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564cbc2eff70 0x564cbc390d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b6ed95640 1 --2- 172.21.15.133:0/4192829654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564cbc2f0890 0x564cbc391830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b6e594640 1 -- 172.21.15.133:0/4192829654 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564cbc2eff70 msgr2=0x564cbc390d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:46.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b6e594640 1 --2- 172.21.15.133:0/4192829654 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564cbc2eff70 0x564cbc390d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b6e594640 1 -- 172.21.15.133:0/4192829654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564cbc2f0890 msgr2=0x564cbc391830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:46.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b6e594640 1 --2- 172.21.15.133:0/4192829654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564cbc2f0890 0x564cbc391830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.400+0000 7f9b6e594640 1 -- 172.21.15.133:0/4192829654 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b54003530 con 0x564cbc2ef650 2023-12-19T19:01:46.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b6e594640 1 --2- 172.21.15.133:0/4192829654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2ef650 0x564cbc3907f0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f9b640ef400 tx=0x7f9b6411e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28cc7f61704c63d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:46.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b497fa640 10 client.0 ms_handle_connect on v2:172.21.15.133:3300/0 2023-12-19T19:01:46.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b497fa640 1 -- 172.21.15.133:0/4192829654 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6411e0b0 con 0x564cbc2ef650 2023-12-19T19:01:46.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b497fa640 1 -- 172.21.15.133:0/4192829654 <== mon.0 v2:172.21.15.133:3300/0 2 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b640ebb80 con 0x564cbc2ef650 2023-12-19T19:01:46.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b73b6c000 1 -- 172.21.15.133:0/4192829654 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564cbc0c9a50 con 0x564cbc2ef650 2023-12-19T19:01:46.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b497fa640 1 -- 172.21.15.133:0/4192829654 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b640ebd40 con 0x564cbc2ef650 2023-12-19T19:01:46.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b73b6c000 10 client.6681 fetch_fsmap learned FSMap version 48 2023-12-19T19:01:46.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b73b6c000 1 -- 172.21.15.133:0/4192829654 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x564cbbe3acc0 con 0x564cbc2ef650 2023-12-19T19:01:46.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b497fa640 1 -- 172.21.15.133:0/4192829654 <== mon.0 v2:172.21.15.133:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b64111080 con 0x564cbc2ef650 2023-12-19T19:01:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b497fa640 1 -- 172.21.15.133:0/4192829654 <== mon.0 v2:172.21.15.133:3300/0 5 ==== fsmap(e 48) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9b640c7020 con 0x564cbc2ef650 2023-12-19T19:01:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b73b6c000 10 client.6681 fetch_fsmap finished waiting for FSMap version 48 2023-12-19T19:01:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b73b6c000 10 client.6681 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T19:01:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b73b6c000 20 client.6681 populate_metadata read hostname 'smithi133' 2023-12-19T19:01:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b73b6c000 1 --2- 172.21.15.133:0/4192829654 >> [v2:172.21.15.133:6832/2813206606,v1:172.21.15.133:6834/2813206606] conn(0x564cbc391d70 0x564cbc392150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b73b6c000 4 client.6681 mds_command: new command op to 6507 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-19T19:01:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b73b6c000 1 -- 172.21.15.133:0/4192829654 --> [v2:172.21.15.133:6832/2813206606,v1:172.21.15.133:6834/2813206606] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564cbc170f30 con 0x564cbc391d70 2023-12-19T19:01:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b6dd93640 1 --2- 172.21.15.133:0/4192829654 >> [v2:172.21.15.133:6832/2813206606,v1:172.21.15.133:6834/2813206606] conn(0x564cbc391d70 0x564cbc392150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b497fa640 10 client.6681 ms_handle_connect on v2:172.21.15.133:6832/2813206606 2023-12-19T19:01:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b6dd93640 1 --2- 172.21.15.133:0/4192829654 >> [v2:172.21.15.133:6832/2813206606,v1:172.21.15.133:6834/2813206606] conn(0x564cbc391d70 0x564cbc392150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae3a8acc51f58485 server_cookie=7ef9143b295c1630 in_seq=0 out_seq=0 2023-12-19T19:01:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b497fa640 1 -- 172.21.15.133:0/4192829654 <== mds.0 v2:172.21.15.133:6832/2813206606 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x564cbc170f30 con 0x564cbc391d70 2023-12-19T19:01:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b497fa640 10 client.6681 handle_command_reply: tid=0 2023-12-19T19:01:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b73b6c000 1 client.6681 shutdown 2023-12-19T19:01:46.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b73b6c000 1 -- 172.21.15.133:0/4192829654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2ef650 msgr2=0x564cbc3907f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:46.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b73b6c000 1 --2- 172.21.15.133:0/4192829654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2ef650 0x564cbc3907f0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f9b640ef400 tx=0x7f9b6411e040 comp rx=0 tx=0).stop 2023-12-19T19:01:46.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b73b6c000 1 -- 172.21.15.133:0/4192829654 shutdown_connections 2023-12-19T19:01:46.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b73b6c000 1 --2- 172.21.15.133:0/4192829654 >> [v2:172.21.15.133:6832/2813206606,v1:172.21.15.133:6834/2813206606] conn(0x564cbc391d70 0x564cbc392150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b73b6c000 1 --2- 172.21.15.133:0/4192829654 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x564cbc2f0890 0x564cbc391830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b73b6c000 1 --2- 172.21.15.133:0/4192829654 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x564cbc2eff70 0x564cbc390d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b73b6c000 1 --2- 172.21.15.133:0/4192829654 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x564cbc2ef650 0x564cbc3907f0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b73b6c000 1 -- 172.21.15.133:0/4192829654 >> 172.21.15.133:0/4192829654 conn(0x564cbc2f82f0 msgr2=0x564cbc32ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:46.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b497fa640 0 client.6681 ms_handle_reset on v2:172.21.15.133:6832/2813206606 2023-12-19T19:01:46.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b73b6c000 1 -- 172.21.15.133:0/4192829654 shutdown_connections 2023-12-19T19:01:46.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b73b6c000 1 -- 172.21.15.133:0/4192829654 wait complete. 2023-12-19T19:01:46.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b73b6c000 20 client.6681 trim_cache size 0 max 16384 2023-12-19T19:01:46.414 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-19T19:01:46.415 INFO:teuthology.orchestra.run.smithi133.stdout: "cluster_fsid": "03e63958-005e-4bf2-ae5b-291aceb6fbbf", 2023-12-19T19:01:46.415 INFO:teuthology.orchestra.run.smithi133.stdout: "whoami": 0, 2023-12-19T19:01:46.415 INFO:teuthology.orchestra.run.smithi133.stdout: "id": 6507, 2023-12-19T19:01:46.415 INFO:teuthology.orchestra.run.smithi133.stdout: "want_state": "up:active", 2023-12-19T19:01:46.415 INFO:teuthology.orchestra.run.smithi133.stdout: "state": "up:active", 2023-12-19T19:01:46.415 INFO:teuthology.orchestra.run.smithi133.stdout: "fs_name": "cephfs", 2023-12-19T19:01:46.415 INFO:teuthology.orchestra.run.smithi133.stdout: "rank_uptime": 10.43469395, 2023-12-19T19:01:46.415 INFO:teuthology.orchestra.run.smithi133.stdout: "mdsmap_epoch": 48, 2023-12-19T19:01:46.415 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch": 69, 2023-12-19T19:01:46.415 INFO:teuthology.orchestra.run.smithi133.stdout: "osdmap_epoch_barrier": 69, 2023-12-19T19:01:46.415 INFO:teuthology.orchestra.run.smithi133.stdout: "uptime": 22.966896260999999 2023-12-19T19:01:46.415 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-19T19:01:46.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b707f8640 1 -- 172.21.15.133:0/3287633458 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9b4c066470 msgr2=0x7f9b4c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:46.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b707f8640 1 --2- 172.21.15.133:0/3287633458 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9b4c066470 0x7f9b4c068930 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f9b681546b0 tx=0x7f9b58009040 comp rx=0 tx=0).stop 2023-12-19T19:01:46.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b707f8640 1 -- 172.21.15.133:0/3287633458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b680c4e60 msgr2=0x7f9b680af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:46.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b707f8640 1 --2- 172.21.15.133:0/3287633458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b680c4e60 0x7f9b680af390 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f9b64018f70 tx=0x7f9b6401aba0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b707f8640 1 -- 172.21.15.133:0/3287633458 shutdown_connections 2023-12-19T19:01:46.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b707f8640 1 --2- 172.21.15.133:0/3287633458 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9b4c066470 0x7f9b4c068930 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b707f8640 1 --2- 172.21.15.133:0/3287633458 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9b68151e90 0x7f9b681f1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b707f8640 1 --2- 172.21.15.133:0/3287633458 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9b680c7ea0 0x7f9b681f0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b707f8640 1 --2- 172.21.15.133:0/3287633458 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9b680c4e60 0x7f9b680af390 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b707f8640 1 -- 172.21.15.133:0/3287633458 >> 172.21.15.133:0/3287633458 conn(0x7f9b680ca170 msgr2=0x7f9b680ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:46.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b707f8640 1 -- 172.21.15.133:0/3287633458 shutdown_connections 2023-12-19T19:01:46.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.404+0000 7f9b707f8640 1 -- 172.21.15.133:0/3287633458 wait complete. 2023-12-19T19:01:46.429 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T19:01:46.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14f785a640 1 Processor -- start 2023-12-19T19:01:46.568 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14f785a640 1 -- start start 2023-12-19T19:01:46.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14f785a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f14f01526e0 0x7f14f0152b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14f785a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f0156820 con 0x7f14f00c76a0 2023-12-19T19:01:46.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14f785a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f00a7830 con 0x7f14f00a7450 2023-12-19T19:01:46.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14f785a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f006ec40 con 0x7f14f01526e0 2023-12-19T19:01:46.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14f4df5640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f14f00c76a0 0x7f14f006f770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42434/0 (socket says 172.21.15.133:42434) 2023-12-19T19:01:46.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14f4df5640 1 -- 172.21.15.133:0/3284010801 learned_addr learned my addr 172.21.15.133:0/3284010801 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:46.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14f5df7640 1 --2- 172.21.15.133:0/3284010801 >> v2:172.21.15.138:3300/0 conn(0x7f14f01526e0 0x7f14f0152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14e7fff640 1 -- 172.21.15.133:0/3284010801 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2384059476 0 0) 0x7f14f0156820 con 0x7f14f00c76a0 2023-12-19T19:01:46.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14e7fff640 1 -- 172.21.15.133:0/3284010801 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14dc003530 con 0x7f14f00c76a0 2023-12-19T19:01:46.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14e7fff640 1 -- 172.21.15.133:0/3284010801 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2750735130 0 0) 0x7f14dc003530 con 0x7f14f00c76a0 2023-12-19T19:01:46.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14e7fff640 1 -- 172.21.15.133:0/3284010801 >> v2:172.21.15.138:3300/0 conn(0x7f14f01526e0 msgr2=0x7f14f0152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:46.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14e7fff640 1 --2- 172.21.15.133:0/3284010801 >> v2:172.21.15.138:3300/0 conn(0x7f14f01526e0 0x7f14f0152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14e7fff640 1 -- 172.21.15.133:0/3284010801 >> v1:172.21.15.138:6789/0 conn(0x7f14f00a7450 legacy=0x7f14f006dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:46.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14e7fff640 1 -- 172.21.15.133:0/3284010801 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f0155c10 con 0x7f14f00c76a0 2023-12-19T19:01:46.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14e7fff640 1 -- 172.21.15.133:0/3284010801 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f14e0001680 con 0x7f14f00c76a0 2023-12-19T19:01:46.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14e7fff640 1 -- 172.21.15.133:0/3284010801 >> v1:172.21.15.133:6789/0 conn(0x7f14f00c76a0 legacy=0x7f14f006f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:46.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14e7fff640 1 --2- 172.21.15.133:0/3284010801 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14dc0039d0 0x7f14dc003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14e7fff640 1 --2- 172.21.15.133:0/3284010801 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14dc0047d0 0x7f14dc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14e7fff640 1 --2- 172.21.15.133:0/3284010801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14dc0051e0 0x7f14dc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14e7fff640 1 -- 172.21.15.133:0/3284010801 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc00c100 con 0x7f14dc0047d0 2023-12-19T19:01:46.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14e7fff640 1 -- 172.21.15.133:0/3284010801 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc00c270 con 0x7f14dc0039d0 2023-12-19T19:01:46.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14e7fff640 1 -- 172.21.15.133:0/3284010801 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc00c430 con 0x7f14dc0051e0 2023-12-19T19:01:46.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14f4df5640 1 --2- 172.21.15.133:0/3284010801 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14dc0047d0 0x7f14dc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14f55f6640 1 --2- 172.21.15.133:0/3284010801 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14dc0039d0 0x7f14dc003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.564+0000 7f14f5df7640 1 --2- 172.21.15.133:0/3284010801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14dc0051e0 0x7f14dc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.568+0000 7f14f4df5640 1 -- 172.21.15.133:0/3284010801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14dc0051e0 msgr2=0x7f14dc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:46.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.568+0000 7f14f4df5640 1 --2- 172.21.15.133:0/3284010801 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14dc0051e0 0x7f14dc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.568+0000 7f14f4df5640 1 -- 172.21.15.133:0/3284010801 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14dc0039d0 msgr2=0x7f14dc003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:46.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.568+0000 7f14f4df5640 1 --2- 172.21.15.133:0/3284010801 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14dc0039d0 0x7f14dc003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.568+0000 7f14f4df5640 1 -- 172.21.15.133:0/3284010801 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc003530 con 0x7f14dc0047d0 2023-12-19T19:01:46.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.568+0000 7f14f5df7640 1 -- 172.21.15.133:0/3284010801 reap_dead start 2023-12-19T19:01:46.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.568+0000 7f14f4df5640 1 --2- 172.21.15.133:0/3284010801 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14dc0047d0 0x7f14dc004c50 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f14e0001ec0 tx=0x7f14e001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4119bf7a7e6e5249 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:46.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.568+0000 7f14e7fff640 1 -- 172.21.15.133:0/3284010801 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e0005ae0 con 0x7f14dc0047d0 2023-12-19T19:01:46.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.568+0000 7f14e7fff640 1 -- 172.21.15.133:0/3284010801 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e0005c40 con 0x7f14dc0047d0 2023-12-19T19:01:46.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.568+0000 7f14e7fff640 1 -- 172.21.15.133:0/3284010801 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e00072b0 con 0x7f14dc0047d0 2023-12-19T19:01:46.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.568+0000 7f14f785a640 1 -- 172.21.15.133:0/3284010801 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14dc0047d0 msgr2=0x7f14dc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:46.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.568+0000 7f14f785a640 1 --2- 172.21.15.133:0/3284010801 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14dc0047d0 0x7f14dc004c50 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f14e0001ec0 tx=0x7f14e001ca90 comp rx=0 tx=0).stop 2023-12-19T19:01:46.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.568+0000 7f14f785a640 1 -- 172.21.15.133:0/3284010801 shutdown_connections 2023-12-19T19:01:46.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.568+0000 7f14f785a640 1 --2- 172.21.15.133:0/3284010801 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14dc0047d0 0x7f14dc004c50 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.568+0000 7f14f785a640 1 -- 172.21.15.133:0/3284010801 >> 172.21.15.133:0/3284010801 conn(0x7f14f00c7e40 msgr2=0x7f14f00c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:46.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.568+0000 7f14f785a640 1 -- 172.21.15.133:0/3284010801 shutdown_connections 2023-12-19T19:01:46.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.568+0000 7f14f785a640 1 -- 172.21.15.133:0/3284010801 wait complete. 2023-12-19T19:01:46.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14f785a640 1 Processor -- start 2023-12-19T19:01:46.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14f785a640 1 -- start start 2023-12-19T19:01:46.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14f785a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14dc0047d0 0x7f14f00ac720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14f785a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14f00bd850 0x7f14f01ebf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14f785a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14f01ec480 0x7f14f014a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14f785a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f01eba90 con 0x7f14dc0047d0 2023-12-19T19:01:46.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14f785a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f01eb4d0 con 0x7f14f00bd850 2023-12-19T19:01:46.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14f785a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f01eb7b0 con 0x7f14f01ec480 2023-12-19T19:01:46.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14f55f6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14dc0047d0 0x7f14f00ac720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14f55f6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14dc0047d0 0x7f14f00ac720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58444/0 (socket says 172.21.15.133:58444) 2023-12-19T19:01:46.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14f55f6640 1 -- 172.21.15.133:0/771274896 learned_addr learned my addr 172.21.15.133:0/771274896 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:46.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14f5df7640 1 --2- 172.21.15.133:0/771274896 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14f01ec480 0x7f14f014a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14f4df5640 1 --2- 172.21.15.133:0/771274896 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14f00bd850 0x7f14f01ebf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14f55f6640 1 -- 172.21.15.133:0/771274896 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14f01ec480 msgr2=0x7f14f014a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:46.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14f55f6640 1 --2- 172.21.15.133:0/771274896 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14f01ec480 0x7f14f014a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14f55f6640 1 -- 172.21.15.133:0/771274896 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14f00bd850 msgr2=0x7f14f01ebf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:46.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14f55f6640 1 --2- 172.21.15.133:0/771274896 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14f00bd850 0x7f14f01ebf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14f55f6640 1 -- 172.21.15.133:0/771274896 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f006e200 con 0x7f14dc0047d0 2023-12-19T19:01:46.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14f4df5640 1 --2- 172.21.15.133:0/771274896 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14f00bd850 0x7f14f01ebf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:46.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14f5df7640 1 --2- 172.21.15.133:0/771274896 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14f01ec480 0x7f14f014a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:46.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14f55f6640 1 --2- 172.21.15.133:0/771274896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14dc0047d0 0x7f14f00ac720 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f14ec00f7f0 tx=0x7f14ec00fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:46.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14e5ffb640 1 -- 172.21.15.133:0/771274896 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec0050d0 con 0x7f14dc0047d0 2023-12-19T19:01:46.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14e5ffb640 1 -- 172.21.15.133:0/771274896 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ec005230 con 0x7f14dc0047d0 2023-12-19T19:01:46.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14f785a640 1 -- 172.21.15.133:0/771274896 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f01ee1e0 con 0x7f14dc0047d0 2023-12-19T19:01:46.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.572+0000 7f14e5ffb640 1 -- 172.21.15.133:0/771274896 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ec00d730 con 0x7f14dc0047d0 2023-12-19T19:01:46.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.576+0000 7f14f785a640 1 -- 172.21.15.133:0/771274896 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f01ee7a0 con 0x7f14dc0047d0 2023-12-19T19:01:46.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.576+0000 7f14f785a640 1 -- 172.21.15.133:0/771274896 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14f01ee040 con 0x7f14dc0047d0 2023-12-19T19:01:46.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.576+0000 7f14e5ffb640 1 -- 172.21.15.133:0/771274896 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f14ec00d890 con 0x7f14dc0047d0 2023-12-19T19:01:46.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.576+0000 7f14e5ffb640 1 --2- 172.21.15.133:0/771274896 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f14d40664a0 0x7f14d4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:46.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.576+0000 7f14e5ffb640 1 -- 172.21.15.133:0/771274896 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14ec083db0 con 0x7f14dc0047d0 2023-12-19T19:01:46.582 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.576+0000 7f14f4df5640 1 --2- 172.21.15.133:0/771274896 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f14d40664a0 0x7f14d4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:46.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.580+0000 7f14f4df5640 1 --2- 172.21.15.133:0/771274896 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f14d40664a0 0x7f14d4068960 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f14e00ab000 tx=0x7f14e00b1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:46.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.580+0000 7f14e5ffb640 1 -- 172.21.15.133:0/771274896 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f14f01ee040 con 0x7f14dc0047d0 2023-12-19T19:01:46.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.764+0000 7f14f785a640 1 -- 172.21.15.133:0/771274896 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f14f01ee040 con 0x7f14dc0047d0 2023-12-19T19:01:46.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.764+0000 7f14e5ffb640 1 -- 172.21.15.133:0/771274896 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7f14f01ee040 con 0x7f14dc0047d0 2023-12-19T19:01:46.768 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T19:01:46.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.764+0000 7f14f785a640 1 -- 172.21.15.133:0/771274896 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f14d40664a0 msgr2=0x7f14d4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:46.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.764+0000 7f14f785a640 1 --2- 172.21.15.133:0/771274896 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f14d40664a0 0x7f14d4068960 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f14e00ab000 tx=0x7f14e00b1040 comp rx=0 tx=0).stop 2023-12-19T19:01:46.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.764+0000 7f14f785a640 1 -- 172.21.15.133:0/771274896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14dc0047d0 msgr2=0x7f14f00ac720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:46.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.764+0000 7f14f785a640 1 --2- 172.21.15.133:0/771274896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14dc0047d0 0x7f14f00ac720 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f14ec00f7f0 tx=0x7f14ec00fcb0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.764+0000 7f14f785a640 1 -- 172.21.15.133:0/771274896 shutdown_connections 2023-12-19T19:01:46.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.764+0000 7f14f785a640 1 --2- 172.21.15.133:0/771274896 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f14d40664a0 0x7f14d4068960 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.764+0000 7f14f785a640 1 --2- 172.21.15.133:0/771274896 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f14f01ec480 0x7f14f014a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.764+0000 7f14f785a640 1 --2- 172.21.15.133:0/771274896 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f14f00bd850 0x7f14f01ebf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.764+0000 7f14f785a640 1 --2- 172.21.15.133:0/771274896 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14dc0047d0 0x7f14f00ac720 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:46.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.764+0000 7f14f785a640 1 -- 172.21.15.133:0/771274896 >> 172.21.15.133:0/771274896 conn(0x7f14f00c7e40 msgr2=0x7f14f0154250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:46.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.764+0000 7f14f785a640 1 -- 172.21.15.133:0/771274896 shutdown_connections 2023-12-19T19:01:46.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:46.764+0000 7f14f785a640 1 -- 172.21.15.133:0/771274896 wait complete. 2023-12-19T19:01:46.789 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T19:01:46.790 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T19:01:46.790 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-19T19:01:46.790 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T19:01:46.790 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T19:01:46.790 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T19:01:46.790 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T19:01:46.790 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T19:01:46.790 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T19:01:46.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:46.790 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-19T19:01:46.800 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T19:01:46.800 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T19:01:46.800 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T19:01:46.800 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:01:46.800 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-19T19:01:46.800 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:01:46.800 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:01:46.800 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:01:46.800 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-19T19:01:46.800 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:01:46.801 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:01:46.801 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-19T19:01:46.801 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:01:46.801 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:01:46.801 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T19:01:46.801 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:01:46.801 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T19:01:46.801 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42253sec preferred_lft 42253sec 2023-12-19T19:01:46.801 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-12-19T19:01:46.801 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:01:46.801 INFO:teuthology.orchestra.run.smithi133.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T19:01:46.801 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 02:42:26:2c:b4:18 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:01:46.801 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T19:01:46.802 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:01:46.802 INFO:teuthology.orchestra.run.smithi133.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T19:01:46.802 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T19:01:46.802 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T19:01:46.802 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:01:46.802 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-19T19:01:46.802 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:01:46.802 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T19:01:46.802 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T19:01:46.802 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-19T19:01:46.802 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:01:46.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:46.803 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T19:01:46.865 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-19T19:01:46.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:46.867 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-19T19:01:46.921 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-19T19:01:46.921 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T19:01:46.921 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T19:01:46.921 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T19:01:46.921 INFO:teuthology.orchestra.run.smithi133.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T19:01:46.921 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T19:01:46.921 INFO:teuthology.orchestra.run.smithi133.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:01:46.922 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:01:46.922 INFO:teuthology.orchestra.run.smithi133.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:01:46.922 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T19:01:46.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:46.922 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-19T19:01:46.922 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-19T19:01:46.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T19:01:46.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T19:01:46.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T19:01:46.922 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-19T19:01:47.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:47.015 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-19T19:01:47.024 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T19:01:47.024 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T19:01:47.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:47.025 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-19T19:01:47.087 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T19:01:47.087 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T19:01:47.139 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T19:01:47.139 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T19:01:47.191 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-19T19:01:47.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:47.191 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:01:47.284 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:01:47.284 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T19:01:47.298 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:01:47.298 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T19:01:47.298 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-12-19T19:01:47.298 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: 0@03e63958-005e-4bf2-ae5b-291aceb6fbbf.cephfs=/ 2023-12-19T19:01:47.298 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.133:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-12-19T19:01:47.302 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T19:01:47.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:47.302 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T19:01:47.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:47.323 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T19:01:47.379 INFO:teuthology.orchestra.run.smithi133.stdout:client6690 2023-12-19T19:01:47.379 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T19:01:47.379 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:01:47.431 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T19:01:47.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98e398d640 1 Processor -- start 2023-12-19T19:01:47.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98e398d640 1 -- start start 2023-12-19T19:01:47.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98e398d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f98dc0c4100 0x7f98dc0c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:47.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98e398d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98dc0c31c0 con 0x7f98dc0c06d0 2023-12-19T19:01:47.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98e398d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98dc0c34a0 con 0x7f98dc0c63c0 2023-12-19T19:01:47.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98e398d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98dc0c1030 con 0x7f98dc0c4100 2023-12-19T19:01:47.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98e1f2a640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f98dc0c06d0 0x7f98dc0a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42442/0 (socket says 172.21.15.133:42442) 2023-12-19T19:01:47.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98e1f2a640 1 -- 172.21.15.133:0/3837763807 learned_addr learned my addr 172.21.15.133:0/3837763807 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:47.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98e0f28640 1 --2- 172.21.15.133:0/3837763807 >> v2:172.21.15.138:3300/0 conn(0x7f98dc0c4100 0x7f98dc0c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:47.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98d3fff640 1 -- 172.21.15.133:0/3837763807 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3955763579 0 0) 0x7f98dc0c31c0 con 0x7f98dc0c06d0 2023-12-19T19:01:47.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98d3fff640 1 -- 172.21.15.133:0/3837763807 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98c8005740 con 0x7f98dc0c06d0 2023-12-19T19:01:47.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98d3fff640 1 -- 172.21.15.133:0/3837763807 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1262227985 0 0) 0x7f98c8005740 con 0x7f98dc0c06d0 2023-12-19T19:01:47.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98d3fff640 1 -- 172.21.15.133:0/3837763807 >> v2:172.21.15.138:3300/0 conn(0x7f98dc0c4100 msgr2=0x7f98dc0c2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:47.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98d3fff640 1 --2- 172.21.15.133:0/3837763807 >> v2:172.21.15.138:3300/0 conn(0x7f98dc0c4100 0x7f98dc0c2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:47.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98d3fff640 1 -- 172.21.15.133:0/3837763807 >> v1:172.21.15.138:6789/0 conn(0x7f98dc0c63c0 legacy=0x7f98dc0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:47.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98d3fff640 1 -- 172.21.15.133:0/3837763807 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98dc0c1310 con 0x7f98dc0c06d0 2023-12-19T19:01:47.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98d3fff640 1 -- 172.21.15.133:0/3837763807 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f98d4001a20 con 0x7f98dc0c06d0 2023-12-19T19:01:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98d3fff640 1 -- 172.21.15.133:0/3837763807 >> v1:172.21.15.133:6789/0 conn(0x7f98dc0c06d0 legacy=0x7f98dc0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98d3fff640 1 --2- 172.21.15.133:0/3837763807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98c8005b90 0x7f98c8005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98d3fff640 1 --2- 172.21.15.133:0/3837763807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98c80069e0 0x7f98c8006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98d3fff640 1 --2- 172.21.15.133:0/3837763807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98c80074c0 0x7f98c800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98d3fff640 1 -- 172.21.15.133:0/3837763807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0c1030 con 0x7f98c80074c0 2023-12-19T19:01:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98d3fff640 1 -- 172.21.15.133:0/3837763807 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c800e390 con 0x7f98c8005b90 2023-12-19T19:01:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98d3fff640 1 -- 172.21.15.133:0/3837763807 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c800e550 con 0x7f98c80069e0 2023-12-19T19:01:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98e1f2a640 1 --2- 172.21.15.133:0/3837763807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98c80074c0 0x7f98c800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98e1729640 1 --2- 172.21.15.133:0/3837763807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98c8005b90 0x7f98c8005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:47.621 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98e0f28640 1 --2- 172.21.15.133:0/3837763807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98c80069e0 0x7f98c8006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:47.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98e1f2a640 1 -- 172.21.15.133:0/3837763807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98c80069e0 msgr2=0x7f98c8006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:47.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98e1f2a640 1 --2- 172.21.15.133:0/3837763807 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98c80069e0 0x7f98c8006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:47.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98e1f2a640 1 -- 172.21.15.133:0/3837763807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98c8005b90 msgr2=0x7f98c8005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:47.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98e1f2a640 1 --2- 172.21.15.133:0/3837763807 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98c8005b90 0x7f98c8005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:47.622 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.612+0000 7f98e1f2a640 1 -- 172.21.15.133:0/3837763807 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c8005740 con 0x7f98c80074c0 2023-12-19T19:01:47.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.616+0000 7f98e1f2a640 1 -- 172.21.15.133:0/3837763807 reap_dead start 2023-12-19T19:01:47.623 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.616+0000 7f98e1f2a640 1 --2- 172.21.15.133:0/3837763807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98c80074c0 0x7f98c800dba0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f98d4002240 tx=0x7f98d401d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1cbc88dec95c96 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:47.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.616+0000 7f98d3fff640 1 -- 172.21.15.133:0/3837763807 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d40ad630 con 0x7f98c80074c0 2023-12-19T19:01:47.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.616+0000 7f98d3fff640 1 -- 172.21.15.133:0/3837763807 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d40a8070 con 0x7f98c80074c0 2023-12-19T19:01:47.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.616+0000 7f98d3fff640 1 -- 172.21.15.133:0/3837763807 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d40ad990 con 0x7f98c80074c0 2023-12-19T19:01:47.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.616+0000 7f98e398d640 1 -- 172.21.15.133:0/3837763807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98c80074c0 msgr2=0x7f98c800dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:47.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.616+0000 7f98e398d640 1 --2- 172.21.15.133:0/3837763807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98c80074c0 0x7f98c800dba0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f98d4002240 tx=0x7f98d401d300 comp rx=0 tx=0).stop 2023-12-19T19:01:47.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.616+0000 7f98e398d640 1 -- 172.21.15.133:0/3837763807 shutdown_connections 2023-12-19T19:01:47.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.616+0000 7f98e398d640 1 --2- 172.21.15.133:0/3837763807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98c80074c0 0x7f98c800dba0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:47.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.616+0000 7f98e398d640 1 -- 172.21.15.133:0/3837763807 >> 172.21.15.133:0/3837763807 conn(0x7f98dc06a5b0 msgr2=0x7f98dc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:47.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.616+0000 7f98e398d640 1 -- 172.21.15.133:0/3837763807 shutdown_connections 2023-12-19T19:01:47.624 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.616+0000 7f98e398d640 1 -- 172.21.15.133:0/3837763807 wait complete. 2023-12-19T19:01:47.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.620+0000 7f98e398d640 1 Processor -- start 2023-12-19T19:01:47.625 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.620+0000 7f98e398d640 1 -- start start 2023-12-19T19:01:47.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.620+0000 7f98e398d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98c80074c0 0x7f98dc1ee220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:47.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.620+0000 7f98e398d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98dc153450 0x7f98dc15b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:47.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.620+0000 7f98e398d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98dc152970 0x7f98dc152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:47.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.620+0000 7f98e398d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc1f12a0 con 0x7f98c80074c0 2023-12-19T19:01:47.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.620+0000 7f98e398d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc15a4c0 con 0x7f98dc152970 2023-12-19T19:01:47.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.620+0000 7f98e398d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc15a7a0 con 0x7f98dc153450 2023-12-19T19:01:47.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.620+0000 7f98e1729640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98c80074c0 0x7f98dc1ee220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:47.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.620+0000 7f98e1729640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98c80074c0 0x7f98dc1ee220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58452/0 (socket says 172.21.15.133:58452) 2023-12-19T19:01:47.627 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.620+0000 7f98e1729640 1 -- 172.21.15.133:0/2878957589 learned_addr learned my addr 172.21.15.133:0/2878957589 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.620+0000 7f98e0f28640 1 --2- 172.21.15.133:0/2878957589 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98dc153450 0x7f98dc15b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.620+0000 7f98e1f2a640 1 --2- 172.21.15.133:0/2878957589 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98dc152970 0x7f98dc152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.620+0000 7f98e1729640 1 -- 172.21.15.133:0/2878957589 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98dc153450 msgr2=0x7f98dc15b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.620+0000 7f98e1729640 1 --2- 172.21.15.133:0/2878957589 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98dc153450 0x7f98dc15b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.620+0000 7f98e1729640 1 -- 172.21.15.133:0/2878957589 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98dc152970 msgr2=0x7f98dc152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.620+0000 7f98e1729640 1 --2- 172.21.15.133:0/2878957589 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98dc152970 0x7f98dc152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.620+0000 7f98e1729640 1 -- 172.21.15.133:0/2878957589 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98dc0c69b0 con 0x7f98c80074c0 2023-12-19T19:01:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.620+0000 7f98e1729640 1 --2- 172.21.15.133:0/2878957589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98c80074c0 0x7f98dc1ee220 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f98d800f5f0 tx=0x7f98d800f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.620+0000 7f98d1ffb640 1 -- 172.21.15.133:0/2878957589 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d80052e0 con 0x7f98c80074c0 2023-12-19T19:01:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.620+0000 7f98d1ffb640 1 -- 172.21.15.133:0/2878957589 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d8005440 con 0x7f98c80074c0 2023-12-19T19:01:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.620+0000 7f98d1ffb640 1 -- 172.21.15.133:0/2878957589 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d8003820 con 0x7f98c80074c0 2023-12-19T19:01:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.620+0000 7f98e398d640 1 -- 172.21.15.133:0/2878957589 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98dc15aa80 con 0x7f98c80074c0 2023-12-19T19:01:47.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.624+0000 7f98e398d640 1 -- 172.21.15.133:0/2878957589 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98dc1ee760 con 0x7f98c80074c0 2023-12-19T19:01:47.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.624+0000 7f98e398d640 1 -- 172.21.15.133:0/2878957589 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98dc068400 con 0x7f98c80074c0 2023-12-19T19:01:47.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.624+0000 7f98d1ffb640 1 -- 172.21.15.133:0/2878957589 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f98d8003980 con 0x7f98c80074c0 2023-12-19T19:01:47.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.624+0000 7f98d1ffb640 1 --2- 172.21.15.133:0/2878957589 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f98c00664a0 0x7f98c0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:47.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.624+0000 7f98d1ffb640 1 -- 172.21.15.133:0/2878957589 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98d8083ad0 con 0x7f98c80074c0 2023-12-19T19:01:47.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.624+0000 7f98e0f28640 1 --2- 172.21.15.133:0/2878957589 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f98c00664a0 0x7f98c0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:47.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.628+0000 7f98e0f28640 1 --2- 172.21.15.133:0/2878957589 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f98c00664a0 0x7f98c0068960 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f98dc15c980 tx=0x7f98cc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:47.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.628+0000 7f98d1ffb640 1 -- 172.21.15.133:0/2878957589 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f98d8050fe0 con 0x7f98c80074c0 2023-12-19T19:01:47.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.812+0000 7f98e398d640 1 -- 172.21.15.133:0/2878957589 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f98dc15cbd0 con 0x7f98c80074c0 2023-12-19T19:01:47.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.812+0000 7f98d1ffb640 1 -- 172.21.15.133:0/2878957589 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7f98d8054600 con 0x7f98c80074c0 2023-12-19T19:01:47.819 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T19:01:47.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.816+0000 7f98e398d640 1 -- 172.21.15.133:0/2878957589 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f98c00664a0 msgr2=0x7f98c0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:47.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.816+0000 7f98e398d640 1 --2- 172.21.15.133:0/2878957589 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f98c00664a0 0x7f98c0068960 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f98dc15c980 tx=0x7f98cc009190 comp rx=0 tx=0).stop 2023-12-19T19:01:47.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.816+0000 7f98e398d640 1 -- 172.21.15.133:0/2878957589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98c80074c0 msgr2=0x7f98dc1ee220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:47.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.816+0000 7f98e398d640 1 --2- 172.21.15.133:0/2878957589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98c80074c0 0x7f98dc1ee220 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f98d800f5f0 tx=0x7f98d800f9f0 comp rx=0 tx=0).stop 2023-12-19T19:01:47.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.816+0000 7f98e398d640 1 -- 172.21.15.133:0/2878957589 shutdown_connections 2023-12-19T19:01:47.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.816+0000 7f98e398d640 1 --2- 172.21.15.133:0/2878957589 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f98c00664a0 0x7f98c0068960 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:47.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.816+0000 7f98e398d640 1 --2- 172.21.15.133:0/2878957589 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98dc152970 0x7f98dc152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:47.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.816+0000 7f98e398d640 1 --2- 172.21.15.133:0/2878957589 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f98dc153450 0x7f98dc15b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:47.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.816+0000 7f98e398d640 1 --2- 172.21.15.133:0/2878957589 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98c80074c0 0x7f98dc1ee220 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:47.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.816+0000 7f98e398d640 1 -- 172.21.15.133:0/2878957589 >> 172.21.15.133:0/2878957589 conn(0x7f98dc06a5b0 msgr2=0x7f98dc155050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:47.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.816+0000 7f98e398d640 1 -- 172.21.15.133:0/2878957589 shutdown_connections 2023-12-19T19:01:47.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:47.816+0000 7f98e398d640 1 -- 172.21.15.133:0/2878957589 wait complete. 2023-12-19T19:01:47.839 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T19:01:47.839 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T19:01:47.840 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi138.front.sepia.ceph.com 2023-12-19T19:01:47.840 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T19:01:47.840 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T19:01:47.840 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T19:01:47.840 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T19:01:47.840 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T19:01:47.840 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T19:01:47.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:47.840 DEBUG:teuthology.orchestra.run.smithi138:> ip addr 2023-12-19T19:01:47.852 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T19:01:47.852 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T19:01:47.852 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T19:01:47.852 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:01:47.852 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2023-12-19T19:01:47.852 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:01:47.852 INFO:teuthology.orchestra.run.smithi138.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:01:47.852 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7a brd ff:ff:ff:ff:ff:ff 2023-12-19T19:01:47.852 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f0 2023-12-19T19:01:47.852 INFO:teuthology.orchestra.run.smithi138.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:01:47.852 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7b brd ff:ff:ff:ff:ff:ff 2023-12-19T19:01:47.853 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f1 2023-12-19T19:01:47.853 INFO:teuthology.orchestra.run.smithi138.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:01:47.853 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:70 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:01:47.853 INFO:teuthology.orchestra.run.smithi138.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T19:01:47.853 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:71 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:01:47.853 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.21.15.138/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T19:01:47.853 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft 42246sec preferred_lft 42246sec 2023-12-19T19:01:47.853 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::ec4:7aff:fe88:6f71/64 scope link 2023-12-19T19:01:47.853 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:01:47.853 INFO:teuthology.orchestra.run.smithi138.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T19:01:47.853 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 02:42:5b:f5:51:87 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:01:47.853 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T19:01:47.853 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:01:47.854 INFO:teuthology.orchestra.run.smithi138.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T19:01:47.854 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T19:01:47.854 INFO:teuthology.orchestra.run.smithi138.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T19:01:47.854 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:01:47.854 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-19T19:01:47.854 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:01:47.854 INFO:teuthology.orchestra.run.smithi138.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T19:01:47.854 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T19:01:47.854 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-19T19:01:47.854 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:01:47.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:47.855 DEBUG:teuthology.orchestra.run.smithi138:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T19:01:47.916 INFO:teuthology.orchestra.run.smithi138.stdout:1 2023-12-19T19:01:47.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:47.918 DEBUG:teuthology.orchestra.run.smithi138:> route 2023-12-19T19:01:47.971 INFO:teuthology.orchestra.run.smithi138.stdout:Kernel IP routing table 2023-12-19T19:01:47.971 INFO:teuthology.orchestra.run.smithi138.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T19:01:47.971 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T19:01:47.971 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T19:01:47.971 INFO:teuthology.orchestra.run.smithi138.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T19:01:47.971 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T19:01:47.972 INFO:teuthology.orchestra.run.smithi138.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:01:47.972 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:01:47.972 INFO:teuthology.orchestra.run.smithi138.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:01:47.972 INFO:teuthology.orchestra.run.smithi138.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T19:01:47.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:47.972 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-12-19T19:01:47.972 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-12-19T19:01:47.972 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T19:01:47.972 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T19:01:47.972 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T19:01:47.972 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-12-19T19:01:48.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:48.074 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2023-12-19T19:01:48.083 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T19:01:48.084 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T19:01:48.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:48.084 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set brx.0 up 2023-12-19T19:01:48.152 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T19:01:48.152 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T19:01:48.203 INFO:teuthology.orchestra.run.smithi138.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T19:01:48.204 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T19:01:48.204 DEBUG:teuthology.orchestra.run.smithi138:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T19:01:48.255 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-19T19:01:48.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:48.255 DEBUG:teuthology.orchestra.run.smithi138:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:01:48.351 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:01:48.351 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T19:01:48.365 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:01:48.365 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T19:01:48.365 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-12-19T19:01:48.365 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: trying mount with new device syntax: 1@03e63958-005e-4bf2-ae5b-291aceb6fbbf.cephfs=/ 2023-12-19T19:01:48.365 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.133:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-12-19T19:01:48.368 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T19:01:48.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:48.369 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T19:01:48.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:01:48.390 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T19:01:48.442 INFO:teuthology.orchestra.run.smithi138.stdout:client6364 2023-12-19T19:01:48.442 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:01:48.443 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:01:48.495 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2023-12-19T19:01:48.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.632+0000 7fabca762640 1 Processor -- start 2023-12-19T19:01:48.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.632+0000 7fabca762640 1 -- start start 2023-12-19T19:01:48.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.632+0000 7fabca762640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fabc40c5360 0x7fabc406c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:48.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.632+0000 7fabca762640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fabc406c5b0 0x7fabc406c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:48.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.632+0000 7fabca762640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabc40c1e30 con 0x7fabc406d990 2023-12-19T19:01:48.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.632+0000 7fabca762640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc406dd70 con 0x7fabc40c5360 2023-12-19T19:01:48.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.632+0000 7fabca762640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabc40c57c0 con 0x7fabc406c5b0 2023-12-19T19:01:48.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.632+0000 7fabc8f5f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fabc40c5360 0x7fabc406c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:48.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.632+0000 7fabc8f5f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fabc40c5360 0x7fabc406c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58454/0 (socket says 172.21.15.133:58454) 2023-12-19T19:01:48.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.632+0000 7fabc8f5f640 1 -- 172.21.15.133:0/4258860762 learned_addr learned my addr 172.21.15.133:0/4258860762 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:48.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.632+0000 7fabc9f61640 1 --2- 172.21.15.133:0/4258860762 >> v2:172.21.15.138:3300/0 conn(0x7fabc406c5b0 0x7fabc406c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:48.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.632+0000 7fabc8f5f640 1 -- 172.21.15.133:0/4258860762 >> v2:172.21.15.138:3300/0 conn(0x7fabc406c5b0 msgr2=0x7fabc406c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:48.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.632+0000 7fabc8f5f640 1 --2- 172.21.15.133:0/4258860762 >> v2:172.21.15.138:3300/0 conn(0x7fabc406c5b0 0x7fabc406c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:48.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.632+0000 7fabc8f5f640 1 -- 172.21.15.133:0/4258860762 >> v1:172.21.15.138:6789/0 conn(0x7fabc406d990 legacy=0x7fabc41546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:48.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.632+0000 7fabc8f5f640 1 -- 172.21.15.133:0/4258860762 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc40c1220 con 0x7fabc40c5360 2023-12-19T19:01:48.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.636+0000 7fabc8f5f640 1 --2- 172.21.15.133:0/4258860762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabc40c5360 0x7fabc406c070 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fabc406b5e0 tx=0x7fabb401eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5de71d9e6a9118 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:48.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.636+0000 7fabbbfff640 1 -- 172.21.15.133:0/4258860762 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb40a7c70 con 0x7fabc40c5360 2023-12-19T19:01:48.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.636+0000 7fabbbfff640 1 -- 172.21.15.133:0/4258860762 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb40a7dd0 con 0x7fabc40c5360 2023-12-19T19:01:48.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.636+0000 7fabbbfff640 1 -- 172.21.15.133:0/4258860762 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb40af660 con 0x7fabc40c5360 2023-12-19T19:01:48.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.636+0000 7fabca762640 1 -- 172.21.15.133:0/4258860762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabc40c5360 msgr2=0x7fabc406c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:48.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.636+0000 7fabca762640 1 --2- 172.21.15.133:0/4258860762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabc40c5360 0x7fabc406c070 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fabc406b5e0 tx=0x7fabb401eba0 comp rx=0 tx=0).stop 2023-12-19T19:01:48.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.636+0000 7fabca762640 1 -- 172.21.15.133:0/4258860762 shutdown_connections 2023-12-19T19:01:48.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.636+0000 7fabca762640 1 --2- 172.21.15.133:0/4258860762 >> v2:172.21.15.138:3300/0 conn(0x7fabc406c5b0 0x7fabc406c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:48.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.636+0000 7fabca762640 1 --2- 172.21.15.133:0/4258860762 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabc40c5360 0x7fabc406c070 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:48.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.636+0000 7fabca762640 1 -- 172.21.15.133:0/4258860762 >> 172.21.15.133:0/4258860762 conn(0x7fabc40a7800 msgr2=0x7fabc40a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:48.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.636+0000 7fabca762640 1 -- 172.21.15.133:0/4258860762 shutdown_connections 2023-12-19T19:01:48.643 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.636+0000 7fabca762640 1 -- 172.21.15.133:0/4258860762 wait complete. 2023-12-19T19:01:48.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabca762640 1 Processor -- start 2023-12-19T19:01:48.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabca762640 1 -- start start 2023-12-19T19:01:48.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabca762640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabc406c5b0 0x7fabc41e3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:48.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabca762640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabc406d990 0x7fabc41ed270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:48.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabca762640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fabc40c5360 0x7fabc41ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:48.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabca762640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc41f07c0 con 0x7fabc406d990 2023-12-19T19:01:48.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabca762640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabc41f0aa0 con 0x7fabc406c5b0 2023-12-19T19:01:48.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabca762640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabc41f0d80 con 0x7fabc40c5360 2023-12-19T19:01:48.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabc8f5f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabc406d990 0x7fabc41ed270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:48.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabc9760640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabc406c5b0 0x7fabc41e3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:48.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabc8f5f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabc406d990 0x7fabc41ed270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58456/0 (socket says 172.21.15.133:58456) 2023-12-19T19:01:48.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabc8f5f640 1 -- 172.21.15.133:0/2598352448 learned_addr learned my addr 172.21.15.133:0/2598352448 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:48.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabc9f61640 1 --2- 172.21.15.133:0/2598352448 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fabc40c5360 0x7fabc41ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:48.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabc8f5f640 1 -- 172.21.15.133:0/2598352448 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fabc40c5360 msgr2=0x7fabc41ed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:48.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabc8f5f640 1 --2- 172.21.15.133:0/2598352448 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fabc40c5360 0x7fabc41ed7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:48.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabc8f5f640 1 -- 172.21.15.133:0/2598352448 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabc406c5b0 msgr2=0x7fabc41e3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:48.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabc8f5f640 1 --2- 172.21.15.133:0/2598352448 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabc406c5b0 0x7fabc41e3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:48.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabc8f5f640 1 -- 172.21.15.133:0/2598352448 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb400b770 con 0x7fabc406d990 2023-12-19T19:01:48.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabc9760640 1 --2- 172.21.15.133:0/2598352448 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabc406c5b0 0x7fabc41e3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:01:48.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabc8f5f640 1 --2- 172.21.15.133:0/2598352448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabc406d990 0x7fabc41ed270 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fabb401b7b0 tx=0x7fabb401b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:48.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabb9ffb640 1 -- 172.21.15.133:0/2598352448 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb40ba660 con 0x7fabc406d990 2023-12-19T19:01:48.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabb9ffb640 1 -- 172.21.15.133:0/2598352448 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb40ba7e0 con 0x7fabc406d990 2023-12-19T19:01:48.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabb9ffb640 1 -- 172.21.15.133:0/2598352448 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabb40bab90 con 0x7fabc406d990 2023-12-19T19:01:48.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabca762640 1 -- 172.21.15.133:0/2598352448 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabc41f1060 con 0x7fabc406d990 2023-12-19T19:01:48.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.640+0000 7fabca762640 1 -- 172.21.15.133:0/2598352448 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabc41ecce0 con 0x7fabc406d990 2023-12-19T19:01:48.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.644+0000 7fabca762640 1 -- 172.21.15.133:0/2598352448 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabc404e850 con 0x7fabc406d990 2023-12-19T19:01:48.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.644+0000 7fabb9ffb640 1 -- 172.21.15.133:0/2598352448 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fabb40c2360 con 0x7fabc406d990 2023-12-19T19:01:48.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.644+0000 7fabb9ffb640 1 --2- 172.21.15.133:0/2598352448 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faba80664a0 0x7faba8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:48.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.644+0000 7fabb9ffb640 1 -- 172.21.15.133:0/2598352448 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabb411ec10 con 0x7fabc406d990 2023-12-19T19:01:48.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.644+0000 7fabc9760640 1 --2- 172.21.15.133:0/2598352448 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faba80664a0 0x7faba8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:48.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.644+0000 7fabc9760640 1 --2- 172.21.15.133:0/2598352448 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faba80664a0 0x7faba8068960 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fabc40a4db0 tx=0x7fabc0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:48.653 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.648+0000 7fabb9ffb640 1 -- 172.21.15.133:0/2598352448 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fabb40ec130 con 0x7fabc406d990 2023-12-19T19:01:48.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.852+0000 7fabca762640 1 -- 172.21.15.133:0/2598352448 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7fabc40c21b0 con 0x7fabc406d990 2023-12-19T19:01:48.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.852+0000 7fabb9ffb640 1 -- 172.21.15.133:0/2598352448 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v19) v1 ==== 84+0+0 (secure 0 0 0) 0x7fabb40bf090 con 0x7fabc406d990 2023-12-19T19:01:48.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.852+0000 7fabca762640 1 -- 172.21.15.133:0/2598352448 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faba80664a0 msgr2=0x7faba8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:48.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.852+0000 7fabca762640 1 --2- 172.21.15.133:0/2598352448 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faba80664a0 0x7faba8068960 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fabc40a4db0 tx=0x7fabc0009040 comp rx=0 tx=0).stop 2023-12-19T19:01:48.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.852+0000 7fabca762640 1 -- 172.21.15.133:0/2598352448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabc406d990 msgr2=0x7fabc41ed270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:48.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.852+0000 7fabca762640 1 --2- 172.21.15.133:0/2598352448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabc406d990 0x7fabc41ed270 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fabb401b7b0 tx=0x7fabb401b940 comp rx=0 tx=0).stop 2023-12-19T19:01:48.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.852+0000 7fabca762640 1 -- 172.21.15.133:0/2598352448 shutdown_connections 2023-12-19T19:01:48.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.852+0000 7fabca762640 1 --2- 172.21.15.133:0/2598352448 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faba80664a0 0x7faba8068960 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:48.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.852+0000 7fabca762640 1 --2- 172.21.15.133:0/2598352448 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fabc40c5360 0x7fabc41ed7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:48.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.852+0000 7fabca762640 1 --2- 172.21.15.133:0/2598352448 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fabc406d990 0x7fabc41ed270 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:48.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.852+0000 7fabca762640 1 --2- 172.21.15.133:0/2598352448 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fabc406c5b0 0x7fabc41e3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:48.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.852+0000 7fabca762640 1 -- 172.21.15.133:0/2598352448 >> 172.21.15.133:0/2598352448 conn(0x7fabc40a7800 msgr2=0x7fabc41544d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:48.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.852+0000 7fabca762640 1 -- 172.21.15.133:0/2598352448 shutdown_connections 2023-12-19T19:01:48.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:48.852+0000 7fabca762640 1 -- 172.21.15.133:0/2598352448 wait complete. 2023-12-19T19:01:48.878 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:01:49.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.012+0000 7f407d26b640 1 Processor -- start 2023-12-19T19:01:49.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.012+0000 7f407d26b640 1 -- start start 2023-12-19T19:01:49.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.012+0000 7f407d26b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f407806a5b0 0x7f407806a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:49.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.012+0000 7f407d26b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f407806dfe0 0x7f40780c2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:49.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.012+0000 7f407d26b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f407806b1e0 0x7f40780c25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:49.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.012+0000 7f407d26b640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f407806ef50 con 0x7f407806b1e0 2023-12-19T19:01:49.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.012+0000 7f407d26b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40780720b0 con 0x7f407806dfe0 2023-12-19T19:01:49.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.012+0000 7f407d26b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4078072500 con 0x7f407806a5b0 2023-12-19T19:01:49.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.012+0000 7f40777fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f407806b1e0 0x7f40780c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:49.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.012+0000 7f40777fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f407806b1e0 0x7f40780c25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58462/0 (socket says 172.21.15.133:58462) 2023-12-19T19:01:49.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.012+0000 7f40777fe640 1 -- 172.21.15.133:0/911680131 learned_addr learned my addr 172.21.15.133:0/911680131 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:49.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.012+0000 7f406e7fc640 1 --2- 172.21.15.133:0/911680131 >> v2:172.21.15.138:3300/0 conn(0x7f407806dfe0 0x7f40780c2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:49.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.012+0000 7f4076ffd640 1 --2- 172.21.15.133:0/911680131 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f407806a5b0 0x7f407806a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:49.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.012+0000 7f40777fe640 1 -- 172.21.15.133:0/911680131 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f407806a5b0 msgr2=0x7f407806a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:49.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.012+0000 7f40777fe640 1 --2- 172.21.15.133:0/911680131 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f407806a5b0 0x7f407806a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.012+0000 7f40777fe640 1 -- 172.21.15.133:0/911680131 >> v2:172.21.15.138:3300/0 conn(0x7f407806dfe0 msgr2=0x7f40780c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:49.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.012+0000 7f40777fe640 1 --2- 172.21.15.133:0/911680131 >> v2:172.21.15.138:3300/0 conn(0x7f407806dfe0 0x7f40780c2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.012+0000 7f40777fe640 1 -- 172.21.15.133:0/911680131 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4078070f60 con 0x7f407806b1e0 2023-12-19T19:01:49.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.016+0000 7f40777fe640 1 --2- 172.21.15.133:0/911680131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f407806b1e0 0x7f40780c25d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f40780741c0 tx=0x7f407001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817a7de31bd5dcf9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:49.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.016+0000 7f40767fc640 1 -- 172.21.15.133:0/911680131 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40700a55c0 con 0x7f407806b1e0 2023-12-19T19:01:49.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.016+0000 7f40767fc640 1 -- 172.21.15.133:0/911680131 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40700a5720 con 0x7f407806b1e0 2023-12-19T19:01:49.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.016+0000 7f40767fc640 1 -- 172.21.15.133:0/911680131 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40700a5ab0 con 0x7f407806b1e0 2023-12-19T19:01:49.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.016+0000 7f407d26b640 1 -- 172.21.15.133:0/911680131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f407806b1e0 msgr2=0x7f40780c25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:49.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.016+0000 7f407d26b640 1 --2- 172.21.15.133:0/911680131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f407806b1e0 0x7f40780c25d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f40780741c0 tx=0x7f407001c940 comp rx=0 tx=0).stop 2023-12-19T19:01:49.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.016+0000 7f407d26b640 1 -- 172.21.15.133:0/911680131 shutdown_connections 2023-12-19T19:01:49.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.016+0000 7f407d26b640 1 --2- 172.21.15.133:0/911680131 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f407806b1e0 0x7f40780c25d0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.016+0000 7f407d26b640 1 --2- 172.21.15.133:0/911680131 >> v2:172.21.15.138:3300/0 conn(0x7f407806dfe0 0x7f40780c2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.016+0000 7f407d26b640 1 --2- 172.21.15.133:0/911680131 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f407806a5b0 0x7f407806a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.016+0000 7f407d26b640 1 -- 172.21.15.133:0/911680131 >> 172.21.15.133:0/911680131 conn(0x7f40780c6ef0 msgr2=0x7f40780c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:49.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.016+0000 7f407d26b640 1 -- 172.21.15.133:0/911680131 shutdown_connections 2023-12-19T19:01:49.024 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.016+0000 7f407d26b640 1 -- 172.21.15.133:0/911680131 wait complete. 2023-12-19T19:01:49.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f407d26b640 1 Processor -- start 2023-12-19T19:01:49.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f407d26b640 1 -- start start 2023-12-19T19:01:49.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f407d26b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f407806a5b0 0x7f40780c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:49.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f407d26b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f407806b1e0 0x7f40781ee210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:49.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f407d26b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f407806dfe0 0x7f40781424c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:49.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f407d26b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40781557c0 con 0x7f407806dfe0 2023-12-19T19:01:49.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f407d26b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4078156060 con 0x7f407806b1e0 2023-12-19T19:01:49.027 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f407d26b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40781edb90 con 0x7f407806a5b0 2023-12-19T19:01:49.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f40777fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f407806dfe0 0x7f40781424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:49.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f40777fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f407806dfe0 0x7f40781424c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58466/0 (socket says 172.21.15.133:58466) 2023-12-19T19:01:49.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f40777fe640 1 -- 172.21.15.133:0/2888448170 learned_addr learned my addr 172.21.15.133:0/2888448170 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:49.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f406e7fc640 1 --2- 172.21.15.133:0/2888448170 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f407806b1e0 0x7f40781ee210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:49.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f4076ffd640 1 --2- 172.21.15.133:0/2888448170 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f407806a5b0 0x7f40780c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:49.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f40777fe640 1 -- 172.21.15.133:0/2888448170 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f407806a5b0 msgr2=0x7f40780c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:49.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f40777fe640 1 --2- 172.21.15.133:0/2888448170 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f407806a5b0 0x7f40780c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f40777fe640 1 -- 172.21.15.133:0/2888448170 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f407806b1e0 msgr2=0x7f40781ee210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:49.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f40777fe640 1 --2- 172.21.15.133:0/2888448170 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f407806b1e0 0x7f40781ee210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f40777fe640 1 -- 172.21.15.133:0/2888448170 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4070009b30 con 0x7f407806dfe0 2023-12-19T19:01:49.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f406e7fc640 1 --2- 172.21.15.133:0/2888448170 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f407806b1e0 0x7f40781ee210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:01:49.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f40777fe640 1 --2- 172.21.15.133:0/2888448170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f407806dfe0 0x7f40781424c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f40700af040 tx=0x7f40700196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:49.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f406ffff640 1 -- 172.21.15.133:0/2888448170 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40700a55c0 con 0x7f407806dfe0 2023-12-19T19:01:49.028 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f406ffff640 1 -- 172.21.15.133:0/2888448170 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40700b8690 con 0x7f407806dfe0 2023-12-19T19:01:49.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f407d26b640 1 -- 172.21.15.133:0/2888448170 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4078155a10 con 0x7f407806dfe0 2023-12-19T19:01:49.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f406ffff640 1 -- 172.21.15.133:0/2888448170 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40700b8a40 con 0x7f407806dfe0 2023-12-19T19:01:49.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.020+0000 7f407d26b640 1 -- 172.21.15.133:0/2888448170 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40780c62d0 con 0x7f407806dfe0 2023-12-19T19:01:49.029 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.024+0000 7f407d26b640 1 -- 172.21.15.133:0/2888448170 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4078068400 con 0x7f407806dfe0 2023-12-19T19:01:49.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.024+0000 7f406ffff640 1 -- 172.21.15.133:0/2888448170 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f40700b8ba0 con 0x7f407806dfe0 2023-12-19T19:01:49.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.024+0000 7f406ffff640 1 --2- 172.21.15.133:0/2888448170 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4058066470 0x7f4058068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:49.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.024+0000 7f406ffff640 1 -- 172.21.15.133:0/2888448170 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f407011f090 con 0x7f407806dfe0 2023-12-19T19:01:49.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.024+0000 7f4076ffd640 1 --2- 172.21.15.133:0/2888448170 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4058066470 0x7f4058068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:49.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.024+0000 7f4076ffd640 1 --2- 172.21.15.133:0/2888448170 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4058066470 0x7f4058068930 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4068009b60 tx=0x7f4068009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:49.033 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.028+0000 7f406ffff640 1 -- 172.21.15.133:0/2888448170 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f40700ec6d0 con 0x7f407806dfe0 2023-12-19T19:01:49.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.180+0000 7f407d26b640 1 -- 172.21.15.133:0/2888448170 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40781561a0 con 0x7f407806dfe0 2023-12-19T19:01:49.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.180+0000 7f406ffff640 1 -- 172.21.15.133:0/2888448170 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16596 (secure 0 0 0) 0x7f40700bc090 con 0x7f407806dfe0 2023-12-19T19:01:49.185 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:49.185 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":69,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:01:36.987598+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:01:33.082188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T19:01:34.349092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:01:49.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.180+0000 7f407d26b640 1 -- 172.21.15.133:0/2888448170 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4058066470 msgr2=0x7f4058068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:49.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.180+0000 7f407d26b640 1 --2- 172.21.15.133:0/2888448170 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4058066470 0x7f4058068930 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4068009b60 tx=0x7f4068009190 comp rx=0 tx=0).stop 2023-12-19T19:01:49.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.180+0000 7f407d26b640 1 -- 172.21.15.133:0/2888448170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f407806dfe0 msgr2=0x7f40781424c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:49.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.180+0000 7f407d26b640 1 --2- 172.21.15.133:0/2888448170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f407806dfe0 0x7f40781424c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f40700af040 tx=0x7f40700196e0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.184+0000 7f407d26b640 1 -- 172.21.15.133:0/2888448170 shutdown_connections 2023-12-19T19:01:49.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.184+0000 7f407d26b640 1 --2- 172.21.15.133:0/2888448170 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4058066470 0x7f4058068930 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.184+0000 7f407d26b640 1 --2- 172.21.15.133:0/2888448170 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f407806dfe0 0x7f40781424c0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.184+0000 7f407d26b640 1 --2- 172.21.15.133:0/2888448170 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f407806b1e0 0x7f40781ee210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.184+0000 7f407d26b640 1 --2- 172.21.15.133:0/2888448170 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f407806a5b0 0x7f40780c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.184+0000 7f407d26b640 1 -- 172.21.15.133:0/2888448170 >> 172.21.15.133:0/2888448170 conn(0x7f40780c6ef0 msgr2=0x7f4078146090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:49.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.184+0000 7f407d26b640 1 -- 172.21.15.133:0/2888448170 shutdown_connections 2023-12-19T19:01:49.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.184+0000 7f407d26b640 1 -- 172.21.15.133:0/2888448170 wait complete. 2023-12-19T19:01:49.207 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T19:01:33.082188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T19:01:34.349092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T19:01:49.207 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T19:01:49.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.344+0000 7f9bbde09640 1 Processor -- start 2023-12-19T19:01:49.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.344+0000 7f9bbde09640 1 -- start start 2023-12-19T19:01:49.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.344+0000 7f9bbde09640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bb8151e90 0x7f9bb80c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:49.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.344+0000 7f9bbde09640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9bb80c7ea0 0x7f9bb806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:49.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.344+0000 7f9bbde09640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9bb80c4e60 0x7f9bb806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:49.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.344+0000 7f9bbde09640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb80c8750 con 0x7f9bb80c7ea0 2023-12-19T19:01:49.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.344+0000 7f9bbde09640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bb81552d0 con 0x7f9bb80c4e60 2023-12-19T19:01:49.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.344+0000 7f9bbde09640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80c5c60 con 0x7f9bb8151e90 2023-12-19T19:01:49.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.344+0000 7f9bb6ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9bb80c7ea0 0x7f9bb806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:49.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.344+0000 7f9bb6ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9bb80c7ea0 0x7f9bb806b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58468/0 (socket says 172.21.15.133:58468) 2023-12-19T19:01:49.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.344+0000 7f9bb6ffd640 1 -- 172.21.15.133:0/1569246005 learned_addr learned my addr 172.21.15.133:0/1569246005 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:49.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.344+0000 7f9bb77fe640 1 --2- 172.21.15.133:0/1569246005 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bb8151e90 0x7f9bb80c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:49.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.344+0000 7f9bb7fff640 1 --2- 172.21.15.133:0/1569246005 >> v2:172.21.15.138:3300/0 conn(0x7f9bb80c4e60 0x7f9bb806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:49.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.344+0000 7f9bb6ffd640 1 -- 172.21.15.133:0/1569246005 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bb8151e90 msgr2=0x7f9bb80c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:49.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.344+0000 7f9bb6ffd640 1 --2- 172.21.15.133:0/1569246005 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bb8151e90 0x7f9bb80c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.344+0000 7f9bb6ffd640 1 -- 172.21.15.133:0/1569246005 >> v2:172.21.15.138:3300/0 conn(0x7f9bb80c4e60 msgr2=0x7f9bb806b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:49.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.344+0000 7f9bb6ffd640 1 --2- 172.21.15.133:0/1569246005 >> v2:172.21.15.138:3300/0 conn(0x7f9bb80c4e60 0x7f9bb806b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.344+0000 7f9bb6ffd640 1 -- 172.21.15.133:0/1569246005 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb806c860 con 0x7f9bb80c7ea0 2023-12-19T19:01:49.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.344+0000 7f9bb77fe640 1 --2- 172.21.15.133:0/1569246005 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bb8151e90 0x7f9bb80c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:49.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.344+0000 7f9bb7fff640 1 --2- 172.21.15.133:0/1569246005 >> v2:172.21.15.138:3300/0 conn(0x7f9bb80c4e60 0x7f9bb806b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:49.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.348+0000 7f9bb6ffd640 1 --2- 172.21.15.133:0/1569246005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb80c7ea0 0x7f9bb806b4a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80bd660 tx=0x7f9bac01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac01c3909f9b091 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:49.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.348+0000 7f9bb67fc640 1 -- 172.21.15.133:0/1569246005 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac0ab600 con 0x7f9bb80c7ea0 2023-12-19T19:01:49.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.348+0000 7f9bb67fc640 1 -- 172.21.15.133:0/1569246005 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac0a7050 con 0x7f9bb80c7ea0 2023-12-19T19:01:49.353 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.348+0000 7f9bb67fc640 1 -- 172.21.15.133:0/1569246005 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac0ab980 con 0x7f9bb80c7ea0 2023-12-19T19:01:49.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.348+0000 7f9bbde09640 1 -- 172.21.15.133:0/1569246005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb80c7ea0 msgr2=0x7f9bb806b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:49.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.348+0000 7f9bbde09640 1 --2- 172.21.15.133:0/1569246005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb80c7ea0 0x7f9bb806b4a0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80bd660 tx=0x7f9bac01c3e0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.348+0000 7f9bbde09640 1 -- 172.21.15.133:0/1569246005 shutdown_connections 2023-12-19T19:01:49.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.348+0000 7f9bbde09640 1 --2- 172.21.15.133:0/1569246005 >> v2:172.21.15.138:3300/0 conn(0x7f9bb80c4e60 0x7f9bb806b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.348+0000 7f9bbde09640 1 --2- 172.21.15.133:0/1569246005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb80c7ea0 0x7f9bb806b4a0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.348+0000 7f9bbde09640 1 --2- 172.21.15.133:0/1569246005 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bb8151e90 0x7f9bb80c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.348+0000 7f9bbde09640 1 -- 172.21.15.133:0/1569246005 >> 172.21.15.133:0/1569246005 conn(0x7f9bb80ca170 msgr2=0x7f9bb80ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:49.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.348+0000 7f9bbde09640 1 -- 172.21.15.133:0/1569246005 shutdown_connections 2023-12-19T19:01:49.354 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.348+0000 7f9bbde09640 1 -- 172.21.15.133:0/1569246005 wait complete. 2023-12-19T19:01:49.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.348+0000 7f9bbde09640 1 Processor -- start 2023-12-19T19:01:49.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9bbde09640 1 -- start start 2023-12-19T19:01:49.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9bbde09640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bb80c4e60 0x7f9bb81526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:49.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9bbde09640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bb80c7ea0 0x7f9bb80be0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:49.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9bbde09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb8151e90 0x7f9bb80c2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:49.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9bbde09640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80c1070 con 0x7f9bb8151e90 2023-12-19T19:01:49.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9bbde09640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80c12c0 con 0x7f9bb80c7ea0 2023-12-19T19:01:49.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9bbde09640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb80c15a0 con 0x7f9bb80c4e60 2023-12-19T19:01:49.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9bb7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb8151e90 0x7f9bb80c2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:49.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9bb7fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb8151e90 0x7f9bb80c2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58480/0 (socket says 172.21.15.133:58480) 2023-12-19T19:01:49.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9bb7fff640 1 -- 172.21.15.133:0/3029768336 learned_addr learned my addr 172.21.15.133:0/3029768336 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:49.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9bb77fe640 1 --2- 172.21.15.133:0/3029768336 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bb80c4e60 0x7f9bb81526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:49.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9bb6ffd640 1 --2- 172.21.15.133:0/3029768336 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bb80c7ea0 0x7f9bb80be0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:49.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9bb7fff640 1 -- 172.21.15.133:0/3029768336 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bb80c4e60 msgr2=0x7f9bb81526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:49.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9bb7fff640 1 --2- 172.21.15.133:0/3029768336 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bb80c4e60 0x7f9bb81526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9bb7fff640 1 -- 172.21.15.133:0/3029768336 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bb80c7ea0 msgr2=0x7f9bb80be0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:49.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9bb7fff640 1 --2- 172.21.15.133:0/3029768336 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bb80c7ea0 0x7f9bb80be0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9bb7fff640 1 -- 172.21.15.133:0/3029768336 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac0094d0 con 0x7f9bb8151e90 2023-12-19T19:01:49.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9bb6ffd640 1 --2- 172.21.15.133:0/3029768336 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bb80c7ea0 0x7f9bb80be0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:49.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9bb7fff640 1 --2- 172.21.15.133:0/3029768336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb8151e90 0x7f9bb80c2430 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0007db0 tx=0x7f9bb000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:49.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9b9ffff640 1 -- 172.21.15.133:0/3029768336 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb00039a0 con 0x7f9bb8151e90 2023-12-19T19:01:49.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9b9ffff640 1 -- 172.21.15.133:0/3029768336 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb000f040 con 0x7f9bb8151e90 2023-12-19T19:01:49.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9b9ffff640 1 -- 172.21.15.133:0/3029768336 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0003d60 con 0x7f9bb8151e90 2023-12-19T19:01:49.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9bbde09640 1 -- 172.21.15.133:0/3029768336 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb80c1880 con 0x7f9bb8151e90 2023-12-19T19:01:49.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9bbde09640 1 -- 172.21.15.133:0/3029768336 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb8152c00 con 0x7f9bb8151e90 2023-12-19T19:01:49.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.352+0000 7f9bbde09640 1 -- 172.21.15.133:0/3029768336 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bb80c1da0 con 0x7f9bb8151e90 2023-12-19T19:01:49.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.356+0000 7f9b9ffff640 1 -- 172.21.15.133:0/3029768336 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9bb0004030 con 0x7f9bb8151e90 2023-12-19T19:01:49.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.356+0000 7f9b9ffff640 1 --2- 172.21.15.133:0/3029768336 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9ba4066470 0x7f9ba4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:49.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.356+0000 7f9b9ffff640 1 -- 172.21.15.133:0/3029768336 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9bb0084090 con 0x7f9bb8151e90 2023-12-19T19:01:49.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.356+0000 7f9bb77fe640 1 --2- 172.21.15.133:0/3029768336 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9ba4066470 0x7f9ba4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:49.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.356+0000 7f9bb77fe640 1 --2- 172.21.15.133:0/3029768336 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9ba4066470 0x7f9ba4068930 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800c900 tx=0x7f9ba8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:49.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.360+0000 7f9b9ffff640 1 -- 172.21.15.133:0/3029768336 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9bb80c1da0 con 0x7f9bb8151e90 2023-12-19T19:01:49.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.512+0000 7f9bbde09640 1 -- 172.21.15.133:0/3029768336 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9bb80c1da0 con 0x7f9bb8151e90 2023-12-19T19:01:49.516 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.512+0000 7f9b9ffff640 1 -- 172.21.15.133:0/3029768336 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9bb80c1da0 con 0x7f9bb8151e90 2023-12-19T19:01:49.516 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T19:01:49.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.512+0000 7f9bbde09640 1 -- 172.21.15.133:0/3029768336 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9ba4066470 msgr2=0x7f9ba4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:49.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.512+0000 7f9bbde09640 1 --2- 172.21.15.133:0/3029768336 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9ba4066470 0x7f9ba4068930 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9ba800c900 tx=0x7f9ba8008040 comp rx=0 tx=0).stop 2023-12-19T19:01:49.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.512+0000 7f9bbde09640 1 -- 172.21.15.133:0/3029768336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb8151e90 msgr2=0x7f9bb80c2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:49.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.512+0000 7f9bbde09640 1 --2- 172.21.15.133:0/3029768336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb8151e90 0x7f9bb80c2430 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0007db0 tx=0x7f9bb000d4a0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.512+0000 7f9bbde09640 1 -- 172.21.15.133:0/3029768336 shutdown_connections 2023-12-19T19:01:49.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.512+0000 7f9bbde09640 1 --2- 172.21.15.133:0/3029768336 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9ba4066470 0x7f9ba4068930 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.512+0000 7f9bbde09640 1 --2- 172.21.15.133:0/3029768336 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9bb8151e90 0x7f9bb80c2430 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.512+0000 7f9bbde09640 1 --2- 172.21.15.133:0/3029768336 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9bb80c7ea0 0x7f9bb80be0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.512+0000 7f9bbde09640 1 --2- 172.21.15.133:0/3029768336 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9bb80c4e60 0x7f9bb81526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.512+0000 7f9bbde09640 1 -- 172.21.15.133:0/3029768336 >> 172.21.15.133:0/3029768336 conn(0x7f9bb80ca170 msgr2=0x7f9bb806b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:49.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.512+0000 7f9bbde09640 1 -- 172.21.15.133:0/3029768336 shutdown_connections 2023-12-19T19:01:49.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.512+0000 7f9bbde09640 1 -- 172.21.15.133:0/3029768336 wait complete. 2023-12-19T19:01:49.537 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T19:01:49.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.672+0000 7fe422f2a640 1 Processor -- start 2023-12-19T19:01:49.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.672+0000 7fe422f2a640 1 -- start start 2023-12-19T19:01:49.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.676+0000 7fe422f2a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe41c155650 0x7fe41c0a6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:49.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.676+0000 7fe422f2a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe41c0c6250 0x7fe41c0c6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:49.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.676+0000 7fe422f2a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe41c0c3980 con 0x7fe41c0c6c70 2023-12-19T19:01:49.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.676+0000 7fe422f2a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41c0c4360 con 0x7fe41c0c6250 2023-12-19T19:01:49.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.676+0000 7fe422f2a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41c0c2bb0 con 0x7fe41c155650 2023-12-19T19:01:49.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.676+0000 7fe41bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe41c0c6250 0x7fe41c0c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:49.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.676+0000 7fe41bfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe41c0c6250 0x7fe41c0c6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58488/0 (socket says 172.21.15.133:58488) 2023-12-19T19:01:49.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.676+0000 7fe41bfff640 1 -- 172.21.15.133:0/604634801 learned_addr learned my addr 172.21.15.133:0/604634801 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:49.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.676+0000 7fe420cc6640 1 --2- 172.21.15.133:0/604634801 >> v2:172.21.15.138:3300/0 conn(0x7fe41c155650 0x7fe41c0a6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:49.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.676+0000 7fe41bfff640 1 -- 172.21.15.133:0/604634801 >> v2:172.21.15.138:3300/0 conn(0x7fe41c155650 msgr2=0x7fe41c0a6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:49.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.676+0000 7fe41bfff640 1 --2- 172.21.15.133:0/604634801 >> v2:172.21.15.138:3300/0 conn(0x7fe41c155650 0x7fe41c0a6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.676+0000 7fe41bfff640 1 -- 172.21.15.133:0/604634801 >> v1:172.21.15.133:6789/0 conn(0x7fe41c0c6c70 legacy=0x7fe41c0c1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:49.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.676+0000 7fe41bfff640 1 -- 172.21.15.133:0/604634801 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c0c2e90 con 0x7fe41c0c6250 2023-12-19T19:01:49.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.680+0000 7fe41bfff640 1 --2- 172.21.15.133:0/604634801 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe41c0c6250 0x7fe41c0c6730 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fe41c0c2680 tx=0x7fe40801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93073c0233cec0ef server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:49.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.680+0000 7fe41b7fe640 1 -- 172.21.15.133:0/604634801 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4080ab670 con 0x7fe41c0c6250 2023-12-19T19:01:49.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.680+0000 7fe41b7fe640 1 -- 172.21.15.133:0/604634801 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4080ab7d0 con 0x7fe41c0c6250 2023-12-19T19:01:49.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.680+0000 7fe41b7fe640 1 -- 172.21.15.133:0/604634801 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4080abb60 con 0x7fe41c0c6250 2023-12-19T19:01:49.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.680+0000 7fe422f2a640 1 -- 172.21.15.133:0/604634801 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe41c0c6250 msgr2=0x7fe41c0c6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:49.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.680+0000 7fe422f2a640 1 --2- 172.21.15.133:0/604634801 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe41c0c6250 0x7fe41c0c6730 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fe41c0c2680 tx=0x7fe40801c470 comp rx=0 tx=0).stop 2023-12-19T19:01:49.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.680+0000 7fe422f2a640 1 -- 172.21.15.133:0/604634801 shutdown_connections 2023-12-19T19:01:49.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.680+0000 7fe422f2a640 1 --2- 172.21.15.133:0/604634801 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe41c0c6250 0x7fe41c0c6730 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.680+0000 7fe422f2a640 1 --2- 172.21.15.133:0/604634801 >> v2:172.21.15.138:3300/0 conn(0x7fe41c155650 0x7fe41c0a6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.680+0000 7fe422f2a640 1 -- 172.21.15.133:0/604634801 >> 172.21.15.133:0/604634801 conn(0x7fe41c0c7e40 msgr2=0x7fe41c0c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:49.686 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.680+0000 7fe422f2a640 1 -- 172.21.15.133:0/604634801 shutdown_connections 2023-12-19T19:01:49.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.680+0000 7fe422f2a640 1 -- 172.21.15.133:0/604634801 wait complete. 2023-12-19T19:01:49.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.680+0000 7fe422f2a640 1 Processor -- start 2023-12-19T19:01:49.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.680+0000 7fe422f2a640 1 -- start start 2023-12-19T19:01:49.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe422f2a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe41c0c6250 0x7fe41c151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:49.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe422f2a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe41c0c6c70 0x7fe41c1f0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:49.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe422f2a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe41c155650 0x7fe41c06ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:49.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe422f2a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c153080 con 0x7fe41c0c6c70 2023-12-19T19:01:49.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe422f2a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c151a10 con 0x7fe41c0c6250 2023-12-19T19:01:49.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe422f2a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c14da10 con 0x7fe41c155650 2023-12-19T19:01:49.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe41bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe41c0c6c70 0x7fe41c1f0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:49.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe41bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe41c0c6c70 0x7fe41c1f0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58494/0 (socket says 172.21.15.133:58494) 2023-12-19T19:01:49.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe41bfff640 1 -- 172.21.15.133:0/2857651216 learned_addr learned my addr 172.21.15.133:0/2857651216 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:49.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe420cc6640 1 --2- 172.21.15.133:0/2857651216 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe41c0c6250 0x7fe41c151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:49.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe4214c7640 1 --2- 172.21.15.133:0/2857651216 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe41c155650 0x7fe41c06ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:49.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe41bfff640 1 -- 172.21.15.133:0/2857651216 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe41c155650 msgr2=0x7fe41c06ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:49.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe41bfff640 1 --2- 172.21.15.133:0/2857651216 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe41c155650 0x7fe41c06ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe41bfff640 1 -- 172.21.15.133:0/2857651216 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe41c0c6250 msgr2=0x7fe41c151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:49.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe41bfff640 1 --2- 172.21.15.133:0/2857651216 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe41c0c6250 0x7fe41c151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe41bfff640 1 -- 172.21.15.133:0/2857651216 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4080094d0 con 0x7fe41c0c6c70 2023-12-19T19:01:49.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe4214c7640 1 --2- 172.21.15.133:0/2857651216 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe41c155650 0x7fe41c06ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:49.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe41bfff640 1 --2- 172.21.15.133:0/2857651216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe41c0c6c70 0x7fe41c1f0d70 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fe4080ad040 tx=0x7fe40801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:49.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe4197fa640 1 -- 172.21.15.133:0/2857651216 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4080b4800 con 0x7fe41c0c6c70 2023-12-19T19:01:49.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe4197fa640 1 -- 172.21.15.133:0/2857651216 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4080b4980 con 0x7fe41c0c6c70 2023-12-19T19:01:49.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe4197fa640 1 -- 172.21.15.133:0/2857651216 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4080b4d30 con 0x7fe41c0c6c70 2023-12-19T19:01:49.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe422f2a640 1 -- 172.21.15.133:0/2857651216 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41c1f12b0 con 0x7fe41c0c6c70 2023-12-19T19:01:49.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe422f2a640 1 -- 172.21.15.133:0/2857651216 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41c1535b0 con 0x7fe41c0c6c70 2023-12-19T19:01:49.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe422f2a640 1 -- 172.21.15.133:0/2857651216 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41c068400 con 0x7fe41c0c6c70 2023-12-19T19:01:49.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.684+0000 7fe4197fa640 1 -- 172.21.15.133:0/2857651216 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe4080c7440 con 0x7fe41c0c6c70 2023-12-19T19:01:49.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.688+0000 7fe4197fa640 1 --2- 172.21.15.133:0/2857651216 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe400066470 0x7fe400068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:49.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.688+0000 7fe4197fa640 1 -- 172.21.15.133:0/2857651216 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe40811e8c0 con 0x7fe41c0c6c70 2023-12-19T19:01:49.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.688+0000 7fe420cc6640 1 --2- 172.21.15.133:0/2857651216 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe400066470 0x7fe400068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:49.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.688+0000 7fe420cc6640 1 --2- 172.21.15.133:0/2857651216 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe400066470 0x7fe400068930 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe41c153810 tx=0x7fe410009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:49.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.692+0000 7fe4197fa640 1 -- 172.21.15.133:0/2857651216 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fe4080ebf00 con 0x7fe41c0c6c70 2023-12-19T19:01:49.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.840+0000 7fe422f2a640 1 -- 172.21.15.133:0/2857651216 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe41c06fe40 con 0x7fe41c0c6c70 2023-12-19T19:01:49.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.840+0000 7fe4197fa640 1 -- 172.21.15.133:0/2857651216 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe40811e0a0 con 0x7fe41c0c6c70 2023-12-19T19:01:49.844 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:01:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.840+0000 7fe422f2a640 1 -- 172.21.15.133:0/2857651216 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe400066470 msgr2=0x7fe400068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.840+0000 7fe422f2a640 1 --2- 172.21.15.133:0/2857651216 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe400066470 0x7fe400068930 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fe41c153810 tx=0x7fe410009190 comp rx=0 tx=0).stop 2023-12-19T19:01:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.840+0000 7fe422f2a640 1 -- 172.21.15.133:0/2857651216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe41c0c6c70 msgr2=0x7fe41c1f0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.840+0000 7fe422f2a640 1 --2- 172.21.15.133:0/2857651216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe41c0c6c70 0x7fe41c1f0d70 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fe4080ad040 tx=0x7fe40801acb0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.840+0000 7fe422f2a640 1 -- 172.21.15.133:0/2857651216 shutdown_connections 2023-12-19T19:01:49.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.840+0000 7fe422f2a640 1 --2- 172.21.15.133:0/2857651216 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe400066470 0x7fe400068930 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.840+0000 7fe422f2a640 1 --2- 172.21.15.133:0/2857651216 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe41c155650 0x7fe41c06ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.840+0000 7fe422f2a640 1 --2- 172.21.15.133:0/2857651216 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe41c0c6c70 0x7fe41c1f0d70 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.840+0000 7fe422f2a640 1 --2- 172.21.15.133:0/2857651216 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe41c0c6250 0x7fe41c151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.840+0000 7fe422f2a640 1 -- 172.21.15.133:0/2857651216 >> 172.21.15.133:0/2857651216 conn(0x7fe41c0c7e40 msgr2=0x7fe41c06f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.840+0000 7fe422f2a640 1 -- 172.21.15.133:0/2857651216 shutdown_connections 2023-12-19T19:01:49.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:49.840+0000 7fe422f2a640 1 -- 172.21.15.133:0/2857651216 wait complete. 2023-12-19T19:01:49.866 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T19:01:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.004+0000 7fc15e9a7640 1 Processor -- start 2023-12-19T19:01:50.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.004+0000 7fc15e9a7640 1 -- start start 2023-12-19T19:01:50.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.008+0000 7fc15e9a7640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1580723f0 0x7fc158150e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:50.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.008+0000 7fc15e9a7640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1580c4bf0 con 0x7fc1581513d0 2023-12-19T19:01:50.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.008+0000 7fc15e9a7640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc15814e680 con 0x7fc15814e2a0 2023-12-19T19:01:50.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.008+0000 7fc15e9a7640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1581509d0 con 0x7fc1580723f0 2023-12-19T19:01:50.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.008+0000 7fc15d1a4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1580723f0 0x7fc158150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:50.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.008+0000 7fc15d1a4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc1580723f0 0x7fc158150e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58498/0 (socket says 172.21.15.133:58498) 2023-12-19T19:01:50.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.008+0000 7fc15e1a6640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc1581513d0 0x7fc15815b270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42456/0 (socket says 172.21.15.133:42456) 2023-12-19T19:01:50.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.008+0000 7fc15d1a4640 1 -- 172.21.15.133:0/1537042294 learned_addr learned my addr 172.21.15.133:0/1537042294 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:50.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.008+0000 7fc15d1a4640 1 -- 172.21.15.133:0/1537042294 >> v1:172.21.15.138:6789/0 conn(0x7fc15814e2a0 legacy=0x7fc15806c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:50.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.008+0000 7fc15d1a4640 1 -- 172.21.15.133:0/1537042294 >> v1:172.21.15.133:6789/0 conn(0x7fc1581513d0 legacy=0x7fc15815b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:50.012 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.008+0000 7fc15d1a4640 1 -- 172.21.15.133:0/1537042294 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1580c0450 con 0x7fc1580723f0 2023-12-19T19:01:50.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.008+0000 7fc15d1a4640 1 --2- 172.21.15.133:0/1537042294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1580723f0 0x7fc158150e90 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc1580c0640 tx=0x7fc14801eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccef25219d2442e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:50.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.008+0000 7fc15c9a3640 1 -- 172.21.15.133:0/1537042294 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1480a7b80 con 0x7fc1580723f0 2023-12-19T19:01:50.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.008+0000 7fc15c9a3640 1 -- 172.21.15.133:0/1537042294 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1480a7ce0 con 0x7fc1580723f0 2023-12-19T19:01:50.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.008+0000 7fc15c9a3640 1 -- 172.21.15.133:0/1537042294 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1480af660 con 0x7fc1580723f0 2023-12-19T19:01:50.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.012+0000 7fc15e9a7640 1 -- 172.21.15.133:0/1537042294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1580723f0 msgr2=0x7fc158150e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:50.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.012+0000 7fc15e9a7640 1 --2- 172.21.15.133:0/1537042294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1580723f0 0x7fc158150e90 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc1580c0640 tx=0x7fc14801eb30 comp rx=0 tx=0).stop 2023-12-19T19:01:50.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.012+0000 7fc15e9a7640 1 -- 172.21.15.133:0/1537042294 shutdown_connections 2023-12-19T19:01:50.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.012+0000 7fc15e9a7640 1 --2- 172.21.15.133:0/1537042294 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc1580723f0 0x7fc158150e90 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.012+0000 7fc15e9a7640 1 -- 172.21.15.133:0/1537042294 >> 172.21.15.133:0/1537042294 conn(0x7fc1580a7800 msgr2=0x7fc1580a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:50.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.012+0000 7fc15e9a7640 1 -- 172.21.15.133:0/1537042294 shutdown_connections 2023-12-19T19:01:50.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.012+0000 7fc15e9a7640 1 -- 172.21.15.133:0/1537042294 wait complete. 2023-12-19T19:01:50.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.012+0000 7fc15e9a7640 1 Processor -- start 2023-12-19T19:01:50.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.012+0000 7fc15e9a7640 1 -- start start 2023-12-19T19:01:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.012+0000 7fc15e9a7640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1580723f0 0x7fc1580ab300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.012+0000 7fc15e9a7640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc15814e2a0 0x7fc158148c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.012+0000 7fc15e9a7640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc1581513d0 0x7fc1581491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.012+0000 7fc15e9a7640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1581487f0 con 0x7fc15814e2a0 2023-12-19T19:01:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.012+0000 7fc15e9a7640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc158147790 con 0x7fc1580723f0 2023-12-19T19:01:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.012+0000 7fc15e9a7640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1580a9350 con 0x7fc1581513d0 2023-12-19T19:01:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.012+0000 7fc15d1a4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc15814e2a0 0x7fc158148c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.012+0000 7fc15d1a4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc15814e2a0 0x7fc158148c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58512/0 (socket says 172.21.15.133:58512) 2023-12-19T19:01:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.012+0000 7fc15d1a4640 1 -- 172.21.15.133:0/2687857234 learned_addr learned my addr 172.21.15.133:0/2687857234 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.012+0000 7fc15d9a5640 1 --2- 172.21.15.133:0/2687857234 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1580723f0 0x7fc1580ab300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.012+0000 7fc15e1a6640 1 --2- 172.21.15.133:0/2687857234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc1581513d0 0x7fc1581491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.016+0000 7fc15d1a4640 1 -- 172.21.15.133:0/2687857234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc1581513d0 msgr2=0x7fc1581491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.016+0000 7fc15d1a4640 1 --2- 172.21.15.133:0/2687857234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc1581513d0 0x7fc1581491c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.016+0000 7fc15d1a4640 1 -- 172.21.15.133:0/2687857234 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1580723f0 msgr2=0x7fc1580ab300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:50.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.016+0000 7fc15d1a4640 1 --2- 172.21.15.133:0/2687857234 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1580723f0 0x7fc1580ab300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.016+0000 7fc15d1a4640 1 -- 172.21.15.133:0/2687857234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc14800b770 con 0x7fc15814e2a0 2023-12-19T19:01:50.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.016+0000 7fc15d1a4640 1 --2- 172.21.15.133:0/2687857234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc15814e2a0 0x7fc158148c80 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc14801b740 tx=0x7fc14801b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:50.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.016+0000 7fc14e7fc640 1 -- 172.21.15.133:0/2687857234 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1480ba660 con 0x7fc15814e2a0 2023-12-19T19:01:50.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.016+0000 7fc14e7fc640 1 -- 172.21.15.133:0/2687857234 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1480ba7e0 con 0x7fc15814e2a0 2023-12-19T19:01:50.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.016+0000 7fc14e7fc640 1 -- 172.21.15.133:0/2687857234 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1480bab90 con 0x7fc15814e2a0 2023-12-19T19:01:50.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.016+0000 7fc15e9a7640 1 -- 172.21.15.133:0/2687857234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1580a8db0 con 0x7fc15814e2a0 2023-12-19T19:01:50.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.016+0000 7fc15e9a7640 1 -- 172.21.15.133:0/2687857234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1580a9070 con 0x7fc15814e2a0 2023-12-19T19:01:50.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.016+0000 7fc15e9a7640 1 -- 172.21.15.133:0/2687857234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc15804e850 con 0x7fc15814e2a0 2023-12-19T19:01:50.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.016+0000 7fc14e7fc640 1 -- 172.21.15.133:0/2687857234 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc1480c2360 con 0x7fc15814e2a0 2023-12-19T19:01:50.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.016+0000 7fc14e7fc640 1 --2- 172.21.15.133:0/2687857234 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc13c066470 0x7fc13c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:50.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.016+0000 7fc14e7fc640 1 -- 172.21.15.133:0/2687857234 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc14811ed40 con 0x7fc15814e2a0 2023-12-19T19:01:50.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.016+0000 7fc15d9a5640 1 --2- 172.21.15.133:0/2687857234 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc13c066470 0x7fc13c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:50.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.020+0000 7fc15d9a5640 1 --2- 172.21.15.133:0/2687857234 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc13c066470 0x7fc13c068930 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc154007fd0 tx=0x7fc154009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:50.026 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.020+0000 7fc14e7fc640 1 -- 172.21.15.133:0/2687857234 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc1480ec260 con 0x7fc15814e2a0 2023-12-19T19:01:50.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.172+0000 7fc15e9a7640 1 -- 172.21.15.133:0/2687857234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc158148930 con 0x7fc15814e2a0 2023-12-19T19:01:50.176 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.172+0000 7fc14e7fc640 1 -- 172.21.15.133:0/2687857234 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc1480b4020 con 0x7fc15814e2a0 2023-12-19T19:01:50.176 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:01:50.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.172+0000 7fc15e9a7640 1 -- 172.21.15.133:0/2687857234 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc13c066470 msgr2=0x7fc13c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:50.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.172+0000 7fc15e9a7640 1 --2- 172.21.15.133:0/2687857234 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc13c066470 0x7fc13c068930 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc154007fd0 tx=0x7fc154009040 comp rx=0 tx=0).stop 2023-12-19T19:01:50.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.172+0000 7fc15e9a7640 1 -- 172.21.15.133:0/2687857234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc15814e2a0 msgr2=0x7fc158148c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:50.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.172+0000 7fc15e9a7640 1 --2- 172.21.15.133:0/2687857234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc15814e2a0 0x7fc158148c80 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fc14801b740 tx=0x7fc14801b8d0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.172+0000 7fc15e9a7640 1 -- 172.21.15.133:0/2687857234 shutdown_connections 2023-12-19T19:01:50.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.172+0000 7fc15e9a7640 1 --2- 172.21.15.133:0/2687857234 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc13c066470 0x7fc13c068930 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.172+0000 7fc15e9a7640 1 --2- 172.21.15.133:0/2687857234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc1581513d0 0x7fc1581491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.172+0000 7fc15e9a7640 1 --2- 172.21.15.133:0/2687857234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc15814e2a0 0x7fc158148c80 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.172+0000 7fc15e9a7640 1 --2- 172.21.15.133:0/2687857234 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc1580723f0 0x7fc1580ab300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.172+0000 7fc15e9a7640 1 -- 172.21.15.133:0/2687857234 >> 172.21.15.133:0/2687857234 conn(0x7fc1580a7800 msgr2=0x7fc158066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:50.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.172+0000 7fc15e9a7640 1 -- 172.21.15.133:0/2687857234 shutdown_connections 2023-12-19T19:01:50.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.172+0000 7fc15e9a7640 1 -- 172.21.15.133:0/2687857234 wait complete. 2023-12-19T19:01:50.197 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T19:01:50.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.328+0000 7f7b9fa9a640 1 Processor -- start 2023-12-19T19:01:50.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.328+0000 7f7b9fa9a640 1 -- start start 2023-12-19T19:01:50.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9fa9a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7b9806d520 0x7f7b9815ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:50.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9fa9a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b9815c600 con 0x7f7b981560e0 2023-12-19T19:01:50.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9fa9a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b9815a5c0 con 0x7f7b980bffc0 2023-12-19T19:01:50.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9fa9a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b981594e0 con 0x7f7b9806d520 2023-12-19T19:01:50.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9d836640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7b981560e0 0x7f7b98159eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42460/0 (socket says 172.21.15.133:42460) 2023-12-19T19:01:50.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9d836640 1 -- 172.21.15.133:0/2563365712 learned_addr learned my addr 172.21.15.133:0/2563365712 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:50.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9d035640 1 --2- 172.21.15.133:0/2563365712 >> v2:172.21.15.138:3300/0 conn(0x7f7b9806d520 0x7f7b9815ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:50.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9c834640 1 -- 172.21.15.133:0/2563365712 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 753994738 0 0) 0x7f7b9815c600 con 0x7f7b981560e0 2023-12-19T19:01:50.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9c834640 1 -- 172.21.15.133:0/2563365712 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b84003530 con 0x7f7b981560e0 2023-12-19T19:01:50.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9c834640 1 -- 172.21.15.133:0/2563365712 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 369322544 0 0) 0x7f7b84003530 con 0x7f7b981560e0 2023-12-19T19:01:50.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9c834640 1 -- 172.21.15.133:0/2563365712 >> v2:172.21.15.138:3300/0 conn(0x7f7b9806d520 msgr2=0x7f7b9815ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:50.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9c834640 1 --2- 172.21.15.133:0/2563365712 >> v2:172.21.15.138:3300/0 conn(0x7f7b9806d520 0x7f7b9815ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9c834640 1 -- 172.21.15.133:0/2563365712 >> v1:172.21.15.138:6789/0 conn(0x7f7b980bffc0 legacy=0x7f7b980c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:50.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9c834640 1 -- 172.21.15.133:0/2563365712 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b981597c0 con 0x7f7b981560e0 2023-12-19T19:01:50.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9c834640 1 -- 172.21.15.133:0/2563365712 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f7b94001680 con 0x7f7b981560e0 2023-12-19T19:01:50.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9d035640 1 --2- 172.21.15.133:0/2563365712 >> v2:172.21.15.138:3300/0 conn(0x7f7b9806d520 0x7f7b9815ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:01:50.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9c834640 1 -- 172.21.15.133:0/2563365712 >> v1:172.21.15.133:6789/0 conn(0x7f7b981560e0 legacy=0x7f7b98159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:50.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9c834640 1 --2- 172.21.15.133:0/2563365712 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b840039d0 0x7f7b84003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:50.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9c834640 1 --2- 172.21.15.133:0/2563365712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b840047d0 0x7f7b84004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:50.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9c834640 1 --2- 172.21.15.133:0/2563365712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b84005190 0x7f7b8400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:50.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9c834640 1 -- 172.21.15.133:0/2563365712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b981594e0 con 0x7f7b840047d0 2023-12-19T19:01:50.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9c834640 1 -- 172.21.15.133:0/2563365712 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8400c090 con 0x7f7b84005190 2023-12-19T19:01:50.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9c834640 1 -- 172.21.15.133:0/2563365712 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8400c250 con 0x7f7b840039d0 2023-12-19T19:01:50.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9d035640 1 --2- 172.21.15.133:0/2563365712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b840047d0 0x7f7b84004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:50.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9d836640 1 --2- 172.21.15.133:0/2563365712 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b840039d0 0x7f7b84003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9e037640 1 --2- 172.21.15.133:0/2563365712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b84005190 0x7f7b8400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9d035640 1 -- 172.21.15.133:0/2563365712 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b840039d0 msgr2=0x7f7b84003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9d035640 1 --2- 172.21.15.133:0/2563365712 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b840039d0 0x7f7b84003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9d035640 1 -- 172.21.15.133:0/2563365712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b84005190 msgr2=0x7f7b8400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9d035640 1 --2- 172.21.15.133:0/2563365712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b84005190 0x7f7b8400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9d035640 1 -- 172.21.15.133:0/2563365712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b84003530 con 0x7f7b840047d0 2023-12-19T19:01:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9e037640 1 --2- 172.21.15.133:0/2563365712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b84005190 0x7f7b8400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:50.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.332+0000 7f7b9e037640 1 -- 172.21.15.133:0/2563365712 reap_dead start 2023-12-19T19:01:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.336+0000 7f7b9d035640 1 --2- 172.21.15.133:0/2563365712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b840047d0 0x7f7b84004c50 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f7b88009c80 tx=0x7f7b8801cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76f0805d7336b5c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.336+0000 7f7b9c834640 1 -- 172.21.15.133:0/2563365712 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b880a5760 con 0x7f7b840047d0 2023-12-19T19:01:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.336+0000 7f7b9c834640 1 -- 172.21.15.133:0/2563365712 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b880a58c0 con 0x7f7b840047d0 2023-12-19T19:01:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.336+0000 7f7b9c834640 1 -- 172.21.15.133:0/2563365712 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b880a5cb0 con 0x7f7b840047d0 2023-12-19T19:01:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.336+0000 7f7b9fa9a640 1 -- 172.21.15.133:0/2563365712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b840047d0 msgr2=0x7f7b84004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:50.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.336+0000 7f7b9fa9a640 1 --2- 172.21.15.133:0/2563365712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b840047d0 0x7f7b84004c50 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f7b88009c80 tx=0x7f7b8801cbb0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.336+0000 7f7b9fa9a640 1 -- 172.21.15.133:0/2563365712 shutdown_connections 2023-12-19T19:01:50.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.336+0000 7f7b9fa9a640 1 --2- 172.21.15.133:0/2563365712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b840047d0 0x7f7b84004c50 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.336+0000 7f7b9fa9a640 1 -- 172.21.15.133:0/2563365712 >> 172.21.15.133:0/2563365712 conn(0x7f7b9806a5b0 msgr2=0x7f7b9806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:50.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.336+0000 7f7b9fa9a640 1 -- 172.21.15.133:0/2563365712 shutdown_connections 2023-12-19T19:01:50.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.336+0000 7f7b9fa9a640 1 -- 172.21.15.133:0/2563365712 wait complete. 2023-12-19T19:01:50.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.336+0000 7f7b9fa9a640 1 Processor -- start 2023-12-19T19:01:50.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.336+0000 7f7b9fa9a640 1 -- start start 2023-12-19T19:01:50.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b9fa9a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b840047d0 0x7f7b980c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:50.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b9fa9a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b9806fe50 0x7f7b980c29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:50.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b9fa9a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b980aa7a0 0x7f7b981f1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:50.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b9fa9a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b980c5be0 con 0x7f7b980aa7a0 2023-12-19T19:01:50.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b9fa9a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b980ab290 con 0x7f7b9806fe50 2023-12-19T19:01:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b9fa9a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b980c4ac0 con 0x7f7b840047d0 2023-12-19T19:01:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b9e037640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b980aa7a0 0x7f7b981f1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b9e037640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b980aa7a0 0x7f7b981f1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58528/0 (socket says 172.21.15.133:58528) 2023-12-19T19:01:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b9e037640 1 -- 172.21.15.133:0/827599231 learned_addr learned my addr 172.21.15.133:0/827599231 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b9d035640 1 --2- 172.21.15.133:0/827599231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b9806fe50 0x7f7b980c29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b9d836640 1 --2- 172.21.15.133:0/827599231 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b840047d0 0x7f7b980c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b9e037640 1 -- 172.21.15.133:0/827599231 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b840047d0 msgr2=0x7f7b980c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b9e037640 1 --2- 172.21.15.133:0/827599231 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b840047d0 0x7f7b980c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b9e037640 1 -- 172.21.15.133:0/827599231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b9806fe50 msgr2=0x7f7b980c29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b9e037640 1 --2- 172.21.15.133:0/827599231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b9806fe50 0x7f7b980c29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b9e037640 1 -- 172.21.15.133:0/827599231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b980c4da0 con 0x7f7b980aa7a0 2023-12-19T19:01:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b9e037640 1 --2- 172.21.15.133:0/827599231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b980aa7a0 0x7f7b981f1ac0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7b980c3840 tx=0x7f7b9000ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b8e7fc640 1 -- 172.21.15.133:0/827599231 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b90003b90 con 0x7f7b980aa7a0 2023-12-19T19:01:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b8e7fc640 1 -- 172.21.15.133:0/827599231 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b90003cf0 con 0x7f7b980aa7a0 2023-12-19T19:01:50.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b9fa9a640 1 -- 172.21.15.133:0/827599231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b980c5080 con 0x7f7b980aa7a0 2023-12-19T19:01:50.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b8e7fc640 1 -- 172.21.15.133:0/827599231 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b900052f0 con 0x7f7b980aa7a0 2023-12-19T19:01:50.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b9fa9a640 1 -- 172.21.15.133:0/827599231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b980c2f00 con 0x7f7b980aa7a0 2023-12-19T19:01:50.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b9fa9a640 1 -- 172.21.15.133:0/827599231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b980c52c0 con 0x7f7b980aa7a0 2023-12-19T19:01:50.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.340+0000 7f7b8e7fc640 1 -- 172.21.15.133:0/827599231 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7b90005450 con 0x7f7b980aa7a0 2023-12-19T19:01:50.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.344+0000 7f7b8e7fc640 1 --2- 172.21.15.133:0/827599231 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b7c066470 0x7f7b7c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:50.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.344+0000 7f7b8e7fc640 1 -- 172.21.15.133:0/827599231 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b90083710 con 0x7f7b980aa7a0 2023-12-19T19:01:50.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.344+0000 7f7b9d836640 1 --2- 172.21.15.133:0/827599231 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b7c066470 0x7f7b7c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:50.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.344+0000 7f7b9d836640 1 --2- 172.21.15.133:0/827599231 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b7c066470 0x7f7b7c068930 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7b94007c20 tx=0x7f7b94000ee0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:50.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.348+0000 7f7b8e7fc640 1 -- 172.21.15.133:0/827599231 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7b980c52c0 con 0x7f7b980aa7a0 2023-12-19T19:01:50.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.496+0000 7f7b9fa9a640 1 -- 172.21.15.133:0/827599231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7b981f1400 con 0x7f7b980aa7a0 2023-12-19T19:01:50.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.496+0000 7f7b8e7fc640 1 -- 172.21.15.133:0/827599231 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v69) v1 ==== 84+0+209 (secure 0 0 0) 0x7f7b981f1400 con 0x7f7b980aa7a0 2023-12-19T19:01:50.503 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:50.503 INFO:teuthology.orchestra.run.smithi133.stdout:[ 2023-12-19T19:01:50.503 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:01:50.503 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 1, 2023-12-19T19:01:50.503 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": ".mgr" 2023-12-19T19:01:50.503 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:01:50.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:01:50.504 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 12, 2023-12-19T19:01:50.504 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "cephfs_metadata" 2023-12-19T19:01:50.504 INFO:teuthology.orchestra.run.smithi133.stdout: }, 2023-12-19T19:01:50.504 INFO:teuthology.orchestra.run.smithi133.stdout: { 2023-12-19T19:01:50.504 INFO:teuthology.orchestra.run.smithi133.stdout: "poolnum": 13, 2023-12-19T19:01:50.504 INFO:teuthology.orchestra.run.smithi133.stdout: "poolname": "cephfs_data" 2023-12-19T19:01:50.504 INFO:teuthology.orchestra.run.smithi133.stdout: } 2023-12-19T19:01:50.504 INFO:teuthology.orchestra.run.smithi133.stdout:] 2023-12-19T19:01:50.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.500+0000 7f7b9fa9a640 1 -- 172.21.15.133:0/827599231 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b7c066470 msgr2=0x7f7b7c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:50.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.500+0000 7f7b9fa9a640 1 --2- 172.21.15.133:0/827599231 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b7c066470 0x7f7b7c068930 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7b94007c20 tx=0x7f7b94000ee0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.500+0000 7f7b9fa9a640 1 -- 172.21.15.133:0/827599231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b980aa7a0 msgr2=0x7f7b981f1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:50.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.500+0000 7f7b9fa9a640 1 --2- 172.21.15.133:0/827599231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b980aa7a0 0x7f7b981f1ac0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7b980c3840 tx=0x7f7b9000ead0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.500+0000 7f7b9fa9a640 1 -- 172.21.15.133:0/827599231 shutdown_connections 2023-12-19T19:01:50.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.500+0000 7f7b9fa9a640 1 --2- 172.21.15.133:0/827599231 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b7c066470 0x7f7b7c068930 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.500+0000 7f7b9fa9a640 1 --2- 172.21.15.133:0/827599231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b980aa7a0 0x7f7b981f1ac0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.500+0000 7f7b9fa9a640 1 --2- 172.21.15.133:0/827599231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b9806fe50 0x7f7b980c29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.500+0000 7f7b9fa9a640 1 --2- 172.21.15.133:0/827599231 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b840047d0 0x7f7b980c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.500+0000 7f7b9fa9a640 1 -- 172.21.15.133:0/827599231 >> 172.21.15.133:0/827599231 conn(0x7f7b9806a5b0 msgr2=0x7f7b980a7240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:50.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.500+0000 7f7b9fa9a640 1 -- 172.21.15.133:0/827599231 shutdown_connections 2023-12-19T19:01:50.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.500+0000 7f7b9fa9a640 1 -- 172.21.15.133:0/827599231 wait complete. 2023-12-19T19:01:50.524 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2023-12-19T19:01:50.524 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2023-12-19T19:01:50.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.660+0000 7f86f8a32640 1 Processor -- start 2023-12-19T19:01:50.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.660+0000 7f86f8a32640 1 -- start start 2023-12-19T19:01:50.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.660+0000 7f86f8a32640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f86f406ca40 0x7f86f40c8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:50.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.660+0000 7f86f8a32640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f4154e90 con 0x7f86f4151c70 2023-12-19T19:01:50.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.660+0000 7f86f8a32640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f40c5350 con 0x7f86f4155320 2023-12-19T19:01:50.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.660+0000 7f86f8a32640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86f406ce90 con 0x7f86f406ca40 2023-12-19T19:01:50.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.664+0000 7f86f259c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f86f4151c70 0x7f86f40c48b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42476/0 (socket says 172.21.15.133:42476) 2023-12-19T19:01:50.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.664+0000 7f86f259c640 1 -- 172.21.15.133:0/1413206476 learned_addr learned my addr 172.21.15.133:0/1413206476 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:50.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.664+0000 7f86f2d9d640 1 --2- 172.21.15.133:0/1413206476 >> v2:172.21.15.138:3300/0 conn(0x7f86f406ca40 0x7f86f40c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:50.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.664+0000 7f86f159a640 1 -- 172.21.15.133:0/1413206476 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854518968 0 0) 0x7f86f4154e90 con 0x7f86f4151c70 2023-12-19T19:01:50.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.664+0000 7f86f159a640 1 -- 172.21.15.133:0/1413206476 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86dc003530 con 0x7f86f4151c70 2023-12-19T19:01:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.664+0000 7f86f2d9d640 1 -- 172.21.15.133:0/1413206476 >> v1:172.21.15.138:6789/0 conn(0x7f86f4155320 legacy=0x7f86f40c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.664+0000 7f86f2d9d640 1 -- 172.21.15.133:0/1413206476 >> v1:172.21.15.133:6789/0 conn(0x7f86f4151c70 legacy=0x7f86f40c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:50.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.664+0000 7f86f2d9d640 1 -- 172.21.15.133:0/1413206476 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f4152050 con 0x7f86f406ca40 2023-12-19T19:01:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.664+0000 7f86f2d9d640 1 --2- 172.21.15.133:0/1413206476 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f86f406ca40 0x7f86f40c8050 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009d90 tx=0x7f86ec01c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2357c37620ba31 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.664+0000 7f86f159a640 1 -- 172.21.15.133:0/1413206476 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec0a5870 con 0x7f86f406ca40 2023-12-19T19:01:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.664+0000 7f86f159a640 1 -- 172.21.15.133:0/1413206476 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86ec0a59d0 con 0x7f86f406ca40 2023-12-19T19:01:50.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.664+0000 7f86f159a640 1 -- 172.21.15.133:0/1413206476 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec0a5d60 con 0x7f86f406ca40 2023-12-19T19:01:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.668+0000 7f86f8a32640 1 -- 172.21.15.133:0/1413206476 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f86f406ca40 msgr2=0x7f86f40c8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.668+0000 7f86f8a32640 1 --2- 172.21.15.133:0/1413206476 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f86f406ca40 0x7f86f40c8050 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f86ec009d90 tx=0x7f86ec01c8c0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.668+0000 7f86f8a32640 1 -- 172.21.15.133:0/1413206476 shutdown_connections 2023-12-19T19:01:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.668+0000 7f86f8a32640 1 --2- 172.21.15.133:0/1413206476 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f86f406ca40 0x7f86f40c8050 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.668+0000 7f86f8a32640 1 -- 172.21.15.133:0/1413206476 >> 172.21.15.133:0/1413206476 conn(0x7f86f40abcf0 msgr2=0x7f86f40ac100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.668+0000 7f86f8a32640 1 -- 172.21.15.133:0/1413206476 shutdown_connections 2023-12-19T19:01:50.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.668+0000 7f86f8a32640 1 -- 172.21.15.133:0/1413206476 wait complete. 2023-12-19T19:01:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.668+0000 7f86f8a32640 1 Processor -- start 2023-12-19T19:01:50.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.668+0000 7f86f8a32640 1 -- start start 2023-12-19T19:01:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.668+0000 7f86f8a32640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86f406ca40 0x7f86f41ed740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.668+0000 7f86f8a32640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f86f4151c70 0x7f86f406b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.668+0000 7f86f8a32640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f86f4155320 0x7f86f40ae150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.668+0000 7f86f8a32640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f40adf20 con 0x7f86f406ca40 2023-12-19T19:01:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.668+0000 7f86f8a32640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f41f0c00 con 0x7f86f4155320 2023-12-19T19:01:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.668+0000 7f86f8a32640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f41ecc60 con 0x7f86f4151c70 2023-12-19T19:01:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.668+0000 7f86f259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86f406ca40 0x7f86f41ed740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.668+0000 7f86f259c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86f406ca40 0x7f86f41ed740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58544/0 (socket says 172.21.15.133:58544) 2023-12-19T19:01:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.668+0000 7f86f259c640 1 -- 172.21.15.133:0/723380383 learned_addr learned my addr 172.21.15.133:0/723380383 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:50.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.668+0000 7f86f2d9d640 1 --2- 172.21.15.133:0/723380383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f86f4155320 0x7f86f40ae150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.668+0000 7f86f1d9b640 1 --2- 172.21.15.133:0/723380383 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f86f4151c70 0x7f86f406b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.672+0000 7f86f259c640 1 -- 172.21.15.133:0/723380383 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f86f4151c70 msgr2=0x7f86f406b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.672+0000 7f86f259c640 1 --2- 172.21.15.133:0/723380383 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f86f4151c70 0x7f86f406b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.672+0000 7f86f259c640 1 -- 172.21.15.133:0/723380383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f86f4155320 msgr2=0x7f86f40ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.672+0000 7f86f259c640 1 --2- 172.21.15.133:0/723380383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f86f4155320 0x7f86f40ae150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.672+0000 7f86f259c640 1 -- 172.21.15.133:0/723380383 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec009a70 con 0x7f86f406ca40 2023-12-19T19:01:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.672+0000 7f86f259c640 1 --2- 172.21.15.133:0/723380383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86f406ca40 0x7f86f41ed740 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f86e400c4d0 tx=0x7f86e400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.672+0000 7f86e2ffd640 1 -- 172.21.15.133:0/723380383 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e4005cf0 con 0x7f86f406ca40 2023-12-19T19:01:50.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.672+0000 7f86e2ffd640 1 -- 172.21.15.133:0/723380383 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e4005e50 con 0x7f86f406ca40 2023-12-19T19:01:50.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.672+0000 7f86f8a32640 1 -- 172.21.15.133:0/723380383 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f41ecf40 con 0x7f86f406ca40 2023-12-19T19:01:50.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.672+0000 7f86e2ffd640 1 -- 172.21.15.133:0/723380383 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e4007270 con 0x7f86f406ca40 2023-12-19T19:01:50.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.672+0000 7f86f8a32640 1 -- 172.21.15.133:0/723380383 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f406bc70 con 0x7f86f406ca40 2023-12-19T19:01:50.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.672+0000 7f86f8a32640 1 -- 172.21.15.133:0/723380383 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f4068400 con 0x7f86f406ca40 2023-12-19T19:01:50.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.672+0000 7f86e2ffd640 1 -- 172.21.15.133:0/723380383 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f86e40073d0 con 0x7f86f406ca40 2023-12-19T19:01:50.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.672+0000 7f86e2ffd640 1 --2- 172.21.15.133:0/723380383 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f86d4066470 0x7f86d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:50.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.672+0000 7f86e2ffd640 1 -- 172.21.15.133:0/723380383 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86e4083360 con 0x7f86f406ca40 2023-12-19T19:01:50.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.672+0000 7f86f1d9b640 1 --2- 172.21.15.133:0/723380383 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f86d4066470 0x7f86d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:50.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.676+0000 7f86f1d9b640 1 --2- 172.21.15.133:0/723380383 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f86d4066470 0x7f86d4068930 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f86f40c21a0 tx=0x7f86e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:50.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.676+0000 7f86e2ffd640 1 -- 172.21.15.133:0/723380383 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f86e4050900 con 0x7f86f406ca40 2023-12-19T19:01:50.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:50.828+0000 7f86f8a32640 1 -- 172.21.15.133:0/723380383 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f86f40c7e30 con 0x7f86f406ca40 2023-12-19T19:01:51.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.664+0000 7f86e2ffd640 1 -- 172.21.15.133:0/723380383 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v70) v1 ==== 140+0+0 (secure 0 0 0) 0x7f86e4053f20 con 0x7f86f406ca40 2023-12-19T19:01:51.671 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs2_metadata' created 2023-12-19T19:01:51.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.668+0000 7f86f8a32640 1 -- 172.21.15.133:0/723380383 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f86d4066470 msgr2=0x7f86d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:51.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.668+0000 7f86f8a32640 1 --2- 172.21.15.133:0/723380383 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f86d4066470 0x7f86d4068930 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f86f40c21a0 tx=0x7f86e8009040 comp rx=0 tx=0).stop 2023-12-19T19:01:51.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.668+0000 7f86f8a32640 1 -- 172.21.15.133:0/723380383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86f406ca40 msgr2=0x7f86f41ed740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:51.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.668+0000 7f86f8a32640 1 --2- 172.21.15.133:0/723380383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86f406ca40 0x7f86f41ed740 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f86e400c4d0 tx=0x7f86e400c990 comp rx=0 tx=0).stop 2023-12-19T19:01:51.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.668+0000 7f86f8a32640 1 -- 172.21.15.133:0/723380383 shutdown_connections 2023-12-19T19:01:51.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.668+0000 7f86f8a32640 1 --2- 172.21.15.133:0/723380383 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f86d4066470 0x7f86d4068930 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:51.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.668+0000 7f86f8a32640 1 --2- 172.21.15.133:0/723380383 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f86f4155320 0x7f86f40ae150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:51.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.668+0000 7f86f8a32640 1 --2- 172.21.15.133:0/723380383 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f86f4151c70 0x7f86f406b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:51.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.668+0000 7f86f8a32640 1 --2- 172.21.15.133:0/723380383 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86f406ca40 0x7f86f41ed740 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:51.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.668+0000 7f86f8a32640 1 -- 172.21.15.133:0/723380383 >> 172.21.15.133:0/723380383 conn(0x7f86f40abcf0 msgr2=0x7f86f40c8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:51.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.668+0000 7f86f8a32640 1 -- 172.21.15.133:0/723380383 shutdown_connections 2023-12-19T19:01:51.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.668+0000 7f86f8a32640 1 -- 172.21.15.133:0/723380383 wait complete. 2023-12-19T19:01:51.701 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T19:01:51.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.840+0000 7f645b2bb640 1 Processor -- start 2023-12-19T19:01:51.882 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.840+0000 7f645b2bb640 1 -- start start 2023-12-19T19:01:51.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.840+0000 7f645b2bb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64540c5640 0x7f64540c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:51.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.840+0000 7f645b2bb640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64540c2580 con 0x7f64540c5260 2023-12-19T19:01:51.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.840+0000 7f645b2bb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64540c1a00 con 0x7f64540c60f0 2023-12-19T19:01:51.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.840+0000 7f645b2bb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6454153510 con 0x7f64540c5640 2023-12-19T19:01:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.844+0000 7f6459057640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f64540c5260 0x7f645406d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42488/0 (socket says 172.21.15.133:42488) 2023-12-19T19:01:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.844+0000 7f6459057640 1 -- 172.21.15.133:0/675055232 learned_addr learned my addr 172.21.15.133:0/675055232 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.844+0000 7f6458856640 1 --2- 172.21.15.133:0/675055232 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64540c5640 0x7f64540c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.844+0000 7f644bfff640 1 -- 172.21.15.133:0/675055232 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154709580 0 0) 0x7f64540c2580 con 0x7f64540c5260 2023-12-19T19:01:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.844+0000 7f644bfff640 1 -- 172.21.15.133:0/675055232 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6440003530 con 0x7f64540c5260 2023-12-19T19:01:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.844+0000 7f6458856640 1 -- 172.21.15.133:0/675055232 >> v1:172.21.15.138:6789/0 conn(0x7f64540c60f0 legacy=0x7f6454155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.844+0000 7f644bfff640 1 -- 172.21.15.133:0/675055232 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992947360 0 0) 0x7f64540c1a00 con 0x7f64540c60f0 2023-12-19T19:01:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.844+0000 7f6458856640 1 -- 172.21.15.133:0/675055232 >> v1:172.21.15.133:6789/0 conn(0x7f64540c5260 legacy=0x7f645406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.844+0000 7f6458856640 1 -- 172.21.15.133:0/675055232 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64540c1ce0 con 0x7f64540c5640 2023-12-19T19:01:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.844+0000 7f6458856640 1 --2- 172.21.15.133:0/675055232 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64540c5640 0x7f64540c5bb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f64440097f0 tx=0x7f644401c430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c519ffed47a1830 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.844+0000 7f644bfff640 1 -- 172.21.15.133:0/675055232 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64440ab600 con 0x7f64540c5640 2023-12-19T19:01:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.844+0000 7f644bfff640 1 -- 172.21.15.133:0/675055232 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64440a7050 con 0x7f64540c5640 2023-12-19T19:01:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.844+0000 7f644bfff640 1 -- 172.21.15.133:0/675055232 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64440ab960 con 0x7f64540c5640 2023-12-19T19:01:51.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f645b2bb640 1 -- 172.21.15.133:0/675055232 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64540c5640 msgr2=0x7f64540c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f645b2bb640 1 --2- 172.21.15.133:0/675055232 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64540c5640 0x7f64540c5bb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f64440097f0 tx=0x7f644401c430 comp rx=0 tx=0).stop 2023-12-19T19:01:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f645b2bb640 1 -- 172.21.15.133:0/675055232 shutdown_connections 2023-12-19T19:01:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f645b2bb640 1 --2- 172.21.15.133:0/675055232 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64540c5640 0x7f64540c5bb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f645b2bb640 1 -- 172.21.15.133:0/675055232 >> 172.21.15.133:0/675055232 conn(0x7f645406a5b0 msgr2=0x7f645406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f645b2bb640 1 -- 172.21.15.133:0/675055232 shutdown_connections 2023-12-19T19:01:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f645b2bb640 1 -- 172.21.15.133:0/675055232 wait complete. 2023-12-19T19:01:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f645b2bb640 1 Processor -- start 2023-12-19T19:01:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f645b2bb640 1 -- start start 2023-12-19T19:01:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f645b2bb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64540c5260 0x7f64540bffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f645b2bb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64540c5640 0x7f6454070de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f645b2bb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64540c60f0 0x7f6454150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f645b2bb640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6454152c20 con 0x7f64540c5640 2023-12-19T19:01:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f645b2bb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64541531a0 con 0x7f64540c60f0 2023-12-19T19:01:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f645b2bb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6454150410 con 0x7f64540c5260 2023-12-19T19:01:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f6458856640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64540c5640 0x7f6454070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:51.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f6458856640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64540c5640 0x7f6454070de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58548/0 (socket says 172.21.15.133:58548) 2023-12-19T19:01:51.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f6458856640 1 -- 172.21.15.133:0/1590690697 learned_addr learned my addr 172.21.15.133:0/1590690697 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:51.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f6459057640 1 --2- 172.21.15.133:0/1590690697 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64540c5260 0x7f64540bffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:51.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f6459858640 1 --2- 172.21.15.133:0/1590690697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64540c60f0 0x7f6454150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:51.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f6458856640 1 -- 172.21.15.133:0/1590690697 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64540c5260 msgr2=0x7f64540bffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:51.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f6458856640 1 --2- 172.21.15.133:0/1590690697 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64540c5260 0x7f64540bffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:51.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f6458856640 1 -- 172.21.15.133:0/1590690697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64540c60f0 msgr2=0x7f6454150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:51.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f6458856640 1 --2- 172.21.15.133:0/1590690697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64540c60f0 0x7f6454150d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:51.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.848+0000 7f6458856640 1 -- 172.21.15.133:0/1590690697 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6444009420 con 0x7f64540c5640 2023-12-19T19:01:51.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.852+0000 7f6458856640 1 --2- 172.21.15.133:0/1590690697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64540c5640 0x7f6454070de0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f64440097f0 tx=0x7f644401ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:51.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.852+0000 7f6449ffb640 1 -- 172.21.15.133:0/1590690697 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64440b7450 con 0x7f64540c5640 2023-12-19T19:01:51.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.852+0000 7f6449ffb640 1 -- 172.21.15.133:0/1590690697 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64440b75b0 con 0x7f64540c5640 2023-12-19T19:01:51.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.852+0000 7f645b2bb640 1 -- 172.21.15.133:0/1590690697 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64541506f0 con 0x7f64540c5640 2023-12-19T19:01:51.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.852+0000 7f6449ffb640 1 -- 172.21.15.133:0/1590690697 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64440b7920 con 0x7f64540c5640 2023-12-19T19:01:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.852+0000 7f645b2bb640 1 -- 172.21.15.133:0/1590690697 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645415d4e0 con 0x7f64540c5640 2023-12-19T19:01:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.852+0000 7f645b2bb640 1 -- 172.21.15.133:0/1590690697 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6454150930 con 0x7f64540c5640 2023-12-19T19:01:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.852+0000 7f6449ffb640 1 -- 172.21.15.133:0/1590690697 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f64440b7a80 con 0x7f64540c5640 2023-12-19T19:01:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.856+0000 7f6449ffb640 1 --2- 172.21.15.133:0/1590690697 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f64380664a0 0x7f6438068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.856+0000 7f6449ffb640 1 -- 172.21.15.133:0/1590690697 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f644411e830 con 0x7f64540c5640 2023-12-19T19:01:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.856+0000 7f6459057640 1 --2- 172.21.15.133:0/1590690697 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f64380664a0 0x7f6438068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.856+0000 7f6459057640 1 --2- 172.21.15.133:0/1590690697 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f64380664a0 0x7f6438068960 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6450007fd0 tx=0x7f6450009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:51.890 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:51.860+0000 7f6449ffb640 1 -- 172.21.15.133:0/1590690697 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f64440ebcf0 con 0x7f64540c5640 2023-12-19T19:01:52.017 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.012+0000 7f645b2bb640 1 -- 172.21.15.133:0/1590690697 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6454153310 con 0x7f64540c5640 2023-12-19T19:01:52.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.672+0000 7f6449ffb640 1 -- 172.21.15.133:0/1590690697 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v71) v1 ==== 172+0+0 (secure 0 0 0) 0x7f64440ef310 con 0x7f64540c5640 2023-12-19T19:01:52.676 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs2_data' created 2023-12-19T19:01:52.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.672+0000 7f645b2bb640 1 -- 172.21.15.133:0/1590690697 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f64380664a0 msgr2=0x7f6438068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:52.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.672+0000 7f645b2bb640 1 --2- 172.21.15.133:0/1590690697 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f64380664a0 0x7f6438068960 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6450007fd0 tx=0x7f6450009040 comp rx=0 tx=0).stop 2023-12-19T19:01:52.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.672+0000 7f645b2bb640 1 -- 172.21.15.133:0/1590690697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64540c5640 msgr2=0x7f6454070de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:52.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.672+0000 7f645b2bb640 1 --2- 172.21.15.133:0/1590690697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64540c5640 0x7f6454070de0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f64440097f0 tx=0x7f644401ac70 comp rx=0 tx=0).stop 2023-12-19T19:01:52.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.672+0000 7f645b2bb640 1 -- 172.21.15.133:0/1590690697 shutdown_connections 2023-12-19T19:01:52.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.672+0000 7f645b2bb640 1 --2- 172.21.15.133:0/1590690697 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f64380664a0 0x7f6438068960 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:52.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.672+0000 7f645b2bb640 1 --2- 172.21.15.133:0/1590690697 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f64540c60f0 0x7f6454150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:52.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.672+0000 7f645b2bb640 1 --2- 172.21.15.133:0/1590690697 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f64540c5640 0x7f6454070de0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:52.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.672+0000 7f645b2bb640 1 --2- 172.21.15.133:0/1590690697 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f64540c5260 0x7f64540bffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:52.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.672+0000 7f645b2bb640 1 -- 172.21.15.133:0/1590690697 >> 172.21.15.133:0/1590690697 conn(0x7f645406a5b0 msgr2=0x7f645406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:52.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.672+0000 7f645b2bb640 1 -- 172.21.15.133:0/1590690697 shutdown_connections 2023-12-19T19:01:52.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.672+0000 7f645b2bb640 1 -- 172.21.15.133:0/1590690697 wait complete. 2023-12-19T19:01:52.715 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2023-12-19T19:01:52.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.848+0000 7fe2afb80640 1 Processor -- start 2023-12-19T19:01:52.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.848+0000 7fe2afb80640 1 -- start start 2023-12-19T19:01:52.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.852+0000 7fe2afb80640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe2a80a5370 0x7fe2a8150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:52.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.852+0000 7fe2afb80640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a80c2760 con 0x7fe2a80725c0 2023-12-19T19:01:52.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.852+0000 7fe2afb80640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a80a57c0 con 0x7fe2a8072090 2023-12-19T19:01:52.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.852+0000 7fe2afb80640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a80c3070 con 0x7fe2a80a5370 2023-12-19T19:01:52.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.852+0000 7fe2ad11b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe2a80725c0 0x7fe2a80c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42498/0 (socket says 172.21.15.133:42498) 2023-12-19T19:01:52.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.852+0000 7fe2ad11b640 1 -- 172.21.15.133:0/697681368 learned_addr learned my addr 172.21.15.133:0/697681368 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:52.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.852+0000 7fe2ae11d640 1 --2- 172.21.15.133:0/697681368 >> v2:172.21.15.138:3300/0 conn(0x7fe2a80a5370 0x7fe2a8150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:52.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.852+0000 7fe2ac91a640 1 -- 172.21.15.133:0/697681368 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2088205362 0 0) 0x7fe2a80c2760 con 0x7fe2a80725c0 2023-12-19T19:01:52.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.852+0000 7fe2ac91a640 1 -- 172.21.15.133:0/697681368 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe294005740 con 0x7fe2a80725c0 2023-12-19T19:01:52.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.852+0000 7fe2ae11d640 1 -- 172.21.15.133:0/697681368 >> v1:172.21.15.138:6789/0 conn(0x7fe2a8072090 legacy=0x7fe2a80c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:52.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.852+0000 7fe2ae11d640 1 -- 172.21.15.133:0/697681368 >> v1:172.21.15.133:6789/0 conn(0x7fe2a80725c0 legacy=0x7fe2a80c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:52.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.852+0000 7fe2ae11d640 1 -- 172.21.15.133:0/697681368 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a80aad20 con 0x7fe2a80a5370 2023-12-19T19:01:52.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.856+0000 7fe2ae11d640 1 --2- 172.21.15.133:0/697681368 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2a80a5370 0x7fe2a8150fa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0009d90 tx=0x7fe2a001c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4a8d1f51c3fd652 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:52.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.856+0000 7fe2ac91a640 1 -- 172.21.15.133:0/697681368 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a00a5780 con 0x7fe2a80a5370 2023-12-19T19:01:52.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.856+0000 7fe2ac91a640 1 -- 172.21.15.133:0/697681368 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a00a58e0 con 0x7fe2a80a5370 2023-12-19T19:01:52.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.856+0000 7fe2ac91a640 1 -- 172.21.15.133:0/697681368 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a00a5c70 con 0x7fe2a80a5370 2023-12-19T19:01:52.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.856+0000 7fe2afb80640 1 -- 172.21.15.133:0/697681368 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2a80a5370 msgr2=0x7fe2a8150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:52.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.856+0000 7fe2afb80640 1 --2- 172.21.15.133:0/697681368 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2a80a5370 0x7fe2a8150fa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0009d90 tx=0x7fe2a001c830 comp rx=0 tx=0).stop 2023-12-19T19:01:52.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.856+0000 7fe2afb80640 1 -- 172.21.15.133:0/697681368 shutdown_connections 2023-12-19T19:01:52.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.856+0000 7fe2afb80640 1 --2- 172.21.15.133:0/697681368 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2a80a5370 0x7fe2a8150fa0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:52.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.856+0000 7fe2afb80640 1 -- 172.21.15.133:0/697681368 >> 172.21.15.133:0/697681368 conn(0x7fe2a806a5b0 msgr2=0x7fe2a806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:52.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.856+0000 7fe2afb80640 1 -- 172.21.15.133:0/697681368 shutdown_connections 2023-12-19T19:01:52.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.856+0000 7fe2afb80640 1 -- 172.21.15.133:0/697681368 wait complete. 2023-12-19T19:01:52.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.856+0000 7fe2afb80640 1 Processor -- start 2023-12-19T19:01:52.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.856+0000 7fe2afb80640 1 -- start start 2023-12-19T19:01:52.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.860+0000 7fe2afb80640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2a8072090 0x7fe2a81468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:52.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.860+0000 7fe2afb80640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2a80725c0 0x7fe2a80a6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:52.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.860+0000 7fe2afb80640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2a80a5370 0x7fe2a81521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:52.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.860+0000 7fe2afb80640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a8146e20 con 0x7fe2a8072090 2023-12-19T19:01:52.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.860+0000 7fe2afb80640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a8143980 con 0x7fe2a80a5370 2023-12-19T19:01:52.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.860+0000 7fe2afb80640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a8147e90 con 0x7fe2a80725c0 2023-12-19T19:01:52.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.860+0000 7fe2ad91c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2a8072090 0x7fe2a81468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:52.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.860+0000 7fe2ad91c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2a8072090 0x7fe2a81468e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58556/0 (socket says 172.21.15.133:58556) 2023-12-19T19:01:52.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.860+0000 7fe2ad91c640 1 -- 172.21.15.133:0/1493855398 learned_addr learned my addr 172.21.15.133:0/1493855398 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:52.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.860+0000 7fe2ad11b640 1 --2- 172.21.15.133:0/1493855398 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2a80725c0 0x7fe2a80a6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:52.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.860+0000 7fe2ae11d640 1 --2- 172.21.15.133:0/1493855398 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2a80a5370 0x7fe2a81521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:52.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.860+0000 7fe2ad91c640 1 -- 172.21.15.133:0/1493855398 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2a80725c0 msgr2=0x7fe2a80a6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:52.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.860+0000 7fe2ad91c640 1 --2- 172.21.15.133:0/1493855398 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2a80725c0 0x7fe2a80a6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:52.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.860+0000 7fe2ad91c640 1 -- 172.21.15.133:0/1493855398 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2a80a5370 msgr2=0x7fe2a81521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:52.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.860+0000 7fe2ad91c640 1 --2- 172.21.15.133:0/1493855398 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2a80a5370 0x7fe2a81521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:52.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.860+0000 7fe2ad91c640 1 -- 172.21.15.133:0/1493855398 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a0009a70 con 0x7fe2a8072090 2023-12-19T19:01:52.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.860+0000 7fe2ad91c640 1 --2- 172.21.15.133:0/1493855398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2a8072090 0x7fe2a81468e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400c500 tx=0x7fe2a400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:52.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.860+0000 7fe29e7fc640 1 -- 172.21.15.133:0/1493855398 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4005220 con 0x7fe2a8072090 2023-12-19T19:01:52.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.860+0000 7fe29e7fc640 1 -- 172.21.15.133:0/1493855398 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a4005380 con 0x7fe2a8072090 2023-12-19T19:01:52.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.860+0000 7fe29e7fc640 1 -- 172.21.15.133:0/1493855398 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4007270 con 0x7fe2a8072090 2023-12-19T19:01:52.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.860+0000 7fe2afb80640 1 -- 172.21.15.133:0/1493855398 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a8148170 con 0x7fe2a8072090 2023-12-19T19:01:52.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.860+0000 7fe2afb80640 1 -- 172.21.15.133:0/1493855398 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a8148730 con 0x7fe2a8072090 2023-12-19T19:01:52.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.860+0000 7fe2afb80640 1 -- 172.21.15.133:0/1493855398 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a8068400 con 0x7fe2a8072090 2023-12-19T19:01:52.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.864+0000 7fe29e7fc640 1 -- 172.21.15.133:0/1493855398 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe2a40073d0 con 0x7fe2a8072090 2023-12-19T19:01:52.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.864+0000 7fe29e7fc640 1 --2- 172.21.15.133:0/1493855398 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe28c066470 0x7fe28c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:52.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.864+0000 7fe29e7fc640 1 -- 172.21.15.133:0/1493855398 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fe2a4083cd0 con 0x7fe2a8072090 2023-12-19T19:01:52.868 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.864+0000 7fe2ad11b640 1 --2- 172.21.15.133:0/1493855398 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe28c066470 0x7fe28c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:52.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.864+0000 7fe2ad11b640 1 --2- 172.21.15.133:0/1493855398 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe28c066470 0x7fe28c068930 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8144560 tx=0x7fe298007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:52.871 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:52.868+0000 7fe29e7fc640 1 -- 172.21.15.133:0/1493855398 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fe2a4050f00 con 0x7fe2a8072090 2023-12-19T19:01:53.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.048+0000 7fe2afb80640 1 -- 172.21.15.133:0/1493855398 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7fe2a8071e70 con 0x7fe2a8072090 2023-12-19T19:01:53.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.700+0000 7fe29e7fc640 1 -- 172.21.15.133:0/1493855398 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 14 and data pool 15 v49) v1 ==== 177+0+0 (secure 0 0 0) 0x7fe2a40210c0 con 0x7fe2a8072090 2023-12-19T19:01:53.709 INFO:teuthology.orchestra.run.smithi133.stderr:new fs with metadata pool 14 and data pool 15 2023-12-19T19:01:53.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.716+0000 7fe2afb80640 1 -- 172.21.15.133:0/1493855398 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe28c066470 msgr2=0x7fe28c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:53.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.716+0000 7fe2afb80640 1 --2- 172.21.15.133:0/1493855398 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe28c066470 0x7fe28c068930 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8144560 tx=0x7fe298007d40 comp rx=0 tx=0).stop 2023-12-19T19:01:53.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.716+0000 7fe2afb80640 1 -- 172.21.15.133:0/1493855398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2a8072090 msgr2=0x7fe2a81468e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:53.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.716+0000 7fe2afb80640 1 --2- 172.21.15.133:0/1493855398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2a8072090 0x7fe2a81468e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fe2a400c500 tx=0x7fe2a400c9c0 comp rx=0 tx=0).stop 2023-12-19T19:01:53.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.716+0000 7fe2afb80640 1 -- 172.21.15.133:0/1493855398 shutdown_connections 2023-12-19T19:01:53.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.716+0000 7fe2afb80640 1 --2- 172.21.15.133:0/1493855398 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe28c066470 0x7fe28c068930 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:53.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.716+0000 7fe2afb80640 1 --2- 172.21.15.133:0/1493855398 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe2a80a5370 0x7fe2a81521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:53.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.716+0000 7fe2afb80640 1 --2- 172.21.15.133:0/1493855398 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe2a80725c0 0x7fe2a80a6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:53.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.716+0000 7fe2afb80640 1 --2- 172.21.15.133:0/1493855398 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe2a8072090 0x7fe2a81468e0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:53.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.716+0000 7fe2afb80640 1 -- 172.21.15.133:0/1493855398 >> 172.21.15.133:0/1493855398 conn(0x7fe2a806a5b0 msgr2=0x7fe2a806ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:53.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.716+0000 7fe2afb80640 1 -- 172.21.15.133:0/1493855398 shutdown_connections 2023-12-19T19:01:53.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.716+0000 7fe2afb80640 1 -- 172.21.15.133:0/1493855398 wait complete. 2023-12-19T19:01:53.753 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:01:53.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.888+0000 7fba83b65640 1 Processor -- start 2023-12-19T19:01:53.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.888+0000 7fba83b65640 1 -- start start 2023-12-19T19:01:53.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.888+0000 7fba83b65640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba7c0c63c0 0x7fba7c0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:53.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.888+0000 7fba83b65640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fba7c0c4100 0x7fba7c0c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:53.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.888+0000 7fba83b65640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fba7c0c29e0 0x7fba7c0a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:53.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.888+0000 7fba83b65640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7c0c31c0 con 0x7fba7c0c29e0 2023-12-19T19:01:53.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.888+0000 7fba83b65640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba7c0c34a0 con 0x7fba7c0c4100 2023-12-19T19:01:53.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.888+0000 7fba83b65640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0c1030 con 0x7fba7c0c63c0 2023-12-19T19:01:53.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.888+0000 7fba82102640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fba7c0c29e0 0x7fba7c0a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:53.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.888+0000 7fba82102640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fba7c0c29e0 0x7fba7c0a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58564/0 (socket says 172.21.15.133:58564) 2023-12-19T19:01:53.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.888+0000 7fba82102640 1 -- 172.21.15.133:0/1859423239 learned_addr learned my addr 172.21.15.133:0/1859423239 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:53.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.888+0000 7fba81100640 1 --2- 172.21.15.133:0/1859423239 >> v2:172.21.15.138:3300/0 conn(0x7fba7c0c4100 0x7fba7c0c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:53.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.888+0000 7fba81901640 1 --2- 172.21.15.133:0/1859423239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba7c0c63c0 0x7fba7c0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:53.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.888+0000 7fba82102640 1 -- 172.21.15.133:0/1859423239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba7c0c63c0 msgr2=0x7fba7c0c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:53.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.888+0000 7fba82102640 1 --2- 172.21.15.133:0/1859423239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba7c0c63c0 0x7fba7c0c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:53.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.888+0000 7fba82102640 1 -- 172.21.15.133:0/1859423239 >> v2:172.21.15.138:3300/0 conn(0x7fba7c0c4100 msgr2=0x7fba7c0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:53.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.888+0000 7fba82102640 1 --2- 172.21.15.133:0/1859423239 >> v2:172.21.15.138:3300/0 conn(0x7fba7c0c4100 0x7fba7c0c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:53.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.888+0000 7fba82102640 1 -- 172.21.15.133:0/1859423239 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c0c1310 con 0x7fba7c0c29e0 2023-12-19T19:01:53.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.892+0000 7fba82102640 1 --2- 172.21.15.133:0/1859423239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba7c0c29e0 0x7fba7c0a9680 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fba7c06b390 tx=0x7fba7401ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614ca4d85883da7c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:53.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.892+0000 7fba808ff640 1 -- 172.21.15.133:0/1859423239 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0aa3d0 con 0x7fba7c0c29e0 2023-12-19T19:01:53.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.892+0000 7fba808ff640 1 -- 172.21.15.133:0/1859423239 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba740a7940 con 0x7fba7c0c29e0 2023-12-19T19:01:53.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.892+0000 7fba808ff640 1 -- 172.21.15.133:0/1859423239 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba740a7cd0 con 0x7fba7c0c29e0 2023-12-19T19:01:53.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.892+0000 7fba83b65640 1 -- 172.21.15.133:0/1859423239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba7c0c29e0 msgr2=0x7fba7c0a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:53.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.892+0000 7fba83b65640 1 --2- 172.21.15.133:0/1859423239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba7c0c29e0 0x7fba7c0a9680 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fba7c06b390 tx=0x7fba7401ea90 comp rx=0 tx=0).stop 2023-12-19T19:01:53.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.892+0000 7fba83b65640 1 -- 172.21.15.133:0/1859423239 shutdown_connections 2023-12-19T19:01:53.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.892+0000 7fba83b65640 1 --2- 172.21.15.133:0/1859423239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba7c0c29e0 0x7fba7c0a9680 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:53.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.892+0000 7fba83b65640 1 --2- 172.21.15.133:0/1859423239 >> v2:172.21.15.138:3300/0 conn(0x7fba7c0c4100 0x7fba7c0c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:53.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.892+0000 7fba83b65640 1 --2- 172.21.15.133:0/1859423239 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba7c0c63c0 0x7fba7c0c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:53.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.892+0000 7fba83b65640 1 -- 172.21.15.133:0/1859423239 >> 172.21.15.133:0/1859423239 conn(0x7fba7c06a5b0 msgr2=0x7fba7c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:53.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.892+0000 7fba83b65640 1 -- 172.21.15.133:0/1859423239 shutdown_connections 2023-12-19T19:01:53.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.892+0000 7fba83b65640 1 -- 172.21.15.133:0/1859423239 wait complete. 2023-12-19T19:01:53.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba83b65640 1 Processor -- start 2023-12-19T19:01:53.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba83b65640 1 -- start start 2023-12-19T19:01:53.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba83b65640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba7c0c29e0 0x7fba7c0a4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:53.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba83b65640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba7c0c4100 0x7fba7c0702f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:53.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba83b65640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba7c0c63c0 0x7fba7c152b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:53.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba83b65640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c0a52f0 con 0x7fba7c0c29e0 2023-12-19T19:01:53.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba83b65640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c09c540 con 0x7fba7c0c4100 2023-12-19T19:01:53.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba83b65640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba7c1ed460 con 0x7fba7c0c63c0 2023-12-19T19:01:53.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba81901640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba7c0c29e0 0x7fba7c0a4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:53.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba81901640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba7c0c29e0 0x7fba7c0a4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58566/0 (socket says 172.21.15.133:58566) 2023-12-19T19:01:53.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba81901640 1 -- 172.21.15.133:0/145804138 learned_addr learned my addr 172.21.15.133:0/145804138 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:53.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba82102640 1 --2- 172.21.15.133:0/145804138 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba7c0c63c0 0x7fba7c152b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:53.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba81100640 1 --2- 172.21.15.133:0/145804138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba7c0c4100 0x7fba7c0702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:53.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba81901640 1 -- 172.21.15.133:0/145804138 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba7c0c63c0 msgr2=0x7fba7c152b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:53.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba81901640 1 --2- 172.21.15.133:0/145804138 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba7c0c63c0 0x7fba7c152b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:53.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba81901640 1 -- 172.21.15.133:0/145804138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba7c0c4100 msgr2=0x7fba7c0702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:53.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba81901640 1 --2- 172.21.15.133:0/145804138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba7c0c4100 0x7fba7c0702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:53.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba81901640 1 -- 172.21.15.133:0/145804138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba74009b30 con 0x7fba7c0c29e0 2023-12-19T19:01:53.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba81100640 1 --2- 172.21.15.133:0/145804138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba7c0c4100 0x7fba7c0702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:53.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba81901640 1 --2- 172.21.15.133:0/145804138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba7c0c29e0 0x7fba7c0a4db0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fba7800d5f0 tx=0x7fba7800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:53.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba727fc640 1 -- 172.21.15.133:0/145804138 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba780125f0 con 0x7fba7c0c29e0 2023-12-19T19:01:53.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba727fc640 1 -- 172.21.15.133:0/145804138 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba78012750 con 0x7fba7c0c29e0 2023-12-19T19:01:53.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba727fc640 1 -- 172.21.15.133:0/145804138 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba78012ae0 con 0x7fba7c0c29e0 2023-12-19T19:01:53.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba83b65640 1 -- 172.21.15.133:0/145804138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba7c0c69b0 con 0x7fba7c0c29e0 2023-12-19T19:01:53.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.896+0000 7fba83b65640 1 -- 172.21.15.133:0/145804138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba7c099df0 con 0x7fba7c0c29e0 2023-12-19T19:01:53.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.900+0000 7fba83b65640 1 -- 172.21.15.133:0/145804138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7c068400 con 0x7fba7c0c29e0 2023-12-19T19:01:53.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.900+0000 7fba727fc640 1 -- 172.21.15.133:0/145804138 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fba78012c40 con 0x7fba7c0c29e0 2023-12-19T19:01:53.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.900+0000 7fba727fc640 1 --2- 172.21.15.133:0/145804138 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fba600664a0 0x7fba60068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:53.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.900+0000 7fba727fc640 1 -- 172.21.15.133:0/145804138 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fba78084690 con 0x7fba7c0c29e0 2023-12-19T19:01:53.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.900+0000 7fba81100640 1 --2- 172.21.15.133:0/145804138 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fba600664a0 0x7fba60068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:53.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.900+0000 7fba81100640 1 --2- 172.21.15.133:0/145804138 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fba600664a0 0x7fba60068960 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0a60c0 tx=0x7fba6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:53.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:53.904+0000 7fba727fc640 1 -- 172.21.15.133:0/145804138 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fba780517a0 con 0x7fba7c0c29e0 2023-12-19T19:01:54.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.056+0000 7fba83b65640 1 -- 172.21.15.133:0/145804138 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba7c099f80 con 0x7fba7c0c29e0 2023-12-19T19:01:54.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.060+0000 7fba727fc640 1 -- 172.21.15.133:0/145804138 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20263 (secure 0 0 0) 0x7fba78004650 con 0x7fba7c0c29e0 2023-12-19T19:01:54.064 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:54.064 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":72,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:01:53.054260+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:01:33.082188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T19:01:34.349092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:01:50.875086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:01:52.061232+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:01:54.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.060+0000 7fba83b65640 1 -- 172.21.15.133:0/145804138 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fba600664a0 msgr2=0x7fba60068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:54.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.060+0000 7fba83b65640 1 --2- 172.21.15.133:0/145804138 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fba600664a0 0x7fba60068960 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fba7c0a60c0 tx=0x7fba6c008040 comp rx=0 tx=0).stop 2023-12-19T19:01:54.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.060+0000 7fba83b65640 1 -- 172.21.15.133:0/145804138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba7c0c29e0 msgr2=0x7fba7c0a4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:54.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.060+0000 7fba83b65640 1 --2- 172.21.15.133:0/145804138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba7c0c29e0 0x7fba7c0a4db0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fba7800d5f0 tx=0x7fba7800dab0 comp rx=0 tx=0).stop 2023-12-19T19:01:54.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.060+0000 7fba83b65640 1 -- 172.21.15.133:0/145804138 shutdown_connections 2023-12-19T19:01:54.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.060+0000 7fba83b65640 1 --2- 172.21.15.133:0/145804138 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fba600664a0 0x7fba60068960 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:54.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.060+0000 7fba83b65640 1 --2- 172.21.15.133:0/145804138 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fba7c0c63c0 0x7fba7c152b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:54.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.060+0000 7fba83b65640 1 --2- 172.21.15.133:0/145804138 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fba7c0c4100 0x7fba7c0702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:54.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.060+0000 7fba83b65640 1 --2- 172.21.15.133:0/145804138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba7c0c29e0 0x7fba7c0a4db0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:54.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.060+0000 7fba83b65640 1 -- 172.21.15.133:0/145804138 >> 172.21.15.133:0/145804138 conn(0x7fba7c06a5b0 msgr2=0x7fba7c0a6110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:54.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.060+0000 7fba83b65640 1 -- 172.21.15.133:0/145804138 shutdown_connections 2023-12-19T19:01:54.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.060+0000 7fba83b65640 1 -- 172.21.15.133:0/145804138 wait complete. 2023-12-19T19:01:54.086 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:01:54.223 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34de4bb640 1 Processor -- start 2023-12-19T19:01:54.224 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34de4bb640 1 -- start start 2023-12-19T19:01:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34de4bb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34d8151cd0 0x7f34d80ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34de4bb640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d80c8160 con 0x7f34d80c7c50 2023-12-19T19:01:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34de4bb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d8157b40 con 0x7f34d8154be0 2023-12-19T19:01:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34de4bb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d8157e20 con 0x7f34d8151cd0 2023-12-19T19:01:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34dccb8640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f34d80c7c50 0x7f34d81544d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:42502/0 (socket says 172.21.15.133:42502) 2023-12-19T19:01:54.225 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34dccb8640 1 -- 172.21.15.133:0/756691073 learned_addr learned my addr 172.21.15.133:0/756691073 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34dd4b9640 1 --2- 172.21.15.133:0/756691073 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34d8151cd0 0x7f34d80ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34cffff640 1 -- 172.21.15.133:0/756691073 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581265691 0 0) 0x7f34d80c8160 con 0x7f34d80c7c50 2023-12-19T19:01:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34cffff640 1 -- 172.21.15.133:0/756691073 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34c4003530 con 0x7f34d80c7c50 2023-12-19T19:01:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34cffff640 1 -- 172.21.15.133:0/756691073 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404216218 0 0) 0x7f34d8157b40 con 0x7f34d8154be0 2023-12-19T19:01:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34cffff640 1 -- 172.21.15.133:0/756691073 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34d80c8160 con 0x7f34d8154be0 2023-12-19T19:01:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34cffff640 1 -- 172.21.15.133:0/756691073 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2684175943 0 0) 0x7f34c4003530 con 0x7f34d80c7c50 2023-12-19T19:01:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34cffff640 1 -- 172.21.15.133:0/756691073 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34d8151cd0 msgr2=0x7f34d80ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:54.227 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34cffff640 1 --2- 172.21.15.133:0/756691073 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34d8151cd0 0x7f34d80ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:54.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34cffff640 1 -- 172.21.15.133:0/756691073 >> v1:172.21.15.138:6789/0 conn(0x7f34d8154be0 legacy=0x7f34d815ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:54.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34cffff640 1 -- 172.21.15.133:0/756691073 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d8158100 con 0x7f34d80c7c50 2023-12-19T19:01:54.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34cffff640 1 -- 172.21.15.133:0/756691073 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f34c8001680 con 0x7f34d80c7c50 2023-12-19T19:01:54.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34cffff640 1 -- 172.21.15.133:0/756691073 >> v1:172.21.15.133:6789/0 conn(0x7f34d80c7c50 legacy=0x7f34d81544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:54.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34cffff640 1 --2- 172.21.15.133:0/756691073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34c4003b40 0x7f34c4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:54.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34cffff640 1 --2- 172.21.15.133:0/756691073 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34d8151cd0 0x7f34c40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:54.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34cffff640 1 --2- 172.21.15.133:0/756691073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34c4004d10 0x7f34c4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:54.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34cffff640 1 -- 172.21.15.133:0/756691073 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d8157e20 con 0x7f34c4004d10 2023-12-19T19:01:54.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34cffff640 1 -- 172.21.15.133:0/756691073 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c400ba40 con 0x7f34c4003b40 2023-12-19T19:01:54.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34cffff640 1 -- 172.21.15.133:0/756691073 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c400bbb0 con 0x7f34d8151cd0 2023-12-19T19:01:54.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34dd4b9640 1 --2- 172.21.15.133:0/756691073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34c4003b40 0x7f34c4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:54.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34ddcba640 1 --2- 172.21.15.133:0/756691073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34c4004d10 0x7f34c4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:54.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34dccb8640 1 --2- 172.21.15.133:0/756691073 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34d8151cd0 0x7f34c40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:54.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34ddcba640 1 -- 172.21.15.133:0/756691073 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34d8151cd0 msgr2=0x7f34c40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:54.228 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34ddcba640 1 --2- 172.21.15.133:0/756691073 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34d8151cd0 0x7f34c40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:54.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34ddcba640 1 -- 172.21.15.133:0/756691073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34c4003b40 msgr2=0x7f34c4003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:54.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34ddcba640 1 --2- 172.21.15.133:0/756691073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34c4003b40 0x7f34c4003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:54.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.220+0000 7f34ddcba640 1 -- 172.21.15.133:0/756691073 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c4003530 con 0x7f34c4004d10 2023-12-19T19:01:54.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.224+0000 7f34ddcba640 1 --2- 172.21.15.133:0/756691073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34c4004d10 0x7f34c4005190 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f34d0001fd0 tx=0x7f34d001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d479e5d1cf6ed3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:54.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.224+0000 7f34cffff640 1 -- 172.21.15.133:0/756691073 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c8007ea0 con 0x7f34c4004d10 2023-12-19T19:01:54.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.224+0000 7f34cffff640 1 -- 172.21.15.133:0/756691073 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34d0003ba0 con 0x7f34c4004d10 2023-12-19T19:01:54.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.224+0000 7f34cffff640 1 -- 172.21.15.133:0/756691073 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34d00050d0 con 0x7f34c4004d10 2023-12-19T19:01:54.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.224+0000 7f34de4bb640 1 -- 172.21.15.133:0/756691073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34c4004d10 msgr2=0x7f34c4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:54.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.224+0000 7f34de4bb640 1 --2- 172.21.15.133:0/756691073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34c4004d10 0x7f34c4005190 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f34d0001fd0 tx=0x7f34d001c8e0 comp rx=0 tx=0).stop 2023-12-19T19:01:54.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.224+0000 7f34ddcba640 1 -- 172.21.15.133:0/756691073 reap_dead start 2023-12-19T19:01:54.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.224+0000 7f34de4bb640 1 -- 172.21.15.133:0/756691073 shutdown_connections 2023-12-19T19:01:54.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.224+0000 7f34de4bb640 1 -- 172.21.15.133:0/756691073 >> 172.21.15.133:0/756691073 conn(0x7f34d80abee0 msgr2=0x7f34d80c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:54.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.224+0000 7f34de4bb640 1 -- 172.21.15.133:0/756691073 shutdown_connections 2023-12-19T19:01:54.231 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.224+0000 7f34de4bb640 1 -- 172.21.15.133:0/756691073 wait complete. 2023-12-19T19:01:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34de4bb640 1 Processor -- start 2023-12-19T19:01:54.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34de4bb640 1 -- start start 2023-12-19T19:01:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34de4bb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34c4004d10 0x7f34d80c10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:54.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34de4bb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d8153e80 0x7f34d80af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:54.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34de4bb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34d8154570 0x7f34d8152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:54.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34de4bb640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d81528a0 con 0x7f34d8153e80 2023-12-19T19:01:54.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34de4bb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d8153ba0 con 0x7f34d8154570 2023-12-19T19:01:54.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34de4bb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d81e9b60 con 0x7f34c4004d10 2023-12-19T19:01:54.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34dccb8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d8153e80 0x7f34d80af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:54.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34dccb8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d8153e80 0x7f34d80af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:58584/0 (socket says 172.21.15.133:58584) 2023-12-19T19:01:54.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34dccb8640 1 -- 172.21.15.133:0/1036458234 learned_addr learned my addr 172.21.15.133:0/1036458234 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:54.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34ddcba640 1 --2- 172.21.15.133:0/1036458234 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34d8154570 0x7f34d8152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:54.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34dd4b9640 1 --2- 172.21.15.133:0/1036458234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34c4004d10 0x7f34d80c10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:54.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34dccb8640 1 -- 172.21.15.133:0/1036458234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34c4004d10 msgr2=0x7f34d80c10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:54.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34dccb8640 1 --2- 172.21.15.133:0/1036458234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34c4004d10 0x7f34d80c10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:54.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34dccb8640 1 -- 172.21.15.133:0/1036458234 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34d8154570 msgr2=0x7f34d8152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:54.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34dccb8640 1 --2- 172.21.15.133:0/1036458234 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34d8154570 0x7f34d8152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:54.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34dccb8640 1 -- 172.21.15.133:0/1036458234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d81524c0 con 0x7f34d8153e80 2023-12-19T19:01:54.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34dd4b9640 1 --2- 172.21.15.133:0/1036458234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34c4004d10 0x7f34d80c10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:54.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34dccb8640 1 --2- 172.21.15.133:0/1036458234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d8153e80 0x7f34d80af710 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f34c8012510 tx=0x7f34c80129d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:54.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34cdffb640 1 -- 172.21.15.133:0/1036458234 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c8014750 con 0x7f34d8153e80 2023-12-19T19:01:54.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34cdffb640 1 -- 172.21.15.133:0/1036458234 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c80148b0 con 0x7f34d8153e80 2023-12-19T19:01:54.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34cdffb640 1 -- 172.21.15.133:0/1036458234 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34c8014c20 con 0x7f34d8153e80 2023-12-19T19:01:54.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34de4bb640 1 -- 172.21.15.133:0/1036458234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d80afc50 con 0x7f34d8153e80 2023-12-19T19:01:54.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.228+0000 7f34de4bb640 1 -- 172.21.15.133:0/1036458234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d8153200 con 0x7f34d8153e80 2023-12-19T19:01:54.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.232+0000 7f34de4bb640 1 -- 172.21.15.133:0/1036458234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d80bd1d0 con 0x7f34d8153e80 2023-12-19T19:01:54.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.232+0000 7f34cdffb640 1 -- 172.21.15.133:0/1036458234 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f34c80153e0 con 0x7f34d8153e80 2023-12-19T19:01:54.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.232+0000 7f34cdffb640 1 --2- 172.21.15.133:0/1036458234 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f34bc0664a0 0x7f34bc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:54.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.232+0000 7f34cdffb640 1 -- 172.21.15.133:0/1036458234 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f34c8086980 con 0x7f34d8153e80 2023-12-19T19:01:54.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.232+0000 7f34dd4b9640 1 --2- 172.21.15.133:0/1036458234 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f34bc0664a0 0x7f34bc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:54.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.232+0000 7f34dd4b9640 1 --2- 172.21.15.133:0/1036458234 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f34bc0664a0 0x7f34bc068960 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f34d81e7800 tx=0x7f34d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:54.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.236+0000 7f34cdffb640 1 -- 172.21.15.133:0/1036458234 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f34c8053b40 con 0x7f34d8153e80 2023-12-19T19:01:54.391 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.384+0000 7f34de4bb640 1 -- 172.21.15.133:0/1036458234 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34d8152320 con 0x7f34d8153e80 2023-12-19T19:01:54.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.388+0000 7f34cdffb640 1 -- 172.21.15.133:0/1036458234 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20263 (secure 0 0 0) 0x7f34d8152320 con 0x7f34d8153e80 2023-12-19T19:01:54.392 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:54.392 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":72,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:01:53.054260+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:01:33.082188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T19:01:34.349092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:01:50.875086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:01:52.061232+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:01:54.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.388+0000 7f34de4bb640 1 -- 172.21.15.133:0/1036458234 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f34bc0664a0 msgr2=0x7f34bc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:54.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.388+0000 7f34de4bb640 1 --2- 172.21.15.133:0/1036458234 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f34bc0664a0 0x7f34bc068960 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f34d81e7800 tx=0x7f34d4008040 comp rx=0 tx=0).stop 2023-12-19T19:01:54.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.388+0000 7f34de4bb640 1 -- 172.21.15.133:0/1036458234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d8153e80 msgr2=0x7f34d80af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:54.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.388+0000 7f34de4bb640 1 --2- 172.21.15.133:0/1036458234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d8153e80 0x7f34d80af710 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f34c8012510 tx=0x7f34c80129d0 comp rx=0 tx=0).stop 2023-12-19T19:01:54.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.388+0000 7f34de4bb640 1 -- 172.21.15.133:0/1036458234 shutdown_connections 2023-12-19T19:01:54.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.388+0000 7f34de4bb640 1 --2- 172.21.15.133:0/1036458234 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f34bc0664a0 0x7f34bc068960 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:54.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.388+0000 7f34de4bb640 1 --2- 172.21.15.133:0/1036458234 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f34d8154570 0x7f34d8152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:54.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.388+0000 7f34de4bb640 1 --2- 172.21.15.133:0/1036458234 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f34d8153e80 0x7f34d80af710 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:54.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.388+0000 7f34de4bb640 1 --2- 172.21.15.133:0/1036458234 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f34c4004d10 0x7f34d80c10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:54.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.388+0000 7f34de4bb640 1 -- 172.21.15.133:0/1036458234 >> 172.21.15.133:0/1036458234 conn(0x7f34d80abee0 msgr2=0x7f34d814eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:54.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.388+0000 7f34de4bb640 1 -- 172.21.15.133:0/1036458234 shutdown_connections 2023-12-19T19:01:54.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.388+0000 7f34de4bb640 1 -- 172.21.15.133:0/1036458234 wait complete. 2023-12-19T19:01:54.414 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2023-12-19T19:01:54.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.548+0000 7f8149b6f640 1 Processor -- start 2023-12-19T19:01:54.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.548+0000 7f8149b6f640 1 -- start start 2023-12-19T19:01:54.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.552+0000 7f8149b6f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f81441551b0 0x7f814406fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:54.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.552+0000 7f8149b6f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81440c51b0 0x7f81440c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:54.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.552+0000 7f8149b6f640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81440c7780 con 0x7f81440c4ae0 2023-12-19T19:01:54.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.552+0000 7f8149b6f640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81440c19f0 con 0x7f81441551b0 2023-12-19T19:01:54.556 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.552+0000 7f8149b6f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81440c1cd0 con 0x7f81440c51b0 2023-12-19T19:01:54.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.552+0000 7f8143fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81440c51b0 0x7f81440c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:54.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.552+0000 7f8143fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81440c51b0 0x7f81440c45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:42268/0 (socket says 172.21.15.133:42268) 2023-12-19T19:01:54.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.552+0000 7f8143fff640 1 -- 172.21.15.133:0/4242756284 learned_addr learned my addr 172.21.15.133:0/4242756284 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:54.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.552+0000 7f814936e640 1 --1- 172.21.15.133:0/4242756284 >> v1:172.21.15.138:6789/0 conn(0x7f81440c4ae0 0x7f81440c5d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:42288/0 (socket says 172.21.15.133:42288) 2023-12-19T19:01:54.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.552+0000 7f8148b6d640 1 --2- 172.21.15.133:0/4242756284 >> v2:172.21.15.138:3300/0 conn(0x7f81441551b0 0x7f814406fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:54.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.552+0000 7f81437fe640 1 -- 172.21.15.133:0/4242756284 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907478161 0 0) 0x7f81440c7780 con 0x7f81440c4ae0 2023-12-19T19:01:54.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.552+0000 7f81437fe640 1 -- 172.21.15.133:0/4242756284 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8130003530 con 0x7f81440c4ae0 2023-12-19T19:01:54.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.552+0000 7f8148b6d640 1 -- 172.21.15.133:0/4242756284 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81440c51b0 msgr2=0x7f81440c45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:54.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.552+0000 7f8148b6d640 1 --2- 172.21.15.133:0/4242756284 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81440c51b0 0x7f81440c45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:54.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.552+0000 7f8148b6d640 1 -- 172.21.15.133:0/4242756284 >> v1:172.21.15.138:6789/0 conn(0x7f81440c4ae0 legacy=0x7f81440c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:54.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.552+0000 7f8148b6d640 1 -- 172.21.15.133:0/4242756284 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81440c7410 con 0x7f81441551b0 2023-12-19T19:01:54.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.552+0000 7f8143fff640 1 --2- 172.21.15.133:0/4242756284 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81440c51b0 0x7f81440c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:01:54.559 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.556+0000 7f8148b6d640 1 --2- 172.21.15.133:0/4242756284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81441551b0 0x7f814406fea0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f812c0097c0 tx=0x7f812c01c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5edc04d002113c06 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:54.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.556+0000 7f81437fe640 1 -- 172.21.15.133:0/4242756284 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c0ab600 con 0x7f81441551b0 2023-12-19T19:01:54.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.556+0000 7f81437fe640 1 -- 172.21.15.133:0/4242756284 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c0a7050 con 0x7f81441551b0 2023-12-19T19:01:54.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.556+0000 7f81437fe640 1 -- 172.21.15.133:0/4242756284 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c0ab980 con 0x7f81441551b0 2023-12-19T19:01:54.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.556+0000 7f8149b6f640 1 -- 172.21.15.133:0/4242756284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81441551b0 msgr2=0x7f814406fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:54.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.556+0000 7f8149b6f640 1 --2- 172.21.15.133:0/4242756284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81441551b0 0x7f814406fea0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f812c0097c0 tx=0x7f812c01c360 comp rx=0 tx=0).stop 2023-12-19T19:01:54.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.556+0000 7f8149b6f640 1 -- 172.21.15.133:0/4242756284 shutdown_connections 2023-12-19T19:01:54.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.556+0000 7f8149b6f640 1 --2- 172.21.15.133:0/4242756284 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81440c51b0 0x7f81440c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:54.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.556+0000 7f8149b6f640 1 --2- 172.21.15.133:0/4242756284 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81441551b0 0x7f814406fea0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:54.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.556+0000 7f8149b6f640 1 -- 172.21.15.133:0/4242756284 >> 172.21.15.133:0/4242756284 conn(0x7f81440c7b10 msgr2=0x7f81440c7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:54.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.556+0000 7f8149b6f640 1 -- 172.21.15.133:0/4242756284 shutdown_connections 2023-12-19T19:01:54.561 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.556+0000 7f8149b6f640 1 -- 172.21.15.133:0/4242756284 wait complete. 2023-12-19T19:01:54.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.556+0000 7f8149b6f640 1 Processor -- start 2023-12-19T19:01:54.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.556+0000 7f8149b6f640 1 -- start start 2023-12-19T19:01:54.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f8149b6f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81440c4ae0 0x7f8144150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:54.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f8149b6f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81440c51b0 0x7f8144153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:54.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f8149b6f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81441551b0 0x7f8144154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:54.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f8149b6f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8144153780 con 0x7f81440c4ae0 2023-12-19T19:01:54.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f8149b6f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8144159fb0 con 0x7f81441551b0 2023-12-19T19:01:54.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f8149b6f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8144154650 con 0x7f81440c51b0 2023-12-19T19:01:54.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f8148b6d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81440c4ae0 0x7f8144150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:54.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f8148b6d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81440c4ae0 0x7f8144150900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34750/0 (socket says 172.21.15.133:34750) 2023-12-19T19:01:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f8148b6d640 1 -- 172.21.15.133:0/3650734953 learned_addr learned my addr 172.21.15.133:0/3650734953 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f8143fff640 1 --2- 172.21.15.133:0/3650734953 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81440c51b0 0x7f8144153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f814936e640 1 --2- 172.21.15.133:0/3650734953 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81441551b0 0x7f8144154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f8148b6d640 1 -- 172.21.15.133:0/3650734953 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81440c51b0 msgr2=0x7f8144153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f8148b6d640 1 --2- 172.21.15.133:0/3650734953 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81440c51b0 0x7f8144153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f8148b6d640 1 -- 172.21.15.133:0/3650734953 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81441551b0 msgr2=0x7f8144154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f8148b6d640 1 --2- 172.21.15.133:0/3650734953 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81441551b0 0x7f8144154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f8148b6d640 1 -- 172.21.15.133:0/3650734953 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81340094d0 con 0x7f81440c4ae0 2023-12-19T19:01:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f8148b6d640 1 --2- 172.21.15.133:0/3650734953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81440c4ae0 0x7f8144150900 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f812c0ae040 tx=0x7f812c01aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f81417fa640 1 -- 172.21.15.133:0/3650734953 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c0b7450 con 0x7f81440c4ae0 2023-12-19T19:01:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f81417fa640 1 -- 172.21.15.133:0/3650734953 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c0b75d0 con 0x7f81440c4ae0 2023-12-19T19:01:54.566 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f81417fa640 1 -- 172.21.15.133:0/3650734953 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c0b7980 con 0x7f81440c4ae0 2023-12-19T19:01:54.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f8149b6f640 1 -- 172.21.15.133:0/3650734953 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f812c009420 con 0x7f81440c4ae0 2023-12-19T19:01:54.567 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f8149b6f640 1 -- 172.21.15.133:0/3650734953 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81441f0fd0 con 0x7f81440c4ae0 2023-12-19T19:01:54.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f8149b6f640 1 -- 172.21.15.133:0/3650734953 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f814404e850 con 0x7f81440c4ae0 2023-12-19T19:01:54.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.560+0000 7f81417fa640 1 -- 172.21.15.133:0/3650734953 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f812c0b7ae0 con 0x7f81440c4ae0 2023-12-19T19:01:54.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.564+0000 7f81417fa640 1 --2- 172.21.15.133:0/3650734953 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8124066470 0x7f8124068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:54.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.564+0000 7f81417fa640 1 -- 172.21.15.133:0/3650734953 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f812c11e930 con 0x7f81440c4ae0 2023-12-19T19:01:54.569 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.564+0000 7f8143fff640 1 --2- 172.21.15.133:0/3650734953 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8124066470 0x7f8124068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:54.570 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.564+0000 7f8143fff640 1 --2- 172.21.15.133:0/3650734953 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8124066470 0x7f8124068930 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8144154b40 tx=0x7f8134008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:54.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.568+0000 7f81417fa640 1 -- 172.21.15.133:0/3650734953 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f812c0ebb60 con 0x7f81440c4ae0 2023-12-19T19:01:54.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:54.752+0000 7f8149b6f640 1 -- 172.21.15.133:0/3650734953 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f81440c5a10 con 0x7f81440c4ae0 2023-12-19T19:01:54.958 INFO:tasks.ceph.mds.d.smithi138.stderr:2023-12-19T19:01:54.952+0000 7f0e750e5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T19:01:55.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.708+0000 7f81417fa640 1 -- 172.21.15.133:0/3650734953 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v52) v1 ==== 119+0+0 (secure 0 0 0) 0x7f812c0bb0b0 con 0x7f81440c4ae0 2023-12-19T19:01:55.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.712+0000 7f8149b6f640 1 -- 172.21.15.133:0/3650734953 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8124066470 msgr2=0x7f8124068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:55.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.712+0000 7f8149b6f640 1 --2- 172.21.15.133:0/3650734953 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8124066470 0x7f8124068930 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8144154b40 tx=0x7f8134008040 comp rx=0 tx=0).stop 2023-12-19T19:01:55.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.712+0000 7f8149b6f640 1 -- 172.21.15.133:0/3650734953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81440c4ae0 msgr2=0x7f8144150900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:55.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.712+0000 7f8149b6f640 1 --2- 172.21.15.133:0/3650734953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81440c4ae0 0x7f8144150900 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f812c0ae040 tx=0x7f812c01aba0 comp rx=0 tx=0).stop 2023-12-19T19:01:55.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.712+0000 7f8149b6f640 1 -- 172.21.15.133:0/3650734953 shutdown_connections 2023-12-19T19:01:55.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.712+0000 7f8149b6f640 1 --2- 172.21.15.133:0/3650734953 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8124066470 0x7f8124068930 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:55.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.712+0000 7f8149b6f640 1 --2- 172.21.15.133:0/3650734953 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81441551b0 0x7f8144154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:55.718 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.712+0000 7f8149b6f640 1 --2- 172.21.15.133:0/3650734953 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81440c51b0 0x7f8144153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:55.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.712+0000 7f8149b6f640 1 --2- 172.21.15.133:0/3650734953 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81440c4ae0 0x7f8144150900 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:55.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.712+0000 7f8149b6f640 1 -- 172.21.15.133:0/3650734953 >> 172.21.15.133:0/3650734953 conn(0x7f81440c7b10 msgr2=0x7f81440a97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:55.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.712+0000 7f8149b6f640 1 -- 172.21.15.133:0/3650734953 shutdown_connections 2023-12-19T19:01:55.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.712+0000 7f8149b6f640 1 -- 172.21.15.133:0/3650734953 wait complete. 2023-12-19T19:01:55.743 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T19:01:55.743 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2023-12-19T19:01:55.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.884+0000 7fd0fb59e640 1 Processor -- start 2023-12-19T19:01:55.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.884+0000 7fd0fb59e640 1 -- start start 2023-12-19T19:01:55.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.884+0000 7fd0fb59e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd0fc14f800 0x7fd0fc072320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:55.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.884+0000 7fd0fb59e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd0fc072860 0x7fd0fc06fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:55.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.884+0000 7fd0fb59e640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0fc071e90 con 0x7fd0fc0c1010 2023-12-19T19:01:55.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.884+0000 7fd0fb59e640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0fc0a5110 con 0x7fd0fc072860 2023-12-19T19:01:55.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.884+0000 7fd0fb59e640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0fc152d70 con 0x7fd0fc14f800 2023-12-19T19:01:55.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.884+0000 7fd0f3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd0fc072860 0x7fd0fc06fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:55.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.884+0000 7fd0fad9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd0fc0c1010 0x7fd0fc155840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57970/0 (socket says 172.21.15.133:57970) 2023-12-19T19:01:55.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.884+0000 7fd0f3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd0fc072860 0x7fd0fc06fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34752/0 (socket says 172.21.15.133:34752) 2023-12-19T19:01:55.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.884+0000 7fd0fad9d640 1 -- 172.21.15.133:0/854672487 learned_addr learned my addr 172.21.15.133:0/854672487 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:55.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.884+0000 7fd0fa59c640 1 --2- 172.21.15.133:0/854672487 >> v2:172.21.15.138:3300/0 conn(0x7fd0fc14f800 0x7fd0fc072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:55.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.888+0000 7fd0f3fff640 1 -- 172.21.15.133:0/854672487 >> v2:172.21.15.138:3300/0 conn(0x7fd0fc14f800 msgr2=0x7fd0fc072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:55.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.888+0000 7fd0f3fff640 1 --2- 172.21.15.133:0/854672487 >> v2:172.21.15.138:3300/0 conn(0x7fd0fc14f800 0x7fd0fc072320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:55.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.888+0000 7fd0f3fff640 1 -- 172.21.15.133:0/854672487 >> v1:172.21.15.133:6789/0 conn(0x7fd0fc0c1010 legacy=0x7fd0fc155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:55.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.888+0000 7fd0f3fff640 1 -- 172.21.15.133:0/854672487 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc153050 con 0x7fd0fc072860 2023-12-19T19:01:55.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.888+0000 7fd0f9d9b640 1 -- 172.21.15.133:0/854672487 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3035454581 0 0) 0x7fd0fc071e90 con 0x7fd0fc0c1010 2023-12-19T19:01:55.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.888+0000 7fd0f3fff640 1 --2- 172.21.15.133:0/854672487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0fc072860 0x7fd0fc06fd40 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc06f8d0 tx=0x7fd0e401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c544fcc55478c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:55.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.888+0000 7fd0f9d9b640 1 -- 172.21.15.133:0/854672487 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e40ac620 con 0x7fd0fc072860 2023-12-19T19:01:55.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.888+0000 7fd0f9d9b640 1 -- 172.21.15.133:0/854672487 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e40ac780 con 0x7fd0fc072860 2023-12-19T19:01:55.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.888+0000 7fd0f9d9b640 1 -- 172.21.15.133:0/854672487 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e40acb10 con 0x7fd0fc072860 2023-12-19T19:01:55.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.888+0000 7fd0fb59e640 1 -- 172.21.15.133:0/854672487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0fc072860 msgr2=0x7fd0fc06fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:55.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.888+0000 7fd0fb59e640 1 --2- 172.21.15.133:0/854672487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0fc072860 0x7fd0fc06fd40 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc06f8d0 tx=0x7fd0e401c3a0 comp rx=0 tx=0).stop 2023-12-19T19:01:55.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0fb59e640 1 -- 172.21.15.133:0/854672487 shutdown_connections 2023-12-19T19:01:55.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0fb59e640 1 --2- 172.21.15.133:0/854672487 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0fc072860 0x7fd0fc06fd40 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:55.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0fb59e640 1 --2- 172.21.15.133:0/854672487 >> v2:172.21.15.138:3300/0 conn(0x7fd0fc14f800 0x7fd0fc072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:55.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0fb59e640 1 -- 172.21.15.133:0/854672487 >> 172.21.15.133:0/854672487 conn(0x7fd0fc0a7800 msgr2=0x7fd0fc0a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:55.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0fb59e640 1 -- 172.21.15.133:0/854672487 shutdown_connections 2023-12-19T19:01:55.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0fb59e640 1 -- 172.21.15.133:0/854672487 wait complete. 2023-12-19T19:01:55.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0fb59e640 1 Processor -- start 2023-12-19T19:01:55.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0fb59e640 1 -- start start 2023-12-19T19:01:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0fb59e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0fc072860 0x7fd0fc0bf0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0fb59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0fc0c1010 0x7fd0fc148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0fb59e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0fc14f800 0x7fd0fc148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0fb59e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc1533c0 con 0x7fd0fc0c1010 2023-12-19T19:01:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0fb59e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc149190 con 0x7fd0fc14f800 2023-12-19T19:01:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0fb59e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0fc1556e0 con 0x7fd0fc072860 2023-12-19T19:01:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0f3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0fc0c1010 0x7fd0fc148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0f3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0fc0c1010 0x7fd0fc148710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34756/0 (socket says 172.21.15.133:34756) 2023-12-19T19:01:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0f3fff640 1 -- 172.21.15.133:0/761953243 learned_addr learned my addr 172.21.15.133:0/761953243 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0fad9d640 1 --2- 172.21.15.133:0/761953243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0fc14f800 0x7fd0fc148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0fa59c640 1 --2- 172.21.15.133:0/761953243 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0fc072860 0x7fd0fc0bf0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0f3fff640 1 -- 172.21.15.133:0/761953243 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0fc072860 msgr2=0x7fd0fc0bf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0f3fff640 1 --2- 172.21.15.133:0/761953243 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0fc072860 0x7fd0fc0bf0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0f3fff640 1 -- 172.21.15.133:0/761953243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0fc14f800 msgr2=0x7fd0fc148c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:55.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0f3fff640 1 --2- 172.21.15.133:0/761953243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0fc14f800 0x7fd0fc148c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:55.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0f3fff640 1 -- 172.21.15.133:0/761953243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e4009420 con 0x7fd0fc0c1010 2023-12-19T19:01:55.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.892+0000 7fd0f3fff640 1 --2- 172.21.15.133:0/761953243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0fc0c1010 0x7fd0fc148710 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40af040 tx=0x7fd0e4019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:55.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.896+0000 7fd0f2ffd640 1 -- 172.21.15.133:0/761953243 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e40b5410 con 0x7fd0fc0c1010 2023-12-19T19:01:55.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.896+0000 7fd0f2ffd640 1 -- 172.21.15.133:0/761953243 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e40b5590 con 0x7fd0fc0c1010 2023-12-19T19:01:55.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.896+0000 7fd0f2ffd640 1 -- 172.21.15.133:0/761953243 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e40b5940 con 0x7fd0fc0c1010 2023-12-19T19:01:55.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.896+0000 7fd0fb59e640 1 -- 172.21.15.133:0/761953243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0fc153610 con 0x7fd0fc0c1010 2023-12-19T19:01:55.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.896+0000 7fd0fb59e640 1 -- 172.21.15.133:0/761953243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0fc153c60 con 0x7fd0fc0c1010 2023-12-19T19:01:55.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.896+0000 7fd0fb59e640 1 -- 172.21.15.133:0/761953243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0fc04e850 con 0x7fd0fc0c1010 2023-12-19T19:01:55.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.896+0000 7fd0f2ffd640 1 -- 172.21.15.133:0/761953243 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd0e40b3040 con 0x7fd0fc0c1010 2023-12-19T19:01:55.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.896+0000 7fd0f2ffd640 1 --2- 172.21.15.133:0/761953243 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd0dc066470 0x7fd0dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:55.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.896+0000 7fd0f2ffd640 1 -- 172.21.15.133:0/761953243 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd0e411e1e0 con 0x7fd0fc0c1010 2023-12-19T19:01:55.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.896+0000 7fd0fa59c640 1 --2- 172.21.15.133:0/761953243 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd0dc066470 0x7fd0dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:55.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.900+0000 7fd0fa59c640 1 --2- 172.21.15.133:0/761953243 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd0dc066470 0x7fd0dc068930 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009af0 tx=0x7fd0ec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:55.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:55.900+0000 7fd0f2ffd640 1 -- 172.21.15.133:0/761953243 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd0e40eb300 con 0x7fd0fc0c1010 2023-12-19T19:01:56.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.084+0000 7fd0fb59e640 1 -- 172.21.15.133:0/761953243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd0fc06e180 con 0x7fd0fc0c1010 2023-12-19T19:01:56.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.724+0000 7fd0f2ffd640 1 -- 172.21.15.133:0/761953243 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v53) v1 ==== 123+0+0 (secure 0 0 0) 0x7fd0e40ee920 con 0x7fd0fc0c1010 2023-12-19T19:01:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.724+0000 7fd0fb59e640 1 -- 172.21.15.133:0/761953243 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd0dc066470 msgr2=0x7fd0dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.724+0000 7fd0fb59e640 1 --2- 172.21.15.133:0/761953243 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd0dc066470 0x7fd0dc068930 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009af0 tx=0x7fd0ec008040 comp rx=0 tx=0).stop 2023-12-19T19:01:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.724+0000 7fd0fb59e640 1 -- 172.21.15.133:0/761953243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0fc0c1010 msgr2=0x7fd0fc148710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:56.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.724+0000 7fd0fb59e640 1 --2- 172.21.15.133:0/761953243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0fc0c1010 0x7fd0fc148710 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fd0e40af040 tx=0x7fd0e4019140 comp rx=0 tx=0).stop 2023-12-19T19:01:56.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.724+0000 7fd0fb59e640 1 -- 172.21.15.133:0/761953243 shutdown_connections 2023-12-19T19:01:56.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.724+0000 7fd0fb59e640 1 --2- 172.21.15.133:0/761953243 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd0dc066470 0x7fd0dc068930 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:56.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.724+0000 7fd0fb59e640 1 --2- 172.21.15.133:0/761953243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd0fc14f800 0x7fd0fc148c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:56.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.724+0000 7fd0fb59e640 1 --2- 172.21.15.133:0/761953243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd0fc0c1010 0x7fd0fc148710 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:56.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.724+0000 7fd0fb59e640 1 --2- 172.21.15.133:0/761953243 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd0fc072860 0x7fd0fc0bf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:56.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.724+0000 7fd0fb59e640 1 -- 172.21.15.133:0/761953243 >> 172.21.15.133:0/761953243 conn(0x7fd0fc0a7800 msgr2=0x7fd0fc0bfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:56.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.724+0000 7fd0fb59e640 1 -- 172.21.15.133:0/761953243 shutdown_connections 2023-12-19T19:01:56.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.724+0000 7fd0fb59e640 1 -- 172.21.15.133:0/761953243 wait complete. 2023-12-19T19:01:56.752 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2023-12-19T19:01:56.752 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:01:56.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.888+0000 7f066151d640 1 Processor -- start 2023-12-19T19:01:56.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.888+0000 7f066151d640 1 -- start start 2023-12-19T19:01:56.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.888+0000 7f066151d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f065c06bbb0 0x7f065c1600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:56.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.888+0000 7f066151d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f065c06c860 con 0x7f065c151e90 2023-12-19T19:01:56.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.888+0000 7f066151d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f065c06c000 con 0x7f065c0c7ea0 2023-12-19T19:01:56.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.888+0000 7f066151d640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065c0c8750 con 0x7f065c06bbb0 2023-12-19T19:01:56.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.888+0000 7f065b7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f065c06bbb0 0x7f065c1600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:56.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.888+0000 7f065affd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f065c151e90 0x7f065c0c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57980/0 (socket says 172.21.15.133:57980) 2023-12-19T19:01:56.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.888+0000 7f065b7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f065c06bbb0 0x7f065c1600b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34768/0 (socket says 172.21.15.133:34768) 2023-12-19T19:01:56.893 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.888+0000 7f065b7fe640 1 -- 172.21.15.133:0/2714944287 learned_addr learned my addr 172.21.15.133:0/2714944287 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:56.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.888+0000 7f065b7fe640 1 -- 172.21.15.133:0/2714944287 >> v1:172.21.15.138:6789/0 conn(0x7f065c0c7ea0 legacy=0x7f065c06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:56.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.888+0000 7f065b7fe640 1 -- 172.21.15.133:0/2714944287 >> v1:172.21.15.133:6789/0 conn(0x7f065c151e90 legacy=0x7f065c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:56.894 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.888+0000 7f065b7fe640 1 -- 172.21.15.133:0/2714944287 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065c154930 con 0x7f065c06bbb0 2023-12-19T19:01:56.895 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.892+0000 7f065b7fe640 1 --2- 172.21.15.133:0/2714944287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f065c06bbb0 0x7f065c1600b0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f0654009e50 tx=0x7f065401c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842ead69983d7020 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:56.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.892+0000 7f0659ffb640 1 -- 172.21.15.133:0/2714944287 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06540a55b0 con 0x7f065c06bbb0 2023-12-19T19:01:56.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.892+0000 7f0659ffb640 1 -- 172.21.15.133:0/2714944287 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06540a5710 con 0x7f065c06bbb0 2023-12-19T19:01:56.896 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.892+0000 7f0659ffb640 1 -- 172.21.15.133:0/2714944287 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06540a5aa0 con 0x7f065c06bbb0 2023-12-19T19:01:56.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.892+0000 7f066151d640 1 -- 172.21.15.133:0/2714944287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f065c06bbb0 msgr2=0x7f065c1600b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:56.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.892+0000 7f066151d640 1 --2- 172.21.15.133:0/2714944287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f065c06bbb0 0x7f065c1600b0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f0654009e50 tx=0x7f065401c8f0 comp rx=0 tx=0).stop 2023-12-19T19:01:56.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.892+0000 7f066151d640 1 -- 172.21.15.133:0/2714944287 shutdown_connections 2023-12-19T19:01:56.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.892+0000 7f066151d640 1 --2- 172.21.15.133:0/2714944287 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f065c06bbb0 0x7f065c1600b0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:56.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.892+0000 7f066151d640 1 -- 172.21.15.133:0/2714944287 >> 172.21.15.133:0/2714944287 conn(0x7f065c0ca170 msgr2=0x7f065c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:56.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.892+0000 7f066151d640 1 -- 172.21.15.133:0/2714944287 shutdown_connections 2023-12-19T19:01:56.897 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.892+0000 7f066151d640 1 -- 172.21.15.133:0/2714944287 wait complete. 2023-12-19T19:01:56.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.892+0000 7f066151d640 1 Processor -- start 2023-12-19T19:01:56.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.892+0000 7f066151d640 1 -- start start 2023-12-19T19:01:56.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f066151d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f065c06bbb0 0x7f065c0ac330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:56.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f066151d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f065c0c7ea0 0x7f065c1f0830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:56.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f066151d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f065c151e90 0x7f065c1f0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:56.901 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f066151d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c1552d0 con 0x7f065c0c7ea0 2023-12-19T19:01:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f066151d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c1f17e0 con 0x7f065c06bbb0 2023-12-19T19:01:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f066151d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065c155f60 con 0x7f065c151e90 2023-12-19T19:01:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f065a7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f065c0c7ea0 0x7f065c1f0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f065a7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f065c0c7ea0 0x7f065c1f0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34782/0 (socket says 172.21.15.133:34782) 2023-12-19T19:01:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f065a7fc640 1 -- 172.21.15.133:0/352502012 learned_addr learned my addr 172.21.15.133:0/352502012 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f065affd640 1 --2- 172.21.15.133:0/352502012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f065c06bbb0 0x7f065c0ac330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f065a7fc640 1 -- 172.21.15.133:0/352502012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f065c151e90 msgr2=0x7f065c1f0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f065b7fe640 1 --2- 172.21.15.133:0/352502012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f065c151e90 0x7f065c1f0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:56.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f065a7fc640 1 --2- 172.21.15.133:0/352502012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f065c151e90 0x7f065c1f0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:56.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f065a7fc640 1 -- 172.21.15.133:0/352502012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f065c06bbb0 msgr2=0x7f065c0ac330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:56.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f065a7fc640 1 --2- 172.21.15.133:0/352502012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f065c06bbb0 0x7f065c0ac330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:56.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f065a7fc640 1 -- 172.21.15.133:0/352502012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0654009b30 con 0x7f065c0c7ea0 2023-12-19T19:01:56.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f065affd640 1 --2- 172.21.15.133:0/352502012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f065c06bbb0 0x7f065c0ac330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:56.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f065b7fe640 1 --2- 172.21.15.133:0/352502012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f065c151e90 0x7f065c1f0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:56.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f065a7fc640 1 --2- 172.21.15.133:0/352502012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f065c0c7ea0 0x7f065c1f0830 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f065000c3c0 tx=0x7f065000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:56.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f06437fe640 1 -- 172.21.15.133:0/352502012 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06500052d0 con 0x7f065c0c7ea0 2023-12-19T19:01:56.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f06437fe640 1 -- 172.21.15.133:0/352502012 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0650005430 con 0x7f065c0c7ea0 2023-12-19T19:01:56.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f066151d640 1 -- 172.21.15.133:0/352502012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f065c1f12b0 con 0x7f065c0c7ea0 2023-12-19T19:01:56.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f06437fe640 1 -- 172.21.15.133:0/352502012 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650003840 con 0x7f065c0c7ea0 2023-12-19T19:01:56.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f066151d640 1 -- 172.21.15.133:0/352502012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065c1f1500 con 0x7f065c0c7ea0 2023-12-19T19:01:56.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f066151d640 1 -- 172.21.15.133:0/352502012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065c151140 con 0x7f065c0c7ea0 2023-12-19T19:01:56.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.896+0000 7f06437fe640 1 -- 172.21.15.133:0/352502012 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f06500039a0 con 0x7f065c0c7ea0 2023-12-19T19:01:56.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.900+0000 7f06437fe640 1 --2- 172.21.15.133:0/352502012 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0648066470 0x7f0648068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:56.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.900+0000 7f06437fe640 1 -- 172.21.15.133:0/352502012 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0650083750 con 0x7f065c0c7ea0 2023-12-19T19:01:56.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.900+0000 7f065affd640 1 --2- 172.21.15.133:0/352502012 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0648066470 0x7f0648068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:56.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.900+0000 7f065affd640 1 --2- 172.21.15.133:0/352502012 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0648066470 0x7f0648068930 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f064c000f70 tx=0x7f064c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:56.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:56.904+0000 7f06437fe640 1 -- 172.21.15.133:0/352502012 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0650050860 con 0x7f065c0c7ea0 2023-12-19T19:01:57.087 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.084+0000 7f066151d640 1 -- 172.21.15.133:0/352502012 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f065c1524c0 con 0x7f065c0c7ea0 2023-12-19T19:01:57.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.084+0000 7f06437fe640 1 -- 172.21.15.133:0/352502012 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6196 (secure 0 0 0) 0x7f0650053e80 con 0x7f065c0c7ea0 2023-12-19T19:01:57.088 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:57.088 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/2119189888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":2119189888},{"type":"v1","addr":"172.21.15.133:6835","nonce":2119189888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/4005236173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":4005236173},{"type":"v1","addr":"172.21.15.138:6835","nonce":4005236173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:01:35.356022+0000","modified":"2023-12-19T19:01:38.376795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6834/2813206606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2813206606},{"type":"v1","addr":"172.21.15.133:6834","nonce":2813206606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:01:53.054600+0000","modified":"2023-12-19T19:01:56.088450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5765},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5765":{"gid":5765,"name":"d","rank":0,"incarnation":49,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6837/1466041773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":1466041773},{"type":"v1","addr":"172.21.15.138:6837","nonce":1466041773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T19:01:57.089 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 53 2023-12-19T19:01:57.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.084+0000 7f066151d640 1 -- 172.21.15.133:0/352502012 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0648066470 msgr2=0x7f0648068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:57.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.084+0000 7f066151d640 1 --2- 172.21.15.133:0/352502012 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0648066470 0x7f0648068930 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f064c000f70 tx=0x7f064c009040 comp rx=0 tx=0).stop 2023-12-19T19:01:57.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.084+0000 7f066151d640 1 -- 172.21.15.133:0/352502012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f065c0c7ea0 msgr2=0x7f065c1f0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:57.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.084+0000 7f066151d640 1 --2- 172.21.15.133:0/352502012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f065c0c7ea0 0x7f065c1f0830 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f065000c3c0 tx=0x7f065000c880 comp rx=0 tx=0).stop 2023-12-19T19:01:57.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.084+0000 7f066151d640 1 -- 172.21.15.133:0/352502012 shutdown_connections 2023-12-19T19:01:57.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.084+0000 7f066151d640 1 --2- 172.21.15.133:0/352502012 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0648066470 0x7f0648068930 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.084+0000 7f066151d640 1 --2- 172.21.15.133:0/352502012 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f065c151e90 0x7f065c1f0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.084+0000 7f066151d640 1 --2- 172.21.15.133:0/352502012 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f065c0c7ea0 0x7f065c1f0830 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.084+0000 7f066151d640 1 --2- 172.21.15.133:0/352502012 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f065c06bbb0 0x7f065c0ac330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.084+0000 7f066151d640 1 -- 172.21.15.133:0/352502012 >> 172.21.15.133:0/352502012 conn(0x7f065c0ca170 msgr2=0x7f065c150a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:57.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.084+0000 7f066151d640 1 -- 172.21.15.133:0/352502012 shutdown_connections 2023-12-19T19:01:57.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.084+0000 7f066151d640 1 -- 172.21.15.133:0/352502012 wait complete. 2023-12-19T19:01:57.110 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:01:57.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.240+0000 7fcbe7d2a640 1 Processor -- start 2023-12-19T19:01:57.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.244+0000 7fcbe7d2a640 1 -- start start 2023-12-19T19:01:57.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.244+0000 7fcbe7d2a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcbe00c5260 0x7fcbe006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:57.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.244+0000 7fcbe7d2a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe00c2580 con 0x7fcbe0155de0 2023-12-19T19:01:57.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.244+0000 7fcbe7d2a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe0156940 con 0x7fcbe00c5640 2023-12-19T19:01:57.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.244+0000 7fcbe7d2a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe0153510 con 0x7fcbe00c5260 2023-12-19T19:01:57.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.244+0000 7fcbe5ac6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcbe00c5260 0x7fcbe006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:57.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.244+0000 7fcbe5ac6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcbe00c5260 0x7fcbe006d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34794/0 (socket says 172.21.15.133:34794) 2023-12-19T19:01:57.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.244+0000 7fcbe62c7640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcbe0155de0 0x7fcbe0156230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57984/0 (socket says 172.21.15.133:57984) 2023-12-19T19:01:57.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.244+0000 7fcbe5ac6640 1 -- 172.21.15.133:0/3603282603 learned_addr learned my addr 172.21.15.133:0/3603282603 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:57.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.244+0000 7fcbe5ac6640 1 -- 172.21.15.133:0/3603282603 >> v1:172.21.15.138:6789/0 conn(0x7fcbe00c5640 legacy=0x7fcbe00c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:57.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.244+0000 7fcbe5ac6640 1 -- 172.21.15.133:0/3603282603 >> v1:172.21.15.133:6789/0 conn(0x7fcbe0155de0 legacy=0x7fcbe0156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:57.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.244+0000 7fcbe5ac6640 1 -- 172.21.15.133:0/3603282603 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe00c1a00 con 0x7fcbe00c5260 2023-12-19T19:01:57.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.248+0000 7fcbe5ac6640 1 --2- 172.21.15.133:0/3603282603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbe00c5260 0x7fcbe006d5b0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009870 tx=0x7fcbdc01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70be00c7d18f8a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:57.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.248+0000 7fcbe4ac4640 1 -- 172.21.15.133:0/3603282603 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc0ac600 con 0x7fcbe00c5260 2023-12-19T19:01:57.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.248+0000 7fcbe4ac4640 1 -- 172.21.15.133:0/3603282603 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc0a8050 con 0x7fcbe00c5260 2023-12-19T19:01:57.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.248+0000 7fcbe4ac4640 1 -- 172.21.15.133:0/3603282603 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc0ac980 con 0x7fcbe00c5260 2023-12-19T19:01:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.248+0000 7fcbe7d2a640 1 -- 172.21.15.133:0/3603282603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbe00c5260 msgr2=0x7fcbe006d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.248+0000 7fcbe7d2a640 1 --2- 172.21.15.133:0/3603282603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbe00c5260 0x7fcbe006d5b0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc009870 tx=0x7fcbdc01c4b0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.248+0000 7fcbe7d2a640 1 -- 172.21.15.133:0/3603282603 shutdown_connections 2023-12-19T19:01:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.248+0000 7fcbe7d2a640 1 --2- 172.21.15.133:0/3603282603 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbe00c5260 0x7fcbe006d5b0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.248+0000 7fcbe7d2a640 1 -- 172.21.15.133:0/3603282603 >> 172.21.15.133:0/3603282603 conn(0x7fcbe006a5b0 msgr2=0x7fcbe006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.248+0000 7fcbe7d2a640 1 -- 172.21.15.133:0/3603282603 shutdown_connections 2023-12-19T19:01:57.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.248+0000 7fcbe7d2a640 1 -- 172.21.15.133:0/3603282603 wait complete. 2023-12-19T19:01:57.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.248+0000 7fcbe7d2a640 1 Processor -- start 2023-12-19T19:01:57.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.248+0000 7fcbe7d2a640 1 -- start start 2023-12-19T19:01:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbe7d2a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbe00c5260 0x7fcbe0150370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbe7d2a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcbe00c5640 0x7fcbe015d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbe7d2a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbe0155de0 0x7fcbe01eea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbe7d2a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe0071200 con 0x7fcbe00c5260 2023-12-19T19:01:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbe7d2a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe0071be0 con 0x7fcbe0155de0 2023-12-19T19:01:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbe7d2a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe01f1230 con 0x7fcbe00c5640 2023-12-19T19:01:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbe5ac6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbe00c5260 0x7fcbe0150370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbe5ac6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbe00c5260 0x7fcbe0150370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34796/0 (socket says 172.21.15.133:34796) 2023-12-19T19:01:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbe5ac6640 1 -- 172.21.15.133:0/235982356 learned_addr learned my addr 172.21.15.133:0/235982356 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbe62c7640 1 --2- 172.21.15.133:0/235982356 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbe0155de0 0x7fcbe01eea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbe52c5640 1 --2- 172.21.15.133:0/235982356 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcbe00c5640 0x7fcbe015d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbe5ac6640 1 -- 172.21.15.133:0/235982356 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcbe00c5640 msgr2=0x7fcbe015d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:57.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbe5ac6640 1 --2- 172.21.15.133:0/235982356 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcbe00c5640 0x7fcbe015d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbe5ac6640 1 -- 172.21.15.133:0/235982356 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbe0155de0 msgr2=0x7fcbe01eea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:57.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbe5ac6640 1 --2- 172.21.15.133:0/235982356 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbe0155de0 0x7fcbe01eea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbe5ac6640 1 -- 172.21.15.133:0/235982356 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc0094d0 con 0x7fcbe00c5260 2023-12-19T19:01:57.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbe62c7640 1 --2- 172.21.15.133:0/235982356 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbe0155de0 0x7fcbe01eea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:57.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbe52c5640 1 --2- 172.21.15.133:0/235982356 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcbe00c5640 0x7fcbe015d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:57.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbe5ac6640 1 --2- 172.21.15.133:0/235982356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbe00c5260 0x7fcbe0150370 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc01a0e0 tx=0x7fcbdc01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:57.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbd67fc640 1 -- 172.21.15.133:0/235982356 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc0b7620 con 0x7fcbe00c5260 2023-12-19T19:01:57.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbd67fc640 1 -- 172.21.15.133:0/235982356 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc0b77a0 con 0x7fcbe00c5260 2023-12-19T19:01:57.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbd67fc640 1 -- 172.21.15.133:0/235982356 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc0b7b50 con 0x7fcbe00c5260 2023-12-19T19:01:57.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbe7d2a640 1 -- 172.21.15.133:0/235982356 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe01f1510 con 0x7fcbe00c5260 2023-12-19T19:01:57.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbe7d2a640 1 -- 172.21.15.133:0/235982356 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe0071ec0 con 0x7fcbe00c5260 2023-12-19T19:01:57.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbe7d2a640 1 -- 172.21.15.133:0/235982356 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe01561f0 con 0x7fcbe00c5260 2023-12-19T19:01:57.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.252+0000 7fcbd67fc640 1 -- 172.21.15.133:0/235982356 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fcbdc0b3040 con 0x7fcbe00c5260 2023-12-19T19:01:57.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.256+0000 7fcbd67fc640 1 --2- 172.21.15.133:0/235982356 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcbc4066470 0x7fcbc4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:57.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.256+0000 7fcbd67fc640 1 -- 172.21.15.133:0/235982356 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcbdc11e6a0 con 0x7fcbe00c5260 2023-12-19T19:01:57.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.256+0000 7fcbe52c5640 1 --2- 172.21.15.133:0/235982356 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcbc4066470 0x7fcbc4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:57.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.256+0000 7fcbe52c5640 1 --2- 172.21.15.133:0/235982356 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcbc4066470 0x7fcbc4068930 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00a4e70 tx=0x7fcbd0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:57.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.260+0000 7fcbd67fc640 1 -- 172.21.15.133:0/235982356 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fcbdc0eb7b0 con 0x7fcbe00c5260 2023-12-19T19:01:57.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.408+0000 7fcbe7d2a640 1 -- 172.21.15.133:0/235982356 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcbe01ee680 con 0x7fcbe00c5260 2023-12-19T19:01:57.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.408+0000 7fcbd67fc640 1 -- 172.21.15.133:0/235982356 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+20250 (secure 0 0 0) 0x7fcbdc0b7cb0 con 0x7fcbe00c5260 2023-12-19T19:01:57.415 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:57.415 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":73,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:01:54.705538+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:01:33.082188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T19:01:34.349092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:01:50.875086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:01:52.061232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:01:57.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.412+0000 7fcbe7d2a640 1 -- 172.21.15.133:0/235982356 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcbc4066470 msgr2=0x7fcbc4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:57.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.412+0000 7fcbe7d2a640 1 --2- 172.21.15.133:0/235982356 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcbc4066470 0x7fcbc4068930 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcbe00a4e70 tx=0x7fcbd0009040 comp rx=0 tx=0).stop 2023-12-19T19:01:57.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.412+0000 7fcbe7d2a640 1 -- 172.21.15.133:0/235982356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbe00c5260 msgr2=0x7fcbe0150370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:57.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.412+0000 7fcbe7d2a640 1 --2- 172.21.15.133:0/235982356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbe00c5260 0x7fcbe0150370 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc01a0e0 tx=0x7fcbdc01acf0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.412+0000 7fcbe7d2a640 1 -- 172.21.15.133:0/235982356 shutdown_connections 2023-12-19T19:01:57.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.412+0000 7fcbe7d2a640 1 --2- 172.21.15.133:0/235982356 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcbc4066470 0x7fcbc4068930 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.412+0000 7fcbe7d2a640 1 --2- 172.21.15.133:0/235982356 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcbe0155de0 0x7fcbe01eea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.412+0000 7fcbe7d2a640 1 --2- 172.21.15.133:0/235982356 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcbe00c5640 0x7fcbe015d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.412+0000 7fcbe7d2a640 1 --2- 172.21.15.133:0/235982356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcbe00c5260 0x7fcbe0150370 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.412+0000 7fcbe7d2a640 1 -- 172.21.15.133:0/235982356 >> 172.21.15.133:0/235982356 conn(0x7fcbe006a5b0 msgr2=0x7fcbe00bfca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:57.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.412+0000 7fcbe7d2a640 1 -- 172.21.15.133:0/235982356 shutdown_connections 2023-12-19T19:01:57.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.412+0000 7fcbe7d2a640 1 -- 172.21.15.133:0/235982356 wait complete. 2023-12-19T19:01:57.437 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T19:01:57.437 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T19:01:57.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.568+0000 7f034f679640 1 Processor -- start 2023-12-19T19:01:57.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.568+0000 7f034f679640 1 -- start start 2023-12-19T19:01:57.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.572+0000 7f034f679640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f03480c63c0 0x7f03480c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:57.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.572+0000 7f034f679640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f03480c4100 0x7f03480c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:57.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.572+0000 7f034f679640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03480c31c0 con 0x7f03480c29e0 2023-12-19T19:01:57.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.572+0000 7f034f679640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03480c34a0 con 0x7f03480c63c0 2023-12-19T19:01:57.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.572+0000 7f034f679640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03480c1030 con 0x7f03480c4100 2023-12-19T19:01:57.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.572+0000 7f034d415640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f03480c63c0 0x7f03480c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:57.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.572+0000 7f034d415640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f03480c63c0 0x7f03480c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34806/0 (socket says 172.21.15.133:34806) 2023-12-19T19:01:57.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.572+0000 7f034d415640 1 -- 172.21.15.133:0/1526698693 learned_addr learned my addr 172.21.15.133:0/1526698693 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:57.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.572+0000 7f034cc14640 1 --2- 172.21.15.133:0/1526698693 >> v2:172.21.15.138:3300/0 conn(0x7f03480c4100 0x7f03480c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:57.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.572+0000 7f034d415640 1 -- 172.21.15.133:0/1526698693 >> v2:172.21.15.138:3300/0 conn(0x7f03480c4100 msgr2=0x7f03480c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:57.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.572+0000 7f034d415640 1 --2- 172.21.15.133:0/1526698693 >> v2:172.21.15.138:3300/0 conn(0x7f03480c4100 0x7f03480c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.572+0000 7f034d415640 1 -- 172.21.15.133:0/1526698693 >> v1:172.21.15.138:6789/0 conn(0x7f03480c29e0 legacy=0x7f03480a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:57.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.572+0000 7f034d415640 1 -- 172.21.15.133:0/1526698693 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03480c1310 con 0x7f03480c63c0 2023-12-19T19:01:57.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.572+0000 7f034d415640 1 --2- 172.21.15.133:0/1526698693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480c63c0 0x7f03480c06d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f03480a8b40 tx=0x7f034401ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be81f60492787d0d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:57.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f033ffff640 1 -- 172.21.15.133:0/1526698693 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03440a7a30 con 0x7f03480c63c0 2023-12-19T19:01:57.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f033ffff640 1 -- 172.21.15.133:0/1526698693 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03440a7b90 con 0x7f03480c63c0 2023-12-19T19:01:57.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f033ffff640 1 -- 172.21.15.133:0/1526698693 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03440af440 con 0x7f03480c63c0 2023-12-19T19:01:57.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f034f679640 1 -- 172.21.15.133:0/1526698693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480c63c0 msgr2=0x7f03480c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:57.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f034f679640 1 --2- 172.21.15.133:0/1526698693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480c63c0 0x7f03480c06d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f03480a8b40 tx=0x7f034401ea40 comp rx=0 tx=0).stop 2023-12-19T19:01:57.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f034f679640 1 -- 172.21.15.133:0/1526698693 shutdown_connections 2023-12-19T19:01:57.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f034f679640 1 --2- 172.21.15.133:0/1526698693 >> v2:172.21.15.138:3300/0 conn(0x7f03480c4100 0x7f03480c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f034f679640 1 --2- 172.21.15.133:0/1526698693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480c63c0 0x7f03480c06d0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f034f679640 1 -- 172.21.15.133:0/1526698693 >> 172.21.15.133:0/1526698693 conn(0x7f034806a5b0 msgr2=0x7f034806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:57.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f034f679640 1 -- 172.21.15.133:0/1526698693 shutdown_connections 2023-12-19T19:01:57.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f034f679640 1 -- 172.21.15.133:0/1526698693 wait complete. 2023-12-19T19:01:57.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f034f679640 1 Processor -- start 2023-12-19T19:01:57.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f034f679640 1 -- start start 2023-12-19T19:01:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f034f679640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f03480c29e0 0x7f03481ec3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f034f679640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480c4100 0x7f03481ec8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f034f679640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03480c63c0 0x7f03480be710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f034f679640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034815a830 con 0x7f03480c4100 2023-12-19T19:01:57.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f034f679640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03481ed0a0 con 0x7f03480c63c0 2023-12-19T19:01:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f034f679640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0348156660 con 0x7f03480c29e0 2023-12-19T19:01:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f034cc14640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480c4100 0x7f03481ec8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f034cc14640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480c4100 0x7f03481ec8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34810/0 (socket says 172.21.15.133:34810) 2023-12-19T19:01:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f034cc14640 1 -- 172.21.15.133:0/1137659243 learned_addr learned my addr 172.21.15.133:0/1137659243 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f034d415640 1 --2- 172.21.15.133:0/1137659243 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f03480c29e0 0x7f03481ec3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.576+0000 7f034dc16640 1 --2- 172.21.15.133:0/1137659243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03480c63c0 0x7f03480be710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.580+0000 7f034cc14640 1 -- 172.21.15.133:0/1137659243 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f03480c29e0 msgr2=0x7f03481ec3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.580+0000 7f034cc14640 1 --2- 172.21.15.133:0/1137659243 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f03480c29e0 0x7f03481ec3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.580+0000 7f034cc14640 1 -- 172.21.15.133:0/1137659243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03480c63c0 msgr2=0x7f03480be710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.580+0000 7f034cc14640 1 --2- 172.21.15.133:0/1137659243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03480c63c0 0x7f03480be710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.580+0000 7f034cc14640 1 -- 172.21.15.133:0/1137659243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f034400b770 con 0x7f03480c4100 2023-12-19T19:01:57.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.580+0000 7f034cc14640 1 --2- 172.21.15.133:0/1137659243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480c4100 0x7f03481ec8e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f033800d800 tx=0x7f033800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:57.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.580+0000 7f033dffb640 1 -- 172.21.15.133:0/1137659243 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033800b6c0 con 0x7f03480c4100 2023-12-19T19:01:57.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.580+0000 7f033dffb640 1 -- 172.21.15.133:0/1137659243 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033800b820 con 0x7f03480c4100 2023-12-19T19:01:57.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.580+0000 7f033dffb640 1 -- 172.21.15.133:0/1137659243 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033800bb90 con 0x7f03480c4100 2023-12-19T19:01:57.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.580+0000 7f034f679640 1 -- 172.21.15.133:0/1137659243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03481ece20 con 0x7f03480c4100 2023-12-19T19:01:57.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.580+0000 7f034f679640 1 -- 172.21.15.133:0/1137659243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0348156af0 con 0x7f03480c4100 2023-12-19T19:01:57.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.580+0000 7f034f679640 1 -- 172.21.15.133:0/1137659243 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0348068400 con 0x7f03480c4100 2023-12-19T19:01:57.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.580+0000 7f033dffb640 1 -- 172.21.15.133:0/1137659243 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f033800bcf0 con 0x7f03480c4100 2023-12-19T19:01:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.580+0000 7f033dffb640 1 --2- 172.21.15.133:0/1137659243 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f032c066470 0x7f032c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.580+0000 7f033dffb640 1 -- 172.21.15.133:0/1137659243 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0338084650 con 0x7f03480c4100 2023-12-19T19:01:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.584+0000 7f034d415640 1 --2- 172.21.15.133:0/1137659243 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f032c066470 0x7f032c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:57.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.584+0000 7f034d415640 1 --2- 172.21.15.133:0/1137659243 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f032c066470 0x7f032c068930 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f03440b1000 tx=0x7f03440a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:57.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.584+0000 7f033dffb640 1 -- 172.21.15.133:0/1137659243 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0338051780 con 0x7f03480c4100 2023-12-19T19:01:57.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.736+0000 7f034f679640 1 -- 172.21.15.133:0/1137659243 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f03480aa3b0 con 0x7f032c066470 2023-12-19T19:01:57.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.752+0000 7f033dffb640 1 -- 172.21.15.133:0/1137659243 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+528193 (secure 0 0 0) 0x7f03440a79b0 con 0x7f032c066470 2023-12-19T19:01:57.758 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:57.766 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T19:01:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.756+0000 7f034f679640 1 -- 172.21.15.133:0/1137659243 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f032c066470 msgr2=0x7f032c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.756+0000 7f034f679640 1 --2- 172.21.15.133:0/1137659243 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f032c066470 0x7f032c068930 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f03440b1000 tx=0x7f03440a9070 comp rx=0 tx=0).stop 2023-12-19T19:01:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.756+0000 7f034f679640 1 -- 172.21.15.133:0/1137659243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480c4100 msgr2=0x7f03481ec8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.756+0000 7f034f679640 1 --2- 172.21.15.133:0/1137659243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480c4100 0x7f03481ec8e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f033800d800 tx=0x7f033800dcc0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.756+0000 7f034f679640 1 -- 172.21.15.133:0/1137659243 shutdown_connections 2023-12-19T19:01:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.756+0000 7f034f679640 1 --2- 172.21.15.133:0/1137659243 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f032c066470 0x7f032c068930 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.756+0000 7f034f679640 1 --2- 172.21.15.133:0/1137659243 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f03480c63c0 0x7f03480be710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.756+0000 7f034f679640 1 --2- 172.21.15.133:0/1137659243 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f03480c4100 0x7f03481ec8e0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.756+0000 7f034f679640 1 --2- 172.21.15.133:0/1137659243 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f03480c29e0 0x7f03481ec3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.756+0000 7f034f679640 1 -- 172.21.15.133:0/1137659243 >> 172.21.15.133:0/1137659243 conn(0x7f034806a5b0 msgr2=0x7f03480711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:57.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.756+0000 7f034f679640 1 -- 172.21.15.133:0/1137659243 shutdown_connections 2023-12-19T19:01:57.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.756+0000 7f034f679640 1 -- 172.21.15.133:0/1137659243 wait complete. 2023-12-19T19:01:57.781 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2023-12-19T19:01:56.880505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253584,"kb_used_data":8268,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721136,"statfs":{"total":773094113280,"available":772834443264,"internally_reserved":0,"allocated":8466432,"data_stored":4367529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.207998"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.714809+0000","last_change":"2023-12-19T19:01:53.724722+0000","last_active":"2023-12-19T19:01:54.714809+0000","last_peered":"2023-12-19T19:01:54.714809+0000","last_clean":"2023-12-19T19:01:54.714809+0000","last_became_active":"2023-12-19T19:01:53.724420+0000","last_became_peered":"2023-12-19T19:01:53.724420+0000","last_unstale":"2023-12-19T19:01:54.714809+0000","last_undegraded":"2023-12-19T19:01:54.714809+0000","last_fullsized":"2023-12-19T19:01:54.714809+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:11:12.853890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.710274+0000","last_change":"2023-12-19T19:01:35.993269+0000","last_active":"2023-12-19T19:01:53.710274+0000","last_peered":"2023-12-19T19:01:53.710274+0000","last_clean":"2023-12-19T19:01:53.710274+0000","last_became_active":"2023-12-19T19:01:35.992720+0000","last_became_peered":"2023-12-19T19:01:35.992720+0000","last_unstale":"2023-12-19T19:01:53.710274+0000","last_undegraded":"2023-12-19T19:01:53.710274+0000","last_fullsized":"2023-12-19T19:01:53.710274+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:13.026799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.551474+0000","last_change":"2023-12-19T19:01:53.716723+0000","last_active":"2023-12-19T19:01:55.551474+0000","last_peered":"2023-12-19T19:01:55.551474+0000","last_clean":"2023-12-19T19:01:55.551474+0000","last_became_active":"2023-12-19T19:01:53.716389+0000","last_became_peered":"2023-12-19T19:01:53.716389+0000","last_unstale":"2023-12-19T19:01:55.551474+0000","last_undegraded":"2023-12-19T19:01:55.551474+0000","last_fullsized":"2023-12-19T19:01:55.551474+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:31:17.144583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.696697+0000","last_change":"2023-12-19T19:01:36.008235+0000","last_active":"2023-12-19T19:01:53.696697+0000","last_peered":"2023-12-19T19:01:53.696697+0000","last_clean":"2023-12-19T19:01:53.696697+0000","last_became_active":"2023-12-19T19:01:36.005960+0000","last_became_peered":"2023-12-19T19:01:36.005960+0000","last_unstale":"2023-12-19T19:01:53.696697+0000","last_undegraded":"2023-12-19T19:01:53.696697+0000","last_fullsized":"2023-12-19T19:01:53.696697+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:01:48.212049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.715140+0000","last_change":"2023-12-19T19:01:53.719908+0000","last_active":"2023-12-19T19:01:54.715140+0000","last_peered":"2023-12-19T19:01:54.715140+0000","last_clean":"2023-12-19T19:01:54.715140+0000","last_became_active":"2023-12-19T19:01:53.719633+0000","last_became_peered":"2023-12-19T19:01:53.719633+0000","last_unstale":"2023-12-19T19:01:54.715140+0000","last_undegraded":"2023-12-19T19:01:54.715140+0000","last_fullsized":"2023-12-19T19:01:54.715140+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:37:58.561635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.698511+0000","last_change":"2023-12-19T19:01:35.997697+0000","last_active":"2023-12-19T19:01:53.698511+0000","last_peered":"2023-12-19T19:01:53.698511+0000","last_clean":"2023-12-19T19:01:53.698511+0000","last_became_active":"2023-12-19T19:01:35.997425+0000","last_became_peered":"2023-12-19T19:01:35.997425+0000","last_unstale":"2023-12-19T19:01:53.698511+0000","last_undegraded":"2023-12-19T19:01:53.698511+0000","last_fullsized":"2023-12-19T19:01:53.698511+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:59.952872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.553440+0000","last_change":"2023-12-19T19:01:53.723171+0000","last_active":"2023-12-19T19:01:55.553440+0000","last_peered":"2023-12-19T19:01:55.553440+0000","last_clean":"2023-12-19T19:01:55.553440+0000","last_became_active":"2023-12-19T19:01:53.722519+0000","last_became_peered":"2023-12-19T19:01:53.722519+0000","last_unstale":"2023-12-19T19:01:55.553440+0000","last_undegraded":"2023-12-19T19:01:55.553440+0000","last_fullsized":"2023-12-19T19:01:55.553440+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:50:45.273009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.707290+0000","last_change":"2023-12-19T19:01:35.997124+0000","last_active":"2023-12-19T19:01:53.707290+0000","last_peered":"2023-12-19T19:01:53.707290+0000","last_clean":"2023-12-19T19:01:53.707290+0000","last_became_active":"2023-12-19T19:01:35.996813+0000","last_became_peered":"2023-12-19T19:01:35.996813+0000","last_unstale":"2023-12-19T19:01:53.707290+0000","last_undegraded":"2023-12-19T19:01:53.707290+0000","last_fullsized":"2023-12-19T19:01:53.707290+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:26:37.197213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.716010+0000","last_change":"2023-12-19T19:01:53.712338+0000","last_active":"2023-12-19T19:01:54.716010+0000","last_peered":"2023-12-19T19:01:54.716010+0000","last_clean":"2023-12-19T19:01:54.716010+0000","last_became_active":"2023-12-19T19:01:53.712065+0000","last_became_peered":"2023-12-19T19:01:53.712065+0000","last_unstale":"2023-12-19T19:01:54.716010+0000","last_undegraded":"2023-12-19T19:01:54.716010+0000","last_fullsized":"2023-12-19T19:01:54.716010+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:07:07.571500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.701118+0000","last_change":"2023-12-19T19:01:35.994723+0000","last_active":"2023-12-19T19:01:53.701118+0000","last_peered":"2023-12-19T19:01:53.701118+0000","last_clean":"2023-12-19T19:01:53.701118+0000","last_became_active":"2023-12-19T19:01:35.994225+0000","last_became_peered":"2023-12-19T19:01:35.994225+0000","last_unstale":"2023-12-19T19:01:53.701118+0000","last_undegraded":"2023-12-19T19:01:53.701118+0000","last_fullsized":"2023-12-19T19:01:53.701118+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:16:21.875547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550122+0000","last_change":"2023-12-19T19:01:53.718986+0000","last_active":"2023-12-19T19:01:55.550122+0000","last_peered":"2023-12-19T19:01:55.550122+0000","last_clean":"2023-12-19T19:01:55.550122+0000","last_became_active":"2023-12-19T19:01:53.718614+0000","last_became_peered":"2023-12-19T19:01:53.718614+0000","last_unstale":"2023-12-19T19:01:55.550122+0000","last_undegraded":"2023-12-19T19:01:55.550122+0000","last_fullsized":"2023-12-19T19:01:55.550122+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:49:45.107264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.707542+0000","last_change":"2023-12-19T19:01:35.996456+0000","last_active":"2023-12-19T19:01:53.707542+0000","last_peered":"2023-12-19T19:01:53.707542+0000","last_clean":"2023-12-19T19:01:53.707542+0000","last_became_active":"2023-12-19T19:01:35.996173+0000","last_became_peered":"2023-12-19T19:01:35.996173+0000","last_unstale":"2023-12-19T19:01:53.707542+0000","last_undegraded":"2023-12-19T19:01:53.707542+0000","last_fullsized":"2023-12-19T19:01:53.707542+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:39.334276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.717711+0000","last_change":"2023-12-19T19:01:53.729902+0000","last_active":"2023-12-19T19:01:54.717711+0000","last_peered":"2023-12-19T19:01:54.717711+0000","last_clean":"2023-12-19T19:01:54.717711+0000","last_became_active":"2023-12-19T19:01:53.729463+0000","last_became_peered":"2023-12-19T19:01:53.729463+0000","last_unstale":"2023-12-19T19:01:54.717711+0000","last_undegraded":"2023-12-19T19:01:54.717711+0000","last_fullsized":"2023-12-19T19:01:54.717711+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:09:04.810249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.701499+0000","last_change":"2023-12-19T19:01:35.991595+0000","last_active":"2023-12-19T19:01:53.701499+0000","last_peered":"2023-12-19T19:01:53.701499+0000","last_clean":"2023-12-19T19:01:53.701499+0000","last_became_active":"2023-12-19T19:01:35.991267+0000","last_became_peered":"2023-12-19T19:01:35.991267+0000","last_unstale":"2023-12-19T19:01:53.701499+0000","last_undegraded":"2023-12-19T19:01:53.701499+0000","last_fullsized":"2023-12-19T19:01:53.701499+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:15:44.155043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.716182+0000","last_change":"2023-12-19T19:01:53.725930+0000","last_active":"2023-12-19T19:01:54.716182+0000","last_peered":"2023-12-19T19:01:54.716182+0000","last_clean":"2023-12-19T19:01:54.716182+0000","last_became_active":"2023-12-19T19:01:53.725650+0000","last_became_peered":"2023-12-19T19:01:53.725650+0000","last_unstale":"2023-12-19T19:01:54.716182+0000","last_undegraded":"2023-12-19T19:01:54.716182+0000","last_fullsized":"2023-12-19T19:01:54.716182+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:31:17.144583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.708368+0000","last_change":"2023-12-19T19:01:36.012804+0000","last_active":"2023-12-19T19:01:53.708368+0000","last_peered":"2023-12-19T19:01:53.708368+0000","last_clean":"2023-12-19T19:01:53.708368+0000","last_became_active":"2023-12-19T19:01:36.012506+0000","last_became_peered":"2023-12-19T19:01:36.012506+0000","last_unstale":"2023-12-19T19:01:53.708368+0000","last_undegraded":"2023-12-19T19:01:53.708368+0000","last_fullsized":"2023-12-19T19:01:53.708368+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:52:57.735191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.716365+0000","last_change":"2023-12-19T19:01:53.713424+0000","last_active":"2023-12-19T19:01:54.716365+0000","last_peered":"2023-12-19T19:01:54.716365+0000","last_clean":"2023-12-19T19:01:54.716365+0000","last_became_active":"2023-12-19T19:01:53.712784+0000","last_became_peered":"2023-12-19T19:01:53.712784+0000","last_unstale":"2023-12-19T19:01:54.716365+0000","last_undegraded":"2023-12-19T19:01:54.716365+0000","last_fullsized":"2023-12-19T19:01:54.716365+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:31.015405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.705746+0000","last_change":"2023-12-19T19:01:36.008329+0000","last_active":"2023-12-19T19:01:53.705746+0000","last_peered":"2023-12-19T19:01:53.705746+0000","last_clean":"2023-12-19T19:01:53.705746+0000","last_became_active":"2023-12-19T19:01:36.007450+0000","last_became_peered":"2023-12-19T19:01:36.007450+0000","last_unstale":"2023-12-19T19:01:53.705746+0000","last_undegraded":"2023-12-19T19:01:53.705746+0000","last_fullsized":"2023-12-19T19:01:53.705746+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:52:33.062884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.050194+0000","last_change":"2023-12-19T19:01:53.715168+0000","last_active":"2023-12-19T19:01:55.050194+0000","last_peered":"2023-12-19T19:01:55.050194+0000","last_clean":"2023-12-19T19:01:55.050194+0000","last_became_active":"2023-12-19T19:01:53.714806+0000","last_became_peered":"2023-12-19T19:01:53.714806+0000","last_unstale":"2023-12-19T19:01:55.050194+0000","last_undegraded":"2023-12-19T19:01:55.050194+0000","last_fullsized":"2023-12-19T19:01:55.050194+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:01:26.155616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.703370+0000","last_change":"2023-12-19T19:01:36.012622+0000","last_active":"2023-12-19T19:01:53.703370+0000","last_peered":"2023-12-19T19:01:53.703370+0000","last_clean":"2023-12-19T19:01:53.703370+0000","last_became_active":"2023-12-19T19:01:36.012313+0000","last_became_peered":"2023-12-19T19:01:36.012313+0000","last_unstale":"2023-12-19T19:01:53.703370+0000","last_undegraded":"2023-12-19T19:01:53.703370+0000","last_fullsized":"2023-12-19T19:01:53.703370+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:32.200929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.050713+0000","last_change":"2023-12-19T19:01:53.721228+0000","last_active":"2023-12-19T19:01:55.050713+0000","last_peered":"2023-12-19T19:01:55.050713+0000","last_clean":"2023-12-19T19:01:55.050713+0000","last_became_active":"2023-12-19T19:01:53.720960+0000","last_became_peered":"2023-12-19T19:01:53.720960+0000","last_unstale":"2023-12-19T19:01:55.050713+0000","last_undegraded":"2023-12-19T19:01:55.050713+0000","last_fullsized":"2023-12-19T19:01:55.050713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:09:13.226066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.695281+0000","last_change":"2023-12-19T19:01:36.005796+0000","last_active":"2023-12-19T19:01:53.695281+0000","last_peered":"2023-12-19T19:01:53.695281+0000","last_clean":"2023-12-19T19:01:53.695281+0000","last_became_active":"2023-12-19T19:01:36.005526+0000","last_became_peered":"2023-12-19T19:01:36.005526+0000","last_unstale":"2023-12-19T19:01:53.695281+0000","last_undegraded":"2023-12-19T19:01:53.695281+0000","last_fullsized":"2023-12-19T19:01:53.695281+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:23:25.851168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.717702+0000","last_change":"2023-12-19T19:01:53.728384+0000","last_active":"2023-12-19T19:01:54.717702+0000","last_peered":"2023-12-19T19:01:54.717702+0000","last_clean":"2023-12-19T19:01:54.717702+0000","last_became_active":"2023-12-19T19:01:53.728021+0000","last_became_peered":"2023-12-19T19:01:53.728021+0000","last_unstale":"2023-12-19T19:01:54.717702+0000","last_undegraded":"2023-12-19T19:01:54.717702+0000","last_fullsized":"2023-12-19T19:01:54.717702+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:31:17.144583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.709536+0000","last_change":"2023-12-19T19:01:36.004265+0000","last_active":"2023-12-19T19:01:53.709536+0000","last_peered":"2023-12-19T19:01:53.709536+0000","last_clean":"2023-12-19T19:01:53.709536+0000","last_became_active":"2023-12-19T19:01:36.004006+0000","last_became_peered":"2023-12-19T19:01:36.004006+0000","last_unstale":"2023-12-19T19:01:53.709536+0000","last_undegraded":"2023-12-19T19:01:53.709536+0000","last_fullsized":"2023-12-19T19:01:53.709536+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:37.477766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550679+0000","last_change":"2023-12-19T19:01:53.711881+0000","last_active":"2023-12-19T19:01:55.550679+0000","last_peered":"2023-12-19T19:01:55.550679+0000","last_clean":"2023-12-19T19:01:55.550679+0000","last_became_active":"2023-12-19T19:01:53.711498+0000","last_became_peered":"2023-12-19T19:01:53.711498+0000","last_unstale":"2023-12-19T19:01:55.550679+0000","last_undegraded":"2023-12-19T19:01:55.550679+0000","last_fullsized":"2023-12-19T19:01:55.550679+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:52:54.882324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.696794+0000","last_change":"2023-12-19T19:01:35.998391+0000","last_active":"2023-12-19T19:01:53.696794+0000","last_peered":"2023-12-19T19:01:53.696794+0000","last_clean":"2023-12-19T19:01:53.696794+0000","last_became_active":"2023-12-19T19:01:35.998129+0000","last_became_peered":"2023-12-19T19:01:35.998129+0000","last_unstale":"2023-12-19T19:01:53.696794+0000","last_undegraded":"2023-12-19T19:01:53.696794+0000","last_fullsized":"2023-12-19T19:01:53.696794+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:32.200929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.715958+0000","last_change":"2023-12-19T19:01:53.711434+0000","last_active":"2023-12-19T19:01:54.715958+0000","last_peered":"2023-12-19T19:01:54.715958+0000","last_clean":"2023-12-19T19:01:54.715958+0000","last_became_active":"2023-12-19T19:01:53.710492+0000","last_became_peered":"2023-12-19T19:01:53.710492+0000","last_unstale":"2023-12-19T19:01:54.715958+0000","last_undegraded":"2023-12-19T19:01:54.715958+0000","last_fullsized":"2023-12-19T19:01:54.715958+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:52:54.882324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.705868+0000","last_change":"2023-12-19T19:01:36.001234+0000","last_active":"2023-12-19T19:01:53.705868+0000","last_peered":"2023-12-19T19:01:53.705868+0000","last_clean":"2023-12-19T19:01:53.705868+0000","last_became_active":"2023-12-19T19:01:36.000486+0000","last_became_peered":"2023-12-19T19:01:36.000486+0000","last_unstale":"2023-12-19T19:01:53.705868+0000","last_undegraded":"2023-12-19T19:01:53.705868+0000","last_fullsized":"2023-12-19T19:01:53.705868+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:30:29.280200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.551249+0000","last_change":"2023-12-19T19:01:53.711267+0000","last_active":"2023-12-19T19:01:55.551249+0000","last_peered":"2023-12-19T19:01:55.551249+0000","last_clean":"2023-12-19T19:01:55.551249+0000","last_became_active":"2023-12-19T19:01:53.710803+0000","last_became_peered":"2023-12-19T19:01:53.710803+0000","last_unstale":"2023-12-19T19:01:55.551249+0000","last_undegraded":"2023-12-19T19:01:55.551249+0000","last_fullsized":"2023-12-19T19:01:55.551249+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:27:52.950786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.698074+0000","last_change":"2023-12-19T19:01:36.014917+0000","last_active":"2023-12-19T19:01:53.698074+0000","last_peered":"2023-12-19T19:01:53.698074+0000","last_clean":"2023-12-19T19:01:53.698074+0000","last_became_active":"2023-12-19T19:01:36.011305+0000","last_became_peered":"2023-12-19T19:01:36.011305+0000","last_unstale":"2023-12-19T19:01:53.698074+0000","last_undegraded":"2023-12-19T19:01:53.698074+0000","last_fullsized":"2023-12-19T19:01:53.698074+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:37:40.853246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550500+0000","last_change":"2023-12-19T19:01:53.715938+0000","last_active":"2023-12-19T19:01:55.550500+0000","last_peered":"2023-12-19T19:01:55.550500+0000","last_clean":"2023-12-19T19:01:55.550500+0000","last_became_active":"2023-12-19T19:01:53.715435+0000","last_became_peered":"2023-12-19T19:01:53.715435+0000","last_unstale":"2023-12-19T19:01:55.550500+0000","last_undegraded":"2023-12-19T19:01:55.550500+0000","last_fullsized":"2023-12-19T19:01:55.550500+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:33:24.155748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.699802+0000","last_change":"2023-12-19T19:01:35.997902+0000","last_active":"2023-12-19T19:01:53.699802+0000","last_peered":"2023-12-19T19:01:53.699802+0000","last_clean":"2023-12-19T19:01:53.699802+0000","last_became_active":"2023-12-19T19:01:35.997621+0000","last_became_peered":"2023-12-19T19:01:35.997621+0000","last_unstale":"2023-12-19T19:01:53.699802+0000","last_undegraded":"2023-12-19T19:01:53.699802+0000","last_fullsized":"2023-12-19T19:01:53.699802+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:52:57.735191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.551337+0000","last_change":"2023-12-19T19:01:53.724462+0000","last_active":"2023-12-19T19:01:55.551337+0000","last_peered":"2023-12-19T19:01:55.551337+0000","last_clean":"2023-12-19T19:01:55.551337+0000","last_became_active":"2023-12-19T19:01:53.724181+0000","last_became_peered":"2023-12-19T19:01:53.724181+0000","last_unstale":"2023-12-19T19:01:55.551337+0000","last_undegraded":"2023-12-19T19:01:55.551337+0000","last_fullsized":"2023-12-19T19:01:55.551337+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:06:59.276086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.701079+0000","last_change":"2023-12-19T19:01:35.993502+0000","last_active":"2023-12-19T19:01:53.701079+0000","last_peered":"2023-12-19T19:01:53.701079+0000","last_clean":"2023-12-19T19:01:53.701079+0000","last_became_active":"2023-12-19T19:01:35.993183+0000","last_became_peered":"2023-12-19T19:01:35.993183+0000","last_unstale":"2023-12-19T19:01:53.701079+0000","last_undegraded":"2023-12-19T19:01:53.701079+0000","last_fullsized":"2023-12-19T19:01:53.701079+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:32.200929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.050185+0000","last_change":"2023-12-19T19:01:53.718493+0000","last_active":"2023-12-19T19:01:55.050185+0000","last_peered":"2023-12-19T19:01:55.050185+0000","last_clean":"2023-12-19T19:01:55.050185+0000","last_became_active":"2023-12-19T19:01:53.718176+0000","last_became_peered":"2023-12-19T19:01:53.718176+0000","last_unstale":"2023-12-19T19:01:55.050185+0000","last_undegraded":"2023-12-19T19:01:55.050185+0000","last_fullsized":"2023-12-19T19:01:55.050185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:45:10.710460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.702468+0000","last_change":"2023-12-19T19:01:35.992492+0000","last_active":"2023-12-19T19:01:53.702468+0000","last_peered":"2023-12-19T19:01:53.702468+0000","last_clean":"2023-12-19T19:01:53.702468+0000","last_became_active":"2023-12-19T19:01:35.992218+0000","last_became_peered":"2023-12-19T19:01:35.992218+0000","last_unstale":"2023-12-19T19:01:53.702468+0000","last_undegraded":"2023-12-19T19:01:53.702468+0000","last_fullsized":"2023-12-19T19:01:53.702468+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:51:54.365989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.553511+0000","last_change":"2023-12-19T19:01:53.713700+0000","last_active":"2023-12-19T19:01:55.553511+0000","last_peered":"2023-12-19T19:01:55.553511+0000","last_clean":"2023-12-19T19:01:55.553511+0000","last_became_active":"2023-12-19T19:01:53.713412+0000","last_became_peered":"2023-12-19T19:01:53.713412+0000","last_unstale":"2023-12-19T19:01:55.553511+0000","last_undegraded":"2023-12-19T19:01:55.553511+0000","last_fullsized":"2023-12-19T19:01:55.553511+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:39.191877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.700279+0000","last_change":"2023-12-19T19:01:36.005018+0000","last_active":"2023-12-19T19:01:53.700279+0000","last_peered":"2023-12-19T19:01:53.700279+0000","last_clean":"2023-12-19T19:01:53.700279+0000","last_became_active":"2023-12-19T19:01:36.004713+0000","last_became_peered":"2023-12-19T19:01:36.004713+0000","last_unstale":"2023-12-19T19:01:53.700279+0000","last_undegraded":"2023-12-19T19:01:53.700279+0000","last_fullsized":"2023-12-19T19:01:53.700279+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:59.952872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552273+0000","last_change":"2023-12-19T19:01:53.713554+0000","last_active":"2023-12-19T19:01:55.552273+0000","last_peered":"2023-12-19T19:01:55.552273+0000","last_clean":"2023-12-19T19:01:55.552273+0000","last_became_active":"2023-12-19T19:01:53.713272+0000","last_became_peered":"2023-12-19T19:01:53.713272+0000","last_unstale":"2023-12-19T19:01:55.552273+0000","last_undegraded":"2023-12-19T19:01:55.552273+0000","last_fullsized":"2023-12-19T19:01:55.552273+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:09:04.810249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.707383+0000","last_change":"2023-12-19T19:01:35.991658+0000","last_active":"2023-12-19T19:01:53.707383+0000","last_peered":"2023-12-19T19:01:53.707383+0000","last_clean":"2023-12-19T19:01:53.707383+0000","last_became_active":"2023-12-19T19:01:35.991237+0000","last_became_peered":"2023-12-19T19:01:35.991237+0000","last_unstale":"2023-12-19T19:01:53.707383+0000","last_undegraded":"2023-12-19T19:01:53.707383+0000","last_fullsized":"2023-12-19T19:01:53.707383+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:50:18.771363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550217+0000","last_change":"2023-12-19T19:01:53.722243+0000","last_active":"2023-12-19T19:01:55.550217+0000","last_peered":"2023-12-19T19:01:55.550217+0000","last_clean":"2023-12-19T19:01:55.550217+0000","last_became_active":"2023-12-19T19:01:53.721975+0000","last_became_peered":"2023-12-19T19:01:53.721975+0000","last_unstale":"2023-12-19T19:01:55.550217+0000","last_undegraded":"2023-12-19T19:01:55.550217+0000","last_fullsized":"2023-12-19T19:01:55.550217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:38:22.203901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.703154+0000","last_change":"2023-12-19T19:01:35.999313+0000","last_active":"2023-12-19T19:01:53.703154+0000","last_peered":"2023-12-19T19:01:53.703154+0000","last_clean":"2023-12-19T19:01:53.703154+0000","last_became_active":"2023-12-19T19:01:35.999030+0000","last_became_peered":"2023-12-19T19:01:35.999030+0000","last_unstale":"2023-12-19T19:01:53.703154+0000","last_undegraded":"2023-12-19T19:01:53.703154+0000","last_fullsized":"2023-12-19T19:01:53.703154+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:43:01.593581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.716130+0000","last_change":"2023-12-19T19:01:53.714439+0000","last_active":"2023-12-19T19:01:54.716130+0000","last_peered":"2023-12-19T19:01:54.716130+0000","last_clean":"2023-12-19T19:01:54.716130+0000","last_became_active":"2023-12-19T19:01:53.713073+0000","last_became_peered":"2023-12-19T19:01:53.713073+0000","last_unstale":"2023-12-19T19:01:54.716130+0000","last_undegraded":"2023-12-19T19:01:54.716130+0000","last_fullsized":"2023-12-19T19:01:54.716130+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:27:52.950786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.693714+0000","last_change":"2023-12-19T19:01:36.009794+0000","last_active":"2023-12-19T19:01:53.693714+0000","last_peered":"2023-12-19T19:01:53.693714+0000","last_clean":"2023-12-19T19:01:53.693714+0000","last_became_active":"2023-12-19T19:01:36.008912+0000","last_became_peered":"2023-12-19T19:01:36.008912+0000","last_unstale":"2023-12-19T19:01:53.693714+0000","last_undegraded":"2023-12-19T19:01:53.693714+0000","last_fullsized":"2023-12-19T19:01:53.693714+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:37.771426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.551900+0000","last_change":"2023-12-19T19:01:53.714089+0000","last_active":"2023-12-19T19:01:55.551900+0000","last_peered":"2023-12-19T19:01:55.551900+0000","last_clean":"2023-12-19T19:01:55.551900+0000","last_became_active":"2023-12-19T19:01:53.713779+0000","last_became_peered":"2023-12-19T19:01:53.713779+0000","last_unstale":"2023-12-19T19:01:55.551900+0000","last_undegraded":"2023-12-19T19:01:55.551900+0000","last_fullsized":"2023-12-19T19:01:55.551900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:07:15.643876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.717679+0000","last_change":"2023-12-19T19:01:35.998877+0000","last_active":"2023-12-19T19:01:53.717679+0000","last_peered":"2023-12-19T19:01:53.717679+0000","last_clean":"2023-12-19T19:01:53.717679+0000","last_became_active":"2023-12-19T19:01:35.998571+0000","last_became_peered":"2023-12-19T19:01:35.998571+0000","last_unstale":"2023-12-19T19:01:53.717679+0000","last_undegraded":"2023-12-19T19:01:53.717679+0000","last_fullsized":"2023-12-19T19:01:53.717679+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:39.334276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.551200+0000","last_change":"2023-12-19T19:01:53.724126+0000","last_active":"2023-12-19T19:01:55.551200+0000","last_peered":"2023-12-19T19:01:55.551200+0000","last_clean":"2023-12-19T19:01:55.551200+0000","last_became_active":"2023-12-19T19:01:53.723565+0000","last_became_peered":"2023-12-19T19:01:53.723565+0000","last_unstale":"2023-12-19T19:01:55.551200+0000","last_undegraded":"2023-12-19T19:01:55.551200+0000","last_fullsized":"2023-12-19T19:01:55.551200+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:24:19.929639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.705011+0000","last_change":"2023-12-19T19:01:35.997800+0000","last_active":"2023-12-19T19:01:53.705011+0000","last_peered":"2023-12-19T19:01:53.705011+0000","last_clean":"2023-12-19T19:01:53.705011+0000","last_became_active":"2023-12-19T19:01:35.997545+0000","last_became_peered":"2023-12-19T19:01:35.997545+0000","last_unstale":"2023-12-19T19:01:53.705011+0000","last_undegraded":"2023-12-19T19:01:53.705011+0000","last_fullsized":"2023-12-19T19:01:53.705011+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:20:16.482489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.716945+0000","last_change":"2023-12-19T19:01:53.713603+0000","last_active":"2023-12-19T19:01:54.716945+0000","last_peered":"2023-12-19T19:01:54.716945+0000","last_clean":"2023-12-19T19:01:54.716945+0000","last_became_active":"2023-12-19T19:01:53.713161+0000","last_became_peered":"2023-12-19T19:01:53.713161+0000","last_unstale":"2023-12-19T19:01:54.716945+0000","last_undegraded":"2023-12-19T19:01:54.716945+0000","last_fullsized":"2023-12-19T19:01:54.716945+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:11.889310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.695878+0000","last_change":"2023-12-19T19:01:36.012530+0000","last_active":"2023-12-19T19:01:53.695878+0000","last_peered":"2023-12-19T19:01:53.695878+0000","last_clean":"2023-12-19T19:01:53.695878+0000","last_became_active":"2023-12-19T19:01:36.000357+0000","last_became_peered":"2023-12-19T19:01:36.000357+0000","last_unstale":"2023-12-19T19:01:53.695878+0000","last_undegraded":"2023-12-19T19:01:53.695878+0000","last_fullsized":"2023-12-19T19:01:53.695878+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:48:37.782606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.718103+0000","last_change":"2023-12-19T19:01:53.728404+0000","last_active":"2023-12-19T19:01:54.718103+0000","last_peered":"2023-12-19T19:01:54.718103+0000","last_clean":"2023-12-19T19:01:54.718103+0000","last_became_active":"2023-12-19T19:01:53.728106+0000","last_became_peered":"2023-12-19T19:01:53.728106+0000","last_unstale":"2023-12-19T19:01:54.718103+0000","last_undegraded":"2023-12-19T19:01:54.718103+0000","last_fullsized":"2023-12-19T19:01:54.718103+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:31.015405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.696603+0000","last_change":"2023-12-19T19:01:36.000335+0000","last_active":"2023-12-19T19:01:53.696603+0000","last_peered":"2023-12-19T19:01:53.696603+0000","last_clean":"2023-12-19T19:01:53.696603+0000","last_became_active":"2023-12-19T19:01:35.999949+0000","last_became_peered":"2023-12-19T19:01:35.999949+0000","last_unstale":"2023-12-19T19:01:53.696603+0000","last_undegraded":"2023-12-19T19:01:53.696603+0000","last_fullsized":"2023-12-19T19:01:53.696603+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:11:15.836065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.718458+0000","last_change":"2023-12-19T19:01:53.725149+0000","last_active":"2023-12-19T19:01:54.718458+0000","last_peered":"2023-12-19T19:01:54.718458+0000","last_clean":"2023-12-19T19:01:54.718458+0000","last_became_active":"2023-12-19T19:01:53.724788+0000","last_became_peered":"2023-12-19T19:01:53.724788+0000","last_unstale":"2023-12-19T19:01:54.718458+0000","last_undegraded":"2023-12-19T19:01:54.718458+0000","last_fullsized":"2023-12-19T19:01:54.718458+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:13:39.216177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.701911+0000","last_change":"2023-12-19T19:01:36.004020+0000","last_active":"2023-12-19T19:01:53.701911+0000","last_peered":"2023-12-19T19:01:53.701911+0000","last_clean":"2023-12-19T19:01:53.701911+0000","last_became_active":"2023-12-19T19:01:36.003711+0000","last_became_peered":"2023-12-19T19:01:36.003711+0000","last_unstale":"2023-12-19T19:01:53.701911+0000","last_undegraded":"2023-12-19T19:01:53.701911+0000","last_fullsized":"2023-12-19T19:01:53.701911+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:37:45.790125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.553526+0000","last_change":"2023-12-19T19:01:53.711357+0000","last_active":"2023-12-19T19:01:55.553526+0000","last_peered":"2023-12-19T19:01:55.553526+0000","last_clean":"2023-12-19T19:01:55.553526+0000","last_became_active":"2023-12-19T19:01:53.711054+0000","last_became_peered":"2023-12-19T19:01:53.711054+0000","last_unstale":"2023-12-19T19:01:55.553526+0000","last_undegraded":"2023-12-19T19:01:55.553526+0000","last_fullsized":"2023-12-19T19:01:55.553526+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:18:48.854453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.709624+0000","last_change":"2023-12-19T19:01:36.002845+0000","last_active":"2023-12-19T19:01:53.709624+0000","last_peered":"2023-12-19T19:01:53.709624+0000","last_clean":"2023-12-19T19:01:53.709624+0000","last_became_active":"2023-12-19T19:01:35.995423+0000","last_became_peered":"2023-12-19T19:01:35.995423+0000","last_unstale":"2023-12-19T19:01:53.709624+0000","last_undegraded":"2023-12-19T19:01:53.709624+0000","last_fullsized":"2023-12-19T19:01:53.709624+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:36.554120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.551107+0000","last_change":"2023-12-19T19:01:53.731528+0000","last_active":"2023-12-19T19:01:55.551107+0000","last_peered":"2023-12-19T19:01:55.551107+0000","last_clean":"2023-12-19T19:01:55.551107+0000","last_became_active":"2023-12-19T19:01:53.731064+0000","last_became_peered":"2023-12-19T19:01:53.731064+0000","last_unstale":"2023-12-19T19:01:55.551107+0000","last_undegraded":"2023-12-19T19:01:55.551107+0000","last_fullsized":"2023-12-19T19:01:55.551107+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:07:07.571500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.694141+0000","last_change":"2023-12-19T19:01:36.010222+0000","last_active":"2023-12-19T19:01:53.694141+0000","last_peered":"2023-12-19T19:01:53.694141+0000","last_clean":"2023-12-19T19:01:53.694141+0000","last_became_active":"2023-12-19T19:01:36.006880+0000","last_became_peered":"2023-12-19T19:01:36.006880+0000","last_unstale":"2023-12-19T19:01:53.694141+0000","last_undegraded":"2023-12-19T19:01:53.694141+0000","last_fullsized":"2023-12-19T19:01:53.694141+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:33:06.447358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.713927+0000","last_change":"2023-12-19T19:01:53.708918+0000","last_active":"2023-12-19T19:01:54.713927+0000","last_peered":"2023-12-19T19:01:54.713927+0000","last_clean":"2023-12-19T19:01:54.713927+0000","last_became_active":"2023-12-19T19:01:53.708564+0000","last_became_peered":"2023-12-19T19:01:53.708564+0000","last_unstale":"2023-12-19T19:01:54.713927+0000","last_undegraded":"2023-12-19T19:01:54.713927+0000","last_fullsized":"2023-12-19T19:01:54.713927+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:30.735188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.693797+0000","last_change":"2023-12-19T19:01:36.009287+0000","last_active":"2023-12-19T19:01:53.693797+0000","last_peered":"2023-12-19T19:01:53.693797+0000","last_clean":"2023-12-19T19:01:53.693797+0000","last_became_active":"2023-12-19T19:01:36.008143+0000","last_became_peered":"2023-12-19T19:01:36.008143+0000","last_unstale":"2023-12-19T19:01:53.693797+0000","last_undegraded":"2023-12-19T19:01:53.693797+0000","last_fullsized":"2023-12-19T19:01:53.693797+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:31:30.154809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552974+0000","last_change":"2023-12-19T19:01:53.711505+0000","last_active":"2023-12-19T19:01:55.552974+0000","last_peered":"2023-12-19T19:01:55.552974+0000","last_clean":"2023-12-19T19:01:55.552974+0000","last_became_active":"2023-12-19T19:01:53.711192+0000","last_became_peered":"2023-12-19T19:01:53.711192+0000","last_unstale":"2023-12-19T19:01:55.552974+0000","last_undegraded":"2023-12-19T19:01:55.552974+0000","last_fullsized":"2023-12-19T19:01:55.552974+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:47:41.887378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.699926+0000","last_change":"2023-12-19T19:01:35.999308+0000","last_active":"2023-12-19T19:01:53.699926+0000","last_peered":"2023-12-19T19:01:53.699926+0000","last_clean":"2023-12-19T19:01:53.699926+0000","last_became_active":"2023-12-19T19:01:35.998266+0000","last_became_peered":"2023-12-19T19:01:35.998266+0000","last_unstale":"2023-12-19T19:01:53.699926+0000","last_undegraded":"2023-12-19T19:01:53.699926+0000","last_fullsized":"2023-12-19T19:01:53.699926+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:39.334276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.551213+0000","last_change":"2023-12-19T19:01:53.715743+0000","last_active":"2023-12-19T19:01:55.551213+0000","last_peered":"2023-12-19T19:01:55.551213+0000","last_clean":"2023-12-19T19:01:55.551213+0000","last_became_active":"2023-12-19T19:01:53.715063+0000","last_became_peered":"2023-12-19T19:01:53.715063+0000","last_unstale":"2023-12-19T19:01:55.551213+0000","last_undegraded":"2023-12-19T19:01:55.551213+0000","last_fullsized":"2023-12-19T19:01:55.551213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:48:55.490995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.702645+0000","last_change":"2023-12-19T19:01:35.997803+0000","last_active":"2023-12-19T19:01:53.702645+0000","last_peered":"2023-12-19T19:01:53.702645+0000","last_clean":"2023-12-19T19:01:53.702645+0000","last_became_active":"2023-12-19T19:01:35.997526+0000","last_became_peered":"2023-12-19T19:01:35.997526+0000","last_unstale":"2023-12-19T19:01:53.702645+0000","last_undegraded":"2023-12-19T19:01:53.702645+0000","last_fullsized":"2023-12-19T19:01:53.702645+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:16:21.875547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.714564+0000","last_change":"2023-12-19T19:01:53.721121+0000","last_active":"2023-12-19T19:01:54.714564+0000","last_peered":"2023-12-19T19:01:54.714564+0000","last_clean":"2023-12-19T19:01:54.714564+0000","last_became_active":"2023-12-19T19:01:53.720664+0000","last_became_peered":"2023-12-19T19:01:53.720664+0000","last_unstale":"2023-12-19T19:01:54.714564+0000","last_undegraded":"2023-12-19T19:01:54.714564+0000","last_fullsized":"2023-12-19T19:01:54.714564+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:06:27.076457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"72'2","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.553054+0000","last_change":"2023-12-19T19:01:52.709206+0000","last_active":"2023-12-19T19:01:55.553054+0000","last_peered":"2023-12-19T19:01:55.553054+0000","last_clean":"2023-12-19T19:01:55.553054+0000","last_became_active":"2023-12-19T19:01:52.707641+0000","last_became_peered":"2023-12-19T19:01:52.707641+0000","last_unstale":"2023-12-19T19:01:55.553054+0000","last_undegraded":"2023-12-19T19:01:55.553054+0000","last_fullsized":"2023-12-19T19:01:55.553054+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:27:51.944633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.702428+0000","last_change":"2023-12-19T19:01:35.998354+0000","last_active":"2023-12-19T19:01:53.702428+0000","last_peered":"2023-12-19T19:01:53.702428+0000","last_clean":"2023-12-19T19:01:53.702428+0000","last_became_active":"2023-12-19T19:01:35.997004+0000","last_became_peered":"2023-12-19T19:01:35.997004+0000","last_unstale":"2023-12-19T19:01:53.702428+0000","last_undegraded":"2023-12-19T19:01:53.702428+0000","last_fullsized":"2023-12-19T19:01:53.702428+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:53:03.688848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"68'4","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.710523+0000","last_change":"2023-12-19T19:01:35.005860+0000","last_active":"2023-12-19T19:01:53.710523+0000","last_peered":"2023-12-19T19:01:53.710523+0000","last_clean":"2023-12-19T19:01:53.710523+0000","last_became_active":"2023-12-19T19:01:35.005458+0000","last_became_peered":"2023-12-19T19:01:35.005458+0000","last_unstale":"2023-12-19T19:01:53.710523+0000","last_undegraded":"2023-12-19T19:01:53.710523+0000","last_fullsized":"2023-12-19T19:01:53.710523+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:13:22.016658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.050329+0000","last_change":"2023-12-19T19:01:53.723293+0000","last_active":"2023-12-19T19:01:55.050329+0000","last_peered":"2023-12-19T19:01:55.050329+0000","last_clean":"2023-12-19T19:01:55.050329+0000","last_became_active":"2023-12-19T19:01:53.722963+0000","last_became_peered":"2023-12-19T19:01:53.722963+0000","last_unstale":"2023-12-19T19:01:55.050329+0000","last_undegraded":"2023-12-19T19:01:55.050329+0000","last_fullsized":"2023-12-19T19:01:55.050329+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:05.979540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"72'2","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552643+0000","last_change":"2023-12-19T19:01:52.708822+0000","last_active":"2023-12-19T19:01:55.552643+0000","last_peered":"2023-12-19T19:01:55.552643+0000","last_clean":"2023-12-19T19:01:55.552643+0000","last_became_active":"2023-12-19T19:01:52.708237+0000","last_became_peered":"2023-12-19T19:01:52.708237+0000","last_unstale":"2023-12-19T19:01:55.552643+0000","last_undegraded":"2023-12-19T19:01:55.552643+0000","last_fullsized":"2023-12-19T19:01:55.552643+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:55:15.463085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.710356+0000","last_change":"2023-12-19T19:01:35.995284+0000","last_active":"2023-12-19T19:01:53.710356+0000","last_peered":"2023-12-19T19:01:53.710356+0000","last_clean":"2023-12-19T19:01:53.710356+0000","last_became_active":"2023-12-19T19:01:35.994915+0000","last_became_peered":"2023-12-19T19:01:35.994915+0000","last_unstale":"2023-12-19T19:01:53.710356+0000","last_undegraded":"2023-12-19T19:01:53.710356+0000","last_fullsized":"2023-12-19T19:01:53.710356+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:59.952872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"68'1","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.702726+0000","last_change":"2023-12-19T19:01:35.000000+0000","last_active":"2023-12-19T19:01:53.702726+0000","last_peered":"2023-12-19T19:01:53.702726+0000","last_clean":"2023-12-19T19:01:53.702726+0000","last_became_active":"2023-12-19T19:01:34.999684+0000","last_became_peered":"2023-12-19T19:01:34.999684+0000","last_unstale":"2023-12-19T19:01:53.702726+0000","last_undegraded":"2023-12-19T19:01:53.702726+0000","last_fullsized":"2023-12-19T19:01:53.702726+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:27.616001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552022+0000","last_change":"2023-12-19T19:01:53.725911+0000","last_active":"2023-12-19T19:01:55.552022+0000","last_peered":"2023-12-19T19:01:55.552022+0000","last_clean":"2023-12-19T19:01:55.552022+0000","last_became_active":"2023-12-19T19:01:53.724799+0000","last_became_peered":"2023-12-19T19:01:53.724799+0000","last_unstale":"2023-12-19T19:01:55.552022+0000","last_undegraded":"2023-12-19T19:01:55.552022+0000","last_fullsized":"2023-12-19T19:01:55.552022+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:13:40.732465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"72'4","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552888+0000","last_change":"2023-12-19T19:01:52.710388+0000","last_active":"2023-12-19T19:01:55.552888+0000","last_peered":"2023-12-19T19:01:55.552888+0000","last_clean":"2023-12-19T19:01:55.552888+0000","last_became_active":"2023-12-19T19:01:52.710053+0000","last_became_peered":"2023-12-19T19:01:52.710053+0000","last_unstale":"2023-12-19T19:01:55.552888+0000","last_undegraded":"2023-12-19T19:01:55.552888+0000","last_fullsized":"2023-12-19T19:01:55.552888+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:41.129122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.709721+0000","last_change":"2023-12-19T19:01:36.005109+0000","last_active":"2023-12-19T19:01:53.709721+0000","last_peered":"2023-12-19T19:01:53.709721+0000","last_clean":"2023-12-19T19:01:53.709721+0000","last_became_active":"2023-12-19T19:01:36.003599+0000","last_became_peered":"2023-12-19T19:01:36.003599+0000","last_unstale":"2023-12-19T19:01:53.709721+0000","last_undegraded":"2023-12-19T19:01:53.709721+0000","last_fullsized":"2023-12-19T19:01:53.709721+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:20:14.686881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"68'2","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.700388+0000","last_change":"2023-12-19T19:01:34.996946+0000","last_active":"2023-12-19T19:01:53.700388+0000","last_peered":"2023-12-19T19:01:53.700388+0000","last_clean":"2023-12-19T19:01:53.700388+0000","last_became_active":"2023-12-19T19:01:34.995689+0000","last_became_peered":"2023-12-19T19:01:34.995689+0000","last_unstale":"2023-12-19T19:01:53.700388+0000","last_undegraded":"2023-12-19T19:01:53.700388+0000","last_fullsized":"2023-12-19T19:01:53.700388+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:52:56.727773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552963+0000","last_change":"2023-12-19T19:01:53.723226+0000","last_active":"2023-12-19T19:01:55.552963+0000","last_peered":"2023-12-19T19:01:55.552963+0000","last_clean":"2023-12-19T19:01:55.552963+0000","last_became_active":"2023-12-19T19:01:53.722955+0000","last_became_peered":"2023-12-19T19:01:53.722955+0000","last_unstale":"2023-12-19T19:01:55.552963+0000","last_undegraded":"2023-12-19T19:01:55.552963+0000","last_fullsized":"2023-12-19T19:01:55.552963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:31.015405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"72'1","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.716814+0000","last_change":"2023-12-19T19:01:52.690786+0000","last_active":"2023-12-19T19:01:54.716814+0000","last_peered":"2023-12-19T19:01:54.716814+0000","last_clean":"2023-12-19T19:01:54.716814+0000","last_became_active":"2023-12-19T19:01:52.690344+0000","last_became_peered":"2023-12-19T19:01:52.690344+0000","last_unstale":"2023-12-19T19:01:54.716814+0000","last_undegraded":"2023-12-19T19:01:54.716814+0000","last_fullsized":"2023-12-19T19:01:54.716814+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:55:15.463085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.698944+0000","last_change":"2023-12-19T19:01:35.996110+0000","last_active":"2023-12-19T19:01:53.698944+0000","last_peered":"2023-12-19T19:01:53.698944+0000","last_clean":"2023-12-19T19:01:53.698944+0000","last_became_active":"2023-12-19T19:01:35.995850+0000","last_became_peered":"2023-12-19T19:01:35.995850+0000","last_unstale":"2023-12-19T19:01:53.698944+0000","last_undegraded":"2023-12-19T19:01:53.698944+0000","last_fullsized":"2023-12-19T19:01:53.698944+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:06:09.368068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"68'2","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.699012+0000","last_change":"2023-12-19T19:01:34.997757+0000","last_active":"2023-12-19T19:01:53.699012+0000","last_peered":"2023-12-19T19:01:53.699012+0000","last_clean":"2023-12-19T19:01:53.699012+0000","last_became_active":"2023-12-19T19:01:34.997458+0000","last_became_peered":"2023-12-19T19:01:34.997458+0000","last_unstale":"2023-12-19T19:01:53.699012+0000","last_undegraded":"2023-12-19T19:01:53.699012+0000","last_fullsized":"2023-12-19T19:01:53.699012+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:53:02.681430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550120+0000","last_change":"2023-12-19T19:01:53.711902+0000","last_active":"2023-12-19T19:01:55.550120+0000","last_peered":"2023-12-19T19:01:55.550120+0000","last_clean":"2023-12-19T19:01:55.550120+0000","last_became_active":"2023-12-19T19:01:53.711611+0000","last_became_peered":"2023-12-19T19:01:53.711611+0000","last_unstale":"2023-12-19T19:01:55.550120+0000","last_undegraded":"2023-12-19T19:01:55.550120+0000","last_fullsized":"2023-12-19T19:01:55.550120+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:05.979540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.717186+0000","last_change":"2023-12-19T19:01:52.708697+0000","last_active":"2023-12-19T19:01:54.717186+0000","last_peered":"2023-12-19T19:01:54.717186+0000","last_clean":"2023-12-19T19:01:54.717186+0000","last_became_active":"2023-12-19T19:01:52.708377+0000","last_became_peered":"2023-12-19T19:01:52.708377+0000","last_unstale":"2023-12-19T19:01:54.717186+0000","last_undegraded":"2023-12-19T19:01:54.717186+0000","last_fullsized":"2023-12-19T19:01:54.717186+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:01:25.149463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.693887+0000","last_change":"2023-12-19T19:01:36.004027+0000","last_active":"2023-12-19T19:01:53.693887+0000","last_peered":"2023-12-19T19:01:53.693887+0000","last_clean":"2023-12-19T19:01:53.693887+0000","last_became_active":"2023-12-19T19:01:35.997940+0000","last_became_peered":"2023-12-19T19:01:35.997940+0000","last_unstale":"2023-12-19T19:01:53.693887+0000","last_undegraded":"2023-12-19T19:01:53.693887+0000","last_fullsized":"2023-12-19T19:01:53.693887+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:13:04.402847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"68'1","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.701424+0000","last_change":"2023-12-19T19:01:34.994677+0000","last_active":"2023-12-19T19:01:53.701424+0000","last_peered":"2023-12-19T19:01:53.701424+0000","last_clean":"2023-12-19T19:01:53.701424+0000","last_became_active":"2023-12-19T19:01:34.994343+0000","last_became_peered":"2023-12-19T19:01:34.994343+0000","last_unstale":"2023-12-19T19:01:53.701424+0000","last_undegraded":"2023-12-19T19:01:53.701424+0000","last_fullsized":"2023-12-19T19:01:53.701424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:13:22.016658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.049686+0000","last_change":"2023-12-19T19:01:53.722871+0000","last_active":"2023-12-19T19:01:55.049686+0000","last_peered":"2023-12-19T19:01:55.049686+0000","last_clean":"2023-12-19T19:01:55.049686+0000","last_became_active":"2023-12-19T19:01:53.722574+0000","last_became_peered":"2023-12-19T19:01:53.722574+0000","last_unstale":"2023-12-19T19:01:55.049686+0000","last_undegraded":"2023-12-19T19:01:55.049686+0000","last_fullsized":"2023-12-19T19:01:55.049686+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:54:12.609735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.713921+0000","last_change":"2023-12-19T19:01:52.702729+0000","last_active":"2023-12-19T19:01:54.713921+0000","last_peered":"2023-12-19T19:01:54.713921+0000","last_clean":"2023-12-19T19:01:54.713921+0000","last_became_active":"2023-12-19T19:01:52.701649+0000","last_became_peered":"2023-12-19T19:01:52.701649+0000","last_unstale":"2023-12-19T19:01:54.713921+0000","last_undegraded":"2023-12-19T19:01:54.713921+0000","last_fullsized":"2023-12-19T19:01:54.713921+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:45.325655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.701210+0000","last_change":"2023-12-19T19:01:35.993058+0000","last_active":"2023-12-19T19:01:53.701210+0000","last_peered":"2023-12-19T19:01:53.701210+0000","last_clean":"2023-12-19T19:01:53.701210+0000","last_became_active":"2023-12-19T19:01:35.992604+0000","last_became_peered":"2023-12-19T19:01:35.992604+0000","last_unstale":"2023-12-19T19:01:53.701210+0000","last_undegraded":"2023-12-19T19:01:53.701210+0000","last_fullsized":"2023-12-19T19:01:53.701210+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:37.477766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"68'1","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.702345+0000","last_change":"2023-12-19T19:01:34.998256+0000","last_active":"2023-12-19T19:01:53.702345+0000","last_peered":"2023-12-19T19:01:53.702345+0000","last_clean":"2023-12-19T19:01:53.702345+0000","last_became_active":"2023-12-19T19:01:34.997890+0000","last_became_peered":"2023-12-19T19:01:34.997890+0000","last_unstale":"2023-12-19T19:01:53.702345+0000","last_undegraded":"2023-12-19T19:01:53.702345+0000","last_fullsized":"2023-12-19T19:01:53.702345+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:01:47.204631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550589+0000","last_change":"2023-12-19T19:01:53.721014+0000","last_active":"2023-12-19T19:01:55.550589+0000","last_peered":"2023-12-19T19:01:55.550589+0000","last_clean":"2023-12-19T19:01:55.550589+0000","last_became_active":"2023-12-19T19:01:53.718429+0000","last_became_peered":"2023-12-19T19:01:53.718429+0000","last_unstale":"2023-12-19T19:01:55.550589+0000","last_undegraded":"2023-12-19T19:01:55.550589+0000","last_fullsized":"2023-12-19T19:01:55.550589+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:59:49.450663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"72'1","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.714310+0000","last_change":"2023-12-19T19:01:52.698715+0000","last_active":"2023-12-19T19:01:54.714310+0000","last_peered":"2023-12-19T19:01:54.714310+0000","last_clean":"2023-12-19T19:01:54.714310+0000","last_became_active":"2023-12-19T19:01:52.697188+0000","last_became_peered":"2023-12-19T19:01:52.697188+0000","last_unstale":"2023-12-19T19:01:54.714310+0000","last_undegraded":"2023-12-19T19:01:54.714310+0000","last_fullsized":"2023-12-19T19:01:54.714310+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:52:49.765121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.697203+0000","last_change":"2023-12-19T19:01:36.004752+0000","last_active":"2023-12-19T19:01:53.697203+0000","last_peered":"2023-12-19T19:01:53.697203+0000","last_clean":"2023-12-19T19:01:53.697203+0000","last_became_active":"2023-12-19T19:01:36.004424+0000","last_became_peered":"2023-12-19T19:01:36.004424+0000","last_unstale":"2023-12-19T19:01:53.697203+0000","last_undegraded":"2023-12-19T19:01:53.697203+0000","last_fullsized":"2023-12-19T19:01:53.697203+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:39:57.224439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.701009+0000","last_change":"2023-12-19T19:01:34.995656+0000","last_active":"2023-12-19T19:01:53.701009+0000","last_peered":"2023-12-19T19:01:53.701009+0000","last_clean":"2023-12-19T19:01:53.701009+0000","last_became_active":"2023-12-19T19:01:34.995357+0000","last_became_peered":"2023-12-19T19:01:34.995357+0000","last_unstale":"2023-12-19T19:01:53.701009+0000","last_undegraded":"2023-12-19T19:01:53.701009+0000","last_fullsized":"2023-12-19T19:01:53.701009+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:37:44.782707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.716240+0000","last_change":"2023-12-19T19:01:53.715621+0000","last_active":"2023-12-19T19:01:54.716240+0000","last_peered":"2023-12-19T19:01:54.716240+0000","last_clean":"2023-12-19T19:01:54.716240+0000","last_became_active":"2023-12-19T19:01:53.715299+0000","last_became_peered":"2023-12-19T19:01:53.715299+0000","last_unstale":"2023-12-19T19:01:54.716240+0000","last_undegraded":"2023-12-19T19:01:54.716240+0000","last_fullsized":"2023-12-19T19:01:54.716240+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:09:04.810249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"72'1","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.551297+0000","last_change":"2023-12-19T19:01:52.709336+0000","last_active":"2023-12-19T19:01:55.551297+0000","last_peered":"2023-12-19T19:01:55.551297+0000","last_clean":"2023-12-19T19:01:55.551297+0000","last_became_active":"2023-12-19T19:01:52.709047+0000","last_became_peered":"2023-12-19T19:01:52.709047+0000","last_unstale":"2023-12-19T19:01:55.551297+0000","last_undegraded":"2023-12-19T19:01:55.551297+0000","last_fullsized":"2023-12-19T19:01:55.551297+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:38.236096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.698255+0000","last_change":"2023-12-19T19:01:36.010420+0000","last_active":"2023-12-19T19:01:53.698255+0000","last_peered":"2023-12-19T19:01:53.698255+0000","last_clean":"2023-12-19T19:01:53.698255+0000","last_became_active":"2023-12-19T19:01:36.007843+0000","last_became_peered":"2023-12-19T19:01:36.007843+0000","last_unstale":"2023-12-19T19:01:53.698255+0000","last_undegraded":"2023-12-19T19:01:53.698255+0000","last_fullsized":"2023-12-19T19:01:53.698255+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:45.276751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.693512+0000","last_change":"2023-12-19T19:01:35.000403+0000","last_active":"2023-12-19T19:01:53.693512+0000","last_peered":"2023-12-19T19:01:53.693512+0000","last_clean":"2023-12-19T19:01:53.693512+0000","last_became_active":"2023-12-19T19:01:34.998866+0000","last_became_peered":"2023-12-19T19:01:34.998866+0000","last_unstale":"2023-12-19T19:01:53.693512+0000","last_undegraded":"2023-12-19T19:01:53.693512+0000","last_fullsized":"2023-12-19T19:01:53.693512+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:11:27.498892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.717663+0000","last_change":"2023-12-19T19:01:53.728523+0000","last_active":"2023-12-19T19:01:54.717663+0000","last_peered":"2023-12-19T19:01:54.717663+0000","last_clean":"2023-12-19T19:01:54.717663+0000","last_became_active":"2023-12-19T19:01:53.728114+0000","last_became_peered":"2023-12-19T19:01:53.728114+0000","last_unstale":"2023-12-19T19:01:54.717663+0000","last_undegraded":"2023-12-19T19:01:54.717663+0000","last_fullsized":"2023-12-19T19:01:54.717663+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:07:07.571500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"72'3","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.717048+0000","last_change":"2023-12-19T19:01:52.691603+0000","last_active":"2023-12-19T19:01:54.717048+0000","last_peered":"2023-12-19T19:01:54.717048+0000","last_clean":"2023-12-19T19:01:54.717048+0000","last_became_active":"2023-12-19T19:01:52.691283+0000","last_became_peered":"2023-12-19T19:01:52.691283+0000","last_unstale":"2023-12-19T19:01:54.717048+0000","last_undegraded":"2023-12-19T19:01:54.717048+0000","last_fullsized":"2023-12-19T19:01:54.717048+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:04.973387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.701897+0000","last_change":"2023-12-19T19:01:36.016594+0000","last_active":"2023-12-19T19:01:53.701897+0000","last_peered":"2023-12-19T19:01:53.701897+0000","last_clean":"2023-12-19T19:01:53.701897+0000","last_became_active":"2023-12-19T19:01:36.016338+0000","last_became_peered":"2023-12-19T19:01:36.016338+0000","last_unstale":"2023-12-19T19:01:53.701897+0000","last_undegraded":"2023-12-19T19:01:53.701897+0000","last_fullsized":"2023-12-19T19:01:53.701897+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:05:52.573183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.720078+0000","last_change":"2023-12-19T19:01:35.002076+0000","last_active":"2023-12-19T19:01:53.720078+0000","last_peered":"2023-12-19T19:01:53.720078+0000","last_clean":"2023-12-19T19:01:53.720078+0000","last_became_active":"2023-12-19T19:01:35.001645+0000","last_became_peered":"2023-12-19T19:01:35.001645+0000","last_unstale":"2023-12-19T19:01:53.720078+0000","last_undegraded":"2023-12-19T19:01:53.720078+0000","last_fullsized":"2023-12-19T19:01:53.720078+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:32:15.466391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.716516+0000","last_change":"2023-12-19T19:01:53.713991+0000","last_active":"2023-12-19T19:01:54.716516+0000","last_peered":"2023-12-19T19:01:54.716516+0000","last_clean":"2023-12-19T19:01:54.716516+0000","last_became_active":"2023-12-19T19:01:53.713705+0000","last_became_peered":"2023-12-19T19:01:53.713705+0000","last_unstale":"2023-12-19T19:01:54.716516+0000","last_undegraded":"2023-12-19T19:01:54.716516+0000","last_fullsized":"2023-12-19T19:01:54.716516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:42.135275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"72'6","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.050399+0000","last_change":"2023-12-19T19:01:52.701962+0000","last_active":"2023-12-19T19:01:55.050399+0000","last_peered":"2023-12-19T19:01:55.050399+0000","last_clean":"2023-12-19T19:01:55.050399+0000","last_became_active":"2023-12-19T19:01:52.701677+0000","last_became_peered":"2023-12-19T19:01:52.701677+0000","last_unstale":"2023-12-19T19:01:55.050399+0000","last_undegraded":"2023-12-19T19:01:55.050399+0000","last_fullsized":"2023-12-19T19:01:55.050399+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:55:15.463085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.706715+0000","last_change":"2023-12-19T19:01:36.003506+0000","last_active":"2023-12-19T19:01:53.706715+0000","last_peered":"2023-12-19T19:01:53.706715+0000","last_clean":"2023-12-19T19:01:53.706715+0000","last_became_active":"2023-12-19T19:01:36.003096+0000","last_became_peered":"2023-12-19T19:01:36.003096+0000","last_unstale":"2023-12-19T19:01:53.706715+0000","last_undegraded":"2023-12-19T19:01:53.706715+0000","last_fullsized":"2023-12-19T19:01:53.706715+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:37.477766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.703463+0000","last_change":"2023-12-19T19:01:35.003678+0000","last_active":"2023-12-19T19:01:53.703463+0000","last_peered":"2023-12-19T19:01:53.703463+0000","last_clean":"2023-12-19T19:01:53.703463+0000","last_became_active":"2023-12-19T19:01:35.003361+0000","last_became_peered":"2023-12-19T19:01:35.003361+0000","last_unstale":"2023-12-19T19:01:53.703463+0000","last_undegraded":"2023-12-19T19:01:53.703463+0000","last_fullsized":"2023-12-19T19:01:53.703463+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:48:51.739304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.553233+0000","last_change":"2023-12-19T19:01:53.717469+0000","last_active":"2023-12-19T19:01:55.553233+0000","last_peered":"2023-12-19T19:01:55.553233+0000","last_clean":"2023-12-19T19:01:55.553233+0000","last_became_active":"2023-12-19T19:01:53.717040+0000","last_became_peered":"2023-12-19T19:01:53.717040+0000","last_unstale":"2023-12-19T19:01:55.553233+0000","last_undegraded":"2023-12-19T19:01:55.553233+0000","last_fullsized":"2023-12-19T19:01:55.553233+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:59:45.768383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.715296+0000","last_change":"2023-12-19T19:01:52.697022+0000","last_active":"2023-12-19T19:01:54.715296+0000","last_peered":"2023-12-19T19:01:54.715296+0000","last_clean":"2023-12-19T19:01:54.715296+0000","last_became_active":"2023-12-19T19:01:52.696731+0000","last_became_peered":"2023-12-19T19:01:52.696731+0000","last_unstale":"2023-12-19T19:01:54.715296+0000","last_undegraded":"2023-12-19T19:01:54.715296+0000","last_fullsized":"2023-12-19T19:01:54.715296+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:40:13.926675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.698913+0000","last_change":"2023-12-19T19:01:35.997000+0000","last_active":"2023-12-19T19:01:53.698913+0000","last_peered":"2023-12-19T19:01:53.698913+0000","last_clean":"2023-12-19T19:01:53.698913+0000","last_became_active":"2023-12-19T19:01:35.994590+0000","last_became_peered":"2023-12-19T19:01:35.994590+0000","last_unstale":"2023-12-19T19:01:53.698913+0000","last_undegraded":"2023-12-19T19:01:53.698913+0000","last_fullsized":"2023-12-19T19:01:53.698913+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:13.026799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"68'3","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.704404+0000","last_change":"2023-12-19T19:01:35.002668+0000","last_active":"2023-12-19T19:01:53.704404+0000","last_peered":"2023-12-19T19:01:53.704404+0000","last_clean":"2023-12-19T19:01:53.704404+0000","last_became_active":"2023-12-19T19:01:35.002367+0000","last_became_peered":"2023-12-19T19:01:35.002367+0000","last_unstale":"2023-12-19T19:01:53.704404+0000","last_undegraded":"2023-12-19T19:01:53.704404+0000","last_fullsized":"2023-12-19T19:01:53.704404+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:27.616001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.050722+0000","last_change":"2023-12-19T19:01:53.723559+0000","last_active":"2023-12-19T19:01:55.050722+0000","last_peered":"2023-12-19T19:01:55.050722+0000","last_clean":"2023-12-19T19:01:55.050722+0000","last_became_active":"2023-12-19T19:01:53.723307+0000","last_became_peered":"2023-12-19T19:01:53.723307+0000","last_unstale":"2023-12-19T19:01:55.050722+0000","last_undegraded":"2023-12-19T19:01:55.050722+0000","last_fullsized":"2023-12-19T19:01:55.050722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:52:54.882324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.551989+0000","last_change":"2023-12-19T19:01:52.709963+0000","last_active":"2023-12-19T19:01:55.551989+0000","last_peered":"2023-12-19T19:01:55.551989+0000","last_clean":"2023-12-19T19:01:55.551989+0000","last_became_active":"2023-12-19T19:01:52.709671+0000","last_became_peered":"2023-12-19T19:01:52.709671+0000","last_unstale":"2023-12-19T19:01:55.551989+0000","last_undegraded":"2023-12-19T19:01:55.551989+0000","last_fullsized":"2023-12-19T19:01:55.551989+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:45:09.704307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.702129+0000","last_change":"2023-12-19T19:01:35.990996+0000","last_active":"2023-12-19T19:01:53.702129+0000","last_peered":"2023-12-19T19:01:53.702129+0000","last_clean":"2023-12-19T19:01:53.702129+0000","last_became_active":"2023-12-19T19:01:35.990358+0000","last_became_peered":"2023-12-19T19:01:35.990358+0000","last_unstale":"2023-12-19T19:01:53.702129+0000","last_undegraded":"2023-12-19T19:01:53.702129+0000","last_fullsized":"2023-12-19T19:01:53.702129+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:52:33.062884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"69'8","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.706387+0000","last_change":"2023-12-19T19:01:34.997430+0000","last_active":"2023-12-19T19:01:53.706387+0000","last_peered":"2023-12-19T19:01:53.706387+0000","last_clean":"2023-12-19T19:01:53.706387+0000","last_became_active":"2023-12-19T19:01:34.997110+0000","last_became_peered":"2023-12-19T19:01:34.997110+0000","last_unstale":"2023-12-19T19:01:53.706387+0000","last_undegraded":"2023-12-19T19:01:53.706387+0000","last_fullsized":"2023-12-19T19:01:53.706387+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:06:40.560279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.049686+0000","last_change":"2023-12-19T19:01:53.723569+0000","last_active":"2023-12-19T19:01:55.049686+0000","last_peered":"2023-12-19T19:01:55.049686+0000","last_clean":"2023-12-19T19:01:55.049686+0000","last_became_active":"2023-12-19T19:01:53.723191+0000","last_became_peered":"2023-12-19T19:01:53.723191+0000","last_unstale":"2023-12-19T19:01:55.049686+0000","last_undegraded":"2023-12-19T19:01:55.049686+0000","last_fullsized":"2023-12-19T19:01:55.049686+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:39.242249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.049823+0000","last_change":"2023-12-19T19:01:52.695165+0000","last_active":"2023-12-19T19:01:55.049823+0000","last_peered":"2023-12-19T19:01:55.049823+0000","last_clean":"2023-12-19T19:01:55.049823+0000","last_became_active":"2023-12-19T19:01:52.694842+0000","last_became_peered":"2023-12-19T19:01:52.694842+0000","last_unstale":"2023-12-19T19:01:55.049823+0000","last_undegraded":"2023-12-19T19:01:55.049823+0000","last_fullsized":"2023-12-19T19:01:55.049823+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:53:12.095865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.699005+0000","last_change":"2023-12-19T19:01:35.988814+0000","last_active":"2023-12-19T19:01:53.699005+0000","last_peered":"2023-12-19T19:01:53.699005+0000","last_clean":"2023-12-19T19:01:53.699005+0000","last_became_active":"2023-12-19T19:01:35.988546+0000","last_became_peered":"2023-12-19T19:01:35.988546+0000","last_unstale":"2023-12-19T19:01:53.699005+0000","last_undegraded":"2023-12-19T19:01:53.699005+0000","last_fullsized":"2023-12-19T19:01:53.699005+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:32.200929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"68'2","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.694233+0000","last_change":"2023-12-19T19:01:34.987868+0000","last_active":"2023-12-19T19:01:53.694233+0000","last_peered":"2023-12-19T19:01:53.694233+0000","last_clean":"2023-12-19T19:01:53.694233+0000","last_became_active":"2023-12-19T19:01:34.987545+0000","last_became_peered":"2023-12-19T19:01:34.987545+0000","last_unstale":"2023-12-19T19:01:53.694233+0000","last_undegraded":"2023-12-19T19:01:53.694233+0000","last_fullsized":"2023-12-19T19:01:53.694233+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:34:38.369643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550979+0000","last_change":"2023-12-19T19:01:53.711997+0000","last_active":"2023-12-19T19:01:55.550979+0000","last_peered":"2023-12-19T19:01:55.550979+0000","last_clean":"2023-12-19T19:01:55.550979+0000","last_became_active":"2023-12-19T19:01:53.711712+0000","last_became_peered":"2023-12-19T19:01:53.711712+0000","last_unstale":"2023-12-19T19:01:55.550979+0000","last_undegraded":"2023-12-19T19:01:55.550979+0000","last_fullsized":"2023-12-19T19:01:55.550979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:02:05.920439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"72'8","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.714007+0000","last_change":"2023-12-19T19:01:52.695953+0000","last_active":"2023-12-19T19:01:54.714007+0000","last_peered":"2023-12-19T19:01:54.714007+0000","last_clean":"2023-12-19T19:01:54.714007+0000","last_became_active":"2023-12-19T19:01:52.693932+0000","last_became_peered":"2023-12-19T19:01:52.693932+0000","last_unstale":"2023-12-19T19:01:54.714007+0000","last_undegraded":"2023-12-19T19:01:54.714007+0000","last_fullsized":"2023-12-19T19:01:54.714007+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:14.437427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.696892+0000","last_change":"2023-12-19T19:01:36.000560+0000","last_active":"2023-12-19T19:01:53.696892+0000","last_peered":"2023-12-19T19:01:53.696892+0000","last_clean":"2023-12-19T19:01:53.696892+0000","last_became_active":"2023-12-19T19:01:35.999311+0000","last_became_peered":"2023-12-19T19:01:35.999311+0000","last_unstale":"2023-12-19T19:01:53.696892+0000","last_undegraded":"2023-12-19T19:01:53.696892+0000","last_fullsized":"2023-12-19T19:01:53.696892+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:13.026799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.698017+0000","last_change":"2023-12-19T19:01:34.994756+0000","last_active":"2023-12-19T19:01:53.698017+0000","last_peered":"2023-12-19T19:01:53.698017+0000","last_clean":"2023-12-19T19:01:53.698017+0000","last_became_active":"2023-12-19T19:01:34.994476+0000","last_became_peered":"2023-12-19T19:01:34.994476+0000","last_unstale":"2023-12-19T19:01:53.698017+0000","last_undegraded":"2023-12-19T19:01:53.698017+0000","last_fullsized":"2023-12-19T19:01:53.698017+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:31.193511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550304+0000","last_change":"2023-12-19T19:01:53.710649+0000","last_active":"2023-12-19T19:01:55.550304+0000","last_peered":"2023-12-19T19:01:55.550304+0000","last_clean":"2023-12-19T19:01:55.550304+0000","last_became_active":"2023-12-19T19:01:53.710322+0000","last_became_peered":"2023-12-19T19:01:53.710322+0000","last_unstale":"2023-12-19T19:01:55.550304+0000","last_undegraded":"2023-12-19T19:01:55.550304+0000","last_fullsized":"2023-12-19T19:01:55.550304+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:09:13.226066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"72'2","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552007+0000","last_change":"2023-12-19T19:01:52.702186+0000","last_active":"2023-12-19T19:01:55.552007+0000","last_peered":"2023-12-19T19:01:55.552007+0000","last_clean":"2023-12-19T19:01:55.552007+0000","last_became_active":"2023-12-19T19:01:52.701931+0000","last_became_peered":"2023-12-19T19:01:52.701931+0000","last_unstale":"2023-12-19T19:01:55.552007+0000","last_undegraded":"2023-12-19T19:01:55.552007+0000","last_fullsized":"2023-12-19T19:01:55.552007+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:38:33.477718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.693418+0000","last_change":"2023-12-19T19:01:35.999708+0000","last_active":"2023-12-19T19:01:53.693418+0000","last_peered":"2023-12-19T19:01:53.693418+0000","last_clean":"2023-12-19T19:01:53.693418+0000","last_became_active":"2023-12-19T19:01:35.999385+0000","last_became_peered":"2023-12-19T19:01:35.999385+0000","last_unstale":"2023-12-19T19:01:53.693418+0000","last_undegraded":"2023-12-19T19:01:53.693418+0000","last_fullsized":"2023-12-19T19:01:53.693418+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:04:12.129299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.705648+0000","last_change":"2023-12-19T19:01:35.002999+0000","last_active":"2023-12-19T19:01:53.705648+0000","last_peered":"2023-12-19T19:01:53.705648+0000","last_clean":"2023-12-19T19:01:53.705648+0000","last_became_active":"2023-12-19T19:01:35.002667+0000","last_became_peered":"2023-12-19T19:01:35.002667+0000","last_unstale":"2023-12-19T19:01:53.705648+0000","last_undegraded":"2023-12-19T19:01:53.705648+0000","last_fullsized":"2023-12-19T19:01:53.705648+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:13:22.016658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.714381+0000","last_change":"2023-12-19T19:01:53.710500+0000","last_active":"2023-12-19T19:01:54.714381+0000","last_peered":"2023-12-19T19:01:54.714381+0000","last_clean":"2023-12-19T19:01:54.714381+0000","last_became_active":"2023-12-19T19:01:53.710194+0000","last_became_peered":"2023-12-19T19:01:53.710194+0000","last_unstale":"2023-12-19T19:01:54.714381+0000","last_undegraded":"2023-12-19T19:01:54.714381+0000","last_fullsized":"2023-12-19T19:01:54.714381+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:41:17.661261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550758+0000","last_change":"2023-12-19T19:01:52.705798+0000","last_active":"2023-12-19T19:01:55.550758+0000","last_peered":"2023-12-19T19:01:55.550758+0000","last_clean":"2023-12-19T19:01:55.550758+0000","last_became_active":"2023-12-19T19:01:52.704982+0000","last_became_peered":"2023-12-19T19:01:52.704982+0000","last_unstale":"2023-12-19T19:01:55.550758+0000","last_undegraded":"2023-12-19T19:01:55.550758+0000","last_fullsized":"2023-12-19T19:01:55.550758+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:04:28.831535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.692953+0000","last_change":"2023-12-19T19:01:35.998862+0000","last_active":"2023-12-19T19:01:53.692953+0000","last_peered":"2023-12-19T19:01:53.692953+0000","last_clean":"2023-12-19T19:01:53.692953+0000","last_became_active":"2023-12-19T19:01:35.998539+0000","last_became_peered":"2023-12-19T19:01:35.998539+0000","last_unstale":"2023-12-19T19:01:53.692953+0000","last_undegraded":"2023-12-19T19:01:53.692953+0000","last_fullsized":"2023-12-19T19:01:53.692953+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:37.690613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"68'8","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.705121+0000","last_change":"2023-12-19T19:01:34.993756+0000","last_active":"2023-12-19T19:01:53.705121+0000","last_peered":"2023-12-19T19:01:53.705121+0000","last_clean":"2023-12-19T19:01:53.705121+0000","last_became_active":"2023-12-19T19:01:34.993466+0000","last_became_peered":"2023-12-19T19:01:34.993466+0000","last_unstale":"2023-12-19T19:01:53.705121+0000","last_undegraded":"2023-12-19T19:01:53.705121+0000","last_fullsized":"2023-12-19T19:01:53.705121+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:38.326858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550695+0000","last_change":"2023-12-19T19:01:53.730076+0000","last_active":"2023-12-19T19:01:55.550695+0000","last_peered":"2023-12-19T19:01:55.550695+0000","last_clean":"2023-12-19T19:01:55.550695+0000","last_became_active":"2023-12-19T19:01:53.729103+0000","last_became_peered":"2023-12-19T19:01:53.729103+0000","last_unstale":"2023-12-19T19:01:55.550695+0000","last_undegraded":"2023-12-19T19:01:55.550695+0000","last_fullsized":"2023-12-19T19:01:55.550695+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:23:16.235010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"72'1","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.717666+0000","last_change":"2023-12-19T19:01:52.697866+0000","last_active":"2023-12-19T19:01:54.717666+0000","last_peered":"2023-12-19T19:01:54.717666+0000","last_clean":"2023-12-19T19:01:54.717666+0000","last_became_active":"2023-12-19T19:01:52.697292+0000","last_became_peered":"2023-12-19T19:01:52.697292+0000","last_unstale":"2023-12-19T19:01:54.717666+0000","last_undegraded":"2023-12-19T19:01:54.717666+0000","last_fullsized":"2023-12-19T19:01:54.717666+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:55:15.463085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.696857+0000","last_change":"2023-12-19T19:01:35.996677+0000","last_active":"2023-12-19T19:01:53.696857+0000","last_peered":"2023-12-19T19:01:53.696857+0000","last_clean":"2023-12-19T19:01:53.696857+0000","last_became_active":"2023-12-19T19:01:35.996429+0000","last_became_peered":"2023-12-19T19:01:35.996429+0000","last_unstale":"2023-12-19T19:01:53.696857+0000","last_undegraded":"2023-12-19T19:01:53.696857+0000","last_fullsized":"2023-12-19T19:01:53.696857+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:10:55.145501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"68'1","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.714330+0000","last_change":"2023-12-19T19:01:35.001602+0000","last_active":"2023-12-19T19:01:53.714330+0000","last_peered":"2023-12-19T19:01:53.714330+0000","last_clean":"2023-12-19T19:01:53.714330+0000","last_became_active":"2023-12-19T19:01:35.000999+0000","last_became_peered":"2023-12-19T19:01:35.000999+0000","last_unstale":"2023-12-19T19:01:53.714330+0000","last_undegraded":"2023-12-19T19:01:53.714330+0000","last_fullsized":"2023-12-19T19:01:53.714330+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:46:31.394472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.716648+0000","last_change":"2023-12-19T19:01:53.711589+0000","last_active":"2023-12-19T19:01:54.716648+0000","last_peered":"2023-12-19T19:01:54.716648+0000","last_clean":"2023-12-19T19:01:54.716648+0000","last_became_active":"2023-12-19T19:01:53.711269+0000","last_became_peered":"2023-12-19T19:01:53.711269+0000","last_unstale":"2023-12-19T19:01:54.716648+0000","last_undegraded":"2023-12-19T19:01:54.716648+0000","last_fullsized":"2023-12-19T19:01:54.716648+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:13:39.216177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552725+0000","last_change":"2023-12-19T19:01:52.705722+0000","last_active":"2023-12-19T19:01:55.552725+0000","last_peered":"2023-12-19T19:01:55.552725+0000","last_clean":"2023-12-19T19:01:55.552725+0000","last_became_active":"2023-12-19T19:01:52.705471+0000","last_became_peered":"2023-12-19T19:01:52.705471+0000","last_unstale":"2023-12-19T19:01:55.552725+0000","last_undegraded":"2023-12-19T19:01:55.552725+0000","last_fullsized":"2023-12-19T19:01:55.552725+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:54:11.603583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.710434+0000","last_change":"2023-12-19T19:01:36.000346+0000","last_active":"2023-12-19T19:01:53.710434+0000","last_peered":"2023-12-19T19:01:53.710434+0000","last_clean":"2023-12-19T19:01:53.710434+0000","last_became_active":"2023-12-19T19:01:35.999742+0000","last_became_peered":"2023-12-19T19:01:35.999742+0000","last_unstale":"2023-12-19T19:01:53.710434+0000","last_undegraded":"2023-12-19T19:01:53.710434+0000","last_fullsized":"2023-12-19T19:01:53.710434+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:06:09.368068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"68'2","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.700917+0000","last_change":"2023-12-19T19:01:34.999856+0000","last_active":"2023-12-19T19:01:53.700917+0000","last_peered":"2023-12-19T19:01:53.700917+0000","last_clean":"2023-12-19T19:01:53.700917+0000","last_became_active":"2023-12-19T19:01:34.999581+0000","last_became_peered":"2023-12-19T19:01:34.999581+0000","last_unstale":"2023-12-19T19:01:53.700917+0000","last_undegraded":"2023-12-19T19:01:53.700917+0000","last_fullsized":"2023-12-19T19:01:53.700917+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:52:32.055466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.718206+0000","last_change":"2023-12-19T19:01:53.738697+0000","last_active":"2023-12-19T19:01:54.718206+0000","last_peered":"2023-12-19T19:01:54.718206+0000","last_clean":"2023-12-19T19:01:54.718206+0000","last_became_active":"2023-12-19T19:01:53.738368+0000","last_became_peered":"2023-12-19T19:01:53.738368+0000","last_unstale":"2023-12-19T19:01:54.718206+0000","last_undegraded":"2023-12-19T19:01:54.718206+0000","last_fullsized":"2023-12-19T19:01:54.718206+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:42.135275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"72'2","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.050406+0000","last_change":"2023-12-19T19:01:52.703126+0000","last_active":"2023-12-19T19:01:55.050406+0000","last_peered":"2023-12-19T19:01:55.050406+0000","last_clean":"2023-12-19T19:01:55.050406+0000","last_became_active":"2023-12-19T19:01:52.702896+0000","last_became_peered":"2023-12-19T19:01:52.702896+0000","last_unstale":"2023-12-19T19:01:55.050406+0000","last_undegraded":"2023-12-19T19:01:55.050406+0000","last_fullsized":"2023-12-19T19:01:55.050406+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:52:17.942323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.703095+0000","last_change":"2023-12-19T19:01:36.000859+0000","last_active":"2023-12-19T19:01:53.703095+0000","last_peered":"2023-12-19T19:01:53.703095+0000","last_clean":"2023-12-19T19:01:53.703095+0000","last_became_active":"2023-12-19T19:01:36.000532+0000","last_became_peered":"2023-12-19T19:01:36.000532+0000","last_unstale":"2023-12-19T19:01:53.703095+0000","last_undegraded":"2023-12-19T19:01:53.703095+0000","last_fullsized":"2023-12-19T19:01:53.703095+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:20:14.686881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.699104+0000","last_change":"2023-12-19T19:01:34.992936+0000","last_active":"2023-12-19T19:01:53.699104+0000","last_peered":"2023-12-19T19:01:53.699104+0000","last_clean":"2023-12-19T19:01:53.699104+0000","last_became_active":"2023-12-19T19:01:34.992664+0000","last_became_peered":"2023-12-19T19:01:34.992664+0000","last_unstale":"2023-12-19T19:01:53.699104+0000","last_undegraded":"2023-12-19T19:01:53.699104+0000","last_fullsized":"2023-12-19T19:01:53.699104+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:35.546701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550468+0000","last_change":"2023-12-19T19:01:53.723619+0000","last_active":"2023-12-19T19:01:55.550468+0000","last_peered":"2023-12-19T19:01:55.550468+0000","last_clean":"2023-12-19T19:01:55.550468+0000","last_became_active":"2023-12-19T19:01:53.722344+0000","last_became_peered":"2023-12-19T19:01:53.722344+0000","last_unstale":"2023-12-19T19:01:55.550468+0000","last_undegraded":"2023-12-19T19:01:55.550468+0000","last_fullsized":"2023-12-19T19:01:55.550468+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:31:47.863198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550389+0000","last_change":"2023-12-19T19:01:52.704582+0000","last_active":"2023-12-19T19:01:55.550389+0000","last_peered":"2023-12-19T19:01:55.550389+0000","last_clean":"2023-12-19T19:01:55.550389+0000","last_became_active":"2023-12-19T19:01:52.704293+0000","last_became_peered":"2023-12-19T19:01:52.704293+0000","last_unstale":"2023-12-19T19:01:55.550389+0000","last_undegraded":"2023-12-19T19:01:55.550389+0000","last_fullsized":"2023-12-19T19:01:55.550389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:11:32.538301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.705956+0000","last_change":"2023-12-19T19:01:36.000821+0000","last_active":"2023-12-19T19:01:53.705956+0000","last_peered":"2023-12-19T19:01:53.705956+0000","last_clean":"2023-12-19T19:01:53.705956+0000","last_became_active":"2023-12-19T19:01:36.000457+0000","last_became_peered":"2023-12-19T19:01:36.000457+0000","last_unstale":"2023-12-19T19:01:53.705956+0000","last_undegraded":"2023-12-19T19:01:53.705956+0000","last_fullsized":"2023-12-19T19:01:53.705956+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:30:27.426356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"68'2","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.698120+0000","last_change":"2023-12-19T19:01:35.000039+0000","last_active":"2023-12-19T19:01:53.698120+0000","last_peered":"2023-12-19T19:01:53.698120+0000","last_clean":"2023-12-19T19:01:53.698120+0000","last_became_active":"2023-12-19T19:01:34.999745+0000","last_became_peered":"2023-12-19T19:01:34.999745+0000","last_unstale":"2023-12-19T19:01:53.698120+0000","last_undegraded":"2023-12-19T19:01:53.698120+0000","last_fullsized":"2023-12-19T19:01:53.698120+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:11:14.828647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.716969+0000","last_change":"2023-12-19T19:01:53.729392+0000","last_active":"2023-12-19T19:01:54.716969+0000","last_peered":"2023-12-19T19:01:54.716969+0000","last_clean":"2023-12-19T19:01:54.716969+0000","last_became_active":"2023-12-19T19:01:53.727574+0000","last_became_peered":"2023-12-19T19:01:53.727574+0000","last_unstale":"2023-12-19T19:01:54.716969+0000","last_undegraded":"2023-12-19T19:01:54.716969+0000","last_fullsized":"2023-12-19T19:01:54.716969+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:09:13.226066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550160+0000","last_change":"2023-12-19T19:01:52.707477+0000","last_active":"2023-12-19T19:01:55.550160+0000","last_peered":"2023-12-19T19:01:55.550160+0000","last_clean":"2023-12-19T19:01:55.550160+0000","last_became_active":"2023-12-19T19:01:52.706881+0000","last_became_peered":"2023-12-19T19:01:52.706881+0000","last_unstale":"2023-12-19T19:01:55.550160+0000","last_undegraded":"2023-12-19T19:01:55.550160+0000","last_fullsized":"2023-12-19T19:01:55.550160+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:10.883157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.705132+0000","last_change":"2023-12-19T19:01:36.003671+0000","last_active":"2023-12-19T19:01:53.705132+0000","last_peered":"2023-12-19T19:01:53.705132+0000","last_clean":"2023-12-19T19:01:53.705132+0000","last_became_active":"2023-12-19T19:01:36.003394+0000","last_became_peered":"2023-12-19T19:01:36.003394+0000","last_unstale":"2023-12-19T19:01:53.705132+0000","last_undegraded":"2023-12-19T19:01:53.705132+0000","last_fullsized":"2023-12-19T19:01:53.705132+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:28.623419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.706053+0000","last_change":"2023-12-19T19:01:34.996284+0000","last_active":"2023-12-19T19:01:53.706053+0000","last_peered":"2023-12-19T19:01:53.706053+0000","last_clean":"2023-12-19T19:01:53.706053+0000","last_became_active":"2023-12-19T19:01:34.996012+0000","last_became_peered":"2023-12-19T19:01:34.996012+0000","last_unstale":"2023-12-19T19:01:53.706053+0000","last_undegraded":"2023-12-19T19:01:53.706053+0000","last_fullsized":"2023-12-19T19:01:53.706053+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:11:45.676991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550501+0000","last_change":"2023-12-19T19:01:53.722221+0000","last_active":"2023-12-19T19:01:55.550501+0000","last_peered":"2023-12-19T19:01:55.550501+0000","last_clean":"2023-12-19T19:01:55.550501+0000","last_became_active":"2023-12-19T19:01:53.721731+0000","last_became_peered":"2023-12-19T19:01:53.721731+0000","last_unstale":"2023-12-19T19:01:55.550501+0000","last_undegraded":"2023-12-19T19:01:55.550501+0000","last_fullsized":"2023-12-19T19:01:55.550501+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:13:22.111236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"72'2","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552998+0000","last_change":"2023-12-19T19:01:52.708721+0000","last_active":"2023-12-19T19:01:55.552998+0000","last_peered":"2023-12-19T19:01:55.552998+0000","last_clean":"2023-12-19T19:01:55.552998+0000","last_became_active":"2023-12-19T19:01:52.707616+0000","last_became_peered":"2023-12-19T19:01:52.707616+0000","last_unstale":"2023-12-19T19:01:55.552998+0000","last_undegraded":"2023-12-19T19:01:55.552998+0000","last_fullsized":"2023-12-19T19:01:55.552998+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:07:06.565347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.705101+0000","last_change":"2023-12-19T19:01:35.999651+0000","last_active":"2023-12-19T19:01:53.705101+0000","last_peered":"2023-12-19T19:01:53.705101+0000","last_clean":"2023-12-19T19:01:53.705101+0000","last_became_active":"2023-12-19T19:01:35.999414+0000","last_became_peered":"2023-12-19T19:01:35.999414+0000","last_unstale":"2023-12-19T19:01:53.705101+0000","last_undegraded":"2023-12-19T19:01:53.705101+0000","last_fullsized":"2023-12-19T19:01:53.705101+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:10:39.431508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.701591+0000","last_change":"2023-12-19T19:01:35.002482+0000","last_active":"2023-12-19T19:01:53.701591+0000","last_peered":"2023-12-19T19:01:53.701591+0000","last_clean":"2023-12-19T19:01:53.701591+0000","last_became_active":"2023-12-19T19:01:35.002110+0000","last_became_peered":"2023-12-19T19:01:35.002110+0000","last_unstale":"2023-12-19T19:01:53.701591+0000","last_undegraded":"2023-12-19T19:01:53.701591+0000","last_fullsized":"2023-12-19T19:01:53.701591+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:53:39.946763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552395+0000","last_change":"2023-12-19T19:01:53.717481+0000","last_active":"2023-12-19T19:01:55.552395+0000","last_peered":"2023-12-19T19:01:55.552395+0000","last_clean":"2023-12-19T19:01:55.552395+0000","last_became_active":"2023-12-19T19:01:53.717207+0000","last_became_peered":"2023-12-19T19:01:53.717207+0000","last_unstale":"2023-12-19T19:01:55.552395+0000","last_undegraded":"2023-12-19T19:01:55.552395+0000","last_fullsized":"2023-12-19T19:01:55.552395+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:32:34.182199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550518+0000","last_change":"2023-12-19T19:01:52.705211+0000","last_active":"2023-12-19T19:01:55.550518+0000","last_peered":"2023-12-19T19:01:55.550518+0000","last_clean":"2023-12-19T19:01:55.550518+0000","last_became_active":"2023-12-19T19:01:52.704929+0000","last_became_peered":"2023-12-19T19:01:52.704929+0000","last_unstale":"2023-12-19T19:01:55.550518+0000","last_undegraded":"2023-12-19T19:01:55.550518+0000","last_fullsized":"2023-12-19T19:01:55.550518+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:23:01.978988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.705452+0000","last_change":"2023-12-19T19:01:35.997317+0000","last_active":"2023-12-19T19:01:53.705452+0000","last_peered":"2023-12-19T19:01:53.705452+0000","last_clean":"2023-12-19T19:01:53.705452+0000","last_became_active":"2023-12-19T19:01:35.996988+0000","last_became_peered":"2023-12-19T19:01:35.996988+0000","last_unstale":"2023-12-19T19:01:53.705452+0000","last_undegraded":"2023-12-19T19:01:53.705452+0000","last_fullsized":"2023-12-19T19:01:53.705452+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:16:21.875547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.699605+0000","last_change":"2023-12-19T19:01:34.997069+0000","last_active":"2023-12-19T19:01:53.699605+0000","last_peered":"2023-12-19T19:01:53.699605+0000","last_clean":"2023-12-19T19:01:53.699605+0000","last_became_active":"2023-12-19T19:01:34.996756+0000","last_became_peered":"2023-12-19T19:01:34.996756+0000","last_unstale":"2023-12-19T19:01:53.699605+0000","last_undegraded":"2023-12-19T19:01:53.699605+0000","last_fullsized":"2023-12-19T19:01:53.699605+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:58.945454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.714649+0000","last_change":"2023-12-19T19:01:53.731027+0000","last_active":"2023-12-19T19:01:54.714649+0000","last_peered":"2023-12-19T19:01:54.714649+0000","last_clean":"2023-12-19T19:01:54.714649+0000","last_became_active":"2023-12-19T19:01:53.730662+0000","last_became_peered":"2023-12-19T19:01:53.730662+0000","last_unstale":"2023-12-19T19:01:54.714649+0000","last_undegraded":"2023-12-19T19:01:54.714649+0000","last_fullsized":"2023-12-19T19:01:54.714649+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:11:33.544454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552892+0000","last_change":"2023-12-19T19:01:52.704658+0000","last_active":"2023-12-19T19:01:55.552892+0000","last_peered":"2023-12-19T19:01:55.552892+0000","last_clean":"2023-12-19T19:01:55.552892+0000","last_became_active":"2023-12-19T19:01:52.704411+0000","last_became_peered":"2023-12-19T19:01:52.704411+0000","last_unstale":"2023-12-19T19:01:55.552892+0000","last_undegraded":"2023-12-19T19:01:55.552892+0000","last_fullsized":"2023-12-19T19:01:55.552892+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:52:53.876171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.702516+0000","last_change":"2023-12-19T19:01:35.995384+0000","last_active":"2023-12-19T19:01:53.702516+0000","last_peered":"2023-12-19T19:01:53.702516+0000","last_clean":"2023-12-19T19:01:53.702516+0000","last_became_active":"2023-12-19T19:01:35.995055+0000","last_became_peered":"2023-12-19T19:01:35.995055+0000","last_unstale":"2023-12-19T19:01:53.702516+0000","last_undegraded":"2023-12-19T19:01:53.702516+0000","last_fullsized":"2023-12-19T19:01:53.702516+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:36.554120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"68'2","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.695931+0000","last_change":"2023-12-19T19:01:34.989700+0000","last_active":"2023-12-19T19:01:53.695931+0000","last_peered":"2023-12-19T19:01:53.695931+0000","last_clean":"2023-12-19T19:01:53.695931+0000","last_became_active":"2023-12-19T19:01:34.989417+0000","last_became_peered":"2023-12-19T19:01:34.989417+0000","last_unstale":"2023-12-19T19:01:53.695931+0000","last_undegraded":"2023-12-19T19:01:53.695931+0000","last_fullsized":"2023-12-19T19:01:53.695931+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:29.601572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.717677+0000","last_change":"2023-12-19T19:01:53.719523+0000","last_active":"2023-12-19T19:01:54.717677+0000","last_peered":"2023-12-19T19:01:54.717677+0000","last_clean":"2023-12-19T19:01:54.717677+0000","last_became_active":"2023-12-19T19:01:53.719232+0000","last_became_peered":"2023-12-19T19:01:53.719232+0000","last_unstale":"2023-12-19T19:01:54.717677+0000","last_undegraded":"2023-12-19T19:01:54.717677+0000","last_fullsized":"2023-12-19T19:01:54.717677+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:27:52.950786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.717754+0000","last_change":"2023-12-19T19:01:52.697329+0000","last_active":"2023-12-19T19:01:54.717754+0000","last_peered":"2023-12-19T19:01:54.717754+0000","last_clean":"2023-12-19T19:01:54.717754+0000","last_became_active":"2023-12-19T19:01:52.697001+0000","last_became_peered":"2023-12-19T19:01:52.697001+0000","last_unstale":"2023-12-19T19:01:54.717754+0000","last_undegraded":"2023-12-19T19:01:54.717754+0000","last_fullsized":"2023-12-19T19:01:54.717754+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:45:09.704307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.696637+0000","last_change":"2023-12-19T19:01:35.997927+0000","last_active":"2023-12-19T19:01:53.696637+0000","last_peered":"2023-12-19T19:01:53.696637+0000","last_clean":"2023-12-19T19:01:53.696637+0000","last_became_active":"2023-12-19T19:01:35.997596+0000","last_became_peered":"2023-12-19T19:01:35.997596+0000","last_unstale":"2023-12-19T19:01:53.696637+0000","last_undegraded":"2023-12-19T19:01:53.696637+0000","last_fullsized":"2023-12-19T19:01:53.696637+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:37:40.853246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"69'1","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.696035+0000","last_change":"2023-12-19T19:01:34.986750+0000","last_active":"2023-12-19T19:01:53.696035+0000","last_peered":"2023-12-19T19:01:53.696035+0000","last_clean":"2023-12-19T19:01:53.696035+0000","last_became_active":"2023-12-19T19:01:34.986455+0000","last_became_peered":"2023-12-19T19:01:34.986455+0000","last_unstale":"2023-12-19T19:01:53.696035+0000","last_undegraded":"2023-12-19T19:01:53.696035+0000","last_fullsized":"2023-12-19T19:01:53.696035+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:32.294680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.553286+0000","last_change":"2023-12-19T19:01:53.723388+0000","last_active":"2023-12-19T19:01:55.553286+0000","last_peered":"2023-12-19T19:01:55.553286+0000","last_clean":"2023-12-19T19:01:55.553286+0000","last_became_active":"2023-12-19T19:01:53.722884+0000","last_became_peered":"2023-12-19T19:01:53.722884+0000","last_unstale":"2023-12-19T19:01:55.553286+0000","last_undegraded":"2023-12-19T19:01:55.553286+0000","last_fullsized":"2023-12-19T19:01:55.553286+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:15:40.361088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"72'2","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550950+0000","last_change":"2023-12-19T19:01:52.699070+0000","last_active":"2023-12-19T19:01:55.550950+0000","last_peered":"2023-12-19T19:01:55.550950+0000","last_clean":"2023-12-19T19:01:55.550950+0000","last_became_active":"2023-12-19T19:01:52.698607+0000","last_became_peered":"2023-12-19T19:01:52.698607+0000","last_unstale":"2023-12-19T19:01:55.550950+0000","last_undegraded":"2023-12-19T19:01:55.550950+0000","last_fullsized":"2023-12-19T19:01:55.550950+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:11:11.847737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.709799+0000","last_change":"2023-12-19T19:01:35.993025+0000","last_active":"2023-12-19T19:01:53.709799+0000","last_peered":"2023-12-19T19:01:53.709799+0000","last_clean":"2023-12-19T19:01:53.709799+0000","last_became_active":"2023-12-19T19:01:35.991791+0000","last_became_peered":"2023-12-19T19:01:35.991791+0000","last_unstale":"2023-12-19T19:01:53.709799+0000","last_undegraded":"2023-12-19T19:01:53.709799+0000","last_fullsized":"2023-12-19T19:01:53.709799+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:39:57.224439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.704554+0000","last_change":"2023-12-19T19:01:35.001204+0000","last_active":"2023-12-19T19:01:53.704554+0000","last_peered":"2023-12-19T19:01:53.704554+0000","last_clean":"2023-12-19T19:01:53.704554+0000","last_became_active":"2023-12-19T19:01:35.000589+0000","last_became_peered":"2023-12-19T19:01:35.000589+0000","last_unstale":"2023-12-19T19:01:53.704554+0000","last_undegraded":"2023-12-19T19:01:53.704554+0000","last_fullsized":"2023-12-19T19:01:53.704554+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:52:56.727773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.715267+0000","last_change":"2023-12-19T19:01:53.714557+0000","last_active":"2023-12-19T19:01:54.715267+0000","last_peered":"2023-12-19T19:01:54.715267+0000","last_clean":"2023-12-19T19:01:54.715267+0000","last_became_active":"2023-12-19T19:01:53.714233+0000","last_became_peered":"2023-12-19T19:01:53.714233+0000","last_unstale":"2023-12-19T19:01:54.715267+0000","last_undegraded":"2023-12-19T19:01:54.715267+0000","last_fullsized":"2023-12-19T19:01:54.715267+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:23:02.985141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.553392+0000","last_change":"2023-12-19T19:01:52.709314+0000","last_active":"2023-12-19T19:01:55.553392+0000","last_peered":"2023-12-19T19:01:55.553392+0000","last_clean":"2023-12-19T19:01:55.553392+0000","last_became_active":"2023-12-19T19:01:52.708982+0000","last_became_peered":"2023-12-19T19:01:52.708982+0000","last_unstale":"2023-12-19T19:01:55.553392+0000","last_undegraded":"2023-12-19T19:01:55.553392+0000","last_fullsized":"2023-12-19T19:01:55.553392+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:09:12.219913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.703187+0000","last_change":"2023-12-19T19:01:35.986829+0000","last_active":"2023-12-19T19:01:53.703187+0000","last_peered":"2023-12-19T19:01:53.703187+0000","last_clean":"2023-12-19T19:01:53.703187+0000","last_became_active":"2023-12-19T19:01:35.986542+0000","last_became_peered":"2023-12-19T19:01:35.986542+0000","last_unstale":"2023-12-19T19:01:53.703187+0000","last_undegraded":"2023-12-19T19:01:53.703187+0000","last_fullsized":"2023-12-19T19:01:53.703187+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:39:57.224439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.709881+0000","last_change":"2023-12-19T19:01:34.999664+0000","last_active":"2023-12-19T19:01:53.709881+0000","last_peered":"2023-12-19T19:01:53.709881+0000","last_clean":"2023-12-19T19:01:53.709881+0000","last_became_active":"2023-12-19T19:01:34.998997+0000","last_became_peered":"2023-12-19T19:01:34.998997+0000","last_unstale":"2023-12-19T19:01:53.709881+0000","last_undegraded":"2023-12-19T19:01:53.709881+0000","last_fullsized":"2023-12-19T19:01:53.709881+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:08:57.128528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550608+0000","last_change":"2023-12-19T19:01:53.721181+0000","last_active":"2023-12-19T19:01:55.550608+0000","last_peered":"2023-12-19T19:01:55.550608+0000","last_clean":"2023-12-19T19:01:55.550608+0000","last_became_active":"2023-12-19T19:01:53.720753+0000","last_became_peered":"2023-12-19T19:01:53.720753+0000","last_unstale":"2023-12-19T19:01:55.550608+0000","last_undegraded":"2023-12-19T19:01:55.550608+0000","last_fullsized":"2023-12-19T19:01:55.550608+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:50.098231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550767+0000","last_change":"2023-12-19T19:01:52.707438+0000","last_active":"2023-12-19T19:01:55.550767+0000","last_peered":"2023-12-19T19:01:55.550767+0000","last_clean":"2023-12-19T19:01:55.550767+0000","last_became_active":"2023-12-19T19:01:52.706766+0000","last_became_peered":"2023-12-19T19:01:52.706766+0000","last_unstale":"2023-12-19T19:01:55.550767+0000","last_undegraded":"2023-12-19T19:01:55.550767+0000","last_fullsized":"2023-12-19T19:01:55.550767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:55:15.463085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.707567+0000","last_change":"2023-12-19T19:01:36.003446+0000","last_active":"2023-12-19T19:01:53.707567+0000","last_peered":"2023-12-19T19:01:53.707567+0000","last_clean":"2023-12-19T19:01:53.707567+0000","last_became_active":"2023-12-19T19:01:36.003111+0000","last_became_peered":"2023-12-19T19:01:36.003111+0000","last_unstale":"2023-12-19T19:01:53.707567+0000","last_undegraded":"2023-12-19T19:01:53.707567+0000","last_fullsized":"2023-12-19T19:01:53.707567+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:37:45.790125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.700150+0000","last_change":"2023-12-19T19:01:34.990870+0000","last_active":"2023-12-19T19:01:53.700150+0000","last_peered":"2023-12-19T19:01:53.700150+0000","last_clean":"2023-12-19T19:01:53.700150+0000","last_became_active":"2023-12-19T19:01:34.990513+0000","last_became_peered":"2023-12-19T19:01:34.990513+0000","last_unstale":"2023-12-19T19:01:53.700150+0000","last_undegraded":"2023-12-19T19:01:53.700150+0000","last_fullsized":"2023-12-19T19:01:53.700150+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:20:13.679462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.717097+0000","last_change":"2023-12-19T19:01:53.729273+0000","last_active":"2023-12-19T19:01:54.717097+0000","last_peered":"2023-12-19T19:01:54.717097+0000","last_clean":"2023-12-19T19:01:54.717097+0000","last_became_active":"2023-12-19T19:01:53.728974+0000","last_became_peered":"2023-12-19T19:01:53.728974+0000","last_unstale":"2023-12-19T19:01:54.717097+0000","last_undegraded":"2023-12-19T19:01:54.717097+0000","last_fullsized":"2023-12-19T19:01:54.717097+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:52:54.882324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550705+0000","last_change":"2023-12-19T19:01:52.711068+0000","last_active":"2023-12-19T19:01:55.550705+0000","last_peered":"2023-12-19T19:01:55.550705+0000","last_clean":"2023-12-19T19:01:55.550705+0000","last_became_active":"2023-12-19T19:01:52.710776+0000","last_became_peered":"2023-12-19T19:01:52.710776+0000","last_unstale":"2023-12-19T19:01:55.550705+0000","last_undegraded":"2023-12-19T19:01:55.550705+0000","last_fullsized":"2023-12-19T19:01:55.550705+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:54.392850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.699801+0000","last_change":"2023-12-19T19:01:35.998133+0000","last_active":"2023-12-19T19:01:53.699801+0000","last_peered":"2023-12-19T19:01:53.699801+0000","last_clean":"2023-12-19T19:01:53.699801+0000","last_became_active":"2023-12-19T19:01:35.997577+0000","last_became_peered":"2023-12-19T19:01:35.997577+0000","last_unstale":"2023-12-19T19:01:53.699801+0000","last_undegraded":"2023-12-19T19:01:53.699801+0000","last_fullsized":"2023-12-19T19:01:53.699801+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:06:09.368068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.702428+0000","last_change":"2023-12-19T19:01:34.994259+0000","last_active":"2023-12-19T19:01:53.702428+0000","last_peered":"2023-12-19T19:01:53.702428+0000","last_clean":"2023-12-19T19:01:53.702428+0000","last_became_active":"2023-12-19T19:01:34.992784+0000","last_became_peered":"2023-12-19T19:01:34.992784+0000","last_unstale":"2023-12-19T19:01:53.702428+0000","last_undegraded":"2023-12-19T19:01:53.702428+0000","last_fullsized":"2023-12-19T19:01:53.702428+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:06:56.928069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550655+0000","last_change":"2023-12-19T19:01:53.722457+0000","last_active":"2023-12-19T19:01:55.550655+0000","last_peered":"2023-12-19T19:01:55.550655+0000","last_clean":"2023-12-19T19:01:55.550655+0000","last_became_active":"2023-12-19T19:01:53.722103+0000","last_became_peered":"2023-12-19T19:01:53.722103+0000","last_unstale":"2023-12-19T19:01:55.550655+0000","last_undegraded":"2023-12-19T19:01:55.550655+0000","last_fullsized":"2023-12-19T19:01:55.550655+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:23:43.559557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552542+0000","last_change":"2023-12-19T19:01:52.704321+0000","last_active":"2023-12-19T19:01:55.552542+0000","last_peered":"2023-12-19T19:01:55.552542+0000","last_clean":"2023-12-19T19:01:55.552542+0000","last_became_active":"2023-12-19T19:01:52.704039+0000","last_became_peered":"2023-12-19T19:01:52.704039+0000","last_unstale":"2023-12-19T19:01:55.552542+0000","last_undegraded":"2023-12-19T19:01:55.552542+0000","last_fullsized":"2023-12-19T19:01:55.552542+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:04.973387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.697300+0000","last_change":"2023-12-19T19:01:36.014563+0000","last_active":"2023-12-19T19:01:53.697300+0000","last_peered":"2023-12-19T19:01:53.697300+0000","last_clean":"2023-12-19T19:01:53.697300+0000","last_became_active":"2023-12-19T19:01:36.014224+0000","last_became_peered":"2023-12-19T19:01:36.014224+0000","last_unstale":"2023-12-19T19:01:53.697300+0000","last_undegraded":"2023-12-19T19:01:53.697300+0000","last_fullsized":"2023-12-19T19:01:53.697300+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:20:14.686881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.717973+0000","last_change":"2023-12-19T19:01:35.001846+0000","last_active":"2023-12-19T19:01:53.717973+0000","last_peered":"2023-12-19T19:01:53.717973+0000","last_clean":"2023-12-19T19:01:53.717973+0000","last_became_active":"2023-12-19T19:01:35.000362+0000","last_became_peered":"2023-12-19T19:01:35.000362+0000","last_unstale":"2023-12-19T19:01:53.717973+0000","last_undegraded":"2023-12-19T19:01:53.717973+0000","last_fullsized":"2023-12-19T19:01:53.717973+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:37:44.782707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.049974+0000","last_change":"2023-12-19T19:01:53.724352+0000","last_active":"2023-12-19T19:01:55.049974+0000","last_peered":"2023-12-19T19:01:55.049974+0000","last_clean":"2023-12-19T19:01:55.049974+0000","last_became_active":"2023-12-19T19:01:53.724079+0000","last_became_peered":"2023-12-19T19:01:53.724079+0000","last_unstale":"2023-12-19T19:01:55.049974+0000","last_undegraded":"2023-12-19T19:01:55.049974+0000","last_fullsized":"2023-12-19T19:01:55.049974+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:03:01.607445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.717434+0000","last_change":"2023-12-19T19:01:52.705342+0000","last_active":"2023-12-19T19:01:54.717434+0000","last_peered":"2023-12-19T19:01:54.717434+0000","last_clean":"2023-12-19T19:01:54.717434+0000","last_became_active":"2023-12-19T19:01:52.705055+0000","last_became_peered":"2023-12-19T19:01:52.705055+0000","last_unstale":"2023-12-19T19:01:54.717434+0000","last_undegraded":"2023-12-19T19:01:54.717434+0000","last_fullsized":"2023-12-19T19:01:54.717434+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:05:00.157761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.717762+0000","last_change":"2023-12-19T19:01:35.989740+0000","last_active":"2023-12-19T19:01:53.717762+0000","last_peered":"2023-12-19T19:01:53.717762+0000","last_clean":"2023-12-19T19:01:53.717762+0000","last_became_active":"2023-12-19T19:01:35.989440+0000","last_became_peered":"2023-12-19T19:01:35.989440+0000","last_unstale":"2023-12-19T19:01:53.717762+0000","last_undegraded":"2023-12-19T19:01:53.717762+0000","last_fullsized":"2023-12-19T19:01:53.717762+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:53:03.688848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.700004+0000","last_change":"2023-12-19T19:01:34.998108+0000","last_active":"2023-12-19T19:01:53.700004+0000","last_peered":"2023-12-19T19:01:53.700004+0000","last_clean":"2023-12-19T19:01:53.700004+0000","last_became_active":"2023-12-19T19:01:34.997738+0000","last_became_peered":"2023-12-19T19:01:34.997738+0000","last_unstale":"2023-12-19T19:01:53.700004+0000","last_undegraded":"2023-12-19T19:01:53.700004+0000","last_fullsized":"2023-12-19T19:01:53.700004+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:08:57.128528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.551596+0000","last_change":"2023-12-19T19:01:53.715985+0000","last_active":"2023-12-19T19:01:55.551596+0000","last_peered":"2023-12-19T19:01:55.551596+0000","last_clean":"2023-12-19T19:01:55.551596+0000","last_became_active":"2023-12-19T19:01:53.715632+0000","last_became_peered":"2023-12-19T19:01:53.715632+0000","last_unstale":"2023-12-19T19:01:55.551596+0000","last_undegraded":"2023-12-19T19:01:55.551596+0000","last_fullsized":"2023-12-19T19:01:55.551596+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:27:22.529562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"72'1","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.716584+0000","last_change":"2023-12-19T19:01:52.700527+0000","last_active":"2023-12-19T19:01:54.716584+0000","last_peered":"2023-12-19T19:01:54.716584+0000","last_clean":"2023-12-19T19:01:54.716584+0000","last_became_active":"2023-12-19T19:01:52.699777+0000","last_became_peered":"2023-12-19T19:01:52.699777+0000","last_unstale":"2023-12-19T19:01:54.716584+0000","last_undegraded":"2023-12-19T19:01:54.716584+0000","last_fullsized":"2023-12-19T19:01:54.716584+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:19:26.599520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.695349+0000","last_change":"2023-12-19T19:01:35.997204+0000","last_active":"2023-12-19T19:01:53.695349+0000","last_peered":"2023-12-19T19:01:53.695349+0000","last_clean":"2023-12-19T19:01:53.695349+0000","last_became_active":"2023-12-19T19:01:35.996928+0000","last_became_peered":"2023-12-19T19:01:35.996928+0000","last_unstale":"2023-12-19T19:01:53.695349+0000","last_undegraded":"2023-12-19T19:01:53.695349+0000","last_fullsized":"2023-12-19T19:01:53.695349+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:32.389842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"68'1","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.699839+0000","last_change":"2023-12-19T19:01:34.999764+0000","last_active":"2023-12-19T19:01:53.699839+0000","last_peered":"2023-12-19T19:01:53.699839+0000","last_clean":"2023-12-19T19:01:53.699839+0000","last_became_active":"2023-12-19T19:01:34.998931+0000","last_became_peered":"2023-12-19T19:01:34.998931+0000","last_unstale":"2023-12-19T19:01:53.699839+0000","last_undegraded":"2023-12-19T19:01:53.699839+0000","last_fullsized":"2023-12-19T19:01:53.699839+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:36.470347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":219,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.697411+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T19:01:53.697411+0000","last_peered":"2023-12-19T19:01:53.697411+0000","last_clean":"2023-12-19T19:01:53.697411+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T19:01:53.697411+0000","last_undegraded":"2023-12-19T19:01:53.697411+0000","last_fullsized":"2023-12-19T19:01:53.697411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32656,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339184,"statfs":{"total":96636764160,"available":96603324416,"internally_reserved":0,"allocated":1503232,"data_stored":989237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.68899999999999995},"min":{"1min":0.44,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92500000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.72399999999999998},"min":{"1min":0.50700000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89300000000000002,"5min":1.117,"15min":1.117},"last":0.75800000000000001}]},{"osd":1,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.46700000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83899999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83399999999999996,"5min":1.01,"15min":1.01},"last":0.71999999999999997}]},{"osd":2,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85499999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.58299999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89500000000000002,"5min":1.089,"15min":1.089},"last":0.74199999999999999}]},{"osd":3,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71299999999999997,"15min":0.72699999999999998},"min":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90900000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73299999999999998,"15min":0.73499999999999999},"min":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91600000000000004,"5min":1.026,"15min":1.026},"last":0.68300000000000005}]},{"osd":4,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64400000000000002,"15min":0.65600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88500000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.625},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66700000000000004,"15min":0.67400000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93799999999999994,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93200000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.70599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91500000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.79300000000000004}]},{"osd":6,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.96799999999999997,"5min":1.069,"15min":1.069},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78000000000000003,"15min":0.79600000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.80800000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":917504,"data_stored":400033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.98899999999999999,"5min":1.022,"15min":1.022},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.89800000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.501}]},{"osd":1,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67100000000000004,"15min":0.65700000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.871,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.52300000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91500000000000004,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.71799999999999997}]},{"osd":2,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.443,"5min":0.437,"15min":0.437},"max":{"1min":0.96299999999999997,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.627},{"interface":"front","average":{"1min":0.745,"5min":0.71999999999999997,"15min":0.71699999999999997},"min":{"1min":0.58099999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94899999999999995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.46000000000000002}]},{"osd":3,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83499999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.442},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72199999999999998,"15min":0.72699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91900000000000004,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.54800000000000004}]},{"osd":4,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.48599999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.74099999999999999,"15min":0.755},"min":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95999999999999996,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.58099999999999996}]},{"osd":5,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.93700000000000006,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73199999999999998,"15min":0.73599999999999999},"min":{"1min":0.54600000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.52800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":905216,"data_stored":394729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.84399999999999997,"15min":0.92900000000000005},"min":{"1min":0.434,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90900000000000003,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":1.1739999999999999,"15min":1.3959999999999999},"min":{"1min":0.495,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86199999999999999,"5min":16.951000000000001,"15min":16.951000000000001},"last":0.56000000000000005}]},{"osd":1,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":1.222,"15min":1.48},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98299999999999998,"5min":19.823,"15min":19.823},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.67200000000000004},"min":{"1min":0.45800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95899999999999996,"5min":1.657,"15min":1.657},"last":0.71699999999999997}]},{"osd":2,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72899999999999998,"15min":0.751},"min":{"1min":0.47599999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92300000000000004,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71599999999999997,"15min":0.73299999999999998},"min":{"1min":0.49399999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93700000000000006,"5min":1.585,"15min":1.585},"last":0.79300000000000004}]},{"osd":3,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76700000000000002,"15min":0.78700000000000003},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.97199999999999998,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.91200000000000003,"15min":0.99399999999999999},"min":{"1min":0.58799999999999997,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.89400000000000002,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":0.74299999999999999}]},{"osd":4,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.46300000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92600000000000005,"5min":1.716,"15min":1.716},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.78700000000000003,"15min":0.82299999999999995},"min":{"1min":0.50700000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91700000000000004,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":0.85999999999999999}]},{"osd":6,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.78500000000000003,"15min":0.83699999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85299999999999998,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.79900000000000004,"15min":0.83599999999999997},"min":{"1min":0.52000000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86899999999999999,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.81000000000000005}]},{"osd":7,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96099999999999997,"5min":2.371,"15min":2.371},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81399999999999995,"15min":0.84099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93500000000000005,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.83999999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":917504,"data_stored":400423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.79300000000000004,"15min":0.85899999999999999},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92600000000000005,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67700000000000005,"15min":0.69099999999999995},"min":{"1min":0.47499999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83599999999999997,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.89900000000000002}]},{"osd":1,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.68600000000000005,"15min":0.69799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85399999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.76500000000000001,"15min":0.79800000000000004},"min":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.86399999999999999,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":0.91300000000000003}]},{"osd":2,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.69199999999999995},"min":{"1min":0.504,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.872,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.76600000000000001,"15min":0.80800000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86399999999999999,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.84399999999999997}]},{"osd":3,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.78200000000000003,"15min":0.83599999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.874,"5min":3.641,"15min":3.641},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.83299999999999996,"15min":0.88500000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91200000000000003,"5min":3.194,"15min":3.194},"last":0.76800000000000002}]},{"osd":5,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.92200000000000004,"15min":1.054},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89200000000000002,"5min":9.3040000000000003,"15min":9.3040000000000003},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69599999999999995,"15min":0.73199999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90800000000000003,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.80600000000000005}]},{"osd":6,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.78700000000000003,"15min":0.83199999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92700000000000005,"5min":3.097,"15min":3.097},"last":1.002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.82299999999999995,"15min":0.877},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89700000000000002,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.95699999999999996}]},{"osd":7,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.879,"15min":0.95899999999999996},"min":{"1min":0.48399999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93200000000000005,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.87},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.95399999999999996,"15min":1.052},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94299999999999995,"5min":6.3449999999999998,"15min":6.3449999999999998},"last":0.88300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":925696,"data_stored":403428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72699999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.36099999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.45200000000000001}]},{"osd":1,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46700000000000003,"15min":0.48499999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60699999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.50600000000000001}]},{"osd":2,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.74299999999999999,"5min":0.75,"15min":0.75},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.54700000000000004},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77600000000000002,"5min":0.875,"15min":0.875},"last":0.47099999999999997}]},{"osd":4,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88400000000000001,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98999999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.67900000000000005}]},{"osd":5,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.50600000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94999999999999996,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.752,"15min":0.77000000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.04,"5min":1.202,"15min":1.202},"last":0.61299999999999999}]},{"osd":6,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96399999999999997,"5min":1.298,"15min":1.298},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.98299999999999998,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.72299999999999998}]},{"osd":7,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94999999999999996,"5min":1.155,"15min":1.155},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93000000000000005,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.755}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":399303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.47399999999999998,"15min":0.5},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53700000000000003,"5min":1.458,"15min":1.458},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.56999999999999995,"15min":0.622},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68799999999999994,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.34799999999999998}]},{"osd":1,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.54600000000000004,"15min":0.58799999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.56899999999999995,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.56799999999999995,"15min":0.61199999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.625,"5min":2.444,"15min":2.444},"last":0.39700000000000002}]},{"osd":3,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.55400000000000005,"15min":0.60599999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.60899999999999999,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.58999999999999997,"15min":0.63200000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65500000000000003,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.52200000000000002}]},{"osd":4,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.88600000000000001,"15min":0.95699999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0189999999999999,"5min":1.968,"15min":1.968},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.84999999999999998,"15min":0.91000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96899999999999997,"5min":2.835,"15min":2.835},"last":0.65100000000000002}]},{"osd":5,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.86399999999999999,"15min":0.93300000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.99099999999999999,"5min":3.5,"15min":3.5},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.86499999999999999,"15min":0.92500000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94999999999999996,"5min":1.996,"15min":1.996},"last":0.63500000000000001}]},{"osd":6,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.86699999999999999,"15min":0.93200000000000005},"min":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0740000000000001,"5min":2.903,"15min":2.903},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.93000000000000005,"15min":1.0129999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0569999999999999,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.78400000000000003}]},{"osd":7,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.90300000000000002,"15min":0.97099999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1259999999999999,"5min":2.875,"15min":2.875},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.88200000000000001,"15min":0.96099999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95199999999999996,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.75700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":909312,"data_stored":398881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.51800000000000002,"15min":0.56999999999999995},"min":{"1min":0.29699999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73399999999999999,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.443,"5min":0.67100000000000004,"15min":0.77500000000000002},"min":{"1min":0.31,"5min":0.255,"15min":0.255},"max":{"1min":0.76700000000000002,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.46300000000000002}]},{"osd":2,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.53900000000000003,"15min":0.58499999999999996},"min":{"1min":0.317,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71799999999999997,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.379},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.61099999999999999,"15min":0.67400000000000004},"min":{"1min":0.34699999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76800000000000002,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.503}]},{"osd":3,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.72299999999999998,"15min":0.81899999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.90700000000000003,"5min":7.8399999999999999,"15min":7.8399999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.746,"15min":0.83799999999999997},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83699999999999997,"5min":7.7949999999999999,"15min":7.7949999999999999},"last":0.48299999999999998}]},{"osd":4,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.81899999999999995,"15min":0.88300000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.871,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.85199999999999998,"15min":0.91400000000000003},"min":{"1min":0.52300000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89300000000000002,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.76300000000000001}]},{"osd":5,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.82999999999999996,"15min":0.89200000000000002},"min":{"1min":0.49399999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93300000000000005,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.84099999999999997,"15min":0.90300000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.996,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.99299999999999999}]},{"osd":6,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.84799999999999998,"15min":0.89600000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95599999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.876,"15min":0.95099999999999996},"min":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.85499999999999998,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.70899999999999996}]},{"osd":7,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.88300000000000001,"15min":0.94999999999999996},"min":{"1min":0.51600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.83299999999999996,"5min":4.3310000000000004,"15min":4.3310000000000004},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.85899999999999999,"15min":0.90900000000000003},"min":{"1min":0.55100000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.92100000000000004,"5min":4.226,"15min":4.226},"last":0.97399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1482752,"data_stored":981495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.436,"15min":0.44800000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60299999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48899999999999999,"15min":0.503},"min":{"1min":0.29799999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65700000000000003,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.437}]},{"osd":2,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.50600000000000001,"15min":0.51300000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63700000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.51100000000000001},"min":{"1min":0.40799999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.39500000000000002}]},{"osd":3,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48199999999999998,"15min":0.48699999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.55900000000000005,"5min":0.747,"15min":0.747},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.57799999999999996,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69299999999999995,"5min":1.264,"15min":1.264},"last":0.372}]},{"osd":4,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.74199999999999999,"15min":0.748},"min":{"1min":0.502,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93999999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89900000000000002,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.749},"min":{"1min":0.57299999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.89300000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79200000000000004,"15min":0.81699999999999995},"min":{"1min":0.57199999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.91000000000000003,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.72799999999999998}]},{"osd":6,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.79600000000000004,"15min":0.82499999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92600000000000005,"5min":1.349,"15min":1.349},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0189999999999999,"5min":1.115,"15min":1.115},"last":0.56399999999999995}]},{"osd":7,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.57499999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94899999999999995,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.79200000000000004,"15min":0.81200000000000006},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.93200000000000005,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.71399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T19:01:57.790 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T19:01:57.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.960+0000 7fb24de9a640 1 Processor -- start 2023-12-19T19:01:57.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.960+0000 7fb24de9a640 1 -- start start 2023-12-19T19:01:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.960+0000 7fb24de9a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2480c5260 0x7fb24806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.960+0000 7fb24de9a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb2480c5640 0x7fb2480c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:57.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.960+0000 7fb24de9a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2480c2580 con 0x7fb2480c60f0 2023-12-19T19:01:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.960+0000 7fb24de9a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb248153510 con 0x7fb2480c5640 2023-12-19T19:01:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.960+0000 7fb24de9a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2480c17f0 con 0x7fb2480c5260 2023-12-19T19:01:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.960+0000 7fb247fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb2480c60f0 0x7fb248155de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57992/0 (socket says 172.21.15.133:57992) 2023-12-19T19:01:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.960+0000 7fb247fff640 1 -- 172.21.15.133:0/3567956552 learned_addr learned my addr 172.21.15.133:0/3567956552 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.960+0000 7fb246ffd640 1 --2- 172.21.15.133:0/3567956552 >> v2:172.21.15.138:3300/0 conn(0x7fb2480c5640 0x7fb2480c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.960+0000 7fb2477fe640 1 --2- 172.21.15.133:0/3567956552 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2480c5260 0x7fb24806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.960+0000 7fb2467fc640 1 -- 172.21.15.133:0/3567956552 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 610521670 0 0) 0x7fb2480c2580 con 0x7fb2480c60f0 2023-12-19T19:01:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.960+0000 7fb2467fc640 1 -- 172.21.15.133:0/3567956552 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb230003530 con 0x7fb2480c60f0 2023-12-19T19:01:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.960+0000 7fb246ffd640 1 -- 172.21.15.133:0/3567956552 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2480c5260 msgr2=0x7fb24806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.960+0000 7fb246ffd640 1 --2- 172.21.15.133:0/3567956552 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2480c5260 0x7fb24806d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.960+0000 7fb246ffd640 1 -- 172.21.15.133:0/3567956552 >> v1:172.21.15.133:6789/0 conn(0x7fb2480c60f0 legacy=0x7fb248155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.960+0000 7fb2467fc640 1 -- 172.21.15.133:0/3567956552 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 8723033 0 0) 0x7fb230003530 con 0x7fb2480c60f0 2023-12-19T19:01:57.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.960+0000 7fb246ffd640 1 -- 172.21.15.133:0/3567956552 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2480c1a00 con 0x7fb2480c5640 2023-12-19T19:01:57.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.964+0000 7fb246ffd640 1 --2- 172.21.15.133:0/3567956552 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2480c5640 0x7fb2480c5bb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb2480c1930 tx=0x7fb23c01c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2071a477882e28f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:57.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.964+0000 7fb2467fc640 1 -- 172.21.15.133:0/3567956552 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb240001a00 con 0x7fb2480c5640 2023-12-19T19:01:57.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.964+0000 7fb2467fc640 1 -- 172.21.15.133:0/3567956552 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23c0a7050 con 0x7fb2480c5640 2023-12-19T19:01:57.970 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.964+0000 7fb2467fc640 1 -- 172.21.15.133:0/3567956552 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c0ab600 con 0x7fb2480c5640 2023-12-19T19:01:57.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.964+0000 7fb24de9a640 1 -- 172.21.15.133:0/3567956552 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2480c5640 msgr2=0x7fb2480c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:57.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.964+0000 7fb24de9a640 1 --2- 172.21.15.133:0/3567956552 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2480c5640 0x7fb2480c5bb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb2480c1930 tx=0x7fb23c01c2e0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.964+0000 7fb24de9a640 1 -- 172.21.15.133:0/3567956552 shutdown_connections 2023-12-19T19:01:57.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.964+0000 7fb24de9a640 1 --2- 172.21.15.133:0/3567956552 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2480c5640 0x7fb2480c5bb0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.964+0000 7fb24de9a640 1 --2- 172.21.15.133:0/3567956552 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2480c5260 0x7fb24806d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.964+0000 7fb24de9a640 1 -- 172.21.15.133:0/3567956552 >> 172.21.15.133:0/3567956552 conn(0x7fb24806a5b0 msgr2=0x7fb24806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:57.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.964+0000 7fb24de9a640 1 -- 172.21.15.133:0/3567956552 shutdown_connections 2023-12-19T19:01:57.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.964+0000 7fb24de9a640 1 -- 172.21.15.133:0/3567956552 wait complete. 2023-12-19T19:01:57.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb24de9a640 1 Processor -- start 2023-12-19T19:01:57.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb24de9a640 1 -- start start 2023-12-19T19:01:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb24de9a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2480c5260 0x7fb2480c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb24de9a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2480c5640 0x7fb24814ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb24de9a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2480c60f0 0x7fb24814d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb24de9a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2480c0390 con 0x7fb2480c5640 2023-12-19T19:01:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb24de9a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb24814d8c0 con 0x7fb2480c5260 2023-12-19T19:01:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb24de9a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2481f0d70 con 0x7fb2480c60f0 2023-12-19T19:01:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb246ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2480c5640 0x7fb24814ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb246ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2480c5640 0x7fb24814ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34824/0 (socket says 172.21.15.133:34824) 2023-12-19T19:01:57.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb246ffd640 1 -- 172.21.15.133:0/1685825911 learned_addr learned my addr 172.21.15.133:0/1685825911 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:57.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb247fff640 1 --2- 172.21.15.133:0/1685825911 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2480c60f0 0x7fb24814d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:57.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb2477fe640 1 --2- 172.21.15.133:0/1685825911 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2480c5260 0x7fb2480c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:57.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb246ffd640 1 -- 172.21.15.133:0/1685825911 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2480c60f0 msgr2=0x7fb24814d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:57.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb246ffd640 1 --2- 172.21.15.133:0/1685825911 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2480c60f0 0x7fb24814d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb246ffd640 1 -- 172.21.15.133:0/1685825911 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2480c5260 msgr2=0x7fb2480c3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:57.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb246ffd640 1 --2- 172.21.15.133:0/1685825911 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2480c5260 0x7fb2480c3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:57.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb246ffd640 1 -- 172.21.15.133:0/1685825911 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c009420 con 0x7fb2480c5640 2023-12-19T19:01:57.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb246ffd640 1 --2- 172.21.15.133:0/1685825911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2480c5640 0x7fb24814ce40 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fb23c000c10 tx=0x7fb23c019080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:57.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb22ffff640 1 -- 172.21.15.133:0/1685825911 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c0b4400 con 0x7fb2480c5640 2023-12-19T19:01:57.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb22ffff640 1 -- 172.21.15.133:0/1685825911 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23c0b4560 con 0x7fb2480c5640 2023-12-19T19:01:57.976 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb24de9a640 1 -- 172.21.15.133:0/1685825911 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2481f1050 con 0x7fb2480c5640 2023-12-19T19:01:57.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb22ffff640 1 -- 172.21.15.133:0/1685825911 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c0b4910 con 0x7fb2480c5640 2023-12-19T19:01:57.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.968+0000 7fb24de9a640 1 -- 172.21.15.133:0/1685825911 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2481505b0 con 0x7fb2480c5640 2023-12-19T19:01:57.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.972+0000 7fb24de9a640 1 -- 172.21.15.133:0/1685825911 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb248068400 con 0x7fb2480c5640 2023-12-19T19:01:57.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.972+0000 7fb22ffff640 1 -- 172.21.15.133:0/1685825911 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb23c0b2040 con 0x7fb2480c5640 2023-12-19T19:01:57.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.972+0000 7fb22ffff640 1 --2- 172.21.15.133:0/1685825911 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb234066470 0x7fb234068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:57.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.972+0000 7fb22ffff640 1 -- 172.21.15.133:0/1685825911 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb23c11e150 con 0x7fb2480c5640 2023-12-19T19:01:57.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.972+0000 7fb2477fe640 1 --2- 172.21.15.133:0/1685825911 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb234066470 0x7fb234068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:57.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.972+0000 7fb2477fe640 1 --2- 172.21.15.133:0/1685825911 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb234066470 0x7fb234068930 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb238009a50 tx=0x7fb238008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:57.981 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:57.976+0000 7fb22ffff640 1 -- 172.21.15.133:0/1685825911 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb23c0eb270 con 0x7fb2480c5640 2023-12-19T19:01:58.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.124+0000 7fb24de9a640 1 -- 172.21.15.133:0/1685825911 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2480674e0 con 0x7fb234066470 2023-12-19T19:01:58.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.140+0000 7fb22ffff640 1 -- 172.21.15.133:0/1685825911 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+528193 (secure 0 0 0) 0x7fb2480674e0 con 0x7fb234066470 2023-12-19T19:01:58.148 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:58.152 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T19:01:58.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.144+0000 7fb24de9a640 1 -- 172.21.15.133:0/1685825911 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb234066470 msgr2=0x7fb234068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:58.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.144+0000 7fb24de9a640 1 --2- 172.21.15.133:0/1685825911 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb234066470 0x7fb234068930 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb238009a50 tx=0x7fb238008040 comp rx=0 tx=0).stop 2023-12-19T19:01:58.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.144+0000 7fb24de9a640 1 -- 172.21.15.133:0/1685825911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2480c5640 msgr2=0x7fb24814ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:58.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.144+0000 7fb24de9a640 1 --2- 172.21.15.133:0/1685825911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2480c5640 0x7fb24814ce40 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fb23c000c10 tx=0x7fb23c019080 comp rx=0 tx=0).stop 2023-12-19T19:01:58.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.144+0000 7fb24de9a640 1 -- 172.21.15.133:0/1685825911 shutdown_connections 2023-12-19T19:01:58.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.144+0000 7fb24de9a640 1 --2- 172.21.15.133:0/1685825911 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb234066470 0x7fb234068930 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.144+0000 7fb24de9a640 1 --2- 172.21.15.133:0/1685825911 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2480c60f0 0x7fb24814d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.144+0000 7fb24de9a640 1 --2- 172.21.15.133:0/1685825911 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2480c5640 0x7fb24814ce40 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.144+0000 7fb24de9a640 1 --2- 172.21.15.133:0/1685825911 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2480c5260 0x7fb2480c3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.144+0000 7fb24de9a640 1 -- 172.21.15.133:0/1685825911 >> 172.21.15.133:0/1685825911 conn(0x7fb24806a5b0 msgr2=0x7fb248155de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:58.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.144+0000 7fb24de9a640 1 -- 172.21.15.133:0/1685825911 shutdown_connections 2023-12-19T19:01:58.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.144+0000 7fb24de9a640 1 -- 172.21.15.133:0/1685825911 wait complete. 2023-12-19T19:01:58.169 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2023-12-19T19:01:56.880505+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253584,"kb_used_data":8268,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721136,"statfs":{"total":773094113280,"available":772834443264,"internally_reserved":0,"allocated":8466432,"data_stored":4367529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.207998"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.714809+0000","last_change":"2023-12-19T19:01:53.724722+0000","last_active":"2023-12-19T19:01:54.714809+0000","last_peered":"2023-12-19T19:01:54.714809+0000","last_clean":"2023-12-19T19:01:54.714809+0000","last_became_active":"2023-12-19T19:01:53.724420+0000","last_became_peered":"2023-12-19T19:01:53.724420+0000","last_unstale":"2023-12-19T19:01:54.714809+0000","last_undegraded":"2023-12-19T19:01:54.714809+0000","last_fullsized":"2023-12-19T19:01:54.714809+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:11:12.853890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.710274+0000","last_change":"2023-12-19T19:01:35.993269+0000","last_active":"2023-12-19T19:01:53.710274+0000","last_peered":"2023-12-19T19:01:53.710274+0000","last_clean":"2023-12-19T19:01:53.710274+0000","last_became_active":"2023-12-19T19:01:35.992720+0000","last_became_peered":"2023-12-19T19:01:35.992720+0000","last_unstale":"2023-12-19T19:01:53.710274+0000","last_undegraded":"2023-12-19T19:01:53.710274+0000","last_fullsized":"2023-12-19T19:01:53.710274+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:13.026799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.551474+0000","last_change":"2023-12-19T19:01:53.716723+0000","last_active":"2023-12-19T19:01:55.551474+0000","last_peered":"2023-12-19T19:01:55.551474+0000","last_clean":"2023-12-19T19:01:55.551474+0000","last_became_active":"2023-12-19T19:01:53.716389+0000","last_became_peered":"2023-12-19T19:01:53.716389+0000","last_unstale":"2023-12-19T19:01:55.551474+0000","last_undegraded":"2023-12-19T19:01:55.551474+0000","last_fullsized":"2023-12-19T19:01:55.551474+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:31:17.144583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.696697+0000","last_change":"2023-12-19T19:01:36.008235+0000","last_active":"2023-12-19T19:01:53.696697+0000","last_peered":"2023-12-19T19:01:53.696697+0000","last_clean":"2023-12-19T19:01:53.696697+0000","last_became_active":"2023-12-19T19:01:36.005960+0000","last_became_peered":"2023-12-19T19:01:36.005960+0000","last_unstale":"2023-12-19T19:01:53.696697+0000","last_undegraded":"2023-12-19T19:01:53.696697+0000","last_fullsized":"2023-12-19T19:01:53.696697+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:01:48.212049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.715140+0000","last_change":"2023-12-19T19:01:53.719908+0000","last_active":"2023-12-19T19:01:54.715140+0000","last_peered":"2023-12-19T19:01:54.715140+0000","last_clean":"2023-12-19T19:01:54.715140+0000","last_became_active":"2023-12-19T19:01:53.719633+0000","last_became_peered":"2023-12-19T19:01:53.719633+0000","last_unstale":"2023-12-19T19:01:54.715140+0000","last_undegraded":"2023-12-19T19:01:54.715140+0000","last_fullsized":"2023-12-19T19:01:54.715140+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:37:58.561635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.698511+0000","last_change":"2023-12-19T19:01:35.997697+0000","last_active":"2023-12-19T19:01:53.698511+0000","last_peered":"2023-12-19T19:01:53.698511+0000","last_clean":"2023-12-19T19:01:53.698511+0000","last_became_active":"2023-12-19T19:01:35.997425+0000","last_became_peered":"2023-12-19T19:01:35.997425+0000","last_unstale":"2023-12-19T19:01:53.698511+0000","last_undegraded":"2023-12-19T19:01:53.698511+0000","last_fullsized":"2023-12-19T19:01:53.698511+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:59.952872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.553440+0000","last_change":"2023-12-19T19:01:53.723171+0000","last_active":"2023-12-19T19:01:55.553440+0000","last_peered":"2023-12-19T19:01:55.553440+0000","last_clean":"2023-12-19T19:01:55.553440+0000","last_became_active":"2023-12-19T19:01:53.722519+0000","last_became_peered":"2023-12-19T19:01:53.722519+0000","last_unstale":"2023-12-19T19:01:55.553440+0000","last_undegraded":"2023-12-19T19:01:55.553440+0000","last_fullsized":"2023-12-19T19:01:55.553440+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:50:45.273009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.707290+0000","last_change":"2023-12-19T19:01:35.997124+0000","last_active":"2023-12-19T19:01:53.707290+0000","last_peered":"2023-12-19T19:01:53.707290+0000","last_clean":"2023-12-19T19:01:53.707290+0000","last_became_active":"2023-12-19T19:01:35.996813+0000","last_became_peered":"2023-12-19T19:01:35.996813+0000","last_unstale":"2023-12-19T19:01:53.707290+0000","last_undegraded":"2023-12-19T19:01:53.707290+0000","last_fullsized":"2023-12-19T19:01:53.707290+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:26:37.197213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.716010+0000","last_change":"2023-12-19T19:01:53.712338+0000","last_active":"2023-12-19T19:01:54.716010+0000","last_peered":"2023-12-19T19:01:54.716010+0000","last_clean":"2023-12-19T19:01:54.716010+0000","last_became_active":"2023-12-19T19:01:53.712065+0000","last_became_peered":"2023-12-19T19:01:53.712065+0000","last_unstale":"2023-12-19T19:01:54.716010+0000","last_undegraded":"2023-12-19T19:01:54.716010+0000","last_fullsized":"2023-12-19T19:01:54.716010+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:07:07.571500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.701118+0000","last_change":"2023-12-19T19:01:35.994723+0000","last_active":"2023-12-19T19:01:53.701118+0000","last_peered":"2023-12-19T19:01:53.701118+0000","last_clean":"2023-12-19T19:01:53.701118+0000","last_became_active":"2023-12-19T19:01:35.994225+0000","last_became_peered":"2023-12-19T19:01:35.994225+0000","last_unstale":"2023-12-19T19:01:53.701118+0000","last_undegraded":"2023-12-19T19:01:53.701118+0000","last_fullsized":"2023-12-19T19:01:53.701118+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:16:21.875547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550122+0000","last_change":"2023-12-19T19:01:53.718986+0000","last_active":"2023-12-19T19:01:55.550122+0000","last_peered":"2023-12-19T19:01:55.550122+0000","last_clean":"2023-12-19T19:01:55.550122+0000","last_became_active":"2023-12-19T19:01:53.718614+0000","last_became_peered":"2023-12-19T19:01:53.718614+0000","last_unstale":"2023-12-19T19:01:55.550122+0000","last_undegraded":"2023-12-19T19:01:55.550122+0000","last_fullsized":"2023-12-19T19:01:55.550122+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:49:45.107264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.707542+0000","last_change":"2023-12-19T19:01:35.996456+0000","last_active":"2023-12-19T19:01:53.707542+0000","last_peered":"2023-12-19T19:01:53.707542+0000","last_clean":"2023-12-19T19:01:53.707542+0000","last_became_active":"2023-12-19T19:01:35.996173+0000","last_became_peered":"2023-12-19T19:01:35.996173+0000","last_unstale":"2023-12-19T19:01:53.707542+0000","last_undegraded":"2023-12-19T19:01:53.707542+0000","last_fullsized":"2023-12-19T19:01:53.707542+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:39.334276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.717711+0000","last_change":"2023-12-19T19:01:53.729902+0000","last_active":"2023-12-19T19:01:54.717711+0000","last_peered":"2023-12-19T19:01:54.717711+0000","last_clean":"2023-12-19T19:01:54.717711+0000","last_became_active":"2023-12-19T19:01:53.729463+0000","last_became_peered":"2023-12-19T19:01:53.729463+0000","last_unstale":"2023-12-19T19:01:54.717711+0000","last_undegraded":"2023-12-19T19:01:54.717711+0000","last_fullsized":"2023-12-19T19:01:54.717711+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:09:04.810249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.701499+0000","last_change":"2023-12-19T19:01:35.991595+0000","last_active":"2023-12-19T19:01:53.701499+0000","last_peered":"2023-12-19T19:01:53.701499+0000","last_clean":"2023-12-19T19:01:53.701499+0000","last_became_active":"2023-12-19T19:01:35.991267+0000","last_became_peered":"2023-12-19T19:01:35.991267+0000","last_unstale":"2023-12-19T19:01:53.701499+0000","last_undegraded":"2023-12-19T19:01:53.701499+0000","last_fullsized":"2023-12-19T19:01:53.701499+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:15:44.155043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.716182+0000","last_change":"2023-12-19T19:01:53.725930+0000","last_active":"2023-12-19T19:01:54.716182+0000","last_peered":"2023-12-19T19:01:54.716182+0000","last_clean":"2023-12-19T19:01:54.716182+0000","last_became_active":"2023-12-19T19:01:53.725650+0000","last_became_peered":"2023-12-19T19:01:53.725650+0000","last_unstale":"2023-12-19T19:01:54.716182+0000","last_undegraded":"2023-12-19T19:01:54.716182+0000","last_fullsized":"2023-12-19T19:01:54.716182+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:31:17.144583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.708368+0000","last_change":"2023-12-19T19:01:36.012804+0000","last_active":"2023-12-19T19:01:53.708368+0000","last_peered":"2023-12-19T19:01:53.708368+0000","last_clean":"2023-12-19T19:01:53.708368+0000","last_became_active":"2023-12-19T19:01:36.012506+0000","last_became_peered":"2023-12-19T19:01:36.012506+0000","last_unstale":"2023-12-19T19:01:53.708368+0000","last_undegraded":"2023-12-19T19:01:53.708368+0000","last_fullsized":"2023-12-19T19:01:53.708368+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:52:57.735191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.716365+0000","last_change":"2023-12-19T19:01:53.713424+0000","last_active":"2023-12-19T19:01:54.716365+0000","last_peered":"2023-12-19T19:01:54.716365+0000","last_clean":"2023-12-19T19:01:54.716365+0000","last_became_active":"2023-12-19T19:01:53.712784+0000","last_became_peered":"2023-12-19T19:01:53.712784+0000","last_unstale":"2023-12-19T19:01:54.716365+0000","last_undegraded":"2023-12-19T19:01:54.716365+0000","last_fullsized":"2023-12-19T19:01:54.716365+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:31.015405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.705746+0000","last_change":"2023-12-19T19:01:36.008329+0000","last_active":"2023-12-19T19:01:53.705746+0000","last_peered":"2023-12-19T19:01:53.705746+0000","last_clean":"2023-12-19T19:01:53.705746+0000","last_became_active":"2023-12-19T19:01:36.007450+0000","last_became_peered":"2023-12-19T19:01:36.007450+0000","last_unstale":"2023-12-19T19:01:53.705746+0000","last_undegraded":"2023-12-19T19:01:53.705746+0000","last_fullsized":"2023-12-19T19:01:53.705746+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:52:33.062884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.050194+0000","last_change":"2023-12-19T19:01:53.715168+0000","last_active":"2023-12-19T19:01:55.050194+0000","last_peered":"2023-12-19T19:01:55.050194+0000","last_clean":"2023-12-19T19:01:55.050194+0000","last_became_active":"2023-12-19T19:01:53.714806+0000","last_became_peered":"2023-12-19T19:01:53.714806+0000","last_unstale":"2023-12-19T19:01:55.050194+0000","last_undegraded":"2023-12-19T19:01:55.050194+0000","last_fullsized":"2023-12-19T19:01:55.050194+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:01:26.155616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.703370+0000","last_change":"2023-12-19T19:01:36.012622+0000","last_active":"2023-12-19T19:01:53.703370+0000","last_peered":"2023-12-19T19:01:53.703370+0000","last_clean":"2023-12-19T19:01:53.703370+0000","last_became_active":"2023-12-19T19:01:36.012313+0000","last_became_peered":"2023-12-19T19:01:36.012313+0000","last_unstale":"2023-12-19T19:01:53.703370+0000","last_undegraded":"2023-12-19T19:01:53.703370+0000","last_fullsized":"2023-12-19T19:01:53.703370+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:32.200929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.050713+0000","last_change":"2023-12-19T19:01:53.721228+0000","last_active":"2023-12-19T19:01:55.050713+0000","last_peered":"2023-12-19T19:01:55.050713+0000","last_clean":"2023-12-19T19:01:55.050713+0000","last_became_active":"2023-12-19T19:01:53.720960+0000","last_became_peered":"2023-12-19T19:01:53.720960+0000","last_unstale":"2023-12-19T19:01:55.050713+0000","last_undegraded":"2023-12-19T19:01:55.050713+0000","last_fullsized":"2023-12-19T19:01:55.050713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:09:13.226066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.695281+0000","last_change":"2023-12-19T19:01:36.005796+0000","last_active":"2023-12-19T19:01:53.695281+0000","last_peered":"2023-12-19T19:01:53.695281+0000","last_clean":"2023-12-19T19:01:53.695281+0000","last_became_active":"2023-12-19T19:01:36.005526+0000","last_became_peered":"2023-12-19T19:01:36.005526+0000","last_unstale":"2023-12-19T19:01:53.695281+0000","last_undegraded":"2023-12-19T19:01:53.695281+0000","last_fullsized":"2023-12-19T19:01:53.695281+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:23:25.851168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.717702+0000","last_change":"2023-12-19T19:01:53.728384+0000","last_active":"2023-12-19T19:01:54.717702+0000","last_peered":"2023-12-19T19:01:54.717702+0000","last_clean":"2023-12-19T19:01:54.717702+0000","last_became_active":"2023-12-19T19:01:53.728021+0000","last_became_peered":"2023-12-19T19:01:53.728021+0000","last_unstale":"2023-12-19T19:01:54.717702+0000","last_undegraded":"2023-12-19T19:01:54.717702+0000","last_fullsized":"2023-12-19T19:01:54.717702+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:31:17.144583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.709536+0000","last_change":"2023-12-19T19:01:36.004265+0000","last_active":"2023-12-19T19:01:53.709536+0000","last_peered":"2023-12-19T19:01:53.709536+0000","last_clean":"2023-12-19T19:01:53.709536+0000","last_became_active":"2023-12-19T19:01:36.004006+0000","last_became_peered":"2023-12-19T19:01:36.004006+0000","last_unstale":"2023-12-19T19:01:53.709536+0000","last_undegraded":"2023-12-19T19:01:53.709536+0000","last_fullsized":"2023-12-19T19:01:53.709536+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:37.477766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550679+0000","last_change":"2023-12-19T19:01:53.711881+0000","last_active":"2023-12-19T19:01:55.550679+0000","last_peered":"2023-12-19T19:01:55.550679+0000","last_clean":"2023-12-19T19:01:55.550679+0000","last_became_active":"2023-12-19T19:01:53.711498+0000","last_became_peered":"2023-12-19T19:01:53.711498+0000","last_unstale":"2023-12-19T19:01:55.550679+0000","last_undegraded":"2023-12-19T19:01:55.550679+0000","last_fullsized":"2023-12-19T19:01:55.550679+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:52:54.882324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.696794+0000","last_change":"2023-12-19T19:01:35.998391+0000","last_active":"2023-12-19T19:01:53.696794+0000","last_peered":"2023-12-19T19:01:53.696794+0000","last_clean":"2023-12-19T19:01:53.696794+0000","last_became_active":"2023-12-19T19:01:35.998129+0000","last_became_peered":"2023-12-19T19:01:35.998129+0000","last_unstale":"2023-12-19T19:01:53.696794+0000","last_undegraded":"2023-12-19T19:01:53.696794+0000","last_fullsized":"2023-12-19T19:01:53.696794+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:32.200929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.715958+0000","last_change":"2023-12-19T19:01:53.711434+0000","last_active":"2023-12-19T19:01:54.715958+0000","last_peered":"2023-12-19T19:01:54.715958+0000","last_clean":"2023-12-19T19:01:54.715958+0000","last_became_active":"2023-12-19T19:01:53.710492+0000","last_became_peered":"2023-12-19T19:01:53.710492+0000","last_unstale":"2023-12-19T19:01:54.715958+0000","last_undegraded":"2023-12-19T19:01:54.715958+0000","last_fullsized":"2023-12-19T19:01:54.715958+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:52:54.882324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.705868+0000","last_change":"2023-12-19T19:01:36.001234+0000","last_active":"2023-12-19T19:01:53.705868+0000","last_peered":"2023-12-19T19:01:53.705868+0000","last_clean":"2023-12-19T19:01:53.705868+0000","last_became_active":"2023-12-19T19:01:36.000486+0000","last_became_peered":"2023-12-19T19:01:36.000486+0000","last_unstale":"2023-12-19T19:01:53.705868+0000","last_undegraded":"2023-12-19T19:01:53.705868+0000","last_fullsized":"2023-12-19T19:01:53.705868+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:30:29.280200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.551249+0000","last_change":"2023-12-19T19:01:53.711267+0000","last_active":"2023-12-19T19:01:55.551249+0000","last_peered":"2023-12-19T19:01:55.551249+0000","last_clean":"2023-12-19T19:01:55.551249+0000","last_became_active":"2023-12-19T19:01:53.710803+0000","last_became_peered":"2023-12-19T19:01:53.710803+0000","last_unstale":"2023-12-19T19:01:55.551249+0000","last_undegraded":"2023-12-19T19:01:55.551249+0000","last_fullsized":"2023-12-19T19:01:55.551249+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:27:52.950786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.698074+0000","last_change":"2023-12-19T19:01:36.014917+0000","last_active":"2023-12-19T19:01:53.698074+0000","last_peered":"2023-12-19T19:01:53.698074+0000","last_clean":"2023-12-19T19:01:53.698074+0000","last_became_active":"2023-12-19T19:01:36.011305+0000","last_became_peered":"2023-12-19T19:01:36.011305+0000","last_unstale":"2023-12-19T19:01:53.698074+0000","last_undegraded":"2023-12-19T19:01:53.698074+0000","last_fullsized":"2023-12-19T19:01:53.698074+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:37:40.853246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550500+0000","last_change":"2023-12-19T19:01:53.715938+0000","last_active":"2023-12-19T19:01:55.550500+0000","last_peered":"2023-12-19T19:01:55.550500+0000","last_clean":"2023-12-19T19:01:55.550500+0000","last_became_active":"2023-12-19T19:01:53.715435+0000","last_became_peered":"2023-12-19T19:01:53.715435+0000","last_unstale":"2023-12-19T19:01:55.550500+0000","last_undegraded":"2023-12-19T19:01:55.550500+0000","last_fullsized":"2023-12-19T19:01:55.550500+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:33:24.155748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.699802+0000","last_change":"2023-12-19T19:01:35.997902+0000","last_active":"2023-12-19T19:01:53.699802+0000","last_peered":"2023-12-19T19:01:53.699802+0000","last_clean":"2023-12-19T19:01:53.699802+0000","last_became_active":"2023-12-19T19:01:35.997621+0000","last_became_peered":"2023-12-19T19:01:35.997621+0000","last_unstale":"2023-12-19T19:01:53.699802+0000","last_undegraded":"2023-12-19T19:01:53.699802+0000","last_fullsized":"2023-12-19T19:01:53.699802+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:52:57.735191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.551337+0000","last_change":"2023-12-19T19:01:53.724462+0000","last_active":"2023-12-19T19:01:55.551337+0000","last_peered":"2023-12-19T19:01:55.551337+0000","last_clean":"2023-12-19T19:01:55.551337+0000","last_became_active":"2023-12-19T19:01:53.724181+0000","last_became_peered":"2023-12-19T19:01:53.724181+0000","last_unstale":"2023-12-19T19:01:55.551337+0000","last_undegraded":"2023-12-19T19:01:55.551337+0000","last_fullsized":"2023-12-19T19:01:55.551337+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:06:59.276086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.701079+0000","last_change":"2023-12-19T19:01:35.993502+0000","last_active":"2023-12-19T19:01:53.701079+0000","last_peered":"2023-12-19T19:01:53.701079+0000","last_clean":"2023-12-19T19:01:53.701079+0000","last_became_active":"2023-12-19T19:01:35.993183+0000","last_became_peered":"2023-12-19T19:01:35.993183+0000","last_unstale":"2023-12-19T19:01:53.701079+0000","last_undegraded":"2023-12-19T19:01:53.701079+0000","last_fullsized":"2023-12-19T19:01:53.701079+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:32.200929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.050185+0000","last_change":"2023-12-19T19:01:53.718493+0000","last_active":"2023-12-19T19:01:55.050185+0000","last_peered":"2023-12-19T19:01:55.050185+0000","last_clean":"2023-12-19T19:01:55.050185+0000","last_became_active":"2023-12-19T19:01:53.718176+0000","last_became_peered":"2023-12-19T19:01:53.718176+0000","last_unstale":"2023-12-19T19:01:55.050185+0000","last_undegraded":"2023-12-19T19:01:55.050185+0000","last_fullsized":"2023-12-19T19:01:55.050185+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:45:10.710460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.702468+0000","last_change":"2023-12-19T19:01:35.992492+0000","last_active":"2023-12-19T19:01:53.702468+0000","last_peered":"2023-12-19T19:01:53.702468+0000","last_clean":"2023-12-19T19:01:53.702468+0000","last_became_active":"2023-12-19T19:01:35.992218+0000","last_became_peered":"2023-12-19T19:01:35.992218+0000","last_unstale":"2023-12-19T19:01:53.702468+0000","last_undegraded":"2023-12-19T19:01:53.702468+0000","last_fullsized":"2023-12-19T19:01:53.702468+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:51:54.365989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.553511+0000","last_change":"2023-12-19T19:01:53.713700+0000","last_active":"2023-12-19T19:01:55.553511+0000","last_peered":"2023-12-19T19:01:55.553511+0000","last_clean":"2023-12-19T19:01:55.553511+0000","last_became_active":"2023-12-19T19:01:53.713412+0000","last_became_peered":"2023-12-19T19:01:53.713412+0000","last_unstale":"2023-12-19T19:01:55.553511+0000","last_undegraded":"2023-12-19T19:01:55.553511+0000","last_fullsized":"2023-12-19T19:01:55.553511+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:39.191877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.700279+0000","last_change":"2023-12-19T19:01:36.005018+0000","last_active":"2023-12-19T19:01:53.700279+0000","last_peered":"2023-12-19T19:01:53.700279+0000","last_clean":"2023-12-19T19:01:53.700279+0000","last_became_active":"2023-12-19T19:01:36.004713+0000","last_became_peered":"2023-12-19T19:01:36.004713+0000","last_unstale":"2023-12-19T19:01:53.700279+0000","last_undegraded":"2023-12-19T19:01:53.700279+0000","last_fullsized":"2023-12-19T19:01:53.700279+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:59.952872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552273+0000","last_change":"2023-12-19T19:01:53.713554+0000","last_active":"2023-12-19T19:01:55.552273+0000","last_peered":"2023-12-19T19:01:55.552273+0000","last_clean":"2023-12-19T19:01:55.552273+0000","last_became_active":"2023-12-19T19:01:53.713272+0000","last_became_peered":"2023-12-19T19:01:53.713272+0000","last_unstale":"2023-12-19T19:01:55.552273+0000","last_undegraded":"2023-12-19T19:01:55.552273+0000","last_fullsized":"2023-12-19T19:01:55.552273+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:09:04.810249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.707383+0000","last_change":"2023-12-19T19:01:35.991658+0000","last_active":"2023-12-19T19:01:53.707383+0000","last_peered":"2023-12-19T19:01:53.707383+0000","last_clean":"2023-12-19T19:01:53.707383+0000","last_became_active":"2023-12-19T19:01:35.991237+0000","last_became_peered":"2023-12-19T19:01:35.991237+0000","last_unstale":"2023-12-19T19:01:53.707383+0000","last_undegraded":"2023-12-19T19:01:53.707383+0000","last_fullsized":"2023-12-19T19:01:53.707383+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:50:18.771363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550217+0000","last_change":"2023-12-19T19:01:53.722243+0000","last_active":"2023-12-19T19:01:55.550217+0000","last_peered":"2023-12-19T19:01:55.550217+0000","last_clean":"2023-12-19T19:01:55.550217+0000","last_became_active":"2023-12-19T19:01:53.721975+0000","last_became_peered":"2023-12-19T19:01:53.721975+0000","last_unstale":"2023-12-19T19:01:55.550217+0000","last_undegraded":"2023-12-19T19:01:55.550217+0000","last_fullsized":"2023-12-19T19:01:55.550217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:38:22.203901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.703154+0000","last_change":"2023-12-19T19:01:35.999313+0000","last_active":"2023-12-19T19:01:53.703154+0000","last_peered":"2023-12-19T19:01:53.703154+0000","last_clean":"2023-12-19T19:01:53.703154+0000","last_became_active":"2023-12-19T19:01:35.999030+0000","last_became_peered":"2023-12-19T19:01:35.999030+0000","last_unstale":"2023-12-19T19:01:53.703154+0000","last_undegraded":"2023-12-19T19:01:53.703154+0000","last_fullsized":"2023-12-19T19:01:53.703154+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:43:01.593581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.716130+0000","last_change":"2023-12-19T19:01:53.714439+0000","last_active":"2023-12-19T19:01:54.716130+0000","last_peered":"2023-12-19T19:01:54.716130+0000","last_clean":"2023-12-19T19:01:54.716130+0000","last_became_active":"2023-12-19T19:01:53.713073+0000","last_became_peered":"2023-12-19T19:01:53.713073+0000","last_unstale":"2023-12-19T19:01:54.716130+0000","last_undegraded":"2023-12-19T19:01:54.716130+0000","last_fullsized":"2023-12-19T19:01:54.716130+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:27:52.950786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.693714+0000","last_change":"2023-12-19T19:01:36.009794+0000","last_active":"2023-12-19T19:01:53.693714+0000","last_peered":"2023-12-19T19:01:53.693714+0000","last_clean":"2023-12-19T19:01:53.693714+0000","last_became_active":"2023-12-19T19:01:36.008912+0000","last_became_peered":"2023-12-19T19:01:36.008912+0000","last_unstale":"2023-12-19T19:01:53.693714+0000","last_undegraded":"2023-12-19T19:01:53.693714+0000","last_fullsized":"2023-12-19T19:01:53.693714+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:37.771426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.551900+0000","last_change":"2023-12-19T19:01:53.714089+0000","last_active":"2023-12-19T19:01:55.551900+0000","last_peered":"2023-12-19T19:01:55.551900+0000","last_clean":"2023-12-19T19:01:55.551900+0000","last_became_active":"2023-12-19T19:01:53.713779+0000","last_became_peered":"2023-12-19T19:01:53.713779+0000","last_unstale":"2023-12-19T19:01:55.551900+0000","last_undegraded":"2023-12-19T19:01:55.551900+0000","last_fullsized":"2023-12-19T19:01:55.551900+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:07:15.643876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.717679+0000","last_change":"2023-12-19T19:01:35.998877+0000","last_active":"2023-12-19T19:01:53.717679+0000","last_peered":"2023-12-19T19:01:53.717679+0000","last_clean":"2023-12-19T19:01:53.717679+0000","last_became_active":"2023-12-19T19:01:35.998571+0000","last_became_peered":"2023-12-19T19:01:35.998571+0000","last_unstale":"2023-12-19T19:01:53.717679+0000","last_undegraded":"2023-12-19T19:01:53.717679+0000","last_fullsized":"2023-12-19T19:01:53.717679+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:39.334276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.551200+0000","last_change":"2023-12-19T19:01:53.724126+0000","last_active":"2023-12-19T19:01:55.551200+0000","last_peered":"2023-12-19T19:01:55.551200+0000","last_clean":"2023-12-19T19:01:55.551200+0000","last_became_active":"2023-12-19T19:01:53.723565+0000","last_became_peered":"2023-12-19T19:01:53.723565+0000","last_unstale":"2023-12-19T19:01:55.551200+0000","last_undegraded":"2023-12-19T19:01:55.551200+0000","last_fullsized":"2023-12-19T19:01:55.551200+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:24:19.929639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.705011+0000","last_change":"2023-12-19T19:01:35.997800+0000","last_active":"2023-12-19T19:01:53.705011+0000","last_peered":"2023-12-19T19:01:53.705011+0000","last_clean":"2023-12-19T19:01:53.705011+0000","last_became_active":"2023-12-19T19:01:35.997545+0000","last_became_peered":"2023-12-19T19:01:35.997545+0000","last_unstale":"2023-12-19T19:01:53.705011+0000","last_undegraded":"2023-12-19T19:01:53.705011+0000","last_fullsized":"2023-12-19T19:01:53.705011+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:20:16.482489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.716945+0000","last_change":"2023-12-19T19:01:53.713603+0000","last_active":"2023-12-19T19:01:54.716945+0000","last_peered":"2023-12-19T19:01:54.716945+0000","last_clean":"2023-12-19T19:01:54.716945+0000","last_became_active":"2023-12-19T19:01:53.713161+0000","last_became_peered":"2023-12-19T19:01:53.713161+0000","last_unstale":"2023-12-19T19:01:54.716945+0000","last_undegraded":"2023-12-19T19:01:54.716945+0000","last_fullsized":"2023-12-19T19:01:54.716945+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:11.889310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.695878+0000","last_change":"2023-12-19T19:01:36.012530+0000","last_active":"2023-12-19T19:01:53.695878+0000","last_peered":"2023-12-19T19:01:53.695878+0000","last_clean":"2023-12-19T19:01:53.695878+0000","last_became_active":"2023-12-19T19:01:36.000357+0000","last_became_peered":"2023-12-19T19:01:36.000357+0000","last_unstale":"2023-12-19T19:01:53.695878+0000","last_undegraded":"2023-12-19T19:01:53.695878+0000","last_fullsized":"2023-12-19T19:01:53.695878+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:48:37.782606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.718103+0000","last_change":"2023-12-19T19:01:53.728404+0000","last_active":"2023-12-19T19:01:54.718103+0000","last_peered":"2023-12-19T19:01:54.718103+0000","last_clean":"2023-12-19T19:01:54.718103+0000","last_became_active":"2023-12-19T19:01:53.728106+0000","last_became_peered":"2023-12-19T19:01:53.728106+0000","last_unstale":"2023-12-19T19:01:54.718103+0000","last_undegraded":"2023-12-19T19:01:54.718103+0000","last_fullsized":"2023-12-19T19:01:54.718103+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:31.015405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.696603+0000","last_change":"2023-12-19T19:01:36.000335+0000","last_active":"2023-12-19T19:01:53.696603+0000","last_peered":"2023-12-19T19:01:53.696603+0000","last_clean":"2023-12-19T19:01:53.696603+0000","last_became_active":"2023-12-19T19:01:35.999949+0000","last_became_peered":"2023-12-19T19:01:35.999949+0000","last_unstale":"2023-12-19T19:01:53.696603+0000","last_undegraded":"2023-12-19T19:01:53.696603+0000","last_fullsized":"2023-12-19T19:01:53.696603+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:11:15.836065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.718458+0000","last_change":"2023-12-19T19:01:53.725149+0000","last_active":"2023-12-19T19:01:54.718458+0000","last_peered":"2023-12-19T19:01:54.718458+0000","last_clean":"2023-12-19T19:01:54.718458+0000","last_became_active":"2023-12-19T19:01:53.724788+0000","last_became_peered":"2023-12-19T19:01:53.724788+0000","last_unstale":"2023-12-19T19:01:54.718458+0000","last_undegraded":"2023-12-19T19:01:54.718458+0000","last_fullsized":"2023-12-19T19:01:54.718458+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:13:39.216177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.701911+0000","last_change":"2023-12-19T19:01:36.004020+0000","last_active":"2023-12-19T19:01:53.701911+0000","last_peered":"2023-12-19T19:01:53.701911+0000","last_clean":"2023-12-19T19:01:53.701911+0000","last_became_active":"2023-12-19T19:01:36.003711+0000","last_became_peered":"2023-12-19T19:01:36.003711+0000","last_unstale":"2023-12-19T19:01:53.701911+0000","last_undegraded":"2023-12-19T19:01:53.701911+0000","last_fullsized":"2023-12-19T19:01:53.701911+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:37:45.790125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.553526+0000","last_change":"2023-12-19T19:01:53.711357+0000","last_active":"2023-12-19T19:01:55.553526+0000","last_peered":"2023-12-19T19:01:55.553526+0000","last_clean":"2023-12-19T19:01:55.553526+0000","last_became_active":"2023-12-19T19:01:53.711054+0000","last_became_peered":"2023-12-19T19:01:53.711054+0000","last_unstale":"2023-12-19T19:01:55.553526+0000","last_undegraded":"2023-12-19T19:01:55.553526+0000","last_fullsized":"2023-12-19T19:01:55.553526+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:18:48.854453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.709624+0000","last_change":"2023-12-19T19:01:36.002845+0000","last_active":"2023-12-19T19:01:53.709624+0000","last_peered":"2023-12-19T19:01:53.709624+0000","last_clean":"2023-12-19T19:01:53.709624+0000","last_became_active":"2023-12-19T19:01:35.995423+0000","last_became_peered":"2023-12-19T19:01:35.995423+0000","last_unstale":"2023-12-19T19:01:53.709624+0000","last_undegraded":"2023-12-19T19:01:53.709624+0000","last_fullsized":"2023-12-19T19:01:53.709624+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:36.554120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.551107+0000","last_change":"2023-12-19T19:01:53.731528+0000","last_active":"2023-12-19T19:01:55.551107+0000","last_peered":"2023-12-19T19:01:55.551107+0000","last_clean":"2023-12-19T19:01:55.551107+0000","last_became_active":"2023-12-19T19:01:53.731064+0000","last_became_peered":"2023-12-19T19:01:53.731064+0000","last_unstale":"2023-12-19T19:01:55.551107+0000","last_undegraded":"2023-12-19T19:01:55.551107+0000","last_fullsized":"2023-12-19T19:01:55.551107+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:07:07.571500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.694141+0000","last_change":"2023-12-19T19:01:36.010222+0000","last_active":"2023-12-19T19:01:53.694141+0000","last_peered":"2023-12-19T19:01:53.694141+0000","last_clean":"2023-12-19T19:01:53.694141+0000","last_became_active":"2023-12-19T19:01:36.006880+0000","last_became_peered":"2023-12-19T19:01:36.006880+0000","last_unstale":"2023-12-19T19:01:53.694141+0000","last_undegraded":"2023-12-19T19:01:53.694141+0000","last_fullsized":"2023-12-19T19:01:53.694141+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:33:06.447358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.713927+0000","last_change":"2023-12-19T19:01:53.708918+0000","last_active":"2023-12-19T19:01:54.713927+0000","last_peered":"2023-12-19T19:01:54.713927+0000","last_clean":"2023-12-19T19:01:54.713927+0000","last_became_active":"2023-12-19T19:01:53.708564+0000","last_became_peered":"2023-12-19T19:01:53.708564+0000","last_unstale":"2023-12-19T19:01:54.713927+0000","last_undegraded":"2023-12-19T19:01:54.713927+0000","last_fullsized":"2023-12-19T19:01:54.713927+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:30.735188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.693797+0000","last_change":"2023-12-19T19:01:36.009287+0000","last_active":"2023-12-19T19:01:53.693797+0000","last_peered":"2023-12-19T19:01:53.693797+0000","last_clean":"2023-12-19T19:01:53.693797+0000","last_became_active":"2023-12-19T19:01:36.008143+0000","last_became_peered":"2023-12-19T19:01:36.008143+0000","last_unstale":"2023-12-19T19:01:53.693797+0000","last_undegraded":"2023-12-19T19:01:53.693797+0000","last_fullsized":"2023-12-19T19:01:53.693797+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:31:30.154809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552974+0000","last_change":"2023-12-19T19:01:53.711505+0000","last_active":"2023-12-19T19:01:55.552974+0000","last_peered":"2023-12-19T19:01:55.552974+0000","last_clean":"2023-12-19T19:01:55.552974+0000","last_became_active":"2023-12-19T19:01:53.711192+0000","last_became_peered":"2023-12-19T19:01:53.711192+0000","last_unstale":"2023-12-19T19:01:55.552974+0000","last_undegraded":"2023-12-19T19:01:55.552974+0000","last_fullsized":"2023-12-19T19:01:55.552974+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:47:41.887378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.699926+0000","last_change":"2023-12-19T19:01:35.999308+0000","last_active":"2023-12-19T19:01:53.699926+0000","last_peered":"2023-12-19T19:01:53.699926+0000","last_clean":"2023-12-19T19:01:53.699926+0000","last_became_active":"2023-12-19T19:01:35.998266+0000","last_became_peered":"2023-12-19T19:01:35.998266+0000","last_unstale":"2023-12-19T19:01:53.699926+0000","last_undegraded":"2023-12-19T19:01:53.699926+0000","last_fullsized":"2023-12-19T19:01:53.699926+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:39.334276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.551213+0000","last_change":"2023-12-19T19:01:53.715743+0000","last_active":"2023-12-19T19:01:55.551213+0000","last_peered":"2023-12-19T19:01:55.551213+0000","last_clean":"2023-12-19T19:01:55.551213+0000","last_became_active":"2023-12-19T19:01:53.715063+0000","last_became_peered":"2023-12-19T19:01:53.715063+0000","last_unstale":"2023-12-19T19:01:55.551213+0000","last_undegraded":"2023-12-19T19:01:55.551213+0000","last_fullsized":"2023-12-19T19:01:55.551213+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:48:55.490995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.702645+0000","last_change":"2023-12-19T19:01:35.997803+0000","last_active":"2023-12-19T19:01:53.702645+0000","last_peered":"2023-12-19T19:01:53.702645+0000","last_clean":"2023-12-19T19:01:53.702645+0000","last_became_active":"2023-12-19T19:01:35.997526+0000","last_became_peered":"2023-12-19T19:01:35.997526+0000","last_unstale":"2023-12-19T19:01:53.702645+0000","last_undegraded":"2023-12-19T19:01:53.702645+0000","last_fullsized":"2023-12-19T19:01:53.702645+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:16:21.875547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.714564+0000","last_change":"2023-12-19T19:01:53.721121+0000","last_active":"2023-12-19T19:01:54.714564+0000","last_peered":"2023-12-19T19:01:54.714564+0000","last_clean":"2023-12-19T19:01:54.714564+0000","last_became_active":"2023-12-19T19:01:53.720664+0000","last_became_peered":"2023-12-19T19:01:53.720664+0000","last_unstale":"2023-12-19T19:01:54.714564+0000","last_undegraded":"2023-12-19T19:01:54.714564+0000","last_fullsized":"2023-12-19T19:01:54.714564+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:06:27.076457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"72'2","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.553054+0000","last_change":"2023-12-19T19:01:52.709206+0000","last_active":"2023-12-19T19:01:55.553054+0000","last_peered":"2023-12-19T19:01:55.553054+0000","last_clean":"2023-12-19T19:01:55.553054+0000","last_became_active":"2023-12-19T19:01:52.707641+0000","last_became_peered":"2023-12-19T19:01:52.707641+0000","last_unstale":"2023-12-19T19:01:55.553054+0000","last_undegraded":"2023-12-19T19:01:55.553054+0000","last_fullsized":"2023-12-19T19:01:55.553054+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:27:51.944633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.702428+0000","last_change":"2023-12-19T19:01:35.998354+0000","last_active":"2023-12-19T19:01:53.702428+0000","last_peered":"2023-12-19T19:01:53.702428+0000","last_clean":"2023-12-19T19:01:53.702428+0000","last_became_active":"2023-12-19T19:01:35.997004+0000","last_became_peered":"2023-12-19T19:01:35.997004+0000","last_unstale":"2023-12-19T19:01:53.702428+0000","last_undegraded":"2023-12-19T19:01:53.702428+0000","last_fullsized":"2023-12-19T19:01:53.702428+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:53:03.688848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"68'4","reported_seq":20,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.710523+0000","last_change":"2023-12-19T19:01:35.005860+0000","last_active":"2023-12-19T19:01:53.710523+0000","last_peered":"2023-12-19T19:01:53.710523+0000","last_clean":"2023-12-19T19:01:53.710523+0000","last_became_active":"2023-12-19T19:01:35.005458+0000","last_became_peered":"2023-12-19T19:01:35.005458+0000","last_unstale":"2023-12-19T19:01:53.710523+0000","last_undegraded":"2023-12-19T19:01:53.710523+0000","last_fullsized":"2023-12-19T19:01:53.710523+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:13:22.016658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.050329+0000","last_change":"2023-12-19T19:01:53.723293+0000","last_active":"2023-12-19T19:01:55.050329+0000","last_peered":"2023-12-19T19:01:55.050329+0000","last_clean":"2023-12-19T19:01:55.050329+0000","last_became_active":"2023-12-19T19:01:53.722963+0000","last_became_peered":"2023-12-19T19:01:53.722963+0000","last_unstale":"2023-12-19T19:01:55.050329+0000","last_undegraded":"2023-12-19T19:01:55.050329+0000","last_fullsized":"2023-12-19T19:01:55.050329+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:05.979540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"72'2","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552643+0000","last_change":"2023-12-19T19:01:52.708822+0000","last_active":"2023-12-19T19:01:55.552643+0000","last_peered":"2023-12-19T19:01:55.552643+0000","last_clean":"2023-12-19T19:01:55.552643+0000","last_became_active":"2023-12-19T19:01:52.708237+0000","last_became_peered":"2023-12-19T19:01:52.708237+0000","last_unstale":"2023-12-19T19:01:55.552643+0000","last_undegraded":"2023-12-19T19:01:55.552643+0000","last_fullsized":"2023-12-19T19:01:55.552643+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:55:15.463085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.710356+0000","last_change":"2023-12-19T19:01:35.995284+0000","last_active":"2023-12-19T19:01:53.710356+0000","last_peered":"2023-12-19T19:01:53.710356+0000","last_clean":"2023-12-19T19:01:53.710356+0000","last_became_active":"2023-12-19T19:01:35.994915+0000","last_became_peered":"2023-12-19T19:01:35.994915+0000","last_unstale":"2023-12-19T19:01:53.710356+0000","last_undegraded":"2023-12-19T19:01:53.710356+0000","last_fullsized":"2023-12-19T19:01:53.710356+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:59.952872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"68'1","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.702726+0000","last_change":"2023-12-19T19:01:35.000000+0000","last_active":"2023-12-19T19:01:53.702726+0000","last_peered":"2023-12-19T19:01:53.702726+0000","last_clean":"2023-12-19T19:01:53.702726+0000","last_became_active":"2023-12-19T19:01:34.999684+0000","last_became_peered":"2023-12-19T19:01:34.999684+0000","last_unstale":"2023-12-19T19:01:53.702726+0000","last_undegraded":"2023-12-19T19:01:53.702726+0000","last_fullsized":"2023-12-19T19:01:53.702726+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:27.616001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552022+0000","last_change":"2023-12-19T19:01:53.725911+0000","last_active":"2023-12-19T19:01:55.552022+0000","last_peered":"2023-12-19T19:01:55.552022+0000","last_clean":"2023-12-19T19:01:55.552022+0000","last_became_active":"2023-12-19T19:01:53.724799+0000","last_became_peered":"2023-12-19T19:01:53.724799+0000","last_unstale":"2023-12-19T19:01:55.552022+0000","last_undegraded":"2023-12-19T19:01:55.552022+0000","last_fullsized":"2023-12-19T19:01:55.552022+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:13:40.732465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"72'4","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552888+0000","last_change":"2023-12-19T19:01:52.710388+0000","last_active":"2023-12-19T19:01:55.552888+0000","last_peered":"2023-12-19T19:01:55.552888+0000","last_clean":"2023-12-19T19:01:55.552888+0000","last_became_active":"2023-12-19T19:01:52.710053+0000","last_became_peered":"2023-12-19T19:01:52.710053+0000","last_unstale":"2023-12-19T19:01:55.552888+0000","last_undegraded":"2023-12-19T19:01:55.552888+0000","last_fullsized":"2023-12-19T19:01:55.552888+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:41.129122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.709721+0000","last_change":"2023-12-19T19:01:36.005109+0000","last_active":"2023-12-19T19:01:53.709721+0000","last_peered":"2023-12-19T19:01:53.709721+0000","last_clean":"2023-12-19T19:01:53.709721+0000","last_became_active":"2023-12-19T19:01:36.003599+0000","last_became_peered":"2023-12-19T19:01:36.003599+0000","last_unstale":"2023-12-19T19:01:53.709721+0000","last_undegraded":"2023-12-19T19:01:53.709721+0000","last_fullsized":"2023-12-19T19:01:53.709721+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:20:14.686881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"68'2","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.700388+0000","last_change":"2023-12-19T19:01:34.996946+0000","last_active":"2023-12-19T19:01:53.700388+0000","last_peered":"2023-12-19T19:01:53.700388+0000","last_clean":"2023-12-19T19:01:53.700388+0000","last_became_active":"2023-12-19T19:01:34.995689+0000","last_became_peered":"2023-12-19T19:01:34.995689+0000","last_unstale":"2023-12-19T19:01:53.700388+0000","last_undegraded":"2023-12-19T19:01:53.700388+0000","last_fullsized":"2023-12-19T19:01:53.700388+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:52:56.727773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552963+0000","last_change":"2023-12-19T19:01:53.723226+0000","last_active":"2023-12-19T19:01:55.552963+0000","last_peered":"2023-12-19T19:01:55.552963+0000","last_clean":"2023-12-19T19:01:55.552963+0000","last_became_active":"2023-12-19T19:01:53.722955+0000","last_became_peered":"2023-12-19T19:01:53.722955+0000","last_unstale":"2023-12-19T19:01:55.552963+0000","last_undegraded":"2023-12-19T19:01:55.552963+0000","last_fullsized":"2023-12-19T19:01:55.552963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:31.015405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"72'1","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.716814+0000","last_change":"2023-12-19T19:01:52.690786+0000","last_active":"2023-12-19T19:01:54.716814+0000","last_peered":"2023-12-19T19:01:54.716814+0000","last_clean":"2023-12-19T19:01:54.716814+0000","last_became_active":"2023-12-19T19:01:52.690344+0000","last_became_peered":"2023-12-19T19:01:52.690344+0000","last_unstale":"2023-12-19T19:01:54.716814+0000","last_undegraded":"2023-12-19T19:01:54.716814+0000","last_fullsized":"2023-12-19T19:01:54.716814+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:55:15.463085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.698944+0000","last_change":"2023-12-19T19:01:35.996110+0000","last_active":"2023-12-19T19:01:53.698944+0000","last_peered":"2023-12-19T19:01:53.698944+0000","last_clean":"2023-12-19T19:01:53.698944+0000","last_became_active":"2023-12-19T19:01:35.995850+0000","last_became_peered":"2023-12-19T19:01:35.995850+0000","last_unstale":"2023-12-19T19:01:53.698944+0000","last_undegraded":"2023-12-19T19:01:53.698944+0000","last_fullsized":"2023-12-19T19:01:53.698944+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:06:09.368068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"68'2","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.699012+0000","last_change":"2023-12-19T19:01:34.997757+0000","last_active":"2023-12-19T19:01:53.699012+0000","last_peered":"2023-12-19T19:01:53.699012+0000","last_clean":"2023-12-19T19:01:53.699012+0000","last_became_active":"2023-12-19T19:01:34.997458+0000","last_became_peered":"2023-12-19T19:01:34.997458+0000","last_unstale":"2023-12-19T19:01:53.699012+0000","last_undegraded":"2023-12-19T19:01:53.699012+0000","last_fullsized":"2023-12-19T19:01:53.699012+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:53:02.681430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550120+0000","last_change":"2023-12-19T19:01:53.711902+0000","last_active":"2023-12-19T19:01:55.550120+0000","last_peered":"2023-12-19T19:01:55.550120+0000","last_clean":"2023-12-19T19:01:55.550120+0000","last_became_active":"2023-12-19T19:01:53.711611+0000","last_became_peered":"2023-12-19T19:01:53.711611+0000","last_unstale":"2023-12-19T19:01:55.550120+0000","last_undegraded":"2023-12-19T19:01:55.550120+0000","last_fullsized":"2023-12-19T19:01:55.550120+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:05.979540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.717186+0000","last_change":"2023-12-19T19:01:52.708697+0000","last_active":"2023-12-19T19:01:54.717186+0000","last_peered":"2023-12-19T19:01:54.717186+0000","last_clean":"2023-12-19T19:01:54.717186+0000","last_became_active":"2023-12-19T19:01:52.708377+0000","last_became_peered":"2023-12-19T19:01:52.708377+0000","last_unstale":"2023-12-19T19:01:54.717186+0000","last_undegraded":"2023-12-19T19:01:54.717186+0000","last_fullsized":"2023-12-19T19:01:54.717186+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:01:25.149463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.693887+0000","last_change":"2023-12-19T19:01:36.004027+0000","last_active":"2023-12-19T19:01:53.693887+0000","last_peered":"2023-12-19T19:01:53.693887+0000","last_clean":"2023-12-19T19:01:53.693887+0000","last_became_active":"2023-12-19T19:01:35.997940+0000","last_became_peered":"2023-12-19T19:01:35.997940+0000","last_unstale":"2023-12-19T19:01:53.693887+0000","last_undegraded":"2023-12-19T19:01:53.693887+0000","last_fullsized":"2023-12-19T19:01:53.693887+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:13:04.402847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"68'1","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.701424+0000","last_change":"2023-12-19T19:01:34.994677+0000","last_active":"2023-12-19T19:01:53.701424+0000","last_peered":"2023-12-19T19:01:53.701424+0000","last_clean":"2023-12-19T19:01:53.701424+0000","last_became_active":"2023-12-19T19:01:34.994343+0000","last_became_peered":"2023-12-19T19:01:34.994343+0000","last_unstale":"2023-12-19T19:01:53.701424+0000","last_undegraded":"2023-12-19T19:01:53.701424+0000","last_fullsized":"2023-12-19T19:01:53.701424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:13:22.016658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.049686+0000","last_change":"2023-12-19T19:01:53.722871+0000","last_active":"2023-12-19T19:01:55.049686+0000","last_peered":"2023-12-19T19:01:55.049686+0000","last_clean":"2023-12-19T19:01:55.049686+0000","last_became_active":"2023-12-19T19:01:53.722574+0000","last_became_peered":"2023-12-19T19:01:53.722574+0000","last_unstale":"2023-12-19T19:01:55.049686+0000","last_undegraded":"2023-12-19T19:01:55.049686+0000","last_fullsized":"2023-12-19T19:01:55.049686+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:54:12.609735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.713921+0000","last_change":"2023-12-19T19:01:52.702729+0000","last_active":"2023-12-19T19:01:54.713921+0000","last_peered":"2023-12-19T19:01:54.713921+0000","last_clean":"2023-12-19T19:01:54.713921+0000","last_became_active":"2023-12-19T19:01:52.701649+0000","last_became_peered":"2023-12-19T19:01:52.701649+0000","last_unstale":"2023-12-19T19:01:54.713921+0000","last_undegraded":"2023-12-19T19:01:54.713921+0000","last_fullsized":"2023-12-19T19:01:54.713921+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:45.325655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.701210+0000","last_change":"2023-12-19T19:01:35.993058+0000","last_active":"2023-12-19T19:01:53.701210+0000","last_peered":"2023-12-19T19:01:53.701210+0000","last_clean":"2023-12-19T19:01:53.701210+0000","last_became_active":"2023-12-19T19:01:35.992604+0000","last_became_peered":"2023-12-19T19:01:35.992604+0000","last_unstale":"2023-12-19T19:01:53.701210+0000","last_undegraded":"2023-12-19T19:01:53.701210+0000","last_fullsized":"2023-12-19T19:01:53.701210+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:37.477766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"68'1","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.702345+0000","last_change":"2023-12-19T19:01:34.998256+0000","last_active":"2023-12-19T19:01:53.702345+0000","last_peered":"2023-12-19T19:01:53.702345+0000","last_clean":"2023-12-19T19:01:53.702345+0000","last_became_active":"2023-12-19T19:01:34.997890+0000","last_became_peered":"2023-12-19T19:01:34.997890+0000","last_unstale":"2023-12-19T19:01:53.702345+0000","last_undegraded":"2023-12-19T19:01:53.702345+0000","last_fullsized":"2023-12-19T19:01:53.702345+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:01:47.204631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550589+0000","last_change":"2023-12-19T19:01:53.721014+0000","last_active":"2023-12-19T19:01:55.550589+0000","last_peered":"2023-12-19T19:01:55.550589+0000","last_clean":"2023-12-19T19:01:55.550589+0000","last_became_active":"2023-12-19T19:01:53.718429+0000","last_became_peered":"2023-12-19T19:01:53.718429+0000","last_unstale":"2023-12-19T19:01:55.550589+0000","last_undegraded":"2023-12-19T19:01:55.550589+0000","last_fullsized":"2023-12-19T19:01:55.550589+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:59:49.450663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"72'1","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.714310+0000","last_change":"2023-12-19T19:01:52.698715+0000","last_active":"2023-12-19T19:01:54.714310+0000","last_peered":"2023-12-19T19:01:54.714310+0000","last_clean":"2023-12-19T19:01:54.714310+0000","last_became_active":"2023-12-19T19:01:52.697188+0000","last_became_peered":"2023-12-19T19:01:52.697188+0000","last_unstale":"2023-12-19T19:01:54.714310+0000","last_undegraded":"2023-12-19T19:01:54.714310+0000","last_fullsized":"2023-12-19T19:01:54.714310+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:52:49.765121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.697203+0000","last_change":"2023-12-19T19:01:36.004752+0000","last_active":"2023-12-19T19:01:53.697203+0000","last_peered":"2023-12-19T19:01:53.697203+0000","last_clean":"2023-12-19T19:01:53.697203+0000","last_became_active":"2023-12-19T19:01:36.004424+0000","last_became_peered":"2023-12-19T19:01:36.004424+0000","last_unstale":"2023-12-19T19:01:53.697203+0000","last_undegraded":"2023-12-19T19:01:53.697203+0000","last_fullsized":"2023-12-19T19:01:53.697203+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:39:57.224439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.701009+0000","last_change":"2023-12-19T19:01:34.995656+0000","last_active":"2023-12-19T19:01:53.701009+0000","last_peered":"2023-12-19T19:01:53.701009+0000","last_clean":"2023-12-19T19:01:53.701009+0000","last_became_active":"2023-12-19T19:01:34.995357+0000","last_became_peered":"2023-12-19T19:01:34.995357+0000","last_unstale":"2023-12-19T19:01:53.701009+0000","last_undegraded":"2023-12-19T19:01:53.701009+0000","last_fullsized":"2023-12-19T19:01:53.701009+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:37:44.782707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.716240+0000","last_change":"2023-12-19T19:01:53.715621+0000","last_active":"2023-12-19T19:01:54.716240+0000","last_peered":"2023-12-19T19:01:54.716240+0000","last_clean":"2023-12-19T19:01:54.716240+0000","last_became_active":"2023-12-19T19:01:53.715299+0000","last_became_peered":"2023-12-19T19:01:53.715299+0000","last_unstale":"2023-12-19T19:01:54.716240+0000","last_undegraded":"2023-12-19T19:01:54.716240+0000","last_fullsized":"2023-12-19T19:01:54.716240+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:09:04.810249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"72'1","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.551297+0000","last_change":"2023-12-19T19:01:52.709336+0000","last_active":"2023-12-19T19:01:55.551297+0000","last_peered":"2023-12-19T19:01:55.551297+0000","last_clean":"2023-12-19T19:01:55.551297+0000","last_became_active":"2023-12-19T19:01:52.709047+0000","last_became_peered":"2023-12-19T19:01:52.709047+0000","last_unstale":"2023-12-19T19:01:55.551297+0000","last_undegraded":"2023-12-19T19:01:55.551297+0000","last_fullsized":"2023-12-19T19:01:55.551297+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:38.236096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.698255+0000","last_change":"2023-12-19T19:01:36.010420+0000","last_active":"2023-12-19T19:01:53.698255+0000","last_peered":"2023-12-19T19:01:53.698255+0000","last_clean":"2023-12-19T19:01:53.698255+0000","last_became_active":"2023-12-19T19:01:36.007843+0000","last_became_peered":"2023-12-19T19:01:36.007843+0000","last_unstale":"2023-12-19T19:01:53.698255+0000","last_undegraded":"2023-12-19T19:01:53.698255+0000","last_fullsized":"2023-12-19T19:01:53.698255+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:22:45.276751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.693512+0000","last_change":"2023-12-19T19:01:35.000403+0000","last_active":"2023-12-19T19:01:53.693512+0000","last_peered":"2023-12-19T19:01:53.693512+0000","last_clean":"2023-12-19T19:01:53.693512+0000","last_became_active":"2023-12-19T19:01:34.998866+0000","last_became_peered":"2023-12-19T19:01:34.998866+0000","last_unstale":"2023-12-19T19:01:53.693512+0000","last_undegraded":"2023-12-19T19:01:53.693512+0000","last_fullsized":"2023-12-19T19:01:53.693512+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:11:27.498892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.717663+0000","last_change":"2023-12-19T19:01:53.728523+0000","last_active":"2023-12-19T19:01:54.717663+0000","last_peered":"2023-12-19T19:01:54.717663+0000","last_clean":"2023-12-19T19:01:54.717663+0000","last_became_active":"2023-12-19T19:01:53.728114+0000","last_became_peered":"2023-12-19T19:01:53.728114+0000","last_unstale":"2023-12-19T19:01:54.717663+0000","last_undegraded":"2023-12-19T19:01:54.717663+0000","last_fullsized":"2023-12-19T19:01:54.717663+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:07:07.571500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"72'3","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.717048+0000","last_change":"2023-12-19T19:01:52.691603+0000","last_active":"2023-12-19T19:01:54.717048+0000","last_peered":"2023-12-19T19:01:54.717048+0000","last_clean":"2023-12-19T19:01:54.717048+0000","last_became_active":"2023-12-19T19:01:52.691283+0000","last_became_peered":"2023-12-19T19:01:52.691283+0000","last_unstale":"2023-12-19T19:01:54.717048+0000","last_undegraded":"2023-12-19T19:01:54.717048+0000","last_fullsized":"2023-12-19T19:01:54.717048+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:04.973387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.701897+0000","last_change":"2023-12-19T19:01:36.016594+0000","last_active":"2023-12-19T19:01:53.701897+0000","last_peered":"2023-12-19T19:01:53.701897+0000","last_clean":"2023-12-19T19:01:53.701897+0000","last_became_active":"2023-12-19T19:01:36.016338+0000","last_became_peered":"2023-12-19T19:01:36.016338+0000","last_unstale":"2023-12-19T19:01:53.701897+0000","last_undegraded":"2023-12-19T19:01:53.701897+0000","last_fullsized":"2023-12-19T19:01:53.701897+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:05:52.573183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.720078+0000","last_change":"2023-12-19T19:01:35.002076+0000","last_active":"2023-12-19T19:01:53.720078+0000","last_peered":"2023-12-19T19:01:53.720078+0000","last_clean":"2023-12-19T19:01:53.720078+0000","last_became_active":"2023-12-19T19:01:35.001645+0000","last_became_peered":"2023-12-19T19:01:35.001645+0000","last_unstale":"2023-12-19T19:01:53.720078+0000","last_undegraded":"2023-12-19T19:01:53.720078+0000","last_fullsized":"2023-12-19T19:01:53.720078+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:32:15.466391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.716516+0000","last_change":"2023-12-19T19:01:53.713991+0000","last_active":"2023-12-19T19:01:54.716516+0000","last_peered":"2023-12-19T19:01:54.716516+0000","last_clean":"2023-12-19T19:01:54.716516+0000","last_became_active":"2023-12-19T19:01:53.713705+0000","last_became_peered":"2023-12-19T19:01:53.713705+0000","last_unstale":"2023-12-19T19:01:54.716516+0000","last_undegraded":"2023-12-19T19:01:54.716516+0000","last_fullsized":"2023-12-19T19:01:54.716516+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:42.135275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"72'6","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.050399+0000","last_change":"2023-12-19T19:01:52.701962+0000","last_active":"2023-12-19T19:01:55.050399+0000","last_peered":"2023-12-19T19:01:55.050399+0000","last_clean":"2023-12-19T19:01:55.050399+0000","last_became_active":"2023-12-19T19:01:52.701677+0000","last_became_peered":"2023-12-19T19:01:52.701677+0000","last_unstale":"2023-12-19T19:01:55.050399+0000","last_undegraded":"2023-12-19T19:01:55.050399+0000","last_fullsized":"2023-12-19T19:01:55.050399+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:55:15.463085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.706715+0000","last_change":"2023-12-19T19:01:36.003506+0000","last_active":"2023-12-19T19:01:53.706715+0000","last_peered":"2023-12-19T19:01:53.706715+0000","last_clean":"2023-12-19T19:01:53.706715+0000","last_became_active":"2023-12-19T19:01:36.003096+0000","last_became_peered":"2023-12-19T19:01:36.003096+0000","last_unstale":"2023-12-19T19:01:53.706715+0000","last_undegraded":"2023-12-19T19:01:53.706715+0000","last_fullsized":"2023-12-19T19:01:53.706715+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:37.477766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.703463+0000","last_change":"2023-12-19T19:01:35.003678+0000","last_active":"2023-12-19T19:01:53.703463+0000","last_peered":"2023-12-19T19:01:53.703463+0000","last_clean":"2023-12-19T19:01:53.703463+0000","last_became_active":"2023-12-19T19:01:35.003361+0000","last_became_peered":"2023-12-19T19:01:35.003361+0000","last_unstale":"2023-12-19T19:01:53.703463+0000","last_undegraded":"2023-12-19T19:01:53.703463+0000","last_fullsized":"2023-12-19T19:01:53.703463+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:48:51.739304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.553233+0000","last_change":"2023-12-19T19:01:53.717469+0000","last_active":"2023-12-19T19:01:55.553233+0000","last_peered":"2023-12-19T19:01:55.553233+0000","last_clean":"2023-12-19T19:01:55.553233+0000","last_became_active":"2023-12-19T19:01:53.717040+0000","last_became_peered":"2023-12-19T19:01:53.717040+0000","last_unstale":"2023-12-19T19:01:55.553233+0000","last_undegraded":"2023-12-19T19:01:55.553233+0000","last_fullsized":"2023-12-19T19:01:55.553233+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:59:45.768383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.715296+0000","last_change":"2023-12-19T19:01:52.697022+0000","last_active":"2023-12-19T19:01:54.715296+0000","last_peered":"2023-12-19T19:01:54.715296+0000","last_clean":"2023-12-19T19:01:54.715296+0000","last_became_active":"2023-12-19T19:01:52.696731+0000","last_became_peered":"2023-12-19T19:01:52.696731+0000","last_unstale":"2023-12-19T19:01:54.715296+0000","last_undegraded":"2023-12-19T19:01:54.715296+0000","last_fullsized":"2023-12-19T19:01:54.715296+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:40:13.926675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.698913+0000","last_change":"2023-12-19T19:01:35.997000+0000","last_active":"2023-12-19T19:01:53.698913+0000","last_peered":"2023-12-19T19:01:53.698913+0000","last_clean":"2023-12-19T19:01:53.698913+0000","last_became_active":"2023-12-19T19:01:35.994590+0000","last_became_peered":"2023-12-19T19:01:35.994590+0000","last_unstale":"2023-12-19T19:01:53.698913+0000","last_undegraded":"2023-12-19T19:01:53.698913+0000","last_fullsized":"2023-12-19T19:01:53.698913+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:13.026799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"68'3","reported_seq":19,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.704404+0000","last_change":"2023-12-19T19:01:35.002668+0000","last_active":"2023-12-19T19:01:53.704404+0000","last_peered":"2023-12-19T19:01:53.704404+0000","last_clean":"2023-12-19T19:01:53.704404+0000","last_became_active":"2023-12-19T19:01:35.002367+0000","last_became_peered":"2023-12-19T19:01:35.002367+0000","last_unstale":"2023-12-19T19:01:53.704404+0000","last_undegraded":"2023-12-19T19:01:53.704404+0000","last_fullsized":"2023-12-19T19:01:53.704404+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:27.616001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.050722+0000","last_change":"2023-12-19T19:01:53.723559+0000","last_active":"2023-12-19T19:01:55.050722+0000","last_peered":"2023-12-19T19:01:55.050722+0000","last_clean":"2023-12-19T19:01:55.050722+0000","last_became_active":"2023-12-19T19:01:53.723307+0000","last_became_peered":"2023-12-19T19:01:53.723307+0000","last_unstale":"2023-12-19T19:01:55.050722+0000","last_undegraded":"2023-12-19T19:01:55.050722+0000","last_fullsized":"2023-12-19T19:01:55.050722+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:52:54.882324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.551989+0000","last_change":"2023-12-19T19:01:52.709963+0000","last_active":"2023-12-19T19:01:55.551989+0000","last_peered":"2023-12-19T19:01:55.551989+0000","last_clean":"2023-12-19T19:01:55.551989+0000","last_became_active":"2023-12-19T19:01:52.709671+0000","last_became_peered":"2023-12-19T19:01:52.709671+0000","last_unstale":"2023-12-19T19:01:55.551989+0000","last_undegraded":"2023-12-19T19:01:55.551989+0000","last_fullsized":"2023-12-19T19:01:55.551989+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:45:09.704307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.702129+0000","last_change":"2023-12-19T19:01:35.990996+0000","last_active":"2023-12-19T19:01:53.702129+0000","last_peered":"2023-12-19T19:01:53.702129+0000","last_clean":"2023-12-19T19:01:53.702129+0000","last_became_active":"2023-12-19T19:01:35.990358+0000","last_became_peered":"2023-12-19T19:01:35.990358+0000","last_unstale":"2023-12-19T19:01:53.702129+0000","last_undegraded":"2023-12-19T19:01:53.702129+0000","last_fullsized":"2023-12-19T19:01:53.702129+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:52:33.062884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"69'8","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.706387+0000","last_change":"2023-12-19T19:01:34.997430+0000","last_active":"2023-12-19T19:01:53.706387+0000","last_peered":"2023-12-19T19:01:53.706387+0000","last_clean":"2023-12-19T19:01:53.706387+0000","last_became_active":"2023-12-19T19:01:34.997110+0000","last_became_peered":"2023-12-19T19:01:34.997110+0000","last_unstale":"2023-12-19T19:01:53.706387+0000","last_undegraded":"2023-12-19T19:01:53.706387+0000","last_fullsized":"2023-12-19T19:01:53.706387+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:06:40.560279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.049686+0000","last_change":"2023-12-19T19:01:53.723569+0000","last_active":"2023-12-19T19:01:55.049686+0000","last_peered":"2023-12-19T19:01:55.049686+0000","last_clean":"2023-12-19T19:01:55.049686+0000","last_became_active":"2023-12-19T19:01:53.723191+0000","last_became_peered":"2023-12-19T19:01:53.723191+0000","last_unstale":"2023-12-19T19:01:55.049686+0000","last_undegraded":"2023-12-19T19:01:55.049686+0000","last_fullsized":"2023-12-19T19:01:55.049686+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:39.242249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.049823+0000","last_change":"2023-12-19T19:01:52.695165+0000","last_active":"2023-12-19T19:01:55.049823+0000","last_peered":"2023-12-19T19:01:55.049823+0000","last_clean":"2023-12-19T19:01:55.049823+0000","last_became_active":"2023-12-19T19:01:52.694842+0000","last_became_peered":"2023-12-19T19:01:52.694842+0000","last_unstale":"2023-12-19T19:01:55.049823+0000","last_undegraded":"2023-12-19T19:01:55.049823+0000","last_fullsized":"2023-12-19T19:01:55.049823+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:53:12.095865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.699005+0000","last_change":"2023-12-19T19:01:35.988814+0000","last_active":"2023-12-19T19:01:53.699005+0000","last_peered":"2023-12-19T19:01:53.699005+0000","last_clean":"2023-12-19T19:01:53.699005+0000","last_became_active":"2023-12-19T19:01:35.988546+0000","last_became_peered":"2023-12-19T19:01:35.988546+0000","last_unstale":"2023-12-19T19:01:53.699005+0000","last_undegraded":"2023-12-19T19:01:53.699005+0000","last_fullsized":"2023-12-19T19:01:53.699005+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:32.200929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"68'2","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.694233+0000","last_change":"2023-12-19T19:01:34.987868+0000","last_active":"2023-12-19T19:01:53.694233+0000","last_peered":"2023-12-19T19:01:53.694233+0000","last_clean":"2023-12-19T19:01:53.694233+0000","last_became_active":"2023-12-19T19:01:34.987545+0000","last_became_peered":"2023-12-19T19:01:34.987545+0000","last_unstale":"2023-12-19T19:01:53.694233+0000","last_undegraded":"2023-12-19T19:01:53.694233+0000","last_fullsized":"2023-12-19T19:01:53.694233+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:34:38.369643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550979+0000","last_change":"2023-12-19T19:01:53.711997+0000","last_active":"2023-12-19T19:01:55.550979+0000","last_peered":"2023-12-19T19:01:55.550979+0000","last_clean":"2023-12-19T19:01:55.550979+0000","last_became_active":"2023-12-19T19:01:53.711712+0000","last_became_peered":"2023-12-19T19:01:53.711712+0000","last_unstale":"2023-12-19T19:01:55.550979+0000","last_undegraded":"2023-12-19T19:01:55.550979+0000","last_fullsized":"2023-12-19T19:01:55.550979+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:02:05.920439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"72'8","reported_seq":20,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.714007+0000","last_change":"2023-12-19T19:01:52.695953+0000","last_active":"2023-12-19T19:01:54.714007+0000","last_peered":"2023-12-19T19:01:54.714007+0000","last_clean":"2023-12-19T19:01:54.714007+0000","last_became_active":"2023-12-19T19:01:52.693932+0000","last_became_peered":"2023-12-19T19:01:52.693932+0000","last_unstale":"2023-12-19T19:01:54.714007+0000","last_undegraded":"2023-12-19T19:01:54.714007+0000","last_fullsized":"2023-12-19T19:01:54.714007+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:14.437427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.696892+0000","last_change":"2023-12-19T19:01:36.000560+0000","last_active":"2023-12-19T19:01:53.696892+0000","last_peered":"2023-12-19T19:01:53.696892+0000","last_clean":"2023-12-19T19:01:53.696892+0000","last_became_active":"2023-12-19T19:01:35.999311+0000","last_became_peered":"2023-12-19T19:01:35.999311+0000","last_unstale":"2023-12-19T19:01:53.696892+0000","last_undegraded":"2023-12-19T19:01:53.696892+0000","last_fullsized":"2023-12-19T19:01:53.696892+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:41:13.026799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.698017+0000","last_change":"2023-12-19T19:01:34.994756+0000","last_active":"2023-12-19T19:01:53.698017+0000","last_peered":"2023-12-19T19:01:53.698017+0000","last_clean":"2023-12-19T19:01:53.698017+0000","last_became_active":"2023-12-19T19:01:34.994476+0000","last_became_peered":"2023-12-19T19:01:34.994476+0000","last_unstale":"2023-12-19T19:01:53.698017+0000","last_undegraded":"2023-12-19T19:01:53.698017+0000","last_fullsized":"2023-12-19T19:01:53.698017+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:31.193511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550304+0000","last_change":"2023-12-19T19:01:53.710649+0000","last_active":"2023-12-19T19:01:55.550304+0000","last_peered":"2023-12-19T19:01:55.550304+0000","last_clean":"2023-12-19T19:01:55.550304+0000","last_became_active":"2023-12-19T19:01:53.710322+0000","last_became_peered":"2023-12-19T19:01:53.710322+0000","last_unstale":"2023-12-19T19:01:55.550304+0000","last_undegraded":"2023-12-19T19:01:55.550304+0000","last_fullsized":"2023-12-19T19:01:55.550304+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:09:13.226066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"72'2","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552007+0000","last_change":"2023-12-19T19:01:52.702186+0000","last_active":"2023-12-19T19:01:55.552007+0000","last_peered":"2023-12-19T19:01:55.552007+0000","last_clean":"2023-12-19T19:01:55.552007+0000","last_became_active":"2023-12-19T19:01:52.701931+0000","last_became_peered":"2023-12-19T19:01:52.701931+0000","last_unstale":"2023-12-19T19:01:55.552007+0000","last_undegraded":"2023-12-19T19:01:55.552007+0000","last_fullsized":"2023-12-19T19:01:55.552007+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:38:33.477718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.693418+0000","last_change":"2023-12-19T19:01:35.999708+0000","last_active":"2023-12-19T19:01:53.693418+0000","last_peered":"2023-12-19T19:01:53.693418+0000","last_clean":"2023-12-19T19:01:53.693418+0000","last_became_active":"2023-12-19T19:01:35.999385+0000","last_became_peered":"2023-12-19T19:01:35.999385+0000","last_unstale":"2023-12-19T19:01:53.693418+0000","last_undegraded":"2023-12-19T19:01:53.693418+0000","last_fullsized":"2023-12-19T19:01:53.693418+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:04:12.129299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.705648+0000","last_change":"2023-12-19T19:01:35.002999+0000","last_active":"2023-12-19T19:01:53.705648+0000","last_peered":"2023-12-19T19:01:53.705648+0000","last_clean":"2023-12-19T19:01:53.705648+0000","last_became_active":"2023-12-19T19:01:35.002667+0000","last_became_peered":"2023-12-19T19:01:35.002667+0000","last_unstale":"2023-12-19T19:01:53.705648+0000","last_undegraded":"2023-12-19T19:01:53.705648+0000","last_fullsized":"2023-12-19T19:01:53.705648+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:13:22.016658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.714381+0000","last_change":"2023-12-19T19:01:53.710500+0000","last_active":"2023-12-19T19:01:54.714381+0000","last_peered":"2023-12-19T19:01:54.714381+0000","last_clean":"2023-12-19T19:01:54.714381+0000","last_became_active":"2023-12-19T19:01:53.710194+0000","last_became_peered":"2023-12-19T19:01:53.710194+0000","last_unstale":"2023-12-19T19:01:54.714381+0000","last_undegraded":"2023-12-19T19:01:54.714381+0000","last_fullsized":"2023-12-19T19:01:54.714381+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:41:17.661261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550758+0000","last_change":"2023-12-19T19:01:52.705798+0000","last_active":"2023-12-19T19:01:55.550758+0000","last_peered":"2023-12-19T19:01:55.550758+0000","last_clean":"2023-12-19T19:01:55.550758+0000","last_became_active":"2023-12-19T19:01:52.704982+0000","last_became_peered":"2023-12-19T19:01:52.704982+0000","last_unstale":"2023-12-19T19:01:55.550758+0000","last_undegraded":"2023-12-19T19:01:55.550758+0000","last_fullsized":"2023-12-19T19:01:55.550758+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:04:28.831535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.692953+0000","last_change":"2023-12-19T19:01:35.998862+0000","last_active":"2023-12-19T19:01:53.692953+0000","last_peered":"2023-12-19T19:01:53.692953+0000","last_clean":"2023-12-19T19:01:53.692953+0000","last_became_active":"2023-12-19T19:01:35.998539+0000","last_became_peered":"2023-12-19T19:01:35.998539+0000","last_unstale":"2023-12-19T19:01:53.692953+0000","last_undegraded":"2023-12-19T19:01:53.692953+0000","last_fullsized":"2023-12-19T19:01:53.692953+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:37.690613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"68'8","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.705121+0000","last_change":"2023-12-19T19:01:34.993756+0000","last_active":"2023-12-19T19:01:53.705121+0000","last_peered":"2023-12-19T19:01:53.705121+0000","last_clean":"2023-12-19T19:01:53.705121+0000","last_became_active":"2023-12-19T19:01:34.993466+0000","last_became_peered":"2023-12-19T19:01:34.993466+0000","last_unstale":"2023-12-19T19:01:53.705121+0000","last_undegraded":"2023-12-19T19:01:53.705121+0000","last_fullsized":"2023-12-19T19:01:53.705121+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:47:38.326858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550695+0000","last_change":"2023-12-19T19:01:53.730076+0000","last_active":"2023-12-19T19:01:55.550695+0000","last_peered":"2023-12-19T19:01:55.550695+0000","last_clean":"2023-12-19T19:01:55.550695+0000","last_became_active":"2023-12-19T19:01:53.729103+0000","last_became_peered":"2023-12-19T19:01:53.729103+0000","last_unstale":"2023-12-19T19:01:55.550695+0000","last_undegraded":"2023-12-19T19:01:55.550695+0000","last_fullsized":"2023-12-19T19:01:55.550695+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:23:16.235010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"72'1","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.717666+0000","last_change":"2023-12-19T19:01:52.697866+0000","last_active":"2023-12-19T19:01:54.717666+0000","last_peered":"2023-12-19T19:01:54.717666+0000","last_clean":"2023-12-19T19:01:54.717666+0000","last_became_active":"2023-12-19T19:01:52.697292+0000","last_became_peered":"2023-12-19T19:01:52.697292+0000","last_unstale":"2023-12-19T19:01:54.717666+0000","last_undegraded":"2023-12-19T19:01:54.717666+0000","last_fullsized":"2023-12-19T19:01:54.717666+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:55:15.463085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.696857+0000","last_change":"2023-12-19T19:01:35.996677+0000","last_active":"2023-12-19T19:01:53.696857+0000","last_peered":"2023-12-19T19:01:53.696857+0000","last_clean":"2023-12-19T19:01:53.696857+0000","last_became_active":"2023-12-19T19:01:35.996429+0000","last_became_peered":"2023-12-19T19:01:35.996429+0000","last_unstale":"2023-12-19T19:01:53.696857+0000","last_undegraded":"2023-12-19T19:01:53.696857+0000","last_fullsized":"2023-12-19T19:01:53.696857+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:10:55.145501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"68'1","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.714330+0000","last_change":"2023-12-19T19:01:35.001602+0000","last_active":"2023-12-19T19:01:53.714330+0000","last_peered":"2023-12-19T19:01:53.714330+0000","last_clean":"2023-12-19T19:01:53.714330+0000","last_became_active":"2023-12-19T19:01:35.000999+0000","last_became_peered":"2023-12-19T19:01:35.000999+0000","last_unstale":"2023-12-19T19:01:53.714330+0000","last_undegraded":"2023-12-19T19:01:53.714330+0000","last_fullsized":"2023-12-19T19:01:53.714330+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:46:31.394472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.716648+0000","last_change":"2023-12-19T19:01:53.711589+0000","last_active":"2023-12-19T19:01:54.716648+0000","last_peered":"2023-12-19T19:01:54.716648+0000","last_clean":"2023-12-19T19:01:54.716648+0000","last_became_active":"2023-12-19T19:01:53.711269+0000","last_became_peered":"2023-12-19T19:01:53.711269+0000","last_unstale":"2023-12-19T19:01:54.716648+0000","last_undegraded":"2023-12-19T19:01:54.716648+0000","last_fullsized":"2023-12-19T19:01:54.716648+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:13:39.216177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552725+0000","last_change":"2023-12-19T19:01:52.705722+0000","last_active":"2023-12-19T19:01:55.552725+0000","last_peered":"2023-12-19T19:01:55.552725+0000","last_clean":"2023-12-19T19:01:55.552725+0000","last_became_active":"2023-12-19T19:01:52.705471+0000","last_became_peered":"2023-12-19T19:01:52.705471+0000","last_unstale":"2023-12-19T19:01:55.552725+0000","last_undegraded":"2023-12-19T19:01:55.552725+0000","last_fullsized":"2023-12-19T19:01:55.552725+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:54:11.603583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.710434+0000","last_change":"2023-12-19T19:01:36.000346+0000","last_active":"2023-12-19T19:01:53.710434+0000","last_peered":"2023-12-19T19:01:53.710434+0000","last_clean":"2023-12-19T19:01:53.710434+0000","last_became_active":"2023-12-19T19:01:35.999742+0000","last_became_peered":"2023-12-19T19:01:35.999742+0000","last_unstale":"2023-12-19T19:01:53.710434+0000","last_undegraded":"2023-12-19T19:01:53.710434+0000","last_fullsized":"2023-12-19T19:01:53.710434+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:06:09.368068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"68'2","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.700917+0000","last_change":"2023-12-19T19:01:34.999856+0000","last_active":"2023-12-19T19:01:53.700917+0000","last_peered":"2023-12-19T19:01:53.700917+0000","last_clean":"2023-12-19T19:01:53.700917+0000","last_became_active":"2023-12-19T19:01:34.999581+0000","last_became_peered":"2023-12-19T19:01:34.999581+0000","last_unstale":"2023-12-19T19:01:53.700917+0000","last_undegraded":"2023-12-19T19:01:53.700917+0000","last_fullsized":"2023-12-19T19:01:53.700917+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:52:32.055466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.718206+0000","last_change":"2023-12-19T19:01:53.738697+0000","last_active":"2023-12-19T19:01:54.718206+0000","last_peered":"2023-12-19T19:01:54.718206+0000","last_clean":"2023-12-19T19:01:54.718206+0000","last_became_active":"2023-12-19T19:01:53.738368+0000","last_became_peered":"2023-12-19T19:01:53.738368+0000","last_unstale":"2023-12-19T19:01:54.718206+0000","last_undegraded":"2023-12-19T19:01:54.718206+0000","last_fullsized":"2023-12-19T19:01:54.718206+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:42.135275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"72'2","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.050406+0000","last_change":"2023-12-19T19:01:52.703126+0000","last_active":"2023-12-19T19:01:55.050406+0000","last_peered":"2023-12-19T19:01:55.050406+0000","last_clean":"2023-12-19T19:01:55.050406+0000","last_became_active":"2023-12-19T19:01:52.702896+0000","last_became_peered":"2023-12-19T19:01:52.702896+0000","last_unstale":"2023-12-19T19:01:55.050406+0000","last_undegraded":"2023-12-19T19:01:55.050406+0000","last_fullsized":"2023-12-19T19:01:55.050406+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:52:17.942323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.703095+0000","last_change":"2023-12-19T19:01:36.000859+0000","last_active":"2023-12-19T19:01:53.703095+0000","last_peered":"2023-12-19T19:01:53.703095+0000","last_clean":"2023-12-19T19:01:53.703095+0000","last_became_active":"2023-12-19T19:01:36.000532+0000","last_became_peered":"2023-12-19T19:01:36.000532+0000","last_unstale":"2023-12-19T19:01:53.703095+0000","last_undegraded":"2023-12-19T19:01:53.703095+0000","last_fullsized":"2023-12-19T19:01:53.703095+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:20:14.686881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.699104+0000","last_change":"2023-12-19T19:01:34.992936+0000","last_active":"2023-12-19T19:01:53.699104+0000","last_peered":"2023-12-19T19:01:53.699104+0000","last_clean":"2023-12-19T19:01:53.699104+0000","last_became_active":"2023-12-19T19:01:34.992664+0000","last_became_peered":"2023-12-19T19:01:34.992664+0000","last_unstale":"2023-12-19T19:01:53.699104+0000","last_undegraded":"2023-12-19T19:01:53.699104+0000","last_fullsized":"2023-12-19T19:01:53.699104+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:35.546701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550468+0000","last_change":"2023-12-19T19:01:53.723619+0000","last_active":"2023-12-19T19:01:55.550468+0000","last_peered":"2023-12-19T19:01:55.550468+0000","last_clean":"2023-12-19T19:01:55.550468+0000","last_became_active":"2023-12-19T19:01:53.722344+0000","last_became_peered":"2023-12-19T19:01:53.722344+0000","last_unstale":"2023-12-19T19:01:55.550468+0000","last_undegraded":"2023-12-19T19:01:55.550468+0000","last_fullsized":"2023-12-19T19:01:55.550468+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:31:47.863198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550389+0000","last_change":"2023-12-19T19:01:52.704582+0000","last_active":"2023-12-19T19:01:55.550389+0000","last_peered":"2023-12-19T19:01:55.550389+0000","last_clean":"2023-12-19T19:01:55.550389+0000","last_became_active":"2023-12-19T19:01:52.704293+0000","last_became_peered":"2023-12-19T19:01:52.704293+0000","last_unstale":"2023-12-19T19:01:55.550389+0000","last_undegraded":"2023-12-19T19:01:55.550389+0000","last_fullsized":"2023-12-19T19:01:55.550389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:11:32.538301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.705956+0000","last_change":"2023-12-19T19:01:36.000821+0000","last_active":"2023-12-19T19:01:53.705956+0000","last_peered":"2023-12-19T19:01:53.705956+0000","last_clean":"2023-12-19T19:01:53.705956+0000","last_became_active":"2023-12-19T19:01:36.000457+0000","last_became_peered":"2023-12-19T19:01:36.000457+0000","last_unstale":"2023-12-19T19:01:53.705956+0000","last_undegraded":"2023-12-19T19:01:53.705956+0000","last_fullsized":"2023-12-19T19:01:53.705956+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:30:27.426356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"68'2","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.698120+0000","last_change":"2023-12-19T19:01:35.000039+0000","last_active":"2023-12-19T19:01:53.698120+0000","last_peered":"2023-12-19T19:01:53.698120+0000","last_clean":"2023-12-19T19:01:53.698120+0000","last_became_active":"2023-12-19T19:01:34.999745+0000","last_became_peered":"2023-12-19T19:01:34.999745+0000","last_unstale":"2023-12-19T19:01:53.698120+0000","last_undegraded":"2023-12-19T19:01:53.698120+0000","last_fullsized":"2023-12-19T19:01:53.698120+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:11:14.828647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.716969+0000","last_change":"2023-12-19T19:01:53.729392+0000","last_active":"2023-12-19T19:01:54.716969+0000","last_peered":"2023-12-19T19:01:54.716969+0000","last_clean":"2023-12-19T19:01:54.716969+0000","last_became_active":"2023-12-19T19:01:53.727574+0000","last_became_peered":"2023-12-19T19:01:53.727574+0000","last_unstale":"2023-12-19T19:01:54.716969+0000","last_undegraded":"2023-12-19T19:01:54.716969+0000","last_fullsized":"2023-12-19T19:01:54.716969+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:09:13.226066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550160+0000","last_change":"2023-12-19T19:01:52.707477+0000","last_active":"2023-12-19T19:01:55.550160+0000","last_peered":"2023-12-19T19:01:55.550160+0000","last_clean":"2023-12-19T19:01:55.550160+0000","last_became_active":"2023-12-19T19:01:52.706881+0000","last_became_peered":"2023-12-19T19:01:52.706881+0000","last_unstale":"2023-12-19T19:01:55.550160+0000","last_undegraded":"2023-12-19T19:01:55.550160+0000","last_fullsized":"2023-12-19T19:01:55.550160+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:10.883157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.705132+0000","last_change":"2023-12-19T19:01:36.003671+0000","last_active":"2023-12-19T19:01:53.705132+0000","last_peered":"2023-12-19T19:01:53.705132+0000","last_clean":"2023-12-19T19:01:53.705132+0000","last_became_active":"2023-12-19T19:01:36.003394+0000","last_became_peered":"2023-12-19T19:01:36.003394+0000","last_unstale":"2023-12-19T19:01:53.705132+0000","last_undegraded":"2023-12-19T19:01:53.705132+0000","last_fullsized":"2023-12-19T19:01:53.705132+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:28.623419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.706053+0000","last_change":"2023-12-19T19:01:34.996284+0000","last_active":"2023-12-19T19:01:53.706053+0000","last_peered":"2023-12-19T19:01:53.706053+0000","last_clean":"2023-12-19T19:01:53.706053+0000","last_became_active":"2023-12-19T19:01:34.996012+0000","last_became_peered":"2023-12-19T19:01:34.996012+0000","last_unstale":"2023-12-19T19:01:53.706053+0000","last_undegraded":"2023-12-19T19:01:53.706053+0000","last_fullsized":"2023-12-19T19:01:53.706053+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:11:45.676991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550501+0000","last_change":"2023-12-19T19:01:53.722221+0000","last_active":"2023-12-19T19:01:55.550501+0000","last_peered":"2023-12-19T19:01:55.550501+0000","last_clean":"2023-12-19T19:01:55.550501+0000","last_became_active":"2023-12-19T19:01:53.721731+0000","last_became_peered":"2023-12-19T19:01:53.721731+0000","last_unstale":"2023-12-19T19:01:55.550501+0000","last_undegraded":"2023-12-19T19:01:55.550501+0000","last_fullsized":"2023-12-19T19:01:55.550501+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:13:22.111236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"72'2","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552998+0000","last_change":"2023-12-19T19:01:52.708721+0000","last_active":"2023-12-19T19:01:55.552998+0000","last_peered":"2023-12-19T19:01:55.552998+0000","last_clean":"2023-12-19T19:01:55.552998+0000","last_became_active":"2023-12-19T19:01:52.707616+0000","last_became_peered":"2023-12-19T19:01:52.707616+0000","last_unstale":"2023-12-19T19:01:55.552998+0000","last_undegraded":"2023-12-19T19:01:55.552998+0000","last_fullsized":"2023-12-19T19:01:55.552998+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:07:06.565347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.705101+0000","last_change":"2023-12-19T19:01:35.999651+0000","last_active":"2023-12-19T19:01:53.705101+0000","last_peered":"2023-12-19T19:01:53.705101+0000","last_clean":"2023-12-19T19:01:53.705101+0000","last_became_active":"2023-12-19T19:01:35.999414+0000","last_became_peered":"2023-12-19T19:01:35.999414+0000","last_unstale":"2023-12-19T19:01:53.705101+0000","last_undegraded":"2023-12-19T19:01:53.705101+0000","last_fullsized":"2023-12-19T19:01:53.705101+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:10:39.431508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.701591+0000","last_change":"2023-12-19T19:01:35.002482+0000","last_active":"2023-12-19T19:01:53.701591+0000","last_peered":"2023-12-19T19:01:53.701591+0000","last_clean":"2023-12-19T19:01:53.701591+0000","last_became_active":"2023-12-19T19:01:35.002110+0000","last_became_peered":"2023-12-19T19:01:35.002110+0000","last_unstale":"2023-12-19T19:01:53.701591+0000","last_undegraded":"2023-12-19T19:01:53.701591+0000","last_fullsized":"2023-12-19T19:01:53.701591+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:53:39.946763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552395+0000","last_change":"2023-12-19T19:01:53.717481+0000","last_active":"2023-12-19T19:01:55.552395+0000","last_peered":"2023-12-19T19:01:55.552395+0000","last_clean":"2023-12-19T19:01:55.552395+0000","last_became_active":"2023-12-19T19:01:53.717207+0000","last_became_peered":"2023-12-19T19:01:53.717207+0000","last_unstale":"2023-12-19T19:01:55.552395+0000","last_undegraded":"2023-12-19T19:01:55.552395+0000","last_fullsized":"2023-12-19T19:01:55.552395+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:32:34.182199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550518+0000","last_change":"2023-12-19T19:01:52.705211+0000","last_active":"2023-12-19T19:01:55.550518+0000","last_peered":"2023-12-19T19:01:55.550518+0000","last_clean":"2023-12-19T19:01:55.550518+0000","last_became_active":"2023-12-19T19:01:52.704929+0000","last_became_peered":"2023-12-19T19:01:52.704929+0000","last_unstale":"2023-12-19T19:01:55.550518+0000","last_undegraded":"2023-12-19T19:01:55.550518+0000","last_fullsized":"2023-12-19T19:01:55.550518+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:23:01.978988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.705452+0000","last_change":"2023-12-19T19:01:35.997317+0000","last_active":"2023-12-19T19:01:53.705452+0000","last_peered":"2023-12-19T19:01:53.705452+0000","last_clean":"2023-12-19T19:01:53.705452+0000","last_became_active":"2023-12-19T19:01:35.996988+0000","last_became_peered":"2023-12-19T19:01:35.996988+0000","last_unstale":"2023-12-19T19:01:53.705452+0000","last_undegraded":"2023-12-19T19:01:53.705452+0000","last_fullsized":"2023-12-19T19:01:53.705452+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:16:21.875547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.699605+0000","last_change":"2023-12-19T19:01:34.997069+0000","last_active":"2023-12-19T19:01:53.699605+0000","last_peered":"2023-12-19T19:01:53.699605+0000","last_clean":"2023-12-19T19:01:53.699605+0000","last_became_active":"2023-12-19T19:01:34.996756+0000","last_became_peered":"2023-12-19T19:01:34.996756+0000","last_unstale":"2023-12-19T19:01:53.699605+0000","last_undegraded":"2023-12-19T19:01:53.699605+0000","last_fullsized":"2023-12-19T19:01:53.699605+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:40:58.945454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.714649+0000","last_change":"2023-12-19T19:01:53.731027+0000","last_active":"2023-12-19T19:01:54.714649+0000","last_peered":"2023-12-19T19:01:54.714649+0000","last_clean":"2023-12-19T19:01:54.714649+0000","last_became_active":"2023-12-19T19:01:53.730662+0000","last_became_peered":"2023-12-19T19:01:53.730662+0000","last_unstale":"2023-12-19T19:01:54.714649+0000","last_undegraded":"2023-12-19T19:01:54.714649+0000","last_fullsized":"2023-12-19T19:01:54.714649+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:11:33.544454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552892+0000","last_change":"2023-12-19T19:01:52.704658+0000","last_active":"2023-12-19T19:01:55.552892+0000","last_peered":"2023-12-19T19:01:55.552892+0000","last_clean":"2023-12-19T19:01:55.552892+0000","last_became_active":"2023-12-19T19:01:52.704411+0000","last_became_peered":"2023-12-19T19:01:52.704411+0000","last_unstale":"2023-12-19T19:01:55.552892+0000","last_undegraded":"2023-12-19T19:01:55.552892+0000","last_fullsized":"2023-12-19T19:01:55.552892+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:52:53.876171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.702516+0000","last_change":"2023-12-19T19:01:35.995384+0000","last_active":"2023-12-19T19:01:53.702516+0000","last_peered":"2023-12-19T19:01:53.702516+0000","last_clean":"2023-12-19T19:01:53.702516+0000","last_became_active":"2023-12-19T19:01:35.995055+0000","last_became_peered":"2023-12-19T19:01:35.995055+0000","last_unstale":"2023-12-19T19:01:53.702516+0000","last_undegraded":"2023-12-19T19:01:53.702516+0000","last_fullsized":"2023-12-19T19:01:53.702516+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:19:36.554120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"68'2","reported_seq":18,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.695931+0000","last_change":"2023-12-19T19:01:34.989700+0000","last_active":"2023-12-19T19:01:53.695931+0000","last_peered":"2023-12-19T19:01:53.695931+0000","last_clean":"2023-12-19T19:01:53.695931+0000","last_became_active":"2023-12-19T19:01:34.989417+0000","last_became_peered":"2023-12-19T19:01:34.989417+0000","last_unstale":"2023-12-19T19:01:53.695931+0000","last_undegraded":"2023-12-19T19:01:53.695931+0000","last_fullsized":"2023-12-19T19:01:53.695931+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:29.601572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.717677+0000","last_change":"2023-12-19T19:01:53.719523+0000","last_active":"2023-12-19T19:01:54.717677+0000","last_peered":"2023-12-19T19:01:54.717677+0000","last_clean":"2023-12-19T19:01:54.717677+0000","last_became_active":"2023-12-19T19:01:53.719232+0000","last_became_peered":"2023-12-19T19:01:53.719232+0000","last_unstale":"2023-12-19T19:01:54.717677+0000","last_undegraded":"2023-12-19T19:01:54.717677+0000","last_fullsized":"2023-12-19T19:01:54.717677+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:27:52.950786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.717754+0000","last_change":"2023-12-19T19:01:52.697329+0000","last_active":"2023-12-19T19:01:54.717754+0000","last_peered":"2023-12-19T19:01:54.717754+0000","last_clean":"2023-12-19T19:01:54.717754+0000","last_became_active":"2023-12-19T19:01:52.697001+0000","last_became_peered":"2023-12-19T19:01:52.697001+0000","last_unstale":"2023-12-19T19:01:54.717754+0000","last_undegraded":"2023-12-19T19:01:54.717754+0000","last_fullsized":"2023-12-19T19:01:54.717754+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:45:09.704307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.696637+0000","last_change":"2023-12-19T19:01:35.997927+0000","last_active":"2023-12-19T19:01:53.696637+0000","last_peered":"2023-12-19T19:01:53.696637+0000","last_clean":"2023-12-19T19:01:53.696637+0000","last_became_active":"2023-12-19T19:01:35.997596+0000","last_became_peered":"2023-12-19T19:01:35.997596+0000","last_unstale":"2023-12-19T19:01:53.696637+0000","last_undegraded":"2023-12-19T19:01:53.696637+0000","last_fullsized":"2023-12-19T19:01:53.696637+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:37:40.853246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"69'1","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.696035+0000","last_change":"2023-12-19T19:01:34.986750+0000","last_active":"2023-12-19T19:01:53.696035+0000","last_peered":"2023-12-19T19:01:53.696035+0000","last_clean":"2023-12-19T19:01:53.696035+0000","last_became_active":"2023-12-19T19:01:34.986455+0000","last_became_peered":"2023-12-19T19:01:34.986455+0000","last_unstale":"2023-12-19T19:01:53.696035+0000","last_undegraded":"2023-12-19T19:01:53.696035+0000","last_fullsized":"2023-12-19T19:01:53.696035+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:32.294680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.553286+0000","last_change":"2023-12-19T19:01:53.723388+0000","last_active":"2023-12-19T19:01:55.553286+0000","last_peered":"2023-12-19T19:01:55.553286+0000","last_clean":"2023-12-19T19:01:55.553286+0000","last_became_active":"2023-12-19T19:01:53.722884+0000","last_became_peered":"2023-12-19T19:01:53.722884+0000","last_unstale":"2023-12-19T19:01:55.553286+0000","last_undegraded":"2023-12-19T19:01:55.553286+0000","last_fullsized":"2023-12-19T19:01:55.553286+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:15:40.361088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"72'2","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550950+0000","last_change":"2023-12-19T19:01:52.699070+0000","last_active":"2023-12-19T19:01:55.550950+0000","last_peered":"2023-12-19T19:01:55.550950+0000","last_clean":"2023-12-19T19:01:55.550950+0000","last_became_active":"2023-12-19T19:01:52.698607+0000","last_became_peered":"2023-12-19T19:01:52.698607+0000","last_unstale":"2023-12-19T19:01:55.550950+0000","last_undegraded":"2023-12-19T19:01:55.550950+0000","last_fullsized":"2023-12-19T19:01:55.550950+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:11:11.847737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.709799+0000","last_change":"2023-12-19T19:01:35.993025+0000","last_active":"2023-12-19T19:01:53.709799+0000","last_peered":"2023-12-19T19:01:53.709799+0000","last_clean":"2023-12-19T19:01:53.709799+0000","last_became_active":"2023-12-19T19:01:35.991791+0000","last_became_peered":"2023-12-19T19:01:35.991791+0000","last_unstale":"2023-12-19T19:01:53.709799+0000","last_undegraded":"2023-12-19T19:01:53.709799+0000","last_fullsized":"2023-12-19T19:01:53.709799+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:39:57.224439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.704554+0000","last_change":"2023-12-19T19:01:35.001204+0000","last_active":"2023-12-19T19:01:53.704554+0000","last_peered":"2023-12-19T19:01:53.704554+0000","last_clean":"2023-12-19T19:01:53.704554+0000","last_became_active":"2023-12-19T19:01:35.000589+0000","last_became_peered":"2023-12-19T19:01:35.000589+0000","last_unstale":"2023-12-19T19:01:53.704554+0000","last_undegraded":"2023-12-19T19:01:53.704554+0000","last_fullsized":"2023-12-19T19:01:53.704554+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:52:56.727773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.715267+0000","last_change":"2023-12-19T19:01:53.714557+0000","last_active":"2023-12-19T19:01:54.715267+0000","last_peered":"2023-12-19T19:01:54.715267+0000","last_clean":"2023-12-19T19:01:54.715267+0000","last_became_active":"2023-12-19T19:01:53.714233+0000","last_became_peered":"2023-12-19T19:01:53.714233+0000","last_unstale":"2023-12-19T19:01:54.715267+0000","last_undegraded":"2023-12-19T19:01:54.715267+0000","last_fullsized":"2023-12-19T19:01:54.715267+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:23:02.985141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.553392+0000","last_change":"2023-12-19T19:01:52.709314+0000","last_active":"2023-12-19T19:01:55.553392+0000","last_peered":"2023-12-19T19:01:55.553392+0000","last_clean":"2023-12-19T19:01:55.553392+0000","last_became_active":"2023-12-19T19:01:52.708982+0000","last_became_peered":"2023-12-19T19:01:52.708982+0000","last_unstale":"2023-12-19T19:01:55.553392+0000","last_undegraded":"2023-12-19T19:01:55.553392+0000","last_fullsized":"2023-12-19T19:01:55.553392+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:09:12.219913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.703187+0000","last_change":"2023-12-19T19:01:35.986829+0000","last_active":"2023-12-19T19:01:53.703187+0000","last_peered":"2023-12-19T19:01:53.703187+0000","last_clean":"2023-12-19T19:01:53.703187+0000","last_became_active":"2023-12-19T19:01:35.986542+0000","last_became_peered":"2023-12-19T19:01:35.986542+0000","last_unstale":"2023-12-19T19:01:53.703187+0000","last_undegraded":"2023-12-19T19:01:53.703187+0000","last_fullsized":"2023-12-19T19:01:53.703187+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:39:57.224439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.709881+0000","last_change":"2023-12-19T19:01:34.999664+0000","last_active":"2023-12-19T19:01:53.709881+0000","last_peered":"2023-12-19T19:01:53.709881+0000","last_clean":"2023-12-19T19:01:53.709881+0000","last_became_active":"2023-12-19T19:01:34.998997+0000","last_became_peered":"2023-12-19T19:01:34.998997+0000","last_unstale":"2023-12-19T19:01:53.709881+0000","last_undegraded":"2023-12-19T19:01:53.709881+0000","last_fullsized":"2023-12-19T19:01:53.709881+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:08:57.128528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550608+0000","last_change":"2023-12-19T19:01:53.721181+0000","last_active":"2023-12-19T19:01:55.550608+0000","last_peered":"2023-12-19T19:01:55.550608+0000","last_clean":"2023-12-19T19:01:55.550608+0000","last_became_active":"2023-12-19T19:01:53.720753+0000","last_became_peered":"2023-12-19T19:01:53.720753+0000","last_unstale":"2023-12-19T19:01:55.550608+0000","last_undegraded":"2023-12-19T19:01:55.550608+0000","last_fullsized":"2023-12-19T19:01:55.550608+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:50.098231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550767+0000","last_change":"2023-12-19T19:01:52.707438+0000","last_active":"2023-12-19T19:01:55.550767+0000","last_peered":"2023-12-19T19:01:55.550767+0000","last_clean":"2023-12-19T19:01:55.550767+0000","last_became_active":"2023-12-19T19:01:52.706766+0000","last_became_peered":"2023-12-19T19:01:52.706766+0000","last_unstale":"2023-12-19T19:01:55.550767+0000","last_undegraded":"2023-12-19T19:01:55.550767+0000","last_fullsized":"2023-12-19T19:01:55.550767+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:55:15.463085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.707567+0000","last_change":"2023-12-19T19:01:36.003446+0000","last_active":"2023-12-19T19:01:53.707567+0000","last_peered":"2023-12-19T19:01:53.707567+0000","last_clean":"2023-12-19T19:01:53.707567+0000","last_became_active":"2023-12-19T19:01:36.003111+0000","last_became_peered":"2023-12-19T19:01:36.003111+0000","last_unstale":"2023-12-19T19:01:53.707567+0000","last_undegraded":"2023-12-19T19:01:53.707567+0000","last_fullsized":"2023-12-19T19:01:53.707567+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:37:45.790125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.700150+0000","last_change":"2023-12-19T19:01:34.990870+0000","last_active":"2023-12-19T19:01:53.700150+0000","last_peered":"2023-12-19T19:01:53.700150+0000","last_clean":"2023-12-19T19:01:53.700150+0000","last_became_active":"2023-12-19T19:01:34.990513+0000","last_became_peered":"2023-12-19T19:01:34.990513+0000","last_unstale":"2023-12-19T19:01:53.700150+0000","last_undegraded":"2023-12-19T19:01:53.700150+0000","last_fullsized":"2023-12-19T19:01:53.700150+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:20:13.679462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.717097+0000","last_change":"2023-12-19T19:01:53.729273+0000","last_active":"2023-12-19T19:01:54.717097+0000","last_peered":"2023-12-19T19:01:54.717097+0000","last_clean":"2023-12-19T19:01:54.717097+0000","last_became_active":"2023-12-19T19:01:53.728974+0000","last_became_peered":"2023-12-19T19:01:53.728974+0000","last_unstale":"2023-12-19T19:01:54.717097+0000","last_undegraded":"2023-12-19T19:01:54.717097+0000","last_fullsized":"2023-12-19T19:01:54.717097+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:52:54.882324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550705+0000","last_change":"2023-12-19T19:01:52.711068+0000","last_active":"2023-12-19T19:01:55.550705+0000","last_peered":"2023-12-19T19:01:55.550705+0000","last_clean":"2023-12-19T19:01:55.550705+0000","last_became_active":"2023-12-19T19:01:52.710776+0000","last_became_peered":"2023-12-19T19:01:52.710776+0000","last_unstale":"2023-12-19T19:01:55.550705+0000","last_undegraded":"2023-12-19T19:01:55.550705+0000","last_fullsized":"2023-12-19T19:01:55.550705+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:54.392850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.699801+0000","last_change":"2023-12-19T19:01:35.998133+0000","last_active":"2023-12-19T19:01:53.699801+0000","last_peered":"2023-12-19T19:01:53.699801+0000","last_clean":"2023-12-19T19:01:53.699801+0000","last_became_active":"2023-12-19T19:01:35.997577+0000","last_became_peered":"2023-12-19T19:01:35.997577+0000","last_unstale":"2023-12-19T19:01:53.699801+0000","last_undegraded":"2023-12-19T19:01:53.699801+0000","last_fullsized":"2023-12-19T19:01:53.699801+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:06:09.368068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.702428+0000","last_change":"2023-12-19T19:01:34.994259+0000","last_active":"2023-12-19T19:01:53.702428+0000","last_peered":"2023-12-19T19:01:53.702428+0000","last_clean":"2023-12-19T19:01:53.702428+0000","last_became_active":"2023-12-19T19:01:34.992784+0000","last_became_peered":"2023-12-19T19:01:34.992784+0000","last_unstale":"2023-12-19T19:01:53.702428+0000","last_undegraded":"2023-12-19T19:01:53.702428+0000","last_fullsized":"2023-12-19T19:01:53.702428+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:06:56.928069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.550655+0000","last_change":"2023-12-19T19:01:53.722457+0000","last_active":"2023-12-19T19:01:55.550655+0000","last_peered":"2023-12-19T19:01:55.550655+0000","last_clean":"2023-12-19T19:01:55.550655+0000","last_became_active":"2023-12-19T19:01:53.722103+0000","last_became_peered":"2023-12-19T19:01:53.722103+0000","last_unstale":"2023-12-19T19:01:55.550655+0000","last_undegraded":"2023-12-19T19:01:55.550655+0000","last_fullsized":"2023-12-19T19:01:55.550655+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:23:43.559557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.552542+0000","last_change":"2023-12-19T19:01:52.704321+0000","last_active":"2023-12-19T19:01:55.552542+0000","last_peered":"2023-12-19T19:01:55.552542+0000","last_clean":"2023-12-19T19:01:55.552542+0000","last_became_active":"2023-12-19T19:01:52.704039+0000","last_became_peered":"2023-12-19T19:01:52.704039+0000","last_unstale":"2023-12-19T19:01:55.552542+0000","last_undegraded":"2023-12-19T19:01:55.552542+0000","last_fullsized":"2023-12-19T19:01:55.552542+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:04.973387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.697300+0000","last_change":"2023-12-19T19:01:36.014563+0000","last_active":"2023-12-19T19:01:53.697300+0000","last_peered":"2023-12-19T19:01:53.697300+0000","last_clean":"2023-12-19T19:01:53.697300+0000","last_became_active":"2023-12-19T19:01:36.014224+0000","last_became_peered":"2023-12-19T19:01:36.014224+0000","last_unstale":"2023-12-19T19:01:53.697300+0000","last_undegraded":"2023-12-19T19:01:53.697300+0000","last_fullsized":"2023-12-19T19:01:53.697300+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:20:14.686881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.717973+0000","last_change":"2023-12-19T19:01:35.001846+0000","last_active":"2023-12-19T19:01:53.717973+0000","last_peered":"2023-12-19T19:01:53.717973+0000","last_clean":"2023-12-19T19:01:53.717973+0000","last_became_active":"2023-12-19T19:01:35.000362+0000","last_became_peered":"2023-12-19T19:01:35.000362+0000","last_unstale":"2023-12-19T19:01:53.717973+0000","last_undegraded":"2023-12-19T19:01:53.717973+0000","last_fullsized":"2023-12-19T19:01:53.717973+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:37:44.782707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.049974+0000","last_change":"2023-12-19T19:01:53.724352+0000","last_active":"2023-12-19T19:01:55.049974+0000","last_peered":"2023-12-19T19:01:55.049974+0000","last_clean":"2023-12-19T19:01:55.049974+0000","last_became_active":"2023-12-19T19:01:53.724079+0000","last_became_peered":"2023-12-19T19:01:53.724079+0000","last_unstale":"2023-12-19T19:01:55.049974+0000","last_undegraded":"2023-12-19T19:01:55.049974+0000","last_fullsized":"2023-12-19T19:01:55.049974+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:03:01.607445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.717434+0000","last_change":"2023-12-19T19:01:52.705342+0000","last_active":"2023-12-19T19:01:54.717434+0000","last_peered":"2023-12-19T19:01:54.717434+0000","last_clean":"2023-12-19T19:01:54.717434+0000","last_became_active":"2023-12-19T19:01:52.705055+0000","last_became_peered":"2023-12-19T19:01:52.705055+0000","last_unstale":"2023-12-19T19:01:54.717434+0000","last_undegraded":"2023-12-19T19:01:54.717434+0000","last_fullsized":"2023-12-19T19:01:54.717434+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:05:00.157761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.717762+0000","last_change":"2023-12-19T19:01:35.989740+0000","last_active":"2023-12-19T19:01:53.717762+0000","last_peered":"2023-12-19T19:01:53.717762+0000","last_clean":"2023-12-19T19:01:53.717762+0000","last_became_active":"2023-12-19T19:01:35.989440+0000","last_became_peered":"2023-12-19T19:01:35.989440+0000","last_unstale":"2023-12-19T19:01:53.717762+0000","last_undegraded":"2023-12-19T19:01:53.717762+0000","last_fullsized":"2023-12-19T19:01:53.717762+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:53:03.688848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":16,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.700004+0000","last_change":"2023-12-19T19:01:34.998108+0000","last_active":"2023-12-19T19:01:53.700004+0000","last_peered":"2023-12-19T19:01:53.700004+0000","last_clean":"2023-12-19T19:01:53.700004+0000","last_became_active":"2023-12-19T19:01:34.997738+0000","last_became_peered":"2023-12-19T19:01:34.997738+0000","last_unstale":"2023-12-19T19:01:53.700004+0000","last_undegraded":"2023-12-19T19:01:53.700004+0000","last_fullsized":"2023-12-19T19:01:53.700004+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:08:57.128528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:55.551596+0000","last_change":"2023-12-19T19:01:53.715985+0000","last_active":"2023-12-19T19:01:55.551596+0000","last_peered":"2023-12-19T19:01:55.551596+0000","last_clean":"2023-12-19T19:01:55.551596+0000","last_became_active":"2023-12-19T19:01:53.715632+0000","last_became_peered":"2023-12-19T19:01:53.715632+0000","last_unstale":"2023-12-19T19:01:55.551596+0000","last_undegraded":"2023-12-19T19:01:55.551596+0000","last_fullsized":"2023-12-19T19:01:55.551596+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":71,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:52.670549+0000","last_clean_scrub_stamp":"2023-12-19T19:01:52.670549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:27:22.529562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"72'1","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-12-19T19:01:54.716584+0000","last_change":"2023-12-19T19:01:52.700527+0000","last_active":"2023-12-19T19:01:54.716584+0000","last_peered":"2023-12-19T19:01:54.716584+0000","last_clean":"2023-12-19T19:01:54.716584+0000","last_became_active":"2023-12-19T19:01:52.699777+0000","last_became_peered":"2023-12-19T19:01:52.699777+0000","last_unstale":"2023-12-19T19:01:54.716584+0000","last_undegraded":"2023-12-19T19:01:54.716584+0000","last_fullsized":"2023-12-19T19:01:54.716584+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:51.664396+0000","last_clean_scrub_stamp":"2023-12-19T19:01:51.664396+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:19:26.599520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":15,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.695349+0000","last_change":"2023-12-19T19:01:35.997204+0000","last_active":"2023-12-19T19:01:53.695349+0000","last_peered":"2023-12-19T19:01:53.695349+0000","last_clean":"2023-12-19T19:01:53.695349+0000","last_became_active":"2023-12-19T19:01:35.996928+0000","last_became_peered":"2023-12-19T19:01:35.996928+0000","last_unstale":"2023-12-19T19:01:53.695349+0000","last_undegraded":"2023-12-19T19:01:53.695349+0000","last_fullsized":"2023-12-19T19:01:53.695349+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:34.962160+0000","last_clean_scrub_stamp":"2023-12-19T19:01:34.962160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:56:32.389842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"68'1","reported_seq":17,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.699839+0000","last_change":"2023-12-19T19:01:34.999764+0000","last_active":"2023-12-19T19:01:53.699839+0000","last_peered":"2023-12-19T19:01:53.699839+0000","last_clean":"2023-12-19T19:01:53.699839+0000","last_became_active":"2023-12-19T19:01:34.998931+0000","last_became_peered":"2023-12-19T19:01:34.998931+0000","last_unstale":"2023-12-19T19:01:53.699839+0000","last_undegraded":"2023-12-19T19:01:53.699839+0000","last_fullsized":"2023-12-19T19:01:53.699839+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T19:01:33.954742+0000","last_clean_scrub_stamp":"2023-12-19T19:01:33.954742+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:36.470347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":219,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-12-19T19:01:53.697411+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T19:01:53.697411+0000","last_peered":"2023-12-19T19:01:53.697411+0000","last_clean":"2023-12-19T19:01:53.697411+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T19:01:53.697411+0000","last_undegraded":"2023-12-19T19:01:53.697411+0000","last_fullsized":"2023-12-19T19:01:53.697411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32656,"kb_used_data":1468,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339184,"statfs":{"total":96636764160,"available":96603324416,"internally_reserved":0,"allocated":1503232,"data_stored":989237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.68899999999999995},"min":{"1min":0.44,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92500000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.72399999999999998},"min":{"1min":0.50700000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89300000000000002,"5min":1.117,"15min":1.117},"last":0.75800000000000001}]},{"osd":1,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.46700000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83899999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83399999999999996,"5min":1.01,"15min":1.01},"last":0.71999999999999997}]},{"osd":2,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85499999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.58299999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89500000000000002,"5min":1.089,"15min":1.089},"last":0.74199999999999999}]},{"osd":3,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71299999999999997,"15min":0.72699999999999998},"min":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90900000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73299999999999998,"15min":0.73499999999999999},"min":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91600000000000004,"5min":1.026,"15min":1.026},"last":0.68300000000000005}]},{"osd":4,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64400000000000002,"15min":0.65600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88500000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.625},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66700000000000004,"15min":0.67400000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93799999999999994,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.56499999999999995}]},{"osd":5,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93200000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.70599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91500000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.79300000000000004}]},{"osd":6,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.96799999999999997,"5min":1.069,"15min":1.069},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78000000000000003,"15min":0.79600000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.80800000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574892,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339760,"statfs":{"total":96636764160,"available":96603914240,"internally_reserved":0,"allocated":917504,"data_stored":400033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.98899999999999999,"5min":1.022,"15min":1.022},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.89800000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.501}]},{"osd":1,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67100000000000004,"15min":0.65700000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.871,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.52300000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91500000000000004,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.71799999999999997}]},{"osd":2,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.443,"5min":0.437,"15min":0.437},"max":{"1min":0.96299999999999997,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.627},{"interface":"front","average":{"1min":0.745,"5min":0.71999999999999997,"15min":0.71699999999999997},"min":{"1min":0.58099999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94899999999999995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.46000000000000002}]},{"osd":3,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83499999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.442},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72199999999999998,"15min":0.72699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91900000000000004,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.54800000000000004}]},{"osd":4,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.48599999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.74099999999999999,"15min":0.755},"min":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95999999999999996,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.58099999999999996}]},{"osd":5,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.93700000000000006,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73199999999999998,"15min":0.73599999999999999},"min":{"1min":0.54600000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.70399999999999996}]},{"osd":7,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.52800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":905216,"data_stored":394729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.84399999999999997,"15min":0.92900000000000005},"min":{"1min":0.434,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90900000000000003,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":1.1739999999999999,"15min":1.3959999999999999},"min":{"1min":0.495,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86199999999999999,"5min":16.951000000000001,"15min":16.951000000000001},"last":0.56000000000000005}]},{"osd":1,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":1.222,"15min":1.48},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98299999999999998,"5min":19.823,"15min":19.823},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.67200000000000004},"min":{"1min":0.45800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95899999999999996,"5min":1.657,"15min":1.657},"last":0.71699999999999997}]},{"osd":2,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72899999999999998,"15min":0.751},"min":{"1min":0.47599999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92300000000000004,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71599999999999997,"15min":0.73299999999999998},"min":{"1min":0.49399999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93700000000000006,"5min":1.585,"15min":1.585},"last":0.79300000000000004}]},{"osd":3,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76700000000000002,"15min":0.78700000000000003},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.97199999999999998,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.91200000000000003,"15min":0.99399999999999999},"min":{"1min":0.58799999999999997,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.89400000000000002,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":0.74299999999999999}]},{"osd":4,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.46300000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92600000000000005,"5min":1.716,"15min":1.716},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.78700000000000003,"15min":0.82299999999999995},"min":{"1min":0.50700000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91700000000000004,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":0.85999999999999999}]},{"osd":6,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.78500000000000003,"15min":0.83699999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85299999999999998,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.79900000000000004,"15min":0.83599999999999997},"min":{"1min":0.52000000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86899999999999999,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.81000000000000005}]},{"osd":7,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96099999999999997,"5min":2.371,"15min":2.371},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81399999999999995,"15min":0.84099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93500000000000005,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.83999999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":917504,"data_stored":400423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.79300000000000004,"15min":0.85899999999999999},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92600000000000005,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67700000000000005,"15min":0.69099999999999995},"min":{"1min":0.47499999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83599999999999997,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.89900000000000002}]},{"osd":1,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.68600000000000005,"15min":0.69799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85399999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.76500000000000001,"15min":0.79800000000000004},"min":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.86399999999999999,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":0.91300000000000003}]},{"osd":2,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.69199999999999995},"min":{"1min":0.504,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.872,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.76600000000000001,"15min":0.80800000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86399999999999999,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.84399999999999997}]},{"osd":3,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.78200000000000003,"15min":0.83599999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.874,"5min":3.641,"15min":3.641},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.83299999999999996,"15min":0.88500000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91200000000000003,"5min":3.194,"15min":3.194},"last":0.76800000000000002}]},{"osd":5,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.92200000000000004,"15min":1.054},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89200000000000002,"5min":9.3040000000000003,"15min":9.3040000000000003},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69599999999999995,"15min":0.73199999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90800000000000003,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.80600000000000005}]},{"osd":6,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.78700000000000003,"15min":0.83199999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92700000000000005,"5min":3.097,"15min":3.097},"last":1.002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.82299999999999995,"15min":0.877},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89700000000000002,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.95699999999999996}]},{"osd":7,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.879,"15min":0.95899999999999996},"min":{"1min":0.48399999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93200000000000005,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.87},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.95399999999999996,"15min":1.052},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94299999999999995,"5min":6.3449999999999998,"15min":6.3449999999999998},"last":0.88300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":925696,"data_stored":403428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72699999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.36099999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.45200000000000001}]},{"osd":1,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46700000000000003,"15min":0.48499999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60699999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.50600000000000001}]},{"osd":2,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.74299999999999999,"5min":0.75,"15min":0.75},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.54700000000000004},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77600000000000002,"5min":0.875,"15min":0.875},"last":0.47099999999999997}]},{"osd":4,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88400000000000001,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98999999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.67900000000000005}]},{"osd":5,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.50600000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94999999999999996,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.752,"15min":0.77000000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.04,"5min":1.202,"15min":1.202},"last":0.61299999999999999}]},{"osd":6,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96399999999999997,"5min":1.298,"15min":1.298},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.98299999999999998,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.72299999999999998}]},{"osd":7,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94999999999999996,"5min":1.155,"15min":1.155},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93000000000000005,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.755}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":905216,"data_stored":399303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.47399999999999998,"15min":0.5},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53700000000000003,"5min":1.458,"15min":1.458},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.56999999999999995,"15min":0.622},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68799999999999994,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.34799999999999998}]},{"osd":1,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.54600000000000004,"15min":0.58799999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.56899999999999995,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.56799999999999995,"15min":0.61199999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.625,"5min":2.444,"15min":2.444},"last":0.39700000000000002}]},{"osd":3,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.55400000000000005,"15min":0.60599999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.60899999999999999,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.58999999999999997,"15min":0.63200000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65500000000000003,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.52200000000000002}]},{"osd":4,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.88600000000000001,"15min":0.95699999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0189999999999999,"5min":1.968,"15min":1.968},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.84999999999999998,"15min":0.91000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96899999999999997,"5min":2.835,"15min":2.835},"last":0.65100000000000002}]},{"osd":5,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.86399999999999999,"15min":0.93300000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.99099999999999999,"5min":3.5,"15min":3.5},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.86499999999999999,"15min":0.92500000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94999999999999996,"5min":1.996,"15min":1.996},"last":0.63500000000000001}]},{"osd":6,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.86699999999999999,"15min":0.93200000000000005},"min":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0740000000000001,"5min":2.903,"15min":2.903},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.93000000000000005,"15min":1.0129999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0569999999999999,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.78400000000000003}]},{"osd":7,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.90300000000000002,"15min":0.97099999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1259999999999999,"5min":2.875,"15min":2.875},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.88200000000000001,"15min":0.96099999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95199999999999996,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.75700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32076,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339764,"statfs":{"total":96636764160,"available":96603918336,"internally_reserved":0,"allocated":909312,"data_stored":398881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.51800000000000002,"15min":0.56999999999999995},"min":{"1min":0.29699999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73399999999999999,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.443,"5min":0.67100000000000004,"15min":0.77500000000000002},"min":{"1min":0.31,"5min":0.255,"15min":0.255},"max":{"1min":0.76700000000000002,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.46300000000000002}]},{"osd":2,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.53900000000000003,"15min":0.58499999999999996},"min":{"1min":0.317,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71799999999999997,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.379},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.61099999999999999,"15min":0.67400000000000004},"min":{"1min":0.34699999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76800000000000002,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.503}]},{"osd":3,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.72299999999999998,"15min":0.81899999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.90700000000000003,"5min":7.8399999999999999,"15min":7.8399999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.746,"15min":0.83799999999999997},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83699999999999997,"5min":7.7949999999999999,"15min":7.7949999999999999},"last":0.48299999999999998}]},{"osd":4,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.81899999999999995,"15min":0.88300000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.871,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.85199999999999998,"15min":0.91400000000000003},"min":{"1min":0.52300000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89300000000000002,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.76300000000000001}]},{"osd":5,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.82999999999999996,"15min":0.89200000000000002},"min":{"1min":0.49399999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93300000000000005,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.84099999999999997,"15min":0.90300000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.996,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.99299999999999999}]},{"osd":6,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.84799999999999998,"15min":0.89600000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95599999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.876,"15min":0.95099999999999996},"min":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.85499999999999998,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.70899999999999996}]},{"osd":7,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.88300000000000001,"15min":0.94999999999999996},"min":{"1min":0.51600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.83299999999999996,"5min":4.3310000000000004,"15min":4.3310000000000004},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.85899999999999999,"15min":0.90900000000000003},"min":{"1min":0.55100000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.92100000000000004,"5min":4.226,"15min":4.226},"last":0.97399999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1482752,"data_stored":981495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.436,"15min":0.44800000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60299999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48899999999999999,"15min":0.503},"min":{"1min":0.29799999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65700000000000003,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.437}]},{"osd":2,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.50600000000000001,"15min":0.51300000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63700000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.51100000000000001},"min":{"1min":0.40799999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.39500000000000002}]},{"osd":3,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48199999999999998,"15min":0.48699999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.55900000000000005,"5min":0.747,"15min":0.747},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.57799999999999996,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69299999999999995,"5min":1.264,"15min":1.264},"last":0.372}]},{"osd":4,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.74199999999999999,"15min":0.748},"min":{"1min":0.502,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93999999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89900000000000002,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.65400000000000003}]},{"osd":5,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.749},"min":{"1min":0.57299999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.89300000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79200000000000004,"15min":0.81699999999999995},"min":{"1min":0.57199999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.91000000000000003,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.72799999999999998}]},{"osd":6,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.79600000000000004,"15min":0.82499999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92600000000000005,"5min":1.349,"15min":1.349},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0189999999999999,"5min":1.115,"15min":1.115},"last":0.56399999999999995}]},{"osd":7,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.57499999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94899999999999995,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.747,"5min":0.79200000000000004,"15min":0.81200000000000006},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.93200000000000005,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.71399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T19:01:58.177 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T19:01:58.177 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2023-12-19T19:01:58.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.352+0000 7f874de5a640 1 Processor -- start 2023-12-19T19:01:58.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.352+0000 7f874de5a640 1 -- start start 2023-12-19T19:01:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.356+0000 7f874de5a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f874814b010 0x7f87480bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.356+0000 7f874de5a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8748073a70 0x7f874806b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.356+0000 7f874de5a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f874806b540 0x7f8748157c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.356+0000 7f874de5a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f874806a5b0 con 0x7f874806b540 2023-12-19T19:01:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.356+0000 7f874de5a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87480c1d60 con 0x7f8748073a70 2023-12-19T19:01:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.356+0000 7f874de5a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87480c2040 con 0x7f874814b010 2023-12-19T19:01:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.356+0000 7f8747fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f874806b540 0x7f8748157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:58.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.356+0000 7f8747fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f874806b540 0x7f8748157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34840/0 (socket says 172.21.15.133:34840) 2023-12-19T19:01:58.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.356+0000 7f8747fff640 1 -- 172.21.15.133:0/3750696679 learned_addr learned my addr 172.21.15.133:0/3750696679 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:58.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.356+0000 7f87477fe640 1 --2- 172.21.15.133:0/3750696679 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f874814b010 0x7f87480bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:58.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.356+0000 7f8746ffd640 1 --2- 172.21.15.133:0/3750696679 >> v2:172.21.15.138:3300/0 conn(0x7f8748073a70 0x7f874806b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:58.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.356+0000 7f8747fff640 1 -- 172.21.15.133:0/3750696679 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f874814b010 msgr2=0x7f87480bf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:58.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.356+0000 7f8747fff640 1 --2- 172.21.15.133:0/3750696679 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f874814b010 0x7f87480bf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.356+0000 7f8747fff640 1 -- 172.21.15.133:0/3750696679 >> v2:172.21.15.138:3300/0 conn(0x7f8748073a70 msgr2=0x7f874806b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:58.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.356+0000 7f8747fff640 1 --2- 172.21.15.133:0/3750696679 >> v2:172.21.15.138:3300/0 conn(0x7f8748073a70 0x7f874806b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.356+0000 7f8747fff640 1 -- 172.21.15.133:0/3750696679 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874806a800 con 0x7f874806b540 2023-12-19T19:01:58.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.360+0000 7f8747fff640 1 --2- 172.21.15.133:0/3750696679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f874806b540 0x7f8748157c20 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f8748066e40 tx=0x7f874001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26d53b0a56dc6a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.360+0000 7f87467fc640 1 -- 172.21.15.133:0/3750696679 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87400af400 con 0x7f874806b540 2023-12-19T19:01:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.360+0000 7f87467fc640 1 -- 172.21.15.133:0/3750696679 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87400ab050 con 0x7f874806b540 2023-12-19T19:01:58.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.360+0000 7f87467fc640 1 -- 172.21.15.133:0/3750696679 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87400af780 con 0x7f874806b540 2023-12-19T19:01:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.360+0000 7f874de5a640 1 -- 172.21.15.133:0/3750696679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f874806b540 msgr2=0x7f8748157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.360+0000 7f874de5a640 1 --2- 172.21.15.133:0/3750696679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f874806b540 0x7f8748157c20 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f8748066e40 tx=0x7f874001f1c0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.360+0000 7f874de5a640 1 -- 172.21.15.133:0/3750696679 shutdown_connections 2023-12-19T19:01:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.360+0000 7f874de5a640 1 --2- 172.21.15.133:0/3750696679 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f874806b540 0x7f8748157c20 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.360+0000 7f874de5a640 1 --2- 172.21.15.133:0/3750696679 >> v2:172.21.15.138:3300/0 conn(0x7f8748073a70 0x7f874806b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.360+0000 7f874de5a640 1 --2- 172.21.15.133:0/3750696679 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f874814b010 0x7f87480bf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.360+0000 7f874de5a640 1 -- 172.21.15.133:0/3750696679 >> 172.21.15.133:0/3750696679 conn(0x7f87480c30c0 msgr2=0x7f87480c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.360+0000 7f874de5a640 1 -- 172.21.15.133:0/3750696679 shutdown_connections 2023-12-19T19:01:58.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.360+0000 7f874de5a640 1 -- 172.21.15.133:0/3750696679 wait complete. 2023-12-19T19:01:58.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.360+0000 7f874de5a640 1 Processor -- start 2023-12-19T19:01:58.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.360+0000 7f874de5a640 1 -- start start 2023-12-19T19:01:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f874de5a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8748073a70 0x7f874814d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f874de5a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f874814b010 0x7f8748146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f874de5a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87481e7900 0x7f87481e9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f874de5a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87481e9890 con 0x7f874814b010 2023-12-19T19:01:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f874de5a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87481ea8f0 con 0x7f8748073a70 2023-12-19T19:01:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f874de5a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87480a98f0 con 0x7f87481e7900 2023-12-19T19:01:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f8746ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f874814b010 0x7f8748146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f8746ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f874814b010 0x7f8748146be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34850/0 (socket says 172.21.15.133:34850) 2023-12-19T19:01:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f8746ffd640 1 -- 172.21.15.133:0/2796880269 learned_addr learned my addr 172.21.15.133:0/2796880269 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f87477fe640 1 --2- 172.21.15.133:0/2796880269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8748073a70 0x7f874814d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:58.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f8747fff640 1 --2- 172.21.15.133:0/2796880269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87481e7900 0x7f87481e9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f8746ffd640 1 -- 172.21.15.133:0/2796880269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87481e7900 msgr2=0x7f87481e9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f8746ffd640 1 --2- 172.21.15.133:0/2796880269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87481e7900 0x7f87481e9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f8746ffd640 1 -- 172.21.15.133:0/2796880269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8748073a70 msgr2=0x7f874814d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f8746ffd640 1 --2- 172.21.15.133:0/2796880269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8748073a70 0x7f874814d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f8746ffd640 1 -- 172.21.15.133:0/2796880269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8740009b30 con 0x7f874814b010 2023-12-19T19:01:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f8746ffd640 1 --2- 172.21.15.133:0/2796880269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f874814b010 0x7f8748146be0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f873c00d830 tx=0x7f873c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f872ffff640 1 -- 172.21.15.133:0/2796880269 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c0096a0 con 0x7f874814b010 2023-12-19T19:01:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f872ffff640 1 -- 172.21.15.133:0/2796880269 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873c009800 con 0x7f874814b010 2023-12-19T19:01:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f872ffff640 1 -- 172.21.15.133:0/2796880269 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873c009b70 con 0x7f874814b010 2023-12-19T19:01:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f874de5a640 1 -- 172.21.15.133:0/2796880269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87480a9bd0 con 0x7f874814b010 2023-12-19T19:01:58.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f874de5a640 1 -- 172.21.15.133:0/2796880269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874814d1f0 con 0x7f874814b010 2023-12-19T19:01:58.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f874de5a640 1 -- 172.21.15.133:0/2796880269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8748068400 con 0x7f874814b010 2023-12-19T19:01:58.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.364+0000 7f872ffff640 1 -- 172.21.15.133:0/2796880269 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f873c014410 con 0x7f874814b010 2023-12-19T19:01:58.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.368+0000 7f872ffff640 1 --2- 172.21.15.133:0/2796880269 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f87340664a0 0x7f8734068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:58.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.368+0000 7f872ffff640 1 -- 172.21.15.133:0/2796880269 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f873c084af0 con 0x7f874814b010 2023-12-19T19:01:58.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.368+0000 7f87477fe640 1 --2- 172.21.15.133:0/2796880269 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f87340664a0 0x7f8734068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:58.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.368+0000 7f87477fe640 1 --2- 172.21.15.133:0/2796880269 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f87340664a0 0x7f8734068960 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f873800b930 tx=0x7f8738008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:58.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.372+0000 7f872ffff640 1 -- 172.21.15.133:0/2796880269 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f873c051c00 con 0x7f874814b010 2023-12-19T19:01:58.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.572+0000 7f874de5a640 1 -- 172.21.15.133:0/2796880269 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f8748073850 con 0x7f874814b010 2023-12-19T19:01:58.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.576+0000 7f872ffff640 1 -- 172.21.15.133:0/2796880269 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v20) v1 ==== 185+0+142 (secure 0 0 0) 0x7f873c055220 con 0x7f874814b010 2023-12-19T19:01:58.580 INFO:teuthology.orchestra.run.smithi133.stdout:[client.1] 2023-12-19T19:01:58.581 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCn54Fl4bbAOhAA4WXKbT5uizIcy0OTOKIaag== 2023-12-19T19:01:58.581 INFO:teuthology.orchestra.run.smithi133.stdout: caps mds = "allow" 2023-12-19T19:01:58.581 INFO:teuthology.orchestra.run.smithi133.stdout: caps mon = "allow r" 2023-12-19T19:01:58.581 INFO:teuthology.orchestra.run.smithi133.stdout: caps osd = "allow rw pool=cephfs2_data" 2023-12-19T19:01:58.581 INFO:teuthology.orchestra.run.smithi133.stderr:updated caps for client.1 2023-12-19T19:01:58.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.576+0000 7f874de5a640 1 -- 172.21.15.133:0/2796880269 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f87340664a0 msgr2=0x7f8734068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:58.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.576+0000 7f874de5a640 1 --2- 172.21.15.133:0/2796880269 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f87340664a0 0x7f8734068960 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f873800b930 tx=0x7f8738008040 comp rx=0 tx=0).stop 2023-12-19T19:01:58.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.576+0000 7f874de5a640 1 -- 172.21.15.133:0/2796880269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f874814b010 msgr2=0x7f8748146be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:58.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.576+0000 7f874de5a640 1 --2- 172.21.15.133:0/2796880269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f874814b010 0x7f8748146be0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f873c00d830 tx=0x7f873c00dcf0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.576+0000 7f874de5a640 1 -- 172.21.15.133:0/2796880269 shutdown_connections 2023-12-19T19:01:58.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.576+0000 7f874de5a640 1 --2- 172.21.15.133:0/2796880269 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f87340664a0 0x7f8734068960 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.576+0000 7f874de5a640 1 --2- 172.21.15.133:0/2796880269 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f87481e7900 0x7f87481e9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.576+0000 7f874de5a640 1 --2- 172.21.15.133:0/2796880269 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f874814b010 0x7f8748146be0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.576+0000 7f874de5a640 1 --2- 172.21.15.133:0/2796880269 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8748073a70 0x7f874814d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.576+0000 7f874de5a640 1 -- 172.21.15.133:0/2796880269 >> 172.21.15.133:0/2796880269 conn(0x7f87480c30c0 msgr2=0x7f87480c5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:58.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.576+0000 7f874de5a640 1 -- 172.21.15.133:0/2796880269 shutdown_connections 2023-12-19T19:01:58.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.576+0000 7f874de5a640 1 -- 172.21.15.133:0/2796880269 wait complete. 2023-12-19T19:01:58.602 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:01:58.603 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:01:58.612 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:01:58.613 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:01:58.668 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:01:58.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.804+0000 7fea37a79640 1 Processor -- start 2023-12-19T19:01:58.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.804+0000 7fea37a79640 1 -- start start 2023-12-19T19:01:58.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.804+0000 7fea37a79640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fea300c63c0 0x7fea300c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:58.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.804+0000 7fea37a79640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fea300c2bb0 0x7fea300a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:58.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.804+0000 7fea37a79640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea300c31c0 con 0x7fea300c4100 2023-12-19T19:01:58.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.804+0000 7fea37a79640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea300c34a0 con 0x7fea300c63c0 2023-12-19T19:01:58.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.804+0000 7fea37a79640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea300c1030 con 0x7fea300c2bb0 2023-12-19T19:01:58.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.804+0000 7fea35815640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fea300c63c0 0x7fea300c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:58.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.804+0000 7fea35815640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fea300c63c0 0x7fea300c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34862/0 (socket says 172.21.15.133:34862) 2023-12-19T19:01:58.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.804+0000 7fea35815640 1 -- 172.21.15.133:0/2304917005 learned_addr learned my addr 172.21.15.133:0/2304917005 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:58.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.804+0000 7fea36016640 1 --2- 172.21.15.133:0/2304917005 >> v2:172.21.15.138:3300/0 conn(0x7fea300c2bb0 0x7fea300a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:58.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.804+0000 7fea35815640 1 -- 172.21.15.133:0/2304917005 >> v2:172.21.15.138:3300/0 conn(0x7fea300c2bb0 msgr2=0x7fea300a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:58.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.804+0000 7fea35815640 1 --2- 172.21.15.133:0/2304917005 >> v2:172.21.15.138:3300/0 conn(0x7fea300c2bb0 0x7fea300a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.804+0000 7fea35815640 1 -- 172.21.15.133:0/2304917005 >> v1:172.21.15.138:6789/0 conn(0x7fea300c4100 legacy=0x7fea300c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:58.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.804+0000 7fea35815640 1 -- 172.21.15.133:0/2304917005 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea300c1310 con 0x7fea300c63c0 2023-12-19T19:01:58.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.804+0000 7fea36016640 1 --2- 172.21.15.133:0/2304917005 >> v2:172.21.15.138:3300/0 conn(0x7fea300c2bb0 0x7fea300a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:01:58.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.808+0000 7fea35815640 1 --2- 172.21.15.133:0/2304917005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea300c63c0 0x7fea300c06d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fea300c4550 tx=0x7fea2c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb5a6c236db900d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:58.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.808+0000 7fea34813640 1 -- 172.21.15.133:0/2304917005 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea300aa3d0 con 0x7fea300c63c0 2023-12-19T19:01:58.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.808+0000 7fea34813640 1 -- 172.21.15.133:0/2304917005 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2c0ac620 con 0x7fea300c63c0 2023-12-19T19:01:58.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.808+0000 7fea34813640 1 -- 172.21.15.133:0/2304917005 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c0ac9b0 con 0x7fea300c63c0 2023-12-19T19:01:58.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.808+0000 7fea37a79640 1 -- 172.21.15.133:0/2304917005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea300c63c0 msgr2=0x7fea300c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:58.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.808+0000 7fea37a79640 1 --2- 172.21.15.133:0/2304917005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea300c63c0 0x7fea300c06d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fea300c4550 tx=0x7fea2c01c3a0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.808+0000 7fea37a79640 1 -- 172.21.15.133:0/2304917005 shutdown_connections 2023-12-19T19:01:58.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.808+0000 7fea37a79640 1 --2- 172.21.15.133:0/2304917005 >> v2:172.21.15.138:3300/0 conn(0x7fea300c2bb0 0x7fea300a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.808+0000 7fea37a79640 1 --2- 172.21.15.133:0/2304917005 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea300c63c0 0x7fea300c06d0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.808+0000 7fea37a79640 1 -- 172.21.15.133:0/2304917005 >> 172.21.15.133:0/2304917005 conn(0x7fea3006a5b0 msgr2=0x7fea3006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:58.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.808+0000 7fea37a79640 1 -- 172.21.15.133:0/2304917005 shutdown_connections 2023-12-19T19:01:58.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.808+0000 7fea37a79640 1 -- 172.21.15.133:0/2304917005 wait complete. 2023-12-19T19:01:58.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea37a79640 1 Processor -- start 2023-12-19T19:01:58.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea37a79640 1 -- start start 2023-12-19T19:01:58.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea37a79640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea300c2bb0 0x7fea30070820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:58.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea37a79640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea300c4100 0x7fea3014b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:58.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea37a79640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea300c63c0 0x7fea3014bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:58.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea37a79640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3014c2c0 con 0x7fea300c4100 2023-12-19T19:01:58.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea37a79640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3014d190 con 0x7fea300c63c0 2023-12-19T19:01:58.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea37a79640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea300a9680 con 0x7fea300c2bb0 2023-12-19T19:01:58.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea35014640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea300c4100 0x7fea3014b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:58.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea35014640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea300c4100 0x7fea3014b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34870/0 (socket says 172.21.15.133:34870) 2023-12-19T19:01:58.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea35014640 1 -- 172.21.15.133:0/1373923081 learned_addr learned my addr 172.21.15.133:0/1373923081 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:58.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea35815640 1 --2- 172.21.15.133:0/1373923081 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea300c2bb0 0x7fea30070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:58.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea36016640 1 --2- 172.21.15.133:0/1373923081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea300c63c0 0x7fea3014bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:58.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea35014640 1 -- 172.21.15.133:0/1373923081 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea300c2bb0 msgr2=0x7fea30070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:58.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea35014640 1 --2- 172.21.15.133:0/1373923081 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea300c2bb0 0x7fea30070820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea35014640 1 -- 172.21.15.133:0/1373923081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea300c63c0 msgr2=0x7fea3014bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:58.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea35014640 1 --2- 172.21.15.133:0/1373923081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea300c63c0 0x7fea3014bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea35014640 1 -- 172.21.15.133:0/1373923081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea2c0094d0 con 0x7fea300c4100 2023-12-19T19:01:58.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea36016640 1 --2- 172.21.15.133:0/1373923081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea300c63c0 0x7fea3014bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:58.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea35014640 1 --2- 172.21.15.133:0/1373923081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea300c4100 0x7fea3014b7e0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fea2000c450 tx=0x7fea2000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:58.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea267fc640 1 -- 172.21.15.133:0/1373923081 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea20012830 con 0x7fea300c4100 2023-12-19T19:01:58.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea267fc640 1 -- 172.21.15.133:0/1373923081 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea200129b0 con 0x7fea300c4100 2023-12-19T19:01:58.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea37a79640 1 -- 172.21.15.133:0/1373923081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea301e9680 con 0x7fea300c4100 2023-12-19T19:01:58.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea267fc640 1 -- 172.21.15.133:0/1373923081 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea20012d60 con 0x7fea300c4100 2023-12-19T19:01:58.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea37a79640 1 -- 172.21.15.133:0/1373923081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea30071a30 con 0x7fea300c4100 2023-12-19T19:01:58.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.812+0000 7fea37a79640 1 -- 172.21.15.133:0/1373923081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea3014d300 con 0x7fea300c4100 2023-12-19T19:01:58.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.816+0000 7fea267fc640 1 -- 172.21.15.133:0/1373923081 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fea2001c460 con 0x7fea300c4100 2023-12-19T19:01:58.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.816+0000 7fea267fc640 1 --2- 172.21.15.133:0/1373923081 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fea14066470 0x7fea14068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:58.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.816+0000 7fea267fc640 1 -- 172.21.15.133:0/1373923081 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fea20083ff0 con 0x7fea300c4100 2023-12-19T19:01:58.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.816+0000 7fea35815640 1 --2- 172.21.15.133:0/1373923081 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fea14066470 0x7fea14068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:58.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.816+0000 7fea35815640 1 --2- 172.21.15.133:0/1373923081 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fea14066470 0x7fea14068930 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fea2c0ae000 tx=0x7fea2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:58.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.820+0000 7fea267fc640 1 -- 172.21.15.133:0/1373923081 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fea200b5290 con 0x7fea300c4100 2023-12-19T19:01:58.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.972+0000 7fea37a79640 1 -- 172.21.15.133:0/1373923081 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea30068400 con 0x7fea300c4100 2023-12-19T19:01:58.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.972+0000 7fea267fc640 1 -- 172.21.15.133:0/1373923081 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+20250 (secure 0 0 0) 0x7fea20051120 con 0x7fea300c4100 2023-12-19T19:01:58.977 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:01:58.977 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":73,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:01:54.705538+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:01:33.082188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T19:01:34.349092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:01:50.875086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:01:52.061232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:01:58.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.972+0000 7fea37a79640 1 -- 172.21.15.133:0/1373923081 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fea14066470 msgr2=0x7fea14068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:58.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.972+0000 7fea37a79640 1 --2- 172.21.15.133:0/1373923081 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fea14066470 0x7fea14068930 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fea2c0ae000 tx=0x7fea2c008040 comp rx=0 tx=0).stop 2023-12-19T19:01:58.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.972+0000 7fea37a79640 1 -- 172.21.15.133:0/1373923081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea300c4100 msgr2=0x7fea3014b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:58.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.972+0000 7fea37a79640 1 --2- 172.21.15.133:0/1373923081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea300c4100 0x7fea3014b7e0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fea2000c450 tx=0x7fea2000c910 comp rx=0 tx=0).stop 2023-12-19T19:01:58.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.976+0000 7fea37a79640 1 -- 172.21.15.133:0/1373923081 shutdown_connections 2023-12-19T19:01:58.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.976+0000 7fea37a79640 1 --2- 172.21.15.133:0/1373923081 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fea14066470 0x7fea14068930 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.976+0000 7fea37a79640 1 --2- 172.21.15.133:0/1373923081 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fea300c63c0 0x7fea3014bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.976+0000 7fea37a79640 1 --2- 172.21.15.133:0/1373923081 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fea300c4100 0x7fea3014b7e0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.976+0000 7fea37a79640 1 --2- 172.21.15.133:0/1373923081 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fea300c2bb0 0x7fea30070820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:58.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.976+0000 7fea37a79640 1 -- 172.21.15.133:0/1373923081 >> 172.21.15.133:0/1373923081 conn(0x7fea3006a5b0 msgr2=0x7fea3015b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:58.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.976+0000 7fea37a79640 1 -- 172.21.15.133:0/1373923081 shutdown_connections 2023-12-19T19:01:58.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:58.976+0000 7fea37a79640 1 -- 172.21.15.133:0/1373923081 wait complete. 2023-12-19T19:01:58.999 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T19:01:33.082188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T19:01:34.349092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-19T19:01:50.875086+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-19T19:01:52.061232+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T19:01:59.000 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T19:01:59.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac73357640 1 Processor -- start 2023-12-19T19:01:59.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac73357640 1 -- start start 2023-12-19T19:01:59.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac73357640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fac6c0a5240 0x7fac6c0bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:59.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac73357640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac6c0c01c0 0x7fac6c0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:59.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac73357640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac6c0c3bd0 con 0x7fac6c0c61a0 2023-12-19T19:01:59.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac73357640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac6c0bf1e0 con 0x7fac6c0a5240 2023-12-19T19:01:59.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac73357640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c0c3e20 con 0x7fac6c0c01c0 2023-12-19T19:01:59.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac718f4640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fac6c0c61a0 0x7fac6c1561f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:57998/0 (socket says 172.21.15.133:57998) 2023-12-19T19:01:59.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac718f4640 1 -- 172.21.15.133:0/1134889967 learned_addr learned my addr 172.21.15.133:0/1134889967 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:59.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac710f3640 1 --2- 172.21.15.133:0/1134889967 >> v2:172.21.15.138:3300/0 conn(0x7fac6c0a5240 0x7fac6c0bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:59.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac708f2640 1 --2- 172.21.15.133:0/1134889967 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac6c0c01c0 0x7fac6c0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:59.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac63fff640 1 -- 172.21.15.133:0/1134889967 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633729695 0 0) 0x7fac6c0c3bd0 con 0x7fac6c0c61a0 2023-12-19T19:01:59.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac63fff640 1 -- 172.21.15.133:0/1134889967 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac58003530 con 0x7fac6c0c61a0 2023-12-19T19:01:59.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac63fff640 1 -- 172.21.15.133:0/1134889967 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 62414180 0 0) 0x7fac58003530 con 0x7fac6c0c61a0 2023-12-19T19:01:59.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac63fff640 1 -- 172.21.15.133:0/1134889967 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac6c0c01c0 msgr2=0x7fac6c0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:59.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac63fff640 1 --2- 172.21.15.133:0/1134889967 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac6c0c01c0 0x7fac6c0c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac63fff640 1 -- 172.21.15.133:0/1134889967 >> v2:172.21.15.138:3300/0 conn(0x7fac6c0a5240 msgr2=0x7fac6c0bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:59.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac63fff640 1 --2- 172.21.15.133:0/1134889967 >> v2:172.21.15.138:3300/0 conn(0x7fac6c0a5240 0x7fac6c0bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac63fff640 1 -- 172.21.15.133:0/1134889967 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac6c0c4100 con 0x7fac6c0c61a0 2023-12-19T19:01:59.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac63fff640 1 -- 172.21.15.133:0/1134889967 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7fac64001a00 con 0x7fac6c0c61a0 2023-12-19T19:01:59.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac63fff640 1 -- 172.21.15.133:0/1134889967 >> v1:172.21.15.133:6789/0 conn(0x7fac6c0c61a0 legacy=0x7fac6c1561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:59.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac63fff640 1 --2- 172.21.15.133:0/1134889967 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac58003980 0x7fac58003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:59.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac63fff640 1 --2- 172.21.15.133:0/1134889967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac580047d0 0x7fac58004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:59.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac63fff640 1 --2- 172.21.15.133:0/1134889967 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac6c0c01c0 0x7fac58005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:59.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac63fff640 1 -- 172.21.15.133:0/1134889967 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c0bf1e0 con 0x7fac580047d0 2023-12-19T19:01:59.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac63fff640 1 -- 172.21.15.133:0/1134889967 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c0c3e20 con 0x7fac58003980 2023-12-19T19:01:59.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.136+0000 7fac63fff640 1 -- 172.21.15.133:0/1134889967 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5800b990 con 0x7fac6c0c01c0 2023-12-19T19:01:59.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.140+0000 7fac708f2640 1 --2- 172.21.15.133:0/1134889967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac580047d0 0x7fac58004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:59.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.140+0000 7fac710f3640 1 --2- 172.21.15.133:0/1134889967 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac58003980 0x7fac58003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:59.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.140+0000 7fac718f4640 1 --2- 172.21.15.133:0/1134889967 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac6c0c01c0 0x7fac58005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:59.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.140+0000 7fac708f2640 1 -- 172.21.15.133:0/1134889967 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac6c0c01c0 msgr2=0x7fac58005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:59.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.140+0000 7fac708f2640 1 --2- 172.21.15.133:0/1134889967 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac6c0c01c0 0x7fac58005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.140+0000 7fac708f2640 1 -- 172.21.15.133:0/1134889967 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac58003980 msgr2=0x7fac58003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:59.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.140+0000 7fac708f2640 1 --2- 172.21.15.133:0/1134889967 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac58003980 0x7fac58003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.140+0000 7fac708f2640 1 -- 172.21.15.133:0/1134889967 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac58003530 con 0x7fac580047d0 2023-12-19T19:01:59.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.140+0000 7fac708f2640 1 --2- 172.21.15.133:0/1134889967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac580047d0 0x7fac58004c50 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fac5c009ae0 tx=0x7fac5c01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc8e0657ae53018 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:59.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.140+0000 7fac63fff640 1 -- 172.21.15.133:0/1134889967 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c0a8450 con 0x7fac580047d0 2023-12-19T19:01:59.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.140+0000 7fac63fff640 1 -- 172.21.15.133:0/1134889967 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5c0a85b0 con 0x7fac580047d0 2023-12-19T19:01:59.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.140+0000 7fac63fff640 1 -- 172.21.15.133:0/1134889967 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c0a8960 con 0x7fac580047d0 2023-12-19T19:01:59.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac73357640 1 -- 172.21.15.133:0/1134889967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac580047d0 msgr2=0x7fac58004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:59.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac73357640 1 --2- 172.21.15.133:0/1134889967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac580047d0 0x7fac58004c50 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fac5c009ae0 tx=0x7fac5c01c9e0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac718f4640 1 -- 172.21.15.133:0/1134889967 reap_dead start 2023-12-19T19:01:59.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac73357640 1 -- 172.21.15.133:0/1134889967 shutdown_connections 2023-12-19T19:01:59.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac73357640 1 -- 172.21.15.133:0/1134889967 >> 172.21.15.133:0/1134889967 conn(0x7fac6c06a5b0 msgr2=0x7fac6c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:59.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac73357640 1 -- 172.21.15.133:0/1134889967 shutdown_connections 2023-12-19T19:01:59.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac73357640 1 -- 172.21.15.133:0/1134889967 wait complete. 2023-12-19T19:01:59.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac73357640 1 Processor -- start 2023-12-19T19:01:59.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac73357640 1 -- start start 2023-12-19T19:01:59.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac73357640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac580047d0 0x7fac6c071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:59.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac73357640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac6c155740 0x7fac6c0a7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:59.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac73357640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac6c0a7fa0 0x7fac6c146e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:59.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac73357640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c1ee080 con 0x7fac580047d0 2023-12-19T19:01:59.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac73357640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c0a8d90 con 0x7fac6c155740 2023-12-19T19:01:59.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac73357640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c1ed700 con 0x7fac6c0a7fa0 2023-12-19T19:01:59.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac710f3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac580047d0 0x7fac6c071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:59.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac710f3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac580047d0 0x7fac6c071100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34890/0 (socket says 172.21.15.133:34890) 2023-12-19T19:01:59.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac710f3640 1 -- 172.21.15.133:0/2943121464 learned_addr learned my addr 172.21.15.133:0/2943121464 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:59.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac708f2640 1 --2- 172.21.15.133:0/2943121464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac6c155740 0x7fac6c0a7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:59.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac718f4640 1 --2- 172.21.15.133:0/2943121464 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac6c0a7fa0 0x7fac6c146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:59.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac710f3640 1 -- 172.21.15.133:0/2943121464 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac6c0a7fa0 msgr2=0x7fac6c146e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:59.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac710f3640 1 --2- 172.21.15.133:0/2943121464 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac6c0a7fa0 0x7fac6c146e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac710f3640 1 -- 172.21.15.133:0/2943121464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac6c155740 msgr2=0x7fac6c0a7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:59.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac710f3640 1 --2- 172.21.15.133:0/2943121464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac6c155740 0x7fac6c0a7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac710f3640 1 -- 172.21.15.133:0/2943121464 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac6c072430 con 0x7fac580047d0 2023-12-19T19:01:59.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac708f2640 1 --2- 172.21.15.133:0/2943121464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac6c155740 0x7fac6c0a7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:01:59.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.144+0000 7fac710f3640 1 --2- 172.21.15.133:0/2943121464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac580047d0 0x7fac6c071100 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fac68011aa0 tx=0x7fac68011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:59.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.148+0000 7fac61ffb640 1 -- 172.21.15.133:0/2943121464 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6800fb80 con 0x7fac580047d0 2023-12-19T19:01:59.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.148+0000 7fac61ffb640 1 -- 172.21.15.133:0/2943121464 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6800fce0 con 0x7fac580047d0 2023-12-19T19:01:59.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.148+0000 7fac73357640 1 -- 172.21.15.133:0/2943121464 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac6c1ed9c0 con 0x7fac580047d0 2023-12-19T19:01:59.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.148+0000 7fac61ffb640 1 -- 172.21.15.133:0/2943121464 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac68014680 con 0x7fac580047d0 2023-12-19T19:01:59.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.148+0000 7fac73357640 1 -- 172.21.15.133:0/2943121464 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac6c071640 con 0x7fac580047d0 2023-12-19T19:01:59.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.148+0000 7fac73357640 1 -- 172.21.15.133:0/2943121464 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac6c0a83b0 con 0x7fac580047d0 2023-12-19T19:01:59.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.148+0000 7fac61ffb640 1 -- 172.21.15.133:0/2943121464 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fac6801d400 con 0x7fac580047d0 2023-12-19T19:01:59.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.148+0000 7fac61ffb640 1 --2- 172.21.15.133:0/2943121464 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fac500664a0 0x7fac50068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:59.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.148+0000 7fac61ffb640 1 -- 172.21.15.133:0/2943121464 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fac68084b60 con 0x7fac580047d0 2023-12-19T19:01:59.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.148+0000 7fac708f2640 1 --2- 172.21.15.133:0/2943121464 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fac500664a0 0x7fac50068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:59.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.152+0000 7fac708f2640 1 --2- 172.21.15.133:0/2943121464 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fac500664a0 0x7fac50068960 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0af000 tx=0x7fac5c0b2040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:59.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.152+0000 7fac61ffb640 1 -- 172.21.15.133:0/2943121464 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fac68051c70 con 0x7fac580047d0 2023-12-19T19:01:59.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.300+0000 7fac73357640 1 -- 172.21.15.133:0/2943121464 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac6c068400 con 0x7fac580047d0 2023-12-19T19:01:59.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.300+0000 7fac61ffb640 1 -- 172.21.15.133:0/2943121464 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac68055290 con 0x7fac580047d0 2023-12-19T19:01:59.307 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T19:01:59.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.304+0000 7fac73357640 1 -- 172.21.15.133:0/2943121464 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fac500664a0 msgr2=0x7fac50068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:59.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.304+0000 7fac73357640 1 --2- 172.21.15.133:0/2943121464 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fac500664a0 0x7fac50068960 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0af000 tx=0x7fac5c0b2040 comp rx=0 tx=0).stop 2023-12-19T19:01:59.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.304+0000 7fac73357640 1 -- 172.21.15.133:0/2943121464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac580047d0 msgr2=0x7fac6c071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:59.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.304+0000 7fac73357640 1 --2- 172.21.15.133:0/2943121464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac580047d0 0x7fac6c071100 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fac68011aa0 tx=0x7fac68011f60 comp rx=0 tx=0).stop 2023-12-19T19:01:59.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.304+0000 7fac73357640 1 -- 172.21.15.133:0/2943121464 shutdown_connections 2023-12-19T19:01:59.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.304+0000 7fac73357640 1 --2- 172.21.15.133:0/2943121464 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fac500664a0 0x7fac50068960 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.304+0000 7fac73357640 1 --2- 172.21.15.133:0/2943121464 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fac6c0a7fa0 0x7fac6c146e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.304+0000 7fac73357640 1 --2- 172.21.15.133:0/2943121464 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fac6c155740 0x7fac6c0a7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.304+0000 7fac73357640 1 --2- 172.21.15.133:0/2943121464 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac580047d0 0x7fac6c071100 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.304+0000 7fac73357640 1 -- 172.21.15.133:0/2943121464 >> 172.21.15.133:0/2943121464 conn(0x7fac6c06a5b0 msgr2=0x7fac6c0a5980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:59.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.304+0000 7fac73357640 1 -- 172.21.15.133:0/2943121464 shutdown_connections 2023-12-19T19:01:59.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.304+0000 7fac73357640 1 -- 172.21.15.133:0/2943121464 wait complete. 2023-12-19T19:01:59.328 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T19:01:59.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.464+0000 7f20573aa640 1 Processor -- start 2023-12-19T19:01:59.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.464+0000 7f20573aa640 1 -- start start 2023-12-19T19:01:59.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.464+0000 7f20573aa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20500c5640 0x7f20500c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:59.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.464+0000 7f20573aa640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20500c2580 con 0x7f20500c5260 2023-12-19T19:01:59.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.464+0000 7f20573aa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20500c1a00 con 0x7f20500c60f0 2023-12-19T19:01:59.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.464+0000 7f20573aa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2050153510 con 0x7f20500c5640 2023-12-19T19:01:59.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.468+0000 7f2055146640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f20500c5260 0x7f205006d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58012/0 (socket says 172.21.15.133:58012) 2023-12-19T19:01:59.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.468+0000 7f2055146640 1 -- 172.21.15.133:0/3775029560 learned_addr learned my addr 172.21.15.133:0/3775029560 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:01:59.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.468+0000 7f2054945640 1 --2- 172.21.15.133:0/3775029560 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20500c5640 0x7f20500c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:59.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.468+0000 7f2047fff640 1 -- 172.21.15.133:0/3775029560 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1118617211 0 0) 0x7f20500c2580 con 0x7f20500c5260 2023-12-19T19:01:59.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.468+0000 7f2047fff640 1 -- 172.21.15.133:0/3775029560 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f203c003530 con 0x7f20500c5260 2023-12-19T19:01:59.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.468+0000 7f2047fff640 1 -- 172.21.15.133:0/3775029560 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2795807158 0 0) 0x7f20500c1a00 con 0x7f20500c60f0 2023-12-19T19:01:59.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.468+0000 7f2047fff640 1 -- 172.21.15.133:0/3775029560 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20500c2580 con 0x7f20500c60f0 2023-12-19T19:01:59.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.468+0000 7f2047fff640 1 -- 172.21.15.133:0/3775029560 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1371848429 0 0) 0x7f203c003530 con 0x7f20500c5260 2023-12-19T19:01:59.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.468+0000 7f2054945640 1 -- 172.21.15.133:0/3775029560 >> v1:172.21.15.138:6789/0 conn(0x7f20500c60f0 legacy=0x7f2050155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:59.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.468+0000 7f2054945640 1 -- 172.21.15.133:0/3775029560 >> v1:172.21.15.133:6789/0 conn(0x7f20500c5260 legacy=0x7f205006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:59.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.468+0000 7f2054945640 1 -- 172.21.15.133:0/3775029560 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20500c1ce0 con 0x7f20500c5640 2023-12-19T19:01:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.468+0000 7f2054945640 1 --2- 172.21.15.133:0/3775029560 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20500c5640 0x7f20500c5bb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f20400097f0 tx=0x7f204001c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=334ecdf2282b15e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.468+0000 7f2047fff640 1 -- 172.21.15.133:0/3775029560 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c001680 con 0x7f20500c5640 2023-12-19T19:01:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.472+0000 7f2047fff640 1 -- 172.21.15.133:0/3775029560 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20400a7050 con 0x7f20500c5640 2023-12-19T19:01:59.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.472+0000 7f2047fff640 1 -- 172.21.15.133:0/3775029560 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20400ab600 con 0x7f20500c5640 2023-12-19T19:01:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.472+0000 7f20573aa640 1 -- 172.21.15.133:0/3775029560 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20500c5640 msgr2=0x7f20500c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.472+0000 7f20573aa640 1 --2- 172.21.15.133:0/3775029560 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20500c5640 0x7f20500c5bb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f20400097f0 tx=0x7f204001c350 comp rx=0 tx=0).stop 2023-12-19T19:01:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.472+0000 7f20573aa640 1 -- 172.21.15.133:0/3775029560 shutdown_connections 2023-12-19T19:01:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.472+0000 7f20573aa640 1 --2- 172.21.15.133:0/3775029560 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20500c5640 0x7f20500c5bb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.472+0000 7f20573aa640 1 -- 172.21.15.133:0/3775029560 >> 172.21.15.133:0/3775029560 conn(0x7f205006a5b0 msgr2=0x7f205006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.472+0000 7f20573aa640 1 -- 172.21.15.133:0/3775029560 shutdown_connections 2023-12-19T19:01:59.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.472+0000 7f20573aa640 1 -- 172.21.15.133:0/3775029560 wait complete. 2023-12-19T19:01:59.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.472+0000 7f20573aa640 1 Processor -- start 2023-12-19T19:01:59.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.472+0000 7f20573aa640 1 -- start start 2023-12-19T19:01:59.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.472+0000 7f20573aa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20500c5260 0x7f20501eba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.472+0000 7f20573aa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20500c5640 0x7f20501ee380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.472+0000 7f20573aa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20500c60f0 0x7f2050145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.472+0000 7f20573aa640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20501515d0 con 0x7f20500c60f0 2023-12-19T19:01:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.472+0000 7f20573aa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2050150370 con 0x7f20500c5640 2023-12-19T19:01:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.472+0000 7f20573aa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2050151800 con 0x7f20500c5260 2023-12-19T19:01:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.472+0000 7f2055947640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20500c60f0 0x7f2050145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.472+0000 7f2054945640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20500c5640 0x7f20501ee380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.472+0000 7f2055146640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20500c5260 0x7f20501eba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.472+0000 7f2055947640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20500c60f0 0x7f2050145a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34892/0 (socket says 172.21.15.133:34892) 2023-12-19T19:01:59.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.472+0000 7f2055947640 1 -- 172.21.15.133:0/3533672930 learned_addr learned my addr 172.21.15.133:0/3533672930 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:59.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.476+0000 7f2055947640 1 -- 172.21.15.133:0/3533672930 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20500c5260 msgr2=0x7f20501eba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:59.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.476+0000 7f2055947640 1 --2- 172.21.15.133:0/3533672930 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20500c5260 0x7f20501eba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.476+0000 7f2055947640 1 -- 172.21.15.133:0/3533672930 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20500c5640 msgr2=0x7f20501ee380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.476+0000 7f2055947640 1 --2- 172.21.15.133:0/3533672930 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20500c5640 0x7f20501ee380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.476+0000 7f2055947640 1 -- 172.21.15.133:0/3533672930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2040009420 con 0x7f20500c60f0 2023-12-19T19:01:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.476+0000 7f2055947640 1 --2- 172.21.15.133:0/3533672930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20500c60f0 0x7f2050145a30 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f204800c730 tx=0x7f204800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.476+0000 7f2045ffb640 1 -- 172.21.15.133:0/3533672930 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2048003b80 con 0x7f20500c60f0 2023-12-19T19:01:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.476+0000 7f2045ffb640 1 -- 172.21.15.133:0/3533672930 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2048003ce0 con 0x7f20500c60f0 2023-12-19T19:01:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.476+0000 7f20573aa640 1 -- 172.21.15.133:0/3533672930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20501eaf20 con 0x7f20500c60f0 2023-12-19T19:01:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.476+0000 7f2045ffb640 1 -- 172.21.15.133:0/3533672930 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204800aa90 con 0x7f20500c60f0 2023-12-19T19:01:59.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.476+0000 7f20573aa640 1 -- 172.21.15.133:0/3533672930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20501eb4e0 con 0x7f20500c60f0 2023-12-19T19:01:59.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.476+0000 7f20573aa640 1 -- 172.21.15.133:0/3533672930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20501eb6d0 con 0x7f20500c60f0 2023-12-19T19:01:59.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.476+0000 7f2045ffb640 1 -- 172.21.15.133:0/3533672930 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f204800abf0 con 0x7f20500c60f0 2023-12-19T19:01:59.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.476+0000 7f2045ffb640 1 --2- 172.21.15.133:0/3533672930 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2034066470 0x7f2034068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:59.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.476+0000 7f2045ffb640 1 -- 172.21.15.133:0/3533672930 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2048083e20 con 0x7f20500c60f0 2023-12-19T19:01:59.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.476+0000 7f2055146640 1 --2- 172.21.15.133:0/3533672930 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2034066470 0x7f2034068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:59.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.480+0000 7f2055146640 1 --2- 172.21.15.133:0/3533672930 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2034066470 0x7f2034068930 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f204c0011f0 tx=0x7f204c001680 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:59.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.480+0000 7f2045ffb640 1 -- 172.21.15.133:0/3533672930 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2048051080 con 0x7f20500c60f0 2023-12-19T19:01:59.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.628+0000 7f20573aa640 1 -- 172.21.15.133:0/3533672930 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2050068400 con 0x7f20500c60f0 2023-12-19T19:01:59.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.632+0000 7f2045ffb640 1 -- 172.21.15.133:0/3533672930 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) v1 ==== 104+0+11 (secure 0 0 0) 0x7f20480546a0 con 0x7f20500c60f0 2023-12-19T19:01:59.636 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:01:59.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.632+0000 7f20573aa640 1 -- 172.21.15.133:0/3533672930 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2034066470 msgr2=0x7f2034068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:59.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.632+0000 7f20573aa640 1 --2- 172.21.15.133:0/3533672930 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2034066470 0x7f2034068930 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f204c0011f0 tx=0x7f204c001680 comp rx=0 tx=0).stop 2023-12-19T19:01:59.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.632+0000 7f20573aa640 1 -- 172.21.15.133:0/3533672930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20500c60f0 msgr2=0x7f2050145a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:59.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.632+0000 7f20573aa640 1 --2- 172.21.15.133:0/3533672930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20500c60f0 0x7f2050145a30 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f204800c730 tx=0x7f204800cbf0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.632+0000 7f20573aa640 1 -- 172.21.15.133:0/3533672930 shutdown_connections 2023-12-19T19:01:59.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.632+0000 7f20573aa640 1 --2- 172.21.15.133:0/3533672930 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2034066470 0x7f2034068930 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.632+0000 7f20573aa640 1 --2- 172.21.15.133:0/3533672930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f20500c60f0 0x7f2050145a30 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.632+0000 7f20573aa640 1 --2- 172.21.15.133:0/3533672930 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f20500c5640 0x7f20501ee380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.632+0000 7f20573aa640 1 --2- 172.21.15.133:0/3533672930 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f20500c5260 0x7f20501eba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.632+0000 7f20573aa640 1 -- 172.21.15.133:0/3533672930 >> 172.21.15.133:0/3533672930 conn(0x7f205006a5b0 msgr2=0x7f205006d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:59.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.632+0000 7f20573aa640 1 -- 172.21.15.133:0/3533672930 shutdown_connections 2023-12-19T19:01:59.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.632+0000 7f20573aa640 1 -- 172.21.15.133:0/3533672930 wait complete. 2023-12-19T19:01:59.656 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T19:01:59.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.792+0000 7fa2503d1640 1 Processor -- start 2023-12-19T19:01:59.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.792+0000 7fa2503d1640 1 -- start start 2023-12-19T19:01:59.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.792+0000 7fa2503d1640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa248072090 0x7fa248150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.792+0000 7fa2503d1640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa2480725c0 0x7fa2481514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.796+0000 7fa2503d1640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2480c2760 con 0x7fa2480a5370 2023-12-19T19:01:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.796+0000 7fa2503d1640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2480c3070 con 0x7fa248072090 2023-12-19T19:01:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.796+0000 7fa2503d1640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2480a5750 con 0x7fa2480725c0 2023-12-19T19:01:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.796+0000 7fa24d96c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa248072090 0x7fa248150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.796+0000 7fa24d96c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa248072090 0x7fa248150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34900/0 (socket says 172.21.15.133:34900) 2023-12-19T19:01:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.796+0000 7fa24d96c640 1 -- 172.21.15.133:0/960707872 learned_addr learned my addr 172.21.15.133:0/960707872 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.796+0000 7fa24e96e640 1 --2- 172.21.15.133:0/960707872 >> v2:172.21.15.138:3300/0 conn(0x7fa2480725c0 0x7fa2481514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.796+0000 7fa24d96c640 1 -- 172.21.15.133:0/960707872 >> v2:172.21.15.138:3300/0 conn(0x7fa2480725c0 msgr2=0x7fa2481514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:01:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.796+0000 7fa24d96c640 1 --2- 172.21.15.133:0/960707872 >> v2:172.21.15.138:3300/0 conn(0x7fa2480725c0 0x7fa2481514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.796+0000 7fa24d96c640 1 -- 172.21.15.133:0/960707872 >> v1:172.21.15.138:6789/0 conn(0x7fa2480a5370 legacy=0x7fa2480c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:59.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.796+0000 7fa24d96c640 1 -- 172.21.15.133:0/960707872 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2480aad20 con 0x7fa248072090 2023-12-19T19:01:59.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.796+0000 7fa24d96c640 1 --2- 172.21.15.133:0/960707872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa248072090 0x7fa248150fa0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fa248072020 tx=0x7fa23801d4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f73dc76818c1a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:59.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.796+0000 7fa24d16b640 1 -- 172.21.15.133:0/960707872 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2380a8070 con 0x7fa248072090 2023-12-19T19:01:59.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.796+0000 7fa24d16b640 1 -- 172.21.15.133:0/960707872 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2380ac430 con 0x7fa248072090 2023-12-19T19:01:59.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.796+0000 7fa24d16b640 1 -- 172.21.15.133:0/960707872 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2380ac7c0 con 0x7fa248072090 2023-12-19T19:01:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa2503d1640 1 -- 172.21.15.133:0/960707872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa248072090 msgr2=0x7fa248150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa2503d1640 1 --2- 172.21.15.133:0/960707872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa248072090 0x7fa248150fa0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fa248072020 tx=0x7fa23801d4c0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa2503d1640 1 -- 172.21.15.133:0/960707872 shutdown_connections 2023-12-19T19:01:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa2503d1640 1 --2- 172.21.15.133:0/960707872 >> v2:172.21.15.138:3300/0 conn(0x7fa2480725c0 0x7fa2481514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa2503d1640 1 --2- 172.21.15.133:0/960707872 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa248072090 0x7fa248150fa0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa2503d1640 1 -- 172.21.15.133:0/960707872 >> 172.21.15.133:0/960707872 conn(0x7fa24806a5b0 msgr2=0x7fa24806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa2503d1640 1 -- 172.21.15.133:0/960707872 shutdown_connections 2023-12-19T19:01:59.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa2503d1640 1 -- 172.21.15.133:0/960707872 wait complete. 2023-12-19T19:01:59.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa2503d1640 1 Processor -- start 2023-12-19T19:01:59.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa2503d1640 1 -- start start 2023-12-19T19:01:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa2503d1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa248072090 0x7fa24814ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:59.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa2503d1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa2480725c0 0x7fa24806fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:59.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa2503d1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2480a5370 0x7fa2480bf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:59.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa2503d1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa248070970 con 0x7fa248072090 2023-12-19T19:01:59.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa2503d1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2481ed690 con 0x7fa2480a5370 2023-12-19T19:01:59.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa2503d1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa248071dc0 con 0x7fa2480725c0 2023-12-19T19:01:59.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa24e16d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa248072090 0x7fa24814ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:59.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa24e16d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa248072090 0x7fa24814ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34916/0 (socket says 172.21.15.133:34916) 2023-12-19T19:01:59.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa24e16d640 1 -- 172.21.15.133:0/3011329186 learned_addr learned my addr 172.21.15.133:0/3011329186 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:01:59.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa24e96e640 1 --2- 172.21.15.133:0/3011329186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2480a5370 0x7fa2480bf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:59.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa24d96c640 1 --2- 172.21.15.133:0/3011329186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa2480725c0 0x7fa24806fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:59.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa24e16d640 1 -- 172.21.15.133:0/3011329186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa2480725c0 msgr2=0x7fa24806fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:59.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa24e16d640 1 --2- 172.21.15.133:0/3011329186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa2480725c0 0x7fa24806fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa24e16d640 1 -- 172.21.15.133:0/3011329186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2480a5370 msgr2=0x7fa2480bf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:59.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa24e16d640 1 --2- 172.21.15.133:0/3011329186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2480a5370 0x7fa2480bf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.800+0000 7fa24e16d640 1 -- 172.21.15.133:0/3011329186 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2380094d0 con 0x7fa248072090 2023-12-19T19:01:59.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.804+0000 7fa24e16d640 1 --2- 172.21.15.133:0/3011329186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa248072090 0x7fa24814ffa0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fa24400c3f0 tx=0x7fa24400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:59.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.804+0000 7fa23effd640 1 -- 172.21.15.133:0/3011329186 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2440052d0 con 0x7fa248072090 2023-12-19T19:01:59.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.804+0000 7fa23effd640 1 -- 172.21.15.133:0/3011329186 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa244005430 con 0x7fa248072090 2023-12-19T19:01:59.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.804+0000 7fa23effd640 1 -- 172.21.15.133:0/3011329186 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa244003840 con 0x7fa248072090 2023-12-19T19:01:59.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.804+0000 7fa2503d1640 1 -- 172.21.15.133:0/3011329186 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa248153cf0 con 0x7fa248072090 2023-12-19T19:01:59.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.804+0000 7fa2503d1640 1 -- 172.21.15.133:0/3011329186 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2481ed160 con 0x7fa248072090 2023-12-19T19:01:59.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.804+0000 7fa2503d1640 1 -- 172.21.15.133:0/3011329186 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa248068400 con 0x7fa248072090 2023-12-19T19:01:59.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.804+0000 7fa23effd640 1 -- 172.21.15.133:0/3011329186 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa2440039a0 con 0x7fa248072090 2023-12-19T19:01:59.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.804+0000 7fa23effd640 1 --2- 172.21.15.133:0/3011329186 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa22c0664a0 0x7fa22c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:01:59.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.804+0000 7fa23effd640 1 -- 172.21.15.133:0/3011329186 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa2440836b0 con 0x7fa248072090 2023-12-19T19:01:59.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.804+0000 7fa24d96c640 1 --2- 172.21.15.133:0/3011329186 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa22c0664a0 0x7fa22c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:01:59.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.808+0000 7fa24d96c640 1 --2- 172.21.15.133:0/3011329186 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa22c0664a0 0x7fa22c068960 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa2380b0000 tx=0x7fa238008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:01:59.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.808+0000 7fa23effd640 1 -- 172.21.15.133:0/3011329186 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa244050870 con 0x7fa248072090 2023-12-19T19:01:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.960+0000 7fa2503d1640 1 -- 172.21.15.133:0/3011329186 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa2480c6780 con 0x7fa248072090 2023-12-19T19:01:59.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.960+0000 7fa23effd640 1 -- 172.21.15.133:0/3011329186 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa244053e90 con 0x7fa248072090 2023-12-19T19:01:59.966 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:01:59.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.964+0000 7fa2503d1640 1 -- 172.21.15.133:0/3011329186 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa22c0664a0 msgr2=0x7fa22c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:59.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.964+0000 7fa2503d1640 1 --2- 172.21.15.133:0/3011329186 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa22c0664a0 0x7fa22c068960 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa2380b0000 tx=0x7fa238008040 comp rx=0 tx=0).stop 2023-12-19T19:01:59.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.964+0000 7fa2503d1640 1 -- 172.21.15.133:0/3011329186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa248072090 msgr2=0x7fa24814ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:01:59.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.964+0000 7fa2503d1640 1 --2- 172.21.15.133:0/3011329186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa248072090 0x7fa24814ffa0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fa24400c3f0 tx=0x7fa24400c8b0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.964+0000 7fa2503d1640 1 -- 172.21.15.133:0/3011329186 shutdown_connections 2023-12-19T19:01:59.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.964+0000 7fa2503d1640 1 --2- 172.21.15.133:0/3011329186 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa22c0664a0 0x7fa22c068960 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.964+0000 7fa2503d1640 1 --2- 172.21.15.133:0/3011329186 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2480a5370 0x7fa2480bf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.964+0000 7fa2503d1640 1 --2- 172.21.15.133:0/3011329186 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa2480725c0 0x7fa24806fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.964+0000 7fa2503d1640 1 --2- 172.21.15.133:0/3011329186 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa248072090 0x7fa24814ffa0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:01:59.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.964+0000 7fa2503d1640 1 -- 172.21.15.133:0/3011329186 >> 172.21.15.133:0/3011329186 conn(0x7fa24806a5b0 msgr2=0x7fa24806d420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:01:59.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.964+0000 7fa2503d1640 1 -- 172.21.15.133:0/3011329186 shutdown_connections 2023-12-19T19:01:59.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:01:59.964+0000 7fa2503d1640 1 -- 172.21.15.133:0/3011329186 wait complete. 2023-12-19T19:01:59.987 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-19T19:02:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.128+0000 7f199d2d6640 1 Processor -- start 2023-12-19T19:02:00.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.128+0000 7f199d2d6640 1 -- start start 2023-12-19T19:02:00.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.128+0000 7f199d2d6640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f19980c5260 0x7f199806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:00.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.128+0000 7f199d2d6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1998155de0 0x7f1998156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:00.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.128+0000 7f199d2d6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19980c2580 con 0x7f19980c5640 2023-12-19T19:02:00.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.128+0000 7f199d2d6640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1998153510 con 0x7f19980c5260 2023-12-19T19:02:00.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.128+0000 7f199d2d6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19980c17f0 con 0x7f1998155de0 2023-12-19T19:02:00.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.128+0000 7f19967fc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f19980c5640 0x7f19980c5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58018/0 (socket says 172.21.15.133:58018) 2023-12-19T19:02:00.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.128+0000 7f19967fc640 1 -- 172.21.15.133:0/2506487433 learned_addr learned my addr 172.21.15.133:0/2506487433 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:00.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.128+0000 7f1996ffd640 1 --2- 172.21.15.133:0/2506487433 >> v2:172.21.15.138:3300/0 conn(0x7f19980c5260 0x7f199806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:00.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.128+0000 7f19977fe640 1 --2- 172.21.15.133:0/2506487433 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1998155de0 0x7f1998156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:00.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.128+0000 7f1995ffb640 1 -- 172.21.15.133:0/2506487433 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1605653005 0 0) 0x7f19980c2580 con 0x7f19980c5640 2023-12-19T19:02:00.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.128+0000 7f1995ffb640 1 -- 172.21.15.133:0/2506487433 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1980003530 con 0x7f19980c5640 2023-12-19T19:02:00.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.128+0000 7f1995ffb640 1 -- 172.21.15.133:0/2506487433 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1194953209 0 0) 0x7f1980003530 con 0x7f19980c5640 2023-12-19T19:02:00.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.128+0000 7f1995ffb640 1 -- 172.21.15.133:0/2506487433 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1998155de0 msgr2=0x7f1998156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:00.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.128+0000 7f1995ffb640 1 --2- 172.21.15.133:0/2506487433 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1998155de0 0x7f1998156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.128+0000 7f1995ffb640 1 -- 172.21.15.133:0/2506487433 >> v2:172.21.15.138:3300/0 conn(0x7f19980c5260 msgr2=0x7f199806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:00.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.128+0000 7f1995ffb640 1 --2- 172.21.15.133:0/2506487433 >> v2:172.21.15.138:3300/0 conn(0x7f19980c5260 0x7f199806d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.128+0000 7f1995ffb640 1 -- 172.21.15.133:0/2506487433 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19980c1a00 con 0x7f19980c5640 2023-12-19T19:02:00.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.128+0000 7f1995ffb640 1 -- 172.21.15.133:0/2506487433 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f198c001680 con 0x7f19980c5640 2023-12-19T19:02:00.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.132+0000 7f1995ffb640 1 -- 172.21.15.133:0/2506487433 >> v1:172.21.15.133:6789/0 conn(0x7f19980c5640 legacy=0x7f19980c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:00.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.132+0000 7f1995ffb640 1 --2- 172.21.15.133:0/2506487433 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1980003980 0x7f1980003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:00.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.132+0000 7f1995ffb640 1 --2- 172.21.15.133:0/2506487433 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1998155de0 0x7f19800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:00.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.132+0000 7f1995ffb640 1 --2- 172.21.15.133:0/2506487433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1980004d10 0x7f1980005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:00.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.132+0000 7f1995ffb640 1 -- 172.21.15.133:0/2506487433 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19980c17f0 con 0x7f1980004d10 2023-12-19T19:02:00.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.132+0000 7f1995ffb640 1 -- 172.21.15.133:0/2506487433 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198000b990 con 0x7f1980003980 2023-12-19T19:02:00.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.132+0000 7f1995ffb640 1 -- 172.21.15.133:0/2506487433 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198000bb50 con 0x7f1998155de0 2023-12-19T19:02:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.132+0000 7f1996ffd640 1 --2- 172.21.15.133:0/2506487433 >> v2:172.21.15.138:3300/0 conn(0x7f19980c5260 0x7f199806d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:02:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.132+0000 7f19977fe640 1 --2- 172.21.15.133:0/2506487433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1980004d10 0x7f1980005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.132+0000 7f19967fc640 1 --2- 172.21.15.133:0/2506487433 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1998155de0 0x7f19800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.132+0000 7f1996ffd640 1 --2- 172.21.15.133:0/2506487433 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1980003980 0x7f1980003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.132+0000 7f19977fe640 1 -- 172.21.15.133:0/2506487433 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1998155de0 msgr2=0x7f19800047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.132+0000 7f19977fe640 1 --2- 172.21.15.133:0/2506487433 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1998155de0 0x7f19800047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.132+0000 7f19977fe640 1 -- 172.21.15.133:0/2506487433 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1980003980 msgr2=0x7f1980003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.132+0000 7f19977fe640 1 --2- 172.21.15.133:0/2506487433 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1980003980 0x7f1980003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.140 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.132+0000 7f19977fe640 1 -- 172.21.15.133:0/2506487433 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1980003530 con 0x7f1980004d10 2023-12-19T19:02:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.132+0000 7f19977fe640 1 --2- 172.21.15.133:0/2506487433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1980004d10 0x7f1980005190 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f1990009fc0 tx=0x7f199001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ad236f852faf50 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.132+0000 7f1995ffb640 1 -- 172.21.15.133:0/2506487433 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19900a5c70 con 0x7f1980004d10 2023-12-19T19:02:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.136+0000 7f1995ffb640 1 -- 172.21.15.133:0/2506487433 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199000f040 con 0x7f1980004d10 2023-12-19T19:02:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.136+0000 7f1995ffb640 1 -- 172.21.15.133:0/2506487433 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19900ad440 con 0x7f1980004d10 2023-12-19T19:02:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.136+0000 7f199d2d6640 1 -- 172.21.15.133:0/2506487433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1980004d10 msgr2=0x7f1980005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.136+0000 7f199d2d6640 1 --2- 172.21.15.133:0/2506487433 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1980004d10 0x7f1980005190 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f1990009fc0 tx=0x7f199001cc60 comp rx=0 tx=0).stop 2023-12-19T19:02:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.136+0000 7f19977fe640 1 -- 172.21.15.133:0/2506487433 reap_dead start 2023-12-19T19:02:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.136+0000 7f199d2d6640 1 -- 172.21.15.133:0/2506487433 shutdown_connections 2023-12-19T19:02:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.136+0000 7f199d2d6640 1 -- 172.21.15.133:0/2506487433 >> 172.21.15.133:0/2506487433 conn(0x7f199806a5b0 msgr2=0x7f199806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.136+0000 7f199d2d6640 1 -- 172.21.15.133:0/2506487433 shutdown_connections 2023-12-19T19:02:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.136+0000 7f199d2d6640 1 -- 172.21.15.133:0/2506487433 wait complete. 2023-12-19T19:02:00.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.136+0000 7f199d2d6640 1 Processor -- start 2023-12-19T19:02:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.136+0000 7f199d2d6640 1 -- start start 2023-12-19T19:02:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.136+0000 7f199d2d6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1980004d10 0x7f19980a4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.136+0000 7f199d2d6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19981ed9e0 0x7f19981ecf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.136+0000 7f199d2d6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f199814e550 0x7f1998150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.136+0000 7f199d2d6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19980aa2f0 con 0x7f1980004d10 2023-12-19T19:02:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.136+0000 7f199d2d6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19980a79d0 con 0x7f19981ed9e0 2023-12-19T19:02:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.136+0000 7f199d2d6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19980a7cb0 con 0x7f199814e550 2023-12-19T19:02:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.136+0000 7f1996ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1980004d10 0x7f19980a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.136+0000 7f1996ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1980004d10 0x7f19980a4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34946/0 (socket says 172.21.15.133:34946) 2023-12-19T19:02:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.136+0000 7f1996ffd640 1 -- 172.21.15.133:0/1886684892 learned_addr learned my addr 172.21.15.133:0/1886684892 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.140+0000 7f19967fc640 1 --2- 172.21.15.133:0/1886684892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19981ed9e0 0x7f19981ecf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.140+0000 7f1996ffd640 1 -- 172.21.15.133:0/1886684892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f199814e550 msgr2=0x7f1998150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.140+0000 7f1996ffd640 1 --2- 172.21.15.133:0/1886684892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f199814e550 0x7f1998150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.140+0000 7f1996ffd640 1 -- 172.21.15.133:0/1886684892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19981ed9e0 msgr2=0x7f19981ecf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:00.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.140+0000 7f1996ffd640 1 --2- 172.21.15.133:0/1886684892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19981ed9e0 0x7f19981ecf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.140+0000 7f1996ffd640 1 -- 172.21.15.133:0/1886684892 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1998152e00 con 0x7f1980004d10 2023-12-19T19:02:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.140+0000 7f19967fc640 1 --2- 172.21.15.133:0/1886684892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19981ed9e0 0x7f19981ecf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.140+0000 7f1996ffd640 1 --2- 172.21.15.133:0/1886684892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1980004d10 0x7f19980a4460 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f1988011900 tx=0x7f1988011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.140+0000 7f197f7fe640 1 -- 172.21.15.133:0/1886684892 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19880096a0 con 0x7f1980004d10 2023-12-19T19:02:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.140+0000 7f197f7fe640 1 -- 172.21.15.133:0/1886684892 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198800fb50 con 0x7f1980004d10 2023-12-19T19:02:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.140+0000 7f197f7fe640 1 -- 172.21.15.133:0/1886684892 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198800fec0 con 0x7f1980004d10 2023-12-19T19:02:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.140+0000 7f199d2d6640 1 -- 172.21.15.133:0/1886684892 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1998153170 con 0x7f1980004d10 2023-12-19T19:02:00.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.140+0000 7f199d2d6640 1 -- 172.21.15.133:0/1886684892 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19981ed490 con 0x7f1980004d10 2023-12-19T19:02:00.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.140+0000 7f199d2d6640 1 -- 172.21.15.133:0/1886684892 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19980a7ed0 con 0x7f1980004d10 2023-12-19T19:02:00.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.140+0000 7f197f7fe640 1 -- 172.21.15.133:0/1886684892 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1988015460 con 0x7f1980004d10 2023-12-19T19:02:00.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.144+0000 7f197f7fe640 1 --2- 172.21.15.133:0/1886684892 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f19840664a0 0x7f1984068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:00.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.144+0000 7f197f7fe640 1 -- 172.21.15.133:0/1886684892 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f19880847e0 con 0x7f1980004d10 2023-12-19T19:02:00.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.144+0000 7f19967fc640 1 --2- 172.21.15.133:0/1886684892 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f19840664a0 0x7f1984068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:00.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.144+0000 7f19967fc640 1 --2- 172.21.15.133:0/1886684892 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f19840664a0 0x7f1984068960 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f198c001060 tx=0x7f198c001dd0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:00.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.148+0000 7f197f7fe640 1 -- 172.21.15.133:0/1886684892 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f19880518f0 con 0x7f1980004d10 2023-12-19T19:02:00.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.296+0000 7f199d2d6640 1 -- 172.21.15.133:0/1886684892 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1998152f90 con 0x7f1980004d10 2023-12-19T19:02:00.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.300+0000 7f197f7fe640 1 -- 172.21.15.133:0/1886684892 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v73) v1 ==== 105+0+11 (secure 0 0 0) 0x7f1988054f10 con 0x7f1980004d10 2023-12-19T19:02:00.304 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:02:00.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.300+0000 7f199d2d6640 1 -- 172.21.15.133:0/1886684892 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f19840664a0 msgr2=0x7f1984068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:00.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.300+0000 7f199d2d6640 1 --2- 172.21.15.133:0/1886684892 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f19840664a0 0x7f1984068960 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f198c001060 tx=0x7f198c001dd0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.300+0000 7f199d2d6640 1 -- 172.21.15.133:0/1886684892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1980004d10 msgr2=0x7f19980a4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:00.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.300+0000 7f199d2d6640 1 --2- 172.21.15.133:0/1886684892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1980004d10 0x7f19980a4460 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f1988011900 tx=0x7f1988011dc0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.300+0000 7f199d2d6640 1 -- 172.21.15.133:0/1886684892 shutdown_connections 2023-12-19T19:02:00.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.300+0000 7f199d2d6640 1 --2- 172.21.15.133:0/1886684892 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f19840664a0 0x7f1984068960 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.300+0000 7f199d2d6640 1 --2- 172.21.15.133:0/1886684892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f199814e550 0x7f1998150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.300+0000 7f199d2d6640 1 --2- 172.21.15.133:0/1886684892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19981ed9e0 0x7f19981ecf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.300+0000 7f199d2d6640 1 --2- 172.21.15.133:0/1886684892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1980004d10 0x7f19980a4460 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.300+0000 7f199d2d6640 1 -- 172.21.15.133:0/1886684892 >> 172.21.15.133:0/1886684892 conn(0x7f199806a5b0 msgr2=0x7f19980a5950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:00.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.300+0000 7f199d2d6640 1 -- 172.21.15.133:0/1886684892 shutdown_connections 2023-12-19T19:02:00.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.300+0000 7f199d2d6640 1 -- 172.21.15.133:0/1886684892 wait complete. 2023-12-19T19:02:00.325 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-19T19:02:00.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.464+0000 7fb1cf3d8640 1 Processor -- start 2023-12-19T19:02:00.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.464+0000 7fb1cf3d8640 1 -- start start 2023-12-19T19:02:00.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.464+0000 7fb1cf3d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1c80c63c0 0x7fb1c80c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:00.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.464+0000 7fb1cf3d8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb1c80c2bb0 0x7fb1c80a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:00.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.464+0000 7fb1cf3d8640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c80c31c0 con 0x7fb1c80c4100 2023-12-19T19:02:00.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.464+0000 7fb1cf3d8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c80c34a0 con 0x7fb1c80c2bb0 2023-12-19T19:02:00.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.464+0000 7fb1cf3d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c80c1030 con 0x7fb1c80c63c0 2023-12-19T19:02:00.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.464+0000 7fb1cd174640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1c80c63c0 0x7fb1c80c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:00.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.464+0000 7fb1cd174640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1c80c63c0 0x7fb1c80c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:42450/0 (socket says 172.21.15.133:42450) 2023-12-19T19:02:00.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.464+0000 7fb1cd975640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb1c80c2bb0 0x7fb1c80a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:00.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.464+0000 7fb1cd174640 1 -- 172.21.15.133:0/1428625825 learned_addr learned my addr 172.21.15.133:0/1428625825 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:00.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.464+0000 7fb1cc973640 1 --1- 172.21.15.133:0/1428625825 >> v1:172.21.15.138:6789/0 conn(0x7fb1c80c4100 0x7fb1c80c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:42358/0 (socket says 172.21.15.133:42358) 2023-12-19T19:02:00.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.464+0000 7fb1cd174640 1 -- 172.21.15.133:0/1428625825 >> v2:172.21.15.138:3300/0 conn(0x7fb1c80c2bb0 msgr2=0x7fb1c80a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:00.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.464+0000 7fb1cd174640 1 --2- 172.21.15.133:0/1428625825 >> v2:172.21.15.138:3300/0 conn(0x7fb1c80c2bb0 0x7fb1c80a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.464+0000 7fb1cd174640 1 -- 172.21.15.133:0/1428625825 >> v1:172.21.15.138:6789/0 conn(0x7fb1c80c4100 legacy=0x7fb1c80c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:00.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.464+0000 7fb1cd174640 1 -- 172.21.15.133:0/1428625825 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c80c1310 con 0x7fb1c80c63c0 2023-12-19T19:02:00.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.468+0000 7fb1cd174640 1 --2- 172.21.15.133:0/1428625825 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1c80c63c0 0x7fb1c80c06d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009e50 tx=0x7fb1c401c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4b574f65753ac5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:00.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.468+0000 7fb1bffff640 1 -- 172.21.15.133:0/1428625825 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c80aa3d0 con 0x7fb1c80c63c0 2023-12-19T19:02:00.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.468+0000 7fb1bffff640 1 -- 172.21.15.133:0/1428625825 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c40a5690 con 0x7fb1c80c63c0 2023-12-19T19:02:00.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.468+0000 7fb1bffff640 1 -- 172.21.15.133:0/1428625825 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c40a5a20 con 0x7fb1c80c63c0 2023-12-19T19:02:00.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.468+0000 7fb1cf3d8640 1 -- 172.21.15.133:0/1428625825 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1c80c63c0 msgr2=0x7fb1c80c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:00.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.468+0000 7fb1cf3d8640 1 --2- 172.21.15.133:0/1428625825 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1c80c63c0 0x7fb1c80c06d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4009e50 tx=0x7fb1c401c8c0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.468+0000 7fb1cf3d8640 1 -- 172.21.15.133:0/1428625825 shutdown_connections 2023-12-19T19:02:00.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.468+0000 7fb1cf3d8640 1 --2- 172.21.15.133:0/1428625825 >> v2:172.21.15.138:3300/0 conn(0x7fb1c80c2bb0 0x7fb1c80a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.468+0000 7fb1cf3d8640 1 --2- 172.21.15.133:0/1428625825 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1c80c63c0 0x7fb1c80c06d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.468+0000 7fb1cf3d8640 1 -- 172.21.15.133:0/1428625825 >> 172.21.15.133:0/1428625825 conn(0x7fb1c806a5b0 msgr2=0x7fb1c806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:00.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.468+0000 7fb1cf3d8640 1 -- 172.21.15.133:0/1428625825 shutdown_connections 2023-12-19T19:02:00.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.468+0000 7fb1cf3d8640 1 -- 172.21.15.133:0/1428625825 wait complete. 2023-12-19T19:02:00.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cf3d8640 1 Processor -- start 2023-12-19T19:02:00.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cf3d8640 1 -- start start 2023-12-19T19:02:00.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cf3d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb1c80c2bb0 0x7fb1c80c5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:00.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cf3d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1c80c4100 0x7fb1c81ed200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:00.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cf3d8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1c80c63c0 0x7fb1c81ed740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:00.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cf3d8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c814b320 con 0x7fb1c80c63c0 2023-12-19T19:02:00.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cf3d8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c814e3f0 con 0x7fb1c80c2bb0 2023-12-19T19:02:00.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cf3d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c814e6d0 con 0x7fb1c80c4100 2023-12-19T19:02:00.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cd975640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1c80c63c0 0x7fb1c81ed740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:00.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cd174640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb1c80c2bb0 0x7fb1c80c5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:00.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cd975640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1c80c63c0 0x7fb1c81ed740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34956/0 (socket says 172.21.15.133:34956) 2023-12-19T19:02:00.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cd975640 1 -- 172.21.15.133:0/754970343 learned_addr learned my addr 172.21.15.133:0/754970343 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:00.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cc973640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1c80c4100 0x7fb1c81ed200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:00.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cd975640 1 -- 172.21.15.133:0/754970343 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1c80c4100 msgr2=0x7fb1c81ed200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:00.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cd975640 1 --2- 172.21.15.133:0/754970343 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1c80c4100 0x7fb1c81ed200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cd975640 1 -- 172.21.15.133:0/754970343 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb1c80c2bb0 msgr2=0x7fb1c80c5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:00.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cd975640 1 --2- 172.21.15.133:0/754970343 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb1c80c2bb0 0x7fb1c80c5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cd975640 1 -- 172.21.15.133:0/754970343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c4009b30 con 0x7fb1c80c63c0 2023-12-19T19:02:00.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cc973640 1 --2- 172.21.15.133:0/754970343 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1c80c4100 0x7fb1c81ed200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:02:00.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cd174640 1 --2- 172.21.15.133:0/754970343 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb1c80c2bb0 0x7fb1c80c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:02:00.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cd975640 1 --2- 172.21.15.133:0/754970343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1c80c63c0 0x7fb1c81ed740 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000e930 tx=0x7fb1c000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:00.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1bdffb640 1 -- 172.21.15.133:0/754970343 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c00096b0 con 0x7fb1c80c63c0 2023-12-19T19:02:00.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1bdffb640 1 -- 172.21.15.133:0/754970343 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c000c9a0 con 0x7fb1c80c63c0 2023-12-19T19:02:00.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cf3d8640 1 -- 172.21.15.133:0/754970343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c814e9b0 con 0x7fb1c80c63c0 2023-12-19T19:02:00.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1bdffb640 1 -- 172.21.15.133:0/754970343 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c000cd30 con 0x7fb1c80c63c0 2023-12-19T19:02:00.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cf3d8640 1 -- 172.21.15.133:0/754970343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c80c58b0 con 0x7fb1c80c63c0 2023-12-19T19:02:00.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.472+0000 7fb1cf3d8640 1 -- 172.21.15.133:0/754970343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c8068400 con 0x7fb1c80c63c0 2023-12-19T19:02:00.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.476+0000 7fb1bdffb640 1 -- 172.21.15.133:0/754970343 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb1c0013470 con 0x7fb1c80c63c0 2023-12-19T19:02:00.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.476+0000 7fb1bdffb640 1 --2- 172.21.15.133:0/754970343 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb1ac066470 0x7fb1ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:00.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.476+0000 7fb1bdffb640 1 -- 172.21.15.133:0/754970343 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb1c0084310 con 0x7fb1c80c63c0 2023-12-19T19:02:00.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.476+0000 7fb1cd174640 1 --2- 172.21.15.133:0/754970343 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb1ac066470 0x7fb1ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:00.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.480+0000 7fb1cd174640 1 --2- 172.21.15.133:0/754970343 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb1ac066470 0x7fb1ac068930 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb1c40ae000 tx=0x7fb1c40a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:00.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.480+0000 7fb1bdffb640 1 -- 172.21.15.133:0/754970343 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb1c0051630 con 0x7fb1c80c63c0 2023-12-19T19:02:00.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.628+0000 7fb1cf3d8640 1 -- 172.21.15.133:0/754970343 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fb1c81ebe80 con 0x7fb1c80c63c0 2023-12-19T19:02:00.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.628+0000 7fb1bdffb640 1 -- 172.21.15.133:0/754970343 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v73) v1 ==== 101+0+11 (secure 0 0 0) 0x7fb1c0054c50 con 0x7fb1c80c63c0 2023-12-19T19:02:00.635 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:02:00.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.632+0000 7fb1cf3d8640 1 -- 172.21.15.133:0/754970343 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb1ac066470 msgr2=0x7fb1ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:00.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.632+0000 7fb1cf3d8640 1 --2- 172.21.15.133:0/754970343 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb1ac066470 0x7fb1ac068930 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb1c40ae000 tx=0x7fb1c40a7070 comp rx=0 tx=0).stop 2023-12-19T19:02:00.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.632+0000 7fb1cf3d8640 1 -- 172.21.15.133:0/754970343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1c80c63c0 msgr2=0x7fb1c81ed740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:00.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.632+0000 7fb1cf3d8640 1 --2- 172.21.15.133:0/754970343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1c80c63c0 0x7fb1c81ed740 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000e930 tx=0x7fb1c000edf0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.632+0000 7fb1cf3d8640 1 -- 172.21.15.133:0/754970343 shutdown_connections 2023-12-19T19:02:00.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.632+0000 7fb1cf3d8640 1 --2- 172.21.15.133:0/754970343 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb1ac066470 0x7fb1ac068930 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.632+0000 7fb1cf3d8640 1 --2- 172.21.15.133:0/754970343 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1c80c63c0 0x7fb1c81ed740 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.632+0000 7fb1cf3d8640 1 --2- 172.21.15.133:0/754970343 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb1c80c4100 0x7fb1c81ed200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.632+0000 7fb1cf3d8640 1 --2- 172.21.15.133:0/754970343 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb1c80c2bb0 0x7fb1c80c5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.632+0000 7fb1cf3d8640 1 -- 172.21.15.133:0/754970343 >> 172.21.15.133:0/754970343 conn(0x7fb1c806a5b0 msgr2=0x7fb1c806a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:00.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.632+0000 7fb1cf3d8640 1 -- 172.21.15.133:0/754970343 shutdown_connections 2023-12-19T19:02:00.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.632+0000 7fb1cf3d8640 1 -- 172.21.15.133:0/754970343 wait complete. 2023-12-19T19:02:00.656 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T19:02:00.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.796+0000 7f4bd5068640 1 Processor -- start 2023-12-19T19:02:00.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.796+0000 7f4bd5068640 1 -- start start 2023-12-19T19:02:00.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.796+0000 7f4bd5068640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4bd00c4100 0x7f4bd00c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:00.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.796+0000 7f4bd5068640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4bd00c06d0 0x7f4bd00a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:00.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.796+0000 7f4bd5068640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd00c31c0 con 0x7f4bd00c63c0 2023-12-19T19:02:00.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.796+0000 7f4bd5068640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd00c34a0 con 0x7f4bd00c4100 2023-12-19T19:02:00.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.796+0000 7f4bd5068640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd00c1030 con 0x7f4bd00c06d0 2023-12-19T19:02:00.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.796+0000 7f4bced9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f4bd00c63c0 0x7f4bd00c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58028/0 (socket says 172.21.15.133:58028) 2023-12-19T19:02:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.796+0000 7f4bced9d640 1 -- 172.21.15.133:0/2728529279 learned_addr learned my addr 172.21.15.133:0/2728529279 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.796+0000 7f4bce59c640 1 --2- 172.21.15.133:0/2728529279 >> v2:172.21.15.133:3300/0 conn(0x7f4bd00c4100 0x7f4bd00c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.796+0000 7f4bcf59e640 1 --2- 172.21.15.133:0/2728529279 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4bd00c06d0 0x7f4bd00a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.796+0000 7f4bce59c640 1 -- 172.21.15.133:0/2728529279 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4bd00c06d0 msgr2=0x7f4bd00a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.796+0000 7f4bce59c640 1 --2- 172.21.15.133:0/2728529279 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4bd00c06d0 0x7f4bd00a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.796+0000 7f4bce59c640 1 -- 172.21.15.133:0/2728529279 >> v1:172.21.15.133:6789/0 conn(0x7f4bd00c63c0 legacy=0x7f4bd00c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.796+0000 7f4bce59c640 1 -- 172.21.15.133:0/2728529279 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd00c1310 con 0x7f4bd00c4100 2023-12-19T19:02:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.796+0000 7f4bcdd9b640 1 -- 172.21.15.133:0/2728529279 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 504701301 0 0) 0x7f4bd00c31c0 con 0x7f4bd00c63c0 2023-12-19T19:02:00.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.796+0000 7f4bcf59e640 1 --2- 172.21.15.133:0/2728529279 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4bd00c06d0 0x7f4bd00a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:00.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.800+0000 7f4bce59c640 1 --2- 172.21.15.133:0/2728529279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bd00c4100 0x7f4bd00c2bb0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f4bc40097c0 tx=0x7f4bc401e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57536382ea082d0a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:00.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.800+0000 7f4bcdd9b640 1 -- 172.21.15.133:0/2728529279 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bd00aa3d0 con 0x7f4bd00c4100 2023-12-19T19:02:00.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.800+0000 7f4bcdd9b640 1 -- 172.21.15.133:0/2728529279 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc40ac5f0 con 0x7f4bd00c4100 2023-12-19T19:02:00.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.800+0000 7f4bcdd9b640 1 -- 172.21.15.133:0/2728529279 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc40ac980 con 0x7f4bd00c4100 2023-12-19T19:02:00.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.800+0000 7f4bd5068640 1 -- 172.21.15.133:0/2728529279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bd00c4100 msgr2=0x7f4bd00c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:00.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.800+0000 7f4bd5068640 1 --2- 172.21.15.133:0/2728529279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bd00c4100 0x7f4bd00c2bb0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f4bc40097c0 tx=0x7f4bc401e570 comp rx=0 tx=0).stop 2023-12-19T19:02:00.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.800+0000 7f4bd5068640 1 -- 172.21.15.133:0/2728529279 shutdown_connections 2023-12-19T19:02:00.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.800+0000 7f4bd5068640 1 --2- 172.21.15.133:0/2728529279 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4bd00c06d0 0x7f4bd00a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.800+0000 7f4bd5068640 1 --2- 172.21.15.133:0/2728529279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bd00c4100 0x7f4bd00c2bb0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.800+0000 7f4bd5068640 1 -- 172.21.15.133:0/2728529279 >> 172.21.15.133:0/2728529279 conn(0x7f4bd006a5b0 msgr2=0x7f4bd006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:00.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.800+0000 7f4bd5068640 1 -- 172.21.15.133:0/2728529279 shutdown_connections 2023-12-19T19:02:00.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.800+0000 7f4bd5068640 1 -- 172.21.15.133:0/2728529279 wait complete. 2023-12-19T19:02:00.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.800+0000 7f4bd5068640 1 Processor -- start 2023-12-19T19:02:00.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bd5068640 1 -- start start 2023-12-19T19:02:00.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bd5068640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4bd00c06d0 0x7f4bd01566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:00.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bd5068640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4bd00c4100 0x7f4bd01526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:00.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bd5068640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bd00c63c0 0x7f4bd00c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:00.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bd5068640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd014fbf0 con 0x7f4bd00c63c0 2023-12-19T19:02:00.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bd5068640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd01f06c0 con 0x7f4bd00c4100 2023-12-19T19:02:00.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bd5068640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd01f0bf0 con 0x7f4bd00c06d0 2023-12-19T19:02:00.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bcf59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bd00c63c0 0x7f4bd00c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:00.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bcf59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bd00c63c0 0x7f4bd00c53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34974/0 (socket says 172.21.15.133:34974) 2023-12-19T19:02:00.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bcf59e640 1 -- 172.21.15.133:0/1001084011 learned_addr learned my addr 172.21.15.133:0/1001084011 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:00.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bced9d640 1 --2- 172.21.15.133:0/1001084011 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4bd00c06d0 0x7f4bd01566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:00.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bcf59e640 1 -- 172.21.15.133:0/1001084011 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4bd00c06d0 msgr2=0x7f4bd01566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:00.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bcf59e640 1 --2- 172.21.15.133:0/1001084011 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4bd00c06d0 0x7f4bd01566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bcf59e640 1 -- 172.21.15.133:0/1001084011 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4bd00c4100 msgr2=0x7f4bd01526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:00.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bce59c640 1 --2- 172.21.15.133:0/1001084011 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4bd00c4100 0x7f4bd01526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:00.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bcf59e640 1 --2- 172.21.15.133:0/1001084011 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4bd00c4100 0x7f4bd01526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bcf59e640 1 -- 172.21.15.133:0/1001084011 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc4009420 con 0x7f4bd00c63c0 2023-12-19T19:02:00.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bced9d640 1 --2- 172.21.15.133:0/1001084011 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4bd00c06d0 0x7f4bd01566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:00.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bce59c640 1 --2- 172.21.15.133:0/1001084011 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4bd00c4100 0x7f4bd01526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:00.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bcf59e640 1 --2- 172.21.15.133:0/1001084011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bd00c63c0 0x7f4bd00c53b0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8007ef0 tx=0x7f4bc800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:00.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bb77fe640 1 -- 172.21.15.133:0/1001084011 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc8003ba0 con 0x7f4bd00c63c0 2023-12-19T19:02:00.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bb77fe640 1 -- 172.21.15.133:0/1001084011 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc800f040 con 0x7f4bd00c63c0 2023-12-19T19:02:00.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bb77fe640 1 -- 172.21.15.133:0/1001084011 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc800de80 con 0x7f4bd00c63c0 2023-12-19T19:02:00.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bd5068640 1 -- 172.21.15.133:0/1001084011 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd0071970 con 0x7f4bd00c63c0 2023-12-19T19:02:00.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bd5068640 1 -- 172.21.15.133:0/1001084011 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd01f0910 con 0x7f4bd00c63c0 2023-12-19T19:02:00.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.804+0000 7f4bd5068640 1 -- 172.21.15.133:0/1001084011 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd0068400 con 0x7f4bd00c63c0 2023-12-19T19:02:00.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.808+0000 7f4bb77fe640 1 -- 172.21.15.133:0/1001084011 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4bc8004030 con 0x7f4bd00c63c0 2023-12-19T19:02:00.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.808+0000 7f4bb77fe640 1 --2- 172.21.15.133:0/1001084011 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4bbc066470 0x7f4bbc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:00.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.808+0000 7f4bb77fe640 1 -- 172.21.15.133:0/1001084011 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4bc8084460 con 0x7f4bd00c63c0 2023-12-19T19:02:00.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.808+0000 7f4bced9d640 1 --2- 172.21.15.133:0/1001084011 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4bbc066470 0x7f4bbc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:00.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.808+0000 7f4bced9d640 1 --2- 172.21.15.133:0/1001084011 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4bbc066470 0x7f4bbc068930 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0007fd0 tx=0x7f4bc0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:00.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.812+0000 7f4bb77fe640 1 -- 172.21.15.133:0/1001084011 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4bc8051620 con 0x7f4bd00c63c0 2023-12-19T19:02:00.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.980+0000 7f4bd5068640 1 -- 172.21.15.133:0/1001084011 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4bd0156420 con 0x7f4bd00c63c0 2023-12-19T19:02:00.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.980+0000 7f4bb77fe640 1 -- 172.21.15.133:0/1001084011 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v73) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4bc8054c40 con 0x7f4bd00c63c0 2023-12-19T19:02:00.985 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-19T19:02:00.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.980+0000 7f4bd5068640 1 -- 172.21.15.133:0/1001084011 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4bbc066470 msgr2=0x7f4bbc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:00.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.980+0000 7f4bd5068640 1 --2- 172.21.15.133:0/1001084011 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4bbc066470 0x7f4bbc068930 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0007fd0 tx=0x7f4bc0009040 comp rx=0 tx=0).stop 2023-12-19T19:02:00.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.980+0000 7f4bd5068640 1 -- 172.21.15.133:0/1001084011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bd00c63c0 msgr2=0x7f4bd00c53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:00.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.980+0000 7f4bd5068640 1 --2- 172.21.15.133:0/1001084011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bd00c63c0 0x7f4bd00c53b0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8007ef0 tx=0x7f4bc800d4a0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.980+0000 7f4bd5068640 1 -- 172.21.15.133:0/1001084011 shutdown_connections 2023-12-19T19:02:00.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.980+0000 7f4bd5068640 1 --2- 172.21.15.133:0/1001084011 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4bbc066470 0x7f4bbc068930 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.980+0000 7f4bd5068640 1 --2- 172.21.15.133:0/1001084011 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4bd00c63c0 0x7f4bd00c53b0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.980+0000 7f4bd5068640 1 --2- 172.21.15.133:0/1001084011 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4bd00c4100 0x7f4bd01526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.980+0000 7f4bd5068640 1 --2- 172.21.15.133:0/1001084011 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4bd00c06d0 0x7f4bd01566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:00.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.980+0000 7f4bd5068640 1 -- 172.21.15.133:0/1001084011 >> 172.21.15.133:0/1001084011 conn(0x7f4bd006a5b0 msgr2=0x7f4bd00c22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:00.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.980+0000 7f4bd5068640 1 -- 172.21.15.133:0/1001084011 shutdown_connections 2023-12-19T19:02:00.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:00.980+0000 7f4bd5068640 1 -- 172.21.15.133:0/1001084011 wait complete. 2023-12-19T19:02:01.006 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T19:02:01.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:01.007 DEBUG:teuthology.orchestra.run.smithi138:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T19:02:01.035 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi138.front.sepia.ceph.com 2023-12-19T19:02:01.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:01.035 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T19:02:01.092 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:02:01.092 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:02:01.146 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3612 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-19T19:02:01.146 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T19:02:01.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.280+0000 7f989b39d640 1 Processor -- start 2023-12-19T19:02:01.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.280+0000 7f989b39d640 1 -- start start 2023-12-19T19:02:01.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.280+0000 7f989b39d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9894151e90 0x7f98940c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:01.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.280+0000 7f989b39d640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f989406c860 con 0x7f98940c4e60 2023-12-19T19:02:01.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.280+0000 7f989b39d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9894154930 con 0x7f98940c7ea0 2023-12-19T19:02:01.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.280+0000 7f989b39d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98940c8750 con 0x7f9894151e90 2023-12-19T19:02:01.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.280+0000 7f989993a640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f98940c4e60 0x7f989415f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58034/0 (socket says 172.21.15.133:58034) 2023-12-19T19:02:01.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.280+0000 7f989993a640 1 -- 172.21.15.133:0/3070366628 learned_addr learned my addr 172.21.15.133:0/3070366628 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:01.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.280+0000 7f9899139640 1 --2- 172.21.15.133:0/3070366628 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9894151e90 0x7f98940c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:01.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.280+0000 7f988bfff640 1 -- 172.21.15.133:0/3070366628 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1801987495 0 0) 0x7f989406c860 con 0x7f98940c4e60 2023-12-19T19:02:01.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.280+0000 7f988bfff640 1 -- 172.21.15.133:0/3070366628 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9880003530 con 0x7f98940c4e60 2023-12-19T19:02:01.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.280+0000 7f988bfff640 1 -- 172.21.15.133:0/3070366628 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1470436822 0 0) 0x7f9894154930 con 0x7f98940c7ea0 2023-12-19T19:02:01.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.280+0000 7f988bfff640 1 -- 172.21.15.133:0/3070366628 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f989406c860 con 0x7f98940c7ea0 2023-12-19T19:02:01.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.280+0000 7f988bfff640 1 -- 172.21.15.133:0/3070366628 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3060641473 0 0) 0x7f9880003530 con 0x7f98940c4e60 2023-12-19T19:02:01.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.280+0000 7f9899139640 1 -- 172.21.15.133:0/3070366628 >> v1:172.21.15.138:6789/0 conn(0x7f98940c7ea0 legacy=0x7f989406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:01.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.280+0000 7f9899139640 1 -- 172.21.15.133:0/3070366628 >> v1:172.21.15.133:6789/0 conn(0x7f98940c4e60 legacy=0x7f989415f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:01.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.280+0000 7f9899139640 1 -- 172.21.15.133:0/3070366628 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9894154c10 con 0x7f9894151e90 2023-12-19T19:02:01.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.284+0000 7f9899139640 1 --2- 172.21.15.133:0/3070366628 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9894151e90 0x7f98940c4920 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f98900097f0 tx=0x7f989001c2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff529c8d14018170 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:01.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.284+0000 7f988bfff640 1 -- 172.21.15.133:0/3070366628 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c001a00 con 0x7f9894151e90 2023-12-19T19:02:01.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.284+0000 7f988bfff640 1 -- 172.21.15.133:0/3070366628 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98900a7050 con 0x7f9894151e90 2023-12-19T19:02:01.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.284+0000 7f988bfff640 1 -- 172.21.15.133:0/3070366628 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98900ab620 con 0x7f9894151e90 2023-12-19T19:02:01.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.284+0000 7f989b39d640 1 -- 172.21.15.133:0/3070366628 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9894151e90 msgr2=0x7f98940c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:01.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.284+0000 7f989b39d640 1 --2- 172.21.15.133:0/3070366628 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9894151e90 0x7f98940c4920 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f98900097f0 tx=0x7f989001c2c0 comp rx=0 tx=0).stop 2023-12-19T19:02:01.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.284+0000 7f989b39d640 1 -- 172.21.15.133:0/3070366628 shutdown_connections 2023-12-19T19:02:01.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.284+0000 7f989b39d640 1 --2- 172.21.15.133:0/3070366628 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9894151e90 0x7f98940c4920 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:01.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.284+0000 7f989b39d640 1 -- 172.21.15.133:0/3070366628 >> 172.21.15.133:0/3070366628 conn(0x7f98940ca170 msgr2=0x7f98940ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:01.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.284+0000 7f989b39d640 1 -- 172.21.15.133:0/3070366628 shutdown_connections 2023-12-19T19:02:01.291 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.284+0000 7f989b39d640 1 -- 172.21.15.133:0/3070366628 wait complete. 2023-12-19T19:02:01.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f989b39d640 1 Processor -- start 2023-12-19T19:02:01.292 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f989b39d640 1 -- start start 2023-12-19T19:02:01.294 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f989b39d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98940c4e60 0x7f98940bd910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:01.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f989b39d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98940c7ea0 0x7f98940bde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:01.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f989b39d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9894151e90 0x7f98940be450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:01.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f989b39d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98941552d0 con 0x7f98940c7ea0 2023-12-19T19:02:01.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f989b39d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989414b9f0 con 0x7f98940c4e60 2023-12-19T19:02:01.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f989b39d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98941eda40 con 0x7f9894151e90 2023-12-19T19:02:01.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f9898938640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98940c7ea0 0x7f98940bde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:01.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f9898938640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98940c7ea0 0x7f98940bde50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34984/0 (socket says 172.21.15.133:34984) 2023-12-19T19:02:01.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f9898938640 1 -- 172.21.15.133:0/4166122073 learned_addr learned my addr 172.21.15.133:0/4166122073 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:01.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f9899139640 1 --2- 172.21.15.133:0/4166122073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98940c4e60 0x7f98940bd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:01.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f989993a640 1 --2- 172.21.15.133:0/4166122073 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9894151e90 0x7f98940be450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:01.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f9898938640 1 -- 172.21.15.133:0/4166122073 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9894151e90 msgr2=0x7f98940be450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:01.295 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f9898938640 1 --2- 172.21.15.133:0/4166122073 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9894151e90 0x7f98940be450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:01.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f9898938640 1 -- 172.21.15.133:0/4166122073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98940c4e60 msgr2=0x7f98940bd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:01.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f9898938640 1 --2- 172.21.15.133:0/4166122073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98940c4e60 0x7f98940bd910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:01.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f9898938640 1 -- 172.21.15.133:0/4166122073 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9890009420 con 0x7f98940c7ea0 2023-12-19T19:02:01.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f989993a640 1 --2- 172.21.15.133:0/4166122073 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9894151e90 0x7f98940be450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:01.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f9898938640 1 --2- 172.21.15.133:0/4166122073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98940c7ea0 0x7f98940bde50 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f988400c460 tx=0x7f988400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:01.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f9889ffb640 1 -- 172.21.15.133:0/4166122073 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98840052d0 con 0x7f98940c7ea0 2023-12-19T19:02:01.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f9889ffb640 1 -- 172.21.15.133:0/4166122073 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9884005450 con 0x7f98940c7ea0 2023-12-19T19:02:01.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f9889ffb640 1 -- 172.21.15.133:0/4166122073 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9884003840 con 0x7f98940c7ea0 2023-12-19T19:02:01.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f989b39d640 1 -- 172.21.15.133:0/4166122073 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98941edf70 con 0x7f98940c7ea0 2023-12-19T19:02:01.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.288+0000 7f989b39d640 1 -- 172.21.15.133:0/4166122073 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98941edc90 con 0x7f98940c7ea0 2023-12-19T19:02:01.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.292+0000 7f989b39d640 1 -- 172.21.15.133:0/4166122073 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98940675e0 con 0x7f98940c7ea0 2023-12-19T19:02:01.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.292+0000 7f9889ffb640 1 -- 172.21.15.133:0/4166122073 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f98840039a0 con 0x7f98940c7ea0 2023-12-19T19:02:01.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.292+0000 7f9889ffb640 1 --2- 172.21.15.133:0/4166122073 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9878066470 0x7f9878068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:01.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.292+0000 7f9889ffb640 1 -- 172.21.15.133:0/4166122073 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9884083700 con 0x7f98940c7ea0 2023-12-19T19:02:01.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.292+0000 7f9899139640 1 --2- 172.21.15.133:0/4166122073 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9878066470 0x7f9878068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:01.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.292+0000 7f9899139640 1 --2- 172.21.15.133:0/4166122073 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9878066470 0x7f9878068930 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f98900ad000 tx=0x7f98900a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:01.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.296+0000 7f9889ffb640 1 -- 172.21.15.133:0/4166122073 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9884050960 con 0x7f98940c7ea0 2023-12-19T19:02:01.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.476+0000 7f989b39d640 1 -- 172.21.15.133:0/4166122073 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9894068400 con 0x7f98940c7ea0 2023-12-19T19:02:01.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.480+0000 7f9889ffb640 1 -- 172.21.15.133:0/4166122073 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) v1 ==== 53+0+149 (secure 0 0 0) 0x7f9884053f80 con 0x7f98940c7ea0 2023-12-19T19:02:01.483 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T19:02:01.484 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-19T19:02:01.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.480+0000 7f989b39d640 1 -- 172.21.15.133:0/4166122073 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9878066470 msgr2=0x7f9878068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:01.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.480+0000 7f989b39d640 1 --2- 172.21.15.133:0/4166122073 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9878066470 0x7f9878068930 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f98900ad000 tx=0x7f98900a6000 comp rx=0 tx=0).stop 2023-12-19T19:02:01.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.480+0000 7f989b39d640 1 -- 172.21.15.133:0/4166122073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98940c7ea0 msgr2=0x7f98940bde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:01.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.480+0000 7f989b39d640 1 --2- 172.21.15.133:0/4166122073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98940c7ea0 0x7f98940bde50 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f988400c460 tx=0x7f988400c920 comp rx=0 tx=0).stop 2023-12-19T19:02:01.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.480+0000 7f989b39d640 1 -- 172.21.15.133:0/4166122073 shutdown_connections 2023-12-19T19:02:01.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.480+0000 7f989b39d640 1 --2- 172.21.15.133:0/4166122073 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9878066470 0x7f9878068930 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:01.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.480+0000 7f989b39d640 1 --2- 172.21.15.133:0/4166122073 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9894151e90 0x7f98940be450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:01.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.480+0000 7f989b39d640 1 --2- 172.21.15.133:0/4166122073 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f98940c7ea0 0x7f98940bde50 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:01.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.480+0000 7f989b39d640 1 --2- 172.21.15.133:0/4166122073 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f98940c4e60 0x7f98940bd910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:01.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.480+0000 7f989b39d640 1 -- 172.21.15.133:0/4166122073 >> 172.21.15.133:0/4166122073 conn(0x7f98940ca170 msgr2=0x7f989406b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:01.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.480+0000 7f989b39d640 1 -- 172.21.15.133:0/4166122073 shutdown_connections 2023-12-19T19:02:01.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:01.480+0000 7f989b39d640 1 -- 172.21.15.133:0/4166122073 wait complete. 2023-12-19T19:02:01.505 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-19T19:02:01.505 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T19:02:01.505 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi138.front.sepia.ceph.com 2023-12-19T19:02:01.505 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T19:02:01.505 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T19:02:01.506 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-19T19:02:01.506 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T19:02:01.506 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T19:02:01.506 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T19:02:01.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:01.506 DEBUG:teuthology.orchestra.run.smithi138:> ip addr 2023-12-19T19:02:01.517 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T19:02:01.517 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T19:02:01.517 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T19:02:01.517 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:02:01.517 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2023-12-19T19:02:01.517 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:02:01.517 INFO:teuthology.orchestra.run.smithi138.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:02:01.517 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7a brd ff:ff:ff:ff:ff:ff 2023-12-19T19:02:01.517 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f0 2023-12-19T19:02:01.517 INFO:teuthology.orchestra.run.smithi138.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:02:01.517 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7b brd ff:ff:ff:ff:ff:ff 2023-12-19T19:02:01.518 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f1 2023-12-19T19:02:01.518 INFO:teuthology.orchestra.run.smithi138.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:02:01.518 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:70 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:02:01.518 INFO:teuthology.orchestra.run.smithi138.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T19:02:01.518 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:71 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:02:01.518 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.21.15.138/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T19:02:01.518 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft 42232sec preferred_lft 42232sec 2023-12-19T19:02:01.518 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::ec4:7aff:fe88:6f71/64 scope link 2023-12-19T19:02:01.518 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:02:01.518 INFO:teuthology.orchestra.run.smithi138.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T19:02:01.518 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 02:42:5b:f5:51:87 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:02:01.519 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T19:02:01.519 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:02:01.519 INFO:teuthology.orchestra.run.smithi138.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T19:02:01.519 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T19:02:01.519 INFO:teuthology.orchestra.run.smithi138.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T19:02:01.519 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:02:01.519 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-19T19:02:01.519 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:02:01.519 INFO:teuthology.orchestra.run.smithi138.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T19:02:01.519 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T19:02:01.519 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-19T19:02:01.519 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:02:01.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:01.520 DEBUG:teuthology.orchestra.run.smithi138:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T19:02:01.587 INFO:teuthology.orchestra.run.smithi138.stdout:1 2023-12-19T19:02:01.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:01.590 DEBUG:teuthology.orchestra.run.smithi138:> route 2023-12-19T19:02:01.642 INFO:teuthology.orchestra.run.smithi138.stdout:Kernel IP routing table 2023-12-19T19:02:01.643 INFO:teuthology.orchestra.run.smithi138.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T19:02:01.643 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T19:02:01.643 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T19:02:01.643 INFO:teuthology.orchestra.run.smithi138.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T19:02:01.643 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T19:02:01.643 INFO:teuthology.orchestra.run.smithi138.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:02:01.643 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:02:01.644 INFO:teuthology.orchestra.run.smithi138.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:02:01.644 INFO:teuthology.orchestra.run.smithi138.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T19:02:01.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:01.644 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-12-19T19:02:01.644 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-12-19T19:02:01.644 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T19:02:01.644 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T19:02:01.644 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T19:02:01.645 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-12-19T19:02:01.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:01.747 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2023-12-19T19:02:01.757 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T19:02:01.758 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T19:02:01.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:01.759 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set brx.0 up 2023-12-19T19:02:01.824 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T19:02:01.824 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T19:02:01.875 INFO:teuthology.orchestra.run.smithi138.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T19:02:01.875 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T19:02:01.875 DEBUG:teuthology.orchestra.run.smithi138:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T19:02:01.926 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2023-12-19T19:02:01.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:01.927 DEBUG:teuthology.orchestra.run.smithi138:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:02:02.021 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:02:02.021 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T19:02:02.034 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:02:02.034 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T19:02:02.034 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-12-19T19:02:02.034 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: trying mount with new device syntax: 1@03e63958-005e-4bf2-ae5b-291aceb6fbbf.cephfs2=/ 2023-12-19T19:02:02.034 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.133:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-12-19T19:02:02.038 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T19:02:02.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:02.038 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T19:02:02.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:02.059 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T19:02:02.119 INFO:teuthology.orchestra.run.smithi138.stdout:client6517 2023-12-19T19:02:02.119 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:02:02.119 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:02:02.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:02.175 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/testdir) 2023-12-19T19:02:02.191 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T19:02:02.191 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/mnt.0/testdir/testfile 2023-12-19T19:02:02.249 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs" at path "/home/ubuntu/cephtest/mnt.0/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T19:02:02.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:02.249 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec mkdir /home/ubuntu/cephtest/mnt.1/testdir) 2023-12-19T19:02:02.265 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:02:02.265 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/mnt.1/testdir/testfile 2023-12-19T19:02:02.320 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs2" at path "/home/ubuntu/cephtest/mnt.1/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.1/testdir/testfile cephfs_name = cephfs2 cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T19:02:02.320 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow r' osd 'allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2' mds 'allow r fsname=cephfs, allow r fsname=cephfs2' 2023-12-19T19:02:02.464 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.460+0000 7ff179b80640 1 Processor -- start 2023-12-19T19:02:02.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.460+0000 7ff179b80640 1 -- start start 2023-12-19T19:02:02.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.460+0000 7ff179b80640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff1740c5260 0x7ff17406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:02.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.460+0000 7ff179b80640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1740c5640 0x7ff1740c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:02.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.460+0000 7ff179b80640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1740c2580 con 0x7ff1740c60f0 2023-12-19T19:02:02.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.460+0000 7ff179b80640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff174153510 con 0x7ff1740c5260 2023-12-19T19:02:02.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.460+0000 7ff179b80640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1740c17f0 con 0x7ff1740c5640 2023-12-19T19:02:02.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.460+0000 7ff1737fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff1740c5260 0x7ff17406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:02.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.460+0000 7ff173fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff1740c60f0 0x7ff174155de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58044/0 (socket says 172.21.15.133:58044) 2023-12-19T19:02:02.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.460+0000 7ff173fff640 1 -- 172.21.15.133:0/3822342624 learned_addr learned my addr 172.21.15.133:0/3822342624 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:02.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.460+0000 7ff172ffd640 1 --2- 172.21.15.133:0/3822342624 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1740c5640 0x7ff1740c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:02.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.460+0000 7ff1737fe640 1 -- 172.21.15.133:0/3822342624 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1740c5640 msgr2=0x7ff1740c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:02.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.460+0000 7ff1737fe640 1 --2- 172.21.15.133:0/3822342624 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1740c5640 0x7ff1740c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:02.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.460+0000 7ff1737fe640 1 -- 172.21.15.133:0/3822342624 >> v1:172.21.15.133:6789/0 conn(0x7ff1740c60f0 legacy=0x7ff174155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:02.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.460+0000 7ff1737fe640 1 -- 172.21.15.133:0/3822342624 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1740c1a00 con 0x7ff1740c5260 2023-12-19T19:02:02.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.460+0000 7ff1727fc640 1 -- 172.21.15.133:0/3822342624 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2585865283 0 0) 0x7ff1740c2580 con 0x7ff1740c60f0 2023-12-19T19:02:02.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.464+0000 7ff1737fe640 1 --2- 172.21.15.133:0/3822342624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1740c5260 0x7ff17406d5b0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7ff1740c1930 tx=0x7ff16401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1708c7cea6c9081e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:02.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.464+0000 7ff1727fc640 1 -- 172.21.15.133:0/3822342624 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1640ac640 con 0x7ff1740c5260 2023-12-19T19:02:02.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.464+0000 7ff1727fc640 1 -- 172.21.15.133:0/3822342624 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1640ac7a0 con 0x7ff1740c5260 2023-12-19T19:02:02.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.464+0000 7ff1727fc640 1 -- 172.21.15.133:0/3822342624 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1640acb30 con 0x7ff1740c5260 2023-12-19T19:02:02.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.464+0000 7ff179b80640 1 -- 172.21.15.133:0/3822342624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1740c5260 msgr2=0x7ff17406d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:02.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.464+0000 7ff179b80640 1 --2- 172.21.15.133:0/3822342624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1740c5260 0x7ff17406d5b0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7ff1740c1930 tx=0x7ff16401c3c0 comp rx=0 tx=0).stop 2023-12-19T19:02:02.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.464+0000 7ff179b80640 1 -- 172.21.15.133:0/3822342624 shutdown_connections 2023-12-19T19:02:02.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.464+0000 7ff179b80640 1 --2- 172.21.15.133:0/3822342624 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1740c5640 0x7ff1740c5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:02.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.464+0000 7ff179b80640 1 --2- 172.21.15.133:0/3822342624 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1740c5260 0x7ff17406d5b0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:02.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.464+0000 7ff179b80640 1 -- 172.21.15.133:0/3822342624 >> 172.21.15.133:0/3822342624 conn(0x7ff17406a5b0 msgr2=0x7ff17406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:02.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.464+0000 7ff179b80640 1 -- 172.21.15.133:0/3822342624 shutdown_connections 2023-12-19T19:02:02.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.464+0000 7ff179b80640 1 -- 172.21.15.133:0/3822342624 wait complete. 2023-12-19T19:02:02.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff179b80640 1 Processor -- start 2023-12-19T19:02:02.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff179b80640 1 -- start start 2023-12-19T19:02:02.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff179b80640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1740c5260 0x7ff1741514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:02.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff179b80640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1740c5640 0x7ff17414ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:02.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff179b80640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1740c60f0 0x7ff17414d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:02.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff179b80640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1741f12b0 con 0x7ff1740c5260 2023-12-19T19:02:02.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff179b80640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1741f17e0 con 0x7ff1740c5640 2023-12-19T19:02:02.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff179b80640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17414d900 con 0x7ff1740c60f0 2023-12-19T19:02:02.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff1737fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1740c5260 0x7ff1741514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:02.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff1737fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1740c5260 0x7ff1741514d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34996/0 (socket says 172.21.15.133:34996) 2023-12-19T19:02:02.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff1737fe640 1 -- 172.21.15.133:0/4085557940 learned_addr learned my addr 172.21.15.133:0/4085557940 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:02.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff1737fe640 1 -- 172.21.15.133:0/4085557940 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1740c60f0 msgr2=0x7ff17414d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:02.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff1737fe640 1 --2- 172.21.15.133:0/4085557940 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1740c60f0 0x7ff17414d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:02.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff172ffd640 1 --2- 172.21.15.133:0/4085557940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1740c5640 0x7ff17414ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:02.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff1737fe640 1 -- 172.21.15.133:0/4085557940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1740c5640 msgr2=0x7ff17414ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:02.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff1737fe640 1 --2- 172.21.15.133:0/4085557940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1740c5640 0x7ff17414ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:02.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff1737fe640 1 -- 172.21.15.133:0/4085557940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff164009420 con 0x7ff1740c5260 2023-12-19T19:02:02.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff172ffd640 1 --2- 172.21.15.133:0/4085557940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1740c5640 0x7ff17414ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:02.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff1737fe640 1 --2- 172.21.15.133:0/4085557940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1740c5260 0x7ff1741514d0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7ff16401aa70 tx=0x7ff16401ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:02.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff15bfff640 1 -- 172.21.15.133:0/4085557940 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1640b7620 con 0x7ff1740c5260 2023-12-19T19:02:02.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff15bfff640 1 -- 172.21.15.133:0/4085557940 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1640b7780 con 0x7ff1740c5260 2023-12-19T19:02:02.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff15bfff640 1 -- 172.21.15.133:0/4085557940 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1640b7af0 con 0x7ff1740c5260 2023-12-19T19:02:02.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff179b80640 1 -- 172.21.15.133:0/4085557940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff174152080 con 0x7ff1740c5260 2023-12-19T19:02:02.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.468+0000 7ff179b80640 1 -- 172.21.15.133:0/4085557940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1741f1500 con 0x7ff1740c5260 2023-12-19T19:02:02.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.472+0000 7ff179b80640 1 -- 172.21.15.133:0/4085557940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1740c0440 con 0x7ff1740c5260 2023-12-19T19:02:02.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.472+0000 7ff15bfff640 1 -- 172.21.15.133:0/4085557940 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff1640b3040 con 0x7ff1740c5260 2023-12-19T19:02:02.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.472+0000 7ff15bfff640 1 --2- 172.21.15.133:0/4085557940 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff160066470 0x7ff160068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:02.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.472+0000 7ff15bfff640 1 -- 172.21.15.133:0/4085557940 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff16411e870 con 0x7ff1740c5260 2023-12-19T19:02:02.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.472+0000 7ff172ffd640 1 --2- 172.21.15.133:0/4085557940 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff160066470 0x7ff160068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:02.478 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.472+0000 7ff172ffd640 1 --2- 172.21.15.133:0/4085557940 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff160066470 0x7ff160068930 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff1740a8300 tx=0x7ff168008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:02.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.476+0000 7ff15bfff640 1 -- 172.21.15.133:0/4085557940 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff1640eb980 con 0x7ff1740c5260 2023-12-19T19:02:02.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.680+0000 7ff179b80640 1 -- 172.21.15.133:0/4085557940 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]} v 0) v1 -- 0x7ff174068400 con 0x7ff1740c5260 2023-12-19T19:02:02.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.684+0000 7ff15bfff640 1 -- 172.21.15.133:0/4085557940 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]}]=0 added key for client.testuser v21) v1 ==== 272+0+0 (secure 0 0 0) 0x7ff1640eefa0 con 0x7ff1740c5260 2023-12-19T19:02:02.687 INFO:teuthology.orchestra.run.smithi133.stderr:added key for client.testuser 2023-12-19T19:02:02.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.684+0000 7ff179b80640 1 -- 172.21.15.133:0/4085557940 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff160066470 msgr2=0x7ff160068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:02.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.684+0000 7ff179b80640 1 --2- 172.21.15.133:0/4085557940 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff160066470 0x7ff160068930 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff1740a8300 tx=0x7ff168008040 comp rx=0 tx=0).stop 2023-12-19T19:02:02.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.684+0000 7ff179b80640 1 -- 172.21.15.133:0/4085557940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1740c5260 msgr2=0x7ff1741514d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:02.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.684+0000 7ff179b80640 1 --2- 172.21.15.133:0/4085557940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1740c5260 0x7ff1741514d0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7ff16401aa70 tx=0x7ff16401ac00 comp rx=0 tx=0).stop 2023-12-19T19:02:02.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.684+0000 7ff179b80640 1 -- 172.21.15.133:0/4085557940 shutdown_connections 2023-12-19T19:02:02.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.684+0000 7ff179b80640 1 --2- 172.21.15.133:0/4085557940 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff160066470 0x7ff160068930 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:02.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.684+0000 7ff179b80640 1 --2- 172.21.15.133:0/4085557940 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff1740c60f0 0x7ff17414d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:02.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.684+0000 7ff179b80640 1 --2- 172.21.15.133:0/4085557940 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff1740c5640 0x7ff17414ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:02.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.684+0000 7ff179b80640 1 --2- 172.21.15.133:0/4085557940 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1740c5260 0x7ff1741514d0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:02.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.684+0000 7ff179b80640 1 -- 172.21.15.133:0/4085557940 >> 172.21.15.133:0/4085557940 conn(0x7ff17406a5b0 msgr2=0x7ff1740a7430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:02.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.684+0000 7ff179b80640 1 -- 172.21.15.133:0/4085557940 shutdown_connections 2023-12-19T19:02:02.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.684+0000 7ff179b80640 1 -- 172.21.15.133:0/4085557940 wait complete. 2023-12-19T19:02:02.709 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2023-12-19T19:02:02.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.844+0000 7f11798fe640 1 Processor -- start 2023-12-19T19:02:02.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.844+0000 7f11798fe640 1 -- start start 2023-12-19T19:02:02.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.844+0000 7f11798fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f11740c42f0 0x7f11740c46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:02.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.844+0000 7f11798fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f117406c3f0 0x7f11741546f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:02.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.844+0000 7f11798fe640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1174154c30 con 0x7f11740c5670 2023-12-19T19:02:02.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.844+0000 7f11798fe640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117406be80 con 0x7f117406c3f0 2023-12-19T19:02:02.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.844+0000 7f11798fe640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1174072520 con 0x7f11740c42f0 2023-12-19T19:02:02.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.844+0000 7f11737fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f117406c3f0 0x7f11741546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:02.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.844+0000 7f116bfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f11740c5670 0x7f1174153fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58046/0 (socket says 172.21.15.133:58046) 2023-12-19T19:02:02.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.844+0000 7f11737fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f117406c3f0 0x7f11741546f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35008/0 (socket says 172.21.15.133:35008) 2023-12-19T19:02:02.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.844+0000 7f116bfff640 1 -- 172.21.15.133:0/1890852329 learned_addr learned my addr 172.21.15.133:0/1890852329 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:02.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.844+0000 7f1172ffd640 1 --2- 172.21.15.133:0/1890852329 >> v2:172.21.15.138:3300/0 conn(0x7f11740c42f0 0x7f11740c46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:02.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.844+0000 7f11737fe640 1 -- 172.21.15.133:0/1890852329 >> v2:172.21.15.138:3300/0 conn(0x7f11740c42f0 msgr2=0x7f11740c46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:02.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.844+0000 7f11737fe640 1 --2- 172.21.15.133:0/1890852329 >> v2:172.21.15.138:3300/0 conn(0x7f11740c42f0 0x7f11740c46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:02.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.844+0000 7f11737fe640 1 -- 172.21.15.133:0/1890852329 >> v1:172.21.15.133:6789/0 conn(0x7f11740c5670 legacy=0x7f1174153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:02.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.844+0000 7f11737fe640 1 -- 172.21.15.133:0/1890852329 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11740c22c0 con 0x7f117406c3f0 2023-12-19T19:02:02.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.844+0000 7f11727fc640 1 -- 172.21.15.133:0/1890852329 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2054460391 0 0) 0x7f115c001120 con 0x7f11740c5670 2023-12-19T19:02:02.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.848+0000 7f11737fe640 1 --2- 172.21.15.133:0/1890852329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f117406c3f0 0x7f11741546f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f11740c5420 tx=0x7f116c01e9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f467004b5b0692f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:02.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.848+0000 7f11727fc640 1 -- 172.21.15.133:0/1890852329 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c00b2d0 con 0x7f117406c3f0 2023-12-19T19:02:02.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.848+0000 7f11727fc640 1 -- 172.21.15.133:0/1890852329 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116c0a7730 con 0x7f117406c3f0 2023-12-19T19:02:02.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.848+0000 7f11727fc640 1 -- 172.21.15.133:0/1890852329 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c0a7ac0 con 0x7f117406c3f0 2023-12-19T19:02:02.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.848+0000 7f11798fe640 1 -- 172.21.15.133:0/1890852329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f117406c3f0 msgr2=0x7f11741546f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:02.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.848+0000 7f11798fe640 1 --2- 172.21.15.133:0/1890852329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f117406c3f0 0x7f11741546f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f11740c5420 tx=0x7f116c01e9f0 comp rx=0 tx=0).stop 2023-12-19T19:02:02.854 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.848+0000 7f11798fe640 1 -- 172.21.15.133:0/1890852329 shutdown_connections 2023-12-19T19:02:02.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.848+0000 7f11798fe640 1 --2- 172.21.15.133:0/1890852329 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f117406c3f0 0x7f11741546f0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:02.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.848+0000 7f11798fe640 1 --2- 172.21.15.133:0/1890852329 >> v2:172.21.15.138:3300/0 conn(0x7f11740c42f0 0x7f11740c46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:02.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.848+0000 7f11798fe640 1 -- 172.21.15.133:0/1890852329 >> 172.21.15.133:0/1890852329 conn(0x7f11740a7910 msgr2=0x7f11740a7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:02.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.848+0000 7f11798fe640 1 -- 172.21.15.133:0/1890852329 shutdown_connections 2023-12-19T19:02:02.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.848+0000 7f11798fe640 1 -- 172.21.15.133:0/1890852329 wait complete. 2023-12-19T19:02:02.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f11798fe640 1 Processor -- start 2023-12-19T19:02:02.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f11798fe640 1 -- start start 2023-12-19T19:02:02.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f11798fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f117406c3f0 0x7f1174151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:02.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f11798fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11740c42f0 0x7f11741429b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:02.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f11798fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11740c5670 0x7f11741ecaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:02.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f11798fe640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11741432b0 con 0x7f11740c5670 2023-12-19T19:02:02.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f11798fe640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11741f0010 con 0x7f11740c42f0 2023-12-19T19:02:02.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f11798fe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11741f02f0 con 0x7f117406c3f0 2023-12-19T19:02:02.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f11737fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11740c5670 0x7f11741ecaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:02.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f11737fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11740c5670 0x7f11741ecaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35018/0 (socket says 172.21.15.133:35018) 2023-12-19T19:02:02.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f11737fe640 1 -- 172.21.15.133:0/1596959120 learned_addr learned my addr 172.21.15.133:0/1596959120 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:02.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f116bfff640 1 --2- 172.21.15.133:0/1596959120 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11740c42f0 0x7f11741429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:02.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f1172ffd640 1 --2- 172.21.15.133:0/1596959120 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f117406c3f0 0x7f1174151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:02.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f11737fe640 1 -- 172.21.15.133:0/1596959120 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f117406c3f0 msgr2=0x7f1174151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:02.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f11737fe640 1 --2- 172.21.15.133:0/1596959120 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f117406c3f0 0x7f1174151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:02.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f11737fe640 1 -- 172.21.15.133:0/1596959120 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11740c42f0 msgr2=0x7f11741429b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:02.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f11737fe640 1 --2- 172.21.15.133:0/1596959120 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11740c42f0 0x7f11741429b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:02.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f11737fe640 1 -- 172.21.15.133:0/1596959120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116c00bc80 con 0x7f11740c5670 2023-12-19T19:02:02.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f1172ffd640 1 --2- 172.21.15.133:0/1596959120 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f117406c3f0 0x7f1174151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:02.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f116bfff640 1 --2- 172.21.15.133:0/1596959120 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11740c42f0 0x7f11741429b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:02.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f11737fe640 1 --2- 172.21.15.133:0/1596959120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11740c5670 0x7f11741ecaa0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f116c01b600 tx=0x7f116c01b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:02.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f1170ff9640 1 -- 172.21.15.133:0/1596959120 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c009540 con 0x7f11740c5670 2023-12-19T19:02:02.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f1170ff9640 1 -- 172.21.15.133:0/1596959120 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116c0096e0 con 0x7f11740c5670 2023-12-19T19:02:02.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f11798fe640 1 -- 172.21.15.133:0/1596959120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11741f05d0 con 0x7f11740c5670 2023-12-19T19:02:02.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f1170ff9640 1 -- 172.21.15.133:0/1596959120 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c009a90 con 0x7f11740c5670 2023-12-19T19:02:02.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f11798fe640 1 -- 172.21.15.133:0/1596959120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1174151760 con 0x7f11740c5670 2023-12-19T19:02:02.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.852+0000 7f11798fe640 1 -- 172.21.15.133:0/1596959120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11740c1f90 con 0x7f11740c5670 2023-12-19T19:02:02.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.856+0000 7f1170ff9640 1 -- 172.21.15.133:0/1596959120 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f116c009bf0 con 0x7f11740c5670 2023-12-19T19:02:02.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.856+0000 7f1170ff9640 1 --2- 172.21.15.133:0/1596959120 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1154066470 0x7f1154068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:02.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.856+0000 7f1170ff9640 1 -- 172.21.15.133:0/1596959120 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f116c11f5f0 con 0x7f11740c5670 2023-12-19T19:02:02.861 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.856+0000 7f1172ffd640 1 --2- 172.21.15.133:0/1596959120 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1154066470 0x7f1154068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:02.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.856+0000 7f1172ffd640 1 --2- 172.21.15.133:0/1596959120 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1154066470 0x7f1154068930 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1164007a70 tx=0x7f1164008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:02.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:02.860+0000 7f1170ff9640 1 -- 172.21.15.133:0/1596959120 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f116c0ec7b0 con 0x7f11740c5670 2023-12-19T19:02:03.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.064+0000 7f11798fe640 1 -- 172.21.15.133:0/1596959120 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7f11741433f0 con 0x7f11740c5670 2023-12-19T19:02:03.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.064+0000 7f1170ff9640 1 -- 172.21.15.133:0/1596959120 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v21) v1 ==== 85+0+226 (secure 0 0 0) 0x7f116c0efdd0 con 0x7f11740c5670 2023-12-19T19:02:03.069 INFO:teuthology.orchestra.run.smithi133.stdout:[client.testuser] 2023-12-19T19:02:03.069 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQCq6IFl/9LRKBAAEdLXh9kRtwlqUFg0RuJGEw== 2023-12-19T19:02:03.069 INFO:teuthology.orchestra.run.smithi133.stdout: caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" 2023-12-19T19:02:03.070 INFO:teuthology.orchestra.run.smithi133.stdout: caps mon = "allow r" 2023-12-19T19:02:03.070 INFO:teuthology.orchestra.run.smithi133.stdout: caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-19T19:02:03.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.064+0000 7f11798fe640 1 -- 172.21.15.133:0/1596959120 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1154066470 msgr2=0x7f1154068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:03.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.064+0000 7f11798fe640 1 --2- 172.21.15.133:0/1596959120 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1154066470 0x7f1154068930 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1164007a70 tx=0x7f1164008040 comp rx=0 tx=0).stop 2023-12-19T19:02:03.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.064+0000 7f11798fe640 1 -- 172.21.15.133:0/1596959120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11740c5670 msgr2=0x7f11741ecaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:03.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.064+0000 7f11798fe640 1 --2- 172.21.15.133:0/1596959120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11740c5670 0x7f11741ecaa0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f116c01b600 tx=0x7f116c01b790 comp rx=0 tx=0).stop 2023-12-19T19:02:03.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.064+0000 7f11798fe640 1 -- 172.21.15.133:0/1596959120 shutdown_connections 2023-12-19T19:02:03.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.064+0000 7f11798fe640 1 --2- 172.21.15.133:0/1596959120 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1154066470 0x7f1154068930 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.064+0000 7f11798fe640 1 --2- 172.21.15.133:0/1596959120 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11740c5670 0x7f11741ecaa0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.064+0000 7f11798fe640 1 --2- 172.21.15.133:0/1596959120 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f11740c42f0 0x7f11741429b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.064+0000 7f11798fe640 1 --2- 172.21.15.133:0/1596959120 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f117406c3f0 0x7f1174151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.064+0000 7f11798fe640 1 -- 172.21.15.133:0/1596959120 >> 172.21.15.133:0/1596959120 conn(0x7f11740a7910 msgr2=0x7f117406c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:03.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.064+0000 7f11798fe640 1 -- 172.21.15.133:0/1596959120 shutdown_connections 2023-12-19T19:02:03.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.064+0000 7f11798fe640 1 -- 172.21.15.133:0/1596959120 wait complete. 2023-12-19T19:02:03.090 INFO:tasks.cephfs.test_multifs_auth:keyring generated for testing is - [client.testuser] key = AQCq6IFl/9LRKBAAEdLXh9kRtwlqUFg0RuJGEw== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-19T19:02:03.090 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2023-12-19T19:02:03.099 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.aqPwYKgnQd 2023-12-19T19:02:03.100 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T19:02:03.100 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/tmp/tmp.aqPwYKgnQd 2023-12-19T19:02:03.151 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T19:02:03.151 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:02:03.203 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T19:02:03.203 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:02:03.255 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:02:03.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.428+0000 7fa4a3632640 1 Processor -- start 2023-12-19T19:02:03.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.428+0000 7fa4a3632640 1 -- start start 2023-12-19T19:02:03.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa4a3632640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa49c0725c0 0x7fa49c1516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:03.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa4a3632640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa49c0c2760 con 0x7fa49c072090 2023-12-19T19:02:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa4a3632640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa49c0a5750 con 0x7fa49c0a5370 2023-12-19T19:02:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa4a3632640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa49c0c3070 con 0x7fa49c0725c0 2023-12-19T19:02:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa4a0bcd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa49c072090 0x7fa49c150fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58054/0 (socket says 172.21.15.133:58054) 2023-12-19T19:02:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa4a0bcd640 1 -- 172.21.15.133:0/3248769371 learned_addr learned my addr 172.21.15.133:0/3248769371 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa493fff640 1 -- 172.21.15.133:0/3248769371 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 547565146 0 0) 0x7fa49c0c2760 con 0x7fa49c072090 2023-12-19T19:02:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa493fff640 1 -- 172.21.15.133:0/3248769371 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa488003530 con 0x7fa49c072090 2023-12-19T19:02:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa4a1bcf640 1 --2- 172.21.15.133:0/3248769371 >> v2:172.21.15.138:3300/0 conn(0x7fa49c0725c0 0x7fa49c1516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa493fff640 1 -- 172.21.15.133:0/3248769371 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1111174310 0 0) 0x7fa488003530 con 0x7fa49c072090 2023-12-19T19:02:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa493fff640 1 -- 172.21.15.133:0/3248769371 >> v2:172.21.15.138:3300/0 conn(0x7fa49c0725c0 msgr2=0x7fa49c1516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa493fff640 1 --2- 172.21.15.133:0/3248769371 >> v2:172.21.15.138:3300/0 conn(0x7fa49c0725c0 0x7fa49c1516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa493fff640 1 -- 172.21.15.133:0/3248769371 >> v1:172.21.15.138:6789/0 conn(0x7fa49c0a5370 legacy=0x7fa49c0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa493fff640 1 -- 172.21.15.133:0/3248769371 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49c0aad20 con 0x7fa49c072090 2023-12-19T19:02:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa493fff640 1 -- 172.21.15.133:0/3248769371 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7fa48c001680 con 0x7fa49c072090 2023-12-19T19:02:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa493fff640 1 -- 172.21.15.133:0/3248769371 >> v1:172.21.15.133:6789/0 conn(0x7fa49c072090 legacy=0x7fa49c150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:03.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa493fff640 1 --2- 172.21.15.133:0/3248769371 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4880039d0 0x7fa488003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa493fff640 1 --2- 172.21.15.133:0/3248769371 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4880047d0 0x7fa488004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa493fff640 1 --2- 172.21.15.133:0/3248769371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa488005390 0x7fa48800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa493fff640 1 -- 172.21.15.133:0/3248769371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c0c3070 con 0x7fa488005390 2023-12-19T19:02:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa493fff640 1 -- 172.21.15.133:0/3248769371 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48800c270 con 0x7fa4880039d0 2023-12-19T19:02:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa493fff640 1 -- 172.21.15.133:0/3248769371 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48800e640 con 0x7fa4880047d0 2023-12-19T19:02:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa4a1bcf640 1 --2- 172.21.15.133:0/3248769371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa488005390 0x7fa48800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa4a13ce640 1 --2- 172.21.15.133:0/3248769371 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4880039d0 0x7fa488003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa4a0bcd640 1 --2- 172.21.15.133:0/3248769371 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4880047d0 0x7fa488004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa4a1bcf640 1 -- 172.21.15.133:0/3248769371 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4880047d0 msgr2=0x7fa488004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa4a1bcf640 1 --2- 172.21.15.133:0/3248769371 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4880047d0 0x7fa488004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa4a1bcf640 1 -- 172.21.15.133:0/3248769371 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4880039d0 msgr2=0x7fa488003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa4a1bcf640 1 --2- 172.21.15.133:0/3248769371 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa4880039d0 0x7fa488003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa4a1bcf640 1 -- 172.21.15.133:0/3248769371 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa488003530 con 0x7fa488005390 2023-12-19T19:02:03.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.432+0000 7fa4a0bcd640 1 --2- 172.21.15.133:0/3248769371 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa4880047d0 0x7fa488004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.436+0000 7fa4a1bcf640 1 -- 172.21.15.133:0/3248769371 reap_dead start 2023-12-19T19:02:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.436+0000 7fa4a1bcf640 1 --2- 172.21.15.133:0/3248769371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa488005390 0x7fa48800b990 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fa4940072d0 tx=0x7fa49401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1acc6029544965a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.436+0000 7fa493fff640 1 -- 172.21.15.133:0/3248769371 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49400a2d0 con 0x7fa488005390 2023-12-19T19:02:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.436+0000 7fa493fff640 1 -- 172.21.15.133:0/3248769371 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4940039a0 con 0x7fa488005390 2023-12-19T19:02:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.436+0000 7fa493fff640 1 -- 172.21.15.133:0/3248769371 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa494003d50 con 0x7fa488005390 2023-12-19T19:02:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.436+0000 7fa4a3632640 1 -- 172.21.15.133:0/3248769371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa488005390 msgr2=0x7fa48800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.436+0000 7fa4a3632640 1 --2- 172.21.15.133:0/3248769371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa488005390 0x7fa48800b990 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fa4940072d0 tx=0x7fa49401cd60 comp rx=0 tx=0).stop 2023-12-19T19:02:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.436+0000 7fa4a3632640 1 -- 172.21.15.133:0/3248769371 shutdown_connections 2023-12-19T19:02:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.436+0000 7fa4a3632640 1 --2- 172.21.15.133:0/3248769371 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa488005390 0x7fa48800b990 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.436+0000 7fa4a3632640 1 -- 172.21.15.133:0/3248769371 >> 172.21.15.133:0/3248769371 conn(0x7fa49c06a5b0 msgr2=0x7fa49c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:03.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.436+0000 7fa4a3632640 1 -- 172.21.15.133:0/3248769371 shutdown_connections 2023-12-19T19:02:03.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.436+0000 7fa4a3632640 1 -- 172.21.15.133:0/3248769371 wait complete. 2023-12-19T19:02:03.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.436+0000 7fa4a3632640 1 Processor -- start 2023-12-19T19:02:03.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.436+0000 7fa4a3632640 1 -- start start 2023-12-19T19:02:03.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.440+0000 7fa4a3632640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa488005390 0x7fa49c06fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:03.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.440+0000 7fa4a3632640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa49c147670 0x7fa49c147af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:03.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.440+0000 7fa4a3632640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa49c144a20 0x7fa49c144ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:03.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.440+0000 7fa4a3632640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c1e9990 con 0x7fa49c144a20 2023-12-19T19:02:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.440+0000 7fa4a3632640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c152020 con 0x7fa488005390 2023-12-19T19:02:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.440+0000 7fa4a3632640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c152300 con 0x7fa49c147670 2023-12-19T19:02:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.440+0000 7fa4a1bcf640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa49c144a20 0x7fa49c144ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.440+0000 7fa4a1bcf640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa49c144a20 0x7fa49c144ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35036/0 (socket says 172.21.15.133:35036) 2023-12-19T19:02:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.440+0000 7fa4a1bcf640 1 -- 172.21.15.133:0/1246264743 learned_addr learned my addr 172.21.15.133:0/1246264743 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.440+0000 7fa4a0bcd640 1 --2- 172.21.15.133:0/1246264743 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa49c147670 0x7fa49c147af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.440+0000 7fa4a13ce640 1 --2- 172.21.15.133:0/1246264743 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa488005390 0x7fa49c06fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.440+0000 7fa4a1bcf640 1 -- 172.21.15.133:0/1246264743 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa49c147670 msgr2=0x7fa49c147af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.440+0000 7fa4a1bcf640 1 --2- 172.21.15.133:0/1246264743 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa49c147670 0x7fa49c147af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.440+0000 7fa4a1bcf640 1 -- 172.21.15.133:0/1246264743 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa488005390 msgr2=0x7fa49c06fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.440+0000 7fa4a1bcf640 1 --2- 172.21.15.133:0/1246264743 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa488005390 0x7fa49c06fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.440+0000 7fa4a1bcf640 1 -- 172.21.15.133:0/1246264743 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49c153ce0 con 0x7fa49c144a20 2023-12-19T19:02:03.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.440+0000 7fa4a1bcf640 1 --2- 172.21.15.133:0/1246264743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa49c144a20 0x7fa49c144ed0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fa49401cb90 tx=0x7fa488005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:03.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.440+0000 7fa491ffb640 1 -- 172.21.15.133:0/1246264743 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4940b6070 con 0x7fa49c144a20 2023-12-19T19:02:03.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.440+0000 7fa491ffb640 1 -- 172.21.15.133:0/1246264743 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa494003d10 con 0x7fa49c144a20 2023-12-19T19:02:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.440+0000 7fa491ffb640 1 -- 172.21.15.133:0/1246264743 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4940a5b00 con 0x7fa49c144a20 2023-12-19T19:02:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.440+0000 7fa4a3632640 1 -- 172.21.15.133:0/1246264743 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa49c1525e0 con 0x7fa49c144a20 2023-12-19T19:02:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.440+0000 7fa4a3632640 1 -- 172.21.15.133:0/1246264743 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa49c1474b0 con 0x7fa49c144a20 2023-12-19T19:02:03.447 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.440+0000 7fa4a3632640 1 -- 172.21.15.133:0/1246264743 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa49c068400 con 0x7fa49c144a20 2023-12-19T19:02:03.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.444+0000 7fa491ffb640 1 -- 172.21.15.133:0/1246264743 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa4940a5c60 con 0x7fa49c144a20 2023-12-19T19:02:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.444+0000 7fa491ffb640 1 --2- 172.21.15.133:0/1246264743 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa4800664a0 0x7fa480068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.444+0000 7fa491ffb640 1 -- 172.21.15.133:0/1246264743 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa49411d870 con 0x7fa49c144a20 2023-12-19T19:02:03.449 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.444+0000 7fa4a13ce640 1 --2- 172.21.15.133:0/1246264743 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa4800664a0 0x7fa480068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:03.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.444+0000 7fa4a13ce640 1 --2- 172.21.15.133:0/1246264743 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa4800664a0 0x7fa480068960 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa49c06e190 tx=0x7fa498009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:03.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.448+0000 7fa491ffb640 1 -- 172.21.15.133:0/1246264743 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa4940ea980 con 0x7fa49c144a20 2023-12-19T19:02:03.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.600+0000 7fa4a3632640 1 -- 172.21.15.133:0/1246264743 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa49c0c6780 con 0x7fa49c144a20 2023-12-19T19:02:03.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.600+0000 7fa491ffb640 1 -- 172.21.15.133:0/1246264743 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+20250 (secure 0 0 0) 0x7fa4940edfa0 con 0x7fa49c144a20 2023-12-19T19:02:03.605 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:03.605 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":73,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:01:54.705538+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:01:33.082188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T19:01:34.349092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:01:50.875086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:01:52.061232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:02:03.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.600+0000 7fa4a3632640 1 -- 172.21.15.133:0/1246264743 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa4800664a0 msgr2=0x7fa480068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:03.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.600+0000 7fa4a3632640 1 --2- 172.21.15.133:0/1246264743 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa4800664a0 0x7fa480068960 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fa49c06e190 tx=0x7fa498009040 comp rx=0 tx=0).stop 2023-12-19T19:02:03.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.600+0000 7fa4a3632640 1 -- 172.21.15.133:0/1246264743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa49c144a20 msgr2=0x7fa49c144ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:03.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.600+0000 7fa4a3632640 1 --2- 172.21.15.133:0/1246264743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa49c144a20 0x7fa49c144ed0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fa49401cb90 tx=0x7fa488005800 comp rx=0 tx=0).stop 2023-12-19T19:02:03.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.604+0000 7fa4a3632640 1 -- 172.21.15.133:0/1246264743 shutdown_connections 2023-12-19T19:02:03.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.604+0000 7fa4a3632640 1 --2- 172.21.15.133:0/1246264743 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa4800664a0 0x7fa480068960 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.604+0000 7fa4a3632640 1 --2- 172.21.15.133:0/1246264743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa49c144a20 0x7fa49c144ed0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.604+0000 7fa4a3632640 1 --2- 172.21.15.133:0/1246264743 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa49c147670 0x7fa49c147af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.604+0000 7fa4a3632640 1 --2- 172.21.15.133:0/1246264743 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa488005390 0x7fa49c06fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.604+0000 7fa4a3632640 1 -- 172.21.15.133:0/1246264743 >> 172.21.15.133:0/1246264743 conn(0x7fa49c06a5b0 msgr2=0x7fa49c0c4840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:03.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.604+0000 7fa4a3632640 1 -- 172.21.15.133:0/1246264743 shutdown_connections 2023-12-19T19:02:03.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.604+0000 7fa4a3632640 1 -- 172.21.15.133:0/1246264743 wait complete. 2023-12-19T19:02:03.626 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T19:01:33.082188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T19:01:34.349092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-19T19:01:50.875086+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-19T19:01:52.061232+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T19:02:03.627 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T19:02:03.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779fc6b640 1 Processor -- start 2023-12-19T19:02:03.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779fc6b640 1 -- start start 2023-12-19T19:02:03.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779fc6b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f77980c60a0 0x7f7798156900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:03.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779fc6b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77980c3bd0 con 0x7f77980a5240 2023-12-19T19:02:03.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779fc6b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77980bf1e0 con 0x7f77980c5c60 2023-12-19T19:02:03.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779fc6b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77980c64f0 con 0x7f77980c60a0 2023-12-19T19:02:03.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779da07640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f77980a5240 0x7f77980bfc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:58068/0 (socket says 172.21.15.133:58068) 2023-12-19T19:02:03.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779da07640 1 -- 172.21.15.133:0/2761662087 learned_addr learned my addr 172.21.15.133:0/2761662087 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:03.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779e208640 1 --2- 172.21.15.133:0/2761662087 >> v2:172.21.15.138:3300/0 conn(0x7f77980c60a0 0x7f7798156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:03.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779ca05640 1 -- 172.21.15.133:0/2761662087 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979688139 0 0) 0x7f77980c3bd0 con 0x7f77980a5240 2023-12-19T19:02:03.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779ca05640 1 -- 172.21.15.133:0/2761662087 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7784003530 con 0x7f77980a5240 2023-12-19T19:02:03.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779ca05640 1 -- 172.21.15.133:0/2761662087 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4132979009 0 0) 0x7f77980bf1e0 con 0x7f77980c5c60 2023-12-19T19:02:03.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779ca05640 1 -- 172.21.15.133:0/2761662087 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77980c3bd0 con 0x7f77980c5c60 2023-12-19T19:02:03.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779ca05640 1 -- 172.21.15.133:0/2761662087 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4167816341 0 0) 0x7f7784003530 con 0x7f77980a5240 2023-12-19T19:02:03.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779ca05640 1 -- 172.21.15.133:0/2761662087 >> v2:172.21.15.138:3300/0 conn(0x7f77980c60a0 msgr2=0x7f7798156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:03.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779ca05640 1 --2- 172.21.15.133:0/2761662087 >> v2:172.21.15.138:3300/0 conn(0x7f77980c60a0 0x7f7798156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779ca05640 1 -- 172.21.15.133:0/2761662087 >> v1:172.21.15.138:6789/0 conn(0x7f77980c5c60 legacy=0x7f77981561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:03.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779ca05640 1 -- 172.21.15.133:0/2761662087 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77980c3e20 con 0x7f77980a5240 2023-12-19T19:02:03.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779ca05640 1 -- 172.21.15.133:0/2761662087 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f7794001680 con 0x7f77980a5240 2023-12-19T19:02:03.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779ca05640 1 -- 172.21.15.133:0/2761662087 >> v1:172.21.15.133:6789/0 conn(0x7f77980a5240 legacy=0x7f77980bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:03.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779ca05640 1 --2- 172.21.15.133:0/2761662087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7784003b10 0x7f7784003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:03.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779ca05640 1 --2- 172.21.15.133:0/2761662087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77840047d0 0x7f7784004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:03.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779ca05640 1 --2- 172.21.15.133:0/2761662087 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7784005190 0x7f778400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:03.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779ca05640 1 -- 172.21.15.133:0/2761662087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77980c64f0 con 0x7f7784003b10 2023-12-19T19:02:03.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779ca05640 1 -- 172.21.15.133:0/2761662087 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778400c0c0 con 0x7f77840047d0 2023-12-19T19:02:03.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779ca05640 1 -- 172.21.15.133:0/2761662087 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778400c280 con 0x7f7784005190 2023-12-19T19:02:03.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779da07640 1 --2- 172.21.15.133:0/2761662087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7784003b10 0x7f7784003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:03.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779d206640 1 --2- 172.21.15.133:0/2761662087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77840047d0 0x7f7784004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:03.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779e208640 1 --2- 172.21.15.133:0/2761662087 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7784005190 0x7f778400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:03.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779da07640 1 -- 172.21.15.133:0/2761662087 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7784005190 msgr2=0x7f778400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:03.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779da07640 1 --2- 172.21.15.133:0/2761662087 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7784005190 0x7f778400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779da07640 1 -- 172.21.15.133:0/2761662087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77840047d0 msgr2=0x7f7784004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:03.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779da07640 1 --2- 172.21.15.133:0/2761662087 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f77840047d0 0x7f7784004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779da07640 1 -- 172.21.15.133:0/2761662087 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7784003530 con 0x7f7784003b10 2023-12-19T19:02:03.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.764+0000 7f779e208640 1 -- 172.21.15.133:0/2761662087 reap_dead start 2023-12-19T19:02:03.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.768+0000 7f779da07640 1 --2- 172.21.15.133:0/2761662087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7784003b10 0x7f7784003f10 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f779400c160 tx=0x7f779401cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e28a101a2230194 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:03.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.768+0000 7f779ca05640 1 -- 172.21.15.133:0/2761662087 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77940058e0 con 0x7f7784003b10 2023-12-19T19:02:03.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.768+0000 7f779ca05640 1 -- 172.21.15.133:0/2761662087 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7794005a40 con 0x7f7784003b10 2023-12-19T19:02:03.774 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.768+0000 7f779ca05640 1 -- 172.21.15.133:0/2761662087 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7794005df0 con 0x7f7784003b10 2023-12-19T19:02:03.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.768+0000 7f779fc6b640 1 -- 172.21.15.133:0/2761662087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7784003b10 msgr2=0x7f7784003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:03.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.768+0000 7f779fc6b640 1 --2- 172.21.15.133:0/2761662087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7784003b10 0x7f7784003f10 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f779400c160 tx=0x7f779401cb90 comp rx=0 tx=0).stop 2023-12-19T19:02:03.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.768+0000 7f779fc6b640 1 -- 172.21.15.133:0/2761662087 shutdown_connections 2023-12-19T19:02:03.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.768+0000 7f779fc6b640 1 --2- 172.21.15.133:0/2761662087 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7784003b10 0x7f7784003f10 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.768+0000 7f779fc6b640 1 -- 172.21.15.133:0/2761662087 >> 172.21.15.133:0/2761662087 conn(0x7f779806a5b0 msgr2=0x7f779806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:03.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.768+0000 7f779fc6b640 1 -- 172.21.15.133:0/2761662087 shutdown_connections 2023-12-19T19:02:03.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.768+0000 7f779fc6b640 1 -- 172.21.15.133:0/2761662087 wait complete. 2023-12-19T19:02:03.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f779fc6b640 1 Processor -- start 2023-12-19T19:02:03.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f779fc6b640 1 -- start start 2023-12-19T19:02:03.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f779fc6b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7784003b10 0x7f77980c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:03.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f779fc6b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7798099a70 0x7f77980c3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:03.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f779fc6b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7798150e30 0x7f77981512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:03.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f779fc6b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77980c0db0 con 0x7f7784003b10 2023-12-19T19:02:03.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f779fc6b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77980c1090 con 0x7f7798150e30 2023-12-19T19:02:03.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f779fc6b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77980c2810 con 0x7f7798099a70 2023-12-19T19:02:03.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f779da07640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7784003b10 0x7f77980c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:03.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f779da07640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7784003b10 0x7f77980c2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35052/0 (socket says 172.21.15.133:35052) 2023-12-19T19:02:03.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f779da07640 1 -- 172.21.15.133:0/3237999372 learned_addr learned my addr 172.21.15.133:0/3237999372 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:03.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f779e208640 1 --2- 172.21.15.133:0/3237999372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7798150e30 0x7f77981512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:03.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f779d206640 1 --2- 172.21.15.133:0/3237999372 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7798099a70 0x7f77980c3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:03.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f779da07640 1 -- 172.21.15.133:0/3237999372 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7798099a70 msgr2=0x7f77980c3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:03.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f779da07640 1 --2- 172.21.15.133:0/3237999372 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7798099a70 0x7f77980c3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.779 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f779da07640 1 -- 172.21.15.133:0/3237999372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7798150e30 msgr2=0x7f77981512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:03.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f779da07640 1 --2- 172.21.15.133:0/3237999372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7798150e30 0x7f77981512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f779da07640 1 -- 172.21.15.133:0/3237999372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7798071fb0 con 0x7f7784003b10 2023-12-19T19:02:03.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f779da07640 1 --2- 172.21.15.133:0/3237999372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7784003b10 0x7f77980c2d30 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f77940ab040 tx=0x7f7784005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:03.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f778e7fc640 1 -- 172.21.15.133:0/3237999372 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7794005db0 con 0x7f7784003b10 2023-12-19T19:02:03.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f778e7fc640 1 -- 172.21.15.133:0/3237999372 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77940a5870 con 0x7f7784003b10 2023-12-19T19:02:03.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f779fc6b640 1 -- 172.21.15.133:0/3237999372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77980c1370 con 0x7f7784003b10 2023-12-19T19:02:03.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f778e7fc640 1 -- 172.21.15.133:0/3237999372 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77940a5c00 con 0x7f7784003b10 2023-12-19T19:02:03.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.772+0000 7f779fc6b640 1 -- 172.21.15.133:0/3237999372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77980700a0 con 0x7f7784003b10 2023-12-19T19:02:03.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.776+0000 7f779fc6b640 1 -- 172.21.15.133:0/3237999372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77980c29d0 con 0x7f7784003b10 2023-12-19T19:02:03.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.776+0000 7f778e7fc640 1 -- 172.21.15.133:0/3237999372 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f77940047f0 con 0x7f7784003b10 2023-12-19T19:02:03.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.776+0000 7f778e7fc640 1 --2- 172.21.15.133:0/3237999372 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f777c0664a0 0x7f777c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:03.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.776+0000 7f778e7fc640 1 -- 172.21.15.133:0/3237999372 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f779411d4d0 con 0x7f7784003b10 2023-12-19T19:02:03.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.776+0000 7f779d206640 1 --2- 172.21.15.133:0/3237999372 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f777c0664a0 0x7f777c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:03.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.776+0000 7f779d206640 1 --2- 172.21.15.133:0/3237999372 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f777c0664a0 0x7f777c068960 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f77981eac30 tx=0x7f7788009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:03.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.780+0000 7f778e7fc640 1 -- 172.21.15.133:0/3237999372 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f77940ea690 con 0x7f7784003b10 2023-12-19T19:02:03.936 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.932+0000 7f779fc6b640 1 -- 172.21.15.133:0/3237999372 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7798070290 con 0x7f7784003b10 2023-12-19T19:02:03.937 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.932+0000 7f778e7fc640 1 -- 172.21.15.133:0/3237999372 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) v1 ==== 93+0+10 (secure 0 0 0) 0x7f77940edcb0 con 0x7f7784003b10 2023-12-19T19:02:03.937 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T19:02:03.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.932+0000 7f779fc6b640 1 -- 172.21.15.133:0/3237999372 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f777c0664a0 msgr2=0x7f777c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:03.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.932+0000 7f779fc6b640 1 --2- 172.21.15.133:0/3237999372 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f777c0664a0 0x7f777c068960 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f77981eac30 tx=0x7f7788009040 comp rx=0 tx=0).stop 2023-12-19T19:02:03.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.932+0000 7f779fc6b640 1 -- 172.21.15.133:0/3237999372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7784003b10 msgr2=0x7f77980c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:03.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.932+0000 7f779fc6b640 1 --2- 172.21.15.133:0/3237999372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7784003b10 0x7f77980c2d30 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f77940ab040 tx=0x7f7784005800 comp rx=0 tx=0).stop 2023-12-19T19:02:03.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.932+0000 7f779fc6b640 1 -- 172.21.15.133:0/3237999372 shutdown_connections 2023-12-19T19:02:03.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.932+0000 7f779fc6b640 1 --2- 172.21.15.133:0/3237999372 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f777c0664a0 0x7f777c068960 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.932+0000 7f779fc6b640 1 --2- 172.21.15.133:0/3237999372 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7798150e30 0x7f77981512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.932+0000 7f779fc6b640 1 --2- 172.21.15.133:0/3237999372 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7798099a70 0x7f77980c3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.932+0000 7f779fc6b640 1 --2- 172.21.15.133:0/3237999372 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7784003b10 0x7f77980c2d30 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:03.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.932+0000 7f779fc6b640 1 -- 172.21.15.133:0/3237999372 >> 172.21.15.133:0/3237999372 conn(0x7f779806a5b0 msgr2=0x7f7798157090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:03.939 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.932+0000 7f779fc6b640 1 -- 172.21.15.133:0/3237999372 shutdown_connections 2023-12-19T19:02:03.940 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:03.932+0000 7f779fc6b640 1 -- 172.21.15.133:0/3237999372 wait complete. 2023-12-19T19:02:03.958 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T19:02:04.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.096+0000 7fad64c32640 1 Processor -- start 2023-12-19T19:02:04.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.096+0000 7fad64c32640 1 -- start start 2023-12-19T19:02:04.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.096+0000 7fad64c32640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad600c63c0 0x7fad600c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.096+0000 7fad64c32640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fad600c4100 0x7fad600c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.096+0000 7fad64c32640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad600c31c0 con 0x7fad600c29e0 2023-12-19T19:02:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.096+0000 7fad64c32640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad600c34a0 con 0x7fad600c4100 2023-12-19T19:02:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.096+0000 7fad64c32640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad600c1030 con 0x7fad600c63c0 2023-12-19T19:02:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.096+0000 7fad5dd9b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fad600c4100 0x7fad600c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.096+0000 7fad5dd9b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fad600c4100 0x7fad600c24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35064/0 (socket says 172.21.15.133:35064) 2023-12-19T19:02:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.096+0000 7fad5dd9b640 1 -- 172.21.15.133:0/1532632283 learned_addr learned my addr 172.21.15.133:0/1532632283 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.096+0000 7fad5e59c640 1 --2- 172.21.15.133:0/1532632283 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad600c63c0 0x7fad600c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.096+0000 7fad5dd9b640 1 -- 172.21.15.133:0/1532632283 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad600c63c0 msgr2=0x7fad600c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.096+0000 7fad5dd9b640 1 --2- 172.21.15.133:0/1532632283 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad600c63c0 0x7fad600c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.096+0000 7fad5dd9b640 1 -- 172.21.15.133:0/1532632283 >> v1:172.21.15.138:6789/0 conn(0x7fad600c29e0 legacy=0x7fad600a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:04.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.096+0000 7fad5dd9b640 1 -- 172.21.15.133:0/1532632283 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad600c1310 con 0x7fad600c4100 2023-12-19T19:02:04.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.100+0000 7fad5dd9b640 1 --2- 172.21.15.133:0/1532632283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad600c4100 0x7fad600c24a0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fad5400bb10 tx=0x7fad5401eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c62cbf8a32aaa8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:04.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.100+0000 7fad5d59a640 1 -- 172.21.15.133:0/1532632283 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad540a7ab0 con 0x7fad600c4100 2023-12-19T19:02:04.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.100+0000 7fad5d59a640 1 -- 172.21.15.133:0/1532632283 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad540a7c10 con 0x7fad600c4100 2023-12-19T19:02:04.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.100+0000 7fad5d59a640 1 -- 172.21.15.133:0/1532632283 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad540af440 con 0x7fad600c4100 2023-12-19T19:02:04.105 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.100+0000 7fad64c32640 1 -- 172.21.15.133:0/1532632283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad600c4100 msgr2=0x7fad600c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:04.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.100+0000 7fad64c32640 1 --2- 172.21.15.133:0/1532632283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad600c4100 0x7fad600c24a0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fad5400bb10 tx=0x7fad5401eac0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.100+0000 7fad64c32640 1 -- 172.21.15.133:0/1532632283 shutdown_connections 2023-12-19T19:02:04.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.100+0000 7fad64c32640 1 --2- 172.21.15.133:0/1532632283 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad600c4100 0x7fad600c24a0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.100+0000 7fad64c32640 1 --2- 172.21.15.133:0/1532632283 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad600c63c0 0x7fad600c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.100+0000 7fad64c32640 1 -- 172.21.15.133:0/1532632283 >> 172.21.15.133:0/1532632283 conn(0x7fad6006a5b0 msgr2=0x7fad6006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:04.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.100+0000 7fad64c32640 1 -- 172.21.15.133:0/1532632283 shutdown_connections 2023-12-19T19:02:04.106 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.100+0000 7fad64c32640 1 -- 172.21.15.133:0/1532632283 wait complete. 2023-12-19T19:02:04.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad64c32640 1 Processor -- start 2023-12-19T19:02:04.107 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad64c32640 1 -- start start 2023-12-19T19:02:04.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad64c32640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad600c29e0 0x7fad601543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:04.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad64c32640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad600c4100 0x7fad601e8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad64c32640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad600c63c0 0x7fad601e92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad64c32640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad601ecf60 con 0x7fad600c29e0 2023-12-19T19:02:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad64c32640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad601524d0 con 0x7fad600c4100 2023-12-19T19:02:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad64c32640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad601ec350 con 0x7fad600c63c0 2023-12-19T19:02:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad5e59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad600c29e0 0x7fad601543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad5e59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad600c29e0 0x7fad601543e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:35076/0 (socket says 172.21.15.133:35076) 2023-12-19T19:02:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad5e59c640 1 -- 172.21.15.133:0/3409582964 learned_addr learned my addr 172.21.15.133:0/3409582964 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad5dd9b640 1 --2- 172.21.15.133:0/3409582964 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad600c4100 0x7fad601e8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad5ed9d640 1 --2- 172.21.15.133:0/3409582964 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad600c63c0 0x7fad601e92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad5e59c640 1 -- 172.21.15.133:0/3409582964 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad600c63c0 msgr2=0x7fad601e92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad5e59c640 1 --2- 172.21.15.133:0/3409582964 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad600c63c0 0x7fad601e92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad5e59c640 1 -- 172.21.15.133:0/3409582964 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad600c4100 msgr2=0x7fad601e8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad5e59c640 1 --2- 172.21.15.133:0/3409582964 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad600c4100 0x7fad601e8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad5e59c640 1 -- 172.21.15.133:0/3409582964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5400b770 con 0x7fad600c29e0 2023-12-19T19:02:04.110 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad5dd9b640 1 --2- 172.21.15.133:0/3409582964 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad600c4100 0x7fad601e8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad5e59c640 1 --2- 172.21.15.133:0/3409582964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad600c29e0 0x7fad601543e0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fad5000d5f0 tx=0x7fad5000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad4effd640 1 -- 172.21.15.133:0/3409582964 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad500125f0 con 0x7fad600c29e0 2023-12-19T19:02:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad4effd640 1 -- 172.21.15.133:0/3409582964 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad50012750 con 0x7fad600c29e0 2023-12-19T19:02:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad4effd640 1 -- 172.21.15.133:0/3409582964 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad50012ae0 con 0x7fad600c29e0 2023-12-19T19:02:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad64c32640 1 -- 172.21.15.133:0/3409582964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad601ec630 con 0x7fad600c29e0 2023-12-19T19:02:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad64c32640 1 -- 172.21.15.133:0/3409582964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad601ecbf0 con 0x7fad600c29e0 2023-12-19T19:02:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.104+0000 7fad64c32640 1 -- 172.21.15.133:0/3409582964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad60068400 con 0x7fad600c29e0 2023-12-19T19:02:04.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.108+0000 7fad4effd640 1 -- 172.21.15.133:0/3409582964 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fad50012c40 con 0x7fad600c29e0 2023-12-19T19:02:04.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.108+0000 7fad4effd640 1 --2- 172.21.15.133:0/3409582964 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fad40066470 0x7fad40068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:04.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.108+0000 7fad4effd640 1 -- 172.21.15.133:0/3409582964 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fad500846e0 con 0x7fad600c29e0 2023-12-19T19:02:04.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.108+0000 7fad5dd9b640 1 --2- 172.21.15.133:0/3409582964 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fad40066470 0x7fad40068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:04.113 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.108+0000 7fad5dd9b640 1 --2- 172.21.15.133:0/3409582964 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fad40066470 0x7fad40068930 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fad540b1000 tx=0x7fad540a9070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:04.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.112+0000 7fad4effd640 1 -- 172.21.15.133:0/3409582964 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fad50051800 con 0x7fad600c29e0 2023-12-19T19:02:04.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.260+0000 7fad64c32640 1 -- 172.21.15.133:0/3409582964 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fad60066720 con 0x7fad600c29e0 2023-12-19T19:02:04.264 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.260+0000 7fad4effd640 1 -- 172.21.15.133:0/3409582964 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) v1 ==== 104+0+11 (secure 0 0 0) 0x7fad50054e20 con 0x7fad600c29e0 2023-12-19T19:02:04.264 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:02:04.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.260+0000 7fad64c32640 1 -- 172.21.15.133:0/3409582964 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fad40066470 msgr2=0x7fad40068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:04.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.260+0000 7fad64c32640 1 --2- 172.21.15.133:0/3409582964 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fad40066470 0x7fad40068930 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fad540b1000 tx=0x7fad540a9070 comp rx=0 tx=0).stop 2023-12-19T19:02:04.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.260+0000 7fad64c32640 1 -- 172.21.15.133:0/3409582964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad600c29e0 msgr2=0x7fad601543e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:04.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.260+0000 7fad64c32640 1 --2- 172.21.15.133:0/3409582964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad600c29e0 0x7fad601543e0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fad5000d5f0 tx=0x7fad5000dab0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.260+0000 7fad64c32640 1 -- 172.21.15.133:0/3409582964 shutdown_connections 2023-12-19T19:02:04.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.260+0000 7fad64c32640 1 --2- 172.21.15.133:0/3409582964 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fad40066470 0x7fad40068930 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.260+0000 7fad64c32640 1 --2- 172.21.15.133:0/3409582964 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fad600c63c0 0x7fad601e92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.260+0000 7fad64c32640 1 --2- 172.21.15.133:0/3409582964 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fad600c4100 0x7fad601e8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.260+0000 7fad64c32640 1 --2- 172.21.15.133:0/3409582964 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fad600c29e0 0x7fad601543e0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.260+0000 7fad64c32640 1 -- 172.21.15.133:0/3409582964 >> 172.21.15.133:0/3409582964 conn(0x7fad6006a5b0 msgr2=0x7fad601528c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:04.266 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.260+0000 7fad64c32640 1 -- 172.21.15.133:0/3409582964 shutdown_connections 2023-12-19T19:02:04.267 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.260+0000 7fad64c32640 1 -- 172.21.15.133:0/3409582964 wait complete. 2023-12-19T19:02:04.285 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T19:02:04.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.420+0000 7f99fc868640 1 Processor -- start 2023-12-19T19:02:04.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.420+0000 7f99fc868640 1 -- start start 2023-12-19T19:02:04.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.420+0000 7f99fc868640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f80c5640 0x7f99f80c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:04.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.420+0000 7f99fc868640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f99f80c60f0 0x7f99f8155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:04.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.420+0000 7f99fc868640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f80c2580 con 0x7f99f80c5260 2023-12-19T19:02:04.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.420+0000 7f99fc868640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f8153510 con 0x7f99f80c60f0 2023-12-19T19:02:04.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.420+0000 7f99fc868640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f80c17f0 con 0x7f99f80c5640 2023-12-19T19:02:04.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.424+0000 7f99f5d9b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f80c5640 0x7f99f80c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:04.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.424+0000 7f99f5d9b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f80c5640 0x7f99f80c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:48864/0 (socket says 172.21.15.133:48864) 2023-12-19T19:02:04.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.424+0000 7f99f5d9b640 1 -- 172.21.15.133:0/1762555765 learned_addr learned my addr 172.21.15.133:0/1762555765 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:04.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.424+0000 7f99f6d9d640 1 --2- 172.21.15.133:0/1762555765 >> v2:172.21.15.138:3300/0 conn(0x7f99f80c60f0 0x7f99f8155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:04.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.424+0000 7f99f5d9b640 1 -- 172.21.15.133:0/1762555765 >> v2:172.21.15.138:3300/0 conn(0x7f99f80c60f0 msgr2=0x7f99f8155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:04.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.424+0000 7f99f5d9b640 1 --2- 172.21.15.133:0/1762555765 >> v2:172.21.15.138:3300/0 conn(0x7f99f80c60f0 0x7f99f8155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.424+0000 7f99f5d9b640 1 -- 172.21.15.133:0/1762555765 >> v1:172.21.15.138:6789/0 conn(0x7f99f80c5260 legacy=0x7f99f806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:04.428 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.424+0000 7f99f5d9b640 1 -- 172.21.15.133:0/1762555765 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f80c1a00 con 0x7f99f80c5640 2023-12-19T19:02:04.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.424+0000 7f99f559a640 1 -- 172.21.15.133:0/1762555765 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700816286 0 0) 0x7f99f80c2580 con 0x7f99f80c5260 2023-12-19T19:02:04.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.428+0000 7f99f5d9b640 1 --2- 172.21.15.133:0/1762555765 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f80c5640 0x7f99f80c5bb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f99f80c1930 tx=0x7f99ec01c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a463db2f9e09600b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:04.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.428+0000 7f99f559a640 1 -- 172.21.15.133:0/1762555765 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec0ab600 con 0x7f99f80c5640 2023-12-19T19:02:04.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.428+0000 7f99f559a640 1 -- 172.21.15.133:0/1762555765 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ec0a7050 con 0x7f99f80c5640 2023-12-19T19:02:04.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.428+0000 7f99f559a640 1 -- 172.21.15.133:0/1762555765 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ec0ab980 con 0x7f99f80c5640 2023-12-19T19:02:04.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.428+0000 7f99fc868640 1 -- 172.21.15.133:0/1762555765 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f80c5640 msgr2=0x7f99f80c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:04.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.428+0000 7f99fc868640 1 --2- 172.21.15.133:0/1762555765 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f80c5640 0x7f99f80c5bb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f99f80c1930 tx=0x7f99ec01c460 comp rx=0 tx=0).stop 2023-12-19T19:02:04.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.428+0000 7f99fc868640 1 -- 172.21.15.133:0/1762555765 shutdown_connections 2023-12-19T19:02:04.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.428+0000 7f99fc868640 1 --2- 172.21.15.133:0/1762555765 >> v2:172.21.15.138:3300/0 conn(0x7f99f80c60f0 0x7f99f8155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.428+0000 7f99fc868640 1 --2- 172.21.15.133:0/1762555765 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f80c5640 0x7f99f80c5bb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.428+0000 7f99fc868640 1 -- 172.21.15.133:0/1762555765 >> 172.21.15.133:0/1762555765 conn(0x7f99f806a5b0 msgr2=0x7f99f806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:04.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.428+0000 7f99fc868640 1 -- 172.21.15.133:0/1762555765 shutdown_connections 2023-12-19T19:02:04.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.428+0000 7f99fc868640 1 -- 172.21.15.133:0/1762555765 wait complete. 2023-12-19T19:02:04.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.428+0000 7f99fc868640 1 Processor -- start 2023-12-19T19:02:04.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.428+0000 7f99fc868640 1 -- start start 2023-12-19T19:02:04.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.428+0000 7f99fc868640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f80c5260 0x7f99f8071af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:04.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.428+0000 7f99fc868640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99f80c5640 0x7f99f8156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:04.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.428+0000 7f99fc868640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f80c60f0 0x7f99f8154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:04.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.428+0000 7f99fc868640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f80a8b70 con 0x7f99f80c60f0 2023-12-19T19:02:04.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.428+0000 7f99fc868640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f8070eb0 con 0x7f99f80c5640 2023-12-19T19:02:04.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.428+0000 7f99fc868640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f80a8dc0 con 0x7f99f80c5260 2023-12-19T19:02:04.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.432+0000 7f99f6d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f80c60f0 0x7f99f8154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:04.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.432+0000 7f99f6d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f80c60f0 0x7f99f8154f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49596/0 (socket says 172.21.15.133:49596) 2023-12-19T19:02:04.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.432+0000 7f99f6d9d640 1 -- 172.21.15.133:0/808034040 learned_addr learned my addr 172.21.15.133:0/808034040 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:04.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.432+0000 7f99f5d9b640 1 --2- 172.21.15.133:0/808034040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99f80c5640 0x7f99f8156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:04.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.432+0000 7f99f659c640 1 --2- 172.21.15.133:0/808034040 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f80c5260 0x7f99f8071af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:04.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.432+0000 7f99f6d9d640 1 -- 172.21.15.133:0/808034040 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f80c5260 msgr2=0x7f99f8071af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:04.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.432+0000 7f99f6d9d640 1 --2- 172.21.15.133:0/808034040 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f80c5260 0x7f99f8071af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.432+0000 7f99f6d9d640 1 -- 172.21.15.133:0/808034040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99f80c5640 msgr2=0x7f99f8156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:04.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.432+0000 7f99f6d9d640 1 --2- 172.21.15.133:0/808034040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99f80c5640 0x7f99f8156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.432+0000 7f99f6d9d640 1 -- 172.21.15.133:0/808034040 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec0094d0 con 0x7f99f80c60f0 2023-12-19T19:02:04.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.432+0000 7f99f6d9d640 1 --2- 172.21.15.133:0/808034040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f80c60f0 0x7f99f8154f40 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f99f000efc0 tx=0x7f99f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:04.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.432+0000 7f99e6ffd640 1 -- 172.21.15.133:0/808034040 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0014480 con 0x7f99f80c60f0 2023-12-19T19:02:04.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.432+0000 7f99e6ffd640 1 -- 172.21.15.133:0/808034040 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f000f040 con 0x7f99f80c60f0 2023-12-19T19:02:04.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.432+0000 7f99e6ffd640 1 -- 172.21.15.133:0/808034040 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0014820 con 0x7f99f80c60f0 2023-12-19T19:02:04.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.432+0000 7f99fc868640 1 -- 172.21.15.133:0/808034040 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f80a90a0 con 0x7f99f80c60f0 2023-12-19T19:02:04.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.432+0000 7f99fc868640 1 -- 172.21.15.133:0/808034040 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f8070830 con 0x7f99f80c60f0 2023-12-19T19:02:04.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.432+0000 7f99fc868640 1 -- 172.21.15.133:0/808034040 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f8068400 con 0x7f99f80c60f0 2023-12-19T19:02:04.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.432+0000 7f99e6ffd640 1 -- 172.21.15.133:0/808034040 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f99f0014980 con 0x7f99f80c60f0 2023-12-19T19:02:04.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.436+0000 7f99e6ffd640 1 --2- 172.21.15.133:0/808034040 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f99d8066470 0x7f99d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:04.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.436+0000 7f99e6ffd640 1 -- 172.21.15.133:0/808034040 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f99f0084be0 con 0x7f99f80c60f0 2023-12-19T19:02:04.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.436+0000 7f99f659c640 1 --2- 172.21.15.133:0/808034040 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f99d8066470 0x7f99d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:04.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.436+0000 7f99f659c640 1 --2- 172.21.15.133:0/808034040 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f99d8066470 0x7f99d8068930 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f99e8007fd0 tx=0x7f99e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:04.443 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.440+0000 7f99e6ffd640 1 -- 172.21.15.133:0/808034040 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f99f0051db0 con 0x7f99f80c60f0 2023-12-19T19:02:04.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.588+0000 7f99fc868640 1 -- 172.21.15.133:0/808034040 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f99f806d390 con 0x7f99f80c60f0 2023-12-19T19:02:04.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.588+0000 7f99e6ffd640 1 -- 172.21.15.133:0/808034040 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) v1 ==== 100+0+11 (secure 0 0 0) 0x7f99f00180a0 con 0x7f99f80c60f0 2023-12-19T19:02:04.593 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:02:04.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.588+0000 7f99fc868640 1 -- 172.21.15.133:0/808034040 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f99d8066470 msgr2=0x7f99d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:04.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.592+0000 7f99fc868640 1 --2- 172.21.15.133:0/808034040 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f99d8066470 0x7f99d8068930 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f99e8007fd0 tx=0x7f99e8009040 comp rx=0 tx=0).stop 2023-12-19T19:02:04.595 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.592+0000 7f99fc868640 1 -- 172.21.15.133:0/808034040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f80c60f0 msgr2=0x7f99f8154f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:04.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.592+0000 7f99fc868640 1 --2- 172.21.15.133:0/808034040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f80c60f0 0x7f99f8154f40 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f99f000efc0 tx=0x7f99f000c490 comp rx=0 tx=0).stop 2023-12-19T19:02:04.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.592+0000 7f99fc868640 1 -- 172.21.15.133:0/808034040 shutdown_connections 2023-12-19T19:02:04.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.592+0000 7f99fc868640 1 --2- 172.21.15.133:0/808034040 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f99d8066470 0x7f99d8068930 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.592+0000 7f99fc868640 1 --2- 172.21.15.133:0/808034040 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99f80c60f0 0x7f99f8154f40 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.592+0000 7f99fc868640 1 --2- 172.21.15.133:0/808034040 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f99f80c5640 0x7f99f8156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.592+0000 7f99fc868640 1 --2- 172.21.15.133:0/808034040 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f99f80c5260 0x7f99f8071af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.592+0000 7f99fc868640 1 -- 172.21.15.133:0/808034040 >> 172.21.15.133:0/808034040 conn(0x7f99f806a5b0 msgr2=0x7f99f814ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:04.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.592+0000 7f99fc868640 1 -- 172.21.15.133:0/808034040 shutdown_connections 2023-12-19T19:02:04.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.592+0000 7f99fc868640 1 -- 172.21.15.133:0/808034040 wait complete. 2023-12-19T19:02:04.615 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-19T19:02:04.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.752+0000 7f808649c640 1 Processor -- start 2023-12-19T19:02:04.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.752+0000 7f808649c640 1 -- start start 2023-12-19T19:02:04.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.752+0000 7f808649c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f80800c5260 0x7f808006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:04.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.752+0000 7f808649c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8080155de0 0x7f8080156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:04.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.752+0000 7f808649c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80800c2580 con 0x7f80800c5640 2023-12-19T19:02:04.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.752+0000 7f808649c640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8080153510 con 0x7f8080155de0 2023-12-19T19:02:04.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.752+0000 7f808649c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80800c17f0 con 0x7f80800c5260 2023-12-19T19:02:04.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.752+0000 7f8084a39640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8080155de0 0x7f8080156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:04.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.752+0000 7f8084a39640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8080155de0 0x7f8080156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49606/0 (socket says 172.21.15.133:49606) 2023-12-19T19:02:04.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.752+0000 7f8084a39640 1 -- 172.21.15.133:0/3314590211 learned_addr learned my addr 172.21.15.133:0/3314590211 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:04.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.752+0000 7f807ffff640 1 --2- 172.21.15.133:0/3314590211 >> v2:172.21.15.138:3300/0 conn(0x7f80800c5260 0x7f808006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:04.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.752+0000 7f8084a39640 1 -- 172.21.15.133:0/3314590211 >> v2:172.21.15.138:3300/0 conn(0x7f80800c5260 msgr2=0x7f808006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:04.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.752+0000 7f8084a39640 1 --2- 172.21.15.133:0/3314590211 >> v2:172.21.15.138:3300/0 conn(0x7f80800c5260 0x7f808006d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.752+0000 7f8084a39640 1 -- 172.21.15.133:0/3314590211 >> v1:172.21.15.138:6789/0 conn(0x7f80800c5640 legacy=0x7f80800c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:04.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.752+0000 7f8084a39640 1 -- 172.21.15.133:0/3314590211 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80800c1a00 con 0x7f8080155de0 2023-12-19T19:02:04.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.756+0000 7f8084a39640 1 --2- 172.21.15.133:0/3314590211 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8080155de0 0x7f8080156230 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f80800c6920 tx=0x7f807801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2caf17d8849486 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:04.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.756+0000 7f807effd640 1 -- 172.21.15.133:0/3314590211 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80780a57d0 con 0x7f8080155de0 2023-12-19T19:02:04.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.756+0000 7f807effd640 1 -- 172.21.15.133:0/3314590211 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80780a5930 con 0x7f8080155de0 2023-12-19T19:02:04.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.756+0000 7f807effd640 1 -- 172.21.15.133:0/3314590211 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80780a5cc0 con 0x7f8080155de0 2023-12-19T19:02:04.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.756+0000 7f808649c640 1 -- 172.21.15.133:0/3314590211 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8080155de0 msgr2=0x7f8080156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:04.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.756+0000 7f808649c640 1 --2- 172.21.15.133:0/3314590211 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8080155de0 0x7f8080156230 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f80800c6920 tx=0x7f807801c910 comp rx=0 tx=0).stop 2023-12-19T19:02:04.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.756+0000 7f808649c640 1 -- 172.21.15.133:0/3314590211 shutdown_connections 2023-12-19T19:02:04.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.756+0000 7f808649c640 1 --2- 172.21.15.133:0/3314590211 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8080155de0 0x7f8080156230 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.756+0000 7f808649c640 1 --2- 172.21.15.133:0/3314590211 >> v2:172.21.15.138:3300/0 conn(0x7f80800c5260 0x7f808006d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.756+0000 7f808649c640 1 -- 172.21.15.133:0/3314590211 >> 172.21.15.133:0/3314590211 conn(0x7f808006a5b0 msgr2=0x7f808006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:04.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.756+0000 7f808649c640 1 -- 172.21.15.133:0/3314590211 shutdown_connections 2023-12-19T19:02:04.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.756+0000 7f808649c640 1 -- 172.21.15.133:0/3314590211 wait complete. 2023-12-19T19:02:04.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.756+0000 7f808649c640 1 Processor -- start 2023-12-19T19:02:04.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f808649c640 1 -- start start 2023-12-19T19:02:04.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f808649c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80800c5260 0x7f8080071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:04.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f808649c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80800c5640 0x7f808015d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:04.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f808649c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8080155de0 0x7f808015d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:04.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f808649c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8080158fe0 con 0x7f80800c5260 2023-12-19T19:02:04.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f808649c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808015dbc0 con 0x7f80800c5640 2023-12-19T19:02:04.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f808649c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808014f580 con 0x7f8080155de0 2023-12-19T19:02:04.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f807ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80800c5260 0x7f8080071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:04.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f807ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80800c5260 0x7f8080071100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49618/0 (socket says 172.21.15.133:49618) 2023-12-19T19:02:04.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f807ffff640 1 -- 172.21.15.133:0/129583895 learned_addr learned my addr 172.21.15.133:0/129583895 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:04.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f807f7fe640 1 --2- 172.21.15.133:0/129583895 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80800c5640 0x7f808015d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:04.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f8084a39640 1 --2- 172.21.15.133:0/129583895 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8080155de0 0x7f808015d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:04.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f807ffff640 1 -- 172.21.15.133:0/129583895 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8080155de0 msgr2=0x7f808015d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:04.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f807ffff640 1 --2- 172.21.15.133:0/129583895 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8080155de0 0x7f808015d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f807ffff640 1 -- 172.21.15.133:0/129583895 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80800c5640 msgr2=0x7f808015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:04.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f807ffff640 1 --2- 172.21.15.133:0/129583895 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80800c5640 0x7f808015d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f807ffff640 1 -- 172.21.15.133:0/129583895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8078009b30 con 0x7f80800c5260 2023-12-19T19:02:04.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f807ffff640 1 --2- 172.21.15.133:0/129583895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80800c5260 0x7f8080071100 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f807000d5f0 tx=0x7f807000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:04.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f807cff9640 1 -- 172.21.15.133:0/129583895 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80700125f0 con 0x7f80800c5260 2023-12-19T19:02:04.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f807cff9640 1 -- 172.21.15.133:0/129583895 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8070012750 con 0x7f80800c5260 2023-12-19T19:02:04.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f808649c640 1 -- 172.21.15.133:0/129583895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808014edf0 con 0x7f80800c5260 2023-12-19T19:02:04.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f807cff9640 1 -- 172.21.15.133:0/129583895 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8070012ae0 con 0x7f80800c5260 2023-12-19T19:02:04.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f808649c640 1 -- 172.21.15.133:0/129583895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80801edae0 con 0x7f80800c5260 2023-12-19T19:02:04.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.760+0000 7f808649c640 1 -- 172.21.15.133:0/129583895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8080068400 con 0x7f80800c5260 2023-12-19T19:02:04.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.764+0000 7f807cff9640 1 -- 172.21.15.133:0/129583895 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8070012c40 con 0x7f80800c5260 2023-12-19T19:02:04.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.764+0000 7f807cff9640 1 --2- 172.21.15.133:0/129583895 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f806c066470 0x7f806c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:04.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.764+0000 7f807cff9640 1 -- 172.21.15.133:0/129583895 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f80700846f0 con 0x7f80800c5260 2023-12-19T19:02:04.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.764+0000 7f807f7fe640 1 --2- 172.21.15.133:0/129583895 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f806c066470 0x7f806c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:04.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.764+0000 7f807f7fe640 1 --2- 172.21.15.133:0/129583895 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f806c066470 0x7f806c068930 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f80800a8840 tx=0x7f8074009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:04.772 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.768+0000 7f807cff9640 1 -- 172.21.15.133:0/129583895 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8070051800 con 0x7f80800c5260 2023-12-19T19:02:04.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.916+0000 7f808649c640 1 -- 172.21.15.133:0/129583895 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f808006d390 con 0x7f80800c5260 2023-12-19T19:02:04.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.916+0000 7f807cff9640 1 -- 172.21.15.133:0/129583895 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v73) v1 ==== 105+0+11 (secure 0 0 0) 0x7f8070007380 con 0x7f80800c5260 2023-12-19T19:02:04.922 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:02:04.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.920+0000 7f808649c640 1 -- 172.21.15.133:0/129583895 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f806c066470 msgr2=0x7f806c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:04.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.920+0000 7f808649c640 1 --2- 172.21.15.133:0/129583895 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f806c066470 0x7f806c068930 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f80800a8840 tx=0x7f8074009040 comp rx=0 tx=0).stop 2023-12-19T19:02:04.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.920+0000 7f808649c640 1 -- 172.21.15.133:0/129583895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80800c5260 msgr2=0x7f8080071100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:04.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.920+0000 7f808649c640 1 --2- 172.21.15.133:0/129583895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80800c5260 0x7f8080071100 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f807000d5f0 tx=0x7f807000dab0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.920+0000 7f808649c640 1 -- 172.21.15.133:0/129583895 shutdown_connections 2023-12-19T19:02:04.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.920+0000 7f808649c640 1 --2- 172.21.15.133:0/129583895 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f806c066470 0x7f806c068930 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.920+0000 7f808649c640 1 --2- 172.21.15.133:0/129583895 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8080155de0 0x7f808015d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.920+0000 7f808649c640 1 --2- 172.21.15.133:0/129583895 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f80800c5640 0x7f808015d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.920+0000 7f808649c640 1 --2- 172.21.15.133:0/129583895 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80800c5260 0x7f8080071100 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:04.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.920+0000 7f808649c640 1 -- 172.21.15.133:0/129583895 >> 172.21.15.133:0/129583895 conn(0x7f808006a5b0 msgr2=0x7f80800bf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:04.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.920+0000 7f808649c640 1 -- 172.21.15.133:0/129583895 shutdown_connections 2023-12-19T19:02:04.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:04.920+0000 7f808649c640 1 -- 172.21.15.133:0/129583895 wait complete. 2023-12-19T19:02:04.943 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-19T19:02:05.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.076+0000 7fcff79f5640 1 Processor -- start 2023-12-19T19:02:05.083 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.080+0000 7fcff79f5640 1 -- start start 2023-12-19T19:02:05.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.080+0000 7fcff79f5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcff00c5260 0x7fcff006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:05.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.080+0000 7fcff79f5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fcff0155de0 0x7fcff0156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:05.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.080+0000 7fcff79f5640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff00c2580 con 0x7fcff00c5640 2023-12-19T19:02:05.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.080+0000 7fcff79f5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff0153510 con 0x7fcff00c5260 2023-12-19T19:02:05.085 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.080+0000 7fcff79f5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff00c17f0 con 0x7fcff0155de0 2023-12-19T19:02:05.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.080+0000 7fcff5791640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcff00c5260 0x7fcff006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:05.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.080+0000 7fcff5791640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcff00c5260 0x7fcff006d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49628/0 (socket says 172.21.15.133:49628) 2023-12-19T19:02:05.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.080+0000 7fcff5791640 1 -- 172.21.15.133:0/2284033683 learned_addr learned my addr 172.21.15.133:0/2284033683 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:05.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.080+0000 7fcff5f92640 1 --2- 172.21.15.133:0/2284033683 >> v2:172.21.15.138:3300/0 conn(0x7fcff0155de0 0x7fcff0156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:05.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.080+0000 7fcff5791640 1 -- 172.21.15.133:0/2284033683 >> v2:172.21.15.138:3300/0 conn(0x7fcff0155de0 msgr2=0x7fcff0156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:05.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.080+0000 7fcff5791640 1 --2- 172.21.15.133:0/2284033683 >> v2:172.21.15.138:3300/0 conn(0x7fcff0155de0 0x7fcff0156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.080+0000 7fcff5791640 1 -- 172.21.15.133:0/2284033683 >> v1:172.21.15.138:6789/0 conn(0x7fcff00c5640 legacy=0x7fcff00c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:05.086 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.080+0000 7fcff5791640 1 -- 172.21.15.133:0/2284033683 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff00c1a00 con 0x7fcff00c5260 2023-12-19T19:02:05.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.084+0000 7fcff5791640 1 --2- 172.21.15.133:0/2284033683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff00c5260 0x7fcff006d5b0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fcff00c6b10 tx=0x7fcfec01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d871e93edb55531 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:05.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.084+0000 7fcfe7fff640 1 -- 172.21.15.133:0/2284033683 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec0ab640 con 0x7fcff00c5260 2023-12-19T19:02:05.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.084+0000 7fcfe7fff640 1 -- 172.21.15.133:0/2284033683 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfec0a7070 con 0x7fcff00c5260 2023-12-19T19:02:05.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.084+0000 7fcfe7fff640 1 -- 172.21.15.133:0/2284033683 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec0ab9c0 con 0x7fcff00c5260 2023-12-19T19:02:05.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.084+0000 7fcff79f5640 1 -- 172.21.15.133:0/2284033683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff00c5260 msgr2=0x7fcff006d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:05.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.084+0000 7fcff79f5640 1 --2- 172.21.15.133:0/2284033683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff00c5260 0x7fcff006d5b0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fcff00c6b10 tx=0x7fcfec01c440 comp rx=0 tx=0).stop 2023-12-19T19:02:05.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.084+0000 7fcff79f5640 1 -- 172.21.15.133:0/2284033683 shutdown_connections 2023-12-19T19:02:05.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.084+0000 7fcff79f5640 1 --2- 172.21.15.133:0/2284033683 >> v2:172.21.15.138:3300/0 conn(0x7fcff0155de0 0x7fcff0156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.084+0000 7fcff79f5640 1 --2- 172.21.15.133:0/2284033683 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff00c5260 0x7fcff006d5b0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.084+0000 7fcff79f5640 1 -- 172.21.15.133:0/2284033683 >> 172.21.15.133:0/2284033683 conn(0x7fcff006a5b0 msgr2=0x7fcff006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:05.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.084+0000 7fcff79f5640 1 -- 172.21.15.133:0/2284033683 shutdown_connections 2023-12-19T19:02:05.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.084+0000 7fcff79f5640 1 -- 172.21.15.133:0/2284033683 wait complete. 2023-12-19T19:02:05.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.084+0000 7fcff79f5640 1 Processor -- start 2023-12-19T19:02:05.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.084+0000 7fcff79f5640 1 -- start start 2023-12-19T19:02:05.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.088+0000 7fcff79f5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff00c5260 0x7fcff00bd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:05.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.088+0000 7fcff79f5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcff00c5640 0x7fcff01ef080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:05.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.088+0000 7fcff79f5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcff0155de0 0x7fcff00a6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:05.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.088+0000 7fcff79f5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff01ef5c0 con 0x7fcff00c5260 2023-12-19T19:02:05.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.088+0000 7fcff79f5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff01eb100 con 0x7fcff0155de0 2023-12-19T19:02:05.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.088+0000 7fcff79f5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff00bc190 con 0x7fcff00c5640 2023-12-19T19:02:05.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.088+0000 7fcff5791640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff00c5260 0x7fcff00bd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:05.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.088+0000 7fcff5791640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff00c5260 0x7fcff00bd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49640/0 (socket says 172.21.15.133:49640) 2023-12-19T19:02:05.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.088+0000 7fcff5791640 1 -- 172.21.15.133:0/792526431 learned_addr learned my addr 172.21.15.133:0/792526431 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:05.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.088+0000 7fcff5791640 1 -- 172.21.15.133:0/792526431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcff00c5640 msgr2=0x7fcff01ef080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:05.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.088+0000 7fcff5791640 1 --2- 172.21.15.133:0/792526431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcff00c5640 0x7fcff01ef080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.088+0000 7fcff5791640 1 -- 172.21.15.133:0/792526431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcff0155de0 msgr2=0x7fcff00a6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:05.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.088+0000 7fcff5791640 1 --2- 172.21.15.133:0/792526431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcff0155de0 0x7fcff00a6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.088+0000 7fcff5791640 1 -- 172.21.15.133:0/792526431 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec0094d0 con 0x7fcff00c5260 2023-12-19T19:02:05.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.088+0000 7fcff5791640 1 --2- 172.21.15.133:0/792526431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff00c5260 0x7fcff00bd2d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0ad040 tx=0x7fcfec01ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:05.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.088+0000 7fcfe5ffb640 1 -- 172.21.15.133:0/792526431 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec0be3f0 con 0x7fcff00c5260 2023-12-19T19:02:05.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.088+0000 7fcfe5ffb640 1 -- 172.21.15.133:0/792526431 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfec0be570 con 0x7fcff00c5260 2023-12-19T19:02:05.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.088+0000 7fcfe5ffb640 1 -- 172.21.15.133:0/792526431 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec0be920 con 0x7fcff00c5260 2023-12-19T19:02:05.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.088+0000 7fcff79f5640 1 -- 172.21.15.133:0/792526431 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff00bc470 con 0x7fcff00c5260 2023-12-19T19:02:05.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.088+0000 7fcff79f5640 1 -- 172.21.15.133:0/792526431 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff01eb3c0 con 0x7fcff00c5260 2023-12-19T19:02:05.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.088+0000 7fcff79f5640 1 -- 172.21.15.133:0/792526431 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcff00c0410 con 0x7fcff00c5260 2023-12-19T19:02:05.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.088+0000 7fcfe5ffb640 1 -- 172.21.15.133:0/792526431 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fcfec0c7440 con 0x7fcff00c5260 2023-12-19T19:02:05.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.092+0000 7fcfe5ffb640 1 --2- 172.21.15.133:0/792526431 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcfd4066470 0x7fcfd4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:05.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.092+0000 7fcfe5ffb640 1 -- 172.21.15.133:0/792526431 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcfec11eb80 con 0x7fcff00c5260 2023-12-19T19:02:05.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.092+0000 7fcff4f90640 1 --2- 172.21.15.133:0/792526431 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcfd4066470 0x7fcfd4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:05.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.092+0000 7fcff4f90640 1 --2- 172.21.15.133:0/792526431 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcfd4066470 0x7fcfd4068930 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0000f70 tx=0x7fcfe00079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:05.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.096+0000 7fcfe5ffb640 1 -- 172.21.15.133:0/792526431 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fcfec0ebc90 con 0x7fcff00c5260 2023-12-19T19:02:05.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.244+0000 7fcff79f5640 1 -- 172.21.15.133:0/792526431 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fcff0068400 con 0x7fcff00c5260 2023-12-19T19:02:05.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.244+0000 7fcfe5ffb640 1 -- 172.21.15.133:0/792526431 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v73) v1 ==== 101+0+11 (secure 0 0 0) 0x7fcfec0ef2b0 con 0x7fcff00c5260 2023-12-19T19:02:05.248 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:02:05.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.244+0000 7fcff79f5640 1 -- 172.21.15.133:0/792526431 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcfd4066470 msgr2=0x7fcfd4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:05.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.244+0000 7fcff79f5640 1 --2- 172.21.15.133:0/792526431 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcfd4066470 0x7fcfd4068930 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0000f70 tx=0x7fcfe00079c0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.244+0000 7fcff79f5640 1 -- 172.21.15.133:0/792526431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff00c5260 msgr2=0x7fcff00bd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:05.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.244+0000 7fcff79f5640 1 --2- 172.21.15.133:0/792526431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff00c5260 0x7fcff00bd2d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0ad040 tx=0x7fcfec01ac80 comp rx=0 tx=0).stop 2023-12-19T19:02:05.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.244+0000 7fcff79f5640 1 -- 172.21.15.133:0/792526431 shutdown_connections 2023-12-19T19:02:05.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.244+0000 7fcff79f5640 1 --2- 172.21.15.133:0/792526431 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcfd4066470 0x7fcfd4068930 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.244+0000 7fcff79f5640 1 --2- 172.21.15.133:0/792526431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcff0155de0 0x7fcff00a6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.244+0000 7fcff79f5640 1 --2- 172.21.15.133:0/792526431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcff00c5640 0x7fcff01ef080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.244+0000 7fcff79f5640 1 --2- 172.21.15.133:0/792526431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcff00c5260 0x7fcff00bd2d0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.244+0000 7fcff79f5640 1 -- 172.21.15.133:0/792526431 >> 172.21.15.133:0/792526431 conn(0x7fcff006a5b0 msgr2=0x7fcff00a5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:05.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.244+0000 7fcff79f5640 1 -- 172.21.15.133:0/792526431 shutdown_connections 2023-12-19T19:02:05.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.244+0000 7fcff79f5640 1 -- 172.21.15.133:0/792526431 wait complete. 2023-12-19T19:02:05.269 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T19:02:05.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.400+0000 7f7af125a640 1 Processor -- start 2023-12-19T19:02:05.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.400+0000 7f7af125a640 1 -- start start 2023-12-19T19:02:05.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.404+0000 7f7af125a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7aec06a5b0 0x7f7aec06a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:05.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.404+0000 7f7af125a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7aec06b1e0 0x7f7aec0c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:05.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.404+0000 7f7af125a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aec072500 con 0x7f7aec06dfe0 2023-12-19T19:02:05.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.404+0000 7f7af125a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aec06ef50 con 0x7f7aec06a5b0 2023-12-19T19:02:05.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.404+0000 7f7af125a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec0720b0 con 0x7f7aec06b1e0 2023-12-19T19:02:05.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.404+0000 7f7aeb59e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7aec06b1e0 0x7f7aec0c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:05.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.404+0000 7f7ae3fff640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f7aec06dfe0 0x7f7aec0c2090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:59418/0 (socket says 172.21.15.133:59418) 2023-12-19T19:02:05.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.404+0000 7f7ae3fff640 1 -- 172.21.15.133:0/3764686193 learned_addr learned my addr 172.21.15.133:0/3764686193 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:05.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.404+0000 7f7aead9d640 1 --2- 172.21.15.133:0/3764686193 >> v2:172.21.15.138:3300/0 conn(0x7f7aec06a5b0 0x7f7aec06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:05.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.404+0000 7f7aea59c640 1 -- 172.21.15.133:0/3764686193 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56944040 0 0) 0x7f7aec072500 con 0x7f7aec06dfe0 2023-12-19T19:02:05.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.404+0000 7f7aea59c640 1 -- 172.21.15.133:0/3764686193 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ad8003530 con 0x7f7aec06dfe0 2023-12-19T19:02:05.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.404+0000 7f7aeb59e640 1 -- 172.21.15.133:0/3764686193 >> v2:172.21.15.138:3300/0 conn(0x7f7aec06a5b0 msgr2=0x7f7aec06a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:05.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.404+0000 7f7aeb59e640 1 --2- 172.21.15.133:0/3764686193 >> v2:172.21.15.138:3300/0 conn(0x7f7aec06a5b0 0x7f7aec06a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.404+0000 7f7aeb59e640 1 -- 172.21.15.133:0/3764686193 >> v1:172.21.15.138:6789/0 conn(0x7f7aec06dfe0 legacy=0x7f7aec0c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:05.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.404+0000 7f7aeb59e640 1 -- 172.21.15.133:0/3764686193 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aec070f60 con 0x7f7aec06b1e0 2023-12-19T19:02:05.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.408+0000 7f7aeb59e640 1 --2- 172.21.15.133:0/3764686193 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7aec06b1e0 0x7f7aec0c27a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009d90 tx=0x7f7ae401c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9879de9d702759f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:05.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.408+0000 7f7aea59c640 1 -- 172.21.15.133:0/3764686193 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae40a5780 con 0x7f7aec06b1e0 2023-12-19T19:02:05.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.408+0000 7f7aea59c640 1 -- 172.21.15.133:0/3764686193 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae40a58e0 con 0x7f7aec06b1e0 2023-12-19T19:02:05.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.408+0000 7f7aea59c640 1 -- 172.21.15.133:0/3764686193 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae40a5c50 con 0x7f7aec06b1e0 2023-12-19T19:02:05.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.408+0000 7f7af125a640 1 -- 172.21.15.133:0/3764686193 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7aec06b1e0 msgr2=0x7f7aec0c27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:05.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.408+0000 7f7af125a640 1 --2- 172.21.15.133:0/3764686193 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7aec06b1e0 0x7f7aec0c27a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009d90 tx=0x7f7ae401c8c0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.408+0000 7f7af125a640 1 -- 172.21.15.133:0/3764686193 shutdown_connections 2023-12-19T19:02:05.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.408+0000 7f7af125a640 1 --2- 172.21.15.133:0/3764686193 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7aec06b1e0 0x7f7aec0c27a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.408+0000 7f7af125a640 1 --2- 172.21.15.133:0/3764686193 >> v2:172.21.15.138:3300/0 conn(0x7f7aec06a5b0 0x7f7aec06a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.408+0000 7f7af125a640 1 -- 172.21.15.133:0/3764686193 >> 172.21.15.133:0/3764686193 conn(0x7f7aec0c6ef0 msgr2=0x7f7aec0c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:05.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.408+0000 7f7af125a640 1 -- 172.21.15.133:0/3764686193 shutdown_connections 2023-12-19T19:02:05.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.408+0000 7f7af125a640 1 -- 172.21.15.133:0/3764686193 wait complete. 2023-12-19T19:02:05.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.408+0000 7f7af125a640 1 Processor -- start 2023-12-19T19:02:05.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.408+0000 7f7af125a640 1 -- start start 2023-12-19T19:02:05.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7af125a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7aec06a5b0 0x7f7aec141000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:05.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7af125a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7aec06b1e0 0x7f7aec13e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:05.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7af125a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7aec06dfe0 0x7f7aec139650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:05.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7af125a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec0c5750 con 0x7f7aec06dfe0 2023-12-19T19:02:05.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7af125a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec15e2a0 con 0x7f7aec06a5b0 2023-12-19T19:02:05.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7af125a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec0c6830 con 0x7f7aec06b1e0 2023-12-19T19:02:05.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7aeb59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7aec06dfe0 0x7f7aec139650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:05.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7aeb59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7aec06dfe0 0x7f7aec139650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49644/0 (socket says 172.21.15.133:49644) 2023-12-19T19:02:05.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7aeb59e640 1 -- 172.21.15.133:0/3870918220 learned_addr learned my addr 172.21.15.133:0/3870918220 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:05.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7ae3fff640 1 --2- 172.21.15.133:0/3870918220 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7aec06b1e0 0x7f7aec13e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:05.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7aead9d640 1 --2- 172.21.15.133:0/3870918220 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7aec06a5b0 0x7f7aec141000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7aeb59e640 1 -- 172.21.15.133:0/3870918220 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7aec06b1e0 msgr2=0x7f7aec13e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7aeb59e640 1 --2- 172.21.15.133:0/3870918220 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7aec06b1e0 0x7f7aec13e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7aeb59e640 1 -- 172.21.15.133:0/3870918220 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7aec06a5b0 msgr2=0x7f7aec141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7aeb59e640 1 --2- 172.21.15.133:0/3870918220 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7aec06a5b0 0x7f7aec141000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7aeb59e640 1 -- 172.21.15.133:0/3870918220 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae4009a70 con 0x7f7aec06dfe0 2023-12-19T19:02:05.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7aeb59e640 1 --2- 172.21.15.133:0/3870918220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7aec06dfe0 0x7f7aec139650 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f7ae401a4f0 tx=0x7f7ae4019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:05.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7ae37fe640 1 -- 172.21.15.133:0/3870918220 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae40ad640 con 0x7f7aec06dfe0 2023-12-19T19:02:05.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7ae37fe640 1 -- 172.21.15.133:0/3870918220 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae40ad7a0 con 0x7f7aec06dfe0 2023-12-19T19:02:05.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7af125a640 1 -- 172.21.15.133:0/3870918220 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aec0c6d40 con 0x7f7aec06dfe0 2023-12-19T19:02:05.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7ae37fe640 1 -- 172.21.15.133:0/3870918220 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae40adb30 con 0x7f7aec06dfe0 2023-12-19T19:02:05.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7af125a640 1 -- 172.21.15.133:0/3870918220 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aec0c4c10 con 0x7f7aec06dfe0 2023-12-19T19:02:05.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7af125a640 1 -- 172.21.15.133:0/3870918220 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aec1f0120 con 0x7f7aec06dfe0 2023-12-19T19:02:05.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.412+0000 7f7ae37fe640 1 -- 172.21.15.133:0/3870918220 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7ae40b4070 con 0x7f7aec06dfe0 2023-12-19T19:02:05.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.416+0000 7f7ae37fe640 1 --2- 172.21.15.133:0/3870918220 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7acc066470 0x7f7acc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:05.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.416+0000 7f7ae37fe640 1 -- 172.21.15.133:0/3870918220 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7ae411ed10 con 0x7f7aec06dfe0 2023-12-19T19:02:05.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.416+0000 7f7aead9d640 1 --2- 172.21.15.133:0/3870918220 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7acc066470 0x7f7acc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:05.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.416+0000 7f7aead9d640 1 --2- 172.21.15.133:0/3870918220 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7acc066470 0x7f7acc068930 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009ac0 tx=0x7f7adc009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:05.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.420+0000 7f7ae37fe640 1 -- 172.21.15.133:0/3870918220 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7aec1f0120 con 0x7f7aec06dfe0 2023-12-19T19:02:05.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.580+0000 7f7af125a640 1 -- 172.21.15.133:0/3870918220 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7aec1f0120 con 0x7f7aec06dfe0 2023-12-19T19:02:05.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.580+0000 7f7ae37fe640 1 -- 172.21.15.133:0/3870918220 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v73) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7aec1f0120 con 0x7f7aec06dfe0 2023-12-19T19:02:05.586 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-19T19:02:05.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.584+0000 7f7af125a640 1 -- 172.21.15.133:0/3870918220 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7acc066470 msgr2=0x7f7acc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:05.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.584+0000 7f7af125a640 1 --2- 172.21.15.133:0/3870918220 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7acc066470 0x7f7acc068930 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009ac0 tx=0x7f7adc009190 comp rx=0 tx=0).stop 2023-12-19T19:02:05.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.584+0000 7f7af125a640 1 -- 172.21.15.133:0/3870918220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7aec06dfe0 msgr2=0x7f7aec139650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:05.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.584+0000 7f7af125a640 1 --2- 172.21.15.133:0/3870918220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7aec06dfe0 0x7f7aec139650 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f7ae401a4f0 tx=0x7f7ae4019660 comp rx=0 tx=0).stop 2023-12-19T19:02:05.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.584+0000 7f7af125a640 1 -- 172.21.15.133:0/3870918220 shutdown_connections 2023-12-19T19:02:05.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.584+0000 7f7af125a640 1 --2- 172.21.15.133:0/3870918220 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7acc066470 0x7f7acc068930 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.584+0000 7f7af125a640 1 --2- 172.21.15.133:0/3870918220 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7aec06dfe0 0x7f7aec139650 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.584+0000 7f7af125a640 1 --2- 172.21.15.133:0/3870918220 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7aec06b1e0 0x7f7aec13e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.584+0000 7f7af125a640 1 --2- 172.21.15.133:0/3870918220 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7aec06a5b0 0x7f7aec141000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.584+0000 7f7af125a640 1 -- 172.21.15.133:0/3870918220 >> 172.21.15.133:0/3870918220 conn(0x7f7aec0c6ef0 msgr2=0x7f7aec14d260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:05.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.584+0000 7f7af125a640 1 -- 172.21.15.133:0/3870918220 shutdown_connections 2023-12-19T19:02:05.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.584+0000 7f7af125a640 1 -- 172.21.15.133:0/3870918220 wait complete. 2023-12-19T19:02:05.607 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-19T19:02:05.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:05.607 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T19:02:05.660 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-19T19:02:05.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:05.660 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T19:02:05.678 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T19:02:05.678 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:02:05.728 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3517 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-19T19:02:05.729 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T19:02:05.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.904+0000 7fc4c4217640 1 Processor -- start 2023-12-19T19:02:05.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.904+0000 7fc4c4217640 1 -- start start 2023-12-19T19:02:05.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.904+0000 7fc4c4217640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4bc0c7ed0 0x7fc4bc154650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:05.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.904+0000 7fc4c4217640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc4bc0bd660 0x7fc4bc154b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:05.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.904+0000 7fc4c4217640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc0ac4f0 con 0x7fc4bc151dc0 2023-12-19T19:02:05.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.904+0000 7fc4c4217640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4bc158780 con 0x7fc4bc0bd660 2023-12-19T19:02:05.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.904+0000 7fc4c4217640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc158a60 con 0x7fc4bc0c7ed0 2023-12-19T19:02:05.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.904+0000 7fc4c17b2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4bc0c7ed0 0x7fc4bc154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:05.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.904+0000 7fc4c17b2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4bc0c7ed0 0x7fc4bc154650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:48908/0 (socket says 172.21.15.133:48908) 2023-12-19T19:02:05.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.904+0000 7fc4c17b2640 1 -- 172.21.15.133:0/3707098979 learned_addr learned my addr 172.21.15.133:0/3707098979 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:05.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.904+0000 7fc4c27b4640 1 --2- 172.21.15.133:0/3707098979 >> v2:172.21.15.138:3300/0 conn(0x7fc4bc0bd660 0x7fc4bc154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:05.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.904+0000 7fc4c1fb3640 1 --1- 172.21.15.133:0/3707098979 >> v1:172.21.15.138:6789/0 conn(0x7fc4bc151dc0 0x7fc4bc0c4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:59428/0 (socket says 172.21.15.133:59428) 2023-12-19T19:02:05.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.904+0000 7fc4c17b2640 1 -- 172.21.15.133:0/3707098979 >> v2:172.21.15.138:3300/0 conn(0x7fc4bc0bd660 msgr2=0x7fc4bc154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:05.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.904+0000 7fc4c17b2640 1 --2- 172.21.15.133:0/3707098979 >> v2:172.21.15.138:3300/0 conn(0x7fc4bc0bd660 0x7fc4bc154b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.904+0000 7fc4c17b2640 1 -- 172.21.15.133:0/3707098979 >> v1:172.21.15.138:6789/0 conn(0x7fc4bc151dc0 legacy=0x7fc4bc0c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:05.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.904+0000 7fc4c17b2640 1 -- 172.21.15.133:0/3707098979 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc0ac180 con 0x7fc4bc0c7ed0 2023-12-19T19:02:05.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.904+0000 7fc4c0fb1640 1 -- 172.21.15.133:0/3707098979 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221092041 0 0) 0x7fc4bc0ac4f0 con 0x7fc4bc151dc0 2023-12-19T19:02:05.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.908+0000 7fc4c17b2640 1 --2- 172.21.15.133:0/3707098979 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4bc0c7ed0 0x7fc4bc154650 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009870 tx=0x7fc4ac01c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=394a426c8f7576ed server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:05.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.908+0000 7fc4c0fb1640 1 -- 172.21.15.133:0/3707098979 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac0ab600 con 0x7fc4bc0c7ed0 2023-12-19T19:02:05.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.908+0000 7fc4c0fb1640 1 -- 172.21.15.133:0/3707098979 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ac0a7050 con 0x7fc4bc0c7ed0 2023-12-19T19:02:05.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.908+0000 7fc4c0fb1640 1 -- 172.21.15.133:0/3707098979 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ac0ab980 con 0x7fc4bc0c7ed0 2023-12-19T19:02:05.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.908+0000 7fc4c4217640 1 -- 172.21.15.133:0/3707098979 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4bc0c7ed0 msgr2=0x7fc4bc154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:05.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.908+0000 7fc4c4217640 1 --2- 172.21.15.133:0/3707098979 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4bc0c7ed0 0x7fc4bc154650 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009870 tx=0x7fc4ac01c420 comp rx=0 tx=0).stop 2023-12-19T19:02:05.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.908+0000 7fc4c4217640 1 -- 172.21.15.133:0/3707098979 shutdown_connections 2023-12-19T19:02:05.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.908+0000 7fc4c4217640 1 --2- 172.21.15.133:0/3707098979 >> v2:172.21.15.138:3300/0 conn(0x7fc4bc0bd660 0x7fc4bc154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.908+0000 7fc4c4217640 1 --2- 172.21.15.133:0/3707098979 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4bc0c7ed0 0x7fc4bc154650 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.908+0000 7fc4c4217640 1 -- 172.21.15.133:0/3707098979 >> 172.21.15.133:0/3707098979 conn(0x7fc4bc071eb0 msgr2=0x7fc4bc0722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:05.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.908+0000 7fc4c4217640 1 -- 172.21.15.133:0/3707098979 shutdown_connections 2023-12-19T19:02:05.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.908+0000 7fc4c4217640 1 -- 172.21.15.133:0/3707098979 wait complete. 2023-12-19T19:02:05.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4c4217640 1 Processor -- start 2023-12-19T19:02:05.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4c4217640 1 -- start start 2023-12-19T19:02:05.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4c4217640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4bc0bd660 0x7fc4bc1ecae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:05.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4c4217640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4bc0c7ed0 0x7fc4bc0c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:05.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4c4217640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4bc151dc0 0x7fc4bc1f0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:05.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4c4217640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc1f0560 con 0x7fc4bc151dc0 2023-12-19T19:02:05.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4c4217640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0c09b0 con 0x7fc4bc0c7ed0 2023-12-19T19:02:05.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4c4217640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc1ed020 con 0x7fc4bc0bd660 2023-12-19T19:02:05.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4c27b4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4bc151dc0 0x7fc4bc1f0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:05.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4c27b4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4bc151dc0 0x7fc4bc1f0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49652/0 (socket says 172.21.15.133:49652) 2023-12-19T19:02:05.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4c27b4640 1 -- 172.21.15.133:0/840377232 learned_addr learned my addr 172.21.15.133:0/840377232 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:05.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4c17b2640 1 --2- 172.21.15.133:0/840377232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4bc0c7ed0 0x7fc4bc0c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:05.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4c1fb3640 1 --2- 172.21.15.133:0/840377232 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4bc0bd660 0x7fc4bc1ecae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:05.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4c27b4640 1 -- 172.21.15.133:0/840377232 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4bc0bd660 msgr2=0x7fc4bc1ecae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:05.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4c27b4640 1 --2- 172.21.15.133:0/840377232 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4bc0bd660 0x7fc4bc1ecae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4c27b4640 1 -- 172.21.15.133:0/840377232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4bc0c7ed0 msgr2=0x7fc4bc0c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:05.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4c27b4640 1 --2- 172.21.15.133:0/840377232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4bc0c7ed0 0x7fc4bc0c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:05.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4c27b4640 1 -- 172.21.15.133:0/840377232 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac0094d0 con 0x7fc4bc151dc0 2023-12-19T19:02:05.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4c27b4640 1 --2- 172.21.15.133:0/840377232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4bc151dc0 0x7fc4bc1f0980 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400efc0 tx=0x7fc4b400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:05.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4b27fc640 1 -- 172.21.15.133:0/840377232 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4009b20 con 0x7fc4bc151dc0 2023-12-19T19:02:05.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4b27fc640 1 -- 172.21.15.133:0/840377232 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b400f040 con 0x7fc4bc151dc0 2023-12-19T19:02:05.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4c4217640 1 -- 172.21.15.133:0/840377232 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4bc0be2d0 con 0x7fc4bc151dc0 2023-12-19T19:02:05.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4b27fc640 1 -- 172.21.15.133:0/840377232 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b40146c0 con 0x7fc4bc151dc0 2023-12-19T19:02:05.919 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.912+0000 7fc4c4217640 1 -- 172.21.15.133:0/840377232 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4bc1f0180 con 0x7fc4bc151dc0 2023-12-19T19:02:05.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.916+0000 7fc4c4217640 1 -- 172.21.15.133:0/840377232 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4bc1f06a0 con 0x7fc4bc151dc0 2023-12-19T19:02:05.920 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.916+0000 7fc4b27fc640 1 -- 172.21.15.133:0/840377232 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc4b4014820 con 0x7fc4bc151dc0 2023-12-19T19:02:05.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.916+0000 7fc4b27fc640 1 --2- 172.21.15.133:0/840377232 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc4a0066470 0x7fc4a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:05.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.916+0000 7fc4b27fc640 1 -- 172.21.15.133:0/840377232 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc4b4084fe0 con 0x7fc4bc151dc0 2023-12-19T19:02:05.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.916+0000 7fc4c1fb3640 1 --2- 172.21.15.133:0/840377232 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc4a0066470 0x7fc4a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:05.922 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.916+0000 7fc4c1fb3640 1 --2- 172.21.15.133:0/840377232 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc4a0066470 0x7fc4a0068930 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8000f70 tx=0x7fc4b8007b60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:05.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:05.920+0000 7fc4b27fc640 1 -- 172.21.15.133:0/840377232 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc4bc1f06a0 con 0x7fc4bc151dc0 2023-12-19T19:02:06.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:06.104+0000 7fc4c4217640 1 -- 172.21.15.133:0/840377232 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc4bc1f06a0 con 0x7fc4bc151dc0 2023-12-19T19:02:06.109 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:06.104+0000 7fc4b27fc640 1 -- 172.21.15.133:0/840377232 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) v1 ==== 53+0+149 (secure 0 0 0) 0x7fc4bc1f06a0 con 0x7fc4bc151dc0 2023-12-19T19:02:06.109 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T19:02:06.109 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-19T19:02:06.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:06.108+0000 7fc4c4217640 1 -- 172.21.15.133:0/840377232 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc4a0066470 msgr2=0x7fc4a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:06.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:06.108+0000 7fc4c4217640 1 --2- 172.21.15.133:0/840377232 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc4a0066470 0x7fc4a0068930 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8000f70 tx=0x7fc4b8007b60 comp rx=0 tx=0).stop 2023-12-19T19:02:06.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:06.108+0000 7fc4c4217640 1 -- 172.21.15.133:0/840377232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4bc151dc0 msgr2=0x7fc4bc1f0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:06.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:06.108+0000 7fc4c4217640 1 --2- 172.21.15.133:0/840377232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4bc151dc0 0x7fc4bc1f0980 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400efc0 tx=0x7fc4b400c490 comp rx=0 tx=0).stop 2023-12-19T19:02:06.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:06.108+0000 7fc4c4217640 1 -- 172.21.15.133:0/840377232 shutdown_connections 2023-12-19T19:02:06.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:06.108+0000 7fc4c4217640 1 --2- 172.21.15.133:0/840377232 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc4a0066470 0x7fc4a0068930 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:06.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:06.108+0000 7fc4c4217640 1 --2- 172.21.15.133:0/840377232 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4bc151dc0 0x7fc4bc1f0980 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:06.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:06.108+0000 7fc4c4217640 1 --2- 172.21.15.133:0/840377232 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc4bc0c7ed0 0x7fc4bc0c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:06.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:06.108+0000 7fc4c4217640 1 --2- 172.21.15.133:0/840377232 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc4bc0bd660 0x7fc4bc1ecae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:06.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:06.108+0000 7fc4c4217640 1 -- 172.21.15.133:0/840377232 >> 172.21.15.133:0/840377232 conn(0x7fc4bc071eb0 msgr2=0x7fc4bc072290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:06.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:06.108+0000 7fc4c4217640 1 -- 172.21.15.133:0/840377232 shutdown_connections 2023-12-19T19:02:06.112 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:06.108+0000 7fc4c4217640 1 -- 172.21.15.133:0/840377232 wait complete. 2023-12-19T19:02:06.130 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T19:02:06.130 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T19:02:06.130 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi133.front.sepia.ceph.com 2023-12-19T19:02:06.130 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-19T19:02:06.130 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T19:02:06.130 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T19:02:06.130 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T19:02:06.131 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.aqPwYKgnQd 2023-12-19T19:02:06.131 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2023-12-19T19:02:06.140 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.O3wH4aaCAU 2023-12-19T19:02:06.140 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /tmp/tmp.aqPwYKgnQd /tmp/tmp.O3wH4aaCAU 2023-12-19T19:02:06.206 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.O3wH4aaCAU 2023-12-19T19:02:06.327 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.O3wH4aaCAU is 226B 2023-12-19T19:02:06.343 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.O3wH4aaCAU 2023-12-19T19:02:06.352 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQCq6IFl/9LRKBAAEdLXh9kRtwlqUFg0RuJGEw== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-19T19:02:06.352 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T19:02:06.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:06.352 DEBUG:teuthology.orchestra.run.smithi133:> ip addr 2023-12-19T19:02:06.403 INFO:teuthology.orchestra.run.smithi133.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T19:02:06.403 INFO:teuthology.orchestra.run.smithi133.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T19:02:06.403 INFO:teuthology.orchestra.run.smithi133.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T19:02:06.404 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:02:06.404 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 ::1/128 scope host 2023-12-19T19:02:06.404 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:02:06.404 INFO:teuthology.orchestra.run.smithi133.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:02:06.404 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b2 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:02:06.404 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f0 2023-12-19T19:02:06.404 INFO:teuthology.orchestra.run.smithi133.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:02:06.404 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:d9:38:b3 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:02:06.404 INFO:teuthology.orchestra.run.smithi133.stdout: altname enp7s0f1 2023-12-19T19:02:06.404 INFO:teuthology.orchestra.run.smithi133.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:02:06.404 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:86 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:02:06.404 INFO:teuthology.orchestra.run.smithi133.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T19:02:06.404 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0c:c4:7a:88:80:87 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:02:06.404 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.21.15.133/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T19:02:06.404 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft 42234sec preferred_lft 42234sec 2023-12-19T19:02:06.405 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::ec4:7aff:fe88:8087/64 scope link 2023-12-19T19:02:06.405 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:02:06.405 INFO:teuthology.orchestra.run.smithi133.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T19:02:06.405 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 02:42:26:2c:b4:18 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:02:06.405 INFO:teuthology.orchestra.run.smithi133.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T19:02:06.405 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:02:06.405 INFO:teuthology.orchestra.run.smithi133.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T19:02:06.405 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T19:02:06.405 INFO:teuthology.orchestra.run.smithi133.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T19:02:06.405 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:02:06.405 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-19T19:02:06.405 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:02:06.405 INFO:teuthology.orchestra.run.smithi133.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T19:02:06.406 INFO:teuthology.orchestra.run.smithi133.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T19:02:06.406 INFO:teuthology.orchestra.run.smithi133.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-19T19:02:06.406 INFO:teuthology.orchestra.run.smithi133.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:02:06.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:06.407 DEBUG:teuthology.orchestra.run.smithi133:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T19:02:06.469 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-12-19T19:02:06.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:06.472 DEBUG:teuthology.orchestra.run.smithi133:> route 2023-12-19T19:02:06.526 INFO:teuthology.orchestra.run.smithi133.stdout:Kernel IP routing table 2023-12-19T19:02:06.526 INFO:teuthology.orchestra.run.smithi133.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T19:02:06.526 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T19:02:06.526 INFO:teuthology.orchestra.run.smithi133.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T19:02:06.526 INFO:teuthology.orchestra.run.smithi133.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T19:02:06.526 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T19:02:06.526 INFO:teuthology.orchestra.run.smithi133.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:02:06.526 INFO:teuthology.orchestra.run.smithi133.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:02:06.526 INFO:teuthology.orchestra.run.smithi133.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:02:06.526 INFO:teuthology.orchestra.run.smithi133.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T19:02:06.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:06.527 DEBUG:teuthology.orchestra.run.smithi133:> (cd / && exec bash -c ' 2023-12-19T19:02:06.527 DEBUG:teuthology.orchestra.run.smithi133:> set -e 2023-12-19T19:02:06.527 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T19:02:06.527 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T19:02:06.527 DEBUG:teuthology.orchestra.run.smithi133:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T19:02:06.527 DEBUG:teuthology.orchestra.run.smithi133:> ') 2023-12-19T19:02:06.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:06.617 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-19T19:02:06.627 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T19:02:06.627 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T19:02:06.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:06.627 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link set brx.0 up 2023-12-19T19:02:06.691 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T19:02:06.691 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T19:02:06.743 INFO:teuthology.orchestra.run.smithi133.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T19:02:06.744 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T19:02:06.744 DEBUG:teuthology.orchestra.run.smithi133:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T19:02:06.799 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T19:02:06.799 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/tmp/tmp.aqPwYKgnQd of=/dev/stdout 2023-12-19T19:02:06.851 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs=/ 2023-12-19T19:02:06.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:06.851 DEBUG:teuthology.orchestra.run.smithi133:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQCq6IFl/9LRKBAAEdLXh9kRtwlqUFg0RuJGEw==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:02:06.945 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,secret=AQCq6IFl/9LRKBAAEdLXh9kRtwlqUFg0RuJGEw==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:02:06.946 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T19:02:06.946 INFO:teuthology.orchestra.run.smithi133.stdout:keyring.get_secret failed 2023-12-19T19:02:06.958 INFO:teuthology.orchestra.run.smithi133.stdout:parsing options: rw,norequire_active_mds,secret=AQCq6IFl/9LRKBAAEdLXh9kRtwlqUFg0RuJGEw==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:02:06.958 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T19:02:06.958 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-12-19T19:02:06.958 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: trying mount with new device syntax: testuser@03e63958-005e-4bf2-ae5b-291aceb6fbbf.cephfs=/ 2023-12-19T19:02:06.958 INFO:teuthology.orchestra.run.smithi133.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.133:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-12-19T19:02:06.962 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T19:02:06.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:06.962 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T19:02:06.980 INFO:teuthology.orchestra.run.smithi133.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.0': Permission denied 2023-12-19T19:02:06.982 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T19:02:06.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:06.982 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T19:02:07.038 INFO:teuthology.orchestra.run.smithi133.stdout:client6924 2023-12-19T19:02:07.038 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T19:02:07.038 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:02:07.088 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2023-12-19T19:02:07.098 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.BSzfoMsRQh 2023-12-19T19:02:07.098 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:02:07.098 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/tmp/tmp.BSzfoMsRQh 2023-12-19T19:02:07.152 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:02:07.186 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:02:07.203 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:02:07.203 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:02:07.255 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:02:07.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.388+0000 7fafb77c1640 1 Processor -- start 2023-12-19T19:02:07.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.388+0000 7fafb77c1640 1 -- start start 2023-12-19T19:02:07.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.388+0000 7fafb77c1640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fafb00c5260 0x7fafb006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:07.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.388+0000 7fafb77c1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb00c2580 con 0x7fafb00c5640 2023-12-19T19:02:07.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.388+0000 7fafb77c1640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb0156940 con 0x7fafb0155de0 2023-12-19T19:02:07.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.388+0000 7fafb77c1640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb0153510 con 0x7fafb00c5260 2023-12-19T19:02:07.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.388+0000 7fafb4d5c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fafb00c5640 0x7fafb00c5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41660/0 (socket says 172.21.15.133:41660) 2023-12-19T19:02:07.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.388+0000 7fafb4d5c640 1 -- 172.21.15.133:0/1385283027 learned_addr learned my addr 172.21.15.133:0/1385283027 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:07.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.388+0000 7fafb555d640 1 --2- 172.21.15.133:0/1385283027 >> v2:172.21.15.138:3300/0 conn(0x7fafb00c5260 0x7fafb006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:07.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.388+0000 7fafa7fff640 1 -- 172.21.15.133:0/1385283027 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188457466 0 0) 0x7fafb00c2580 con 0x7fafb00c5640 2023-12-19T19:02:07.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.388+0000 7fafa7fff640 1 -- 172.21.15.133:0/1385283027 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf9c003530 con 0x7fafb00c5640 2023-12-19T19:02:07.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.392+0000 7fafb555d640 1 -- 172.21.15.133:0/1385283027 >> v1:172.21.15.138:6789/0 conn(0x7fafb0155de0 legacy=0x7fafb0156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:07.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.392+0000 7fafb555d640 1 -- 172.21.15.133:0/1385283027 >> v1:172.21.15.133:6789/0 conn(0x7fafb00c5640 legacy=0x7fafb00c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:07.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.392+0000 7fafb555d640 1 -- 172.21.15.133:0/1385283027 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb00c1a00 con 0x7fafb00c5260 2023-12-19T19:02:07.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.392+0000 7fafb555d640 1 --2- 172.21.15.133:0/1385283027 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fafb00c5260 0x7fafb006d5b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fafac0097c0 tx=0x7fafac01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=126148c2185aa295 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:07.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.392+0000 7fafa7fff640 1 -- 172.21.15.133:0/1385283027 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac0ab600 con 0x7fafb00c5260 2023-12-19T19:02:07.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.392+0000 7fafa7fff640 1 -- 172.21.15.133:0/1385283027 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac0a7050 con 0x7fafb00c5260 2023-12-19T19:02:07.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.392+0000 7fafa7fff640 1 -- 172.21.15.133:0/1385283027 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac0ab960 con 0x7fafb00c5260 2023-12-19T19:02:07.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.392+0000 7fafb77c1640 1 -- 172.21.15.133:0/1385283027 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fafb00c5260 msgr2=0x7fafb006d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:07.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.392+0000 7fafb77c1640 1 --2- 172.21.15.133:0/1385283027 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fafb00c5260 0x7fafb006d5b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fafac0097c0 tx=0x7fafac01c3f0 comp rx=0 tx=0).stop 2023-12-19T19:02:07.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.392+0000 7fafb77c1640 1 -- 172.21.15.133:0/1385283027 shutdown_connections 2023-12-19T19:02:07.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.392+0000 7fafb77c1640 1 --2- 172.21.15.133:0/1385283027 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fafb00c5260 0x7fafb006d5b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:07.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.392+0000 7fafb77c1640 1 -- 172.21.15.133:0/1385283027 >> 172.21.15.133:0/1385283027 conn(0x7fafb006a5b0 msgr2=0x7fafb006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:07.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafb77c1640 1 -- 172.21.15.133:0/1385283027 shutdown_connections 2023-12-19T19:02:07.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafb77c1640 1 -- 172.21.15.133:0/1385283027 wait complete. 2023-12-19T19:02:07.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafb77c1640 1 Processor -- start 2023-12-19T19:02:07.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafb77c1640 1 -- start start 2023-12-19T19:02:07.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafb77c1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fafb00c5260 0x7fafb0154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:07.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafb77c1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fafb00c5640 0x7fafb00a73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:07.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafb77c1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafb0155de0 0x7fafb014add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:07.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafb77c1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00a9ad0 con 0x7fafb0155de0 2023-12-19T19:02:07.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafb77c1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00a8ec0 con 0x7fafb00c5260 2023-12-19T19:02:07.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafb77c1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb00a91a0 con 0x7fafb00c5640 2023-12-19T19:02:07.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafb5d5e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafb0155de0 0x7fafb014add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:07.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafb5d5e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafb0155de0 0x7fafb014add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49658/0 (socket says 172.21.15.133:49658) 2023-12-19T19:02:07.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafb5d5e640 1 -- 172.21.15.133:0/1868345363 learned_addr learned my addr 172.21.15.133:0/1868345363 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:07.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafb555d640 1 --2- 172.21.15.133:0/1868345363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fafb00c5260 0x7fafb0154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:07.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafb4d5c640 1 --2- 172.21.15.133:0/1868345363 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fafb00c5640 0x7fafb00a73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:07.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafb5d5e640 1 -- 172.21.15.133:0/1868345363 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fafb00c5640 msgr2=0x7fafb00a73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:07.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafb5d5e640 1 --2- 172.21.15.133:0/1868345363 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fafb00c5640 0x7fafb00a73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:07.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafb5d5e640 1 -- 172.21.15.133:0/1868345363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fafb00c5260 msgr2=0x7fafb0154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:07.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafb5d5e640 1 --2- 172.21.15.133:0/1868345363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fafb00c5260 0x7fafb0154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:07.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafb5d5e640 1 -- 172.21.15.133:0/1868345363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac009420 con 0x7fafb0155de0 2023-12-19T19:02:07.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafb4d5c640 1 --2- 172.21.15.133:0/1868345363 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fafb00c5640 0x7fafb00a73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:07.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafb5d5e640 1 --2- 172.21.15.133:0/1868345363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafb0155de0 0x7fafb014add0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fafa800c770 tx=0x7fafa800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:07.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafa5ffb640 1 -- 172.21.15.133:0/1868345363 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa8003b80 con 0x7fafb0155de0 2023-12-19T19:02:07.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafa5ffb640 1 -- 172.21.15.133:0/1868345363 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa8003ce0 con 0x7fafb0155de0 2023-12-19T19:02:07.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafa5ffb640 1 -- 172.21.15.133:0/1868345363 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa800aa90 con 0x7fafb0155de0 2023-12-19T19:02:07.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.396+0000 7fafb77c1640 1 -- 172.21.15.133:0/1868345363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb00a9480 con 0x7fafb0155de0 2023-12-19T19:02:07.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.400+0000 7fafb77c1640 1 -- 172.21.15.133:0/1868345363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb0154990 con 0x7fafb0155de0 2023-12-19T19:02:07.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.400+0000 7fafb77c1640 1 -- 172.21.15.133:0/1868345363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb0068400 con 0x7fafb0155de0 2023-12-19T19:02:07.405 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.400+0000 7fafa5ffb640 1 -- 172.21.15.133:0/1868345363 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fafa800abf0 con 0x7fafb0155de0 2023-12-19T19:02:07.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.400+0000 7fafa5ffb640 1 --2- 172.21.15.133:0/1868345363 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf940664a0 0x7faf94068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:07.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.400+0000 7fafa5ffb640 1 -- 172.21.15.133:0/1868345363 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fafa8083fd0 con 0x7fafb0155de0 2023-12-19T19:02:07.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.400+0000 7fafb555d640 1 --2- 172.21.15.133:0/1868345363 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf940664a0 0x7faf94068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:07.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.404+0000 7fafb555d640 1 --2- 172.21.15.133:0/1868345363 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf940664a0 0x7faf94068960 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fafac0ad000 tx=0x7fafac0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:07.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.404+0000 7fafa5ffb640 1 -- 172.21.15.133:0/1868345363 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fafa8051050 con 0x7fafb0155de0 2023-12-19T19:02:07.560 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.556+0000 7fafb77c1640 1 -- 172.21.15.133:0/1868345363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafb00a9c10 con 0x7fafb0155de0 2023-12-19T19:02:07.562 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.556+0000 7fafa5ffb640 1 -- 172.21.15.133:0/1868345363 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+20250 (secure 0 0 0) 0x7fafb00a9c10 con 0x7fafb0155de0 2023-12-19T19:02:07.562 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:07.562 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":73,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:01:54.705538+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:01:33.082188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T19:01:34.349092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:01:50.875086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:01:52.061232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:02:07.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.560+0000 7fafb77c1640 1 -- 172.21.15.133:0/1868345363 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf940664a0 msgr2=0x7faf94068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:07.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.560+0000 7fafb77c1640 1 --2- 172.21.15.133:0/1868345363 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf940664a0 0x7faf94068960 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fafac0ad000 tx=0x7fafac0a6000 comp rx=0 tx=0).stop 2023-12-19T19:02:07.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.560+0000 7fafb77c1640 1 -- 172.21.15.133:0/1868345363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafb0155de0 msgr2=0x7fafb014add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:07.564 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.560+0000 7fafb77c1640 1 --2- 172.21.15.133:0/1868345363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafb0155de0 0x7fafb014add0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fafa800c770 tx=0x7fafa800cc30 comp rx=0 tx=0).stop 2023-12-19T19:02:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.560+0000 7fafb77c1640 1 -- 172.21.15.133:0/1868345363 shutdown_connections 2023-12-19T19:02:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.560+0000 7fafb77c1640 1 --2- 172.21.15.133:0/1868345363 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7faf940664a0 0x7faf94068960 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.560+0000 7fafb77c1640 1 --2- 172.21.15.133:0/1868345363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fafb0155de0 0x7fafb014add0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.560+0000 7fafb77c1640 1 --2- 172.21.15.133:0/1868345363 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fafb00c5640 0x7fafb00a73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.560+0000 7fafb77c1640 1 --2- 172.21.15.133:0/1868345363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fafb00c5260 0x7fafb0154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.560+0000 7fafb77c1640 1 -- 172.21.15.133:0/1868345363 >> 172.21.15.133:0/1868345363 conn(0x7fafb006a5b0 msgr2=0x7fafb0153870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.560+0000 7fafb77c1640 1 -- 172.21.15.133:0/1868345363 shutdown_connections 2023-12-19T19:02:07.565 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.560+0000 7fafb77c1640 1 -- 172.21.15.133:0/1868345363 wait complete. 2023-12-19T19:02:07.583 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T19:01:33.082188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T19:01:34.349092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-19T19:01:50.875086+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-19T19:01:52.061232+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T19:02:07.584 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T19:02:07.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.724+0000 7f1976c68640 1 Processor -- start 2023-12-19T19:02:07.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.724+0000 7f1976c68640 1 -- start start 2023-12-19T19:02:07.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.724+0000 7f1976c68640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1970151dc0 0x7f19700c4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:07.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.724+0000 7f1976c68640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19700bd660 0x7f1970154d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:07.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.724+0000 7f1976c68640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19700ac4f0 con 0x7f19700c7ed0 2023-12-19T19:02:07.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.724+0000 7f1976c68640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1970158780 con 0x7f1970151dc0 2023-12-19T19:02:07.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.724+0000 7f1976c68640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1970158a60 con 0x7f19700bd660 2023-12-19T19:02:07.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.724+0000 7f1967fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f19700c7ed0 0x7f1970154650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41672/0 (socket says 172.21.15.133:41672) 2023-12-19T19:02:07.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.724+0000 7f1967fff640 1 -- 172.21.15.133:0/3314915399 learned_addr learned my addr 172.21.15.133:0/3314915399 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:07.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.724+0000 7f1974a04640 1 --2- 172.21.15.133:0/3314915399 >> v2:172.21.15.133:3300/0 conn(0x7f1970151dc0 0x7f19700c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:07.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.724+0000 7f1975205640 1 --2- 172.21.15.133:0/3314915399 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19700bd660 0x7f1970154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:07.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.724+0000 7f19677fe640 1 -- 172.21.15.133:0/3314915399 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445525168 0 0) 0x7f19700ac4f0 con 0x7f19700c7ed0 2023-12-19T19:02:07.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.724+0000 7f19677fe640 1 -- 172.21.15.133:0/3314915399 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1958003530 con 0x7f19700c7ed0 2023-12-19T19:02:07.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.724+0000 7f1974a04640 1 -- 172.21.15.133:0/3314915399 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19700bd660 msgr2=0x7f1970154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:07.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.724+0000 7f1974a04640 1 --2- 172.21.15.133:0/3314915399 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19700bd660 0x7f1970154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:07.731 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.724+0000 7f1974a04640 1 -- 172.21.15.133:0/3314915399 >> v1:172.21.15.133:6789/0 conn(0x7f19700c7ed0 legacy=0x7f1970154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:07.732 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.724+0000 7f1974a04640 1 -- 172.21.15.133:0/3314915399 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19700ac180 con 0x7f1970151dc0 2023-12-19T19:02:07.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.728+0000 7f1974a04640 1 --2- 172.21.15.133:0/3314915399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1970151dc0 0x7f19700c4950 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f196c0097f0 tx=0x7f196c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cda16da00bc5f3aa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:07.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.728+0000 7f19677fe640 1 -- 172.21.15.133:0/3314915399 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c0ab600 con 0x7f1970151dc0 2023-12-19T19:02:07.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.728+0000 7f19677fe640 1 -- 172.21.15.133:0/3314915399 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196c0a7050 con 0x7f1970151dc0 2023-12-19T19:02:07.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.728+0000 7f19677fe640 1 -- 172.21.15.133:0/3314915399 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c0ab980 con 0x7f1970151dc0 2023-12-19T19:02:07.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.728+0000 7f1976c68640 1 -- 172.21.15.133:0/3314915399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1970151dc0 msgr2=0x7f19700c4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:07.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.728+0000 7f1976c68640 1 --2- 172.21.15.133:0/3314915399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1970151dc0 0x7f19700c4950 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f196c0097f0 tx=0x7f196c01c360 comp rx=0 tx=0).stop 2023-12-19T19:02:07.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.728+0000 7f1976c68640 1 -- 172.21.15.133:0/3314915399 shutdown_connections 2023-12-19T19:02:07.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.728+0000 7f1976c68640 1 --2- 172.21.15.133:0/3314915399 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19700bd660 0x7f1970154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:07.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.728+0000 7f1976c68640 1 --2- 172.21.15.133:0/3314915399 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1970151dc0 0x7f19700c4950 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:07.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.728+0000 7f1976c68640 1 -- 172.21.15.133:0/3314915399 >> 172.21.15.133:0/3314915399 conn(0x7f1970071eb0 msgr2=0x7f19700722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:07.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.728+0000 7f1976c68640 1 -- 172.21.15.133:0/3314915399 shutdown_connections 2023-12-19T19:02:07.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.728+0000 7f1976c68640 1 -- 172.21.15.133:0/3314915399 wait complete. 2023-12-19T19:02:07.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.732+0000 7f1976c68640 1 Processor -- start 2023-12-19T19:02:07.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.732+0000 7f1976c68640 1 -- start start 2023-12-19T19:02:07.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.732+0000 7f1976c68640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19700bd660 0x7f19700c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:07.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.732+0000 7f1976c68640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19700c7ed0 0x7f19700bf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:07.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.732+0000 7f1976c68640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1970151dc0 0x7f197014b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:07.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.732+0000 7f1976c68640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19700c2b90 con 0x7f19700bd660 2023-12-19T19:02:07.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.732+0000 7f1976c68640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19700c0970 con 0x7f1970151dc0 2023-12-19T19:02:07.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.732+0000 7f1976c68640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19700c0340 con 0x7f19700c7ed0 2023-12-19T19:02:07.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.732+0000 7f1974a04640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19700bd660 0x7f19700c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:07.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.732+0000 7f1974a04640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19700bd660 0x7f19700c3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49684/0 (socket says 172.21.15.133:49684) 2023-12-19T19:02:07.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.732+0000 7f1974a04640 1 -- 172.21.15.133:0/2192552839 learned_addr learned my addr 172.21.15.133:0/2192552839 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:07.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.732+0000 7f1974a04640 1 -- 172.21.15.133:0/2192552839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19700c7ed0 msgr2=0x7f19700bf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:07.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.732+0000 7f1974a04640 1 --2- 172.21.15.133:0/2192552839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19700c7ed0 0x7f19700bf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:07.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.732+0000 7f1974a04640 1 -- 172.21.15.133:0/2192552839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1970151dc0 msgr2=0x7f197014b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:07.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.732+0000 7f1974a04640 1 --2- 172.21.15.133:0/2192552839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1970151dc0 0x7f197014b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:07.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.732+0000 7f1974a04640 1 -- 172.21.15.133:0/2192552839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c009420 con 0x7f19700bd660 2023-12-19T19:02:07.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.732+0000 7f1974a04640 1 --2- 172.21.15.133:0/2192552839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19700bd660 0x7f19700c3c70 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f196c0ae040 tx=0x7f196c01aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:07.739 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.732+0000 7f19657fa640 1 -- 172.21.15.133:0/2192552839 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c0b7450 con 0x7f19700bd660 2023-12-19T19:02:07.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.732+0000 7f19657fa640 1 -- 172.21.15.133:0/2192552839 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196c0b75d0 con 0x7f19700bd660 2023-12-19T19:02:07.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.732+0000 7f19657fa640 1 -- 172.21.15.133:0/2192552839 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c0b7980 con 0x7f19700bd660 2023-12-19T19:02:07.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.732+0000 7f1976c68640 1 -- 172.21.15.133:0/2192552839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19701ed7e0 con 0x7f19700bd660 2023-12-19T19:02:07.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.732+0000 7f1976c68640 1 -- 172.21.15.133:0/2192552839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19700c0600 con 0x7f19700bd660 2023-12-19T19:02:07.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.736+0000 7f1976c68640 1 -- 172.21.15.133:0/2192552839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1970068400 con 0x7f19700bd660 2023-12-19T19:02:07.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.736+0000 7f19657fa640 1 -- 172.21.15.133:0/2192552839 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f196c0b7ae0 con 0x7f19700bd660 2023-12-19T19:02:07.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.736+0000 7f19657fa640 1 --2- 172.21.15.133:0/2192552839 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f195c066470 0x7f195c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:07.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.736+0000 7f19657fa640 1 -- 172.21.15.133:0/2192552839 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f196c11e880 con 0x7f19700bd660 2023-12-19T19:02:07.741 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.736+0000 7f1967fff640 1 --2- 172.21.15.133:0/2192552839 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f195c066470 0x7f195c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:07.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.736+0000 7f1967fff640 1 --2- 172.21.15.133:0/2192552839 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f195c066470 0x7f195c068930 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1960007fd0 tx=0x7f1960007940 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:07.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.740+0000 7f19657fa640 1 -- 172.21.15.133:0/2192552839 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f196c0eb990 con 0x7f19700bd660 2023-12-19T19:02:07.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.888+0000 7f1976c68640 1 -- 172.21.15.133:0/2192552839 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f197006c9a0 con 0x7f19700bd660 2023-12-19T19:02:07.898 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.892+0000 7f19657fa640 1 -- 172.21.15.133:0/2192552839 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) v1 ==== 93+0+10 (secure 0 0 0) 0x7f196c0eefb0 con 0x7f19700bd660 2023-12-19T19:02:07.898 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T19:02:07.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.892+0000 7f1976c68640 1 -- 172.21.15.133:0/2192552839 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f195c066470 msgr2=0x7f195c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:07.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.892+0000 7f1976c68640 1 --2- 172.21.15.133:0/2192552839 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f195c066470 0x7f195c068930 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1960007fd0 tx=0x7f1960007940 comp rx=0 tx=0).stop 2023-12-19T19:02:07.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.892+0000 7f1976c68640 1 -- 172.21.15.133:0/2192552839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19700bd660 msgr2=0x7f19700c3c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:07.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.892+0000 7f1976c68640 1 --2- 172.21.15.133:0/2192552839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19700bd660 0x7f19700c3c70 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f196c0ae040 tx=0x7f196c01aba0 comp rx=0 tx=0).stop 2023-12-19T19:02:07.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.892+0000 7f1976c68640 1 -- 172.21.15.133:0/2192552839 shutdown_connections 2023-12-19T19:02:07.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.892+0000 7f1976c68640 1 --2- 172.21.15.133:0/2192552839 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f195c066470 0x7f195c068930 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:07.899 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.892+0000 7f1976c68640 1 --2- 172.21.15.133:0/2192552839 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1970151dc0 0x7f197014b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:07.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.892+0000 7f1976c68640 1 --2- 172.21.15.133:0/2192552839 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19700c7ed0 0x7f19700bf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:07.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.892+0000 7f1976c68640 1 --2- 172.21.15.133:0/2192552839 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19700bd660 0x7f19700c3c70 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:07.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.892+0000 7f1976c68640 1 -- 172.21.15.133:0/2192552839 >> 172.21.15.133:0/2192552839 conn(0x7f1970071eb0 msgr2=0x7f197015e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:07.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.892+0000 7f1976c68640 1 -- 172.21.15.133:0/2192552839 shutdown_connections 2023-12-19T19:02:07.900 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:07.892+0000 7f1976c68640 1 -- 172.21.15.133:0/2192552839 wait complete. 2023-12-19T19:02:07.917 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T19:02:08.061 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.056+0000 7fa2d2a09640 1 Processor -- start 2023-12-19T19:02:08.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.056+0000 7fa2d2a09640 1 -- start start 2023-12-19T19:02:08.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.056+0000 7fa2d2a09640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa2cc072090 0x7fa2cc150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:08.063 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.056+0000 7fa2d2a09640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa2cc0725c0 0x7fa2cc1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:08.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.056+0000 7fa2d2a09640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2cc0c2760 con 0x7fa2cc0a5370 2023-12-19T19:02:08.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.056+0000 7fa2d2a09640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2cc0c3070 con 0x7fa2cc0725c0 2023-12-19T19:02:08.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.056+0000 7fa2d2a09640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2cc0a5750 con 0x7fa2cc072090 2023-12-19T19:02:08.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.060+0000 7fa2d0fa6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa2cc0725c0 0x7fa2cc1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:08.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.060+0000 7fa2d0fa6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa2cc0725c0 0x7fa2cc1514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49694/0 (socket says 172.21.15.133:49694) 2023-12-19T19:02:08.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.060+0000 7fa2d0fa6640 1 -- 172.21.15.133:0/2623207391 learned_addr learned my addr 172.21.15.133:0/2623207391 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:08.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.060+0000 7fa2cbfff640 1 --1- 172.21.15.133:0/2623207391 >> v1:172.21.15.133:6789/0 conn(0x7fa2cc0a5370 0x7fa2cc0c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41688/0 (socket says 172.21.15.133:41688) 2023-12-19T19:02:08.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.060+0000 7fa2cb7fe640 1 --2- 172.21.15.133:0/2623207391 >> v2:172.21.15.138:3300/0 conn(0x7fa2cc072090 0x7fa2cc150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:08.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.060+0000 7fa2d0fa6640 1 -- 172.21.15.133:0/2623207391 >> v2:172.21.15.138:3300/0 conn(0x7fa2cc072090 msgr2=0x7fa2cc150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:08.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.060+0000 7fa2d0fa6640 1 --2- 172.21.15.133:0/2623207391 >> v2:172.21.15.138:3300/0 conn(0x7fa2cc072090 0x7fa2cc150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.060+0000 7fa2d0fa6640 1 -- 172.21.15.133:0/2623207391 >> v1:172.21.15.133:6789/0 conn(0x7fa2cc0a5370 legacy=0x7fa2cc0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:08.064 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.060+0000 7fa2d0fa6640 1 -- 172.21.15.133:0/2623207391 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2cc0aad20 con 0x7fa2cc0725c0 2023-12-19T19:02:08.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.060+0000 7fa2d0fa6640 1 --2- 172.21.15.133:0/2623207391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2cc0725c0 0x7fa2cc1514e0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc06b360 tx=0x7fa2c401ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6095d94a9d0087 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:08.066 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.060+0000 7fa2caffd640 1 -- 172.21.15.133:0/2623207391 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c40a7900 con 0x7fa2cc0725c0 2023-12-19T19:02:08.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.060+0000 7fa2caffd640 1 -- 172.21.15.133:0/2623207391 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c40a7a60 con 0x7fa2cc0725c0 2023-12-19T19:02:08.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.060+0000 7fa2caffd640 1 -- 172.21.15.133:0/2623207391 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c40a7df0 con 0x7fa2cc0725c0 2023-12-19T19:02:08.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2d2a09640 1 -- 172.21.15.133:0/2623207391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2cc0725c0 msgr2=0x7fa2cc1514e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:08.067 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2d2a09640 1 --2- 172.21.15.133:0/2623207391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2cc0725c0 0x7fa2cc1514e0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc06b360 tx=0x7fa2c401ea90 comp rx=0 tx=0).stop 2023-12-19T19:02:08.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2d2a09640 1 -- 172.21.15.133:0/2623207391 shutdown_connections 2023-12-19T19:02:08.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2d2a09640 1 --2- 172.21.15.133:0/2623207391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2cc0725c0 0x7fa2cc1514e0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2d2a09640 1 --2- 172.21.15.133:0/2623207391 >> v2:172.21.15.138:3300/0 conn(0x7fa2cc072090 0x7fa2cc150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2d2a09640 1 -- 172.21.15.133:0/2623207391 >> 172.21.15.133:0/2623207391 conn(0x7fa2cc06a5b0 msgr2=0x7fa2cc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:08.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2d2a09640 1 -- 172.21.15.133:0/2623207391 shutdown_connections 2023-12-19T19:02:08.068 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2d2a09640 1 -- 172.21.15.133:0/2623207391 wait complete. 2023-12-19T19:02:08.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2d2a09640 1 Processor -- start 2023-12-19T19:02:08.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2d2a09640 1 -- start start 2023-12-19T19:02:08.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2d2a09640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa2cc072090 0x7fa2cc149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:08.071 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2d2a09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2cc0725c0 0x7fa2cc0a6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:08.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2d2a09640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2cc0a5370 0x7fa2cc14bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:08.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2d2a09640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc14b1f0 con 0x7fa2cc0725c0 2023-12-19T19:02:08.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2d2a09640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc1f4e40 con 0x7fa2cc0a5370 2023-12-19T19:02:08.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2d2a09640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2cc1f5120 con 0x7fa2cc072090 2023-12-19T19:02:08.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2cb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2cc0725c0 0x7fa2cc0a6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:08.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2cb7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2cc0725c0 0x7fa2cc0a6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49696/0 (socket says 172.21.15.133:49696) 2023-12-19T19:02:08.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2cb7fe640 1 -- 172.21.15.133:0/1179589063 learned_addr learned my addr 172.21.15.133:0/1179589063 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:08.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2cbfff640 1 --2- 172.21.15.133:0/1179589063 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa2cc072090 0x7fa2cc149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:08.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2d0fa6640 1 --2- 172.21.15.133:0/1179589063 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2cc0a5370 0x7fa2cc14bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:08.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2cb7fe640 1 -- 172.21.15.133:0/1179589063 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa2cc072090 msgr2=0x7fa2cc149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:08.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2cb7fe640 1 --2- 172.21.15.133:0/1179589063 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa2cc072090 0x7fa2cc149710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2cb7fe640 1 -- 172.21.15.133:0/1179589063 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2cc0a5370 msgr2=0x7fa2cc14bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:08.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2cb7fe640 1 --2- 172.21.15.133:0/1179589063 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2cc0a5370 0x7fa2cc14bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2cb7fe640 1 -- 172.21.15.133:0/1179589063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c4009b30 con 0x7fa2cc0725c0 2023-12-19T19:02:08.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.064+0000 7fa2cbfff640 1 --2- 172.21.15.133:0/1179589063 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa2cc072090 0x7fa2cc149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:08.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.068+0000 7fa2cb7fe640 1 --2- 172.21.15.133:0/1179589063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2cc0725c0 0x7fa2cc0a6c70 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000e870 tx=0x7fa2c000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:08.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.068+0000 7fa2c8ff9640 1 -- 172.21.15.133:0/1179589063 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0009510 con 0x7fa2cc0725c0 2023-12-19T19:02:08.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.068+0000 7fa2c8ff9640 1 -- 172.21.15.133:0/1179589063 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c000eec0 con 0x7fa2cc0725c0 2023-12-19T19:02:08.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.068+0000 7fa2c8ff9640 1 -- 172.21.15.133:0/1179589063 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c000cb40 con 0x7fa2cc0725c0 2023-12-19T19:02:08.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.068+0000 7fa2d2a09640 1 -- 172.21.15.133:0/1179589063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2cc14b3e0 con 0x7fa2cc0725c0 2023-12-19T19:02:08.073 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.068+0000 7fa2d2a09640 1 -- 172.21.15.133:0/1179589063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2cc0a71b0 con 0x7fa2cc0725c0 2023-12-19T19:02:08.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.068+0000 7fa2d2a09640 1 -- 172.21.15.133:0/1179589063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2cc068400 con 0x7fa2cc0725c0 2023-12-19T19:02:08.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.068+0000 7fa2c8ff9640 1 -- 172.21.15.133:0/1179589063 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa2c000cca0 con 0x7fa2cc0725c0 2023-12-19T19:02:08.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.068+0000 7fa2c8ff9640 1 --2- 172.21.15.133:0/1179589063 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa2b8066470 0x7fa2b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:08.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.068+0000 7fa2c8ff9640 1 -- 172.21.15.133:0/1179589063 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa2c0084210 con 0x7fa2cc0725c0 2023-12-19T19:02:08.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.068+0000 7fa2cbfff640 1 --2- 172.21.15.133:0/1179589063 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa2b8066470 0x7fa2b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:08.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.072+0000 7fa2cbfff640 1 --2- 172.21.15.133:0/1179589063 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa2b8066470 0x7fa2b8068930 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc000f70 tx=0x7fa2bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:08.078 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.072+0000 7fa2c8ff9640 1 -- 172.21.15.133:0/1179589063 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa2c00513d0 con 0x7fa2cc0725c0 2023-12-19T19:02:08.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.220+0000 7fa2d2a09640 1 -- 172.21.15.133:0/1179589063 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa2cc071e70 con 0x7fa2cc0725c0 2023-12-19T19:02:08.226 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.220+0000 7fa2c8ff9640 1 -- 172.21.15.133:0/1179589063 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa2c00549f0 con 0x7fa2cc0725c0 2023-12-19T19:02:08.227 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:02:08.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.224+0000 7fa2d2a09640 1 -- 172.21.15.133:0/1179589063 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa2b8066470 msgr2=0x7fa2b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:08.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.224+0000 7fa2d2a09640 1 --2- 172.21.15.133:0/1179589063 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa2b8066470 0x7fa2b8068930 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc000f70 tx=0x7fa2bc009040 comp rx=0 tx=0).stop 2023-12-19T19:02:08.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.224+0000 7fa2d2a09640 1 -- 172.21.15.133:0/1179589063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2cc0725c0 msgr2=0x7fa2cc0a6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:08.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.224+0000 7fa2d2a09640 1 --2- 172.21.15.133:0/1179589063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2cc0725c0 0x7fa2cc0a6c70 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000e870 tx=0x7fa2c000ec70 comp rx=0 tx=0).stop 2023-12-19T19:02:08.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.224+0000 7fa2d2a09640 1 -- 172.21.15.133:0/1179589063 shutdown_connections 2023-12-19T19:02:08.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.224+0000 7fa2d2a09640 1 --2- 172.21.15.133:0/1179589063 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa2b8066470 0x7fa2b8068930 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.224+0000 7fa2d2a09640 1 --2- 172.21.15.133:0/1179589063 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa2cc0a5370 0x7fa2cc14bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.224+0000 7fa2d2a09640 1 --2- 172.21.15.133:0/1179589063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2cc0725c0 0x7fa2cc0a6c70 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.224+0000 7fa2d2a09640 1 --2- 172.21.15.133:0/1179589063 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa2cc072090 0x7fa2cc149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.224+0000 7fa2d2a09640 1 -- 172.21.15.133:0/1179589063 >> 172.21.15.133:0/1179589063 conn(0x7fa2cc06a5b0 msgr2=0x7fa2cc0c0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:08.229 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.224+0000 7fa2d2a09640 1 -- 172.21.15.133:0/1179589063 shutdown_connections 2023-12-19T19:02:08.230 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.224+0000 7fa2d2a09640 1 -- 172.21.15.133:0/1179589063 wait complete. 2023-12-19T19:02:08.247 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T19:02:08.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.384+0000 7f4de0cd6640 1 Processor -- start 2023-12-19T19:02:08.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.384+0000 7f4de0cd6640 1 -- start start 2023-12-19T19:02:08.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.384+0000 7f4de0cd6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4ddc0a5370 0x7f4ddc0c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:08.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.384+0000 7f4de0cd6640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f4ddc072090 0x7f4ddc1516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:08.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.384+0000 7f4de0cd6640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ddc0c2760 con 0x7f4ddc0c4110 2023-12-19T19:02:08.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.384+0000 7f4de0cd6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ddc0c3070 con 0x7f4ddc0a5370 2023-12-19T19:02:08.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.384+0000 7f4de0cd6640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ddc151bf0 con 0x7f4ddc072090 2023-12-19T19:02:08.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.384+0000 7f4dda59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4ddc0a5370 0x7f4ddc0c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:08.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.384+0000 7f4dda59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4ddc0a5370 0x7f4ddc0c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49704/0 (socket says 172.21.15.133:49704) 2023-12-19T19:02:08.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.384+0000 7f4dda59c640 1 -- 172.21.15.133:0/248915835 learned_addr learned my addr 172.21.15.133:0/248915835 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:08.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.384+0000 7f4ddad9d640 1 --2- 172.21.15.133:0/248915835 >> v2:172.21.15.138:3300/0 conn(0x7f4ddc072090 0x7f4ddc1516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:08.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.384+0000 7f4dda59c640 1 -- 172.21.15.133:0/248915835 >> v2:172.21.15.138:3300/0 conn(0x7f4ddc072090 msgr2=0x7f4ddc1516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:08.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.384+0000 7f4dda59c640 1 --2- 172.21.15.133:0/248915835 >> v2:172.21.15.138:3300/0 conn(0x7f4ddc072090 0x7f4ddc1516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.384+0000 7f4dda59c640 1 -- 172.21.15.133:0/248915835 >> v1:172.21.15.138:6789/0 conn(0x7f4ddc0c4110 legacy=0x7f4ddc150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:08.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.384+0000 7f4dda59c640 1 -- 172.21.15.133:0/248915835 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ddc0a5750 con 0x7f4ddc0a5370 2023-12-19T19:02:08.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.384+0000 7f4ddad9d640 1 --2- 172.21.15.133:0/248915835 >> v2:172.21.15.138:3300/0 conn(0x7f4ddc072090 0x7f4ddc1516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:08.392 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.388+0000 7f4dda59c640 1 --2- 172.21.15.133:0/248915835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ddc0a5370 0x7f4ddc0c3bd0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc072020 tx=0x7f4dcc01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee6a7eb769a6dec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:08.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.388+0000 7f4dd959a640 1 -- 172.21.15.133:0/248915835 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc0ab600 con 0x7f4ddc0a5370 2023-12-19T19:02:08.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.388+0000 7f4dd959a640 1 -- 172.21.15.133:0/248915835 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dcc0a7050 con 0x7f4ddc0a5370 2023-12-19T19:02:08.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.388+0000 7f4dd959a640 1 -- 172.21.15.133:0/248915835 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc0ab980 con 0x7f4ddc0a5370 2023-12-19T19:02:08.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.388+0000 7f4de0cd6640 1 -- 172.21.15.133:0/248915835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ddc0a5370 msgr2=0x7f4ddc0c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:08.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.388+0000 7f4de0cd6640 1 --2- 172.21.15.133:0/248915835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ddc0a5370 0x7f4ddc0c3bd0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc072020 tx=0x7f4dcc01c370 comp rx=0 tx=0).stop 2023-12-19T19:02:08.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.388+0000 7f4de0cd6640 1 -- 172.21.15.133:0/248915835 shutdown_connections 2023-12-19T19:02:08.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.388+0000 7f4de0cd6640 1 --2- 172.21.15.133:0/248915835 >> v2:172.21.15.138:3300/0 conn(0x7f4ddc072090 0x7f4ddc1516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.388+0000 7f4de0cd6640 1 --2- 172.21.15.133:0/248915835 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ddc0a5370 0x7f4ddc0c3bd0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.388+0000 7f4de0cd6640 1 -- 172.21.15.133:0/248915835 >> 172.21.15.133:0/248915835 conn(0x7f4ddc06a5b0 msgr2=0x7f4ddc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:08.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.388+0000 7f4de0cd6640 1 -- 172.21.15.133:0/248915835 shutdown_connections 2023-12-19T19:02:08.394 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.388+0000 7f4de0cd6640 1 -- 172.21.15.133:0/248915835 wait complete. 2023-12-19T19:02:08.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4de0cd6640 1 Processor -- start 2023-12-19T19:02:08.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4de0cd6640 1 -- start start 2023-12-19T19:02:08.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4de0cd6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ddc072090 0x7f4ddc1f0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:08.397 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4de0cd6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ddc0a5370 0x7f4ddc1f1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:08.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4de0cd6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ddc0c4110 0x7f4ddc14cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:08.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4de0cd6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc1504d0 con 0x7f4ddc0c4110 2023-12-19T19:02:08.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4de0cd6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc14a610 con 0x7f4ddc0a5370 2023-12-19T19:02:08.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4de0cd6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc14a8f0 con 0x7f4ddc072090 2023-12-19T19:02:08.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4ddad9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ddc0c4110 0x7f4ddc14cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:08.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4ddad9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ddc0c4110 0x7f4ddc14cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49714/0 (socket says 172.21.15.133:49714) 2023-12-19T19:02:08.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4ddad9d640 1 -- 172.21.15.133:0/4137329377 learned_addr learned my addr 172.21.15.133:0/4137329377 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:08.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4dd9d9b640 1 --2- 172.21.15.133:0/4137329377 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ddc0a5370 0x7f4ddc1f1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:08.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4dda59c640 1 --2- 172.21.15.133:0/4137329377 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ddc072090 0x7f4ddc1f0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:08.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4ddad9d640 1 -- 172.21.15.133:0/4137329377 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ddc072090 msgr2=0x7f4ddc1f0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:08.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4ddad9d640 1 --2- 172.21.15.133:0/4137329377 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ddc072090 0x7f4ddc1f0d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4ddad9d640 1 -- 172.21.15.133:0/4137329377 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ddc0a5370 msgr2=0x7f4ddc1f1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:08.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4ddad9d640 1 --2- 172.21.15.133:0/4137329377 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ddc0a5370 0x7f4ddc1f1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.398 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4ddad9d640 1 -- 172.21.15.133:0/4137329377 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dcc0094d0 con 0x7f4ddc0c4110 2023-12-19T19:02:08.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4ddad9d640 1 --2- 172.21.15.133:0/4137329377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ddc0c4110 0x7f4ddc14cd20 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f4dd400cef0 tx=0x7f4dd400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:08.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4dcaffd640 1 -- 172.21.15.133:0/4137329377 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd400d840 con 0x7f4ddc0c4110 2023-12-19T19:02:08.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4dcaffd640 1 -- 172.21.15.133:0/4137329377 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd400d9c0 con 0x7f4ddc0c4110 2023-12-19T19:02:08.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4dcaffd640 1 -- 172.21.15.133:0/4137329377 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd400dd70 con 0x7f4ddc0c4110 2023-12-19T19:02:08.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4de0cd6640 1 -- 172.21.15.133:0/4137329377 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ddc14c800 con 0x7f4ddc0c4110 2023-12-19T19:02:08.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4de0cd6640 1 -- 172.21.15.133:0/4137329377 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ddc1f1780 con 0x7f4ddc0c4110 2023-12-19T19:02:08.399 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.392+0000 7f4de0cd6640 1 -- 172.21.15.133:0/4137329377 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ddc14c660 con 0x7f4ddc0c4110 2023-12-19T19:02:08.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.396+0000 7f4dcaffd640 1 -- 172.21.15.133:0/4137329377 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f4dd401e3b0 con 0x7f4ddc0c4110 2023-12-19T19:02:08.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.396+0000 7f4dcaffd640 1 --2- 172.21.15.133:0/4137329377 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4dbc066470 0x7f4dbc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:08.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.396+0000 7f4dcaffd640 1 -- 172.21.15.133:0/4137329377 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4dd4084bf0 con 0x7f4ddc0c4110 2023-12-19T19:02:08.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.396+0000 7f4dda59c640 1 --2- 172.21.15.133:0/4137329377 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4dbc066470 0x7f4dbc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:08.401 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.396+0000 7f4dda59c640 1 --2- 172.21.15.133:0/4137329377 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4dbc066470 0x7f4dbc068930 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0ad000 tx=0x7f4dcc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:08.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.400+0000 7f4dcaffd640 1 -- 172.21.15.133:0/4137329377 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f4ddc14c660 con 0x7f4ddc0c4110 2023-12-19T19:02:08.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.548+0000 7f4de0cd6640 1 -- 172.21.15.133:0/4137329377 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ddc14ca40 con 0x7f4ddc0c4110 2023-12-19T19:02:08.555 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.552+0000 7f4dcaffd640 1 -- 172.21.15.133:0/4137329377 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4ddc14ca40 con 0x7f4ddc0c4110 2023-12-19T19:02:08.555 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:02:08.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.552+0000 7f4de0cd6640 1 -- 172.21.15.133:0/4137329377 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4dbc066470 msgr2=0x7f4dbc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:08.557 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.552+0000 7f4de0cd6640 1 --2- 172.21.15.133:0/4137329377 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4dbc066470 0x7f4dbc068930 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc0ad000 tx=0x7f4dcc009040 comp rx=0 tx=0).stop 2023-12-19T19:02:08.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.552+0000 7f4de0cd6640 1 -- 172.21.15.133:0/4137329377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ddc0c4110 msgr2=0x7f4ddc14cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:08.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.552+0000 7f4de0cd6640 1 --2- 172.21.15.133:0/4137329377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ddc0c4110 0x7f4ddc14cd20 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f4dd400cef0 tx=0x7f4dd400a710 comp rx=0 tx=0).stop 2023-12-19T19:02:08.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.552+0000 7f4de0cd6640 1 -- 172.21.15.133:0/4137329377 shutdown_connections 2023-12-19T19:02:08.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.552+0000 7f4de0cd6640 1 --2- 172.21.15.133:0/4137329377 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f4dbc066470 0x7f4dbc068930 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.552+0000 7f4de0cd6640 1 --2- 172.21.15.133:0/4137329377 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4ddc0c4110 0x7f4ddc14cd20 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.552+0000 7f4de0cd6640 1 --2- 172.21.15.133:0/4137329377 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4ddc0a5370 0x7f4ddc1f1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.552+0000 7f4de0cd6640 1 --2- 172.21.15.133:0/4137329377 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4ddc072090 0x7f4ddc1f0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.552+0000 7f4de0cd6640 1 -- 172.21.15.133:0/4137329377 >> 172.21.15.133:0/4137329377 conn(0x7f4ddc06a5b0 msgr2=0x7f4ddc151430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:08.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.552+0000 7f4de0cd6640 1 -- 172.21.15.133:0/4137329377 shutdown_connections 2023-12-19T19:02:08.558 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.552+0000 7f4de0cd6640 1 -- 172.21.15.133:0/4137329377 wait complete. 2023-12-19T19:02:08.576 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-19T19:02:08.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.712+0000 7fb4dc10f640 1 Processor -- start 2023-12-19T19:02:08.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.712+0000 7fb4dc10f640 1 -- start start 2023-12-19T19:02:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.716+0000 7fb4dc10f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4d40c63c0 0x7fb4d40c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.716+0000 7fb4dc10f640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb4d40c4100 0x7fb4d40c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.716+0000 7fb4dc10f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4d40c29e0 0x7fb4d40a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.716+0000 7fb4dc10f640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d40c31c0 con 0x7fb4d40c63c0 2023-12-19T19:02:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.716+0000 7fb4dc10f640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d40c34a0 con 0x7fb4d40c4100 2023-12-19T19:02:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.716+0000 7fb4dc10f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d40c1030 con 0x7fb4d40c29e0 2023-12-19T19:02:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.716+0000 7fb4d9eab640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4d40c63c0 0x7fb4d40c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.716+0000 7fb4d9eab640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb4d40c63c0 0x7fb4d40c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49722/0 (socket says 172.21.15.133:49722) 2023-12-19T19:02:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.716+0000 7fb4d9eab640 1 -- 172.21.15.133:0/767878390 learned_addr learned my addr 172.21.15.133:0/767878390 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.716+0000 7fb4da6ac640 1 --2- 172.21.15.133:0/767878390 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4d40c29e0 0x7fb4d40a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:08.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.716+0000 7fb4d96aa640 1 --2- 172.21.15.133:0/767878390 >> v2:172.21.15.138:3300/0 conn(0x7fb4d40c4100 0x7fb4d40c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.716+0000 7fb4d9eab640 1 -- 172.21.15.133:0/767878390 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4d40c29e0 msgr2=0x7fb4d40a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.716+0000 7fb4d9eab640 1 --2- 172.21.15.133:0/767878390 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4d40c29e0 0x7fb4d40a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.716+0000 7fb4d9eab640 1 -- 172.21.15.133:0/767878390 >> v2:172.21.15.138:3300/0 conn(0x7fb4d40c4100 msgr2=0x7fb4d40c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.716+0000 7fb4d9eab640 1 --2- 172.21.15.133:0/767878390 >> v2:172.21.15.138:3300/0 conn(0x7fb4d40c4100 0x7fb4d40c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.716+0000 7fb4d9eab640 1 -- 172.21.15.133:0/767878390 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d40c1310 con 0x7fb4d40c63c0 2023-12-19T19:02:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.716+0000 7fb4da6ac640 1 --2- 172.21.15.133:0/767878390 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4d40c29e0 0x7fb4d40a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:08.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.716+0000 7fb4d96aa640 1 --2- 172.21.15.133:0/767878390 >> v2:172.21.15.138:3300/0 conn(0x7fb4d40c4100 0x7fb4d40c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:08.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.720+0000 7fb4d9eab640 1 --2- 172.21.15.133:0/767878390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4d40c63c0 0x7fb4d40c06d0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fb4d40a8b40 tx=0x7fb4d001ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc9f19fa707381c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:08.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.720+0000 7fb4d8ea9640 1 -- 172.21.15.133:0/767878390 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d40aa3d0 con 0x7fb4d40c63c0 2023-12-19T19:02:08.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.720+0000 7fb4d8ea9640 1 -- 172.21.15.133:0/767878390 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d00a7b30 con 0x7fb4d40c63c0 2023-12-19T19:02:08.724 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.720+0000 7fb4d8ea9640 1 -- 172.21.15.133:0/767878390 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d00af440 con 0x7fb4d40c63c0 2023-12-19T19:02:08.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.720+0000 7fb4dc10f640 1 -- 172.21.15.133:0/767878390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4d40c63c0 msgr2=0x7fb4d40c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:08.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.720+0000 7fb4dc10f640 1 --2- 172.21.15.133:0/767878390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4d40c63c0 0x7fb4d40c06d0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fb4d40a8b40 tx=0x7fb4d001ea80 comp rx=0 tx=0).stop 2023-12-19T19:02:08.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.720+0000 7fb4dc10f640 1 -- 172.21.15.133:0/767878390 shutdown_connections 2023-12-19T19:02:08.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.720+0000 7fb4dc10f640 1 --2- 172.21.15.133:0/767878390 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4d40c29e0 0x7fb4d40a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.720+0000 7fb4dc10f640 1 --2- 172.21.15.133:0/767878390 >> v2:172.21.15.138:3300/0 conn(0x7fb4d40c4100 0x7fb4d40c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.720+0000 7fb4dc10f640 1 --2- 172.21.15.133:0/767878390 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4d40c63c0 0x7fb4d40c06d0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.720+0000 7fb4dc10f640 1 -- 172.21.15.133:0/767878390 >> 172.21.15.133:0/767878390 conn(0x7fb4d406a5b0 msgr2=0x7fb4d406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:08.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.720+0000 7fb4dc10f640 1 -- 172.21.15.133:0/767878390 shutdown_connections 2023-12-19T19:02:08.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.720+0000 7fb4dc10f640 1 -- 172.21.15.133:0/767878390 wait complete. 2023-12-19T19:02:08.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.720+0000 7fb4dc10f640 1 Processor -- start 2023-12-19T19:02:08.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.720+0000 7fb4dc10f640 1 -- start start 2023-12-19T19:02:08.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.724+0000 7fb4dc10f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4d40c29e0 0x7fb4d41f07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:08.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.724+0000 7fb4dc10f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb4d40c4100 0x7fb4d415a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:08.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.724+0000 7fb4dc10f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4d40c63c0 0x7fb4d414e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:08.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.724+0000 7fb4dc10f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d414f030 con 0x7fb4d40c29e0 2023-12-19T19:02:08.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.724+0000 7fb4dc10f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d41558f0 con 0x7fb4d40c4100 2023-12-19T19:02:08.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.724+0000 7fb4dc10f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d4152fb0 con 0x7fb4d40c63c0 2023-12-19T19:02:08.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.724+0000 7fb4d9eab640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4d40c29e0 0x7fb4d41f07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:08.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.724+0000 7fb4d9eab640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4d40c29e0 0x7fb4d41f07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49738/0 (socket says 172.21.15.133:49738) 2023-12-19T19:02:08.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.724+0000 7fb4d9eab640 1 -- 172.21.15.133:0/3659481509 learned_addr learned my addr 172.21.15.133:0/3659481509 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:08.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.724+0000 7fb4d9eab640 1 -- 172.21.15.133:0/3659481509 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4d40c63c0 msgr2=0x7fb4d414e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:08.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.724+0000 7fb4d9eab640 1 --2- 172.21.15.133:0/3659481509 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4d40c63c0 0x7fb4d414e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.724+0000 7fb4d9eab640 1 -- 172.21.15.133:0/3659481509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb4d40c4100 msgr2=0x7fb4d415a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:08.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.724+0000 7fb4d9eab640 1 --2- 172.21.15.133:0/3659481509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb4d40c4100 0x7fb4d415a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.724+0000 7fb4d9eab640 1 -- 172.21.15.133:0/3659481509 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d000b770 con 0x7fb4d40c29e0 2023-12-19T19:02:08.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.724+0000 7fb4d9eab640 1 --2- 172.21.15.133:0/3659481509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4d40c29e0 0x7fb4d41f07f0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fb4d000b2c0 tx=0x7fb4d001b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:08.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.724+0000 7fb4ca7fc640 1 -- 172.21.15.133:0/3659481509 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d00ad750 con 0x7fb4d40c29e0 2023-12-19T19:02:08.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.724+0000 7fb4ca7fc640 1 -- 172.21.15.133:0/3659481509 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d00ad8d0 con 0x7fb4d40c29e0 2023-12-19T19:02:08.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.724+0000 7fb4dc10f640 1 -- 172.21.15.133:0/3659481509 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d40c69b0 con 0x7fb4d40c29e0 2023-12-19T19:02:08.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.724+0000 7fb4ca7fc640 1 -- 172.21.15.133:0/3659481509 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d00adc80 con 0x7fb4d40c29e0 2023-12-19T19:02:08.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.724+0000 7fb4dc10f640 1 -- 172.21.15.133:0/3659481509 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d4154f50 con 0x7fb4d40c29e0 2023-12-19T19:02:08.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.724+0000 7fb4dc10f640 1 -- 172.21.15.133:0/3659481509 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d4068400 con 0x7fb4d40c29e0 2023-12-19T19:02:08.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.724+0000 7fb4ca7fc640 1 -- 172.21.15.133:0/3659481509 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb4d00c33b0 con 0x7fb4d40c29e0 2023-12-19T19:02:08.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.728+0000 7fb4ca7fc640 1 --2- 172.21.15.133:0/3659481509 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb4b80664a0 0x7fb4b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:08.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.728+0000 7fb4ca7fc640 1 -- 172.21.15.133:0/3659481509 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb4d011f010 con 0x7fb4d40c29e0 2023-12-19T19:02:08.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.728+0000 7fb4d96aa640 1 --2- 172.21.15.133:0/3659481509 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb4b80664a0 0x7fb4b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:08.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.728+0000 7fb4d96aa640 1 --2- 172.21.15.133:0/3659481509 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb4b80664a0 0x7fb4b8068960 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb4d415ad00 tx=0x7fb4c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:08.738 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.732+0000 7fb4ca7fc640 1 -- 172.21.15.133:0/3659481509 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb4d00ec2e0 con 0x7fb4d40c29e0 2023-12-19T19:02:08.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.880+0000 7fb4dc10f640 1 -- 172.21.15.133:0/3659481509 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4d40c3e70 con 0x7fb4d40c29e0 2023-12-19T19:02:08.884 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.880+0000 7fb4ca7fc640 1 -- 172.21.15.133:0/3659481509 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v73) v1 ==== 105+0+11 (secure 0 0 0) 0x7fb4d00b4020 con 0x7fb4d40c29e0 2023-12-19T19:02:08.884 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:02:08.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.880+0000 7fb4dc10f640 1 -- 172.21.15.133:0/3659481509 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb4b80664a0 msgr2=0x7fb4b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:08.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.880+0000 7fb4dc10f640 1 --2- 172.21.15.133:0/3659481509 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb4b80664a0 0x7fb4b8068960 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb4d415ad00 tx=0x7fb4c4008040 comp rx=0 tx=0).stop 2023-12-19T19:02:08.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.880+0000 7fb4dc10f640 1 -- 172.21.15.133:0/3659481509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4d40c29e0 msgr2=0x7fb4d41f07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:08.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.880+0000 7fb4dc10f640 1 --2- 172.21.15.133:0/3659481509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4d40c29e0 0x7fb4d41f07f0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fb4d000b2c0 tx=0x7fb4d001b820 comp rx=0 tx=0).stop 2023-12-19T19:02:08.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.880+0000 7fb4dc10f640 1 -- 172.21.15.133:0/3659481509 shutdown_connections 2023-12-19T19:02:08.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.880+0000 7fb4dc10f640 1 --2- 172.21.15.133:0/3659481509 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb4b80664a0 0x7fb4b8068960 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.880+0000 7fb4dc10f640 1 --2- 172.21.15.133:0/3659481509 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb4d40c63c0 0x7fb4d414e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.880+0000 7fb4dc10f640 1 --2- 172.21.15.133:0/3659481509 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb4d40c4100 0x7fb4d415a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.880+0000 7fb4dc10f640 1 --2- 172.21.15.133:0/3659481509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb4d40c29e0 0x7fb4d41f07f0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:08.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.880+0000 7fb4dc10f640 1 -- 172.21.15.133:0/3659481509 >> 172.21.15.133:0/3659481509 conn(0x7fb4d406a5b0 msgr2=0x7fb4d406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:08.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.880+0000 7fb4dc10f640 1 -- 172.21.15.133:0/3659481509 shutdown_connections 2023-12-19T19:02:08.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:08.880+0000 7fb4dc10f640 1 -- 172.21.15.133:0/3659481509 wait complete. 2023-12-19T19:02:08.905 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-19T19:02:09.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.040+0000 7fe908172640 1 Processor -- start 2023-12-19T19:02:09.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.040+0000 7fe908172640 1 -- start start 2023-12-19T19:02:09.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.040+0000 7fe908172640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe90006d520 0x7fe90015ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:09.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.044+0000 7fe908172640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe9000bffc0 0x7fe9000c1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:09.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.044+0000 7fe908172640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe90015c600 con 0x7fe9001560e0 2023-12-19T19:02:09.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.044+0000 7fe908172640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe90015a5c0 con 0x7fe9000bffc0 2023-12-19T19:02:09.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.044+0000 7fe908172640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9001594e0 con 0x7fe90006d520 2023-12-19T19:02:09.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.044+0000 7fe90670f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe9000bffc0 0x7fe9000c1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:09.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.044+0000 7fe90670f640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe9000bffc0 0x7fe9000c1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49748/0 (socket says 172.21.15.133:49748) 2023-12-19T19:02:09.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.044+0000 7fe90670f640 1 -- 172.21.15.133:0/2808982 learned_addr learned my addr 172.21.15.133:0/2808982 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:09.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.044+0000 7fe90570d640 1 --2- 172.21.15.133:0/2808982 >> v2:172.21.15.138:3300/0 conn(0x7fe90006d520 0x7fe90015ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:09.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.044+0000 7fe90670f640 1 -- 172.21.15.133:0/2808982 >> v2:172.21.15.138:3300/0 conn(0x7fe90006d520 msgr2=0x7fe90015ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:09.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.044+0000 7fe90670f640 1 --2- 172.21.15.133:0/2808982 >> v2:172.21.15.138:3300/0 conn(0x7fe90006d520 0x7fe90015ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.044+0000 7fe90670f640 1 -- 172.21.15.133:0/2808982 >> v1:172.21.15.138:6789/0 conn(0x7fe9001560e0 legacy=0x7fe900159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:09.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.044+0000 7fe90670f640 1 -- 172.21.15.133:0/2808982 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9001597c0 con 0x7fe9000bffc0 2023-12-19T19:02:09.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.044+0000 7fe90670f640 1 --2- 172.21.15.133:0/2808982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9000bffc0 0x7fe9000c1bf0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fe9000c1330 tx=0x7fe8f801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5e4b318bbc4aa0f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:09.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.044+0000 7fe904f0c640 1 -- 172.21.15.133:0/2808982 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f80a5770 con 0x7fe9000bffc0 2023-12-19T19:02:09.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.044+0000 7fe904f0c640 1 -- 172.21.15.133:0/2808982 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f80a58d0 con 0x7fe9000bffc0 2023-12-19T19:02:09.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.044+0000 7fe904f0c640 1 -- 172.21.15.133:0/2808982 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f80a5c60 con 0x7fe9000bffc0 2023-12-19T19:02:09.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe908172640 1 -- 172.21.15.133:0/2808982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9000bffc0 msgr2=0x7fe9000c1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:09.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe908172640 1 --2- 172.21.15.133:0/2808982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9000bffc0 0x7fe9000c1bf0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fe9000c1330 tx=0x7fe8f801c9a0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe908172640 1 -- 172.21.15.133:0/2808982 shutdown_connections 2023-12-19T19:02:09.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe908172640 1 --2- 172.21.15.133:0/2808982 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9000bffc0 0x7fe9000c1bf0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe908172640 1 --2- 172.21.15.133:0/2808982 >> v2:172.21.15.138:3300/0 conn(0x7fe90006d520 0x7fe90015ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe908172640 1 -- 172.21.15.133:0/2808982 >> 172.21.15.133:0/2808982 conn(0x7fe90006a5b0 msgr2=0x7fe90006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:09.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe908172640 1 -- 172.21.15.133:0/2808982 shutdown_connections 2023-12-19T19:02:09.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe908172640 1 -- 172.21.15.133:0/2808982 wait complete. 2023-12-19T19:02:09.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe908172640 1 Processor -- start 2023-12-19T19:02:09.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe908172640 1 -- start start 2023-12-19T19:02:09.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe908172640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe90006d520 0x7fe9001f54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:09.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe908172640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9000bffc0 0x7fe9001f1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:09.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe908172640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9001560e0 0x7fe90014fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:09.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe908172640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9000a96e0 con 0x7fe9001560e0 2023-12-19T19:02:09.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe908172640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9000c4280 con 0x7fe9000bffc0 2023-12-19T19:02:09.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe908172640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9001f4aa0 con 0x7fe90006d520 2023-12-19T19:02:09.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe90670f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9001560e0 0x7fe90014fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:09.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe90670f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9001560e0 0x7fe90014fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49754/0 (socket says 172.21.15.133:49754) 2023-12-19T19:02:09.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe90670f640 1 -- 172.21.15.133:0/2658454641 learned_addr learned my addr 172.21.15.133:0/2658454641 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:09.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe90570d640 1 --2- 172.21.15.133:0/2658454641 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9000bffc0 0x7fe9001f1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:09.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe905f0e640 1 --2- 172.21.15.133:0/2658454641 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe90006d520 0x7fe9001f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:09.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe90670f640 1 -- 172.21.15.133:0/2658454641 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe90006d520 msgr2=0x7fe9001f54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:09.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe90670f640 1 --2- 172.21.15.133:0/2658454641 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe90006d520 0x7fe9001f54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe90670f640 1 -- 172.21.15.133:0/2658454641 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9000bffc0 msgr2=0x7fe9001f1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:09.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe90670f640 1 --2- 172.21.15.133:0/2658454641 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9000bffc0 0x7fe9001f1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.056 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe90670f640 1 -- 172.21.15.133:0/2658454641 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f8009b30 con 0x7fe9001560e0 2023-12-19T19:02:09.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.048+0000 7fe905f0e640 1 --2- 172.21.15.133:0/2658454641 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe90006d520 0x7fe9001f54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:09.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.052+0000 7fe90670f640 1 --2- 172.21.15.133:0/2658454641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9001560e0 0x7fe90014fd00 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80195b0 tx=0x7fe8f8019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:09.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.052+0000 7fe8f67fc640 1 -- 172.21.15.133:0/2658454641 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f80b8670 con 0x7fe9001560e0 2023-12-19T19:02:09.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.052+0000 7fe8f67fc640 1 -- 172.21.15.133:0/2658454641 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f80b87f0 con 0x7fe9001560e0 2023-12-19T19:02:09.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.052+0000 7fe908172640 1 -- 172.21.15.133:0/2658454641 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9000a8f30 con 0x7fe9001560e0 2023-12-19T19:02:09.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.052+0000 7fe8f67fc640 1 -- 172.21.15.133:0/2658454641 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f80b8ba0 con 0x7fe9001560e0 2023-12-19T19:02:09.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.052+0000 7fe908172640 1 -- 172.21.15.133:0/2658454641 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9001f4cf0 con 0x7fe9001560e0 2023-12-19T19:02:09.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.052+0000 7fe908172640 1 -- 172.21.15.133:0/2658454641 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe900068400 con 0x7fe9001560e0 2023-12-19T19:02:09.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.052+0000 7fe8f67fc640 1 -- 172.21.15.133:0/2658454641 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe8f80b8d00 con 0x7fe9001560e0 2023-12-19T19:02:09.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.052+0000 7fe8f67fc640 1 --2- 172.21.15.133:0/2658454641 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe8e4066470 0x7fe8e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:09.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.052+0000 7fe8f67fc640 1 -- 172.21.15.133:0/2658454641 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe8f811fb60 con 0x7fe9001560e0 2023-12-19T19:02:09.058 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.052+0000 7fe905f0e640 1 --2- 172.21.15.133:0/2658454641 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe8e4066470 0x7fe8e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:09.059 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.056+0000 7fe905f0e640 1 --2- 172.21.15.133:0/2658454641 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe8e4066470 0x7fe8e4068930 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc000f70 tx=0x7fe8fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:09.062 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.056+0000 7fe8f67fc640 1 -- 172.21.15.133:0/2658454641 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fe8f80ecd90 con 0x7fe9001560e0 2023-12-19T19:02:09.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.204+0000 7fe908172640 1 -- 172.21.15.133:0/2658454641 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fe900164130 con 0x7fe9001560e0 2023-12-19T19:02:09.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.204+0000 7fe8f67fc640 1 -- 172.21.15.133:0/2658454641 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v73) v1 ==== 101+0+11 (secure 0 0 0) 0x7fe8f80bc020 con 0x7fe9001560e0 2023-12-19T19:02:09.211 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:02:09.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.208+0000 7fe908172640 1 -- 172.21.15.133:0/2658454641 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe8e4066470 msgr2=0x7fe8e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:09.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.208+0000 7fe908172640 1 --2- 172.21.15.133:0/2658454641 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe8e4066470 0x7fe8e4068930 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc000f70 tx=0x7fe8fc009040 comp rx=0 tx=0).stop 2023-12-19T19:02:09.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.208+0000 7fe908172640 1 -- 172.21.15.133:0/2658454641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9001560e0 msgr2=0x7fe90014fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:09.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.208+0000 7fe908172640 1 --2- 172.21.15.133:0/2658454641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9001560e0 0x7fe90014fd00 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fe8f80195b0 tx=0x7fe8f8019740 comp rx=0 tx=0).stop 2023-12-19T19:02:09.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.208+0000 7fe908172640 1 -- 172.21.15.133:0/2658454641 shutdown_connections 2023-12-19T19:02:09.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.208+0000 7fe908172640 1 --2- 172.21.15.133:0/2658454641 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe8e4066470 0x7fe8e4068930 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.208+0000 7fe908172640 1 --2- 172.21.15.133:0/2658454641 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe9001560e0 0x7fe90014fd00 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.208+0000 7fe908172640 1 --2- 172.21.15.133:0/2658454641 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe9000bffc0 0x7fe9001f1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.208+0000 7fe908172640 1 --2- 172.21.15.133:0/2658454641 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe90006d520 0x7fe9001f54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.208+0000 7fe908172640 1 -- 172.21.15.133:0/2658454641 >> 172.21.15.133:0/2658454641 conn(0x7fe90006a5b0 msgr2=0x7fe90006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:09.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.208+0000 7fe908172640 1 -- 172.21.15.133:0/2658454641 shutdown_connections 2023-12-19T19:02:09.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.208+0000 7fe908172640 1 -- 172.21.15.133:0/2658454641 wait complete. 2023-12-19T19:02:09.232 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T19:02:09.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.364+0000 7f9f70454640 1 Processor -- start 2023-12-19T19:02:09.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.364+0000 7f9f70454640 1 -- start start 2023-12-19T19:02:09.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.368+0000 7f9f70454640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9f68152030 0x7f9f680c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:09.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.368+0000 7f9f70454640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f9f68157c90 0x7f9f680c2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:09.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.368+0000 7f9f70454640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f68154b60 con 0x7f9f6806c470 2023-12-19T19:02:09.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.368+0000 7f9f70454640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f68152410 con 0x7f9f68152030 2023-12-19T19:02:09.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.368+0000 7f9f70454640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f68155700 con 0x7f9f68157c90 2023-12-19T19:02:09.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.368+0000 7f9f6e1f0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9f68152030 0x7f9f680c0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:09.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.368+0000 7f9f6e1f0640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9f68152030 0x7f9f680c0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49758/0 (socket says 172.21.15.133:49758) 2023-12-19T19:02:09.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.368+0000 7f9f6e1f0640 1 -- 172.21.15.133:0/3031953582 learned_addr learned my addr 172.21.15.133:0/3031953582 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:09.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.368+0000 7f9f6e1f0640 1 -- 172.21.15.133:0/3031953582 >> v2:172.21.15.138:3300/0 conn(0x7f9f68157c90 msgr2=0x7f9f680c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:09.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.368+0000 7f9f6e1f0640 1 --2- 172.21.15.133:0/3031953582 >> v2:172.21.15.138:3300/0 conn(0x7f9f68157c90 0x7f9f680c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.368+0000 7f9f6e1f0640 1 -- 172.21.15.133:0/3031953582 >> v1:172.21.15.138:6789/0 conn(0x7f9f6806c470 legacy=0x7f9f68154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:09.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.368+0000 7f9f6e1f0640 1 -- 172.21.15.133:0/3031953582 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f680c1820 con 0x7f9f68152030 2023-12-19T19:02:09.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.372+0000 7f9f6e1f0640 1 --2- 172.21.15.133:0/3031953582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f68152030 0x7f9f680c0c40 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f9f6806ca00 tx=0x7f9f6401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6f76b669f7ddbb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:09.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.372+0000 7f9f6d1ee640 1 -- 172.21.15.133:0/3031953582 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f640ab610 con 0x7f9f68152030 2023-12-19T19:02:09.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.372+0000 7f9f6d1ee640 1 -- 172.21.15.133:0/3031953582 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f640ab770 con 0x7f9f68152030 2023-12-19T19:02:09.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.372+0000 7f9f6d1ee640 1 -- 172.21.15.133:0/3031953582 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f640abb00 con 0x7f9f68152030 2023-12-19T19:02:09.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.372+0000 7f9f70454640 1 -- 172.21.15.133:0/3031953582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f68152030 msgr2=0x7f9f680c0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:09.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.372+0000 7f9f70454640 1 --2- 172.21.15.133:0/3031953582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f68152030 0x7f9f680c0c40 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f9f6806ca00 tx=0x7f9f6401c410 comp rx=0 tx=0).stop 2023-12-19T19:02:09.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.372+0000 7f9f70454640 1 -- 172.21.15.133:0/3031953582 shutdown_connections 2023-12-19T19:02:09.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.372+0000 7f9f70454640 1 --2- 172.21.15.133:0/3031953582 >> v2:172.21.15.138:3300/0 conn(0x7f9f68157c90 0x7f9f680c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.372+0000 7f9f70454640 1 --2- 172.21.15.133:0/3031953582 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f68152030 0x7f9f680c0c40 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.372+0000 7f9f70454640 1 -- 172.21.15.133:0/3031953582 >> 172.21.15.133:0/3031953582 conn(0x7f9f6806a5b0 msgr2=0x7f9f6806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:09.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.372+0000 7f9f70454640 1 -- 172.21.15.133:0/3031953582 shutdown_connections 2023-12-19T19:02:09.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.372+0000 7f9f70454640 1 -- 172.21.15.133:0/3031953582 wait complete. 2023-12-19T19:02:09.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.372+0000 7f9f70454640 1 Processor -- start 2023-12-19T19:02:09.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.372+0000 7f9f70454640 1 -- start start 2023-12-19T19:02:09.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.372+0000 7f9f70454640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f6806c470 0x7f9f68156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:09.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f70454640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f68152030 0x7f9f68156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:09.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f70454640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f68157c90 0x7f9f680aa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:09.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f70454640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f680a93f0 con 0x7f9f6806c470 2023-12-19T19:02:09.380 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f70454640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f680a9c90 con 0x7f9f68152030 2023-12-19T19:02:09.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f70454640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f681575b0 con 0x7f9f68157c90 2023-12-19T19:02:09.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f6e1f0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f6806c470 0x7f9f68156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:09.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f6e1f0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f6806c470 0x7f9f68156d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49768/0 (socket says 172.21.15.133:49768) 2023-12-19T19:02:09.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f6e1f0640 1 -- 172.21.15.133:0/4119427354 learned_addr learned my addr 172.21.15.133:0/4119427354 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:09.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f6d9ef640 1 --2- 172.21.15.133:0/4119427354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f68152030 0x7f9f68156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:09.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f6e1f0640 1 -- 172.21.15.133:0/4119427354 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f68157c90 msgr2=0x7f9f680aa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:09.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f6e9f1640 1 --2- 172.21.15.133:0/4119427354 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f68157c90 0x7f9f680aa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:09.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f6e1f0640 1 --2- 172.21.15.133:0/4119427354 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f68157c90 0x7f9f680aa120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f6e1f0640 1 -- 172.21.15.133:0/4119427354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f68152030 msgr2=0x7f9f68156350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:09.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f6e1f0640 1 --2- 172.21.15.133:0/4119427354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f68152030 0x7f9f68156350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f6e1f0640 1 -- 172.21.15.133:0/4119427354 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f640094d0 con 0x7f9f6806c470 2023-12-19T19:02:09.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f6d9ef640 1 --2- 172.21.15.133:0/4119427354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f68152030 0x7f9f68156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:09.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f6e9f1640 1 --2- 172.21.15.133:0/4119427354 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f68157c90 0x7f9f680aa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:09.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f6e1f0640 1 --2- 172.21.15.133:0/4119427354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f6806c470 0x7f9f68156d60 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f9f640ad040 tx=0x7f9f6401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:09.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f5effd640 1 -- 172.21.15.133:0/4119427354 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f640b4800 con 0x7f9f6806c470 2023-12-19T19:02:09.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f5effd640 1 -- 172.21.15.133:0/4119427354 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f640b4960 con 0x7f9f6806c470 2023-12-19T19:02:09.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f70454640 1 -- 172.21.15.133:0/4119427354 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f680a9640 con 0x7f9f6806c470 2023-12-19T19:02:09.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f5effd640 1 -- 172.21.15.133:0/4119427354 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f640b4d10 con 0x7f9f6806c470 2023-12-19T19:02:09.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f70454640 1 -- 172.21.15.133:0/4119427354 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f681572a0 con 0x7f9f6806c470 2023-12-19T19:02:09.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f70454640 1 -- 172.21.15.133:0/4119427354 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f68068400 con 0x7f9f6806c470 2023-12-19T19:02:09.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f5effd640 1 -- 172.21.15.133:0/4119427354 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9f640c7440 con 0x7f9f6806c470 2023-12-19T19:02:09.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.376+0000 7f9f5effd640 1 --2- 172.21.15.133:0/4119427354 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9f4c066470 0x7f9f4c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:09.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.380+0000 7f9f5effd640 1 -- 172.21.15.133:0/4119427354 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9f6411ef00 con 0x7f9f6806c470 2023-12-19T19:02:09.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.380+0000 7f9f6d9ef640 1 --2- 172.21.15.133:0/4119427354 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9f4c066470 0x7f9f4c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:09.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.380+0000 7f9f6d9ef640 1 --2- 172.21.15.133:0/4119427354 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9f4c066470 0x7f9f4c068930 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9f68144a30 tx=0x7f9f58009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:09.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.380+0000 7f9f5effd640 1 -- 172.21.15.133:0/4119427354 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f9f640ec010 con 0x7f9f6806c470 2023-12-19T19:02:09.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.544+0000 7f9f70454640 1 -- 172.21.15.133:0/4119427354 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9f6806ca50 con 0x7f9f6806c470 2023-12-19T19:02:09.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.544+0000 7f9f5effd640 1 -- 172.21.15.133:0/4119427354 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v73) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9f640ef630 con 0x7f9f6806c470 2023-12-19T19:02:09.550 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-19T19:02:09.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.548+0000 7f9f70454640 1 -- 172.21.15.133:0/4119427354 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9f4c066470 msgr2=0x7f9f4c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:09.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.548+0000 7f9f70454640 1 --2- 172.21.15.133:0/4119427354 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9f4c066470 0x7f9f4c068930 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f9f68144a30 tx=0x7f9f58009040 comp rx=0 tx=0).stop 2023-12-19T19:02:09.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.548+0000 7f9f70454640 1 -- 172.21.15.133:0/4119427354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f6806c470 msgr2=0x7f9f68156d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:09.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.548+0000 7f9f70454640 1 --2- 172.21.15.133:0/4119427354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f6806c470 0x7f9f68156d60 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f9f640ad040 tx=0x7f9f6401ac50 comp rx=0 tx=0).stop 2023-12-19T19:02:09.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.548+0000 7f9f70454640 1 -- 172.21.15.133:0/4119427354 shutdown_connections 2023-12-19T19:02:09.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.548+0000 7f9f70454640 1 --2- 172.21.15.133:0/4119427354 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9f4c066470 0x7f9f4c068930 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.548+0000 7f9f70454640 1 --2- 172.21.15.133:0/4119427354 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9f68157c90 0x7f9f680aa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.548+0000 7f9f70454640 1 --2- 172.21.15.133:0/4119427354 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f9f68152030 0x7f9f68156350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.548+0000 7f9f70454640 1 --2- 172.21.15.133:0/4119427354 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9f6806c470 0x7f9f68156d60 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.548+0000 7f9f70454640 1 -- 172.21.15.133:0/4119427354 >> 172.21.15.133:0/4119427354 conn(0x7f9f6806a5b0 msgr2=0x7f9f68150950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:09.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.548+0000 7f9f70454640 1 -- 172.21.15.133:0/4119427354 shutdown_connections 2023-12-19T19:02:09.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.548+0000 7f9f70454640 1 -- 172.21.15.133:0/4119427354 wait complete. 2023-12-19T19:02:09.571 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-19T19:02:09.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:09.571 DEBUG:teuthology.orchestra.run.smithi138:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T19:02:09.629 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi138.front.sepia.ceph.com 2023-12-19T19:02:09.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:09.630 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T19:02:09.652 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:02:09.652 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:02:09.703 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3612 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-19T19:02:09.704 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T19:02:09.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.840+0000 7f913e365640 1 Processor -- start 2023-12-19T19:02:09.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.840+0000 7f913e365640 1 -- start start 2023-12-19T19:02:09.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.840+0000 7f913e365640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91380a5370 0x7f91380c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:09.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.840+0000 7f913e365640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9138072090 0x7f91381516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:09.847 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.840+0000 7f913e365640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91380c2760 con 0x7f91380c4110 2023-12-19T19:02:09.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.840+0000 7f913e365640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91380c3070 con 0x7f9138072090 2023-12-19T19:02:09.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.840+0000 7f913e365640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9138151bf0 con 0x7f91380a5370 2023-12-19T19:02:09.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.840+0000 7f91377fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f91380c4110 0x7f9138150fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41694/0 (socket says 172.21.15.133:41694) 2023-12-19T19:02:09.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.840+0000 7f91377fe640 1 -- 172.21.15.133:0/929802709 learned_addr learned my addr 172.21.15.133:0/929802709 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:09.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.840+0000 7f913c902640 1 --2- 172.21.15.133:0/929802709 >> v2:172.21.15.133:3300/0 conn(0x7f9138072090 0x7f91381516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:09.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.844+0000 7f9137fff640 1 --2- 172.21.15.133:0/929802709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91380a5370 0x7f91380c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:09.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.844+0000 7f9136ffd640 1 -- 172.21.15.133:0/929802709 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2857443123 0 0) 0x7f91380c2760 con 0x7f91380c4110 2023-12-19T19:02:09.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.844+0000 7f9136ffd640 1 -- 172.21.15.133:0/929802709 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9120003530 con 0x7f91380c4110 2023-12-19T19:02:09.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.844+0000 7f913c902640 1 -- 172.21.15.133:0/929802709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91380a5370 msgr2=0x7f91380c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:09.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.844+0000 7f913c902640 1 --2- 172.21.15.133:0/929802709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91380a5370 0x7f91380c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.844+0000 7f913c902640 1 -- 172.21.15.133:0/929802709 >> v1:172.21.15.133:6789/0 conn(0x7f91380c4110 legacy=0x7f9138150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:09.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.844+0000 7f913c902640 1 -- 172.21.15.133:0/929802709 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91380a5750 con 0x7f9138072090 2023-12-19T19:02:09.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.844+0000 7f9137fff640 1 --2- 172.21.15.133:0/929802709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91380a5370 0x7f91380c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:09.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.844+0000 7f913c902640 1 --2- 172.21.15.133:0/929802709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9138072090 0x7f91381516b0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f9130009dc0 tx=0x7f913001c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f646a6fdd7e40e2d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:09.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.844+0000 7f9136ffd640 1 -- 172.21.15.133:0/929802709 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91300a5710 con 0x7f9138072090 2023-12-19T19:02:09.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.844+0000 7f9136ffd640 1 -- 172.21.15.133:0/929802709 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91300a5870 con 0x7f9138072090 2023-12-19T19:02:09.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.844+0000 7f9136ffd640 1 -- 172.21.15.133:0/929802709 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91300a5c00 con 0x7f9138072090 2023-12-19T19:02:09.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913e365640 1 -- 172.21.15.133:0/929802709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9138072090 msgr2=0x7f91381516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:09.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913e365640 1 --2- 172.21.15.133:0/929802709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9138072090 0x7f91381516b0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f9130009dc0 tx=0x7f913001c7e0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913e365640 1 -- 172.21.15.133:0/929802709 shutdown_connections 2023-12-19T19:02:09.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913e365640 1 --2- 172.21.15.133:0/929802709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9138072090 0x7f91381516b0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913e365640 1 --2- 172.21.15.133:0/929802709 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f91380a5370 0x7f91380c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913e365640 1 -- 172.21.15.133:0/929802709 >> 172.21.15.133:0/929802709 conn(0x7f913806a5b0 msgr2=0x7f913806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:09.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913e365640 1 -- 172.21.15.133:0/929802709 shutdown_connections 2023-12-19T19:02:09.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913e365640 1 -- 172.21.15.133:0/929802709 wait complete. 2023-12-19T19:02:09.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913e365640 1 Processor -- start 2023-12-19T19:02:09.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913e365640 1 -- start start 2023-12-19T19:02:09.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913e365640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9138072090 0x7f91381463d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:09.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913e365640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91380a5370 0x7f91380bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:09.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913e365640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91380c4110 0x7f91381f0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:09.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913e365640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9138146910 con 0x7f91380c4110 2023-12-19T19:02:09.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913e365640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91381502a0 con 0x7f91380a5370 2023-12-19T19:02:09.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913e365640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9138150580 con 0x7f9138072090 2023-12-19T19:02:09.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913c902640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91380c4110 0x7f91381f0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:09.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913c902640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91380c4110 0x7f91381f0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49776/0 (socket says 172.21.15.133:49776) 2023-12-19T19:02:09.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913c902640 1 -- 172.21.15.133:0/477863357 learned_addr learned my addr 172.21.15.133:0/477863357 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:09.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f91377fe640 1 --2- 172.21.15.133:0/477863357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91380a5370 0x7f91380bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:09.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f9137fff640 1 --2- 172.21.15.133:0/477863357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9138072090 0x7f91381463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:09.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913c902640 1 -- 172.21.15.133:0/477863357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9138072090 msgr2=0x7f91381463d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:09.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913c902640 1 --2- 172.21.15.133:0/477863357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9138072090 0x7f91381463d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913c902640 1 -- 172.21.15.133:0/477863357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91380a5370 msgr2=0x7f91380bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:09.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913c902640 1 --2- 172.21.15.133:0/477863357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91380a5370 0x7f91380bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:09.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.848+0000 7f913c902640 1 -- 172.21.15.133:0/477863357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9130009a70 con 0x7f91380c4110 2023-12-19T19:02:09.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.852+0000 7f913c902640 1 --2- 172.21.15.133:0/477863357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91380c4110 0x7f91381f0a20 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f913001ae90 tx=0x7f9130019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:09.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.852+0000 7f9134ff9640 1 -- 172.21.15.133:0/477863357 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91300ad640 con 0x7f91380c4110 2023-12-19T19:02:09.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.852+0000 7f9134ff9640 1 -- 172.21.15.133:0/477863357 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91300ad7a0 con 0x7f91380c4110 2023-12-19T19:02:09.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.852+0000 7f9134ff9640 1 -- 172.21.15.133:0/477863357 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91300adb50 con 0x7f91380c4110 2023-12-19T19:02:09.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.852+0000 7f913e365640 1 -- 172.21.15.133:0/477863357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9138150860 con 0x7f91380c4110 2023-12-19T19:02:09.858 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.852+0000 7f913e365640 1 -- 172.21.15.133:0/477863357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91380bf8a0 con 0x7f91380c4110 2023-12-19T19:02:09.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.852+0000 7f913e365640 1 -- 172.21.15.133:0/477863357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91381f0360 con 0x7f91380c4110 2023-12-19T19:02:09.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.852+0000 7f9134ff9640 1 -- 172.21.15.133:0/477863357 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f91300b4050 con 0x7f91380c4110 2023-12-19T19:02:09.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.852+0000 7f9134ff9640 1 --2- 172.21.15.133:0/477863357 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f91240664a0 0x7f9124068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:09.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.852+0000 7f9134ff9640 1 -- 172.21.15.133:0/477863357 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f913011ee80 con 0x7f91380c4110 2023-12-19T19:02:09.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.852+0000 7f9137fff640 1 --2- 172.21.15.133:0/477863357 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f91240664a0 0x7f9124068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:09.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.856+0000 7f9137fff640 1 --2- 172.21.15.133:0/477863357 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f91240664a0 0x7f9124068960 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9128009950 tx=0x7f9128008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:09.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:09.856+0000 7f9134ff9640 1 -- 172.21.15.133:0/477863357 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f91381f0360 con 0x7f91380c4110 2023-12-19T19:02:10.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:10.040+0000 7f913e365640 1 -- 172.21.15.133:0/477863357 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f91381f0360 con 0x7f91380c4110 2023-12-19T19:02:10.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:10.040+0000 7f9134ff9640 1 -- 172.21.15.133:0/477863357 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) v1 ==== 53+0+149 (secure 0 0 0) 0x7f91381f0360 con 0x7f91380c4110 2023-12-19T19:02:10.046 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T19:02:10.046 INFO:teuthology.orchestra.run.smithi133.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2023-12-19T19:02:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:10.044+0000 7f913e365640 1 -- 172.21.15.133:0/477863357 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f91240664a0 msgr2=0x7f9124068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:10.044+0000 7f913e365640 1 --2- 172.21.15.133:0/477863357 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f91240664a0 0x7f9124068960 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f9128009950 tx=0x7f9128008040 comp rx=0 tx=0).stop 2023-12-19T19:02:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:10.044+0000 7f913e365640 1 -- 172.21.15.133:0/477863357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91380c4110 msgr2=0x7f91381f0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:10.044+0000 7f913e365640 1 --2- 172.21.15.133:0/477863357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91380c4110 0x7f91381f0a20 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f913001ae90 tx=0x7f9130019580 comp rx=0 tx=0).stop 2023-12-19T19:02:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:10.044+0000 7f913e365640 1 -- 172.21.15.133:0/477863357 shutdown_connections 2023-12-19T19:02:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:10.044+0000 7f913e365640 1 --2- 172.21.15.133:0/477863357 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f91240664a0 0x7f9124068960 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:10.044+0000 7f913e365640 1 --2- 172.21.15.133:0/477863357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f91380c4110 0x7f91381f0a20 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:10.044+0000 7f913e365640 1 --2- 172.21.15.133:0/477863357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f91380a5370 0x7f91380bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:10.044+0000 7f913e365640 1 --2- 172.21.15.133:0/477863357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f9138072090 0x7f91381463d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:10.044+0000 7f913e365640 1 -- 172.21.15.133:0/477863357 >> 172.21.15.133:0/477863357 conn(0x7f913806a5b0 msgr2=0x7f91380a9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:10.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:10.044+0000 7f913e365640 1 -- 172.21.15.133:0/477863357 shutdown_connections 2023-12-19T19:02:10.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:10.044+0000 7f913e365640 1 -- 172.21.15.133:0/477863357 wait complete. 2023-12-19T19:02:10.067 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2023-12-19T19:02:10.067 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T19:02:10.067 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi138.front.sepia.ceph.com 2023-12-19T19:02:10.067 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2023-12-19T19:02:10.067 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T19:02:10.067 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2023-12-19T19:02:10.067 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-19T19:02:10.067 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.BSzfoMsRQh 2023-12-19T19:02:10.067 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2023-12-19T19:02:10.076 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.7KpGE2sL87 2023-12-19T19:02:10.076 DEBUG:teuthology.orchestra.run.smithi138:> sudo cp /tmp/tmp.BSzfoMsRQh /tmp/tmp.7KpGE2sL87 2023-12-19T19:02:10.139 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.7KpGE2sL87 2023-12-19T19:02:10.260 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.7KpGE2sL87 is 226B 2023-12-19T19:02:10.278 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.7KpGE2sL87 2023-12-19T19:02:10.287 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQCq6IFl/9LRKBAAEdLXh9kRtwlqUFg0RuJGEw== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2023-12-19T19:02:10.287 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T19:02:10.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:10.288 DEBUG:teuthology.orchestra.run.smithi138:> ip addr 2023-12-19T19:02:10.339 INFO:teuthology.orchestra.run.smithi138.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T19:02:10.339 INFO:teuthology.orchestra.run.smithi138.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T19:02:10.340 INFO:teuthology.orchestra.run.smithi138.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T19:02:10.340 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:02:10.340 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 ::1/128 scope host 2023-12-19T19:02:10.340 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:02:10.340 INFO:teuthology.orchestra.run.smithi138.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:02:10.340 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7a brd ff:ff:ff:ff:ff:ff 2023-12-19T19:02:10.340 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f0 2023-12-19T19:02:10.340 INFO:teuthology.orchestra.run.smithi138.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:02:10.340 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:d9:36:7b brd ff:ff:ff:ff:ff:ff 2023-12-19T19:02:10.340 INFO:teuthology.orchestra.run.smithi138.stdout: altname enp7s0f1 2023-12-19T19:02:10.340 INFO:teuthology.orchestra.run.smithi138.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T19:02:10.340 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:70 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:02:10.340 INFO:teuthology.orchestra.run.smithi138.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T19:02:10.340 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0c:c4:7a:88:6f:71 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:02:10.341 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.21.15.138/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T19:02:10.341 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft 42223sec preferred_lft 42223sec 2023-12-19T19:02:10.341 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::ec4:7aff:fe88:6f71/64 scope link 2023-12-19T19:02:10.341 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:02:10.341 INFO:teuthology.orchestra.run.smithi138.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T19:02:10.341 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 02:42:5b:f5:51:87 brd ff:ff:ff:ff:ff:ff 2023-12-19T19:02:10.341 INFO:teuthology.orchestra.run.smithi138.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T19:02:10.341 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:02:10.341 INFO:teuthology.orchestra.run.smithi138.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T19:02:10.341 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-19T19:02:10.341 INFO:teuthology.orchestra.run.smithi138.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T19:02:10.341 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:02:10.341 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-19T19:02:10.341 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:02:10.342 INFO:teuthology.orchestra.run.smithi138.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T19:02:10.342 INFO:teuthology.orchestra.run.smithi138.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T19:02:10.342 INFO:teuthology.orchestra.run.smithi138.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-19T19:02:10.342 INFO:teuthology.orchestra.run.smithi138.stdout: valid_lft forever preferred_lft forever 2023-12-19T19:02:10.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:10.343 DEBUG:teuthology.orchestra.run.smithi138:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T19:02:10.405 INFO:teuthology.orchestra.run.smithi138.stdout:1 2023-12-19T19:02:10.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:10.407 DEBUG:teuthology.orchestra.run.smithi138:> route 2023-12-19T19:02:10.461 INFO:teuthology.orchestra.run.smithi138.stdout:Kernel IP routing table 2023-12-19T19:02:10.462 INFO:teuthology.orchestra.run.smithi138.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T19:02:10.462 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T19:02:10.462 INFO:teuthology.orchestra.run.smithi138.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T19:02:10.462 INFO:teuthology.orchestra.run.smithi138.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T19:02:10.462 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-19T19:02:10.462 INFO:teuthology.orchestra.run.smithi138.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:02:10.463 INFO:teuthology.orchestra.run.smithi138.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:02:10.463 INFO:teuthology.orchestra.run.smithi138.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T19:02:10.463 INFO:teuthology.orchestra.run.smithi138.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T19:02:10.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:10.464 DEBUG:teuthology.orchestra.run.smithi138:> (cd / && exec bash -c ' 2023-12-19T19:02:10.464 DEBUG:teuthology.orchestra.run.smithi138:> set -e 2023-12-19T19:02:10.464 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T19:02:10.464 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T19:02:10.464 DEBUG:teuthology.orchestra.run.smithi138:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T19:02:10.464 DEBUG:teuthology.orchestra.run.smithi138:> ') 2023-12-19T19:02:10.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:10.554 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2023-12-19T19:02:10.563 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T19:02:10.563 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T19:02:10.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:10.564 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link set brx.0 up 2023-12-19T19:02:10.626 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T19:02:10.626 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T19:02:10.683 INFO:teuthology.orchestra.run.smithi138.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T19:02:10.683 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T19:02:10.683 DEBUG:teuthology.orchestra.run.smithi138:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T19:02:10.735 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:02:10.735 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/tmp/tmp.BSzfoMsRQh of=/dev/stdout 2023-12-19T19:02:10.790 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2023-12-19T19:02:10.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:10.791 DEBUG:teuthology.orchestra.run.smithi138:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,secret=AQCq6IFl/9LRKBAAEdLXh9kRtwlqUFg0RuJGEw==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:02:10.885 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,secret=AQCq6IFl/9LRKBAAEdLXh9kRtwlqUFg0RuJGEw==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:02:10.885 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T19:02:10.885 INFO:teuthology.orchestra.run.smithi138.stdout:keyring.get_secret failed 2023-12-19T19:02:10.899 INFO:teuthology.orchestra.run.smithi138.stdout:parsing options: rw,norequire_active_mds,secret=AQCq6IFl/9LRKBAAEdLXh9kRtwlqUFg0RuJGEw==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-19T19:02:10.899 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-19T19:02:10.899 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: resolved to: "172.21.15.133:3300,172.21.15.138:3300,172.21.15.138:3301" 2023-12-19T19:02:10.899 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: trying mount with new device syntax: testuser@03e63958-005e-4bf2-ae5b-291aceb6fbbf.cephfs2=/ 2023-12-19T19:02:10.899 INFO:teuthology.orchestra.run.smithi138.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.133:3300/172.21.15.138:3300/172.21.15.138:3301" will pass to kernel 2023-12-19T19:02:10.904 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-19T19:02:10.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:10.904 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T19:02:10.922 INFO:teuthology.orchestra.run.smithi138.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.1': Permission denied 2023-12-19T19:02:10.924 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T19:02:10.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:10.924 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-19T19:02:10.981 INFO:teuthology.orchestra.run.smithi138.stdout:client6622 2023-12-19T19:02:10.981 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:02:10.981 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:02:11.031 INFO:tasks.cephfs.caps_helper:test read perm: read file /home/ubuntu/cephtest/mnt.0/testdir/testfile and expect data "self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0" 2023-12-19T19:02:11.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:11.031 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile) 2023-12-19T19:02:11.041 INFO:teuthology.orchestra.run.smithi133.stderr:cat: /home/ubuntu/cephtest/mnt.0/testdir/testfile: Permission denied 2023-12-19T19:02:11.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T19:02:11.042 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T19:02:11.043 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:02:11.095 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T19:02:11.095 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:02:11.148 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:02:11.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.328+0000 7fe8cd580640 1 Processor -- start 2023-12-19T19:02:11.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.328+0000 7fe8cd580640 1 -- start start 2023-12-19T19:02:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.328+0000 7fe8cd580640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fe8c8151dc0 0x7fe8c80c4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.328+0000 7fe8cd580640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe8c80bd660 0x7fe8c8154d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.328+0000 7fe8cd580640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c80ac4f0 con 0x7fe8c80c7ed0 2023-12-19T19:02:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.328+0000 7fe8cd580640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8c8158780 con 0x7fe8c8151dc0 2023-12-19T19:02:11.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.328+0000 7fe8cd580640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c8158a60 con 0x7fe8c80bd660 2023-12-19T19:02:11.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.328+0000 7fe8bffff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fe8c80c7ed0 0x7fe8c8154650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41700/0 (socket says 172.21.15.133:41700) 2023-12-19T19:02:11.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.328+0000 7fe8bffff640 1 -- 172.21.15.133:0/684137379 learned_addr learned my addr 172.21.15.133:0/684137379 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:11.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.328+0000 7fe8c77fe640 1 --2- 172.21.15.133:0/684137379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe8c80bd660 0x7fe8c8154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:11.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.328+0000 7fe8c6ffd640 1 --2- 172.21.15.133:0/684137379 >> v2:172.21.15.138:3300/0 conn(0x7fe8c8151dc0 0x7fe8c80c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:11.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.328+0000 7fe8c67fc640 1 -- 172.21.15.133:0/684137379 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 158835089 0 0) 0x7fe8c80ac4f0 con 0x7fe8c80c7ed0 2023-12-19T19:02:11.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.328+0000 7fe8c67fc640 1 -- 172.21.15.133:0/684137379 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8b4003530 con 0x7fe8c80c7ed0 2023-12-19T19:02:11.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.328+0000 7fe8c67fc640 1 -- 172.21.15.133:0/684137379 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3187618123 0 0) 0x7fe8b4003530 con 0x7fe8c80c7ed0 2023-12-19T19:02:11.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.328+0000 7fe8c6ffd640 1 -- 172.21.15.133:0/684137379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe8c80bd660 msgr2=0x7fe8c8154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:11.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.328+0000 7fe8c6ffd640 1 --2- 172.21.15.133:0/684137379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe8c80bd660 0x7fe8c8154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:11.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.328+0000 7fe8c6ffd640 1 -- 172.21.15.133:0/684137379 >> v1:172.21.15.133:6789/0 conn(0x7fe8c80c7ed0 legacy=0x7fe8c8154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:11.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.328+0000 7fe8c6ffd640 1 -- 172.21.15.133:0/684137379 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c80ac180 con 0x7fe8c8151dc0 2023-12-19T19:02:11.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.332+0000 7fe8c6ffd640 1 --2- 172.21.15.133:0/684137379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c8151dc0 0x7fe8c80c4950 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80097f0 tx=0x7fe8b801c280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef9916bd98e7532e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:11.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.332+0000 7fe8c67fc640 1 -- 172.21.15.133:0/684137379 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0001680 con 0x7fe8c8151dc0 2023-12-19T19:02:11.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.332+0000 7fe8c67fc640 1 -- 172.21.15.133:0/684137379 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b80a7050 con 0x7fe8c8151dc0 2023-12-19T19:02:11.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.332+0000 7fe8c67fc640 1 -- 172.21.15.133:0/684137379 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b80ab620 con 0x7fe8c8151dc0 2023-12-19T19:02:11.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.332+0000 7fe8cd580640 1 -- 172.21.15.133:0/684137379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c8151dc0 msgr2=0x7fe8c80c4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:11.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.332+0000 7fe8cd580640 1 --2- 172.21.15.133:0/684137379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c8151dc0 0x7fe8c80c4950 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80097f0 tx=0x7fe8b801c280 comp rx=0 tx=0).stop 2023-12-19T19:02:11.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.332+0000 7fe8cd580640 1 -- 172.21.15.133:0/684137379 shutdown_connections 2023-12-19T19:02:11.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.332+0000 7fe8cd580640 1 --2- 172.21.15.133:0/684137379 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe8c80bd660 0x7fe8c8154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:11.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.332+0000 7fe8cd580640 1 --2- 172.21.15.133:0/684137379 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c8151dc0 0x7fe8c80c4950 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:11.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.332+0000 7fe8cd580640 1 -- 172.21.15.133:0/684137379 >> 172.21.15.133:0/684137379 conn(0x7fe8c8071eb0 msgr2=0x7fe8c80722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.332+0000 7fe8cd580640 1 -- 172.21.15.133:0/684137379 shutdown_connections 2023-12-19T19:02:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.332+0000 7fe8cd580640 1 -- 172.21.15.133:0/684137379 wait complete. 2023-12-19T19:02:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8cd580640 1 Processor -- start 2023-12-19T19:02:11.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8cd580640 1 -- start start 2023-12-19T19:02:11.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8cd580640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8c80bd660 0x7fe8c814b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:11.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8cd580640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c80c7ed0 0x7fe8c81ed670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:11.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8cd580640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe8c8151dc0 0x7fe8c80c0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:11.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8cd580640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c81edbb0 con 0x7fe8c80bd660 2023-12-19T19:02:11.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8cd580640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c80bfd70 con 0x7fe8c80c7ed0 2023-12-19T19:02:11.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8cd580640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c8153dd0 con 0x7fe8c8151dc0 2023-12-19T19:02:11.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8c6ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8c80bd660 0x7fe8c814b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:11.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8c6ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8c80bd660 0x7fe8c814b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49792/0 (socket says 172.21.15.133:49792) 2023-12-19T19:02:11.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8c6ffd640 1 -- 172.21.15.133:0/761707559 learned_addr learned my addr 172.21.15.133:0/761707559 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:11.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8bffff640 1 --2- 172.21.15.133:0/761707559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c80c7ed0 0x7fe8c81ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:11.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8c77fe640 1 --2- 172.21.15.133:0/761707559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe8c8151dc0 0x7fe8c80c0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:11.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8c6ffd640 1 -- 172.21.15.133:0/761707559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe8c8151dc0 msgr2=0x7fe8c80c0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:11.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8c6ffd640 1 --2- 172.21.15.133:0/761707559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe8c8151dc0 0x7fe8c80c0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:11.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8c6ffd640 1 -- 172.21.15.133:0/761707559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c80c7ed0 msgr2=0x7fe8c81ed670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:11.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8c6ffd640 1 --2- 172.21.15.133:0/761707559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c80c7ed0 0x7fe8c81ed670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:11.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8c6ffd640 1 -- 172.21.15.133:0/761707559 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b8009420 con 0x7fe8c80bd660 2023-12-19T19:02:11.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8bffff640 1 --2- 172.21.15.133:0/761707559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c80c7ed0 0x7fe8c81ed670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:11.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8c6ffd640 1 --2- 172.21.15.133:0/761707559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8c80bd660 0x7fe8c814b8d0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80ae040 tx=0x7fe8b801aac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:11.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8bf7fe640 1 -- 172.21.15.133:0/761707559 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b80b7450 con 0x7fe8c80bd660 2023-12-19T19:02:11.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8bf7fe640 1 -- 172.21.15.133:0/761707559 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b80b75d0 con 0x7fe8c80bd660 2023-12-19T19:02:11.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8cd580640 1 -- 172.21.15.133:0/761707559 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c8152710 con 0x7fe8c80bd660 2023-12-19T19:02:11.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8bf7fe640 1 -- 172.21.15.133:0/761707559 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b80b7980 con 0x7fe8c80bd660 2023-12-19T19:02:11.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8cd580640 1 -- 172.21.15.133:0/761707559 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c8152cd0 con 0x7fe8c80bd660 2023-12-19T19:02:11.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.336+0000 7fe8cd580640 1 -- 172.21.15.133:0/761707559 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c8068400 con 0x7fe8c80bd660 2023-12-19T19:02:11.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.340+0000 7fe8bf7fe640 1 -- 172.21.15.133:0/761707559 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fe8b80b7ae0 con 0x7fe8c80bd660 2023-12-19T19:02:11.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.340+0000 7fe8bf7fe640 1 --2- 172.21.15.133:0/761707559 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe8a8066470 0x7fe8a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:11.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.340+0000 7fe8bf7fe640 1 -- 172.21.15.133:0/761707559 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe8b811e9f0 con 0x7fe8c80bd660 2023-12-19T19:02:11.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.340+0000 7fe8bffff640 1 --2- 172.21.15.133:0/761707559 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe8a8066470 0x7fe8a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:11.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.340+0000 7fe8bffff640 1 --2- 172.21.15.133:0/761707559 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe8a8066470 0x7fe8a8068930 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8154cc0 tx=0x7fe8b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:11.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.344+0000 7fe8bf7fe640 1 -- 172.21.15.133:0/761707559 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fe8b80ebc20 con 0x7fe8c80bd660 2023-12-19T19:02:11.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.508+0000 7fe8cd580640 1 -- 172.21.15.133:0/761707559 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8c806c9a0 con 0x7fe8c80bd660 2023-12-19T19:02:11.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.512+0000 7fe8bf7fe640 1 -- 172.21.15.133:0/761707559 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+20250 (secure 0 0 0) 0x7fe8b80bb090 con 0x7fe8c80bd660 2023-12-19T19:02:11.516 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:11.516 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":73,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:01:54.705538+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:01:33.082188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T19:01:34.349092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:01:50.875086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:01:52.061232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:02:11.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.512+0000 7fe8cd580640 1 -- 172.21.15.133:0/761707559 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe8a8066470 msgr2=0x7fe8a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:11.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.512+0000 7fe8cd580640 1 --2- 172.21.15.133:0/761707559 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe8a8066470 0x7fe8a8068930 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe8c8154cc0 tx=0x7fe8b0009040 comp rx=0 tx=0).stop 2023-12-19T19:02:11.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.512+0000 7fe8cd580640 1 -- 172.21.15.133:0/761707559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8c80bd660 msgr2=0x7fe8c814b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:11.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.512+0000 7fe8cd580640 1 --2- 172.21.15.133:0/761707559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8c80bd660 0x7fe8c814b8d0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fe8b80ae040 tx=0x7fe8b801aac0 comp rx=0 tx=0).stop 2023-12-19T19:02:11.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.512+0000 7fe8cd580640 1 -- 172.21.15.133:0/761707559 shutdown_connections 2023-12-19T19:02:11.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.512+0000 7fe8cd580640 1 --2- 172.21.15.133:0/761707559 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fe8a8066470 0x7fe8a8068930 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:11.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.512+0000 7fe8cd580640 1 --2- 172.21.15.133:0/761707559 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fe8c8151dc0 0x7fe8c80c0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:11.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.512+0000 7fe8cd580640 1 --2- 172.21.15.133:0/761707559 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fe8c80c7ed0 0x7fe8c81ed670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:11.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.512+0000 7fe8cd580640 1 --2- 172.21.15.133:0/761707559 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe8c80bd660 0x7fe8c814b8d0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:11.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.512+0000 7fe8cd580640 1 -- 172.21.15.133:0/761707559 >> 172.21.15.133:0/761707559 conn(0x7fe8c8071eb0 msgr2=0x7fe8c80c9680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:11.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.512+0000 7fe8cd580640 1 -- 172.21.15.133:0/761707559 shutdown_connections 2023-12-19T19:02:11.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.512+0000 7fe8cd580640 1 -- 172.21.15.133:0/761707559 wait complete. 2023-12-19T19:02:11.537 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T19:01:33.082188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T19:01:34.349092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-19T19:01:50.875086+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-19T19:01:52.061232+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T19:02:11.537 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T19:02:11.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.672+0000 7f7b7da9c640 1 Processor -- start 2023-12-19T19:02:11.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.672+0000 7f7b7da9c640 1 -- start start 2023-12-19T19:02:11.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.676+0000 7f7b7da9c640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7b780c4100 0x7f7b780c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:11.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.676+0000 7f7b7da9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b780c06d0 0x7f7b780a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:11.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.676+0000 7f7b7da9c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b780c31c0 con 0x7f7b780c63c0 2023-12-19T19:02:11.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.676+0000 7f7b7da9c640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b780c34a0 con 0x7f7b780c4100 2023-12-19T19:02:11.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.676+0000 7f7b7da9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b780c1030 con 0x7f7b780c06d0 2023-12-19T19:02:11.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.676+0000 7f7b76ffd640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f7b780c4100 0x7f7b780c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:11.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.676+0000 7f7b77fff640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b780c06d0 0x7f7b780a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:11.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.676+0000 7f7b777fe640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f7b780c63c0 0x7f7b780c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:59476/0 (socket says 172.21.15.133:59476) 2023-12-19T19:02:11.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.676+0000 7f7b777fe640 1 -- 172.21.15.133:0/3315971555 learned_addr learned my addr 172.21.15.133:0/3315971555 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:11.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.676+0000 7f7b76ffd640 1 -- 172.21.15.133:0/3315971555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b780c06d0 msgr2=0x7f7b780a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:11.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.676+0000 7f7b76ffd640 1 --2- 172.21.15.133:0/3315971555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b780c06d0 0x7f7b780a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:11.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.676+0000 7f7b76ffd640 1 -- 172.21.15.133:0/3315971555 >> v1:172.21.15.138:6789/0 conn(0x7f7b780c63c0 legacy=0x7f7b780c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:11.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.676+0000 7f7b76ffd640 1 -- 172.21.15.133:0/3315971555 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b780c1310 con 0x7f7b780c4100 2023-12-19T19:02:11.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.676+0000 7f7b76ffd640 1 --2- 172.21.15.133:0/3315971555 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b780c4100 0x7f7b780c2bb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0097c0 tx=0x7f7b6c01c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eca850a689f04884 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:11.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.680+0000 7f7b767fc640 1 -- 172.21.15.133:0/3315971555 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b780aa3d0 con 0x7f7b780c4100 2023-12-19T19:02:11.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.680+0000 7f7b767fc640 1 -- 172.21.15.133:0/3315971555 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6c0a7050 con 0x7f7b780c4100 2023-12-19T19:02:11.683 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.680+0000 7f7b767fc640 1 -- 172.21.15.133:0/3315971555 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0ab820 con 0x7f7b780c4100 2023-12-19T19:02:11.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.680+0000 7f7b7da9c640 1 -- 172.21.15.133:0/3315971555 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b780c4100 msgr2=0x7f7b780c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:11.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.680+0000 7f7b7da9c640 1 --2- 172.21.15.133:0/3315971555 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b780c4100 0x7f7b780c2bb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0097c0 tx=0x7f7b6c01c360 comp rx=0 tx=0).stop 2023-12-19T19:02:11.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.680+0000 7f7b7da9c640 1 -- 172.21.15.133:0/3315971555 shutdown_connections 2023-12-19T19:02:11.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.680+0000 7f7b7da9c640 1 --2- 172.21.15.133:0/3315971555 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b780c06d0 0x7f7b780a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:11.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.680+0000 7f7b7da9c640 1 --2- 172.21.15.133:0/3315971555 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b780c4100 0x7f7b780c2bb0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:11.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.680+0000 7f7b7da9c640 1 -- 172.21.15.133:0/3315971555 >> 172.21.15.133:0/3315971555 conn(0x7f7b7806a5b0 msgr2=0x7f7b7806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:11.684 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.680+0000 7f7b7da9c640 1 -- 172.21.15.133:0/3315971555 shutdown_connections 2023-12-19T19:02:11.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.680+0000 7f7b7da9c640 1 -- 172.21.15.133:0/3315971555 wait complete. 2023-12-19T19:02:11.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.680+0000 7f7b7da9c640 1 Processor -- start 2023-12-19T19:02:11.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.680+0000 7f7b7da9c640 1 -- start start 2023-12-19T19:02:11.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.680+0000 7f7b7da9c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b780c06d0 0x7f7b7815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:11.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.680+0000 7f7b7da9c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b780c4100 0x7f7b781e9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:11.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.680+0000 7f7b7da9c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b780c63c0 0x7f7b781ea2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:11.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.680+0000 7f7b7da9c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7814d780 con 0x7f7b780c4100 2023-12-19T19:02:11.687 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.680+0000 7f7b7da9c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b780bb090 con 0x7f7b780c63c0 2023-12-19T19:02:11.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.680+0000 7f7b7da9c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b781f0fd0 con 0x7f7b780c06d0 2023-12-19T19:02:11.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.680+0000 7f7b76ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b780c4100 0x7f7b781e9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:11.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.684+0000 7f7b76ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b780c4100 0x7f7b781e9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49802/0 (socket says 172.21.15.133:49802) 2023-12-19T19:02:11.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.684+0000 7f7b76ffd640 1 -- 172.21.15.133:0/3589966482 learned_addr learned my addr 172.21.15.133:0/3589966482 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:11.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.684+0000 7f7b77fff640 1 --2- 172.21.15.133:0/3589966482 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b780c63c0 0x7f7b781ea2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:11.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.684+0000 7f7b777fe640 1 --2- 172.21.15.133:0/3589966482 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b780c06d0 0x7f7b7815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:11.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.684+0000 7f7b76ffd640 1 -- 172.21.15.133:0/3589966482 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b780c06d0 msgr2=0x7f7b7815a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:11.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.684+0000 7f7b76ffd640 1 --2- 172.21.15.133:0/3589966482 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b780c06d0 0x7f7b7815a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:11.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.684+0000 7f7b76ffd640 1 -- 172.21.15.133:0/3589966482 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b780c63c0 msgr2=0x7f7b781ea2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:11.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.684+0000 7f7b76ffd640 1 --2- 172.21.15.133:0/3589966482 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b780c63c0 0x7f7b781ea2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:11.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.684+0000 7f7b76ffd640 1 -- 172.21.15.133:0/3589966482 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6c009420 con 0x7f7b780c4100 2023-12-19T19:02:11.688 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.684+0000 7f7b777fe640 1 --2- 172.21.15.133:0/3589966482 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b780c06d0 0x7f7b7815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:11.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.684+0000 7f7b76ffd640 1 --2- 172.21.15.133:0/3589966482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b780c4100 0x7f7b781e9d80 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c019f90 tx=0x7f7b6c01aba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:11.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.684+0000 7f7b5ffff640 1 -- 172.21.15.133:0/3589966482 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0b7450 con 0x7f7b780c4100 2023-12-19T19:02:11.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.684+0000 7f7b5ffff640 1 -- 172.21.15.133:0/3589966482 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b6c0b75b0 con 0x7f7b780c4100 2023-12-19T19:02:11.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.684+0000 7f7b7da9c640 1 -- 172.21.15.133:0/3589966482 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b7814d9d0 con 0x7f7b780c4100 2023-12-19T19:02:11.689 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.684+0000 7f7b5ffff640 1 -- 172.21.15.133:0/3589966482 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c0b7960 con 0x7f7b780c4100 2023-12-19T19:02:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.684+0000 7f7b7da9c640 1 -- 172.21.15.133:0/3589966482 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b7815a960 con 0x7f7b780c4100 2023-12-19T19:02:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.684+0000 7f7b7da9c640 1 -- 172.21.15.133:0/3589966482 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b78068400 con 0x7f7b780c4100 2023-12-19T19:02:11.690 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.684+0000 7f7b5ffff640 1 -- 172.21.15.133:0/3589966482 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f7b6c0b7ac0 con 0x7f7b780c4100 2023-12-19T19:02:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.688+0000 7f7b5ffff640 1 --2- 172.21.15.133:0/3589966482 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b640664a0 0x7f7b64068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:11.691 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.688+0000 7f7b5ffff640 1 -- 172.21.15.133:0/3589966482 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7b6c11e9a0 con 0x7f7b780c4100 2023-12-19T19:02:11.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.688+0000 7f7b777fe640 1 --2- 172.21.15.133:0/3589966482 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b640664a0 0x7f7b64068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:11.692 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.688+0000 7f7b777fe640 1 --2- 172.21.15.133:0/3589966482 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b640664a0 0x7f7b64068960 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7b68005890 tx=0x7f7b68009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:11.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.692+0000 7f7b5ffff640 1 -- 172.21.15.133:0/3589966482 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7b6c0ebbd0 con 0x7f7b780c4100 2023-12-19T19:02:11.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.840+0000 7f7b7da9c640 1 -- 172.21.15.133:0/3589966482 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7b7806acc0 con 0x7f7b780c4100 2023-12-19T19:02:11.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.840+0000 7f7b5ffff640 1 -- 172.21.15.133:0/3589966482 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7b6c0bb0a0 con 0x7f7b780c4100 2023-12-19T19:02:11.847 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T19:02:11.848 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.844+0000 7f7b7da9c640 1 -- 172.21.15.133:0/3589966482 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b640664a0 msgr2=0x7f7b64068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:11.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.844+0000 7f7b7da9c640 1 --2- 172.21.15.133:0/3589966482 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b640664a0 0x7f7b64068960 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7b68005890 tx=0x7f7b68009040 comp rx=0 tx=0).stop 2023-12-19T19:02:11.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.844+0000 7f7b7da9c640 1 -- 172.21.15.133:0/3589966482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b780c4100 msgr2=0x7f7b781e9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:11.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.844+0000 7f7b7da9c640 1 --2- 172.21.15.133:0/3589966482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b780c4100 0x7f7b781e9d80 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c019f90 tx=0x7f7b6c01aba0 comp rx=0 tx=0).stop 2023-12-19T19:02:11.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.844+0000 7f7b7da9c640 1 -- 172.21.15.133:0/3589966482 shutdown_connections 2023-12-19T19:02:11.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.844+0000 7f7b7da9c640 1 --2- 172.21.15.133:0/3589966482 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7b640664a0 0x7f7b64068960 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:11.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.844+0000 7f7b7da9c640 1 --2- 172.21.15.133:0/3589966482 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7b780c63c0 0x7f7b781ea2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:11.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.844+0000 7f7b7da9c640 1 --2- 172.21.15.133:0/3589966482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7b780c4100 0x7f7b781e9d80 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:11.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.844+0000 7f7b7da9c640 1 --2- 172.21.15.133:0/3589966482 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f7b780c06d0 0x7f7b7815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:11.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.844+0000 7f7b7da9c640 1 -- 172.21.15.133:0/3589966482 >> 172.21.15.133:0/3589966482 conn(0x7f7b7806a5b0 msgr2=0x7f7b780a61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:11.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.844+0000 7f7b7da9c640 1 -- 172.21.15.133:0/3589966482 shutdown_connections 2023-12-19T19:02:11.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:11.844+0000 7f7b7da9c640 1 -- 172.21.15.133:0/3589966482 wait complete. 2023-12-19T19:02:11.867 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T19:02:12.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.004+0000 7fdfc5454640 1 Processor -- start 2023-12-19T19:02:12.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.004+0000 7fdfc5454640 1 -- start start 2023-12-19T19:02:12.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.004+0000 7fdfc5454640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdfc00c63c0 0x7fdfc00c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:12.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.004+0000 7fdfc5454640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fdfc00c4100 0x7fdfc00c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:12.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.004+0000 7fdfc5454640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc00c31c0 con 0x7fdfc00c29e0 2023-12-19T19:02:12.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.004+0000 7fdfc5454640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc00c34a0 con 0x7fdfc00c63c0 2023-12-19T19:02:12.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.004+0000 7fdfc5454640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc00c1030 con 0x7fdfc00c4100 2023-12-19T19:02:12.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.004+0000 7fdfbeffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdfc00c63c0 0x7fdfc00c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:12.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.004+0000 7fdfbeffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdfc00c63c0 0x7fdfc00c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49818/0 (socket says 172.21.15.133:49818) 2023-12-19T19:02:12.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.004+0000 7fdfbeffd640 1 -- 172.21.15.133:0/693387457 learned_addr learned my addr 172.21.15.133:0/693387457 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:12.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.004+0000 7fdfb67fc640 1 --2- 172.21.15.133:0/693387457 >> v2:172.21.15.138:3300/0 conn(0x7fdfc00c4100 0x7fdfc00c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:12.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.004+0000 7fdfbeffd640 1 -- 172.21.15.133:0/693387457 >> v2:172.21.15.138:3300/0 conn(0x7fdfc00c4100 msgr2=0x7fdfc00c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:12.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.004+0000 7fdfbeffd640 1 --2- 172.21.15.133:0/693387457 >> v2:172.21.15.138:3300/0 conn(0x7fdfc00c4100 0x7fdfc00c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.004+0000 7fdfbeffd640 1 -- 172.21.15.133:0/693387457 >> v1:172.21.15.138:6789/0 conn(0x7fdfc00c29e0 legacy=0x7fdfc00a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:12.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.004+0000 7fdfbeffd640 1 -- 172.21.15.133:0/693387457 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc00c1310 con 0x7fdfc00c63c0 2023-12-19T19:02:12.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.008+0000 7fdfbeffd640 1 --2- 172.21.15.133:0/693387457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc00c63c0 0x7fdfc00c06d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fdfc00a8b40 tx=0x7fdfb001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2385fc2fd4cbb4c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:12.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.008+0000 7fdfbe7fc640 1 -- 172.21.15.133:0/693387457 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb00ac630 con 0x7fdfc00c63c0 2023-12-19T19:02:12.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.008+0000 7fdfbe7fc640 1 -- 172.21.15.133:0/693387457 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb00ac790 con 0x7fdfc00c63c0 2023-12-19T19:02:12.013 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.008+0000 7fdfbe7fc640 1 -- 172.21.15.133:0/693387457 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb00acb20 con 0x7fdfc00c63c0 2023-12-19T19:02:12.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.008+0000 7fdfc5454640 1 -- 172.21.15.133:0/693387457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc00c63c0 msgr2=0x7fdfc00c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:12.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.008+0000 7fdfc5454640 1 --2- 172.21.15.133:0/693387457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc00c63c0 0x7fdfc00c06d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fdfc00a8b40 tx=0x7fdfb001c3b0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.008+0000 7fdfc5454640 1 -- 172.21.15.133:0/693387457 shutdown_connections 2023-12-19T19:02:12.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.008+0000 7fdfc5454640 1 --2- 172.21.15.133:0/693387457 >> v2:172.21.15.138:3300/0 conn(0x7fdfc00c4100 0x7fdfc00c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.008+0000 7fdfc5454640 1 --2- 172.21.15.133:0/693387457 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc00c63c0 0x7fdfc00c06d0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.008+0000 7fdfc5454640 1 -- 172.21.15.133:0/693387457 >> 172.21.15.133:0/693387457 conn(0x7fdfc006a5b0 msgr2=0x7fdfc006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:12.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.008+0000 7fdfc5454640 1 -- 172.21.15.133:0/693387457 shutdown_connections 2023-12-19T19:02:12.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.008+0000 7fdfc5454640 1 -- 172.21.15.133:0/693387457 wait complete. 2023-12-19T19:02:12.015 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfc5454640 1 Processor -- start 2023-12-19T19:02:12.016 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfc5454640 1 -- start start 2023-12-19T19:02:12.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfc5454640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfc00c29e0 0x7fdfc00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:12.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfc5454640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfc00c4100 0x7fdfc015a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:12.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfc5454640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc00c63c0 0x7fdfc01ed5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:12.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfc5454640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc01ed1c0 con 0x7fdfc00c63c0 2023-12-19T19:02:12.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfc5454640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc015b870 con 0x7fdfc00c4100 2023-12-19T19:02:12.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfc5454640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc015bae0 con 0x7fdfc00c29e0 2023-12-19T19:02:12.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfbeffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfc00c29e0 0x7fdfc00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:12.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfbf7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc00c63c0 0x7fdfc01ed5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:12.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfbeffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfc00c29e0 0x7fdfc00a57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:49058/0 (socket says 172.21.15.133:49058) 2023-12-19T19:02:12.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfbeffd640 1 -- 172.21.15.133:0/2735905418 learned_addr learned my addr 172.21.15.133:0/2735905418 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:12.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfb67fc640 1 --2- 172.21.15.133:0/2735905418 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfc00c4100 0x7fdfc015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:12.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfbf7fe640 1 -- 172.21.15.133:0/2735905418 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfc00c29e0 msgr2=0x7fdfc00a57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:12.018 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfbf7fe640 1 --2- 172.21.15.133:0/2735905418 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfc00c29e0 0x7fdfc00a57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfbf7fe640 1 -- 172.21.15.133:0/2735905418 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfc00c4100 msgr2=0x7fdfc015a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:12.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfbf7fe640 1 --2- 172.21.15.133:0/2735905418 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfc00c4100 0x7fdfc015a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfbf7fe640 1 -- 172.21.15.133:0/2735905418 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb00094d0 con 0x7fdfc00c63c0 2023-12-19T19:02:12.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfbf7fe640 1 --2- 172.21.15.133:0/2735905418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc00c63c0 0x7fdfc01ed5e0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800c730 tx=0x7fdfb800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:12.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfb7fff640 1 -- 172.21.15.133:0/2735905418 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8003b80 con 0x7fdfc00c63c0 2023-12-19T19:02:12.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfb7fff640 1 -- 172.21.15.133:0/2735905418 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb8003ce0 con 0x7fdfc00c63c0 2023-12-19T19:02:12.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfb7fff640 1 -- 172.21.15.133:0/2735905418 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb800aa30 con 0x7fdfc00c63c0 2023-12-19T19:02:12.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfc5454640 1 -- 172.21.15.133:0/2735905418 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc00bf160 con 0x7fdfc00c63c0 2023-12-19T19:02:12.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.012+0000 7fdfc5454640 1 -- 172.21.15.133:0/2735905418 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc01ecde0 con 0x7fdfc00c63c0 2023-12-19T19:02:12.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.016+0000 7fdfc5454640 1 -- 172.21.15.133:0/2735905418 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc01ecfa0 con 0x7fdfc00c63c0 2023-12-19T19:02:12.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.016+0000 7fdfb7fff640 1 -- 172.21.15.133:0/2735905418 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fdfb800ab90 con 0x7fdfc00c63c0 2023-12-19T19:02:12.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.016+0000 7fdfb7fff640 1 --2- 172.21.15.133:0/2735905418 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdfa4066470 0x7fdfa4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:12.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.016+0000 7fdfb7fff640 1 -- 172.21.15.133:0/2735905418 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdfb8083ed0 con 0x7fdfc00c63c0 2023-12-19T19:02:12.021 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.016+0000 7fdfbeffd640 1 --2- 172.21.15.133:0/2735905418 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdfa4066470 0x7fdfa4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:12.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.016+0000 7fdfbeffd640 1 --2- 172.21.15.133:0/2735905418 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdfa4066470 0x7fdfa4068930 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdfb001c3f0 tx=0x7fdfb0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:12.025 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.020+0000 7fdfb7fff640 1 -- 172.21.15.133:0/2735905418 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fdfb8051000 con 0x7fdfc00c63c0 2023-12-19T19:02:12.065 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T19:02:12.068 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T19:02:12.177 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.172+0000 7fdfc5454640 1 -- 172.21.15.133:0/2735905418 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdfc01ed300 con 0x7fdfc00c63c0 2023-12-19T19:02:12.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.172+0000 7fdfb7fff640 1 -- 172.21.15.133:0/2735905418 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdfc01ed300 con 0x7fdfc00c63c0 2023-12-19T19:02:12.178 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:02:12.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.176+0000 7fdfc5454640 1 -- 172.21.15.133:0/2735905418 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdfa4066470 msgr2=0x7fdfa4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:12.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.176+0000 7fdfc5454640 1 --2- 172.21.15.133:0/2735905418 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdfa4066470 0x7fdfa4068930 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdfb001c3f0 tx=0x7fdfb0008040 comp rx=0 tx=0).stop 2023-12-19T19:02:12.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.176+0000 7fdfc5454640 1 -- 172.21.15.133:0/2735905418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc00c63c0 msgr2=0x7fdfc01ed5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:12.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.176+0000 7fdfc5454640 1 --2- 172.21.15.133:0/2735905418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc00c63c0 0x7fdfc01ed5e0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fdfb800c730 tx=0x7fdfb800cbf0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.176+0000 7fdfc5454640 1 -- 172.21.15.133:0/2735905418 shutdown_connections 2023-12-19T19:02:12.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.176+0000 7fdfc5454640 1 --2- 172.21.15.133:0/2735905418 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdfa4066470 0x7fdfa4068930 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.176+0000 7fdfc5454640 1 --2- 172.21.15.133:0/2735905418 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc00c63c0 0x7fdfc01ed5e0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.176+0000 7fdfc5454640 1 --2- 172.21.15.133:0/2735905418 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdfc00c4100 0x7fdfc015a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.176+0000 7fdfc5454640 1 --2- 172.21.15.133:0/2735905418 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdfc00c29e0 0x7fdfc00a57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.176+0000 7fdfc5454640 1 -- 172.21.15.133:0/2735905418 >> 172.21.15.133:0/2735905418 conn(0x7fdfc006a5b0 msgr2=0x7fdfc0066360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:12.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.176+0000 7fdfc5454640 1 -- 172.21.15.133:0/2735905418 shutdown_connections 2023-12-19T19:02:12.180 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.176+0000 7fdfc5454640 1 -- 172.21.15.133:0/2735905418 wait complete. 2023-12-19T19:02:12.198 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T19:02:12.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.332+0000 7f3d7c49a640 1 Processor -- start 2023-12-19T19:02:12.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.332+0000 7f3d7c49a640 1 -- start start 2023-12-19T19:02:12.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.336+0000 7f3d7c49a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f3d740c63c0 0x7f3d740c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:12.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.336+0000 7f3d7c49a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3d740c2bb0 0x7f3d740a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:12.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.336+0000 7f3d7c49a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d740c31c0 con 0x7f3d740c4100 2023-12-19T19:02:12.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.336+0000 7f3d7c49a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d740c34a0 con 0x7f3d740c2bb0 2023-12-19T19:02:12.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.336+0000 7f3d7c49a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d740c1030 con 0x7f3d740c63c0 2023-12-19T19:02:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.336+0000 7f3d7aa37640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3d740c2bb0 0x7f3d740a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.336+0000 7f3d7aa37640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3d740c2bb0 0x7f3d740a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49844/0 (socket says 172.21.15.133:49844) 2023-12-19T19:02:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.336+0000 7f3d7aa37640 1 -- 172.21.15.133:0/2469405935 learned_addr learned my addr 172.21.15.133:0/2469405935 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.336+0000 7f3d7a236640 1 --2- 172.21.15.133:0/2469405935 >> v2:172.21.15.138:3300/0 conn(0x7f3d740c63c0 0x7f3d740c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.336+0000 7f3d7aa37640 1 -- 172.21.15.133:0/2469405935 >> v2:172.21.15.138:3300/0 conn(0x7f3d740c63c0 msgr2=0x7f3d740c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.336+0000 7f3d7aa37640 1 --2- 172.21.15.133:0/2469405935 >> v2:172.21.15.138:3300/0 conn(0x7f3d740c63c0 0x7f3d740c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.336+0000 7f3d7aa37640 1 -- 172.21.15.133:0/2469405935 >> v1:172.21.15.138:6789/0 conn(0x7f3d740c4100 legacy=0x7f3d740c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:12.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.336+0000 7f3d7aa37640 1 -- 172.21.15.133:0/2469405935 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d740c1310 con 0x7f3d740c2bb0 2023-12-19T19:02:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.340+0000 7f3d7aa37640 1 --2- 172.21.15.133:0/2469405935 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d740c2bb0 0x7f3d740a9680 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f3d7406e000 tx=0x7f3d6c01eab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e05c1019f703e37 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.340+0000 7f3d79234640 1 -- 172.21.15.133:0/2469405935 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d740aa3d0 con 0x7f3d740c2bb0 2023-12-19T19:02:12.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.340+0000 7f3d79234640 1 -- 172.21.15.133:0/2469405935 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6c00b2d0 con 0x7f3d740c2bb0 2023-12-19T19:02:12.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.340+0000 7f3d79234640 1 -- 172.21.15.133:0/2469405935 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c0a7bc0 con 0x7f3d740c2bb0 2023-12-19T19:02:12.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.340+0000 7f3d7c49a640 1 -- 172.21.15.133:0/2469405935 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d740c2bb0 msgr2=0x7f3d740a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:12.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.340+0000 7f3d7c49a640 1 --2- 172.21.15.133:0/2469405935 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d740c2bb0 0x7f3d740a9680 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f3d7406e000 tx=0x7f3d6c01eab0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.344 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.340+0000 7f3d7c49a640 1 -- 172.21.15.133:0/2469405935 shutdown_connections 2023-12-19T19:02:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.340+0000 7f3d7c49a640 1 --2- 172.21.15.133:0/2469405935 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d740c2bb0 0x7f3d740a9680 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.340+0000 7f3d7c49a640 1 --2- 172.21.15.133:0/2469405935 >> v2:172.21.15.138:3300/0 conn(0x7f3d740c63c0 0x7f3d740c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.340+0000 7f3d7c49a640 1 -- 172.21.15.133:0/2469405935 >> 172.21.15.133:0/2469405935 conn(0x7f3d7406a5b0 msgr2=0x7f3d7406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.340+0000 7f3d7c49a640 1 -- 172.21.15.133:0/2469405935 shutdown_connections 2023-12-19T19:02:12.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.340+0000 7f3d7c49a640 1 -- 172.21.15.133:0/2469405935 wait complete. 2023-12-19T19:02:12.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.340+0000 7f3d7c49a640 1 Processor -- start 2023-12-19T19:02:12.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.340+0000 7f3d7c49a640 1 -- start start 2023-12-19T19:02:12.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d7c49a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d740c2bb0 0x7f3d7415a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:12.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d7c49a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d740c4100 0x7f3d741581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:12.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d7c49a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3d740c63c0 0x7f3d741567a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:12.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d7c49a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7415a510 con 0x7f3d740c2bb0 2023-12-19T19:02:12.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d7c49a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d741f0aa0 con 0x7f3d740c4100 2023-12-19T19:02:12.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d7c49a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d74159ec0 con 0x7f3d740c63c0 2023-12-19T19:02:12.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d7a236640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d740c2bb0 0x7f3d7415a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:12.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d7a236640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d740c2bb0 0x7f3d7415a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49856/0 (socket says 172.21.15.133:49856) 2023-12-19T19:02:12.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d7a236640 1 -- 172.21.15.133:0/3891073826 learned_addr learned my addr 172.21.15.133:0/3891073826 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:12.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d7aa37640 1 --2- 172.21.15.133:0/3891073826 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3d740c63c0 0x7f3d741567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:12.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d79a35640 1 --2- 172.21.15.133:0/3891073826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d740c4100 0x7f3d741581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:12.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d7a236640 1 -- 172.21.15.133:0/3891073826 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3d740c63c0 msgr2=0x7f3d741567a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:12.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d7a236640 1 --2- 172.21.15.133:0/3891073826 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3d740c63c0 0x7f3d741567a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d7a236640 1 -- 172.21.15.133:0/3891073826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d740c4100 msgr2=0x7f3d741581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:12.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d7a236640 1 --2- 172.21.15.133:0/3891073826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d740c4100 0x7f3d741581f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d7a236640 1 -- 172.21.15.133:0/3891073826 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c00bd40 con 0x7f3d740c2bb0 2023-12-19T19:02:12.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d7a236640 1 --2- 172.21.15.133:0/3891073826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d740c2bb0 0x7f3d7415a9a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000d5f0 tx=0x7f3d7000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:12.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d6affd640 1 -- 172.21.15.133:0/3891073826 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d700125f0 con 0x7f3d740c2bb0 2023-12-19T19:02:12.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d6affd640 1 -- 172.21.15.133:0/3891073826 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d70012750 con 0x7f3d740c2bb0 2023-12-19T19:02:12.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d7c49a640 1 -- 172.21.15.133:0/3891073826 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d7415a1a0 con 0x7f3d740c2bb0 2023-12-19T19:02:12.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d6affd640 1 -- 172.21.15.133:0/3891073826 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d70012b00 con 0x7f3d740c2bb0 2023-12-19T19:02:12.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d7c49a640 1 -- 172.21.15.133:0/3891073826 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d74158730 con 0x7f3d740c2bb0 2023-12-19T19:02:12.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d7c49a640 1 -- 172.21.15.133:0/3891073826 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d74068400 con 0x7f3d740c2bb0 2023-12-19T19:02:12.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.344+0000 7f3d6affd640 1 -- 172.21.15.133:0/3891073826 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f3d70012c60 con 0x7f3d740c2bb0 2023-12-19T19:02:12.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.348+0000 7f3d6affd640 1 --2- 172.21.15.133:0/3891073826 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3d580664a0 0x7f3d58068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:12.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.348+0000 7f3d6affd640 1 -- 172.21.15.133:0/3891073826 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3d70084670 con 0x7f3d740c2bb0 2023-12-19T19:02:12.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.348+0000 7f3d79a35640 1 --2- 172.21.15.133:0/3891073826 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3d580664a0 0x7f3d58068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:12.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.348+0000 7f3d79a35640 1 --2- 172.21.15.133:0/3891073826 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3d580664a0 0x7f3d58068960 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3d74072b80 tx=0x7f3d64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:12.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.348+0000 7f3d6affd640 1 -- 172.21.15.133:0/3891073826 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f3d70051780 con 0x7f3d740c2bb0 2023-12-19T19:02:12.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.500+0000 7f3d7c49a640 1 -- 172.21.15.133:0/3891073826 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3d740c3e70 con 0x7f3d740c2bb0 2023-12-19T19:02:12.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.500+0000 7f3d6affd640 1 -- 172.21.15.133:0/3891073826 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3d70054da0 con 0x7f3d740c2bb0 2023-12-19T19:02:12.504 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:02:12.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.500+0000 7f3d7c49a640 1 -- 172.21.15.133:0/3891073826 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3d580664a0 msgr2=0x7f3d58068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:12.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.500+0000 7f3d7c49a640 1 --2- 172.21.15.133:0/3891073826 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3d580664a0 0x7f3d58068960 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3d74072b80 tx=0x7f3d64009040 comp rx=0 tx=0).stop 2023-12-19T19:02:12.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.500+0000 7f3d7c49a640 1 -- 172.21.15.133:0/3891073826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d740c2bb0 msgr2=0x7f3d7415a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:12.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.500+0000 7f3d7c49a640 1 --2- 172.21.15.133:0/3891073826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d740c2bb0 0x7f3d7415a9a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f3d7000d5f0 tx=0x7f3d7000dab0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.500+0000 7f3d7c49a640 1 -- 172.21.15.133:0/3891073826 shutdown_connections 2023-12-19T19:02:12.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.500+0000 7f3d7c49a640 1 --2- 172.21.15.133:0/3891073826 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3d580664a0 0x7f3d58068960 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.500+0000 7f3d7c49a640 1 --2- 172.21.15.133:0/3891073826 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f3d740c63c0 0x7f3d741567a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.500+0000 7f3d7c49a640 1 --2- 172.21.15.133:0/3891073826 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f3d740c4100 0x7f3d741581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.500+0000 7f3d7c49a640 1 --2- 172.21.15.133:0/3891073826 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3d740c2bb0 0x7f3d7415a9a0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.500+0000 7f3d7c49a640 1 -- 172.21.15.133:0/3891073826 >> 172.21.15.133:0/3891073826 conn(0x7f3d7406a5b0 msgr2=0x7f3d74071e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:12.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.500+0000 7f3d7c49a640 1 -- 172.21.15.133:0/3891073826 shutdown_connections 2023-12-19T19:02:12.507 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.500+0000 7f3d7c49a640 1 -- 172.21.15.133:0/3891073826 wait complete. 2023-12-19T19:02:12.525 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-19T19:02:12.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.664+0000 7f2e6f59e640 1 Processor -- start 2023-12-19T19:02:12.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.664+0000 7f2e6f59e640 1 -- start start 2023-12-19T19:02:12.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.664+0000 7f2e6f59e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2e700c4750 0x7f2e700c4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:12.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.664+0000 7f2e6f59e640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e7006c660 con 0x7f2e701544c0 2023-12-19T19:02:12.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.664+0000 7f2e6f59e640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e7006ba50 con 0x7f2e700af5c0 2023-12-19T19:02:12.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.664+0000 7f2e6f59e640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7006bd30 con 0x7f2e700c4750 2023-12-19T19:02:12.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.664+0000 7f2e6ed9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2e701544c0 0x7f2e70154910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41706/0 (socket says 172.21.15.133:41706) 2023-12-19T19:02:12.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.664+0000 7f2e6ed9d640 1 -- 172.21.15.133:0/967398990 learned_addr learned my addr 172.21.15.133:0/967398990 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:12.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.664+0000 7f2e6dd9b640 1 --2- 172.21.15.133:0/967398990 >> v2:172.21.15.138:3300/0 conn(0x7f2e700c4750 0x7f2e700c4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:12.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.664+0000 7f2e6d59a640 1 -- 172.21.15.133:0/967398990 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2371365104 0 0) 0x7f2e7006c660 con 0x7f2e701544c0 2023-12-19T19:02:12.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.664+0000 7f2e6d59a640 1 -- 172.21.15.133:0/967398990 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e58003530 con 0x7f2e701544c0 2023-12-19T19:02:12.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.664+0000 7f2e6d59a640 1 -- 172.21.15.133:0/967398990 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114476571 0 0) 0x7f2e7006ba50 con 0x7f2e700af5c0 2023-12-19T19:02:12.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.664+0000 7f2e6d59a640 1 -- 172.21.15.133:0/967398990 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e7006c660 con 0x7f2e700af5c0 2023-12-19T19:02:12.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.664+0000 7f2e6dd9b640 1 -- 172.21.15.133:0/967398990 >> v1:172.21.15.138:6789/0 conn(0x7f2e700af5c0 legacy=0x7f2e700c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:12.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.664+0000 7f2e6dd9b640 1 -- 172.21.15.133:0/967398990 >> v1:172.21.15.133:6789/0 conn(0x7f2e701544c0 legacy=0x7f2e70154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:12.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.664+0000 7f2e6dd9b640 1 -- 172.21.15.133:0/967398990 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7006c010 con 0x7f2e700c4750 2023-12-19T19:02:12.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.668+0000 7f2e6dd9b640 1 --2- 172.21.15.133:0/967398990 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e700c4750 0x7f2e700c4bc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2e640097c0 tx=0x7f2e6401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e343fb9bfb6b4a59 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:12.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.668+0000 7f2e6d59a640 1 -- 172.21.15.133:0/967398990 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e640a8050 con 0x7f2e700c4750 2023-12-19T19:02:12.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.668+0000 7f2e6d59a640 1 -- 172.21.15.133:0/967398990 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e640ac5f0 con 0x7f2e700c4750 2023-12-19T19:02:12.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.668+0000 7f2e6d59a640 1 -- 172.21.15.133:0/967398990 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e640ac980 con 0x7f2e700c4750 2023-12-19T19:02:12.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.668+0000 7f2e6f59e640 1 -- 172.21.15.133:0/967398990 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e700c4750 msgr2=0x7f2e700c4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:12.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.668+0000 7f2e6f59e640 1 --2- 172.21.15.133:0/967398990 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e700c4750 0x7f2e700c4bc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f2e640097c0 tx=0x7f2e6401c480 comp rx=0 tx=0).stop 2023-12-19T19:02:12.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.668+0000 7f2e6f59e640 1 -- 172.21.15.133:0/967398990 shutdown_connections 2023-12-19T19:02:12.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.668+0000 7f2e6f59e640 1 --2- 172.21.15.133:0/967398990 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e700c4750 0x7f2e700c4bc0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.668+0000 7f2e6f59e640 1 -- 172.21.15.133:0/967398990 >> 172.21.15.133:0/967398990 conn(0x7f2e700ab960 msgr2=0x7f2e700abd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:12.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.668+0000 7f2e6f59e640 1 -- 172.21.15.133:0/967398990 shutdown_connections 2023-12-19T19:02:12.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.668+0000 7f2e6f59e640 1 -- 172.21.15.133:0/967398990 wait complete. 2023-12-19T19:02:12.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e6f59e640 1 Processor -- start 2023-12-19T19:02:12.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e6f59e640 1 -- start start 2023-12-19T19:02:12.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e6f59e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e700af5c0 0x7f2e700acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:12.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e6f59e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e700c4750 0x7f2e700ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:12.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e6f59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e701544c0 0x7f2e700ae7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:12.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e6f59e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e70150ae0 con 0x7f2e701544c0 2023-12-19T19:02:12.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e6f59e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7014fda0 con 0x7f2e700c4750 2023-12-19T19:02:12.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e6f59e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7014fff0 con 0x7f2e700af5c0 2023-12-19T19:02:12.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e6ed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e701544c0 0x7f2e700ae7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:12.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e6ed9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e701544c0 0x7f2e700ae7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49858/0 (socket says 172.21.15.133:49858) 2023-12-19T19:02:12.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e6ed9d640 1 -- 172.21.15.133:0/1615064728 learned_addr learned my addr 172.21.15.133:0/1615064728 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:12.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e6e59c640 1 --2- 172.21.15.133:0/1615064728 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e700af5c0 0x7f2e700acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:12.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e6dd9b640 1 --2- 172.21.15.133:0/1615064728 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e700c4750 0x7f2e700ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:12.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e6ed9d640 1 -- 172.21.15.133:0/1615064728 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e700af5c0 msgr2=0x7f2e700acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:12.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e6ed9d640 1 --2- 172.21.15.133:0/1615064728 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e700af5c0 0x7f2e700acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e6ed9d640 1 -- 172.21.15.133:0/1615064728 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e700c4750 msgr2=0x7f2e700ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:12.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e6ed9d640 1 --2- 172.21.15.133:0/1615064728 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e700c4750 0x7f2e700ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e6ed9d640 1 -- 172.21.15.133:0/1615064728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e64009420 con 0x7f2e701544c0 2023-12-19T19:02:12.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e6dd9b640 1 --2- 172.21.15.133:0/1615064728 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e700c4750 0x7f2e700ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:12.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e6ed9d640 1 --2- 172.21.15.133:0/1615064728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e701544c0 0x7f2e700ae7f0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800cba0 tx=0x7f2e6800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:12.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e5effd640 1 -- 172.21.15.133:0/1615064728 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6800ace0 con 0x7f2e701544c0 2023-12-19T19:02:12.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e5effd640 1 -- 172.21.15.133:0/1615064728 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6800ae40 con 0x7f2e701544c0 2023-12-19T19:02:12.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e5effd640 1 -- 172.21.15.133:0/1615064728 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68012620 con 0x7f2e701544c0 2023-12-19T19:02:12.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e6f59e640 1 -- 172.21.15.133:0/1615064728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e701502d0 con 0x7f2e701544c0 2023-12-19T19:02:12.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.672+0000 7f2e6f59e640 1 -- 172.21.15.133:0/1615064728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e700ad310 con 0x7f2e701544c0 2023-12-19T19:02:12.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.676+0000 7f2e6f59e640 1 -- 172.21.15.133:0/1615064728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e700adfd0 con 0x7f2e701544c0 2023-12-19T19:02:12.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.676+0000 7f2e5effd640 1 -- 172.21.15.133:0/1615064728 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2e68007070 con 0x7f2e701544c0 2023-12-19T19:02:12.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.676+0000 7f2e5effd640 1 --2- 172.21.15.133:0/1615064728 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2e50066470 0x7f2e50068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:12.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.676+0000 7f2e5effd640 1 -- 172.21.15.133:0/1615064728 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2e68084230 con 0x7f2e701544c0 2023-12-19T19:02:12.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.676+0000 7f2e6e59c640 1 --2- 172.21.15.133:0/1615064728 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2e50066470 0x7f2e50068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:12.682 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.676+0000 7f2e6e59c640 1 --2- 172.21.15.133:0/1615064728 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2e50066470 0x7f2e50068930 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2e600011f0 tx=0x7f2e60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:12.685 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.680+0000 7f2e5effd640 1 -- 172.21.15.133:0/1615064728 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2e700adfd0 con 0x7f2e701544c0 2023-12-19T19:02:12.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.828+0000 7f2e6f59e640 1 -- 172.21.15.133:0/1615064728 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2e700adfd0 con 0x7f2e701544c0 2023-12-19T19:02:12.835 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.828+0000 7f2e5effd640 1 -- 172.21.15.133:0/1615064728 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v73) v1 ==== 105+0+11 (secure 0 0 0) 0x7f2e700adfd0 con 0x7f2e701544c0 2023-12-19T19:02:12.835 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:02:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.832+0000 7f2e6f59e640 1 -- 172.21.15.133:0/1615064728 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2e50066470 msgr2=0x7f2e50068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.832+0000 7f2e6f59e640 1 --2- 172.21.15.133:0/1615064728 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2e50066470 0x7f2e50068930 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2e600011f0 tx=0x7f2e60009040 comp rx=0 tx=0).stop 2023-12-19T19:02:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.832+0000 7f2e6f59e640 1 -- 172.21.15.133:0/1615064728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e701544c0 msgr2=0x7f2e700ae7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.832+0000 7f2e6f59e640 1 --2- 172.21.15.133:0/1615064728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e701544c0 0x7f2e700ae7f0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800cba0 tx=0x7f2e6800a430 comp rx=0 tx=0).stop 2023-12-19T19:02:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.832+0000 7f2e6f59e640 1 -- 172.21.15.133:0/1615064728 shutdown_connections 2023-12-19T19:02:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.832+0000 7f2e6f59e640 1 --2- 172.21.15.133:0/1615064728 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2e50066470 0x7f2e50068930 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.832+0000 7f2e6f59e640 1 --2- 172.21.15.133:0/1615064728 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e701544c0 0x7f2e700ae7f0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.832+0000 7f2e6f59e640 1 --2- 172.21.15.133:0/1615064728 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2e700c4750 0x7f2e700ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.832+0000 7f2e6f59e640 1 --2- 172.21.15.133:0/1615064728 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2e700af5c0 0x7f2e700acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.832+0000 7f2e6f59e640 1 -- 172.21.15.133:0/1615064728 >> 172.21.15.133:0/1615064728 conn(0x7f2e700ab960 msgr2=0x7f2e7015f060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:12.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.832+0000 7f2e6f59e640 1 -- 172.21.15.133:0/1615064728 shutdown_connections 2023-12-19T19:02:12.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.832+0000 7f2e6f59e640 1 -- 172.21.15.133:0/1615064728 wait complete. 2023-12-19T19:02:12.856 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-19T19:02:12.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.992+0000 7f6e6d72a640 1 Processor -- start 2023-12-19T19:02:12.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.992+0000 7f6e6d72a640 1 -- start start 2023-12-19T19:02:12.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.992+0000 7f6e6d72a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6e6806fdb0 0x7f6e680c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:12.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.992+0000 7f6e6d72a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e681577f0 0x7f6e68157c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:12.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.992+0000 7f6e6d72a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e680c1db0 con 0x7f6e68157410 2023-12-19T19:02:12.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.992+0000 7f6e6d72a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e680c2090 con 0x7f6e6806fdb0 2023-12-19T19:02:12.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.992+0000 7f6e6d72a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e680c5cd0 con 0x7f6e681577f0 2023-12-19T19:02:13.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.996+0000 7f6e677fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e681577f0 0x7f6e68157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:13.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.996+0000 7f6e66ffd640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f6e68157410 0x7f6e680c64d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:59514/0 (socket says 172.21.15.133:59514) 2023-12-19T19:02:13.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.996+0000 7f6e66ffd640 1 -- 172.21.15.133:0/2256212357 learned_addr learned my addr 172.21.15.133:0/2256212357 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:13.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.996+0000 7f6e5e7fc640 1 --2- 172.21.15.133:0/2256212357 >> v2:172.21.15.138:3300/0 conn(0x7f6e6806fdb0 0x7f6e680c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:13.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.996+0000 7f6e5e7fc640 1 -- 172.21.15.133:0/2256212357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e681577f0 msgr2=0x7f6e68157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:13.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.996+0000 7f6e5e7fc640 1 --2- 172.21.15.133:0/2256212357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e681577f0 0x7f6e68157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.996+0000 7f6e5e7fc640 1 -- 172.21.15.133:0/2256212357 >> v1:172.21.15.138:6789/0 conn(0x7f6e68157410 legacy=0x7f6e680c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:13.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.996+0000 7f6e5e7fc640 1 -- 172.21.15.133:0/2256212357 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e680c5fb0 con 0x7f6e6806fdb0 2023-12-19T19:02:13.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.996+0000 7f6e677fe640 1 --2- 172.21.15.133:0/2256212357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e681577f0 0x7f6e68157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:02:13.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.996+0000 7f6e5e7fc640 1 --2- 172.21.15.133:0/2256212357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e6806fdb0 0x7f6e680c6be0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6e580097c0 tx=0x7f6e5801c1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b2b989a29b396df server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:13.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.996+0000 7f6e667fc640 1 -- 172.21.15.133:0/2256212357 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e580ab600 con 0x7f6e6806fdb0 2023-12-19T19:02:13.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.996+0000 7f6e667fc640 1 -- 172.21.15.133:0/2256212357 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e580a7050 con 0x7f6e6806fdb0 2023-12-19T19:02:13.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:12.996+0000 7f6e667fc640 1 -- 172.21.15.133:0/2256212357 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e580ab980 con 0x7f6e6806fdb0 2023-12-19T19:02:13.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e6d72a640 1 -- 172.21.15.133:0/2256212357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e6806fdb0 msgr2=0x7f6e680c6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:13.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e6d72a640 1 --2- 172.21.15.133:0/2256212357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e6806fdb0 0x7f6e680c6be0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f6e580097c0 tx=0x7f6e5801c1c0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e6d72a640 1 -- 172.21.15.133:0/2256212357 shutdown_connections 2023-12-19T19:02:13.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e6d72a640 1 --2- 172.21.15.133:0/2256212357 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e681577f0 0x7f6e68157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e6d72a640 1 --2- 172.21.15.133:0/2256212357 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e6806fdb0 0x7f6e680c6be0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e6d72a640 1 -- 172.21.15.133:0/2256212357 >> 172.21.15.133:0/2256212357 conn(0x7f6e680a9b80 msgr2=0x7f6e680a9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:13.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e6d72a640 1 -- 172.21.15.133:0/2256212357 shutdown_connections 2023-12-19T19:02:13.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e6d72a640 1 -- 172.21.15.133:0/2256212357 wait complete. 2023-12-19T19:02:13.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e6d72a640 1 Processor -- start 2023-12-19T19:02:13.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e6d72a640 1 -- start start 2023-12-19T19:02:13.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e6d72a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6806fdb0 0x7f6e6814b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:13.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e6d72a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e68157410 0x7f6e68151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:13.007 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e6d72a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e681577f0 0x7f6e6806dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e6d72a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e681554b0 con 0x7f6e6806fdb0 2023-12-19T19:02:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e6d72a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e68153790 con 0x7f6e681577f0 2023-12-19T19:02:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e6d72a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e6806ce00 con 0x7f6e68157410 2023-12-19T19:02:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e66ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6806fdb0 0x7f6e6814b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e66ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6806fdb0 0x7f6e6814b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49864/0 (socket says 172.21.15.133:49864) 2023-12-19T19:02:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e66ffd640 1 -- 172.21.15.133:0/2996485110 learned_addr learned my addr 172.21.15.133:0/2996485110 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e5e7fc640 1 --2- 172.21.15.133:0/2996485110 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e68157410 0x7f6e68151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e677fe640 1 --2- 172.21.15.133:0/2996485110 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e681577f0 0x7f6e6806dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e66ffd640 1 -- 172.21.15.133:0/2996485110 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e68157410 msgr2=0x7f6e68151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e66ffd640 1 --2- 172.21.15.133:0/2996485110 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e68157410 0x7f6e68151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e66ffd640 1 -- 172.21.15.133:0/2996485110 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e681577f0 msgr2=0x7f6e6806dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e66ffd640 1 --2- 172.21.15.133:0/2996485110 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e681577f0 0x7f6e6806dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.000+0000 7f6e66ffd640 1 -- 172.21.15.133:0/2996485110 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e60009a70 con 0x7f6e6806fdb0 2023-12-19T19:02:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.004+0000 7f6e66ffd640 1 --2- 172.21.15.133:0/2996485110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6806fdb0 0x7f6e6814b610 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000c500 tx=0x7f6e5000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:13.008 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.004+0000 7f6e5ffff640 1 -- 172.21.15.133:0/2996485110 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e50005cf0 con 0x7f6e6806fdb0 2023-12-19T19:02:13.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.004+0000 7f6e5ffff640 1 -- 172.21.15.133:0/2996485110 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e50005e50 con 0x7f6e6806fdb0 2023-12-19T19:02:13.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.004+0000 7f6e6d72a640 1 -- 172.21.15.133:0/2996485110 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e58009420 con 0x7f6e6806fdb0 2023-12-19T19:02:13.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.004+0000 7f6e5ffff640 1 -- 172.21.15.133:0/2996485110 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e500072f0 con 0x7f6e6806fdb0 2023-12-19T19:02:13.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.004+0000 7f6e6d72a640 1 -- 172.21.15.133:0/2996485110 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e6814bf70 con 0x7f6e6806fdb0 2023-12-19T19:02:13.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.004+0000 7f6e6d72a640 1 -- 172.21.15.133:0/2996485110 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e68068400 con 0x7f6e6806fdb0 2023-12-19T19:02:13.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.004+0000 7f6e5ffff640 1 -- 172.21.15.133:0/2996485110 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6e50007450 con 0x7f6e6806fdb0 2023-12-19T19:02:13.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.004+0000 7f6e5ffff640 1 --2- 172.21.15.133:0/2996485110 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6e48066470 0x7f6e48068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:13.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.004+0000 7f6e5ffff640 1 -- 172.21.15.133:0/2996485110 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6e50083690 con 0x7f6e6806fdb0 2023-12-19T19:02:13.010 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.004+0000 7f6e5e7fc640 1 --2- 172.21.15.133:0/2996485110 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6e48066470 0x7f6e48068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:13.011 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.008+0000 7f6e5e7fc640 1 --2- 172.21.15.133:0/2996485110 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6e48066470 0x7f6e48068930 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6e580ad000 tx=0x7f6e58008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:13.014 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.008+0000 7f6e5ffff640 1 -- 172.21.15.133:0/2996485110 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6e50050850 con 0x7f6e6806fdb0 2023-12-19T19:02:13.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.156+0000 7f6e6d72a640 1 -- 172.21.15.133:0/2996485110 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f6e680675d0 con 0x7f6e6806fdb0 2023-12-19T19:02:13.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.160+0000 7f6e5ffff640 1 -- 172.21.15.133:0/2996485110 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v73) v1 ==== 101+0+11 (secure 0 0 0) 0x7f6e50053e70 con 0x7f6e6806fdb0 2023-12-19T19:02:13.164 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:02:13.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.160+0000 7f6e6d72a640 1 -- 172.21.15.133:0/2996485110 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6e48066470 msgr2=0x7f6e48068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:13.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.160+0000 7f6e6d72a640 1 --2- 172.21.15.133:0/2996485110 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6e48066470 0x7f6e48068930 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6e580ad000 tx=0x7f6e58008040 comp rx=0 tx=0).stop 2023-12-19T19:02:13.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.160+0000 7f6e6d72a640 1 -- 172.21.15.133:0/2996485110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6806fdb0 msgr2=0x7f6e6814b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:13.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.160+0000 7f6e6d72a640 1 --2- 172.21.15.133:0/2996485110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6806fdb0 0x7f6e6814b610 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000c500 tx=0x7f6e5000c9c0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.160+0000 7f6e6d72a640 1 -- 172.21.15.133:0/2996485110 shutdown_connections 2023-12-19T19:02:13.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.160+0000 7f6e6d72a640 1 --2- 172.21.15.133:0/2996485110 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6e48066470 0x7f6e48068930 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.160+0000 7f6e6d72a640 1 --2- 172.21.15.133:0/2996485110 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6e681577f0 0x7f6e6806dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.160+0000 7f6e6d72a640 1 --2- 172.21.15.133:0/2996485110 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6e68157410 0x7f6e68151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.160+0000 7f6e6d72a640 1 --2- 172.21.15.133:0/2996485110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6e6806fdb0 0x7f6e6814b610 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.160+0000 7f6e6d72a640 1 -- 172.21.15.133:0/2996485110 >> 172.21.15.133:0/2996485110 conn(0x7f6e680a9b80 msgr2=0x7f6e6814ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:13.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.160+0000 7f6e6d72a640 1 -- 172.21.15.133:0/2996485110 shutdown_connections 2023-12-19T19:02:13.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.160+0000 7f6e6d72a640 1 -- 172.21.15.133:0/2996485110 wait complete. 2023-12-19T19:02:13.185 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T19:02:13.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.316+0000 7f7399032640 1 Processor -- start 2023-12-19T19:02:13.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.316+0000 7f7399032640 1 -- start start 2023-12-19T19:02:13.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.320+0000 7f7399032640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f73940a5240 0x7f73940bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:13.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.320+0000 7f7399032640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f73941561f0 0x7f7394156640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:13.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.320+0000 7f7399032640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73940c3bd0 con 0x7f73940c01c0 2023-12-19T19:02:13.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.320+0000 7f7399032640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73940bf1e0 con 0x7f73940a5240 2023-12-19T19:02:13.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.320+0000 7f7399032640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73940c3e20 con 0x7f73941561f0 2023-12-19T19:02:13.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.320+0000 7f7392d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f73940a5240 0x7f73940bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:13.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.320+0000 7f7392d9d640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f73940a5240 0x7f73940bfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49878/0 (socket says 172.21.15.133:49878) 2023-12-19T19:02:13.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.320+0000 7f7392d9d640 1 -- 172.21.15.133:0/1263665183 learned_addr learned my addr 172.21.15.133:0/1263665183 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:13.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.320+0000 7f739359e640 1 --2- 172.21.15.133:0/1263665183 >> v2:172.21.15.138:3300/0 conn(0x7f73941561f0 0x7f7394156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:13.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.320+0000 7f7392d9d640 1 -- 172.21.15.133:0/1263665183 >> v2:172.21.15.138:3300/0 conn(0x7f73941561f0 msgr2=0x7f7394156640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:13.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.320+0000 7f7392d9d640 1 --2- 172.21.15.133:0/1263665183 >> v2:172.21.15.138:3300/0 conn(0x7f73941561f0 0x7f7394156640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.320+0000 7f7392d9d640 1 -- 172.21.15.133:0/1263665183 >> v1:172.21.15.138:6789/0 conn(0x7f73940c01c0 legacy=0x7f73940c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:13.325 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.320+0000 7f7392d9d640 1 -- 172.21.15.133:0/1263665183 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73940c4100 con 0x7f73940a5240 2023-12-19T19:02:13.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.324+0000 7f7392d9d640 1 --2- 172.21.15.133:0/1263665183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73940a5240 0x7f73940bfc80 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f73940729a0 tx=0x7f738401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101301efdf7cb184 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:13.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.324+0000 7f7391d9b640 1 -- 172.21.15.133:0/1263665183 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384004230 con 0x7f73940a5240 2023-12-19T19:02:13.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.324+0000 7f7391d9b640 1 -- 172.21.15.133:0/1263665183 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73840a7050 con 0x7f73940a5240 2023-12-19T19:02:13.327 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.324+0000 7f7391d9b640 1 -- 172.21.15.133:0/1263665183 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384003620 con 0x7f73940a5240 2023-12-19T19:02:13.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.324+0000 7f7399032640 1 -- 172.21.15.133:0/1263665183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73940a5240 msgr2=0x7f73940bfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:13.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.324+0000 7f7399032640 1 --2- 172.21.15.133:0/1263665183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73940a5240 0x7f73940bfc80 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f73940729a0 tx=0x7f738401c440 comp rx=0 tx=0).stop 2023-12-19T19:02:13.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.324+0000 7f7399032640 1 -- 172.21.15.133:0/1263665183 shutdown_connections 2023-12-19T19:02:13.328 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.324+0000 7f7399032640 1 --2- 172.21.15.133:0/1263665183 >> v2:172.21.15.138:3300/0 conn(0x7f73941561f0 0x7f7394156640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.324+0000 7f7399032640 1 --2- 172.21.15.133:0/1263665183 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73940a5240 0x7f73940bfc80 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.324+0000 7f7399032640 1 -- 172.21.15.133:0/1263665183 >> 172.21.15.133:0/1263665183 conn(0x7f739406a5b0 msgr2=0x7f739406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:13.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.324+0000 7f7399032640 1 -- 172.21.15.133:0/1263665183 shutdown_connections 2023-12-19T19:02:13.329 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.324+0000 7f7399032640 1 -- 172.21.15.133:0/1263665183 wait complete. 2023-12-19T19:02:13.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.324+0000 7f7399032640 1 Processor -- start 2023-12-19T19:02:13.330 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.324+0000 7f7399032640 1 -- start start 2023-12-19T19:02:13.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.324+0000 7f7399032640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73940a5240 0x7f73941f0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:13.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.324+0000 7f7399032640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f73940c01c0 0x7f73941552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:13.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.324+0000 7f7399032640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73941561f0 0x7f73941ed6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:13.332 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.328+0000 7f7399032640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73941ecfa0 con 0x7f73941561f0 2023-12-19T19:02:13.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.328+0000 7f7399032640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73940aa270 con 0x7f73940c01c0 2023-12-19T19:02:13.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.328+0000 7f7399032640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73941ed230 con 0x7f73940a5240 2023-12-19T19:02:13.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.328+0000 7f739359e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73941561f0 0x7f73941ed6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:13.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.328+0000 7f739359e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73941561f0 0x7f73941ed6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49890/0 (socket says 172.21.15.133:49890) 2023-12-19T19:02:13.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.328+0000 7f739359e640 1 -- 172.21.15.133:0/362680177 learned_addr learned my addr 172.21.15.133:0/362680177 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:13.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.328+0000 7f7392d9d640 1 --2- 172.21.15.133:0/362680177 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73940a5240 0x7f73941f0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:13.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.328+0000 7f739259c640 1 --2- 172.21.15.133:0/362680177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f73940c01c0 0x7f73941552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:13.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.328+0000 7f739359e640 1 -- 172.21.15.133:0/362680177 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73940a5240 msgr2=0x7f73941f0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:13.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.328+0000 7f739359e640 1 --2- 172.21.15.133:0/362680177 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73940a5240 0x7f73941f0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.328+0000 7f739359e640 1 -- 172.21.15.133:0/362680177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f73940c01c0 msgr2=0x7f73941552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:13.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.328+0000 7f739359e640 1 --2- 172.21.15.133:0/362680177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f73940c01c0 0x7f73941552b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.328+0000 7f739359e640 1 -- 172.21.15.133:0/362680177 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73840094d0 con 0x7f73941561f0 2023-12-19T19:02:13.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.328+0000 7f7392d9d640 1 --2- 172.21.15.133:0/362680177 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73940a5240 0x7f73941f0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:13.333 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.328+0000 7f739359e640 1 --2- 172.21.15.133:0/362680177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73941561f0 0x7f73941ed6c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f738c009dd0 tx=0x7f738c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:13.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.328+0000 7f737b7fe640 1 -- 172.21.15.133:0/362680177 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c014480 con 0x7f73941561f0 2023-12-19T19:02:13.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.328+0000 7f737b7fe640 1 -- 172.21.15.133:0/362680177 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738c00f040 con 0x7f73941561f0 2023-12-19T19:02:13.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.328+0000 7f737b7fe640 1 -- 172.21.15.133:0/362680177 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c014840 con 0x7f73941561f0 2023-12-19T19:02:13.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.328+0000 7f7399032640 1 -- 172.21.15.133:0/362680177 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73940aaa80 con 0x7f73941561f0 2023-12-19T19:02:13.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.328+0000 7f7399032640 1 -- 172.21.15.133:0/362680177 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73940aa4c0 con 0x7f73941561f0 2023-12-19T19:02:13.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.328+0000 7f7399032640 1 -- 172.21.15.133:0/362680177 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73940c52e0 con 0x7f73941561f0 2023-12-19T19:02:13.334 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.328+0000 7f737b7fe640 1 -- 172.21.15.133:0/362680177 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f738c0149a0 con 0x7f73941561f0 2023-12-19T19:02:13.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.328+0000 7f737b7fe640 1 --2- 172.21.15.133:0/362680177 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f73800664a0 0x7f7380068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:13.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.332+0000 7f737b7fe640 1 -- 172.21.15.133:0/362680177 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f738c084d40 con 0x7f73941561f0 2023-12-19T19:02:13.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.332+0000 7f7392d9d640 1 --2- 172.21.15.133:0/362680177 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f73800664a0 0x7f7380068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:13.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.332+0000 7f7392d9d640 1 --2- 172.21.15.133:0/362680177 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f73800664a0 0x7f7380068960 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f73840ad000 tx=0x7f7384008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:13.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.332+0000 7f737b7fe640 1 -- 172.21.15.133:0/362680177 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f738c051e50 con 0x7f73941561f0 2023-12-19T19:02:13.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.496+0000 7f7399032640 1 -- 172.21.15.133:0/362680177 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7394068400 con 0x7f73941561f0 2023-12-19T19:02:13.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.496+0000 7f737b7fe640 1 -- 172.21.15.133:0/362680177 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v73) v1 ==== 80+0+0 (secure 0 0 0) 0x7f738c018080 con 0x7f73941561f0 2023-12-19T19:02:13.501 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-19T19:02:13.503 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.500+0000 7f7399032640 1 -- 172.21.15.133:0/362680177 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f73800664a0 msgr2=0x7f7380068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:13.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.500+0000 7f7399032640 1 --2- 172.21.15.133:0/362680177 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f73800664a0 0x7f7380068960 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f73840ad000 tx=0x7f7384008040 comp rx=0 tx=0).stop 2023-12-19T19:02:13.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.500+0000 7f7399032640 1 -- 172.21.15.133:0/362680177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73941561f0 msgr2=0x7f73941ed6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:13.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.500+0000 7f7399032640 1 --2- 172.21.15.133:0/362680177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73941561f0 0x7f73941ed6c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f738c009dd0 tx=0x7f738c00c490 comp rx=0 tx=0).stop 2023-12-19T19:02:13.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.500+0000 7f7399032640 1 -- 172.21.15.133:0/362680177 shutdown_connections 2023-12-19T19:02:13.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.500+0000 7f7399032640 1 --2- 172.21.15.133:0/362680177 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f73800664a0 0x7f7380068960 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.500+0000 7f7399032640 1 --2- 172.21.15.133:0/362680177 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73941561f0 0x7f73941ed6c0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.500+0000 7f7399032640 1 --2- 172.21.15.133:0/362680177 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f73940c01c0 0x7f73941552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.500+0000 7f7399032640 1 --2- 172.21.15.133:0/362680177 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f73940a5240 0x7f73941f0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.500+0000 7f7399032640 1 -- 172.21.15.133:0/362680177 >> 172.21.15.133:0/362680177 conn(0x7f739406a5b0 msgr2=0x7f739406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:13.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.500+0000 7f7399032640 1 -- 172.21.15.133:0/362680177 shutdown_connections 2023-12-19T19:02:13.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.500+0000 7f7399032640 1 -- 172.21.15.133:0/362680177 wait complete. 2023-12-19T19:02:13.522 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2023-12-19T19:02:13.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:13.522 DEBUG:teuthology.orchestra.run.smithi133:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-12-19T19:02:13.549 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi133.front.sepia.ceph.com 2023-12-19T19:02:13.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:13.549 DEBUG:teuthology.orchestra.run.smithi133:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T19:02:13.604 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:02:13.604 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:02:13.614 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:02:13.614 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:02:13.663 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:02:13.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.796+0000 7f8d13f72640 1 Processor -- start 2023-12-19T19:02:13.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.796+0000 7f8d13f72640 1 -- start start 2023-12-19T19:02:13.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.796+0000 7f8d13f72640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8d0c0c63c0 0x7f8d0c0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:13.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.796+0000 7f8d13f72640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d0c0c2bb0 0x7f8d0c0a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:13.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.796+0000 7f8d13f72640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d0c0c31c0 con 0x7f8d0c0c4100 2023-12-19T19:02:13.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.796+0000 7f8d13f72640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d0c0c34a0 con 0x7f8d0c0c63c0 2023-12-19T19:02:13.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.796+0000 7f8d13f72640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c0c1030 con 0x7f8d0c0c2bb0 2023-12-19T19:02:13.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.796+0000 7f8d11d0e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8d0c0c63c0 0x7f8d0c0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:13.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.796+0000 7f8d1150d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8d0c0c4100 0x7f8d0c0c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41720/0 (socket says 172.21.15.133:41720) 2023-12-19T19:02:13.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.796+0000 7f8d1150d640 1 -- 172.21.15.133:0/2868594478 learned_addr learned my addr 172.21.15.133:0/2868594478 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:13.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.796+0000 7f8d1250f640 1 --2- 172.21.15.133:0/2868594478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d0c0c2bb0 0x7f8d0c0a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:13.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.796+0000 7f8d11d0e640 1 -- 172.21.15.133:0/2868594478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d0c0c2bb0 msgr2=0x7f8d0c0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:13.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.796+0000 7f8d11d0e640 1 --2- 172.21.15.133:0/2868594478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d0c0c2bb0 0x7f8d0c0a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.796+0000 7f8d11d0e640 1 -- 172.21.15.133:0/2868594478 >> v1:172.21.15.133:6789/0 conn(0x7f8d0c0c4100 legacy=0x7f8d0c0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:13.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.796+0000 7f8d11d0e640 1 -- 172.21.15.133:0/2868594478 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c0c1310 con 0x7f8d0c0c63c0 2023-12-19T19:02:13.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.800+0000 7f8d11d0e640 1 --2- 172.21.15.133:0/2868594478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d0c0c63c0 0x7f8d0c0c06d0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f8d080097c0 tx=0x7f8d0801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f433bfad1221f75 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:13.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.800+0000 7f8d10d0c640 1 -- 172.21.15.133:0/2868594478 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c0aa3d0 con 0x7f8d0c0c63c0 2023-12-19T19:02:13.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.800+0000 7f8d10d0c640 1 -- 172.21.15.133:0/2868594478 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d080a7050 con 0x7f8d0c0c63c0 2023-12-19T19:02:13.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.800+0000 7f8d10d0c640 1 -- 172.21.15.133:0/2868594478 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d080ab820 con 0x7f8d0c0c63c0 2023-12-19T19:02:13.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.800+0000 7f8d13f72640 1 -- 172.21.15.133:0/2868594478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d0c0c63c0 msgr2=0x7f8d0c0c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:13.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.800+0000 7f8d13f72640 1 --2- 172.21.15.133:0/2868594478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d0c0c63c0 0x7f8d0c0c06d0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f8d080097c0 tx=0x7f8d0801c330 comp rx=0 tx=0).stop 2023-12-19T19:02:13.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.800+0000 7f8d13f72640 1 -- 172.21.15.133:0/2868594478 shutdown_connections 2023-12-19T19:02:13.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.800+0000 7f8d13f72640 1 --2- 172.21.15.133:0/2868594478 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d0c0c2bb0 0x7f8d0c0a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.800+0000 7f8d13f72640 1 --2- 172.21.15.133:0/2868594478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d0c0c63c0 0x7f8d0c0c06d0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.800+0000 7f8d13f72640 1 -- 172.21.15.133:0/2868594478 >> 172.21.15.133:0/2868594478 conn(0x7f8d0c06a5b0 msgr2=0x7f8d0c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:13.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.800+0000 7f8d13f72640 1 -- 172.21.15.133:0/2868594478 shutdown_connections 2023-12-19T19:02:13.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.800+0000 7f8d13f72640 1 -- 172.21.15.133:0/2868594478 wait complete. 2023-12-19T19:02:13.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d13f72640 1 Processor -- start 2023-12-19T19:02:13.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d13f72640 1 -- start start 2023-12-19T19:02:13.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d13f72640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d0c0c2bb0 0x7f8d0c159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:13.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d13f72640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d0c0c4100 0x7f8d0c1ee570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:13.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d13f72640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d0c0c63c0 0x7f8d0c0bb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:13.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d13f72640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c1eeab0 con 0x7f8d0c0c2bb0 2023-12-19T19:02:13.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d13f72640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c0c0500 con 0x7f8d0c0c4100 2023-12-19T19:02:13.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d13f72640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c1ea5f0 con 0x7f8d0c0c63c0 2023-12-19T19:02:13.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d11d0e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d0c0c2bb0 0x7f8d0c159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:13.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d11d0e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d0c0c2bb0 0x7f8d0c159050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49894/0 (socket says 172.21.15.133:49894) 2023-12-19T19:02:13.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d11d0e640 1 -- 172.21.15.133:0/2759242712 learned_addr learned my addr 172.21.15.133:0/2759242712 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:13.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d11d0e640 1 -- 172.21.15.133:0/2759242712 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d0c0c63c0 msgr2=0x7f8d0c0bb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:13.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d11d0e640 1 --2- 172.21.15.133:0/2759242712 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d0c0c63c0 0x7f8d0c0bb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d11d0e640 1 -- 172.21.15.133:0/2759242712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d0c0c4100 msgr2=0x7f8d0c1ee570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:13.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d1150d640 1 --2- 172.21.15.133:0/2759242712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d0c0c4100 0x7f8d0c1ee570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:13.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d11d0e640 1 --2- 172.21.15.133:0/2759242712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d0c0c4100 0x7f8d0c1ee570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d11d0e640 1 -- 172.21.15.133:0/2759242712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d08009420 con 0x7f8d0c0c2bb0 2023-12-19T19:02:13.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d1150d640 1 --2- 172.21.15.133:0/2759242712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d0c0c4100 0x7f8d0c1ee570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:13.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d11d0e640 1 --2- 172.21.15.133:0/2759242712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d0c0c2bb0 0x7f8d0c159050 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f8d08019f60 tx=0x7f8d0801ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:13.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d027fc640 1 -- 172.21.15.133:0/2759242712 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d080b7650 con 0x7f8d0c0c2bb0 2023-12-19T19:02:13.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d027fc640 1 -- 172.21.15.133:0/2759242712 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d080abe90 con 0x7f8d0c0c2bb0 2023-12-19T19:02:13.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d13f72640 1 -- 172.21.15.133:0/2759242712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d0c0c69b0 con 0x7f8d0c0c2bb0 2023-12-19T19:02:13.812 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d027fc640 1 -- 172.21.15.133:0/2759242712 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d080b7a10 con 0x7f8d0c0c2bb0 2023-12-19T19:02:13.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.804+0000 7f8d13f72640 1 -- 172.21.15.133:0/2759242712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d0c0706d0 con 0x7f8d0c0c2bb0 2023-12-19T19:02:13.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.808+0000 7f8d13f72640 1 -- 172.21.15.133:0/2759242712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d0c068400 con 0x7f8d0c0c2bb0 2023-12-19T19:02:13.813 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.808+0000 7f8d027fc640 1 -- 172.21.15.133:0/2759242712 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8d080b7b70 con 0x7f8d0c0c2bb0 2023-12-19T19:02:13.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.808+0000 7f8d027fc640 1 --2- 172.21.15.133:0/2759242712 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8cf0066470 0x7f8cf0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:13.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.808+0000 7f8d027fc640 1 -- 172.21.15.133:0/2759242712 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8d0811ebd0 con 0x7f8d0c0c2bb0 2023-12-19T19:02:13.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.808+0000 7f8d1150d640 1 --2- 172.21.15.133:0/2759242712 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8cf0066470 0x7f8cf0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:13.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.812+0000 7f8d1150d640 1 --2- 172.21.15.133:0/2759242712 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8cf0066470 0x7f8cf0068930 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c157fe0 tx=0x7f8cfc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:13.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.812+0000 7f8d027fc640 1 -- 172.21.15.133:0/2759242712 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8d080ebdf0 con 0x7f8d0c0c2bb0 2023-12-19T19:02:13.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.964+0000 7f8d13f72640 1 -- 172.21.15.133:0/2759242712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d0c0c3e70 con 0x7f8d0c0c2bb0 2023-12-19T19:02:13.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.964+0000 7f8d027fc640 1 -- 172.21.15.133:0/2759242712 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+20250 (secure 0 0 0) 0x7f8d080b0090 con 0x7f8d0c0c2bb0 2023-12-19T19:02:13.970 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:13.970 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":73,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:01:54.705538+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:01:33.082188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T19:01:34.349092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:01:50.875086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:01:52.061232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:02:13.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.968+0000 7f8d13f72640 1 -- 172.21.15.133:0/2759242712 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8cf0066470 msgr2=0x7f8cf0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.968+0000 7f8d13f72640 1 --2- 172.21.15.133:0/2759242712 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8cf0066470 0x7f8cf0068930 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c157fe0 tx=0x7f8cfc009040 comp rx=0 tx=0).stop 2023-12-19T19:02:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.968+0000 7f8d13f72640 1 -- 172.21.15.133:0/2759242712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d0c0c2bb0 msgr2=0x7f8d0c159050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.968+0000 7f8d13f72640 1 --2- 172.21.15.133:0/2759242712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d0c0c2bb0 0x7f8d0c159050 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f8d08019f60 tx=0x7f8d0801ab70 comp rx=0 tx=0).stop 2023-12-19T19:02:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.968+0000 7f8d13f72640 1 -- 172.21.15.133:0/2759242712 shutdown_connections 2023-12-19T19:02:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.968+0000 7f8d13f72640 1 --2- 172.21.15.133:0/2759242712 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8cf0066470 0x7f8cf0068930 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.968+0000 7f8d13f72640 1 --2- 172.21.15.133:0/2759242712 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8d0c0c63c0 0x7f8d0c0bb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.968+0000 7f8d13f72640 1 --2- 172.21.15.133:0/2759242712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8d0c0c4100 0x7f8d0c1ee570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.968+0000 7f8d13f72640 1 --2- 172.21.15.133:0/2759242712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8d0c0c2bb0 0x7f8d0c159050 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.968+0000 7f8d13f72640 1 -- 172.21.15.133:0/2759242712 >> 172.21.15.133:0/2759242712 conn(0x7f8d0c06a5b0 msgr2=0x7f8d0c0713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.968+0000 7f8d13f72640 1 -- 172.21.15.133:0/2759242712 shutdown_connections 2023-12-19T19:02:13.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:13.968+0000 7f8d13f72640 1 -- 172.21.15.133:0/2759242712 wait complete. 2023-12-19T19:02:13.990 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T19:01:33.082188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T19:01:34.349092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-19T19:01:50.875086+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-19T19:01:52.061232+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T19:02:13.991 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T19:02:14.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.124+0000 7f8ddbc5a640 1 Processor -- start 2023-12-19T19:02:14.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.124+0000 7f8ddbc5a640 1 -- start start 2023-12-19T19:02:14.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8ddbc5a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8dd40c63c0 0x7f8dd40c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:14.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8ddbc5a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd40c31c0 con 0x7f8dd40c2bb0 2023-12-19T19:02:14.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8ddbc5a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd40c34a0 con 0x7f8dd40c4100 2023-12-19T19:02:14.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8ddbc5a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd40c1030 con 0x7f8dd40c63c0 2023-12-19T19:02:14.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dda1f7640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f8dd40c2bb0 0x7f8dd40a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:41728/0 (socket says 172.21.15.133:41728) 2023-12-19T19:02:14.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dda1f7640 1 -- 172.21.15.133:0/1534263859 learned_addr learned my addr 172.21.15.133:0/1534263859 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:14.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd99f6640 1 --2- 172.21.15.133:0/1534263859 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8dd40c63c0 0x7f8dd40c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:14.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd89f4640 1 -- 172.21.15.133:0/1534263859 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 46567549 0 0) 0x7f8dd40c31c0 con 0x7f8dd40c2bb0 2023-12-19T19:02:14.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd89f4640 1 -- 172.21.15.133:0/1534263859 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dc0003530 con 0x7f8dd40c2bb0 2023-12-19T19:02:14.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd89f4640 1 -- 172.21.15.133:0/1534263859 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409792152 0 0) 0x7f8dd40c34a0 con 0x7f8dd40c4100 2023-12-19T19:02:14.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd89f4640 1 -- 172.21.15.133:0/1534263859 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dd40c31c0 con 0x7f8dd40c4100 2023-12-19T19:02:14.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd89f4640 1 -- 172.21.15.133:0/1534263859 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 554792543 0 0) 0x7f8dc0003530 con 0x7f8dd40c2bb0 2023-12-19T19:02:14.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd89f4640 1 -- 172.21.15.133:0/1534263859 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8dd40c63c0 msgr2=0x7f8dd40c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:14.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd89f4640 1 --2- 172.21.15.133:0/1534263859 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8dd40c63c0 0x7f8dd40c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd89f4640 1 -- 172.21.15.133:0/1534263859 >> v1:172.21.15.138:6789/0 conn(0x7f8dd40c4100 legacy=0x7f8dd40c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:14.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd89f4640 1 -- 172.21.15.133:0/1534263859 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd40c1310 con 0x7f8dd40c2bb0 2023-12-19T19:02:14.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd89f4640 1 -- 172.21.15.133:0/1534263859 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f8dcc001a00 con 0x7f8dd40c2bb0 2023-12-19T19:02:14.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd99f6640 1 --2- 172.21.15.133:0/1534263859 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8dd40c63c0 0x7f8dd40c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:02:14.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd89f4640 1 -- 172.21.15.133:0/1534263859 >> v1:172.21.15.133:6789/0 conn(0x7f8dd40c2bb0 legacy=0x7f8dd40a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:14.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd89f4640 1 --2- 172.21.15.133:0/1534263859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dc0003b40 0x7f8dc0003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:14.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd89f4640 1 --2- 172.21.15.133:0/1534263859 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8dd40c63c0 0x7f8dc00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:14.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd89f4640 1 --2- 172.21.15.133:0/1534263859 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8dc0004d10 0x7f8dc0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:14.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd89f4640 1 -- 172.21.15.133:0/1534263859 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd40c1030 con 0x7f8dc0003b40 2023-12-19T19:02:14.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd89f4640 1 -- 172.21.15.133:0/1534263859 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc000bb50 con 0x7f8dc0004d10 2023-12-19T19:02:14.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd89f4640 1 -- 172.21.15.133:0/1534263859 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc000bd10 con 0x7f8dd40c63c0 2023-12-19T19:02:14.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd99f6640 1 --2- 172.21.15.133:0/1534263859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dc0003b40 0x7f8dc0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:14.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd91f5640 1 --2- 172.21.15.133:0/1534263859 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8dd40c63c0 0x7f8dc00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:14.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dda1f7640 1 --2- 172.21.15.133:0/1534263859 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8dc0004d10 0x7f8dc0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:14.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd99f6640 1 -- 172.21.15.133:0/1534263859 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8dd40c63c0 msgr2=0x7f8dc00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:14.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd99f6640 1 --2- 172.21.15.133:0/1534263859 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8dd40c63c0 0x7f8dc00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd99f6640 1 -- 172.21.15.133:0/1534263859 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8dc0004d10 msgr2=0x7f8dc0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:14.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd99f6640 1 --2- 172.21.15.133:0/1534263859 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8dc0004d10 0x7f8dc0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.136 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.128+0000 7f8dd99f6640 1 -- 172.21.15.133:0/1534263859 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd0009420 con 0x7f8dc0003b40 2023-12-19T19:02:14.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.132+0000 7f8dd99f6640 1 --2- 172.21.15.133:0/1534263859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dc0003b40 0x7f8dc0003f40 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0009c80 tx=0x7f8dd001cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2bd008d81ede9a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:14.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.132+0000 7f8dd89f4640 1 -- 172.21.15.133:0/1534263859 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd00a5730 con 0x7f8dc0003b40 2023-12-19T19:02:14.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.132+0000 7f8dd89f4640 1 -- 172.21.15.133:0/1534263859 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd00a5890 con 0x7f8dc0003b40 2023-12-19T19:02:14.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.132+0000 7f8dd89f4640 1 -- 172.21.15.133:0/1534263859 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd00a5c40 con 0x7f8dc0003b40 2023-12-19T19:02:14.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.132+0000 7f8ddbc5a640 1 -- 172.21.15.133:0/1534263859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dc0003b40 msgr2=0x7f8dc0003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:14.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.132+0000 7f8ddbc5a640 1 --2- 172.21.15.133:0/1534263859 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dc0003b40 0x7f8dc0003f40 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0009c80 tx=0x7f8dd001cb80 comp rx=0 tx=0).stop 2023-12-19T19:02:14.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.132+0000 7f8dda1f7640 1 -- 172.21.15.133:0/1534263859 reap_dead start 2023-12-19T19:02:14.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.132+0000 7f8ddbc5a640 1 -- 172.21.15.133:0/1534263859 shutdown_connections 2023-12-19T19:02:14.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.132+0000 7f8ddbc5a640 1 -- 172.21.15.133:0/1534263859 >> 172.21.15.133:0/1534263859 conn(0x7f8dd406a5b0 msgr2=0x7f8dd406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:14.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.132+0000 7f8ddbc5a640 1 -- 172.21.15.133:0/1534263859 shutdown_connections 2023-12-19T19:02:14.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.132+0000 7f8ddbc5a640 1 -- 172.21.15.133:0/1534263859 wait complete. 2023-12-19T19:02:14.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8ddbc5a640 1 Processor -- start 2023-12-19T19:02:14.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8ddbc5a640 1 -- start start 2023-12-19T19:02:14.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8ddbc5a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dc0003b40 0x7f8dd40bfd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:14.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8ddbc5a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8dd406ac70 0x7f8dd4151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:14.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8ddbc5a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8dd40bae60 0x7f8dd4152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:14.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8ddbc5a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd40bf710 con 0x7f8dc0003b40 2023-12-19T19:02:14.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8ddbc5a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd40be330 con 0x7f8dd40bae60 2023-12-19T19:02:14.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8ddbc5a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd41edcf0 con 0x7f8dd406ac70 2023-12-19T19:02:14.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8dd99f6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dc0003b40 0x7f8dd40bfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:14.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8dd99f6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dc0003b40 0x7f8dd40bfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:49914/0 (socket says 172.21.15.133:49914) 2023-12-19T19:02:14.141 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8dd99f6640 1 -- 172.21.15.133:0/3771592693 learned_addr learned my addr 172.21.15.133:0/3771592693 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:14.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8dd91f5640 1 --2- 172.21.15.133:0/3771592693 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8dd406ac70 0x7f8dd4151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:14.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8dda1f7640 1 --2- 172.21.15.133:0/3771592693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8dd40bae60 0x7f8dd4152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:14.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8dd99f6640 1 -- 172.21.15.133:0/3771592693 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8dd406ac70 msgr2=0x7f8dd4151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:14.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8dd99f6640 1 --2- 172.21.15.133:0/3771592693 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8dd406ac70 0x7f8dd4151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8dd99f6640 1 -- 172.21.15.133:0/3771592693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8dd40bae60 msgr2=0x7f8dd4152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:14.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8dd99f6640 1 --2- 172.21.15.133:0/3771592693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8dd40bae60 0x7f8dd4152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8dd99f6640 1 -- 172.21.15.133:0/3771592693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd40c69b0 con 0x7f8dc0003b40 2023-12-19T19:02:14.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8dd91f5640 1 --2- 172.21.15.133:0/3771592693 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8dd406ac70 0x7f8dd4151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:14.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8dda1f7640 1 --2- 172.21.15.133:0/3771592693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8dd40bae60 0x7f8dd4152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:14.142 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8dd99f6640 1 --2- 172.21.15.133:0/3771592693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dc0003b40 0x7f8dd40bfd00 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f8dd001c9b0 tx=0x7f8dc0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:14.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8dca7fc640 1 -- 172.21.15.133:0/3771592693 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd00b8440 con 0x7f8dc0003b40 2023-12-19T19:02:14.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8dca7fc640 1 -- 172.21.15.133:0/3771592693 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd00b85a0 con 0x7f8dc0003b40 2023-12-19T19:02:14.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8ddbc5a640 1 -- 172.21.15.133:0/3771592693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dd40be950 con 0x7f8dc0003b40 2023-12-19T19:02:14.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8dca7fc640 1 -- 172.21.15.133:0/3771592693 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd00b8930 con 0x7f8dc0003b40 2023-12-19T19:02:14.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8ddbc5a640 1 -- 172.21.15.133:0/3771592693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd40bef10 con 0x7f8dc0003b40 2023-12-19T19:02:14.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.136+0000 7f8ddbc5a640 1 -- 172.21.15.133:0/3771592693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd406ce50 con 0x7f8dc0003b40 2023-12-19T19:02:14.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.140+0000 7f8dca7fc640 1 -- 172.21.15.133:0/3771592693 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8dd00b4040 con 0x7f8dc0003b40 2023-12-19T19:02:14.144 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.140+0000 7f8dca7fc640 1 --2- 172.21.15.133:0/3771592693 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8db8066470 0x7f8db8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:14.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.140+0000 7f8dca7fc640 1 -- 172.21.15.133:0/3771592693 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8dd011db40 con 0x7f8dc0003b40 2023-12-19T19:02:14.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.140+0000 7f8dd91f5640 1 --2- 172.21.15.133:0/3771592693 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8db8066470 0x7f8db8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:14.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.140+0000 7f8dd91f5640 1 --2- 172.21.15.133:0/3771592693 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8db8066470 0x7f8db8068930 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8dc40010f0 tx=0x7f8dc4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:14.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.144+0000 7f8dca7fc640 1 -- 172.21.15.133:0/3771592693 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8dd00eab30 con 0x7f8dc0003b40 2023-12-19T19:02:14.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.292+0000 7f8ddbc5a640 1 -- 172.21.15.133:0/3771592693 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8dd4068400 con 0x7f8dc0003b40 2023-12-19T19:02:14.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.292+0000 7f8dca7fc640 1 -- 172.21.15.133:0/3771592693 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8dd00ee150 con 0x7f8dc0003b40 2023-12-19T19:02:14.298 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T19:02:14.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.296+0000 7f8ddbc5a640 1 -- 172.21.15.133:0/3771592693 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8db8066470 msgr2=0x7f8db8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:14.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.296+0000 7f8ddbc5a640 1 --2- 172.21.15.133:0/3771592693 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8db8066470 0x7f8db8068930 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f8dc40010f0 tx=0x7f8dc4009040 comp rx=0 tx=0).stop 2023-12-19T19:02:14.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.296+0000 7f8ddbc5a640 1 -- 172.21.15.133:0/3771592693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dc0003b40 msgr2=0x7f8dd40bfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:14.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.296+0000 7f8ddbc5a640 1 --2- 172.21.15.133:0/3771592693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dc0003b40 0x7f8dd40bfd00 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f8dd001c9b0 tx=0x7f8dc0005800 comp rx=0 tx=0).stop 2023-12-19T19:02:14.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.296+0000 7f8ddbc5a640 1 -- 172.21.15.133:0/3771592693 shutdown_connections 2023-12-19T19:02:14.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.296+0000 7f8ddbc5a640 1 --2- 172.21.15.133:0/3771592693 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8db8066470 0x7f8db8068930 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.296+0000 7f8ddbc5a640 1 --2- 172.21.15.133:0/3771592693 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8dd40bae60 0x7f8dd4152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.296+0000 7f8ddbc5a640 1 --2- 172.21.15.133:0/3771592693 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8dd406ac70 0x7f8dd4151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.296+0000 7f8ddbc5a640 1 --2- 172.21.15.133:0/3771592693 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8dc0003b40 0x7f8dd40bfd00 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.296+0000 7f8ddbc5a640 1 -- 172.21.15.133:0/3771592693 >> 172.21.15.133:0/3771592693 conn(0x7f8dd406a5b0 msgr2=0x7f8dd4153740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:14.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.296+0000 7f8ddbc5a640 1 -- 172.21.15.133:0/3771592693 shutdown_connections 2023-12-19T19:02:14.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.296+0000 7f8ddbc5a640 1 -- 172.21.15.133:0/3771592693 wait complete. 2023-12-19T19:02:14.319 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T19:02:14.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.456+0000 7f19c2b34640 1 Processor -- start 2023-12-19T19:02:14.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.456+0000 7f19c2b34640 1 -- start start 2023-12-19T19:02:14.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.456+0000 7f19c2b34640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f19bc155dd0 0x7f19bc0c1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:14.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.456+0000 7f19c2b34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19bc06e0b0 0x7f19bc15be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:14.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.456+0000 7f19c2b34640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19bc158a90 con 0x7f19bc06c980 2023-12-19T19:02:14.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.456+0000 7f19c2b34640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19bc1588a0 con 0x7f19bc155dd0 2023-12-19T19:02:14.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.456+0000 7f19c2b34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc158d70 con 0x7f19bc06e0b0 2023-12-19T19:02:14.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.456+0000 7f19c1b32640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f19bc155dd0 0x7f19bc0c1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:14.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.456+0000 7f19c2333640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f19bc06c980 0x7f19bc15c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34036/0 (socket says 172.21.15.133:34036) 2023-12-19T19:02:14.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.456+0000 7f19c2333640 1 -- 172.21.15.133:0/1861038658 learned_addr learned my addr 172.21.15.133:0/1861038658 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:14.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.456+0000 7f19c1331640 1 --2- 172.21.15.133:0/1861038658 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19bc06e0b0 0x7f19bc15be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:14.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.456+0000 7f19c1b32640 1 -- 172.21.15.133:0/1861038658 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19bc06e0b0 msgr2=0x7f19bc15be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:14.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.456+0000 7f19c1b32640 1 --2- 172.21.15.133:0/1861038658 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19bc06e0b0 0x7f19bc15be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.456+0000 7f19c1b32640 1 -- 172.21.15.133:0/1861038658 >> v1:172.21.15.133:6789/0 conn(0x7f19bc06c980 legacy=0x7f19bc15c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:14.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.456+0000 7f19c1b32640 1 -- 172.21.15.133:0/1861038658 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19bc159050 con 0x7f19bc155dd0 2023-12-19T19:02:14.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.456+0000 7f19c0b30640 1 -- 172.21.15.133:0/1861038658 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2808255284 0 0) 0x7f19bc158a90 con 0x7f19bc06c980 2023-12-19T19:02:14.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.456+0000 7f19c1331640 1 --2- 172.21.15.133:0/1861038658 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19bc06e0b0 0x7f19bc15be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:14.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.460+0000 7f19c1b32640 1 --2- 172.21.15.133:0/1861038658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19bc155dd0 0x7f19bc0c1920 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f19b80097c0 tx=0x7f19b801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf8213dd8bfc912 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:14.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.460+0000 7f19c0b30640 1 -- 172.21.15.133:0/1861038658 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b80a4ea0 con 0x7f19bc155dd0 2023-12-19T19:02:14.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.460+0000 7f19c0b30640 1 -- 172.21.15.133:0/1861038658 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b80a7050 con 0x7f19bc155dd0 2023-12-19T19:02:14.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.460+0000 7f19c0b30640 1 -- 172.21.15.133:0/1861038658 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b80ab820 con 0x7f19bc155dd0 2023-12-19T19:02:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.460+0000 7f19c2b34640 1 -- 172.21.15.133:0/1861038658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19bc155dd0 msgr2=0x7f19bc0c1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.460+0000 7f19c2b34640 1 --2- 172.21.15.133:0/1861038658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19bc155dd0 0x7f19bc0c1920 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f19b80097c0 tx=0x7f19b801c360 comp rx=0 tx=0).stop 2023-12-19T19:02:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.460+0000 7f19c2b34640 1 -- 172.21.15.133:0/1861038658 shutdown_connections 2023-12-19T19:02:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.460+0000 7f19c2b34640 1 --2- 172.21.15.133:0/1861038658 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19bc06e0b0 0x7f19bc15be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.460+0000 7f19c2b34640 1 --2- 172.21.15.133:0/1861038658 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19bc155dd0 0x7f19bc0c1920 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.460+0000 7f19c2b34640 1 -- 172.21.15.133:0/1861038658 >> 172.21.15.133:0/1861038658 conn(0x7f19bc0a7800 msgr2=0x7f19bc0a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:14.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.460+0000 7f19c2b34640 1 -- 172.21.15.133:0/1861038658 shutdown_connections 2023-12-19T19:02:14.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.460+0000 7f19c2b34640 1 -- 172.21.15.133:0/1861038658 wait complete. 2023-12-19T19:02:14.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.464+0000 7f19c2b34640 1 Processor -- start 2023-12-19T19:02:14.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.464+0000 7f19c2b34640 1 -- start start 2023-12-19T19:02:14.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.464+0000 7f19c2b34640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19bc06c980 0x7f19bc0aace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:14.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.464+0000 7f19c2b34640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19bc06e0b0 0x7f19bc0a2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:14.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.464+0000 7f19c2b34640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19bc155dd0 0x7f19bc0a27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:14.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.464+0000 7f19c2b34640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc0a6840 con 0x7f19bc06c980 2023-12-19T19:02:14.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.464+0000 7f19c2b34640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc0bff40 con 0x7f19bc155dd0 2023-12-19T19:02:14.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.464+0000 7f19c2b34640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19bc1f4ea0 con 0x7f19bc06e0b0 2023-12-19T19:02:14.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.464+0000 7f19c1b32640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19bc06c980 0x7f19bc0aace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:14.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.464+0000 7f19c1b32640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19bc06c980 0x7f19bc0aace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38804/0 (socket says 172.21.15.133:38804) 2023-12-19T19:02:14.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.464+0000 7f19c1b32640 1 -- 172.21.15.133:0/2757995235 learned_addr learned my addr 172.21.15.133:0/2757995235 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:14.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.464+0000 7f19c1b32640 1 -- 172.21.15.133:0/2757995235 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19bc06e0b0 msgr2=0x7f19bc0a2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:14.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.464+0000 7f19c1b32640 1 --2- 172.21.15.133:0/2757995235 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19bc06e0b0 0x7f19bc0a2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.464+0000 7f19c1b32640 1 -- 172.21.15.133:0/2757995235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19bc155dd0 msgr2=0x7f19bc0a27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:14.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.464+0000 7f19c1b32640 1 --2- 172.21.15.133:0/2757995235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19bc155dd0 0x7f19bc0a27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.464+0000 7f19c1b32640 1 -- 172.21.15.133:0/2757995235 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b8009420 con 0x7f19bc06c980 2023-12-19T19:02:14.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.464+0000 7f19c1b32640 1 --2- 172.21.15.133:0/2757995235 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19bc06c980 0x7f19bc0aace0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f19b8019f90 tx=0x7f19b8019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:14.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.464+0000 7f19b27fc640 1 -- 172.21.15.133:0/2757995235 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b80b4610 con 0x7f19bc06c980 2023-12-19T19:02:14.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.464+0000 7f19b27fc640 1 -- 172.21.15.133:0/2757995235 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b80abe90 con 0x7f19bc06c980 2023-12-19T19:02:14.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.464+0000 7f19c2b34640 1 -- 172.21.15.133:0/2757995235 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19bc0a2d00 con 0x7f19bc06c980 2023-12-19T19:02:14.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.464+0000 7f19b27fc640 1 -- 172.21.15.133:0/2757995235 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b80b49d0 con 0x7f19bc06c980 2023-12-19T19:02:14.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.464+0000 7f19c2b34640 1 -- 172.21.15.133:0/2757995235 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19bc1f5140 con 0x7f19bc06c980 2023-12-19T19:02:14.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.464+0000 7f19c2b34640 1 -- 172.21.15.133:0/2757995235 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19bc04e850 con 0x7f19bc06c980 2023-12-19T19:02:14.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.468+0000 7f19b27fc640 1 -- 172.21.15.133:0/2757995235 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f19b80b2040 con 0x7f19bc06c980 2023-12-19T19:02:14.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.468+0000 7f19b27fc640 1 --2- 172.21.15.133:0/2757995235 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f19a0066470 0x7f19a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:14.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.468+0000 7f19b27fc640 1 -- 172.21.15.133:0/2757995235 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f19b811e390 con 0x7f19bc06c980 2023-12-19T19:02:14.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.468+0000 7f19c1331640 1 --2- 172.21.15.133:0/2757995235 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f19a0066470 0x7f19a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:14.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.468+0000 7f19c1331640 1 --2- 172.21.15.133:0/2757995235 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f19a0066470 0x7f19a0068930 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f19ac006f10 tx=0x7f19ac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:14.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.472+0000 7f19b27fc640 1 -- 172.21.15.133:0/2757995235 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f19b80eb5c0 con 0x7f19bc06c980 2023-12-19T19:02:14.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.624+0000 7f19c2b34640 1 -- 172.21.15.133:0/2757995235 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f19bc164010 con 0x7f19bc06c980 2023-12-19T19:02:14.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.624+0000 7f19b27fc640 1 -- 172.21.15.133:0/2757995235 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) v1 ==== 104+0+11 (secure 0 0 0) 0x7f19b80eebe0 con 0x7f19bc06c980 2023-12-19T19:02:14.628 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:02:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.624+0000 7f19c2b34640 1 -- 172.21.15.133:0/2757995235 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f19a0066470 msgr2=0x7f19a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.624+0000 7f19c2b34640 1 --2- 172.21.15.133:0/2757995235 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f19a0066470 0x7f19a0068930 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f19ac006f10 tx=0x7f19ac008040 comp rx=0 tx=0).stop 2023-12-19T19:02:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.624+0000 7f19c2b34640 1 -- 172.21.15.133:0/2757995235 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19bc06c980 msgr2=0x7f19bc0aace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.624+0000 7f19c2b34640 1 --2- 172.21.15.133:0/2757995235 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19bc06c980 0x7f19bc0aace0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f19b8019f90 tx=0x7f19b8019100 comp rx=0 tx=0).stop 2023-12-19T19:02:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.624+0000 7f19c2b34640 1 -- 172.21.15.133:0/2757995235 shutdown_connections 2023-12-19T19:02:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.624+0000 7f19c2b34640 1 --2- 172.21.15.133:0/2757995235 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f19a0066470 0x7f19a0068930 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.624+0000 7f19c2b34640 1 --2- 172.21.15.133:0/2757995235 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19bc155dd0 0x7f19bc0a27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.624+0000 7f19c2b34640 1 --2- 172.21.15.133:0/2757995235 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f19bc06e0b0 0x7f19bc0a2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.624+0000 7f19c2b34640 1 --2- 172.21.15.133:0/2757995235 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19bc06c980 0x7f19bc0aace0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.624+0000 7f19c2b34640 1 -- 172.21.15.133:0/2757995235 >> 172.21.15.133:0/2757995235 conn(0x7f19bc0a7800 msgr2=0x7f19bc0c24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.624+0000 7f19c2b34640 1 -- 172.21.15.133:0/2757995235 shutdown_connections 2023-12-19T19:02:14.631 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.624+0000 7f19c2b34640 1 -- 172.21.15.133:0/2757995235 wait complete. 2023-12-19T19:02:14.649 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T19:02:14.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.784+0000 7f238359e640 1 Processor -- start 2023-12-19T19:02:14.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.784+0000 7f238359e640 1 -- start start 2023-12-19T19:02:14.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.788+0000 7f238359e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f238414f800 0x7f2384072320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:14.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.788+0000 7f238359e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2384072860 0x7f238406fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:14.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.788+0000 7f238359e640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2384071e90 con 0x7f23840c1010 2023-12-19T19:02:14.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.788+0000 7f238359e640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23840a5110 con 0x7f238414f800 2023-12-19T19:02:14.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.788+0000 7f238359e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2384152d70 con 0x7f2384072860 2023-12-19T19:02:14.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.788+0000 7f238259c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f238414f800 0x7f2384072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:14.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.788+0000 7f238259c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f238414f800 0x7f2384072320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38808/0 (socket says 172.21.15.133:38808) 2023-12-19T19:02:14.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.788+0000 7f238259c640 1 -- 172.21.15.133:0/1923142358 learned_addr learned my addr 172.21.15.133:0/1923142358 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:14.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.788+0000 7f237bfff640 1 --2- 172.21.15.133:0/1923142358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2384072860 0x7f238406fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:14.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.788+0000 7f238259c640 1 -- 172.21.15.133:0/1923142358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2384072860 msgr2=0x7f238406fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:14.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.788+0000 7f238259c640 1 --2- 172.21.15.133:0/1923142358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2384072860 0x7f238406fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.788+0000 7f238259c640 1 -- 172.21.15.133:0/1923142358 >> v1:172.21.15.138:6789/0 conn(0x7f23840c1010 legacy=0x7f2384155840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:14.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.788+0000 7f238259c640 1 -- 172.21.15.133:0/1923142358 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2384153050 con 0x7f238414f800 2023-12-19T19:02:14.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.788+0000 7f238259c640 1 --2- 172.21.15.133:0/1923142358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f238414f800 0x7f2384072320 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f2374009870 tx=0x7f237401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb382a41dbfb82f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:14.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f2381d9b640 1 -- 172.21.15.133:0/1923142358 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23740a6040 con 0x7f238414f800 2023-12-19T19:02:14.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f2381d9b640 1 -- 172.21.15.133:0/1923142358 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23740aa600 con 0x7f238414f800 2023-12-19T19:02:14.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f2381d9b640 1 -- 172.21.15.133:0/1923142358 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23740aa990 con 0x7f238414f800 2023-12-19T19:02:14.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f238359e640 1 -- 172.21.15.133:0/1923142358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f238414f800 msgr2=0x7f2384072320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:14.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f238359e640 1 --2- 172.21.15.133:0/1923142358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f238414f800 0x7f2384072320 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f2374009870 tx=0x7f237401c480 comp rx=0 tx=0).stop 2023-12-19T19:02:14.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f238359e640 1 -- 172.21.15.133:0/1923142358 shutdown_connections 2023-12-19T19:02:14.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f238359e640 1 --2- 172.21.15.133:0/1923142358 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2384072860 0x7f238406fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f238359e640 1 --2- 172.21.15.133:0/1923142358 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f238414f800 0x7f2384072320 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f238359e640 1 -- 172.21.15.133:0/1923142358 >> 172.21.15.133:0/1923142358 conn(0x7f23840a7800 msgr2=0x7f23840a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:14.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f238359e640 1 -- 172.21.15.133:0/1923142358 shutdown_connections 2023-12-19T19:02:14.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f238359e640 1 -- 172.21.15.133:0/1923142358 wait complete. 2023-12-19T19:02:14.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f238359e640 1 Processor -- start 2023-12-19T19:02:14.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f238359e640 1 -- start start 2023-12-19T19:02:14.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f238359e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2384072860 0x7f23841500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:14.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f238359e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23840c1010 0x7f23840a6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:14.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f238359e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f238414f800 0x7f23841ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:14.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f238359e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2384151370 con 0x7f23840c1010 2023-12-19T19:02:14.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f238359e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23841ecfd0 con 0x7f2384072860 2023-12-19T19:02:14.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f238359e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23841534e0 con 0x7f238414f800 2023-12-19T19:02:14.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f237bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23840c1010 0x7f23840a6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:14.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f238259c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2384072860 0x7f23841500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:14.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f237bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23840c1010 0x7f23840a6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38818/0 (socket says 172.21.15.133:38818) 2023-12-19T19:02:14.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f237bfff640 1 -- 172.21.15.133:0/3486833168 learned_addr learned my addr 172.21.15.133:0/3486833168 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:14.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.792+0000 7f2382d9d640 1 --2- 172.21.15.133:0/3486833168 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f238414f800 0x7f23841ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:14.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.796+0000 7f237bfff640 1 -- 172.21.15.133:0/3486833168 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f238414f800 msgr2=0x7f23841ed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:14.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.796+0000 7f237bfff640 1 --2- 172.21.15.133:0/3486833168 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f238414f800 0x7f23841ed7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.796+0000 7f237bfff640 1 -- 172.21.15.133:0/3486833168 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2384072860 msgr2=0x7f23841500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:14.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.796+0000 7f237bfff640 1 --2- 172.21.15.133:0/3486833168 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2384072860 0x7f23841500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.796+0000 7f237bfff640 1 -- 172.21.15.133:0/3486833168 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23740094d0 con 0x7f23840c1010 2023-12-19T19:02:14.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.796+0000 7f238259c640 1 --2- 172.21.15.133:0/3486833168 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2384072860 0x7f23841500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:02:14.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.796+0000 7f237bfff640 1 --2- 172.21.15.133:0/3486833168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23840c1010 0x7f23840a6a60 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f236c00d5f0 tx=0x7f236c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:14.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.796+0000 7f237affd640 1 -- 172.21.15.133:0/3486833168 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c0125f0 con 0x7f23840c1010 2023-12-19T19:02:14.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.796+0000 7f237affd640 1 -- 172.21.15.133:0/3486833168 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236c012750 con 0x7f23840c1010 2023-12-19T19:02:14.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.796+0000 7f238359e640 1 -- 172.21.15.133:0/3486833168 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2384151610 con 0x7f23840c1010 2023-12-19T19:02:14.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.796+0000 7f237affd640 1 -- 172.21.15.133:0/3486833168 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c012ae0 con 0x7f23840c1010 2023-12-19T19:02:14.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.796+0000 7f238359e640 1 -- 172.21.15.133:0/3486833168 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23841ed290 con 0x7f23840c1010 2023-12-19T19:02:14.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.796+0000 7f238359e640 1 -- 172.21.15.133:0/3486833168 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f238404e850 con 0x7f23840c1010 2023-12-19T19:02:14.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.796+0000 7f237affd640 1 -- 172.21.15.133:0/3486833168 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f236c012c40 con 0x7f23840c1010 2023-12-19T19:02:14.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.800+0000 7f237affd640 1 --2- 172.21.15.133:0/3486833168 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2364066470 0x7f2364068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:14.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.800+0000 7f237affd640 1 -- 172.21.15.133:0/3486833168 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f236c0845c0 con 0x7f23840c1010 2023-12-19T19:02:14.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.800+0000 7f238259c640 1 --2- 172.21.15.133:0/3486833168 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2364066470 0x7f2364068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:14.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.800+0000 7f238259c640 1 --2- 172.21.15.133:0/3486833168 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2364066470 0x7f2364068930 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f23740ae000 tx=0x7f23740b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:14.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.804+0000 7f237affd640 1 -- 172.21.15.133:0/3486833168 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f236c051780 con 0x7f23840c1010 2023-12-19T19:02:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.952+0000 7f238359e640 1 -- 172.21.15.133:0/3486833168 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f23840c5370 con 0x7f23840c1010 2023-12-19T19:02:14.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.952+0000 7f237affd640 1 -- 172.21.15.133:0/3486833168 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) v1 ==== 100+0+11 (secure 0 0 0) 0x7f236c007380 con 0x7f23840c1010 2023-12-19T19:02:14.957 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:02:14.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.952+0000 7f238359e640 1 -- 172.21.15.133:0/3486833168 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2364066470 msgr2=0x7f2364068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:14.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.952+0000 7f238359e640 1 --2- 172.21.15.133:0/3486833168 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2364066470 0x7f2364068930 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f23740ae000 tx=0x7f23740b5040 comp rx=0 tx=0).stop 2023-12-19T19:02:14.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.952+0000 7f238359e640 1 -- 172.21.15.133:0/3486833168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23840c1010 msgr2=0x7f23840a6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:14.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.952+0000 7f238359e640 1 --2- 172.21.15.133:0/3486833168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23840c1010 0x7f23840a6a60 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f236c00d5f0 tx=0x7f236c00dab0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.952+0000 7f238359e640 1 -- 172.21.15.133:0/3486833168 shutdown_connections 2023-12-19T19:02:14.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.952+0000 7f238359e640 1 --2- 172.21.15.133:0/3486833168 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2364066470 0x7f2364068930 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.952+0000 7f238359e640 1 --2- 172.21.15.133:0/3486833168 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f238414f800 0x7f23841ed7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.952+0000 7f238359e640 1 --2- 172.21.15.133:0/3486833168 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f23840c1010 0x7f23840a6a60 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.952+0000 7f238359e640 1 --2- 172.21.15.133:0/3486833168 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2384072860 0x7f23841500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:14.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.952+0000 7f238359e640 1 -- 172.21.15.133:0/3486833168 >> 172.21.15.133:0/3486833168 conn(0x7f23840a7800 msgr2=0x7f23840bee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:14.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.952+0000 7f238359e640 1 -- 172.21.15.133:0/3486833168 shutdown_connections 2023-12-19T19:02:14.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:14.952+0000 7f238359e640 1 -- 172.21.15.133:0/3486833168 wait complete. 2023-12-19T19:02:14.978 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-19T19:02:15.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.116+0000 7f1abd757640 1 Processor -- start 2023-12-19T19:02:15.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.116+0000 7f1abd757640 1 -- start start 2023-12-19T19:02:15.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.116+0000 7f1abd757640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ab8155de0 0x7f1ab8156230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:15.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.116+0000 7f1abd757640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab80c2580 con 0x7f1ab80c5640 2023-12-19T19:02:15.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.116+0000 7f1abd757640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab80c1a00 con 0x7f1ab80c5260 2023-12-19T19:02:15.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.116+0000 7f1abd757640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab8153510 con 0x7f1ab8155de0 2023-12-19T19:02:15.121 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.116+0000 7f1aae7fc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1ab80c5640 0x7f1ab80c5bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34038/0 (socket says 172.21.15.133:34038) 2023-12-19T19:02:15.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.116+0000 7f1aae7fc640 1 -- 172.21.15.133:0/1901707778 learned_addr learned my addr 172.21.15.133:0/1901707778 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:15.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.116+0000 7f1ab77fe640 1 --2- 172.21.15.133:0/1901707778 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ab8155de0 0x7f1ab8156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:15.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.116+0000 7f1ab67fc640 1 -- 172.21.15.133:0/1901707778 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242203174 0 0) 0x7f1ab80c2580 con 0x7f1ab80c5640 2023-12-19T19:02:15.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.116+0000 7f1ab67fc640 1 -- 172.21.15.133:0/1901707778 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aa4003530 con 0x7f1ab80c5640 2023-12-19T19:02:15.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.116+0000 7f1ab67fc640 1 -- 172.21.15.133:0/1901707778 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 324977466 0 0) 0x7f1ab80c1a00 con 0x7f1ab80c5260 2023-12-19T19:02:15.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.116+0000 7f1ab67fc640 1 -- 172.21.15.133:0/1901707778 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ab80c2580 con 0x7f1ab80c5260 2023-12-19T19:02:15.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.116+0000 7f1ab77fe640 1 -- 172.21.15.133:0/1901707778 >> v1:172.21.15.138:6789/0 conn(0x7f1ab80c5260 legacy=0x7f1ab806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:15.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.116+0000 7f1ab77fe640 1 -- 172.21.15.133:0/1901707778 >> v1:172.21.15.133:6789/0 conn(0x7f1ab80c5640 legacy=0x7f1ab80c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:15.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.116+0000 7f1ab77fe640 1 -- 172.21.15.133:0/1901707778 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab80c1ce0 con 0x7f1ab8155de0 2023-12-19T19:02:15.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.120+0000 7f1ab77fe640 1 --2- 172.21.15.133:0/1901707778 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ab8155de0 0x7f1ab8156230 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009dc0 tx=0x7f1ab001c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b31afdfc95ee17c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:15.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.120+0000 7f1ab67fc640 1 -- 172.21.15.133:0/1901707778 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00a5890 con 0x7f1ab8155de0 2023-12-19T19:02:15.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.120+0000 7f1ab67fc640 1 -- 172.21.15.133:0/1901707778 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab00a59f0 con 0x7f1ab8155de0 2023-12-19T19:02:15.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.120+0000 7f1ab67fc640 1 -- 172.21.15.133:0/1901707778 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab00a5d60 con 0x7f1ab8155de0 2023-12-19T19:02:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.120+0000 7f1abd757640 1 -- 172.21.15.133:0/1901707778 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ab8155de0 msgr2=0x7f1ab8156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.120+0000 7f1abd757640 1 --2- 172.21.15.133:0/1901707778 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ab8155de0 0x7f1ab8156230 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0009dc0 tx=0x7f1ab001c8e0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.120+0000 7f1abd757640 1 -- 172.21.15.133:0/1901707778 shutdown_connections 2023-12-19T19:02:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.120+0000 7f1abd757640 1 --2- 172.21.15.133:0/1901707778 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ab8155de0 0x7f1ab8156230 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.120+0000 7f1abd757640 1 -- 172.21.15.133:0/1901707778 >> 172.21.15.133:0/1901707778 conn(0x7f1ab806a5b0 msgr2=0x7f1ab806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.120+0000 7f1abd757640 1 -- 172.21.15.133:0/1901707778 shutdown_connections 2023-12-19T19:02:15.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.120+0000 7f1abd757640 1 -- 172.21.15.133:0/1901707778 wait complete. 2023-12-19T19:02:15.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1abd757640 1 Processor -- start 2023-12-19T19:02:15.128 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1abd757640 1 -- start start 2023-12-19T19:02:15.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1abd757640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab80c5260 0x7f1ab8154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:15.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1abd757640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ab80c5640 0x7f1ab814ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:15.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1abd757640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ab8155de0 0x7f1ab814e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:15.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1abd757640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab81ef000 con 0x7f1ab80c5260 2023-12-19T19:02:15.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1abd757640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab81ee760 con 0x7f1ab8155de0 2023-12-19T19:02:15.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1abd757640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab8150e90 con 0x7f1ab80c5640 2023-12-19T19:02:15.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1ab6ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab80c5260 0x7f1ab8154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1ab6ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab80c5260 0x7f1ab8154610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38830/0 (socket says 172.21.15.133:38830) 2023-12-19T19:02:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1ab6ffd640 1 -- 172.21.15.133:0/2206010026 learned_addr learned my addr 172.21.15.133:0/2206010026 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1ab77fe640 1 --2- 172.21.15.133:0/2206010026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ab8155de0 0x7f1ab814e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1aae7fc640 1 --2- 172.21.15.133:0/2206010026 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ab80c5640 0x7f1ab814ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1ab6ffd640 1 -- 172.21.15.133:0/2206010026 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ab80c5640 msgr2=0x7f1ab814ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1ab6ffd640 1 --2- 172.21.15.133:0/2206010026 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ab80c5640 0x7f1ab814ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1ab6ffd640 1 -- 172.21.15.133:0/2206010026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ab8155de0 msgr2=0x7f1ab814e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1ab6ffd640 1 --2- 172.21.15.133:0/2206010026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ab8155de0 0x7f1ab814e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1ab6ffd640 1 -- 172.21.15.133:0/2206010026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab0009a70 con 0x7f1ab80c5260 2023-12-19T19:02:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1ab6ffd640 1 --2- 172.21.15.133:0/2206010026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab80c5260 0x7f1ab8154610 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800c430 tx=0x7f1aa800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1aaffff640 1 -- 172.21.15.133:0/2206010026 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa80052d0 con 0x7f1ab80c5260 2023-12-19T19:02:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1aaffff640 1 -- 172.21.15.133:0/2206010026 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa8005450 con 0x7f1ab80c5260 2023-12-19T19:02:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1aaffff640 1 -- 172.21.15.133:0/2206010026 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa8003840 con 0x7f1ab80c5260 2023-12-19T19:02:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1abd757640 1 -- 172.21.15.133:0/2206010026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab81ee9b0 con 0x7f1ab80c5260 2023-12-19T19:02:15.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1abd757640 1 -- 172.21.15.133:0/2206010026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab8154b50 con 0x7f1ab80c5260 2023-12-19T19:02:15.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.124+0000 7f1abd757640 1 -- 172.21.15.133:0/2206010026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab8068400 con 0x7f1ab80c5260 2023-12-19T19:02:15.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.128+0000 7f1aaffff640 1 -- 172.21.15.133:0/2206010026 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1aa80039a0 con 0x7f1ab80c5260 2023-12-19T19:02:15.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.128+0000 7f1aaffff640 1 --2- 172.21.15.133:0/2206010026 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1a98066470 0x7f1a98068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:15.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.128+0000 7f1aaffff640 1 -- 172.21.15.133:0/2206010026 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1aa8083790 con 0x7f1ab80c5260 2023-12-19T19:02:15.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.128+0000 7f1aae7fc640 1 --2- 172.21.15.133:0/2206010026 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1a98066470 0x7f1a98068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:15.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.128+0000 7f1aae7fc640 1 --2- 172.21.15.133:0/2206010026 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1a98066470 0x7f1a98068930 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1ab814fb70 tx=0x7f1aa0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:15.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.132+0000 7f1aaffff640 1 -- 172.21.15.133:0/2206010026 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1aa80508a0 con 0x7f1ab80c5260 2023-12-19T19:02:15.285 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.280+0000 7f1abd757640 1 -- 172.21.15.133:0/2206010026 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1ab81553e0 con 0x7f1ab80c5260 2023-12-19T19:02:15.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.280+0000 7f1aaffff640 1 -- 172.21.15.133:0/2206010026 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v73) v1 ==== 105+0+11 (secure 0 0 0) 0x7f1aa8053ec0 con 0x7f1ab80c5260 2023-12-19T19:02:15.286 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:02:15.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.280+0000 7f1abd757640 1 -- 172.21.15.133:0/2206010026 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1a98066470 msgr2=0x7f1a98068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:15.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.280+0000 7f1abd757640 1 --2- 172.21.15.133:0/2206010026 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1a98066470 0x7f1a98068930 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1ab814fb70 tx=0x7f1aa0009040 comp rx=0 tx=0).stop 2023-12-19T19:02:15.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.280+0000 7f1abd757640 1 -- 172.21.15.133:0/2206010026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab80c5260 msgr2=0x7f1ab8154610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:15.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.280+0000 7f1abd757640 1 --2- 172.21.15.133:0/2206010026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab80c5260 0x7f1ab8154610 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f1aa800c430 tx=0x7f1aa800c8f0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.284+0000 7f1abd757640 1 -- 172.21.15.133:0/2206010026 shutdown_connections 2023-12-19T19:02:15.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.284+0000 7f1abd757640 1 --2- 172.21.15.133:0/2206010026 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f1a98066470 0x7f1a98068930 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.284+0000 7f1abd757640 1 --2- 172.21.15.133:0/2206010026 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1ab8155de0 0x7f1ab814e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.284+0000 7f1abd757640 1 --2- 172.21.15.133:0/2206010026 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1ab80c5640 0x7f1ab814ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.284+0000 7f1abd757640 1 --2- 172.21.15.133:0/2206010026 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1ab80c5260 0x7f1ab8154610 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.284+0000 7f1abd757640 1 -- 172.21.15.133:0/2206010026 >> 172.21.15.133:0/2206010026 conn(0x7f1ab806a5b0 msgr2=0x7f1ab80c4760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:15.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.284+0000 7f1abd757640 1 -- 172.21.15.133:0/2206010026 shutdown_connections 2023-12-19T19:02:15.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.284+0000 7f1abd757640 1 -- 172.21.15.133:0/2206010026 wait complete. 2023-12-19T19:02:15.306 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-19T19:02:15.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.440+0000 7f72307c1640 1 Processor -- start 2023-12-19T19:02:15.446 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.440+0000 7f72307c1640 1 -- start start 2023-12-19T19:02:15.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f72307c1640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f72280c7ea0 0x7f722806b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:15.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f72307c1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f722806b9e0 0x7f722815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:15.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f72307c1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f722806c860 con 0x7f7228151e90 2023-12-19T19:02:15.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f72307c1640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72280c8750 con 0x7f72280c7ea0 2023-12-19T19:02:15.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f72307c1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72281552d0 con 0x7f722806b9e0 2023-12-19T19:02:15.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722e55d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7228151e90 0x7f72280c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34054/0 (socket says 172.21.15.133:34054) 2023-12-19T19:02:15.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722e55d640 1 -- 172.21.15.133:0/3500208819 learned_addr learned my addr 172.21.15.133:0/3500208819 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:15.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722dd5c640 1 --2- 172.21.15.133:0/3500208819 >> v2:172.21.15.138:3300/0 conn(0x7f72280c7ea0 0x7f722806b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:15.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722ed5e640 1 --2- 172.21.15.133:0/3500208819 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f722806b9e0 0x7f722815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:15.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722d55b640 1 -- 172.21.15.133:0/3500208819 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1058882446 0 0) 0x7f722806c860 con 0x7f7228151e90 2023-12-19T19:02:15.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722d55b640 1 -- 172.21.15.133:0/3500208819 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7214003530 con 0x7f7228151e90 2023-12-19T19:02:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722d55b640 1 -- 172.21.15.133:0/3500208819 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1669089696 0 0) 0x7f7214003530 con 0x7f7228151e90 2023-12-19T19:02:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722d55b640 1 -- 172.21.15.133:0/3500208819 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f722806b9e0 msgr2=0x7f722815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722d55b640 1 --2- 172.21.15.133:0/3500208819 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f722806b9e0 0x7f722815f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722d55b640 1 -- 172.21.15.133:0/3500208819 >> v2:172.21.15.138:3300/0 conn(0x7f72280c7ea0 msgr2=0x7f722806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722d55b640 1 --2- 172.21.15.133:0/3500208819 >> v2:172.21.15.138:3300/0 conn(0x7f72280c7ea0 0x7f722806b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722d55b640 1 -- 172.21.15.133:0/3500208819 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7228154930 con 0x7f7228151e90 2023-12-19T19:02:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722d55b640 1 -- 172.21.15.133:0/3500208819 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f7224001680 con 0x7f7228151e90 2023-12-19T19:02:15.450 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722d55b640 1 -- 172.21.15.133:0/3500208819 >> v1:172.21.15.133:6789/0 conn(0x7f7228151e90 legacy=0x7f72280c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722d55b640 1 --2- 172.21.15.133:0/3500208819 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f722806b9e0 0x7f7214003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722d55b640 1 --2- 172.21.15.133:0/3500208819 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7214003f50 0x7f72140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722d55b640 1 --2- 172.21.15.133:0/3500208819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7214004d10 0x7f7214005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722d55b640 1 -- 172.21.15.133:0/3500208819 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72280c8750 con 0x7f7214004d10 2023-12-19T19:02:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722d55b640 1 -- 172.21.15.133:0/3500208819 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72281552d0 con 0x7f7214003f50 2023-12-19T19:02:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722d55b640 1 -- 172.21.15.133:0/3500208819 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721400bac0 con 0x7f722806b9e0 2023-12-19T19:02:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722dd5c640 1 --2- 172.21.15.133:0/3500208819 >> v2:172.21.15.138:3300/0 conn(0x7f72280c7ea0 0x7f722806b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:02:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722ed5e640 1 --2- 172.21.15.133:0/3500208819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7214004d10 0x7f7214005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722e55d640 1 --2- 172.21.15.133:0/3500208819 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f722806b9e0 0x7f7214003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722dd5c640 1 --2- 172.21.15.133:0/3500208819 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7214003f50 0x7f72140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722ed5e640 1 -- 172.21.15.133:0/3500208819 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f722806b9e0 msgr2=0x7f7214003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722ed5e640 1 --2- 172.21.15.133:0/3500208819 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f722806b9e0 0x7f7214003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722ed5e640 1 -- 172.21.15.133:0/3500208819 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7214003f50 msgr2=0x7f72140047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:15.451 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722ed5e640 1 --2- 172.21.15.133:0/3500208819 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7214003f50 0x7f72140047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.452 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.444+0000 7f722ed5e640 1 -- 172.21.15.133:0/3500208819 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7214003530 con 0x7f7214004d10 2023-12-19T19:02:15.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.448+0000 7f722ed5e640 1 --2- 172.21.15.133:0/3500208819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7214004d10 0x7f7214005190 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f7220009fc0 tx=0x7f722001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=facbb35b3bad7e57 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:15.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.448+0000 7f722d55b640 1 -- 172.21.15.133:0/3500208819 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72200a5a50 con 0x7f7214004d10 2023-12-19T19:02:15.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.448+0000 7f722d55b640 1 -- 172.21.15.133:0/3500208819 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722000f040 con 0x7f7214004d10 2023-12-19T19:02:15.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.448+0000 7f722d55b640 1 -- 172.21.15.133:0/3500208819 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72200a5df0 con 0x7f7214004d10 2023-12-19T19:02:15.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.448+0000 7f72307c1640 1 -- 172.21.15.133:0/3500208819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7214004d10 msgr2=0x7f7214005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:15.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.448+0000 7f72307c1640 1 --2- 172.21.15.133:0/3500208819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7214004d10 0x7f7214005190 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f7220009fc0 tx=0x7f722001cc60 comp rx=0 tx=0).stop 2023-12-19T19:02:15.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.448+0000 7f722ed5e640 1 -- 172.21.15.133:0/3500208819 reap_dead start 2023-12-19T19:02:15.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.448+0000 7f72307c1640 1 -- 172.21.15.133:0/3500208819 shutdown_connections 2023-12-19T19:02:15.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.448+0000 7f72307c1640 1 -- 172.21.15.133:0/3500208819 >> 172.21.15.133:0/3500208819 conn(0x7f72280ca170 msgr2=0x7f72280ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:15.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.448+0000 7f72307c1640 1 -- 172.21.15.133:0/3500208819 shutdown_connections 2023-12-19T19:02:15.453 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.448+0000 7f72307c1640 1 -- 172.21.15.133:0/3500208819 wait complete. 2023-12-19T19:02:15.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.448+0000 7f72307c1640 1 Processor -- start 2023-12-19T19:02:15.454 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.448+0000 7f72307c1640 1 -- start start 2023-12-19T19:02:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f72307c1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7214004d10 0x7f722814a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f72307c1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72281587f0 0x7f72280ab040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f72307c1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f72280ab580 0x7f72281f01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f72307c1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7228157c80 con 0x7f7214004d10 2023-12-19T19:02:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f72307c1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72281492c0 con 0x7f72280ab580 2023-12-19T19:02:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f72307c1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72280c0b70 con 0x7f72281587f0 2023-12-19T19:02:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f722e55d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7214004d10 0x7f722814a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f722e55d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7214004d10 0x7f722814a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38852/0 (socket says 172.21.15.133:38852) 2023-12-19T19:02:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f722e55d640 1 -- 172.21.15.133:0/2402461258 learned_addr learned my addr 172.21.15.133:0/2402461258 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:15.456 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f722ed5e640 1 --2- 172.21.15.133:0/2402461258 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f72280ab580 0x7f72281f01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:15.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f722dd5c640 1 --2- 172.21.15.133:0/2402461258 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72281587f0 0x7f72280ab040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:15.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f722e55d640 1 -- 172.21.15.133:0/2402461258 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72281587f0 msgr2=0x7f72280ab040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:15.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f722e55d640 1 --2- 172.21.15.133:0/2402461258 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72281587f0 0x7f72280ab040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f722e55d640 1 -- 172.21.15.133:0/2402461258 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f72280ab580 msgr2=0x7f72281f01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:15.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f722e55d640 1 --2- 172.21.15.133:0/2402461258 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f72280ab580 0x7f72281f01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f722e55d640 1 -- 172.21.15.133:0/2402461258 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72280c0dc0 con 0x7f7214004d10 2023-12-19T19:02:15.457 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f722e55d640 1 --2- 172.21.15.133:0/2402461258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7214004d10 0x7f722814a6a0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f7224007340 tx=0x7f7224007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:15.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f721effd640 1 -- 172.21.15.133:0/2402461258 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722400f9c0 con 0x7f7214004d10 2023-12-19T19:02:15.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f721effd640 1 -- 172.21.15.133:0/2402461258 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722400fb20 con 0x7f7214004d10 2023-12-19T19:02:15.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f72307c1640 1 -- 172.21.15.133:0/2402461258 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72281579a0 con 0x7f7214004d10 2023-12-19T19:02:15.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f721effd640 1 -- 172.21.15.133:0/2402461258 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722400feb0 con 0x7f7214004d10 2023-12-19T19:02:15.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f72307c1640 1 -- 172.21.15.133:0/2402461258 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72281582d0 con 0x7f7214004d10 2023-12-19T19:02:15.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f72307c1640 1 -- 172.21.15.133:0/2402461258 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7228157e50 con 0x7f7214004d10 2023-12-19T19:02:15.458 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.452+0000 7f721effd640 1 -- 172.21.15.133:0/2402461258 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f722401d460 con 0x7f7214004d10 2023-12-19T19:02:15.459 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.456+0000 7f721effd640 1 --2- 172.21.15.133:0/2402461258 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f720c066470 0x7f720c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:15.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.456+0000 7f721effd640 1 -- 172.21.15.133:0/2402461258 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7224084450 con 0x7f7214004d10 2023-12-19T19:02:15.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.456+0000 7f722dd5c640 1 --2- 172.21.15.133:0/2402461258 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f720c066470 0x7f720c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:15.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.456+0000 7f722dd5c640 1 --2- 172.21.15.133:0/2402461258 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f720c066470 0x7f720c068930 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f722815c480 tx=0x7f7218008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:15.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.460+0000 7f721effd640 1 -- 172.21.15.133:0/2402461258 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f7228157e50 con 0x7f7214004d10 2023-12-19T19:02:15.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.608+0000 7f72307c1640 1 -- 172.21.15.133:0/2402461258 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f7228157e50 con 0x7f7214004d10 2023-12-19T19:02:15.613 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.608+0000 7f721effd640 1 -- 172.21.15.133:0/2402461258 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v73) v1 ==== 101+0+11 (secure 0 0 0) 0x7f7228157e50 con 0x7f7214004d10 2023-12-19T19:02:15.614 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:02:15.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.612+0000 7f72307c1640 1 -- 172.21.15.133:0/2402461258 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f720c066470 msgr2=0x7f720c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:15.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.612+0000 7f72307c1640 1 --2- 172.21.15.133:0/2402461258 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f720c066470 0x7f720c068930 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f722815c480 tx=0x7f7218008040 comp rx=0 tx=0).stop 2023-12-19T19:02:15.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.612+0000 7f72307c1640 1 -- 172.21.15.133:0/2402461258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7214004d10 msgr2=0x7f722814a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:15.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.612+0000 7f72307c1640 1 --2- 172.21.15.133:0/2402461258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7214004d10 0x7f722814a6a0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f7224007340 tx=0x7f7224007800 comp rx=0 tx=0).stop 2023-12-19T19:02:15.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.612+0000 7f72307c1640 1 -- 172.21.15.133:0/2402461258 shutdown_connections 2023-12-19T19:02:15.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.612+0000 7f72307c1640 1 --2- 172.21.15.133:0/2402461258 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f720c066470 0x7f720c068930 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.612+0000 7f72307c1640 1 --2- 172.21.15.133:0/2402461258 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f72280ab580 0x7f72281f01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.612+0000 7f72307c1640 1 --2- 172.21.15.133:0/2402461258 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f72281587f0 0x7f72280ab040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.612+0000 7f72307c1640 1 --2- 172.21.15.133:0/2402461258 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7214004d10 0x7f722814a6a0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.612+0000 7f72307c1640 1 -- 172.21.15.133:0/2402461258 >> 172.21.15.133:0/2402461258 conn(0x7f72280ca170 msgr2=0x7f7228147400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:15.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.612+0000 7f72307c1640 1 -- 172.21.15.133:0/2402461258 shutdown_connections 2023-12-19T19:02:15.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.612+0000 7f72307c1640 1 -- 172.21.15.133:0/2402461258 wait complete. 2023-12-19T19:02:15.635 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T19:02:15.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.768+0000 7f2ec5780640 1 Processor -- start 2023-12-19T19:02:15.775 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.768+0000 7f2ec5780640 1 -- start start 2023-12-19T19:02:15.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.772+0000 7f2ec5780640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2ec0151dc0 0x7f2ec00c4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:15.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.772+0000 7f2ec5780640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2ec00c7ed0 0x7f2ec0154650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:15.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.772+0000 7f2ec5780640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec00ac4f0 con 0x7f2ec00bd660 2023-12-19T19:02:15.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.772+0000 7f2ec5780640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec0158780 con 0x7f2ec0151dc0 2023-12-19T19:02:15.776 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.772+0000 7f2ec5780640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec0158a60 con 0x7f2ec00c7ed0 2023-12-19T19:02:15.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.772+0000 7f2ebf7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2ec00bd660 0x7f2ec0154b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34060/0 (socket says 172.21.15.133:34060) 2023-12-19T19:02:15.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.772+0000 7f2ebeffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2ec0151dc0 0x7f2ec00c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:15.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.772+0000 7f2ebf7fe640 1 -- 172.21.15.133:0/2340261404 learned_addr learned my addr 172.21.15.133:0/2340261404 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:15.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.772+0000 7f2eb67fc640 1 --2- 172.21.15.133:0/2340261404 >> v2:172.21.15.138:3300/0 conn(0x7f2ec00c7ed0 0x7f2ec0154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:15.777 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.772+0000 7f2ebe7fc640 1 -- 172.21.15.133:0/2340261404 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 794126855 0 0) 0x7f2ec00ac4f0 con 0x7f2ec00bd660 2023-12-19T19:02:15.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.772+0000 7f2ebeffd640 1 -- 172.21.15.133:0/2340261404 >> v2:172.21.15.138:3300/0 conn(0x7f2ec00c7ed0 msgr2=0x7f2ec0154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:15.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.772+0000 7f2ebeffd640 1 --2- 172.21.15.133:0/2340261404 >> v2:172.21.15.138:3300/0 conn(0x7f2ec00c7ed0 0x7f2ec0154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.772+0000 7f2ebeffd640 1 -- 172.21.15.133:0/2340261404 >> v1:172.21.15.133:6789/0 conn(0x7f2ec00bd660 legacy=0x7f2ec0154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:15.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.772+0000 7f2ebeffd640 1 -- 172.21.15.133:0/2340261404 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec00ac180 con 0x7f2ec0151dc0 2023-12-19T19:02:15.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.772+0000 7f2eb67fc640 1 --2- 172.21.15.133:0/2340261404 >> v2:172.21.15.138:3300/0 conn(0x7f2ec00c7ed0 0x7f2ec0154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:15.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.776+0000 7f2ebeffd640 1 --2- 172.21.15.133:0/2340261404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ec0151dc0 0x7f2ec00c4950 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00097c0 tx=0x7f2eb001c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a02d7fb19588df2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:15.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.776+0000 7f2ebe7fc640 1 -- 172.21.15.133:0/2340261404 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb00ab600 con 0x7f2ec0151dc0 2023-12-19T19:02:15.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.776+0000 7f2ebe7fc640 1 -- 172.21.15.133:0/2340261404 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb00a7050 con 0x7f2ec0151dc0 2023-12-19T19:02:15.780 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.776+0000 7f2ebe7fc640 1 -- 172.21.15.133:0/2340261404 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb00ab980 con 0x7f2ec0151dc0 2023-12-19T19:02:15.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.776+0000 7f2ec5780640 1 -- 172.21.15.133:0/2340261404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ec0151dc0 msgr2=0x7f2ec00c4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:15.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.776+0000 7f2ec5780640 1 --2- 172.21.15.133:0/2340261404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ec0151dc0 0x7f2ec00c4950 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00097c0 tx=0x7f2eb001c320 comp rx=0 tx=0).stop 2023-12-19T19:02:15.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.776+0000 7f2ec5780640 1 -- 172.21.15.133:0/2340261404 shutdown_connections 2023-12-19T19:02:15.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.776+0000 7f2ec5780640 1 --2- 172.21.15.133:0/2340261404 >> v2:172.21.15.138:3300/0 conn(0x7f2ec00c7ed0 0x7f2ec0154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.776+0000 7f2ec5780640 1 --2- 172.21.15.133:0/2340261404 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ec0151dc0 0x7f2ec00c4950 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.776+0000 7f2ec5780640 1 -- 172.21.15.133:0/2340261404 >> 172.21.15.133:0/2340261404 conn(0x7f2ec0071eb0 msgr2=0x7f2ec00722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:15.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.776+0000 7f2ec5780640 1 -- 172.21.15.133:0/2340261404 shutdown_connections 2023-12-19T19:02:15.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.776+0000 7f2ec5780640 1 -- 172.21.15.133:0/2340261404 wait complete. 2023-12-19T19:02:15.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.776+0000 7f2ec5780640 1 Processor -- start 2023-12-19T19:02:15.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.776+0000 7f2ec5780640 1 -- start start 2023-12-19T19:02:15.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2ec5780640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ec00bd660 0x7f2ec00c0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:15.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2ec5780640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec00c7ed0 0x7f2ec00bdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:15.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2ec5780640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec0151dc0 0x7f2ec014e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:15.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2ec5780640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec014d4a0 con 0x7f2ec00bd660 2023-12-19T19:02:15.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2ec5780640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec014d600 con 0x7f2ec0151dc0 2023-12-19T19:02:15.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2ec5780640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec014de60 con 0x7f2ec00c7ed0 2023-12-19T19:02:15.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2ebeffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ec00bd660 0x7f2ec00c0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:15.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2ebeffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ec00bd660 0x7f2ec00c0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38874/0 (socket says 172.21.15.133:38874) 2023-12-19T19:02:15.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2ebeffd640 1 -- 172.21.15.133:0/311767919 learned_addr learned my addr 172.21.15.133:0/311767919 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:15.785 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2eb67fc640 1 --2- 172.21.15.133:0/311767919 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec00c7ed0 0x7f2ec00bdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:15.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2ebf7fe640 1 --2- 172.21.15.133:0/311767919 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec0151dc0 0x7f2ec014e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:15.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2ebeffd640 1 -- 172.21.15.133:0/311767919 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec00c7ed0 msgr2=0x7f2ec00bdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:15.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2ebeffd640 1 --2- 172.21.15.133:0/311767919 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec00c7ed0 0x7f2ec00bdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2ebeffd640 1 -- 172.21.15.133:0/311767919 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec0151dc0 msgr2=0x7f2ec014e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:15.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2ebeffd640 1 --2- 172.21.15.133:0/311767919 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec0151dc0 0x7f2ec014e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2ebeffd640 1 -- 172.21.15.133:0/311767919 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb0009420 con 0x7f2ec00bd660 2023-12-19T19:02:15.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2ebeffd640 1 --2- 172.21.15.133:0/311767919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ec00bd660 0x7f2ec00c0460 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0018f30 tx=0x7f2eb001ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:15.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2eb7fff640 1 -- 172.21.15.133:0/311767919 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0004230 con 0x7f2ec00bd660 2023-12-19T19:02:15.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2eb7fff640 1 -- 172.21.15.133:0/311767919 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb0004390 con 0x7f2ec00bd660 2023-12-19T19:02:15.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2eb7fff640 1 -- 172.21.15.133:0/311767919 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0003820 con 0x7f2ec00bd660 2023-12-19T19:02:15.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2ec5780640 1 -- 172.21.15.133:0/311767919 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec01ee000 con 0x7f2ec00bd660 2023-12-19T19:02:15.786 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2ec5780640 1 -- 172.21.15.133:0/311767919 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec014daf0 con 0x7f2ec00bd660 2023-12-19T19:02:15.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2ec5780640 1 -- 172.21.15.133:0/311767919 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec0068400 con 0x7f2ec00bd660 2023-12-19T19:02:15.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.780+0000 7f2eb7fff640 1 -- 172.21.15.133:0/311767919 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2eb0003980 con 0x7f2ec00bd660 2023-12-19T19:02:15.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.784+0000 7f2eb7fff640 1 --2- 172.21.15.133:0/311767919 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2ea0066470 0x7f2ea0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:15.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.784+0000 7f2eb7fff640 1 -- 172.21.15.133:0/311767919 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2eb00a4e40 con 0x7f2ec00bd660 2023-12-19T19:02:15.788 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.784+0000 7f2eb67fc640 1 --2- 172.21.15.133:0/311767919 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2ea0066470 0x7f2ea0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:15.789 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.784+0000 7f2eb67fc640 1 --2- 172.21.15.133:0/311767919 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2ea0066470 0x7f2ea0068930 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2ec00c4c30 tx=0x7f2ea8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:15.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.788+0000 7f2eb7fff640 1 -- 172.21.15.133:0/311767919 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2eb00ebc50 con 0x7f2ec00bd660 2023-12-19T19:02:15.956 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.948+0000 7f2ec5780640 1 -- 172.21.15.133:0/311767919 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2ec006c9a0 con 0x7f2ec00bd660 2023-12-19T19:02:15.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.948+0000 7f2eb7fff640 1 -- 172.21.15.133:0/311767919 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v73) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2eb00b0080 con 0x7f2ec00bd660 2023-12-19T19:02:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:listed 0 entries 2023-12-19T19:02:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.952+0000 7f2ec5780640 1 -- 172.21.15.133:0/311767919 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2ea0066470 msgr2=0x7f2ea0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.952+0000 7f2ec5780640 1 --2- 172.21.15.133:0/311767919 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2ea0066470 0x7f2ea0068930 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2ec00c4c30 tx=0x7f2ea8008040 comp rx=0 tx=0).stop 2023-12-19T19:02:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.952+0000 7f2ec5780640 1 -- 172.21.15.133:0/311767919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ec00bd660 msgr2=0x7f2ec00c0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.952+0000 7f2ec5780640 1 --2- 172.21.15.133:0/311767919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ec00bd660 0x7f2ec00c0460 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f2eb0018f30 tx=0x7f2eb001ab60 comp rx=0 tx=0).stop 2023-12-19T19:02:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.952+0000 7f2ec5780640 1 -- 172.21.15.133:0/311767919 shutdown_connections 2023-12-19T19:02:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.952+0000 7f2ec5780640 1 --2- 172.21.15.133:0/311767919 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2ea0066470 0x7f2ea0068930 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.952+0000 7f2ec5780640 1 --2- 172.21.15.133:0/311767919 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2ec0151dc0 0x7f2ec014e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.952+0000 7f2ec5780640 1 --2- 172.21.15.133:0/311767919 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2ec00c7ed0 0x7f2ec00bdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.952+0000 7f2ec5780640 1 --2- 172.21.15.133:0/311767919 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2ec00bd660 0x7f2ec00c0460 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.952+0000 7f2ec5780640 1 -- 172.21.15.133:0/311767919 >> 172.21.15.133:0/311767919 conn(0x7f2ec0071eb0 msgr2=0x7f2ec015e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.952+0000 7f2ec5780640 1 -- 172.21.15.133:0/311767919 shutdown_connections 2023-12-19T19:02:15.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:15.952+0000 7f2ec5780640 1 -- 172.21.15.133:0/311767919 wait complete. 2023-12-19T19:02:15.975 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2023-12-19T19:02:15.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:15.975 DEBUG:teuthology.orchestra.run.smithi138:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-12-19T19:02:16.008 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi138.front.sepia.ceph.com 2023-12-19T19:02:16.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:16.008 DEBUG:teuthology.orchestra.run.smithi138:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T19:02:16.064 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T19:02:16.064 DEBUG:teuthology.orchestra.run.smithi133:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T19:02:16.149 DEBUG:teuthology.orchestra.run.smithi138:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T19:02:16.270 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T19:02:16.270 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T19:02:16.270 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:02:16.279 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3517 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-19T19:02:16.279 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:02:16.279 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:02:16.289 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3612 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-19T19:02:16.289 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:02:16.460 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.456+0000 7ff63d5f5640 1 Processor -- start 2023-12-19T19:02:16.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.456+0000 7ff63d5f5640 1 -- start start 2023-12-19T19:02:16.461 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.456+0000 7ff63d5f5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff638151e90 0x7ff6380c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:16.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.456+0000 7ff63d5f5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff6380c4e60 0x7ff63806bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:16.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.456+0000 7ff63d5f5640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff63806c860 con 0x7ff6380c7ea0 2023-12-19T19:02:16.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.456+0000 7ff63d5f5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6380c8750 con 0x7ff6380c4e60 2023-12-19T19:02:16.462 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.456+0000 7ff63d5f5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6381552d0 con 0x7ff638151e90 2023-12-19T19:02:16.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.456+0000 7ff6377fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff6380c4e60 0x7ff63806bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:16.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.456+0000 7ff636ffd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff638151e90 0x7ff6380c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:16.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.456+0000 7ff6377fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff6380c4e60 0x7ff63806bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:47596/0 (socket says 172.21.15.133:47596) 2023-12-19T19:02:16.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.456+0000 7ff6377fe640 1 -- 172.21.15.133:0/2092753550 learned_addr learned my addr 172.21.15.133:0/2092753550 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:16.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.456+0000 7ff62e7fc640 1 --1- 172.21.15.133:0/2092753550 >> v1:172.21.15.138:6789/0 conn(0x7ff6380c7ea0 0x7ff63806b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:46388/0 (socket says 172.21.15.133:46388) 2023-12-19T19:02:16.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.456+0000 7ff6377fe640 1 -- 172.21.15.133:0/2092753550 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff638151e90 msgr2=0x7ff6380c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:16.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.456+0000 7ff6377fe640 1 --2- 172.21.15.133:0/2092753550 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff638151e90 0x7ff6380c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:16.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.456+0000 7ff6377fe640 1 -- 172.21.15.133:0/2092753550 >> v1:172.21.15.138:6789/0 conn(0x7ff6380c7ea0 legacy=0x7ff63806b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:16.463 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.456+0000 7ff6377fe640 1 -- 172.21.15.133:0/2092753550 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff638154930 con 0x7ff6380c4e60 2023-12-19T19:02:16.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.460+0000 7ff6377fe640 1 --2- 172.21.15.133:0/2092753550 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6380c4e60 0x7ff63806bbb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff630009e50 tx=0x7ff63001c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e4366c3bd146e8a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:16.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.460+0000 7ff6367fc640 1 -- 172.21.15.133:0/2092753550 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6300a55b0 con 0x7ff6380c4e60 2023-12-19T19:02:16.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.460+0000 7ff6367fc640 1 -- 172.21.15.133:0/2092753550 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6300a5710 con 0x7ff6380c4e60 2023-12-19T19:02:16.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.460+0000 7ff6367fc640 1 -- 172.21.15.133:0/2092753550 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6300a5aa0 con 0x7ff6380c4e60 2023-12-19T19:02:16.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.460+0000 7ff63d5f5640 1 -- 172.21.15.133:0/2092753550 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6380c4e60 msgr2=0x7ff63806bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:16.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.460+0000 7ff63d5f5640 1 --2- 172.21.15.133:0/2092753550 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6380c4e60 0x7ff63806bbb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff630009e50 tx=0x7ff63001c8f0 comp rx=0 tx=0).stop 2023-12-19T19:02:16.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.460+0000 7ff63d5f5640 1 -- 172.21.15.133:0/2092753550 shutdown_connections 2023-12-19T19:02:16.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.460+0000 7ff63d5f5640 1 --2- 172.21.15.133:0/2092753550 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6380c4e60 0x7ff63806bbb0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:16.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.460+0000 7ff63d5f5640 1 --2- 172.21.15.133:0/2092753550 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff638151e90 0x7ff6380c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:16.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.460+0000 7ff63d5f5640 1 -- 172.21.15.133:0/2092753550 >> 172.21.15.133:0/2092753550 conn(0x7ff6380ca170 msgr2=0x7ff6380ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:16.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.460+0000 7ff63d5f5640 1 -- 172.21.15.133:0/2092753550 shutdown_connections 2023-12-19T19:02:16.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.460+0000 7ff63d5f5640 1 -- 172.21.15.133:0/2092753550 wait complete. 2023-12-19T19:02:16.467 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff63d5f5640 1 Processor -- start 2023-12-19T19:02:16.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff63d5f5640 1 -- start start 2023-12-19T19:02:16.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff63d5f5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6380c4e60 0x7ff6381ed1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:16.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff63d5f5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6380c7ea0 0x7ff6381ed700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:16.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff63d5f5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff638151e90 0x7ff6380c32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:16.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff63d5f5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6380aab80 con 0x7ff638151e90 2023-12-19T19:02:16.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff63d5f5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6381edc40 con 0x7ff6380c4e60 2023-12-19T19:02:16.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff63d5f5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63814d310 con 0x7ff6380c7ea0 2023-12-19T19:02:16.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff6377fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff638151e90 0x7ff6380c32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:16.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff6377fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff638151e90 0x7ff6380c32c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38880/0 (socket says 172.21.15.133:38880) 2023-12-19T19:02:16.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff6377fe640 1 -- 172.21.15.133:0/193998467 learned_addr learned my addr 172.21.15.133:0/193998467 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:16.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff636ffd640 1 --2- 172.21.15.133:0/193998467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6380c4e60 0x7ff6381ed1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:16.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff62e7fc640 1 --2- 172.21.15.133:0/193998467 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6380c7ea0 0x7ff6381ed700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:16.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff6377fe640 1 -- 172.21.15.133:0/193998467 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6380c7ea0 msgr2=0x7ff6381ed700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:16.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff6377fe640 1 --2- 172.21.15.133:0/193998467 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6380c7ea0 0x7ff6381ed700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:16.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff6377fe640 1 -- 172.21.15.133:0/193998467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6380c4e60 msgr2=0x7ff6381ed1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:16.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff6377fe640 1 --2- 172.21.15.133:0/193998467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6380c4e60 0x7ff6381ed1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:16.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff6377fe640 1 -- 172.21.15.133:0/193998467 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff630009b30 con 0x7ff638151e90 2023-12-19T19:02:16.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff62e7fc640 1 --2- 172.21.15.133:0/193998467 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6380c7ea0 0x7ff6381ed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:16.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff6377fe640 1 --2- 172.21.15.133:0/193998467 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff638151e90 0x7ff6380c32c0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7ff63001a520 tx=0x7ff630019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:16.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff62ffff640 1 -- 172.21.15.133:0/193998467 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6300a55b0 con 0x7ff638151e90 2023-12-19T19:02:16.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff62ffff640 1 -- 172.21.15.133:0/193998467 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6300b8670 con 0x7ff638151e90 2023-12-19T19:02:16.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff63d5f5640 1 -- 172.21.15.133:0/193998467 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff63814d5f0 con 0x7ff638151e90 2023-12-19T19:02:16.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff62ffff640 1 -- 172.21.15.133:0/193998467 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6300b89e0 con 0x7ff638151e90 2023-12-19T19:02:16.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.464+0000 7ff63d5f5640 1 -- 172.21.15.133:0/193998467 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63814dbb0 con 0x7ff638151e90 2023-12-19T19:02:16.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.468+0000 7ff63d5f5640 1 -- 172.21.15.133:0/193998467 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff638068400 con 0x7ff638151e90 2023-12-19T19:02:16.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.468+0000 7ff62ffff640 1 -- 172.21.15.133:0/193998467 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff6300b8b40 con 0x7ff638151e90 2023-12-19T19:02:16.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.468+0000 7ff62ffff640 1 --2- 172.21.15.133:0/193998467 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff618066470 0x7ff618068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:16.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.468+0000 7ff62ffff640 1 -- 172.21.15.133:0/193998467 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff63011f3e0 con 0x7ff638151e90 2023-12-19T19:02:16.473 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.468+0000 7ff636ffd640 1 --2- 172.21.15.133:0/193998467 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff618066470 0x7ff618068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:16.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.468+0000 7ff636ffd640 1 --2- 172.21.15.133:0/193998467 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff618066470 0x7ff618068930 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff628009b60 tx=0x7ff628009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:16.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.472+0000 7ff62ffff640 1 -- 172.21.15.133:0/193998467 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff6300ec610 con 0x7ff638151e90 2023-12-19T19:02:16.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.652+0000 7ff63d5f5640 1 -- 172.21.15.133:0/193998467 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff63815ed70 con 0x7ff638151e90 2023-12-19T19:02:16.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.652+0000 7ff62ffff640 1 -- 172.21.15.133:0/193998467 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6196 (secure 0 0 0) 0x7ff630009510 con 0x7ff638151e90 2023-12-19T19:02:16.659 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:16.659 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/2119189888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":2119189888},{"type":"v1","addr":"172.21.15.133:6835","nonce":2119189888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/4005236173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":4005236173},{"type":"v1","addr":"172.21.15.138:6835","nonce":4005236173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:01:35.356022+0000","modified":"2023-12-19T19:01:38.376795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6834/2813206606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2813206606},{"type":"v1","addr":"172.21.15.133:6834","nonce":2813206606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:01:53.054600+0000","modified":"2023-12-19T19:01:56.088450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5765},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5765":{"gid":5765,"name":"d","rank":0,"incarnation":49,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6837/1466041773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":1466041773},{"type":"v1","addr":"172.21.15.138:6837","nonce":1466041773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T19:02:16.659 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 53 2023-12-19T19:02:16.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.656+0000 7ff63d5f5640 1 -- 172.21.15.133:0/193998467 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff618066470 msgr2=0x7ff618068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:16.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.656+0000 7ff63d5f5640 1 --2- 172.21.15.133:0/193998467 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff618066470 0x7ff618068930 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff628009b60 tx=0x7ff628009190 comp rx=0 tx=0).stop 2023-12-19T19:02:16.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.656+0000 7ff63d5f5640 1 -- 172.21.15.133:0/193998467 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff638151e90 msgr2=0x7ff6380c32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:16.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.656+0000 7ff63d5f5640 1 --2- 172.21.15.133:0/193998467 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff638151e90 0x7ff6380c32c0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7ff63001a520 tx=0x7ff630019690 comp rx=0 tx=0).stop 2023-12-19T19:02:16.661 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.656+0000 7ff63d5f5640 1 -- 172.21.15.133:0/193998467 shutdown_connections 2023-12-19T19:02:16.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.656+0000 7ff63d5f5640 1 --2- 172.21.15.133:0/193998467 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff618066470 0x7ff618068930 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:16.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.656+0000 7ff63d5f5640 1 --2- 172.21.15.133:0/193998467 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff638151e90 0x7ff6380c32c0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:16.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.656+0000 7ff63d5f5640 1 --2- 172.21.15.133:0/193998467 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff6380c7ea0 0x7ff6381ed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:16.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.656+0000 7ff63d5f5640 1 --2- 172.21.15.133:0/193998467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff6380c4e60 0x7ff6381ed1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:16.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.656+0000 7ff63d5f5640 1 -- 172.21.15.133:0/193998467 >> 172.21.15.133:0/193998467 conn(0x7ff6380ca170 msgr2=0x7ff6380ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:16.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.656+0000 7ff63d5f5640 1 -- 172.21.15.133:0/193998467 shutdown_connections 2023-12-19T19:02:16.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.656+0000 7ff63d5f5640 1 -- 172.21.15.133:0/193998467 wait complete. 2023-12-19T19:02:16.680 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:02:16.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.816+0000 7fb2f7596640 1 Processor -- start 2023-12-19T19:02:16.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.816+0000 7fb2f7596640 1 -- start start 2023-12-19T19:02:16.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.816+0000 7fb2f7596640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2f01560e0 0x7fb2f015ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:16.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.816+0000 7fb2f7596640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb2f006d520 0x7fb2f0159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:16.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.816+0000 7fb2f7596640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f015c600 con 0x7fb2f00bffc0 2023-12-19T19:02:16.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.816+0000 7fb2f7596640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f01594e0 con 0x7fb2f006d520 2023-12-19T19:02:16.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.816+0000 7fb2f7596640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f01597c0 con 0x7fb2f01560e0 2023-12-19T19:02:16.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.816+0000 7fb2f5b33640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fb2f00bffc0 0x7fb2f00c1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34066/0 (socket says 172.21.15.133:34066) 2023-12-19T19:02:16.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.816+0000 7fb2f5b33640 1 -- 172.21.15.133:0/49261148 learned_addr learned my addr 172.21.15.133:0/49261148 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:16.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.816+0000 7fb2f4b31640 1 --2- 172.21.15.133:0/49261148 >> v2:172.21.15.138:3300/0 conn(0x7fb2f006d520 0x7fb2f0159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:16.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.816+0000 7fb2f5332640 1 --2- 172.21.15.133:0/49261148 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2f01560e0 0x7fb2f015ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:16.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.816+0000 7fb2e7fff640 1 -- 172.21.15.133:0/49261148 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3407456595 0 0) 0x7fb2f015c600 con 0x7fb2f00bffc0 2023-12-19T19:02:16.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.820+0000 7fb2e7fff640 1 -- 172.21.15.133:0/49261148 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2dc003530 con 0x7fb2f00bffc0 2023-12-19T19:02:16.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.820+0000 7fb2f4b31640 1 -- 172.21.15.133:0/49261148 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2f01560e0 msgr2=0x7fb2f015ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:16.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.820+0000 7fb2f4b31640 1 --2- 172.21.15.133:0/49261148 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2f01560e0 0x7fb2f015ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:16.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.820+0000 7fb2e7fff640 1 -- 172.21.15.133:0/49261148 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 773255592 0 0) 0x7fb2dc003530 con 0x7fb2f00bffc0 2023-12-19T19:02:16.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.820+0000 7fb2f4b31640 1 -- 172.21.15.133:0/49261148 >> v1:172.21.15.133:6789/0 conn(0x7fb2f00bffc0 legacy=0x7fb2f00c1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:16.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.820+0000 7fb2f4b31640 1 -- 172.21.15.133:0/49261148 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f015bfb0 con 0x7fb2f006d520 2023-12-19T19:02:16.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.820+0000 7fb2f4b31640 1 --2- 172.21.15.133:0/49261148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2f006d520 0x7fb2f0159eb0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00097c0 tx=0x7fb2e001c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e08a585db3391bfc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:16.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.820+0000 7fb2e7fff640 1 -- 172.21.15.133:0/49261148 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f01566d0 con 0x7fb2f006d520 2023-12-19T19:02:16.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.820+0000 7fb2e7fff640 1 -- 172.21.15.133:0/49261148 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e00a7050 con 0x7fb2f006d520 2023-12-19T19:02:16.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.820+0000 7fb2e7fff640 1 -- 172.21.15.133:0/49261148 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e8001a00 con 0x7fb2f006d520 2023-12-19T19:02:16.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f7596640 1 -- 172.21.15.133:0/49261148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2f006d520 msgr2=0x7fb2f0159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:16.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f7596640 1 --2- 172.21.15.133:0/49261148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2f006d520 0x7fb2f0159eb0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb2e00097c0 tx=0x7fb2e001c370 comp rx=0 tx=0).stop 2023-12-19T19:02:16.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f7596640 1 -- 172.21.15.133:0/49261148 shutdown_connections 2023-12-19T19:02:16.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f7596640 1 --2- 172.21.15.133:0/49261148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2f006d520 0x7fb2f0159eb0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:16.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f7596640 1 --2- 172.21.15.133:0/49261148 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2f01560e0 0x7fb2f015ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:16.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f7596640 1 -- 172.21.15.133:0/49261148 >> 172.21.15.133:0/49261148 conn(0x7fb2f006a5b0 msgr2=0x7fb2f006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:16.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f7596640 1 -- 172.21.15.133:0/49261148 shutdown_connections 2023-12-19T19:02:16.828 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f7596640 1 -- 172.21.15.133:0/49261148 wait complete. 2023-12-19T19:02:16.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f7596640 1 Processor -- start 2023-12-19T19:02:16.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f7596640 1 -- start start 2023-12-19T19:02:16.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f7596640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2f006d520 0x7fb2f0155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:16.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f7596640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2f00bffc0 0x7fb2f00aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:16.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f7596640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2f01560e0 0x7fb2f01f42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:16.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f7596640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f00bdc00 con 0x7fb2f01560e0 2023-12-19T19:02:16.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f7596640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f00bf450 con 0x7fb2f006d520 2023-12-19T19:02:16.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f7596640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f00bf640 con 0x7fb2f00bffc0 2023-12-19T19:02:16.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f5b33640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2f01560e0 0x7fb2f01f42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:16.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f5b33640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2f01560e0 0x7fb2f01f42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38896/0 (socket says 172.21.15.133:38896) 2023-12-19T19:02:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f5b33640 1 -- 172.21.15.133:0/1682270043 learned_addr learned my addr 172.21.15.133:0/1682270043 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f4b31640 1 --2- 172.21.15.133:0/1682270043 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2f00bffc0 0x7fb2f00aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f5332640 1 --2- 172.21.15.133:0/1682270043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2f006d520 0x7fb2f0155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f5b33640 1 -- 172.21.15.133:0/1682270043 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2f00bffc0 msgr2=0x7fb2f00aa8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f5b33640 1 --2- 172.21.15.133:0/1682270043 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2f00bffc0 0x7fb2f00aa8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f5b33640 1 -- 172.21.15.133:0/1682270043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2f006d520 msgr2=0x7fb2f0155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f5b33640 1 --2- 172.21.15.133:0/1682270043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2f006d520 0x7fb2f0155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f5b33640 1 -- 172.21.15.133:0/1682270043 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e0009420 con 0x7fb2f01560e0 2023-12-19T19:02:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2f5b33640 1 --2- 172.21.15.133:0/1682270043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2f01560e0 0x7fb2f01f42e0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8001f80 tx=0x7fb2e800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.824+0000 7fb2e5ffb640 1 -- 172.21.15.133:0/1682270043 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e8012400 con 0x7fb2f01560e0 2023-12-19T19:02:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.828+0000 7fb2e5ffb640 1 -- 172.21.15.133:0/1682270043 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2e8012560 con 0x7fb2f01560e0 2023-12-19T19:02:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.828+0000 7fb2f7596640 1 -- 172.21.15.133:0/1682270043 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f00bf920 con 0x7fb2f01560e0 2023-12-19T19:02:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.828+0000 7fb2e5ffb640 1 -- 172.21.15.133:0/1682270043 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2e80128d0 con 0x7fb2f01560e0 2023-12-19T19:02:16.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.828+0000 7fb2f7596640 1 -- 172.21.15.133:0/1682270043 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f00aa0b0 con 0x7fb2f01560e0 2023-12-19T19:02:16.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.828+0000 7fb2f7596640 1 -- 172.21.15.133:0/1682270043 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f0068400 con 0x7fb2f01560e0 2023-12-19T19:02:16.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.828+0000 7fb2e5ffb640 1 -- 172.21.15.133:0/1682270043 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb2e8012a30 con 0x7fb2f01560e0 2023-12-19T19:02:16.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.828+0000 7fb2e5ffb640 1 --2- 172.21.15.133:0/1682270043 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb2d4066470 0x7fb2d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:16.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.828+0000 7fb2e5ffb640 1 -- 172.21.15.133:0/1682270043 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb2e8084780 con 0x7fb2f01560e0 2023-12-19T19:02:16.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.828+0000 7fb2f5332640 1 --2- 172.21.15.133:0/1682270043 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb2d4066470 0x7fb2d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:16.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.828+0000 7fb2f5332640 1 --2- 172.21.15.133:0/1682270043 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb2d4066470 0x7fb2d4068930 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0157aa0 tx=0x7fb2ec009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:16.837 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.832+0000 7fb2e5ffb640 1 -- 172.21.15.133:0/1682270043 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb2e80519e0 con 0x7fb2f01560e0 2023-12-19T19:02:16.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.984+0000 7fb2f7596640 1 -- 172.21.15.133:0/1682270043 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2f015cdb0 con 0x7fb2f01560e0 2023-12-19T19:02:16.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.984+0000 7fb2e5ffb640 1 -- 172.21.15.133:0/1682270043 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+20250 (secure 0 0 0) 0x7fb2e8055000 con 0x7fb2f01560e0 2023-12-19T19:02:16.991 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:16.991 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":73,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:01:54.705538+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:01:33.082188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T19:01:34.349092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:01:50.875086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:01:52.061232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:02:16.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.988+0000 7fb2f7596640 1 -- 172.21.15.133:0/1682270043 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb2d4066470 msgr2=0x7fb2d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:16.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.988+0000 7fb2f7596640 1 --2- 172.21.15.133:0/1682270043 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb2d4066470 0x7fb2d4068930 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0157aa0 tx=0x7fb2ec009190 comp rx=0 tx=0).stop 2023-12-19T19:02:16.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.988+0000 7fb2f7596640 1 -- 172.21.15.133:0/1682270043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2f01560e0 msgr2=0x7fb2f01f42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:16.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.988+0000 7fb2f7596640 1 --2- 172.21.15.133:0/1682270043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2f01560e0 0x7fb2f01f42e0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fb2e8001f80 tx=0x7fb2e800a430 comp rx=0 tx=0).stop 2023-12-19T19:02:16.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.988+0000 7fb2f7596640 1 -- 172.21.15.133:0/1682270043 shutdown_connections 2023-12-19T19:02:16.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.988+0000 7fb2f7596640 1 --2- 172.21.15.133:0/1682270043 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb2d4066470 0x7fb2d4068930 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:16.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.988+0000 7fb2f7596640 1 --2- 172.21.15.133:0/1682270043 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb2f01560e0 0x7fb2f01f42e0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:16.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.988+0000 7fb2f7596640 1 --2- 172.21.15.133:0/1682270043 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb2f00bffc0 0x7fb2f00aa8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:16.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.988+0000 7fb2f7596640 1 --2- 172.21.15.133:0/1682270043 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb2f006d520 0x7fb2f0155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:16.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.988+0000 7fb2f7596640 1 -- 172.21.15.133:0/1682270043 >> 172.21.15.133:0/1682270043 conn(0x7fb2f006a5b0 msgr2=0x7fb2f01586b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:16.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.988+0000 7fb2f7596640 1 -- 172.21.15.133:0/1682270043 shutdown_connections 2023-12-19T19:02:16.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:16.988+0000 7fb2f7596640 1 -- 172.21.15.133:0/1682270043 wait complete. 2023-12-19T19:02:17.012 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T19:01:33.082188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '68', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T19:01:34.349092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '69', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-19T19:01:50.875086+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-19T19:01:52.061232+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T19:02:17.013 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T19:02:17.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.148+0000 7f213526b640 1 Processor -- start 2023-12-19T19:02:17.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.148+0000 7f213526b640 1 -- start start 2023-12-19T19:02:17.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.148+0000 7f213526b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f21300c4100 0x7f21300c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:17.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.148+0000 7f213526b640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f21300c06d0 0x7f21300a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:17.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.148+0000 7f213526b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21300c31c0 con 0x7f21300c63c0 2023-12-19T19:02:17.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.148+0000 7f213526b640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21300c34a0 con 0x7f21300c4100 2023-12-19T19:02:17.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.148+0000 7f213526b640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21300c1030 con 0x7f21300c06d0 2023-12-19T19:02:17.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.148+0000 7f212effd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f21300c63c0 0x7f21300c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34076/0 (socket says 172.21.15.133:34076) 2023-12-19T19:02:17.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.148+0000 7f212effd640 1 -- 172.21.15.133:0/2124699308 learned_addr learned my addr 172.21.15.133:0/2124699308 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:17.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.148+0000 7f212e7fc640 1 --2- 172.21.15.133:0/2124699308 >> v2:172.21.15.133:3300/0 conn(0x7f21300c4100 0x7f21300c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:17.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.148+0000 7f212f7fe640 1 --2- 172.21.15.133:0/2124699308 >> v2:172.21.15.138:3300/0 conn(0x7f21300c06d0 0x7f21300a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:17.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.148+0000 7f212dffb640 1 -- 172.21.15.133:0/2124699308 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2198217959 0 0) 0x7f21300c31c0 con 0x7f21300c63c0 2023-12-19T19:02:17.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.148+0000 7f212dffb640 1 -- 172.21.15.133:0/2124699308 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2110005740 con 0x7f21300c63c0 2023-12-19T19:02:17.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.152+0000 7f212e7fc640 1 -- 172.21.15.133:0/2124699308 >> v2:172.21.15.138:3300/0 conn(0x7f21300c06d0 msgr2=0x7f21300a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:17.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.152+0000 7f212e7fc640 1 --2- 172.21.15.133:0/2124699308 >> v2:172.21.15.138:3300/0 conn(0x7f21300c06d0 0x7f21300a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.152+0000 7f212e7fc640 1 -- 172.21.15.133:0/2124699308 >> v1:172.21.15.133:6789/0 conn(0x7f21300c63c0 legacy=0x7f21300c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:17.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.152+0000 7f212e7fc640 1 -- 172.21.15.133:0/2124699308 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21300c1310 con 0x7f21300c4100 2023-12-19T19:02:17.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.152+0000 7f212e7fc640 1 --2- 172.21.15.133:0/2124699308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21300c4100 0x7f21300c2bb0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f21300c0ee0 tx=0x7f211801c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4ffe822a5cc647 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:17.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.152+0000 7f212dffb640 1 -- 172.21.15.133:0/2124699308 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21300aa3d0 con 0x7f21300c4100 2023-12-19T19:02:17.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.152+0000 7f212dffb640 1 -- 172.21.15.133:0/2124699308 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21180a7050 con 0x7f21300c4100 2023-12-19T19:02:17.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.152+0000 7f212dffb640 1 -- 172.21.15.133:0/2124699308 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21180ab820 con 0x7f21300c4100 2023-12-19T19:02:17.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.152+0000 7f213526b640 1 -- 172.21.15.133:0/2124699308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21300c4100 msgr2=0x7f21300c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:17.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.152+0000 7f213526b640 1 --2- 172.21.15.133:0/2124699308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21300c4100 0x7f21300c2bb0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f21300c0ee0 tx=0x7f211801c340 comp rx=0 tx=0).stop 2023-12-19T19:02:17.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.152+0000 7f213526b640 1 -- 172.21.15.133:0/2124699308 shutdown_connections 2023-12-19T19:02:17.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.152+0000 7f213526b640 1 --2- 172.21.15.133:0/2124699308 >> v2:172.21.15.138:3300/0 conn(0x7f21300c06d0 0x7f21300a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.152+0000 7f213526b640 1 --2- 172.21.15.133:0/2124699308 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21300c4100 0x7f21300c2bb0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.152+0000 7f213526b640 1 -- 172.21.15.133:0/2124699308 >> 172.21.15.133:0/2124699308 conn(0x7f213006a5b0 msgr2=0x7f213006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:17.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.152+0000 7f213526b640 1 -- 172.21.15.133:0/2124699308 shutdown_connections 2023-12-19T19:02:17.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.152+0000 7f213526b640 1 -- 172.21.15.133:0/2124699308 wait complete. 2023-12-19T19:02:17.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f213526b640 1 Processor -- start 2023-12-19T19:02:17.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f213526b640 1 -- start start 2023-12-19T19:02:17.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f213526b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21300c06d0 0x7f2130154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:17.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f213526b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21300c4100 0x7f2130159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:17.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f213526b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21300c63c0 0x7f213014eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:17.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f213526b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213014de70 con 0x7f21300c4100 2023-12-19T19:02:17.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f213526b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2130158d00 con 0x7f21300c63c0 2023-12-19T19:02:17.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f213526b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21301ec7b0 con 0x7f21300c06d0 2023-12-19T19:02:17.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f212e7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21300c4100 0x7f2130159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:17.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f212e7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21300c4100 0x7f2130159400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38918/0 (socket says 172.21.15.133:38918) 2023-12-19T19:02:17.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f212e7fc640 1 -- 172.21.15.133:0/3506520653 learned_addr learned my addr 172.21.15.133:0/3506520653 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:17.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f212effd640 1 --2- 172.21.15.133:0/3506520653 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21300c06d0 0x7f2130154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:17.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f212f7fe640 1 --2- 172.21.15.133:0/3506520653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21300c63c0 0x7f213014eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:17.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f212e7fc640 1 -- 172.21.15.133:0/3506520653 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21300c06d0 msgr2=0x7f2130154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:17.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f212e7fc640 1 --2- 172.21.15.133:0/3506520653 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21300c06d0 0x7f2130154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f212e7fc640 1 -- 172.21.15.133:0/3506520653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21300c63c0 msgr2=0x7f213014eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:17.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f212e7fc640 1 --2- 172.21.15.133:0/3506520653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21300c63c0 0x7f213014eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f212e7fc640 1 -- 172.21.15.133:0/3506520653 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2118009420 con 0x7f21300c4100 2023-12-19T19:02:17.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f212e7fc640 1 --2- 172.21.15.133:0/3506520653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21300c4100 0x7f2130159400 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f2118019f70 tx=0x7f21180190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:17.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f21277fe640 1 -- 172.21.15.133:0/3506520653 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21180b4430 con 0x7f21300c4100 2023-12-19T19:02:17.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f21277fe640 1 -- 172.21.15.133:0/3506520653 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21180b45b0 con 0x7f21300c4100 2023-12-19T19:02:17.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f21277fe640 1 -- 172.21.15.133:0/3506520653 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21180b4960 con 0x7f21300c4100 2023-12-19T19:02:17.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f213526b640 1 -- 172.21.15.133:0/3506520653 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21301eca90 con 0x7f21300c4100 2023-12-19T19:02:17.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.156+0000 7f213526b640 1 -- 172.21.15.133:0/3506520653 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213014f7c0 con 0x7f21300c4100 2023-12-19T19:02:17.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.160+0000 7f213526b640 1 -- 172.21.15.133:0/3506520653 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21300aa7a0 con 0x7f21300c4100 2023-12-19T19:02:17.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.160+0000 7f21277fe640 1 -- 172.21.15.133:0/3506520653 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f21180b2040 con 0x7f21300c4100 2023-12-19T19:02:17.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.160+0000 7f21277fe640 1 --2- 172.21.15.133:0/3506520653 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2114066470 0x7f2114068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:17.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.160+0000 7f21277fe640 1 -- 172.21.15.133:0/3506520653 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f211811dff0 con 0x7f21300c4100 2023-12-19T19:02:17.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.160+0000 7f212effd640 1 --2- 172.21.15.133:0/3506520653 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2114066470 0x7f2114068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:17.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.160+0000 7f212effd640 1 --2- 172.21.15.133:0/3506520653 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2114066470 0x7f2114068930 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2120005890 tx=0x7f2120009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:17.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.164+0000 7f21277fe640 1 -- 172.21.15.133:0/3506520653 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f211814f290 con 0x7f21300c4100 2023-12-19T19:02:17.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.312+0000 7f213526b640 1 -- 172.21.15.133:0/3506520653 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2130154cd0 con 0x7f21300c4100 2023-12-19T19:02:17.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.316+0000 7f21277fe640 1 -- 172.21.15.133:0/3506520653 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2130154cd0 con 0x7f21300c4100 2023-12-19T19:02:17.319 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T19:02:17.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.316+0000 7f213526b640 1 -- 172.21.15.133:0/3506520653 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2114066470 msgr2=0x7f2114068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.316+0000 7f213526b640 1 --2- 172.21.15.133:0/3506520653 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2114066470 0x7f2114068930 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2120005890 tx=0x7f2120009040 comp rx=0 tx=0).stop 2023-12-19T19:02:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.316+0000 7f213526b640 1 -- 172.21.15.133:0/3506520653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21300c4100 msgr2=0x7f2130159400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.316+0000 7f213526b640 1 --2- 172.21.15.133:0/3506520653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21300c4100 0x7f2130159400 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f2118019f70 tx=0x7f21180190e0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.316+0000 7f213526b640 1 -- 172.21.15.133:0/3506520653 shutdown_connections 2023-12-19T19:02:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.316+0000 7f213526b640 1 --2- 172.21.15.133:0/3506520653 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2114066470 0x7f2114068930 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.316+0000 7f213526b640 1 --2- 172.21.15.133:0/3506520653 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f21300c63c0 0x7f213014eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.316+0000 7f213526b640 1 --2- 172.21.15.133:0/3506520653 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f21300c4100 0x7f2130159400 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.316+0000 7f213526b640 1 --2- 172.21.15.133:0/3506520653 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f21300c06d0 0x7f2130154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.316+0000 7f213526b640 1 -- 172.21.15.133:0/3506520653 >> 172.21.15.133:0/3506520653 conn(0x7f213006a5b0 msgr2=0x7f2130070000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.316+0000 7f213526b640 1 -- 172.21.15.133:0/3506520653 shutdown_connections 2023-12-19T19:02:17.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.316+0000 7f213526b640 1 -- 172.21.15.133:0/3506520653 wait complete. 2023-12-19T19:02:17.340 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T19:02:17.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.476+0000 7f064eafe640 1 Processor -- start 2023-12-19T19:02:17.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.476+0000 7f064eafe640 1 -- start start 2023-12-19T19:02:17.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.476+0000 7f064eafe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0648072090 0x7f0648150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:17.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.476+0000 7f064eafe640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06480c2760 con 0x7f06480725c0 2023-12-19T19:02:17.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.476+0000 7f064eafe640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06480a5750 con 0x7f06480a5370 2023-12-19T19:02:17.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.476+0000 7f064eafe640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06480c3070 con 0x7f0648072090 2023-12-19T19:02:17.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.476+0000 7f063ffff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0648072090 0x7f0648150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:17.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.476+0000 7f064d09b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f06480725c0 0x7f06481514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34092/0 (socket says 172.21.15.133:34092) 2023-12-19T19:02:17.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.476+0000 7f064d09b640 1 -- 172.21.15.133:0/3213029466 learned_addr learned my addr 172.21.15.133:0/3213029466 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:17.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.476+0000 7f063ffff640 1 -- 172.21.15.133:0/3213029466 >> v1:172.21.15.138:6789/0 conn(0x7f06480a5370 legacy=0x7f06480c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:17.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.476+0000 7f063ffff640 1 -- 172.21.15.133:0/3213029466 >> v1:172.21.15.133:6789/0 conn(0x7f06480725c0 legacy=0x7f06481514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:17.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.476+0000 7f063ffff640 1 -- 172.21.15.133:0/3213029466 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06480aad20 con 0x7f0648072090 2023-12-19T19:02:17.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.476+0000 7f063f7fe640 1 -- 172.21.15.133:0/3213029466 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835066954 0 0) 0x7f06480c2760 con 0x7f06480725c0 2023-12-19T19:02:17.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.480+0000 7f063ffff640 1 --2- 172.21.15.133:0/3213029466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0648072090 0x7f0648150fa0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f06380097c0 tx=0x7f063801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15fa5633f479df3a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:17.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.480+0000 7f063f7fe640 1 -- 172.21.15.133:0/3213029466 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06380ab600 con 0x7f0648072090 2023-12-19T19:02:17.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.480+0000 7f063f7fe640 1 -- 172.21.15.133:0/3213029466 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06380a7050 con 0x7f0648072090 2023-12-19T19:02:17.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.480+0000 7f063f7fe640 1 -- 172.21.15.133:0/3213029466 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06380ab980 con 0x7f0648072090 2023-12-19T19:02:17.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.480+0000 7f064eafe640 1 -- 172.21.15.133:0/3213029466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0648072090 msgr2=0x7f0648150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:17.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.480+0000 7f064eafe640 1 --2- 172.21.15.133:0/3213029466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0648072090 0x7f0648150fa0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f06380097c0 tx=0x7f063801c360 comp rx=0 tx=0).stop 2023-12-19T19:02:17.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.480+0000 7f064eafe640 1 -- 172.21.15.133:0/3213029466 shutdown_connections 2023-12-19T19:02:17.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.480+0000 7f064eafe640 1 --2- 172.21.15.133:0/3213029466 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0648072090 0x7f0648150fa0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.480+0000 7f064eafe640 1 -- 172.21.15.133:0/3213029466 >> 172.21.15.133:0/3213029466 conn(0x7f064806a5b0 msgr2=0x7f064806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:17.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.480+0000 7f064eafe640 1 -- 172.21.15.133:0/3213029466 shutdown_connections 2023-12-19T19:02:17.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.480+0000 7f064eafe640 1 -- 172.21.15.133:0/3213029466 wait complete. 2023-12-19T19:02:17.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f064eafe640 1 Processor -- start 2023-12-19T19:02:17.488 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f064eafe640 1 -- start start 2023-12-19T19:02:17.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f064eafe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0648072090 0x7f064815ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:17.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f064eafe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06480725c0 0x7f064814e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:17.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f064eafe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06480a5370 0x7f0648147a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:17.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f064eafe640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0648153cd0 con 0x7f06480725c0 2023-12-19T19:02:17.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f064eafe640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0648154af0 con 0x7f06480a5370 2023-12-19T19:02:17.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f064eafe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0648153ee0 con 0x7f0648072090 2023-12-19T19:02:17.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f063ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06480725c0 0x7f064814e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:17.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f063ffff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06480725c0 0x7f064814e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38938/0 (socket says 172.21.15.133:38938) 2023-12-19T19:02:17.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f063ffff640 1 -- 172.21.15.133:0/1278497161 learned_addr learned my addr 172.21.15.133:0/1278497161 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:17.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f064d09b640 1 --2- 172.21.15.133:0/1278497161 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06480a5370 0x7f0648147a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:17.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f064c89a640 1 --2- 172.21.15.133:0/1278497161 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0648072090 0x7f064815ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:17.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f063ffff640 1 -- 172.21.15.133:0/1278497161 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0648072090 msgr2=0x7f064815ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:17.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f063ffff640 1 --2- 172.21.15.133:0/1278497161 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0648072090 0x7f064815ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f063ffff640 1 -- 172.21.15.133:0/1278497161 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06480a5370 msgr2=0x7f0648147a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:17.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f063ffff640 1 --2- 172.21.15.133:0/1278497161 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06480a5370 0x7f0648147a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f063ffff640 1 -- 172.21.15.133:0/1278497161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0638009420 con 0x7f06480725c0 2023-12-19T19:02:17.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f063ffff640 1 --2- 172.21.15.133:0/1278497161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06480725c0 0x7f064814e5c0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f0638019f90 tx=0x7f0638019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:17.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f063d7fa640 1 -- 172.21.15.133:0/1278497161 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638004220 con 0x7f06480725c0 2023-12-19T19:02:17.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f063d7fa640 1 -- 172.21.15.133:0/1278497161 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0638004380 con 0x7f06480725c0 2023-12-19T19:02:17.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f063d7fa640 1 -- 172.21.15.133:0/1278497161 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638003820 con 0x7f06480725c0 2023-12-19T19:02:17.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f064eafe640 1 -- 172.21.15.133:0/1278497161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06481541c0 con 0x7f06480725c0 2023-12-19T19:02:17.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.484+0000 7f064eafe640 1 -- 172.21.15.133:0/1278497161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0648154780 con 0x7f06480725c0 2023-12-19T19:02:17.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.488+0000 7f064eafe640 1 -- 172.21.15.133:0/1278497161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0648154c60 con 0x7f06480725c0 2023-12-19T19:02:17.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.488+0000 7f063d7fa640 1 -- 172.21.15.133:0/1278497161 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f06380b2040 con 0x7f06480725c0 2023-12-19T19:02:17.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.488+0000 7f063d7fa640 1 --2- 172.21.15.133:0/1278497161 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f06340664a0 0x7f0634068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:17.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.488+0000 7f063d7fa640 1 -- 172.21.15.133:0/1278497161 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f063811e100 con 0x7f06480725c0 2023-12-19T19:02:17.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.488+0000 7f064c89a640 1 --2- 172.21.15.133:0/1278497161 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f06340664a0 0x7f0634068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:17.494 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.488+0000 7f064c89a640 1 --2- 172.21.15.133:0/1278497161 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f06340664a0 0x7f0634068960 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0644000f70 tx=0x7f0644009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:17.497 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.492+0000 7f063d7fa640 1 -- 172.21.15.133:0/1278497161 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f06380eb180 con 0x7f06480725c0 2023-12-19T19:02:17.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.640+0000 7f064eafe640 1 -- 172.21.15.133:0/1278497161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0648068400 con 0x7f06480725c0 2023-12-19T19:02:17.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.644+0000 7f063d7fa640 1 -- 172.21.15.133:0/1278497161 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v73) v1 ==== 104+0+11 (secure 0 0 0) 0x7f06380044f0 con 0x7f06480725c0 2023-12-19T19:02:17.647 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:02:17.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.644+0000 7f064eafe640 1 -- 172.21.15.133:0/1278497161 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f06340664a0 msgr2=0x7f0634068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:17.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.644+0000 7f064eafe640 1 --2- 172.21.15.133:0/1278497161 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f06340664a0 0x7f0634068960 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0644000f70 tx=0x7f0644009040 comp rx=0 tx=0).stop 2023-12-19T19:02:17.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.644+0000 7f064eafe640 1 -- 172.21.15.133:0/1278497161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06480725c0 msgr2=0x7f064814e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:17.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.644+0000 7f064eafe640 1 --2- 172.21.15.133:0/1278497161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06480725c0 0x7f064814e5c0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f0638019f90 tx=0x7f0638019100 comp rx=0 tx=0).stop 2023-12-19T19:02:17.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.644+0000 7f064eafe640 1 -- 172.21.15.133:0/1278497161 shutdown_connections 2023-12-19T19:02:17.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.644+0000 7f064eafe640 1 --2- 172.21.15.133:0/1278497161 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f06340664a0 0x7f0634068960 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.644+0000 7f064eafe640 1 --2- 172.21.15.133:0/1278497161 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06480a5370 0x7f0648147a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.644+0000 7f064eafe640 1 --2- 172.21.15.133:0/1278497161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06480725c0 0x7f064814e5c0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.644+0000 7f064eafe640 1 --2- 172.21.15.133:0/1278497161 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0648072090 0x7f064815ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.644+0000 7f064eafe640 1 -- 172.21.15.133:0/1278497161 >> 172.21.15.133:0/1278497161 conn(0x7f064806a5b0 msgr2=0x7f06480c0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:17.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.644+0000 7f064eafe640 1 -- 172.21.15.133:0/1278497161 shutdown_connections 2023-12-19T19:02:17.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.644+0000 7f064eafe640 1 -- 172.21.15.133:0/1278497161 wait complete. 2023-12-19T19:02:17.668 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T19:02:17.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.808+0000 7f49cc017640 1 Processor -- start 2023-12-19T19:02:17.814 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.808+0000 7f49cc017640 1 -- start start 2023-12-19T19:02:17.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.812+0000 7f49cc017640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f49c40c5640 0x7f49c40c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:17.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.812+0000 7f49cc017640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49c40c60f0 0x7f49c4155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:17.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.812+0000 7f49cc017640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c40c2580 con 0x7f49c40c5260 2023-12-19T19:02:17.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.812+0000 7f49cc017640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c4153510 con 0x7f49c40c5640 2023-12-19T19:02:17.815 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.812+0000 7f49cc017640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40c17f0 con 0x7f49c40c60f0 2023-12-19T19:02:17.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.812+0000 7f49c95b2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f49c40c5640 0x7f49c40c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:17.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.812+0000 7f49c95b2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f49c40c5640 0x7f49c40c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38954/0 (socket says 172.21.15.133:38954) 2023-12-19T19:02:17.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.812+0000 7f49c95b2640 1 -- 172.21.15.133:0/3150497236 learned_addr learned my addr 172.21.15.133:0/3150497236 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:17.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.812+0000 7f49ca5b4640 1 --2- 172.21.15.133:0/3150497236 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49c40c60f0 0x7f49c4155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:17.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.812+0000 7f49c95b2640 1 -- 172.21.15.133:0/3150497236 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49c40c60f0 msgr2=0x7f49c4155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:17.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.812+0000 7f49c95b2640 1 --2- 172.21.15.133:0/3150497236 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49c40c60f0 0x7f49c4155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.812+0000 7f49c95b2640 1 -- 172.21.15.133:0/3150497236 >> v1:172.21.15.138:6789/0 conn(0x7f49c40c5260 legacy=0x7f49c406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:17.816 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.812+0000 7f49c95b2640 1 -- 172.21.15.133:0/3150497236 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c40c1a00 con 0x7f49c40c5640 2023-12-19T19:02:17.817 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.812+0000 7f49ca5b4640 1 --2- 172.21.15.133:0/3150497236 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49c40c60f0 0x7f49c4155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:17.818 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.812+0000 7f49c95b2640 1 --2- 172.21.15.133:0/3150497236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c40c5640 0x7f49c40c5bb0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f49c40c1930 tx=0x7f49b401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21939028b76d0af2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:17.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49c8db1640 1 -- 172.21.15.133:0/3150497236 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b40ab600 con 0x7f49c40c5640 2023-12-19T19:02:17.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49c8db1640 1 -- 172.21.15.133:0/3150497236 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b40a7050 con 0x7f49c40c5640 2023-12-19T19:02:17.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49c8db1640 1 -- 172.21.15.133:0/3150497236 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b40ab980 con 0x7f49c40c5640 2023-12-19T19:02:17.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49cc017640 1 -- 172.21.15.133:0/3150497236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c40c5640 msgr2=0x7f49c40c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:17.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49cc017640 1 --2- 172.21.15.133:0/3150497236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c40c5640 0x7f49c40c5bb0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f49c40c1930 tx=0x7f49b401c460 comp rx=0 tx=0).stop 2023-12-19T19:02:17.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49cc017640 1 -- 172.21.15.133:0/3150497236 shutdown_connections 2023-12-19T19:02:17.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49cc017640 1 --2- 172.21.15.133:0/3150497236 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49c40c60f0 0x7f49c4155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49cc017640 1 --2- 172.21.15.133:0/3150497236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c40c5640 0x7f49c40c5bb0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49cc017640 1 -- 172.21.15.133:0/3150497236 >> 172.21.15.133:0/3150497236 conn(0x7f49c406a5b0 msgr2=0x7f49c406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:17.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49cc017640 1 -- 172.21.15.133:0/3150497236 shutdown_connections 2023-12-19T19:02:17.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49cc017640 1 -- 172.21.15.133:0/3150497236 wait complete. 2023-12-19T19:02:17.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49cc017640 1 Processor -- start 2023-12-19T19:02:17.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49cc017640 1 -- start start 2023-12-19T19:02:17.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49cc017640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49c40c5260 0x7f49c4071730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:17.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49cc017640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49c40c5640 0x7f49c4149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:17.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49cc017640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c40c60f0 0x7f49c414a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:17.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49cc017640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40706b0 con 0x7f49c40c60f0 2023-12-19T19:02:17.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49cc017640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40bb1e0 con 0x7f49c40c5640 2023-12-19T19:02:17.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49cc017640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c41eb920 con 0x7f49c40c5260 2023-12-19T19:02:17.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49ca5b4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c40c60f0 0x7f49c414a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:17.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49ca5b4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c40c60f0 0x7f49c414a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38968/0 (socket says 172.21.15.133:38968) 2023-12-19T19:02:17.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49ca5b4640 1 -- 172.21.15.133:0/1655029338 learned_addr learned my addr 172.21.15.133:0/1655029338 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:17.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49c95b2640 1 --2- 172.21.15.133:0/1655029338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49c40c5640 0x7f49c4149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:17.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.816+0000 7f49c9db3640 1 --2- 172.21.15.133:0/1655029338 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49c40c5260 0x7f49c4071730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:17.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.820+0000 7f49ca5b4640 1 -- 172.21.15.133:0/1655029338 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49c40c5260 msgr2=0x7f49c4071730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:17.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.820+0000 7f49ca5b4640 1 --2- 172.21.15.133:0/1655029338 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49c40c5260 0x7f49c4071730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.820+0000 7f49ca5b4640 1 -- 172.21.15.133:0/1655029338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49c40c5640 msgr2=0x7f49c4149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:17.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.820+0000 7f49ca5b4640 1 --2- 172.21.15.133:0/1655029338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49c40c5640 0x7f49c4149dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.820+0000 7f49ca5b4640 1 -- 172.21.15.133:0/1655029338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b40094d0 con 0x7f49c40c60f0 2023-12-19T19:02:17.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.820+0000 7f49ca5b4640 1 --2- 172.21.15.133:0/1655029338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c40c60f0 0x7f49c414a300 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00cf20 tx=0x7f49bc00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:17.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.820+0000 7f49ba7fc640 1 -- 172.21.15.133:0/1655029338 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc00d840 con 0x7f49c40c60f0 2023-12-19T19:02:17.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.820+0000 7f49ba7fc640 1 -- 172.21.15.133:0/1655029338 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49bc00d9a0 con 0x7f49c40c60f0 2023-12-19T19:02:17.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.820+0000 7f49ba7fc640 1 -- 172.21.15.133:0/1655029338 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc00dd50 con 0x7f49c40c60f0 2023-12-19T19:02:17.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.820+0000 7f49cc017640 1 -- 172.21.15.133:0/1655029338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c4070900 con 0x7f49c40c60f0 2023-12-19T19:02:17.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.820+0000 7f49cc017640 1 -- 172.21.15.133:0/1655029338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c414a840 con 0x7f49c40c60f0 2023-12-19T19:02:17.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.820+0000 7f49cc017640 1 -- 172.21.15.133:0/1655029338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c4068400 con 0x7f49c40c60f0 2023-12-19T19:02:17.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.820+0000 7f49ba7fc640 1 -- 172.21.15.133:0/1655029338 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f49bc01e3b0 con 0x7f49c40c60f0 2023-12-19T19:02:17.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.820+0000 7f49ba7fc640 1 --2- 172.21.15.133:0/1655029338 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f49a8066470 0x7f49a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:17.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.820+0000 7f49ba7fc640 1 -- 172.21.15.133:0/1655029338 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f49bc084be0 con 0x7f49c40c60f0 2023-12-19T19:02:17.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.820+0000 7f49c9db3640 1 --2- 172.21.15.133:0/1655029338 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f49a8066470 0x7f49a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:17.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.824+0000 7f49c9db3640 1 --2- 172.21.15.133:0/1655029338 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f49a8066470 0x7f49a8068930 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f49c414fb10 tx=0x7f49c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:17.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.824+0000 7f49ba7fc640 1 -- 172.21.15.133:0/1655029338 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f49bc051da0 con 0x7f49c40c60f0 2023-12-19T19:02:17.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.976+0000 7f49cc017640 1 -- 172.21.15.133:0/1655029338 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f49c406d390 con 0x7f49c40c60f0 2023-12-19T19:02:17.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.976+0000 7f49ba7fc640 1 -- 172.21.15.133:0/1655029338 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v73) v1 ==== 100+0+11 (secure 0 0 0) 0x7f49bc01a020 con 0x7f49c40c60f0 2023-12-19T19:02:17.983 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:02:17.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.980+0000 7f49cc017640 1 -- 172.21.15.133:0/1655029338 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f49a8066470 msgr2=0x7f49a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:17.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.980+0000 7f49cc017640 1 --2- 172.21.15.133:0/1655029338 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f49a8066470 0x7f49a8068930 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f49c414fb10 tx=0x7f49c0009040 comp rx=0 tx=0).stop 2023-12-19T19:02:17.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.980+0000 7f49cc017640 1 -- 172.21.15.133:0/1655029338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c40c60f0 msgr2=0x7f49c414a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:17.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.980+0000 7f49cc017640 1 --2- 172.21.15.133:0/1655029338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c40c60f0 0x7f49c414a300 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00cf20 tx=0x7f49bc00a7d0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.980+0000 7f49cc017640 1 -- 172.21.15.133:0/1655029338 shutdown_connections 2023-12-19T19:02:17.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.980+0000 7f49cc017640 1 --2- 172.21.15.133:0/1655029338 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f49a8066470 0x7f49a8068930 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.980+0000 7f49cc017640 1 --2- 172.21.15.133:0/1655029338 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f49c40c60f0 0x7f49c414a300 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.980+0000 7f49cc017640 1 --2- 172.21.15.133:0/1655029338 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f49c40c5640 0x7f49c4149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.980+0000 7f49cc017640 1 --2- 172.21.15.133:0/1655029338 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f49c40c5260 0x7f49c4071730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:17.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.980+0000 7f49cc017640 1 -- 172.21.15.133:0/1655029338 >> 172.21.15.133:0/1655029338 conn(0x7f49c406a5b0 msgr2=0x7f49c406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:17.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.980+0000 7f49cc017640 1 -- 172.21.15.133:0/1655029338 shutdown_connections 2023-12-19T19:02:17.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:17.980+0000 7f49cc017640 1 -- 172.21.15.133:0/1655029338 wait complete. 2023-12-19T19:02:18.003 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-19T19:02:18.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.140+0000 7fd75306b640 1 Processor -- start 2023-12-19T19:02:18.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.140+0000 7fd75306b640 1 -- start start 2023-12-19T19:02:18.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.140+0000 7fd75306b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd74c0a5240 0x7fd74c0bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:18.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.140+0000 7fd75306b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd74c1561f0 0x7fd74c156680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:18.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.140+0000 7fd75306b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd74c0c3bd0 con 0x7fd74c0c01c0 2023-12-19T19:02:18.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.140+0000 7fd75306b640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd74c0bf1e0 con 0x7fd74c1561f0 2023-12-19T19:02:18.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.140+0000 7fd75306b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c0c3e20 con 0x7fd74c0a5240 2023-12-19T19:02:18.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.140+0000 7fd743fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd74c0c01c0 0x7fd74c0c5c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34102/0 (socket says 172.21.15.133:34102) 2023-12-19T19:02:18.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.140+0000 7fd743fff640 1 -- 172.21.15.133:0/3882088844 learned_addr learned my addr 172.21.15.133:0/3882088844 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:18.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.140+0000 7fd751608640 1 --2- 172.21.15.133:0/3882088844 >> v2:172.21.15.133:3300/0 conn(0x7fd74c1561f0 0x7fd74c156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:18.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.140+0000 7fd750e07640 1 --2- 172.21.15.133:0/3882088844 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd74c0a5240 0x7fd74c0bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:18.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.140+0000 7fd751608640 1 -- 172.21.15.133:0/3882088844 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd74c0a5240 msgr2=0x7fd74c0bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:18.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.140+0000 7fd751608640 1 --2- 172.21.15.133:0/3882088844 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd74c0a5240 0x7fd74c0bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.140+0000 7fd751608640 1 -- 172.21.15.133:0/3882088844 >> v1:172.21.15.133:6789/0 conn(0x7fd74c0c01c0 legacy=0x7fd74c0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:18.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.140+0000 7fd751608640 1 -- 172.21.15.133:0/3882088844 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74c0c4100 con 0x7fd74c1561f0 2023-12-19T19:02:18.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.140+0000 7fd7437fe640 1 -- 172.21.15.133:0/3882088844 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393989808 0 0) 0x7fd74c0c3bd0 con 0x7fd74c0c01c0 2023-12-19T19:02:18.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.144+0000 7fd751608640 1 --2- 172.21.15.133:0/3882088844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd74c1561f0 0x7fd74c156680 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fd7440097f0 tx=0x7fd74401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7431ab60810faad3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:18.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.144+0000 7fd7437fe640 1 -- 172.21.15.133:0/3882088844 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7440ac620 con 0x7fd74c1561f0 2023-12-19T19:02:18.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.144+0000 7fd7437fe640 1 -- 172.21.15.133:0/3882088844 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7440ac780 con 0x7fd74c1561f0 2023-12-19T19:02:18.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.144+0000 7fd7437fe640 1 -- 172.21.15.133:0/3882088844 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7440acb10 con 0x7fd74c1561f0 2023-12-19T19:02:18.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.144+0000 7fd75306b640 1 -- 172.21.15.133:0/3882088844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd74c1561f0 msgr2=0x7fd74c156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:18.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.144+0000 7fd75306b640 1 --2- 172.21.15.133:0/3882088844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd74c1561f0 0x7fd74c156680 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fd7440097f0 tx=0x7fd74401c3c0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.144+0000 7fd75306b640 1 -- 172.21.15.133:0/3882088844 shutdown_connections 2023-12-19T19:02:18.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.144+0000 7fd75306b640 1 --2- 172.21.15.133:0/3882088844 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd74c1561f0 0x7fd74c156680 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.144+0000 7fd75306b640 1 --2- 172.21.15.133:0/3882088844 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd74c0a5240 0x7fd74c0bfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.144+0000 7fd75306b640 1 -- 172.21.15.133:0/3882088844 >> 172.21.15.133:0/3882088844 conn(0x7fd74c06a5b0 msgr2=0x7fd74c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:18.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.144+0000 7fd75306b640 1 -- 172.21.15.133:0/3882088844 shutdown_connections 2023-12-19T19:02:18.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.144+0000 7fd75306b640 1 -- 172.21.15.133:0/3882088844 wait complete. 2023-12-19T19:02:18.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.144+0000 7fd75306b640 1 Processor -- start 2023-12-19T19:02:18.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.144+0000 7fd75306b640 1 -- start start 2023-12-19T19:02:18.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd75306b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd74c0a5240 0x7fd74c153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:18.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd75306b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd74c0c01c0 0x7fd74c155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:18.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd75306b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd74c1561f0 0x7fd74c071840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:18.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd75306b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c159b30 con 0x7fd74c1561f0 2023-12-19T19:02:18.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd75306b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c1edc20 con 0x7fd74c0c01c0 2023-12-19T19:02:18.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd75306b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd74c1edf00 con 0x7fd74c0a5240 2023-12-19T19:02:18.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd751608640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd74c1561f0 0x7fd74c071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:18.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd751608640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd74c1561f0 0x7fd74c071840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:38990/0 (socket says 172.21.15.133:38990) 2023-12-19T19:02:18.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd751608640 1 -- 172.21.15.133:0/2586237892 learned_addr learned my addr 172.21.15.133:0/2586237892 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:18.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd743fff640 1 --2- 172.21.15.133:0/2586237892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd74c0c01c0 0x7fd74c155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:18.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd750e07640 1 --2- 172.21.15.133:0/2586237892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd74c0a5240 0x7fd74c153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:18.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd751608640 1 -- 172.21.15.133:0/2586237892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd74c0a5240 msgr2=0x7fd74c153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:18.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd751608640 1 --2- 172.21.15.133:0/2586237892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd74c0a5240 0x7fd74c153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd751608640 1 -- 172.21.15.133:0/2586237892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd74c0c01c0 msgr2=0x7fd74c155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:18.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd751608640 1 --2- 172.21.15.133:0/2586237892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd74c0c01c0 0x7fd74c155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd751608640 1 -- 172.21.15.133:0/2586237892 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd744009420 con 0x7fd74c1561f0 2023-12-19T19:02:18.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd751608640 1 --2- 172.21.15.133:0/2586237892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd74c1561f0 0x7fd74c071840 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fd7440af040 tx=0x7fd744019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:18.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd7417fa640 1 -- 172.21.15.133:0/2586237892 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7440ac620 con 0x7fd74c1561f0 2023-12-19T19:02:18.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd7417fa640 1 -- 172.21.15.133:0/2586237892 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7440b5410 con 0x7fd74c1561f0 2023-12-19T19:02:18.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd75306b640 1 -- 172.21.15.133:0/2586237892 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd74c071040 con 0x7fd74c1561f0 2023-12-19T19:02:18.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd7417fa640 1 -- 172.21.15.133:0/2586237892 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7440b57c0 con 0x7fd74c1561f0 2023-12-19T19:02:18.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd75306b640 1 -- 172.21.15.133:0/2586237892 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd74c155640 con 0x7fd74c1561f0 2023-12-19T19:02:18.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd75306b640 1 -- 172.21.15.133:0/2586237892 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd74c1ee0d0 con 0x7fd74c1561f0 2023-12-19T19:02:18.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.148+0000 7fd7417fa640 1 -- 172.21.15.133:0/2586237892 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd7440b3040 con 0x7fd74c1561f0 2023-12-19T19:02:18.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.152+0000 7fd7417fa640 1 --2- 172.21.15.133:0/2586237892 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd738066470 0x7fd738068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:18.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.152+0000 7fd7417fa640 1 -- 172.21.15.133:0/2586237892 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd74411e3a0 con 0x7fd74c1561f0 2023-12-19T19:02:18.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.152+0000 7fd750e07640 1 --2- 172.21.15.133:0/2586237892 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd738066470 0x7fd738068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:18.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.152+0000 7fd750e07640 1 --2- 172.21.15.133:0/2586237892 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd738066470 0x7fd738068930 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd7480073f0 tx=0x7fd74800b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:18.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.156+0000 7fd7417fa640 1 -- 172.21.15.133:0/2586237892 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd7440eb550 con 0x7fd74c1561f0 2023-12-19T19:02:18.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.300+0000 7fd75306b640 1 -- 172.21.15.133:0/2586237892 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd74c0c52e0 con 0x7fd74c1561f0 2023-12-19T19:02:18.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.304+0000 7fd7417fa640 1 -- 172.21.15.133:0/2586237892 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v73) v1 ==== 105+0+11 (secure 0 0 0) 0x7fd7440eeb70 con 0x7fd74c1561f0 2023-12-19T19:02:18.308 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:02:18.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.304+0000 7fd75306b640 1 -- 172.21.15.133:0/2586237892 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd738066470 msgr2=0x7fd738068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:18.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.304+0000 7fd75306b640 1 --2- 172.21.15.133:0/2586237892 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd738066470 0x7fd738068930 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fd7480073f0 tx=0x7fd74800b040 comp rx=0 tx=0).stop 2023-12-19T19:02:18.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.304+0000 7fd75306b640 1 -- 172.21.15.133:0/2586237892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd74c1561f0 msgr2=0x7fd74c071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:18.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.304+0000 7fd75306b640 1 --2- 172.21.15.133:0/2586237892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd74c1561f0 0x7fd74c071840 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fd7440af040 tx=0x7fd744019160 comp rx=0 tx=0).stop 2023-12-19T19:02:18.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.304+0000 7fd75306b640 1 -- 172.21.15.133:0/2586237892 shutdown_connections 2023-12-19T19:02:18.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.304+0000 7fd75306b640 1 --2- 172.21.15.133:0/2586237892 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd738066470 0x7fd738068930 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.304+0000 7fd75306b640 1 --2- 172.21.15.133:0/2586237892 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd74c1561f0 0x7fd74c071840 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.304+0000 7fd75306b640 1 --2- 172.21.15.133:0/2586237892 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd74c0c01c0 0x7fd74c155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.304+0000 7fd75306b640 1 --2- 172.21.15.133:0/2586237892 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd74c0a5240 0x7fd74c153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.304+0000 7fd75306b640 1 -- 172.21.15.133:0/2586237892 >> 172.21.15.133:0/2586237892 conn(0x7fd74c06a5b0 msgr2=0x7fd74c0c07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:18.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.304+0000 7fd75306b640 1 -- 172.21.15.133:0/2586237892 shutdown_connections 2023-12-19T19:02:18.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.304+0000 7fd75306b640 1 -- 172.21.15.133:0/2586237892 wait complete. 2023-12-19T19:02:18.328 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-19T19:02:18.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.464+0000 7fa1db9d8640 1 Processor -- start 2023-12-19T19:02:18.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.464+0000 7fa1db9d8640 1 -- start start 2023-12-19T19:02:18.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.464+0000 7fa1db9d8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa1d4151e90 0x7fa1d40c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:18.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.464+0000 7fa1db9d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1d40c7ea0 0x7fa1d406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:18.470 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.464+0000 7fa1db9d8640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d406c860 con 0x7fa1d40c4e60 2023-12-19T19:02:18.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.464+0000 7fa1db9d8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d40c8750 con 0x7fa1d4151e90 2023-12-19T19:02:18.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.464+0000 7fa1db9d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d41552d0 con 0x7fa1d40c7ea0 2023-12-19T19:02:18.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.464+0000 7fa1d9f75640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa1d40c4e60 0x7fa1d406b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34110/0 (socket says 172.21.15.133:34110) 2023-12-19T19:02:18.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.464+0000 7fa1d9f75640 1 -- 172.21.15.133:0/3884697019 learned_addr learned my addr 172.21.15.133:0/3884697019 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:18.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.464+0000 7fa1d8f73640 1 --2- 172.21.15.133:0/3884697019 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1d40c7ea0 0x7fa1d406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:18.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.464+0000 7fa1d9774640 1 --2- 172.21.15.133:0/3884697019 >> v2:172.21.15.138:3300/0 conn(0x7fa1d4151e90 0x7fa1d40c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:18.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.464+0000 7fa1cbfff640 1 -- 172.21.15.133:0/3884697019 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237395492 0 0) 0x7fa1d406c860 con 0x7fa1d40c4e60 2023-12-19T19:02:18.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.464+0000 7fa1cbfff640 1 -- 172.21.15.133:0/3884697019 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1c0003530 con 0x7fa1d40c4e60 2023-12-19T19:02:18.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.464+0000 7fa1d8f73640 1 -- 172.21.15.133:0/3884697019 >> v2:172.21.15.138:3300/0 conn(0x7fa1d4151e90 msgr2=0x7fa1d40c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:18.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.464+0000 7fa1cbfff640 1 -- 172.21.15.133:0/3884697019 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1198653213 0 0) 0x7fa1c0003530 con 0x7fa1d40c4e60 2023-12-19T19:02:18.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.464+0000 7fa1d8f73640 1 --2- 172.21.15.133:0/3884697019 >> v2:172.21.15.138:3300/0 conn(0x7fa1d4151e90 0x7fa1d40c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.464+0000 7fa1d8f73640 1 -- 172.21.15.133:0/3884697019 >> v1:172.21.15.133:6789/0 conn(0x7fa1d40c4e60 legacy=0x7fa1d406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:18.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.464+0000 7fa1d8f73640 1 -- 172.21.15.133:0/3884697019 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d4154930 con 0x7fa1d40c7ea0 2023-12-19T19:02:18.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.468+0000 7fa1d8f73640 1 --2- 172.21.15.133:0/3884697019 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1d40c7ea0 0x7fa1d406b4a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa1c40097c0 tx=0x7fa1c401c280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9706ef47b4756946 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:18.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.468+0000 7fa1cbfff640 1 -- 172.21.15.133:0/3884697019 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1cc001a00 con 0x7fa1d40c7ea0 2023-12-19T19:02:18.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.468+0000 7fa1cbfff640 1 -- 172.21.15.133:0/3884697019 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c40a7050 con 0x7fa1d40c7ea0 2023-12-19T19:02:18.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.468+0000 7fa1cbfff640 1 -- 172.21.15.133:0/3884697019 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c40ab620 con 0x7fa1d40c7ea0 2023-12-19T19:02:18.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.468+0000 7fa1db9d8640 1 -- 172.21.15.133:0/3884697019 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1d40c7ea0 msgr2=0x7fa1d406b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:18.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.468+0000 7fa1db9d8640 1 --2- 172.21.15.133:0/3884697019 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1d40c7ea0 0x7fa1d406b4a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa1c40097c0 tx=0x7fa1c401c280 comp rx=0 tx=0).stop 2023-12-19T19:02:18.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.468+0000 7fa1db9d8640 1 -- 172.21.15.133:0/3884697019 shutdown_connections 2023-12-19T19:02:18.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.468+0000 7fa1db9d8640 1 --2- 172.21.15.133:0/3884697019 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1d40c7ea0 0x7fa1d406b4a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.468+0000 7fa1db9d8640 1 --2- 172.21.15.133:0/3884697019 >> v2:172.21.15.138:3300/0 conn(0x7fa1d4151e90 0x7fa1d40c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.468+0000 7fa1db9d8640 1 -- 172.21.15.133:0/3884697019 >> 172.21.15.133:0/3884697019 conn(0x7fa1d40ca170 msgr2=0x7fa1d40ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:18.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1db9d8640 1 -- 172.21.15.133:0/3884697019 shutdown_connections 2023-12-19T19:02:18.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1db9d8640 1 -- 172.21.15.133:0/3884697019 wait complete. 2023-12-19T19:02:18.476 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1db9d8640 1 Processor -- start 2023-12-19T19:02:18.477 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1db9d8640 1 -- start start 2023-12-19T19:02:18.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1db9d8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1d40c4e60 0x7fa1d41f04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:18.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1db9d8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1d40c7ea0 0x7fa1d41f0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:18.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1db9d8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1d4151e90 0x7fa1d414e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:18.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1db9d8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d41f0f60 con 0x7fa1d40c4e60 2023-12-19T19:02:18.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1db9d8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d41ee180 con 0x7fa1d4151e90 2023-12-19T19:02:18.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1db9d8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d414e1d0 con 0x7fa1d40c7ea0 2023-12-19T19:02:18.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1d9774640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1d40c4e60 0x7fa1d41f04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:18.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1d9774640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1d40c4e60 0x7fa1d41f04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39002/0 (socket says 172.21.15.133:39002) 2023-12-19T19:02:18.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1d9774640 1 -- 172.21.15.133:0/199942763 learned_addr learned my addr 172.21.15.133:0/199942763 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:18.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1d8f73640 1 --2- 172.21.15.133:0/199942763 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1d40c7ea0 0x7fa1d41f0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:18.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1d9f75640 1 --2- 172.21.15.133:0/199942763 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1d4151e90 0x7fa1d414e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:18.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1d9774640 1 -- 172.21.15.133:0/199942763 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1d40c7ea0 msgr2=0x7fa1d41f0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:18.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1d9774640 1 --2- 172.21.15.133:0/199942763 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1d40c7ea0 0x7fa1d41f0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1d9774640 1 -- 172.21.15.133:0/199942763 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1d4151e90 msgr2=0x7fa1d414e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:18.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1d9774640 1 --2- 172.21.15.133:0/199942763 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1d4151e90 0x7fa1d414e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1d9774640 1 -- 172.21.15.133:0/199942763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c4009420 con 0x7fa1d40c4e60 2023-12-19T19:02:18.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1d9f75640 1 --2- 172.21.15.133:0/199942763 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1d4151e90 0x7fa1d414e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:18.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1d9774640 1 --2- 172.21.15.133:0/199942763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1d40c4e60 0x7fa1d41f04e0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000e9e0 tx=0x7fa1d000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:18.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1c9ffb640 1 -- 172.21.15.133:0/199942763 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d00096b0 con 0x7fa1d40c4e60 2023-12-19T19:02:18.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1c9ffb640 1 -- 172.21.15.133:0/199942763 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d000c9d0 con 0x7fa1d40c4e60 2023-12-19T19:02:18.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1db9d8640 1 -- 172.21.15.133:0/199942763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d414d8a0 con 0x7fa1d40c4e60 2023-12-19T19:02:18.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.472+0000 7fa1c9ffb640 1 -- 172.21.15.133:0/199942763 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d000cd60 con 0x7fa1d40c4e60 2023-12-19T19:02:18.481 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.476+0000 7fa1db9d8640 1 -- 172.21.15.133:0/199942763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d414de60 con 0x7fa1d40c4e60 2023-12-19T19:02:18.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.476+0000 7fa1db9d8640 1 -- 172.21.15.133:0/199942763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d414d660 con 0x7fa1d40c4e60 2023-12-19T19:02:18.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.476+0000 7fa1c9ffb640 1 -- 172.21.15.133:0/199942763 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa1d0013470 con 0x7fa1d40c4e60 2023-12-19T19:02:18.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.476+0000 7fa1c9ffb640 1 --2- 172.21.15.133:0/199942763 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa1b80664a0 0x7fa1b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:18.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.476+0000 7fa1c9ffb640 1 -- 172.21.15.133:0/199942763 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa1d00846d0 con 0x7fa1d40c4e60 2023-12-19T19:02:18.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.476+0000 7fa1d8f73640 1 --2- 172.21.15.133:0/199942763 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa1b80664a0 0x7fa1b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:18.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.476+0000 7fa1d8f73640 1 --2- 172.21.15.133:0/199942763 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa1b80664a0 0x7fa1b8068960 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa1c40ad000 tx=0x7fa1c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:18.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.480+0000 7fa1c9ffb640 1 -- 172.21.15.133:0/199942763 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa1d414d660 con 0x7fa1d40c4e60 2023-12-19T19:02:18.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.628+0000 7fa1db9d8640 1 -- 172.21.15.133:0/199942763 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fa1d414d660 con 0x7fa1d40c4e60 2023-12-19T19:02:18.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.632+0000 7fa1c9ffb640 1 -- 172.21.15.133:0/199942763 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v73) v1 ==== 101+0+11 (secure 0 0 0) 0x7fa1d414d660 con 0x7fa1d40c4e60 2023-12-19T19:02:18.635 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:02:18.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.632+0000 7fa1db9d8640 1 -- 172.21.15.133:0/199942763 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa1b80664a0 msgr2=0x7fa1b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:18.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.632+0000 7fa1db9d8640 1 --2- 172.21.15.133:0/199942763 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa1b80664a0 0x7fa1b8068960 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fa1c40ad000 tx=0x7fa1c4008040 comp rx=0 tx=0).stop 2023-12-19T19:02:18.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.632+0000 7fa1db9d8640 1 -- 172.21.15.133:0/199942763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1d40c4e60 msgr2=0x7fa1d41f04e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:18.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.632+0000 7fa1db9d8640 1 --2- 172.21.15.133:0/199942763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1d40c4e60 0x7fa1d41f04e0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000e9e0 tx=0x7fa1d000eea0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.632+0000 7fa1db9d8640 1 -- 172.21.15.133:0/199942763 shutdown_connections 2023-12-19T19:02:18.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.632+0000 7fa1db9d8640 1 --2- 172.21.15.133:0/199942763 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa1b80664a0 0x7fa1b8068960 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.632+0000 7fa1db9d8640 1 --2- 172.21.15.133:0/199942763 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1d4151e90 0x7fa1d414e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.632+0000 7fa1db9d8640 1 --2- 172.21.15.133:0/199942763 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1d40c7ea0 0x7fa1d41f0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.632+0000 7fa1db9d8640 1 --2- 172.21.15.133:0/199942763 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1d40c4e60 0x7fa1d41f04e0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.632+0000 7fa1db9d8640 1 -- 172.21.15.133:0/199942763 >> 172.21.15.133:0/199942763 conn(0x7fa1d40ca170 msgr2=0x7fa1d415e480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:18.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.632+0000 7fa1db9d8640 1 -- 172.21.15.133:0/199942763 shutdown_connections 2023-12-19T19:02:18.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.632+0000 7fa1db9d8640 1 -- 172.21.15.133:0/199942763 wait complete. 2023-12-19T19:02:18.656 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:02:18.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.788+0000 7fb697ed6640 1 Processor -- start 2023-12-19T19:02:18.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.788+0000 7fb697ed6640 1 -- start start 2023-12-19T19:02:18.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.792+0000 7fb697ed6640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb6900c5260 0x7fb69006d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:18.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.792+0000 7fb697ed6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6900c5640 0x7fb6900c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:18.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.792+0000 7fb697ed6640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6900c2580 con 0x7fb6900c60f0 2023-12-19T19:02:18.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.792+0000 7fb697ed6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb690153510 con 0x7fb6900c5640 2023-12-19T19:02:18.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.792+0000 7fb697ed6640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6900c17f0 con 0x7fb6900c5260 2023-12-19T19:02:18.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.792+0000 7fb695471640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6900c5640 0x7fb6900c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:18.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.792+0000 7fb695471640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6900c5640 0x7fb6900c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39008/0 (socket says 172.21.15.133:39008) 2023-12-19T19:02:18.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.792+0000 7fb695471640 1 -- 172.21.15.133:0/1882389415 learned_addr learned my addr 172.21.15.133:0/1882389415 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:18.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.792+0000 7fb695c72640 1 --2- 172.21.15.133:0/1882389415 >> v2:172.21.15.138:3300/0 conn(0x7fb6900c5260 0x7fb69006d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:18.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.792+0000 7fb695471640 1 -- 172.21.15.133:0/1882389415 >> v2:172.21.15.138:3300/0 conn(0x7fb6900c5260 msgr2=0x7fb69006d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:18.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.792+0000 7fb695471640 1 --2- 172.21.15.133:0/1882389415 >> v2:172.21.15.138:3300/0 conn(0x7fb6900c5260 0x7fb69006d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.792+0000 7fb695471640 1 -- 172.21.15.133:0/1882389415 >> v1:172.21.15.138:6789/0 conn(0x7fb6900c60f0 legacy=0x7fb690155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:18.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.792+0000 7fb695471640 1 -- 172.21.15.133:0/1882389415 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6900c1a00 con 0x7fb6900c5640 2023-12-19T19:02:18.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.796+0000 7fb695471640 1 --2- 172.21.15.133:0/1882389415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6900c5640 0x7fb6900c5bb0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fb6900c6920 tx=0x7fb68001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c918809b2ae7dc91 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:18.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.796+0000 7fb694c70640 1 -- 172.21.15.133:0/1882389415 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680004230 con 0x7fb6900c5640 2023-12-19T19:02:18.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.796+0000 7fb694c70640 1 -- 172.21.15.133:0/1882389415 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6800a7050 con 0x7fb6900c5640 2023-12-19T19:02:18.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.796+0000 7fb694c70640 1 -- 172.21.15.133:0/1882389415 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680003620 con 0x7fb6900c5640 2023-12-19T19:02:18.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.796+0000 7fb697ed6640 1 -- 172.21.15.133:0/1882389415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6900c5640 msgr2=0x7fb6900c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:18.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.796+0000 7fb697ed6640 1 --2- 172.21.15.133:0/1882389415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6900c5640 0x7fb6900c5bb0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fb6900c6920 tx=0x7fb68001c440 comp rx=0 tx=0).stop 2023-12-19T19:02:18.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.796+0000 7fb697ed6640 1 -- 172.21.15.133:0/1882389415 shutdown_connections 2023-12-19T19:02:18.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.796+0000 7fb697ed6640 1 --2- 172.21.15.133:0/1882389415 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6900c5640 0x7fb6900c5bb0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.796+0000 7fb697ed6640 1 --2- 172.21.15.133:0/1882389415 >> v2:172.21.15.138:3300/0 conn(0x7fb6900c5260 0x7fb69006d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.796+0000 7fb697ed6640 1 -- 172.21.15.133:0/1882389415 >> 172.21.15.133:0/1882389415 conn(0x7fb69006a5b0 msgr2=0x7fb69006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:18.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.796+0000 7fb697ed6640 1 -- 172.21.15.133:0/1882389415 shutdown_connections 2023-12-19T19:02:18.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.796+0000 7fb697ed6640 1 -- 172.21.15.133:0/1882389415 wait complete. 2023-12-19T19:02:18.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.796+0000 7fb697ed6640 1 Processor -- start 2023-12-19T19:02:18.802 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.796+0000 7fb697ed6640 1 -- start start 2023-12-19T19:02:18.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.796+0000 7fb697ed6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6900c5260 0x7fb6900a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:18.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.796+0000 7fb697ed6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6900c5640 0x7fb69014f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:18.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.796+0000 7fb697ed6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6900c60f0 0x7fb69014afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:18.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.796+0000 7fb697ed6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69014c030 con 0x7fb6900c5260 2023-12-19T19:02:18.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.796+0000 7fb697ed6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6900a6ff0 con 0x7fb6900c5640 2023-12-19T19:02:18.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.796+0000 7fb697ed6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6900a8e80 con 0x7fb6900c60f0 2023-12-19T19:02:18.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.800+0000 7fb695c72640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6900c5260 0x7fb6900a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:18.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.800+0000 7fb695c72640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6900c5260 0x7fb6900a5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39018/0 (socket says 172.21.15.133:39018) 2023-12-19T19:02:18.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.800+0000 7fb695c72640 1 -- 172.21.15.133:0/2423130056 learned_addr learned my addr 172.21.15.133:0/2423130056 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:18.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.800+0000 7fb696473640 1 --2- 172.21.15.133:0/2423130056 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6900c60f0 0x7fb69014afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:18.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.800+0000 7fb695471640 1 --2- 172.21.15.133:0/2423130056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6900c5640 0x7fb69014f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:18.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.800+0000 7fb695c72640 1 -- 172.21.15.133:0/2423130056 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6900c60f0 msgr2=0x7fb69014afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:18.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.800+0000 7fb695c72640 1 --2- 172.21.15.133:0/2423130056 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6900c60f0 0x7fb69014afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.800+0000 7fb695c72640 1 -- 172.21.15.133:0/2423130056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6900c5640 msgr2=0x7fb69014f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:18.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.800+0000 7fb695c72640 1 --2- 172.21.15.133:0/2423130056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6900c5640 0x7fb69014f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.800+0000 7fb695c72640 1 -- 172.21.15.133:0/2423130056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6800094d0 con 0x7fb6900c5260 2023-12-19T19:02:18.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.800+0000 7fb696473640 1 --2- 172.21.15.133:0/2423130056 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6900c60f0 0x7fb69014afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:18.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.800+0000 7fb695471640 1 --2- 172.21.15.133:0/2423130056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6900c5640 0x7fb69014f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:18.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.800+0000 7fb695c72640 1 --2- 172.21.15.133:0/2423130056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6900c5260 0x7fb6900a5840 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00e8a0 tx=0x7fb68c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:18.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.800+0000 7fb6867fc640 1 -- 172.21.15.133:0/2423130056 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c009510 con 0x7fb6900c5260 2023-12-19T19:02:18.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.800+0000 7fb6867fc640 1 -- 172.21.15.133:0/2423130056 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c00c940 con 0x7fb6900c5260 2023-12-19T19:02:18.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.800+0000 7fb697ed6640 1 -- 172.21.15.133:0/2423130056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb69014c4f0 con 0x7fb6900c5260 2023-12-19T19:02:18.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.800+0000 7fb6867fc640 1 -- 172.21.15.133:0/2423130056 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c00ccb0 con 0x7fb6900c5260 2023-12-19T19:02:18.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.800+0000 7fb697ed6640 1 -- 172.21.15.133:0/2423130056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb69014bcc0 con 0x7fb6900c5260 2023-12-19T19:02:18.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.800+0000 7fb697ed6640 1 -- 172.21.15.133:0/2423130056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb690068400 con 0x7fb6900c5260 2023-12-19T19:02:18.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.800+0000 7fb6867fc640 1 -- 172.21.15.133:0/2423130056 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb68c013470 con 0x7fb6900c5260 2023-12-19T19:02:18.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.800+0000 7fb6867fc640 1 --2- 172.21.15.133:0/2423130056 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb674066470 0x7fb674068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:18.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.800+0000 7fb6867fc640 1 -- 172.21.15.133:0/2423130056 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb68c084620 con 0x7fb6900c5260 2023-12-19T19:02:18.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.804+0000 7fb695471640 1 --2- 172.21.15.133:0/2423130056 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb674066470 0x7fb674068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:18.807 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.804+0000 7fb695471640 1 --2- 172.21.15.133:0/2423130056 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb674066470 0x7fb674068930 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb6800ad000 tx=0x7fb680009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:18.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.804+0000 7fb6867fc640 1 -- 172.21.15.133:0/2423130056 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb68c051740 con 0x7fb6900c5260 2023-12-19T19:02:18.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.984+0000 7fb697ed6640 1 -- 172.21.15.133:0/2423130056 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb69006d390 con 0x7fb6900c5260 2023-12-19T19:02:18.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.988+0000 7fb6867fc640 1 -- 172.21.15.133:0/2423130056 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6196 (secure 0 0 0) 0x7fb68c054d60 con 0x7fb6900c5260 2023-12-19T19:02:18.992 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:18.992 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/2119189888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":2119189888},{"type":"v1","addr":"172.21.15.133:6835","nonce":2119189888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/4005236173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":4005236173},{"type":"v1","addr":"172.21.15.138:6835","nonce":4005236173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:01:35.356022+0000","modified":"2023-12-19T19:01:38.376795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6834/2813206606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2813206606},{"type":"v1","addr":"172.21.15.133:6834","nonce":2813206606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:01:53.054600+0000","modified":"2023-12-19T19:01:56.088450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5765},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5765":{"gid":5765,"name":"d","rank":0,"incarnation":49,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6837/1466041773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":1466041773},{"type":"v1","addr":"172.21.15.138:6837","nonce":1466041773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T19:02:18.992 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 53 2023-12-19T19:02:18.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.988+0000 7fb697ed6640 1 -- 172.21.15.133:0/2423130056 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb674066470 msgr2=0x7fb674068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:18.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.988+0000 7fb697ed6640 1 --2- 172.21.15.133:0/2423130056 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb674066470 0x7fb674068930 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb6800ad000 tx=0x7fb680009040 comp rx=0 tx=0).stop 2023-12-19T19:02:18.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.988+0000 7fb697ed6640 1 -- 172.21.15.133:0/2423130056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6900c5260 msgr2=0x7fb6900a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:18.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.988+0000 7fb697ed6640 1 --2- 172.21.15.133:0/2423130056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6900c5260 0x7fb6900a5840 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00e8a0 tx=0x7fb68c00eca0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.988+0000 7fb697ed6640 1 -- 172.21.15.133:0/2423130056 shutdown_connections 2023-12-19T19:02:18.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.988+0000 7fb697ed6640 1 --2- 172.21.15.133:0/2423130056 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb674066470 0x7fb674068930 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.988+0000 7fb697ed6640 1 --2- 172.21.15.133:0/2423130056 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb6900c60f0 0x7fb69014afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.988+0000 7fb697ed6640 1 --2- 172.21.15.133:0/2423130056 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb6900c5640 0x7fb69014f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.988+0000 7fb697ed6640 1 --2- 172.21.15.133:0/2423130056 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6900c5260 0x7fb6900a5840 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:18.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.988+0000 7fb697ed6640 1 -- 172.21.15.133:0/2423130056 >> 172.21.15.133:0/2423130056 conn(0x7fb69006a5b0 msgr2=0x7fb69006dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:18.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.988+0000 7fb697ed6640 1 -- 172.21.15.133:0/2423130056 shutdown_connections 2023-12-19T19:02:18.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:18.988+0000 7fb697ed6640 1 -- 172.21.15.133:0/2423130056 wait complete. 2023-12-19T19:02:19.012 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:02:19.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.144+0000 7ff2ada9a640 1 Processor -- start 2023-12-19T19:02:19.150 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.144+0000 7ff2ada9a640 1 -- start start 2023-12-19T19:02:19.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.144+0000 7ff2ada9a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff2a80c5260 0x7ff2a806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:19.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.144+0000 7ff2ada9a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a80c2580 con 0x7ff2a8155de0 2023-12-19T19:02:19.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.144+0000 7ff2ada9a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a8156940 con 0x7ff2a80c5640 2023-12-19T19:02:19.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.144+0000 7ff2ada9a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a8153510 con 0x7ff2a80c5260 2023-12-19T19:02:19.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.148+0000 7ff2a7fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff2a8155de0 0x7ff2a8156230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34118/0 (socket says 172.21.15.133:34118) 2023-12-19T19:02:19.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.148+0000 7ff2a7fff640 1 -- 172.21.15.133:0/4091569937 learned_addr learned my addr 172.21.15.133:0/4091569937 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:19.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.148+0000 7ff2a77fe640 1 --2- 172.21.15.133:0/4091569937 >> v2:172.21.15.138:3300/0 conn(0x7ff2a80c5260 0x7ff2a806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:19.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.148+0000 7ff2a67fc640 1 -- 172.21.15.133:0/4091569937 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631496884 0 0) 0x7ff2a80c2580 con 0x7ff2a8155de0 2023-12-19T19:02:19.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.148+0000 7ff2a67fc640 1 -- 172.21.15.133:0/4091569937 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff290003530 con 0x7ff2a8155de0 2023-12-19T19:02:19.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.148+0000 7ff2a77fe640 1 -- 172.21.15.133:0/4091569937 >> v1:172.21.15.138:6789/0 conn(0x7ff2a80c5640 legacy=0x7ff2a80c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:19.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.148+0000 7ff2a77fe640 1 -- 172.21.15.133:0/4091569937 >> v1:172.21.15.133:6789/0 conn(0x7ff2a8155de0 legacy=0x7ff2a8156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:19.152 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.148+0000 7ff2a77fe640 1 -- 172.21.15.133:0/4091569937 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a80c1a00 con 0x7ff2a80c5260 2023-12-19T19:02:19.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.152+0000 7ff2a77fe640 1 --2- 172.21.15.133:0/4091569937 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2a80c5260 0x7ff2a806d5b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff2980097c0 tx=0x7ff29801c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0a55dadeec084ce server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:19.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.152+0000 7ff2a67fc640 1 -- 172.21.15.133:0/4091569937 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2980ab600 con 0x7ff2a80c5260 2023-12-19T19:02:19.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.152+0000 7ff2a67fc640 1 -- 172.21.15.133:0/4091569937 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2980a7050 con 0x7ff2a80c5260 2023-12-19T19:02:19.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.152+0000 7ff2a67fc640 1 -- 172.21.15.133:0/4091569937 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2980ab980 con 0x7ff2a80c5260 2023-12-19T19:02:19.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.152+0000 7ff2ada9a640 1 -- 172.21.15.133:0/4091569937 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2a80c5260 msgr2=0x7ff2a806d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:19.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.152+0000 7ff2ada9a640 1 --2- 172.21.15.133:0/4091569937 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2a80c5260 0x7ff2a806d5b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff2980097c0 tx=0x7ff29801c3f0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.152+0000 7ff2ada9a640 1 -- 172.21.15.133:0/4091569937 shutdown_connections 2023-12-19T19:02:19.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.152+0000 7ff2ada9a640 1 --2- 172.21.15.133:0/4091569937 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2a80c5260 0x7ff2a806d5b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.152+0000 7ff2ada9a640 1 -- 172.21.15.133:0/4091569937 >> 172.21.15.133:0/4091569937 conn(0x7ff2a806a5b0 msgr2=0x7ff2a806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:19.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.152+0000 7ff2ada9a640 1 -- 172.21.15.133:0/4091569937 shutdown_connections 2023-12-19T19:02:19.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.152+0000 7ff2ada9a640 1 -- 172.21.15.133:0/4091569937 wait complete. 2023-12-19T19:02:19.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.152+0000 7ff2ada9a640 1 Processor -- start 2023-12-19T19:02:19.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.152+0000 7ff2ada9a640 1 -- start start 2023-12-19T19:02:19.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.152+0000 7ff2ada9a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2a80c5260 0x7ff2a80bcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:19.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.152+0000 7ff2ada9a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2a80c5640 0x7ff2a81543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:19.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.152+0000 7ff2ada9a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff2a8155de0 0x7ff2a81eee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:19.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.152+0000 7ff2ada9a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a80bebf0 con 0x7ff2a80c5640 2023-12-19T19:02:19.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.152+0000 7ff2ada9a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a81eea40 con 0x7ff2a80c5260 2023-12-19T19:02:19.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.152+0000 7ff2ada9a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a80bc9e0 con 0x7ff2a8155de0 2023-12-19T19:02:19.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.152+0000 7ff2a6ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2a80c5640 0x7ff2a81543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:19.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.156+0000 7ff2a6ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2a80c5640 0x7ff2a81543e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39020/0 (socket says 172.21.15.133:39020) 2023-12-19T19:02:19.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.156+0000 7ff2a6ffd640 1 -- 172.21.15.133:0/3190203409 learned_addr learned my addr 172.21.15.133:0/3190203409 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:19.159 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.156+0000 7ff2a77fe640 1 --2- 172.21.15.133:0/3190203409 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2a80c5260 0x7ff2a80bcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:19.160 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.156+0000 7ff2a7fff640 1 --2- 172.21.15.133:0/3190203409 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff2a8155de0 0x7ff2a81eee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:19.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.156+0000 7ff2a6ffd640 1 -- 172.21.15.133:0/3190203409 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff2a8155de0 msgr2=0x7ff2a81eee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:19.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.156+0000 7ff2a6ffd640 1 --2- 172.21.15.133:0/3190203409 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff2a8155de0 0x7ff2a81eee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.156+0000 7ff2a6ffd640 1 -- 172.21.15.133:0/3190203409 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2a80c5260 msgr2=0x7ff2a80bcbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:19.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.156+0000 7ff2a6ffd640 1 --2- 172.21.15.133:0/3190203409 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2a80c5260 0x7ff2a80bcbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.156+0000 7ff2a6ffd640 1 -- 172.21.15.133:0/3190203409 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff298009420 con 0x7ff2a80c5640 2023-12-19T19:02:19.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.156+0000 7ff2a6ffd640 1 --2- 172.21.15.133:0/3190203409 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2a80c5640 0x7ff2a81543e0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00c390 tx=0x7ff29c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:19.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.156+0000 7ff28ffff640 1 -- 172.21.15.133:0/3190203409 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c0052d0 con 0x7ff2a80c5640 2023-12-19T19:02:19.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.156+0000 7ff28ffff640 1 -- 172.21.15.133:0/3190203409 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29c005430 con 0x7ff2a80c5640 2023-12-19T19:02:19.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.156+0000 7ff2ada9a640 1 -- 172.21.15.133:0/3190203409 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a80bfee0 con 0x7ff2a80c5640 2023-12-19T19:02:19.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.156+0000 7ff28ffff640 1 -- 172.21.15.133:0/3190203409 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29c003820 con 0x7ff2a80c5640 2023-12-19T19:02:19.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.156+0000 7ff2ada9a640 1 -- 172.21.15.133:0/3190203409 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a81ee660 con 0x7ff2a80c5640 2023-12-19T19:02:19.161 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.156+0000 7ff2ada9a640 1 -- 172.21.15.133:0/3190203409 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a81eeb80 con 0x7ff2a80c5640 2023-12-19T19:02:19.162 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.156+0000 7ff28ffff640 1 -- 172.21.15.133:0/3190203409 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff29c003980 con 0x7ff2a80c5640 2023-12-19T19:02:19.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.156+0000 7ff28ffff640 1 --2- 172.21.15.133:0/3190203409 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff294066470 0x7ff294068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:19.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.160+0000 7ff28ffff640 1 -- 172.21.15.133:0/3190203409 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7ff29c0836b0 con 0x7ff2a80c5640 2023-12-19T19:02:19.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.160+0000 7ff2a77fe640 1 --2- 172.21.15.133:0/3190203409 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff294066470 0x7ff294068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:19.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.160+0000 7ff2a77fe640 1 --2- 172.21.15.133:0/3190203409 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff294066470 0x7ff294068930 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff2980ad000 tx=0x7ff2980a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:19.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.164+0000 7ff28ffff640 1 -- 172.21.15.133:0/3190203409 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff2a81eeb80 con 0x7ff2a80c5640 2023-12-19T19:02:19.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.312+0000 7ff2ada9a640 1 -- 172.21.15.133:0/3190203409 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2a81eeb80 con 0x7ff2a80c5640 2023-12-19T19:02:19.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.316+0000 7ff28ffff640 1 -- 172.21.15.133:0/3190203409 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+20250 (secure 0 0 0) 0x7ff2a81eeb80 con 0x7ff2a80c5640 2023-12-19T19:02:19.320 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:19.320 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":73,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:01:54.705538+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:01:33.082188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T19:01:34.349092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:01:50.875086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:01:52.061232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:02:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.316+0000 7ff2ada9a640 1 -- 172.21.15.133:0/3190203409 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff294066470 msgr2=0x7ff294068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.316+0000 7ff2ada9a640 1 --2- 172.21.15.133:0/3190203409 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff294066470 0x7ff294068930 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff2980ad000 tx=0x7ff2980a6000 comp rx=0 tx=0).stop 2023-12-19T19:02:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.316+0000 7ff2ada9a640 1 -- 172.21.15.133:0/3190203409 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2a80c5640 msgr2=0x7ff2a81543e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.316+0000 7ff2ada9a640 1 --2- 172.21.15.133:0/3190203409 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2a80c5640 0x7ff2a81543e0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7ff29c00c390 tx=0x7ff29c00c850 comp rx=0 tx=0).stop 2023-12-19T19:02:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.316+0000 7ff2ada9a640 1 -- 172.21.15.133:0/3190203409 shutdown_connections 2023-12-19T19:02:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.316+0000 7ff2ada9a640 1 --2- 172.21.15.133:0/3190203409 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff294066470 0x7ff294068930 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.316+0000 7ff2ada9a640 1 --2- 172.21.15.133:0/3190203409 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff2a8155de0 0x7ff2a81eee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.316+0000 7ff2ada9a640 1 --2- 172.21.15.133:0/3190203409 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff2a80c5640 0x7ff2a81543e0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.316+0000 7ff2ada9a640 1 --2- 172.21.15.133:0/3190203409 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff2a80c5260 0x7ff2a80bcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.316+0000 7ff2ada9a640 1 -- 172.21.15.133:0/3190203409 >> 172.21.15.133:0/3190203409 conn(0x7ff2a806a5b0 msgr2=0x7ff2a8153870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.316+0000 7ff2ada9a640 1 -- 172.21.15.133:0/3190203409 shutdown_connections 2023-12-19T19:02:19.322 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.316+0000 7ff2ada9a640 1 -- 172.21.15.133:0/3190203409 wait complete. 2023-12-19T19:02:19.341 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T19:02:19.341 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:02:19.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.472+0000 7f000309c640 1 Processor -- start 2023-12-19T19:02:19.479 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.472+0000 7f000309c640 1 -- start start 2023-12-19T19:02:19.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7f000309c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efffc0c5640 0x7efffc0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:19.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7f000309c640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efffc0c2580 con 0x7efffc0c5260 2023-12-19T19:02:19.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7f000309c640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efffc0c1a00 con 0x7efffc0c60f0 2023-12-19T19:02:19.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7f000309c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efffc153510 con 0x7efffc0c5640 2023-12-19T19:02:19.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7f0000e38640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7efffc0c5260 0x7efffc06d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34122/0 (socket says 172.21.15.133:34122) 2023-12-19T19:02:19.480 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7f0000e38640 1 -- 172.21.15.133:0/309316431 learned_addr learned my addr 172.21.15.133:0/309316431 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:19.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7efffb7fe640 1 -- 172.21.15.133:0/309316431 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078094001 0 0) 0x7efffc0c2580 con 0x7efffc0c5260 2023-12-19T19:02:19.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7efffb7fe640 1 -- 172.21.15.133:0/309316431 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effec003530 con 0x7efffc0c5260 2023-12-19T19:02:19.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7efffbfff640 1 --2- 172.21.15.133:0/309316431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efffc0c5640 0x7efffc0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:19.482 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7efffb7fe640 1 -- 172.21.15.133:0/309316431 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 304479096 0 0) 0x7effec003530 con 0x7efffc0c5260 2023-12-19T19:02:19.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7efffb7fe640 1 -- 172.21.15.133:0/309316431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efffc0c5640 msgr2=0x7efffc0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:19.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7efffb7fe640 1 --2- 172.21.15.133:0/309316431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efffc0c5640 0x7efffc0c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7efffb7fe640 1 -- 172.21.15.133:0/309316431 >> v1:172.21.15.138:6789/0 conn(0x7efffc0c60f0 legacy=0x7efffc155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:19.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7efffb7fe640 1 -- 172.21.15.133:0/309316431 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc0c1ce0 con 0x7efffc0c5260 2023-12-19T19:02:19.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7efffb7fe640 1 -- 172.21.15.133:0/309316431 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7efff0001680 con 0x7efffc0c5260 2023-12-19T19:02:19.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7efffb7fe640 1 -- 172.21.15.133:0/309316431 >> v1:172.21.15.133:6789/0 conn(0x7efffc0c5260 legacy=0x7efffc06d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:19.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7efffb7fe640 1 --2- 172.21.15.133:0/309316431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effec0039b0 0x7effec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:19.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7efffb7fe640 1 --2- 172.21.15.133:0/309316431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7effec0047d0 0x7effec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:19.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7efffb7fe640 1 --2- 172.21.15.133:0/309316431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efffc0c5640 0x7effec0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:19.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7efffb7fe640 1 -- 172.21.15.133:0/309316431 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec00ba90 con 0x7effec0039b0 2023-12-19T19:02:19.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7efffb7fe640 1 -- 172.21.15.133:0/309316431 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec00bc00 con 0x7effec0047d0 2023-12-19T19:02:19.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7efffb7fe640 1 -- 172.21.15.133:0/309316431 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effec00bdc0 con 0x7efffc0c5640 2023-12-19T19:02:19.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7f0000e38640 1 --2- 172.21.15.133:0/309316431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effec0039b0 0x7effec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:19.483 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7efffbfff640 1 --2- 172.21.15.133:0/309316431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7effec0047d0 0x7effec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:19.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7f0001639640 1 --2- 172.21.15.133:0/309316431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efffc0c5640 0x7effec0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:19.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7f0000e38640 1 -- 172.21.15.133:0/309316431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efffc0c5640 msgr2=0x7effec0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:19.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7f0000e38640 1 --2- 172.21.15.133:0/309316431 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7efffc0c5640 0x7effec0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7f0000e38640 1 -- 172.21.15.133:0/309316431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7effec0047d0 msgr2=0x7effec004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:19.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7f0000e38640 1 --2- 172.21.15.133:0/309316431 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7effec0047d0 0x7effec004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.484 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.476+0000 7f0000e38640 1 -- 172.21.15.133:0/309316431 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec003530 con 0x7effec0039b0 2023-12-19T19:02:19.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.480+0000 7f0000e38640 1 --2- 172.21.15.133:0/309316431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effec0039b0 0x7effec003dd0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7efff000c1c0 tx=0x7efff001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e51c3ebfb1de63 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:19.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.480+0000 7efffb7fe640 1 -- 172.21.15.133:0/309316431 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff0005ae0 con 0x7effec0039b0 2023-12-19T19:02:19.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.480+0000 7efffb7fe640 1 -- 172.21.15.133:0/309316431 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff0005c40 con 0x7effec0039b0 2023-12-19T19:02:19.485 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.480+0000 7efffb7fe640 1 -- 172.21.15.133:0/309316431 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff0007070 con 0x7effec0039b0 2023-12-19T19:02:19.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.480+0000 7f000309c640 1 -- 172.21.15.133:0/309316431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effec0039b0 msgr2=0x7effec003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:19.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.480+0000 7f000309c640 1 --2- 172.21.15.133:0/309316431 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7effec0039b0 0x7effec003dd0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7efff000c1c0 tx=0x7efff001cc20 comp rx=0 tx=0).stop 2023-12-19T19:02:19.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.480+0000 7f0001639640 1 -- 172.21.15.133:0/309316431 reap_dead start 2023-12-19T19:02:19.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.480+0000 7f000309c640 1 -- 172.21.15.133:0/309316431 shutdown_connections 2023-12-19T19:02:19.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.480+0000 7f000309c640 1 -- 172.21.15.133:0/309316431 >> 172.21.15.133:0/309316431 conn(0x7efffc06a5b0 msgr2=0x7efffc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:19.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.480+0000 7f000309c640 1 -- 172.21.15.133:0/309316431 shutdown_connections 2023-12-19T19:02:19.486 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.480+0000 7f000309c640 1 -- 172.21.15.133:0/309316431 wait complete. 2023-12-19T19:02:19.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7f000309c640 1 Processor -- start 2023-12-19T19:02:19.487 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7f000309c640 1 -- start start 2023-12-19T19:02:19.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7f000309c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7effec0039b0 0x7efffc071850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:19.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7f000309c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efffc0a72a0 0x7efffc14eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:19.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7f000309c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efffc0a7700 0x7efffc14f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:19.489 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7f000309c640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc1f1360 con 0x7efffc0a7700 2023-12-19T19:02:19.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7f000309c640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efffc150610 con 0x7efffc0a72a0 2023-12-19T19:02:19.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7f000309c640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efffc0c0330 con 0x7effec0039b0 2023-12-19T19:02:19.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7f0001639640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efffc0a7700 0x7efffc14f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:19.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7f0001639640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efffc0a7700 0x7efffc14f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39026/0 (socket says 172.21.15.133:39026) 2023-12-19T19:02:19.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7f0001639640 1 -- 172.21.15.133:0/4283719046 learned_addr learned my addr 172.21.15.133:0/4283719046 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:19.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7efffbfff640 1 --2- 172.21.15.133:0/4283719046 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efffc0a72a0 0x7efffc14eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:19.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7f0000e38640 1 --2- 172.21.15.133:0/4283719046 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7effec0039b0 0x7efffc071850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:19.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7f0001639640 1 -- 172.21.15.133:0/4283719046 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7effec0039b0 msgr2=0x7efffc071850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:19.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7f0001639640 1 --2- 172.21.15.133:0/4283719046 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7effec0039b0 0x7efffc071850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7f0001639640 1 -- 172.21.15.133:0/4283719046 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efffc0a72a0 msgr2=0x7efffc14eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:19.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7f0001639640 1 --2- 172.21.15.133:0/4283719046 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efffc0a72a0 0x7efffc14eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7f0001639640 1 -- 172.21.15.133:0/4283719046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efffc1f06e0 con 0x7efffc0a7700 2023-12-19T19:02:19.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7efffbfff640 1 --2- 172.21.15.133:0/4283719046 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efffc0a72a0 0x7efffc14eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:19.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7f0000e38640 1 --2- 172.21.15.133:0/4283719046 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7effec0039b0 0x7efffc071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:19.490 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7f0001639640 1 --2- 172.21.15.133:0/4283719046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efffc0a7700 0x7efffc14f000 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7efffc0c6b10 tx=0x7efff400fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:19.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7efff97fa640 1 -- 172.21.15.133:0/4283719046 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4006d70 con 0x7efffc0a7700 2023-12-19T19:02:19.491 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7efff97fa640 1 -- 172.21.15.133:0/4283719046 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff4003980 con 0x7efffc0a7700 2023-12-19T19:02:19.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7f000309c640 1 -- 172.21.15.133:0/4283719046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efffc1f09c0 con 0x7efffc0a7700 2023-12-19T19:02:19.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7efff97fa640 1 -- 172.21.15.133:0/4283719046 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff4003d30 con 0x7efffc0a7700 2023-12-19T19:02:19.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7f000309c640 1 -- 172.21.15.133:0/4283719046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efffc1f0f80 con 0x7efffc0a7700 2023-12-19T19:02:19.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.484+0000 7f000309c640 1 -- 172.21.15.133:0/4283719046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efffc1f14a0 con 0x7efffc0a7700 2023-12-19T19:02:19.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.488+0000 7efff97fa640 1 -- 172.21.15.133:0/4283719046 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7efff4005070 con 0x7efffc0a7700 2023-12-19T19:02:19.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.488+0000 7efff97fa640 1 --2- 172.21.15.133:0/4283719046 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7effe00664a0 0x7effe0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:19.492 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.488+0000 7efff97fa640 1 -- 172.21.15.133:0/4283719046 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7efff4083660 con 0x7efffc0a7700 2023-12-19T19:02:19.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.488+0000 7f0000e38640 1 --2- 172.21.15.133:0/4283719046 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7effe00664a0 0x7effe0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:19.493 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.488+0000 7f0000e38640 1 --2- 172.21.15.133:0/4283719046 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7effe00664a0 0x7effe0068960 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efff00ab000 tx=0x7efff00a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:19.496 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.492+0000 7efff97fa640 1 -- 172.21.15.133:0/4283719046 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7efffc1f14a0 con 0x7efffc0a7700 2023-12-19T19:02:19.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.672+0000 7f000309c640 1 -- 172.21.15.133:0/4283719046 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efffc1f14a0 con 0x7efffc0a7700 2023-12-19T19:02:19.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.672+0000 7efff97fa640 1 -- 172.21.15.133:0/4283719046 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6196 (secure 0 0 0) 0x7efffc1f14a0 con 0x7efffc0a7700 2023-12-19T19:02:19.678 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:19.678 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/2119189888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":2119189888},{"type":"v1","addr":"172.21.15.133:6835","nonce":2119189888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/4005236173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":4005236173},{"type":"v1","addr":"172.21.15.138:6835","nonce":4005236173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:01:35.356022+0000","modified":"2023-12-19T19:01:38.376795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6834/2813206606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2813206606},{"type":"v1","addr":"172.21.15.133:6834","nonce":2813206606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:01:53.054600+0000","modified":"2023-12-19T19:01:56.088450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5765},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5765":{"gid":5765,"name":"d","rank":0,"incarnation":49,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6837/1466041773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":1466041773},{"type":"v1","addr":"172.21.15.138:6837","nonce":1466041773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T19:02:19.679 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 53 2023-12-19T19:02:19.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.676+0000 7f000309c640 1 -- 172.21.15.133:0/4283719046 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7effe00664a0 msgr2=0x7effe0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:19.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.676+0000 7f000309c640 1 --2- 172.21.15.133:0/4283719046 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7effe00664a0 0x7effe0068960 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7efff00ab000 tx=0x7efff00a7070 comp rx=0 tx=0).stop 2023-12-19T19:02:19.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.676+0000 7f000309c640 1 -- 172.21.15.133:0/4283719046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efffc0a7700 msgr2=0x7efffc14f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:19.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.676+0000 7f000309c640 1 --2- 172.21.15.133:0/4283719046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efffc0a7700 0x7efffc14f000 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7efffc0c6b10 tx=0x7efff400fcd0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.676+0000 7f000309c640 1 -- 172.21.15.133:0/4283719046 shutdown_connections 2023-12-19T19:02:19.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.676+0000 7f000309c640 1 --2- 172.21.15.133:0/4283719046 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7effe00664a0 0x7effe0068960 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.676+0000 7f000309c640 1 --2- 172.21.15.133:0/4283719046 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efffc0a7700 0x7efffc14f000 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.676+0000 7f000309c640 1 --2- 172.21.15.133:0/4283719046 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7efffc0a72a0 0x7efffc14eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.676+0000 7f000309c640 1 --2- 172.21.15.133:0/4283719046 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7effec0039b0 0x7efffc071850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.676+0000 7f000309c640 1 -- 172.21.15.133:0/4283719046 >> 172.21.15.133:0/4283719046 conn(0x7efffc06a5b0 msgr2=0x7efffc070c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:19.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.676+0000 7f000309c640 1 -- 172.21.15.133:0/4283719046 shutdown_connections 2023-12-19T19:02:19.681 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.676+0000 7f000309c640 1 -- 172.21.15.133:0/4283719046 wait complete. 2023-12-19T19:02:19.700 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:02:19.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.832+0000 7f061c6aa640 1 Processor -- start 2023-12-19T19:02:19.838 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.832+0000 7f061c6aa640 1 -- start start 2023-12-19T19:02:19.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f061c6aa640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f06140c5260 0x7f061406d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:19.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f061c6aa640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06140c2580 con 0x7f0614155de0 2023-12-19T19:02:19.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f061c6aa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0614156940 con 0x7f06140c5640 2023-12-19T19:02:19.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f061c6aa640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0614153510 con 0x7f06140c5260 2023-12-19T19:02:19.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f061ac47640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0614155de0 0x7f0614156230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34134/0 (socket says 172.21.15.133:34134) 2023-12-19T19:02:19.839 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f061ac47640 1 -- 172.21.15.133:0/3253772530 learned_addr learned my addr 172.21.15.133:0/3253772530 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:19.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f061a446640 1 --2- 172.21.15.133:0/3253772530 >> v2:172.21.15.138:3300/0 conn(0x7f06140c5260 0x7f061406d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:19.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f0619444640 1 -- 172.21.15.133:0/3253772530 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694972967 0 0) 0x7f06140c2580 con 0x7f0614155de0 2023-12-19T19:02:19.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f0619444640 1 -- 172.21.15.133:0/3253772530 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0600003530 con 0x7f0614155de0 2023-12-19T19:02:19.841 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f0619444640 1 -- 172.21.15.133:0/3253772530 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2518549799 0 0) 0x7f0600003530 con 0x7f0614155de0 2023-12-19T19:02:19.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f0619444640 1 -- 172.21.15.133:0/3253772530 >> v2:172.21.15.138:3300/0 conn(0x7f06140c5260 msgr2=0x7f061406d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:19.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f0619444640 1 --2- 172.21.15.133:0/3253772530 >> v2:172.21.15.138:3300/0 conn(0x7f06140c5260 0x7f061406d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f0619444640 1 -- 172.21.15.133:0/3253772530 >> v1:172.21.15.138:6789/0 conn(0x7f06140c5640 legacy=0x7f06140c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:19.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f0619444640 1 -- 172.21.15.133:0/3253772530 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06140c1a00 con 0x7f0614155de0 2023-12-19T19:02:19.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f0619444640 1 -- 172.21.15.133:0/3253772530 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f060c001a00 con 0x7f0614155de0 2023-12-19T19:02:19.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f0619444640 1 -- 172.21.15.133:0/3253772530 >> v1:172.21.15.133:6789/0 conn(0x7f0614155de0 legacy=0x7f0614156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:19.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f0619444640 1 --2- 172.21.15.133:0/3253772530 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0600003980 0x7f0600003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:19.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f0619444640 1 --2- 172.21.15.133:0/3253772530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06000047d0 0x7f0600004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:19.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f0619444640 1 --2- 172.21.15.133:0/3253772530 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0600005190 0x7f060000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:19.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f0619444640 1 -- 172.21.15.133:0/3253772530 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060000c100 con 0x7f06000047d0 2023-12-19T19:02:19.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f0619444640 1 -- 172.21.15.133:0/3253772530 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f060000c270 con 0x7f0600005190 2023-12-19T19:02:19.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f0619444640 1 -- 172.21.15.133:0/3253772530 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f060000c430 con 0x7f0600003980 2023-12-19T19:02:19.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f0619c45640 1 --2- 172.21.15.133:0/3253772530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06000047d0 0x7f0600004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:19.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f061a446640 1 --2- 172.21.15.133:0/3253772530 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0600003980 0x7f0600003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:19.842 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f061ac47640 1 --2- 172.21.15.133:0/3253772530 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0600005190 0x7f060000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:19.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f0619c45640 1 -- 172.21.15.133:0/3253772530 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0600003980 msgr2=0x7f0600003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:19.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f0619c45640 1 --2- 172.21.15.133:0/3253772530 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0600003980 0x7f0600003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f0619c45640 1 -- 172.21.15.133:0/3253772530 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0600005190 msgr2=0x7f060000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:19.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f0619c45640 1 --2- 172.21.15.133:0/3253772530 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0600005190 0x7f060000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f061ac47640 1 -- 172.21.15.133:0/3253772530 reap_dead start 2023-12-19T19:02:19.843 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.836+0000 7f0619c45640 1 -- 172.21.15.133:0/3253772530 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0600003530 con 0x7f06000047d0 2023-12-19T19:02:19.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.840+0000 7f0619c45640 1 --2- 172.21.15.133:0/3253772530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06000047d0 0x7f0600004c50 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f0604001750 tx=0x7f060401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77aac49d79fb3105 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:19.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.840+0000 7f0619444640 1 -- 172.21.15.133:0/3253772530 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06040052d0 con 0x7f06000047d0 2023-12-19T19:02:19.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.840+0000 7f0619444640 1 -- 172.21.15.133:0/3253772530 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06040a7050 con 0x7f06000047d0 2023-12-19T19:02:19.844 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.840+0000 7f0619444640 1 -- 172.21.15.133:0/3253772530 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0604003600 con 0x7f06000047d0 2023-12-19T19:02:19.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.840+0000 7f061c6aa640 1 -- 172.21.15.133:0/3253772530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06000047d0 msgr2=0x7f0600004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:19.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.840+0000 7f061c6aa640 1 --2- 172.21.15.133:0/3253772530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06000047d0 0x7f0600004c50 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f0604001750 tx=0x7f060401c3a0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.840+0000 7f061c6aa640 1 -- 172.21.15.133:0/3253772530 shutdown_connections 2023-12-19T19:02:19.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.840+0000 7f061c6aa640 1 --2- 172.21.15.133:0/3253772530 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06000047d0 0x7f0600004c50 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.840+0000 7f061c6aa640 1 -- 172.21.15.133:0/3253772530 >> 172.21.15.133:0/3253772530 conn(0x7f061406a5b0 msgr2=0x7f061406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:19.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.840+0000 7f061c6aa640 1 -- 172.21.15.133:0/3253772530 shutdown_connections 2023-12-19T19:02:19.845 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.840+0000 7f061c6aa640 1 -- 172.21.15.133:0/3253772530 wait complete. 2023-12-19T19:02:19.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.840+0000 7f061c6aa640 1 Processor -- start 2023-12-19T19:02:19.846 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.840+0000 7f061c6aa640 1 -- start start 2023-12-19T19:02:19.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f061c6aa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06000047d0 0x7f061414c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:19.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f061c6aa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06141ea990 0x7f06140bacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:19.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f061c6aa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06140bb230 0x7f0614152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:19.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f061c6aa640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0614151cc0 con 0x7f06140bb230 2023-12-19T19:02:19.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f061c6aa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061406ac80 con 0x7f06000047d0 2023-12-19T19:02:19.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f061c6aa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06141eaf00 con 0x7f06141ea990 2023-12-19T19:02:19.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f061ac47640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06140bb230 0x7f0614152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:19.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f061ac47640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06140bb230 0x7f0614152110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39048/0 (socket says 172.21.15.133:39048) 2023-12-19T19:02:19.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f061ac47640 1 -- 172.21.15.133:0/3367984233 learned_addr learned my addr 172.21.15.133:0/3367984233 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:19.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f061a446640 1 --2- 172.21.15.133:0/3367984233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06000047d0 0x7f061414c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:19.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f0619c45640 1 --2- 172.21.15.133:0/3367984233 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06141ea990 0x7f06140bacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:19.849 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f061ac47640 1 -- 172.21.15.133:0/3367984233 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06141ea990 msgr2=0x7f06140bacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f061ac47640 1 --2- 172.21.15.133:0/3367984233 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06141ea990 0x7f06140bacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f061ac47640 1 -- 172.21.15.133:0/3367984233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06000047d0 msgr2=0x7f061414c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f061ac47640 1 --2- 172.21.15.133:0/3367984233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06000047d0 0x7f061414c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f061ac47640 1 -- 172.21.15.133:0/3367984233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06141eb1e0 con 0x7f06140bb230 2023-12-19T19:02:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f061a446640 1 --2- 172.21.15.133:0/3367984233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06000047d0 0x7f061414c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f061ac47640 1 --2- 172.21.15.133:0/3367984233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06140bb230 0x7f0614152110 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f06140c68d0 tx=0x7f060c007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f060affd640 1 -- 172.21.15.133:0/3367984233 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c00abd0 con 0x7f06140bb230 2023-12-19T19:02:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f060affd640 1 -- 172.21.15.133:0/3367984233 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060c00ad50 con 0x7f06140bb230 2023-12-19T19:02:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f060affd640 1 -- 172.21.15.133:0/3367984233 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c013630 con 0x7f06140bb230 2023-12-19T19:02:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f061c6aa640 1 -- 172.21.15.133:0/3367984233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06141eb4c0 con 0x7f06140bb230 2023-12-19T19:02:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f061c6aa640 1 -- 172.21.15.133:0/3367984233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f061414c8b0 con 0x7f06140bb230 2023-12-19T19:02:19.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.844+0000 7f061c6aa640 1 -- 172.21.15.133:0/3367984233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0614151e30 con 0x7f06140bb230 2023-12-19T19:02:19.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.848+0000 7f060affd640 1 -- 172.21.15.133:0/3367984233 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f060c013790 con 0x7f06140bb230 2023-12-19T19:02:19.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.848+0000 7f060affd640 1 --2- 172.21.15.133:0/3367984233 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f05f8066470 0x7f05f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:19.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.848+0000 7f060affd640 1 -- 172.21.15.133:0/3367984233 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f060c084b10 con 0x7f06140bb230 2023-12-19T19:02:19.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.848+0000 7f061a446640 1 --2- 172.21.15.133:0/3367984233 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f05f8066470 0x7f05f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:19.853 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.848+0000 7f061a446640 1 --2- 172.21.15.133:0/3367984233 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f05f8066470 0x7f05f8068930 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f06140a7360 tx=0x7f0610008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:19.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:19.852+0000 7f060affd640 1 -- 172.21.15.133:0/3367984233 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0614151e30 con 0x7f06140bb230 2023-12-19T19:02:20.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.032+0000 7f061c6aa640 1 -- 172.21.15.133:0/3367984233 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0614151e30 con 0x7f06140bb230 2023-12-19T19:02:20.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.032+0000 7f060affd640 1 -- 172.21.15.133:0/3367984233 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6196 (secure 0 0 0) 0x7f0614151e30 con 0x7f06140bb230 2023-12-19T19:02:20.039 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:20.039 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/2119189888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":2119189888},{"type":"v1","addr":"172.21.15.133:6835","nonce":2119189888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/4005236173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":4005236173},{"type":"v1","addr":"172.21.15.138:6835","nonce":4005236173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:01:35.356022+0000","modified":"2023-12-19T19:01:38.376795+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6507},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6507":{"gid":6507,"name":"c","rank":0,"incarnation":44,"state":"up:active","state_seq":5,"addr":"172.21.15.133:6834/2813206606","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":2813206606},{"type":"v1","addr":"172.21.15.133:6834","nonce":2813206606}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:01:53.054600+0000","modified":"2023-12-19T19:01:56.088450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5765},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5765":{"gid":5765,"name":"d","rank":0,"incarnation":49,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6837/1466041773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":1466041773},{"type":"v1","addr":"172.21.15.138:6837","nonce":1466041773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T19:02:20.040 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 53 2023-12-19T19:02:20.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.036+0000 7f061c6aa640 1 -- 172.21.15.133:0/3367984233 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f05f8066470 msgr2=0x7f05f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:20.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.036+0000 7f061c6aa640 1 --2- 172.21.15.133:0/3367984233 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f05f8066470 0x7f05f8068930 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f06140a7360 tx=0x7f0610008040 comp rx=0 tx=0).stop 2023-12-19T19:02:20.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.036+0000 7f061c6aa640 1 -- 172.21.15.133:0/3367984233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06140bb230 msgr2=0x7f0614152110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:20.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.036+0000 7f061c6aa640 1 --2- 172.21.15.133:0/3367984233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06140bb230 0x7f0614152110 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f06140c68d0 tx=0x7f060c007bd0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.036+0000 7f061c6aa640 1 -- 172.21.15.133:0/3367984233 shutdown_connections 2023-12-19T19:02:20.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.036+0000 7f061c6aa640 1 --2- 172.21.15.133:0/3367984233 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f05f8066470 0x7f05f8068930 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.036+0000 7f061c6aa640 1 --2- 172.21.15.133:0/3367984233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06140bb230 0x7f0614152110 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.036+0000 7f061c6aa640 1 --2- 172.21.15.133:0/3367984233 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f06141ea990 0x7f06140bacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.036+0000 7f061c6aa640 1 --2- 172.21.15.133:0/3367984233 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f06000047d0 0x7f061414c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.036+0000 7f061c6aa640 1 -- 172.21.15.133:0/3367984233 >> 172.21.15.133:0/3367984233 conn(0x7f061406a5b0 msgr2=0x7f06140a78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:20.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.036+0000 7f061c6aa640 1 -- 172.21.15.133:0/3367984233 shutdown_connections 2023-12-19T19:02:20.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.036+0000 7f061c6aa640 1 -- 172.21.15.133:0/3367984233 wait complete. 2023-12-19T19:02:20.060 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:02:20.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.192+0000 7fddccb80640 1 Processor -- start 2023-12-19T19:02:20.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.192+0000 7fddccb80640 1 -- start start 2023-12-19T19:02:20.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddccb80640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fddc80a5370 0x7fddc8150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:20.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddccb80640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc80c2760 con 0x7fddc80725c0 2023-12-19T19:02:20.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddccb80640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddc80a57c0 con 0x7fddc8072090 2023-12-19T19:02:20.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddccb80640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddc80c3070 con 0x7fddc80a5370 2023-12-19T19:02:20.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc5d9b640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fddc80725c0 0x7fddc80c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34150/0 (socket says 172.21.15.133:34150) 2023-12-19T19:02:20.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc5d9b640 1 -- 172.21.15.133:0/656905471 learned_addr learned my addr 172.21.15.133:0/656905471 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:20.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc6d9d640 1 --2- 172.21.15.133:0/656905471 >> v2:172.21.15.138:3300/0 conn(0x7fddc80a5370 0x7fddc8150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:20.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc559a640 1 -- 172.21.15.133:0/656905471 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987667262 0 0) 0x7fddc80c2760 con 0x7fddc80725c0 2023-12-19T19:02:20.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc559a640 1 -- 172.21.15.133:0/656905471 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddb0003530 con 0x7fddc80725c0 2023-12-19T19:02:20.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc559a640 1 -- 172.21.15.133:0/656905471 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3734821311 0 0) 0x7fddb0003530 con 0x7fddc80725c0 2023-12-19T19:02:20.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc559a640 1 -- 172.21.15.133:0/656905471 >> v2:172.21.15.138:3300/0 conn(0x7fddc80a5370 msgr2=0x7fddc8150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:20.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc559a640 1 --2- 172.21.15.133:0/656905471 >> v2:172.21.15.138:3300/0 conn(0x7fddc80a5370 0x7fddc8150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc559a640 1 -- 172.21.15.133:0/656905471 >> v1:172.21.15.138:6789/0 conn(0x7fddc8072090 legacy=0x7fddc80c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:20.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc559a640 1 -- 172.21.15.133:0/656905471 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc80aad20 con 0x7fddc80725c0 2023-12-19T19:02:20.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc559a640 1 -- 172.21.15.133:0/656905471 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7fddbc001680 con 0x7fddc80725c0 2023-12-19T19:02:20.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc559a640 1 -- 172.21.15.133:0/656905471 >> v1:172.21.15.133:6789/0 conn(0x7fddc80725c0 legacy=0x7fddc80c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:20.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc559a640 1 --2- 172.21.15.133:0/656905471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddb0003980 0x7fddb0003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:20.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc559a640 1 --2- 172.21.15.133:0/656905471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddb00047d0 0x7fddb0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:20.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc559a640 1 --2- 172.21.15.133:0/656905471 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddb0005190 0x7fddb000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:20.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc559a640 1 -- 172.21.15.133:0/656905471 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc80c3070 con 0x7fddb00047d0 2023-12-19T19:02:20.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc559a640 1 -- 172.21.15.133:0/656905471 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb000c0e0 con 0x7fddb0003980 2023-12-19T19:02:20.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc559a640 1 -- 172.21.15.133:0/656905471 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb000c2a0 con 0x7fddb0005190 2023-12-19T19:02:20.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc6d9d640 1 --2- 172.21.15.133:0/656905471 >> v2:172.21.15.138:3300/0 conn(0x7fddc80a5370 0x7fddc8150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:02:20.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc5d9b640 1 --2- 172.21.15.133:0/656905471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddb00047d0 0x7fddb0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:20.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc659c640 1 --2- 172.21.15.133:0/656905471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddb0003980 0x7fddb0003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:20.203 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc6d9d640 1 --2- 172.21.15.133:0/656905471 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddb0005190 0x7fddb000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:20.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc5d9b640 1 -- 172.21.15.133:0/656905471 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddb0005190 msgr2=0x7fddb000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:20.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc5d9b640 1 --2- 172.21.15.133:0/656905471 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddb0005190 0x7fddb000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc5d9b640 1 -- 172.21.15.133:0/656905471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddb0003980 msgr2=0x7fddb0003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:20.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc5d9b640 1 --2- 172.21.15.133:0/656905471 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddb0003980 0x7fddb0003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc5d9b640 1 -- 172.21.15.133:0/656905471 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb0003530 con 0x7fddb00047d0 2023-12-19T19:02:20.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.196+0000 7fddc6d9d640 1 -- 172.21.15.133:0/656905471 reap_dead start 2023-12-19T19:02:20.205 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.200+0000 7fddc5d9b640 1 --2- 172.21.15.133:0/656905471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddb00047d0 0x7fddb0004c50 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fddbc00c210 tx=0x7fddbc01cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3db94323a522850 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.200+0000 7fddc559a640 1 -- 172.21.15.133:0/656905471 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc005ae0 con 0x7fddb00047d0 2023-12-19T19:02:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.200+0000 7fddc559a640 1 -- 172.21.15.133:0/656905471 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddbc005c60 con 0x7fddb00047d0 2023-12-19T19:02:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.200+0000 7fddc559a640 1 -- 172.21.15.133:0/656905471 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddbc0a5a60 con 0x7fddb00047d0 2023-12-19T19:02:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.200+0000 7fddccb80640 1 -- 172.21.15.133:0/656905471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddb00047d0 msgr2=0x7fddb0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.200+0000 7fddccb80640 1 --2- 172.21.15.133:0/656905471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddb00047d0 0x7fddb0004c50 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fddbc00c210 tx=0x7fddbc01cbc0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.200+0000 7fddccb80640 1 -- 172.21.15.133:0/656905471 shutdown_connections 2023-12-19T19:02:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.200+0000 7fddccb80640 1 --2- 172.21.15.133:0/656905471 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddb00047d0 0x7fddb0004c50 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.200+0000 7fddccb80640 1 -- 172.21.15.133:0/656905471 >> 172.21.15.133:0/656905471 conn(0x7fddc806a5b0 msgr2=0x7fddc806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.200+0000 7fddccb80640 1 -- 172.21.15.133:0/656905471 shutdown_connections 2023-12-19T19:02:20.206 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.200+0000 7fddccb80640 1 -- 172.21.15.133:0/656905471 wait complete. 2023-12-19T19:02:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.200+0000 7fddccb80640 1 Processor -- start 2023-12-19T19:02:20.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddccb80640 1 -- start start 2023-12-19T19:02:20.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddccb80640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddb00047d0 0x7fddc81e9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:20.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddccb80640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddc81529d0 0x7fddc8149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:20.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddccb80640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddc814eec0 0x7fddc814f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:20.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddccb80640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc8150280 con 0x7fddc814eec0 2023-12-19T19:02:20.209 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddccb80640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc81e9940 con 0x7fddb00047d0 2023-12-19T19:02:20.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddccb80640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc814e750 con 0x7fddc81529d0 2023-12-19T19:02:20.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddc6d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddc814eec0 0x7fddc814f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:20.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddc6d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddc814eec0 0x7fddc814f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39062/0 (socket says 172.21.15.133:39062) 2023-12-19T19:02:20.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddc6d9d640 1 -- 172.21.15.133:0/3340248504 learned_addr learned my addr 172.21.15.133:0/3340248504 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:20.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddc5d9b640 1 --2- 172.21.15.133:0/3340248504 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddc81529d0 0x7fddc8149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:20.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddc659c640 1 --2- 172.21.15.133:0/3340248504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddb00047d0 0x7fddc81e9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:20.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddc6d9d640 1 -- 172.21.15.133:0/3340248504 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddc81529d0 msgr2=0x7fddc8149940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:20.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddc6d9d640 1 --2- 172.21.15.133:0/3340248504 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddc81529d0 0x7fddc8149940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddc6d9d640 1 -- 172.21.15.133:0/3340248504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddb00047d0 msgr2=0x7fddc81e9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:20.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddc6d9d640 1 --2- 172.21.15.133:0/3340248504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddb00047d0 0x7fddc81e9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddc6d9d640 1 -- 172.21.15.133:0/3340248504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc814ea30 con 0x7fddc814eec0 2023-12-19T19:02:20.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddc6d9d640 1 --2- 172.21.15.133:0/3340248504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddc814eec0 0x7fddc814f340 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fddc0009f90 tx=0x7fddc00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:20.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddb6ffd640 1 -- 172.21.15.133:0/3340248504 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc000e070 con 0x7fddc814eec0 2023-12-19T19:02:20.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddb6ffd640 1 -- 172.21.15.133:0/3340248504 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddc0011ea0 con 0x7fddc814eec0 2023-12-19T19:02:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddccb80640 1 -- 172.21.15.133:0/3340248504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddc8152380 con 0x7fddc814eec0 2023-12-19T19:02:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddb6ffd640 1 -- 172.21.15.133:0/3340248504 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddc00039a0 con 0x7fddc814eec0 2023-12-19T19:02:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddccb80640 1 -- 172.21.15.133:0/3340248504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddc8150740 con 0x7fddc814eec0 2023-12-19T19:02:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.204+0000 7fddccb80640 1 -- 172.21.15.133:0/3340248504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddc814ebc0 con 0x7fddc814eec0 2023-12-19T19:02:20.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.208+0000 7fddb6ffd640 1 -- 172.21.15.133:0/3340248504 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fddc0003b20 con 0x7fddc814eec0 2023-12-19T19:02:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.208+0000 7fddb6ffd640 1 --2- 172.21.15.133:0/3340248504 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdda80664a0 0x7fdda8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:20.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.208+0000 7fddb6ffd640 1 -- 172.21.15.133:0/3340248504 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fddc0084b80 con 0x7fddc814eec0 2023-12-19T19:02:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.208+0000 7fddc659c640 1 --2- 172.21.15.133:0/3340248504 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdda80664a0 0x7fdda8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:20.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.208+0000 7fddc659c640 1 --2- 172.21.15.133:0/3340248504 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdda80664a0 0x7fdda8068960 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fddb8000c10 tx=0x7fddb8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:20.216 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.212+0000 7fddb6ffd640 1 -- 172.21.15.133:0/3340248504 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fddc0051c90 con 0x7fddc814eec0 2023-12-19T19:02:20.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.364+0000 7fddccb80640 1 -- 172.21.15.133:0/3340248504 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fddc8068400 con 0x7fddc814eec0 2023-12-19T19:02:20.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.368+0000 7fddb6ffd640 1 -- 172.21.15.133:0/3340248504 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+20250 (secure 0 0 0) 0x7fddc00552b0 con 0x7fddc814eec0 2023-12-19T19:02:20.372 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:20.372 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":73,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:01:54.705538+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-19T19:01:33.082188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-19T19:01:34.349092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:01:50.875086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:01:52.061232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:02:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.368+0000 7fddccb80640 1 -- 172.21.15.133:0/3340248504 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdda80664a0 msgr2=0x7fdda8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.368+0000 7fddccb80640 1 --2- 172.21.15.133:0/3340248504 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdda80664a0 0x7fdda8068960 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fddb8000c10 tx=0x7fddb8009040 comp rx=0 tx=0).stop 2023-12-19T19:02:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.368+0000 7fddccb80640 1 -- 172.21.15.133:0/3340248504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddc814eec0 msgr2=0x7fddc814f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.368+0000 7fddccb80640 1 --2- 172.21.15.133:0/3340248504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddc814eec0 0x7fddc814f340 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fddc0009f90 tx=0x7fddc00115a0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.368+0000 7fddccb80640 1 -- 172.21.15.133:0/3340248504 shutdown_connections 2023-12-19T19:02:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.368+0000 7fddccb80640 1 --2- 172.21.15.133:0/3340248504 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdda80664a0 0x7fdda8068960 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.368+0000 7fddccb80640 1 --2- 172.21.15.133:0/3340248504 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fddc814eec0 0x7fddc814f340 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.368+0000 7fddccb80640 1 --2- 172.21.15.133:0/3340248504 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fddc81529d0 0x7fddc8149940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.368+0000 7fddccb80640 1 --2- 172.21.15.133:0/3340248504 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fddb00047d0 0x7fddc81e9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.368+0000 7fddccb80640 1 -- 172.21.15.133:0/3340248504 >> 172.21.15.133:0/3340248504 conn(0x7fddc806a5b0 msgr2=0x7fddc80c5300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:20.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.368+0000 7fddccb80640 1 -- 172.21.15.133:0/3340248504 shutdown_connections 2023-12-19T19:02:20.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.368+0000 7fddccb80640 1 -- 172.21.15.133:0/3340248504 wait complete. 2023-12-19T19:02:20.393 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T19:02:20.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.528+0000 7f8093f1d640 1 Processor -- start 2023-12-19T19:02:20.532 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.528+0000 7f8093f1d640 1 -- start start 2023-12-19T19:02:20.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.528+0000 7f8093f1d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f808c0c63c0 0x7f808c0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:20.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.528+0000 7f8093f1d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f808c0c2bb0 0x7f808c0a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:20.533 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.528+0000 7f8093f1d640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f808c0c31c0 con 0x7f808c0c4100 2023-12-19T19:02:20.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.528+0000 7f8093f1d640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f808c0c34a0 con 0x7f808c0c2bb0 2023-12-19T19:02:20.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.528+0000 7f8093f1d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808c0c1030 con 0x7f808c0c63c0 2023-12-19T19:02:20.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.528+0000 7f8091cb9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f808c0c63c0 0x7f808c0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:20.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.528+0000 7f80924ba640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f808c0c2bb0 0x7f808c0a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:20.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.528+0000 7f8091cb9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f808c0c63c0 0x7f808c0c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:46582/0 (socket says 172.21.15.133:46582) 2023-12-19T19:02:20.534 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.528+0000 7f8091cb9640 1 -- 172.21.15.133:0/3916223954 learned_addr learned my addr 172.21.15.133:0/3916223954 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:20.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.528+0000 7f8091cb9640 1 -- 172.21.15.133:0/3916223954 >> v2:172.21.15.138:3300/0 conn(0x7f808c0c2bb0 msgr2=0x7f808c0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:20.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.528+0000 7f8091cb9640 1 --2- 172.21.15.133:0/3916223954 >> v2:172.21.15.138:3300/0 conn(0x7f808c0c2bb0 0x7f808c0a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.528+0000 7f8091cb9640 1 -- 172.21.15.133:0/3916223954 >> v1:172.21.15.138:6789/0 conn(0x7f808c0c4100 legacy=0x7f808c0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:20.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.528+0000 7f8091cb9640 1 -- 172.21.15.133:0/3916223954 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f808c0c1310 con 0x7f808c0c63c0 2023-12-19T19:02:20.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.532+0000 7f8091cb9640 1 --2- 172.21.15.133:0/3916223954 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f808c0c63c0 0x7f808c0c06d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8088009870 tx=0x7f808801e600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce135c7779ed44ea server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:20.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.532+0000 7f8090cb7640 1 -- 172.21.15.133:0/3916223954 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c0aa3d0 con 0x7f808c0c63c0 2023-12-19T19:02:20.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.532+0000 7f8090cb7640 1 -- 172.21.15.133:0/3916223954 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80880ac680 con 0x7f808c0c63c0 2023-12-19T19:02:20.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.532+0000 7f8090cb7640 1 -- 172.21.15.133:0/3916223954 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80880aca10 con 0x7f808c0c63c0 2023-12-19T19:02:20.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.532+0000 7f8093f1d640 1 -- 172.21.15.133:0/3916223954 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f808c0c63c0 msgr2=0x7f808c0c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:20.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.532+0000 7f8093f1d640 1 --2- 172.21.15.133:0/3916223954 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f808c0c63c0 0x7f808c0c06d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8088009870 tx=0x7f808801e600 comp rx=0 tx=0).stop 2023-12-19T19:02:20.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.532+0000 7f8093f1d640 1 -- 172.21.15.133:0/3916223954 shutdown_connections 2023-12-19T19:02:20.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.532+0000 7f8093f1d640 1 --2- 172.21.15.133:0/3916223954 >> v2:172.21.15.138:3300/0 conn(0x7f808c0c2bb0 0x7f808c0a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.532+0000 7f8093f1d640 1 --2- 172.21.15.133:0/3916223954 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f808c0c63c0 0x7f808c0c06d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.532+0000 7f8093f1d640 1 -- 172.21.15.133:0/3916223954 >> 172.21.15.133:0/3916223954 conn(0x7f808c06a5b0 msgr2=0x7f808c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:20.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.532+0000 7f8093f1d640 1 -- 172.21.15.133:0/3916223954 shutdown_connections 2023-12-19T19:02:20.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.532+0000 7f8093f1d640 1 -- 172.21.15.133:0/3916223954 wait complete. 2023-12-19T19:02:20.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f8093f1d640 1 Processor -- start 2023-12-19T19:02:20.540 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f8093f1d640 1 -- start start 2023-12-19T19:02:20.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f8093f1d640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f808c0c2bb0 0x7f808c0bcef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:20.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f8093f1d640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f808c0c4100 0x7f808c1502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:20.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f8093f1d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f808c0c63c0 0x7f808c143e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:20.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f8093f1d640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c09a800 con 0x7f808c0c63c0 2023-12-19T19:02:20.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f8093f1d640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f808c0bae20 con 0x7f808c0c2bb0 2023-12-19T19:02:20.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f8093f1d640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f808c1eda40 con 0x7f808c0c4100 2023-12-19T19:02:20.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f80924ba640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f808c0c63c0 0x7f808c143e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:20.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f80924ba640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f808c0c63c0 0x7f808c143e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39070/0 (socket says 172.21.15.133:39070) 2023-12-19T19:02:20.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f8091cb9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f808c0c2bb0 0x7f808c0bcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:20.542 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f80924ba640 1 -- 172.21.15.133:0/2659483363 learned_addr learned my addr 172.21.15.133:0/2659483363 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:20.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f80914b8640 1 --2- 172.21.15.133:0/2659483363 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f808c0c4100 0x7f808c1502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:20.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f80924ba640 1 -- 172.21.15.133:0/2659483363 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f808c0c4100 msgr2=0x7f808c1502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:20.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f80924ba640 1 --2- 172.21.15.133:0/2659483363 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f808c0c4100 0x7f808c1502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f80924ba640 1 -- 172.21.15.133:0/2659483363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f808c0c2bb0 msgr2=0x7f808c0bcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:20.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f80924ba640 1 --2- 172.21.15.133:0/2659483363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f808c0c2bb0 0x7f808c0bcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f80924ba640 1 -- 172.21.15.133:0/2659483363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80880094d0 con 0x7f808c0c63c0 2023-12-19T19:02:20.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f80924ba640 1 --2- 172.21.15.133:0/2659483363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f808c0c63c0 0x7f808c143e40 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f808400efc0 tx=0x7f808400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:20.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f80827fc640 1 -- 172.21.15.133:0/2659483363 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8084014480 con 0x7f808c0c63c0 2023-12-19T19:02:20.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f80827fc640 1 -- 172.21.15.133:0/2659483363 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808400f040 con 0x7f808c0c63c0 2023-12-19T19:02:20.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f8093f1d640 1 -- 172.21.15.133:0/2659483363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f808c0bb0c0 con 0x7f808c0c63c0 2023-12-19T19:02:20.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f80827fc640 1 -- 172.21.15.133:0/2659483363 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8084014820 con 0x7f808c0c63c0 2023-12-19T19:02:20.543 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f8093f1d640 1 -- 172.21.15.133:0/2659483363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f808c1edd20 con 0x7f808c0c63c0 2023-12-19T19:02:20.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.536+0000 7f8093f1d640 1 -- 172.21.15.133:0/2659483363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f808c068400 con 0x7f808c0c63c0 2023-12-19T19:02:20.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.540+0000 7f80827fc640 1 -- 172.21.15.133:0/2659483363 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8084014980 con 0x7f808c0c63c0 2023-12-19T19:02:20.544 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.540+0000 7f80827fc640 1 --2- 172.21.15.133:0/2659483363 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f80700664a0 0x7f8070068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:20.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.540+0000 7f80827fc640 1 -- 172.21.15.133:0/2659483363 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8084084c30 con 0x7f808c0c63c0 2023-12-19T19:02:20.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.540+0000 7f8091cb9640 1 --2- 172.21.15.133:0/2659483363 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f80700664a0 0x7f8070068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:20.545 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.540+0000 7f8091cb9640 1 --2- 172.21.15.133:0/2659483363 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f80700664a0 0x7f8070068960 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f80880b0000 tx=0x7f80880a9000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:20.548 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.544+0000 7f80827fc640 1 -- 172.21.15.133:0/2659483363 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8084051e00 con 0x7f808c0c63c0 2023-12-19T19:02:20.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.724+0000 7f8093f1d640 1 -- 172.21.15.133:0/2659483363 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f808c0bb570 con 0x7f808c0c63c0 2023-12-19T19:02:20.730 INFO:tasks.ceph.mon.a.smithi133.stderr:2023-12-19T19:02:20.724+0000 7f5189f85640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T19:02:20.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.728+0000 7f80827fc640 1 -- 172.21.15.133:0/2659483363 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v54) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8084018090 con 0x7f808c0c63c0 2023-12-19T19:02:20.733 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T19:02:20.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.728+0000 7f8093f1d640 1 -- 172.21.15.133:0/2659483363 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f80700664a0 msgr2=0x7f8070068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:20.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.728+0000 7f8093f1d640 1 --2- 172.21.15.133:0/2659483363 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f80700664a0 0x7f8070068960 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f80880b0000 tx=0x7f80880a9000 comp rx=0 tx=0).stop 2023-12-19T19:02:20.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.728+0000 7f8093f1d640 1 -- 172.21.15.133:0/2659483363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f808c0c63c0 msgr2=0x7f808c143e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:20.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.728+0000 7f8093f1d640 1 --2- 172.21.15.133:0/2659483363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f808c0c63c0 0x7f808c143e40 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f808400efc0 tx=0x7f808400c490 comp rx=0 tx=0).stop 2023-12-19T19:02:20.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.732+0000 7f8093f1d640 1 -- 172.21.15.133:0/2659483363 shutdown_connections 2023-12-19T19:02:20.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.732+0000 7f8093f1d640 1 --2- 172.21.15.133:0/2659483363 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f80700664a0 0x7f8070068960 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.732+0000 7f8093f1d640 1 --2- 172.21.15.133:0/2659483363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f808c0c63c0 0x7f808c143e40 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.732+0000 7f8093f1d640 1 --2- 172.21.15.133:0/2659483363 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f808c0c4100 0x7f808c1502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.732+0000 7f8093f1d640 1 --2- 172.21.15.133:0/2659483363 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f808c0c2bb0 0x7f808c0bcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.732+0000 7f8093f1d640 1 -- 172.21.15.133:0/2659483363 >> 172.21.15.133:0/2659483363 conn(0x7f808c06a5b0 msgr2=0x7f808c06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:20.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.732+0000 7f8093f1d640 1 -- 172.21.15.133:0/2659483363 shutdown_connections 2023-12-19T19:02:20.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.732+0000 7f8093f1d640 1 -- 172.21.15.133:0/2659483363 wait complete. 2023-12-19T19:02:20.745 INFO:tasks.ceph.mds.c.smithi133.stderr: -5284> 2023-12-19T19:01:39.324+0000 7f39be949640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T19:02:20.757 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T19:02:20.797 INFO:tasks.ceph.mds.c.smithi133.stdout:starting mds.c at 2023-12-19T19:02:20.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.896+0000 7f7558357640 1 Processor -- start 2023-12-19T19:02:20.902 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.896+0000 7f7558357640 1 -- start start 2023-12-19T19:02:20.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.896+0000 7f7558357640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f75500c63c0 0x7f75500c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:20.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.896+0000 7f7558357640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f75500c4100 0x7f75500c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:20.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.896+0000 7f7558357640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75500c31c0 con 0x7f75500c29e0 2023-12-19T19:02:20.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.896+0000 7f7558357640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75500c34a0 con 0x7f75500c4100 2023-12-19T19:02:20.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.896+0000 7f7558357640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75500c1030 con 0x7f75500c63c0 2023-12-19T19:02:20.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.900+0000 7f75558f2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f75500c4100 0x7f75500c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:20.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.900+0000 7f75558f2640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f75500c4100 0x7f75500c24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39096/0 (socket says 172.21.15.133:39096) 2023-12-19T19:02:20.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.900+0000 7f75558f2640 1 -- 172.21.15.133:0/3021711146 learned_addr learned my addr 172.21.15.133:0/3021711146 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:20.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.900+0000 7f75560f3640 1 --2- 172.21.15.133:0/3021711146 >> v2:172.21.15.138:3300/0 conn(0x7f75500c63c0 0x7f75500c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:20.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.900+0000 7f75558f2640 1 -- 172.21.15.133:0/3021711146 >> v2:172.21.15.138:3300/0 conn(0x7f75500c63c0 msgr2=0x7f75500c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:20.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.900+0000 7f75558f2640 1 --2- 172.21.15.133:0/3021711146 >> v2:172.21.15.138:3300/0 conn(0x7f75500c63c0 0x7f75500c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.900+0000 7f75558f2640 1 -- 172.21.15.133:0/3021711146 >> v1:172.21.15.138:6789/0 conn(0x7f75500c29e0 legacy=0x7f75500a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:20.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.900+0000 7f75558f2640 1 -- 172.21.15.133:0/3021711146 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75500c1310 con 0x7f75500c4100 2023-12-19T19:02:20.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.900+0000 7f75558f2640 1 --2- 172.21.15.133:0/3021711146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75500c4100 0x7f75500c24a0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f755006e000 tx=0x7f754001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a610c48499281a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:20.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.900+0000 7f75550f1640 1 -- 172.21.15.133:0/3021711146 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75400ac630 con 0x7f75500c4100 2023-12-19T19:02:20.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.900+0000 7f75550f1640 1 -- 172.21.15.133:0/3021711146 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75400ac790 con 0x7f75500c4100 2023-12-19T19:02:20.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.900+0000 7f75550f1640 1 -- 172.21.15.133:0/3021711146 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75400acb20 con 0x7f75500c4100 2023-12-19T19:02:20.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f7558357640 1 -- 172.21.15.133:0/3021711146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75500c4100 msgr2=0x7f75500c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:20.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f7558357640 1 --2- 172.21.15.133:0/3021711146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75500c4100 0x7f75500c24a0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f755006e000 tx=0x7f754001c3b0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f7558357640 1 -- 172.21.15.133:0/3021711146 shutdown_connections 2023-12-19T19:02:20.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f7558357640 1 --2- 172.21.15.133:0/3021711146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75500c4100 0x7f75500c24a0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f7558357640 1 --2- 172.21.15.133:0/3021711146 >> v2:172.21.15.138:3300/0 conn(0x7f75500c63c0 0x7f75500c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f7558357640 1 -- 172.21.15.133:0/3021711146 >> 172.21.15.133:0/3021711146 conn(0x7f755006a5b0 msgr2=0x7f755006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:20.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f7558357640 1 -- 172.21.15.133:0/3021711146 shutdown_connections 2023-12-19T19:02:20.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f7558357640 1 -- 172.21.15.133:0/3021711146 wait complete. 2023-12-19T19:02:20.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f7558357640 1 Processor -- start 2023-12-19T19:02:20.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f7558357640 1 -- start start 2023-12-19T19:02:20.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f7558357640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75500c29e0 0x7f75500a6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:20.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f7558357640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f75500c4100 0x7f755014c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:20.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f7558357640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75500c63c0 0x7f755014c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:20.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f7558357640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75501ed730 con 0x7f75500c29e0 2023-12-19T19:02:20.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f7558357640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7550072260 con 0x7f75500c63c0 2023-12-19T19:02:20.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f7558357640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75501edbc0 con 0x7f75500c4100 2023-12-19T19:02:20.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f75560f3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75500c29e0 0x7f75500a6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:20.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f75560f3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75500c29e0 0x7f75500a6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39098/0 (socket says 172.21.15.133:39098) 2023-12-19T19:02:20.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f75560f3640 1 -- 172.21.15.133:0/3558625823 learned_addr learned my addr 172.21.15.133:0/3558625823 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:20.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f75568f4640 1 --2- 172.21.15.133:0/3558625823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75500c63c0 0x7f755014c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:20.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f75558f2640 1 --2- 172.21.15.133:0/3558625823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f75500c4100 0x7f755014c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:20.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f75560f3640 1 -- 172.21.15.133:0/3558625823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f75500c4100 msgr2=0x7f755014c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:20.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f75560f3640 1 --2- 172.21.15.133:0/3558625823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f75500c4100 0x7f755014c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f75560f3640 1 -- 172.21.15.133:0/3558625823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75500c63c0 msgr2=0x7f755014c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:20.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f75560f3640 1 --2- 172.21.15.133:0/3558625823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75500c63c0 0x7f755014c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:20.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f75560f3640 1 -- 172.21.15.133:0/3558625823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75400094d0 con 0x7f75500c29e0 2023-12-19T19:02:20.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f75558f2640 1 --2- 172.21.15.133:0/3558625823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f75500c4100 0x7f755014c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:20.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.904+0000 7f75560f3640 1 --2- 172.21.15.133:0/3558625823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75500c29e0 0x7f75500a6610 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f754c00e870 tx=0x7f754c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:20.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.908+0000 7f7546ffd640 1 -- 172.21.15.133:0/3558625823 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c009510 con 0x7f75500c29e0 2023-12-19T19:02:20.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.908+0000 7f7558357640 1 -- 172.21.15.133:0/3558625823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75501ece00 con 0x7f75500c29e0 2023-12-19T19:02:20.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.908+0000 7f7558357640 1 -- 172.21.15.133:0/3558625823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75501ed3c0 con 0x7f75500c29e0 2023-12-19T19:02:20.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.908+0000 7f7546ffd640 1 -- 172.21.15.133:0/3558625823 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c00eec0 con 0x7f75500c29e0 2023-12-19T19:02:20.912 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.908+0000 7f7546ffd640 1 -- 172.21.15.133:0/3558625823 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c00cb40 con 0x7f75500c29e0 2023-12-19T19:02:20.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.908+0000 7f7558357640 1 -- 172.21.15.133:0/3558625823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7538005260 con 0x7f75500c29e0 2023-12-19T19:02:20.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.908+0000 7f7546ffd640 1 -- 172.21.15.133:0/3558625823 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f754c00cca0 con 0x7f75500c29e0 2023-12-19T19:02:20.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.908+0000 7f7546ffd640 1 --2- 172.21.15.133:0/3558625823 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7534066470 0x7f7534068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:20.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.908+0000 7f7546ffd640 1 -- 172.21.15.133:0/3558625823 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f754c084640 con 0x7f75500c29e0 2023-12-19T19:02:20.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.908+0000 7f75558f2640 1 --2- 172.21.15.133:0/3558625823 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7534066470 0x7f7534068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:20.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.912+0000 7f75558f2640 1 --2- 172.21.15.133:0/3558625823 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7534066470 0x7f7534068930 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f75400ae000 tx=0x7f7540008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:20.918 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:20.912+0000 7f7546ffd640 1 -- 172.21.15.133:0/3558625823 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f754c0517d0 con 0x7f75500c29e0 2023-12-19T19:02:21.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.096+0000 7f7558357640 1 -- 172.21.15.133:0/3558625823 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7538005a90 con 0x7f75500c29e0 2023-12-19T19:02:21.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.760+0000 7f7546ffd640 1 -- 172.21.15.133:0/3558625823 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v55) v1 ==== 104+0+0 (secure 0 0 0) 0x7f754c054df0 con 0x7f75500c29e0 2023-12-19T19:02:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.764+0000 7f7558357640 1 -- 172.21.15.133:0/3558625823 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7534066470 msgr2=0x7f7534068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.764+0000 7f7558357640 1 --2- 172.21.15.133:0/3558625823 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7534066470 0x7f7534068930 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f75400ae000 tx=0x7f7540008040 comp rx=0 tx=0).stop 2023-12-19T19:02:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.764+0000 7f7558357640 1 -- 172.21.15.133:0/3558625823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75500c29e0 msgr2=0x7f75500a6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.764+0000 7f7558357640 1 --2- 172.21.15.133:0/3558625823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75500c29e0 0x7f75500a6610 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f754c00e870 tx=0x7f754c00ec70 comp rx=0 tx=0).stop 2023-12-19T19:02:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.764+0000 7f7558357640 1 -- 172.21.15.133:0/3558625823 shutdown_connections 2023-12-19T19:02:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.764+0000 7f7558357640 1 --2- 172.21.15.133:0/3558625823 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7534066470 0x7f7534068930 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.764+0000 7f7558357640 1 --2- 172.21.15.133:0/3558625823 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f75500c63c0 0x7f755014c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:21.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.764+0000 7f7558357640 1 --2- 172.21.15.133:0/3558625823 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f75500c4100 0x7f755014c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.764+0000 7f7558357640 1 --2- 172.21.15.133:0/3558625823 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f75500c29e0 0x7f75500a6610 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.764+0000 7f7558357640 1 -- 172.21.15.133:0/3558625823 >> 172.21.15.133:0/3558625823 conn(0x7f755006a5b0 msgr2=0x7f755006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.764+0000 7f7558357640 1 -- 172.21.15.133:0/3558625823 shutdown_connections 2023-12-19T19:02:21.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.764+0000 7f7558357640 1 -- 172.21.15.133:0/3558625823 wait complete. 2023-12-19T19:02:21.791 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T19:02:21.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.976+0000 7f97c872a640 1 Processor -- start 2023-12-19T19:02:21.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.976+0000 7f97c872a640 1 -- start start 2023-12-19T19:02:21.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c872a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f97c014f9f0 0x7f97c00c27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:21.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c872a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f97c00c07b0 0x7f97c006d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:21.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c872a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97c00c5ba0 con 0x7f97c00c2d10 2023-12-19T19:02:21.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c872a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97c006e320 con 0x7f97c014f9f0 2023-12-19T19:02:21.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c872a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c006c160 con 0x7f97c00c07b0 2023-12-19T19:02:21.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c6cc7640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f97c00c2d10 0x7f97c006dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34166/0 (socket says 172.21.15.133:34166) 2023-12-19T19:02:21.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c6cc7640 1 -- 172.21.15.133:0/3464461554 learned_addr learned my addr 172.21.15.133:0/3464461554 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:21.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c64c6640 1 --2- 172.21.15.133:0/3464461554 >> v2:172.21.15.138:3300/0 conn(0x7f97c014f9f0 0x7f97c00c27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:21.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c5cc5640 1 --2- 172.21.15.133:0/3464461554 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f97c00c07b0 0x7f97c006d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:21.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c54c4640 1 -- 172.21.15.133:0/3464461554 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376212533 0 0) 0x7f97b80014a0 con 0x7f97c00c2d10 2023-12-19T19:02:21.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c54c4640 1 -- 172.21.15.133:0/3464461554 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97ac003530 con 0x7f97c00c2d10 2023-12-19T19:02:21.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c54c4640 1 -- 172.21.15.133:0/3464461554 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3718510293 0 0) 0x7f97ac003530 con 0x7f97c00c2d10 2023-12-19T19:02:21.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c54c4640 1 -- 172.21.15.133:0/3464461554 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f97c00c07b0 msgr2=0x7f97c006d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:21.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c54c4640 1 --2- 172.21.15.133:0/3464461554 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f97c00c07b0 0x7f97c006d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:21.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c54c4640 1 -- 172.21.15.133:0/3464461554 >> v2:172.21.15.138:3300/0 conn(0x7f97c014f9f0 msgr2=0x7f97c00c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:21.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c54c4640 1 --2- 172.21.15.133:0/3464461554 >> v2:172.21.15.138:3300/0 conn(0x7f97c014f9f0 0x7f97c00c27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:21.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c54c4640 1 -- 172.21.15.133:0/3464461554 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c00c5410 con 0x7f97c00c2d10 2023-12-19T19:02:21.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c54c4640 1 -- 172.21.15.133:0/3464461554 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f97b8001b90 con 0x7f97c00c2d10 2023-12-19T19:02:21.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c54c4640 1 -- 172.21.15.133:0/3464461554 >> v1:172.21.15.133:6789/0 conn(0x7f97c00c2d10 legacy=0x7f97c006dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:21.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c54c4640 1 --2- 172.21.15.133:0/3464461554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97ac003980 0x7f97ac003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:21.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c54c4640 1 --2- 172.21.15.133:0/3464461554 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97ac0047d0 0x7f97ac004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:21.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c54c4640 1 --2- 172.21.15.133:0/3464461554 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f97c00c07b0 0x7f97ac005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:21.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c54c4640 1 -- 172.21.15.133:0/3464461554 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c006c160 con 0x7f97ac003980 2023-12-19T19:02:21.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c54c4640 1 -- 172.21.15.133:0/3464461554 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac00b990 con 0x7f97ac0047d0 2023-12-19T19:02:21.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c54c4640 1 -- 172.21.15.133:0/3464461554 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ac00bb00 con 0x7f97c00c07b0 2023-12-19T19:02:21.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c64c6640 1 --2- 172.21.15.133:0/3464461554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97ac003980 0x7f97ac003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:21.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c5cc5640 1 --2- 172.21.15.133:0/3464461554 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97ac0047d0 0x7f97ac004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:21.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c6cc7640 1 --2- 172.21.15.133:0/3464461554 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f97c00c07b0 0x7f97ac005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:21.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c64c6640 1 -- 172.21.15.133:0/3464461554 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f97c00c07b0 msgr2=0x7f97ac005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:21.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c64c6640 1 --2- 172.21.15.133:0/3464461554 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f97c00c07b0 0x7f97ac005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:21.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c64c6640 1 -- 172.21.15.133:0/3464461554 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97ac0047d0 msgr2=0x7f97ac004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:21.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c64c6640 1 --2- 172.21.15.133:0/3464461554 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97ac0047d0 0x7f97ac004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:21.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.980+0000 7f97c64c6640 1 -- 172.21.15.133:0/3464461554 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ac003530 con 0x7f97ac003980 2023-12-19T19:02:21.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.984+0000 7f97c64c6640 1 --2- 172.21.15.133:0/3464461554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97ac003980 0x7f97ac003da0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f97bc009ae0 tx=0x7f97bc01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11dbf508b7f881ed server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:21.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.984+0000 7f97c54c4640 1 -- 172.21.15.133:0/3464461554 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc0a5550 con 0x7f97ac003980 2023-12-19T19:02:21.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.984+0000 7f97c54c4640 1 -- 172.21.15.133:0/3464461554 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97bc0a56b0 con 0x7f97ac003980 2023-12-19T19:02:21.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.984+0000 7f97c54c4640 1 -- 172.21.15.133:0/3464461554 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc0a5a60 con 0x7f97ac003980 2023-12-19T19:02:21.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.984+0000 7f97c872a640 1 -- 172.21.15.133:0/3464461554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97ac003980 msgr2=0x7f97ac003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:21.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.984+0000 7f97c872a640 1 --2- 172.21.15.133:0/3464461554 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97ac003980 0x7f97ac003da0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f97bc009ae0 tx=0x7f97bc01ca00 comp rx=0 tx=0).stop 2023-12-19T19:02:21.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.984+0000 7f97c6cc7640 1 -- 172.21.15.133:0/3464461554 reap_dead start 2023-12-19T19:02:21.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.984+0000 7f97c872a640 1 -- 172.21.15.133:0/3464461554 shutdown_connections 2023-12-19T19:02:21.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.984+0000 7f97c872a640 1 -- 172.21.15.133:0/3464461554 >> 172.21.15.133:0/3464461554 conn(0x7f97c00c5d40 msgr2=0x7f97c00c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:21.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.984+0000 7f97c872a640 1 -- 172.21.15.133:0/3464461554 shutdown_connections 2023-12-19T19:02:21.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.984+0000 7f97c872a640 1 -- 172.21.15.133:0/3464461554 wait complete. 2023-12-19T19:02:21.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97c872a640 1 Processor -- start 2023-12-19T19:02:21.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97c872a640 1 -- start start 2023-12-19T19:02:21.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97c872a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f97ac003980 0x7f97c014e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:21.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97c872a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97c014d220 0x7f97c0070df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:21.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97c872a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97c0071330 0x7f97c01ee970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:21.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97c872a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c0145980 con 0x7f97c014d220 2023-12-19T19:02:21.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97c872a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c00704a0 con 0x7f97c0071330 2023-12-19T19:02:21.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97c872a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c01515c0 con 0x7f97ac003980 2023-12-19T19:02:21.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97c5cc5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97c014d220 0x7f97c0070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:21.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97c5cc5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97c014d220 0x7f97c0070df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39128/0 (socket says 172.21.15.133:39128) 2023-12-19T19:02:21.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97c5cc5640 1 -- 172.21.15.133:0/3536796057 learned_addr learned my addr 172.21.15.133:0/3536796057 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:21.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97c6cc7640 1 --2- 172.21.15.133:0/3536796057 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97c0071330 0x7f97c01ee970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:21.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97c64c6640 1 --2- 172.21.15.133:0/3536796057 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f97ac003980 0x7f97c014e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:21.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97c5cc5640 1 -- 172.21.15.133:0/3536796057 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f97ac003980 msgr2=0x7f97c014e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:21.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97c5cc5640 1 --2- 172.21.15.133:0/3536796057 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f97ac003980 0x7f97c014e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:21.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97c5cc5640 1 -- 172.21.15.133:0/3536796057 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97c0071330 msgr2=0x7f97c01ee970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:21.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97c5cc5640 1 --2- 172.21.15.133:0/3536796057 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97c0071330 0x7f97c01ee970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:21.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97c5cc5640 1 -- 172.21.15.133:0/3536796057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c01518a0 con 0x7f97c014d220 2023-12-19T19:02:21.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97c5cc5640 1 --2- 172.21.15.133:0/3536796057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97c014d220 0x7f97c0070df0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f97b00118b0 tx=0x7f97b0011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:21.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97b6ffd640 1 -- 172.21.15.133:0/3536796057 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b000fa30 con 0x7f97c014d220 2023-12-19T19:02:21.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97b6ffd640 1 -- 172.21.15.133:0/3536796057 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97b000fb90 con 0x7f97c014d220 2023-12-19T19:02:21.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97b6ffd640 1 -- 172.21.15.133:0/3536796057 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b0014440 con 0x7f97c014d220 2023-12-19T19:02:21.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97c872a640 1 -- 172.21.15.133:0/3536796057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c0151b80 con 0x7f97c014d220 2023-12-19T19:02:21.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97c872a640 1 -- 172.21.15.133:0/3536796057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c014e660 con 0x7f97c014d220 2023-12-19T19:02:21.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.988+0000 7f97c872a640 1 -- 172.21.15.133:0/3536796057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c0070250 con 0x7f97c014d220 2023-12-19T19:02:21.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.992+0000 7f97b6ffd640 1 -- 172.21.15.133:0/3536796057 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f97b00145a0 con 0x7f97c014d220 2023-12-19T19:02:21.996 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.992+0000 7f97b6ffd640 1 --2- 172.21.15.133:0/3536796057 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f97a40664a0 0x7f97a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:21.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.992+0000 7f97b6ffd640 1 -- 172.21.15.133:0/3536796057 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f97b0084970 con 0x7f97c014d220 2023-12-19T19:02:21.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.992+0000 7f97c64c6640 1 --2- 172.21.15.133:0/3536796057 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f97a40664a0 0x7f97a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:21.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.992+0000 7f97c64c6640 1 --2- 172.21.15.133:0/3536796057 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f97a40664a0 0x7f97a4068960 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f97bc0af000 tx=0x7f97bc0046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:22.001 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:21.996+0000 7f97b6ffd640 1 -- 172.21.15.133:0/3536796057 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f97c0070250 con 0x7f97c014d220 2023-12-19T19:02:22.153 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.148+0000 7f97c872a640 1 -- 172.21.15.133:0/3536796057 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f97c0070250 con 0x7f97c014d220 2023-12-19T19:02:22.778 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.772+0000 7f97b6ffd640 1 -- 172.21.15.133:0/3536796057 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v75) v1 ==== 181+0+0 (secure 0 0 0) 0x7f97c0070250 con 0x7f97c014d220 2023-12-19T19:02:22.779 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_metadata' removed 2023-12-19T19:02:22.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.776+0000 7f97c872a640 1 -- 172.21.15.133:0/3536796057 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f97a40664a0 msgr2=0x7f97a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:22.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.776+0000 7f97c872a640 1 --2- 172.21.15.133:0/3536796057 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f97a40664a0 0x7f97a4068960 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f97bc0af000 tx=0x7f97bc0046d0 comp rx=0 tx=0).stop 2023-12-19T19:02:22.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.776+0000 7f97c872a640 1 -- 172.21.15.133:0/3536796057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97c014d220 msgr2=0x7f97c0070df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:22.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.776+0000 7f97c872a640 1 --2- 172.21.15.133:0/3536796057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97c014d220 0x7f97c0070df0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f97b00118b0 tx=0x7f97b0011d70 comp rx=0 tx=0).stop 2023-12-19T19:02:22.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.776+0000 7f97c872a640 1 -- 172.21.15.133:0/3536796057 shutdown_connections 2023-12-19T19:02:22.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.776+0000 7f97c872a640 1 --2- 172.21.15.133:0/3536796057 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f97a40664a0 0x7f97a4068960 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:22.781 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.776+0000 7f97c872a640 1 --2- 172.21.15.133:0/3536796057 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f97c0071330 0x7f97c01ee970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:22.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.776+0000 7f97c872a640 1 --2- 172.21.15.133:0/3536796057 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97c014d220 0x7f97c0070df0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:22.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.776+0000 7f97c872a640 1 --2- 172.21.15.133:0/3536796057 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f97ac003980 0x7f97c014e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:22.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.776+0000 7f97c872a640 1 -- 172.21.15.133:0/3536796057 >> 172.21.15.133:0/3536796057 conn(0x7f97c00c5d40 msgr2=0x7f97c01493c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:22.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.776+0000 7f97c872a640 1 -- 172.21.15.133:0/3536796057 shutdown_connections 2023-12-19T19:02:22.782 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.776+0000 7f97c872a640 1 -- 172.21.15.133:0/3536796057 wait complete. 2023-12-19T19:02:22.805 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T19:02:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.940+0000 7f02af654640 1 Processor -- start 2023-12-19T19:02:22.947 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f02af654640 1 -- start start 2023-12-19T19:02:22.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f02af654640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f02a80c4fb0 0x7f02a80c1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:22.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f02af654640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02a806db90 0x7f02a806dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:22.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f02af654640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a80aa750 con 0x7f02a806c840 2023-12-19T19:02:22.950 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f02af654640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a806e530 con 0x7f02a80c4fb0 2023-12-19T19:02:22.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f02af654640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a80a8f90 con 0x7f02a806db90 2023-12-19T19:02:22.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f02adbf1640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f02a806c840 0x7f02a806ccb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34176/0 (socket says 172.21.15.133:34176) 2023-12-19T19:02:22.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f02adbf1640 1 -- 172.21.15.133:0/2942537563 learned_addr learned my addr 172.21.15.133:0/2942537563 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:22.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f02ad3f0640 1 --2- 172.21.15.133:0/2942537563 >> v2:172.21.15.138:3300/0 conn(0x7f02a80c4fb0 0x7f02a80c1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:22.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f02acbef640 1 --2- 172.21.15.133:0/2942537563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02a806db90 0x7f02a806dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:22.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f029ffff640 1 -- 172.21.15.133:0/2942537563 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097581333 0 0) 0x7f02a80aa750 con 0x7f02a806c840 2023-12-19T19:02:22.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f029ffff640 1 -- 172.21.15.133:0/2942537563 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0294005740 con 0x7f02a806c840 2023-12-19T19:02:22.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f029ffff640 1 -- 172.21.15.133:0/2942537563 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1723558063 0 0) 0x7f0294005740 con 0x7f02a806c840 2023-12-19T19:02:22.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f029ffff640 1 -- 172.21.15.133:0/2942537563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02a806db90 msgr2=0x7f02a806dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:22.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f029ffff640 1 --2- 172.21.15.133:0/2942537563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02a806db90 0x7f02a806dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:22.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f029ffff640 1 -- 172.21.15.133:0/2942537563 >> v2:172.21.15.138:3300/0 conn(0x7f02a80c4fb0 msgr2=0x7f02a80c1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:22.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f029ffff640 1 --2- 172.21.15.133:0/2942537563 >> v2:172.21.15.138:3300/0 conn(0x7f02a80c4fb0 0x7f02a80c1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:22.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f029ffff640 1 -- 172.21.15.133:0/2942537563 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a80a9270 con 0x7f02a806c840 2023-12-19T19:02:22.951 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f029ffff640 1 -- 172.21.15.133:0/2942537563 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f02a0001a00 con 0x7f02a806c840 2023-12-19T19:02:22.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f029ffff640 1 -- 172.21.15.133:0/2942537563 >> v1:172.21.15.133:6789/0 conn(0x7f02a806c840 legacy=0x7f02a806ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:22.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f029ffff640 1 --2- 172.21.15.133:0/2942537563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0294005b90 0x7f0294005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:22.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f029ffff640 1 --2- 172.21.15.133:0/2942537563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02a806db90 0x7f02940069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:22.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f029ffff640 1 --2- 172.21.15.133:0/2942537563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0294006f20 0x7f02940073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:22.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f029ffff640 1 -- 172.21.15.133:0/2942537563 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a806e530 con 0x7f0294006f20 2023-12-19T19:02:22.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f029ffff640 1 -- 172.21.15.133:0/2942537563 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a80a8f90 con 0x7f0294005b90 2023-12-19T19:02:22.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f029ffff640 1 -- 172.21.15.133:0/2942537563 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029400dc20 con 0x7f02a806db90 2023-12-19T19:02:22.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f02adbf1640 1 --2- 172.21.15.133:0/2942537563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0294006f20 0x7f02940073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:22.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f02ad3f0640 1 --2- 172.21.15.133:0/2942537563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0294005b90 0x7f0294005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:22.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f02acbef640 1 --2- 172.21.15.133:0/2942537563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02a806db90 0x7f02940069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:22.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f02adbf1640 1 -- 172.21.15.133:0/2942537563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02a806db90 msgr2=0x7f02940069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:22.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f02adbf1640 1 --2- 172.21.15.133:0/2942537563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02a806db90 0x7f02940069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:22.952 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f02adbf1640 1 -- 172.21.15.133:0/2942537563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0294005b90 msgr2=0x7f0294005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:22.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f02adbf1640 1 --2- 172.21.15.133:0/2942537563 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0294005b90 0x7f0294005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:22.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f02adbf1640 1 -- 172.21.15.133:0/2942537563 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0294005740 con 0x7f0294006f20 2023-12-19T19:02:22.953 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.944+0000 7f02acbef640 1 --2- 172.21.15.133:0/2942537563 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02a806db90 0x7f02940069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:22.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.948+0000 7f02adbf1640 1 --2- 172.21.15.133:0/2942537563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0294006f20 0x7f02940073a0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f02a000a830 tx=0x7f02a001d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c221338a9afc1d27 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:22.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.948+0000 7f029ffff640 1 -- 172.21.15.133:0/2942537563 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a00ad430 con 0x7f0294006f20 2023-12-19T19:02:22.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.948+0000 7f029ffff640 1 -- 172.21.15.133:0/2942537563 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a00a8070 con 0x7f0294006f20 2023-12-19T19:02:22.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.948+0000 7f029ffff640 1 -- 172.21.15.133:0/2942537563 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a00ad7f0 con 0x7f0294006f20 2023-12-19T19:02:22.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.948+0000 7f02af654640 1 -- 172.21.15.133:0/2942537563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0294006f20 msgr2=0x7f02940073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:22.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.948+0000 7f02af654640 1 --2- 172.21.15.133:0/2942537563 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0294006f20 0x7f02940073a0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f02a000a830 tx=0x7f02a001d360 comp rx=0 tx=0).stop 2023-12-19T19:02:22.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.948+0000 7f02adbf1640 1 -- 172.21.15.133:0/2942537563 reap_dead start 2023-12-19T19:02:22.954 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.948+0000 7f02af654640 1 -- 172.21.15.133:0/2942537563 shutdown_connections 2023-12-19T19:02:22.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.948+0000 7f02af654640 1 -- 172.21.15.133:0/2942537563 >> 172.21.15.133:0/2942537563 conn(0x7f02a80c5d40 msgr2=0x7f02a80c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:22.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.948+0000 7f02af654640 1 -- 172.21.15.133:0/2942537563 shutdown_connections 2023-12-19T19:02:22.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.948+0000 7f02af654640 1 -- 172.21.15.133:0/2942537563 wait complete. 2023-12-19T19:02:22.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f02af654640 1 Processor -- start 2023-12-19T19:02:22.955 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f02af654640 1 -- start start 2023-12-19T19:02:22.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f02af654640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0294006f20 0x7f02a81e4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:22.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f02af654640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02a80a5890 0x7f02a80a5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:22.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f02af654640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02a80a6250 0x7f02a81dfb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:22.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f02af654640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a81e0d50 con 0x7f0294006f20 2023-12-19T19:02:22.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f02af654640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a81edbd0 con 0x7f02a80a6250 2023-12-19T19:02:22.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f02af654640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a81ee100 con 0x7f02a80a5890 2023-12-19T19:02:22.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f02ad3f0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0294006f20 0x7f02a81e4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:22.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f02ad3f0640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0294006f20 0x7f02a81e4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39138/0 (socket says 172.21.15.133:39138) 2023-12-19T19:02:22.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f02ad3f0640 1 -- 172.21.15.133:0/1681755386 learned_addr learned my addr 172.21.15.133:0/1681755386 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:22.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f02acbef640 1 --2- 172.21.15.133:0/1681755386 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02a80a5890 0x7f02a80a5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:22.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f02adbf1640 1 --2- 172.21.15.133:0/1681755386 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02a80a6250 0x7f02a81dfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:22.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f02ad3f0640 1 -- 172.21.15.133:0/1681755386 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02a80a5890 msgr2=0x7f02a80a5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:22.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f02ad3f0640 1 --2- 172.21.15.133:0/1681755386 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02a80a5890 0x7f02a80a5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:22.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f02ad3f0640 1 -- 172.21.15.133:0/1681755386 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02a80a6250 msgr2=0x7f02a81dfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:22.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f02ad3f0640 1 --2- 172.21.15.133:0/1681755386 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02a80a6250 0x7f02a81dfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:22.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f02ad3f0640 1 -- 172.21.15.133:0/1681755386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a81ede20 con 0x7f0294006f20 2023-12-19T19:02:22.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f02adbf1640 1 --2- 172.21.15.133:0/1681755386 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02a80a6250 0x7f02a81dfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:22.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f02acbef640 1 --2- 172.21.15.133:0/1681755386 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02a80a5890 0x7f02a80a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:22.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f02ad3f0640 1 --2- 172.21.15.133:0/1681755386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0294006f20 0x7f02a81e4200 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f02a4011a30 tx=0x7f02a4011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:22.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f029dffb640 1 -- 172.21.15.133:0/1681755386 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a400fb50 con 0x7f0294006f20 2023-12-19T19:02:22.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f029dffb640 1 -- 172.21.15.133:0/1681755386 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02a400fcb0 con 0x7f0294006f20 2023-12-19T19:02:22.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f029dffb640 1 -- 172.21.15.133:0/1681755386 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02a4014440 con 0x7f0294006f20 2023-12-19T19:02:22.959 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f02af654640 1 -- 172.21.15.133:0/1681755386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a80a76b0 con 0x7f0294006f20 2023-12-19T19:02:22.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.952+0000 7f02af654640 1 -- 172.21.15.133:0/1681755386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a80a7c70 con 0x7f0294006f20 2023-12-19T19:02:22.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.956+0000 7f02af654640 1 -- 172.21.15.133:0/1681755386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a8068400 con 0x7f0294006f20 2023-12-19T19:02:22.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.956+0000 7f029dffb640 1 -- 172.21.15.133:0/1681755386 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f02a40145a0 con 0x7f0294006f20 2023-12-19T19:02:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.956+0000 7f029dffb640 1 --2- 172.21.15.133:0/1681755386 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f028c066470 0x7f028c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.956+0000 7f029dffb640 1 -- 172.21.15.133:0/1681755386 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6213+0+0 (secure 0 0 0) 0x7f02a4084960 con 0x7f0294006f20 2023-12-19T19:02:22.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.956+0000 7f02acbef640 1 --2- 172.21.15.133:0/1681755386 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f028c066470 0x7f028c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:22.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.956+0000 7f02acbef640 1 --2- 172.21.15.133:0/1681755386 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f028c066470 0x7f028c068930 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f02a8153000 tx=0x7f0298008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:22.965 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:22.960+0000 7f029dffb640 1 -- 172.21.15.133:0/1681755386 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f02a4051c90 con 0x7f0294006f20 2023-12-19T19:02:23.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.116+0000 7f02af654640 1 -- 172.21.15.133:0/1681755386 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f02a80c1100 con 0x7f0294006f20 2023-12-19T19:02:23.787 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.780+0000 7f029dffb640 1 -- 172.21.15.133:0/1681755386 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v76) v1 ==== 169+0+0 (secure 0 0 0) 0x7f02a4022020 con 0x7f0294006f20 2023-12-19T19:02:23.787 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs_data' removed 2023-12-19T19:02:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.784+0000 7f02af654640 1 -- 172.21.15.133:0/1681755386 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f028c066470 msgr2=0x7f028c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.784+0000 7f02af654640 1 --2- 172.21.15.133:0/1681755386 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f028c066470 0x7f028c068930 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f02a8153000 tx=0x7f0298008040 comp rx=0 tx=0).stop 2023-12-19T19:02:23.790 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.784+0000 7f02af654640 1 -- 172.21.15.133:0/1681755386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0294006f20 msgr2=0x7f02a81e4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.784+0000 7f02af654640 1 --2- 172.21.15.133:0/1681755386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0294006f20 0x7f02a81e4200 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f02a4011a30 tx=0x7f02a4011ef0 comp rx=0 tx=0).stop 2023-12-19T19:02:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.784+0000 7f02af654640 1 -- 172.21.15.133:0/1681755386 shutdown_connections 2023-12-19T19:02:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.784+0000 7f02af654640 1 --2- 172.21.15.133:0/1681755386 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f028c066470 0x7f028c068930 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.784+0000 7f02af654640 1 --2- 172.21.15.133:0/1681755386 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f02a80a6250 0x7f02a81dfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.784+0000 7f02af654640 1 --2- 172.21.15.133:0/1681755386 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f02a80a5890 0x7f02a80a5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.784+0000 7f02af654640 1 --2- 172.21.15.133:0/1681755386 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0294006f20 0x7f02a81e4200 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.784+0000 7f02af654640 1 -- 172.21.15.133:0/1681755386 >> 172.21.15.133:0/1681755386 conn(0x7f02a80c5d40 msgr2=0x7f02a8070460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.784+0000 7f02af654640 1 -- 172.21.15.133:0/1681755386 shutdown_connections 2023-12-19T19:02:23.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.784+0000 7f02af654640 1 -- 172.21.15.133:0/1681755386 wait complete. 2023-12-19T19:02:23.820 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:02:23.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.956+0000 7eff64a6b640 1 Processor -- start 2023-12-19T19:02:23.962 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.956+0000 7eff64a6b640 1 -- start start 2023-12-19T19:02:23.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.956+0000 7eff64a6b640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7eff600725c0 0x7eff601516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:23.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.956+0000 7eff64a6b640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff600c2760 con 0x7eff600a5370 2023-12-19T19:02:23.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.956+0000 7eff64a6b640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff600a5750 con 0x7eff60072090 2023-12-19T19:02:23.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.956+0000 7eff64a6b640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff600c3070 con 0x7eff600725c0 2023-12-19T19:02:23.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.956+0000 7eff5e59c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7eff600a5370 0x7eff600c3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34184/0 (socket says 172.21.15.133:34184) 2023-12-19T19:02:23.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.956+0000 7eff5e59c640 1 -- 172.21.15.133:0/1359580521 learned_addr learned my addr 172.21.15.133:0/1359580521 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:23.963 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.956+0000 7eff5ed9d640 1 --2- 172.21.15.133:0/1359580521 >> v2:172.21.15.133:3300/0 conn(0x7eff600725c0 0x7eff601516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:23.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.960+0000 7eff5dd9b640 1 -- 172.21.15.133:0/1359580521 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3764658715 0 0) 0x7eff600c2760 con 0x7eff600a5370 2023-12-19T19:02:23.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.960+0000 7eff5dd9b640 1 -- 172.21.15.133:0/1359580521 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff4c005740 con 0x7eff600a5370 2023-12-19T19:02:23.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.960+0000 7eff5ed9d640 1 -- 172.21.15.133:0/1359580521 >> v1:172.21.15.138:6789/0 conn(0x7eff60072090 legacy=0x7eff60150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:23.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.960+0000 7eff5ed9d640 1 -- 172.21.15.133:0/1359580521 >> v1:172.21.15.133:6789/0 conn(0x7eff600a5370 legacy=0x7eff600c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:23.964 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.960+0000 7eff5ed9d640 1 -- 172.21.15.133:0/1359580521 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff600aad20 con 0x7eff600725c0 2023-12-19T19:02:23.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.960+0000 7eff5ed9d640 1 --2- 172.21.15.133:0/1359580521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff600725c0 0x7eff601516b0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7eff58009d90 tx=0x7eff5801c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5416ef2a8b053ea3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:23.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.960+0000 7eff5dd9b640 1 -- 172.21.15.133:0/1359580521 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff580a5760 con 0x7eff600725c0 2023-12-19T19:02:23.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.960+0000 7eff5dd9b640 1 -- 172.21.15.133:0/1359580521 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff580a58c0 con 0x7eff600725c0 2023-12-19T19:02:23.966 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.960+0000 7eff5dd9b640 1 -- 172.21.15.133:0/1359580521 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff580a5c50 con 0x7eff600725c0 2023-12-19T19:02:23.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff64a6b640 1 -- 172.21.15.133:0/1359580521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff600725c0 msgr2=0x7eff601516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:23.967 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff64a6b640 1 --2- 172.21.15.133:0/1359580521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff600725c0 0x7eff601516b0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7eff58009d90 tx=0x7eff5801c830 comp rx=0 tx=0).stop 2023-12-19T19:02:23.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff64a6b640 1 -- 172.21.15.133:0/1359580521 shutdown_connections 2023-12-19T19:02:23.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff64a6b640 1 --2- 172.21.15.133:0/1359580521 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff600725c0 0x7eff601516b0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:23.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff64a6b640 1 -- 172.21.15.133:0/1359580521 >> 172.21.15.133:0/1359580521 conn(0x7eff6006a5b0 msgr2=0x7eff6006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:23.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff64a6b640 1 -- 172.21.15.133:0/1359580521 shutdown_connections 2023-12-19T19:02:23.968 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff64a6b640 1 -- 172.21.15.133:0/1359580521 wait complete. 2023-12-19T19:02:23.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff64a6b640 1 Processor -- start 2023-12-19T19:02:23.969 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff64a6b640 1 -- start start 2023-12-19T19:02:23.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff64a6b640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff60072090 0x7eff6014eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:23.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff64a6b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff600725c0 0x7eff601f4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:23.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff64a6b640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7eff600a5370 0x7eff6014d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:23.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff64a6b640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff60153080 con 0x7eff600725c0 2023-12-19T19:02:23.971 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff64a6b640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff60150760 con 0x7eff60072090 2023-12-19T19:02:23.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff64a6b640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff60150a00 con 0x7eff600a5370 2023-12-19T19:02:23.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff55d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff600725c0 0x7eff601f4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:23.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff55d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff600725c0 0x7eff601f4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39146/0 (socket says 172.21.15.133:39146) 2023-12-19T19:02:23.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff55d9b640 1 -- 172.21.15.133:0/2858427187 learned_addr learned my addr 172.21.15.133:0/2858427187 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:23.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff5e59c640 1 --2- 172.21.15.133:0/2858427187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff60072090 0x7eff6014eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:23.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff5ed9d640 1 --2- 172.21.15.133:0/2858427187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7eff600a5370 0x7eff6014d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:23.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff55d9b640 1 -- 172.21.15.133:0/2858427187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7eff600a5370 msgr2=0x7eff6014d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:23.972 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff55d9b640 1 --2- 172.21.15.133:0/2858427187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7eff600a5370 0x7eff6014d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff55d9b640 1 -- 172.21.15.133:0/2858427187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff60072090 msgr2=0x7eff6014eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff55d9b640 1 --2- 172.21.15.133:0/2858427187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff60072090 0x7eff6014eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.964+0000 7eff55d9b640 1 -- 172.21.15.133:0/2858427187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff58009a70 con 0x7eff600725c0 2023-12-19T19:02:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.968+0000 7eff55d9b640 1 --2- 172.21.15.133:0/2858427187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff600725c0 0x7eff601f4c80 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7eff4800c500 tx=0x7eff4800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.968+0000 7eff577fe640 1 -- 172.21.15.133:0/2858427187 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48005220 con 0x7eff600725c0 2023-12-19T19:02:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.968+0000 7eff577fe640 1 -- 172.21.15.133:0/2858427187 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff48005380 con 0x7eff600725c0 2023-12-19T19:02:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.968+0000 7eff64a6b640 1 -- 172.21.15.133:0/2858427187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6014fb10 con 0x7eff600725c0 2023-12-19T19:02:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.968+0000 7eff577fe640 1 -- 172.21.15.133:0/2858427187 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff48007270 con 0x7eff600725c0 2023-12-19T19:02:23.973 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.968+0000 7eff64a6b640 1 -- 172.21.15.133:0/2858427187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6014f020 con 0x7eff600725c0 2023-12-19T19:02:23.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.968+0000 7eff64a6b640 1 -- 172.21.15.133:0/2858427187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff60068400 con 0x7eff600725c0 2023-12-19T19:02:23.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.968+0000 7eff577fe640 1 -- 172.21.15.133:0/2858427187 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7eff480073d0 con 0x7eff600725c0 2023-12-19T19:02:23.974 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.968+0000 7eff577fe640 1 --2- 172.21.15.133:0/2858427187 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7eff40066470 0x7eff40068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.968+0000 7eff577fe640 1 -- 172.21.15.133:0/2858427187 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5799+0+0 (secure 0 0 0) 0x7eff48083730 con 0x7eff600725c0 2023-12-19T19:02:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.968+0000 7eff5e59c640 1 --2- 172.21.15.133:0/2858427187 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7eff40066470 0x7eff40068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:23.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.972+0000 7eff5e59c640 1 --2- 172.21.15.133:0/2858427187 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7eff40066470 0x7eff40068930 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7eff500011f0 tx=0x7eff50007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:23.978 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:23.972+0000 7eff577fe640 1 -- 172.21.15.133:0/2858427187 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7eff48050b70 con 0x7eff600725c0 2023-12-19T19:02:24.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.128+0000 7eff64a6b640 1 -- 172.21.15.133:0/2858427187 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff60071e70 con 0x7eff600725c0 2023-12-19T19:02:24.135 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.132+0000 7eff577fe640 1 -- 172.21.15.133:0/2858427187 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16679 (secure 0 0 0) 0x7eff48054190 con 0x7eff600725c0 2023-12-19T19:02:24.136 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:24.136 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":76,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:02:23.778994+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:01:50.875086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:01:52.061232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6834/2813206606":"2023-12-20T19:02:20.729934+0000","172.21.15.133:6832/2813206606":"2023-12-20T19:02:20.729934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:02:24.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.132+0000 7eff64a6b640 1 -- 172.21.15.133:0/2858427187 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7eff40066470 msgr2=0x7eff40068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:24.137 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.132+0000 7eff64a6b640 1 --2- 172.21.15.133:0/2858427187 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7eff40066470 0x7eff40068930 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7eff500011f0 tx=0x7eff50007d40 comp rx=0 tx=0).stop 2023-12-19T19:02:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.132+0000 7eff64a6b640 1 -- 172.21.15.133:0/2858427187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff600725c0 msgr2=0x7eff601f4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.132+0000 7eff64a6b640 1 --2- 172.21.15.133:0/2858427187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff600725c0 0x7eff601f4c80 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7eff4800c500 tx=0x7eff4800c9c0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.132+0000 7eff64a6b640 1 -- 172.21.15.133:0/2858427187 shutdown_connections 2023-12-19T19:02:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.132+0000 7eff64a6b640 1 --2- 172.21.15.133:0/2858427187 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7eff40066470 0x7eff40068930 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.132+0000 7eff64a6b640 1 --2- 172.21.15.133:0/2858427187 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7eff600a5370 0x7eff6014d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.132+0000 7eff64a6b640 1 --2- 172.21.15.133:0/2858427187 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7eff600725c0 0x7eff601f4c80 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.132+0000 7eff64a6b640 1 --2- 172.21.15.133:0/2858427187 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7eff60072090 0x7eff6014eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.138 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.132+0000 7eff64a6b640 1 -- 172.21.15.133:0/2858427187 >> 172.21.15.133:0/2858427187 conn(0x7eff6006a5b0 msgr2=0x7eff600c0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:24.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.132+0000 7eff64a6b640 1 -- 172.21.15.133:0/2858427187 shutdown_connections 2023-12-19T19:02:24.139 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.132+0000 7eff64a6b640 1 -- 172.21.15.133:0/2858427187 wait complete. 2023-12-19T19:02:24.156 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T18:58:30.894083+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2023-12-19T19:01:50.875086+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2023-12-19T19:01:52.061232+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T19:02:24.157 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T19:02:24.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.292+0000 7f79c4fd1640 1 Processor -- start 2023-12-19T19:02:24.297 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.292+0000 7f79c4fd1640 1 -- start start 2023-12-19T19:02:24.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.292+0000 7f79c4fd1640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f79c00725c0 0x7f79c00a5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:24.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.292+0000 7f79c4fd1640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c00c2760 con 0x7f79c0072090 2023-12-19T19:02:24.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.292+0000 7f79c4fd1640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c00aad20 con 0x7f79c00c3bd0 2023-12-19T19:02:24.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.292+0000 7f79c4fd1640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c00c3070 con 0x7f79c00725c0 2023-12-19T19:02:24.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.292+0000 7f79be59c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f79c0072090 0x7f79c00c5cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:34194/0 (socket says 172.21.15.133:34194) 2023-12-19T19:02:24.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.292+0000 7f79be59c640 1 -- 172.21.15.133:0/3576167943 learned_addr learned my addr 172.21.15.133:0/3576167943 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:24.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.292+0000 7f79b5d9b640 1 --2- 172.21.15.133:0/3576167943 >> v2:172.21.15.138:3300/0 conn(0x7f79c00725c0 0x7f79c00a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:24.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.292+0000 7f79bdd9b640 1 -- 172.21.15.133:0/3576167943 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 8867789 0 0) 0x7f79c00c2760 con 0x7f79c0072090 2023-12-19T19:02:24.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.292+0000 7f79bdd9b640 1 -- 172.21.15.133:0/3576167943 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79ac003530 con 0x7f79c0072090 2023-12-19T19:02:24.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.296+0000 7f79b5d9b640 1 -- 172.21.15.133:0/3576167943 >> v1:172.21.15.138:6789/0 conn(0x7f79c00c3bd0 legacy=0x7f79c0150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:24.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.296+0000 7f79bdd9b640 1 -- 172.21.15.133:0/3576167943 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 846918743 0 0) 0x7f79c00aad20 con 0x7f79c00c3bd0 2023-12-19T19:02:24.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.296+0000 7f79b5d9b640 1 -- 172.21.15.133:0/3576167943 >> v1:172.21.15.133:6789/0 conn(0x7f79c0072090 legacy=0x7f79c00c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:24.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.296+0000 7f79b5d9b640 1 -- 172.21.15.133:0/3576167943 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c00ab000 con 0x7f79c00725c0 2023-12-19T19:02:24.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.296+0000 7f79b5d9b640 1 --2- 172.21.15.133:0/3576167943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79c00725c0 0x7f79c00a5370 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f79b00097c0 tx=0x7f79b001c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d643929c83b7121 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:24.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.296+0000 7f79bdd9b640 1 -- 172.21.15.133:0/3576167943 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b00ab600 con 0x7f79c00725c0 2023-12-19T19:02:24.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.296+0000 7f79bdd9b640 1 -- 172.21.15.133:0/3576167943 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b00a7050 con 0x7f79c00725c0 2023-12-19T19:02:24.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.296+0000 7f79bdd9b640 1 -- 172.21.15.133:0/3576167943 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b00ab960 con 0x7f79c00725c0 2023-12-19T19:02:24.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.296+0000 7f79c4fd1640 1 -- 172.21.15.133:0/3576167943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79c00725c0 msgr2=0x7f79c00a5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:24.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.296+0000 7f79c4fd1640 1 --2- 172.21.15.133:0/3576167943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79c00725c0 0x7f79c00a5370 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f79b00097c0 tx=0x7f79b001c360 comp rx=0 tx=0).stop 2023-12-19T19:02:24.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.296+0000 7f79c4fd1640 1 -- 172.21.15.133:0/3576167943 shutdown_connections 2023-12-19T19:02:24.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.296+0000 7f79c4fd1640 1 --2- 172.21.15.133:0/3576167943 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79c00725c0 0x7f79c00a5370 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.296+0000 7f79c4fd1640 1 -- 172.21.15.133:0/3576167943 >> 172.21.15.133:0/3576167943 conn(0x7f79c006a5b0 msgr2=0x7f79c006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:24.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.296+0000 7f79c4fd1640 1 -- 172.21.15.133:0/3576167943 shutdown_connections 2023-12-19T19:02:24.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.300+0000 7f79c4fd1640 1 -- 172.21.15.133:0/3576167943 wait complete. 2023-12-19T19:02:24.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.300+0000 7f79c4fd1640 1 Processor -- start 2023-12-19T19:02:24.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.300+0000 7f79c4fd1640 1 -- start start 2023-12-19T19:02:24.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.300+0000 7f79c4fd1640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79c0072090 0x7f79c0151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:24.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.300+0000 7f79c4fd1640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79c00725c0 0x7f79c0154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:24.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.300+0000 7f79c4fd1640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79c00c3bd0 0x7f79c014e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:24.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.300+0000 7f79c4fd1640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c0154490 con 0x7f79c00725c0 2023-12-19T19:02:24.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.300+0000 7f79c4fd1640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c0155060 con 0x7f79c00c3bd0 2023-12-19T19:02:24.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.300+0000 7f79c4fd1640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c01536d0 con 0x7f79c0072090 2023-12-19T19:02:24.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.300+0000 7f79b5d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79c00725c0 0x7f79c0154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:24.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.300+0000 7f79b5d9b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79c00725c0 0x7f79c0154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:39152/0 (socket says 172.21.15.133:39152) 2023-12-19T19:02:24.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.300+0000 7f79b5d9b640 1 -- 172.21.15.133:0/99774450 learned_addr learned my addr 172.21.15.133:0/99774450 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:24.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.300+0000 7f79bed9d640 1 --2- 172.21.15.133:0/99774450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79c00c3bd0 0x7f79c014e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:24.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.300+0000 7f79be59c640 1 --2- 172.21.15.133:0/99774450 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79c0072090 0x7f79c0151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:24.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.300+0000 7f79b5d9b640 1 -- 172.21.15.133:0/99774450 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79c0072090 msgr2=0x7f79c0151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:24.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.300+0000 7f79b5d9b640 1 --2- 172.21.15.133:0/99774450 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79c0072090 0x7f79c0151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.300+0000 7f79b5d9b640 1 -- 172.21.15.133:0/99774450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79c00c3bd0 msgr2=0x7f79c014e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:24.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.300+0000 7f79b5d9b640 1 --2- 172.21.15.133:0/99774450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79c00c3bd0 0x7f79c014e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.300+0000 7f79b5d9b640 1 -- 172.21.15.133:0/99774450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b0009420 con 0x7f79c00725c0 2023-12-19T19:02:24.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.300+0000 7f79be59c640 1 --2- 172.21.15.133:0/99774450 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79c0072090 0x7f79c0151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:24.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.300+0000 7f79b5d9b640 1 --2- 172.21.15.133:0/99774450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79c00725c0 0x7f79c0154810 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f79b0000c10 tx=0x7f79b0019100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:24.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.304+0000 7f79b77fe640 1 -- 172.21.15.133:0/99774450 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b00b4400 con 0x7f79c00725c0 2023-12-19T19:02:24.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.304+0000 7f79b77fe640 1 -- 172.21.15.133:0/99774450 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b00b4560 con 0x7f79c00725c0 2023-12-19T19:02:24.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.304+0000 7f79b77fe640 1 -- 172.21.15.133:0/99774450 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b00b48f0 con 0x7f79c00725c0 2023-12-19T19:02:24.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.304+0000 7f79c4fd1640 1 -- 172.21.15.133:0/99774450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c01539b0 con 0x7f79c00725c0 2023-12-19T19:02:24.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.304+0000 7f79c4fd1640 1 -- 172.21.15.133:0/99774450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c0153f70 con 0x7f79c00725c0 2023-12-19T19:02:24.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.304+0000 7f79c4fd1640 1 -- 172.21.15.133:0/99774450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c0068400 con 0x7f79c00725c0 2023-12-19T19:02:24.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.304+0000 7f79b77fe640 1 -- 172.21.15.133:0/99774450 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f79b00b2040 con 0x7f79c00725c0 2023-12-19T19:02:24.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.304+0000 7f79b77fe640 1 --2- 172.21.15.133:0/99774450 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f79a0066470 0x7f79a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:24.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.304+0000 7f79b77fe640 1 -- 172.21.15.133:0/99774450 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f79b011dc20 con 0x7f79c00725c0 2023-12-19T19:02:24.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.304+0000 7f79be59c640 1 --2- 172.21.15.133:0/99774450 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f79a0066470 0x7f79a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:24.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.308+0000 7f79be59c640 1 --2- 172.21.15.133:0/99774450 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f79a0066470 0x7f79a0068930 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f79a8005890 tx=0x7f79a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:24.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.308+0000 7f79b77fe640 1 -- 172.21.15.133:0/99774450 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f79b00eb0d0 con 0x7f79c00725c0 2023-12-19T19:02:24.465 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.460+0000 7f79c4fd1640 1 -- 172.21.15.133:0/99774450 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79c0071e70 con 0x7f79c00725c0 2023-12-19T19:02:24.466 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.460+0000 7f79b77fe640 1 -- 172.21.15.133:0/99774450 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f79b00ee6f0 con 0x7f79c00725c0 2023-12-19T19:02:24.466 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 1 2023-12-19T19:02:24.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.464+0000 7f79c4fd1640 1 -- 172.21.15.133:0/99774450 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f79a0066470 msgr2=0x7f79a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:24.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.464+0000 7f79c4fd1640 1 --2- 172.21.15.133:0/99774450 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f79a0066470 0x7f79a0068930 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f79a8005890 tx=0x7f79a8009040 comp rx=0 tx=0).stop 2023-12-19T19:02:24.468 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.464+0000 7f79c4fd1640 1 -- 172.21.15.133:0/99774450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79c00725c0 msgr2=0x7f79c0154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:24.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.464+0000 7f79c4fd1640 1 --2- 172.21.15.133:0/99774450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79c00725c0 0x7f79c0154810 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f79b0000c10 tx=0x7f79b0019100 comp rx=0 tx=0).stop 2023-12-19T19:02:24.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.464+0000 7f79c4fd1640 1 -- 172.21.15.133:0/99774450 shutdown_connections 2023-12-19T19:02:24.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.464+0000 7f79c4fd1640 1 --2- 172.21.15.133:0/99774450 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f79a0066470 0x7f79a0068930 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.464+0000 7f79c4fd1640 1 --2- 172.21.15.133:0/99774450 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f79c00c3bd0 0x7f79c014e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.464+0000 7f79c4fd1640 1 --2- 172.21.15.133:0/99774450 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f79c00725c0 0x7f79c0154810 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.464+0000 7f79c4fd1640 1 --2- 172.21.15.133:0/99774450 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f79c0072090 0x7f79c0151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.464+0000 7f79c4fd1640 1 -- 172.21.15.133:0/99774450 >> 172.21.15.133:0/99774450 conn(0x7f79c006a5b0 msgr2=0x7f79c0150ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:24.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.464+0000 7f79c4fd1640 1 -- 172.21.15.133:0/99774450 shutdown_connections 2023-12-19T19:02:24.469 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.464+0000 7f79c4fd1640 1 -- 172.21.15.133:0/99774450 wait complete. 2023-12-19T19:02:24.487 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2023-12-19T19:02:24.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.620+0000 7fa18e93e640 1 Processor -- start 2023-12-19T19:02:24.626 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.620+0000 7fa18e93e640 1 -- start start 2023-12-19T19:02:24.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.624+0000 7fa18e93e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1880c5260 0x7fa18806d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:24.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.624+0000 7fa18e93e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa1880c5640 0x7fa1880c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:24.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.624+0000 7fa18e93e640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1880c2580 con 0x7fa1880c60f0 2023-12-19T19:02:24.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.624+0000 7fa18e93e640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa188153510 con 0x7fa1880c5640 2023-12-19T19:02:24.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.624+0000 7fa18e93e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1880c17f0 con 0x7fa1880c5260 2023-12-19T19:02:24.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.624+0000 7fa1877fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa1880c5640 0x7fa1880c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:24.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.624+0000 7fa18cedb640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fa1880c60f0 0x7fa188155de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43742/0 (socket says 172.21.15.133:43742) 2023-12-19T19:02:24.628 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.624+0000 7fa18cedb640 1 -- 172.21.15.133:0/2231381408 learned_addr learned my addr 172.21.15.133:0/2231381408 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:24.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.624+0000 7fa187fff640 1 --2- 172.21.15.133:0/2231381408 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1880c5260 0x7fa18806d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:24.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.624+0000 7fa1877fe640 1 -- 172.21.15.133:0/2231381408 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1880c5260 msgr2=0x7fa18806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:24.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.624+0000 7fa1877fe640 1 --2- 172.21.15.133:0/2231381408 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1880c5260 0x7fa18806d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.624+0000 7fa1877fe640 1 -- 172.21.15.133:0/2231381408 >> v1:172.21.15.133:6789/0 conn(0x7fa1880c60f0 legacy=0x7fa188155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:24.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.624+0000 7fa186ffd640 1 -- 172.21.15.133:0/2231381408 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437851575 0 0) 0x7fa1880c2580 con 0x7fa1880c60f0 2023-12-19T19:02:24.629 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.624+0000 7fa1877fe640 1 -- 172.21.15.133:0/2231381408 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1880c1a00 con 0x7fa1880c5640 2023-12-19T19:02:24.630 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.624+0000 7fa1877fe640 1 --2- 172.21.15.133:0/2231381408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1880c5640 0x7fa1880c5bb0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fa1880c1930 tx=0x7fa17c01c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c828c65ab94d0376 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:24.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.628+0000 7fa186ffd640 1 -- 172.21.15.133:0/2231381408 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0ac640 con 0x7fa1880c5640 2023-12-19T19:02:24.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.628+0000 7fa186ffd640 1 -- 172.21.15.133:0/2231381408 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c0ac7a0 con 0x7fa1880c5640 2023-12-19T19:02:24.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.628+0000 7fa186ffd640 1 -- 172.21.15.133:0/2231381408 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c0acb30 con 0x7fa1880c5640 2023-12-19T19:02:24.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.628+0000 7fa18e93e640 1 -- 172.21.15.133:0/2231381408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1880c5640 msgr2=0x7fa1880c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:24.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.628+0000 7fa18e93e640 1 --2- 172.21.15.133:0/2231381408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1880c5640 0x7fa1880c5bb0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fa1880c1930 tx=0x7fa17c01c3c0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.628+0000 7fa18e93e640 1 -- 172.21.15.133:0/2231381408 shutdown_connections 2023-12-19T19:02:24.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.628+0000 7fa18e93e640 1 --2- 172.21.15.133:0/2231381408 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1880c5640 0x7fa1880c5bb0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.628+0000 7fa18e93e640 1 --2- 172.21.15.133:0/2231381408 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1880c5260 0x7fa18806d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.628+0000 7fa18e93e640 1 -- 172.21.15.133:0/2231381408 >> 172.21.15.133:0/2231381408 conn(0x7fa18806a5b0 msgr2=0x7fa18806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:24.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.628+0000 7fa18e93e640 1 -- 172.21.15.133:0/2231381408 shutdown_connections 2023-12-19T19:02:24.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.628+0000 7fa18e93e640 1 -- 172.21.15.133:0/2231381408 wait complete. 2023-12-19T19:02:24.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.628+0000 7fa18e93e640 1 Processor -- start 2023-12-19T19:02:24.633 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.628+0000 7fa18e93e640 1 -- start start 2023-12-19T19:02:24.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.628+0000 7fa18e93e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1880c5260 0x7fa1880bf900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:24.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.628+0000 7fa18e93e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1880c5640 0x7fa18815d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:24.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.628+0000 7fa18e93e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1880c60f0 0x7fa18814ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:24.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.628+0000 7fa18e93e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1881ec290 con 0x7fa1880c5640 2023-12-19T19:02:24.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.628+0000 7fa18e93e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1880bb760 con 0x7fa1880c60f0 2023-12-19T19:02:24.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.628+0000 7fa18e93e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1880bba00 con 0x7fa1880c5260 2023-12-19T19:02:24.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.628+0000 7fa1877fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1880c5640 0x7fa18815d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:24.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.628+0000 7fa1877fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1880c5640 0x7fa18815d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37298/0 (socket says 172.21.15.133:37298) 2023-12-19T19:02:24.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.628+0000 7fa1877fe640 1 -- 172.21.15.133:0/1620780474 learned_addr learned my addr 172.21.15.133:0/1620780474 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:24.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.632+0000 7fa187fff640 1 --2- 172.21.15.133:0/1620780474 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1880c5260 0x7fa1880bf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:24.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.632+0000 7fa18cedb640 1 --2- 172.21.15.133:0/1620780474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1880c60f0 0x7fa18814ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:24.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.632+0000 7fa1877fe640 1 -- 172.21.15.133:0/1620780474 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1880c5260 msgr2=0x7fa1880bf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:24.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.632+0000 7fa1877fe640 1 --2- 172.21.15.133:0/1620780474 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1880c5260 0x7fa1880bf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.632+0000 7fa1877fe640 1 -- 172.21.15.133:0/1620780474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1880c60f0 msgr2=0x7fa18814ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:24.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.632+0000 7fa1877fe640 1 --2- 172.21.15.133:0/1620780474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1880c60f0 0x7fa18814ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.632+0000 7fa1877fe640 1 -- 172.21.15.133:0/1620780474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17c009420 con 0x7fa1880c5640 2023-12-19T19:02:24.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.632+0000 7fa18cedb640 1 --2- 172.21.15.133:0/1620780474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1880c60f0 0x7fa18814ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:24.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.632+0000 7fa1877fe640 1 --2- 172.21.15.133:0/1620780474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1880c5640 0x7fa18815d240 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fa17c019ff0 tx=0x7fa17c01ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:24.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.632+0000 7fa184ff9640 1 -- 172.21.15.133:0/1620780474 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c004230 con 0x7fa1880c5640 2023-12-19T19:02:24.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.632+0000 7fa184ff9640 1 -- 172.21.15.133:0/1620780474 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa17c004390 con 0x7fa1880c5640 2023-12-19T19:02:24.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.632+0000 7fa18e93e640 1 -- 172.21.15.133:0/1620780474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1881eeb20 con 0x7fa1880c5640 2023-12-19T19:02:24.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.632+0000 7fa184ff9640 1 -- 172.21.15.133:0/1620780474 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17c003820 con 0x7fa1880c5640 2023-12-19T19:02:24.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.632+0000 7fa18e93e640 1 -- 172.21.15.133:0/1620780474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18815d780 con 0x7fa1880c5640 2023-12-19T19:02:24.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.632+0000 7fa18e93e640 1 -- 172.21.15.133:0/1620780474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1881ef040 con 0x7fa1880c5640 2023-12-19T19:02:24.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.632+0000 7fa184ff9640 1 -- 172.21.15.133:0/1620780474 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa17c003980 con 0x7fa1880c5640 2023-12-19T19:02:24.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.632+0000 7fa184ff9640 1 --2- 172.21.15.133:0/1620780474 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa174066470 0x7fa174068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:24.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.632+0000 7fa184ff9640 1 -- 172.21.15.133:0/1620780474 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fa17c11e6e0 con 0x7fa1880c5640 2023-12-19T19:02:24.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.636+0000 7fa187fff640 1 --2- 172.21.15.133:0/1620780474 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa174066470 0x7fa174068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:24.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.636+0000 7fa187fff640 1 --2- 172.21.15.133:0/1620780474 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa174066470 0x7fa174068930 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa178009a30 tx=0x7fa178008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:24.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.636+0000 7fa184ff9640 1 -- 172.21.15.133:0/1620780474 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fa17c0ebb90 con 0x7fa1880c5640 2023-12-19T19:02:24.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.800+0000 7fa18e93e640 1 -- 172.21.15.133:0/1620780474 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa188068400 con 0x7fa1880c5640 2023-12-19T19:02:24.806 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.800+0000 7fa184ff9640 1 -- 172.21.15.133:0/1620780474 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v76) v1 ==== 105+0+11 (secure 0 0 0) 0x7fa17c0ef1b0 con 0x7fa1880c5640 2023-12-19T19:02:24.807 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 32 2023-12-19T19:02:24.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.804+0000 7fa18e93e640 1 -- 172.21.15.133:0/1620780474 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa174066470 msgr2=0x7fa174068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:24.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.804+0000 7fa18e93e640 1 --2- 172.21.15.133:0/1620780474 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa174066470 0x7fa174068930 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa178009a30 tx=0x7fa178008040 comp rx=0 tx=0).stop 2023-12-19T19:02:24.809 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.804+0000 7fa18e93e640 1 -- 172.21.15.133:0/1620780474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1880c5640 msgr2=0x7fa18815d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:24.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.804+0000 7fa18e93e640 1 --2- 172.21.15.133:0/1620780474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1880c5640 0x7fa18815d240 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fa17c019ff0 tx=0x7fa17c01ac00 comp rx=0 tx=0).stop 2023-12-19T19:02:24.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.804+0000 7fa18e93e640 1 -- 172.21.15.133:0/1620780474 shutdown_connections 2023-12-19T19:02:24.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.804+0000 7fa18e93e640 1 --2- 172.21.15.133:0/1620780474 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa174066470 0x7fa174068930 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.804+0000 7fa18e93e640 1 --2- 172.21.15.133:0/1620780474 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa1880c60f0 0x7fa18814ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.804+0000 7fa18e93e640 1 --2- 172.21.15.133:0/1620780474 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1880c5640 0x7fa18815d240 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.804+0000 7fa18e93e640 1 --2- 172.21.15.133:0/1620780474 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa1880c5260 0x7fa1880bf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.804+0000 7fa18e93e640 1 -- 172.21.15.133:0/1620780474 >> 172.21.15.133:0/1620780474 conn(0x7fa18806a5b0 msgr2=0x7fa188151cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:24.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.804+0000 7fa18e93e640 1 -- 172.21.15.133:0/1620780474 shutdown_connections 2023-12-19T19:02:24.810 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.804+0000 7fa18e93e640 1 -- 172.21.15.133:0/1620780474 wait complete. 2023-12-19T19:02:24.836 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2023-12-19T19:02:24.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.972+0000 7f66f609a640 1 Processor -- start 2023-12-19T19:02:24.977 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.972+0000 7f66f609a640 1 -- start start 2023-12-19T19:02:24.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.972+0000 7f66f609a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f66f00bf9f0 0x7f66f0158330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:24.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.972+0000 7f66f609a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f006a5b0 con 0x7f66f0073a70 2023-12-19T19:02:24.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.972+0000 7f66f609a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f006b710 con 0x7f66f014b010 2023-12-19T19:02:24.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.972+0000 7f66f609a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f00bfe10 con 0x7f66f00bf9f0 2023-12-19T19:02:24.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.972+0000 7f66eeffd640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f66f0073a70 0x7f66f0157c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43756/0 (socket says 172.21.15.133:43756) 2023-12-19T19:02:24.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.972+0000 7f66eeffd640 1 -- 172.21.15.133:0/4021748832 learned_addr learned my addr 172.21.15.133:0/4021748832 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:24.979 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.976+0000 7f66effff640 1 --2- 172.21.15.133:0/4021748832 >> v2:172.21.15.138:3300/0 conn(0x7f66f00bf9f0 0x7f66f0158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:24.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.976+0000 7f66ee7fc640 1 -- 172.21.15.133:0/4021748832 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768460314 0 0) 0x7f66f006a5b0 con 0x7f66f0073a70 2023-12-19T19:02:24.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.976+0000 7f66ee7fc640 1 -- 172.21.15.133:0/4021748832 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66d8003530 con 0x7f66f0073a70 2023-12-19T19:02:24.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.976+0000 7f66ee7fc640 1 -- 172.21.15.133:0/4021748832 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1951547102 0 0) 0x7f66f006b710 con 0x7f66f014b010 2023-12-19T19:02:24.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.976+0000 7f66ee7fc640 1 -- 172.21.15.133:0/4021748832 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66f006a5b0 con 0x7f66f014b010 2023-12-19T19:02:24.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.976+0000 7f66effff640 1 -- 172.21.15.133:0/4021748832 >> v1:172.21.15.138:6789/0 conn(0x7f66f014b010 legacy=0x7f66f006b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:24.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.976+0000 7f66effff640 1 -- 172.21.15.133:0/4021748832 >> v1:172.21.15.133:6789/0 conn(0x7f66f0073a70 legacy=0x7f66f0157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:24.980 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.976+0000 7f66effff640 1 -- 172.21.15.133:0/4021748832 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f00c1d60 con 0x7f66f00bf9f0 2023-12-19T19:02:24.982 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.976+0000 7f66effff640 1 --2- 172.21.15.133:0/4021748832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66f00bf9f0 0x7f66f0158330 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009d90 tx=0x7f66e801f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4efc86ca8df9eda7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:24.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.976+0000 7f66ee7fc640 1 -- 172.21.15.133:0/4021748832 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e80af600 con 0x7f66f00bf9f0 2023-12-19T19:02:24.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.976+0000 7f66ee7fc640 1 -- 172.21.15.133:0/4021748832 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e80ab050 con 0x7f66f00bf9f0 2023-12-19T19:02:24.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.976+0000 7f66ee7fc640 1 -- 172.21.15.133:0/4021748832 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e80af960 con 0x7f66f00bf9f0 2023-12-19T19:02:24.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.980+0000 7f66f609a640 1 -- 172.21.15.133:0/4021748832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66f00bf9f0 msgr2=0x7f66f0158330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:24.983 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.980+0000 7f66f609a640 1 --2- 172.21.15.133:0/4021748832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66f00bf9f0 0x7f66f0158330 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009d90 tx=0x7f66e801f130 comp rx=0 tx=0).stop 2023-12-19T19:02:24.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.980+0000 7f66f609a640 1 -- 172.21.15.133:0/4021748832 shutdown_connections 2023-12-19T19:02:24.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.980+0000 7f66f609a640 1 --2- 172.21.15.133:0/4021748832 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66f00bf9f0 0x7f66f0158330 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.980+0000 7f66f609a640 1 -- 172.21.15.133:0/4021748832 >> 172.21.15.133:0/4021748832 conn(0x7f66f00c30c0 msgr2=0x7f66f00c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:24.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.980+0000 7f66f609a640 1 -- 172.21.15.133:0/4021748832 shutdown_connections 2023-12-19T19:02:24.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.980+0000 7f66f609a640 1 -- 172.21.15.133:0/4021748832 wait complete. 2023-12-19T19:02:24.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.980+0000 7f66f609a640 1 Processor -- start 2023-12-19T19:02:24.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.980+0000 7f66f609a640 1 -- start start 2023-12-19T19:02:24.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.980+0000 7f66f609a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66f0073a70 0x7f66f014df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:24.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.980+0000 7f66f609a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66f00bf9f0 0x7f66f0151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:24.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.980+0000 7f66f609a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66f014b010 0x7f66f01515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:24.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.980+0000 7f66f609a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f014b3f0 con 0x7f66f014b010 2023-12-19T19:02:24.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.980+0000 7f66f609a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f00a9b00 con 0x7f66f00bf9f0 2023-12-19T19:02:24.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.980+0000 7f66f609a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f014bc20 con 0x7f66f0073a70 2023-12-19T19:02:24.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.980+0000 7f66effff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66f014b010 0x7f66f01515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:24.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.980+0000 7f66effff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66f014b010 0x7f66f01515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37308/0 (socket says 172.21.15.133:37308) 2023-12-19T19:02:24.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.980+0000 7f66effff640 1 -- 172.21.15.133:0/2079703208 learned_addr learned my addr 172.21.15.133:0/2079703208 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:24.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.980+0000 7f66eeffd640 1 --2- 172.21.15.133:0/2079703208 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66f00bf9f0 0x7f66f0151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:24.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.980+0000 7f66ef7fe640 1 --2- 172.21.15.133:0/2079703208 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66f0073a70 0x7f66f014df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:24.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.984+0000 7f66effff640 1 -- 172.21.15.133:0/2079703208 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66f0073a70 msgr2=0x7f66f014df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:24.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.984+0000 7f66effff640 1 --2- 172.21.15.133:0/2079703208 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66f0073a70 0x7f66f014df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.984+0000 7f66effff640 1 -- 172.21.15.133:0/2079703208 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66f00bf9f0 msgr2=0x7f66f0151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:24.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.984+0000 7f66effff640 1 --2- 172.21.15.133:0/2079703208 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66f00bf9f0 0x7f66f0151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:24.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.984+0000 7f66effff640 1 -- 172.21.15.133:0/2079703208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e8009a70 con 0x7f66f014b010 2023-12-19T19:02:24.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.984+0000 7f66effff640 1 --2- 172.21.15.133:0/2079703208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66f014b010 0x7f66f01515b0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f66e801cd60 tx=0x7f66e801bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:24.988 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.984+0000 7f66d7fff640 1 -- 172.21.15.133:0/2079703208 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e80bf070 con 0x7f66f014b010 2023-12-19T19:02:24.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.984+0000 7f66d7fff640 1 -- 172.21.15.133:0/2079703208 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e8004250 con 0x7f66f014b010 2023-12-19T19:02:24.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.984+0000 7f66d7fff640 1 -- 172.21.15.133:0/2079703208 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e80045c0 con 0x7f66f014b010 2023-12-19T19:02:24.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.984+0000 7f66f609a640 1 -- 172.21.15.133:0/2079703208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f0151af0 con 0x7f66f014b010 2023-12-19T19:02:24.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.984+0000 7f66f609a640 1 -- 172.21.15.133:0/2079703208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f01e9e80 con 0x7f66f014b010 2023-12-19T19:02:24.989 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.984+0000 7f66f609a640 1 -- 172.21.15.133:0/2079703208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f014bdd0 con 0x7f66f014b010 2023-12-19T19:02:24.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.984+0000 7f66d7fff640 1 -- 172.21.15.133:0/2079703208 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f66e8004720 con 0x7f66f014b010 2023-12-19T19:02:24.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.984+0000 7f66d7fff640 1 --2- 172.21.15.133:0/2079703208 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f66dc0664a0 0x7f66dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:24.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.988+0000 7f66d7fff640 1 -- 172.21.15.133:0/2079703208 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f66e81220f0 con 0x7f66f014b010 2023-12-19T19:02:24.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.988+0000 7f66ef7fe640 1 --2- 172.21.15.133:0/2079703208 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f66dc0664a0 0x7f66dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:24.992 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.988+0000 7f66ef7fe640 1 --2- 172.21.15.133:0/2079703208 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f66dc0664a0 0x7f66dc068960 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f66e00011f0 tx=0x7f66e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:24.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:24.988+0000 7f66d7fff640 1 -- 172.21.15.133:0/2079703208 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f66f014bdd0 con 0x7f66f014b010 2023-12-19T19:02:25.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.136+0000 7f66f609a640 1 -- 172.21.15.133:0/2079703208 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f66f014bdd0 con 0x7f66f014b010 2023-12-19T19:02:25.143 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.140+0000 7f66d7fff640 1 -- 172.21.15.133:0/2079703208 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v76) v1 ==== 101+0+11 (secure 0 0 0) 0x7f66f014bdd0 con 0x7f66f014b010 2023-12-19T19:02:25.144 INFO:teuthology.orchestra.run.smithi133.stdout:pg_num: 64 2023-12-19T19:02:25.145 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.140+0000 7f66f609a640 1 -- 172.21.15.133:0/2079703208 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f66dc0664a0 msgr2=0x7f66dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.140+0000 7f66f609a640 1 --2- 172.21.15.133:0/2079703208 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f66dc0664a0 0x7f66dc068960 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f66e00011f0 tx=0x7f66e0009040 comp rx=0 tx=0).stop 2023-12-19T19:02:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.140+0000 7f66f609a640 1 -- 172.21.15.133:0/2079703208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66f014b010 msgr2=0x7f66f01515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.140+0000 7f66f609a640 1 --2- 172.21.15.133:0/2079703208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66f014b010 0x7f66f01515b0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f66e801cd60 tx=0x7f66e801bed0 comp rx=0 tx=0).stop 2023-12-19T19:02:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.140+0000 7f66f609a640 1 -- 172.21.15.133:0/2079703208 shutdown_connections 2023-12-19T19:02:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.140+0000 7f66f609a640 1 --2- 172.21.15.133:0/2079703208 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f66dc0664a0 0x7f66dc068960 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.140+0000 7f66f609a640 1 --2- 172.21.15.133:0/2079703208 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66f014b010 0x7f66f01515b0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.140+0000 7f66f609a640 1 --2- 172.21.15.133:0/2079703208 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66f00bf9f0 0x7f66f0151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.140+0000 7f66f609a640 1 --2- 172.21.15.133:0/2079703208 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66f0073a70 0x7f66f014df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.140+0000 7f66f609a640 1 -- 172.21.15.133:0/2079703208 >> 172.21.15.133:0/2079703208 conn(0x7f66f00c30c0 msgr2=0x7f66f00c53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.140+0000 7f66f609a640 1 -- 172.21.15.133:0/2079703208 shutdown_connections 2023-12-19T19:02:25.146 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.140+0000 7f66f609a640 1 -- 172.21.15.133:0/2079703208 wait complete. 2023-12-19T19:02:25.165 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:02:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.296+0000 7ff8f2ae3640 1 Processor -- start 2023-12-19T19:02:25.302 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.296+0000 7ff8f2ae3640 1 -- start start 2023-12-19T19:02:25.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.300+0000 7ff8f2ae3640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff8ec072090 0x7ff8ec150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:25.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.300+0000 7ff8f2ae3640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8ec0c2760 con 0x7ff8ec0725c0 2023-12-19T19:02:25.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.300+0000 7ff8f2ae3640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8ec0a5750 con 0x7ff8ec0a5370 2023-12-19T19:02:25.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.300+0000 7ff8f2ae3640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8ec0c3070 con 0x7ff8ec072090 2023-12-19T19:02:25.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.300+0000 7ff8f1080640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7ff8ec0725c0 0x7ff8ec1514e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43772/0 (socket says 172.21.15.133:43772) 2023-12-19T19:02:25.303 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.300+0000 7ff8f1080640 1 -- 172.21.15.133:0/1919026790 learned_addr learned my addr 172.21.15.133:0/1919026790 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.300+0000 7ff8e3fff640 1 --2- 172.21.15.133:0/1919026790 >> v2:172.21.15.138:3300/0 conn(0x7ff8ec072090 0x7ff8ec150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.300+0000 7ff8e37fe640 1 -- 172.21.15.133:0/1919026790 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479458780 0 0) 0x7ff8ec0c2760 con 0x7ff8ec0725c0 2023-12-19T19:02:25.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.300+0000 7ff8e37fe640 1 -- 172.21.15.133:0/1919026790 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8d4003530 con 0x7ff8ec0725c0 2023-12-19T19:02:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.300+0000 7ff8e37fe640 1 -- 172.21.15.133:0/1919026790 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226587008 0 0) 0x7ff8ec0a5750 con 0x7ff8ec0a5370 2023-12-19T19:02:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.300+0000 7ff8e37fe640 1 -- 172.21.15.133:0/1919026790 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8ec0c2760 con 0x7ff8ec0a5370 2023-12-19T19:02:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.300+0000 7ff8e3fff640 1 -- 172.21.15.133:0/1919026790 >> v1:172.21.15.138:6789/0 conn(0x7ff8ec0a5370 legacy=0x7ff8ec0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.300+0000 7ff8e3fff640 1 -- 172.21.15.133:0/1919026790 >> v1:172.21.15.133:6789/0 conn(0x7ff8ec0725c0 legacy=0x7ff8ec1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:25.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.300+0000 7ff8e3fff640 1 -- 172.21.15.133:0/1919026790 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8ec0aad20 con 0x7ff8ec072090 2023-12-19T19:02:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.304+0000 7ff8e3fff640 1 --2- 172.21.15.133:0/1919026790 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8ec072090 0x7ff8ec150fa0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0097c0 tx=0x7ff8dc01c360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b30aea70572b149 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:25.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.304+0000 7ff8e37fe640 1 -- 172.21.15.133:0/1919026790 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc0ab600 con 0x7ff8ec072090 2023-12-19T19:02:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.304+0000 7ff8e37fe640 1 -- 172.21.15.133:0/1919026790 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8dc0a7050 con 0x7ff8ec072090 2023-12-19T19:02:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.304+0000 7ff8e37fe640 1 -- 172.21.15.133:0/1919026790 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc0ab980 con 0x7ff8ec072090 2023-12-19T19:02:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.304+0000 7ff8f2ae3640 1 -- 172.21.15.133:0/1919026790 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8ec072090 msgr2=0x7ff8ec150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.304+0000 7ff8f2ae3640 1 --2- 172.21.15.133:0/1919026790 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8ec072090 0x7ff8ec150fa0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0097c0 tx=0x7ff8dc01c360 comp rx=0 tx=0).stop 2023-12-19T19:02:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.304+0000 7ff8f2ae3640 1 -- 172.21.15.133:0/1919026790 shutdown_connections 2023-12-19T19:02:25.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.304+0000 7ff8f2ae3640 1 --2- 172.21.15.133:0/1919026790 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8ec072090 0x7ff8ec150fa0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.304+0000 7ff8f2ae3640 1 -- 172.21.15.133:0/1919026790 >> 172.21.15.133:0/1919026790 conn(0x7ff8ec06a5b0 msgr2=0x7ff8ec06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.304+0000 7ff8f2ae3640 1 -- 172.21.15.133:0/1919026790 shutdown_connections 2023-12-19T19:02:25.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.304+0000 7ff8f2ae3640 1 -- 172.21.15.133:0/1919026790 wait complete. 2023-12-19T19:02:25.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.304+0000 7ff8f2ae3640 1 Processor -- start 2023-12-19T19:02:25.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.304+0000 7ff8f2ae3640 1 -- start start 2023-12-19T19:02:25.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8f2ae3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8ec072090 0x7ff8ec0714e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:25.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8f2ae3640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8ec0725c0 0x7ff8ec147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:25.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8f2ae3640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8ec0a5370 0x7ff8ec1ee2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:25.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8f2ae3640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec1549b0 con 0x7ff8ec072090 2023-12-19T19:02:25.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8f2ae3640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec070860 con 0x7ff8ec0a5370 2023-12-19T19:02:25.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8f2ae3640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8ec150a60 con 0x7ff8ec0725c0 2023-12-19T19:02:25.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8f087f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8ec072090 0x7ff8ec0714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:25.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8f087f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8ec072090 0x7ff8ec0714e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37320/0 (socket says 172.21.15.133:37320) 2023-12-19T19:02:25.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8f087f640 1 -- 172.21.15.133:0/694445712 learned_addr learned my addr 172.21.15.133:0/694445712 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:25.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8f1080640 1 --2- 172.21.15.133:0/694445712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8ec0a5370 0x7ff8ec1ee2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:25.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8e3fff640 1 --2- 172.21.15.133:0/694445712 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8ec0725c0 0x7ff8ec147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:25.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8f087f640 1 -- 172.21.15.133:0/694445712 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8ec0725c0 msgr2=0x7ff8ec147de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:25.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8f087f640 1 --2- 172.21.15.133:0/694445712 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8ec0725c0 0x7ff8ec147de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:25.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8f087f640 1 -- 172.21.15.133:0/694445712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8ec0a5370 msgr2=0x7ff8ec1ee2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:25.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8f087f640 1 --2- 172.21.15.133:0/694445712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8ec0a5370 0x7ff8ec1ee2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:25.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8f087f640 1 -- 172.21.15.133:0/694445712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc009420 con 0x7ff8ec072090 2023-12-19T19:02:25.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8f087f640 1 --2- 172.21.15.133:0/694445712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8ec072090 0x7ff8ec0714e0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800c430 tx=0x7ff8e800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:25.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8e17fa640 1 -- 172.21.15.133:0/694445712 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e80052d0 con 0x7ff8ec072090 2023-12-19T19:02:25.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8e17fa640 1 -- 172.21.15.133:0/694445712 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e8005450 con 0x7ff8ec072090 2023-12-19T19:02:25.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8f2ae3640 1 -- 172.21.15.133:0/694445712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8ec150450 con 0x7ff8ec072090 2023-12-19T19:02:25.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8e17fa640 1 -- 172.21.15.133:0/694445712 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8003840 con 0x7ff8ec072090 2023-12-19T19:02:25.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8f2ae3640 1 -- 172.21.15.133:0/694445712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8ec070ab0 con 0x7ff8ec072090 2023-12-19T19:02:25.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8f2ae3640 1 -- 172.21.15.133:0/694445712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8ec068400 con 0x7ff8ec072090 2023-12-19T19:02:25.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.308+0000 7ff8e17fa640 1 -- 172.21.15.133:0/694445712 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff8e80039a0 con 0x7ff8ec072090 2023-12-19T19:02:25.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.312+0000 7ff8e17fa640 1 --2- 172.21.15.133:0/694445712 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff8d80664a0 0x7ff8d8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:25.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.312+0000 7ff8e17fa640 1 -- 172.21.15.133:0/694445712 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5799+0+0 (secure 0 0 0) 0x7ff8e8083460 con 0x7ff8ec072090 2023-12-19T19:02:25.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.312+0000 7ff8e3fff640 1 --2- 172.21.15.133:0/694445712 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff8d80664a0 0x7ff8d8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:25.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.312+0000 7ff8e3fff640 1 --2- 172.21.15.133:0/694445712 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff8d80664a0 0x7ff8d8068960 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0ad000 tx=0x7ff8dc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:25.319 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.312+0000 7ff8e17fa640 1 -- 172.21.15.133:0/694445712 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff8e8050910 con 0x7ff8ec072090 2023-12-19T19:02:25.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.492+0000 7ff8f2ae3640 1 -- 172.21.15.133:0/694445712 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8ec15c2e0 con 0x7ff8ec072090 2023-12-19T19:02:25.498 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.492+0000 7ff8e17fa640 1 -- 172.21.15.133:0/694445712 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4954 (secure 0 0 0) 0x7ff8e8053f30 con 0x7ff8ec072090 2023-12-19T19:02:25.498 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:25.499 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/2119189888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":2119189888},{"type":"v1","addr":"172.21.15.133:6835","nonce":2119189888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/4005236173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":4005236173},{"type":"v1","addr":"172.21.15.138:6835","nonce":4005236173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7152,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/3920117238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3920117238},{"type":"v1","addr":"172.21.15.133:6834","nonce":3920117238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:01:53.054600+0000","modified":"2023-12-19T19:01:56.088450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5765},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5765":{"gid":5765,"name":"d","rank":0,"incarnation":49,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6837/1466041773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":1466041773},{"type":"v1","addr":"172.21.15.138:6837","nonce":1466041773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T19:02:25.499 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 55 2023-12-19T19:02:25.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.496+0000 7ff8f2ae3640 1 -- 172.21.15.133:0/694445712 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff8d80664a0 msgr2=0x7ff8d8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:25.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.496+0000 7ff8f2ae3640 1 --2- 172.21.15.133:0/694445712 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff8d80664a0 0x7ff8d8068960 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc0ad000 tx=0x7ff8dc008040 comp rx=0 tx=0).stop 2023-12-19T19:02:25.500 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.496+0000 7ff8f2ae3640 1 -- 172.21.15.133:0/694445712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8ec072090 msgr2=0x7ff8ec0714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:25.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.496+0000 7ff8f2ae3640 1 --2- 172.21.15.133:0/694445712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8ec072090 0x7ff8ec0714e0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800c430 tx=0x7ff8e800c8f0 comp rx=0 tx=0).stop 2023-12-19T19:02:25.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.496+0000 7ff8f2ae3640 1 -- 172.21.15.133:0/694445712 shutdown_connections 2023-12-19T19:02:25.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.496+0000 7ff8f2ae3640 1 --2- 172.21.15.133:0/694445712 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff8d80664a0 0x7ff8d8068960 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:25.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.496+0000 7ff8f2ae3640 1 --2- 172.21.15.133:0/694445712 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff8ec0a5370 0x7ff8ec1ee2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:25.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.496+0000 7ff8f2ae3640 1 --2- 172.21.15.133:0/694445712 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff8ec0725c0 0x7ff8ec147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:25.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.496+0000 7ff8f2ae3640 1 --2- 172.21.15.133:0/694445712 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8ec072090 0x7ff8ec0714e0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:25.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.496+0000 7ff8f2ae3640 1 -- 172.21.15.133:0/694445712 >> 172.21.15.133:0/694445712 conn(0x7ff8ec06a5b0 msgr2=0x7ff8ec0c0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:25.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.496+0000 7ff8f2ae3640 1 -- 172.21.15.133:0/694445712 shutdown_connections 2023-12-19T19:02:25.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.496+0000 7ff8f2ae3640 1 -- 172.21.15.133:0/694445712 wait complete. 2023-12-19T19:02:25.520 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:02:25.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.652+0000 7fcb010ea640 1 Processor -- start 2023-12-19T19:02:25.657 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.652+0000 7fcb010ea640 1 -- start start 2023-12-19T19:02:25.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.652+0000 7fcb010ea640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcafc06b1e0 0x7fcafc06a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:25.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.652+0000 7fcb010ea640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcafc072500 con 0x7fcafc06dfe0 2023-12-19T19:02:25.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.652+0000 7fcb010ea640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcafc070f60 con 0x7fcafc06a5b0 2023-12-19T19:02:25.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.652+0000 7fcb010ea640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcafc06ef50 con 0x7fcafc06b1e0 2023-12-19T19:02:25.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.652+0000 7fcafa59c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcafc06dfe0 0x7fcafc15cf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43778/0 (socket says 172.21.15.133:43778) 2023-12-19T19:02:25.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.652+0000 7fcafb59e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcafc06b1e0 0x7fcafc06a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:25.658 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.652+0000 7fcafa59c640 1 -- 172.21.15.133:0/380972569 learned_addr learned my addr 172.21.15.133:0/380972569 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:25.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.652+0000 7fcafb59e640 1 -- 172.21.15.133:0/380972569 >> v1:172.21.15.138:6789/0 conn(0x7fcafc06a5b0 legacy=0x7fcafc0c2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:25.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.652+0000 7fcafb59e640 1 -- 172.21.15.133:0/380972569 >> v1:172.21.15.133:6789/0 conn(0x7fcafc06dfe0 legacy=0x7fcafc15cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:25.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.652+0000 7fcafb59e640 1 -- 172.21.15.133:0/380972569 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcafc14eda0 con 0x7fcafc06b1e0 2023-12-19T19:02:25.659 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.652+0000 7fcaf9d9b640 1 -- 172.21.15.133:0/380972569 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284495260 0 0) 0x7fcafc072500 con 0x7fcafc06dfe0 2023-12-19T19:02:25.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.656+0000 7fcafb59e640 1 --2- 172.21.15.133:0/380972569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcafc06b1e0 0x7fcafc06a990 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009d90 tx=0x7fcaf401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7299f7bdeb7d0e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:25.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.656+0000 7fcaf9d9b640 1 -- 172.21.15.133:0/380972569 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf40a5780 con 0x7fcafc06b1e0 2023-12-19T19:02:25.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.656+0000 7fcaf9d9b640 1 -- 172.21.15.133:0/380972569 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf40a58e0 con 0x7fcafc06b1e0 2023-12-19T19:02:25.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.656+0000 7fcaf9d9b640 1 -- 172.21.15.133:0/380972569 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf40a5c70 con 0x7fcafc06b1e0 2023-12-19T19:02:25.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.656+0000 7fcb010ea640 1 -- 172.21.15.133:0/380972569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcafc06b1e0 msgr2=0x7fcafc06a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:25.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.656+0000 7fcb010ea640 1 --2- 172.21.15.133:0/380972569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcafc06b1e0 0x7fcafc06a990 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4009d90 tx=0x7fcaf401c8c0 comp rx=0 tx=0).stop 2023-12-19T19:02:25.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.656+0000 7fcb010ea640 1 -- 172.21.15.133:0/380972569 shutdown_connections 2023-12-19T19:02:25.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.656+0000 7fcb010ea640 1 --2- 172.21.15.133:0/380972569 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcafc06b1e0 0x7fcafc06a990 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:25.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.656+0000 7fcb010ea640 1 -- 172.21.15.133:0/380972569 >> 172.21.15.133:0/380972569 conn(0x7fcafc0c6ef0 msgr2=0x7fcafc0c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:25.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.656+0000 7fcb010ea640 1 -- 172.21.15.133:0/380972569 shutdown_connections 2023-12-19T19:02:25.663 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.656+0000 7fcb010ea640 1 -- 172.21.15.133:0/380972569 wait complete. 2023-12-19T19:02:25.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcb010ea640 1 Processor -- start 2023-12-19T19:02:25.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcb010ea640 1 -- start start 2023-12-19T19:02:25.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcb010ea640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcafc06a5b0 0x7fcafc1559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:25.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcb010ea640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcafc06b1e0 0x7fcafc0c5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:25.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcb010ea640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcafc06dfe0 0x7fcafc14ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:25.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcb010ea640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc151570 con 0x7fcafc06dfe0 2023-12-19T19:02:25.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcb010ea640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc151a60 con 0x7fcafc06a5b0 2023-12-19T19:02:25.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcb010ea640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcafc1589e0 con 0x7fcafc06b1e0 2023-12-19T19:02:25.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcafb59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcafc06dfe0 0x7fcafc14ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:25.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcafb59e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcafc06dfe0 0x7fcafc14ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37336/0 (socket says 172.21.15.133:37336) 2023-12-19T19:02:25.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcafb59e640 1 -- 172.21.15.133:0/505740748 learned_addr learned my addr 172.21.15.133:0/505740748 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:25.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcafa59c640 1 --2- 172.21.15.133:0/505740748 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcafc06b1e0 0x7fcafc0c5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcafad9d640 1 --2- 172.21.15.133:0/505740748 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcafc06a5b0 0x7fcafc1559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcafb59e640 1 -- 172.21.15.133:0/505740748 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcafc06b1e0 msgr2=0x7fcafc0c5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcafb59e640 1 --2- 172.21.15.133:0/505740748 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcafc06b1e0 0x7fcafc0c5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcafb59e640 1 -- 172.21.15.133:0/505740748 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcafc06a5b0 msgr2=0x7fcafc1559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcafb59e640 1 --2- 172.21.15.133:0/505740748 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcafc06a5b0 0x7fcafc1559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcafb59e640 1 -- 172.21.15.133:0/505740748 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf4009a70 con 0x7fcafc06dfe0 2023-12-19T19:02:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcafa59c640 1 --2- 172.21.15.133:0/505740748 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcafc06b1e0 0x7fcafc0c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcafad9d640 1 --2- 172.21.15.133:0/505740748 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcafc06a5b0 0x7fcafc1559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcafb59e640 1 --2- 172.21.15.133:0/505740748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcafc06dfe0 0x7fcafc14ef70 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40b0040 tx=0x7fcaf4019660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcae37fe640 1 -- 172.21.15.133:0/505740748 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf40b9860 con 0x7fcafc06dfe0 2023-12-19T19:02:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcae37fe640 1 -- 172.21.15.133:0/505740748 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf40b99c0 con 0x7fcafc06dfe0 2023-12-19T19:02:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcb010ea640 1 -- 172.21.15.133:0/505740748 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcafc151dc0 con 0x7fcafc06dfe0 2023-12-19T19:02:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.660+0000 7fcae37fe640 1 -- 172.21.15.133:0/505740748 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf40b9d30 con 0x7fcafc06dfe0 2023-12-19T19:02:25.668 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.664+0000 7fcb010ea640 1 -- 172.21.15.133:0/505740748 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcafc1584c0 con 0x7fcafc06dfe0 2023-12-19T19:02:25.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.664+0000 7fcb010ea640 1 -- 172.21.15.133:0/505740748 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcafc158300 con 0x7fcafc06dfe0 2023-12-19T19:02:25.669 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.664+0000 7fcae37fe640 1 -- 172.21.15.133:0/505740748 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fcaf40ad440 con 0x7fcafc06dfe0 2023-12-19T19:02:25.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.664+0000 7fcae37fe640 1 --2- 172.21.15.133:0/505740748 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcae8066470 0x7fcae8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:25.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.664+0000 7fcae37fe640 1 -- 172.21.15.133:0/505740748 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fcaf411f220 con 0x7fcafc06dfe0 2023-12-19T19:02:25.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.664+0000 7fcafad9d640 1 --2- 172.21.15.133:0/505740748 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcae8066470 0x7fcae8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:25.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.664+0000 7fcafad9d640 1 --2- 172.21.15.133:0/505740748 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcae8066470 0x7fcae8068930 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fcaec000f70 tx=0x7fcaec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:25.673 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.668+0000 7fcae37fe640 1 -- 172.21.15.133:0/505740748 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fcaf40f00d0 con 0x7fcafc06dfe0 2023-12-19T19:02:25.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.824+0000 7fcb010ea640 1 -- 172.21.15.133:0/505740748 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcafc1586b0 con 0x7fcafc06dfe0 2023-12-19T19:02:25.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.828+0000 7fcae37fe640 1 -- 172.21.15.133:0/505740748 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16679 (secure 0 0 0) 0x7fcaf40efc60 con 0x7fcafc06dfe0 2023-12-19T19:02:25.831 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:25.832 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":76,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:02:23.778994+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:01:50.875086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:01:52.061232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6834/2813206606":"2023-12-20T19:02:20.729934+0000","172.21.15.133:6832/2813206606":"2023-12-20T19:02:20.729934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:02:25.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.828+0000 7fcb010ea640 1 -- 172.21.15.133:0/505740748 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcae8066470 msgr2=0x7fcae8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:25.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.828+0000 7fcb010ea640 1 --2- 172.21.15.133:0/505740748 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcae8066470 0x7fcae8068930 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fcaec000f70 tx=0x7fcaec009040 comp rx=0 tx=0).stop 2023-12-19T19:02:25.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.828+0000 7fcb010ea640 1 -- 172.21.15.133:0/505740748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcafc06dfe0 msgr2=0x7fcafc14ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:25.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.828+0000 7fcb010ea640 1 --2- 172.21.15.133:0/505740748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcafc06dfe0 0x7fcafc14ef70 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40b0040 tx=0x7fcaf4019660 comp rx=0 tx=0).stop 2023-12-19T19:02:25.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.828+0000 7fcb010ea640 1 -- 172.21.15.133:0/505740748 shutdown_connections 2023-12-19T19:02:25.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.828+0000 7fcb010ea640 1 --2- 172.21.15.133:0/505740748 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcae8066470 0x7fcae8068930 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:25.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.828+0000 7fcb010ea640 1 --2- 172.21.15.133:0/505740748 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcafc06dfe0 0x7fcafc14ef70 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:25.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.828+0000 7fcb010ea640 1 --2- 172.21.15.133:0/505740748 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcafc06b1e0 0x7fcafc0c5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:25.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.828+0000 7fcb010ea640 1 --2- 172.21.15.133:0/505740748 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcafc06a5b0 0x7fcafc1559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:25.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.828+0000 7fcb010ea640 1 -- 172.21.15.133:0/505740748 >> 172.21.15.133:0/505740748 conn(0x7fcafc0c6ef0 msgr2=0x7fcafc0c0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:25.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.828+0000 7fcb010ea640 1 -- 172.21.15.133:0/505740748 shutdown_connections 2023-12-19T19:02:25.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.828+0000 7fcb010ea640 1 -- 172.21.15.133:0/505740748 wait complete. 2023-12-19T19:02:25.853 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2023-12-19T19:02:25.853 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:02:25.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.988+0000 7f748952a640 1 Processor -- start 2023-12-19T19:02:25.993 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.988+0000 7f748952a640 1 -- start start 2023-12-19T19:02:25.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.988+0000 7f748952a640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7484151e90 0x7f74840c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:25.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.988+0000 7f748952a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f748406c860 con 0x7f74840c7ea0 2023-12-19T19:02:25.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.988+0000 7f748952a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7484154930 con 0x7f74840c4e60 2023-12-19T19:02:25.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.988+0000 7f748952a640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74840c8750 con 0x7f7484151e90 2023-12-19T19:02:25.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.988+0000 7f747a7fc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f74840c7ea0 0x7f748406b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43792/0 (socket says 172.21.15.133:43792) 2023-12-19T19:02:25.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.988+0000 7f747a7fc640 1 -- 172.21.15.133:0/1169362130 learned_addr learned my addr 172.21.15.133:0/1169362130 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:25.994 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.988+0000 7f7482ffd640 1 --2- 172.21.15.133:0/1169362130 >> v2:172.21.15.133:3300/0 conn(0x7f7484151e90 0x7f74840c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:25.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.988+0000 7f7482ffd640 1 -- 172.21.15.133:0/1169362130 >> v1:172.21.15.138:6789/0 conn(0x7f74840c4e60 legacy=0x7f748415f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:25.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.988+0000 7f7482ffd640 1 -- 172.21.15.133:0/1169362130 >> v1:172.21.15.133:6789/0 conn(0x7f74840c7ea0 legacy=0x7f748406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:25.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.988+0000 7f7482ffd640 1 -- 172.21.15.133:0/1169362130 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7484154c10 con 0x7f7484151e90 2023-12-19T19:02:25.995 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.988+0000 7f74827fc640 1 -- 172.21.15.133:0/1169362130 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1383839991 0 0) 0x7f748406c860 con 0x7f74840c7ea0 2023-12-19T19:02:25.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.992+0000 7f7482ffd640 1 --2- 172.21.15.133:0/1169362130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7484151e90 0x7f74840c4920 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f746c0097c0 tx=0x7f746c01c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9fab6d64e35570 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:25.997 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.992+0000 7f74827fc640 1 -- 172.21.15.133:0/1169362130 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c0ab600 con 0x7f7484151e90 2023-12-19T19:02:25.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.992+0000 7f74827fc640 1 -- 172.21.15.133:0/1169362130 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746c0a7050 con 0x7f7484151e90 2023-12-19T19:02:25.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.992+0000 7f74827fc640 1 -- 172.21.15.133:0/1169362130 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c0ab980 con 0x7f7484151e90 2023-12-19T19:02:25.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.992+0000 7f748952a640 1 -- 172.21.15.133:0/1169362130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7484151e90 msgr2=0x7f74840c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:25.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.992+0000 7f748952a640 1 --2- 172.21.15.133:0/1169362130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7484151e90 0x7f74840c4920 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f746c0097c0 tx=0x7f746c01c320 comp rx=0 tx=0).stop 2023-12-19T19:02:25.998 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.992+0000 7f748952a640 1 -- 172.21.15.133:0/1169362130 shutdown_connections 2023-12-19T19:02:25.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.992+0000 7f748952a640 1 --2- 172.21.15.133:0/1169362130 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7484151e90 0x7f74840c4920 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:25.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.992+0000 7f748952a640 1 -- 172.21.15.133:0/1169362130 >> 172.21.15.133:0/1169362130 conn(0x7f74840ca170 msgr2=0x7f74840ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:25.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.992+0000 7f748952a640 1 -- 172.21.15.133:0/1169362130 shutdown_connections 2023-12-19T19:02:25.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.992+0000 7f748952a640 1 -- 172.21.15.133:0/1169362130 wait complete. 2023-12-19T19:02:25.999 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f748952a640 1 Processor -- start 2023-12-19T19:02:26.000 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f748952a640 1 -- start start 2023-12-19T19:02:26.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f748952a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74840c4e60 0x7f74840c3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:26.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f748952a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74840c7ea0 0x7f74841f0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:26.002 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f748952a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7484151e90 0x7f74840c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f748952a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74841552d0 con 0x7f74840c4e60 2023-12-19T19:02:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f748952a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74840c2330 con 0x7f7484151e90 2023-12-19T19:02:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f748952a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74841f1430 con 0x7f74840c7ea0 2023-12-19T19:02:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f7482ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74840c4e60 0x7f74840c3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f7482ffd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74840c4e60 0x7f74840c3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37360/0 (socket says 172.21.15.133:37360) 2023-12-19T19:02:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f7482ffd640 1 -- 172.21.15.133:0/2530704571 learned_addr learned my addr 172.21.15.133:0/2530704571 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f747a7fc640 1 --2- 172.21.15.133:0/2530704571 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74840c7ea0 0x7f74841f0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f74837fe640 1 --2- 172.21.15.133:0/2530704571 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7484151e90 0x7f74840c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f7482ffd640 1 -- 172.21.15.133:0/2530704571 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74840c7ea0 msgr2=0x7f74841f0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f7482ffd640 1 --2- 172.21.15.133:0/2530704571 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74840c7ea0 0x7f74841f0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f7482ffd640 1 -- 172.21.15.133:0/2530704571 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7484151e90 msgr2=0x7f74840c27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f7482ffd640 1 --2- 172.21.15.133:0/2530704571 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7484151e90 0x7f74840c27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f7482ffd640 1 -- 172.21.15.133:0/2530704571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c009420 con 0x7f74840c4e60 2023-12-19T19:02:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f747a7fc640 1 --2- 172.21.15.133:0/2530704571 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74840c7ea0 0x7f74841f0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:26.003 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f74837fe640 1 --2- 172.21.15.133:0/2530704571 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7484151e90 0x7f74840c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f7482ffd640 1 --2- 172.21.15.133:0/2530704571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74840c4e60 0x7f74840c3c80 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f746c0ae040 tx=0x7f746c01ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f747bfff640 1 -- 172.21.15.133:0/2530704571 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c0b7650 con 0x7f74840c4e60 2023-12-19T19:02:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f747bfff640 1 -- 172.21.15.133:0/2530704571 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746c0b77b0 con 0x7f74840c4e60 2023-12-19T19:02:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f748952a640 1 -- 172.21.15.133:0/2530704571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74841f1150 con 0x7f74840c4e60 2023-12-19T19:02:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f747bfff640 1 -- 172.21.15.133:0/2530704571 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746c0b7b60 con 0x7f74840c4e60 2023-12-19T19:02:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:25.996+0000 7f748952a640 1 -- 172.21.15.133:0/2530704571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74840c1fc0 con 0x7f74840c4e60 2023-12-19T19:02:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.000+0000 7f748952a640 1 -- 172.21.15.133:0/2530704571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7484068400 con 0x7f74840c4e60 2023-12-19T19:02:26.004 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.000+0000 7f747bfff640 1 -- 172.21.15.133:0/2530704571 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f746c0b7cc0 con 0x7f74840c4e60 2023-12-19T19:02:26.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.000+0000 7f747bfff640 1 --2- 172.21.15.133:0/2530704571 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7464066470 0x7f7464068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:26.005 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.000+0000 7f747bfff640 1 -- 172.21.15.133:0/2530704571 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f746c11e9e0 con 0x7f74840c4e60 2023-12-19T19:02:26.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.000+0000 7f747a7fc640 1 --2- 172.21.15.133:0/2530704571 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7464066470 0x7f7464068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:26.006 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.000+0000 7f747a7fc640 1 --2- 172.21.15.133:0/2530704571 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7464066470 0x7f7464068930 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7474007fd0 tx=0x7f7474009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:26.009 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.004+0000 7f747bfff640 1 -- 172.21.15.133:0/2530704571 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f746c0ebcd0 con 0x7f74840c4e60 2023-12-19T19:02:26.191 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.188+0000 7f748952a640 1 -- 172.21.15.133:0/2530704571 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7484150270 con 0x7f74840c4e60 2023-12-19T19:02:26.192 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.188+0000 7f747bfff640 1 -- 172.21.15.133:0/2530704571 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4954 (secure 0 0 0) 0x7f746c0bb090 con 0x7f74840c4e60 2023-12-19T19:02:26.192 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:26.192 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/2119189888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":2119189888},{"type":"v1","addr":"172.21.15.133:6835","nonce":2119189888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/4005236173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":4005236173},{"type":"v1","addr":"172.21.15.138:6835","nonce":4005236173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7152,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/3920117238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3920117238},{"type":"v1","addr":"172.21.15.133:6834","nonce":3920117238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:01:53.054600+0000","modified":"2023-12-19T19:01:56.088450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5765},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5765":{"gid":5765,"name":"d","rank":0,"incarnation":49,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6837/1466041773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":1466041773},{"type":"v1","addr":"172.21.15.138:6837","nonce":1466041773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T19:02:26.192 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 55 2023-12-19T19:02:26.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.188+0000 7f748952a640 1 -- 172.21.15.133:0/2530704571 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7464066470 msgr2=0x7f7464068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:26.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.188+0000 7f748952a640 1 --2- 172.21.15.133:0/2530704571 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7464066470 0x7f7464068930 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7474007fd0 tx=0x7f7474009040 comp rx=0 tx=0).stop 2023-12-19T19:02:26.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.188+0000 7f748952a640 1 -- 172.21.15.133:0/2530704571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74840c4e60 msgr2=0x7f74840c3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:26.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.188+0000 7f748952a640 1 --2- 172.21.15.133:0/2530704571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74840c4e60 0x7f74840c3c80 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f746c0ae040 tx=0x7f746c01ab60 comp rx=0 tx=0).stop 2023-12-19T19:02:26.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.188+0000 7f748952a640 1 -- 172.21.15.133:0/2530704571 shutdown_connections 2023-12-19T19:02:26.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.188+0000 7f748952a640 1 --2- 172.21.15.133:0/2530704571 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7464066470 0x7f7464068930 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.188+0000 7f748952a640 1 --2- 172.21.15.133:0/2530704571 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f7484151e90 0x7f74840c27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.188+0000 7f748952a640 1 --2- 172.21.15.133:0/2530704571 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74840c7ea0 0x7f74841f0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.188+0000 7f748952a640 1 --2- 172.21.15.133:0/2530704571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f74840c4e60 0x7f74840c3c80 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.188+0000 7f748952a640 1 -- 172.21.15.133:0/2530704571 >> 172.21.15.133:0/2530704571 conn(0x7f74840ca170 msgr2=0x7f748414f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:26.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.188+0000 7f748952a640 1 -- 172.21.15.133:0/2530704571 shutdown_connections 2023-12-19T19:02:26.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.188+0000 7f748952a640 1 -- 172.21.15.133:0/2530704571 wait complete. 2023-12-19T19:02:26.213 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:02:26.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.344+0000 7f05d0817640 1 Processor -- start 2023-12-19T19:02:26.350 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.344+0000 7f05d0817640 1 -- start start 2023-12-19T19:02:26.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.344+0000 7f05d0817640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f05cc0c63c0 0x7f05cc0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:26.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.344+0000 7f05d0817640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f05cc0c2bb0 0x7f05cc0a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:26.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.344+0000 7f05d0817640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05cc0c31c0 con 0x7f05cc0c4100 2023-12-19T19:02:26.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.344+0000 7f05d0817640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05cc0c34a0 con 0x7f05cc0c63c0 2023-12-19T19:02:26.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.344+0000 7f05d0817640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05cc0c1030 con 0x7f05cc0c2bb0 2023-12-19T19:02:26.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.348+0000 7f05ca59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f05cc0c63c0 0x7f05cc0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:26.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.348+0000 7f05ca59c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f05cc0c63c0 0x7f05cc0c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37366/0 (socket says 172.21.15.133:37366) 2023-12-19T19:02:26.351 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.348+0000 7f05ca59c640 1 -- 172.21.15.133:0/3226401651 learned_addr learned my addr 172.21.15.133:0/3226401651 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:26.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.348+0000 7f05cad9d640 1 --2- 172.21.15.133:0/3226401651 >> v2:172.21.15.138:3300/0 conn(0x7f05cc0c2bb0 0x7f05cc0a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:26.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.348+0000 7f05ca59c640 1 -- 172.21.15.133:0/3226401651 >> v2:172.21.15.138:3300/0 conn(0x7f05cc0c2bb0 msgr2=0x7f05cc0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:26.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.348+0000 7f05ca59c640 1 --2- 172.21.15.133:0/3226401651 >> v2:172.21.15.138:3300/0 conn(0x7f05cc0c2bb0 0x7f05cc0a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.348+0000 7f05ca59c640 1 -- 172.21.15.133:0/3226401651 >> v1:172.21.15.138:6789/0 conn(0x7f05cc0c4100 legacy=0x7f05cc0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:26.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.348+0000 7f05ca59c640 1 -- 172.21.15.133:0/3226401651 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc0c1310 con 0x7f05cc0c63c0 2023-12-19T19:02:26.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.348+0000 7f05cad9d640 1 --2- 172.21.15.133:0/3226401651 >> v2:172.21.15.138:3300/0 conn(0x7f05cc0c2bb0 0x7f05cc0a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:26.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.348+0000 7f05ca59c640 1 --2- 172.21.15.133:0/3226401651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05cc0c63c0 0x7f05cc0c06d0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0c4550 tx=0x7f05bc01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47804c0ad200aa79 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:26.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.348+0000 7f05c959a640 1 -- 172.21.15.133:0/3226401651 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc0aa3d0 con 0x7f05cc0c63c0 2023-12-19T19:02:26.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.348+0000 7f05c959a640 1 -- 172.21.15.133:0/3226401651 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc0ac620 con 0x7f05cc0c63c0 2023-12-19T19:02:26.355 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.348+0000 7f05c959a640 1 -- 172.21.15.133:0/3226401651 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc0ac9b0 con 0x7f05cc0c63c0 2023-12-19T19:02:26.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.352+0000 7f05d0817640 1 -- 172.21.15.133:0/3226401651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05cc0c63c0 msgr2=0x7f05cc0c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:26.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.352+0000 7f05d0817640 1 --2- 172.21.15.133:0/3226401651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05cc0c63c0 0x7f05cc0c06d0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0c4550 tx=0x7f05bc01c3a0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.352+0000 7f05d0817640 1 -- 172.21.15.133:0/3226401651 shutdown_connections 2023-12-19T19:02:26.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.352+0000 7f05d0817640 1 --2- 172.21.15.133:0/3226401651 >> v2:172.21.15.138:3300/0 conn(0x7f05cc0c2bb0 0x7f05cc0a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.352+0000 7f05d0817640 1 --2- 172.21.15.133:0/3226401651 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05cc0c63c0 0x7f05cc0c06d0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.352+0000 7f05d0817640 1 -- 172.21.15.133:0/3226401651 >> 172.21.15.133:0/3226401651 conn(0x7f05cc06a5b0 msgr2=0x7f05cc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:26.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.352+0000 7f05d0817640 1 -- 172.21.15.133:0/3226401651 shutdown_connections 2023-12-19T19:02:26.356 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.352+0000 7f05d0817640 1 -- 172.21.15.133:0/3226401651 wait complete. 2023-12-19T19:02:26.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.352+0000 7f05d0817640 1 Processor -- start 2023-12-19T19:02:26.357 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.352+0000 7f05d0817640 1 -- start start 2023-12-19T19:02:26.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.352+0000 7f05d0817640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05cc0c2bb0 0x7f05cc070c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:26.358 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.352+0000 7f05d0817640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05cc0c4100 0x7f05cc1f26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:26.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.352+0000 7f05d0817640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05cc0c63c0 0x7f05cc1f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:26.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.352+0000 7f05d0817640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc155510 con 0x7f05cc0c2bb0 2023-12-19T19:02:26.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.352+0000 7f05d0817640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc1f3150 con 0x7f05cc0c4100 2023-12-19T19:02:26.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.352+0000 7f05d0817640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05cc15df90 con 0x7f05cc0c63c0 2023-12-19T19:02:26.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.352+0000 7f05ca59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05cc0c2bb0 0x7f05cc070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:26.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.352+0000 7f05ca59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05cc0c2bb0 0x7f05cc070c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37380/0 (socket says 172.21.15.133:37380) 2023-12-19T19:02:26.359 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.352+0000 7f05ca59c640 1 -- 172.21.15.133:0/1127197274 learned_addr learned my addr 172.21.15.133:0/1127197274 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:26.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.356+0000 7f05ca59c640 1 -- 172.21.15.133:0/1127197274 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05cc0c63c0 msgr2=0x7f05cc1f2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:26.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.356+0000 7f05ca59c640 1 --2- 172.21.15.133:0/1127197274 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05cc0c63c0 0x7f05cc1f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.356+0000 7f05ca59c640 1 -- 172.21.15.133:0/1127197274 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05cc0c4100 msgr2=0x7f05cc1f26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:26.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.356+0000 7f05ca59c640 1 --2- 172.21.15.133:0/1127197274 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05cc0c4100 0x7f05cc1f26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.356+0000 7f05ca59c640 1 -- 172.21.15.133:0/1127197274 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05bc0094d0 con 0x7f05cc0c2bb0 2023-12-19T19:02:26.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.356+0000 7f05ca59c640 1 --2- 172.21.15.133:0/1127197274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05cc0c2bb0 0x7f05cc070c40 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0af040 tx=0x7f05bc01abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:26.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.356+0000 7f05baffd640 1 -- 172.21.15.133:0/1127197274 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc0b7620 con 0x7f05cc0c2bb0 2023-12-19T19:02:26.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.356+0000 7f05baffd640 1 -- 172.21.15.133:0/1127197274 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05bc0b77a0 con 0x7f05cc0c2bb0 2023-12-19T19:02:26.360 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.356+0000 7f05d0817640 1 -- 172.21.15.133:0/1127197274 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05cc15e270 con 0x7f05cc0c2bb0 2023-12-19T19:02:26.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.356+0000 7f05baffd640 1 -- 172.21.15.133:0/1127197274 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05bc0b7b50 con 0x7f05cc0c2bb0 2023-12-19T19:02:26.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.356+0000 7f05d0817640 1 -- 172.21.15.133:0/1127197274 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05cc15e830 con 0x7f05cc0c2bb0 2023-12-19T19:02:26.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.356+0000 7f05d0817640 1 -- 172.21.15.133:0/1127197274 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05cc15ea20 con 0x7f05cc0c2bb0 2023-12-19T19:02:26.361 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.356+0000 7f05baffd640 1 -- 172.21.15.133:0/1127197274 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f05bc0b3040 con 0x7f05cc0c2bb0 2023-12-19T19:02:26.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.356+0000 7f05baffd640 1 --2- 172.21.15.133:0/1127197274 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f05ac066470 0x7f05ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:26.362 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.356+0000 7f05baffd640 1 -- 172.21.15.133:0/1127197274 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f05bc11e360 con 0x7f05cc0c2bb0 2023-12-19T19:02:26.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.356+0000 7f05c9d9b640 1 --2- 172.21.15.133:0/1127197274 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f05ac066470 0x7f05ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:26.363 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.360+0000 7f05c9d9b640 1 --2- 172.21.15.133:0/1127197274 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f05ac066470 0x7f05ac068930 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f05c0007fd0 tx=0x7f05c00079a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:26.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.360+0000 7f05baffd640 1 -- 172.21.15.133:0/1127197274 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f05bc0eb890 con 0x7f05cc0c2bb0 2023-12-19T19:02:26.550 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.544+0000 7f05d0817640 1 -- 172.21.15.133:0/1127197274 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05cc15ea20 con 0x7f05cc0c2bb0 2023-12-19T19:02:26.551 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.548+0000 7f05baffd640 1 -- 172.21.15.133:0/1127197274 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4954 (secure 0 0 0) 0x7f05bc0eeeb0 con 0x7f05cc0c2bb0 2023-12-19T19:02:26.551 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:26.551 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/2119189888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":2119189888},{"type":"v1","addr":"172.21.15.133:6835","nonce":2119189888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/4005236173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":4005236173},{"type":"v1","addr":"172.21.15.138:6835","nonce":4005236173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7152,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/3920117238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3920117238},{"type":"v1","addr":"172.21.15.133:6834","nonce":3920117238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T19:01:53.054600+0000","modified":"2023-12-19T19:01:56.088450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5765},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5765":{"gid":5765,"name":"d","rank":0,"incarnation":49,"state":"up:active","state_seq":8,"addr":"172.21.15.138:6837/1466041773","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":1466041773},{"type":"v1","addr":"172.21.15.138:6837","nonce":1466041773}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-19T19:02:26.552 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 55 2023-12-19T19:02:26.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.548+0000 7f05d0817640 1 -- 172.21.15.133:0/1127197274 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f05ac066470 msgr2=0x7f05ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:26.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.548+0000 7f05d0817640 1 --2- 172.21.15.133:0/1127197274 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f05ac066470 0x7f05ac068930 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f05c0007fd0 tx=0x7f05c00079a0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.548+0000 7f05d0817640 1 -- 172.21.15.133:0/1127197274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05cc0c2bb0 msgr2=0x7f05cc070c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:26.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.548+0000 7f05d0817640 1 --2- 172.21.15.133:0/1127197274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05cc0c2bb0 0x7f05cc070c40 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f05bc0af040 tx=0x7f05bc01abe0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.548+0000 7f05d0817640 1 -- 172.21.15.133:0/1127197274 shutdown_connections 2023-12-19T19:02:26.553 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.548+0000 7f05d0817640 1 --2- 172.21.15.133:0/1127197274 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f05ac066470 0x7f05ac068930 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.548+0000 7f05d0817640 1 --2- 172.21.15.133:0/1127197274 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f05cc0c63c0 0x7f05cc1f2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.548+0000 7f05d0817640 1 --2- 172.21.15.133:0/1127197274 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f05cc0c4100 0x7f05cc1f26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.548+0000 7f05d0817640 1 --2- 172.21.15.133:0/1127197274 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f05cc0c2bb0 0x7f05cc070c40 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.548+0000 7f05d0817640 1 -- 172.21.15.133:0/1127197274 >> 172.21.15.133:0/1127197274 conn(0x7f05cc06a5b0 msgr2=0x7f05cc0a7260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:26.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.548+0000 7f05d0817640 1 -- 172.21.15.133:0/1127197274 shutdown_connections 2023-12-19T19:02:26.554 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.548+0000 7f05d0817640 1 -- 172.21.15.133:0/1127197274 wait complete. 2023-12-19T19:02:26.572 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:02:26.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.704+0000 7fb5e23f5640 1 Processor -- start 2023-12-19T19:02:26.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.704+0000 7fb5e23f5640 1 -- start start 2023-12-19T19:02:26.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.704+0000 7fb5e23f5640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb5dc151e90 0x7fb5dc0c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:26.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.708+0000 7fb5e23f5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fb5dc0c4e60 0x7fb5dc06bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:26.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.708+0000 7fb5e23f5640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5dc06c860 con 0x7fb5dc0c7ea0 2023-12-19T19:02:26.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.708+0000 7fb5e23f5640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5dc0c8750 con 0x7fb5dc151e90 2023-12-19T19:02:26.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.708+0000 7fb5e23f5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5dc1552d0 con 0x7fb5dc0c4e60 2023-12-19T19:02:26.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.708+0000 7fb5dbfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb5dc151e90 0x7fb5dc0c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:26.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.708+0000 7fb5dbfff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb5dc151e90 0x7fb5dc0c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37388/0 (socket says 172.21.15.133:37388) 2023-12-19T19:02:26.711 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.708+0000 7fb5dbfff640 1 -- 172.21.15.133:0/696530214 learned_addr learned my addr 172.21.15.133:0/696530214 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:26.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.708+0000 7fb5dbfff640 1 -- 172.21.15.133:0/696530214 >> v2:172.21.15.138:3300/0 conn(0x7fb5dc0c4e60 msgr2=0x7fb5dc06bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:26.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.708+0000 7fb5dbfff640 1 --2- 172.21.15.133:0/696530214 >> v2:172.21.15.138:3300/0 conn(0x7fb5dc0c4e60 0x7fb5dc06bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.708+0000 7fb5dbfff640 1 -- 172.21.15.133:0/696530214 >> v1:172.21.15.138:6789/0 conn(0x7fb5dc0c7ea0 legacy=0x7fb5dc06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:26.712 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.708+0000 7fb5dbfff640 1 -- 172.21.15.133:0/696530214 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc154930 con 0x7fb5dc151e90 2023-12-19T19:02:26.714 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.708+0000 7fb5dbfff640 1 --2- 172.21.15.133:0/696530214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5dc151e90 0x7fb5dc0c4920 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc08c190 tx=0x7fb5cc01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e626bbf25978b45 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:26.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.708+0000 7fb5daffd640 1 -- 172.21.15.133:0/696530214 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc0ab600 con 0x7fb5dc151e90 2023-12-19T19:02:26.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.708+0000 7fb5daffd640 1 -- 172.21.15.133:0/696530214 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5cc0a7050 con 0x7fb5dc151e90 2023-12-19T19:02:26.715 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.708+0000 7fb5daffd640 1 -- 172.21.15.133:0/696530214 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc0ab980 con 0x7fb5dc151e90 2023-12-19T19:02:26.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5e23f5640 1 -- 172.21.15.133:0/696530214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5dc151e90 msgr2=0x7fb5dc0c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:26.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5e23f5640 1 --2- 172.21.15.133:0/696530214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5dc151e90 0x7fb5dc0c4920 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc08c190 tx=0x7fb5cc01c3a0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5e23f5640 1 -- 172.21.15.133:0/696530214 shutdown_connections 2023-12-19T19:02:26.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5e23f5640 1 --2- 172.21.15.133:0/696530214 >> v2:172.21.15.138:3300/0 conn(0x7fb5dc0c4e60 0x7fb5dc06bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5e23f5640 1 --2- 172.21.15.133:0/696530214 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5dc151e90 0x7fb5dc0c4920 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5e23f5640 1 -- 172.21.15.133:0/696530214 >> 172.21.15.133:0/696530214 conn(0x7fb5dc0ca170 msgr2=0x7fb5dc0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:26.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5e23f5640 1 -- 172.21.15.133:0/696530214 shutdown_connections 2023-12-19T19:02:26.716 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5e23f5640 1 -- 172.21.15.133:0/696530214 wait complete. 2023-12-19T19:02:26.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5e23f5640 1 Processor -- start 2023-12-19T19:02:26.717 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5e23f5640 1 -- start start 2023-12-19T19:02:26.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5e23f5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5dc0c4e60 0x7fb5dc1457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:26.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5e23f5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5dc0c7ea0 0x7fb5dc0aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:26.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5e23f5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5dc151e90 0x7fb5dc0a9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:26.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5e23f5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0ac1a0 con 0x7fb5dc0c7ea0 2023-12-19T19:02:26.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5e23f5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0c3b70 con 0x7fb5dc0c4e60 2023-12-19T19:02:26.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5e23f5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc14edd0 con 0x7fb5dc151e90 2023-12-19T19:02:26.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5db7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5dc0c7ea0 0x7fb5dc0aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:26.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5db7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5dc0c7ea0 0x7fb5dc0aaf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37394/0 (socket says 172.21.15.133:37394) 2023-12-19T19:02:26.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5db7fe640 1 -- 172.21.15.133:0/4273532908 learned_addr learned my addr 172.21.15.133:0/4273532908 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:26.719 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5dbfff640 1 --2- 172.21.15.133:0/4273532908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5dc0c4e60 0x7fb5dc1457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:26.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5e0992640 1 --2- 172.21.15.133:0/4273532908 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5dc151e90 0x7fb5dc0a9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:26.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5db7fe640 1 -- 172.21.15.133:0/4273532908 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5dc151e90 msgr2=0x7fb5dc0a9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:26.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5db7fe640 1 --2- 172.21.15.133:0/4273532908 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5dc151e90 0x7fb5dc0a9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5db7fe640 1 -- 172.21.15.133:0/4273532908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5dc0c4e60 msgr2=0x7fb5dc1457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:26.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5db7fe640 1 --2- 172.21.15.133:0/4273532908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5dc0c4e60 0x7fb5dc1457d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.712+0000 7fb5db7fe640 1 -- 172.21.15.133:0/4273532908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5cc0094d0 con 0x7fb5dc0c7ea0 2023-12-19T19:02:26.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.716+0000 7fb5dbfff640 1 --2- 172.21.15.133:0/4273532908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5dc0c4e60 0x7fb5dc1457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:26.720 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.716+0000 7fb5db7fe640 1 --2- 172.21.15.133:0/4273532908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5dc0c7ea0 0x7fb5dc0aaf10 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fb5d000b3e0 tx=0x7fb5d000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:26.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.716+0000 7fb5d8ff9640 1 -- 172.21.15.133:0/4273532908 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0011830 con 0x7fb5dc0c7ea0 2023-12-19T19:02:26.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.716+0000 7fb5d8ff9640 1 -- 172.21.15.133:0/4273532908 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d00119b0 con 0x7fb5dc0c7ea0 2023-12-19T19:02:26.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.716+0000 7fb5e23f5640 1 -- 172.21.15.133:0/4273532908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5dc14f0b0 con 0x7fb5dc0c7ea0 2023-12-19T19:02:26.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.716+0000 7fb5d8ff9640 1 -- 172.21.15.133:0/4273532908 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d0011d60 con 0x7fb5dc0c7ea0 2023-12-19T19:02:26.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.716+0000 7fb5e23f5640 1 -- 172.21.15.133:0/4273532908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5dc13cea0 con 0x7fb5dc0c7ea0 2023-12-19T19:02:26.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.716+0000 7fb5e23f5640 1 -- 172.21.15.133:0/4273532908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5dc068400 con 0x7fb5dc0c7ea0 2023-12-19T19:02:26.721 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.716+0000 7fb5d8ff9640 1 -- 172.21.15.133:0/4273532908 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fb5d001a400 con 0x7fb5dc0c7ea0 2023-12-19T19:02:26.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.716+0000 7fb5d8ff9640 1 --2- 172.21.15.133:0/4273532908 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb5c8066470 0x7fb5c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:26.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.716+0000 7fb5d8ff9640 1 -- 172.21.15.133:0/4273532908 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fb5d0083f50 con 0x7fb5dc0c7ea0 2023-12-19T19:02:26.722 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.716+0000 7fb5dbfff640 1 --2- 172.21.15.133:0/4273532908 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb5c8066470 0x7fb5c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:26.723 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.720+0000 7fb5dbfff640 1 --2- 172.21.15.133:0/4273532908 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb5c8066470 0x7fb5c8068930 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc0ad000 tx=0x7fb5cc0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:26.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.720+0000 7fb5d8ff9640 1 -- 172.21.15.133:0/4273532908 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fb5d0051400 con 0x7fb5dc0c7ea0 2023-12-19T19:02:26.877 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.872+0000 7fb5e23f5640 1 -- 172.21.15.133:0/4273532908 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5dc066ff0 con 0x7fb5dc0c7ea0 2023-12-19T19:02:26.878 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.872+0000 7fb5d8ff9640 1 -- 172.21.15.133:0/4273532908 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16679 (secure 0 0 0) 0x7fb5d0015090 con 0x7fb5dc0c7ea0 2023-12-19T19:02:26.878 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:26.878 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":76,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:02:23.778994+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2023-12-19T19:01:50.875086+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2023-12-19T19:01:52.061232+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"73","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.133:6834/2813206606":"2023-12-20T19:02:20.729934+0000","172.21.15.133:6832/2813206606":"2023-12-20T19:02:20.729934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:02:26.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.876+0000 7fb5e23f5640 1 -- 172.21.15.133:0/4273532908 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb5c8066470 msgr2=0x7fb5c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:26.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.876+0000 7fb5e23f5640 1 --2- 172.21.15.133:0/4273532908 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb5c8066470 0x7fb5c8068930 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc0ad000 tx=0x7fb5cc0a6000 comp rx=0 tx=0).stop 2023-12-19T19:02:26.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.876+0000 7fb5e23f5640 1 -- 172.21.15.133:0/4273532908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5dc0c7ea0 msgr2=0x7fb5dc0aaf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:26.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.876+0000 7fb5e23f5640 1 --2- 172.21.15.133:0/4273532908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5dc0c7ea0 0x7fb5dc0aaf10 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fb5d000b3e0 tx=0x7fb5d000b8a0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.880 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.876+0000 7fb5e23f5640 1 -- 172.21.15.133:0/4273532908 shutdown_connections 2023-12-19T19:02:26.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.876+0000 7fb5e23f5640 1 --2- 172.21.15.133:0/4273532908 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fb5c8066470 0x7fb5c8068930 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.876+0000 7fb5e23f5640 1 --2- 172.21.15.133:0/4273532908 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fb5dc151e90 0x7fb5dc0a9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.876+0000 7fb5e23f5640 1 --2- 172.21.15.133:0/4273532908 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb5dc0c7ea0 0x7fb5dc0aaf10 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.876+0000 7fb5e23f5640 1 --2- 172.21.15.133:0/4273532908 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fb5dc0c4e60 0x7fb5dc1457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:26.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.876+0000 7fb5e23f5640 1 -- 172.21.15.133:0/4273532908 >> 172.21.15.133:0/4273532908 conn(0x7fb5dc0ca170 msgr2=0x7fb5dc06bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:26.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.876+0000 7fb5e23f5640 1 -- 172.21.15.133:0/4273532908 shutdown_connections 2023-12-19T19:02:26.881 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:26.876+0000 7fb5e23f5640 1 -- 172.21.15.133:0/4273532908 wait complete. 2023-12-19T19:02:26.900 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2023-12-19T19:02:27.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd78e7e6640 1 Processor -- start 2023-12-19T19:02:27.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd78e7e6640 1 -- start start 2023-12-19T19:02:27.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd78e7e6640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd7880c5640 0x7fd7880c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:27.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd78e7e6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd7880c60f0 0x7fd788155de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:27.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd78e7e6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7880c2580 con 0x7fd7880c5260 2023-12-19T19:02:27.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd78e7e6640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd788153510 con 0x7fd7880c5640 2023-12-19T19:02:27.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd78e7e6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7880c17f0 con 0x7fd7880c60f0 2023-12-19T19:02:27.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd787fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd7880c5260 0x7fd78806d5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43804/0 (socket says 172.21.15.133:43804) 2023-12-19T19:02:27.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd787fff640 1 -- 172.21.15.133:0/2858729253 learned_addr learned my addr 172.21.15.133:0/2858729253 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:27.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd786ffd640 1 -- 172.21.15.133:0/2858729253 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1745348007 0 0) 0x7fd7880c2580 con 0x7fd7880c5260 2023-12-19T19:02:27.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd78cd83640 1 --2- 172.21.15.133:0/2858729253 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd7880c60f0 0x7fd788155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:27.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd7877fe640 1 --2- 172.21.15.133:0/2858729253 >> v2:172.21.15.138:3300/0 conn(0x7fd7880c5640 0x7fd7880c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:27.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd786ffd640 1 -- 172.21.15.133:0/2858729253 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd770003530 con 0x7fd7880c5260 2023-12-19T19:02:27.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd786ffd640 1 -- 172.21.15.133:0/2858729253 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3927461462 0 0) 0x7fd770003530 con 0x7fd7880c5260 2023-12-19T19:02:27.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd786ffd640 1 -- 172.21.15.133:0/2858729253 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd7880c60f0 msgr2=0x7fd788155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:27.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd786ffd640 1 --2- 172.21.15.133:0/2858729253 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd7880c60f0 0x7fd788155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:27.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd786ffd640 1 -- 172.21.15.133:0/2858729253 >> v2:172.21.15.138:3300/0 conn(0x7fd7880c5640 msgr2=0x7fd7880c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd786ffd640 1 --2- 172.21.15.133:0/2858729253 >> v2:172.21.15.138:3300/0 conn(0x7fd7880c5640 0x7fd7880c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd786ffd640 1 -- 172.21.15.133:0/2858729253 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7880c1a00 con 0x7fd7880c5260 2023-12-19T19:02:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd786ffd640 1 -- 172.21.15.133:0/2858729253 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7fd778001680 con 0x7fd7880c5260 2023-12-19T19:02:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd786ffd640 1 -- 172.21.15.133:0/2858729253 >> v1:172.21.15.133:6789/0 conn(0x7fd7880c5260 legacy=0x7fd78806d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd786ffd640 1 --2- 172.21.15.133:0/2858729253 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd770003980 0x7fd770003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd786ffd640 1 --2- 172.21.15.133:0/2858729253 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd7880c60f0 0x7fd7700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd786ffd640 1 --2- 172.21.15.133:0/2858729253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd770004d10 0x7fd770005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd786ffd640 1 -- 172.21.15.133:0/2858729253 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7880c17f0 con 0x7fd770004d10 2023-12-19T19:02:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd786ffd640 1 -- 172.21.15.133:0/2858729253 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd77000b990 con 0x7fd770003980 2023-12-19T19:02:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd786ffd640 1 -- 172.21.15.133:0/2858729253 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd77000bb00 con 0x7fd7880c60f0 2023-12-19T19:02:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd787fff640 1 --2- 172.21.15.133:0/2858729253 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd770003980 0x7fd770003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd78cd83640 1 --2- 172.21.15.133:0/2858729253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd770004d10 0x7fd770005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd7877fe640 1 --2- 172.21.15.133:0/2858729253 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd7880c60f0 0x7fd7700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:27.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd78cd83640 1 -- 172.21.15.133:0/2858729253 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd7880c60f0 msgr2=0x7fd7700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:27.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd78cd83640 1 --2- 172.21.15.133:0/2858729253 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd7880c60f0 0x7fd7700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:27.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd78cd83640 1 -- 172.21.15.133:0/2858729253 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd770003980 msgr2=0x7fd770003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:27.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd78cd83640 1 --2- 172.21.15.133:0/2858729253 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd770003980 0x7fd770003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:27.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd78cd83640 1 -- 172.21.15.133:0/2858729253 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd770003530 con 0x7fd770004d10 2023-12-19T19:02:27.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.036+0000 7fd787fff640 1 --2- 172.21.15.133:0/2858729253 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd770003980 0x7fd770003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:02:27.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.040+0000 7fd78cd83640 1 --2- 172.21.15.133:0/2858729253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd770004d10 0x7fd770005190 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fd780009fc0 tx=0x7fd78001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf4f7d14f9fe354 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:27.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.040+0000 7fd786ffd640 1 -- 172.21.15.133:0/2858729253 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7800a5b60 con 0x7fd770004d10 2023-12-19T19:02:27.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.040+0000 7fd786ffd640 1 -- 172.21.15.133:0/2858729253 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78000f040 con 0x7fd770004d10 2023-12-19T19:02:27.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.040+0000 7fd786ffd640 1 -- 172.21.15.133:0/2858729253 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7800ad440 con 0x7fd770004d10 2023-12-19T19:02:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.040+0000 7fd78e7e6640 1 -- 172.21.15.133:0/2858729253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd770004d10 msgr2=0x7fd770005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.040+0000 7fd78e7e6640 1 --2- 172.21.15.133:0/2858729253 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd770004d10 0x7fd770005190 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fd780009fc0 tx=0x7fd78001cc60 comp rx=0 tx=0).stop 2023-12-19T19:02:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.040+0000 7fd78cd83640 1 -- 172.21.15.133:0/2858729253 reap_dead start 2023-12-19T19:02:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.040+0000 7fd78e7e6640 1 -- 172.21.15.133:0/2858729253 shutdown_connections 2023-12-19T19:02:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.040+0000 7fd78e7e6640 1 -- 172.21.15.133:0/2858729253 >> 172.21.15.133:0/2858729253 conn(0x7fd78806a5b0 msgr2=0x7fd78806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.040+0000 7fd78e7e6640 1 -- 172.21.15.133:0/2858729253 shutdown_connections 2023-12-19T19:02:27.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.040+0000 7fd78e7e6640 1 -- 172.21.15.133:0/2858729253 wait complete. 2023-12-19T19:02:27.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd78e7e6640 1 Processor -- start 2023-12-19T19:02:27.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd78e7e6640 1 -- start start 2023-12-19T19:02:27.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd78e7e6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd770004d10 0x7fd788071880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:27.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd78e7e6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd788071dc0 0x7fd7881ebdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:27.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd78e7e6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7880a9dc0 0x7fd7881ec310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:27.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd78e7e6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7881eb9b0 con 0x7fd788071dc0 2023-12-19T19:02:27.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd78e7e6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7880aa640 con 0x7fd7880a9dc0 2023-12-19T19:02:27.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd78e7e6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7880aa360 con 0x7fd770004d10 2023-12-19T19:02:27.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd7877fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd788071dc0 0x7fd7881ebdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:27.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd7877fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd788071dc0 0x7fd7881ebdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37404/0 (socket says 172.21.15.133:37404) 2023-12-19T19:02:27.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd7877fe640 1 -- 172.21.15.133:0/4278204913 learned_addr learned my addr 172.21.15.133:0/4278204913 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:27.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd787fff640 1 --2- 172.21.15.133:0/4278204913 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd770004d10 0x7fd788071880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:27.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd78cd83640 1 --2- 172.21.15.133:0/4278204913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7880a9dc0 0x7fd7881ec310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:27.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd7877fe640 1 -- 172.21.15.133:0/4278204913 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd770004d10 msgr2=0x7fd788071880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:27.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd7877fe640 1 --2- 172.21.15.133:0/4278204913 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd770004d10 0x7fd788071880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:27.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd7877fe640 1 -- 172.21.15.133:0/4278204913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7880a9dc0 msgr2=0x7fd7881ec310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:27.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd7877fe640 1 --2- 172.21.15.133:0/4278204913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7880a9dc0 0x7fd7881ec310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:27.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd7877fe640 1 -- 172.21.15.133:0/4278204913 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7881eb2f0 con 0x7fd788071dc0 2023-12-19T19:02:27.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd7877fe640 1 --2- 172.21.15.133:0/4278204913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd788071dc0 0x7fd7881ebdd0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0119b0 tx=0x7fd77c011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:27.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd784ff9640 1 -- 172.21.15.133:0/4278204913 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c004240 con 0x7fd788071dc0 2023-12-19T19:02:27.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd784ff9640 1 -- 172.21.15.133:0/4278204913 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77c0043a0 con 0x7fd788071dc0 2023-12-19T19:02:27.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd784ff9640 1 -- 172.21.15.133:0/4278204913 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c00fa40 con 0x7fd788071dc0 2023-12-19T19:02:27.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd78e7e6640 1 -- 172.21.15.133:0/4278204913 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7881eb5d0 con 0x7fd788071dc0 2023-12-19T19:02:27.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.044+0000 7fd78e7e6640 1 -- 172.21.15.133:0/4278204913 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7881eca20 con 0x7fd788071dc0 2023-12-19T19:02:27.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.048+0000 7fd78e7e6640 1 -- 172.21.15.133:0/4278204913 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7881ebaf0 con 0x7fd788071dc0 2023-12-19T19:02:27.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.048+0000 7fd784ff9640 1 -- 172.21.15.133:0/4278204913 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd77c00fba0 con 0x7fd788071dc0 2023-12-19T19:02:27.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.048+0000 7fd784ff9640 1 --2- 172.21.15.133:0/4278204913 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd774066470 0x7fd774068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:27.053 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.048+0000 7fd784ff9640 1 -- 172.21.15.133:0/4278204913 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fd77c084560 con 0x7fd788071dc0 2023-12-19T19:02:27.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.048+0000 7fd787fff640 1 --2- 172.21.15.133:0/4278204913 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd774066470 0x7fd774068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:27.054 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.048+0000 7fd787fff640 1 --2- 172.21.15.133:0/4278204913 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd774066470 0x7fd774068930 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd778000c10 tx=0x7fd778007900 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:27.057 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.052+0000 7fd784ff9640 1 -- 172.21.15.133:0/4278204913 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fd7881ebaf0 con 0x7fd788071dc0 2023-12-19T19:02:27.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.232+0000 7fd78e7e6640 1 -- 172.21.15.133:0/4278204913 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7fd7881ebaf0 con 0x7fd788071dc0 2023-12-19T19:02:27.238 INFO:tasks.ceph.mon.a.smithi133.stderr:2023-12-19T19:02:27.232+0000 7f5189f85640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T19:02:27.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.236+0000 7fd784ff9640 1 -- 172.21.15.133:0/4278204913 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) v1 ==== 163+0+0 (secure 0 0 0) 0x7fd7881ebaf0 con 0x7fd788071dc0 2023-12-19T19:02:27.241 INFO:teuthology.orchestra.run.smithi133.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T19:02:27.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.240+0000 7fd78e7e6640 1 -- 172.21.15.133:0/4278204913 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd774066470 msgr2=0x7fd774068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:27.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.240+0000 7fd78e7e6640 1 --2- 172.21.15.133:0/4278204913 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd774066470 0x7fd774068930 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd778000c10 tx=0x7fd778007900 comp rx=0 tx=0).stop 2023-12-19T19:02:27.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.240+0000 7fd78e7e6640 1 -- 172.21.15.133:0/4278204913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd788071dc0 msgr2=0x7fd7881ebdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:27.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.240+0000 7fd78e7e6640 1 --2- 172.21.15.133:0/4278204913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd788071dc0 0x7fd7881ebdd0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fd77c0119b0 tx=0x7fd77c011db0 comp rx=0 tx=0).stop 2023-12-19T19:02:27.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.240+0000 7fd78e7e6640 1 -- 172.21.15.133:0/4278204913 shutdown_connections 2023-12-19T19:02:27.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.240+0000 7fd78e7e6640 1 --2- 172.21.15.133:0/4278204913 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd774066470 0x7fd774068930 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:27.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.240+0000 7fd78e7e6640 1 --2- 172.21.15.133:0/4278204913 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd7880a9dc0 0x7fd7881ec310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:27.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.240+0000 7fd78e7e6640 1 --2- 172.21.15.133:0/4278204913 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd788071dc0 0x7fd7881ebdd0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:27.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.240+0000 7fd78e7e6640 1 --2- 172.21.15.133:0/4278204913 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd770004d10 0x7fd788071880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:27.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.240+0000 7fd78e7e6640 1 -- 172.21.15.133:0/4278204913 >> 172.21.15.133:0/4278204913 conn(0x7fd78806a5b0 msgr2=0x7fd7881dba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:27.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.240+0000 7fd78e7e6640 1 -- 172.21.15.133:0/4278204913 shutdown_connections 2023-12-19T19:02:27.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.240+0000 7fd78e7e6640 1 -- 172.21.15.133:0/4278204913 wait complete. 2023-12-19T19:02:27.254 INFO:tasks.ceph.mds.d.smithi138.stderr: -4581> 2023-12-19T19:01:54.952+0000 7f0e750e5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T19:02:27.264 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2023-12-19T19:02:27.307 INFO:tasks.ceph.mds.d.smithi138.stdout:starting mds.d at 2023-12-19T19:02:27.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.400+0000 7fc081cbb640 1 Processor -- start 2023-12-19T19:02:27.406 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.400+0000 7fc081cbb640 1 -- start start 2023-12-19T19:02:27.407 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.404+0000 7fc081cbb640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc07c0c63c0 0x7fc07c0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:27.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.404+0000 7fc081cbb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc07c0c4100 0x7fc07c0c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:27.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.404+0000 7fc081cbb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc07c0c31c0 con 0x7fc07c0c29e0 2023-12-19T19:02:27.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.404+0000 7fc081cbb640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc07c0c34a0 con 0x7fc07c0c63c0 2023-12-19T19:02:27.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.404+0000 7fc081cbb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c0c1030 con 0x7fc07c0c4100 2023-12-19T19:02:27.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.404+0000 7fc07b7fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc07c0c63c0 0x7fc07c0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:27.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.404+0000 7fc07affd640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc07c0c4100 0x7fc07c0c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:27.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.404+0000 7fc07b7fe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc07c0c63c0 0x7fc07c0c06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:33784/0 (socket says 172.21.15.133:33784) 2023-12-19T19:02:27.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.404+0000 7fc07b7fe640 1 -- 172.21.15.133:0/3721674424 learned_addr learned my addr 172.21.15.133:0/3721674424 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:27.408 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.404+0000 7fc07bfff640 1 --1- 172.21.15.133:0/3721674424 >> v1:172.21.15.138:6789/0 conn(0x7fc07c0c29e0 0x7fc07c0a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:33954/0 (socket says 172.21.15.133:33954) 2023-12-19T19:02:27.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.404+0000 7fc07a7fc640 1 -- 172.21.15.133:0/3721674424 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172483887 0 0) 0x7fc07c0c31c0 con 0x7fc07c0c29e0 2023-12-19T19:02:27.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.404+0000 7fc07b7fe640 1 -- 172.21.15.133:0/3721674424 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc07c0c4100 msgr2=0x7fc07c0c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:27.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.404+0000 7fc07b7fe640 1 --2- 172.21.15.133:0/3721674424 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc07c0c4100 0x7fc07c0c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:27.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.404+0000 7fc07b7fe640 1 -- 172.21.15.133:0/3721674424 >> v1:172.21.15.138:6789/0 conn(0x7fc07c0c29e0 legacy=0x7fc07c0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:27.409 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.404+0000 7fc07b7fe640 1 -- 172.21.15.133:0/3721674424 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc07c0c1310 con 0x7fc07c0c63c0 2023-12-19T19:02:27.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.404+0000 7fc07b7fe640 1 --2- 172.21.15.133:0/3721674424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc07c0c63c0 0x7fc07c0c06d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc06c009870 tx=0x7fc06c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21b8932732a82429 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:27.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc07a7fc640 1 -- 172.21.15.133:0/3721674424 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c0ab610 con 0x7fc07c0c63c0 2023-12-19T19:02:27.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc07a7fc640 1 -- 172.21.15.133:0/3721674424 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c0ab770 con 0x7fc07c0c63c0 2023-12-19T19:02:27.411 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc07a7fc640 1 -- 172.21.15.133:0/3721674424 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c0abb00 con 0x7fc07c0c63c0 2023-12-19T19:02:27.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc081cbb640 1 -- 172.21.15.133:0/3721674424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc07c0c63c0 msgr2=0x7fc07c0c06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:27.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc081cbb640 1 --2- 172.21.15.133:0/3721674424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc07c0c63c0 0x7fc07c0c06d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc06c009870 tx=0x7fc06c01c3f0 comp rx=0 tx=0).stop 2023-12-19T19:02:27.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc081cbb640 1 -- 172.21.15.133:0/3721674424 shutdown_connections 2023-12-19T19:02:27.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc081cbb640 1 --2- 172.21.15.133:0/3721674424 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc07c0c4100 0x7fc07c0c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:27.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc081cbb640 1 --2- 172.21.15.133:0/3721674424 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc07c0c63c0 0x7fc07c0c06d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:27.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc081cbb640 1 -- 172.21.15.133:0/3721674424 >> 172.21.15.133:0/3721674424 conn(0x7fc07c06a5b0 msgr2=0x7fc07c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:27.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc081cbb640 1 -- 172.21.15.133:0/3721674424 shutdown_connections 2023-12-19T19:02:27.412 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc081cbb640 1 -- 172.21.15.133:0/3721674424 wait complete. 2023-12-19T19:02:27.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc081cbb640 1 Processor -- start 2023-12-19T19:02:27.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc081cbb640 1 -- start start 2023-12-19T19:02:27.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc081cbb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc07c0c29e0 0x7fc07c151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:27.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc081cbb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc07c0c4100 0x7fc07c0a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:27.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc081cbb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc07c0c63c0 0x7fc07c13fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:27.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc081cbb640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c158030 con 0x7fc07c0c29e0 2023-12-19T19:02:27.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc081cbb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c156860 con 0x7fc07c0c63c0 2023-12-19T19:02:27.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc081cbb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07c156ad0 con 0x7fc07c0c4100 2023-12-19T19:02:27.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc07b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc07c0c29e0 0x7fc07c151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:27.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc07b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc07c0c29e0 0x7fc07c151690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37414/0 (socket says 172.21.15.133:37414) 2023-12-19T19:02:27.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc07b7fe640 1 -- 172.21.15.133:0/2639500960 learned_addr learned my addr 172.21.15.133:0/2639500960 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:27.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc07bfff640 1 --2- 172.21.15.133:0/2639500960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc07c0c63c0 0x7fc07c13fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:27.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.408+0000 7fc07affd640 1 --2- 172.21.15.133:0/2639500960 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc07c0c4100 0x7fc07c0a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:27.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.412+0000 7fc07b7fe640 1 -- 172.21.15.133:0/2639500960 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc07c0c4100 msgr2=0x7fc07c0a59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:27.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.412+0000 7fc07b7fe640 1 --2- 172.21.15.133:0/2639500960 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc07c0c4100 0x7fc07c0a59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:27.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.412+0000 7fc07b7fe640 1 -- 172.21.15.133:0/2639500960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc07c0c63c0 msgr2=0x7fc07c13fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:27.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.412+0000 7fc07b7fe640 1 --2- 172.21.15.133:0/2639500960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc07c0c63c0 0x7fc07c13fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:27.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.412+0000 7fc07b7fe640 1 -- 172.21.15.133:0/2639500960 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06c0094d0 con 0x7fc07c0c29e0 2023-12-19T19:02:27.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.412+0000 7fc07bfff640 1 --2- 172.21.15.133:0/2639500960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc07c0c63c0 0x7fc07c13fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:02:27.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.412+0000 7fc07b7fe640 1 --2- 172.21.15.133:0/2639500960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc07c0c29e0 0x7fc07c151690 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fc06c01aaa0 tx=0x7fc06c01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:27.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.412+0000 7fc063fff640 1 -- 172.21.15.133:0/2639500960 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c0be5f0 con 0x7fc07c0c29e0 2023-12-19T19:02:27.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.412+0000 7fc063fff640 1 -- 172.21.15.133:0/2639500960 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c0be770 con 0x7fc07c0c29e0 2023-12-19T19:02:27.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.412+0000 7fc063fff640 1 -- 172.21.15.133:0/2639500960 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06c0beb20 con 0x7fc07c0c29e0 2023-12-19T19:02:27.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.412+0000 7fc081cbb640 1 -- 172.21.15.133:0/2639500960 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc07c0a5f30 con 0x7fc07c0c29e0 2023-12-19T19:02:27.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.412+0000 7fc081cbb640 1 -- 172.21.15.133:0/2639500960 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07c156fe0 con 0x7fc07c0c29e0 2023-12-19T19:02:27.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.412+0000 7fc081cbb640 1 -- 172.21.15.133:0/2639500960 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc07c156cf0 con 0x7fc07c0c29e0 2023-12-19T19:02:27.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.412+0000 7fc063fff640 1 -- 172.21.15.133:0/2639500960 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc06c0b4600 con 0x7fc07c0c29e0 2023-12-19T19:02:27.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.416+0000 7fc063fff640 1 --2- 172.21.15.133:0/2639500960 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc068066470 0x7fc068068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:27.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.416+0000 7fc063fff640 1 -- 172.21.15.133:0/2639500960 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5885+0+0 (secure 0 0 0) 0x7fc06c11eea0 con 0x7fc07c0c29e0 2023-12-19T19:02:27.419 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.416+0000 7fc07affd640 1 --2- 172.21.15.133:0/2639500960 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc068066470 0x7fc068068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:27.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.416+0000 7fc07affd640 1 --2- 172.21.15.133:0/2639500960 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc068066470 0x7fc068068930 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0a53e0 tx=0x7fc070009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:27.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.420+0000 7fc063fff640 1 -- 172.21.15.133:0/2639500960 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc06c0ec320 con 0x7fc07c0c29e0 2023-12-19T19:02:27.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:27.600+0000 7fc081cbb640 1 -- 172.21.15.133:0/2639500960 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc07c068400 con 0x7fc07c0c29e0 2023-12-19T19:02:28.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.240+0000 7fc063fff640 1 -- 172.21.15.133:0/2639500960 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v57) v1 ==== 105+0+0 (secure 0 0 0) 0x7fc06c0ef940 con 0x7fc07c0c29e0 2023-12-19T19:02:28.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.240+0000 7fc081cbb640 1 -- 172.21.15.133:0/2639500960 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc068066470 msgr2=0x7fc068068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:28.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.240+0000 7fc081cbb640 1 --2- 172.21.15.133:0/2639500960 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc068066470 0x7fc068068930 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0a53e0 tx=0x7fc070009190 comp rx=0 tx=0).stop 2023-12-19T19:02:28.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.240+0000 7fc081cbb640 1 -- 172.21.15.133:0/2639500960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc07c0c29e0 msgr2=0x7fc07c151690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:28.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.240+0000 7fc081cbb640 1 --2- 172.21.15.133:0/2639500960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc07c0c29e0 0x7fc07c151690 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fc06c01aaa0 tx=0x7fc06c01ac30 comp rx=0 tx=0).stop 2023-12-19T19:02:28.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.240+0000 7fc081cbb640 1 -- 172.21.15.133:0/2639500960 shutdown_connections 2023-12-19T19:02:28.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.240+0000 7fc081cbb640 1 --2- 172.21.15.133:0/2639500960 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc068066470 0x7fc068068930 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:28.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.240+0000 7fc081cbb640 1 --2- 172.21.15.133:0/2639500960 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc07c0c63c0 0x7fc07c13fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:28.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.240+0000 7fc081cbb640 1 --2- 172.21.15.133:0/2639500960 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc07c0c4100 0x7fc07c0a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:28.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.240+0000 7fc081cbb640 1 --2- 172.21.15.133:0/2639500960 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc07c0c29e0 0x7fc07c151690 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:28.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.240+0000 7fc081cbb640 1 -- 172.21.15.133:0/2639500960 >> 172.21.15.133:0/2639500960 conn(0x7fc07c06a5b0 msgr2=0x7fc07c15b010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:28.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.240+0000 7fc081cbb640 1 -- 172.21.15.133:0/2639500960 shutdown_connections 2023-12-19T19:02:28.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.240+0000 7fc081cbb640 1 -- 172.21.15.133:0/2639500960 wait complete. 2023-12-19T19:02:28.267 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2023-12-19T19:02:28.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.404+0000 7f8eaf780640 1 Processor -- start 2023-12-19T19:02:28.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.404+0000 7f8eaf780640 1 -- start start 2023-12-19T19:02:28.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.408+0000 7f8eaf780640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8ea814dca0 0x7f8ea80c2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:28.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.408+0000 7f8eaf780640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f8ea8153db0 0x7f8ea8154220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:28.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.408+0000 7f8eaf780640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea806a5b0 con 0x7f8ea80c0f30 2023-12-19T19:02:28.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.408+0000 7f8eaf780640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea80c2740 con 0x7f8ea814dca0 2023-12-19T19:02:28.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.408+0000 7f8eaf780640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea814e080 con 0x7f8ea8153db0 2023-12-19T19:02:28.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.408+0000 7f8ead51c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8ea814dca0 0x7f8ea80c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:28.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.408+0000 7f8ead51c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8ea814dca0 0x7f8ea80c2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37416/0 (socket says 172.21.15.133:37416) 2023-12-19T19:02:28.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.408+0000 7f8ead51c640 1 -- 172.21.15.133:0/3973988851 learned_addr learned my addr 172.21.15.133:0/3973988851 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:28.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.408+0000 7f8eadd1d640 1 --2- 172.21.15.133:0/3973988851 >> v2:172.21.15.138:3300/0 conn(0x7f8ea8153db0 0x7f8ea8154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:28.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.408+0000 7f8ead51c640 1 -- 172.21.15.133:0/3973988851 >> v2:172.21.15.138:3300/0 conn(0x7f8ea8153db0 msgr2=0x7f8ea8154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:28.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.408+0000 7f8ead51c640 1 --2- 172.21.15.133:0/3973988851 >> v2:172.21.15.138:3300/0 conn(0x7f8ea8153db0 0x7f8ea8154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:28.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.408+0000 7f8ead51c640 1 -- 172.21.15.133:0/3973988851 >> v1:172.21.15.138:6789/0 conn(0x7f8ea80c0f30 legacy=0x7f8ea8070aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:28.414 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.408+0000 7f8ead51c640 1 -- 172.21.15.133:0/3973988851 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea80c29e0 con 0x7f8ea814dca0 2023-12-19T19:02:28.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.412+0000 7f8ead51c640 1 --2- 172.21.15.133:0/3973988851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea814dca0 0x7f8ea80c2200 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8151760 tx=0x7f8ea401d440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0610d2de5e2b99 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:28.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.412+0000 7f8e9ffff640 1 -- 172.21.15.133:0/3973988851 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40089e0 con 0x7f8ea814dca0 2023-12-19T19:02:28.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.412+0000 7f8e9ffff640 1 -- 172.21.15.133:0/3973988851 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea4008b40 con 0x7f8ea814dca0 2023-12-19T19:02:28.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.412+0000 7f8e9ffff640 1 -- 172.21.15.133:0/3973988851 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea400a0d0 con 0x7f8ea814dca0 2023-12-19T19:02:28.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.412+0000 7f8eaf780640 1 -- 172.21.15.133:0/3973988851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea814dca0 msgr2=0x7f8ea80c2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:28.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.412+0000 7f8eaf780640 1 --2- 172.21.15.133:0/3973988851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea814dca0 0x7f8ea80c2200 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8151760 tx=0x7f8ea401d440 comp rx=0 tx=0).stop 2023-12-19T19:02:28.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.412+0000 7f8eaf780640 1 -- 172.21.15.133:0/3973988851 shutdown_connections 2023-12-19T19:02:28.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.412+0000 7f8eaf780640 1 --2- 172.21.15.133:0/3973988851 >> v2:172.21.15.138:3300/0 conn(0x7f8ea8153db0 0x7f8ea8154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:28.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.412+0000 7f8eaf780640 1 --2- 172.21.15.133:0/3973988851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea814dca0 0x7f8ea80c2200 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:28.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.412+0000 7f8eaf780640 1 -- 172.21.15.133:0/3973988851 >> 172.21.15.133:0/3973988851 conn(0x7f8ea80a8ad0 msgr2=0x7f8ea80c6240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:28.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.412+0000 7f8eaf780640 1 -- 172.21.15.133:0/3973988851 shutdown_connections 2023-12-19T19:02:28.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.412+0000 7f8eaf780640 1 -- 172.21.15.133:0/3973988851 wait complete. 2023-12-19T19:02:28.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.412+0000 7f8eaf780640 1 Processor -- start 2023-12-19T19:02:28.418 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.412+0000 7f8eaf780640 1 -- start start 2023-12-19T19:02:28.420 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8eaf780640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8ea80c0f30 0x7f8ea81f1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:28.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8eaf780640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ea814dca0 0x7f8ea80c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:28.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8eaf780640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea8153db0 0x7f8ea81ee6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:28.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8eaf780640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea8150b10 con 0x7f8ea8153db0 2023-12-19T19:02:28.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8eaf780640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea81edc10 con 0x7f8ea814dca0 2023-12-19T19:02:28.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8eaf780640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea81ede20 con 0x7f8ea80c0f30 2023-12-19T19:02:28.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8eadd1d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea8153db0 0x7f8ea81ee6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:28.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8eadd1d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea8153db0 0x7f8ea81ee6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37424/0 (socket says 172.21.15.133:37424) 2023-12-19T19:02:28.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8eadd1d640 1 -- 172.21.15.133:0/4015982626 learned_addr learned my addr 172.21.15.133:0/4015982626 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:28.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8ead51c640 1 --2- 172.21.15.133:0/4015982626 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8ea80c0f30 0x7f8ea81f1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:28.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8eacd1b640 1 --2- 172.21.15.133:0/4015982626 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ea814dca0 0x7f8ea80c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:28.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8eadd1d640 1 -- 172.21.15.133:0/4015982626 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8ea80c0f30 msgr2=0x7f8ea81f1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:28.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8eadd1d640 1 --2- 172.21.15.133:0/4015982626 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8ea80c0f30 0x7f8ea81f1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:28.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8eadd1d640 1 -- 172.21.15.133:0/4015982626 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ea814dca0 msgr2=0x7f8ea80c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:28.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8eadd1d640 1 --2- 172.21.15.133:0/4015982626 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ea814dca0 0x7f8ea80c5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:28.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8eadd1d640 1 -- 172.21.15.133:0/4015982626 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea4007040 con 0x7f8ea8153db0 2023-12-19T19:02:28.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8eadd1d640 1 --2- 172.21.15.133:0/4015982626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea8153db0 0x7f8ea81ee6d0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0007e40 tx=0x7f8ea000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:28.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8e9dffb640 1 -- 172.21.15.133:0/4015982626 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0014620 con 0x7f8ea8153db0 2023-12-19T19:02:28.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8e9dffb640 1 -- 172.21.15.133:0/4015982626 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea00147a0 con 0x7f8ea8153db0 2023-12-19T19:02:28.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8eaf780640 1 -- 172.21.15.133:0/4015982626 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea81ee100 con 0x7f8ea8153db0 2023-12-19T19:02:28.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8e9dffb640 1 -- 172.21.15.133:0/4015982626 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea0014b50 con 0x7f8ea8153db0 2023-12-19T19:02:28.422 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8eaf780640 1 -- 172.21.15.133:0/4015982626 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea81f0b50 con 0x7f8ea8153db0 2023-12-19T19:02:28.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8eaf780640 1 -- 172.21.15.133:0/4015982626 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea8068400 con 0x7f8ea8153db0 2023-12-19T19:02:28.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.416+0000 7f8e9dffb640 1 -- 172.21.15.133:0/4015982626 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f8ea0014cb0 con 0x7f8ea8153db0 2023-12-19T19:02:28.423 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.420+0000 7f8e9dffb640 1 --2- 172.21.15.133:0/4015982626 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8e8c066470 0x7f8e8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:28.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.420+0000 7f8e9dffb640 1 -- 172.21.15.133:0/4015982626 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f8ea0084670 con 0x7f8ea8153db0 2023-12-19T19:02:28.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.420+0000 7f8ead51c640 1 --2- 172.21.15.133:0/4015982626 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8e8c066470 0x7f8e8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:28.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.420+0000 7f8ead51c640 1 --2- 172.21.15.133:0/4015982626 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8e8c066470 0x7f8e8c068930 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40ae000 tx=0x7f8ea40b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:28.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.424+0000 7f8e9dffb640 1 -- 172.21.15.133:0/4015982626 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f8ea0051b80 con 0x7f8ea8153db0 2023-12-19T19:02:28.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:28.572+0000 7f8eaf780640 1 -- 172.21.15.133:0/4015982626 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8ea80c0d10 con 0x7f8ea8153db0 2023-12-19T19:02:29.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.240+0000 7f8e9dffb640 1 -- 172.21.15.133:0/4015982626 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v78) v1 ==== 184+0+0 (secure 0 0 0) 0x7f8ea00551a0 con 0x7f8ea8153db0 2023-12-19T19:02:29.246 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs2_metadata' removed 2023-12-19T19:02:29.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.244+0000 7f8eaf780640 1 -- 172.21.15.133:0/4015982626 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8e8c066470 msgr2=0x7f8e8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:29.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.244+0000 7f8eaf780640 1 --2- 172.21.15.133:0/4015982626 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8e8c066470 0x7f8e8c068930 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40ae000 tx=0x7f8ea40b5040 comp rx=0 tx=0).stop 2023-12-19T19:02:29.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.244+0000 7f8eaf780640 1 -- 172.21.15.133:0/4015982626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea8153db0 msgr2=0x7f8ea81ee6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:29.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.244+0000 7f8eaf780640 1 --2- 172.21.15.133:0/4015982626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea8153db0 0x7f8ea81ee6d0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0007e40 tx=0x7f8ea000e4b0 comp rx=0 tx=0).stop 2023-12-19T19:02:29.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.244+0000 7f8eaf780640 1 -- 172.21.15.133:0/4015982626 shutdown_connections 2023-12-19T19:02:29.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.244+0000 7f8eaf780640 1 --2- 172.21.15.133:0/4015982626 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8e8c066470 0x7f8e8c068930 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:29.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.244+0000 7f8eaf780640 1 --2- 172.21.15.133:0/4015982626 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8ea8153db0 0x7f8ea81ee6d0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:29.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.244+0000 7f8eaf780640 1 --2- 172.21.15.133:0/4015982626 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f8ea814dca0 0x7f8ea80c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:29.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.244+0000 7f8eaf780640 1 --2- 172.21.15.133:0/4015982626 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f8ea80c0f30 0x7f8ea81f1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:29.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.244+0000 7f8eaf780640 1 -- 172.21.15.133:0/4015982626 >> 172.21.15.133:0/4015982626 conn(0x7f8ea80a8ad0 msgr2=0x7f8ea814cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:29.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.244+0000 7f8eaf780640 1 -- 172.21.15.133:0/4015982626 shutdown_connections 2023-12-19T19:02:29.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.244+0000 7f8eaf780640 1 -- 172.21.15.133:0/4015982626 wait complete. 2023-12-19T19:02:29.273 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2023-12-19T19:02:29.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.420+0000 7fdf6b474640 1 Processor -- start 2023-12-19T19:02:29.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.420+0000 7fdf6b474640 1 -- start start 2023-12-19T19:02:29.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.420+0000 7fdf6b474640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf640c4be0 0x7fdf6406c260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:29.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.420+0000 7fdf6b474640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf640c83f0 con 0x7fdf640c4760 2023-12-19T19:02:29.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.420+0000 7fdf6b474640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf641544e0 con 0x7fdf64151bc0 2023-12-19T19:02:29.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.420+0000 7fdf6b474640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf64151fa0 con 0x7fdf640c4be0 2023-12-19T19:02:29.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.420+0000 7fdf69c71640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fdf640c4760 0x7fdf6406bb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43806/0 (socket says 172.21.15.133:43806) 2023-12-19T19:02:29.427 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.420+0000 7fdf69c71640 1 -- 172.21.15.133:0/406242148 learned_addr learned my addr 172.21.15.133:0/406242148 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:29.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf6ac73640 1 --2- 172.21.15.133:0/406242148 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf640c4be0 0x7fdf6406c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:29.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf69470640 1 -- 172.21.15.133:0/406242148 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152089531 0 0) 0x7fdf640c83f0 con 0x7fdf640c4760 2023-12-19T19:02:29.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf69470640 1 -- 172.21.15.133:0/406242148 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf50003530 con 0x7fdf640c4760 2023-12-19T19:02:29.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf69470640 1 -- 172.21.15.133:0/406242148 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560196626 0 0) 0x7fdf641544e0 con 0x7fdf64151bc0 2023-12-19T19:02:29.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf69470640 1 -- 172.21.15.133:0/406242148 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf640c83f0 con 0x7fdf64151bc0 2023-12-19T19:02:29.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf69470640 1 -- 172.21.15.133:0/406242148 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1874211182 0 0) 0x7fdf50003530 con 0x7fdf640c4760 2023-12-19T19:02:29.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf69470640 1 -- 172.21.15.133:0/406242148 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf640c4be0 msgr2=0x7fdf6406c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:29.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf69470640 1 --2- 172.21.15.133:0/406242148 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf640c4be0 0x7fdf6406c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:29.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf69470640 1 -- 172.21.15.133:0/406242148 >> v1:172.21.15.138:6789/0 conn(0x7fdf64151bc0 legacy=0x7fdf640c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:29.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf69470640 1 -- 172.21.15.133:0/406242148 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf641547a0 con 0x7fdf640c4760 2023-12-19T19:02:29.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf69470640 1 -- 172.21.15.133:0/406242148 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7fdf540050a0 con 0x7fdf640c4760 2023-12-19T19:02:29.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf69470640 1 -- 172.21.15.133:0/406242148 >> v1:172.21.15.133:6789/0 conn(0x7fdf640c4760 legacy=0x7fdf6406bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:29.429 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf69470640 1 --2- 172.21.15.133:0/406242148 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf50003b40 0x7fdf50003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:29.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf69470640 1 --2- 172.21.15.133:0/406242148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf500047d0 0x7fdf50004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:29.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf69470640 1 --2- 172.21.15.133:0/406242148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf500051e0 0x7fdf5000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:29.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf69470640 1 -- 172.21.15.133:0/406242148 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf64151fa0 con 0x7fdf500047d0 2023-12-19T19:02:29.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf69470640 1 -- 172.21.15.133:0/406242148 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5000c110 con 0x7fdf500051e0 2023-12-19T19:02:29.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf69470640 1 -- 172.21.15.133:0/406242148 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf5000c2d0 con 0x7fdf50003b40 2023-12-19T19:02:29.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf69c71640 1 --2- 172.21.15.133:0/406242148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf500047d0 0x7fdf50004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:29.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf6ac73640 1 --2- 172.21.15.133:0/406242148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf500051e0 0x7fdf5000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:29.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf6a472640 1 --2- 172.21.15.133:0/406242148 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf50003b40 0x7fdf50003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:29.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf69c71640 1 -- 172.21.15.133:0/406242148 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf50003b40 msgr2=0x7fdf50003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:29.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf69c71640 1 --2- 172.21.15.133:0/406242148 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf50003b40 0x7fdf50003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:29.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf69c71640 1 -- 172.21.15.133:0/406242148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf500051e0 msgr2=0x7fdf5000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:29.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf69c71640 1 --2- 172.21.15.133:0/406242148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf500051e0 0x7fdf5000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:29.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf69c71640 1 -- 172.21.15.133:0/406242148 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf50003530 con 0x7fdf500047d0 2023-12-19T19:02:29.430 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.424+0000 7fdf6ac73640 1 --2- 172.21.15.133:0/406242148 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf500051e0 0x7fdf5000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:29.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.428+0000 7fdf69c71640 1 --2- 172.21.15.133:0/406242148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf500047d0 0x7fdf50004c50 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fdf54007fb0 tx=0x7fdf5401cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35f07ea5a88c300 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:29.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.428+0000 7fdf69470640 1 -- 172.21.15.133:0/406242148 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf54005ae0 con 0x7fdf500047d0 2023-12-19T19:02:29.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.428+0000 7fdf69470640 1 -- 172.21.15.133:0/406242148 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf54005c40 con 0x7fdf500047d0 2023-12-19T19:02:29.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.428+0000 7fdf69470640 1 -- 172.21.15.133:0/406242148 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf540072b0 con 0x7fdf500047d0 2023-12-19T19:02:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.428+0000 7fdf6b474640 1 -- 172.21.15.133:0/406242148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf500047d0 msgr2=0x7fdf50004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.428+0000 7fdf6b474640 1 --2- 172.21.15.133:0/406242148 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf500047d0 0x7fdf50004c50 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fdf54007fb0 tx=0x7fdf5401cae0 comp rx=0 tx=0).stop 2023-12-19T19:02:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.428+0000 7fdf6ac73640 1 -- 172.21.15.133:0/406242148 reap_dead start 2023-12-19T19:02:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.428+0000 7fdf6b474640 1 -- 172.21.15.133:0/406242148 shutdown_connections 2023-12-19T19:02:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.428+0000 7fdf6b474640 1 -- 172.21.15.133:0/406242148 >> 172.21.15.133:0/406242148 conn(0x7fdf640ab970 msgr2=0x7fdf640abd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.428+0000 7fdf6b474640 1 -- 172.21.15.133:0/406242148 shutdown_connections 2023-12-19T19:02:29.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.428+0000 7fdf6b474640 1 -- 172.21.15.133:0/406242148 wait complete. 2023-12-19T19:02:29.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.428+0000 7fdf6b474640 1 Processor -- start 2023-12-19T19:02:29.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.428+0000 7fdf6b474640 1 -- start start 2023-12-19T19:02:29.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.428+0000 7fdf6b474640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf500047d0 0x7fdf6414c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.428+0000 7fdf6b474640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf640c24a0 0x7fdf640c2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.428+0000 7fdf6b474640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf6414e480 0x7fdf6414e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.428+0000 7fdf6b474640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf640c1c10 con 0x7fdf500047d0 2023-12-19T19:02:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.428+0000 7fdf6b474640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf640c39f0 con 0x7fdf640c24a0 2023-12-19T19:02:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.428+0000 7fdf6b474640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf640c1e60 con 0x7fdf6414e480 2023-12-19T19:02:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.428+0000 7fdf6a472640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf500047d0 0x7fdf6414c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.428+0000 7fdf6a472640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf500047d0 0x7fdf6414c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37446/0 (socket says 172.21.15.133:37446) 2023-12-19T19:02:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.428+0000 7fdf6a472640 1 -- 172.21.15.133:0/1326139303 learned_addr learned my addr 172.21.15.133:0/1326139303 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.432+0000 7fdf6a472640 1 -- 172.21.15.133:0/1326139303 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf6414e480 msgr2=0x7fdf6414e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.432+0000 7fdf6a472640 1 --2- 172.21.15.133:0/1326139303 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf6414e480 0x7fdf6414e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.432+0000 7fdf6a472640 1 -- 172.21.15.133:0/1326139303 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf640c24a0 msgr2=0x7fdf640c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.432+0000 7fdf6a472640 1 --2- 172.21.15.133:0/1326139303 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf640c24a0 0x7fdf640c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.432+0000 7fdf6a472640 1 -- 172.21.15.133:0/1326139303 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf640c3c40 con 0x7fdf500047d0 2023-12-19T19:02:29.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.432+0000 7fdf6a472640 1 --2- 172.21.15.133:0/1326139303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf500047d0 0x7fdf6414c7d0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fdf6000e550 tx=0x7fdf6000ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:29.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.432+0000 7fdf5affd640 1 -- 172.21.15.133:0/1326139303 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf600052e0 con 0x7fdf500047d0 2023-12-19T19:02:29.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.432+0000 7fdf5affd640 1 -- 172.21.15.133:0/1326139303 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf60005440 con 0x7fdf500047d0 2023-12-19T19:02:29.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.432+0000 7fdf6b474640 1 -- 172.21.15.133:0/1326139303 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf640c2e60 con 0x7fdf500047d0 2023-12-19T19:02:29.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.432+0000 7fdf5affd640 1 -- 172.21.15.133:0/1326139303 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf60003840 con 0x7fdf500047d0 2023-12-19T19:02:29.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.432+0000 7fdf6b474640 1 -- 172.21.15.133:0/1326139303 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf64152620 con 0x7fdf500047d0 2023-12-19T19:02:29.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.432+0000 7fdf6b474640 1 -- 172.21.15.133:0/1326139303 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf640c3e80 con 0x7fdf500047d0 2023-12-19T19:02:29.437 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.432+0000 7fdf5affd640 1 -- 172.21.15.133:0/1326139303 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fdf600039a0 con 0x7fdf500047d0 2023-12-19T19:02:29.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.432+0000 7fdf5affd640 1 --2- 172.21.15.133:0/1326139303 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdf480664a0 0x7fdf48068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:29.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.432+0000 7fdf5affd640 1 -- 172.21.15.133:0/1326139303 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5445+0+0 (secure 0 0 0) 0x7fdf60083b30 con 0x7fdf500047d0 2023-12-19T19:02:29.439 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.432+0000 7fdf69c71640 1 --2- 172.21.15.133:0/1326139303 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdf480664a0 0x7fdf48068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:29.440 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.436+0000 7fdf69c71640 1 --2- 172.21.15.133:0/1326139303 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdf480664a0 0x7fdf48068960 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdf54007f80 tx=0x7fdf640c5ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:29.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.436+0000 7fdf5affd640 1 -- 172.21.15.133:0/1326139303 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fdf600510a0 con 0x7fdf500047d0 2023-12-19T19:02:29.593 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:29.588+0000 7fdf6b474640 1 -- 172.21.15.133:0/1326139303 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdf6404e850 con 0x7fdf500047d0 2023-12-19T19:02:30.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.244+0000 7fdf5affd640 1 -- 172.21.15.133:0/1326139303 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v79) v1 ==== 172+0+0 (secure 0 0 0) 0x7fdf60007dc0 con 0x7fdf500047d0 2023-12-19T19:02:30.248 INFO:teuthology.orchestra.run.smithi133.stderr:pool 'cephfs2_data' removed 2023-12-19T19:02:30.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.248+0000 7fdf6b474640 1 -- 172.21.15.133:0/1326139303 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdf480664a0 msgr2=0x7fdf48068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:30.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.248+0000 7fdf6b474640 1 --2- 172.21.15.133:0/1326139303 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdf480664a0 0x7fdf48068960 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdf54007f80 tx=0x7fdf640c5ca0 comp rx=0 tx=0).stop 2023-12-19T19:02:30.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.248+0000 7fdf6b474640 1 -- 172.21.15.133:0/1326139303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf500047d0 msgr2=0x7fdf6414c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:30.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.248+0000 7fdf6b474640 1 --2- 172.21.15.133:0/1326139303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf500047d0 0x7fdf6414c7d0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fdf6000e550 tx=0x7fdf6000ea10 comp rx=0 tx=0).stop 2023-12-19T19:02:30.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.248+0000 7fdf6b474640 1 -- 172.21.15.133:0/1326139303 shutdown_connections 2023-12-19T19:02:30.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.248+0000 7fdf6b474640 1 --2- 172.21.15.133:0/1326139303 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fdf480664a0 0x7fdf48068960 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:30.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.248+0000 7fdf6b474640 1 --2- 172.21.15.133:0/1326139303 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fdf6414e480 0x7fdf6414e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:30.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.248+0000 7fdf6b474640 1 --2- 172.21.15.133:0/1326139303 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fdf640c24a0 0x7fdf640c2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:30.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.248+0000 7fdf6b474640 1 --2- 172.21.15.133:0/1326139303 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf500047d0 0x7fdf6414c7d0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:30.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.248+0000 7fdf6b474640 1 -- 172.21.15.133:0/1326139303 >> 172.21.15.133:0/1326139303 conn(0x7fdf640ab970 msgr2=0x7fdf640c8580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:30.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.248+0000 7fdf6b474640 1 -- 172.21.15.133:0/1326139303 shutdown_connections 2023-12-19T19:02:30.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.248+0000 7fdf6b474640 1 -- 172.21.15.133:0/1326139303 wait complete. 2023-12-19T19:02:30.278 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T19:02:30.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.415+0000 7f5ee49aa640 1 Processor -- start 2023-12-19T19:02:30.421 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.415+0000 7f5ee49aa640 1 -- start start 2023-12-19T19:02:30.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.415+0000 7f5ee49aa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5ee00a5240 0x7f5ee00bfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:30.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.415+0000 7f5ee49aa640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee00c3bd0 con 0x7f5ee01561f0 2023-12-19T19:02:30.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.415+0000 7f5ee49aa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ee00bf1e0 con 0x7f5ee00c01c0 2023-12-19T19:02:30.424 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.415+0000 7f5ee49aa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee00c3e20 con 0x7f5ee00a5240 2023-12-19T19:02:30.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.415+0000 7f5eded9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f5ee01561f0 0x7f5ee0156680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43810/0 (socket says 172.21.15.133:43810) 2023-12-19T19:02:30.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.415+0000 7f5eded9d640 1 -- 172.21.15.133:0/1881559830 learned_addr learned my addr 172.21.15.133:0/1881559830 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:30.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.415+0000 7f5ede59c640 1 --2- 172.21.15.133:0/1881559830 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5ee00a5240 0x7f5ee00bfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:30.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.415+0000 7f5edd59a640 1 -- 172.21.15.133:0/1881559830 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 579106079 0 0) 0x7f5ee00c3bd0 con 0x7f5ee01561f0 2023-12-19T19:02:30.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.415+0000 7f5edd59a640 1 -- 172.21.15.133:0/1881559830 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ec8003530 con 0x7f5ee01561f0 2023-12-19T19:02:30.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.415+0000 7f5edd59a640 1 -- 172.21.15.133:0/1881559830 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1932823510 0 0) 0x7f5ec8003530 con 0x7f5ee01561f0 2023-12-19T19:02:30.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.415+0000 7f5edd59a640 1 -- 172.21.15.133:0/1881559830 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5ee00a5240 msgr2=0x7f5ee00bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:30.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.415+0000 7f5edd59a640 1 --2- 172.21.15.133:0/1881559830 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5ee00a5240 0x7f5ee00bfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:30.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.415+0000 7f5edd59a640 1 -- 172.21.15.133:0/1881559830 >> v1:172.21.15.138:6789/0 conn(0x7f5ee00c01c0 legacy=0x7f5ee00c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:30.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.415+0000 7f5edd59a640 1 -- 172.21.15.133:0/1881559830 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee00c4100 con 0x7f5ee01561f0 2023-12-19T19:02:30.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.415+0000 7f5edd59a640 1 -- 172.21.15.133:0/1881559830 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f5ed8001680 con 0x7f5ee01561f0 2023-12-19T19:02:30.425 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.415+0000 7f5edd59a640 1 -- 172.21.15.133:0/1881559830 >> v1:172.21.15.133:6789/0 conn(0x7f5ee01561f0 legacy=0x7f5ee0156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:30.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.415+0000 7f5edd59a640 1 --2- 172.21.15.133:0/1881559830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec80039b0 0x7f5ec8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:30.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.419+0000 7f5edd59a640 1 --2- 172.21.15.133:0/1881559830 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ec80047d0 0x7f5ec8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:30.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.419+0000 7f5edd59a640 1 --2- 172.21.15.133:0/1881559830 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5ee00a5240 0x7f5ec8005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:30.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.419+0000 7f5edd59a640 1 -- 172.21.15.133:0/1881559830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee00c3e20 con 0x7f5ec80039b0 2023-12-19T19:02:30.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.419+0000 7f5edd59a640 1 -- 172.21.15.133:0/1881559830 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec800bb20 con 0x7f5ec80047d0 2023-12-19T19:02:30.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.419+0000 7f5edd59a640 1 -- 172.21.15.133:0/1881559830 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec800bce0 con 0x7f5ee00a5240 2023-12-19T19:02:30.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.419+0000 7f5ede59c640 1 --2- 172.21.15.133:0/1881559830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec80039b0 0x7f5ec8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:30.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.419+0000 7f5eddd9b640 1 --2- 172.21.15.133:0/1881559830 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ec80047d0 0x7f5ec8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:30.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.419+0000 7f5eded9d640 1 --2- 172.21.15.133:0/1881559830 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5ee00a5240 0x7f5ec8005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:30.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.419+0000 7f5ede59c640 1 -- 172.21.15.133:0/1881559830 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5ee00a5240 msgr2=0x7f5ec8005240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:30.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.419+0000 7f5ede59c640 1 --2- 172.21.15.133:0/1881559830 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5ee00a5240 0x7f5ec8005240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:30.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.419+0000 7f5ede59c640 1 -- 172.21.15.133:0/1881559830 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ec80047d0 msgr2=0x7f5ec8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:30.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.419+0000 7f5ede59c640 1 --2- 172.21.15.133:0/1881559830 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ec80047d0 0x7f5ec8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:30.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.419+0000 7f5ede59c640 1 -- 172.21.15.133:0/1881559830 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec8003530 con 0x7f5ec80039b0 2023-12-19T19:02:30.426 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.419+0000 7f5eded9d640 1 --2- 172.21.15.133:0/1881559830 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5ee00a5240 0x7f5ec8005240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:30.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.419+0000 7f5ede59c640 1 --2- 172.21.15.133:0/1881559830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec80039b0 0x7f5ec8003dd0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0009fc0 tx=0x7f5ed001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29860d4a198d6348 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:30.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.419+0000 7f5edd59a640 1 -- 172.21.15.133:0/1881559830 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed00a5b30 con 0x7f5ec80039b0 2023-12-19T19:02:30.431 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.419+0000 7f5edd59a640 1 -- 172.21.15.133:0/1881559830 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed000f040 con 0x7f5ec80039b0 2023-12-19T19:02:30.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.419+0000 7f5edd59a640 1 -- 172.21.15.133:0/1881559830 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed00ad440 con 0x7f5ec80039b0 2023-12-19T19:02:30.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.423+0000 7f5ee49aa640 1 -- 172.21.15.133:0/1881559830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec80039b0 msgr2=0x7f5ec8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:30.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.423+0000 7f5ee49aa640 1 --2- 172.21.15.133:0/1881559830 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ec80039b0 0x7f5ec8003dd0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0009fc0 tx=0x7f5ed001cc30 comp rx=0 tx=0).stop 2023-12-19T19:02:30.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.423+0000 7f5eded9d640 1 -- 172.21.15.133:0/1881559830 reap_dead start 2023-12-19T19:02:30.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.423+0000 7f5ee49aa640 1 -- 172.21.15.133:0/1881559830 shutdown_connections 2023-12-19T19:02:30.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.423+0000 7f5ee49aa640 1 -- 172.21.15.133:0/1881559830 >> 172.21.15.133:0/1881559830 conn(0x7f5ee006a5b0 msgr2=0x7f5ee006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:30.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.423+0000 7f5ee49aa640 1 -- 172.21.15.133:0/1881559830 shutdown_connections 2023-12-19T19:02:30.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.423+0000 7f5ee49aa640 1 -- 172.21.15.133:0/1881559830 wait complete. 2023-12-19T19:02:30.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.423+0000 7f5ee49aa640 1 Processor -- start 2023-12-19T19:02:30.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.423+0000 7f5ee49aa640 1 -- start start 2023-12-19T19:02:30.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.423+0000 7f5ee49aa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ec80039b0 0x7f5ee00c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:30.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.423+0000 7f5ee49aa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ee01ed770 0x7f5ee01f0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:30.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.423+0000 7f5ee49aa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5ee01f0f50 0x7f5ee0152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:30.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.423+0000 7f5ee49aa640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee01f02a0 con 0x7f5ee01ed770 2023-12-19T19:02:30.432 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.423+0000 7f5ee49aa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee01f0580 con 0x7f5ec80039b0 2023-12-19T19:02:30.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.423+0000 7f5ee49aa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ee01edc80 con 0x7f5ee01f0f50 2023-12-19T19:02:30.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.423+0000 7f5ede59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ec80039b0 0x7f5ee00c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:30.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.423+0000 7f5ede59c640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ec80039b0 0x7f5ee00c1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:33842/0 (socket says 172.21.15.133:33842) 2023-12-19T19:02:30.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.423+0000 7f5ede59c640 1 -- 172.21.15.133:0/4290473549 learned_addr learned my addr 172.21.15.133:0/4290473549 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:30.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.423+0000 7f5eded9d640 1 --2- 172.21.15.133:0/4290473549 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5ee01f0f50 0x7f5ee0152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:30.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.423+0000 7f5eddd9b640 1 --2- 172.21.15.133:0/4290473549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ee01ed770 0x7f5ee01f0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:30.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.427+0000 7f5ede59c640 1 -- 172.21.15.133:0/4290473549 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5ee01f0f50 msgr2=0x7f5ee0152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:30.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.427+0000 7f5ede59c640 1 --2- 172.21.15.133:0/4290473549 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5ee01f0f50 0x7f5ee0152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:30.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.427+0000 7f5ede59c640 1 -- 172.21.15.133:0/4290473549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ee01ed770 msgr2=0x7f5ee01f0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:30.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.427+0000 7f5ede59c640 1 --2- 172.21.15.133:0/4290473549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ee01ed770 0x7f5ee01f0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:30.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.427+0000 7f5ede59c640 1 -- 172.21.15.133:0/4290473549 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee0071020 con 0x7f5ec80039b0 2023-12-19T19:02:30.433 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.427+0000 7f5ede59c640 1 --2- 172.21.15.133:0/4290473549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ec80039b0 0x7f5ee00c1f50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0098650 tx=0x7f5ed0009750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:30.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.427+0000 7f5eceffd640 1 -- 172.21.15.133:0/4290473549 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0003ba0 con 0x7f5ec80039b0 2023-12-19T19:02:30.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.427+0000 7f5eceffd640 1 -- 172.21.15.133:0/4290473549 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed0003d00 con 0x7f5ec80039b0 2023-12-19T19:02:30.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.427+0000 7f5ee49aa640 1 -- 172.21.15.133:0/4290473549 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ee0071300 con 0x7f5ec80039b0 2023-12-19T19:02:30.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.427+0000 7f5eceffd640 1 -- 172.21.15.133:0/4290473549 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0004240 con 0x7f5ec80039b0 2023-12-19T19:02:30.434 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.427+0000 7f5ee49aa640 1 -- 172.21.15.133:0/4290473549 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ee0070090 con 0x7f5ec80039b0 2023-12-19T19:02:30.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.427+0000 7f5ee49aa640 1 -- 172.21.15.133:0/4290473549 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ee0071490 con 0x7f5ec80039b0 2023-12-19T19:02:30.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.427+0000 7f5eceffd640 1 -- 172.21.15.133:0/4290473549 <== mon.1 v2:172.21.15.138:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5ed00b4040 con 0x7f5ec80039b0 2023-12-19T19:02:30.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.427+0000 7f5eceffd640 1 --2- 172.21.15.133:0/4290473549 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5ec00664a0 0x7f5ec0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:30.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.431+0000 7f5eceffd640 1 -- 172.21.15.133:0/4290473549 <== mon.1 v2:172.21.15.138:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f5ed011e680 con 0x7f5ec80039b0 2023-12-19T19:02:30.435 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.431+0000 7f5eddd9b640 1 --2- 172.21.15.133:0/4290473549 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5ec00664a0 0x7f5ec0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:30.436 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.431+0000 7f5eddd9b640 1 --2- 172.21.15.133:0/4290473549 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5ec00664a0 0x7f5ec0068960 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5ee00aac60 tx=0x7f5ed4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:30.438 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.431+0000 7f5eceffd640 1 -- 172.21.15.133:0/4290473549 <== mon.1 v2:172.21.15.138:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5ed00ebfe0 con 0x7f5ec80039b0 2023-12-19T19:02:30.589 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.583+0000 7f5ee49aa640 1 -- 172.21.15.133:0/4290473549 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5ee0068400 con 0x7f5ec80039b0 2023-12-19T19:02:30.596 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.591+0000 7f5eceffd640 1 -- 172.21.15.133:0/4290473549 <== mon.1 v2:172.21.15.138:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5ed00ef600 con 0x7f5ec80039b0 2023-12-19T19:02:30.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.591+0000 7f5ee49aa640 1 -- 172.21.15.133:0/4290473549 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5ec00664a0 msgr2=0x7f5ec0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:30.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.591+0000 7f5ee49aa640 1 --2- 172.21.15.133:0/4290473549 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5ec00664a0 0x7f5ec0068960 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f5ee00aac60 tx=0x7f5ed4009040 comp rx=0 tx=0).stop 2023-12-19T19:02:30.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.591+0000 7f5ee49aa640 1 -- 172.21.15.133:0/4290473549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ec80039b0 msgr2=0x7f5ee00c1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:30.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.591+0000 7f5ee49aa640 1 --2- 172.21.15.133:0/4290473549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ec80039b0 0x7f5ee00c1f50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f5ed0098650 tx=0x7f5ed0009750 comp rx=0 tx=0).stop 2023-12-19T19:02:30.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.591+0000 7f5ee49aa640 1 -- 172.21.15.133:0/4290473549 shutdown_connections 2023-12-19T19:02:30.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.591+0000 7f5ee49aa640 1 --2- 172.21.15.133:0/4290473549 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5ec00664a0 0x7f5ec0068960 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:30.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.591+0000 7f5ee49aa640 1 --2- 172.21.15.133:0/4290473549 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5ee01f0f50 0x7f5ee0152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:30.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.591+0000 7f5ee49aa640 1 --2- 172.21.15.133:0/4290473549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5ee01ed770 0x7f5ee01f0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:30.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.591+0000 7f5ee49aa640 1 --2- 172.21.15.133:0/4290473549 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5ec80039b0 0x7f5ee00c1f50 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:30.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.591+0000 7f5ee49aa640 1 -- 172.21.15.133:0/4290473549 >> 172.21.15.133:0/4290473549 conn(0x7f5ee006a5b0 msgr2=0x7f5ee0158630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:30.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.591+0000 7f5ee49aa640 1 -- 172.21.15.133:0/4290473549 shutdown_connections 2023-12-19T19:02:30.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.591+0000 7f5ee49aa640 1 -- 172.21.15.133:0/4290473549 wait complete. 2023-12-19T19:02:30.618 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2023-12-19T19:02:30.755 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.751+0000 7f520b0d6640 1 Processor -- start 2023-12-19T19:02:30.756 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.751+0000 7f520b0d6640 1 -- start start 2023-12-19T19:02:30.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.751+0000 7f520b0d6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5204151e90 0x7f52040c4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:30.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.751+0000 7f520b0d6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f52040c7ea0 0x7f520406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:30.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.751+0000 7f520b0d6640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520406c860 con 0x7f52040c4e60 2023-12-19T19:02:30.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.751+0000 7f520b0d6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52040c8750 con 0x7f52040c7ea0 2023-12-19T19:02:30.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.751+0000 7f520b0d6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52041552d0 con 0x7f5204151e90 2023-12-19T19:02:30.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.751+0000 7f5203fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f52040c7ea0 0x7f520406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:30.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.751+0000 7f5203fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f52040c7ea0 0x7f520406b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37490/0 (socket says 172.21.15.133:37490) 2023-12-19T19:02:30.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.751+0000 7f5203fff640 1 -- 172.21.15.133:0/1011322532 learned_addr learned my addr 172.21.15.133:0/1011322532 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:30.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.751+0000 7f5208e72640 1 --2- 172.21.15.133:0/1011322532 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5204151e90 0x7f52040c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:30.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.751+0000 7f5203fff640 1 -- 172.21.15.133:0/1011322532 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5204151e90 msgr2=0x7f52040c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:30.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.751+0000 7f5203fff640 1 --2- 172.21.15.133:0/1011322532 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5204151e90 0x7f52040c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:30.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.751+0000 7f5203fff640 1 -- 172.21.15.133:0/1011322532 >> v1:172.21.15.138:6789/0 conn(0x7f52040c4e60 legacy=0x7f520406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:30.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.751+0000 7f5203fff640 1 -- 172.21.15.133:0/1011322532 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5204154930 con 0x7f52040c7ea0 2023-12-19T19:02:30.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.755+0000 7f5203fff640 1 --2- 172.21.15.133:0/1011322532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52040c7ea0 0x7f520406b4a0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f51f0009870 tx=0x7f51f001c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1259f42d55f43221 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:30.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.755+0000 7f52037fe640 1 -- 172.21.15.133:0/1011322532 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f00ab600 con 0x7f52040c7ea0 2023-12-19T19:02:30.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.755+0000 7f52037fe640 1 -- 172.21.15.133:0/1011322532 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f00a7050 con 0x7f52040c7ea0 2023-12-19T19:02:30.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.755+0000 7f52037fe640 1 -- 172.21.15.133:0/1011322532 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f00ab980 con 0x7f52040c7ea0 2023-12-19T19:02:30.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.755+0000 7f520b0d6640 1 -- 172.21.15.133:0/1011322532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52040c7ea0 msgr2=0x7f520406b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:30.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.755+0000 7f520b0d6640 1 --2- 172.21.15.133:0/1011322532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52040c7ea0 0x7f520406b4a0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f51f0009870 tx=0x7f51f001c420 comp rx=0 tx=0).stop 2023-12-19T19:02:30.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.755+0000 7f520b0d6640 1 -- 172.21.15.133:0/1011322532 shutdown_connections 2023-12-19T19:02:30.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.755+0000 7f520b0d6640 1 --2- 172.21.15.133:0/1011322532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52040c7ea0 0x7f520406b4a0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:30.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.755+0000 7f520b0d6640 1 --2- 172.21.15.133:0/1011322532 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5204151e90 0x7f52040c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:30.761 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.755+0000 7f520b0d6640 1 -- 172.21.15.133:0/1011322532 >> 172.21.15.133:0/1011322532 conn(0x7f52040ca170 msgr2=0x7f52040ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:30.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.755+0000 7f520b0d6640 1 -- 172.21.15.133:0/1011322532 shutdown_connections 2023-12-19T19:02:30.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.755+0000 7f520b0d6640 1 -- 172.21.15.133:0/1011322532 wait complete. 2023-12-19T19:02:30.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.755+0000 7f520b0d6640 1 Processor -- start 2023-12-19T19:02:30.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.755+0000 7f520b0d6640 1 -- start start 2023-12-19T19:02:30.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f520b0d6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f52040c4e60 0x7f52040af550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:30.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f520b0d6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52040c7ea0 0x7f520414b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:30.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f520b0d6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5204151e90 0x7f520414c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:30.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f520b0d6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52040afa90 con 0x7f52040c7ea0 2023-12-19T19:02:30.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f520b0d6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52040aeb00 con 0x7f5204151e90 2023-12-19T19:02:30.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f520b0d6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52040af0c0 con 0x7f52040c4e60 2023-12-19T19:02:30.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f5203fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52040c7ea0 0x7f520414b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:30.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f5203fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52040c7ea0 0x7f520414b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37502/0 (socket says 172.21.15.133:37502) 2023-12-19T19:02:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f5203fff640 1 -- 172.21.15.133:0/790576435 learned_addr learned my addr 172.21.15.133:0/790576435 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f5208e72640 1 --2- 172.21.15.133:0/790576435 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f52040c4e60 0x7f52040af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f5209673640 1 --2- 172.21.15.133:0/790576435 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5204151e90 0x7f520414c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f5203fff640 1 -- 172.21.15.133:0/790576435 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f52040c4e60 msgr2=0x7f52040af550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f5203fff640 1 --2- 172.21.15.133:0/790576435 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f52040c4e60 0x7f52040af550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f5203fff640 1 -- 172.21.15.133:0/790576435 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5204151e90 msgr2=0x7f520414c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f5203fff640 1 --2- 172.21.15.133:0/790576435 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5204151e90 0x7f520414c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f5203fff640 1 -- 172.21.15.133:0/790576435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f00094d0 con 0x7f52040c7ea0 2023-12-19T19:02:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f5203fff640 1 --2- 172.21.15.133:0/790576435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52040c7ea0 0x7f520414b510 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f51f00ae040 tx=0x7f51f00191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f52017fa640 1 -- 172.21.15.133:0/790576435 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f00b4420 con 0x7f52040c7ea0 2023-12-19T19:02:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f52017fa640 1 -- 172.21.15.133:0/790576435 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f00b4580 con 0x7f52040c7ea0 2023-12-19T19:02:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f52017fa640 1 -- 172.21.15.133:0/790576435 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f00b4930 con 0x7f52040c7ea0 2023-12-19T19:02:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f520b0d6640 1 -- 172.21.15.133:0/790576435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52041f13a0 con 0x7f52040c7ea0 2023-12-19T19:02:30.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f520b0d6640 1 -- 172.21.15.133:0/790576435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52040aed50 con 0x7f52040c7ea0 2023-12-19T19:02:30.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f520b0d6640 1 -- 172.21.15.133:0/790576435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52041f1850 con 0x7f52040c7ea0 2023-12-19T19:02:30.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.759+0000 7f52017fa640 1 -- 172.21.15.133:0/790576435 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f51f00b2070 con 0x7f52040c7ea0 2023-12-19T19:02:30.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.763+0000 7f52017fa640 1 --2- 172.21.15.133:0/790576435 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f51e80664a0 0x7f51e8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:30.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.763+0000 7f52017fa640 1 -- 172.21.15.133:0/790576435 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f51f011d790 con 0x7f52040c7ea0 2023-12-19T19:02:30.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.763+0000 7f5208e72640 1 --2- 172.21.15.133:0/790576435 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f51e80664a0 0x7f51e8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:30.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.763+0000 7f5208e72640 1 --2- 172.21.15.133:0/790576435 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f51e80664a0 0x7f51e8068960 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f51f8007a60 tx=0x7f51f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:30.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.767+0000 7f52017fa640 1 -- 172.21.15.133:0/790576435 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f51f00eaea0 con 0x7f52040c7ea0 2023-12-19T19:02:30.975 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:30.967+0000 7f520b0d6640 1 -- 172.21.15.133:0/790576435 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7f5204068400 con 0x7f52040c7ea0 2023-12-19T19:02:31.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:31.243+0000 7f52017fa640 1 -- 172.21.15.133:0/790576435 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v240) v1 ==== 159+0+0 (secure 0 0 0) 0x7f51f00ee4c0 con 0x7f52040c7ea0 2023-12-19T19:02:31.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:31.247+0000 7f520b0d6640 1 -- 172.21.15.133:0/790576435 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f51e80664a0 msgr2=0x7f51e8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:31.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:31.247+0000 7f520b0d6640 1 --2- 172.21.15.133:0/790576435 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f51e80664a0 0x7f51e8068960 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f51f8007a60 tx=0x7f51f8008040 comp rx=0 tx=0).stop 2023-12-19T19:02:31.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:31.247+0000 7f520b0d6640 1 -- 172.21.15.133:0/790576435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52040c7ea0 msgr2=0x7f520414b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:31.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:31.247+0000 7f520b0d6640 1 --2- 172.21.15.133:0/790576435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52040c7ea0 0x7f520414b510 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f51f00ae040 tx=0x7f51f00191c0 comp rx=0 tx=0).stop 2023-12-19T19:02:31.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:31.247+0000 7f520b0d6640 1 -- 172.21.15.133:0/790576435 shutdown_connections 2023-12-19T19:02:31.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:31.247+0000 7f520b0d6640 1 --2- 172.21.15.133:0/790576435 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f51e80664a0 0x7f51e8068960 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:31.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:31.247+0000 7f520b0d6640 1 --2- 172.21.15.133:0/790576435 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5204151e90 0x7f520414c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:31.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:31.247+0000 7f520b0d6640 1 --2- 172.21.15.133:0/790576435 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f52040c7ea0 0x7f520414b510 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:31.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:31.247+0000 7f520b0d6640 1 --2- 172.21.15.133:0/790576435 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f52040c4e60 0x7f52040af550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:31.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:31.247+0000 7f520b0d6640 1 -- 172.21.15.133:0/790576435 >> 172.21.15.133:0/790576435 conn(0x7f52040ca170 msgr2=0x7f52040ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:31.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:31.247+0000 7f520b0d6640 1 -- 172.21.15.133:0/790576435 shutdown_connections 2023-12-19T19:02:31.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:31.247+0000 7f520b0d6640 1 -- 172.21.15.133:0/790576435 wait complete. 2023-12-19T19:02:31.275 INFO:tasks.cephfs_test_runner:test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) ... ERROR 2023-12-19T19:02:31.275 INFO:tasks.cephfs_test_runner: 2023-12-19T19:02:31.275 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-19T19:02:31.275 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-19T19:02:31.275 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-19T19:02:31.275 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-19T19:02:31.276 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2023-12-19T19:02:31.276 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2023-12-19T19:02:31.276 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2023-12-19T19:02:31.276 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2023-12-19T19:02:31.276 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2023-12-19T19:02:31.276 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2023-12-19T19:02:31.276 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks/cephfs/mount.py", line 749, in read_file 2023-12-19T19:02:31.276 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2023-12-19T19:02:31.276 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-12-19T19:02:31.276 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-12-19T19:02:31.276 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run 2023-12-19T19:02:31.276 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-12-19T19:02:31.276 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run 2023-12-19T19:02:31.276 INFO:tasks.cephfs_test_runner: r.wait() 2023-12-19T19:02:31.276 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait 2023-12-19T19:02:31.276 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-19T19:02:31.276 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-19T19:02:31.276 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-19T19:02:31.276 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi133 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2023-12-19T19:02:31.277 INFO:tasks.cephfs_test_runner: 2023-12-19T19:02:31.277 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-19T19:02:31.277 INFO:tasks.cephfs_test_runner:Ran 3 tests in 203.461s 2023-12-19T19:02:31.277 INFO:tasks.cephfs_test_runner: 2023-12-19T19:02:31.277 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-12-19T19:02:31.277 INFO:tasks.cephfs_test_runner: 2023-12-19T19:02:31.277 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-19T19:02:31.277 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-19T19:02:31.277 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-19T19:02:31.277 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-19T19:02:31.277 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2023-12-19T19:02:31.277 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2023-12-19T19:02:31.277 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2023-12-19T19:02:31.277 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2023-12-19T19:02:31.278 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2023-12-19T19:02:31.278 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2023-12-19T19:02:31.278 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks/cephfs/mount.py", line 749, in read_file 2023-12-19T19:02:31.278 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2023-12-19T19:02:31.278 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks/cephfs/mount.py", line 784, in run_shell 2023-12-19T19:02:31.278 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-12-19T19:02:31.278 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run 2023-12-19T19:02:31.278 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-12-19T19:02:31.278 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run 2023-12-19T19:02:31.278 INFO:tasks.cephfs_test_runner: r.wait() 2023-12-19T19:02:31.278 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait 2023-12-19T19:02:31.278 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-19T19:02:31.278 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-19T19:02:31.278 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-19T19:02:31.278 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi133 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2023-12-19T19:02:31.278 INFO:tasks.cephfs_test_runner: 2023-12-19T19:02:31.279 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-19T19:02:31.390 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=f1ed950e0ff2437e81e43c5435b77ce8 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_c7586e95519b7be76f3b6e3a4b333888baf46bc9/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2023-12-19T19:02:31.392 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-19T19:02:31.401 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-12-19T19:02:31.423 INFO:tasks.kclient:Unmounting kernel clients... 2023-12-19T19:02:31.424 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-12-19T19:02:31.424 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:02:31.437 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3517 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2023-12-19T19:02:31.437 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2023-12-19T19:02:31.438 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T19:02:31.449 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354628k,nr_inodes=4088657,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3612 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2023-12-19T19:02:31.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:31.450 DEBUG:teuthology.orchestra.run.smithi133:> ip netns list 2023-12-19T19:02:31.492 INFO:teuthology.orchestra.run.smithi133.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T19:02:31.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:31.492 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T19:02:31.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:31.561 DEBUG:teuthology.orchestra.run.smithi133:> sudo ip link delete ceph-brx 2023-12-19T19:02:31.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:31.786 DEBUG:teuthology.orchestra.run.smithi138:> ip netns list 2023-12-19T19:02:31.797 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T19:02:31.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:31.797 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T19:02:31.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T19:02:31.862 DEBUG:teuthology.orchestra.run.smithi138:> sudo ip link delete ceph-brx 2023-12-19T19:02:32.097 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-19T19:02:32.106 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-19T19:02:32.106 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T19:02:32.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.239+0000 7f2ddedf8640 1 Processor -- start 2023-12-19T19:02:32.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.239+0000 7f2ddedf8640 1 -- start start 2023-12-19T19:02:32.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.243+0000 7f2ddedf8640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2dd80c4100 0x7f2dd80c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:32.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.243+0000 7f2ddedf8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f2dd80c06d0 0x7f2dd80a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:32.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.243+0000 7f2ddedf8640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd80c31c0 con 0x7f2dd80c63c0 2023-12-19T19:02:32.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.243+0000 7f2ddedf8640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd80c34a0 con 0x7f2dd80c4100 2023-12-19T19:02:32.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.243+0000 7f2ddedf8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd80c1030 con 0x7f2dd80c06d0 2023-12-19T19:02:32.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.243+0000 7f2ddcb94640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f2dd80c63c0 0x7f2dd80c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43826/0 (socket says 172.21.15.133:43826) 2023-12-19T19:02:32.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.243+0000 7f2ddcb94640 1 -- 172.21.15.133:0/1115453282 learned_addr learned my addr 172.21.15.133:0/1115453282 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:32.248 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.243+0000 7f2dd7fff640 1 --2- 172.21.15.133:0/1115453282 >> v2:172.21.15.133:3300/0 conn(0x7f2dd80c4100 0x7f2dd80c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:32.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.243+0000 7f2dd77fe640 1 -- 172.21.15.133:0/1115453282 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844239533 0 0) 0x7f2dd80c31c0 con 0x7f2dd80c63c0 2023-12-19T19:02:32.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.243+0000 7f2dd77fe640 1 -- 172.21.15.133:0/1115453282 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dc8003530 con 0x7f2dd80c63c0 2023-12-19T19:02:32.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.243+0000 7f2ddd395640 1 --2- 172.21.15.133:0/1115453282 >> v2:172.21.15.138:3300/0 conn(0x7f2dd80c06d0 0x7f2dd80a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:32.249 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.243+0000 7f2dd7fff640 1 -- 172.21.15.133:0/1115453282 >> v2:172.21.15.138:3300/0 conn(0x7f2dd80c06d0 msgr2=0x7f2dd80a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:32.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.243+0000 7f2dd7fff640 1 --2- 172.21.15.133:0/1115453282 >> v2:172.21.15.138:3300/0 conn(0x7f2dd80c06d0 0x7f2dd80a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.243+0000 7f2dd7fff640 1 -- 172.21.15.133:0/1115453282 >> v1:172.21.15.133:6789/0 conn(0x7f2dd80c63c0 legacy=0x7f2dd80c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:32.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.243+0000 7f2dd7fff640 1 -- 172.21.15.133:0/1115453282 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd80c1310 con 0x7f2dd80c4100 2023-12-19T19:02:32.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.243+0000 7f2ddd395640 1 --2- 172.21.15.133:0/1115453282 >> v2:172.21.15.138:3300/0 conn(0x7f2dd80c06d0 0x7f2dd80a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:32.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.243+0000 7f2dd7fff640 1 --2- 172.21.15.133:0/1115453282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dd80c4100 0x7f2dd80c2bb0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f2dd80c0ee0 tx=0x7f2dc401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d55aea1c3217ad14 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:32.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.243+0000 7f2dd77fe640 1 -- 172.21.15.133:0/1115453282 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd80aa3d0 con 0x7f2dd80c4100 2023-12-19T19:02:32.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.247+0000 7f2dd77fe640 1 -- 172.21.15.133:0/1115453282 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc40a7050 con 0x7f2dd80c4100 2023-12-19T19:02:32.251 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.247+0000 7f2dd77fe640 1 -- 172.21.15.133:0/1115453282 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc40ab820 con 0x7f2dd80c4100 2023-12-19T19:02:32.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.247+0000 7f2ddedf8640 1 -- 172.21.15.133:0/1115453282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dd80c4100 msgr2=0x7f2dd80c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:32.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.247+0000 7f2ddedf8640 1 --2- 172.21.15.133:0/1115453282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dd80c4100 0x7f2dd80c2bb0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f2dd80c0ee0 tx=0x7f2dc401c340 comp rx=0 tx=0).stop 2023-12-19T19:02:32.252 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.247+0000 7f2ddedf8640 1 -- 172.21.15.133:0/1115453282 shutdown_connections 2023-12-19T19:02:32.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.247+0000 7f2ddedf8640 1 --2- 172.21.15.133:0/1115453282 >> v2:172.21.15.138:3300/0 conn(0x7f2dd80c06d0 0x7f2dd80a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.247+0000 7f2ddedf8640 1 --2- 172.21.15.133:0/1115453282 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dd80c4100 0x7f2dd80c2bb0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.247+0000 7f2ddedf8640 1 -- 172.21.15.133:0/1115453282 >> 172.21.15.133:0/1115453282 conn(0x7f2dd806a5b0 msgr2=0x7f2dd806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:32.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.247+0000 7f2ddedf8640 1 -- 172.21.15.133:0/1115453282 shutdown_connections 2023-12-19T19:02:32.253 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.247+0000 7f2ddedf8640 1 -- 172.21.15.133:0/1115453282 wait complete. 2023-12-19T19:02:32.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.247+0000 7f2ddedf8640 1 Processor -- start 2023-12-19T19:02:32.254 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.247+0000 7f2ddedf8640 1 -- start start 2023-12-19T19:02:32.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.247+0000 7f2ddedf8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dd80c06d0 0x7f2dd815a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:32.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.247+0000 7f2ddedf8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2dd80c4100 0x7f2dd8070830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:32.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.247+0000 7f2ddedf8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2dd80c63c0 0x7f2dd814fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:32.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.247+0000 7f2ddedf8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd815a4c0 con 0x7f2dd80c06d0 2023-12-19T19:02:32.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.247+0000 7f2ddedf8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd8155f70 con 0x7f2dd80c63c0 2023-12-19T19:02:32.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.247+0000 7f2ddedf8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd8156250 con 0x7f2dd80c4100 2023-12-19T19:02:32.256 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.247+0000 7f2ddcb94640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dd80c06d0 0x7f2dd815a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:32.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.247+0000 7f2ddcb94640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dd80c06d0 0x7f2dd815a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37518/0 (socket says 172.21.15.133:37518) 2023-12-19T19:02:32.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.247+0000 7f2ddcb94640 1 -- 172.21.15.133:0/584762578 learned_addr learned my addr 172.21.15.133:0/584762578 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:32.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.251+0000 7f2ddd395640 1 --2- 172.21.15.133:0/584762578 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2dd80c63c0 0x7f2dd814fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:32.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.251+0000 7f2dd7fff640 1 --2- 172.21.15.133:0/584762578 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2dd80c4100 0x7f2dd8070830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:32.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.251+0000 7f2ddcb94640 1 -- 172.21.15.133:0/584762578 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2dd80c4100 msgr2=0x7f2dd8070830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:32.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.251+0000 7f2ddcb94640 1 --2- 172.21.15.133:0/584762578 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2dd80c4100 0x7f2dd8070830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.257 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.251+0000 7f2ddcb94640 1 -- 172.21.15.133:0/584762578 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2dd80c63c0 msgr2=0x7f2dd814fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:32.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.251+0000 7f2ddcb94640 1 --2- 172.21.15.133:0/584762578 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2dd80c63c0 0x7f2dd814fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.251+0000 7f2ddcb94640 1 -- 172.21.15.133:0/584762578 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc4009420 con 0x7f2dd80c06d0 2023-12-19T19:02:32.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.251+0000 7f2ddcb94640 1 --2- 172.21.15.133:0/584762578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dd80c06d0 0x7f2dd815a8f0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00c420 tx=0x7f2dcc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:32.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.251+0000 7f2dd57fa640 1 -- 172.21.15.133:0/584762578 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc005cf0 con 0x7f2dd80c06d0 2023-12-19T19:02:32.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.251+0000 7f2dd57fa640 1 -- 172.21.15.133:0/584762578 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dcc005e50 con 0x7f2dd80c06d0 2023-12-19T19:02:32.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.251+0000 7f2ddedf8640 1 -- 172.21.15.133:0/584762578 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd81f1110 con 0x7f2dd80c06d0 2023-12-19T19:02:32.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.251+0000 7f2dd57fa640 1 -- 172.21.15.133:0/584762578 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc0072d0 con 0x7f2dd80c06d0 2023-12-19T19:02:32.258 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.251+0000 7f2ddedf8640 1 -- 172.21.15.133:0/584762578 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd8070d70 con 0x7f2dd80c06d0 2023-12-19T19:02:32.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.251+0000 7f2ddedf8640 1 -- 172.21.15.133:0/584762578 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd8068400 con 0x7f2dd80c06d0 2023-12-19T19:02:32.259 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.251+0000 7f2dd57fa640 1 -- 172.21.15.133:0/584762578 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f2dcc007450 con 0x7f2dd80c06d0 2023-12-19T19:02:32.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.255+0000 7f2dd57fa640 1 --2- 172.21.15.133:0/584762578 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2dbc066470 0x7f2dbc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:32.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.255+0000 7f2dd57fa640 1 -- 172.21.15.133:0/584762578 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f2dcc083190 con 0x7f2dd80c06d0 2023-12-19T19:02:32.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.255+0000 7f2dd7fff640 1 --2- 172.21.15.133:0/584762578 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2dbc066470 0x7f2dbc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:32.260 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.255+0000 7f2dd7fff640 1 --2- 172.21.15.133:0/584762578 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2dbc066470 0x7f2dbc068930 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2dc40ad000 tx=0x7f2dc4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:32.263 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.259+0000 7f2dd57fa640 1 -- 172.21.15.133:0/584762578 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f2dcc050a10 con 0x7f2dd80c06d0 2023-12-19T19:02:32.410 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.403+0000 7f2ddedf8640 1 -- 172.21.15.133:0/584762578 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2dd815b2c0 con 0x7f2dbc066470 2023-12-19T19:02:32.413 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.407+0000 7f2dd57fa640 1 -- 172.21.15.133:0/584762578 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51009 (secure 0 0 0) 0x7f2dd815b2c0 con 0x7f2dbc066470 2023-12-19T19:02:32.414 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:32.415 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T19:02:32.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.407+0000 7f2ddedf8640 1 -- 172.21.15.133:0/584762578 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2dbc066470 msgr2=0x7f2dbc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:32.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.407+0000 7f2ddedf8640 1 --2- 172.21.15.133:0/584762578 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2dbc066470 0x7f2dbc068930 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2dc40ad000 tx=0x7f2dc4008040 comp rx=0 tx=0).stop 2023-12-19T19:02:32.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.407+0000 7f2ddedf8640 1 -- 172.21.15.133:0/584762578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dd80c06d0 msgr2=0x7f2dd815a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:32.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.407+0000 7f2ddedf8640 1 --2- 172.21.15.133:0/584762578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dd80c06d0 0x7f2dd815a8f0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00c420 tx=0x7f2dcc00c8e0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.411+0000 7f2ddedf8640 1 -- 172.21.15.133:0/584762578 shutdown_connections 2023-12-19T19:02:32.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.411+0000 7f2ddedf8640 1 --2- 172.21.15.133:0/584762578 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f2dbc066470 0x7f2dbc068930 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.411+0000 7f2ddedf8640 1 --2- 172.21.15.133:0/584762578 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f2dd80c63c0 0x7f2dd814fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.411+0000 7f2ddedf8640 1 --2- 172.21.15.133:0/584762578 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f2dd80c4100 0x7f2dd8070830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.411+0000 7f2ddedf8640 1 --2- 172.21.15.133:0/584762578 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2dd80c06d0 0x7f2dd815a8f0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.416 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.411+0000 7f2ddedf8640 1 -- 172.21.15.133:0/584762578 >> 172.21.15.133:0/584762578 conn(0x7f2dd806a5b0 msgr2=0x7f2dd815b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:32.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.411+0000 7f2ddedf8640 1 -- 172.21.15.133:0/584762578 shutdown_connections 2023-12-19T19:02:32.417 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.411+0000 7f2ddedf8640 1 -- 172.21.15.133:0/584762578 wait complete. 2023-12-19T19:02:32.434 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2023-12-19T19:02:30.889903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":258204,"kb_used_data":8756,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716516,"statfs":{"total":773094113280,"available":772829712384,"internally_reserved":0,"allocated":8966144,"data_stored":4628961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001605"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":225,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-19T19:02:29.250939+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T19:02:29.250939+0000","last_peered":"2023-12-19T19:02:29.250939+0000","last_clean":"2023-12-19T19:02:29.250939+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T19:02:29.250939+0000","last_undegraded":"2023-12-19T19:02:29.250939+0000","last_fullsized":"2023-12-19T19:02:29.250939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1581056,"data_stored":1027189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.68899999999999995},"min":{"1min":0.44,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92500000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.72399999999999998},"min":{"1min":0.50700000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89300000000000002,"5min":1.117,"15min":1.117},"last":0.61299999999999999}]},{"osd":1,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.46700000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83899999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83399999999999996,"5min":1.01,"15min":1.01},"last":0.67700000000000005}]},{"osd":2,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85499999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.58299999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89500000000000002,"5min":1.089,"15min":1.089},"last":0.86499999999999999}]},{"osd":3,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71299999999999997,"15min":0.72699999999999998},"min":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90900000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73299999999999998,"15min":0.73499999999999999},"min":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91600000000000004,"5min":1.026,"15min":1.026},"last":0.70999999999999996}]},{"osd":4,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64400000000000002,"15min":0.65600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88500000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66700000000000004,"15min":0.67400000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93799999999999994,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.499}]},{"osd":5,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93200000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.70599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91500000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.52500000000000002}]},{"osd":6,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.96799999999999997,"5min":1.069,"15min":1.069},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78000000000000003,"15min":0.79600000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.747}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":431168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.98899999999999999,"5min":1.022,"15min":1.022},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.89800000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.443}]},{"osd":1,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67100000000000004,"15min":0.65700000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.871,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.625},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.52300000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91500000000000004,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.68899999999999995}]},{"osd":2,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.443,"5min":0.437,"15min":0.437},"max":{"1min":0.96299999999999997,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.71999999999999997,"15min":0.71699999999999997},"min":{"1min":0.58099999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94899999999999995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.80400000000000005}]},{"osd":3,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83499999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72199999999999998,"15min":0.72699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91900000000000004,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.56999999999999995}]},{"osd":4,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.48599999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.74099999999999999,"15min":0.755},"min":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95999999999999996,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.76100000000000001}]},{"osd":5,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.93700000000000006,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73199999999999998,"15min":0.73599999999999999},"min":{"1min":0.54600000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.85099999999999998}]},{"osd":7,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.52800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.87},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.78900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":431168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.84399999999999997,"15min":0.92900000000000005},"min":{"1min":0.434,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90900000000000003,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":1.1739999999999999,"15min":1.3959999999999999},"min":{"1min":0.495,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86199999999999999,"5min":16.951000000000001,"15min":16.951000000000001},"last":0.80300000000000005}]},{"osd":1,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":1.222,"15min":1.48},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98299999999999998,"5min":19.823,"15min":19.823},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.67200000000000004},"min":{"1min":0.45800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95899999999999996,"5min":1.657,"15min":1.657},"last":1.4710000000000001}]},{"osd":2,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72899999999999998,"15min":0.751},"min":{"1min":0.47599999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92300000000000004,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71599999999999997,"15min":0.73299999999999998},"min":{"1min":0.49399999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93700000000000006,"5min":1.585,"15min":1.585},"last":0.78100000000000003}]},{"osd":3,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76700000000000002,"15min":0.78700000000000003},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.97199999999999998,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.747},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.91200000000000003,"15min":0.99399999999999999},"min":{"1min":0.58799999999999997,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.89400000000000002,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":0.96999999999999997}]},{"osd":4,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.46300000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92600000000000005,"5min":1.716,"15min":1.716},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.78700000000000003,"15min":0.82299999999999995},"min":{"1min":0.50700000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91700000000000004,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":0.58599999999999997}]},{"osd":6,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.78500000000000003,"15min":0.83699999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85299999999999998,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.79900000000000004,"15min":0.83599999999999997},"min":{"1min":0.52000000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86899999999999999,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.871}]},{"osd":7,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96099999999999997,"5min":2.371,"15min":2.371},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81399999999999995,"15min":0.84099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93500000000000005,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.65100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":436821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.79300000000000004,"15min":0.85899999999999999},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92600000000000005,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67700000000000005,"15min":0.69099999999999995},"min":{"1min":0.47499999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83599999999999997,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.89100000000000001}]},{"osd":1,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.68600000000000005,"15min":0.69799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85399999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.76500000000000001,"15min":0.79800000000000004},"min":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.86399999999999999,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":0.96499999999999997}]},{"osd":2,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.69199999999999995},"min":{"1min":0.504,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.872,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.875},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.76600000000000001,"15min":0.80800000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86399999999999999,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.93799999999999994}]},{"osd":3,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.78200000000000003,"15min":0.83599999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.874,"5min":3.641,"15min":3.641},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.83299999999999996,"15min":0.88500000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91200000000000003,"5min":3.194,"15min":3.194},"last":0.79200000000000004}]},{"osd":5,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.92200000000000004,"15min":1.054},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89200000000000002,"5min":9.3040000000000003,"15min":9.3040000000000003},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69599999999999995,"15min":0.73199999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90800000000000003,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.80400000000000005}]},{"osd":6,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.78700000000000003,"15min":0.83199999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92700000000000005,"5min":3.097,"15min":3.097},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.82299999999999995,"15min":0.877},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89700000000000002,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.77100000000000002}]},{"osd":7,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.879,"15min":0.95899999999999996},"min":{"1min":0.48399999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93200000000000005,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.95399999999999996,"15min":1.052},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94299999999999995,"5min":6.3449999999999998,"15min":6.3449999999999998},"last":0.68100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":431168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72699999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.371},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.36099999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.52000000000000002}]},{"osd":1,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46700000000000003,"15min":0.48499999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60699999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56299999999999994}]},{"osd":2,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.74299999999999999,"5min":0.75,"15min":0.75},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.54700000000000004},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77600000000000002,"5min":0.875,"15min":0.875},"last":0.498}]},{"osd":4,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88400000000000001,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98999999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.73699999999999999}]},{"osd":5,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.50600000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94999999999999996,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.752,"15min":0.77000000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.04,"5min":1.202,"15min":1.202},"last":0.76100000000000001}]},{"osd":6,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96399999999999997,"5min":1.298,"15min":1.298},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.98299999999999998,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.80000000000000004}]},{"osd":7,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94999999999999996,"5min":1.155,"15min":1.155},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93000000000000005,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.78800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":431306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.47399999999999998,"15min":0.5},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53700000000000003,"5min":1.458,"15min":1.458},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.56999999999999995,"15min":0.622},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68799999999999994,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.30299999999999999}]},{"osd":1,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.54600000000000004,"15min":0.58799999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.56899999999999995,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.56799999999999995,"15min":0.61199999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.625,"5min":2.444,"15min":2.444},"last":0.34300000000000003}]},{"osd":3,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.55400000000000005,"15min":0.60599999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.60899999999999999,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.58999999999999997,"15min":0.63200000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65500000000000003,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.36599999999999999}]},{"osd":4,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.88600000000000001,"15min":0.95699999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0189999999999999,"5min":1.968,"15min":1.968},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.84999999999999998,"15min":0.91000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96899999999999997,"5min":2.835,"15min":2.835},"last":0.51300000000000001}]},{"osd":5,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.86399999999999999,"15min":0.93300000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.99099999999999999,"5min":3.5,"15min":3.5},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.86499999999999999,"15min":0.92500000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94999999999999996,"5min":1.996,"15min":1.996},"last":0.54300000000000004}]},{"osd":6,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.86699999999999999,"15min":0.93200000000000005},"min":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0740000000000001,"5min":2.903,"15min":2.903},"last":0.497},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.93000000000000005,"15min":1.0129999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0569999999999999,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.55800000000000005}]},{"osd":7,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.90300000000000002,"15min":0.97099999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1259999999999999,"5min":2.875,"15min":2.875},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.88200000000000001,"15min":0.96099999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95199999999999996,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.59999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":431306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.51800000000000002,"15min":0.56999999999999995},"min":{"1min":0.29699999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73399999999999999,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.67100000000000004,"15min":0.77500000000000002},"min":{"1min":0.31,"5min":0.255,"15min":0.255},"max":{"1min":0.76700000000000002,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.38400000000000001}]},{"osd":2,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.53900000000000003,"15min":0.58499999999999996},"min":{"1min":0.317,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71799999999999997,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.61099999999999999,"15min":0.67400000000000004},"min":{"1min":0.34699999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76800000000000002,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.42199999999999999}]},{"osd":3,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.72299999999999998,"15min":0.81899999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.90700000000000003,"5min":7.8399999999999999,"15min":7.8399999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.746,"15min":0.83799999999999997},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83699999999999997,"5min":7.7949999999999999,"15min":7.7949999999999999},"last":0.44900000000000001}]},{"osd":4,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.81899999999999995,"15min":0.88300000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.871,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.85199999999999998,"15min":0.91400000000000003},"min":{"1min":0.52300000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89300000000000002,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.84799999999999998}]},{"osd":5,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.82999999999999996,"15min":0.89200000000000002},"min":{"1min":0.49399999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93300000000000005,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.84099999999999997,"15min":0.90300000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.996,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.68700000000000006}]},{"osd":6,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.84799999999999998,"15min":0.89600000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95599999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.876,"15min":0.95099999999999996},"min":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.85499999999999998,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.70199999999999996}]},{"osd":7,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.88300000000000001,"15min":0.94999999999999996},"min":{"1min":0.51600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.83299999999999996,"5min":4.3310000000000004,"15min":4.3310000000000004},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.85899999999999999,"15min":0.90900000000000003},"min":{"1min":0.55100000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.92100000000000004,"5min":4.226,"15min":4.226},"last":0.86899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32680,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339160,"statfs":{"total":96636764160,"available":96603299840,"internally_reserved":0,"allocated":1536000,"data_stored":1008835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.436,"15min":0.44800000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60299999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48899999999999999,"15min":0.503},"min":{"1min":0.29799999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65700000000000003,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.626}]},{"osd":2,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.50600000000000001,"15min":0.51300000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63700000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.51100000000000001},"min":{"1min":0.40799999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.436}]},{"osd":3,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48199999999999998,"15min":0.48699999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.55900000000000005,"5min":0.747,"15min":0.747},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.57799999999999996,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69299999999999995,"5min":1.264,"15min":1.264},"last":0.55900000000000005}]},{"osd":4,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.74199999999999999,"15min":0.748},"min":{"1min":0.502,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93999999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89900000000000002,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.52800000000000002}]},{"osd":5,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.749},"min":{"1min":0.57299999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.89300000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79200000000000004,"15min":0.81699999999999995},"min":{"1min":0.57199999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.91000000000000003,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.68300000000000005}]},{"osd":6,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.79600000000000004,"15min":0.82499999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92600000000000005,"5min":1.349,"15min":1.349},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0189999999999999,"5min":1.115,"15min":1.115},"last":0.67000000000000004}]},{"osd":7,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.57499999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94899999999999995,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.79200000000000004,"15min":0.81200000000000006},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.93200000000000005,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.65300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T19:02:32.436 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T19:02:32.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.567+0000 7f9261e32640 1 Processor -- start 2023-12-19T19:02:32.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.567+0000 7f9261e32640 1 -- start start 2023-12-19T19:02:32.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.567+0000 7f9261e32640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f925c0c63c0 0x7f925c0c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:32.574 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.567+0000 7f9261e32640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f925c0c4100 0x7f925c0c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:32.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.567+0000 7f9261e32640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925c0c31c0 con 0x7f925c0c29e0 2023-12-19T19:02:32.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.567+0000 7f9261e32640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f925c0c34a0 con 0x7f925c0c4100 2023-12-19T19:02:32.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.567+0000 7f9261e32640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925c0c1030 con 0x7f925c0c63c0 2023-12-19T19:02:32.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.571+0000 7f925affd640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f925c0c4100 0x7f925c0c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:32.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.571+0000 7f925bfff640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f925c0c29e0 0x7f925c0a9680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:33988/0 (socket says 172.21.15.133:33988) 2023-12-19T19:02:32.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.571+0000 7f925bfff640 1 -- 172.21.15.133:0/903040650 learned_addr learned my addr 172.21.15.133:0/903040650 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:32.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.571+0000 7f925b7fe640 1 --2- 172.21.15.133:0/903040650 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f925c0c63c0 0x7f925c0c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:32.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.571+0000 7f925a7fc640 1 -- 172.21.15.133:0/903040650 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2146004683 0 0) 0x7f925c0c31c0 con 0x7f925c0c29e0 2023-12-19T19:02:32.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.571+0000 7f925a7fc640 1 -- 172.21.15.133:0/903040650 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9244003530 con 0x7f925c0c29e0 2023-12-19T19:02:32.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.571+0000 7f925affd640 1 -- 172.21.15.133:0/903040650 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f925c0c63c0 msgr2=0x7f925c0c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:32.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.571+0000 7f925affd640 1 --2- 172.21.15.133:0/903040650 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f925c0c63c0 0x7f925c0c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.571+0000 7f925affd640 1 -- 172.21.15.133:0/903040650 >> v1:172.21.15.138:6789/0 conn(0x7f925c0c29e0 legacy=0x7f925c0a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:32.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.571+0000 7f925affd640 1 -- 172.21.15.133:0/903040650 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f925c0c1310 con 0x7f925c0c4100 2023-12-19T19:02:32.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.571+0000 7f925affd640 1 --2- 172.21.15.133:0/903040650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f925c0c4100 0x7f925c0c24a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f92500097c0 tx=0x7f925001c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1461ed7d80d63556 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:32.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.571+0000 7f925a7fc640 1 -- 172.21.15.133:0/903040650 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250004230 con 0x7f925c0c4100 2023-12-19T19:02:32.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.571+0000 7f925a7fc640 1 -- 172.21.15.133:0/903040650 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92500a7050 con 0x7f925c0c4100 2023-12-19T19:02:32.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.571+0000 7f925a7fc640 1 -- 172.21.15.133:0/903040650 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9250003620 con 0x7f925c0c4100 2023-12-19T19:02:32.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.575+0000 7f9261e32640 1 -- 172.21.15.133:0/903040650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f925c0c4100 msgr2=0x7f925c0c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:32.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.575+0000 7f9261e32640 1 --2- 172.21.15.133:0/903040650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f925c0c4100 0x7f925c0c24a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f92500097c0 tx=0x7f925001c330 comp rx=0 tx=0).stop 2023-12-19T19:02:32.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.575+0000 7f9261e32640 1 -- 172.21.15.133:0/903040650 shutdown_connections 2023-12-19T19:02:32.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.575+0000 7f9261e32640 1 --2- 172.21.15.133:0/903040650 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f925c0c4100 0x7f925c0c24a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.575+0000 7f9261e32640 1 --2- 172.21.15.133:0/903040650 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f925c0c63c0 0x7f925c0c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.575+0000 7f9261e32640 1 -- 172.21.15.133:0/903040650 >> 172.21.15.133:0/903040650 conn(0x7f925c06a5b0 msgr2=0x7f925c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:32.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.575+0000 7f9261e32640 1 -- 172.21.15.133:0/903040650 shutdown_connections 2023-12-19T19:02:32.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.575+0000 7f9261e32640 1 -- 172.21.15.133:0/903040650 wait complete. 2023-12-19T19:02:32.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.575+0000 7f9261e32640 1 Processor -- start 2023-12-19T19:02:32.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.575+0000 7f9261e32640 1 -- start start 2023-12-19T19:02:32.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.575+0000 7f9261e32640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f925c0c29e0 0x7f925c0bfb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:32.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.575+0000 7f9261e32640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f925c0c4100 0x7f925c1ed620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:32.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.575+0000 7f9261e32640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f925c0c63c0 0x7f925c157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:32.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.575+0000 7f9261e32640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c071e30 con 0x7f925c0c63c0 2023-12-19T19:02:32.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.575+0000 7f9261e32640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925c1eceb0 con 0x7f925c0c4100 2023-12-19T19:02:32.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.575+0000 7f9261e32640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925c15a620 con 0x7f925c0c29e0 2023-12-19T19:02:32.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.575+0000 7f925bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f925c0c63c0 0x7f925c157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:32.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.575+0000 7f925bfff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f925c0c63c0 0x7f925c157d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37530/0 (socket says 172.21.15.133:37530) 2023-12-19T19:02:32.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.575+0000 7f925bfff640 1 -- 172.21.15.133:0/2119144786 learned_addr learned my addr 172.21.15.133:0/2119144786 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:32.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.575+0000 7f925b7fe640 1 --2- 172.21.15.133:0/2119144786 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f925c0c29e0 0x7f925c0bfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:32.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.575+0000 7f925affd640 1 --2- 172.21.15.133:0/2119144786 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f925c0c4100 0x7f925c1ed620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:32.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.579+0000 7f925bfff640 1 -- 172.21.15.133:0/2119144786 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f925c0c29e0 msgr2=0x7f925c0bfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:32.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.579+0000 7f925bfff640 1 --2- 172.21.15.133:0/2119144786 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f925c0c29e0 0x7f925c0bfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.579+0000 7f925bfff640 1 -- 172.21.15.133:0/2119144786 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f925c0c4100 msgr2=0x7f925c1ed620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:32.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.579+0000 7f925bfff640 1 --2- 172.21.15.133:0/2119144786 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f925c0c4100 0x7f925c1ed620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.579+0000 7f925bfff640 1 -- 172.21.15.133:0/2119144786 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9250009420 con 0x7f925c0c63c0 2023-12-19T19:02:32.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.579+0000 7f925bfff640 1 --2- 172.21.15.133:0/2119144786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f925c0c63c0 0x7f925c157d30 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f925400cb70 tx=0x7f925400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:32.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.579+0000 7f9243fff640 1 -- 172.21.15.133:0/2119144786 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925400ad40 con 0x7f925c0c63c0 2023-12-19T19:02:32.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.579+0000 7f9243fff640 1 -- 172.21.15.133:0/2119144786 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9254012400 con 0x7f925c0c63c0 2023-12-19T19:02:32.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.579+0000 7f9261e32640 1 -- 172.21.15.133:0/2119144786 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f925c15a900 con 0x7f925c0c63c0 2023-12-19T19:02:32.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.579+0000 7f9243fff640 1 -- 172.21.15.133:0/2119144786 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925400aea0 con 0x7f925c0c63c0 2023-12-19T19:02:32.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.579+0000 7f9261e32640 1 -- 172.21.15.133:0/2119144786 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f925c0c0050 con 0x7f925c0c63c0 2023-12-19T19:02:32.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.579+0000 7f9261e32640 1 -- 172.21.15.133:0/2119144786 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f925c1ed340 con 0x7f925c0c63c0 2023-12-19T19:02:32.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.579+0000 7f9243fff640 1 -- 172.21.15.133:0/2119144786 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f9254007070 con 0x7f925c0c63c0 2023-12-19T19:02:32.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.579+0000 7f9243fff640 1 --2- 172.21.15.133:0/2119144786 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9248066470 0x7f9248068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:32.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.579+0000 7f9243fff640 1 -- 172.21.15.133:0/2119144786 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9254083ba0 con 0x7f925c0c63c0 2023-12-19T19:02:32.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.583+0000 7f925b7fe640 1 --2- 172.21.15.133:0/2119144786 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9248066470 0x7f9248068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:32.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.583+0000 7f925b7fe640 1 --2- 172.21.15.133:0/2119144786 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9248066470 0x7f9248068930 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f924c009ac0 tx=0x7f924c009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:32.590 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.583+0000 7f9243fff640 1 -- 172.21.15.133:0/2119144786 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f925c1ed340 con 0x7f925c0c63c0 2023-12-19T19:02:32.740 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.735+0000 7f9261e32640 1 -- 172.21.15.133:0/2119144786 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f925c0aa3b0 con 0x7f9248066470 2023-12-19T19:02:32.742 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.735+0000 7f9243fff640 1 -- 172.21.15.133:0/2119144786 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51009 (secure 0 0 0) 0x7f924c0119e0 con 0x7f9248066470 2023-12-19T19:02:32.743 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:32.743 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T19:02:32.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.739+0000 7f9261e32640 1 -- 172.21.15.133:0/2119144786 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9248066470 msgr2=0x7f9248068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:32.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.739+0000 7f9261e32640 1 --2- 172.21.15.133:0/2119144786 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9248066470 0x7f9248068930 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f924c009ac0 tx=0x7f924c009190 comp rx=0 tx=0).stop 2023-12-19T19:02:32.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.739+0000 7f9261e32640 1 -- 172.21.15.133:0/2119144786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f925c0c63c0 msgr2=0x7f925c157d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:32.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.739+0000 7f9261e32640 1 --2- 172.21.15.133:0/2119144786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f925c0c63c0 0x7f925c157d30 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f925400cb70 tx=0x7f925400a430 comp rx=0 tx=0).stop 2023-12-19T19:02:32.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.739+0000 7f9261e32640 1 -- 172.21.15.133:0/2119144786 shutdown_connections 2023-12-19T19:02:32.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.739+0000 7f9261e32640 1 --2- 172.21.15.133:0/2119144786 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f9248066470 0x7f9248068930 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.745 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.739+0000 7f9261e32640 1 --2- 172.21.15.133:0/2119144786 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f925c0c63c0 0x7f925c157d30 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.739+0000 7f9261e32640 1 --2- 172.21.15.133:0/2119144786 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f925c0c4100 0x7f925c1ed620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.739+0000 7f9261e32640 1 --2- 172.21.15.133:0/2119144786 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f925c0c29e0 0x7f925c0bfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.739+0000 7f9261e32640 1 -- 172.21.15.133:0/2119144786 >> 172.21.15.133:0/2119144786 conn(0x7f925c06a5b0 msgr2=0x7f925c06a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:32.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.739+0000 7f9261e32640 1 -- 172.21.15.133:0/2119144786 shutdown_connections 2023-12-19T19:02:32.746 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.739+0000 7f9261e32640 1 -- 172.21.15.133:0/2119144786 wait complete. 2023-12-19T19:02:32.763 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":192,"stamp":"2023-12-19T19:02:30.889903+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":258204,"kb_used_data":8756,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716516,"statfs":{"total":773094113280,"available":772829712384,"internally_reserved":0,"allocated":8966144,"data_stored":4628961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001605"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":225,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-19T19:02:29.250939+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T19:02:29.250939+0000","last_peered":"2023-12-19T19:02:29.250939+0000","last_clean":"2023-12-19T19:02:29.250939+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T19:02:29.250939+0000","last_undegraded":"2023-12-19T19:02:29.250939+0000","last_fullsized":"2023-12-19T19:02:29.250939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1581056,"data_stored":1027189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.68899999999999995},"min":{"1min":0.44,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92500000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.72399999999999998},"min":{"1min":0.50700000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89300000000000002,"5min":1.117,"15min":1.117},"last":0.61299999999999999}]},{"osd":1,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.46700000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83899999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83399999999999996,"5min":1.01,"15min":1.01},"last":0.67700000000000005}]},{"osd":2,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85499999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.58299999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89500000000000002,"5min":1.089,"15min":1.089},"last":0.86499999999999999}]},{"osd":3,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71299999999999997,"15min":0.72699999999999998},"min":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90900000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73299999999999998,"15min":0.73499999999999999},"min":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91600000000000004,"5min":1.026,"15min":1.026},"last":0.70999999999999996}]},{"osd":4,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64400000000000002,"15min":0.65600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88500000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66700000000000004,"15min":0.67400000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93799999999999994,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.499}]},{"osd":5,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93200000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.70599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91500000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.52500000000000002}]},{"osd":6,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.96799999999999997,"5min":1.069,"15min":1.069},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78000000000000003,"15min":0.79600000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.747}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":431168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.98899999999999999,"5min":1.022,"15min":1.022},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.89800000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.443}]},{"osd":1,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67100000000000004,"15min":0.65700000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.871,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.625},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.52300000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91500000000000004,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.68899999999999995}]},{"osd":2,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.443,"5min":0.437,"15min":0.437},"max":{"1min":0.96299999999999997,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.71999999999999997,"15min":0.71699999999999997},"min":{"1min":0.58099999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94899999999999995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.80400000000000005}]},{"osd":3,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83499999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72199999999999998,"15min":0.72699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91900000000000004,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.56999999999999995}]},{"osd":4,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.48599999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.74099999999999999,"15min":0.755},"min":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95999999999999996,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.76100000000000001}]},{"osd":5,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.93700000000000006,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73199999999999998,"15min":0.73599999999999999},"min":{"1min":0.54600000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.85099999999999998}]},{"osd":7,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.52800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.87},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.78900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":431168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.84399999999999997,"15min":0.92900000000000005},"min":{"1min":0.434,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90900000000000003,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":1.1739999999999999,"15min":1.3959999999999999},"min":{"1min":0.495,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86199999999999999,"5min":16.951000000000001,"15min":16.951000000000001},"last":0.80300000000000005}]},{"osd":1,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":1.222,"15min":1.48},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98299999999999998,"5min":19.823,"15min":19.823},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.67200000000000004},"min":{"1min":0.45800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95899999999999996,"5min":1.657,"15min":1.657},"last":1.4710000000000001}]},{"osd":2,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72899999999999998,"15min":0.751},"min":{"1min":0.47599999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92300000000000004,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71599999999999997,"15min":0.73299999999999998},"min":{"1min":0.49399999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93700000000000006,"5min":1.585,"15min":1.585},"last":0.78100000000000003}]},{"osd":3,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76700000000000002,"15min":0.78700000000000003},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.97199999999999998,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.747},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.91200000000000003,"15min":0.99399999999999999},"min":{"1min":0.58799999999999997,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.89400000000000002,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":0.96999999999999997}]},{"osd":4,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.46300000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92600000000000005,"5min":1.716,"15min":1.716},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.78700000000000003,"15min":0.82299999999999995},"min":{"1min":0.50700000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91700000000000004,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":0.58599999999999997}]},{"osd":6,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.78500000000000003,"15min":0.83699999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85299999999999998,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.79900000000000004,"15min":0.83599999999999997},"min":{"1min":0.52000000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86899999999999999,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.871}]},{"osd":7,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96099999999999997,"5min":2.371,"15min":2.371},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81399999999999995,"15min":0.84099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93500000000000005,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.65100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":436821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.79300000000000004,"15min":0.85899999999999999},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92600000000000005,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67700000000000005,"15min":0.69099999999999995},"min":{"1min":0.47499999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83599999999999997,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.89100000000000001}]},{"osd":1,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.68600000000000005,"15min":0.69799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85399999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.76500000000000001,"15min":0.79800000000000004},"min":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.86399999999999999,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":0.96499999999999997}]},{"osd":2,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.69199999999999995},"min":{"1min":0.504,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.872,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.875},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.76600000000000001,"15min":0.80800000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86399999999999999,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.93799999999999994}]},{"osd":3,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.78200000000000003,"15min":0.83599999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.874,"5min":3.641,"15min":3.641},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.83299999999999996,"15min":0.88500000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91200000000000003,"5min":3.194,"15min":3.194},"last":0.79200000000000004}]},{"osd":5,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.92200000000000004,"15min":1.054},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89200000000000002,"5min":9.3040000000000003,"15min":9.3040000000000003},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69599999999999995,"15min":0.73199999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90800000000000003,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.80400000000000005}]},{"osd":6,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.78700000000000003,"15min":0.83199999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92700000000000005,"5min":3.097,"15min":3.097},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.82299999999999995,"15min":0.877},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89700000000000002,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.77100000000000002}]},{"osd":7,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.879,"15min":0.95899999999999996},"min":{"1min":0.48399999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93200000000000005,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.95399999999999996,"15min":1.052},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94299999999999995,"5min":6.3449999999999998,"15min":6.3449999999999998},"last":0.68100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":431168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72699999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.371},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.36099999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.52000000000000002}]},{"osd":1,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46700000000000003,"15min":0.48499999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60699999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56299999999999994}]},{"osd":2,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.74299999999999999,"5min":0.75,"15min":0.75},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.54700000000000004},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77600000000000002,"5min":0.875,"15min":0.875},"last":0.498}]},{"osd":4,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88400000000000001,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98999999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.73699999999999999}]},{"osd":5,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.50600000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94999999999999996,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.752,"15min":0.77000000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.04,"5min":1.202,"15min":1.202},"last":0.76100000000000001}]},{"osd":6,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96399999999999997,"5min":1.298,"15min":1.298},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.98299999999999998,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.80000000000000004}]},{"osd":7,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94999999999999996,"5min":1.155,"15min":1.155},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93000000000000005,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.78800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":431306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.47399999999999998,"15min":0.5},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53700000000000003,"5min":1.458,"15min":1.458},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.56999999999999995,"15min":0.622},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68799999999999994,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.30299999999999999}]},{"osd":1,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.54600000000000004,"15min":0.58799999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.56899999999999995,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.56799999999999995,"15min":0.61199999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.625,"5min":2.444,"15min":2.444},"last":0.34300000000000003}]},{"osd":3,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.55400000000000005,"15min":0.60599999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.60899999999999999,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.58999999999999997,"15min":0.63200000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65500000000000003,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.36599999999999999}]},{"osd":4,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.88600000000000001,"15min":0.95699999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0189999999999999,"5min":1.968,"15min":1.968},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.84999999999999998,"15min":0.91000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96899999999999997,"5min":2.835,"15min":2.835},"last":0.51300000000000001}]},{"osd":5,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.86399999999999999,"15min":0.93300000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.99099999999999999,"5min":3.5,"15min":3.5},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.86499999999999999,"15min":0.92500000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94999999999999996,"5min":1.996,"15min":1.996},"last":0.54300000000000004}]},{"osd":6,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.86699999999999999,"15min":0.93200000000000005},"min":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0740000000000001,"5min":2.903,"15min":2.903},"last":0.497},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.93000000000000005,"15min":1.0129999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0569999999999999,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.55800000000000005}]},{"osd":7,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.90300000000000002,"15min":0.97099999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1259999999999999,"5min":2.875,"15min":2.875},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.88200000000000001,"15min":0.96099999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95199999999999996,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.59999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":431306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.51800000000000002,"15min":0.56999999999999995},"min":{"1min":0.29699999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73399999999999999,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.67100000000000004,"15min":0.77500000000000002},"min":{"1min":0.31,"5min":0.255,"15min":0.255},"max":{"1min":0.76700000000000002,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.38400000000000001}]},{"osd":2,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.53900000000000003,"15min":0.58499999999999996},"min":{"1min":0.317,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71799999999999997,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.61099999999999999,"15min":0.67400000000000004},"min":{"1min":0.34699999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76800000000000002,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.42199999999999999}]},{"osd":3,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.72299999999999998,"15min":0.81899999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.90700000000000003,"5min":7.8399999999999999,"15min":7.8399999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.746,"15min":0.83799999999999997},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83699999999999997,"5min":7.7949999999999999,"15min":7.7949999999999999},"last":0.44900000000000001}]},{"osd":4,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.81899999999999995,"15min":0.88300000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.871,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.85199999999999998,"15min":0.91400000000000003},"min":{"1min":0.52300000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89300000000000002,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.84799999999999998}]},{"osd":5,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.82999999999999996,"15min":0.89200000000000002},"min":{"1min":0.49399999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93300000000000005,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.84099999999999997,"15min":0.90300000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.996,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.68700000000000006}]},{"osd":6,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.84799999999999998,"15min":0.89600000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95599999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.876,"15min":0.95099999999999996},"min":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.85499999999999998,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.70199999999999996}]},{"osd":7,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.88300000000000001,"15min":0.94999999999999996},"min":{"1min":0.51600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.83299999999999996,"5min":4.3310000000000004,"15min":4.3310000000000004},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.85899999999999999,"15min":0.90900000000000003},"min":{"1min":0.55100000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.92100000000000004,"5min":4.226,"15min":4.226},"last":0.86899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32680,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339160,"statfs":{"total":96636764160,"available":96603299840,"internally_reserved":0,"allocated":1536000,"data_stored":1008835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.436,"15min":0.44800000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60299999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48899999999999999,"15min":0.503},"min":{"1min":0.29799999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65700000000000003,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.626}]},{"osd":2,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.50600000000000001,"15min":0.51300000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63700000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.51100000000000001},"min":{"1min":0.40799999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.436}]},{"osd":3,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48199999999999998,"15min":0.48699999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.55900000000000005,"5min":0.747,"15min":0.747},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.57799999999999996,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69299999999999995,"5min":1.264,"15min":1.264},"last":0.55900000000000005}]},{"osd":4,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.74199999999999999,"15min":0.748},"min":{"1min":0.502,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93999999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89900000000000002,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.52800000000000002}]},{"osd":5,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.749},"min":{"1min":0.57299999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.89300000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79200000000000004,"15min":0.81699999999999995},"min":{"1min":0.57199999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.91000000000000003,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.68300000000000005}]},{"osd":6,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.79600000000000004,"15min":0.82499999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92600000000000005,"5min":1.349,"15min":1.349},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0189999999999999,"5min":1.115,"15min":1.115},"last":0.67000000000000004}]},{"osd":7,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.57499999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94899999999999995,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.79200000000000004,"15min":0.81200000000000006},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.93200000000000005,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.65300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T19:02:32.765 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-19T19:02:32.765 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T19:02:32.903 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.899+0000 7f7895daa640 1 Processor -- start 2023-12-19T19:02:32.904 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.899+0000 7f7895daa640 1 -- start start 2023-12-19T19:02:32.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.899+0000 7f7895daa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78900c63c0 0x7f78900c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:32.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.899+0000 7f7895daa640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f78900c4100 0x7f78900c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:32.905 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.899+0000 7f7895daa640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78900c31c0 con 0x7f78900c29e0 2023-12-19T19:02:32.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.899+0000 7f7895daa640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78900c34a0 con 0x7f78900c4100 2023-12-19T19:02:32.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.899+0000 7f7895daa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78900c1030 con 0x7f78900c63c0 2023-12-19T19:02:32.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.899+0000 7f788effd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f78900c4100 0x7f78900c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:32.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.899+0000 7f788effd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f78900c4100 0x7f78900c24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37536/0 (socket says 172.21.15.133:37536) 2023-12-19T19:02:32.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.899+0000 7f788effd640 1 -- 172.21.15.133:0/1545509233 learned_addr learned my addr 172.21.15.133:0/1545509233 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:32.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.899+0000 7f788f7fe640 1 --2- 172.21.15.133:0/1545509233 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78900c63c0 0x7f78900c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:32.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.899+0000 7f788effd640 1 -- 172.21.15.133:0/1545509233 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78900c63c0 msgr2=0x7f78900c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:32.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.899+0000 7f788effd640 1 --2- 172.21.15.133:0/1545509233 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78900c63c0 0x7f78900c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.906 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.899+0000 7f788effd640 1 -- 172.21.15.133:0/1545509233 >> v1:172.21.15.138:6789/0 conn(0x7f78900c29e0 legacy=0x7f78900a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:32.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.899+0000 7f788effd640 1 -- 172.21.15.133:0/1545509233 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78900c1310 con 0x7f78900c4100 2023-12-19T19:02:32.907 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.899+0000 7f788f7fe640 1 --2- 172.21.15.133:0/1545509233 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78900c63c0 0x7f78900c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:32.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.903+0000 7f788effd640 1 --2- 172.21.15.133:0/1545509233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78900c4100 0x7f78900c24a0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f7884009870 tx=0x7f788401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c2aa88a58c8360 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:32.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.903+0000 7f788e7fc640 1 -- 172.21.15.133:0/1545509233 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78840ad640 con 0x7f78900c4100 2023-12-19T19:02:32.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.903+0000 7f788e7fc640 1 -- 172.21.15.133:0/1545509233 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78840ad7a0 con 0x7f78900c4100 2023-12-19T19:02:32.908 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.903+0000 7f788e7fc640 1 -- 172.21.15.133:0/1545509233 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78840adb30 con 0x7f78900c4100 2023-12-19T19:02:32.909 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.903+0000 7f7895daa640 1 -- 172.21.15.133:0/1545509233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78900c4100 msgr2=0x7f78900c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:32.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.903+0000 7f7895daa640 1 --2- 172.21.15.133:0/1545509233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78900c4100 0x7f78900c24a0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f7884009870 tx=0x7f788401c3b0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.903+0000 7f7895daa640 1 -- 172.21.15.133:0/1545509233 shutdown_connections 2023-12-19T19:02:32.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.903+0000 7f7895daa640 1 --2- 172.21.15.133:0/1545509233 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78900c4100 0x7f78900c24a0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.903+0000 7f7895daa640 1 --2- 172.21.15.133:0/1545509233 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78900c63c0 0x7f78900c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.903+0000 7f7895daa640 1 -- 172.21.15.133:0/1545509233 >> 172.21.15.133:0/1545509233 conn(0x7f789006a5b0 msgr2=0x7f789006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:32.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.903+0000 7f7895daa640 1 -- 172.21.15.133:0/1545509233 shutdown_connections 2023-12-19T19:02:32.910 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.903+0000 7f7895daa640 1 -- 172.21.15.133:0/1545509233 wait complete. 2023-12-19T19:02:32.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.903+0000 7f7895daa640 1 Processor -- start 2023-12-19T19:02:32.911 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.903+0000 7f7895daa640 1 -- start start 2023-12-19T19:02:32.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f7895daa640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78900c29e0 0x7f789014ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:32.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f7895daa640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78900c4100 0x7f7890159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:32.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f7895daa640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78900c63c0 0x7f789015a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:32.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f7895daa640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7890158970 con 0x7f78900c4100 2023-12-19T19:02:32.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f7895daa640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7890159930 con 0x7f78900c29e0 2023-12-19T19:02:32.913 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f7895daa640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7890153290 con 0x7f78900c63c0 2023-12-19T19:02:32.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f788effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78900c4100 0x7f7890159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:32.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f788effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78900c4100 0x7f7890159d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37552/0 (socket says 172.21.15.133:37552) 2023-12-19T19:02:32.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f788effd640 1 -- 172.21.15.133:0/2995473587 learned_addr learned my addr 172.21.15.133:0/2995473587 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:32.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f788f7fe640 1 --2- 172.21.15.133:0/2995473587 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78900c29e0 0x7f789014ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:32.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f788ffff640 1 --2- 172.21.15.133:0/2995473587 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78900c63c0 0x7f789015a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:32.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f788effd640 1 -- 172.21.15.133:0/2995473587 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78900c63c0 msgr2=0x7f789015a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:32.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f788effd640 1 --2- 172.21.15.133:0/2995473587 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78900c63c0 0x7f789015a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f788effd640 1 -- 172.21.15.133:0/2995473587 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78900c29e0 msgr2=0x7f789014ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:32.914 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f788effd640 1 --2- 172.21.15.133:0/2995473587 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78900c29e0 0x7f789014ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:32.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f788effd640 1 -- 172.21.15.133:0/2995473587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78840094d0 con 0x7f78900c4100 2023-12-19T19:02:32.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f788f7fe640 1 --2- 172.21.15.133:0/2995473587 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78900c29e0 0x7f789014ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:32.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f788ffff640 1 --2- 172.21.15.133:0/2995473587 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78900c63c0 0x7f789015a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:32.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f788effd640 1 --2- 172.21.15.133:0/2995473587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78900c4100 0x7f7890159d50 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f788401cc50 tx=0x7f7884019150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:32.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f7877fff640 1 -- 172.21.15.133:0/2995473587 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78840b77f0 con 0x7f78900c4100 2023-12-19T19:02:32.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f7877fff640 1 -- 172.21.15.133:0/2995473587 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78840a6040 con 0x7f78900c4100 2023-12-19T19:02:32.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f7895daa640 1 -- 172.21.15.133:0/2995473587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7890154400 con 0x7f78900c4100 2023-12-19T19:02:32.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f7877fff640 1 -- 172.21.15.133:0/2995473587 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78840b7bd0 con 0x7f78900c4100 2023-12-19T19:02:32.915 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f7895daa640 1 -- 172.21.15.133:0/2995473587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78901e9660 con 0x7f78900c4100 2023-12-19T19:02:32.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.907+0000 7f7895daa640 1 -- 172.21.15.133:0/2995473587 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78901e94c0 con 0x7f78900c4100 2023-12-19T19:02:32.916 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.911+0000 7f7877fff640 1 -- 172.21.15.133:0/2995473587 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f78840b7d30 con 0x7f78900c4100 2023-12-19T19:02:32.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.911+0000 7f7877fff640 1 --2- 172.21.15.133:0/2995473587 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f787c0664a0 0x7f787c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:32.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.911+0000 7f7877fff640 1 -- 172.21.15.133:0/2995473587 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f788411e860 con 0x7f78900c4100 2023-12-19T19:02:32.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.911+0000 7f788f7fe640 1 --2- 172.21.15.133:0/2995473587 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f787c0664a0 0x7f787c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:32.917 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.911+0000 7f788f7fe640 1 --2- 172.21.15.133:0/2995473587 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f787c0664a0 0x7f787c068960 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7880008890 tx=0x7f7880008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:32.921 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:32.915+0000 7f7877fff640 1 -- 172.21.15.133:0/2995473587 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f78901e94c0 con 0x7f78900c4100 2023-12-19T19:02:33.069 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.063+0000 7f7895daa640 1 -- 172.21.15.133:0/2995473587 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f78900aa3b0 con 0x7f787c0664a0 2023-12-19T19:02:33.072 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.067+0000 7f7877fff640 1 -- 172.21.15.133:0/2995473587 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51023 (secure 0 0 0) 0x7f788000c040 con 0x7f787c0664a0 2023-12-19T19:02:33.073 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:33.073 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T19:02:33.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.067+0000 7f7895daa640 1 -- 172.21.15.133:0/2995473587 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f787c0664a0 msgr2=0x7f787c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:33.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.067+0000 7f7895daa640 1 --2- 172.21.15.133:0/2995473587 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f787c0664a0 0x7f787c068960 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7880008890 tx=0x7f7880008040 comp rx=0 tx=0).stop 2023-12-19T19:02:33.074 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.067+0000 7f7895daa640 1 -- 172.21.15.133:0/2995473587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78900c4100 msgr2=0x7f7890159d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:33.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.067+0000 7f7895daa640 1 --2- 172.21.15.133:0/2995473587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78900c4100 0x7f7890159d50 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f788401cc50 tx=0x7f7884019150 comp rx=0 tx=0).stop 2023-12-19T19:02:33.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.067+0000 7f7895daa640 1 -- 172.21.15.133:0/2995473587 shutdown_connections 2023-12-19T19:02:33.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.067+0000 7f7895daa640 1 --2- 172.21.15.133:0/2995473587 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f787c0664a0 0x7f787c068960 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:33.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.067+0000 7f7895daa640 1 --2- 172.21.15.133:0/2995473587 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f78900c63c0 0x7f789015a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:33.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.067+0000 7f7895daa640 1 --2- 172.21.15.133:0/2995473587 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f78900c4100 0x7f7890159d50 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:33.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.067+0000 7f7895daa640 1 --2- 172.21.15.133:0/2995473587 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f78900c29e0 0x7f789014ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:33.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.067+0000 7f7895daa640 1 -- 172.21.15.133:0/2995473587 >> 172.21.15.133:0/2995473587 conn(0x7f789006a5b0 msgr2=0x7f789006a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:33.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.067+0000 7f7895daa640 1 -- 172.21.15.133:0/2995473587 shutdown_connections 2023-12-19T19:02:33.075 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.067+0000 7f7895daa640 1 -- 172.21.15.133:0/2995473587 wait complete. 2023-12-19T19:02:33.093 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":193,"stamp":"2023-12-19T19:02:32.890289+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":258228,"kb_used_data":8780,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716492,"statfs":{"total":773094113280,"available":772829687808,"internally_reserved":0,"allocated":8990720,"data_stored":4640643,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001396"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":225,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-19T19:02:29.250939+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T19:02:29.250939+0000","last_peered":"2023-12-19T19:02:29.250939+0000","last_clean":"2023-12-19T19:02:29.250939+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T19:02:29.250939+0000","last_undegraded":"2023-12-19T19:02:29.250939+0000","last_fullsized":"2023-12-19T19:02:29.250939+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1581056,"data_stored":1027189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.68899999999999995},"min":{"1min":0.44,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.92500000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.72399999999999998},"min":{"1min":0.50700000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.89300000000000002,"5min":1.117,"15min":1.117},"last":0.61299999999999999}]},{"osd":1,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.46700000000000003,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83899999999999997,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68200000000000005,"15min":0.68799999999999994},"min":{"1min":0.45200000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83399999999999996,"5min":1.01,"15min":1.01},"last":0.67700000000000005}]},{"osd":2,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85499999999999998,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.58299999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89500000000000002,"5min":1.089,"15min":1.089},"last":0.86499999999999999}]},{"osd":3,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71299999999999997,"15min":0.72699999999999998},"min":{"1min":0.47999999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.90900000000000003,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.73299999999999998,"15min":0.73499999999999999},"min":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.91600000000000004,"5min":1.026,"15min":1.026},"last":0.70999999999999996}]},{"osd":4,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.64400000000000002,"15min":0.65600000000000003},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.88500000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66700000000000004,"15min":0.67400000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.93799999999999994,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.499}]},{"osd":5,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.93200000000000005,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69299999999999995,"15min":0.70599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.91500000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.52500000000000002}]},{"osd":6,"last update":"Tue Dec 19 19:01:34 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.80100000000000005,"15min":0.81399999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.96799999999999997,"5min":1.069,"15min":1.069},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.78000000000000003,"15min":0.79600000000000004},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.747}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":431168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.63800000000000001,"15min":0.63300000000000001},"min":{"1min":0.46600000000000003,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.98899999999999999,"5min":1.022,"15min":1.022},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.70099999999999996,"15min":0.69999999999999996},"min":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.89800000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.443}]},{"osd":1,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.67100000000000004,"15min":0.65700000000000003},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.871,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.625},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.52300000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.91500000000000004,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.68899999999999995}]},{"osd":2,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.443,"5min":0.437,"15min":0.437},"max":{"1min":0.96299999999999997,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.71999999999999997,"15min":0.71699999999999997},"min":{"1min":0.58099999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94899999999999995,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.80400000000000005}]},{"osd":3,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.83499999999999996,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72199999999999998,"15min":0.72699999999999998},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.91900000000000004,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.56999999999999995}]},{"osd":4,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.66200000000000003,"15min":0.67100000000000004},"min":{"1min":0.48599999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.877,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.74099999999999999,"15min":0.755},"min":{"1min":0.47999999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95999999999999996,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.76100000000000001}]},{"osd":5,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.93700000000000006,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73199999999999998,"15min":0.73599999999999999},"min":{"1min":0.54600000000000004,"5min":0.505,"15min":0.505},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.85099999999999998}]},{"osd":7,"last update":"Tue Dec 19 19:01:33 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.755,"15min":0.76300000000000001},"min":{"1min":0.52800000000000002,"5min":0.437,"15min":0.437},"max":{"1min":1,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.87},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.78900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":431168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.84399999999999997,"15min":0.92900000000000005},"min":{"1min":0.434,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90900000000000003,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":1.1739999999999999,"15min":1.3959999999999999},"min":{"1min":0.495,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86199999999999999,"5min":16.951000000000001,"15min":16.951000000000001},"last":0.80300000000000005}]},{"osd":1,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":1.222,"15min":1.48},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98299999999999998,"5min":19.823,"15min":19.823},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.67200000000000004},"min":{"1min":0.45800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95899999999999996,"5min":1.657,"15min":1.657},"last":1.4710000000000001}]},{"osd":2,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72899999999999998,"15min":0.751},"min":{"1min":0.47599999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92300000000000004,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71599999999999997,"15min":0.73299999999999998},"min":{"1min":0.49399999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93700000000000006,"5min":1.585,"15min":1.585},"last":0.78100000000000003}]},{"osd":3,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76700000000000002,"15min":0.78700000000000003},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.97199999999999998,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.747},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.91200000000000003,"15min":0.99399999999999999},"min":{"1min":0.58799999999999997,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.89400000000000002,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":0.96999999999999997}]},{"osd":4,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.46300000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92600000000000005,"5min":1.716,"15min":1.716},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.78700000000000003,"15min":0.82299999999999995},"min":{"1min":0.50700000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91700000000000004,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":0.58599999999999997}]},{"osd":6,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.78500000000000003,"15min":0.83699999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85299999999999998,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.79900000000000004,"15min":0.83599999999999997},"min":{"1min":0.52000000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86899999999999999,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.871}]},{"osd":7,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96099999999999997,"5min":2.371,"15min":2.371},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81399999999999995,"15min":0.84099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93500000000000005,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.65100000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":436821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.79300000000000004,"15min":0.85899999999999999},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92600000000000005,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67700000000000005,"15min":0.69099999999999995},"min":{"1min":0.47499999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83599999999999997,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.89100000000000001}]},{"osd":1,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.68600000000000005,"15min":0.69799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85399999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.76500000000000001,"15min":0.79800000000000004},"min":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.86399999999999999,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":0.96499999999999997}]},{"osd":2,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.69199999999999995},"min":{"1min":0.504,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.872,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.875},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.76600000000000001,"15min":0.80800000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86399999999999999,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.93799999999999994}]},{"osd":3,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.78200000000000003,"15min":0.83599999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.874,"5min":3.641,"15min":3.641},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.83299999999999996,"15min":0.88500000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91200000000000003,"5min":3.194,"15min":3.194},"last":0.79200000000000004}]},{"osd":5,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.92200000000000004,"15min":1.054},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89200000000000002,"5min":9.3040000000000003,"15min":9.3040000000000003},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69599999999999995,"15min":0.73199999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90800000000000003,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.80400000000000005}]},{"osd":6,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.78700000000000003,"15min":0.83199999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92700000000000005,"5min":3.097,"15min":3.097},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.82299999999999995,"15min":0.877},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89700000000000002,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.77100000000000002}]},{"osd":7,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.879,"15min":0.95899999999999996},"min":{"1min":0.48399999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93200000000000005,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.95399999999999996,"15min":1.052},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94299999999999995,"5min":6.3449999999999998,"15min":6.3449999999999998},"last":0.68100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32128,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339712,"statfs":{"total":96636764160,"available":96603865088,"internally_reserved":0,"allocated":970752,"data_stored":431168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72699999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.371},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.36099999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.52000000000000002}]},{"osd":1,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46700000000000003,"15min":0.48499999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60699999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56299999999999994}]},{"osd":2,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.74299999999999999,"5min":0.75,"15min":0.75},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.54700000000000004},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77600000000000002,"5min":0.875,"15min":0.875},"last":0.498}]},{"osd":4,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88400000000000001,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98999999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.73699999999999999}]},{"osd":5,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.50600000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94999999999999996,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.752,"15min":0.77000000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.04,"5min":1.202,"15min":1.202},"last":0.76100000000000001}]},{"osd":6,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96399999999999997,"5min":1.298,"15min":1.298},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.98299999999999998,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.80000000000000004}]},{"osd":7,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94999999999999996,"5min":1.155,"15min":1.155},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93000000000000005,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.78800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":431306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.47399999999999998,"15min":0.5},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53700000000000003,"5min":1.458,"15min":1.458},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.56999999999999995,"15min":0.622},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68799999999999994,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.30299999999999999}]},{"osd":1,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.54600000000000004,"15min":0.58799999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.56899999999999995,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.56799999999999995,"15min":0.61199999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.625,"5min":2.444,"15min":2.444},"last":0.34300000000000003}]},{"osd":3,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.55400000000000005,"15min":0.60599999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.60899999999999999,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.58999999999999997,"15min":0.63200000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65500000000000003,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.36599999999999999}]},{"osd":4,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.88600000000000001,"15min":0.95699999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0189999999999999,"5min":1.968,"15min":1.968},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.84999999999999998,"15min":0.91000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96899999999999997,"5min":2.835,"15min":2.835},"last":0.51300000000000001}]},{"osd":5,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.86399999999999999,"15min":0.93300000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.99099999999999999,"5min":3.5,"15min":3.5},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.86499999999999999,"15min":0.92500000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94999999999999996,"5min":1.996,"15min":1.996},"last":0.54300000000000004}]},{"osd":6,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.86699999999999999,"15min":0.93200000000000005},"min":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0740000000000001,"5min":2.903,"15min":2.903},"last":0.497},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.93000000000000005,"15min":1.0129999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0569999999999999,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.55800000000000005}]},{"osd":7,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.90300000000000002,"15min":0.97099999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1259999999999999,"5min":2.875,"15min":2.875},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.88200000000000001,"15min":0.96099999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95199999999999996,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.59999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32132,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339708,"statfs":{"total":96636764160,"available":96603860992,"internally_reserved":0,"allocated":974848,"data_stored":431306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.51800000000000002,"15min":0.56999999999999995},"min":{"1min":0.29699999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73399999999999999,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.443,"5min":0.67100000000000004,"15min":0.77500000000000002},"min":{"1min":0.31,"5min":0.255,"15min":0.255},"max":{"1min":0.76700000000000002,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.38400000000000001}]},{"osd":2,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.53900000000000003,"15min":0.58499999999999996},"min":{"1min":0.317,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71799999999999997,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.61099999999999999,"15min":0.67400000000000004},"min":{"1min":0.34699999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76800000000000002,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.42199999999999999}]},{"osd":3,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.72299999999999998,"15min":0.81899999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.90700000000000003,"5min":7.8399999999999999,"15min":7.8399999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.746,"15min":0.83799999999999997},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83699999999999997,"5min":7.7949999999999999,"15min":7.7949999999999999},"last":0.44900000000000001}]},{"osd":4,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.81899999999999995,"15min":0.88300000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.871,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.85199999999999998,"15min":0.91400000000000003},"min":{"1min":0.52300000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89300000000000002,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.84799999999999998}]},{"osd":5,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.82999999999999996,"15min":0.89200000000000002},"min":{"1min":0.49399999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93300000000000005,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.84099999999999997,"15min":0.90300000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.996,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.68700000000000006}]},{"osd":6,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.84799999999999998,"15min":0.89600000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95599999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.876,"15min":0.95099999999999996},"min":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.85499999999999998,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.70199999999999996}]},{"osd":7,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.88300000000000001,"15min":0.94999999999999996},"min":{"1min":0.51600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.83299999999999996,"5min":4.3310000000000004,"15min":4.3310000000000004},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.85899999999999999,"15min":0.90900000000000003},"min":{"1min":0.55100000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.92100000000000004,"5min":4.226,"15min":4.226},"last":0.86899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1560576,"data_stored":1020517,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.436,"15min":0.44800000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60299999999999998,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.497},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.48899999999999999,"15min":0.503},"min":{"1min":0.29799999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.65700000000000003,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.36499999999999999}]},{"osd":2,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.50600000000000001,"15min":0.51300000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.63700000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.51100000000000001},"min":{"1min":0.40799999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.66500000000000004}]},{"osd":3,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.48199999999999998,"15min":0.48699999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.55900000000000005,"5min":0.747,"15min":0.747},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.57799999999999996,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.69299999999999995,"5min":1.264,"15min":1.264},"last":0.45600000000000002}]},{"osd":4,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.74199999999999999,"15min":0.748},"min":{"1min":0.502,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93999999999999995,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.754,"15min":0.77600000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.89900000000000002,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.64200000000000002}]},{"osd":5,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73499999999999999,"15min":0.749},"min":{"1min":0.57299999999999995,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.89300000000000002,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.79200000000000004,"15min":0.81699999999999995},"min":{"1min":0.57199999999999995,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.91000000000000003,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.79600000000000004,"15min":0.82499999999999996},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":0.92600000000000005,"5min":1.349,"15min":1.349},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.754,"15min":0.77700000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0189999999999999,"5min":1.115,"15min":1.115},"last":0.85999999999999999}]},{"osd":7,"last update":"Tue Dec 19 19:01:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.77000000000000002,"15min":0.79400000000000004},"min":{"1min":0.57499999999999996,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.94899999999999995,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.79200000000000004,"15min":0.81200000000000006},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.93200000000000005,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.76500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T19:02:33.095 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T19:02:33.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4444232640 1 Processor -- start 2023-12-19T19:02:33.232 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4444232640 1 -- start start 2023-12-19T19:02:33.233 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4444232640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f443c0c7ea0 0x7f443c06b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:33.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4444232640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f443c06b9e0 0x7f443c15f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:33.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4444232640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f443c06c860 con 0x7f443c151e90 2023-12-19T19:02:33.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4444232640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f443c0c8750 con 0x7f443c06b9e0 2023-12-19T19:02:33.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4444232640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443c1552d0 con 0x7f443c0c7ea0 2023-12-19T19:02:33.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4441fce640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f443c151e90 0x7f443c0c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:43836/0 (socket says 172.21.15.133:43836) 2023-12-19T19:02:33.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4441fce640 1 -- 172.21.15.133:0/1148017190 learned_addr learned my addr 172.21.15.133:0/1148017190 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:33.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f44417cd640 1 --2- 172.21.15.133:0/1148017190 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f443c0c7ea0 0x7f443c06b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:33.234 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f44427cf640 1 --2- 172.21.15.133:0/1148017190 >> v2:172.21.15.138:3300/0 conn(0x7f443c06b9e0 0x7f443c15f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:33.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4440fcc640 1 -- 172.21.15.133:0/1148017190 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213266389 0 0) 0x7f443c06c860 con 0x7f443c151e90 2023-12-19T19:02:33.235 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4440fcc640 1 -- 172.21.15.133:0/1148017190 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4428003530 con 0x7f443c151e90 2023-12-19T19:02:33.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4440fcc640 1 -- 172.21.15.133:0/1148017190 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2771977890 0 0) 0x7f4428003530 con 0x7f443c151e90 2023-12-19T19:02:33.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4440fcc640 1 -- 172.21.15.133:0/1148017190 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f443c0c7ea0 msgr2=0x7f443c06b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:33.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4440fcc640 1 --2- 172.21.15.133:0/1148017190 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f443c0c7ea0 0x7f443c06b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:33.236 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4440fcc640 1 -- 172.21.15.133:0/1148017190 >> v2:172.21.15.138:3300/0 conn(0x7f443c06b9e0 msgr2=0x7f443c15f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:33.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4440fcc640 1 --2- 172.21.15.133:0/1148017190 >> v2:172.21.15.138:3300/0 conn(0x7f443c06b9e0 0x7f443c15f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:33.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4440fcc640 1 -- 172.21.15.133:0/1148017190 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c154930 con 0x7f443c151e90 2023-12-19T19:02:33.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4440fcc640 1 -- 172.21.15.133:0/1148017190 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f4438001680 con 0x7f443c151e90 2023-12-19T19:02:33.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4440fcc640 1 -- 172.21.15.133:0/1148017190 >> v1:172.21.15.133:6789/0 conn(0x7f443c151e90 legacy=0x7f443c0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:33.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4440fcc640 1 --2- 172.21.15.133:0/1148017190 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4428003980 0x7f4428003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:33.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4440fcc640 1 --2- 172.21.15.133:0/1148017190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44280047d0 0x7f4428004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:33.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4440fcc640 1 --2- 172.21.15.133:0/1148017190 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f443c0c7ea0 0x7f4428005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:33.237 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4440fcc640 1 -- 172.21.15.133:0/1148017190 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c0c8750 con 0x7f44280047d0 2023-12-19T19:02:33.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4440fcc640 1 -- 172.21.15.133:0/1148017190 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c1552d0 con 0x7f4428003980 2023-12-19T19:02:33.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4440fcc640 1 -- 172.21.15.133:0/1148017190 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442800ba70 con 0x7f443c0c7ea0 2023-12-19T19:02:33.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f44417cd640 1 --2- 172.21.15.133:0/1148017190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44280047d0 0x7f4428004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:33.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f4441fce640 1 --2- 172.21.15.133:0/1148017190 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4428003980 0x7f4428003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:33.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.227+0000 7f44427cf640 1 --2- 172.21.15.133:0/1148017190 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f443c0c7ea0 0x7f4428005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:33.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.231+0000 7f4441fce640 1 -- 172.21.15.133:0/1148017190 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f443c0c7ea0 msgr2=0x7f4428005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:33.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.231+0000 7f4441fce640 1 --2- 172.21.15.133:0/1148017190 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f443c0c7ea0 0x7f4428005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:33.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.231+0000 7f4441fce640 1 -- 172.21.15.133:0/1148017190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44280047d0 msgr2=0x7f4428004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:33.238 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.231+0000 7f4441fce640 1 --2- 172.21.15.133:0/1148017190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44280047d0 0x7f4428004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:33.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.231+0000 7f4441fce640 1 -- 172.21.15.133:0/1148017190 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4428003530 con 0x7f4428003980 2023-12-19T19:02:33.239 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.231+0000 7f44417cd640 1 --2- 172.21.15.133:0/1148017190 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f44280047d0 0x7f4428004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:02:33.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.231+0000 7f4441fce640 1 --2- 172.21.15.133:0/1148017190 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4428003980 0x7f4428003da0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f443800c0e0 tx=0x7f443801cb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e7ed43937442ca6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:33.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.231+0000 7f4440fcc640 1 -- 172.21.15.133:0/1148017190 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44380058e0 con 0x7f4428003980 2023-12-19T19:02:33.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.231+0000 7f4440fcc640 1 -- 172.21.15.133:0/1148017190 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4438005a60 con 0x7f4428003980 2023-12-19T19:02:33.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.231+0000 7f4440fcc640 1 -- 172.21.15.133:0/1148017190 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4438005e10 con 0x7f4428003980 2023-12-19T19:02:33.240 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f4444232640 1 -- 172.21.15.133:0/1148017190 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4428003980 msgr2=0x7f4428003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:33.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f4444232640 1 --2- 172.21.15.133:0/1148017190 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f4428003980 0x7f4428003da0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f443800c0e0 tx=0x7f443801cb40 comp rx=0 tx=0).stop 2023-12-19T19:02:33.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f44427cf640 1 -- 172.21.15.133:0/1148017190 reap_dead start 2023-12-19T19:02:33.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f4444232640 1 -- 172.21.15.133:0/1148017190 shutdown_connections 2023-12-19T19:02:33.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f4444232640 1 -- 172.21.15.133:0/1148017190 >> 172.21.15.133:0/1148017190 conn(0x7f443c0ca170 msgr2=0x7f443c0ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:33.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f4444232640 1 -- 172.21.15.133:0/1148017190 shutdown_connections 2023-12-19T19:02:33.241 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f4444232640 1 -- 172.21.15.133:0/1148017190 wait complete. 2023-12-19T19:02:33.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f4444232640 1 Processor -- start 2023-12-19T19:02:33.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f4444232640 1 -- start start 2023-12-19T19:02:33.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f4444232640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4428003980 0x7f443c157f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:33.243 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f4444232640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f443c0c0ba0 0x7f443c1efe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:33.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f4444232640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f443c0c38f0 0x7f443c1f0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:33.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f4444232640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c0c40d0 con 0x7f443c0c38f0 2023-12-19T19:02:33.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f4444232640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443c0c0480 con 0x7f443c0c0ba0 2023-12-19T19:02:33.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f4444232640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443c0c3df0 con 0x7f4428003980 2023-12-19T19:02:33.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f44427cf640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f443c0c38f0 0x7f443c1f0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:33.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f44427cf640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f443c0c38f0 0x7f443c1f0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:37578/0 (socket says 172.21.15.133:37578) 2023-12-19T19:02:33.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f44427cf640 1 -- 172.21.15.133:0/3153731597 learned_addr learned my addr 172.21.15.133:0/3153731597 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:33.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f4441fce640 1 --2- 172.21.15.133:0/3153731597 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4428003980 0x7f443c157f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:33.244 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f44417cd640 1 --2- 172.21.15.133:0/3153731597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f443c0c0ba0 0x7f443c1efe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:33.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f44427cf640 1 -- 172.21.15.133:0/3153731597 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4428003980 msgr2=0x7f443c157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:33.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f44427cf640 1 --2- 172.21.15.133:0/3153731597 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4428003980 0x7f443c157f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:33.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f44427cf640 1 -- 172.21.15.133:0/3153731597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f443c0c0ba0 msgr2=0x7f443c1efe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:33.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f44427cf640 1 --2- 172.21.15.133:0/3153731597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f443c0c0ba0 0x7f443c1efe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:33.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.235+0000 7f44427cf640 1 -- 172.21.15.133:0/3153731597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f443c0aaf60 con 0x7f443c0c38f0 2023-12-19T19:02:33.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.239+0000 7f44427cf640 1 --2- 172.21.15.133:0/3153731597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f443c0c38f0 0x7f443c1f0370 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f443c06a9b0 tx=0x7f443400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:33.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.239+0000 7f44327fc640 1 -- 172.21.15.133:0/3153731597 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443400e040 con 0x7f443c0c38f0 2023-12-19T19:02:33.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.239+0000 7f44327fc640 1 -- 172.21.15.133:0/3153731597 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443400f040 con 0x7f443c0c38f0 2023-12-19T19:02:33.245 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.239+0000 7f44327fc640 1 -- 172.21.15.133:0/3153731597 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4434015670 con 0x7f443c0c38f0 2023-12-19T19:02:33.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.239+0000 7f4444232640 1 -- 172.21.15.133:0/3153731597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f443c0ab240 con 0x7f443c0c38f0 2023-12-19T19:02:33.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.239+0000 7f4444232640 1 -- 172.21.15.133:0/3153731597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f443c158480 con 0x7f443c0c38f0 2023-12-19T19:02:33.246 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.239+0000 7f4444232640 1 -- 172.21.15.133:0/3153731597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f443c0aadc0 con 0x7f443c0c38f0 2023-12-19T19:02:33.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.239+0000 7f44327fc640 1 -- 172.21.15.133:0/3153731597 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f44340157d0 con 0x7f443c0c38f0 2023-12-19T19:02:33.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.239+0000 7f44327fc640 1 --2- 172.21.15.133:0/3153731597 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f44200664a0 0x7f4420068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:33.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.239+0000 7f44327fc640 1 -- 172.21.15.133:0/3153731597 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f44340841b0 con 0x7f443c0c38f0 2023-12-19T19:02:33.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.239+0000 7f4441fce640 1 --2- 172.21.15.133:0/3153731597 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f44200664a0 0x7f4420068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:33.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.243+0000 7f4441fce640 1 --2- 172.21.15.133:0/3153731597 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f44200664a0 0x7f4420068960 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f44380aa000 tx=0x7f44380019b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:33.250 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.243+0000 7f44327fc640 1 -- 172.21.15.133:0/3153731597 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f443c0aadc0 con 0x7f443c0c38f0 2023-12-19T19:02:33.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.395+0000 7f4444232640 1 -- 172.21.15.133:0/3153731597 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f443c0aadc0 con 0x7f443c0c38f0 2023-12-19T19:02:33.400 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.395+0000 7f44327fc640 1 -- 172.21.15.133:0/3153731597 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+13157 (secure 0 0 0) 0x7f443c0aadc0 con 0x7f443c0c38f0 2023-12-19T19:02:33.401 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:33.401 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":79,"fsid":"03e63958-005e-4bf2-ae5b-291aceb6fbbf","created":"2023-12-19T18:58:17.814385+0000","modified":"2023-12-19T19:02:30.245400+0000","last_up_change":"2023-12-19T18:58:30.115818+0000","last_in_change":"2023-12-19T18:58:20.321740+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T18:58:30.894083+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8c2e9cd-28d1-4571-be11-049752ec6b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6825","nonce":522902042}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6826","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6827","nonce":522902042}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6830","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6831","nonce":522902042}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6828","nonce":522902042},{"type":"v1","addr":"172.21.15.133:6829","nonce":522902042}]},"public_addr":"172.21.15.133:6825/522902042","cluster_addr":"172.21.15.133:6827/522902042","heartbeat_back_addr":"172.21.15.133:6831/522902042","heartbeat_front_addr":"172.21.15.133:6829/522902042","state":["exists","up"]},{"osd":1,"uuid":"dd512604-37d9-45fd-80b5-6ed8cf3e768f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6817","nonce":1006296948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6819","nonce":1006296948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6823","nonce":1006296948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":1006296948},{"type":"v1","addr":"172.21.15.133:6821","nonce":1006296948}]},"public_addr":"172.21.15.133:6817/1006296948","cluster_addr":"172.21.15.133:6819/1006296948","heartbeat_back_addr":"172.21.15.133:6823/1006296948","heartbeat_front_addr":"172.21.15.133:6821/1006296948","state":["exists","up"]},{"osd":2,"uuid":"df52ee94-3b99-4b0f-b79f-605737675bed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6801","nonce":2461607163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6803","nonce":2461607163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6807","nonce":2461607163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":2461607163},{"type":"v1","addr":"172.21.15.133:6805","nonce":2461607163}]},"public_addr":"172.21.15.133:6801/2461607163","cluster_addr":"172.21.15.133:6803/2461607163","heartbeat_back_addr":"172.21.15.133:6807/2461607163","heartbeat_front_addr":"172.21.15.133:6805/2461607163","state":["exists","up"]},{"osd":3,"uuid":"d6c8a62c-7fc9-475d-a9b4-b48d4bc43043","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6809","nonce":829250353}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6811","nonce":829250353}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6815","nonce":829250353}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":829250353},{"type":"v1","addr":"172.21.15.133:6813","nonce":829250353}]},"public_addr":"172.21.15.133:6809/829250353","cluster_addr":"172.21.15.133:6811/829250353","heartbeat_back_addr":"172.21.15.133:6815/829250353","heartbeat_front_addr":"172.21.15.133:6813/829250353","state":["exists","up"]},{"osd":4,"uuid":"3df6c9b2-a431-4825-80ad-9b46e58fed89","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6801","nonce":3351784616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6803","nonce":3351784616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6807","nonce":3351784616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":3351784616},{"type":"v1","addr":"172.21.15.138:6805","nonce":3351784616}]},"public_addr":"172.21.15.138:6801/3351784616","cluster_addr":"172.21.15.138:6803/3351784616","heartbeat_back_addr":"172.21.15.138:6807/3351784616","heartbeat_front_addr":"172.21.15.138:6805/3351784616","state":["exists","up"]},{"osd":5,"uuid":"4e19068c-54e3-4daf-930c-bb0d13a64896","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6809","nonce":2638336882}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6811","nonce":2638336882}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6815","nonce":2638336882}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":2638336882},{"type":"v1","addr":"172.21.15.138:6813","nonce":2638336882}]},"public_addr":"172.21.15.138:6809/2638336882","cluster_addr":"172.21.15.138:6811/2638336882","heartbeat_back_addr":"172.21.15.138:6815/2638336882","heartbeat_front_addr":"172.21.15.138:6813/2638336882","state":["exists","up"]},{"osd":6,"uuid":"93fa8d4c-4d3f-4011-a527-1600d354164d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6817","nonce":2860949089}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6819","nonce":2860949089}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6823","nonce":2860949089}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":2860949089},{"type":"v1","addr":"172.21.15.138:6821","nonce":2860949089}]},"public_addr":"172.21.15.138:6817/2860949089","cluster_addr":"172.21.15.138:6819/2860949089","heartbeat_back_addr":"172.21.15.138:6823/2860949089","heartbeat_front_addr":"172.21.15.138:6821/2860949089","state":["exists","up"]},{"osd":7,"uuid":"b40a1b04-ffa3-4a47-9b65-db90dd8e7054","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6825","nonce":2464037857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6827","nonce":2464037857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6831","nonce":2464037857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2464037857},{"type":"v1","addr":"172.21.15.138:6829","nonce":2464037857}]},"public_addr":"172.21.15.138:6825/2464037857","cluster_addr":"172.21.15.138:6827/2464037857","heartbeat_back_addr":"172.21.15.138:6831/2464037857","heartbeat_front_addr":"172.21.15.138:6829/2464037857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.061011+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.995130+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.828919+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.838298+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:25.962253+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.094182+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.071077+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T18:58:26.017175+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.138:6837/1466041773":"2023-12-20T19:02:27.238212+0000","172.21.15.133:6834/2813206606":"2023-12-20T19:02:20.729934+0000","172.21.15.138:6836/1466041773":"2023-12-20T19:02:27.238212+0000","172.21.15.133:6832/2813206606":"2023-12-20T19:02:20.729934+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T19:02:33.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.395+0000 7f4444232640 1 -- 172.21.15.133:0/3153731597 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f44200664a0 msgr2=0x7f4420068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:33.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.395+0000 7f4444232640 1 --2- 172.21.15.133:0/3153731597 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f44200664a0 0x7f4420068960 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f44380aa000 tx=0x7f44380019b0 comp rx=0 tx=0).stop 2023-12-19T19:02:33.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.395+0000 7f4444232640 1 -- 172.21.15.133:0/3153731597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f443c0c38f0 msgr2=0x7f443c1f0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:33.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.395+0000 7f4444232640 1 --2- 172.21.15.133:0/3153731597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f443c0c38f0 0x7f443c1f0370 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f443c06a9b0 tx=0x7f443400f580 comp rx=0 tx=0).stop 2023-12-19T19:02:33.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.395+0000 7f4444232640 1 -- 172.21.15.133:0/3153731597 shutdown_connections 2023-12-19T19:02:33.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.395+0000 7f4444232640 1 --2- 172.21.15.133:0/3153731597 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f44200664a0 0x7f4420068960 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:33.403 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.395+0000 7f4444232640 1 --2- 172.21.15.133:0/3153731597 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f443c0c38f0 0x7f443c1f0370 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:33.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.395+0000 7f4444232640 1 --2- 172.21.15.133:0/3153731597 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f443c0c0ba0 0x7f443c1efe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:33.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.395+0000 7f4444232640 1 --2- 172.21.15.133:0/3153731597 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f4428003980 0x7f443c157f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:33.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.395+0000 7f4444232640 1 -- 172.21.15.133:0/3153731597 >> 172.21.15.133:0/3153731597 conn(0x7f443c0ca170 msgr2=0x7f443c0c4820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:33.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.395+0000 7f4444232640 1 -- 172.21.15.133:0/3153731597 shutdown_connections 2023-12-19T19:02:33.404 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:33.395+0000 7f4444232640 1 -- 172.21.15.133:0/3153731597 wait complete. 2023-12-19T19:02:34.422 INFO:tasks.ceph:Scrubbing osd.0 2023-12-19T19:02:34.422 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-19T19:02:34.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.563+0000 7fd477efe640 1 Processor -- start 2023-12-19T19:02:34.571 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd477efe640 1 -- start start 2023-12-19T19:02:34.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd477efe640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fd4700724c0 0x7fd47006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:34.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd477efe640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4700c5ba0 con 0x7fd47014f9f0 2023-12-19T19:02:34.572 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd477efe640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47006c160 con 0x7fd4700c07b0 2023-12-19T19:02:34.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd477efe640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47006e320 con 0x7fd4700724c0 2023-12-19T19:02:34.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd475c9a640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fd47014f9f0 0x7fd4700c27d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52038/0 (socket says 172.21.15.133:52038) 2023-12-19T19:02:34.573 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd475c9a640 1 -- 172.21.15.133:0/3976144966 learned_addr learned my addr 172.21.15.133:0/3976144966 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:34.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd47649b640 1 --2- 172.21.15.133:0/3976144966 >> v2:172.21.15.138:3300/0 conn(0x7fd4700724c0 0x7fd47006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:34.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd474c98640 1 -- 172.21.15.133:0/3976144966 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444853663 0 0) 0x7fd46c001120 con 0x7fd47014f9f0 2023-12-19T19:02:34.575 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd474c98640 1 -- 172.21.15.133:0/3976144966 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd45c003530 con 0x7fd47014f9f0 2023-12-19T19:02:34.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd474c98640 1 -- 172.21.15.133:0/3976144966 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 520004084 0 0) 0x7fd47006c160 con 0x7fd4700c07b0 2023-12-19T19:02:34.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd474c98640 1 -- 172.21.15.133:0/3976144966 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd46c001120 con 0x7fd4700c07b0 2023-12-19T19:02:34.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd474c98640 1 -- 172.21.15.133:0/3976144966 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 410671001 0 0) 0x7fd45c003530 con 0x7fd47014f9f0 2023-12-19T19:02:34.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd474c98640 1 -- 172.21.15.133:0/3976144966 >> v2:172.21.15.138:3300/0 conn(0x7fd4700724c0 msgr2=0x7fd47006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:34.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd474c98640 1 --2- 172.21.15.133:0/3976144966 >> v2:172.21.15.138:3300/0 conn(0x7fd4700724c0 0x7fd47006dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:34.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd474c98640 1 -- 172.21.15.133:0/3976144966 >> v1:172.21.15.138:6789/0 conn(0x7fd4700c07b0 legacy=0x7fd47006d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:34.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd474c98640 1 -- 172.21.15.133:0/3976144966 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4700c5410 con 0x7fd47014f9f0 2023-12-19T19:02:34.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd474c98640 1 -- 172.21.15.133:0/3976144966 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7fd46c001810 con 0x7fd47014f9f0 2023-12-19T19:02:34.576 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd47649b640 1 --2- 172.21.15.133:0/3976144966 >> v2:172.21.15.138:3300/0 conn(0x7fd4700724c0 0x7fd47006dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T19:02:34.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd474c98640 1 -- 172.21.15.133:0/3976144966 >> v1:172.21.15.133:6789/0 conn(0x7fd47014f9f0 legacy=0x7fd4700c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:34.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd474c98640 1 --2- 172.21.15.133:0/3976144966 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd45c003b10 0x7fd45c003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:34.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd474c98640 1 --2- 172.21.15.133:0/3976144966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd45c0047d0 0x7fd45c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:34.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd474c98640 1 --2- 172.21.15.133:0/3976144966 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd45c005200 0x7fd45c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:34.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd474c98640 1 -- 172.21.15.133:0/3976144966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c00c130 con 0x7fd45c0047d0 2023-12-19T19:02:34.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd474c98640 1 -- 172.21.15.133:0/3976144966 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c00c2a0 con 0x7fd45c005200 2023-12-19T19:02:34.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd474c98640 1 -- 172.21.15.133:0/3976144966 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c00c460 con 0x7fd45c003b10 2023-12-19T19:02:34.577 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd475499640 1 --2- 172.21.15.133:0/3976144966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd45c0047d0 0x7fd45c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:34.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd475c9a640 1 --2- 172.21.15.133:0/3976144966 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd45c003b10 0x7fd45c003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:34.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd47649b640 1 --2- 172.21.15.133:0/3976144966 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd45c005200 0x7fd45c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:34.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd475499640 1 -- 172.21.15.133:0/3976144966 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd45c003b10 msgr2=0x7fd45c003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:34.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd475499640 1 --2- 172.21.15.133:0/3976144966 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd45c003b10 0x7fd45c003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:34.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd475499640 1 -- 172.21.15.133:0/3976144966 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd45c005200 msgr2=0x7fd45c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:34.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd475499640 1 --2- 172.21.15.133:0/3976144966 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd45c005200 0x7fd45c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:34.578 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd475499640 1 -- 172.21.15.133:0/3976144966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd45c003530 con 0x7fd45c0047d0 2023-12-19T19:02:34.579 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.567+0000 7fd47649b640 1 -- 172.21.15.133:0/3976144966 reap_dead start 2023-12-19T19:02:34.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.571+0000 7fd475499640 1 --2- 172.21.15.133:0/3976144966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd45c0047d0 0x7fd45c004c50 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fd4600018d0 tx=0x7fd46001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4462b512476523b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:34.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.571+0000 7fd474c98640 1 -- 172.21.15.133:0/3976144966 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4600050d0 con 0x7fd45c0047d0 2023-12-19T19:02:34.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.571+0000 7fd474c98640 1 -- 172.21.15.133:0/3976144966 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd460005250 con 0x7fd45c0047d0 2023-12-19T19:02:34.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.571+0000 7fd474c98640 1 -- 172.21.15.133:0/3976144966 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd460003600 con 0x7fd45c0047d0 2023-12-19T19:02:34.580 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.571+0000 7fd477efe640 1 -- 172.21.15.133:0/3976144966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd45c0047d0 msgr2=0x7fd45c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:34.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.571+0000 7fd477efe640 1 --2- 172.21.15.133:0/3976144966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd45c0047d0 0x7fd45c004c50 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fd4600018d0 tx=0x7fd46001c4d0 comp rx=0 tx=0).stop 2023-12-19T19:02:34.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.571+0000 7fd477efe640 1 -- 172.21.15.133:0/3976144966 shutdown_connections 2023-12-19T19:02:34.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.571+0000 7fd477efe640 1 --2- 172.21.15.133:0/3976144966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd45c0047d0 0x7fd45c004c50 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:34.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.571+0000 7fd477efe640 1 -- 172.21.15.133:0/3976144966 >> 172.21.15.133:0/3976144966 conn(0x7fd4700c5d40 msgr2=0x7fd4700c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:34.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.571+0000 7fd477efe640 1 -- 172.21.15.133:0/3976144966 shutdown_connections 2023-12-19T19:02:34.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.571+0000 7fd477efe640 1 -- 172.21.15.133:0/3976144966 wait complete. 2023-12-19T19:02:34.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd477efe640 1 Processor -- start 2023-12-19T19:02:34.581 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd477efe640 1 -- start start 2023-12-19T19:02:34.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd477efe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd45c0047d0 0x7fd47014e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:34.583 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd477efe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd470156810 0x7fd470146e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:34.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd477efe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4701efbd0 0x7fd4701473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:34.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd477efe640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd470154300 con 0x7fd4701efbd0 2023-12-19T19:02:34.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd477efe640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4701ed410 con 0x7fd470156810 2023-12-19T19:02:34.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd477efe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4701ec800 con 0x7fd45c0047d0 2023-12-19T19:02:34.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd47649b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4701efbd0 0x7fd4701473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:34.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd47649b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4701efbd0 0x7fd4701473b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60962/0 (socket says 172.21.15.133:60962) 2023-12-19T19:02:34.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd47649b640 1 -- 172.21.15.133:0/3853680044 learned_addr learned my addr 172.21.15.133:0/3853680044 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:34.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd475499640 1 --2- 172.21.15.133:0/3853680044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd470156810 0x7fd470146e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:34.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd475c9a640 1 --2- 172.21.15.133:0/3853680044 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd45c0047d0 0x7fd47014e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:34.584 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd47649b640 1 -- 172.21.15.133:0/3853680044 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd45c0047d0 msgr2=0x7fd47014e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:34.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd47649b640 1 --2- 172.21.15.133:0/3853680044 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fd45c0047d0 0x7fd47014e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:34.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd47649b640 1 -- 172.21.15.133:0/3853680044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd470156810 msgr2=0x7fd470146e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:34.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd47649b640 1 --2- 172.21.15.133:0/3853680044 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fd470156810 0x7fd470146e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:34.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd47649b640 1 -- 172.21.15.133:0/3853680044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4701ecae0 con 0x7fd4701efbd0 2023-12-19T19:02:34.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd47649b640 1 --2- 172.21.15.133:0/3853680044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4701efbd0 0x7fd4701473b0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fd4700c6b20 tx=0x7fd46800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:34.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd4667fc640 1 -- 172.21.15.133:0/3853680044 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46801c070 con 0x7fd4701efbd0 2023-12-19T19:02:34.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd4667fc640 1 -- 172.21.15.133:0/3853680044 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46800f040 con 0x7fd4701efbd0 2023-12-19T19:02:34.585 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd4667fc640 1 -- 172.21.15.133:0/3853680044 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46800e040 con 0x7fd4701efbd0 2023-12-19T19:02:34.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd477efe640 1 -- 172.21.15.133:0/3853680044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4701ecdc0 con 0x7fd4701efbd0 2023-12-19T19:02:34.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd477efe640 1 -- 172.21.15.133:0/3853680044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd47014ea10 con 0x7fd4701efbd0 2023-12-19T19:02:34.586 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.575+0000 7fd477efe640 1 -- 172.21.15.133:0/3853680044 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd4700c4fb0 con 0x7fd4701efbd0 2023-12-19T19:02:34.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.579+0000 7fd4667fc640 1 -- 172.21.15.133:0/3853680044 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fd468015430 con 0x7fd4701efbd0 2023-12-19T19:02:34.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.579+0000 7fd4667fc640 1 --2- 172.21.15.133:0/3853680044 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd4540664a0 0x7fd454068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:34.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.579+0000 7fd4667fc640 1 -- 172.21.15.133:0/3853680044 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd4680839b0 con 0x7fd4701efbd0 2023-12-19T19:02:34.587 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.579+0000 7fd4667fc640 1 --2- 172.21.15.133:0/3853680044 >> [v2:172.21.15.133:6824/522902042,v1:172.21.15.133:6825/522902042] conn(0x7fd45406c3a0 0x7fd45406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:34.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.579+0000 7fd4667fc640 1 -- 172.21.15.133:0/3853680044 --> [v2:172.21.15.133:6824/522902042,v1:172.21.15.133:6825/522902042] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd45406ee70 con 0x7fd45406c3a0 2023-12-19T19:02:34.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.579+0000 7fd4667fc640 1 -- 172.21.15.133:0/3853680044 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4680882c0 con 0x7fd4701efbd0 2023-12-19T19:02:34.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.579+0000 7fd475c9a640 1 --2- 172.21.15.133:0/3853680044 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd4540664a0 0x7fd454068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:34.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.579+0000 7fd475499640 1 --2- 172.21.15.133:0/3853680044 >> [v2:172.21.15.133:6824/522902042,v1:172.21.15.133:6825/522902042] conn(0x7fd45406c3a0 0x7fd45406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:34.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.579+0000 7fd475c9a640 1 --2- 172.21.15.133:0/3853680044 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd4540664a0 0x7fd454068960 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd47014f420 tx=0x7fd46c0079b0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:34.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.579+0000 7fd475499640 1 --2- 172.21.15.133:0/3853680044 >> [v2:172.21.15.133:6824/522902042,v1:172.21.15.133:6825/522902042] conn(0x7fd45406c3a0 0x7fd45406e7c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:34.588 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.579+0000 7fd4667fc640 1 -- 172.21.15.133:0/3853680044 <== osd.0 v2:172.21.15.133:6824/522902042 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd45406ee70 con 0x7fd45406c3a0 2023-12-19T19:02:34.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.595+0000 7fd477efe640 1 -- 172.21.15.133:0/3853680044 --> [v2:172.21.15.133:6824/522902042,v1:172.21.15.133:6825/522902042] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd47014fdd0 con 0x7fd45406c3a0 2023-12-19T19:02:34.600 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.595+0000 7fd4667fc640 1 -- 172.21.15.133:0/3853680044 <== osd.0 v2:172.21.15.133:6824/522902042 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd4600053c0 con 0x7fd45406c3a0 2023-12-19T19:02:34.600 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-19T19:02:34.601 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-19T19:02:34.601 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-19T19:02:34.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.595+0000 7fd477efe640 1 -- 172.21.15.133:0/3853680044 >> [v2:172.21.15.133:6824/522902042,v1:172.21.15.133:6825/522902042] conn(0x7fd45406c3a0 msgr2=0x7fd45406e7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:34.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.595+0000 7fd477efe640 1 --2- 172.21.15.133:0/3853680044 >> [v2:172.21.15.133:6824/522902042,v1:172.21.15.133:6825/522902042] conn(0x7fd45406c3a0 0x7fd45406e7c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:34.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.595+0000 7fd477efe640 1 -- 172.21.15.133:0/3853680044 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd4540664a0 msgr2=0x7fd454068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:34.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.595+0000 7fd477efe640 1 --2- 172.21.15.133:0/3853680044 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fd4540664a0 0x7fd454068960 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd47014f420 tx=0x7fd46c0079b0 comp rx=0 tx=0).stop 2023-12-19T19:02:34.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.595+0000 7fd477efe640 1 -- 172.21.15.133:0/3853680044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4701efbd0 msgr2=0x7fd4701473b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:34.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.595+0000 7fd477efe640 1 --2- 172.21.15.133:0/3853680044 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd4701efbd0 0x7fd4701473b0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7fd4700c6b20 tx=0x7fd46800f580 comp rx=0 tx=0).stop 2023-12-19T19:02:34.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.595+0000 7fd47649b640 1 -- 172.21.15.133:0/3853680044 reap_dead start 2023-12-19T19:02:34.602 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.595+0000 7fd477efe640 1 -- 172.21.15.133:0/3853680044 shutdown_connections 2023-12-19T19:02:34.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.595+0000 7fd477efe640 1 -- 172.21.15.133:0/3853680044 >> 172.21.15.133:0/3853680044 conn(0x7fd4700c5d40 msgr2=0x7fd47014ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:34.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.595+0000 7fd477efe640 1 -- 172.21.15.133:0/3853680044 shutdown_connections 2023-12-19T19:02:34.603 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.595+0000 7fd477efe640 1 -- 172.21.15.133:0/3853680044 wait complete. 2023-12-19T19:02:34.619 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-19T19:02:34.757 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.751+0000 7f39324d6640 1 Processor -- start 2023-12-19T19:02:34.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.751+0000 7f39324d6640 1 -- start start 2023-12-19T19:02:34.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.751+0000 7f39324d6640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f392c0c60a0 0x7f392c156900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:34.758 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.751+0000 7f39324d6640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392c0c3bd0 con 0x7f392c0c5c60 2023-12-19T19:02:34.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.751+0000 7f39324d6640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f392c0bf1e0 con 0x7f392c0a5240 2023-12-19T19:02:34.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.751+0000 7f39324d6640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f392c0c64f0 con 0x7f392c0c60a0 2023-12-19T19:02:34.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.751+0000 7f3930a73640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f392c0c60a0 0x7f392c156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:34.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.751+0000 7f392b7fe640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f392c0c5c60 0x7f392c1561f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52040/0 (socket says 172.21.15.133:52040) 2023-12-19T19:02:34.759 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.751+0000 7f392b7fe640 1 -- 172.21.15.133:0/4151922549 learned_addr learned my addr 172.21.15.133:0/4151922549 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:34.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.755+0000 7f392affd640 1 -- 172.21.15.133:0/4151922549 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2802253472 0 0) 0x7f392c0c3bd0 con 0x7f392c0c5c60 2023-12-19T19:02:34.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.755+0000 7f392affd640 1 -- 172.21.15.133:0/4151922549 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3914003530 con 0x7f392c0c5c60 2023-12-19T19:02:34.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.755+0000 7f3930a73640 1 -- 172.21.15.133:0/4151922549 >> v1:172.21.15.138:6789/0 conn(0x7f392c0a5240 legacy=0x7f392c0bfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:34.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.755+0000 7f392affd640 1 -- 172.21.15.133:0/4151922549 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198263904 0 0) 0x7f392c0bf1e0 con 0x7f392c0a5240 2023-12-19T19:02:34.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.755+0000 7f3930a73640 1 -- 172.21.15.133:0/4151922549 >> v1:172.21.15.133:6789/0 conn(0x7f392c0c5c60 legacy=0x7f392c1561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:34.760 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.755+0000 7f3930a73640 1 -- 172.21.15.133:0/4151922549 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c0c3e20 con 0x7f392c0c60a0 2023-12-19T19:02:34.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.755+0000 7f3930a73640 1 --2- 172.21.15.133:0/4151922549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f392c0c60a0 0x7f392c156900 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f3924009d90 tx=0x7f392401c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e283fa0b033e341 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:34.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.755+0000 7f392affd640 1 -- 172.21.15.133:0/4151922549 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39240a5950 con 0x7f392c0c60a0 2023-12-19T19:02:34.762 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.755+0000 7f392affd640 1 -- 172.21.15.133:0/4151922549 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39240a5ab0 con 0x7f392c0c60a0 2023-12-19T19:02:34.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.755+0000 7f392affd640 1 -- 172.21.15.133:0/4151922549 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39240a5e40 con 0x7f392c0c60a0 2023-12-19T19:02:34.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f39324d6640 1 -- 172.21.15.133:0/4151922549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f392c0c60a0 msgr2=0x7f392c156900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:34.763 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f39324d6640 1 --2- 172.21.15.133:0/4151922549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f392c0c60a0 0x7f392c156900 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f3924009d90 tx=0x7f392401c890 comp rx=0 tx=0).stop 2023-12-19T19:02:34.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f39324d6640 1 -- 172.21.15.133:0/4151922549 shutdown_connections 2023-12-19T19:02:34.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f39324d6640 1 --2- 172.21.15.133:0/4151922549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f392c0c60a0 0x7f392c156900 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:34.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f39324d6640 1 -- 172.21.15.133:0/4151922549 >> 172.21.15.133:0/4151922549 conn(0x7f392c06a5b0 msgr2=0x7f392c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:34.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f39324d6640 1 -- 172.21.15.133:0/4151922549 shutdown_connections 2023-12-19T19:02:34.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f39324d6640 1 -- 172.21.15.133:0/4151922549 wait complete. 2023-12-19T19:02:34.764 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f39324d6640 1 Processor -- start 2023-12-19T19:02:34.765 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f39324d6640 1 -- start start 2023-12-19T19:02:34.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f39324d6640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f392c0a5240 0x7f392c15f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:34.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f39324d6640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f392c0c5c60 0x7f392c1eff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:34.766 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f39324d6640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f392c0c60a0 0x7f392c0aa110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:34.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f39324d6640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c15e630 con 0x7f392c0c5c60 2023-12-19T19:02:34.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f39324d6640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f392c15ff00 con 0x7f392c0c60a0 2023-12-19T19:02:34.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f39324d6640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f392c15e210 con 0x7f392c0a5240 2023-12-19T19:02:34.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f392b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f392c0c5c60 0x7f392c1eff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:34.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f392b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f392c0c5c60 0x7f392c1eff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:60980/0 (socket says 172.21.15.133:60980) 2023-12-19T19:02:34.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f392b7fe640 1 -- 172.21.15.133:0/68480676 learned_addr learned my addr 172.21.15.133:0/68480676 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:34.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f392bfff640 1 --2- 172.21.15.133:0/68480676 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f392c0a5240 0x7f392c15f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:34.767 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f3930a73640 1 --2- 172.21.15.133:0/68480676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f392c0c60a0 0x7f392c0aa110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:34.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f392b7fe640 1 -- 172.21.15.133:0/68480676 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f392c0a5240 msgr2=0x7f392c15f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:34.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f392b7fe640 1 --2- 172.21.15.133:0/68480676 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f392c0a5240 0x7f392c15f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:34.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f392b7fe640 1 -- 172.21.15.133:0/68480676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f392c0c60a0 msgr2=0x7f392c0aa110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:34.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f392b7fe640 1 --2- 172.21.15.133:0/68480676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f392c0c60a0 0x7f392c0aa110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:34.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f392b7fe640 1 -- 172.21.15.133:0/68480676 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3924009a70 con 0x7f392c0c5c60 2023-12-19T19:02:34.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f392bfff640 1 --2- 172.21.15.133:0/68480676 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f392c0a5240 0x7f392c15f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:34.768 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.759+0000 7f392b7fe640 1 --2- 172.21.15.133:0/68480676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f392c0c5c60 0x7f392c1eff90 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f392000c450 tx=0x7f392000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:34.769 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.763+0000 7f3928ff9640 1 -- 172.21.15.133:0/68480676 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920005cf0 con 0x7f392c0c5c60 2023-12-19T19:02:34.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.763+0000 7f3928ff9640 1 -- 172.21.15.133:0/68480676 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3920005e50 con 0x7f392c0c5c60 2023-12-19T19:02:34.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.763+0000 7f39324d6640 1 -- 172.21.15.133:0/68480676 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f392c15f940 con 0x7f392c0c5c60 2023-12-19T19:02:34.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.763+0000 7f3928ff9640 1 -- 172.21.15.133:0/68480676 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3920007290 con 0x7f392c0c5c60 2023-12-19T19:02:34.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.763+0000 7f39324d6640 1 -- 172.21.15.133:0/68480676 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f392c15e840 con 0x7f392c0c5c60 2023-12-19T19:02:34.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.763+0000 7f39324d6640 1 -- 172.21.15.133:0/68480676 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f392c068400 con 0x7f392c0c5c60 2023-12-19T19:02:34.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.763+0000 7f3928ff9640 1 -- 172.21.15.133:0/68480676 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f39200073f0 con 0x7f392c0c5c60 2023-12-19T19:02:34.770 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.763+0000 7f3928ff9640 1 --2- 172.21.15.133:0/68480676 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3918066470 0x7f3918068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:34.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.763+0000 7f3928ff9640 1 -- 172.21.15.133:0/68480676 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3920083100 con 0x7f392c0c5c60 2023-12-19T19:02:34.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.763+0000 7f392bfff640 1 --2- 172.21.15.133:0/68480676 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3918066470 0x7f3918068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:34.771 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.767+0000 7f392bfff640 1 --2- 172.21.15.133:0/68480676 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3918066470 0x7f3918068930 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f391c000f70 tx=0x7f391c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:34.773 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.767+0000 7f3928ff9640 1 -- 172.21.15.133:0/68480676 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f39200508d0 con 0x7f392c0c5c60 2023-12-19T19:02:34.924 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.919+0000 7f39324d6640 1 -- 172.21.15.133:0/68480676 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f392c06df70 con 0x7f3918066470 2023-12-19T19:02:34.925 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.919+0000 7f3928ff9640 1 -- 172.21.15.133:0/68480676 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f392c06df70 con 0x7f3918066470 2023-12-19T19:02:34.926 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 0 to deep-scrub 2023-12-19T19:02:34.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.923+0000 7f39324d6640 1 -- 172.21.15.133:0/68480676 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3918066470 msgr2=0x7f3918068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:34.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.923+0000 7f39324d6640 1 --2- 172.21.15.133:0/68480676 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3918066470 0x7f3918068930 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f391c000f70 tx=0x7f391c009040 comp rx=0 tx=0).stop 2023-12-19T19:02:34.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.923+0000 7f39324d6640 1 -- 172.21.15.133:0/68480676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f392c0c5c60 msgr2=0x7f392c1eff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:34.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.923+0000 7f39324d6640 1 --2- 172.21.15.133:0/68480676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f392c0c5c60 0x7f392c1eff90 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f392000c450 tx=0x7f392000c910 comp rx=0 tx=0).stop 2023-12-19T19:02:34.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.923+0000 7f39324d6640 1 -- 172.21.15.133:0/68480676 shutdown_connections 2023-12-19T19:02:34.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.923+0000 7f39324d6640 1 --2- 172.21.15.133:0/68480676 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f3918066470 0x7f3918068930 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:34.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.923+0000 7f39324d6640 1 --2- 172.21.15.133:0/68480676 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f392c0c60a0 0x7f392c0aa110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:34.928 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.923+0000 7f39324d6640 1 --2- 172.21.15.133:0/68480676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f392c0c5c60 0x7f392c1eff90 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:34.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.923+0000 7f39324d6640 1 --2- 172.21.15.133:0/68480676 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f392c0a5240 0x7f392c15f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:34.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.923+0000 7f39324d6640 1 -- 172.21.15.133:0/68480676 >> 172.21.15.133:0/68480676 conn(0x7f392c06a5b0 msgr2=0x7f392c160690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:34.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.923+0000 7f39324d6640 1 -- 172.21.15.133:0/68480676 shutdown_connections 2023-12-19T19:02:34.929 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:34.923+0000 7f39324d6640 1 -- 172.21.15.133:0/68480676 wait complete. 2023-12-19T19:02:34.947 INFO:tasks.ceph:Scrubbing osd.1 2023-12-19T19:02:34.947 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-19T19:02:35.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f07437c4640 1 Processor -- start 2023-12-19T19:02:35.088 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f07437c4640 1 -- start start 2023-12-19T19:02:35.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f07437c4640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f073c0c0aa0 0x7f073c0c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f07437c4640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073c0c1960 con 0x7f073c06fec0 2023-12-19T19:02:35.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f07437c4640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f073c072800 con 0x7f073c0a4fc0 2023-12-19T19:02:35.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f07437c4640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f073c0a9fc0 con 0x7f073c0c0aa0 2023-12-19T19:02:35.089 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0741560640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f073c06fec0 0x7f073c0c1250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52050/0 (socket says 172.21.15.133:52050) 2023-12-19T19:02:35.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0741560640 1 -- 172.21.15.133:0/4000359356 learned_addr learned my addr 172.21.15.133:0/4000359356 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:35.090 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0740d5f640 1 --2- 172.21.15.133:0/4000359356 >> v2:172.21.15.138:3300/0 conn(0x7f073c0c0aa0 0x7f073c0c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.091 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0733fff640 1 -- 172.21.15.133:0/4000359356 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 163099080 0 0) 0x7f0738001120 con 0x7f073c06fec0 2023-12-19T19:02:35.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0733fff640 1 -- 172.21.15.133:0/4000359356 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0728003530 con 0x7f073c06fec0 2023-12-19T19:02:35.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0733fff640 1 -- 172.21.15.133:0/4000359356 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1033398358 0 0) 0x7f0728003530 con 0x7f073c06fec0 2023-12-19T19:02:35.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0733fff640 1 -- 172.21.15.133:0/4000359356 >> v2:172.21.15.138:3300/0 conn(0x7f073c0c0aa0 msgr2=0x7f073c0c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:35.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0733fff640 1 --2- 172.21.15.133:0/4000359356 >> v2:172.21.15.138:3300/0 conn(0x7f073c0c0aa0 0x7f073c0c1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0733fff640 1 -- 172.21.15.133:0/4000359356 >> v1:172.21.15.138:6789/0 conn(0x7f073c0a4fc0 legacy=0x7f073c0c2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0733fff640 1 -- 172.21.15.133:0/4000359356 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c072ae0 con 0x7f073c06fec0 2023-12-19T19:02:35.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0733fff640 1 -- 172.21.15.133:0/4000359356 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7f0738001810 con 0x7f073c06fec0 2023-12-19T19:02:35.092 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0733fff640 1 -- 172.21.15.133:0/4000359356 >> v1:172.21.15.133:6789/0 conn(0x7f073c06fec0 legacy=0x7f073c0c1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0733fff640 1 --2- 172.21.15.133:0/4000359356 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07280039d0 0x7f0728003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0733fff640 1 --2- 172.21.15.133:0/4000359356 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07280047d0 0x7f0728004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0733fff640 1 --2- 172.21.15.133:0/4000359356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07280052b0 0x7f072800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0733fff640 1 -- 172.21.15.133:0/4000359356 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c0a9fc0 con 0x7f07280052b0 2023-12-19T19:02:35.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0733fff640 1 -- 172.21.15.133:0/4000359356 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072800c1b0 con 0x7f07280047d0 2023-12-19T19:02:35.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0733fff640 1 -- 172.21.15.133:0/4000359356 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072800c370 con 0x7f07280039d0 2023-12-19T19:02:35.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0741d61640 1 --2- 172.21.15.133:0/4000359356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07280052b0 0x7f072800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0740d5f640 1 --2- 172.21.15.133:0/4000359356 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07280047d0 0x7f0728004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.093 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0741560640 1 --2- 172.21.15.133:0/4000359356 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07280039d0 0x7f0728003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0741d61640 1 -- 172.21.15.133:0/4000359356 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07280039d0 msgr2=0x7f0728003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:35.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0741d61640 1 --2- 172.21.15.133:0/4000359356 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07280039d0 0x7f0728003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0741d61640 1 -- 172.21.15.133:0/4000359356 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07280047d0 msgr2=0x7f0728004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:35.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0741d61640 1 --2- 172.21.15.133:0/4000359356 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f07280047d0 0x7f0728004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.094 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.083+0000 7f0741d61640 1 -- 172.21.15.133:0/4000359356 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0728003530 con 0x7f07280052b0 2023-12-19T19:02:35.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.087+0000 7f0741d61640 1 -- 172.21.15.133:0/4000359356 reap_dead start 2023-12-19T19:02:35.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.087+0000 7f0741d61640 1 --2- 172.21.15.133:0/4000359356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07280052b0 0x7f072800b990 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f0734001e70 tx=0x7f073401c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a795a5f2063b41 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:35.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.087+0000 7f0733fff640 1 -- 172.21.15.133:0/4000359356 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734003b80 con 0x7f07280052b0 2023-12-19T19:02:35.095 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.087+0000 7f0733fff640 1 -- 172.21.15.133:0/4000359356 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0734003d20 con 0x7f07280052b0 2023-12-19T19:02:35.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.087+0000 7f0733fff640 1 -- 172.21.15.133:0/4000359356 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734005260 con 0x7f07280052b0 2023-12-19T19:02:35.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.087+0000 7f07437c4640 1 -- 172.21.15.133:0/4000359356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07280052b0 msgr2=0x7f072800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.087+0000 7f07437c4640 1 --2- 172.21.15.133:0/4000359356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07280052b0 0x7f072800b990 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f0734001e70 tx=0x7f073401c730 comp rx=0 tx=0).stop 2023-12-19T19:02:35.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.087+0000 7f07437c4640 1 -- 172.21.15.133:0/4000359356 shutdown_connections 2023-12-19T19:02:35.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.087+0000 7f07437c4640 1 --2- 172.21.15.133:0/4000359356 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f07280052b0 0x7f072800b990 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.087+0000 7f07437c4640 1 -- 172.21.15.133:0/4000359356 >> 172.21.15.133:0/4000359356 conn(0x7f073c0c5d40 msgr2=0x7f073c0c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:35.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.087+0000 7f07437c4640 1 -- 172.21.15.133:0/4000359356 shutdown_connections 2023-12-19T19:02:35.096 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.087+0000 7f07437c4640 1 -- 172.21.15.133:0/4000359356 wait complete. 2023-12-19T19:02:35.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f07437c4640 1 Processor -- start 2023-12-19T19:02:35.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f07437c4640 1 -- start start 2023-12-19T19:02:35.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f07437c4640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07280052b0 0x7f073c0c4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.097 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f07437c4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f073c153d10 0x7f073c153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f07437c4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f073c154260 0x7f073c1537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f07437c4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c1f1750 con 0x7f073c154260 2023-12-19T19:02:35.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f07437c4640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073c1f11f0 con 0x7f073c153d10 2023-12-19T19:02:35.098 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f07437c4640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073c1f1470 con 0x7f07280052b0 2023-12-19T19:02:35.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f0741d61640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f073c154260 0x7f073c1537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f0741d61640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f073c154260 0x7f073c1537a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32776/0 (socket says 172.21.15.133:32776) 2023-12-19T19:02:35.099 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f0741d61640 1 -- 172.21.15.133:0/137169098 learned_addr learned my addr 172.21.15.133:0/137169098 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:35.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f0740d5f640 1 --2- 172.21.15.133:0/137169098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f073c153d10 0x7f073c153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f0741560640 1 --2- 172.21.15.133:0/137169098 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07280052b0 0x7f073c0c4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f0741d61640 1 -- 172.21.15.133:0/137169098 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07280052b0 msgr2=0x7f073c0c4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f0741d61640 1 --2- 172.21.15.133:0/137169098 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07280052b0 0x7f073c0c4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f0741d61640 1 -- 172.21.15.133:0/137169098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f073c153d10 msgr2=0x7f073c153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f0741d61640 1 --2- 172.21.15.133:0/137169098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f073c153d10 0x7f073c153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f0741d61640 1 -- 172.21.15.133:0/137169098 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c0ab0b0 con 0x7f073c154260 2023-12-19T19:02:35.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f0740d5f640 1 --2- 172.21.15.133:0/137169098 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f073c153d10 0x7f073c153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:35.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f0741560640 1 --2- 172.21.15.133:0/137169098 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f07280052b0 0x7f073c0c4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:35.100 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f0741d61640 1 --2- 172.21.15.133:0/137169098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f073c154260 0x7f073c1537a0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f073401cfd0 tx=0x7f0728005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:35.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f0731ffb640 1 -- 172.21.15.133:0/137169098 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07340ac070 con 0x7f073c154260 2023-12-19T19:02:35.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f0731ffb640 1 -- 172.21.15.133:0/137169098 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0734003e90 con 0x7f073c154260 2023-12-19T19:02:35.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f07437c4640 1 -- 172.21.15.133:0/137169098 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f073c159c70 con 0x7f073c154260 2023-12-19T19:02:35.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f0731ffb640 1 -- 172.21.15.133:0/137169098 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734005680 con 0x7f073c154260 2023-12-19T19:02:35.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.091+0000 7f07437c4640 1 -- 172.21.15.133:0/137169098 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f073c0c4670 con 0x7f073c154260 2023-12-19T19:02:35.101 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.095+0000 7f07437c4640 1 -- 172.21.15.133:0/137169098 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f073c1f15e0 con 0x7f073c154260 2023-12-19T19:02:35.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.095+0000 7f0731ffb640 1 -- 172.21.15.133:0/137169098 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0734006b60 con 0x7f073c154260 2023-12-19T19:02:35.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.095+0000 7f0731ffb640 1 --2- 172.21.15.133:0/137169098 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0720066490 0x7f0720068950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.102 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.095+0000 7f0731ffb640 1 -- 172.21.15.133:0/137169098 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f073411cc10 con 0x7f073c154260 2023-12-19T19:02:35.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.095+0000 7f0731ffb640 1 --2- 172.21.15.133:0/137169098 >> [v2:172.21.15.133:6816/1006296948,v1:172.21.15.133:6817/1006296948] conn(0x7f072006c390 0x7f072006e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.095+0000 7f0731ffb640 1 -- 172.21.15.133:0/137169098 --> [v2:172.21.15.133:6816/1006296948,v1:172.21.15.133:6817/1006296948] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f072006ee60 con 0x7f072006c390 2023-12-19T19:02:35.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.095+0000 7f0731ffb640 1 -- 172.21.15.133:0/137169098 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07341212a0 con 0x7f073c154260 2023-12-19T19:02:35.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.095+0000 7f0741560640 1 --2- 172.21.15.133:0/137169098 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0720066490 0x7f0720068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.095+0000 7f0740d5f640 1 --2- 172.21.15.133:0/137169098 >> [v2:172.21.15.133:6816/1006296948,v1:172.21.15.133:6817/1006296948] conn(0x7f072006c390 0x7f072006e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.095+0000 7f0741560640 1 --2- 172.21.15.133:0/137169098 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0720066490 0x7f0720068950 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0738001ec0 tx=0x7f0738009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:35.103 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.095+0000 7f0740d5f640 1 --2- 172.21.15.133:0/137169098 >> [v2:172.21.15.133:6816/1006296948,v1:172.21.15.133:6817/1006296948] conn(0x7f072006c390 0x7f072006e7b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:35.104 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.099+0000 7f0731ffb640 1 -- 172.21.15.133:0/137169098 <== osd.1 v2:172.21.15.133:6816/1006296948 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f072006ee60 con 0x7f072006c390 2023-12-19T19:02:35.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.111+0000 7f07437c4640 1 -- 172.21.15.133:0/137169098 --> [v2:172.21.15.133:6816/1006296948,v1:172.21.15.133:6817/1006296948] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f073c070b60 con 0x7f072006c390 2023-12-19T19:02:35.116 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.111+0000 7f0731ffb640 1 -- 172.21.15.133:0/137169098 <== osd.1 v2:172.21.15.133:6816/1006296948 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f073c070b60 con 0x7f072006c390 2023-12-19T19:02:35.117 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-19T19:02:35.117 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-19T19:02:35.117 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-19T19:02:35.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.111+0000 7f07437c4640 1 -- 172.21.15.133:0/137169098 >> [v2:172.21.15.133:6816/1006296948,v1:172.21.15.133:6817/1006296948] conn(0x7f072006c390 msgr2=0x7f072006e7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.111+0000 7f07437c4640 1 --2- 172.21.15.133:0/137169098 >> [v2:172.21.15.133:6816/1006296948,v1:172.21.15.133:6817/1006296948] conn(0x7f072006c390 0x7f072006e7b0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.111+0000 7f07437c4640 1 -- 172.21.15.133:0/137169098 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0720066490 msgr2=0x7f0720068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.111+0000 7f07437c4640 1 --2- 172.21.15.133:0/137169098 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0720066490 0x7f0720068950 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0738001ec0 tx=0x7f0738009040 comp rx=0 tx=0).stop 2023-12-19T19:02:35.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.111+0000 7f07437c4640 1 -- 172.21.15.133:0/137169098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f073c154260 msgr2=0x7f073c1537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.111+0000 7f07437c4640 1 --2- 172.21.15.133:0/137169098 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f073c154260 0x7f073c1537a0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f073401cfd0 tx=0x7f0728005800 comp rx=0 tx=0).stop 2023-12-19T19:02:35.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.111+0000 7f0741d61640 1 -- 172.21.15.133:0/137169098 reap_dead start 2023-12-19T19:02:35.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.111+0000 7f07437c4640 1 -- 172.21.15.133:0/137169098 shutdown_connections 2023-12-19T19:02:35.118 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.111+0000 7f07437c4640 1 -- 172.21.15.133:0/137169098 >> 172.21.15.133:0/137169098 conn(0x7f073c0c5d40 msgr2=0x7f073c0c6120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:35.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.111+0000 7f07437c4640 1 -- 172.21.15.133:0/137169098 shutdown_connections 2023-12-19T19:02:35.119 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.111+0000 7f07437c4640 1 -- 172.21.15.133:0/137169098 wait complete. 2023-12-19T19:02:35.137 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-19T19:02:35.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.271+0000 7fcddd8bb640 1 Processor -- start 2023-12-19T19:02:35.276 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.271+0000 7fcddd8bb640 1 -- start start 2023-12-19T19:02:35.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.271+0000 7fcddd8bb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcdd8151dc0 0x7fcdd80c4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.271+0000 7fcddd8bb640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd80ac4f0 con 0x7fcdd80c7ed0 2023-12-19T19:02:35.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.271+0000 7fcddd8bb640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd8158780 con 0x7fcdd80bd660 2023-12-19T19:02:35.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.271+0000 7fcddd8bb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd8158a60 con 0x7fcdd8151dc0 2023-12-19T19:02:35.277 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.271+0000 7fcdce7fc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcdd80c7ed0 0x7fcdd8154650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52066/0 (socket says 172.21.15.133:52066) 2023-12-19T19:02:35.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.271+0000 7fcdce7fc640 1 -- 172.21.15.133:0/730442108 learned_addr learned my addr 172.21.15.133:0/730442108 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:35.278 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.271+0000 7fcdd6ffd640 1 --2- 172.21.15.133:0/730442108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcdd8151dc0 0x7fcdd80c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.271+0000 7fcdd67fc640 1 -- 172.21.15.133:0/730442108 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3669744639 0 0) 0x7fcdd80ac4f0 con 0x7fcdd80c7ed0 2023-12-19T19:02:35.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.271+0000 7fcdd67fc640 1 -- 172.21.15.133:0/730442108 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdc4003530 con 0x7fcdd80c7ed0 2023-12-19T19:02:35.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.271+0000 7fcdd6ffd640 1 -- 172.21.15.133:0/730442108 >> v1:172.21.15.138:6789/0 conn(0x7fcdd80bd660 legacy=0x7fcdd8154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.271+0000 7fcdd67fc640 1 -- 172.21.15.133:0/730442108 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774311084 0 0) 0x7fcdd8158780 con 0x7fcdd80bd660 2023-12-19T19:02:35.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.271+0000 7fcdd6ffd640 1 -- 172.21.15.133:0/730442108 >> v1:172.21.15.133:6789/0 conn(0x7fcdd80c7ed0 legacy=0x7fcdd8154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.279 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.271+0000 7fcdd6ffd640 1 -- 172.21.15.133:0/730442108 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd80ac180 con 0x7fcdd8151dc0 2023-12-19T19:02:35.281 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.275+0000 7fcdd6ffd640 1 --2- 172.21.15.133:0/730442108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcdd8151dc0 0x7fcdd80c4950 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80097f0 tx=0x7fcdc801c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7095d3c036ac313a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:35.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.275+0000 7fcdd67fc640 1 -- 172.21.15.133:0/730442108 <== mon.2 v2:172.21.15.138:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc80ab600 con 0x7fcdd8151dc0 2023-12-19T19:02:35.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.275+0000 7fcdd67fc640 1 -- 172.21.15.133:0/730442108 <== mon.2 v2:172.21.15.138:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc80a7050 con 0x7fcdd8151dc0 2023-12-19T19:02:35.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.275+0000 7fcdd67fc640 1 -- 172.21.15.133:0/730442108 <== mon.2 v2:172.21.15.138:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc80ab960 con 0x7fcdd8151dc0 2023-12-19T19:02:35.282 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.275+0000 7fcddd8bb640 1 -- 172.21.15.133:0/730442108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcdd8151dc0 msgr2=0x7fcdd80c4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.275+0000 7fcddd8bb640 1 --2- 172.21.15.133:0/730442108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcdd8151dc0 0x7fcdd80c4950 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80097f0 tx=0x7fcdc801c3a0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.275+0000 7fcddd8bb640 1 -- 172.21.15.133:0/730442108 shutdown_connections 2023-12-19T19:02:35.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.275+0000 7fcddd8bb640 1 --2- 172.21.15.133:0/730442108 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcdd8151dc0 0x7fcdd80c4950 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.275+0000 7fcddd8bb640 1 -- 172.21.15.133:0/730442108 >> 172.21.15.133:0/730442108 conn(0x7fcdd8071eb0 msgr2=0x7fcdd80722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:35.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.275+0000 7fcddd8bb640 1 -- 172.21.15.133:0/730442108 shutdown_connections 2023-12-19T19:02:35.283 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.275+0000 7fcddd8bb640 1 -- 172.21.15.133:0/730442108 wait complete. 2023-12-19T19:02:35.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcddd8bb640 1 Processor -- start 2023-12-19T19:02:35.284 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcddd8bb640 1 -- start start 2023-12-19T19:02:35.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcddd8bb640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcdd80bd660 0x7fcdd81ecf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcddd8bb640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd80c7ed0 0x7fcdd80bdd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.286 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcddd8bb640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcdd8151dc0 0x7fcdd8156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcddd8bb640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd8156790 con 0x7fcdd80c7ed0 2023-12-19T19:02:35.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcddd8bb640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd80c3af0 con 0x7fcdd80bd660 2023-12-19T19:02:35.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcddd8bb640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd80c3d60 con 0x7fcdd8151dc0 2023-12-19T19:02:35.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcdce7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd80c7ed0 0x7fcdd80bdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcdce7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd80c7ed0 0x7fcdd80bdd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32786/0 (socket says 172.21.15.133:32786) 2023-12-19T19:02:35.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcdce7fc640 1 -- 172.21.15.133:0/3445753345 learned_addr learned my addr 172.21.15.133:0/3445753345 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:35.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcdd6ffd640 1 --2- 172.21.15.133:0/3445753345 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcdd80bd660 0x7fcdd81ecf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcdd77fe640 1 --2- 172.21.15.133:0/3445753345 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcdd8151dc0 0x7fcdd8156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcdce7fc640 1 -- 172.21.15.133:0/3445753345 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcdd8151dc0 msgr2=0x7fcdd8156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.287 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcdce7fc640 1 --2- 172.21.15.133:0/3445753345 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcdd8151dc0 0x7fcdd8156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcdce7fc640 1 -- 172.21.15.133:0/3445753345 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcdd80bd660 msgr2=0x7fcdd81ecf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcdce7fc640 1 --2- 172.21.15.133:0/3445753345 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcdd80bd660 0x7fcdd81ecf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcdce7fc640 1 -- 172.21.15.133:0/3445753345 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc8009420 con 0x7fcdd80c7ed0 2023-12-19T19:02:35.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcdd77fe640 1 --2- 172.21.15.133:0/3445753345 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcdd8151dc0 0x7fcdd8156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:35.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcdce7fc640 1 --2- 172.21.15.133:0/3445753345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd80c7ed0 0x7fcdd80bdd60 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000c390 tx=0x7fcdc000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:35.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcdd4ff9640 1 -- 172.21.15.133:0/3445753345 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc0005cf0 con 0x7fcdd80c7ed0 2023-12-19T19:02:35.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcdd4ff9640 1 -- 172.21.15.133:0/3445753345 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc0005e70 con 0x7fcdd80c7ed0 2023-12-19T19:02:35.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcdd4ff9640 1 -- 172.21.15.133:0/3445753345 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc00072f0 con 0x7fcdd80c7ed0 2023-12-19T19:02:35.288 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcddd8bb640 1 -- 172.21.15.133:0/3445753345 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd80c4040 con 0x7fcdd80c7ed0 2023-12-19T19:02:35.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.279+0000 7fcddd8bb640 1 -- 172.21.15.133:0/3445753345 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd80c08a0 con 0x7fcdd80c7ed0 2023-12-19T19:02:35.289 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.283+0000 7fcddd8bb640 1 -- 172.21.15.133:0/3445753345 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd81568d0 con 0x7fcdd80c7ed0 2023-12-19T19:02:35.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.283+0000 7fcdd4ff9640 1 -- 172.21.15.133:0/3445753345 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fcdc0007450 con 0x7fcdd80c7ed0 2023-12-19T19:02:35.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.283+0000 7fcdd4ff9640 1 --2- 172.21.15.133:0/3445753345 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcdb8066470 0x7fcdb8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.283+0000 7fcdd4ff9640 1 -- 172.21.15.133:0/3445753345 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fcdc0083220 con 0x7fcdd80c7ed0 2023-12-19T19:02:35.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.283+0000 7fcdd6ffd640 1 --2- 172.21.15.133:0/3445753345 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcdb8066470 0x7fcdb8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.290 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.283+0000 7fcdd6ffd640 1 --2- 172.21.15.133:0/3445753345 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcdb8066470 0x7fcdb8068930 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80ad000 tx=0x7fcdc80a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:35.293 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.287+0000 7fcdd4ff9640 1 -- 172.21.15.133:0/3445753345 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fcdd81568d0 con 0x7fcdd80c7ed0 2023-12-19T19:02:35.441 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.435+0000 7fcddd8bb640 1 -- 172.21.15.133:0/3445753345 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fcdd81568d0 con 0x7fcdb8066470 2023-12-19T19:02:35.442 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.435+0000 7fcdd4ff9640 1 -- 172.21.15.133:0/3445753345 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcdd81568d0 con 0x7fcdb8066470 2023-12-19T19:02:35.442 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 1 to deep-scrub 2023-12-19T19:02:35.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.439+0000 7fcddd8bb640 1 -- 172.21.15.133:0/3445753345 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcdb8066470 msgr2=0x7fcdb8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.439+0000 7fcddd8bb640 1 --2- 172.21.15.133:0/3445753345 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcdb8066470 0x7fcdb8068930 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80ad000 tx=0x7fcdc80a6000 comp rx=0 tx=0).stop 2023-12-19T19:02:35.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.439+0000 7fcddd8bb640 1 -- 172.21.15.133:0/3445753345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd80c7ed0 msgr2=0x7fcdd80bdd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.439+0000 7fcddd8bb640 1 --2- 172.21.15.133:0/3445753345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd80c7ed0 0x7fcdd80bdd60 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fcdc000c390 tx=0x7fcdc000c850 comp rx=0 tx=0).stop 2023-12-19T19:02:35.444 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.439+0000 7fcddd8bb640 1 -- 172.21.15.133:0/3445753345 shutdown_connections 2023-12-19T19:02:35.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.439+0000 7fcddd8bb640 1 --2- 172.21.15.133:0/3445753345 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcdb8066470 0x7fcdb8068930 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.439+0000 7fcddd8bb640 1 --2- 172.21.15.133:0/3445753345 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcdd8151dc0 0x7fcdd8156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.439+0000 7fcddd8bb640 1 --2- 172.21.15.133:0/3445753345 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdd80c7ed0 0x7fcdd80bdd60 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.439+0000 7fcddd8bb640 1 --2- 172.21.15.133:0/3445753345 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcdd80bd660 0x7fcdd81ecf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.439+0000 7fcddd8bb640 1 -- 172.21.15.133:0/3445753345 >> 172.21.15.133:0/3445753345 conn(0x7fcdd8071eb0 msgr2=0x7fcdd8072290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:35.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.439+0000 7fcddd8bb640 1 -- 172.21.15.133:0/3445753345 shutdown_connections 2023-12-19T19:02:35.445 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.439+0000 7fcddd8bb640 1 -- 172.21.15.133:0/3445753345 wait complete. 2023-12-19T19:02:35.463 INFO:tasks.ceph:Scrubbing osd.2 2023-12-19T19:02:35.464 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-19T19:02:35.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.599+0000 7f81588fe640 1 Processor -- start 2023-12-19T19:02:35.605 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.599+0000 7f81588fe640 1 -- start start 2023-12-19T19:02:35.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.599+0000 7f81588fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f81540c13b0 0x7f81540a5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.599+0000 7f81588fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81540a4fc0 0x7f81540a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.599+0000 7f81588fe640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81540c28e0 con 0x7f81540c42b0 2023-12-19T19:02:35.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.599+0000 7f81588fe640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81540c2bc0 con 0x7f81540c13b0 2023-12-19T19:02:35.606 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.599+0000 7f81588fe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81540c2ea0 con 0x7f81540a4fc0 2023-12-19T19:02:35.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.599+0000 7f8152d9d640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f81540c42b0 0x7f81540bf170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52072/0 (socket says 172.21.15.133:52072) 2023-12-19T19:02:35.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.599+0000 7f8152d9d640 1 -- 172.21.15.133:0/1519468928 learned_addr learned my addr 172.21.15.133:0/1519468928 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:35.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.599+0000 7f815259c640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f81540c13b0 0x7f81540a5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.599+0000 7f814bfff640 1 --2- 172.21.15.133:0/1519468928 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81540a4fc0 0x7f81540a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.607 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.599+0000 7f815259c640 1 -- 172.21.15.133:0/1519468928 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81540a4fc0 msgr2=0x7f81540a9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:35.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.599+0000 7f815259c640 1 --2- 172.21.15.133:0/1519468928 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81540a4fc0 0x7f81540a9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.599+0000 7f815259c640 1 -- 172.21.15.133:0/1519468928 >> v1:172.21.15.133:6789/0 conn(0x7f81540c42b0 legacy=0x7f81540bf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.599+0000 7f815259c640 1 -- 172.21.15.133:0/1519468928 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81540c3180 con 0x7f81540c13b0 2023-12-19T19:02:35.608 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.599+0000 7f8151d9b640 1 -- 172.21.15.133:0/1519468928 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935757234 0 0) 0x7f81540c28e0 con 0x7f81540c42b0 2023-12-19T19:02:35.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.603+0000 7f815259c640 1 --2- 172.21.15.133:0/1519468928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81540c13b0 0x7f81540a5430 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f81440097c0 tx=0x7f814401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1033be48a9546cba server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:35.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.603+0000 7f8151d9b640 1 -- 172.21.15.133:0/1519468928 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81540c26e0 con 0x7f81540c13b0 2023-12-19T19:02:35.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.603+0000 7f8151d9b640 1 -- 172.21.15.133:0/1519468928 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81440ac640 con 0x7f81540c13b0 2023-12-19T19:02:35.610 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.603+0000 7f8151d9b640 1 -- 172.21.15.133:0/1519468928 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81440ac9d0 con 0x7f81540c13b0 2023-12-19T19:02:35.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.603+0000 7f81588fe640 1 -- 172.21.15.133:0/1519468928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81540c13b0 msgr2=0x7f81540a5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.603+0000 7f81588fe640 1 --2- 172.21.15.133:0/1519468928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81540c13b0 0x7f81540a5430 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f81440097c0 tx=0x7f814401c3c0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.603+0000 7f81588fe640 1 -- 172.21.15.133:0/1519468928 shutdown_connections 2023-12-19T19:02:35.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.603+0000 7f81588fe640 1 --2- 172.21.15.133:0/1519468928 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81540a4fc0 0x7f81540a9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.603+0000 7f81588fe640 1 --2- 172.21.15.133:0/1519468928 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81540c13b0 0x7f81540a5430 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.603+0000 7f81588fe640 1 -- 172.21.15.133:0/1519468928 >> 172.21.15.133:0/1519468928 conn(0x7f81540c5d40 msgr2=0x7f81540c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:35.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.603+0000 7f81588fe640 1 -- 172.21.15.133:0/1519468928 shutdown_connections 2023-12-19T19:02:35.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.603+0000 7f81588fe640 1 -- 172.21.15.133:0/1519468928 wait complete. 2023-12-19T19:02:35.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.607+0000 7f81588fe640 1 Processor -- start 2023-12-19T19:02:35.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.607+0000 7f81588fe640 1 -- start start 2023-12-19T19:02:35.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.607+0000 7f81588fe640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81540a4fc0 0x7f8154099cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.607+0000 7f81588fe640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81540c13b0 0x7f8154149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.607+0000 7f81588fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81540c42b0 0x7f815414a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.607+0000 7f81588fe640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815414a9b0 con 0x7f81540c42b0 2023-12-19T19:02:35.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.607+0000 7f81588fe640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815409b370 con 0x7f81540c13b0 2023-12-19T19:02:35.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.607+0000 7f81588fe640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81541ed9f0 con 0x7f81540a4fc0 2023-12-19T19:02:35.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.607+0000 7f8152d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81540c42b0 0x7f815414a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.607+0000 7f8152d9d640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81540c42b0 0x7f815414a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32798/0 (socket says 172.21.15.133:32798) 2023-12-19T19:02:35.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.607+0000 7f8152d9d640 1 -- 172.21.15.133:0/2900667425 learned_addr learned my addr 172.21.15.133:0/2900667425 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:35.615 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.607+0000 7f815259c640 1 --2- 172.21.15.133:0/2900667425 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81540a4fc0 0x7f8154099cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.607+0000 7f814bfff640 1 --2- 172.21.15.133:0/2900667425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81540c13b0 0x7f8154149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.607+0000 7f8152d9d640 1 -- 172.21.15.133:0/2900667425 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81540a4fc0 msgr2=0x7f8154099cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.607+0000 7f8152d9d640 1 --2- 172.21.15.133:0/2900667425 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f81540a4fc0 0x7f8154099cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.607+0000 7f8152d9d640 1 -- 172.21.15.133:0/2900667425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81540c13b0 msgr2=0x7f8154149f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.607+0000 7f8152d9d640 1 --2- 172.21.15.133:0/2900667425 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f81540c13b0 0x7f8154149f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.607+0000 7f8152d9d640 1 -- 172.21.15.133:0/2900667425 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8144009420 con 0x7f81540c42b0 2023-12-19T19:02:35.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.607+0000 7f8152d9d640 1 --2- 172.21.15.133:0/2900667425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81540c42b0 0x7f815414a470 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f814c00c750 tx=0x7f814c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:35.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.607+0000 7f814affd640 1 -- 172.21.15.133:0/2900667425 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c00ce60 con 0x7f81540c42b0 2023-12-19T19:02:35.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.607+0000 7f814affd640 1 -- 172.21.15.133:0/2900667425 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f814c00a5e0 con 0x7f81540c42b0 2023-12-19T19:02:35.616 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.607+0000 7f814affd640 1 -- 172.21.15.133:0/2900667425 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c00a950 con 0x7f81540c42b0 2023-12-19T19:02:35.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.607+0000 7f81588fe640 1 -- 172.21.15.133:0/2900667425 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f815406ff60 con 0x7f81540c42b0 2023-12-19T19:02:35.617 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.611+0000 7f81588fe640 1 -- 172.21.15.133:0/2900667425 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8154070200 con 0x7f81540c42b0 2023-12-19T19:02:35.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.611+0000 7f81588fe640 1 -- 172.21.15.133:0/2900667425 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f81540c57c0 con 0x7f81540c42b0 2023-12-19T19:02:35.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.611+0000 7f814affd640 1 -- 172.21.15.133:0/2900667425 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f814c00aab0 con 0x7f81540c42b0 2023-12-19T19:02:35.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.611+0000 7f814affd640 1 --2- 172.21.15.133:0/2900667425 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8134066470 0x7f8134068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.611+0000 7f814affd640 1 -- 172.21.15.133:0/2900667425 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f814c083080 con 0x7f81540c42b0 2023-12-19T19:02:35.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.611+0000 7f814affd640 1 --2- 172.21.15.133:0/2900667425 >> [v2:172.21.15.133:6800/2461607163,v1:172.21.15.133:6801/2461607163] conn(0x7f813406c370 0x7f813406e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.611+0000 7f814affd640 1 -- 172.21.15.133:0/2900667425 --> [v2:172.21.15.133:6800/2461607163,v1:172.21.15.133:6801/2461607163] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f813406ee40 con 0x7f813406c370 2023-12-19T19:02:35.618 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.611+0000 7f814affd640 1 -- 172.21.15.133:0/2900667425 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f814c085600 con 0x7f81540c42b0 2023-12-19T19:02:35.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.611+0000 7f815259c640 1 --2- 172.21.15.133:0/2900667425 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8134066470 0x7f8134068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.611+0000 7f814bfff640 1 --2- 172.21.15.133:0/2900667425 >> [v2:172.21.15.133:6800/2461607163,v1:172.21.15.133:6801/2461607163] conn(0x7f813406c370 0x7f813406e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.611+0000 7f814bfff640 1 --2- 172.21.15.133:0/2900667425 >> [v2:172.21.15.133:6800/2461607163,v1:172.21.15.133:6801/2461607163] conn(0x7f813406c370 0x7f813406e790 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:35.619 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.611+0000 7f815259c640 1 --2- 172.21.15.133:0/2900667425 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8134066470 0x7f8134068930 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f81440ae000 tx=0x7f81440a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:35.620 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.615+0000 7f814affd640 1 -- 172.21.15.133:0/2900667425 <== osd.2 v2:172.21.15.133:6800/2461607163 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f813406ee40 con 0x7f813406c370 2023-12-19T19:02:35.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.627+0000 7f81588fe640 1 -- 172.21.15.133:0/2900667425 --> [v2:172.21.15.133:6800/2461607163,v1:172.21.15.133:6801/2461607163] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f81540aab50 con 0x7f813406c370 2023-12-19T19:02:35.632 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.627+0000 7f814affd640 1 -- 172.21.15.133:0/2900667425 <== osd.2 v2:172.21.15.133:6800/2461607163 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f81540aab50 con 0x7f813406c370 2023-12-19T19:02:35.633 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-19T19:02:35.633 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-19T19:02:35.633 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-19T19:02:35.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.627+0000 7f81588fe640 1 -- 172.21.15.133:0/2900667425 >> [v2:172.21.15.133:6800/2461607163,v1:172.21.15.133:6801/2461607163] conn(0x7f813406c370 msgr2=0x7f813406e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.627+0000 7f81588fe640 1 --2- 172.21.15.133:0/2900667425 >> [v2:172.21.15.133:6800/2461607163,v1:172.21.15.133:6801/2461607163] conn(0x7f813406c370 0x7f813406e790 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.627+0000 7f81588fe640 1 -- 172.21.15.133:0/2900667425 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8134066470 msgr2=0x7f8134068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.627+0000 7f81588fe640 1 --2- 172.21.15.133:0/2900667425 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f8134066470 0x7f8134068930 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f81440ae000 tx=0x7f81440a7000 comp rx=0 tx=0).stop 2023-12-19T19:02:35.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.627+0000 7f81588fe640 1 -- 172.21.15.133:0/2900667425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81540c42b0 msgr2=0x7f815414a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.627+0000 7f81588fe640 1 --2- 172.21.15.133:0/2900667425 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81540c42b0 0x7f815414a470 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f814c00c750 tx=0x7f814c00cc10 comp rx=0 tx=0).stop 2023-12-19T19:02:35.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.627+0000 7f8152d9d640 1 -- 172.21.15.133:0/2900667425 reap_dead start 2023-12-19T19:02:35.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.627+0000 7f81588fe640 1 -- 172.21.15.133:0/2900667425 shutdown_connections 2023-12-19T19:02:35.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.627+0000 7f81588fe640 1 -- 172.21.15.133:0/2900667425 >> 172.21.15.133:0/2900667425 conn(0x7f81540c5d40 msgr2=0x7f81540a8360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:35.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.627+0000 7f81588fe640 1 -- 172.21.15.133:0/2900667425 shutdown_connections 2023-12-19T19:02:35.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.627+0000 7f81588fe640 1 -- 172.21.15.133:0/2900667425 wait complete. 2023-12-19T19:02:35.651 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-19T19:02:35.791 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.787+0000 7f8391d3e640 1 Processor -- start 2023-12-19T19:02:35.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.787+0000 7f8391d3e640 1 -- start start 2023-12-19T19:02:35.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.787+0000 7f8391d3e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f838c073a70 0x7f838c0bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.787+0000 7f8391d3e640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838c06a5b0 con 0x7f838c157c20 2023-12-19T19:02:35.792 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.787+0000 7f8391d3e640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838c06b710 con 0x7f838c14b010 2023-12-19T19:02:35.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.787+0000 7f8391d3e640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838c0c1d60 con 0x7f838c073a70 2023-12-19T19:02:35.793 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.787+0000 7f838bfff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f838c157c20 0x7f838c158070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52088/0 (socket says 172.21.15.133:52088) 2023-12-19T19:02:35.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.787+0000 7f838bfff640 1 -- 172.21.15.133:0/1805304166 learned_addr learned my addr 172.21.15.133:0/1805304166 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:35.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.787+0000 7f8383fff640 1 --2- 172.21.15.133:0/1805304166 >> v2:172.21.15.138:3300/0 conn(0x7f838c073a70 0x7f838c0bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.787+0000 7f838affd640 1 -- 172.21.15.133:0/1805304166 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497756090 0 0) 0x7f838c06a5b0 con 0x7f838c157c20 2023-12-19T19:02:35.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.787+0000 7f838affd640 1 -- 172.21.15.133:0/1805304166 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8378003530 con 0x7f838c157c20 2023-12-19T19:02:35.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.787+0000 7f838affd640 1 -- 172.21.15.133:0/1805304166 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937141818 0 0) 0x7f838c06b710 con 0x7f838c14b010 2023-12-19T19:02:35.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.787+0000 7f838affd640 1 -- 172.21.15.133:0/1805304166 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f838c06a5b0 con 0x7f838c14b010 2023-12-19T19:02:35.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.787+0000 7f8383fff640 1 -- 172.21.15.133:0/1805304166 >> v1:172.21.15.138:6789/0 conn(0x7f838c14b010 legacy=0x7f838c06b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.794 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.787+0000 7f8383fff640 1 -- 172.21.15.133:0/1805304166 >> v1:172.21.15.133:6789/0 conn(0x7f838c157c20 legacy=0x7f838c158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.795 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.787+0000 7f8383fff640 1 -- 172.21.15.133:0/1805304166 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838c0c2040 con 0x7f838c073a70 2023-12-19T19:02:35.796 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.791+0000 7f8383fff640 1 --2- 172.21.15.133:0/1805304166 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f838c073a70 0x7f838c0bf9f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f83740097c0 tx=0x7f837401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=255e302dffe220ed server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:35.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.791+0000 7f838affd640 1 -- 172.21.15.133:0/1805304166 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83740a8970 con 0x7f838c073a70 2023-12-19T19:02:35.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.791+0000 7f838affd640 1 -- 172.21.15.133:0/1805304166 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83740a8ad0 con 0x7f838c073a70 2023-12-19T19:02:35.797 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.791+0000 7f838affd640 1 -- 172.21.15.133:0/1805304166 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83740a8e60 con 0x7f838c073a70 2023-12-19T19:02:35.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.791+0000 7f8391d3e640 1 -- 172.21.15.133:0/1805304166 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f838c073a70 msgr2=0x7f838c0bf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.791+0000 7f8391d3e640 1 --2- 172.21.15.133:0/1805304166 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f838c073a70 0x7f838c0bf9f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f83740097c0 tx=0x7f837401ec70 comp rx=0 tx=0).stop 2023-12-19T19:02:35.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.791+0000 7f8391d3e640 1 -- 172.21.15.133:0/1805304166 shutdown_connections 2023-12-19T19:02:35.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.791+0000 7f8391d3e640 1 --2- 172.21.15.133:0/1805304166 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f838c073a70 0x7f838c0bf9f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.791+0000 7f8391d3e640 1 -- 172.21.15.133:0/1805304166 >> 172.21.15.133:0/1805304166 conn(0x7f838c0c30c0 msgr2=0x7f838c0c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:35.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.791+0000 7f8391d3e640 1 -- 172.21.15.133:0/1805304166 shutdown_connections 2023-12-19T19:02:35.798 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.791+0000 7f8391d3e640 1 -- 172.21.15.133:0/1805304166 wait complete. 2023-12-19T19:02:35.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f8391d3e640 1 Processor -- start 2023-12-19T19:02:35.799 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f8391d3e640 1 -- start start 2023-12-19T19:02:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f8391d3e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f838c073a70 0x7f838c156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.800 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f8391d3e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f838c14b010 0x7f838c144e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f8391d3e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f838c157c20 0x7f838c145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f8391d3e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c1458d0 con 0x7f838c073a70 2023-12-19T19:02:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f8391d3e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c1e9cf0 con 0x7f838c14b010 2023-12-19T19:02:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f8391d3e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838c1e9fd0 con 0x7f838c157c20 2023-12-19T19:02:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f838b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f838c073a70 0x7f838c156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f838b7fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f838c073a70 0x7f838c156fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32802/0 (socket says 172.21.15.133:32802) 2023-12-19T19:02:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f838b7fe640 1 -- 172.21.15.133:0/1500677048 learned_addr learned my addr 172.21.15.133:0/1500677048 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f8383fff640 1 --2- 172.21.15.133:0/1500677048 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f838c14b010 0x7f838c144e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.801 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f838bfff640 1 --2- 172.21.15.133:0/1500677048 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f838c157c20 0x7f838c145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f838b7fe640 1 -- 172.21.15.133:0/1500677048 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f838c157c20 msgr2=0x7f838c145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f838b7fe640 1 --2- 172.21.15.133:0/1500677048 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f838c157c20 0x7f838c145390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f838b7fe640 1 -- 172.21.15.133:0/1500677048 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f838c14b010 msgr2=0x7f838c144e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f838b7fe640 1 --2- 172.21.15.133:0/1500677048 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f838c14b010 0x7f838c144e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.803 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f838b7fe640 1 -- 172.21.15.133:0/1500677048 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8374009420 con 0x7f838c073a70 2023-12-19T19:02:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f838b7fe640 1 --2- 172.21.15.133:0/1500677048 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f838c073a70 0x7f838c156fe0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f837c00c490 tx=0x7f837c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f8388ff9640 1 -- 172.21.15.133:0/1500677048 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c0052d0 con 0x7f838c073a70 2023-12-19T19:02:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f8388ff9640 1 -- 172.21.15.133:0/1500677048 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c005430 con 0x7f838c073a70 2023-12-19T19:02:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f8388ff9640 1 -- 172.21.15.133:0/1500677048 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c012870 con 0x7f838c073a70 2023-12-19T19:02:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f8391d3e640 1 -- 172.21.15.133:0/1500677048 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f838c1ea2b0 con 0x7f838c073a70 2023-12-19T19:02:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f8391d3e640 1 -- 172.21.15.133:0/1500677048 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f838c1ea870 con 0x7f838c073a70 2023-12-19T19:02:35.804 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.795+0000 7f8391d3e640 1 -- 172.21.15.133:0/1500677048 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838c068400 con 0x7f838c073a70 2023-12-19T19:02:35.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.799+0000 7f8388ff9640 1 -- 172.21.15.133:0/1500677048 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f837c0129d0 con 0x7f838c073a70 2023-12-19T19:02:35.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.799+0000 7f8388ff9640 1 --2- 172.21.15.133:0/1500677048 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f836c066470 0x7f836c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:35.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.799+0000 7f8388ff9640 1 -- 172.21.15.133:0/1500677048 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f837c083750 con 0x7f838c073a70 2023-12-19T19:02:35.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.799+0000 7f8383fff640 1 --2- 172.21.15.133:0/1500677048 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f836c066470 0x7f836c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:35.805 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.799+0000 7f8383fff640 1 --2- 172.21.15.133:0/1500677048 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f836c066470 0x7f836c068930 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f83740b2000 tx=0x7f8374008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:35.808 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.803+0000 7f8388ff9640 1 -- 172.21.15.133:0/1500677048 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f837c050e80 con 0x7f838c073a70 2023-12-19T19:02:35.957 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.951+0000 7f8391d3e640 1 -- 172.21.15.133:0/1500677048 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f838c0735f0 con 0x7f836c066470 2023-12-19T19:02:35.958 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.951+0000 7f8388ff9640 1 -- 172.21.15.133:0/1500677048 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f83740b0440 con 0x7f836c066470 2023-12-19T19:02:35.958 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 2 to deep-scrub 2023-12-19T19:02:35.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.955+0000 7f8391d3e640 1 -- 172.21.15.133:0/1500677048 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f836c066470 msgr2=0x7f836c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.955+0000 7f8391d3e640 1 --2- 172.21.15.133:0/1500677048 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f836c066470 0x7f836c068930 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f83740b2000 tx=0x7f8374008040 comp rx=0 tx=0).stop 2023-12-19T19:02:35.960 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.955+0000 7f8391d3e640 1 -- 172.21.15.133:0/1500677048 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f838c073a70 msgr2=0x7f838c156fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:35.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.955+0000 7f8391d3e640 1 --2- 172.21.15.133:0/1500677048 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f838c073a70 0x7f838c156fe0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f837c00c490 tx=0x7f837c00c950 comp rx=0 tx=0).stop 2023-12-19T19:02:35.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.955+0000 7f8391d3e640 1 -- 172.21.15.133:0/1500677048 shutdown_connections 2023-12-19T19:02:35.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.955+0000 7f8391d3e640 1 --2- 172.21.15.133:0/1500677048 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f836c066470 0x7f836c068930 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.955+0000 7f8391d3e640 1 --2- 172.21.15.133:0/1500677048 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f838c157c20 0x7f838c145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.955+0000 7f8391d3e640 1 --2- 172.21.15.133:0/1500677048 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f838c14b010 0x7f838c144e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.955+0000 7f8391d3e640 1 --2- 172.21.15.133:0/1500677048 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f838c073a70 0x7f838c156fe0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:35.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.955+0000 7f8391d3e640 1 -- 172.21.15.133:0/1500677048 >> 172.21.15.133:0/1500677048 conn(0x7f838c0c30c0 msgr2=0x7f838c158070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:35.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.955+0000 7f8391d3e640 1 -- 172.21.15.133:0/1500677048 shutdown_connections 2023-12-19T19:02:35.961 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:35.955+0000 7f8391d3e640 1 -- 172.21.15.133:0/1500677048 wait complete. 2023-12-19T19:02:35.979 INFO:tasks.ceph:Scrubbing osd.3 2023-12-19T19:02:35.979 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-19T19:02:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.115+0000 7f1225a09640 1 Processor -- start 2023-12-19T19:02:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.115+0000 7f1225a09640 1 -- start start 2023-12-19T19:02:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.115+0000 7f1225a09640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1220151c70 0x7f122006ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.115+0000 7f1225a09640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f12200c8b90 0x7f12200c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.115+0000 7f1225a09640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1220154e90 con 0x7f1220155320 2023-12-19T19:02:36.122 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.115+0000 7f1225a09640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1220154630 con 0x7f1220151c70 2023-12-19T19:02:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.115+0000 7f1225a09640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12200c5350 con 0x7f12200c8b90 2023-12-19T19:02:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.115+0000 7f121effd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1220151c70 0x7f122006ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.115+0000 7f121effd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1220151c70 0x7f122006ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32814/0 (socket says 172.21.15.133:32814) 2023-12-19T19:02:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.115+0000 7f121effd640 1 -- 172.21.15.133:0/3237413505 learned_addr learned my addr 172.21.15.133:0/3237413505 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.115+0000 7f121effd640 1 -- 172.21.15.133:0/3237413505 >> v2:172.21.15.138:3300/0 conn(0x7f12200c8b90 msgr2=0x7f12200c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.115+0000 7f121f7fe640 1 --2- 172.21.15.133:0/3237413505 >> v2:172.21.15.138:3300/0 conn(0x7f12200c8b90 0x7f12200c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.115+0000 7f121effd640 1 --2- 172.21.15.133:0/3237413505 >> v2:172.21.15.138:3300/0 conn(0x7f12200c8b90 0x7f12200c8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.115+0000 7f121effd640 1 -- 172.21.15.133:0/3237413505 >> v1:172.21.15.138:6789/0 conn(0x7f1220155320 legacy=0x7f12200c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:36.123 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.115+0000 7f121effd640 1 -- 172.21.15.133:0/3237413505 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1220152050 con 0x7f1220151c70 2023-12-19T19:02:36.124 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.119+0000 7f121effd640 1 --2- 172.21.15.133:0/3237413505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1220151c70 0x7f122006ca40 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f122006a640 tx=0x7f121001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ecaf4a501dbea67 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:36.125 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.119+0000 7f121dffb640 1 -- 172.21.15.133:0/3237413505 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12100ab400 con 0x7f1220151c70 2023-12-19T19:02:36.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.119+0000 7f121dffb640 1 -- 172.21.15.133:0/3237413505 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12100ab560 con 0x7f1220151c70 2023-12-19T19:02:36.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.119+0000 7f121dffb640 1 -- 172.21.15.133:0/3237413505 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12100ab8f0 con 0x7f1220151c70 2023-12-19T19:02:36.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.119+0000 7f1225a09640 1 -- 172.21.15.133:0/3237413505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1220151c70 msgr2=0x7f122006ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.119+0000 7f1225a09640 1 --2- 172.21.15.133:0/3237413505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1220151c70 0x7f122006ca40 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f122006a640 tx=0x7f121001c400 comp rx=0 tx=0).stop 2023-12-19T19:02:36.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.119+0000 7f1225a09640 1 -- 172.21.15.133:0/3237413505 shutdown_connections 2023-12-19T19:02:36.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.119+0000 7f1225a09640 1 --2- 172.21.15.133:0/3237413505 >> v2:172.21.15.138:3300/0 conn(0x7f12200c8b90 0x7f12200c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.119+0000 7f1225a09640 1 --2- 172.21.15.133:0/3237413505 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1220151c70 0x7f122006ca40 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.119+0000 7f1225a09640 1 -- 172.21.15.133:0/3237413505 >> 172.21.15.133:0/3237413505 conn(0x7f12200abcf0 msgr2=0x7f12200ac100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:36.126 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.119+0000 7f1225a09640 1 -- 172.21.15.133:0/3237413505 shutdown_connections 2023-12-19T19:02:36.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.119+0000 7f1225a09640 1 -- 172.21.15.133:0/3237413505 wait complete. 2023-12-19T19:02:36.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f1225a09640 1 Processor -- start 2023-12-19T19:02:36.127 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f1225a09640 1 -- start start 2023-12-19T19:02:36.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f1225a09640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12200c8b90 0x7f12201ed5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.129 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f1225a09640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1220151c70 0x7f122014a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f1225a09640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1220155320 0x7f12201421c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f1225a09640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12200aaee0 con 0x7f1220151c70 2023-12-19T19:02:36.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f1225a09640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1220147100 con 0x7f1220155320 2023-12-19T19:02:36.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f1225a09640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12201524a0 con 0x7f12200c8b90 2023-12-19T19:02:36.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f121e7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1220151c70 0x7f122014a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f121e7fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1220151c70 0x7f122014a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32828/0 (socket says 172.21.15.133:32828) 2023-12-19T19:02:36.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f121e7fc640 1 -- 172.21.15.133:0/3128481991 learned_addr learned my addr 172.21.15.133:0/3128481991 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:36.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f121f7fe640 1 --2- 172.21.15.133:0/3128481991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1220155320 0x7f12201421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.130 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f121e7fc640 1 -- 172.21.15.133:0/3128481991 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12200c8b90 msgr2=0x7f12201ed5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f121effd640 1 --2- 172.21.15.133:0/3128481991 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12200c8b90 0x7f12201ed5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f121e7fc640 1 --2- 172.21.15.133:0/3128481991 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12200c8b90 0x7f12201ed5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f121e7fc640 1 -- 172.21.15.133:0/3128481991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1220155320 msgr2=0x7f12201421c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f121e7fc640 1 --2- 172.21.15.133:0/3128481991 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f1220155320 0x7f12201421c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f121e7fc640 1 -- 172.21.15.133:0/3128481991 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12100094d0 con 0x7f1220151c70 2023-12-19T19:02:36.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f121effd640 1 --2- 172.21.15.133:0/3128481991 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f12200c8b90 0x7f12201ed5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:36.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f121e7fc640 1 --2- 172.21.15.133:0/3128481991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1220151c70 0x7f122014a980 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f121400b410 tx=0x7f121400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:36.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f1207fff640 1 -- 172.21.15.133:0/3128481991 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1214005930 con 0x7f1220151c70 2023-12-19T19:02:36.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f1207fff640 1 -- 172.21.15.133:0/3128481991 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1214005a90 con 0x7f1220151c70 2023-12-19T19:02:36.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f1225a09640 1 -- 172.21.15.133:0/3128481991 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12201edb30 con 0x7f1220151c70 2023-12-19T19:02:36.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f1207fff640 1 -- 172.21.15.133:0/3128481991 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1214005e40 con 0x7f1220151c70 2023-12-19T19:02:36.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f1225a09640 1 -- 172.21.15.133:0/3128481991 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1220149080 con 0x7f1220151c70 2023-12-19T19:02:36.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.123+0000 7f1225a09640 1 -- 172.21.15.133:0/3128481991 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1220068400 con 0x7f1220151c70 2023-12-19T19:02:36.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.127+0000 7f1207fff640 1 -- 172.21.15.133:0/3128481991 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f1214011630 con 0x7f1220151c70 2023-12-19T19:02:36.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.127+0000 7f1207fff640 1 --2- 172.21.15.133:0/3128481991 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f120c066470 0x7f120c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.127+0000 7f1207fff640 1 -- 172.21.15.133:0/3128481991 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f12140837a0 con 0x7f1220151c70 2023-12-19T19:02:36.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.127+0000 7f1207fff640 1 --2- 172.21.15.133:0/3128481991 >> [v2:172.21.15.133:6808/829250353,v1:172.21.15.133:6809/829250353] conn(0x7f120c06c370 0x7f120c06e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.127+0000 7f1207fff640 1 -- 172.21.15.133:0/3128481991 --> [v2:172.21.15.133:6808/829250353,v1:172.21.15.133:6809/829250353] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f120c06ee40 con 0x7f120c06c370 2023-12-19T19:02:36.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.127+0000 7f1207fff640 1 -- 172.21.15.133:0/3128481991 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1214085d00 con 0x7f1220151c70 2023-12-19T19:02:36.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.127+0000 7f121effd640 1 --2- 172.21.15.133:0/3128481991 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f120c066470 0x7f120c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.127+0000 7f121f7fe640 1 --2- 172.21.15.133:0/3128481991 >> [v2:172.21.15.133:6808/829250353,v1:172.21.15.133:6809/829250353] conn(0x7f120c06c370 0x7f120c06e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.127+0000 7f121f7fe640 1 --2- 172.21.15.133:0/3128481991 >> [v2:172.21.15.133:6808/829250353,v1:172.21.15.133:6809/829250353] conn(0x7f120c06c370 0x7f120c06e790 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:36.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.127+0000 7f121effd640 1 --2- 172.21.15.133:0/3128481991 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f120c066470 0x7f120c068930 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f12100af000 tx=0x7f1210008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:36.134 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.127+0000 7f1207fff640 1 -- 172.21.15.133:0/3128481991 <== osd.3 v2:172.21.15.133:6808/829250353 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f120c06ee40 con 0x7f120c06c370 2023-12-19T19:02:36.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.139+0000 7f1225a09640 1 -- 172.21.15.133:0/3128481991 --> [v2:172.21.15.133:6808/829250353,v1:172.21.15.133:6809/829250353] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f12201edb30 con 0x7f120c06c370 2023-12-19T19:02:36.147 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.143+0000 7f1207fff640 1 -- 172.21.15.133:0/3128481991 <== osd.3 v2:172.21.15.133:6808/829250353 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f12201edb30 con 0x7f120c06c370 2023-12-19T19:02:36.147 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-19T19:02:36.147 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-19T19:02:36.147 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-19T19:02:36.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.143+0000 7f1225a09640 1 -- 172.21.15.133:0/3128481991 >> [v2:172.21.15.133:6808/829250353,v1:172.21.15.133:6809/829250353] conn(0x7f120c06c370 msgr2=0x7f120c06e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.143+0000 7f1225a09640 1 --2- 172.21.15.133:0/3128481991 >> [v2:172.21.15.133:6808/829250353,v1:172.21.15.133:6809/829250353] conn(0x7f120c06c370 0x7f120c06e790 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.148 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.143+0000 7f1225a09640 1 -- 172.21.15.133:0/3128481991 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f120c066470 msgr2=0x7f120c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.143+0000 7f1225a09640 1 --2- 172.21.15.133:0/3128481991 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f120c066470 0x7f120c068930 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f12100af000 tx=0x7f1210008040 comp rx=0 tx=0).stop 2023-12-19T19:02:36.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.143+0000 7f1225a09640 1 -- 172.21.15.133:0/3128481991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1220151c70 msgr2=0x7f122014a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.143+0000 7f1225a09640 1 --2- 172.21.15.133:0/3128481991 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1220151c70 0x7f122014a980 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f121400b410 tx=0x7f121400b8d0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.143+0000 7f121f7fe640 1 -- 172.21.15.133:0/3128481991 reap_dead start 2023-12-19T19:02:36.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.143+0000 7f1225a09640 1 -- 172.21.15.133:0/3128481991 shutdown_connections 2023-12-19T19:02:36.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.143+0000 7f1225a09640 1 -- 172.21.15.133:0/3128481991 >> 172.21.15.133:0/3128481991 conn(0x7f12200abcf0 msgr2=0x7f12200c47b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:36.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.143+0000 7f1225a09640 1 -- 172.21.15.133:0/3128481991 shutdown_connections 2023-12-19T19:02:36.149 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.143+0000 7f1225a09640 1 -- 172.21.15.133:0/3128481991 wait complete. 2023-12-19T19:02:36.166 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-19T19:02:36.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.299+0000 7f0f42734640 1 Processor -- start 2023-12-19T19:02:36.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.299+0000 7f0f42734640 1 -- start start 2023-12-19T19:02:36.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.299+0000 7f0f42734640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0f3c0af5c0 0x7f0f3c0c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.299+0000 7f0f42734640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0f3c0c4bc0 0x7f0f3c154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.299+0000 7f0f42734640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3c06c660 con 0x7f0f3c0c4750 2023-12-19T19:02:36.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.299+0000 7f0f42734640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3c06ba50 con 0x7f0f3c0af5c0 2023-12-19T19:02:36.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.299+0000 7f0f42734640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c06bd30 con 0x7f0f3c0c4bc0 2023-12-19T19:02:36.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.299+0000 7f0f40f31640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f0f3c0c4750 0x7f0f3c1544c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52104/0 (socket says 172.21.15.133:52104) 2023-12-19T19:02:36.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.299+0000 7f0f40f31640 1 -- 172.21.15.133:0/852410570 learned_addr learned my addr 172.21.15.133:0/852410570 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:36.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.299+0000 7f0f41732640 1 --2- 172.21.15.133:0/852410570 >> v2:172.21.15.133:3300/0 conn(0x7f0f3c0af5c0 0x7f0f3c0c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.299+0000 7f0f41f33640 1 --2- 172.21.15.133:0/852410570 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0f3c0c4bc0 0x7f0f3c154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.299+0000 7f0f33fff640 1 -- 172.21.15.133:0/852410570 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893255746 0 0) 0x7f0f3c06c660 con 0x7f0f3c0c4750 2023-12-19T19:02:36.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.299+0000 7f0f33fff640 1 -- 172.21.15.133:0/852410570 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f28003530 con 0x7f0f3c0c4750 2023-12-19T19:02:36.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.299+0000 7f0f41732640 1 -- 172.21.15.133:0/852410570 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0f3c0c4bc0 msgr2=0x7f0f3c154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:36.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.299+0000 7f0f41732640 1 --2- 172.21.15.133:0/852410570 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0f3c0c4bc0 0x7f0f3c154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.299+0000 7f0f41732640 1 -- 172.21.15.133:0/852410570 >> v1:172.21.15.133:6789/0 conn(0x7f0f3c0c4750 legacy=0x7f0f3c1544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.299+0000 7f0f41732640 1 -- 172.21.15.133:0/852410570 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c06c010 con 0x7f0f3c0af5c0 2023-12-19T19:02:36.308 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.299+0000 7f0f41f33640 1 --2- 172.21.15.133:0/852410570 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0f3c0c4bc0 0x7f0f3c154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:36.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.303+0000 7f0f41732640 1 --2- 172.21.15.133:0/852410570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3c0af5c0 0x7f0f3c0c7d80 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f0f380097c0 tx=0x7f0f3801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919bfe4cea3b4a29 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:36.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.303+0000 7f0f33fff640 1 -- 172.21.15.133:0/852410570 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f380ab600 con 0x7f0f3c0af5c0 2023-12-19T19:02:36.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.303+0000 7f0f33fff640 1 -- 172.21.15.133:0/852410570 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f380a7050 con 0x7f0f3c0af5c0 2023-12-19T19:02:36.309 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.303+0000 7f0f33fff640 1 -- 172.21.15.133:0/852410570 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f380ab980 con 0x7f0f3c0af5c0 2023-12-19T19:02:36.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.303+0000 7f0f42734640 1 -- 172.21.15.133:0/852410570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3c0af5c0 msgr2=0x7f0f3c0c7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.310 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.303+0000 7f0f42734640 1 --2- 172.21.15.133:0/852410570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3c0af5c0 0x7f0f3c0c7d80 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f0f380097c0 tx=0x7f0f3801c480 comp rx=0 tx=0).stop 2023-12-19T19:02:36.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.303+0000 7f0f42734640 1 -- 172.21.15.133:0/852410570 shutdown_connections 2023-12-19T19:02:36.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.303+0000 7f0f42734640 1 --2- 172.21.15.133:0/852410570 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0f3c0c4bc0 0x7f0f3c154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.303+0000 7f0f42734640 1 --2- 172.21.15.133:0/852410570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3c0af5c0 0x7f0f3c0c7d80 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.303+0000 7f0f42734640 1 -- 172.21.15.133:0/852410570 >> 172.21.15.133:0/852410570 conn(0x7f0f3c0ab960 msgr2=0x7f0f3c0abd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:36.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.303+0000 7f0f42734640 1 -- 172.21.15.133:0/852410570 shutdown_connections 2023-12-19T19:02:36.311 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.303+0000 7f0f42734640 1 -- 172.21.15.133:0/852410570 wait complete. 2023-12-19T19:02:36.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f42734640 1 Processor -- start 2023-12-19T19:02:36.312 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f42734640 1 -- start start 2023-12-19T19:02:36.313 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f42734640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3c0af5c0 0x7f0f3c0c3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f42734640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f3c0c4750 0x7f0f3c1ee2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f42734640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0f3c0c4bc0 0x7f0f3c1ee810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f42734640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c158730 con 0x7f0f3c0af5c0 2023-12-19T19:02:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f42734640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c1eed50 con 0x7f0f3c0c4750 2023-12-19T19:02:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f42734640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c157a10 con 0x7f0f3c0c4bc0 2023-12-19T19:02:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f41732640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3c0af5c0 0x7f0f3c0c3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f41732640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3c0af5c0 0x7f0f3c0c3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32844/0 (socket says 172.21.15.133:32844) 2023-12-19T19:02:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f41732640 1 -- 172.21.15.133:0/162442927 learned_addr learned my addr 172.21.15.133:0/162442927 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:36.314 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f41f33640 1 --2- 172.21.15.133:0/162442927 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0f3c0c4bc0 0x7f0f3c1ee810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f40f31640 1 --2- 172.21.15.133:0/162442927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f3c0c4750 0x7f0f3c1ee2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f41732640 1 -- 172.21.15.133:0/162442927 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0f3c0c4bc0 msgr2=0x7f0f3c1ee810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f41732640 1 --2- 172.21.15.133:0/162442927 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0f3c0c4bc0 0x7f0f3c1ee810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f41732640 1 -- 172.21.15.133:0/162442927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f3c0c4750 msgr2=0x7f0f3c1ee2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f41732640 1 --2- 172.21.15.133:0/162442927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f3c0c4750 0x7f0f3c1ee2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f41732640 1 -- 172.21.15.133:0/162442927 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f38009420 con 0x7f0f3c0af5c0 2023-12-19T19:02:36.315 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f41732640 1 --2- 172.21.15.133:0/162442927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3c0af5c0 0x7f0f3c0c3580 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f0f3801a0b0 tx=0x7f0f38019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:36.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f31ffb640 1 -- 172.21.15.133:0/162442927 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f380b4410 con 0x7f0f3c0af5c0 2023-12-19T19:02:36.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f31ffb640 1 -- 172.21.15.133:0/162442927 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f380b4570 con 0x7f0f3c0af5c0 2023-12-19T19:02:36.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f31ffb640 1 -- 172.21.15.133:0/162442927 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f380b4920 con 0x7f0f3c0af5c0 2023-12-19T19:02:36.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f42734640 1 -- 172.21.15.133:0/162442927 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f3c156970 con 0x7f0f3c0af5c0 2023-12-19T19:02:36.316 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.307+0000 7f0f42734640 1 -- 172.21.15.133:0/162442927 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3c156f30 con 0x7f0f3c0af5c0 2023-12-19T19:02:36.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.311+0000 7f0f42734640 1 -- 172.21.15.133:0/162442927 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3c04e850 con 0x7f0f3c0af5c0 2023-12-19T19:02:36.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.311+0000 7f0f31ffb640 1 -- 172.21.15.133:0/162442927 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f0f380b2040 con 0x7f0f3c0af5c0 2023-12-19T19:02:36.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.311+0000 7f0f31ffb640 1 --2- 172.21.15.133:0/162442927 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0f20066470 0x7f0f20068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.311+0000 7f0f31ffb640 1 -- 172.21.15.133:0/162442927 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f0f3811dc40 con 0x7f0f3c0af5c0 2023-12-19T19:02:36.317 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.311+0000 7f0f40f31640 1 --2- 172.21.15.133:0/162442927 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0f20066470 0x7f0f20068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.318 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.311+0000 7f0f40f31640 1 --2- 172.21.15.133:0/162442927 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0f20066470 0x7f0f20068930 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0aed30 tx=0x7f0f2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:36.321 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.315+0000 7f0f31ffb640 1 -- 172.21.15.133:0/162442927 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f0f380eb350 con 0x7f0f3c0af5c0 2023-12-19T19:02:36.471 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.467+0000 7f0f42734640 1 -- 172.21.15.133:0/162442927 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f3c161640 con 0x7f0f20066470 2023-12-19T19:02:36.472 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.467+0000 7f0f31ffb640 1 -- 172.21.15.133:0/162442927 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0f2c0013f0 con 0x7f0f20066470 2023-12-19T19:02:36.472 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 3 to deep-scrub 2023-12-19T19:02:36.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.467+0000 7f0f42734640 1 -- 172.21.15.133:0/162442927 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0f20066470 msgr2=0x7f0f20068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.467+0000 7f0f42734640 1 --2- 172.21.15.133:0/162442927 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0f20066470 0x7f0f20068930 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0aed30 tx=0x7f0f2c009040 comp rx=0 tx=0).stop 2023-12-19T19:02:36.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.467+0000 7f0f42734640 1 -- 172.21.15.133:0/162442927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3c0af5c0 msgr2=0x7f0f3c0c3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.474 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.467+0000 7f0f42734640 1 --2- 172.21.15.133:0/162442927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3c0af5c0 0x7f0f3c0c3580 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f0f3801a0b0 tx=0x7f0f38019220 comp rx=0 tx=0).stop 2023-12-19T19:02:36.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.467+0000 7f0f42734640 1 -- 172.21.15.133:0/162442927 shutdown_connections 2023-12-19T19:02:36.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.467+0000 7f0f42734640 1 --2- 172.21.15.133:0/162442927 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f0f20066470 0x7f0f20068930 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.467+0000 7f0f42734640 1 --2- 172.21.15.133:0/162442927 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f0f3c0c4bc0 0x7f0f3c1ee810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.467+0000 7f0f42734640 1 --2- 172.21.15.133:0/162442927 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f0f3c0c4750 0x7f0f3c1ee2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.467+0000 7f0f42734640 1 --2- 172.21.15.133:0/162442927 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0f3c0af5c0 0x7f0f3c0c3580 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.467+0000 7f0f42734640 1 -- 172.21.15.133:0/162442927 >> 172.21.15.133:0/162442927 conn(0x7f0f3c0ab960 msgr2=0x7f0f3c15e2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:36.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.467+0000 7f0f42734640 1 -- 172.21.15.133:0/162442927 shutdown_connections 2023-12-19T19:02:36.475 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.467+0000 7f0f42734640 1 -- 172.21.15.133:0/162442927 wait complete. 2023-12-19T19:02:36.493 INFO:tasks.ceph:Scrubbing osd.4 2023-12-19T19:02:36.493 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-19T19:02:36.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.627+0000 7f305569a640 1 Processor -- start 2023-12-19T19:02:36.634 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.627+0000 7f305569a640 1 -- start start 2023-12-19T19:02:36.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.631+0000 7f305569a640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f30500c4940 0x7f30500c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.631+0000 7f305569a640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30500c8b20 con 0x7f30500c9850 2023-12-19T19:02:36.635 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.631+0000 7f305569a640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30500c9cc0 con 0x7f30500c4d20 2023-12-19T19:02:36.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.631+0000 7f305569a640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30500c5650 con 0x7f30500c4940 2023-12-19T19:02:36.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.631+0000 7f30467fc640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f30500c9850 0x7f30500a98e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52114/0 (socket says 172.21.15.133:52114) 2023-12-19T19:02:36.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.631+0000 7f30467fc640 1 -- 172.21.15.133:0/1854278403 learned_addr learned my addr 172.21.15.133:0/1854278403 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:36.636 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.631+0000 7f304effd640 1 --2- 172.21.15.133:0/1854278403 >> v2:172.21.15.138:3300/0 conn(0x7f30500c4940 0x7f30500c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.631+0000 7f304e7fc640 1 -- 172.21.15.133:0/1854278403 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2333972470 0 0) 0x7f30500c8b20 con 0x7f30500c9850 2023-12-19T19:02:36.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.631+0000 7f304e7fc640 1 -- 172.21.15.133:0/1854278403 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f303c003530 con 0x7f30500c9850 2023-12-19T19:02:36.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.631+0000 7f304e7fc640 1 -- 172.21.15.133:0/1854278403 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1572994431 0 0) 0x7f30500c9cc0 con 0x7f30500c4d20 2023-12-19T19:02:36.637 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.631+0000 7f304e7fc640 1 -- 172.21.15.133:0/1854278403 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30500c8b20 con 0x7f30500c4d20 2023-12-19T19:02:36.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.631+0000 7f304effd640 1 -- 172.21.15.133:0/1854278403 >> v1:172.21.15.138:6789/0 conn(0x7f30500c4d20 legacy=0x7f305015f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.631+0000 7f304e7fc640 1 -- 172.21.15.133:0/1854278403 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3274425177 0 0) 0x7f303c003530 con 0x7f30500c9850 2023-12-19T19:02:36.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.631+0000 7f304effd640 1 -- 172.21.15.133:0/1854278403 >> v1:172.21.15.133:6789/0 conn(0x7f30500c9850 legacy=0x7f30500a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.638 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.631+0000 7f304effd640 1 -- 172.21.15.133:0/1854278403 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30500c5150 con 0x7f30500c4940 2023-12-19T19:02:36.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.635+0000 7f304effd640 1 --2- 172.21.15.133:0/1854278403 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30500c4940 0x7f30500c7f70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f30380097c0 tx=0x7f303801c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c5ea3b3e12235d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:36.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.635+0000 7f304e7fc640 1 -- 172.21.15.133:0/1854278403 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3040001680 con 0x7f30500c4940 2023-12-19T19:02:36.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.635+0000 7f304e7fc640 1 -- 172.21.15.133:0/1854278403 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30380a7050 con 0x7f30500c4940 2023-12-19T19:02:36.639 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.635+0000 7f304e7fc640 1 -- 172.21.15.133:0/1854278403 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30380ab600 con 0x7f30500c4940 2023-12-19T19:02:36.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.635+0000 7f305569a640 1 -- 172.21.15.133:0/1854278403 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30500c4940 msgr2=0x7f30500c7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.635+0000 7f305569a640 1 --2- 172.21.15.133:0/1854278403 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30500c4940 0x7f30500c7f70 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f30380097c0 tx=0x7f303801c3a0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.640 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.635+0000 7f305569a640 1 -- 172.21.15.133:0/1854278403 shutdown_connections 2023-12-19T19:02:36.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.635+0000 7f305569a640 1 --2- 172.21.15.133:0/1854278403 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30500c4940 0x7f30500c7f70 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.635+0000 7f305569a640 1 -- 172.21.15.133:0/1854278403 >> 172.21.15.133:0/1854278403 conn(0x7f30500abb70 msgr2=0x7f30500abf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:36.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.635+0000 7f305569a640 1 -- 172.21.15.133:0/1854278403 shutdown_connections 2023-12-19T19:02:36.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.635+0000 7f305569a640 1 -- 172.21.15.133:0/1854278403 wait complete. 2023-12-19T19:02:36.641 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.635+0000 7f305569a640 1 Processor -- start 2023-12-19T19:02:36.642 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.635+0000 7f305569a640 1 -- start start 2023-12-19T19:02:36.644 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.635+0000 7f305569a640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30500c4940 0x7f30501538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.635+0000 7f305569a640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30500c4d20 0x7f3050149d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.639+0000 7f305569a640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30500c9850 0x7f305014a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.639+0000 7f305569a640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305014d300 con 0x7f30500c4940 2023-12-19T19:02:36.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.639+0000 7f305569a640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3050158420 con 0x7f30500c9850 2023-12-19T19:02:36.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.639+0000 7f305569a640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305014a800 con 0x7f30500c4d20 2023-12-19T19:02:36.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.639+0000 7f304effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30500c4940 0x7f30501538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.645 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.639+0000 7f304effd640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30500c4940 0x7f30501538b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32854/0 (socket says 172.21.15.133:32854) 2023-12-19T19:02:36.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.639+0000 7f304effd640 1 -- 172.21.15.133:0/2067501851 learned_addr learned my addr 172.21.15.133:0/2067501851 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:36.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.639+0000 7f30467fc640 1 --2- 172.21.15.133:0/2067501851 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30500c4d20 0x7f3050149d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.639+0000 7f304f7fe640 1 --2- 172.21.15.133:0/2067501851 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30500c9850 0x7f305014a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.639+0000 7f304effd640 1 -- 172.21.15.133:0/2067501851 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30500c4d20 msgr2=0x7f3050149d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.639+0000 7f304effd640 1 --2- 172.21.15.133:0/2067501851 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f30500c4d20 0x7f3050149d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.639+0000 7f304effd640 1 -- 172.21.15.133:0/2067501851 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30500c9850 msgr2=0x7f305014a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.639+0000 7f304effd640 1 --2- 172.21.15.133:0/2067501851 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f30500c9850 0x7f305014a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.639+0000 7f304effd640 1 -- 172.21.15.133:0/2067501851 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3038009420 con 0x7f30500c4940 2023-12-19T19:02:36.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.639+0000 7f304effd640 1 --2- 172.21.15.133:0/2067501851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30500c4940 0x7f30501538b0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f3038000c10 tx=0x7f3038019140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:36.646 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.639+0000 7f3047fff640 1 -- 172.21.15.133:0/2067501851 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3038003ab0 con 0x7f30500c4940 2023-12-19T19:02:36.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.639+0000 7f3047fff640 1 -- 172.21.15.133:0/2067501851 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3038003c10 con 0x7f30500c4940 2023-12-19T19:02:36.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.639+0000 7f3047fff640 1 -- 172.21.15.133:0/2067501851 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30380ab400 con 0x7f30500c4940 2023-12-19T19:02:36.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.639+0000 7f305569a640 1 -- 172.21.15.133:0/2067501851 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30500c02c0 con 0x7f30500c4940 2023-12-19T19:02:36.647 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.639+0000 7f305569a640 1 -- 172.21.15.133:0/2067501851 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30500c1090 con 0x7f30500c4940 2023-12-19T19:02:36.648 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.639+0000 7f305569a640 1 -- 172.21.15.133:0/2067501851 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f30500ae7c0 con 0x7f30500c4940 2023-12-19T19:02:36.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.639+0000 7f3047fff640 1 -- 172.21.15.133:0/2067501851 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f30380b2040 con 0x7f30500c4940 2023-12-19T19:02:36.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.643+0000 7f3047fff640 1 --2- 172.21.15.133:0/2067501851 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f30300664a0 0x7f3030068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.643+0000 7f3047fff640 1 -- 172.21.15.133:0/2067501851 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f303811e6b0 con 0x7f30500c4940 2023-12-19T19:02:36.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.643+0000 7f3047fff640 1 --2- 172.21.15.133:0/2067501851 >> [v2:172.21.15.138:6800/3351784616,v1:172.21.15.138:6801/3351784616] conn(0x7f303006c3a0 0x7f303006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.643+0000 7f3047fff640 1 -- 172.21.15.133:0/2067501851 --> [v2:172.21.15.138:6800/3351784616,v1:172.21.15.138:6801/3351784616] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f303006ee70 con 0x7f303006c3a0 2023-12-19T19:02:36.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.643+0000 7f3047fff640 1 -- 172.21.15.133:0/2067501851 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f303811ea20 con 0x7f30500c4940 2023-12-19T19:02:36.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.643+0000 7f30467fc640 1 --2- 172.21.15.133:0/2067501851 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f30300664a0 0x7f3030068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.649 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.643+0000 7f304f7fe640 1 --2- 172.21.15.133:0/2067501851 >> [v2:172.21.15.138:6800/3351784616,v1:172.21.15.138:6801/3351784616] conn(0x7f303006c3a0 0x7f303006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.643+0000 7f30467fc640 1 --2- 172.21.15.133:0/2067501851 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f30300664a0 0x7f3030068960 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3050154220 tx=0x7f3040009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:36.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.643+0000 7f304f7fe640 1 --2- 172.21.15.133:0/2067501851 >> [v2:172.21.15.138:6800/3351784616,v1:172.21.15.138:6801/3351784616] conn(0x7f303006c3a0 0x7f303006e7c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:36.650 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.643+0000 7f3047fff640 1 -- 172.21.15.133:0/2067501851 <== osd.4 v2:172.21.15.138:6800/3351784616 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f303006ee70 con 0x7f303006c3a0 2023-12-19T19:02:36.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.655+0000 7f305569a640 1 -- 172.21.15.133:0/2067501851 --> [v2:172.21.15.138:6800/3351784616,v1:172.21.15.138:6801/3351784616] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3050155620 con 0x7f303006c3a0 2023-12-19T19:02:36.662 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.655+0000 7f3047fff640 1 -- 172.21.15.133:0/2067501851 <== osd.4 v2:172.21.15.138:6800/3351784616 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3048001aa0 con 0x7f303006c3a0 2023-12-19T19:02:36.663 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-19T19:02:36.663 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-19T19:02:36.663 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-19T19:02:36.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.655+0000 7f305569a640 1 -- 172.21.15.133:0/2067501851 >> [v2:172.21.15.138:6800/3351784616,v1:172.21.15.138:6801/3351784616] conn(0x7f303006c3a0 msgr2=0x7f303006e7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.655+0000 7f305569a640 1 --2- 172.21.15.133:0/2067501851 >> [v2:172.21.15.138:6800/3351784616,v1:172.21.15.138:6801/3351784616] conn(0x7f303006c3a0 0x7f303006e7c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.659+0000 7f305569a640 1 -- 172.21.15.133:0/2067501851 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f30300664a0 msgr2=0x7f3030068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.659+0000 7f305569a640 1 --2- 172.21.15.133:0/2067501851 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f30300664a0 0x7f3030068960 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f3050154220 tx=0x7f3040009040 comp rx=0 tx=0).stop 2023-12-19T19:02:36.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.659+0000 7f305569a640 1 -- 172.21.15.133:0/2067501851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30500c4940 msgr2=0x7f30501538b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.659+0000 7f305569a640 1 --2- 172.21.15.133:0/2067501851 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30500c4940 0x7f30501538b0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f3038000c10 tx=0x7f3038019140 comp rx=0 tx=0).stop 2023-12-19T19:02:36.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.659+0000 7f304f7fe640 1 -- 172.21.15.133:0/2067501851 reap_dead start 2023-12-19T19:02:36.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.659+0000 7f305569a640 1 -- 172.21.15.133:0/2067501851 shutdown_connections 2023-12-19T19:02:36.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.659+0000 7f305569a640 1 -- 172.21.15.133:0/2067501851 >> 172.21.15.133:0/2067501851 conn(0x7f30500abb70 msgr2=0x7f30501515c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:36.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.659+0000 7f305569a640 1 -- 172.21.15.133:0/2067501851 shutdown_connections 2023-12-19T19:02:36.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.659+0000 7f305569a640 1 -- 172.21.15.133:0/2067501851 wait complete. 2023-12-19T19:02:36.681 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-19T19:02:36.819 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.815+0000 7f6669e32640 1 Processor -- start 2023-12-19T19:02:36.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.815+0000 7f6669e32640 1 -- start start 2023-12-19T19:02:36.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.815+0000 7f6669e32640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f66640a5370 0x7f66640c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.815+0000 7f6669e32640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f66640c4110 0x7f6664150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.815+0000 7f6669e32640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66640c2760 con 0x7f6664072090 2023-12-19T19:02:36.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.815+0000 7f6669e32640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66640c3070 con 0x7f66640c4110 2023-12-19T19:02:36.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.815+0000 7f6669e32640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6664151bf0 con 0x7f66640a5370 2023-12-19T19:02:36.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.815+0000 7f6662ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f66640c4110 0x7f6664150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.815+0000 7f6662ffd640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f66640c4110 0x7f6664150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32858/0 (socket says 172.21.15.133:32858) 2023-12-19T19:02:36.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.815+0000 7f6662ffd640 1 -- 172.21.15.133:0/2586949973 learned_addr learned my addr 172.21.15.133:0/2586949973 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:36.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.815+0000 7f66637fe640 1 --2- 172.21.15.133:0/2586949973 >> v2:172.21.15.138:3300/0 conn(0x7f66640a5370 0x7f66640c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.815+0000 7f6662ffd640 1 -- 172.21.15.133:0/2586949973 >> v2:172.21.15.138:3300/0 conn(0x7f66640a5370 msgr2=0x7f66640c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:36.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.815+0000 7f6662ffd640 1 --2- 172.21.15.133:0/2586949973 >> v2:172.21.15.138:3300/0 conn(0x7f66640a5370 0x7f66640c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.815+0000 7f6662ffd640 1 -- 172.21.15.133:0/2586949973 >> v1:172.21.15.138:6789/0 conn(0x7f6664072090 legacy=0x7f66641514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:36.823 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.815+0000 7f6662ffd640 1 -- 172.21.15.133:0/2586949973 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66640a5750 con 0x7f66640c4110 2023-12-19T19:02:36.824 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.819+0000 7f6662ffd640 1 --2- 172.21.15.133:0/2586949973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66640c4110 0x7f6664150fa0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f66640a8af0 tx=0x7f665801d740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36857acb906c5c8c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:36.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.819+0000 7f66627fc640 1 -- 172.21.15.133:0/2586949973 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66580a6770 con 0x7f66640c4110 2023-12-19T19:02:36.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.819+0000 7f66627fc640 1 -- 172.21.15.133:0/2586949973 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66580a68d0 con 0x7f66640c4110 2023-12-19T19:02:36.825 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.819+0000 7f66627fc640 1 -- 172.21.15.133:0/2586949973 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66580a6c60 con 0x7f66640c4110 2023-12-19T19:02:36.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.819+0000 7f6669e32640 1 -- 172.21.15.133:0/2586949973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66640c4110 msgr2=0x7f6664150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.819+0000 7f6669e32640 1 --2- 172.21.15.133:0/2586949973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66640c4110 0x7f6664150fa0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f66640a8af0 tx=0x7f665801d740 comp rx=0 tx=0).stop 2023-12-19T19:02:36.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.819+0000 7f6669e32640 1 -- 172.21.15.133:0/2586949973 shutdown_connections 2023-12-19T19:02:36.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.819+0000 7f6669e32640 1 --2- 172.21.15.133:0/2586949973 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f66640c4110 0x7f6664150fa0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.826 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.819+0000 7f6669e32640 1 --2- 172.21.15.133:0/2586949973 >> v2:172.21.15.138:3300/0 conn(0x7f66640a5370 0x7f66640c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.819+0000 7f6669e32640 1 -- 172.21.15.133:0/2586949973 >> 172.21.15.133:0/2586949973 conn(0x7f666406a5b0 msgr2=0x7f666406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:36.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.819+0000 7f6669e32640 1 -- 172.21.15.133:0/2586949973 shutdown_connections 2023-12-19T19:02:36.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.819+0000 7f6669e32640 1 -- 172.21.15.133:0/2586949973 wait complete. 2023-12-19T19:02:36.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f6669e32640 1 Processor -- start 2023-12-19T19:02:36.827 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f6669e32640 1 -- start start 2023-12-19T19:02:36.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f6669e32640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6664072090 0x7f666414b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f6669e32640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66640a5370 0x7f666406fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f6669e32640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66640c4110 0x7f6664145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f6669e32640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66641e9740 con 0x7f6664072090 2023-12-19T19:02:36.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f6669e32640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66641e9c70 con 0x7f66640c4110 2023-12-19T19:02:36.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f6669e32640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66641e9990 con 0x7f66640a5370 2023-12-19T19:02:36.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f66637fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6664072090 0x7f666414b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f66637fe640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6664072090 0x7f666414b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32862/0 (socket says 172.21.15.133:32862) 2023-12-19T19:02:36.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f66637fe640 1 -- 172.21.15.133:0/681752143 learned_addr learned my addr 172.21.15.133:0/681752143 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:36.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f6663fff640 1 --2- 172.21.15.133:0/681752143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66640c4110 0x7f6664145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f6662ffd640 1 --2- 172.21.15.133:0/681752143 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66640a5370 0x7f666406fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f66637fe640 1 -- 172.21.15.133:0/681752143 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66640a5370 msgr2=0x7f666406fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f66637fe640 1 --2- 172.21.15.133:0/681752143 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66640a5370 0x7f666406fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.831 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f66637fe640 1 -- 172.21.15.133:0/681752143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66640c4110 msgr2=0x7f6664145cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f66637fe640 1 --2- 172.21.15.133:0/681752143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66640c4110 0x7f6664145cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f66637fe640 1 -- 172.21.15.133:0/681752143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665800a670 con 0x7f6664072090 2023-12-19T19:02:36.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f6663fff640 1 --2- 172.21.15.133:0/681752143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66640c4110 0x7f6664145cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:36.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f66637fe640 1 --2- 172.21.15.133:0/681752143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6664072090 0x7f666414b3c0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f665400d800 tx=0x7f665400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:36.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f664bfff640 1 -- 172.21.15.133:0/681752143 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665400b6c0 con 0x7f6664072090 2023-12-19T19:02:36.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f664bfff640 1 -- 172.21.15.133:0/681752143 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665400b820 con 0x7f6664072090 2023-12-19T19:02:36.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f664bfff640 1 -- 172.21.15.133:0/681752143 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665400bb90 con 0x7f6664072090 2023-12-19T19:02:36.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f6669e32640 1 -- 172.21.15.133:0/681752143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6664149680 con 0x7f6664072090 2023-12-19T19:02:36.832 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f6669e32640 1 -- 172.21.15.133:0/681752143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6664071990 con 0x7f6664072090 2023-12-19T19:02:36.833 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.823+0000 7f6669e32640 1 -- 172.21.15.133:0/681752143 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f666414b900 con 0x7f6664072090 2023-12-19T19:02:36.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.827+0000 7f664bfff640 1 -- 172.21.15.133:0/681752143 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f665400bcf0 con 0x7f6664072090 2023-12-19T19:02:36.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.827+0000 7f664bfff640 1 --2- 172.21.15.133:0/681752143 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6650066470 0x7f6650068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:36.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.827+0000 7f664bfff640 1 -- 172.21.15.133:0/681752143 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f6654084180 con 0x7f6664072090 2023-12-19T19:02:36.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.827+0000 7f6662ffd640 1 --2- 172.21.15.133:0/681752143 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6650066470 0x7f6650068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:36.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.827+0000 7f6662ffd640 1 --2- 172.21.15.133:0/681752143 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6650066470 0x7f6650068930 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f66580b0000 tx=0x7f6658008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:36.836 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.831+0000 7f664bfff640 1 -- 172.21.15.133:0/681752143 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6654051890 con 0x7f6664072090 2023-12-19T19:02:36.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.979+0000 7f6669e32640 1 -- 172.21.15.133:0/681752143 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f66640c2c90 con 0x7f6650066470 2023-12-19T19:02:36.987 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.983+0000 7f664bfff640 1 -- 172.21.15.133:0/681752143 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f66580a6a40 con 0x7f6650066470 2023-12-19T19:02:36.988 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 4 to deep-scrub 2023-12-19T19:02:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.983+0000 7f6669e32640 1 -- 172.21.15.133:0/681752143 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6650066470 msgr2=0x7f6650068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.983+0000 7f6669e32640 1 --2- 172.21.15.133:0/681752143 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6650066470 0x7f6650068930 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f66580b0000 tx=0x7f6658008040 comp rx=0 tx=0).stop 2023-12-19T19:02:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.983+0000 7f6669e32640 1 -- 172.21.15.133:0/681752143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6664072090 msgr2=0x7f666414b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:36.990 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.983+0000 7f6669e32640 1 --2- 172.21.15.133:0/681752143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6664072090 0x7f666414b3c0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f665400d800 tx=0x7f665400dcc0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.983+0000 7f6669e32640 1 -- 172.21.15.133:0/681752143 shutdown_connections 2023-12-19T19:02:36.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.983+0000 7f6669e32640 1 --2- 172.21.15.133:0/681752143 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6650066470 0x7f6650068930 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.983+0000 7f6669e32640 1 --2- 172.21.15.133:0/681752143 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f66640c4110 0x7f6664145cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.983+0000 7f6669e32640 1 --2- 172.21.15.133:0/681752143 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66640a5370 0x7f666406fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.983+0000 7f6669e32640 1 --2- 172.21.15.133:0/681752143 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6664072090 0x7f666414b3c0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:36.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.983+0000 7f6669e32640 1 -- 172.21.15.133:0/681752143 >> 172.21.15.133:0/681752143 conn(0x7f666406a5b0 msgr2=0x7f66640a8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:36.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.983+0000 7f6669e32640 1 -- 172.21.15.133:0/681752143 shutdown_connections 2023-12-19T19:02:36.991 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:36.983+0000 7f6669e32640 1 -- 172.21.15.133:0/681752143 wait complete. 2023-12-19T19:02:37.010 INFO:tasks.ceph:Scrubbing osd.5 2023-12-19T19:02:37.010 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-19T19:02:37.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.143+0000 7fa5155f8640 1 Processor -- start 2023-12-19T19:02:37.151 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.147+0000 7fa5155f8640 1 -- start start 2023-12-19T19:02:37.154 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.147+0000 7fa5155f8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa5100c1250 0x7fa5100c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.147+0000 7fa5155f8640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fa51006fec0 0x7fa5100c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.147+0000 7fa5155f8640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5100c0aa0 0x7fa5100c4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.147+0000 7fa5155f8640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5100a9fc0 con 0x7fa5100c0aa0 2023-12-19T19:02:37.155 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.147+0000 7fa5155f8640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa510072800 con 0x7fa51006fec0 2023-12-19T19:02:37.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.147+0000 7fa5155f8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa510072ae0 con 0x7fa5100c1250 2023-12-19T19:02:37.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.147+0000 7fa50f7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5100c0aa0 0x7fa5100c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.147+0000 7fa50f7fe640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa5100c0aa0 0x7fa5100c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32872/0 (socket says 172.21.15.133:32872) 2023-12-19T19:02:37.156 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.147+0000 7fa50f7fe640 1 -- 172.21.15.133:0/1295032437 learned_addr learned my addr 172.21.15.133:0/1295032437 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:37.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.147+0000 7fa50f7fe640 1 -- 172.21.15.133:0/1295032437 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa5100c1250 msgr2=0x7fa5100c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:37.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.147+0000 7fa50effd640 1 --2- 172.21.15.133:0/1295032437 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa5100c1250 0x7fa5100c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.147+0000 7fa5067fc640 1 --2- 172.21.15.133:0/1295032437 >> v2:172.21.15.138:3300/0 conn(0x7fa51006fec0 0x7fa5100c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.157 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.147+0000 7fa50f7fe640 1 --2- 172.21.15.133:0/1295032437 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa5100c1250 0x7fa5100c1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.147+0000 7fa50f7fe640 1 -- 172.21.15.133:0/1295032437 >> v2:172.21.15.138:3300/0 conn(0x7fa51006fec0 msgr2=0x7fa5100c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:37.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.147+0000 7fa50f7fe640 1 --2- 172.21.15.133:0/1295032437 >> v2:172.21.15.138:3300/0 conn(0x7fa51006fec0 0x7fa5100c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.147+0000 7fa50f7fe640 1 -- 172.21.15.133:0/1295032437 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5100a9900 con 0x7fa5100c0aa0 2023-12-19T19:02:37.158 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.147+0000 7fa5067fc640 1 --2- 172.21.15.133:0/1295032437 >> v2:172.21.15.138:3300/0 conn(0x7fa51006fec0 0x7fa5100c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T19:02:37.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.151+0000 7fa50f7fe640 1 --2- 172.21.15.133:0/1295032437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5100c0aa0 0x7fa5100c4180 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fa5100c6c90 tx=0x7fa50801c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54b6217faff6a17 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:37.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.151+0000 7fa50e7fc640 1 -- 172.21.15.133:0/1295032437 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5080ad640 con 0x7fa5100c0aa0 2023-12-19T19:02:37.163 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.151+0000 7fa50e7fc640 1 -- 172.21.15.133:0/1295032437 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5080ad7a0 con 0x7fa5100c0aa0 2023-12-19T19:02:37.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.151+0000 7fa50e7fc640 1 -- 172.21.15.133:0/1295032437 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5080adb30 con 0x7fa5100c0aa0 2023-12-19T19:02:37.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.151+0000 7fa5155f8640 1 -- 172.21.15.133:0/1295032437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5100c0aa0 msgr2=0x7fa5100c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.151+0000 7fa5155f8640 1 --2- 172.21.15.133:0/1295032437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5100c0aa0 0x7fa5100c4180 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fa5100c6c90 tx=0x7fa50801c3b0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.151+0000 7fa5155f8640 1 -- 172.21.15.133:0/1295032437 shutdown_connections 2023-12-19T19:02:37.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.151+0000 7fa5155f8640 1 --2- 172.21.15.133:0/1295032437 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5100c0aa0 0x7fa5100c4180 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.151+0000 7fa5155f8640 1 --2- 172.21.15.133:0/1295032437 >> v2:172.21.15.138:3300/0 conn(0x7fa51006fec0 0x7fa5100c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.151+0000 7fa5155f8640 1 --2- 172.21.15.133:0/1295032437 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa5100c1250 0x7fa5100c1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.164 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.151+0000 7fa5155f8640 1 -- 172.21.15.133:0/1295032437 >> 172.21.15.133:0/1295032437 conn(0x7fa5100c5d40 msgr2=0x7fa5100c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:37.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.151+0000 7fa5155f8640 1 -- 172.21.15.133:0/1295032437 shutdown_connections 2023-12-19T19:02:37.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.151+0000 7fa5155f8640 1 -- 172.21.15.133:0/1295032437 wait complete. 2023-12-19T19:02:37.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.151+0000 7fa5155f8640 1 Processor -- start 2023-12-19T19:02:37.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.151+0000 7fa5155f8640 1 -- start start 2023-12-19T19:02:37.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa5155f8640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa51006fec0 0x7fa5101e3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa5155f8640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5100c0aa0 0x7fa510151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa5155f8640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa5100c1250 0x7fa5101517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa5155f8640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5101e4f40 con 0x7fa5100c0aa0 2023-12-19T19:02:37.165 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa5155f8640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5101f1290 con 0x7fa51006fec0 2023-12-19T19:02:37.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa5155f8640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5101f1570 con 0x7fa5100c1250 2023-12-19T19:02:37.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa5067fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5100c0aa0 0x7fa510151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa5067fc640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5100c0aa0 0x7fa510151260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32884/0 (socket says 172.21.15.133:32884) 2023-12-19T19:02:37.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa5067fc640 1 -- 172.21.15.133:0/775022031 learned_addr learned my addr 172.21.15.133:0/775022031 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:37.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa50effd640 1 --2- 172.21.15.133:0/775022031 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa51006fec0 0x7fa5101e3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa50f7fe640 1 --2- 172.21.15.133:0/775022031 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa5100c1250 0x7fa5101517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa5067fc640 1 -- 172.21.15.133:0/775022031 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa5100c1250 msgr2=0x7fa5101517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa5067fc640 1 --2- 172.21.15.133:0/775022031 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fa5100c1250 0x7fa5101517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa5067fc640 1 -- 172.21.15.133:0/775022031 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa51006fec0 msgr2=0x7fa5101e3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.166 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa5067fc640 1 --2- 172.21.15.133:0/775022031 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fa51006fec0 0x7fa5101e3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa5067fc640 1 -- 172.21.15.133:0/775022031 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5080094d0 con 0x7fa5100c0aa0 2023-12-19T19:02:37.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa5067fc640 1 --2- 172.21.15.133:0/775022031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5100c0aa0 0x7fa510151260 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fa4f800c7c0 tx=0x7fa4f800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:37.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa507fff640 1 -- 172.21.15.133:0/775022031 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8007820 con 0x7fa5100c0aa0 2023-12-19T19:02:37.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa507fff640 1 -- 172.21.15.133:0/775022031 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f8007980 con 0x7fa5100c0aa0 2023-12-19T19:02:37.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa507fff640 1 -- 172.21.15.133:0/775022031 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8007d10 con 0x7fa5100c0aa0 2023-12-19T19:02:37.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa5155f8640 1 -- 172.21.15.133:0/775022031 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5100c26b0 con 0x7fa5100c0aa0 2023-12-19T19:02:37.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa5155f8640 1 -- 172.21.15.133:0/775022031 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5101e39a0 con 0x7fa5100c0aa0 2023-12-19T19:02:37.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa5155f8640 1 -- 172.21.15.133:0/775022031 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa5101e4a50 con 0x7fa5100c0aa0 2023-12-19T19:02:37.167 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.155+0000 7fa507fff640 1 -- 172.21.15.133:0/775022031 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fa4f80113f0 con 0x7fa5100c0aa0 2023-12-19T19:02:37.168 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.159+0000 7fa507fff640 1 --2- 172.21.15.133:0/775022031 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa4f00664a0 0x7fa4f0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.159+0000 7fa507fff640 1 -- 172.21.15.133:0/775022031 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa4f8083c00 con 0x7fa5100c0aa0 2023-12-19T19:02:37.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.159+0000 7fa507fff640 1 --2- 172.21.15.133:0/775022031 >> [v2:172.21.15.138:6808/2638336882,v1:172.21.15.138:6809/2638336882] conn(0x7fa4f006c3a0 0x7fa4f006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.159+0000 7fa507fff640 1 -- 172.21.15.133:0/775022031 --> [v2:172.21.15.138:6808/2638336882,v1:172.21.15.138:6809/2638336882] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa4f006ee70 con 0x7fa4f006c3a0 2023-12-19T19:02:37.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.159+0000 7fa507fff640 1 -- 172.21.15.133:0/775022031 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4f80882a0 con 0x7fa5100c0aa0 2023-12-19T19:02:37.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.159+0000 7fa50effd640 1 --2- 172.21.15.133:0/775022031 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa4f00664a0 0x7fa4f0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.159+0000 7fa50f7fe640 1 --2- 172.21.15.133:0/775022031 >> [v2:172.21.15.138:6808/2638336882,v1:172.21.15.138:6809/2638336882] conn(0x7fa4f006c3a0 0x7fa4f006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.159+0000 7fa50effd640 1 --2- 172.21.15.133:0/775022031 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa4f00664a0 0x7fa4f0068960 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa50000f360 tx=0x7fa500007710 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:37.169 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.159+0000 7fa50f7fe640 1 --2- 172.21.15.133:0/775022031 >> [v2:172.21.15.138:6808/2638336882,v1:172.21.15.138:6809/2638336882] conn(0x7fa4f006c3a0 0x7fa4f006e7c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:37.170 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.159+0000 7fa507fff640 1 -- 172.21.15.133:0/775022031 <== osd.5 v2:172.21.15.138:6808/2638336882 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa4f006ee70 con 0x7fa4f006c3a0 2023-12-19T19:02:37.178 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.171+0000 7fa5155f8640 1 -- 172.21.15.133:0/775022031 --> [v2:172.21.15.138:6808/2638336882,v1:172.21.15.138:6809/2638336882] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa5100c2530 con 0x7fa4f006c3a0 2023-12-19T19:02:37.179 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.175+0000 7fa507fff640 1 -- 172.21.15.133:0/775022031 <== osd.5 v2:172.21.15.138:6808/2638336882 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa5080a6040 con 0x7fa4f006c3a0 2023-12-19T19:02:37.179 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-19T19:02:37.180 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-19T19:02:37.180 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-19T19:02:37.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.175+0000 7fa5155f8640 1 -- 172.21.15.133:0/775022031 >> [v2:172.21.15.138:6808/2638336882,v1:172.21.15.138:6809/2638336882] conn(0x7fa4f006c3a0 msgr2=0x7fa4f006e7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.175+0000 7fa5155f8640 1 --2- 172.21.15.133:0/775022031 >> [v2:172.21.15.138:6808/2638336882,v1:172.21.15.138:6809/2638336882] conn(0x7fa4f006c3a0 0x7fa4f006e7c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.175+0000 7fa5155f8640 1 -- 172.21.15.133:0/775022031 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa4f00664a0 msgr2=0x7fa4f0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.175+0000 7fa5155f8640 1 --2- 172.21.15.133:0/775022031 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fa4f00664a0 0x7fa4f0068960 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fa50000f360 tx=0x7fa500007710 comp rx=0 tx=0).stop 2023-12-19T19:02:37.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.175+0000 7fa5155f8640 1 -- 172.21.15.133:0/775022031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5100c0aa0 msgr2=0x7fa510151260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.175+0000 7fa5155f8640 1 --2- 172.21.15.133:0/775022031 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa5100c0aa0 0x7fa510151260 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7fa4f800c7c0 tx=0x7fa4f800cc80 comp rx=0 tx=0).stop 2023-12-19T19:02:37.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.175+0000 7fa50f7fe640 1 -- 172.21.15.133:0/775022031 reap_dead start 2023-12-19T19:02:37.181 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.175+0000 7fa5155f8640 1 -- 172.21.15.133:0/775022031 shutdown_connections 2023-12-19T19:02:37.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.175+0000 7fa5155f8640 1 -- 172.21.15.133:0/775022031 >> 172.21.15.133:0/775022031 conn(0x7fa5100c5d40 msgr2=0x7fa510070310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:37.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.175+0000 7fa5155f8640 1 -- 172.21.15.133:0/775022031 shutdown_connections 2023-12-19T19:02:37.182 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.175+0000 7fa5155f8640 1 -- 172.21.15.133:0/775022031 wait complete. 2023-12-19T19:02:37.198 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-19T19:02:37.335 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.331+0000 7f6c3b93e640 1 Processor -- start 2023-12-19T19:02:37.336 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.331+0000 7f6c3b93e640 1 -- start start 2023-12-19T19:02:37.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.331+0000 7f6c3b93e640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6c340c4100 0x7f6c340c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.331+0000 7f6c3b93e640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f6c340c06d0 0x7f6c340a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.331+0000 7f6c3b93e640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c340c31c0 con 0x7f6c340c63c0 2023-12-19T19:02:37.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.331+0000 7f6c3b93e640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c340c34a0 con 0x7f6c340c4100 2023-12-19T19:02:37.337 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.331+0000 7f6c3b93e640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c340c1030 con 0x7f6c340c06d0 2023-12-19T19:02:37.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.331+0000 7f6c396da640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f6c340c63c0 0x7f6c340c24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52120/0 (socket says 172.21.15.133:52120) 2023-12-19T19:02:37.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.331+0000 7f6c38ed9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6c340c4100 0x7f6c340c2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.338 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.331+0000 7f6c396da640 1 -- 172.21.15.133:0/2109953730 learned_addr learned my addr 172.21.15.133:0/2109953730 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:37.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.331+0000 7f6c39edb640 1 --2- 172.21.15.133:0/2109953730 >> v2:172.21.15.138:3300/0 conn(0x7f6c340c06d0 0x7f6c340a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.331+0000 7f6c2bfff640 1 -- 172.21.15.133:0/2109953730 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511135884 0 0) 0x7f6c340c31c0 con 0x7f6c340c63c0 2023-12-19T19:02:37.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.331+0000 7f6c2bfff640 1 -- 172.21.15.133:0/2109953730 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c20003530 con 0x7f6c340c63c0 2023-12-19T19:02:37.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.331+0000 7f6c38ed9640 1 -- 172.21.15.133:0/2109953730 >> v2:172.21.15.138:3300/0 conn(0x7f6c340c06d0 msgr2=0x7f6c340a9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:37.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.331+0000 7f6c38ed9640 1 --2- 172.21.15.133:0/2109953730 >> v2:172.21.15.138:3300/0 conn(0x7f6c340c06d0 0x7f6c340a9680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.331+0000 7f6c38ed9640 1 -- 172.21.15.133:0/2109953730 >> v1:172.21.15.133:6789/0 conn(0x7f6c340c63c0 legacy=0x7f6c340c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.339 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.331+0000 7f6c38ed9640 1 -- 172.21.15.133:0/2109953730 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c340c1310 con 0x7f6c340c4100 2023-12-19T19:02:37.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.335+0000 7f6c38ed9640 1 --2- 172.21.15.133:0/2109953730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c340c4100 0x7f6c340c2bb0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f6c340c0ee0 tx=0x7f6c2401c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53a28c615ad3d512 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:37.340 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.335+0000 7f6c2bfff640 1 -- 172.21.15.133:0/2109953730 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c340aa3d0 con 0x7f6c340c4100 2023-12-19T19:02:37.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.335+0000 7f6c2bfff640 1 -- 172.21.15.133:0/2109953730 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c240a7050 con 0x7f6c340c4100 2023-12-19T19:02:37.341 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.335+0000 7f6c2bfff640 1 -- 172.21.15.133:0/2109953730 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c240ab820 con 0x7f6c340c4100 2023-12-19T19:02:37.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.335+0000 7f6c3b93e640 1 -- 172.21.15.133:0/2109953730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c340c4100 msgr2=0x7f6c340c2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.342 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.335+0000 7f6c3b93e640 1 --2- 172.21.15.133:0/2109953730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c340c4100 0x7f6c340c2bb0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f6c340c0ee0 tx=0x7f6c2401c340 comp rx=0 tx=0).stop 2023-12-19T19:02:37.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.335+0000 7f6c3b93e640 1 -- 172.21.15.133:0/2109953730 shutdown_connections 2023-12-19T19:02:37.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.335+0000 7f6c3b93e640 1 --2- 172.21.15.133:0/2109953730 >> v2:172.21.15.138:3300/0 conn(0x7f6c340c06d0 0x7f6c340a9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.335+0000 7f6c3b93e640 1 --2- 172.21.15.133:0/2109953730 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c340c4100 0x7f6c340c2bb0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.335+0000 7f6c3b93e640 1 -- 172.21.15.133:0/2109953730 >> 172.21.15.133:0/2109953730 conn(0x7f6c3406a5b0 msgr2=0x7f6c3406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:37.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.335+0000 7f6c3b93e640 1 -- 172.21.15.133:0/2109953730 shutdown_connections 2023-12-19T19:02:37.343 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.335+0000 7f6c3b93e640 1 -- 172.21.15.133:0/2109953730 wait complete. 2023-12-19T19:02:37.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.339+0000 7f6c3b93e640 1 Processor -- start 2023-12-19T19:02:37.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.339+0000 7f6c3b93e640 1 -- start start 2023-12-19T19:02:37.345 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.339+0000 7f6c3b93e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c340c06d0 0x7f6c341f0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.339+0000 7f6c3b93e640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c340c4100 0x7f6c341ed3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.339+0000 7f6c3b93e640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6c340c63c0 0x7f6c3414e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.339+0000 7f6c3b93e640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c34154a90 con 0x7f6c340c06d0 2023-12-19T19:02:37.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.339+0000 7f6c3b93e640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c341552a0 con 0x7f6c340c4100 2023-12-19T19:02:37.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.339+0000 7f6c3b93e640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c341f0580 con 0x7f6c340c63c0 2023-12-19T19:02:37.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.339+0000 7f6c396da640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c340c06d0 0x7f6c341f0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.339+0000 7f6c396da640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c340c06d0 0x7f6c341f0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32900/0 (socket says 172.21.15.133:32900) 2023-12-19T19:02:37.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.339+0000 7f6c396da640 1 -- 172.21.15.133:0/895949350 learned_addr learned my addr 172.21.15.133:0/895949350 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:37.346 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.339+0000 7f6c396da640 1 -- 172.21.15.133:0/895949350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6c340c63c0 msgr2=0x7f6c3414e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.339+0000 7f6c396da640 1 --2- 172.21.15.133:0/895949350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6c340c63c0 0x7f6c3414e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.339+0000 7f6c396da640 1 -- 172.21.15.133:0/895949350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c340c4100 msgr2=0x7f6c341ed3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.339+0000 7f6c396da640 1 --2- 172.21.15.133:0/895949350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c340c4100 0x7f6c341ed3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.339+0000 7f6c396da640 1 -- 172.21.15.133:0/895949350 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c24009420 con 0x7f6c340c06d0 2023-12-19T19:02:37.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.339+0000 7f6c396da640 1 --2- 172.21.15.133:0/895949350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c340c06d0 0x7f6c341f0040 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000c480 tx=0x7f6c3000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:37.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.339+0000 7f6c29ffb640 1 -- 172.21.15.133:0/895949350 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c30005cf0 con 0x7f6c340c06d0 2023-12-19T19:02:37.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.339+0000 7f6c29ffb640 1 -- 172.21.15.133:0/895949350 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c30005e50 con 0x7f6c340c06d0 2023-12-19T19:02:37.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.339+0000 7f6c29ffb640 1 -- 172.21.15.133:0/895949350 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c30007270 con 0x7f6c340c06d0 2023-12-19T19:02:37.347 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.339+0000 7f6c3b93e640 1 -- 172.21.15.133:0/895949350 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c34154ce0 con 0x7f6c340c06d0 2023-12-19T19:02:37.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.339+0000 7f6c3b93e640 1 -- 172.21.15.133:0/895949350 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c341ecbf0 con 0x7f6c340c06d0 2023-12-19T19:02:37.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.339+0000 7f6c3b93e640 1 -- 172.21.15.133:0/895949350 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c341eca50 con 0x7f6c340c06d0 2023-12-19T19:02:37.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.343+0000 7f6c29ffb640 1 -- 172.21.15.133:0/895949350 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f6c300073d0 con 0x7f6c340c06d0 2023-12-19T19:02:37.348 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.343+0000 7f6c29ffb640 1 --2- 172.21.15.133:0/895949350 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6c18066470 0x7f6c18068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.343+0000 7f6c29ffb640 1 -- 172.21.15.133:0/895949350 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f6c30082cd0 con 0x7f6c340c06d0 2023-12-19T19:02:37.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.343+0000 7f6c38ed9640 1 --2- 172.21.15.133:0/895949350 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6c18066470 0x7f6c18068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.349 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.343+0000 7f6c38ed9640 1 --2- 172.21.15.133:0/895949350 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6c18066470 0x7f6c18068930 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6c240ad000 tx=0x7f6c24004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:37.352 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.347+0000 7f6c29ffb640 1 -- 172.21.15.133:0/895949350 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f6c341eca50 con 0x7f6c340c06d0 2023-12-19T19:02:37.501 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.495+0000 7f6c3b93e640 1 -- 172.21.15.133:0/895949350 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c341eca50 con 0x7f6c18066470 2023-12-19T19:02:37.502 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.495+0000 7f6c29ffb640 1 -- 172.21.15.133:0/895949350 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6c341eca50 con 0x7f6c18066470 2023-12-19T19:02:37.502 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 5 to deep-scrub 2023-12-19T19:02:37.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.499+0000 7f6c3b93e640 1 -- 172.21.15.133:0/895949350 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6c18066470 msgr2=0x7f6c18068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.499+0000 7f6c3b93e640 1 --2- 172.21.15.133:0/895949350 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6c18066470 0x7f6c18068930 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6c240ad000 tx=0x7f6c24004740 comp rx=0 tx=0).stop 2023-12-19T19:02:37.504 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.499+0000 7f6c3b93e640 1 -- 172.21.15.133:0/895949350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c340c06d0 msgr2=0x7f6c341f0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.499+0000 7f6c3b93e640 1 --2- 172.21.15.133:0/895949350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c340c06d0 0x7f6c341f0040 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000c480 tx=0x7f6c3000c940 comp rx=0 tx=0).stop 2023-12-19T19:02:37.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.499+0000 7f6c3b93e640 1 -- 172.21.15.133:0/895949350 shutdown_connections 2023-12-19T19:02:37.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.499+0000 7f6c3b93e640 1 --2- 172.21.15.133:0/895949350 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f6c18066470 0x7f6c18068930 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.499+0000 7f6c3b93e640 1 --2- 172.21.15.133:0/895949350 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f6c340c63c0 0x7f6c3414e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.499+0000 7f6c3b93e640 1 --2- 172.21.15.133:0/895949350 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f6c340c4100 0x7f6c341ed3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.505 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.499+0000 7f6c3b93e640 1 --2- 172.21.15.133:0/895949350 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6c340c06d0 0x7f6c341f0040 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.499+0000 7f6c3b93e640 1 -- 172.21.15.133:0/895949350 >> 172.21.15.133:0/895949350 conn(0x7f6c3406a5b0 msgr2=0x7f6c3406a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:37.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.499+0000 7f6c3b93e640 1 -- 172.21.15.133:0/895949350 shutdown_connections 2023-12-19T19:02:37.506 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.499+0000 7f6c3b93e640 1 -- 172.21.15.133:0/895949350 wait complete. 2023-12-19T19:02:37.523 INFO:tasks.ceph:Scrubbing osd.6 2023-12-19T19:02:37.523 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-19T19:02:37.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.659+0000 7f57daec9640 1 Processor -- start 2023-12-19T19:02:37.664 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.659+0000 7f57daec9640 1 -- start start 2023-12-19T19:02:37.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.659+0000 7f57daec9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57d406fec0 0x7f57d4158bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.659+0000 7f57daec9640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d4072800 con 0x7f57d40c0aa0 2023-12-19T19:02:37.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.659+0000 7f57daec9640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d4072ae0 con 0x7f57d40c1250 2023-12-19T19:02:37.665 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.659+0000 7f57daec9640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d40a9fc0 con 0x7f57d406fec0 2023-12-19T19:02:37.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.659+0000 7f57d3fff640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f57d406fec0 0x7f57d4158bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.659+0000 7f57d9466640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f57d40c0aa0 0x7f57d415b100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52126/0 (socket says 172.21.15.133:52126) 2023-12-19T19:02:37.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.659+0000 7f57d9466640 1 -- 172.21.15.133:0/1630456129 learned_addr learned my addr 172.21.15.133:0/1630456129 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:37.666 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.659+0000 7f57d37fe640 1 -- 172.21.15.133:0/1630456129 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120235154 0 0) 0x7f57d4072800 con 0x7f57d40c0aa0 2023-12-19T19:02:37.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.659+0000 7f57d3fff640 1 -- 172.21.15.133:0/1630456129 >> v1:172.21.15.138:6789/0 conn(0x7f57d40c1250 legacy=0x7f57d40c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.659+0000 7f57d3fff640 1 -- 172.21.15.133:0/1630456129 >> v1:172.21.15.133:6789/0 conn(0x7f57d40c0aa0 legacy=0x7f57d415b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.667 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.659+0000 7f57d3fff640 1 -- 172.21.15.133:0/1630456129 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d40a9900 con 0x7f57d406fec0 2023-12-19T19:02:37.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.663+0000 7f57d3fff640 1 --2- 172.21.15.133:0/1630456129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57d406fec0 0x7f57d4158bb0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f57c40097c0 tx=0x7f57c401c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c269c792570375 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:37.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.663+0000 7f57d37fe640 1 -- 172.21.15.133:0/1630456129 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c4004230 con 0x7f57d406fec0 2023-12-19T19:02:37.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.663+0000 7f57d37fe640 1 -- 172.21.15.133:0/1630456129 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c40a7050 con 0x7f57d406fec0 2023-12-19T19:02:37.670 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.663+0000 7f57d37fe640 1 -- 172.21.15.133:0/1630456129 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c4003620 con 0x7f57d406fec0 2023-12-19T19:02:37.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.663+0000 7f57daec9640 1 -- 172.21.15.133:0/1630456129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57d406fec0 msgr2=0x7f57d4158bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.663+0000 7f57daec9640 1 --2- 172.21.15.133:0/1630456129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57d406fec0 0x7f57d4158bb0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f57c40097c0 tx=0x7f57c401c330 comp rx=0 tx=0).stop 2023-12-19T19:02:37.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.663+0000 7f57daec9640 1 -- 172.21.15.133:0/1630456129 shutdown_connections 2023-12-19T19:02:37.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.663+0000 7f57daec9640 1 --2- 172.21.15.133:0/1630456129 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57d406fec0 0x7f57d4158bb0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.663+0000 7f57daec9640 1 -- 172.21.15.133:0/1630456129 >> 172.21.15.133:0/1630456129 conn(0x7f57d40c5d40 msgr2=0x7f57d40c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:37.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.663+0000 7f57daec9640 1 -- 172.21.15.133:0/1630456129 shutdown_connections 2023-12-19T19:02:37.671 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.663+0000 7f57daec9640 1 -- 172.21.15.133:0/1630456129 wait complete. 2023-12-19T19:02:37.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57daec9640 1 Processor -- start 2023-12-19T19:02:37.672 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57daec9640 1 -- start start 2023-12-19T19:02:37.674 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57daec9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57d406fec0 0x7f57d41f0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57daec9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57d40c0aa0 0x7f57d41587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57daec9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57d40c1250 0x7f57d41edad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57daec9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d4157400 con 0x7f57d40c1250 2023-12-19T19:02:37.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57daec9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d41ed6b0 con 0x7f57d40c0aa0 2023-12-19T19:02:37.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57daec9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d41580e0 con 0x7f57d406fec0 2023-12-19T19:02:37.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57d9466640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57d40c1250 0x7f57d41edad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.675 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57d9466640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57d40c1250 0x7f57d41edad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32916/0 (socket says 172.21.15.133:32916) 2023-12-19T19:02:37.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57d9466640 1 -- 172.21.15.133:0/2934006231 learned_addr learned my addr 172.21.15.133:0/2934006231 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:37.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57d3fff640 1 --2- 172.21.15.133:0/2934006231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57d40c0aa0 0x7f57d41587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57d8c65640 1 --2- 172.21.15.133:0/2934006231 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57d406fec0 0x7f57d41f0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57d9466640 1 -- 172.21.15.133:0/2934006231 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57d406fec0 msgr2=0x7f57d41f0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57d9466640 1 --2- 172.21.15.133:0/2934006231 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f57d406fec0 0x7f57d41f0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57d9466640 1 -- 172.21.15.133:0/2934006231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57d40c0aa0 msgr2=0x7f57d41587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57d9466640 1 --2- 172.21.15.133:0/2934006231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57d40c0aa0 0x7f57d41587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57d9466640 1 -- 172.21.15.133:0/2934006231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c4009420 con 0x7f57d40c1250 2023-12-19T19:02:37.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57d3fff640 1 --2- 172.21.15.133:0/2934006231 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f57d40c0aa0 0x7f57d41587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:37.676 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57d9466640 1 --2- 172.21.15.133:0/2934006231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57d40c1250 0x7f57d41edad0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f57cc00c7d0 tx=0x7f57cc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:37.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57d17fa640 1 -- 172.21.15.133:0/2934006231 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc00a640 con 0x7f57d40c1250 2023-12-19T19:02:37.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57d17fa640 1 -- 172.21.15.133:0/2934006231 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57cc00a7a0 con 0x7f57d40c1250 2023-12-19T19:02:37.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57d17fa640 1 -- 172.21.15.133:0/2934006231 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc00ab90 con 0x7f57d40c1250 2023-12-19T19:02:37.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57daec9640 1 -- 172.21.15.133:0/2934006231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d406db70 con 0x7f57d40c1250 2023-12-19T19:02:37.677 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.667+0000 7f57daec9640 1 -- 172.21.15.133:0/2934006231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d406e130 con 0x7f57d40c1250 2023-12-19T19:02:37.678 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.671+0000 7f57daec9640 1 -- 172.21.15.133:0/2934006231 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f57d40c2f10 con 0x7f57d40c1250 2023-12-19T19:02:37.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.671+0000 7f57d17fa640 1 -- 172.21.15.133:0/2934006231 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f57cc00acf0 con 0x7f57d40c1250 2023-12-19T19:02:37.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.671+0000 7f57d17fa640 1 --2- 172.21.15.133:0/2934006231 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f57c0066470 0x7f57c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.671+0000 7f57d17fa640 1 -- 172.21.15.133:0/2934006231 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f57cc083870 con 0x7f57d40c1250 2023-12-19T19:02:37.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.671+0000 7f57d17fa640 1 --2- 172.21.15.133:0/2934006231 >> [v2:172.21.15.138:6816/2860949089,v1:172.21.15.138:6817/2860949089] conn(0x7f57c006c370 0x7f57c006e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.671+0000 7f57d17fa640 1 -- 172.21.15.133:0/2934006231 --> [v2:172.21.15.138:6816/2860949089,v1:172.21.15.138:6817/2860949089] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57c006ee40 con 0x7f57c006c370 2023-12-19T19:02:37.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.671+0000 7f57d17fa640 1 -- 172.21.15.133:0/2934006231 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57cc083be0 con 0x7f57d40c1250 2023-12-19T19:02:37.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.671+0000 7f57d8c65640 1 --2- 172.21.15.133:0/2934006231 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f57c0066470 0x7f57c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.671+0000 7f57d3fff640 1 --2- 172.21.15.133:0/2934006231 >> [v2:172.21.15.138:6816/2860949089,v1:172.21.15.138:6817/2860949089] conn(0x7f57c006c370 0x7f57c006e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.671+0000 7f57d8c65640 1 --2- 172.21.15.133:0/2934006231 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f57c0066470 0x7f57c0068930 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f57d415aa40 tx=0x7f57c8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:37.679 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.671+0000 7f57d3fff640 1 --2- 172.21.15.133:0/2934006231 >> [v2:172.21.15.138:6816/2860949089,v1:172.21.15.138:6817/2860949089] conn(0x7f57c006c370 0x7f57c006e790 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:37.680 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.675+0000 7f57d17fa640 1 -- 172.21.15.133:0/2934006231 <== osd.6 v2:172.21.15.138:6816/2860949089 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f57c006ee40 con 0x7f57c006c370 2023-12-19T19:02:37.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.687+0000 7f57daec9640 1 -- 172.21.15.133:0/2934006231 --> [v2:172.21.15.138:6816/2860949089,v1:172.21.15.138:6817/2860949089] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f57d4068400 con 0x7f57c006c370 2023-12-19T19:02:37.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.687+0000 7f57d17fa640 1 -- 172.21.15.133:0/2934006231 <== osd.6 v2:172.21.15.138:6816/2860949089 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f57d4068400 con 0x7f57c006c370 2023-12-19T19:02:37.695 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-19T19:02:37.695 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-19T19:02:37.695 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-19T19:02:37.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.687+0000 7f57daec9640 1 -- 172.21.15.133:0/2934006231 >> [v2:172.21.15.138:6816/2860949089,v1:172.21.15.138:6817/2860949089] conn(0x7f57c006c370 msgr2=0x7f57c006e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.687+0000 7f57daec9640 1 --2- 172.21.15.133:0/2934006231 >> [v2:172.21.15.138:6816/2860949089,v1:172.21.15.138:6817/2860949089] conn(0x7f57c006c370 0x7f57c006e790 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.691+0000 7f57daec9640 1 -- 172.21.15.133:0/2934006231 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f57c0066470 msgr2=0x7f57c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.691+0000 7f57daec9640 1 --2- 172.21.15.133:0/2934006231 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f57c0066470 0x7f57c0068930 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f57d415aa40 tx=0x7f57c8009040 comp rx=0 tx=0).stop 2023-12-19T19:02:37.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.691+0000 7f57daec9640 1 -- 172.21.15.133:0/2934006231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57d40c1250 msgr2=0x7f57d41edad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.691+0000 7f57daec9640 1 --2- 172.21.15.133:0/2934006231 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f57d40c1250 0x7f57d41edad0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f57cc00c7d0 tx=0x7f57cc00cc90 comp rx=0 tx=0).stop 2023-12-19T19:02:37.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.691+0000 7f57d9466640 1 -- 172.21.15.133:0/2934006231 reap_dead start 2023-12-19T19:02:37.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.691+0000 7f57daec9640 1 -- 172.21.15.133:0/2934006231 shutdown_connections 2023-12-19T19:02:37.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.691+0000 7f57daec9640 1 -- 172.21.15.133:0/2934006231 >> 172.21.15.133:0/2934006231 conn(0x7f57d40c5d40 msgr2=0x7f57d40c6120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:37.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.691+0000 7f57daec9640 1 -- 172.21.15.133:0/2934006231 shutdown_connections 2023-12-19T19:02:37.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.691+0000 7f57daec9640 1 -- 172.21.15.133:0/2934006231 wait complete. 2023-12-19T19:02:37.713 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-19T19:02:37.850 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.843+0000 7fcfdfb0f640 1 Processor -- start 2023-12-19T19:02:37.851 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.843+0000 7fcfdfb0f640 1 -- start start 2023-12-19T19:02:37.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdfb0f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfd80a5370 0x7fcfd80c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdfb0f640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd80c2760 con 0x7fcfd80c4110 2023-12-19T19:02:37.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdfb0f640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd80a5750 con 0x7fcfd8072090 2023-12-19T19:02:37.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdfb0f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd80c3070 con 0x7fcfd80a5370 2023-12-19T19:02:37.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdd0aa640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fcfd80c4110 0x7fcfd8150fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52138/0 (socket says 172.21.15.133:52138) 2023-12-19T19:02:37.852 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdd0aa640 1 -- 172.21.15.133:0/726614918 learned_addr learned my addr 172.21.15.133:0/726614918 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:37.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdd8ab640 1 --2- 172.21.15.133:0/726614918 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfd80a5370 0x7fcfd80c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdc8a9640 1 -- 172.21.15.133:0/726614918 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202647213 0 0) 0x7fcfd80c2760 con 0x7fcfd80c4110 2023-12-19T19:02:37.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdc8a9640 1 -- 172.21.15.133:0/726614918 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfc4003530 con 0x7fcfd80c4110 2023-12-19T19:02:37.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdc8a9640 1 -- 172.21.15.133:0/726614918 <== mon.0 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 829053351 0 0) 0x7fcfc4003530 con 0x7fcfd80c4110 2023-12-19T19:02:37.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdc8a9640 1 -- 172.21.15.133:0/726614918 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfd80a5370 msgr2=0x7fcfd80c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:37.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdc8a9640 1 --2- 172.21.15.133:0/726614918 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfd80a5370 0x7fcfd80c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.855 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdc8a9640 1 -- 172.21.15.133:0/726614918 >> v1:172.21.15.138:6789/0 conn(0x7fcfd8072090 legacy=0x7fcfd815b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdc8a9640 1 -- 172.21.15.133:0/726614918 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd80aad20 con 0x7fcfd80c4110 2023-12-19T19:02:37.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdc8a9640 1 -- 172.21.15.133:0/726614918 <== mon.0 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 39183604 0 0) 0x7fcfc8001680 con 0x7fcfd80c4110 2023-12-19T19:02:37.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdc8a9640 1 -- 172.21.15.133:0/726614918 >> v1:172.21.15.133:6789/0 conn(0x7fcfd80c4110 legacy=0x7fcfd8150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdc8a9640 1 --2- 172.21.15.133:0/726614918 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfd80a5370 0x7fcfc40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdc8a9640 1 --2- 172.21.15.133:0/726614918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfc4003ef0 0x7fcfc40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdc8a9640 1 --2- 172.21.15.133:0/726614918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfc4004d10 0x7fcfc4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdc8a9640 1 -- 172.21.15.133:0/726614918 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd80c3070 con 0x7fcfc4004d10 2023-12-19T19:02:37.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdc8a9640 1 -- 172.21.15.133:0/726614918 --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc400bb50 con 0x7fcfc4003ef0 2023-12-19T19:02:37.856 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdc8a9640 1 -- 172.21.15.133:0/726614918 --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc400bd10 con 0x7fcfd80a5370 2023-12-19T19:02:37.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfde0ac640 1 --2- 172.21.15.133:0/726614918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfc4004d10 0x7fcfc4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdd8ab640 1 --2- 172.21.15.133:0/726614918 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfd80a5370 0x7fcfc40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfdd0aa640 1 --2- 172.21.15.133:0/726614918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfc4003ef0 0x7fcfc40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfde0ac640 1 -- 172.21.15.133:0/726614918 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfd80a5370 msgr2=0x7fcfc40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:37.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfde0ac640 1 --2- 172.21.15.133:0/726614918 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfd80a5370 0x7fcfc40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfde0ac640 1 -- 172.21.15.133:0/726614918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfc4003ef0 msgr2=0x7fcfc40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:37.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfde0ac640 1 --2- 172.21.15.133:0/726614918 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfc4003ef0 0x7fcfc40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.857 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.847+0000 7fcfde0ac640 1 -- 172.21.15.133:0/726614918 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc4003530 con 0x7fcfc4004d10 2023-12-19T19:02:37.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.851+0000 7fcfde0ac640 1 --2- 172.21.15.133:0/726614918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfc4004d10 0x7fcfc4005190 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0001f60 tx=0x7fcfd00211e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785412efce000d0c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:37.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.851+0000 7fcfdc8a9640 1 -- 172.21.15.133:0/726614918 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd00aae00 con 0x7fcfc4004d10 2023-12-19T19:02:37.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.851+0000 7fcfdc8a9640 1 -- 172.21.15.133:0/726614918 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd00b2440 con 0x7fcfc4004d10 2023-12-19T19:02:37.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.851+0000 7fcfdc8a9640 1 -- 172.21.15.133:0/726614918 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd00b2830 con 0x7fcfc4004d10 2023-12-19T19:02:37.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.851+0000 7fcfdfb0f640 1 -- 172.21.15.133:0/726614918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfc4004d10 msgr2=0x7fcfc4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.851+0000 7fcfdfb0f640 1 --2- 172.21.15.133:0/726614918 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfc4004d10 0x7fcfc4005190 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fcfd0001f60 tx=0x7fcfd00211e0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.859 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.851+0000 7fcfde0ac640 1 -- 172.21.15.133:0/726614918 reap_dead start 2023-12-19T19:02:37.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.851+0000 7fcfdfb0f640 1 -- 172.21.15.133:0/726614918 shutdown_connections 2023-12-19T19:02:37.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.851+0000 7fcfdfb0f640 1 -- 172.21.15.133:0/726614918 >> 172.21.15.133:0/726614918 conn(0x7fcfd806a5b0 msgr2=0x7fcfd806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:37.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.851+0000 7fcfdfb0f640 1 -- 172.21.15.133:0/726614918 shutdown_connections 2023-12-19T19:02:37.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.851+0000 7fcfdfb0f640 1 -- 172.21.15.133:0/726614918 wait complete. 2023-12-19T19:02:37.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfdfb0f640 1 Processor -- start 2023-12-19T19:02:37.862 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfdfb0f640 1 -- start start 2023-12-19T19:02:37.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfdfb0f640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfc4004d10 0x7fcfd80bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfdfb0f640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfd81ecfa0 0x7fcfd81ed420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfdfb0f640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfd81ed960 0x7fcfd814c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfdfb0f640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd80c4a80 con 0x7fcfd81ed960 2023-12-19T19:02:37.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfdfb0f640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd80c5890 con 0x7fcfc4004d10 2023-12-19T19:02:37.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfdfb0f640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd80c63f0 con 0x7fcfd81ecfa0 2023-12-19T19:02:37.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfde0ac640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfd81ed960 0x7fcfd814c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfde0ac640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfd81ed960 0x7fcfd814c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32942/0 (socket says 172.21.15.133:32942) 2023-12-19T19:02:37.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfde0ac640 1 -- 172.21.15.133:0/2853418321 learned_addr learned my addr 172.21.15.133:0/2853418321 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:37.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfdd8ab640 1 --2- 172.21.15.133:0/2853418321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfc4004d10 0x7fcfd80bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfdd0aa640 1 --2- 172.21.15.133:0/2853418321 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfd81ecfa0 0x7fcfd81ed420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfde0ac640 1 -- 172.21.15.133:0/2853418321 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfd81ecfa0 msgr2=0x7fcfd81ed420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfde0ac640 1 --2- 172.21.15.133:0/2853418321 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfd81ecfa0 0x7fcfd81ed420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfde0ac640 1 -- 172.21.15.133:0/2853418321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfc4004d10 msgr2=0x7fcfd80bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:37.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfde0ac640 1 --2- 172.21.15.133:0/2853418321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfc4004d10 0x7fcfd80bf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:37.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfde0ac640 1 -- 172.21.15.133:0/2853418321 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd80a9ba0 con 0x7fcfd81ed960 2023-12-19T19:02:37.864 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfdd0aa640 1 --2- 172.21.15.133:0/2853418321 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfd81ecfa0 0x7fcfd81ed420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:37.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfde0ac640 1 --2- 172.21.15.133:0/2853418321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfd81ed960 0x7fcfd814c0e0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00b5040 tx=0x7fcfc4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:37.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfce7fc640 1 -- 172.21.15.133:0/2853418321 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0006b60 con 0x7fcfd81ed960 2023-12-19T19:02:37.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfce7fc640 1 -- 172.21.15.133:0/2853418321 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd0006cc0 con 0x7fcfd81ed960 2023-12-19T19:02:37.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfdfb0f640 1 -- 172.21.15.133:0/2853418321 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd80c5ac0 con 0x7fcfd81ed960 2023-12-19T19:02:37.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfce7fc640 1 -- 172.21.15.133:0/2853418321 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd0003b80 con 0x7fcfd81ed960 2023-12-19T19:02:37.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfdfb0f640 1 -- 172.21.15.133:0/2853418321 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd80c6080 con 0x7fcfd81ed960 2023-12-19T19:02:37.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.855+0000 7fcfdfb0f640 1 -- 172.21.15.133:0/2853418321 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd80c6560 con 0x7fcfd81ed960 2023-12-19T19:02:37.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.859+0000 7fcfce7fc640 1 -- 172.21.15.133:0/2853418321 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fcfd00b9070 con 0x7fcfd81ed960 2023-12-19T19:02:37.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.859+0000 7fcfce7fc640 1 --2- 172.21.15.133:0/2853418321 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcfbc066470 0x7fcfbc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:37.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.859+0000 7fcfce7fc640 1 -- 172.21.15.133:0/2853418321 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fcfd01207e0 con 0x7fcfd81ed960 2023-12-19T19:02:37.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.859+0000 7fcfdd8ab640 1 --2- 172.21.15.133:0/2853418321 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcfbc066470 0x7fcfbc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:37.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.859+0000 7fcfdd8ab640 1 --2- 172.21.15.133:0/2853418321 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcfbc066470 0x7fcfbc068930 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400ace0 tx=0x7fcfd400a2a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:37.869 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:37.863+0000 7fcfce7fc640 1 -- 172.21.15.133:0/2853418321 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fcfd00eddd0 con 0x7fcfd81ed960 2023-12-19T19:02:38.019 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.015+0000 7fcfdfb0f640 1 -- 172.21.15.133:0/2853418321 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fcfd80c2c90 con 0x7fcfbc066470 2023-12-19T19:02:38.020 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.015+0000 7fcfce7fc640 1 -- 172.21.15.133:0/2853418321 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcfd400add0 con 0x7fcfbc066470 2023-12-19T19:02:38.020 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 6 to deep-scrub 2023-12-19T19:02:38.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.015+0000 7fcfdfb0f640 1 -- 172.21.15.133:0/2853418321 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcfbc066470 msgr2=0x7fcfbc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:38.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.015+0000 7fcfdfb0f640 1 --2- 172.21.15.133:0/2853418321 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcfbc066470 0x7fcfbc068930 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fcfd400ace0 tx=0x7fcfd400a2a0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.015+0000 7fcfdfb0f640 1 -- 172.21.15.133:0/2853418321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfd81ed960 msgr2=0x7fcfd814c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:38.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.015+0000 7fcfdfb0f640 1 --2- 172.21.15.133:0/2853418321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfd81ed960 0x7fcfd814c0e0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fcfd00b5040 tx=0x7fcfc4005800 comp rx=0 tx=0).stop 2023-12-19T19:02:38.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.015+0000 7fcfdfb0f640 1 -- 172.21.15.133:0/2853418321 shutdown_connections 2023-12-19T19:02:38.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.015+0000 7fcfdfb0f640 1 --2- 172.21.15.133:0/2853418321 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fcfbc066470 0x7fcfbc068930 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.022 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.015+0000 7fcfdfb0f640 1 --2- 172.21.15.133:0/2853418321 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfd81ed960 0x7fcfd814c0e0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.015+0000 7fcfdfb0f640 1 --2- 172.21.15.133:0/2853418321 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fcfd81ecfa0 0x7fcfd81ed420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.015+0000 7fcfdfb0f640 1 --2- 172.21.15.133:0/2853418321 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fcfc4004d10 0x7fcfd80bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.015+0000 7fcfdfb0f640 1 -- 172.21.15.133:0/2853418321 >> 172.21.15.133:0/2853418321 conn(0x7fcfd806a5b0 msgr2=0x7fcfd80c38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:38.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.015+0000 7fcfdfb0f640 1 -- 172.21.15.133:0/2853418321 shutdown_connections 2023-12-19T19:02:38.023 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.015+0000 7fcfdfb0f640 1 -- 172.21.15.133:0/2853418321 wait complete. 2023-12-19T19:02:38.041 INFO:tasks.ceph:Scrubbing osd.7 2023-12-19T19:02:38.041 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-19T19:02:38.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.175+0000 7f7459017640 1 Processor -- start 2023-12-19T19:02:38.183 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.175+0000 7f7459017640 1 -- start start 2023-12-19T19:02:38.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.179+0000 7f7459017640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f74540c07b0 0x7f745406d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:38.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.179+0000 7f7459017640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74540c5ba0 con 0x7f74540724c0 2023-12-19T19:02:38.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.179+0000 7f7459017640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f745406c160 con 0x7f745414f9f0 2023-12-19T19:02:38.184 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.179+0000 7f7459017640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f745406e320 con 0x7f74540c07b0 2023-12-19T19:02:38.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.179+0000 7f745359e640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f74540724c0 0x7f745406dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52152/0 (socket says 172.21.15.133:52152) 2023-12-19T19:02:38.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.179+0000 7f745359e640 1 -- 172.21.15.133:0/2498508541 learned_addr learned my addr 172.21.15.133:0/2498508541 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:38.185 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.179+0000 7f744a59c640 1 --2- 172.21.15.133:0/2498508541 >> v2:172.21.15.138:3300/0 conn(0x7f74540c07b0 0x7f745406d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:38.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.179+0000 7f745259c640 1 -- 172.21.15.133:0/2498508541 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188671345 0 0) 0x7f744c0014a0 con 0x7f74540724c0 2023-12-19T19:02:38.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.179+0000 7f745259c640 1 -- 172.21.15.133:0/2498508541 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7440003530 con 0x7f74540724c0 2023-12-19T19:02:38.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.179+0000 7f745259c640 1 -- 172.21.15.133:0/2498508541 <== mon.1 v1:172.21.15.138:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475231380 0 0) 0x7f745406c160 con 0x7f745414f9f0 2023-12-19T19:02:38.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.179+0000 7f745259c640 1 -- 172.21.15.133:0/2498508541 --> v1:172.21.15.138:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f744c0014a0 con 0x7f745414f9f0 2023-12-19T19:02:38.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.179+0000 7f744a59c640 1 -- 172.21.15.133:0/2498508541 >> v1:172.21.15.138:6789/0 conn(0x7f745414f9f0 legacy=0x7f74540c27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:38.186 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.179+0000 7f744a59c640 1 -- 172.21.15.133:0/2498508541 >> v1:172.21.15.133:6789/0 conn(0x7f74540724c0 legacy=0x7f745406dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:38.187 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.179+0000 7f744a59c640 1 -- 172.21.15.133:0/2498508541 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74540c5410 con 0x7f74540c07b0 2023-12-19T19:02:38.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.183+0000 7f744a59c640 1 --2- 172.21.15.133:0/2498508541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f74540c07b0 0x7f745406d6d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f743c0097f0 tx=0x7f743c01c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d44ecb29b0c0a268 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:38.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.183+0000 7f745259c640 1 -- 172.21.15.133:0/2498508541 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c0ab600 con 0x7f74540c07b0 2023-12-19T19:02:38.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.183+0000 7f745259c640 1 -- 172.21.15.133:0/2498508541 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f743c0a7050 con 0x7f74540c07b0 2023-12-19T19:02:38.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.183+0000 7f745259c640 1 -- 172.21.15.133:0/2498508541 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743c0ab980 con 0x7f74540c07b0 2023-12-19T19:02:38.188 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.183+0000 7f7459017640 1 -- 172.21.15.133:0/2498508541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f74540c07b0 msgr2=0x7f745406d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:38.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.183+0000 7f7459017640 1 --2- 172.21.15.133:0/2498508541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f74540c07b0 0x7f745406d6d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f743c0097f0 tx=0x7f743c01c330 comp rx=0 tx=0).stop 2023-12-19T19:02:38.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.183+0000 7f7459017640 1 -- 172.21.15.133:0/2498508541 shutdown_connections 2023-12-19T19:02:38.189 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.183+0000 7f7459017640 1 --2- 172.21.15.133:0/2498508541 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f74540c07b0 0x7f745406d6d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.183+0000 7f7459017640 1 -- 172.21.15.133:0/2498508541 >> 172.21.15.133:0/2498508541 conn(0x7f74540c5d40 msgr2=0x7f74540c6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:38.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.183+0000 7f7459017640 1 -- 172.21.15.133:0/2498508541 shutdown_connections 2023-12-19T19:02:38.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.183+0000 7f7459017640 1 -- 172.21.15.133:0/2498508541 wait complete. 2023-12-19T19:02:38.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.183+0000 7f7459017640 1 Processor -- start 2023-12-19T19:02:38.190 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.183+0000 7f7459017640 1 -- start start 2023-12-19T19:02:38.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f7459017640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74540724c0 0x7f745414d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:38.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f7459017640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f74540c07b0 0x7f7454145e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:38.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f7459017640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f745414f9f0 0x7f74541463a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:38.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f7459017640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74541442f0 con 0x7f745414f9f0 2023-12-19T19:02:38.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f7459017640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7454142780 con 0x7f74540c07b0 2023-12-19T19:02:38.193 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f7459017640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7454142a60 con 0x7f74540724c0 2023-12-19T19:02:38.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f745359e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f745414f9f0 0x7f74541463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:38.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f745359e640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f745414f9f0 0x7f74541463a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32948/0 (socket says 172.21.15.133:32948) 2023-12-19T19:02:38.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f745359e640 1 -- 172.21.15.133:0/1182990493 learned_addr learned my addr 172.21.15.133:0/1182990493 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:38.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f744a59c640 1 --2- 172.21.15.133:0/1182990493 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f74540c07b0 0x7f7454145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:38.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f7452d9d640 1 --2- 172.21.15.133:0/1182990493 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74540724c0 0x7f745414d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:38.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f745359e640 1 -- 172.21.15.133:0/1182990493 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74540724c0 msgr2=0x7f745414d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:38.194 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f745359e640 1 --2- 172.21.15.133:0/1182990493 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f74540724c0 0x7f745414d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f745359e640 1 -- 172.21.15.133:0/1182990493 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f74540c07b0 msgr2=0x7f7454145e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:38.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f745359e640 1 --2- 172.21.15.133:0/1182990493 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f74540c07b0 0x7f7454145e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f745359e640 1 -- 172.21.15.133:0/1182990493 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f743c009420 con 0x7f745414f9f0 2023-12-19T19:02:38.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f744a59c640 1 --2- 172.21.15.133:0/1182990493 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f74540c07b0 0x7f7454145e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:38.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f745359e640 1 --2- 172.21.15.133:0/1182990493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f745414f9f0 0x7f74541463a0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f744c00cc50 tx=0x7f744c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:38.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f744bfff640 1 -- 172.21.15.133:0/1182990493 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c00ce60 con 0x7f745414f9f0 2023-12-19T19:02:38.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f744bfff640 1 -- 172.21.15.133:0/1182990493 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c012400 con 0x7f745414f9f0 2023-12-19T19:02:38.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f7459017640 1 -- 172.21.15.133:0/1182990493 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7454142d40 con 0x7f745414f9f0 2023-12-19T19:02:38.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f744bfff640 1 -- 172.21.15.133:0/1182990493 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c012790 con 0x7f745414f9f0 2023-12-19T19:02:38.196 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f7459017640 1 -- 172.21.15.133:0/1182990493 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f745414d9c0 con 0x7f745414f9f0 2023-12-19T19:02:38.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f7459017640 1 -- 172.21.15.133:0/1182990493 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f74541428f0 con 0x7f745414f9f0 2023-12-19T19:02:38.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.187+0000 7f744bfff640 1 -- 172.21.15.133:0/1182990493 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f744c007070 con 0x7f745414f9f0 2023-12-19T19:02:38.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.191+0000 7f744bfff640 1 --2- 172.21.15.133:0/1182990493 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7434066470 0x7f7434068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:38.197 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.191+0000 7f744bfff640 1 -- 172.21.15.133:0/1182990493 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f744c083c40 con 0x7f745414f9f0 2023-12-19T19:02:38.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.191+0000 7f744bfff640 1 --2- 172.21.15.133:0/1182990493 >> [v2:172.21.15.138:6824/2464037857,v1:172.21.15.138:6825/2464037857] conn(0x7f743406c370 0x7f743406e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:38.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.191+0000 7f744bfff640 1 -- 172.21.15.133:0/1182990493 --> [v2:172.21.15.138:6824/2464037857,v1:172.21.15.138:6825/2464037857] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f743406ee40 con 0x7f743406c370 2023-12-19T19:02:38.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.191+0000 7f744bfff640 1 -- 172.21.15.133:0/1182990493 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_get_version_reply(handle=1 version=79) v2 ==== 24+0+0 (secure 0 0 0) 0x7f744c088240 con 0x7f745414f9f0 2023-12-19T19:02:38.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.191+0000 7f7452d9d640 1 --2- 172.21.15.133:0/1182990493 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7434066470 0x7f7434068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:38.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.191+0000 7f744a59c640 1 --2- 172.21.15.133:0/1182990493 >> [v2:172.21.15.138:6824/2464037857,v1:172.21.15.138:6825/2464037857] conn(0x7f743406c370 0x7f743406e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:38.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.191+0000 7f744a59c640 1 --2- 172.21.15.133:0/1182990493 >> [v2:172.21.15.138:6824/2464037857,v1:172.21.15.138:6825/2464037857] conn(0x7f743406c370 0x7f743406e790 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:38.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.191+0000 7f7452d9d640 1 --2- 172.21.15.133:0/1182990493 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7434066470 0x7f7434068930 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f74440011f0 tx=0x7f7444009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:38.198 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.191+0000 7f744bfff640 1 -- 172.21.15.133:0/1182990493 <== osd.7 v2:172.21.15.138:6824/2464037857 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f743406ee40 con 0x7f743406c370 2023-12-19T19:02:38.210 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.203+0000 7f7459017640 1 -- 172.21.15.133:0/1182990493 --> [v2:172.21.15.138:6824/2464037857,v1:172.21.15.138:6825/2464037857] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7454142bd0 con 0x7f743406c370 2023-12-19T19:02:38.211 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.207+0000 7f744bfff640 1 -- 172.21.15.133:0/1182990493 <== osd.7 v2:172.21.15.138:6824/2464037857 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f7454142bd0 con 0x7f743406c370 2023-12-19T19:02:38.211 INFO:teuthology.orchestra.run.smithi133.stdout:{ 2023-12-19T19:02:38.211 INFO:teuthology.orchestra.run.smithi133.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-19T19:02:38.211 INFO:teuthology.orchestra.run.smithi133.stdout:} 2023-12-19T19:02:38.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.207+0000 7f7459017640 1 -- 172.21.15.133:0/1182990493 >> [v2:172.21.15.138:6824/2464037857,v1:172.21.15.138:6825/2464037857] conn(0x7f743406c370 msgr2=0x7f743406e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:38.212 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.207+0000 7f7459017640 1 --2- 172.21.15.133:0/1182990493 >> [v2:172.21.15.138:6824/2464037857,v1:172.21.15.138:6825/2464037857] conn(0x7f743406c370 0x7f743406e790 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.207+0000 7f7459017640 1 -- 172.21.15.133:0/1182990493 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7434066470 msgr2=0x7f7434068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:38.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.207+0000 7f7459017640 1 --2- 172.21.15.133:0/1182990493 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f7434066470 0x7f7434068930 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f74440011f0 tx=0x7f7444009040 comp rx=0 tx=0).stop 2023-12-19T19:02:38.213 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.207+0000 7f7459017640 1 -- 172.21.15.133:0/1182990493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f745414f9f0 msgr2=0x7f74541463a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:38.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.207+0000 7f7459017640 1 --2- 172.21.15.133:0/1182990493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f745414f9f0 0x7f74541463a0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f744c00cc50 tx=0x7f744c00a430 comp rx=0 tx=0).stop 2023-12-19T19:02:38.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.207+0000 7f745359e640 1 -- 172.21.15.133:0/1182990493 reap_dead start 2023-12-19T19:02:38.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.207+0000 7f7459017640 1 -- 172.21.15.133:0/1182990493 shutdown_connections 2023-12-19T19:02:38.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.207+0000 7f7459017640 1 -- 172.21.15.133:0/1182990493 >> 172.21.15.133:0/1182990493 conn(0x7f74540c5d40 msgr2=0x7f74540c0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:38.214 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.207+0000 7f7459017640 1 -- 172.21.15.133:0/1182990493 shutdown_connections 2023-12-19T19:02:38.215 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.207+0000 7f7459017640 1 -- 172.21.15.133:0/1182990493 wait complete. 2023-12-19T19:02:38.230 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-19T19:02:38.368 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.363+0000 7ff7ee5b5640 1 Processor -- start 2023-12-19T19:02:38.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.363+0000 7ff7ee5b5640 1 -- start start 2023-12-19T19:02:38.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.363+0000 7ff7ee5b5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7e806e0b0 0x7ff7e80c3950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:38.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.363+0000 7ff7ee5b5640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff7e806c980 0x7ff7e80c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:38.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.363+0000 7ff7ee5b5640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e8158a90 con 0x7ff7e8155dd0 2023-12-19T19:02:38.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.363+0000 7ff7ee5b5640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e81588a0 con 0x7ff7e806c980 2023-12-19T19:02:38.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.363+0000 7ff7ee5b5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e8158d70 con 0x7ff7e806e0b0 2023-12-19T19:02:38.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.363+0000 7ff7eddb4640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff7e806c980 0x7ff7e80c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:38.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.363+0000 7ff7ecdb2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7e806e0b0 0x7ff7e80c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:38.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.363+0000 7ff7eddb4640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7ff7e806c980 0x7ff7e80c3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3300/0 says I am v2:172.21.15.133:43842/0 (socket says 172.21.15.133:43842) 2023-12-19T19:02:38.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.363+0000 7ff7ecdb2640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7e806e0b0 0x7ff7e80c3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.138:3301/0 says I am v2:172.21.15.133:43992/0 (socket says 172.21.15.133:43992) 2023-12-19T19:02:38.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.363+0000 7ff7eddb4640 1 -- 172.21.15.133:0/2636837467 learned_addr learned my addr 172.21.15.133:0/2636837467 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:38.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.363+0000 7ff7ed5b3640 1 --1- 172.21.15.133:0/2636837467 >> v1:172.21.15.138:6789/0 conn(0x7ff7e8155dd0 0x7ff7e80c1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:48804/0 (socket says 172.21.15.133:48804) 2023-12-19T19:02:38.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.363+0000 7ff7eddb4640 1 -- 172.21.15.133:0/2636837467 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7e806e0b0 msgr2=0x7ff7e80c3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:38.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.363+0000 7ff7eddb4640 1 --2- 172.21.15.133:0/2636837467 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7e806e0b0 0x7ff7e80c3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.373 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.363+0000 7ff7eddb4640 1 -- 172.21.15.133:0/2636837467 >> v1:172.21.15.138:6789/0 conn(0x7ff7e8155dd0 legacy=0x7ff7e80c1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:38.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.363+0000 7ff7eddb4640 1 -- 172.21.15.133:0/2636837467 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e8159050 con 0x7ff7e806c980 2023-12-19T19:02:38.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.367+0000 7ff7eddb4640 1 --2- 172.21.15.133:0/2636837467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7e806c980 0x7ff7e80c3e90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009e50 tx=0x7ff7e001c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c202994d694050b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:38.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.367+0000 7ff7dffff640 1 -- 172.21.15.133:0/2636837467 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e00a5660 con 0x7ff7e806c980 2023-12-19T19:02:38.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.367+0000 7ff7dffff640 1 -- 172.21.15.133:0/2636837467 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e00a57c0 con 0x7ff7e806c980 2023-12-19T19:02:38.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.367+0000 7ff7dffff640 1 -- 172.21.15.133:0/2636837467 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e00a5b50 con 0x7ff7e806c980 2023-12-19T19:02:38.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.367+0000 7ff7ee5b5640 1 -- 172.21.15.133:0/2636837467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7e806c980 msgr2=0x7ff7e80c3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:38.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.367+0000 7ff7ee5b5640 1 --2- 172.21.15.133:0/2636837467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7e806c980 0x7ff7e80c3e90 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009e50 tx=0x7ff7e001c8f0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.367+0000 7ff7ee5b5640 1 -- 172.21.15.133:0/2636837467 shutdown_connections 2023-12-19T19:02:38.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.367+0000 7ff7ee5b5640 1 --2- 172.21.15.133:0/2636837467 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7e806c980 0x7ff7e80c3e90 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.367+0000 7ff7ee5b5640 1 --2- 172.21.15.133:0/2636837467 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7e806e0b0 0x7ff7e80c3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.367+0000 7ff7ee5b5640 1 -- 172.21.15.133:0/2636837467 >> 172.21.15.133:0/2636837467 conn(0x7ff7e80a7800 msgr2=0x7ff7e80a7c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:38.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.367+0000 7ff7ee5b5640 1 -- 172.21.15.133:0/2636837467 shutdown_connections 2023-12-19T19:02:38.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.367+0000 7ff7ee5b5640 1 -- 172.21.15.133:0/2636837467 wait complete. 2023-12-19T19:02:38.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7ee5b5640 1 Processor -- start 2023-12-19T19:02:38.379 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7ee5b5640 1 -- start start 2023-12-19T19:02:38.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7ee5b5640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7e806c980 0x7ff7e80aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:38.383 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7ee5b5640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7e806e0b0 0x7ff7e80a9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:38.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7ee5b5640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7e8155dd0 0x7ff7e8153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:38.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7ee5b5640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e80a8d10 con 0x7ff7e806c980 2023-12-19T19:02:38.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7ee5b5640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e80a8a70 con 0x7ff7e8155dd0 2023-12-19T19:02:38.384 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7ee5b5640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e80aafb0 con 0x7ff7e806e0b0 2023-12-19T19:02:38.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7ed5b3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7e806c980 0x7ff7e80aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:38.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7ed5b3640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7e806c980 0x7ff7e80aaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32960/0 (socket says 172.21.15.133:32960) 2023-12-19T19:02:38.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7ed5b3640 1 -- 172.21.15.133:0/585011222 learned_addr learned my addr 172.21.15.133:0/585011222 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:38.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7ecdb2640 1 --2- 172.21.15.133:0/585011222 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7e806e0b0 0x7ff7e80a9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:38.385 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7eddb4640 1 --2- 172.21.15.133:0/585011222 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7e8155dd0 0x7ff7e8153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:38.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7ed5b3640 1 -- 172.21.15.133:0/585011222 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7e806e0b0 msgr2=0x7ff7e80a9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:38.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7ed5b3640 1 --2- 172.21.15.133:0/585011222 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7e806e0b0 0x7ff7e80a9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7ed5b3640 1 -- 172.21.15.133:0/585011222 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7e8155dd0 msgr2=0x7ff7e8153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:38.386 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7ed5b3640 1 --2- 172.21.15.133:0/585011222 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7e8155dd0 0x7ff7e8153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7ed5b3640 1 -- 172.21.15.133:0/585011222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e0009b30 con 0x7ff7e806c980 2023-12-19T19:02:38.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7ed5b3640 1 --2- 172.21.15.133:0/585011222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7e806c980 0x7ff7e80aaa70 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400c490 tx=0x7ff7e400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:38.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7ddffb640 1 -- 172.21.15.133:0/585011222 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4007480 con 0x7ff7e806c980 2023-12-19T19:02:38.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7ddffb640 1 -- 172.21.15.133:0/585011222 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e40075e0 con 0x7ff7e806c980 2023-12-19T19:02:38.387 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7ee5b5640 1 -- 172.21.15.133:0/585011222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e80ab410 con 0x7ff7e806c980 2023-12-19T19:02:38.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7ddffb640 1 -- 172.21.15.133:0/585011222 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e4004a10 con 0x7ff7e806c980 2023-12-19T19:02:38.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.371+0000 7ff7ee5b5640 1 -- 172.21.15.133:0/585011222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e814da40 con 0x7ff7e806c980 2023-12-19T19:02:38.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.375+0000 7ff7ee5b5640 1 -- 172.21.15.133:0/585011222 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e80ab750 con 0x7ff7e806c980 2023-12-19T19:02:38.388 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.375+0000 7ff7ddffb640 1 -- 172.21.15.133:0/585011222 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7ff7e4004b70 con 0x7ff7e806c980 2023-12-19T19:02:38.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.375+0000 7ff7ddffb640 1 --2- 172.21.15.133:0/585011222 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff7cc066470 0x7ff7cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:38.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.375+0000 7ff7ddffb640 1 -- 172.21.15.133:0/585011222 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff7e4083080 con 0x7ff7e806c980 2023-12-19T19:02:38.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.375+0000 7ff7ecdb2640 1 --2- 172.21.15.133:0/585011222 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff7cc066470 0x7ff7cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:38.389 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.375+0000 7ff7ecdb2640 1 --2- 172.21.15.133:0/585011222 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff7cc066470 0x7ff7cc068930 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8157ce0 tx=0x7ff7d8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:38.390 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.379+0000 7ff7ddffb640 1 -- 172.21.15.133:0/585011222 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7ff7e40b4290 con 0x7ff7e806c980 2023-12-19T19:02:38.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.527+0000 7ff7ee5b5640 1 -- 172.21.15.133:0/585011222 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7e806c180 con 0x7ff7cc066470 2023-12-19T19:02:38.535 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.527+0000 7ff7ddffb640 1 -- 172.21.15.133:0/585011222 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff7d80119d0 con 0x7ff7cc066470 2023-12-19T19:02:38.535 INFO:teuthology.orchestra.run.smithi133.stderr:instructed osd(s) 7 to deep-scrub 2023-12-19T19:02:38.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.531+0000 7ff7ee5b5640 1 -- 172.21.15.133:0/585011222 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff7cc066470 msgr2=0x7ff7cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:38.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.531+0000 7ff7ee5b5640 1 --2- 172.21.15.133:0/585011222 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff7cc066470 0x7ff7cc068930 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8157ce0 tx=0x7ff7d8009190 comp rx=0 tx=0).stop 2023-12-19T19:02:38.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.531+0000 7ff7ee5b5640 1 -- 172.21.15.133:0/585011222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7e806c980 msgr2=0x7ff7e80aaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:38.537 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.531+0000 7ff7ee5b5640 1 --2- 172.21.15.133:0/585011222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7e806c980 0x7ff7e80aaa70 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7ff7e400c490 tx=0x7ff7e400c950 comp rx=0 tx=0).stop 2023-12-19T19:02:38.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.531+0000 7ff7ee5b5640 1 -- 172.21.15.133:0/585011222 shutdown_connections 2023-12-19T19:02:38.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.531+0000 7ff7ee5b5640 1 --2- 172.21.15.133:0/585011222 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7ff7cc066470 0x7ff7cc068930 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.531+0000 7ff7ee5b5640 1 --2- 172.21.15.133:0/585011222 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7ff7e8155dd0 0x7ff7e8153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.531+0000 7ff7ee5b5640 1 --2- 172.21.15.133:0/585011222 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7ff7e806e0b0 0x7ff7e80a9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.531+0000 7ff7ee5b5640 1 --2- 172.21.15.133:0/585011222 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff7e806c980 0x7ff7e80aaa70 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.531+0000 7ff7ee5b5640 1 -- 172.21.15.133:0/585011222 >> 172.21.15.133:0/585011222 conn(0x7ff7e80a7800 msgr2=0x7ff7e80663f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:38.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.531+0000 7ff7ee5b5640 1 -- 172.21.15.133:0/585011222 shutdown_connections 2023-12-19T19:02:38.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.531+0000 7ff7ee5b5640 1 -- 172.21.15.133:0/585011222 wait complete. 2023-12-19T19:02:38.556 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T19:02:38.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.687+0000 7f90ca3c4640 1 Processor -- start 2023-12-19T19:02:38.693 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.687+0000 7f90ca3c4640 1 -- start start 2023-12-19T19:02:38.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.687+0000 7f90ca3c4640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f90c40c7ea0 0x7f90c406b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:38.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.687+0000 7f90ca3c4640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f90c406b9e0 0x7f90c415f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:38.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.687+0000 7f90ca3c4640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c406c860 con 0x7f90c4151e90 2023-12-19T19:02:38.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.687+0000 7f90ca3c4640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c40c8750 con 0x7f90c406b9e0 2023-12-19T19:02:38.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.687+0000 7f90ca3c4640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c41552d0 con 0x7f90c40c7ea0 2023-12-19T19:02:38.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.691+0000 7f90c3fff640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f90c4151e90 0x7f90c40c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:52154/0 (socket says 172.21.15.133:52154) 2023-12-19T19:02:38.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.691+0000 7f90c3fff640 1 -- 172.21.15.133:0/71447331 learned_addr learned my addr 172.21.15.133:0/71447331 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:38.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.691+0000 7f90c8961640 1 --2- 172.21.15.133:0/71447331 >> v2:172.21.15.133:3300/0 conn(0x7f90c406b9e0 0x7f90c415f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:38.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.691+0000 7f90c37fe640 1 --2- 172.21.15.133:0/71447331 >> v2:172.21.15.138:3300/0 conn(0x7f90c40c7ea0 0x7f90c406b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:38.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.691+0000 7f90c2ffd640 1 -- 172.21.15.133:0/71447331 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943754687 0 0) 0x7f90c406c860 con 0x7f90c4151e90 2023-12-19T19:02:38.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.691+0000 7f90c2ffd640 1 -- 172.21.15.133:0/71447331 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90ac003530 con 0x7f90c4151e90 2023-12-19T19:02:38.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.691+0000 7f90c8961640 1 -- 172.21.15.133:0/71447331 >> v2:172.21.15.138:3300/0 conn(0x7f90c40c7ea0 msgr2=0x7f90c406b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:38.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.691+0000 7f90c8961640 1 --2- 172.21.15.133:0/71447331 >> v2:172.21.15.138:3300/0 conn(0x7f90c40c7ea0 0x7f90c406b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.691+0000 7f90c8961640 1 -- 172.21.15.133:0/71447331 >> v1:172.21.15.133:6789/0 conn(0x7f90c4151e90 legacy=0x7f90c40c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:38.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.691+0000 7f90c8961640 1 -- 172.21.15.133:0/71447331 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c4154930 con 0x7f90c406b9e0 2023-12-19T19:02:38.698 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.691+0000 7f90c8961640 1 --2- 172.21.15.133:0/71447331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90c406b9e0 0x7f90c415f0a0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f90c40a9a70 tx=0x7f90bc01c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9ad77e350a84b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:38.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.691+0000 7f90c2ffd640 1 -- 172.21.15.133:0/71447331 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc0a66c0 con 0x7f90c406b9e0 2023-12-19T19:02:38.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.691+0000 7f90c2ffd640 1 -- 172.21.15.133:0/71447331 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc0a6820 con 0x7f90c406b9e0 2023-12-19T19:02:38.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.691+0000 7f90c2ffd640 1 -- 172.21.15.133:0/71447331 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc0a6b90 con 0x7f90c406b9e0 2023-12-19T19:02:38.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.695+0000 7f90ca3c4640 1 -- 172.21.15.133:0/71447331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90c406b9e0 msgr2=0x7f90c415f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:38.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.695+0000 7f90ca3c4640 1 --2- 172.21.15.133:0/71447331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90c406b9e0 0x7f90c415f0a0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f90c40a9a70 tx=0x7f90bc01c7f0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.695+0000 7f90ca3c4640 1 -- 172.21.15.133:0/71447331 shutdown_connections 2023-12-19T19:02:38.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.695+0000 7f90ca3c4640 1 --2- 172.21.15.133:0/71447331 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90c406b9e0 0x7f90c415f0a0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.695+0000 7f90ca3c4640 1 --2- 172.21.15.133:0/71447331 >> v2:172.21.15.138:3300/0 conn(0x7f90c40c7ea0 0x7f90c406b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.695+0000 7f90ca3c4640 1 -- 172.21.15.133:0/71447331 >> 172.21.15.133:0/71447331 conn(0x7f90c40ca170 msgr2=0x7f90c40ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:38.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.695+0000 7f90ca3c4640 1 -- 172.21.15.133:0/71447331 shutdown_connections 2023-12-19T19:02:38.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.695+0000 7f90ca3c4640 1 -- 172.21.15.133:0/71447331 wait complete. 2023-12-19T19:02:38.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.695+0000 7f90ca3c4640 1 Processor -- start 2023-12-19T19:02:38.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.695+0000 7f90ca3c4640 1 -- start start 2023-12-19T19:02:38.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.695+0000 7f90ca3c4640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90c406b9e0 0x7f90c40ac460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:38.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.695+0000 7f90ca3c4640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90c40c7ea0 0x7f90c41ed640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:38.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.695+0000 7f90ca3c4640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90c4151e90 0x7f90c40c16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:38.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.695+0000 7f90ca3c4640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c41ee140 con 0x7f90c406b9e0 2023-12-19T19:02:38.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.695+0000 7f90ca3c4640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c4142cf0 con 0x7f90c40c7ea0 2023-12-19T19:02:38.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.695+0000 7f90ca3c4640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c414d130 con 0x7f90c4151e90 2023-12-19T19:02:38.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.695+0000 7f90c3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90c406b9e0 0x7f90c40ac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:38.703 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.695+0000 7f90c3fff640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90c406b9e0 0x7f90c40ac460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:32978/0 (socket says 172.21.15.133:32978) 2023-12-19T19:02:38.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.695+0000 7f90c3fff640 1 -- 172.21.15.133:0/1781703760 learned_addr learned my addr 172.21.15.133:0/1781703760 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:38.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.695+0000 7f90c37fe640 1 --2- 172.21.15.133:0/1781703760 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90c40c7ea0 0x7f90c41ed640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:38.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.695+0000 7f90c8961640 1 --2- 172.21.15.133:0/1781703760 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90c4151e90 0x7f90c40c16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:38.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.699+0000 7f90c3fff640 1 -- 172.21.15.133:0/1781703760 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90c4151e90 msgr2=0x7f90c40c16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:38.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.699+0000 7f90c3fff640 1 --2- 172.21.15.133:0/1781703760 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90c4151e90 0x7f90c40c16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.699+0000 7f90c3fff640 1 -- 172.21.15.133:0/1781703760 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90c40c7ea0 msgr2=0x7f90c41ed640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:38.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.699+0000 7f90c3fff640 1 --2- 172.21.15.133:0/1781703760 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90c40c7ea0 0x7f90c41ed640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.699+0000 7f90c3fff640 1 -- 172.21.15.133:0/1781703760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90bc009a70 con 0x7f90c406b9e0 2023-12-19T19:02:38.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.699+0000 7f90c3fff640 1 --2- 172.21.15.133:0/1781703760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90c406b9e0 0x7f90c40ac460 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f90b400c450 tx=0x7f90b400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:38.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.699+0000 7f90c0ff9640 1 -- 172.21.15.133:0/1781703760 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b4005cf0 con 0x7f90c406b9e0 2023-12-19T19:02:38.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.699+0000 7f90c0ff9640 1 -- 172.21.15.133:0/1781703760 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b4005e50 con 0x7f90c406b9e0 2023-12-19T19:02:38.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.699+0000 7f90c0ff9640 1 -- 172.21.15.133:0/1781703760 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b40072f0 con 0x7f90c406b9e0 2023-12-19T19:02:38.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.699+0000 7f90ca3c4640 1 -- 172.21.15.133:0/1781703760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c40c2810 con 0x7f90c406b9e0 2023-12-19T19:02:38.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.699+0000 7f90ca3c4640 1 -- 172.21.15.133:0/1781703760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c414c2e0 con 0x7f90c406b9e0 2023-12-19T19:02:38.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.699+0000 7f90ca3c4640 1 -- 172.21.15.133:0/1781703760 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c414c140 con 0x7f90c406b9e0 2023-12-19T19:02:38.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.699+0000 7f90c0ff9640 1 -- 172.21.15.133:0/1781703760 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f90b4007450 con 0x7f90c406b9e0 2023-12-19T19:02:38.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.699+0000 7f90c0ff9640 1 --2- 172.21.15.133:0/1781703760 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f90b0066470 0x7f90b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:38.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.699+0000 7f90c0ff9640 1 -- 172.21.15.133:0/1781703760 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f90b40831b0 con 0x7f90c406b9e0 2023-12-19T19:02:38.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.699+0000 7f90c37fe640 1 --2- 172.21.15.133:0/1781703760 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f90b0066470 0x7f90b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:38.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.703+0000 7f90c37fe640 1 --2- 172.21.15.133:0/1781703760 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f90b0066470 0x7f90b0068930 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f90c41eaf80 tx=0x7f90b8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:38.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.703+0000 7f90c0ff9640 1 -- 172.21.15.133:0/1781703760 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f90c414c140 con 0x7f90c406b9e0 2023-12-19T19:02:38.860 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.855+0000 7f90ca3c4640 1 -- 172.21.15.133:0/1781703760 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f90c40c5a60 con 0x7f90b0066470 2023-12-19T19:02:38.863 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.855+0000 7f90c0ff9640 1 -- 172.21.15.133:0/1781703760 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+51156 (secure 0 0 0) 0x7f90c40c5a60 con 0x7f90b0066470 2023-12-19T19:02:38.863 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:38.864 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T19:02:38.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.859+0000 7f90ca3c4640 1 -- 172.21.15.133:0/1781703760 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f90b0066470 msgr2=0x7f90b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:38.865 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.859+0000 7f90ca3c4640 1 --2- 172.21.15.133:0/1781703760 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f90b0066470 0x7f90b0068930 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f90c41eaf80 tx=0x7f90b8009190 comp rx=0 tx=0).stop 2023-12-19T19:02:38.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.859+0000 7f90ca3c4640 1 -- 172.21.15.133:0/1781703760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90c406b9e0 msgr2=0x7f90c40ac460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:38.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.859+0000 7f90ca3c4640 1 --2- 172.21.15.133:0/1781703760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90c406b9e0 0x7f90c40ac460 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f90b400c450 tx=0x7f90b400c910 comp rx=0 tx=0).stop 2023-12-19T19:02:38.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.859+0000 7f90ca3c4640 1 -- 172.21.15.133:0/1781703760 shutdown_connections 2023-12-19T19:02:38.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.859+0000 7f90ca3c4640 1 --2- 172.21.15.133:0/1781703760 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f90b0066470 0x7f90b0068930 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.859+0000 7f90ca3c4640 1 --2- 172.21.15.133:0/1781703760 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f90c4151e90 0x7f90c40c16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.859+0000 7f90ca3c4640 1 --2- 172.21.15.133:0/1781703760 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f90c40c7ea0 0x7f90c41ed640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.859+0000 7f90ca3c4640 1 --2- 172.21.15.133:0/1781703760 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90c406b9e0 0x7f90c40ac460 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:38.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.859+0000 7f90ca3c4640 1 -- 172.21.15.133:0/1781703760 >> 172.21.15.133:0/1781703760 conn(0x7f90c40ca170 msgr2=0x7f90c41488e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:38.866 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.859+0000 7f90ca3c4640 1 -- 172.21.15.133:0/1781703760 shutdown_connections 2023-12-19T19:02:38.867 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:38.859+0000 7f90ca3c4640 1 -- 172.21.15.133:0/1781703760 wait complete. 2023-12-19T19:02:38.884 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":195,"stamp":"2023-12-19T19:02:36.891058+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":258332,"kb_used_data":8868,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716388,"statfs":{"total":773094113280,"available":772829581312,"internally_reserved":0,"allocated":9080832,"data_stored":4674285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12079,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-63,"num_write_kb":-33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001570"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":226,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-19T19:02:30.252777+0000","last_change":"2023-12-19T18:58:32.218455+0000","last_active":"2023-12-19T19:02:30.252777+0000","last_peered":"2023-12-19T19:02:30.252777+0000","last_clean":"2023-12-19T19:02:30.252777+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T19:02:30.252777+0000","last_undegraded":"2023-12-19T19:02:30.252777+0000","last_fullsized":"2023-12-19T19:02:30.252777+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:58:31.118336+0000","last_clean_scrub_stamp":"2023-12-19T18:58:31.118336+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:59.151520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32728,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339112,"statfs":{"total":96636764160,"available":96603250688,"internally_reserved":0,"allocated":1581056,"data_stored":1027189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.68200000000000005,"15min":0.68999999999999995},"min":{"1min":0.58099999999999996,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84399999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.71299999999999997,"15min":0.72199999999999998},"min":{"1min":0.56399999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.82599999999999996,"5min":1.117,"15min":1.117},"last":0.61599999999999999}]},{"osd":1,"last update":"Tue Dec 19 19:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.47599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68000000000000005,"15min":0.68700000000000006},"min":{"1min":0.51700000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.51700000000000002}]},{"osd":2,"last update":"Tue Dec 19 19:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66700000000000004,"15min":0.68100000000000005},"min":{"1min":0.48099999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79400000000000004,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.56699999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92000000000000004,"5min":1.089,"15min":1.089},"last":0.76000000000000001}]},{"osd":3,"last update":"Tue Dec 19 19:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70099999999999996,"15min":0.72299999999999998},"min":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.92100000000000004,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72599999999999998,"15min":0.73299999999999998},"min":{"1min":0.53500000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.85299999999999998,"5min":1.026,"15min":1.026},"last":0.53500000000000003}]},{"osd":4,"last update":"Tue Dec 19 19:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.629,"15min":0.65100000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85199999999999998,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65800000000000003,"15min":0.67100000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89800000000000002,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.68899999999999995}]},{"osd":5,"last update":"Tue Dec 19 19:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67600000000000005,"15min":0.69199999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.96099999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68700000000000006,"15min":0.70399999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92300000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.71099999999999997}]},{"osd":6,"last update":"Tue Dec 19 19:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78800000000000003,"15min":0.81000000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94999999999999996,"5min":1.069,"15min":1.069},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.75,"15min":0.78600000000000003},"min":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89100000000000001,"5min":1.044,"15min":1.044},"last":0.64600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":436821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64200000000000002,"15min":0.63400000000000001},"min":{"1min":0.41499999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85499999999999998,"5min":1.022,"15min":1.022},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68799999999999994,"15min":0.69599999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.89500000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.73299999999999998}]},{"osd":1,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.67800000000000005,"15min":0.65900000000000003},"min":{"1min":0.52900000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97199999999999998,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.48799999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95399999999999996,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.70499999999999996}]},{"osd":2,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.47099999999999997,"5min":0.437,"15min":0.437},"max":{"1min":0.83999999999999997,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71399999999999997,"15min":0.71499999999999997},"min":{"1min":0.46000000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88800000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.77400000000000002}]},{"osd":3,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70299999999999996,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91800000000000004,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.51300000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93700000000000006,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.68700000000000006}]},{"osd":4,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88500000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71999999999999997,"15min":0.748},"min":{"1min":0.48899999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.86599999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.54300000000000004}]},{"osd":5,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.47899999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86599999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.501},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72799999999999998,"15min":0.73499999999999999},"min":{"1min":0.51700000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.91700000000000004,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.57399999999999995}]},{"osd":7,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.74199999999999999,"15min":0.75800000000000001},"min":{"1min":0.45200000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.95999999999999996,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.89000000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.59899999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":436821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.84399999999999997,"15min":0.92900000000000005},"min":{"1min":0.434,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.90900000000000003,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.66800000000000004,"5min":1.1739999999999999,"15min":1.3959999999999999},"min":{"1min":0.495,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86199999999999999,"5min":16.951000000000001,"15min":16.951000000000001},"last":0.70499999999999996}]},{"osd":1,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":1.222,"15min":1.48},"min":{"1min":0.45900000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.98299999999999998,"5min":19.823,"15min":19.823},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67400000000000004,"15min":0.67200000000000004},"min":{"1min":0.45800000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.95899999999999996,"5min":1.657,"15min":1.657},"last":0.75800000000000001}]},{"osd":2,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.72899999999999998,"15min":0.751},"min":{"1min":0.47599999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.92300000000000004,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.71599999999999997,"15min":0.73299999999999998},"min":{"1min":0.49399999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93700000000000006,"5min":1.585,"15min":1.585},"last":0.81399999999999995}]},{"osd":3,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76700000000000002,"15min":0.78700000000000003},"min":{"1min":0.53500000000000003,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.97199999999999998,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.91200000000000003,"15min":0.99399999999999999},"min":{"1min":0.58799999999999997,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.89400000000000002,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":0.73799999999999999}]},{"osd":4,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66500000000000004,"15min":0.67300000000000004},"min":{"1min":0.46300000000000002,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92600000000000005,"5min":1.716,"15min":1.716},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.78700000000000003,"15min":0.82299999999999995},"min":{"1min":0.50700000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.91700000000000004,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":0.83499999999999996}]},{"osd":6,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.78500000000000003,"15min":0.83699999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85299999999999998,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.79900000000000004,"15min":0.83599999999999997},"min":{"1min":0.52000000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.86899999999999999,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.68200000000000005}]},{"osd":7,"last update":"Tue Dec 19 19:01:42 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.80800000000000005,"15min":0.83199999999999996},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96099999999999997,"5min":2.371,"15min":2.371},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.81399999999999995,"15min":0.84099999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.93500000000000005,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.85199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":436821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.79300000000000004,"15min":0.85899999999999999},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.92600000000000005,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67700000000000005,"15min":0.69099999999999995},"min":{"1min":0.47499999999999998,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83599999999999997,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.64400000000000002}]},{"osd":1,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.68600000000000005,"15min":0.69799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.85399999999999998,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.76500000000000001,"15min":0.79800000000000004},"min":{"1min":0.47499999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.86399999999999999,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":0.57399999999999995}]},{"osd":2,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.69199999999999995},"min":{"1min":0.504,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.872,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.76600000000000001,"15min":0.80800000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.86399999999999999,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.88200000000000001}]},{"osd":3,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.78200000000000003,"15min":0.83599999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.874,"5min":3.641,"15min":3.641},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.83299999999999996,"15min":0.88500000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.91200000000000003,"5min":3.194,"15min":3.194},"last":0.98399999999999999}]},{"osd":5,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.92200000000000004,"15min":1.054},"min":{"1min":0.434,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89200000000000002,"5min":9.3040000000000003,"15min":9.3040000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.69599999999999995,"15min":0.73199999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.90800000000000003,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.499}]},{"osd":6,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.78700000000000003,"15min":0.83199999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92700000000000005,"5min":3.097,"15min":3.097},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.82299999999999995,"15min":0.877},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89700000000000002,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.67900000000000005}]},{"osd":7,"last update":"Tue Dec 19 19:01:39 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.879,"15min":0.95899999999999996},"min":{"1min":0.48399999999999999,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.93200000000000005,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.95399999999999996,"15min":1.052},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.94299999999999995,"5min":6.3449999999999998,"15min":6.3449999999999998},"last":0.77800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32144,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":987136,"data_stored":436821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.44900000000000001,"15min":0.45600000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72699999999999998,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.36099999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.71299999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.33600000000000002}]},{"osd":1,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.46700000000000003,"15min":0.48499999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60699999999999998,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.504,"5min":0.50600000000000001,"15min":0.51800000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.44}]},{"osd":2,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.74299999999999999,"5min":0.75,"15min":0.75},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.54700000000000004},"min":{"1min":0.34999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.77600000000000002,"5min":0.875,"15min":0.875},"last":0.57599999999999996}]},{"osd":4,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.76600000000000001,"15min":0.78300000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88400000000000001,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.754,"5min":0.79300000000000004,"15min":0.81100000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98999999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.60299999999999998}]},{"osd":5,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73899999999999999,"15min":0.751},"min":{"1min":0.50600000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94999999999999996,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.752,"15min":0.77000000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.04,"5min":1.202,"15min":1.202},"last":0.56000000000000005}]},{"osd":6,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.79800000000000004,"15min":0.82199999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.96399999999999997,"5min":1.298,"15min":1.298},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.79400000000000004,"15min":0.80400000000000005},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":0.98299999999999998,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.78000000000000003,"15min":0.79200000000000004},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94999999999999996,"5min":1.155,"15min":1.155},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.76600000000000001,"15min":0.78000000000000003},"min":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.93000000000000005,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.68700000000000006}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32144,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":987136,"data_stored":436821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.47399999999999998,"15min":0.5},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53700000000000003,"5min":1.458,"15min":1.458},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.56999999999999995,"15min":0.622},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.68799999999999994,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.32800000000000001}]},{"osd":1,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.54600000000000004,"15min":0.58799999999999997},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.56899999999999995,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.56799999999999995,"15min":0.61199999999999999},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.625,"5min":2.444,"15min":2.444},"last":0.45700000000000002}]},{"osd":3,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.55400000000000005,"15min":0.60599999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.60899999999999999,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.58999999999999997,"15min":0.63200000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.65500000000000003,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.39800000000000002}]},{"osd":4,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.88600000000000001,"15min":0.95699999999999996},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.0189999999999999,"5min":1.968,"15min":1.968},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.84999999999999998,"15min":0.91000000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96899999999999997,"5min":2.835,"15min":2.835},"last":0.753}]},{"osd":5,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.86399999999999999,"15min":0.93300000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.99099999999999999,"5min":3.5,"15min":3.5},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.86499999999999999,"15min":0.92500000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94999999999999996,"5min":1.996,"15min":1.996},"last":0.878}]},{"osd":6,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.86699999999999999,"15min":0.93200000000000005},"min":{"1min":0.53500000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0740000000000001,"5min":2.903,"15min":2.903},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.93000000000000005,"15min":1.0129999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0569999999999999,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.80100000000000005}]},{"osd":7,"last update":"Tue Dec 19 19:01:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.90300000000000002,"15min":0.97099999999999997},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1259999999999999,"5min":2.875,"15min":2.875},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.88200000000000001,"15min":0.96099999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.95199999999999996,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.73399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":436821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.51800000000000002,"15min":0.56999999999999995},"min":{"1min":0.29699999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73399999999999999,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.443,"5min":0.67100000000000004,"15min":0.77500000000000002},"min":{"1min":0.31,"5min":0.255,"15min":0.255},"max":{"1min":0.76700000000000002,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.48399999999999999}]},{"osd":2,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.53900000000000003,"15min":0.58499999999999996},"min":{"1min":0.317,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71799999999999997,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.61099999999999999,"15min":0.67400000000000004},"min":{"1min":0.34699999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76800000000000002,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.54100000000000004}]},{"osd":3,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.72299999999999998,"15min":0.81899999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.90700000000000003,"5min":7.8399999999999999,"15min":7.8399999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.746,"15min":0.83799999999999997},"min":{"1min":0.42999999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.83699999999999997,"5min":7.7949999999999999,"15min":7.7949999999999999},"last":0.63600000000000001}]},{"osd":4,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.81899999999999995,"15min":0.88300000000000001},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.871,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.85199999999999998,"15min":0.91400000000000003},"min":{"1min":0.52300000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.89300000000000002,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.627}]},{"osd":5,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.82999999999999996,"15min":0.89200000000000002},"min":{"1min":0.49399999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93300000000000005,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.84099999999999997,"15min":0.90300000000000002},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.996,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.66800000000000004}]},{"osd":6,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.84799999999999998,"15min":0.89600000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.95599999999999996,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.876,"15min":0.95099999999999996},"min":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.85499999999999998,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.57699999999999996}]},{"osd":7,"last update":"Tue Dec 19 19:01:38 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.88300000000000001,"15min":0.94999999999999996},"min":{"1min":0.51600000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.83299999999999996,"5min":4.3310000000000004,"15min":4.3310000000000004},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.85899999999999999,"15min":0.90900000000000003},"min":{"1min":0.55100000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.92100000000000004,"5min":4.226,"15min":4.226},"last":0.68600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1576960,"data_stored":1026170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.42499999999999999,"15min":0.44500000000000001},"min":{"1min":0.27200000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.64000000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.47399999999999998,"15min":0.498},"min":{"1min":0.30099999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.626,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.30099999999999999}]},{"osd":2,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.49399999999999999,"15min":0.50900000000000001},"min":{"1min":0.32800000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.57499999999999996,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.501,"15min":0.50900000000000001},"min":{"1min":0.372,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.67100000000000004,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.38900000000000001}]},{"osd":3,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47499999999999998,"15min":0.48499999999999999},"min":{"1min":0.35399999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.70699999999999996,"5min":0.747,"15min":0.747},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.55300000000000005,"15min":0.58999999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.79400000000000004,"5min":1.264,"15min":1.264},"last":0.44}]},{"osd":4,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.72299999999999998,"15min":0.74099999999999999},"min":{"1min":0.48699999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82899999999999996,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.72799999999999998,"15min":0.76700000000000002},"min":{"1min":0.52200000000000002,"5min":0.495,"15min":0.495},"max":{"1min":0.82699999999999996,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.55000000000000004}]},{"osd":5,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.71599999999999997,"15min":0.74299999999999999},"min":{"1min":0.53500000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.81799999999999995,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.75900000000000001,"15min":0.80600000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.84899999999999998,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.51900000000000002}]},{"osd":6,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.76200000000000001,"15min":0.81399999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.83299999999999996,"5min":1.349,"15min":1.349},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73299999999999998,"15min":0.77000000000000002},"min":{"1min":0.56399999999999995,"5min":0.496,"15min":0.496},"max":{"1min":0.86299999999999999,"5min":1.115,"15min":1.115},"last":0.67800000000000005}]},{"osd":7,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.73899999999999999,"15min":0.78300000000000003},"min":{"1min":0.52100000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.79200000000000004,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.76900000000000002,"15min":0.80400000000000005},"min":{"1min":0.58699999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.81399999999999995,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.624}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T19:02:38.888 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-19T18:58:31.118336+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=18, tm_min=58, tm_sec=31, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=19, tm_min=2, tm_sec=33, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T19:02:38.888 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-19T19:02:42.121 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T19:02:42.126 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T19:02:58.888 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T19:02:59.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.031+0000 7fc74f8c9640 1 Processor -- start 2023-12-19T19:02:59.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.031+0000 7fc74f8c9640 1 -- start start 2023-12-19T19:02:59.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.035+0000 7fc74f8c9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7480c63c0 0x7fc7480c06d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:59.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.035+0000 7fc74f8c9640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7fc7480c4100 0x7fc7480c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:59.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.035+0000 7fc74f8c9640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc7480c29e0 0x7fc7480a9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:59.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.035+0000 7fc74f8c9640 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7480c31c0 con 0x7fc7480c29e0 2023-12-19T19:02:59.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.035+0000 7fc74f8c9640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7480c34a0 con 0x7fc7480c4100 2023-12-19T19:02:59.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.035+0000 7fc74f8c9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7480c1030 con 0x7fc7480c63c0 2023-12-19T19:02:59.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.035+0000 7fc74de66640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc7480c29e0 0x7fc7480a9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:59.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.035+0000 7fc74de66640 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc7480c29e0 0x7fc7480a9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34758/0 (socket says 172.21.15.133:34758) 2023-12-19T19:02:59.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.035+0000 7fc74de66640 1 -- 172.21.15.133:0/3634315297 learned_addr learned my addr 172.21.15.133:0/3634315297 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:59.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.035+0000 7fc74ce64640 1 --2- 172.21.15.133:0/3634315297 >> v2:172.21.15.138:3300/0 conn(0x7fc7480c4100 0x7fc7480c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:59.041 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.035+0000 7fc74d665640 1 --2- 172.21.15.133:0/3634315297 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7480c63c0 0x7fc7480c06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:59.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.035+0000 7fc74de66640 1 -- 172.21.15.133:0/3634315297 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7480c63c0 msgr2=0x7fc7480c06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:59.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.035+0000 7fc74de66640 1 --2- 172.21.15.133:0/3634315297 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7480c63c0 0x7fc7480c06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.035+0000 7fc74de66640 1 -- 172.21.15.133:0/3634315297 >> v2:172.21.15.138:3300/0 conn(0x7fc7480c4100 msgr2=0x7fc7480c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:59.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.035+0000 7fc74de66640 1 --2- 172.21.15.133:0/3634315297 >> v2:172.21.15.138:3300/0 conn(0x7fc7480c4100 0x7fc7480c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.035+0000 7fc74de66640 1 -- 172.21.15.133:0/3634315297 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7480c1310 con 0x7fc7480c29e0 2023-12-19T19:02:59.042 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.035+0000 7fc74ce64640 1 --2- 172.21.15.133:0/3634315297 >> v2:172.21.15.138:3300/0 conn(0x7fc7480c4100 0x7fc7480c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:59.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.039+0000 7fc74de66640 1 --2- 172.21.15.133:0/3634315297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7480c29e0 0x7fc7480a9680 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fc74806b390 tx=0x7fc74001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9905126dd3e8064d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:59.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.039+0000 7fc73ffff640 1 -- 172.21.15.133:0/3634315297 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7480aa3d0 con 0x7fc7480c29e0 2023-12-19T19:02:59.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.039+0000 7fc73ffff640 1 -- 172.21.15.133:0/3634315297 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7400a5720 con 0x7fc7480c29e0 2023-12-19T19:02:59.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.039+0000 7fc73ffff640 1 -- 172.21.15.133:0/3634315297 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7400a5ab0 con 0x7fc7480c29e0 2023-12-19T19:02:59.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.039+0000 7fc74f8c9640 1 -- 172.21.15.133:0/3634315297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7480c29e0 msgr2=0x7fc7480a9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:59.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.039+0000 7fc74f8c9640 1 --2- 172.21.15.133:0/3634315297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7480c29e0 0x7fc7480a9680 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fc74806b390 tx=0x7fc74001c880 comp rx=0 tx=0).stop 2023-12-19T19:02:59.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.039+0000 7fc74f8c9640 1 -- 172.21.15.133:0/3634315297 shutdown_connections 2023-12-19T19:02:59.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.039+0000 7fc74f8c9640 1 --2- 172.21.15.133:0/3634315297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7480c29e0 0x7fc7480a9680 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.039+0000 7fc74f8c9640 1 --2- 172.21.15.133:0/3634315297 >> v2:172.21.15.138:3300/0 conn(0x7fc7480c4100 0x7fc7480c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.039+0000 7fc74f8c9640 1 --2- 172.21.15.133:0/3634315297 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7480c63c0 0x7fc7480c06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.039+0000 7fc74f8c9640 1 -- 172.21.15.133:0/3634315297 >> 172.21.15.133:0/3634315297 conn(0x7fc74806a5b0 msgr2=0x7fc74806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:59.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.039+0000 7fc74f8c9640 1 -- 172.21.15.133:0/3634315297 shutdown_connections 2023-12-19T19:02:59.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.039+0000 7fc74f8c9640 1 -- 172.21.15.133:0/3634315297 wait complete. 2023-12-19T19:02:59.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.039+0000 7fc74f8c9640 1 Processor -- start 2023-12-19T19:02:59.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.039+0000 7fc74f8c9640 1 -- start start 2023-12-19T19:02:59.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.043+0000 7fc74f8c9640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7480c29e0 0x7fc74806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:59.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.043+0000 7fc74f8c9640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7480c4100 0x7fc748148a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:59.048 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.043+0000 7fc74f8c9640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7480c63c0 0x7fc748148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:59.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.043+0000 7fc74f8c9640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74814d240 con 0x7fc7480c29e0 2023-12-19T19:02:59.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.043+0000 7fc74f8c9640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc748149ba0 con 0x7fc7480c4100 2023-12-19T19:02:59.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.043+0000 7fc74f8c9640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7480a89d0 con 0x7fc7480c63c0 2023-12-19T19:02:59.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.043+0000 7fc74d665640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7480c29e0 0x7fc74806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:59.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.043+0000 7fc74d665640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7480c29e0 0x7fc74806d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34762/0 (socket says 172.21.15.133:34762) 2023-12-19T19:02:59.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.043+0000 7fc74d665640 1 -- 172.21.15.133:0/793599074 learned_addr learned my addr 172.21.15.133:0/793599074 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:59.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.043+0000 7fc74d665640 1 -- 172.21.15.133:0/793599074 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7480c63c0 msgr2=0x7fc748148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:59.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.043+0000 7fc74d665640 1 --2- 172.21.15.133:0/793599074 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7480c63c0 0x7fc748148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.049 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.043+0000 7fc74d665640 1 -- 172.21.15.133:0/793599074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7480c4100 msgr2=0x7fc748148a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:59.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.043+0000 7fc74d665640 1 --2- 172.21.15.133:0/793599074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7480c4100 0x7fc748148a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.043+0000 7fc74d665640 1 -- 172.21.15.133:0/793599074 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc740009b30 con 0x7fc7480c29e0 2023-12-19T19:02:59.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.043+0000 7fc74d665640 1 --2- 172.21.15.133:0/793599074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7480c29e0 0x7fc74806d6d0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fc74400d5f0 tx=0x7fc74400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:59.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.043+0000 7fc73dffb640 1 -- 172.21.15.133:0/793599074 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7440125f0 con 0x7fc7480c29e0 2023-12-19T19:02:59.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.043+0000 7fc73dffb640 1 -- 172.21.15.133:0/793599074 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc744012750 con 0x7fc7480c29e0 2023-12-19T19:02:59.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.043+0000 7fc74f8c9640 1 -- 172.21.15.133:0/793599074 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7480c69b0 con 0x7fc7480c29e0 2023-12-19T19:02:59.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.043+0000 7fc73dffb640 1 -- 172.21.15.133:0/793599074 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc744012ae0 con 0x7fc7480c29e0 2023-12-19T19:02:59.050 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.043+0000 7fc74f8c9640 1 -- 172.21.15.133:0/793599074 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7481498c0 con 0x7fc7480c29e0 2023-12-19T19:02:59.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.043+0000 7fc74f8c9640 1 -- 172.21.15.133:0/793599074 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc748068400 con 0x7fc7480c29e0 2023-12-19T19:02:59.051 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.043+0000 7fc73dffb640 1 -- 172.21.15.133:0/793599074 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7fc744012c40 con 0x7fc7480c29e0 2023-12-19T19:02:59.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.047+0000 7fc73dffb640 1 --2- 172.21.15.133:0/793599074 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc72c0664a0 0x7fc72c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:59.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.047+0000 7fc73dffb640 1 -- 172.21.15.133:0/793599074 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc744083ff0 con 0x7fc7480c29e0 2023-12-19T19:02:59.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.047+0000 7fc74ce64640 1 --2- 172.21.15.133:0/793599074 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc72c0664a0 0x7fc72c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:59.052 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.047+0000 7fc74ce64640 1 --2- 172.21.15.133:0/793599074 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc72c0664a0 0x7fc72c068960 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc7480bfc10 tx=0x7fc738008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:59.055 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.051+0000 7fc73dffb640 1 -- 172.21.15.133:0/793599074 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7fc744051760 con 0x7fc7480c29e0 2023-12-19T19:02:59.202 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.195+0000 7fc74f8c9640 1 -- 172.21.15.133:0/793599074 --> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc7480c3e70 con 0x7fc72c0664a0 2023-12-19T19:02:59.204 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.199+0000 7fc73dffb640 1 -- 172.21.15.133:0/793599074 <== mgr.4100 v2:172.21.15.138:6832/185741991 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50676 (secure 0 0 0) 0x7fc7480c3e70 con 0x7fc72c0664a0 2023-12-19T19:02:59.205 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:59.206 INFO:teuthology.orchestra.run.smithi133.stderr:dumped all 2023-12-19T19:02:59.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.199+0000 7fc74f8c9640 1 -- 172.21.15.133:0/793599074 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc72c0664a0 msgr2=0x7fc72c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:59.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.199+0000 7fc74f8c9640 1 --2- 172.21.15.133:0/793599074 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc72c0664a0 0x7fc72c068960 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc7480bfc10 tx=0x7fc738008040 comp rx=0 tx=0).stop 2023-12-19T19:02:59.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.199+0000 7fc74f8c9640 1 -- 172.21.15.133:0/793599074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7480c29e0 msgr2=0x7fc74806d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:59.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.199+0000 7fc74f8c9640 1 --2- 172.21.15.133:0/793599074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7480c29e0 0x7fc74806d6d0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fc74400d5f0 tx=0x7fc74400dab0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.207 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.199+0000 7fc74f8c9640 1 -- 172.21.15.133:0/793599074 shutdown_connections 2023-12-19T19:02:59.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.199+0000 7fc74f8c9640 1 --2- 172.21.15.133:0/793599074 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7fc72c0664a0 0x7fc72c068960 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.199+0000 7fc74f8c9640 1 --2- 172.21.15.133:0/793599074 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7fc7480c63c0 0x7fc748148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.199+0000 7fc74f8c9640 1 --2- 172.21.15.133:0/793599074 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7fc7480c4100 0x7fc748148a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.199+0000 7fc74f8c9640 1 --2- 172.21.15.133:0/793599074 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7480c29e0 0x7fc74806d6d0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.199+0000 7fc74f8c9640 1 -- 172.21.15.133:0/793599074 >> 172.21.15.133:0/793599074 conn(0x7fc74806a5b0 msgr2=0x7fc7480c03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:59.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.199+0000 7fc74f8c9640 1 -- 172.21.15.133:0/793599074 shutdown_connections 2023-12-19T19:02:59.208 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.199+0000 7fc74f8c9640 1 -- 172.21.15.133:0/793599074 wait complete. 2023-12-19T19:02:59.226 INFO:teuthology.orchestra.run.smithi133.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2023-12-19T19:02:58.895296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":258316,"kb_used_data":8868,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716404,"statfs":{"total":773094113280,"available":772829597696,"internally_reserved":0,"allocated":9080832,"data_stored":4674285,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002172"},"pg_stats":[{"pgid":"1.0","version":"79'119","reported_seq":237,"reported_epoch":79,"state":"active+clean","last_fresh":"2023-12-19T19:02:40.605318+0000","last_change":"2023-12-19T19:02:40.605370+0000","last_active":"2023-12-19T19:02:40.605318+0000","last_peered":"2023-12-19T19:02:40.605318+0000","last_clean":"2023-12-19T19:02:40.605318+0000","last_became_active":"2023-12-19T18:58:32.217371+0000","last_became_peered":"2023-12-19T18:58:32.217371+0000","last_unstale":"2023-12-19T19:02:40.605318+0000","last_undegraded":"2023-12-19T19:02:40.605318+0000","last_fullsized":"2023-12-19T19:02:40.605318+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"79'119","last_scrub_stamp":"2023-12-19T19:02:40.605192+0000","last_deep_scrub":"79'119","last_deep_scrub_stamp":"2023-12-19T19:02:40.605192+0000","last_clean_scrub_stamp":"2023-12-19T19:02:40.605192+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:09.936998+0000","scrub_duration":0.0093608890000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32720,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339120,"statfs":{"total":96636764160,"available":96603258880,"internally_reserved":0,"allocated":1581056,"data_stored":1027189,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.68200000000000005,"15min":0.68999999999999995},"min":{"1min":0.58099999999999996,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84399999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.71299999999999997,"15min":0.72199999999999998},"min":{"1min":0.56399999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.82599999999999996,"5min":1.117,"15min":1.117},"last":0.60999999999999999}]},{"osd":1,"last update":"Tue Dec 19 19:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66600000000000004,"15min":0.67200000000000004},"min":{"1min":0.47599999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.68000000000000005,"15min":0.68700000000000006},"min":{"1min":0.51700000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.57399999999999995}]},{"osd":2,"last update":"Tue Dec 19 19:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66700000000000004,"15min":0.68100000000000005},"min":{"1min":0.48099999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.79400000000000004,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71699999999999997,"15min":0.71099999999999997},"min":{"1min":0.56699999999999995,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92000000000000004,"5min":1.089,"15min":1.089},"last":0.68999999999999995}]},{"osd":3,"last update":"Tue Dec 19 19:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.70099999999999996,"15min":0.72299999999999998},"min":{"1min":0.49299999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.92100000000000004,"5min":0.98099999999999998,"15min":0.98099999999999998},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72599999999999998,"15min":0.73299999999999998},"min":{"1min":0.53500000000000003,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.85299999999999998,"5min":1.026,"15min":1.026},"last":0.66500000000000004}]},{"osd":4,"last update":"Tue Dec 19 19:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.629,"15min":0.65100000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.85199999999999998,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.437},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65800000000000003,"15min":0.67100000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.89800000000000002,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.55100000000000005}]},{"osd":5,"last update":"Tue Dec 19 19:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67600000000000005,"15min":0.69199999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.96099999999999997,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68700000000000006,"15min":0.70399999999999996},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.92300000000000004,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.53400000000000003}]},{"osd":6,"last update":"Tue Dec 19 19:02:35 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.78800000000000003,"15min":0.81000000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.94999999999999996,"5min":1.069,"15min":1.069},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.75,"15min":0.78600000000000003},"min":{"1min":0.46100000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89100000000000001,"5min":1.044,"15min":1.044},"last":0.70599999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":436821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64200000000000002,"15min":0.63400000000000001},"min":{"1min":0.41499999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.85499999999999998,"5min":1.022,"15min":1.022},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68799999999999994,"15min":0.69599999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.89500000000000002,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.72099999999999997}]},{"osd":1,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.67800000000000005,"15min":0.65900000000000003},"min":{"1min":0.52900000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97199999999999998,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.48799999999999999,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95399999999999996,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.84199999999999997}]},{"osd":2,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.47099999999999997,"5min":0.437,"15min":0.437},"max":{"1min":0.83999999999999997,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.71399999999999997,"15min":0.71499999999999997},"min":{"1min":0.46000000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.88800000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.69899999999999995}]},{"osd":3,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70299999999999996,"15min":0.69299999999999995},"min":{"1min":0.442,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91800000000000004,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.70899999999999996,"15min":0.72299999999999998},"min":{"1min":0.51300000000000001,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.93700000000000006,"5min":1.4199999999999999,"15min":1.4199999999999999},"last":0.80100000000000005}]},{"osd":4,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66000000000000003,"15min":0.67000000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.88500000000000001,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.71999999999999997,"15min":0.748},"min":{"1min":0.48899999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.86599999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.54800000000000004}]},{"osd":5,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.65300000000000002,"15min":0.65100000000000002},"min":{"1min":0.47899999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86599999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72799999999999998,"15min":0.73499999999999999},"min":{"1min":0.51700000000000002,"5min":0.505,"15min":0.505},"max":{"1min":0.91700000000000004,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.625}]},{"osd":7,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.74199999999999999,"15min":0.75800000000000001},"min":{"1min":0.45200000000000001,"5min":0.437,"15min":0.437},"max":{"1min":0.95999999999999996,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.752,"15min":0.76200000000000001},"min":{"1min":0.53600000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.89000000000000001,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.56999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":436821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.77500000000000002,"15min":0.90600000000000003},"min":{"1min":0.47099999999999997,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.80600000000000005,"5min":7.4550000000000001,"15min":7.4550000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":1.0069999999999999,"15min":1.341},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.92000000000000004,"5min":16.951000000000001,"15min":16.951000000000001},"last":0.79000000000000004}]},{"osd":1,"last update":"Tue Dec 19 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":1.026,"15min":1.415},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.83399999999999996,"5min":19.823,"15min":19.823},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68100000000000005,"15min":0.67400000000000004},"min":{"1min":0.442,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.4710000000000001,"5min":1.657,"15min":1.657},"last":0.63}]},{"osd":2,"last update":"Tue Dec 19 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.71199999999999997,"15min":0.745},"min":{"1min":0.5,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90300000000000002,"5min":2.1659999999999999,"15min":2.1659999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.70699999999999996,"15min":0.72999999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.873,"5min":1.585,"15min":1.585},"last":0.76600000000000001}]},{"osd":3,"last update":"Tue Dec 19 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.73899999999999999,"15min":0.77700000000000002},"min":{"1min":0.52000000000000002,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.83299999999999996,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.85299999999999998,"15min":0.97499999999999998},"min":{"1min":0.54500000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96999999999999997,"5min":6.7649999999999997,"15min":6.7649999999999997},"last":0.84799999999999998}]},{"osd":4,"last update":"Tue Dec 19 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.65500000000000003,"15min":0.67000000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.83599999999999997,"5min":1.716,"15min":1.716},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.746,"15min":0.81000000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.85999999999999999,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":0.60899999999999999}]},{"osd":6,"last update":"Tue Dec 19 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.74399999999999999,"15min":0.82299999999999995},"min":{"1min":0.45300000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89200000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":0.5},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.76200000000000001,"15min":0.82399999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.871,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":0.52800000000000002}]},{"osd":7,"last update":"Tue Dec 19 19:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.78100000000000003,"15min":0.82299999999999995},"min":{"1min":0.5,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86799999999999999,"5min":2.371,"15min":2.371},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.79000000000000004,"15min":0.83299999999999996},"min":{"1min":0.57899999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.99199999999999999,"5min":2.5760000000000001,"15min":2.5760000000000001},"last":0.68400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":436821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.747,"15min":0.84299999999999997},"min":{"1min":0.46000000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.90400000000000003,"5min":4.7690000000000001,"15min":4.7690000000000001},"last":0.878},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66800000000000004,"15min":0.68799999999999994},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.89900000000000002,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.77500000000000002}]},{"osd":1,"last update":"Tue Dec 19 19:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68200000000000005,"15min":0.69699999999999995},"min":{"1min":0.497,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.86299999999999999,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.74399999999999999,"15min":0.79100000000000004},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96499999999999997,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":0.83799999999999997}]},{"osd":2,"last update":"Tue Dec 19 19:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.69999999999999996,"15min":0.69599999999999995},"min":{"1min":0.47399999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.73899999999999999,"15min":0.79900000000000004},"min":{"1min":0.44400000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.93799999999999994,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":0.91300000000000003}]},{"osd":3,"last update":"Tue Dec 19 19:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.751,"15min":0.82499999999999996},"min":{"1min":0.48199999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0289999999999999,"5min":3.641,"15min":3.641},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.748,"5min":0.80000000000000004,"15min":0.874},"min":{"1min":0.54000000000000004,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.98399999999999999,"5min":3.194,"15min":3.194},"last":0.75800000000000001}]},{"osd":5,"last update":"Tue Dec 19 19:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.83399999999999996,"15min":1.024},"min":{"1min":0.48899999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97999999999999998,"5min":9.3040000000000003,"15min":9.3040000000000003},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.67800000000000005,"15min":0.72599999999999998},"min":{"1min":0.434,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84699999999999998,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.64500000000000002}]},{"osd":6,"last update":"Tue Dec 19 19:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.754,"15min":0.82099999999999995},"min":{"1min":0.47499999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.002,"5min":3.097,"15min":3.097},"last":0.625},{"interface":"front","average":{"1min":0.752,"5min":0.79300000000000004,"15min":0.86699999999999999},"min":{"1min":0.55300000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.95699999999999996,"5min":3.3319999999999999,"15min":3.3319999999999999},"last":0.79000000000000004}]},{"osd":7,"last update":"Tue Dec 19 19:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.81899999999999995,"15min":0.93899999999999995},"min":{"1min":0.47999999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.92300000000000004,"5min":5.0410000000000004,"15min":5.0410000000000004},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.753,"5min":0.88400000000000001,"15min":1.0289999999999999},"min":{"1min":0.57899999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96499999999999997,"5min":6.3449999999999998,"15min":6.3449999999999998},"last":0.68400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32144,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":987136,"data_stored":436821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:02:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.44,"15min":0.45300000000000001},"min":{"1min":0.27700000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.498,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.46000000000000002,"5min":0.44900000000000001,"15min":0.44800000000000001},"min":{"1min":0.30399999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.60999999999999999,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.45700000000000002}]},{"osd":1,"last update":"Tue Dec 19 19:02:36 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45700000000000002,"15min":0.48099999999999998},"min":{"1min":0.29799999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57399999999999995,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.498,"15min":0.51500000000000001},"min":{"1min":0.35299999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.64300000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.56899999999999995}]},{"osd":2,"last update":"Tue Dec 19 19:02:36 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51200000000000001,"15min":0.51600000000000001},"min":{"1min":0.38900000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.52200000000000002,"15min":0.54400000000000004},"min":{"1min":0.40999999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.63100000000000001,"5min":0.875,"15min":0.875},"last":0.53200000000000003}]},{"osd":4,"last update":"Tue Dec 19 19:02:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.749,"15min":0.77700000000000002},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.875,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.77300000000000002,"15min":0.80400000000000005},"min":{"1min":0.58099999999999996,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.89000000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.875}]},{"osd":5,"last update":"Tue Dec 19 19:02:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.72199999999999998,"15min":0.746},"min":{"1min":0.51200000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.84899999999999998,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.72799999999999998,"15min":0.76200000000000001},"min":{"1min":0.48699999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.877,"5min":1.202,"15min":1.202},"last":0.73699999999999999}]},{"osd":6,"last update":"Tue Dec 19 19:02:36 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.77300000000000002,"15min":0.81399999999999995},"min":{"1min":0.56399999999999995,"5min":0.498,"15min":0.498},"max":{"1min":0.93600000000000005,"5min":1.298,"15min":1.298},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.77900000000000003,"15min":0.79900000000000004},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.88800000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.76300000000000001}]},{"osd":7,"last update":"Tue Dec 19 19:02:36 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.76000000000000001,"15min":0.78500000000000003},"min":{"1min":0.53100000000000003,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.79800000000000004,"5min":1.155,"15min":1.155},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.75800000000000001,"15min":0.77700000000000002},"min":{"1min":0.64300000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.02,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.78400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32144,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339696,"statfs":{"total":96636764160,"available":96603848704,"internally_reserved":0,"allocated":987136,"data_stored":436821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.44500000000000001,"15min":0.48999999999999999},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.51400000000000001,"5min":1.458,"15min":1.458},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.51900000000000002,"15min":0.60499999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.52200000000000002,"5min":3.3599999999999999,"15min":3.3599999999999999},"last":0.65500000000000003}]},{"osd":1,"last update":"Tue Dec 19 19:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.51200000000000001,"15min":0.57599999999999996},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.627,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.441,"5min":0.52900000000000003,"15min":0.59899999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.64900000000000002,"5min":2.444,"15min":2.444},"last":0.59199999999999997}]},{"osd":3,"last update":"Tue Dec 19 19:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.52100000000000002,"15min":0.59499999999999997},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.70199999999999996,"5min":3.0259999999999998,"15min":3.0259999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.55800000000000005,"15min":0.621},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.65500000000000003,"5min":1.9259999999999999,"15min":1.9259999999999999},"last":0.64500000000000002}]},{"osd":4,"last update":"Tue Dec 19 19:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.83299999999999996,"15min":0.93899999999999995},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.97399999999999998,"5min":1.968,"15min":1.968},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.80000000000000004,"15min":0.89400000000000002},"min":{"1min":0.51300000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.98399999999999999,"5min":2.835,"15min":2.835},"last":0.75}]},{"osd":5,"last update":"Tue Dec 19 19:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.80700000000000005,"15min":0.91400000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94399999999999995,"5min":3.5,"15min":3.5},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.81699999999999995,"15min":0.90900000000000003},"min":{"1min":0.54200000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.92900000000000005,"5min":1.996,"15min":1.996},"last":0.871}]},{"osd":6,"last update":"Tue Dec 19 19:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.81299999999999994,"15min":0.91400000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0109999999999999,"5min":2.903,"15min":2.903},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.86299999999999999,"15min":0.99099999999999999},"min":{"1min":0.50900000000000001,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.96199999999999997,"5min":3.7109999999999999,"15min":3.7109999999999999},"last":0.79300000000000004}]},{"osd":7,"last update":"Tue Dec 19 19:02:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.84399999999999997,"15min":0.95099999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.94299999999999995,"5min":2.875,"15min":2.875},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.82499999999999996,"15min":0.94199999999999995},"min":{"1min":0.55600000000000005,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.995,"5min":3.7570000000000001,"15min":3.7570000000000001},"last":0.81599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32148,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339692,"statfs":{"total":96636764160,"available":96603844608,"internally_reserved":0,"allocated":987136,"data_stored":436821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 19:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.47899999999999998,"15min":0.55700000000000005},"min":{"1min":0.26900000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65400000000000003,"5min":4.2000000000000002,"15min":4.2000000000000002},"last":0.435},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.59499999999999997,"15min":0.75},"min":{"1min":0.32300000000000001,"5min":0.255,"15min":0.255},"max":{"1min":0.69799999999999995,"5min":7.7320000000000002,"15min":7.7320000000000002},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Dec 19 19:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.499,"15min":0.57099999999999995},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.59999999999999998,"5min":3.9129999999999998,"15min":3.9129999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.56299999999999994,"15min":0.65800000000000003},"min":{"1min":0.37,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.57899999999999996,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.51100000000000001}]},{"osd":3,"last update":"Tue Dec 19 19:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.64700000000000002,"15min":0.79300000000000004},"min":{"1min":0.36099999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.65000000000000002,"5min":7.8399999999999999,"15min":7.8399999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.67500000000000004,"15min":0.81399999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.78000000000000003,"5min":7.7949999999999999,"15min":7.7949999999999999},"last":0.60699999999999998}]},{"osd":4,"last update":"Tue Dec 19 19:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.77100000000000002,"15min":0.86699999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83899999999999997,"5min":4.2690000000000001,"15min":4.2690000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.79700000000000004,"15min":0.89600000000000002},"min":{"1min":0.5,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.87,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.67100000000000004}]},{"osd":5,"last update":"Tue Dec 19 19:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78700000000000003,"15min":0.878},"min":{"1min":0.53900000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.92000000000000004,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.79400000000000004,"15min":0.88800000000000001},"min":{"1min":0.56899999999999995,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.99299999999999999,"5min":4.2480000000000002,"15min":4.2480000000000002},"last":0.77600000000000002}]},{"osd":6,"last update":"Tue Dec 19 19:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.80600000000000005,"15min":0.88200000000000001},"min":{"1min":0.56899999999999995,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.88,"5min":4.1609999999999996,"15min":4.1609999999999996},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.81299999999999994,"15min":0.93000000000000005},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.89900000000000002,"5min":4.3099999999999996,"15min":4.3099999999999996},"last":0.75800000000000001}]},{"osd":7,"last update":"Tue Dec 19 19:02:39 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.82599999999999996,"15min":0.93100000000000005},"min":{"1min":0.52200000000000002,"5min":0.497,"15min":0.497},"max":{"1min":0.86599999999999999,"5min":4.3310000000000004,"15min":4.3310000000000004},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.81899999999999995,"15min":0.89600000000000002},"min":{"1min":0.54300000000000004,"5min":0.499,"15min":0.499},"max":{"1min":0.97399999999999998,"5min":4.226,"15min":4.226},"last":0.72599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574904,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32716,"kb_used_data":1540,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339124,"statfs":{"total":96636764160,"available":96603262976,"internally_reserved":0,"allocated":1576960,"data_stored":1026170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.42499999999999999,"15min":0.44500000000000001},"min":{"1min":0.27200000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.64000000000000001,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.47399999999999998,"15min":0.498},"min":{"1min":0.30099999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.626,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.44}]},{"osd":2,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.49399999999999999,"15min":0.50900000000000001},"min":{"1min":0.32800000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.57499999999999996,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.501,"15min":0.50900000000000001},"min":{"1min":0.372,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.67100000000000004,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.63400000000000001}]},{"osd":3,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.47499999999999998,"15min":0.48499999999999999},"min":{"1min":0.35399999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.70699999999999996,"5min":0.747,"15min":0.747},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.55300000000000005,"15min":0.58999999999999997},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.79400000000000004,"5min":1.264,"15min":1.264},"last":0.52500000000000002}]},{"osd":4,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.72299999999999998,"15min":0.74099999999999999},"min":{"1min":0.48699999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82899999999999996,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.72799999999999998,"15min":0.76700000000000002},"min":{"1min":0.52200000000000002,"5min":0.495,"15min":0.495},"max":{"1min":0.82699999999999996,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.752}]},{"osd":5,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.71599999999999997,"15min":0.74299999999999999},"min":{"1min":0.53500000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.81799999999999995,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.75900000000000001,"15min":0.80600000000000005},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.84899999999999998,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.77000000000000002}]},{"osd":6,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.76200000000000001,"15min":0.81399999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.83299999999999996,"5min":1.349,"15min":1.349},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73299999999999998,"15min":0.77000000000000002},"min":{"1min":0.56399999999999995,"5min":0.496,"15min":0.496},"max":{"1min":0.86299999999999999,"5min":1.115,"15min":1.115},"last":0.69299999999999995}]},{"osd":7,"last update":"Tue Dec 19 19:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.73899999999999999,"15min":0.78300000000000003},"min":{"1min":0.52100000000000002,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.79200000000000004,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.76900000000000002,"15min":0.80400000000000005},"min":{"1min":0.58699999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":0.81399999999999995,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.66400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T19:02:59.228 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-19T19:02:59.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.359+0000 7f197bb80640 1 Processor -- start 2023-12-19T19:02:59.364 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.359+0000 7f197bb80640 1 -- start start 2023-12-19T19:02:59.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.359+0000 7f197bb80640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f19740bd660 0x7f1974154d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:59.365 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.359+0000 7f197bb80640 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19740ac4f0 con 0x7f1974151dc0 2023-12-19T19:02:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.359+0000 7f197bb80640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1974158780 con 0x7f19740c7ed0 2023-12-19T19:02:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.359+0000 7f197bb80640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1974158a60 con 0x7f19740bd660 2023-12-19T19:02:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.359+0000 7f197991c640 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f1974151dc0 0x7f19740c4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:54020/0 (socket says 172.21.15.133:54020) 2023-12-19T19:02:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.359+0000 7f197991c640 1 -- 172.21.15.133:0/2524722554 learned_addr learned my addr 172.21.15.133:0/2524722554 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:59.366 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.359+0000 7f197a11d640 1 --2- 172.21.15.133:0/2524722554 >> v2:172.21.15.138:3300/0 conn(0x7f19740bd660 0x7f1974154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:59.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.359+0000 7f197891a640 1 -- 172.21.15.133:0/2524722554 <== mon.0 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 450885919 0 0) 0x7f19740ac4f0 con 0x7f1974151dc0 2023-12-19T19:02:59.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.359+0000 7f197891a640 1 -- 172.21.15.133:0/2524722554 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1960003530 con 0x7f1974151dc0 2023-12-19T19:02:59.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.359+0000 7f197a11d640 1 -- 172.21.15.133:0/2524722554 >> v1:172.21.15.138:6789/0 conn(0x7f19740c7ed0 legacy=0x7f1974154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:59.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.359+0000 7f197a11d640 1 -- 172.21.15.133:0/2524722554 >> v1:172.21.15.133:6789/0 conn(0x7f1974151dc0 legacy=0x7f19740c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:59.367 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.359+0000 7f197a11d640 1 -- 172.21.15.133:0/2524722554 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19740ac180 con 0x7f19740bd660 2023-12-19T19:02:59.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.363+0000 7f197a11d640 1 --2- 172.21.15.133:0/2524722554 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19740bd660 0x7f1974154d60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f196c009dc0 tx=0x7f196c01c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cedae9dbd101578 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:59.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.363+0000 7f197891a640 1 -- 172.21.15.133:0/2524722554 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c0a5760 con 0x7f19740bd660 2023-12-19T19:02:59.369 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.363+0000 7f197891a640 1 -- 172.21.15.133:0/2524722554 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f196c0a58c0 con 0x7f19740bd660 2023-12-19T19:02:59.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.363+0000 7f197891a640 1 -- 172.21.15.133:0/2524722554 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196c0a5c50 con 0x7f19740bd660 2023-12-19T19:02:59.370 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.363+0000 7f197bb80640 1 -- 172.21.15.133:0/2524722554 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19740bd660 msgr2=0x7f1974154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:59.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.363+0000 7f197bb80640 1 --2- 172.21.15.133:0/2524722554 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19740bd660 0x7f1974154d60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f196c009dc0 tx=0x7f196c01c810 comp rx=0 tx=0).stop 2023-12-19T19:02:59.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.363+0000 7f197bb80640 1 -- 172.21.15.133:0/2524722554 shutdown_connections 2023-12-19T19:02:59.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.363+0000 7f197bb80640 1 --2- 172.21.15.133:0/2524722554 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19740bd660 0x7f1974154d60 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.363+0000 7f197bb80640 1 -- 172.21.15.133:0/2524722554 >> 172.21.15.133:0/2524722554 conn(0x7f1974071eb0 msgr2=0x7f19740722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:59.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.363+0000 7f197bb80640 1 -- 172.21.15.133:0/2524722554 shutdown_connections 2023-12-19T19:02:59.371 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.363+0000 7f197bb80640 1 -- 172.21.15.133:0/2524722554 wait complete. 2023-12-19T19:02:59.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f197bb80640 1 Processor -- start 2023-12-19T19:02:59.372 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f197bb80640 1 -- start start 2023-12-19T19:02:59.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f197bb80640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19740bd660 0x7f197415f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:59.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f197bb80640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19740c7ed0 0x7f197414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:59.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f197bb80640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1974151dc0 0x7f197414b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:59.374 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f197bb80640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f197414f130 con 0x7f19740c7ed0 2023-12-19T19:02:59.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f197bb80640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1974154760 con 0x7f19740bd660 2023-12-19T19:02:59.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f197bb80640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19740c3f90 con 0x7f1974151dc0 2023-12-19T19:02:59.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f197911b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19740c7ed0 0x7f197414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:59.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f197911b640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19740c7ed0 0x7f197414b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34774/0 (socket says 172.21.15.133:34774) 2023-12-19T19:02:59.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f197911b640 1 -- 172.21.15.133:0/3390876511 learned_addr learned my addr 172.21.15.133:0/3390876511 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:59.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f197a11d640 1 --2- 172.21.15.133:0/3390876511 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1974151dc0 0x7f197414b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:59.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f197991c640 1 --2- 172.21.15.133:0/3390876511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19740bd660 0x7f197415f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:59.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f197911b640 1 -- 172.21.15.133:0/3390876511 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1974151dc0 msgr2=0x7f197414b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:59.375 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f197911b640 1 --2- 172.21.15.133:0/3390876511 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1974151dc0 0x7f197414b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f197911b640 1 -- 172.21.15.133:0/3390876511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19740bd660 msgr2=0x7f197415f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:59.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f197911b640 1 --2- 172.21.15.133:0/3390876511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19740bd660 0x7f197415f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f197911b640 1 -- 172.21.15.133:0/3390876511 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c009a70 con 0x7f19740c7ed0 2023-12-19T19:02:59.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f197991c640 1 --2- 172.21.15.133:0/3390876511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19740bd660 0x7f197415f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T19:02:59.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f197911b640 1 --2- 172.21.15.133:0/3390876511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19740c7ed0 0x7f197414b2f0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f196400c500 tx=0x7f196400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:59.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f196a7fc640 1 -- 172.21.15.133:0/3390876511 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964005220 con 0x7f19740c7ed0 2023-12-19T19:02:59.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f196a7fc640 1 -- 172.21.15.133:0/3390876511 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1964005380 con 0x7f19740c7ed0 2023-12-19T19:02:59.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f197bb80640 1 -- 172.21.15.133:0/3390876511 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19740c39d0 con 0x7f19740c7ed0 2023-12-19T19:02:59.376 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f196a7fc640 1 -- 172.21.15.133:0/3390876511 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964007270 con 0x7f19740c7ed0 2023-12-19T19:02:59.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f197bb80640 1 -- 172.21.15.133:0/3390876511 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197414eae0 con 0x7f19740c7ed0 2023-12-19T19:02:59.377 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.367+0000 7f197bb80640 1 -- 172.21.15.133:0/3390876511 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1974068400 con 0x7f19740c7ed0 2023-12-19T19:02:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.371+0000 7f196a7fc640 1 -- 172.21.15.133:0/3390876511 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f19640073d0 con 0x7f19740c7ed0 2023-12-19T19:02:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.371+0000 7f196a7fc640 1 --2- 172.21.15.133:0/3390876511 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f19580664a0 0x7f1958068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.371+0000 7f196a7fc640 1 -- 172.21.15.133:0/3390876511 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f1964082f40 con 0x7f19740c7ed0 2023-12-19T19:02:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.371+0000 7f197991c640 1 --2- 172.21.15.133:0/3390876511 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f19580664a0 0x7f1958068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:59.378 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.371+0000 7f197991c640 1 --2- 172.21.15.133:0/3390876511 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f19580664a0 0x7f1958068960 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f19700011f0 tx=0x7f1970009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:59.381 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.375+0000 7f196a7fc640 1 -- 172.21.15.133:0/3390876511 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f1964050680 con 0x7f19740c7ed0 2023-12-19T19:02:59.530 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.523+0000 7f197bb80640 1 -- 172.21.15.133:0/3390876511 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f197406c9a0 con 0x7f19740c7ed0 2023-12-19T19:02:59.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.527+0000 7f196a7fc640 1 -- 172.21.15.133:0/3390876511 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7f1964053ca0 con 0x7f19740c7ed0 2023-12-19T19:02:59.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.531+0000 7f196a7fc640 1 -- 172.21.15.133:0/3390876511 <== mon.0 v2:172.21.15.133:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f19640011d0 con 0x7f19740c7ed0 2023-12-19T19:02:59.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.531+0000 7f197bb80640 1 -- 172.21.15.133:0/3390876511 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f19580664a0 msgr2=0x7f1958068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:59.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.531+0000 7f197bb80640 1 --2- 172.21.15.133:0/3390876511 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f19580664a0 0x7f1958068960 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f19700011f0 tx=0x7f1970009040 comp rx=0 tx=0).stop 2023-12-19T19:02:59.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.531+0000 7f197bb80640 1 -- 172.21.15.133:0/3390876511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19740c7ed0 msgr2=0x7f197414b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:59.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.531+0000 7f197bb80640 1 --2- 172.21.15.133:0/3390876511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19740c7ed0 0x7f197414b2f0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f196400c500 tx=0x7f196400c9c0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.531+0000 7f197bb80640 1 -- 172.21.15.133:0/3390876511 shutdown_connections 2023-12-19T19:02:59.538 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.531+0000 7f197bb80640 1 --2- 172.21.15.133:0/3390876511 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f19580664a0 0x7f1958068960 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.531+0000 7f197bb80640 1 --2- 172.21.15.133:0/3390876511 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f1974151dc0 0x7f197414b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.531+0000 7f197bb80640 1 --2- 172.21.15.133:0/3390876511 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f19740c7ed0 0x7f197414b2f0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.531+0000 7f197bb80640 1 --2- 172.21.15.133:0/3390876511 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f19740bd660 0x7f197415f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.531+0000 7f197bb80640 1 -- 172.21.15.133:0/3390876511 >> 172.21.15.133:0/3390876511 conn(0x7f1974071eb0 msgr2=0x7f19740ab350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:59.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.531+0000 7f197bb80640 1 -- 172.21.15.133:0/3390876511 shutdown_connections 2023-12-19T19:02:59.539 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.531+0000 7f197bb80640 1 -- 172.21.15.133:0/3390876511 wait complete. 2023-12-19T19:02:59.556 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T19:02:59.556 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T19:02:59.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.687+0000 7f5bd0b80640 1 Processor -- start 2023-12-19T19:02:59.694 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.687+0000 7f5bd0b80640 1 -- start start 2023-12-19T19:02:59.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.687+0000 7f5bd0b80640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5bcc0a5370 0x7f5bcc0c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:59.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.687+0000 7f5bd0b80640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5bcc072090 0x7f5bcc1516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:59.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.687+0000 7f5bd0b80640 1 -- --> v1:172.21.15.138:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bcc0c2760 con 0x7f5bcc0c4110 2023-12-19T19:02:59.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.687+0000 7f5bd0b80640 1 -- --> v2:172.21.15.138:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bcc0c3070 con 0x7f5bcc072090 2023-12-19T19:02:59.695 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.687+0000 7f5bd0b80640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc151bf0 con 0x7f5bcc0a5370 2023-12-19T19:02:59.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.691+0000 7f5bcad9d640 1 --2- >> v2:172.21.15.138:3300/0 conn(0x7f5bcc072090 0x7f5bcc1516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:59.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.691+0000 7f5bca59c640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5bcc0a5370 0x7f5bcc0c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:59.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.691+0000 7f5bc1d9b640 1 --1- >> v1:172.21.15.138:6789/0 conn(0x7f5bcc0c4110 0x7f5bcc150fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.138:6789/0 says I am v1:172.21.15.133:56696/0 (socket says 172.21.15.133:56696) 2023-12-19T19:02:59.696 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.691+0000 7f5bc1d9b640 1 -- 172.21.15.133:0/648878093 learned_addr learned my addr 172.21.15.133:0/648878093 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-12-19T19:02:59.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.691+0000 7f5bcad9d640 1 -- 172.21.15.133:0/648878093 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5bcc0a5370 msgr2=0x7f5bcc0c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T19:02:59.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.691+0000 7f5bcad9d640 1 --2- 172.21.15.133:0/648878093 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5bcc0a5370 0x7f5bcc0c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.691+0000 7f5bcad9d640 1 -- 172.21.15.133:0/648878093 >> v1:172.21.15.138:6789/0 conn(0x7f5bcc0c4110 legacy=0x7f5bcc150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:59.697 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.691+0000 7f5bcad9d640 1 -- 172.21.15.133:0/648878093 --> v2:172.21.15.138:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc0a5750 con 0x7f5bcc072090 2023-12-19T19:02:59.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.691+0000 7f5bcad9d640 1 --2- 172.21.15.133:0/648878093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bcc072090 0x7f5bcc1516b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4009dc0 tx=0x7f5bc401c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77c9766c37d783fb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:59.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bc9d9b640 1 -- 172.21.15.133:0/648878093 <== mon.1 v2:172.21.15.138:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc40a5820 con 0x7f5bcc072090 2023-12-19T19:02:59.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bc9d9b640 1 -- 172.21.15.133:0/648878093 <== mon.1 v2:172.21.15.138:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5bc40a5980 con 0x7f5bcc072090 2023-12-19T19:02:59.699 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bc9d9b640 1 -- 172.21.15.133:0/648878093 <== mon.1 v2:172.21.15.138:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc40a5d30 con 0x7f5bcc072090 2023-12-19T19:02:59.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bd0b80640 1 -- 172.21.15.133:0/648878093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bcc072090 msgr2=0x7f5bcc1516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:59.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bd0b80640 1 --2- 172.21.15.133:0/648878093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bcc072090 0x7f5bcc1516b0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5bc4009dc0 tx=0x7f5bc401c7e0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bd0b80640 1 -- 172.21.15.133:0/648878093 shutdown_connections 2023-12-19T19:02:59.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bd0b80640 1 --2- 172.21.15.133:0/648878093 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bcc072090 0x7f5bcc1516b0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.700 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bd0b80640 1 --2- 172.21.15.133:0/648878093 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5bcc0a5370 0x7f5bcc0c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bd0b80640 1 -- 172.21.15.133:0/648878093 >> 172.21.15.133:0/648878093 conn(0x7f5bcc06a5b0 msgr2=0x7f5bcc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:59.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bd0b80640 1 -- 172.21.15.133:0/648878093 shutdown_connections 2023-12-19T19:02:59.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bd0b80640 1 -- 172.21.15.133:0/648878093 wait complete. 2023-12-19T19:02:59.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bd0b80640 1 Processor -- start 2023-12-19T19:02:59.701 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bd0b80640 1 -- start start 2023-12-19T19:02:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bd0b80640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bcc072090 0x7f5bcc149580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bd0b80640 1 --2- >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bcc0a5370 0x7f5bcc14fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bd0b80640 1 --2- >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5bcc0c4110 0x7f5bcc06fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bd0b80640 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc143fd0 con 0x7f5bcc072090 2023-12-19T19:02:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bd0b80640 1 -- --> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc144270 con 0x7f5bcc0a5370 2023-12-19T19:02:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bd0b80640 1 -- --> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc144550 con 0x7f5bcc0c4110 2023-12-19T19:02:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bca59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bcc072090 0x7f5bcc149580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:59.704 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bca59c640 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bcc072090 0x7f5bcc149580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:34790/0 (socket says 172.21.15.133:34790) 2023-12-19T19:02:59.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bca59c640 1 -- 172.21.15.133:0/4279788469 learned_addr learned my addr 172.21.15.133:0/4279788469 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-12-19T19:02:59.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bc1d9b640 1 --2- 172.21.15.133:0/4279788469 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bcc0a5370 0x7f5bcc14fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:59.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.695+0000 7f5bcad9d640 1 --2- 172.21.15.133:0/4279788469 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5bcc0c4110 0x7f5bcc06fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:59.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.699+0000 7f5bca59c640 1 -- 172.21.15.133:0/4279788469 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5bcc0c4110 msgr2=0x7f5bcc06fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:59.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.699+0000 7f5bca59c640 1 --2- 172.21.15.133:0/4279788469 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5bcc0c4110 0x7f5bcc06fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.699+0000 7f5bca59c640 1 -- 172.21.15.133:0/4279788469 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bcc0a5370 msgr2=0x7f5bcc14fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:59.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.699+0000 7f5bca59c640 1 --2- 172.21.15.133:0/4279788469 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bcc0a5370 0x7f5bcc14fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.705 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.699+0000 7f5bca59c640 1 -- 172.21.15.133:0/4279788469 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc4009a70 con 0x7f5bcc072090 2023-12-19T19:02:59.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.699+0000 7f5bca59c640 1 --2- 172.21.15.133:0/4279788469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bcc072090 0x7f5bcc149580 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00e930 tx=0x7f5bbc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:59.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.699+0000 7f5bc37fe640 1 -- 172.21.15.133:0/4279788469 <== mon.0 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc009690 con 0x7f5bcc072090 2023-12-19T19:02:59.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.699+0000 7f5bc37fe640 1 -- 172.21.15.133:0/4279788469 <== mon.0 v2:172.21.15.133:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5bbc00ca00 con 0x7f5bcc072090 2023-12-19T19:02:59.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.699+0000 7f5bd0b80640 1 -- 172.21.15.133:0/4279788469 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bcc144830 con 0x7f5bcc072090 2023-12-19T19:02:59.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.699+0000 7f5bc37fe640 1 -- 172.21.15.133:0/4279788469 <== mon.0 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc00cd90 con 0x7f5bcc072090 2023-12-19T19:02:59.706 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.699+0000 7f5bd0b80640 1 -- 172.21.15.133:0/4279788469 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bcc14f030 con 0x7f5bcc072090 2023-12-19T19:02:59.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.699+0000 7f5bd0b80640 1 -- 172.21.15.133:0/4279788469 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bcc068400 con 0x7f5bcc072090 2023-12-19T19:02:59.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.699+0000 7f5bc37fe640 1 -- 172.21.15.133:0/4279788469 <== mon.0 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 85854+0+0 (secure 0 0 0) 0x7f5bbc013470 con 0x7f5bcc072090 2023-12-19T19:02:59.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.699+0000 7f5bc37fe640 1 --2- 172.21.15.133:0/4279788469 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5bac066470 0x7f5bac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T19:02:59.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.699+0000 7f5bc37fe640 1 -- 172.21.15.133:0/4279788469 <== mon.0 v2:172.21.15.133:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f5bbc083ea0 con 0x7f5bcc072090 2023-12-19T19:02:59.707 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.703+0000 7f5bc1d9b640 1 --2- 172.21.15.133:0/4279788469 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5bac066470 0x7f5bac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T19:02:59.708 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.703+0000 7f5bc1d9b640 1 --2- 172.21.15.133:0/4279788469 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5bac066470 0x7f5bac068930 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc14eae0 tx=0x7f5bb4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T19:02:59.710 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.703+0000 7f5bc37fe640 1 -- 172.21.15.133:0/4279788469 <== mon.0 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172666 (secure 0 0 0) 0x7f5bbc051690 con 0x7f5bcc072090 2023-12-19T19:02:59.888 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.883+0000 7f5bd0b80640 1 -- 172.21.15.133:0/4279788469 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5bcc1449c0 con 0x7f5bcc072090 2023-12-19T19:02:59.889 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.883+0000 7f5bc37fe640 1 -- 172.21.15.133:0/4279788469 <== mon.0 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+3711 (secure 0 0 0) 0x7f5bbc021e90 con 0x7f5bcc072090 2023-12-19T19:02:59.889 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-12-19T19:02:59.889 INFO:teuthology.orchestra.run.smithi133.stdout:{"epoch":57,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5756,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6835/2119189888","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6833","nonce":2119189888},{"type":"v1","addr":"172.21.15.133:6835","nonce":2119189888}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5759,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6835/4005236173","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6834","nonce":4005236173},{"type":"v1","addr":"172.21.15.138:6835","nonce":4005236173}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6206,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.138:6837/1354486964","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6836","nonce":1354486964},{"type":"v1","addr":"172.21.15.138:6837","nonce":1354486964}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57},{"gid":7152,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6834/3920117238","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6832","nonce":3920117238},{"type":"v1","addr":"172.21.15.133:6834","nonce":3920117238}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[]} 2023-12-19T19:02:59.889 INFO:teuthology.orchestra.run.smithi133.stderr:dumped fsmap epoch 57 2023-12-19T19:02:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.883+0000 7f5bd0b80640 1 -- 172.21.15.133:0/4279788469 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5bac066470 msgr2=0x7f5bac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.883+0000 7f5bd0b80640 1 --2- 172.21.15.133:0/4279788469 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5bac066470 0x7f5bac068930 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5bcc14eae0 tx=0x7f5bb4009040 comp rx=0 tx=0).stop 2023-12-19T19:02:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.883+0000 7f5bd0b80640 1 -- 172.21.15.133:0/4279788469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bcc072090 msgr2=0x7f5bcc149580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T19:02:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.883+0000 7f5bd0b80640 1 --2- 172.21.15.133:0/4279788469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bcc072090 0x7f5bcc149580 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00e930 tx=0x7f5bbc00edf0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.883+0000 7f5bd0b80640 1 -- 172.21.15.133:0/4279788469 shutdown_connections 2023-12-19T19:02:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.883+0000 7f5bd0b80640 1 --2- 172.21.15.133:0/4279788469 >> [v2:172.21.15.138:6832/185741991,v1:172.21.15.138:6833/185741991] conn(0x7f5bac066470 0x7f5bac068930 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.883+0000 7f5bd0b80640 1 --2- 172.21.15.133:0/4279788469 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f5bcc0c4110 0x7f5bcc06fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.891 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.883+0000 7f5bd0b80640 1 --2- 172.21.15.133:0/4279788469 >> [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] conn(0x7f5bcc0a5370 0x7f5bcc14fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.883+0000 7f5bd0b80640 1 --2- 172.21.15.133:0/4279788469 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5bcc072090 0x7f5bcc149580 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T19:02:59.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.883+0000 7f5bd0b80640 1 -- 172.21.15.133:0/4279788469 >> 172.21.15.133:0/4279788469 conn(0x7f5bcc06a5b0 msgr2=0x7f5bcc0c45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T19:02:59.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.883+0000 7f5bd0b80640 1 -- 172.21.15.133:0/4279788469 shutdown_connections 2023-12-19T19:02:59.892 INFO:teuthology.orchestra.run.smithi133.stderr:2023-12-19T19:02:59.883+0000 7f5bd0b80640 1 -- 172.21.15.133:0/4279788469 wait complete. 2023-12-19T19:02:59.910 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-19T19:02:59.910 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-19T19:02:59.910 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T19:02:59.910 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:02:59.922 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T19:02:59.923 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T19:02:59.923 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:02:59.980 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T19:02:59.980 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T19:02:59.980 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:02:59.996 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T19:02:59.996 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T19:02:59.996 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:03:00.057 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T19:03:00.057 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-19T19:03:00.057 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-19T19:03:00.057 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:03:00.135 INFO:tasks.ceph.osd.0:Stopped 2023-12-19T19:03:00.135 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-19T19:03:00.135 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:03:00.206 INFO:tasks.ceph.osd.1:Stopped 2023-12-19T19:03:00.206 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-19T19:03:00.206 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:03:00.288 INFO:tasks.ceph.osd.2:Stopped 2023-12-19T19:03:00.289 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-19T19:03:00.289 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:03:00.374 INFO:tasks.ceph.osd.3:Stopped 2023-12-19T19:03:00.374 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-19T19:03:00.374 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:03:00.459 INFO:tasks.ceph.osd.4:Stopped 2023-12-19T19:03:00.460 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-19T19:03:00.460 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:03:00.560 INFO:tasks.ceph.osd.5:Stopped 2023-12-19T19:03:00.560 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-19T19:03:00.560 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:03:00.629 INFO:tasks.ceph.osd.6:Stopped 2023-12-19T19:03:00.630 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-19T19:03:00.630 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:03:03.428 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-12-19T19:03:06.731 INFO:tasks.ceph.osd.7:Stopped 2023-12-19T19:03:06.731 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-19T19:03:06.732 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-19T19:03:06.732 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:03:06.784 INFO:tasks.ceph.mgr.y:Stopped 2023-12-19T19:03:06.784 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-19T19:03:06.784 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:03:06.841 INFO:tasks.ceph.mgr.x:Stopped 2023-12-19T19:03:06.841 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-19T19:03:06.841 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-19T19:03:06.841 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:03:06.861 INFO:tasks.ceph.mon.a:Stopped 2023-12-19T19:03:06.862 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-19T19:03:06.862 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:03:06.879 INFO:tasks.ceph.mon.b:Stopped 2023-12-19T19:03:06.879 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-19T19:03:06.879 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T19:03:06.939 INFO:tasks.ceph.mon.c:Stopped 2023-12-19T19:03:06.939 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-19T19:03:06.940 DEBUG:teuthology.orchestra.run.smithi133:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-19T19:03:06.972 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-19T19:03:06.972 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-19T19:03:07.226 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-19T19:03:07.226 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-19T19:03:07.440 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-19T19:03:07.440 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-19T19:03:07.621 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi133.front.sepia.ceph.com 2023-12-19T19:03:07.621 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-19T19:03:07.804 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi138.front.sepia.ceph.com 2023-12-19T19:03:07.804 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-19T19:03:08.019 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi138.front.sepia.ceph.com 2023-12-19T19:03:08.020 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-19T19:03:08.190 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi138.front.sepia.ceph.com 2023-12-19T19:03:08.191 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-19T19:03:08.318 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi138.front.sepia.ceph.com 2023-12-19T19:03:08.318 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-19T19:03:08.430 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-12-19T19:03:08.464 INFO:tasks.ceph:Archiving mon data... 2023-12-19T19:03:08.466 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497300/data/mon.a.tgz 2023-12-19T19:03:08.466 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2023-12-19T19:03:08.476 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.K1rDVPKzuZ 2023-12-19T19:03:08.476 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.K1rDVPKzuZ 2023-12-19T19:03:08.632 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.K1rDVPKzuZ 2023-12-19T19:03:08.707 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.K1rDVPKzuZ is 447KB 2023-12-19T19:03:08.778 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.K1rDVPKzuZ 2023-12-19T19:03:08.786 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497300/data/mon.b.tgz 2023-12-19T19:03:08.787 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2023-12-19T19:03:08.795 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.43mzLF056c 2023-12-19T19:03:08.796 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.43mzLF056c 2023-12-19T19:03:08.978 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.43mzLF056c 2023-12-19T19:03:09.054 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.43mzLF056c is 581KB 2023-12-19T19:03:09.124 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.43mzLF056c 2023-12-19T19:03:09.133 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497300/data/mon.c.tgz 2023-12-19T19:03:09.133 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2023-12-19T19:03:09.182 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.WHdJvsRmVO 2023-12-19T19:03:09.182 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.WHdJvsRmVO 2023-12-19T19:03:09.361 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.WHdJvsRmVO 2023-12-19T19:03:09.440 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.WHdJvsRmVO is 581KB 2023-12-19T19:03:09.518 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.WHdJvsRmVO 2023-12-19T19:03:09.527 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-19T19:03:09.527 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-19T19:03:09.531 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-19T19:03:09.604 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-19T19:03:09.651 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-19T19:03:09.652 INFO:tasks.ceph:Archiving crash dumps... 2023-12-19T19:03:09.654 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497300/remote/smithi133/crash 2023-12-19T19:03:09.655 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-19T19:03:09.677 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497300/remote/smithi138/crash 2023-12-19T19:03:09.677 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-19T19:03:09.714 INFO:tasks.ceph:Shutting down logrotate 2023-12-19T19:03:09.714 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T19:03:09.726 DEBUG:teuthology.orchestra.run.smithi138:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T19:03:09.806 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-19T19:03:09.828 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-19T19:03:09.870 INFO:tasks.ceph:Compressing logs... 2023-12-19T19:03:09.870 DEBUG:teuthology.orchestra.run.smithi133:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-19T19:03:09.875 DEBUG:teuthology.orchestra.run.smithi138:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-19T19:03:09.906 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44282.log 2023-12-19T19:03:09.907 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45254.log 2023-12-19T19:03:09.908 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49495.log 2023-12-19T19:03:09.908 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44282.log.gz 2023-12-19T19:03:09.909 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52508.log 2023-12-19T19:03:09.909 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45254.log.gz 2023-12-19T19:03:09.910 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55724.log 2023-12-19T19:03:09.911 INFO:teuthology.orchestra.run.smithi133.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.49495.log.gz 2023-12-19T19:03:09.911 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56439.log 2023-12-19T19:03:09.911 INFO:teuthology.orchestra.run.smithi133.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52508.log.gz 2023-12-19T19:03:09.912 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45686.log 2023-12-19T19:03:09.913 INFO:teuthology.orchestra.run.smithi133.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55724.log.gz 2023-12-19T19:03:09.913 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49058.log 2023-12-19T19:03:09.913 INFO:teuthology.orchestra.run.smithi133.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56439.log.gz 2023-12-19T19:03:09.916 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48902.log 2023-12-19T19:03:09.916 INFO:teuthology.orchestra.run.smithi133.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45686.log.gz 2023-12-19T19:03:09.916 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49982.log 2023-12-19T19:03:09.916 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49058.log.gz 2023-12-19T19:03:09.917 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48902.log: gzip 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48902.log.gz -5 2023-12-19T19:03:09.917 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53277.log 2023-12-19T19:03:09.921 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47262.log 2023-12-19T19:03:09.921 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49982.log.gz 2023-12-19T19:03:09.922 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51420.log 2023-12-19T19:03:09.922 INFO:teuthology.orchestra.run.smithi133.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53277.log.gz 2023-12-19T19:03:09.922 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46247.log 2023-12-19T19:03:09.922 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47262.log.gz 2023-12-19T19:03:09.922 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53863.log 2023-12-19T19:03:09.923 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51420.log.gz 2023-12-19T19:03:09.923 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38358.log 2023-12-19T19:03:09.923 INFO:teuthology.orchestra.run.smithi133.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46247.log.gz 2023-12-19T19:03:09.926 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55542.log 2023-12-19T19:03:09.927 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53863.log.gz 2023-12-19T19:03:09.927 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.38358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55367.log 2023-12-19T19:03:09.927 INFO:teuthology.orchestra.run.smithi133.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38358.log.gz 2023-12-19T19:03:09.927 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47713.log 2023-12-19T19:03:09.928 INFO:teuthology.orchestra.run.smithi133.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55542.log.gz 2023-12-19T19:03:09.928 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55367.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-12-19T19:03:09.928 INFO:teuthology.orchestra.run.smithi133.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55367.log.gz 2023-12-19T19:03:09.929 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53941.log 2023-12-19T19:03:09.929 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47713.log.gz 2023-12-19T19:03:09.929 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53837.log 2023-12-19T19:03:09.933 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48513.log 2023-12-19T19:03:09.933 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53941.log.gz 2023-12-19T19:03:09.933 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46050.log 2023-12-19T19:03:09.934 INFO:teuthology.orchestra.run.smithi133.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53837.log.gz 2023-12-19T19:03:09.934 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50090.log 2023-12-19T19:03:09.934 INFO:teuthology.orchestra.run.smithi133.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48513.log.gz 2023-12-19T19:03:09.934 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46050.log: 93.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-12-19T19:03:09.934 INFO:teuthology.orchestra.run.smithi133.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46050.log.gz 2023-12-19T19:03:09.935 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55049.log 2023-12-19T19:03:09.935 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55750.log 2023-12-19T19:03:09.935 INFO:teuthology.orchestra.run.smithi133.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50090.log.gz 2023-12-19T19:03:09.935 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50589.log 2023-12-19T19:03:09.936 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55049.log.gz 2023-12-19T19:03:09.938 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52560.log 2023-12-19T19:03:09.939 INFO:teuthology.orchestra.run.smithi133.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55750.log.gz 2023-12-19T19:03:09.939 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.50589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50589.log.gz 2023-12-19T19:03:09.939 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44240.log 2023-12-19T19:03:09.939 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48353.log 2023-12-19T19:03:09.939 INFO:teuthology.orchestra.run.smithi133.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52560.log.gz 2023-12-19T19:03:09.939 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54071.log 2023-12-19T19:03:09.939 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44240.log.gz 2023-12-19T19:03:09.939 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47288.log 2023-12-19T19:03:09.939 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48353.log.gz 2023-12-19T19:03:09.940 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54175.log 2023-12-19T19:03:09.940 INFO:teuthology.orchestra.run.smithi133.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54071.log.gz 2023-12-19T19:03:09.940 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47288.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47288.log.gz 2023-12-19T19:03:09.940 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54201.log 2023-12-19T19:03:09.941 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45764.log 2023-12-19T19:03:09.941 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54175.log.gz 2023-12-19T19:03:09.942 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50361.log 2023-12-19T19:03:09.942 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54201.log.gz 2023-12-19T19:03:09.943 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54390.log 2023-12-19T19:03:09.943 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45764.log.gz 2023-12-19T19:03:09.944 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50361.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.50361.log.gz 2023-12-19T19:03:09.944 INFO:teuthology.orchestra.run.smithi133.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43978.log 2023-12-19T19:03:09.945 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55393.log 2023-12-19T19:03:09.945 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54390.log.gz 2023-12-19T19:03:09.946 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.43978.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43978.log.gz 2023-12-19T19:03:09.946 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47549.log 2023-12-19T19:03:09.947 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44730.log 2023-12-19T19:03:09.947 INFO:teuthology.orchestra.run.smithi133.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55393.log.gz 2023-12-19T19:03:09.948 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53547.log 2023-12-19T19:03:09.949 INFO:teuthology.orchestra.run.smithi133.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.47549.log.gz 2023-12-19T19:03:09.950 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44730.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-19T19:03:09.950 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44730.log.gz 2023-12-19T19:03:09.951 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55289.log 2023-12-19T19:03:09.951 INFO:teuthology.orchestra.run.smithi133.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53547.log.gz 2023-12-19T19:03:09.951 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49930.log 2023-12-19T19:03:09.952 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38461.log 2023-12-19T19:03:09.952 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43932.log 2023-12-19T19:03:09.952 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38461.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-12-19T19:03:09.952 INFO:teuthology.orchestra.run.smithi138.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38461.log.gz 2023-12-19T19:03:09.952 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.1.43932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43932.log.gz 2023-12-19T19:03:09.953 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-12-19T19:03:09.954 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38365.log 2023-12-19T19:03:09.954 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43886.log 2023-12-19T19:03:09.955 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51338.log 2023-12-19T19:03:09.955 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55289.log.gz 2023-12-19T19:03:09.956 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45306.log 2023-12-19T19:03:09.956 INFO:teuthology.orchestra.run.smithi133.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.49930.log.gz 2023-12-19T19:03:09.956 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47767.log 2023-12-19T19:03:09.956 INFO:teuthology.orchestra.run.smithi133.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51338.log.gz 2023-12-19T19:03:09.956 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46024.log 2023-12-19T19:03:09.956 INFO:teuthology.orchestra.run.smithi133.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.45306.log.gz 2023-12-19T19:03:09.959 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51286.log 2023-12-19T19:03:09.959 INFO:teuthology.orchestra.run.smithi133.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47767.log.gz 2023-12-19T19:03:09.959 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50205.log 2023-12-19T19:03:09.959 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46024.log.gz 2023-12-19T19:03:09.959 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51286.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51286.log.gz 2023-12-19T19:03:09.959 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54782.log 2023-12-19T19:03:09.960 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38365.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.38365.log.gz 2023-12-19T19:03:09.960 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38485.log 2023-12-19T19:03:09.961 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.1.43886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43886.log.gz 2023-12-19T19:03:09.961 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44037.log 2023-12-19T19:03:09.961 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38485.log: gzip -5 --verbose -- 88.1% /var/log/ceph/ceph-client.admin.38317.log -- replaced with /var/log/ceph/ceph-client.admin.38485.log.gz 2023-12-19T19:03:09.961 INFO:teuthology.orchestra.run.smithi138.stderr: 2023-12-19T19:03:09.961 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.1.44037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44037.log.gz 2023-12-19T19:03:09.961 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-12-19T19:03:09.961 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38317.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.38317.log.gz 2023-12-19T19:03:09.961 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38413.log 2023-12-19T19:03:09.962 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38341.log 2023-12-19T19:03:09.963 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38413.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38413.log.gz 2023-12-19T19:03:09.963 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-19T19:03:09.963 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38341.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38341.log.gz 2023-12-19T19:03:09.963 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.44327.log 2023-12-19T19:03:09.965 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52638.log 2023-12-19T19:03:09.966 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50205.log.gz 2023-12-19T19:03:09.966 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44136.log 2023-12-19T19:03:09.966 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54782.log.gz 2023-12-19T19:03:09.966 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50657.log 2023-12-19T19:03:09.966 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52638.log.gz 2023-12-19T19:03:09.966 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44136.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44136.log.gz 2023-12-19T19:03:09.966 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51835.log 2023-12-19T19:03:09.966 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44501.log 2023-12-19T19:03:09.967 INFO:teuthology.orchestra.run.smithi133.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50657.log.gz 2023-12-19T19:03:09.967 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49904.log 2023-12-19T19:03:09.967 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51835.log.gz 2023-12-19T19:03:09.967 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53409.log 2023-12-19T19:03:09.967 INFO:teuthology.orchestra.run.smithi133.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44501.log.gz 2023-12-19T19:03:09.970 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-19T19:03:09.970 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.testuser.44327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.44327.log.gz 2023-12-19T19:03:09.970 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-12-19T19:03:09.970 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44270.log 2023-12-19T19:03:09.970 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38437.log 2023-12-19T19:03:09.970 INFO:teuthology.orchestra.run.smithi138.stderr: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-19T19:03:09.971 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.1.44270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44270.log.gz 2023-12-19T19:03:09.971 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43775.log 2023-12-19T19:03:09.972 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49904.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49904.log.gz 2023-12-19T19:03:09.972 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44968.log 2023-12-19T19:03:09.972 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53251.log 88.9% 2023-12-19T19:03:09.972 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53409.log.gz 2023-12-19T19:03:09.972 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52716.log 2023-12-19T19:03:09.973 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44968.log.gz 2023-12-19T19:03:09.973 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45280.log 2023-12-19T19:03:09.973 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53251.log.gz 2023-12-19T19:03:09.973 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56101.log 2023-12-19T19:03:09.973 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52716.log.gz 2023-12-19T19:03:09.973 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55996.log 2023-12-19T19:03:09.973 INFO:teuthology.orchestra.run.smithi133.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45280.log.gz 2023-12-19T19:03:09.973 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45920.log 2023-12-19T19:03:09.973 INFO:teuthology.orchestra.run.smithi133.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56101.log.gz 2023-12-19T19:03:09.975 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38437.log: gzip -5 --verbose 88.2% -- -- replaced with /var/log/ceph/ceph-client.admin.38437.log.gz /var/log/ceph/ceph-client.admin.38389.log 2023-12-19T19:03:09.975 INFO:teuthology.orchestra.run.smithi138.stderr: 2023-12-19T19:03:09.976 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.1.43775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43775.log.gz 2023-12-19T19:03:09.976 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-19T19:03:09.976 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.38389.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.38389.log.gz -5 2023-12-19T19:03:09.976 INFO:teuthology.orchestra.run.smithi138.stderr: --verbose -- /var/log/ceph/ceph-mds.d.log 2023-12-19T19:03:09.977 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52846.log 2023-12-19T19:03:09.977 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55996.log.gz 2023-12-19T19:03:09.977 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47739.log 2023-12-19T19:03:09.977 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45920.log.gz 2023-12-19T19:03:09.978 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54227.log 2023-12-19T19:03:09.978 INFO:teuthology.orchestra.run.smithi133.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52846.log.gz 2023-12-19T19:03:09.978 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56361.log 2023-12-19T19:03:09.978 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47739.log.gz 2023-12-19T19:03:09.978 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44686.log 2023-12-19T19:03:09.978 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54227.log.gz 2023-12-19T19:03:09.982 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-12-19T19:03:09.982 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mds.b.log: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-19T19:03:09.982 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-12-19T19:03:09.984 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56361.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56361.log.gz 2023-12-19T19:03:09.984 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53093.log 2023-12-19T19:03:09.984 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48746.log 2023-12-19T19:03:09.984 INFO:teuthology.orchestra.run.smithi133.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44686.log.gz 2023-12-19T19:03:09.984 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43886.log 87.7% 2023-12-19T19:03:09.984 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53093.log.gz 2023-12-19T19:03:09.985 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48954.log 2023-12-19T19:03:09.985 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48746.log.gz 2023-12-19T19:03:09.985 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.43886.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43886.log.gz 2023-12-19T19:03:09.985 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47471.log 2023-12-19T19:03:09.985 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54808.log 2023-12-19T19:03:09.985 INFO:teuthology.orchestra.run.smithi133.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48954.log.gz 2023-12-19T19:03:09.985 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54596.log 2023-12-19T19:03:09.985 INFO:teuthology.orchestra.run.smithi133.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47471.log.gz 2023-12-19T19:03:09.986 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44890.log 2023-12-19T19:03:09.987 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54808.log.gz 2023-12-19T19:03:09.987 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50683.log 2023-12-19T19:03:09.987 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54596.log.gz 2023-12-19T19:03:09.987 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44216.log 2023-12-19T19:03:09.988 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44890.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44890.log.gz 2023-12-19T19:03:09.988 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48539.log 2023-12-19T19:03:09.988 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50178.log 2023-12-19T19:03:09.988 INFO:teuthology.orchestra.run.smithi133.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50683.log.gz 2023-12-19T19:03:09.989 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-12-19T19:03:09.990 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.1.44216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44216.log.gz 2023-12-19T19:03:09.990 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55023.log 2023-12-19T19:03:09.990 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48539.log.gz 2023-12-19T19:03:09.990 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49670.log 2023-12-19T19:03:09.991 INFO:teuthology.orchestra.run.smithi133.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50178.log.gz 2023-12-19T19:03:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49806.log 2023-12-19T19:03:09.992 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55023.log.gz 2023-12-19T19:03:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49670.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49670.log.gz 2023-12-19T19:03:09.992 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46403.log 2023-12-19T19:03:09.993 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44485.log 2023-12-19T19:03:09.993 INFO:teuthology.orchestra.run.smithi133.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49806.log.gz 2023-12-19T19:03:09.994 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46403.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46403.log.gz 2023-12-19T19:03:09.994 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49285.log 2023-12-19T19:03:09.995 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44093.log 2023-12-19T19:03:09.995 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44485.log: gzip -5 --verbose -- 88.7% /var/log/ceph/ceph-client.admin.56465.log 2023-12-19T19:03:09.995 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44485.log.gz 2023-12-19T19:03:09.996 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56309.log 2023-12-19T19:03:09.996 INFO:teuthology.orchestra.run.smithi133.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49285.log.gz 2023-12-19T19:03:09.997 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55127.log 2023-12-19T19:03:09.997 INFO:teuthology.orchestra.run.smithi133.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56465.log.gz 2023-12-19T19:03:09.998 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48301.log 2023-12-19T19:03:09.998 INFO:teuthology.orchestra.run.smithi133.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56309.log.gz 2023-12-19T19:03:09.999 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55127.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55127.log.gz 2023-12-19T19:03:10.000 INFO:teuthology.orchestra.run.smithi138.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-12-19T19:03:10.000 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45608.log 2023-12-19T19:03:10.001 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52376.log 2023-12-19T19:03:10.001 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48301.log.gz 2023-12-19T19:03:10.001 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53599.log 2023-12-19T19:03:10.001 INFO:teuthology.orchestra.run.smithi133.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45608.log.gz 2023-12-19T19:03:10.002 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52376.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-19T19:03:10.002 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52376.log.gz 2023-12-19T19:03:10.003 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49389.log 2023-12-19T19:03:10.003 INFO:teuthology.orchestra.run.smithi133.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.53599.log.gz 2023-12-19T19:03:10.004 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48850.log 2023-12-19T19:03:10.005 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49389.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49389.log.gz 2023-12-19T19:03:10.006 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51965.log 2023-12-19T19:03:10.007 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.1.44093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44093.log.gz 2023-12-19T19:03:10.007 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48850.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48850.log.gz 2023-12-19T19:03:10.007 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56257.log 2023-12-19T19:03:10.008 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51965.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51965.log.gz 2023-12-19T19:03:10.008 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48720.log 2023-12-19T19:03:10.009 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56257.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56257.log.gz 2023-12-19T19:03:10.009 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51104.log 2023-12-19T19:03:10.010 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48720.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48720.log.gz 2023-12-19T19:03:10.010 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44275.log 2023-12-19T19:03:10.011 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51104.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51104.log.gz 2023-12-19T19:03:10.011 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44490.log 2023-12-19T19:03:10.012 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44275.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44275.log.gz 2023-12-19T19:03:10.012 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49748.log 2023-12-19T19:03:10.013 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44490.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44490.log.gz 2023-12-19T19:03:10.013 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46708.log 2023-12-19T19:03:10.014 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49748.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49748.log.gz 2023-12-19T19:03:10.014 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44293.log 2023-12-19T19:03:10.015 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46708.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46708.log.gz 2023-12-19T19:03:10.015 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46559.log 2023-12-19T19:03:10.016 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44293.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44293.log.gz 2023-12-19T19:03:10.017 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53993.log 2023-12-19T19:03:10.017 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46559.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46559.log.gz 2023-12-19T19:03:10.018 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46299.log 2023-12-19T19:03:10.018 INFO:teuthology.orchestra.run.smithi138.stderr: 92.9% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-12-19T19:03:10.019 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53993.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53993.log.gz 2023-12-19T19:03:10.019 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43631.log 2023-12-19T19:03:10.020 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46299.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46299.log.gz 2023-12-19T19:03:10.020 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49032.log 2023-12-19T19:03:10.021 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.43631.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43631.log.gz 2023-12-19T19:03:10.021 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51809.log 2023-12-19T19:03:10.022 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49032.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49032.log.gz 2023-12-19T19:03:10.022 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-19T19:03:10.023 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51809.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51809.log.gz 2023-12-19T19:03:10.023 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54862.log 2023-12-19T19:03:10.024 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56127.log 2023-12-19T19:03:10.025 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54862.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54862.log.gz 2023-12-19T19:03:10.026 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50493.log 2023-12-19T19:03:10.026 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56127.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56127.log.gz 2023-12-19T19:03:10.027 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53573.log 2023-12-19T19:03:10.028 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53199.log 2023-12-19T19:03:10.029 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53573.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.50493.log.gz 2023-12-19T19:03:10.029 INFO:teuthology.orchestra.run.smithi133.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53573.log.gz 2023-12-19T19:03:10.030 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54570.log 2023-12-19T19:03:10.030 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53199.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53199.log.gz 2023-12-19T19:03:10.031 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48327.log 2023-12-19T19:03:10.032 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53357.log 2023-12-19T19:03:10.032 INFO:teuthology.orchestra.run.smithi133.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54570.log.gz 2023-12-19T19:03:10.033 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48327.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48327.log.gz 2023-12-19T19:03:10.033 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44481.log 2023-12-19T19:03:10.034 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56022.log 2023-12-19T19:03:10.035 INFO:teuthology.orchestra.run.smithi133.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53357.log.gz 2023-12-19T19:03:10.036 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44481.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44481.log.gz 2023-12-19T19:03:10.036 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55802.log 2023-12-19T19:03:10.037 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56022.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56022.log.gz 2023-12-19T19:03:10.038 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51446.log 2023-12-19T19:03:10.039 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56387.log 2023-12-19T19:03:10.039 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55802.log.gz 2023-12-19T19:03:10.040 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51446.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51446.log.gz 2023-12-19T19:03:10.040 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50309.log 2023-12-19T19:03:10.042 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56387.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56387.log.gz 2023-12-19T19:03:10.042 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52612.log 2023-12-19T19:03:10.043 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50309.log: gzip 88.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.50309.log.gz -- 2023-12-19T19:03:10.043 INFO:teuthology.orchestra.run.smithi133.stderr: /var/log/ceph/ceph-client.admin.52246.log 2023-12-19T19:03:10.044 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52612.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52612.log.gz 2023-12-19T19:03:10.045 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47873.log 2023-12-19T19:03:10.046 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53225.log 2023-12-19T19:03:10.046 INFO:teuthology.orchestra.run.smithi133.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52246.log.gz 2023-12-19T19:03:10.047 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47873.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47873.log.gz 2023-12-19T19:03:10.047 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50413.log 2023-12-19T19:03:10.048 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53225.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53225.log.gz 2023-12-19T19:03:10.049 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53173.log 2023-12-19T19:03:10.049 INFO:teuthology.orchestra.run.smithi138.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-19T19:03:10.050 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51156.log 2023-12-19T19:03:10.050 INFO:teuthology.orchestra.run.smithi133.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50413.log.gz 2023-12-19T19:03:10.051 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45176.log 2023-12-19T19:03:10.052 INFO:teuthology.orchestra.run.smithi133.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53173.log.gz 2023-12-19T19:03:10.052 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51156.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51156.log.gz 2023-12-19T19:03:10.053 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51182.log 2023-12-19T19:03:10.054 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47987.log 2023-12-19T19:03:10.054 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45176.log.gz 2023-12-19T19:03:10.055 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51182.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51182.log.gz 2023-12-19T19:03:10.055 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56231.log 2023-12-19T19:03:10.057 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47987.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47987.log.gz 2023-12-19T19:03:10.057 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55698.log 2023-12-19T19:03:10.058 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56231.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56231.log.gz 2023-12-19T19:03:10.059 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51783.log 2023-12-19T19:03:10.060 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47366.log 2023-12-19T19:03:10.060 INFO:teuthology.orchestra.run.smithi133.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55698.log.gz 2023-12-19T19:03:10.061 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51783.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51783.log.gz 2023-12-19T19:03:10.061 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46325.log 2023-12-19T19:03:10.062 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53485.log 2023-12-19T19:03:10.063 INFO:teuthology.orchestra.run.smithi133.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47366.log.gz 2023-12-19T19:03:10.064 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46325.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46325.log.gz 2023-12-19T19:03:10.064 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55958.log 2023-12-19T19:03:10.065 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53485.log: gzip 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53485.log.gz -5 2023-12-19T19:03:10.066 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47182.log 2023-12-19T19:03:10.066 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55958.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55958.log.gz 2023-12-19T19:03:10.067 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52121.log 2023-12-19T19:03:10.068 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49956.log 2023-12-19T19:03:10.068 INFO:teuthology.orchestra.run.smithi133.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47182.log.gz 2023-12-19T19:03:10.069 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52121.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52121.log.gz 2023-12-19T19:03:10.069 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50815.log 2023-12-19T19:03:10.070 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49956.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49956.log.gz 2023-12-19T19:03:10.071 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44698.log 2023-12-19T19:03:10.072 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49136.log 2023-12-19T19:03:10.072 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50815.log.gz 2023-12-19T19:03:10.073 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44698.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44698.log.gz 2023-12-19T19:03:10.074 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45020.log 2023-12-19T19:03:10.074 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49136.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49136.log.gz 2023-12-19T19:03:10.075 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50231.log 2023-12-19T19:03:10.076 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46455.log 2023-12-19T19:03:10.076 INFO:teuthology.orchestra.run.smithi133.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45020.log.gz 2023-12-19T19:03:10.077 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50231.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50231.log.gz 2023-12-19T19:03:10.078 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53651.log 2023-12-19T19:03:10.078 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46455.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46455.log.gz 2023-12-19T19:03:10.079 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48379.log 2023-12-19T19:03:10.080 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54019.log 2023-12-19T19:03:10.080 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53651.log.gz 2023-12-19T19:03:10.081 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48379.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48379.log.gz 2023-12-19T19:03:10.082 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43574.log 2023-12-19T19:03:10.083 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54019.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54019.log.gz 2023-12-19T19:03:10.083 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46190.log 2023-12-19T19:03:10.084 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.43574.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43574.log.gz 2023-12-19T19:03:10.085 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54914.log 2023-12-19T19:03:10.086 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43729.log 2023-12-19T19:03:10.086 INFO:teuthology.orchestra.run.smithi133.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46190.log.gz 2023-12-19T19:03:10.087 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54914.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54914.log.gz 2023-12-19T19:03:10.087 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56153.log 2023-12-19T19:03:10.089 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.43729.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43729.log.gz 2023-12-19T19:03:10.089 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52950.log 2023-12-19T19:03:10.090 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56153.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56153.log.gz 2023-12-19T19:03:10.090 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44004.log 2023-12-19T19:03:10.092 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44292.log 89.2% 2023-12-19T19:03:10.092 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52950.log.gz 2023-12-19T19:03:10.093 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44004.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44004.log.gz 2023-12-19T19:03:10.094 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54500.log 2023-12-19T19:03:10.095 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54256.log 2023-12-19T19:03:10.095 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44292.log.gz 2023-12-19T19:03:10.096 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54500.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54500.log.gz 2023-12-19T19:03:10.096 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53785.log 2023-12-19T19:03:10.097 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52192.log 2023-12-19T19:03:10.098 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54256.log.gz 2023-12-19T19:03:10.098 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53785.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53785.log.gz 2023-12-19T19:03:10.099 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46481.log 2023-12-19T19:03:10.100 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52192.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52192.log.gz 2023-12-19T19:03:10.101 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47819.log 2023-12-19T19:03:10.102 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46481.log: gzip -5 89.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.46481.log.gz /var/log/ceph/ceph-client.admin.43782.log 2023-12-19T19:03:10.102 INFO:teuthology.orchestra.run.smithi133.stderr: 2023-12-19T19:03:10.103 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47819.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47819.log.gz 2023-12-19T19:03:10.104 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54149.log 2023-12-19T19:03:10.105 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.43782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51653.log 2023-12-19T19:03:10.105 INFO:teuthology.orchestra.run.smithi133.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43782.log.gz 2023-12-19T19:03:10.106 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54149.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54149.log.gz 2023-12-19T19:03:10.106 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45712.log 2023-12-19T19:03:10.108 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51653.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51653.log.gz 2023-12-19T19:03:10.108 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45361.log 2023-12-19T19:03:10.109 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45712.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45712.log.gz 2023-12-19T19:03:10.109 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49006.log 2023-12-19T19:03:10.111 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45361.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45361.log.gz 2023-12-19T19:03:10.111 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52017.log 2023-12-19T19:03:10.112 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49006.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49006.log.gz 2023-12-19T19:03:10.112 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50787.log 2023-12-19T19:03:10.113 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52017.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52017.log.gz 2023-12-19T19:03:10.114 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50974.log 2023-12-19T19:03:10.115 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45124.log 2023-12-19T19:03:10.115 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50787.log.gz 2023-12-19T19:03:10.116 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47497.log 2023-12-19T19:03:10.116 INFO:teuthology.orchestra.run.smithi133.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50974.log.gz 2023-12-19T19:03:10.117 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45124.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45124.log.gz 2023-12-19T19:03:10.118 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55185.log 2023-12-19T19:03:10.119 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44058.log 2023-12-19T19:03:10.119 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47497.log.gz 2023-12-19T19:03:10.120 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55185.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55185.log.gz 2023-12-19T19:03:10.120 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55075.log 2023-12-19T19:03:10.122 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44058.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44058.log.gz 2023-12-19T19:03:10.122 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52220.log 2023-12-19T19:03:10.123 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55075.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55075.log.gz 2023-12-19T19:03:10.124 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44289.log 2023-12-19T19:03:10.125 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52220.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52220.log.gz 2023-12-19T19:03:10.125 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-19T19:03:10.126 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44289.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44289.log.gz 2023-12-19T19:03:10.127 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51234.log 2023-12-19T19:03:10.128 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53383.log 2023-12-19T19:03:10.130 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43916.log 2023-12-19T19:03:10.130 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51234.log.gz 2023-12-19T19:03:10.131 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55315.log 2023-12-19T19:03:10.131 INFO:teuthology.orchestra.run.smithi133.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53383.log.gz 2023-12-19T19:03:10.132 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.43916.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43916.log.gz 2023-12-19T19:03:10.133 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44694.log 2023-12-19T19:03:10.134 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55341.log 2023-12-19T19:03:10.134 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55315.log.gz 2023-12-19T19:03:10.135 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48461.log 2023-12-19T19:03:10.136 INFO:teuthology.orchestra.run.smithi133.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44694.log.gz 2023-12-19T19:03:10.137 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55341.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55341.log.gz 2023-12-19T19:03:10.137 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45842.log 2023-12-19T19:03:10.138 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51078.log 87.8% 2023-12-19T19:03:10.139 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48461.log.gz 2023-12-19T19:03:10.140 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45842.log: gzip -5 88.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.45842.log.gz /var/log/ceph/ceph-client.0.53531.log 2023-12-19T19:03:10.140 INFO:teuthology.orchestra.run.smithi133.stderr: 2023-12-19T19:03:10.141 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46162.log 2023-12-19T19:03:10.141 INFO:teuthology.orchestra.run.smithi133.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51078.log.gz 2023-12-19T19:03:10.142 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.53531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.53531.log.gz 2023-12-19T19:03:10.142 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38480.log 2023-12-19T19:03:10.144 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48171.log 2023-12-19T19:03:10.144 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46162.log.gz 2023-12-19T19:03:10.145 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.38480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44277.log 2023-12-19T19:03:10.146 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38480.log.gz 2023-12-19T19:03:10.147 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52924.log 2023-12-19T19:03:10.147 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48171.log.gz 2023-12-19T19:03:10.148 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44188.log 2023-12-19T19:03:10.148 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44277.log.gz 2023-12-19T19:03:10.150 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52924.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52924.log.gz 2023-12-19T19:03:10.150 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52350.log 2023-12-19T19:03:10.151 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44188.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44188.log.gz 2023-12-19T19:03:10.151 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49878.log 2023-12-19T19:03:10.153 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53757.log 2023-12-19T19:03:10.153 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52350.log.gz 2023-12-19T19:03:10.154 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53677.log 2023-12-19T19:03:10.155 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49878.log.gz 2023-12-19T19:03:10.156 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52404.log 2023-12-19T19:03:10.156 INFO:teuthology.orchestra.run.smithi133.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53757.log.gz 2023-12-19T19:03:10.158 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53677.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.53677.log.gz -5 2023-12-19T19:03:10.158 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47392.log 2023-12-19T19:03:10.159 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45150.log 2023-12-19T19:03:10.159 INFO:teuthology.orchestra.run.smithi133.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52404.log.gz 2023-12-19T19:03:10.160 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47392.log: gzip -5 88.1% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.47392.log.gz /var/log/ceph/ceph-client.admin.45046.log 2023-12-19T19:03:10.160 INFO:teuthology.orchestra.run.smithi133.stderr: 2023-12-19T19:03:10.162 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49363.log 2023-12-19T19:03:10.162 INFO:teuthology.orchestra.run.smithi133.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45150.log.gz 2023-12-19T19:03:10.162 INFO:teuthology.orchestra.run.smithi138.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-12-19T19:03:10.163 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47901.log 2023-12-19T19:03:10.164 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45046.log.gz 2023-12-19T19:03:10.165 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44729.log 2023-12-19T19:03:10.165 INFO:teuthology.orchestra.run.smithi133.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49363.log.gz 2023-12-19T19:03:10.166 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47523.log 2023-12-19T19:03:10.166 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47901.log.gz 2023-12-19T19:03:10.168 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44729.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-19T19:03:10.168 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44729.log.gz 2023-12-19T19:03:10.169 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47523.log: gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47523.log.gz -5 2023-12-19T19:03:10.169 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48409.log 2023-12-19T19:03:10.170 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46136.log 2023-12-19T19:03:10.172 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47208.log 2023-12-19T19:03:10.172 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48409.log.gz 2023-12-19T19:03:10.174 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53303.log 2023-12-19T19:03:10.174 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46136.log.gz 2023-12-19T19:03:10.175 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.54555.log 2023-12-19T19:03:10.175 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47208.log.gz 2023-12-19T19:03:10.177 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52069.log 2023-12-19T19:03:10.177 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53303.log.gz 2023-12-19T19:03:10.177 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.testuser.54555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.54555.log.gz 2023-12-19T19:03:10.178 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46533.log 2023-12-19T19:03:10.180 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51208.log 2023-12-19T19:03:10.180 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52069.log.gz 2023-12-19T19:03:10.181 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53147.log 2023-12-19T19:03:10.181 INFO:teuthology.orchestra.run.smithi133.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46533.log.gz 2023-12-19T19:03:10.182 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51208.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51208.log.gz -5 2023-12-19T19:03:10.183 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51312.log 2023-12-19T19:03:10.184 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53147.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53147.log.gz 2023-12-19T19:03:10.184 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48668.log 2023-12-19T19:03:10.186 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52690.log 2023-12-19T19:03:10.186 INFO:teuthology.orchestra.run.smithi133.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.51312.log.gz 2023-12-19T19:03:10.187 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52534.log 2023-12-19T19:03:10.187 INFO:teuthology.orchestra.run.smithi133.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48668.log.gz 2023-12-19T19:03:10.189 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52043.log 2023-12-19T19:03:10.189 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52690.log.gz 2023-12-19T19:03:10.190 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52534.log: gzip -5 --verbose 88.1% -- -- replaced with /var/log/ceph/ceph-client.admin.52534.log.gz /var/log/ceph/ceph-client.admin.55419.log 2023-12-19T19:03:10.190 INFO:teuthology.orchestra.run.smithi133.stderr: 2023-12-19T19:03:10.192 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52043.log: gzip -5 88.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.52043.log.gz /var/log/ceph/ceph-client.testuser.48652.log 2023-12-19T19:03:10.192 INFO:teuthology.orchestra.run.smithi133.stderr: 2023-12-19T19:03:10.193 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46637.log 2023-12-19T19:03:10.193 INFO:teuthology.orchestra.run.smithi133.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55419.log.gz 2023-12-19T19:03:10.194 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.testuser.48652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.48652.log.gz 2023-12-19T19:03:10.194 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44916.log 2023-12-19T19:03:10.196 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56491.log 2023-12-19T19:03:10.196 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46637.log.gz 2023-12-19T19:03:10.197 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54045.log 2023-12-19T19:03:10.198 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44916.log.gz 2023-12-19T19:03:10.199 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49521.log 2023-12-19T19:03:10.199 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56491.log.gz 2023-12-19T19:03:10.200 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54045.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54045.log.gz 2023-12-19T19:03:10.201 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46882.log 2023-12-19T19:03:10.201 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49521.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49521.log.gz 2023-12-19T19:03:10.202 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50335.log 2023-12-19T19:03:10.203 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46882.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46882.log.gz 2023-12-19T19:03:10.204 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51260.log 2023-12-19T19:03:10.205 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.51611.log 2023-12-19T19:03:10.206 INFO:teuthology.orchestra.run.smithi133.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50335.log.gz 2023-12-19T19:03:10.207 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54700.log 2023-12-19T19:03:10.207 INFO:teuthology.orchestra.run.smithi133.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51260.log.gz 2023-12-19T19:03:10.208 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.testuser.51611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.51611.log.gz 2023-12-19T19:03:10.208 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50034.log 2023-12-19T19:03:10.210 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50008.log 2023-12-19T19:03:10.210 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54700.log.gz 2023-12-19T19:03:10.211 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50034.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50034.log.gz -5 2023-12-19T19:03:10.212 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.admin.52898.log 2023-12-19T19:03:10.213 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54971.log 2023-12-19T19:03:10.213 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50008.log.gz 2023-12-19T19:03:10.214 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52898.log: gzip -5 --verbose 88.5% -- -- replaced with /var/log/ceph/ceph-client.admin.52898.log.gz /var/log/ceph/ceph-client.admin.48435.log 2023-12-19T19:03:10.215 INFO:teuthology.orchestra.run.smithi133.stderr: 2023-12-19T19:03:10.216 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54971.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54971.log.gz 2023-12-19T19:03:10.216 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53119.log 2023-12-19T19:03:10.217 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48435.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.47014.log -- replaced with /var/log/ceph/ceph-client.admin.48435.log.gz 2023-12-19T19:03:10.217 INFO:teuthology.orchestra.run.smithi133.stderr: 2023-12-19T19:03:10.219 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53119.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53119.log.gz 2023-12-19T19:03:10.219 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49592.log 2023-12-19T19:03:10.220 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46076.log 2023-12-19T19:03:10.220 INFO:teuthology.orchestra.run.smithi133.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47014.log.gz 2023-12-19T19:03:10.222 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52482.log 2023-12-19T19:03:10.222 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49592.log.gz 2023-12-19T19:03:10.223 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46110.log 2023-12-19T19:03:10.223 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46076.log.gz 2023-12-19T19:03:10.225 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52482.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52482.log.gzgzip 2023-12-19T19:03:10.225 INFO:teuthology.orchestra.run.smithi133.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49084.log 2023-12-19T19:03:10.226 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54940.log 2023-12-19T19:03:10.226 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46110.log.gz 2023-12-19T19:03:10.228 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51472.log 2023-12-19T19:03:10.228 INFO:teuthology.orchestra.run.smithi133.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49084.log.gz 2023-12-19T19:03:10.229 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44489.log 2023-12-19T19:03:10.229 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54940.log.gz 2023-12-19T19:03:10.230 INFO:teuthology.orchestra.run.smithi138.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-12-19T19:03:10.230 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51472.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51472.log.gz 2023-12-19T19:03:10.231 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44162.log 2023-12-19T19:03:10.232 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52272.log 2023-12-19T19:03:10.232 INFO:teuthology.orchestra.run.smithi133.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44489.log.gz 2023-12-19T19:03:10.233 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44162.log: gzip 88.5% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.44162.log.gz -- 2023-12-19T19:03:10.234 INFO:teuthology.orchestra.run.smithi133.stderr: /var/log/ceph/ceph-client.admin.55497.log 2023-12-19T19:03:10.235 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52430.log 2023-12-19T19:03:10.235 INFO:teuthology.orchestra.run.smithi133.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52272.log.gz 2023-12-19T19:03:10.236 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47120.log 2023-12-19T19:03:10.236 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55497.log.gz 2023-12-19T19:03:10.238 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52430.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52430.log.gz 2023-12-19T19:03:10.239 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47120.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47120.log.gz 2023-12-19T19:03:10.240 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49110.log 2023-12-19T19:03:10.241 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54282.log 2023-12-19T19:03:10.243 INFO:teuthology.orchestra.run.smithi138.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-12-19T19:03:10.243 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45098.log 2023-12-19T19:03:10.243 INFO:teuthology.orchestra.run.smithi133.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49110.log.gz 2023-12-19T19:03:10.244 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54282.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54282.log.gz 2023-12-19T19:03:10.244 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51731.log 2023-12-19T19:03:10.246 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45098.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45098.log.gz 2023-12-19T19:03:10.246 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56595.log 2023-12-19T19:03:10.247 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51731.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51731.log.gz 2023-12-19T19:03:10.247 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56517.log 2023-12-19T19:03:10.249 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51627.log 2023-12-19T19:03:10.249 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56595.log.gz 2023-12-19T19:03:10.251 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56517.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56517.log.gz 2023-12-19T19:03:10.251 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-19T19:03:10.252 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51627.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51627.log.gz 2023-12-19T19:03:10.252 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49188.log 2023-12-19T19:03:10.254 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45530.log 2023-12-19T19:03:10.255 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49188.log: 86.1% -- replaced with /var/log/ceph/ceph.log.gz 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49188.log.gz 2023-12-19T19:03:10.256 INFO:teuthology.orchestra.run.smithi133.stderr: 2023-12-19T19:03:10.256 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45530.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45530.log.gz 2023-12-19T19:03:10.257 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55932.log 2023-12-19T19:03:10.258 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48145.log 2023-12-19T19:03:10.260 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52298.log 2023-12-19T19:03:10.260 INFO:teuthology.orchestra.run.smithi133.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55932.log.gz 2023-12-19T19:03:10.261 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46962.log 2023-12-19T19:03:10.262 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48145.log.gz 2023-12-19T19:03:10.263 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52298.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52298.log.gz 2023-12-19T19:03:10.263 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51705.log 2023-12-19T19:03:10.264 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48694.log 2023-12-19T19:03:10.264 INFO:teuthology.orchestra.run.smithi133.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46962.log.gz 2023-12-19T19:03:10.266 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56074.log 2023-12-19T19:03:10.266 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51705.log.gz 2023-12-19T19:03:10.267 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43755.log 2023-12-19T19:03:10.267 INFO:teuthology.orchestra.run.smithi133.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48694.log.gz 2023-12-19T19:03:10.269 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56074.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.56074.log.gz -5 2023-12-19T19:03:10.269 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.admin.54097.log 2023-12-19T19:03:10.270 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.43755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56569.log 2023-12-19T19:03:10.270 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43755.log.gz 2023-12-19T19:03:10.272 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54097.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54097.log.gz 2023-12-19T19:03:10.272 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46429.log 2023-12-19T19:03:10.273 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45556.log 87.7% 2023-12-19T19:03:10.273 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56569.log.gz 2023-12-19T19:03:10.275 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50465.log 2023-12-19T19:03:10.275 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46429.log.gz 2023-12-19T19:03:10.276 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45556.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45556.log.gz 2023-12-19T19:03:10.276 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47444.log 2023-12-19T19:03:10.277 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51556.log 2023-12-19T19:03:10.278 INFO:teuthology.orchestra.run.smithi133.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50465.log.gz 2023-12-19T19:03:10.279 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47444.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.47444.log.gz 2023-12-19T19:03:10.279 INFO:teuthology.orchestra.run.smithi133.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46611.log 2023-12-19T19:03:10.280 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45946.log 2023-12-19T19:03:10.281 INFO:teuthology.orchestra.run.smithi133.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51556.log.gz 2023-12-19T19:03:10.282 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46611.log: gzip -5 --verbose -- 89.0% /var/log/ceph/ceph-client.admin.44695.log 2023-12-19T19:03:10.282 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46611.log.gz 2023-12-19T19:03:10.284 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45946.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45946.log.gz 2023-12-19T19:03:10.284 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56179.log 2023-12-19T19:03:10.285 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45504.log 2023-12-19T19:03:10.285 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44695.log.gz 2023-12-19T19:03:10.286 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56179.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56179.log.gz 2023-12-19T19:03:10.286 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52820.log 2023-12-19T19:03:10.288 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45504.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45504.log.gz 2023-12-19T19:03:10.288 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56048.log 2023-12-19T19:03:10.289 INFO:teuthology.orchestra.run.smithi138.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-12-19T19:03:10.289 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55263.log 2023-12-19T19:03:10.289 INFO:teuthology.orchestra.run.smithi133.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52820.log.gz 2023-12-19T19:03:10.291 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56048.log: gzip -5 --verbose 88.9% -- /var/log/ceph/ceph-client.admin.48275.log -- replaced with /var/log/ceph/ceph-client.admin.56048.log.gz 2023-12-19T19:03:10.291 INFO:teuthology.orchestra.run.smithi133.stderr: 2023-12-19T19:03:10.292 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44285.log 2023-12-19T19:03:10.292 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55263.log.gz 2023-12-19T19:03:10.293 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47092.log 2023-12-19T19:03:10.294 INFO:teuthology.orchestra.run.smithi133.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48275.log.gz 2023-12-19T19:03:10.295 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48772.log 2023-12-19T19:03:10.295 INFO:teuthology.orchestra.run.smithi133.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44285.log.gz 2023-12-19T19:03:10.296 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47092.log: gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47092.log.gz 2023-12-19T19:03:10.297 INFO:teuthology.orchestra.run.smithi133.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49696.log 2023-12-19T19:03:10.298 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48772.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48772.log.gz 2023-12-19T19:03:10.298 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33411.log 2023-12-19T19:03:10.299 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55445.log 2023-12-19T19:03:10.300 INFO:teuthology.orchestra.run.smithi133.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49696.log.gz 2023-12-19T19:03:10.300 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph.tmp-client.admin.33411.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33411.log.gz 2023-12-19T19:03:10.301 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47314.log 2023-12-19T19:03:10.302 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55445.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55445.log.gz 2023-12-19T19:03:10.303 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51026.log 2023-12-19T19:03:10.304 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47793.log 2023-12-19T19:03:10.304 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47314.log.gz 2023-12-19T19:03:10.305 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50948.log 2023-12-19T19:03:10.306 INFO:teuthology.orchestra.run.smithi133.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51026.log.gz 2023-12-19T19:03:10.307 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56335.log 2023-12-19T19:03:10.307 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47793.log.gz 2023-12-19T19:03:10.308 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50948.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50948.log.gz 2023-12-19T19:03:10.309 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46830.log 2023-12-19T19:03:10.310 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56335.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56335.log.gz 2023-12-19T19:03:10.310 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54834.log 2023-12-19T19:03:10.311 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46830.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46830.log.gz 2023-12-19T19:03:10.312 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45972.log 2023-12-19T19:03:10.313 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54834.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54834.log.gz 2023-12-19T19:03:10.313 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48093.log 2023-12-19T19:03:10.315 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55854.log 2023-12-19T19:03:10.315 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45972.log.gz 2023-12-19T19:03:10.316 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56413.log 2023-12-19T19:03:10.317 INFO:teuthology.orchestra.run.smithi133.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48093.log.gz 2023-12-19T19:03:10.318 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55854.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55854.log.gz 2023-12-19T19:03:10.318 INFO:teuthology.orchestra.run.smithi133.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50439.log 2023-12-19T19:03:10.320 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47418.log 2023-12-19T19:03:10.320 INFO:teuthology.orchestra.run.smithi133.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56413.log.gz 2023-12-19T19:03:10.321 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50439.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50439.log.gz 2023-12-19T19:03:10.321 INFO:teuthology.orchestra.run.smithi133.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45072.log 2023-12-19T19:03:10.322 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47418.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47418.log.gz 2023-12-19T19:03:10.323 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52664.log 2023-12-19T19:03:10.324 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46216.log 2023-12-19T19:03:10.324 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45072.log.gz 2023-12-19T19:03:10.325 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52664.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52664.log.gz 2023-12-19T19:03:10.327 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46216.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46216.log.gz 2023-12-19T19:03:10.327 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51757.log 2023-12-19T19:03:10.328 INFO:teuthology.orchestra.run.smithi133.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-19T19:03:10.329 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55101.log 2023-12-19T19:03:10.330 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54648.log 2023-12-19T19:03:10.330 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51757.log.gz 2023-12-19T19:03:10.331 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55101.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55101.log.gz 2023-12-19T19:03:10.332 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50631.log 2023-12-19T19:03:10.333 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54648.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54648.log.gz 2023-12-19T19:03:10.334 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43664.log 2023-12-19T19:03:10.335 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48223.log 2023-12-19T19:03:10.335 INFO:teuthology.orchestra.run.smithi133.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50631.log.gz 2023-12-19T19:03:10.336 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.43664.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43664.log.gz 2023-12-19T19:03:10.336 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55646.log 2023-12-19T19:03:10.337 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53967.log 2023-12-19T19:03:10.337 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48223.log.gz 2023-12-19T19:03:10.338 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55646.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55646.log.gz 2023-12-19T19:03:10.338 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48597.log 2023-12-19T19:03:10.340 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45228.log 2023-12-19T19:03:10.340 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53967.log.gz 2023-12-19T19:03:10.341 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48597.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48597.log.gz 2023-12-19T19:03:10.341 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45582.log 2023-12-19T19:03:10.342 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53005.log 2023-12-19T19:03:10.343 INFO:teuthology.orchestra.run.smithi133.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.45228.log.gz 2023-12-19T19:03:10.343 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45582.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45582.log.gz 2023-12-19T19:03:10.343 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49547.log 2023-12-19T19:03:10.344 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51861.log 2023-12-19T19:03:10.345 INFO:teuthology.orchestra.run.smithi133.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53005.log.gz 2023-12-19T19:03:10.346 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49547.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49547.log.gz 2023-12-19T19:03:10.346 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54674.log 2023-12-19T19:03:10.348 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51861.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51861.log.gz 2023-12-19T19:03:10.348 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50605.log 2023-12-19T19:03:10.349 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54674.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54674.log.gz 2023-12-19T19:03:10.350 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52456.log 2023-12-19T19:03:10.353 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50605.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50605.log.gz 2023-12-19T19:03:10.354 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50844.log 2023-12-19T19:03:10.354 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52456.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.52456.log.gz 2023-12-19T19:03:10.354 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44994.log 2023-12-19T19:03:10.354 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50844.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50844.log.gz 2023-12-19T19:03:10.355 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46936.log 2023-12-19T19:03:10.356 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44994.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44994.log.gz 2023-12-19T19:03:10.356 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45475.log 2023-12-19T19:03:10.357 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46936.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.54123.log 2023-12-19T19:03:10.357 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46936.log.gz 2023-12-19T19:03:10.358 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.45475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45475.log.gz 2023-12-19T19:03:10.358 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49467.log 2023-12-19T19:03:10.359 INFO:teuthology.orchestra.run.smithi133.stderr: 94.0%/var/log/ceph/ceph-client.admin.54123.log: -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-19T19:03:10.360 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54123.log.gz 2023-12-19T19:03:10.360 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55880.log 2023-12-19T19:03:10.361 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49467.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49467.log.gz 2023-12-19T19:03:10.362 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47234.log 2023-12-19T19:03:10.363 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55620.log 2023-12-19T19:03:10.363 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55880.log.gz 2023-12-19T19:03:10.364 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47234.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47234.log.gz 2023-12-19T19:03:10.365 INFO:teuthology.orchestra.run.smithi138.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-12-19T19:03:10.365 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45998.log 2023-12-19T19:03:10.366 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55620.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55620.log.gz 2023-12-19T19:03:10.366 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51498.log 2023-12-19T19:03:10.368 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45998.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45998.log.gz 2023-12-19T19:03:10.368 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51679.log 2023-12-19T19:03:10.369 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51498.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51498.log.gz 2023-12-19T19:03:10.370 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49722.log 2023-12-19T19:03:10.371 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51679.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51679.log.gz 2023-12-19T19:03:10.371 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54312.log 2023-12-19T19:03:10.372 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49722.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49722.log.gz 2023-12-19T19:03:10.373 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47148.log 2023-12-19T19:03:10.374 INFO:teuthology.orchestra.run.smithi138.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-12-19T19:03:10.374 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50735.log 2023-12-19T19:03:10.374 INFO:teuthology.orchestra.run.smithi133.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54312.log.gz 2023-12-19T19:03:10.376 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47148.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.47148.log.gz 2023-12-19T19:03:10.376 INFO:teuthology.orchestra.run.smithi133.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43944.log 2023-12-19T19:03:10.377 INFO:teuthology.orchestra.run.smithi138.stderr: 2023-12-19T19:03:10.377 INFO:teuthology.orchestra.run.smithi138.stderr:real 0m0.455s 2023-12-19T19:03:10.377 INFO:teuthology.orchestra.run.smithi138.stderr:user 0m1.820s 2023-12-19T19:03:10.377 INFO:teuthology.orchestra.run.smithi138.stderr:sys 0m0.247s 2023-12-19T19:03:10.378 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55828.log 2023-12-19T19:03:10.378 INFO:teuthology.orchestra.run.smithi133.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50735.log.gz 2023-12-19T19:03:10.378 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.43944.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43944.log.gz 2023-12-19T19:03:10.380 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54338.log 2023-12-19T19:03:10.380 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48824.log 2023-12-19T19:03:10.380 INFO:teuthology.orchestra.run.smithi133.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55828.log.gz 2023-12-19T19:03:10.381 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54338.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.54338.log.gz 2023-12-19T19:03:10.381 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44214.log 2023-12-19T19:03:10.383 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48824.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48824.log.gz 2023-12-19T19:03:10.383 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52147.log 2023-12-19T19:03:10.384 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44214.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44214.log.gz 2023-12-19T19:03:10.384 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54416.log 2023-12-19T19:03:10.386 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52147.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52147.log.gz 2023-12-19T19:03:10.389 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-19T19:03:10.390 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54416.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54416.log.gz 2023-12-19T19:03:10.391 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46766.log 2023-12-19T19:03:10.391 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-12-19T19:03:10.391 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55159.log 2023-12-19T19:03:10.391 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46766.log.gz 2023-12-19T19:03:10.391 INFO:teuthology.orchestra.run.smithi133.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-19T19:03:10.392 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53729.log 2023-12-19T19:03:10.393 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55159.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55159.log.gz 2023-12-19T19:03:10.393 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53067.log 2023-12-19T19:03:10.394 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53729.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53729.log.gz 2023-12-19T19:03:10.395 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51887.log 2023-12-19T19:03:10.396 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53067.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53067.log.gz 2023-12-19T19:03:10.396 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54442.log 2023-12-19T19:03:10.397 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51887.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51887.log.gz 2023-12-19T19:03:10.398 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-12-19T19:03:10.399 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54442.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54442.log.gz 2023-12-19T19:03:10.399 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47961.log 2023-12-19T19:03:10.401 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54997.log 2023-12-19T19:03:10.403 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51939.log 2023-12-19T19:03:10.403 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47961.log.gz 2023-12-19T19:03:10.404 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49337.log 2023-12-19T19:03:10.404 INFO:teuthology.orchestra.run.smithi133.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54997.log.gz 2023-12-19T19:03:10.406 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52095.log 2023-12-19T19:03:10.406 INFO:teuthology.orchestra.run.smithi133.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51939.log.gz 2023-12-19T19:03:10.407 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48041.log 2023-12-19T19:03:10.407 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49337.log.gz 2023-12-19T19:03:10.408 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52095.log: 88.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.52095.log.gz -5 2023-12-19T19:03:10.409 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51130.log 2023-12-19T19:03:10.410 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43860.log 2023-12-19T19:03:10.410 INFO:teuthology.orchestra.run.smithi133.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48041.log.gz 2023-12-19T19:03:10.411 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51130.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.51130.log.gz 2023-12-19T19:03:10.412 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52976.log 2023-12-19T19:03:10.413 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.43860.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43860.log.gz 2023-12-19T19:03:10.413 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45816.log 2023-12-19T19:03:10.414 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51394.log 2023-12-19T19:03:10.415 INFO:teuthology.orchestra.run.smithi133.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52976.log.gz 2023-12-19T19:03:10.416 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55594.log 2023-12-19T19:03:10.416 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45816.log.gz 2023-12-19T19:03:10.417 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53329.log 2023-12-19T19:03:10.418 INFO:teuthology.orchestra.run.smithi133.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.51394.log.gz 2023-12-19T19:03:10.419 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55594.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55594.log.gz 2023-12-19T19:03:10.419 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47066.log 2023-12-19T19:03:10.420 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53329.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53329.log.gz 2023-12-19T19:03:10.421 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49415.log 2023-12-19T19:03:10.422 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53915.log 2023-12-19T19:03:10.422 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47066.log.gz 2023-12-19T19:03:10.423 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49415.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49415.log.gz 2023-12-19T19:03:10.424 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43834.log 2023-12-19T19:03:10.424 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53915.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53915.log.gz 2023-12-19T19:03:10.425 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55471.log 2023-12-19T19:03:10.427 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.43834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44084.log 2023-12-19T19:03:10.427 INFO:teuthology.orchestra.run.smithi133.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.43834.log.gz 2023-12-19T19:03:10.428 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55471.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55471.log.gz 2023-12-19T19:03:10.428 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49311.log 2023-12-19T19:03:10.430 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54888.log 2023-12-19T19:03:10.430 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44084.log.gz 2023-12-19T19:03:10.431 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49311.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49311.log.gz 2023-12-19T19:03:10.431 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48015.log 2023-12-19T19:03:10.432 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54888.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54888.log.gz 2023-12-19T19:03:10.433 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51991.log 2023-12-19T19:03:10.434 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48015.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.48015.log.gz -5 2023-12-19T19:03:10.434 INFO:teuthology.orchestra.run.smithi133.stderr: --verbose -- /var/log/ceph/ceph-client.admin.50896.log 2023-12-19T19:03:10.436 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51991.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51991.log.gz 2023-12-19T19:03:10.436 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46507.log 2023-12-19T19:03:10.437 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50761.log 2023-12-19T19:03:10.437 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50896.log.gz 2023-12-19T19:03:10.439 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47687.log 2023-12-19T19:03:10.439 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46507.log.gz 2023-12-19T19:03:10.440 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50761.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.51052.log 2023-12-19T19:03:10.440 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50761.log.gz 2023-12-19T19:03:10.442 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44942.log 2023-12-19T19:03:10.442 INFO:teuthology.orchestra.run.smithi133.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47687.log.gz 2023-12-19T19:03:10.443 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54622.log 2023-12-19T19:03:10.443 INFO:teuthology.orchestra.run.smithi133.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51052.log.gz 2023-12-19T19:03:10.445 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47661.log 2023-12-19T19:03:10.445 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44942.log.gz 2023-12-19T19:03:10.446 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47845.log 2023-12-19T19:03:10.446 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54622.log.gz 2023-12-19T19:03:10.447 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47661.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47661.log.gz 2023-12-19T19:03:10.448 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52586.log 2023-12-19T19:03:10.449 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50257.log 2023-12-19T19:03:10.449 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47845.log.gz 2023-12-19T19:03:10.451 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48565.log 2023-12-19T19:03:10.451 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52586.log.gz 2023-12-19T19:03:10.452 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50257.log: gzip 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50257.log.gz 2023-12-19T19:03:10.452 INFO:teuthology.orchestra.run.smithi133.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48067.log 2023-12-19T19:03:10.454 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48565.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48565.log.gz 2023-12-19T19:03:10.454 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55776.log 2023-12-19T19:03:10.455 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48067.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48067.log.gz 2023-12-19T19:03:10.456 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44502.log 2023-12-19T19:03:10.456 INFO:teuthology.orchestra.run.smithi133.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-12-19T19:03:10.456 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52748.log 2023-12-19T19:03:10.457 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55776.log.gz 2023-12-19T19:03:10.457 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44502.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44502.log.gz 2023-12-19T19:03:10.458 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44727.log 2023-12-19T19:03:10.459 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46910.log 2023-12-19T19:03:10.459 INFO:teuthology.orchestra.run.smithi133.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52748.log.gz 2023-12-19T19:03:10.460 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44727.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44727.log.gz 2023-12-19T19:03:10.460 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45790.log 2023-12-19T19:03:10.462 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46377.log 2023-12-19T19:03:10.462 INFO:teuthology.orchestra.run.smithi133.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46910.log.gz 2023-12-19T19:03:10.462 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45790.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45790.log.gz 2023-12-19T19:03:10.463 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56283.log 2023-12-19T19:03:10.464 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48487.log 2023-12-19T19:03:10.465 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46377.log.gz 2023-12-19T19:03:10.465 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56283.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56283.log.gz 2023-12-19T19:03:10.465 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47935.log 2023-12-19T19:03:10.467 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55568.log 2023-12-19T19:03:10.467 INFO:teuthology.orchestra.run.smithi133.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48487.log.gz 2023-12-19T19:03:10.468 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47935.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47935.log.gz 2023-12-19T19:03:10.468 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47599.log 2023-12-19T19:03:10.469 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53435.log 2023-12-19T19:03:10.470 INFO:teuthology.orchestra.run.smithi133.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55568.log.gz 2023-12-19T19:03:10.470 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47599.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.47599.log.gz 2023-12-19T19:03:10.470 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53625.log 2023-12-19T19:03:10.472 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45202.log 2023-12-19T19:03:10.472 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53625.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53435.log.gz 2023-12-19T19:03:10.473 INFO:teuthology.orchestra.run.smithi133.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.53625.log.gz 2023-12-19T19:03:10.473 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49441.log 2023-12-19T19:03:10.474 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50870.log 2023-12-19T19:03:10.474 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45202.log.gz 2023-12-19T19:03:10.475 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49441.log: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-19T19:03:10.475 INFO:teuthology.orchestra.run.smithi133.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49441.log.gz 2023-12-19T19:03:10.476 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50709.log 2023-12-19T19:03:10.476 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49259.log 2023-12-19T19:03:10.477 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50870.log.gz 2023-12-19T19:03:10.478 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50709.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-12-19T19:03:10.478 INFO:teuthology.orchestra.run.smithi133.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50709.log.gz 2023-12-19T19:03:10.478 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49618.log 2023-12-19T19:03:10.479 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51000.log 2023-12-19T19:03:10.480 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49618.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49259.log.gz 2023-12-19T19:03:10.480 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56545.log 2023-12-19T19:03:10.480 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49618.log.gz 2023-12-19T19:03:10.481 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51000.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51000.log.gz 2023-12-19T19:03:10.481 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49774.log 2023-12-19T19:03:10.482 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46856.log 2023-12-19T19:03:10.483 INFO:teuthology.orchestra.run.smithi133.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56545.log.gz 2023-12-19T19:03:10.483 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49774.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49774.log.gz 2023-12-19T19:03:10.484 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47645.log 2023-12-19T19:03:10.485 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45634.log 2023-12-19T19:03:10.485 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46856.log.gz 2023-12-19T19:03:10.485 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.0.47645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47645.log.gz 2023-12-19T19:03:10.486 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47340.log 2023-12-19T19:03:10.487 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55906.log 2023-12-19T19:03:10.487 INFO:teuthology.orchestra.run.smithi133.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45634.log.gz 2023-12-19T19:03:10.488 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47340.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47340.log.gz 2023-12-19T19:03:10.488 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53033.log 2023-12-19T19:03:10.489 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44480.log 2023-12-19T19:03:10.490 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55906.log.gz 2023-12-19T19:03:10.490 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53033.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53033.log.gz 2023-12-19T19:03:10.491 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50124.log 2023-12-19T19:03:10.492 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44500.log 2023-12-19T19:03:10.492 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44480.log.gz 2023-12-19T19:03:10.493 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50124.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50124.log.gz 2023-12-19T19:03:10.493 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50283.log 2023-12-19T19:03:10.494 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44682.log 2023-12-19T19:03:10.494 INFO:teuthology.orchestra.run.smithi133.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44500.log.gz 2023-12-19T19:03:10.495 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50283.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50283.log.gz 2023-12-19T19:03:10.495 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56205.log 2023-12-19T19:03:10.496 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52872.log 2023-12-19T19:03:10.496 INFO:teuthology.orchestra.run.smithi133.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44682.log.gz 2023-12-19T19:03:10.497 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.56205.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56205.log.gz 2023-12-19T19:03:10.498 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52324.log 2023-12-19T19:03:10.499 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54364.log 2023-12-19T19:03:10.499 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52872.log.gz 2023-12-19T19:03:10.500 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.52324.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.52324.log.gz 2023-12-19T19:03:10.500 INFO:teuthology.orchestra.run.smithi133.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50543.log 2023-12-19T19:03:10.501 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45660.log 2023-12-19T19:03:10.501 INFO:teuthology.orchestra.run.smithi133.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54364.log.gz 2023-12-19T19:03:10.502 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50543.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50543.log.gz 2023-12-19T19:03:10.502 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48876.log 2023-12-19T19:03:10.503 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45660.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45660.log.gz 2023-12-19T19:03:10.504 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38245.log 2023-12-19T19:03:10.504 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48876.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48876.log.gz 2023-12-19T19:03:10.505 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45894.log 2023-12-19T19:03:10.506 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.38245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48249.log 2023-12-19T19:03:10.506 INFO:teuthology.orchestra.run.smithi133.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38245.log.gz 2023-12-19T19:03:10.507 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45894.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45894.log.gz 2023-12-19T19:03:10.507 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48980.log 2023-12-19T19:03:10.508 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49233.log 2023-12-19T19:03:10.508 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48249.log.gz 2023-12-19T19:03:10.509 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48980.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48980.log.gz 2023-12-19T19:03:10.509 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46351.log 2023-12-19T19:03:10.510 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55672.log 2023-12-19T19:03:10.511 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49233.log.gz 2023-12-19T19:03:10.512 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46351.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46351.log.gz 2023-12-19T19:03:10.512 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51913.log 2023-12-19T19:03:10.513 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51524.log 2023-12-19T19:03:10.513 INFO:teuthology.orchestra.run.smithi133.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55672.log.gz 2023-12-19T19:03:10.514 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51913.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51913.log.gz 2023-12-19T19:03:10.514 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48798.log 2023-12-19T19:03:10.515 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54752.log 2023-12-19T19:03:10.515 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51524.log.gz 2023-12-19T19:03:10.516 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48798.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48798.log.gz 2023-12-19T19:03:10.516 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48119.log 2023-12-19T19:03:10.517 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46988.log 2023-12-19T19:03:10.517 INFO:teuthology.orchestra.run.smithi133.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54752.log.gz 2023-12-19T19:03:10.518 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48119.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48119.log.gz 2023-12-19T19:03:10.518 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46273.log 2023-12-19T19:03:10.519 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44294.log 2023-12-19T19:03:10.520 INFO:teuthology.orchestra.run.smithi133.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46988.log.gz 2023-12-19T19:03:10.521 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46273.log: 88.4% 94.0% -- replaced with /var/log/ceph/ceph-client.admin.46273.log.gz 2023-12-19T19:03:10.521 INFO:teuthology.orchestra.run.smithi133.stderr: -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-19T19:03:10.521 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43808.log 2023-12-19T19:03:10.522 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53811.log 2023-12-19T19:03:10.523 INFO:teuthology.orchestra.run.smithi133.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44294.log.gz 2023-12-19T19:03:10.523 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.43808.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43808.log.gz 2023-12-19T19:03:10.523 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47040.log 2023-12-19T19:03:10.524 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53811.log: gzip -5 89.5% --verbose -- replaced with /var/log/ceph/ceph-client.admin.53811.log.gz -- 2023-12-19T19:03:10.524 INFO:teuthology.orchestra.run.smithi133.stderr: /var/log/ceph/ceph-client.admin.46663.log 2023-12-19T19:03:10.525 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.47040.log: gzip -5 --verbose -- 89.6% /var/log/ceph/ceph-client.admin.48197.log -- replaced with /var/log/ceph/ceph-client.admin.47040.log.gz 2023-12-19T19:03:10.525 INFO:teuthology.orchestra.run.smithi133.stderr: 2023-12-19T19:03:10.526 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46734.log 2023-12-19T19:03:10.526 INFO:teuthology.orchestra.run.smithi133.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46663.log.gz 2023-12-19T19:03:10.527 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44030.log 2023-12-19T19:03:10.527 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48197.log.gz 2023-12-19T19:03:10.528 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54726.log 2023-12-19T19:03:10.528 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46734.log.gz 2023-12-19T19:03:10.529 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44030.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44030.log.gz 2023-12-19T19:03:10.529 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55211.log 2023-12-19T19:03:10.530 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46585.log 2023-12-19T19:03:10.530 INFO:teuthology.orchestra.run.smithi133.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54726.log.gz 2023-12-19T19:03:10.531 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55211.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55211.log.gz 2023-12-19T19:03:10.531 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50150.log 2023-12-19T19:03:10.532 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.46585.log: gzip 88.8% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.46585.log.gz -- 2023-12-19T19:03:10.532 INFO:teuthology.orchestra.run.smithi133.stderr: /var/log/ceph/ceph-client.admin.51368.log 2023-12-19T19:03:10.533 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50150.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50150.log.gz 2023-12-19T19:03:10.533 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50922.log 2023-12-19T19:03:10.533 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.51368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45868.log 2023-12-19T19:03:10.534 INFO:teuthology.orchestra.run.smithi133.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51368.log.gz 2023-12-19T19:03:10.535 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50062.log 2023-12-19T19:03:10.535 INFO:teuthology.orchestra.run.smithi133.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50922.log.gz 2023-12-19T19:03:10.536 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53703.log 2023-12-19T19:03:10.536 INFO:teuthology.orchestra.run.smithi133.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45868.log.gz 2023-12-19T19:03:10.537 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50062.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50062.log.gz 2023-12-19T19:03:10.537 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50387.log 2023-12-19T19:03:10.538 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48928.log 2023-12-19T19:03:10.538 INFO:teuthology.orchestra.run.smithi133.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53703.log.gz 2023-12-19T19:03:10.539 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.50387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53889.log 2023-12-19T19:03:10.539 INFO:teuthology.orchestra.run.smithi133.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50387.log.gz 2023-12-19T19:03:10.540 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.48928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54468.log 2023-12-19T19:03:10.540 INFO:teuthology.orchestra.run.smithi133.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48928.log.gz 2023-12-19T19:03:10.541 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.53889.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53889.log.gz 2023-12-19T19:03:10.541 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55237.log 2023-12-19T19:03:10.542 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.54468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45738.log 2023-12-19T19:03:10.542 INFO:teuthology.orchestra.run.smithi133.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54468.log.gz 2023-12-19T19:03:10.543 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.55237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49162.log 2023-12-19T19:03:10.543 INFO:teuthology.orchestra.run.smithi133.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55237.log.gz 2023-12-19T19:03:10.544 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.45738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49644.log 2023-12-19T19:03:10.544 INFO:teuthology.orchestra.run.smithi133.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45738.log.gz 2023-12-19T19:03:10.545 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49162.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49162.log.gz 2023-12-19T19:03:10.545 INFO:teuthology.orchestra.run.smithi133.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44110.log 2023-12-19T19:03:10.546 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.49644.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49644.log.gz 2023-12-19T19:03:10.547 INFO:teuthology.orchestra.run.smithi133.stderr:/var/log/ceph/ceph-client.admin.44110.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44110.log.gz 2023-12-19T19:03:10.565 INFO:teuthology.orchestra.run.smithi133.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-19T19:03:10.567 INFO:teuthology.orchestra.run.smithi133.stderr: 2023-12-19T19:03:10.567 INFO:teuthology.orchestra.run.smithi133.stderr:real 0m0.690s 2023-12-19T19:03:10.567 INFO:teuthology.orchestra.run.smithi133.stderr:user 0m2.476s 2023-12-19T19:03:10.568 INFO:teuthology.orchestra.run.smithi133.stderr:sys 0m1.081s 2023-12-19T19:03:10.569 INFO:tasks.ceph:Archiving logs... 2023-12-19T19:03:10.569 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497300/remote/smithi133/log 2023-12-19T19:03:10.570 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-19T19:03:11.213 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497300/remote/smithi138/log 2023-12-19T19:03:11.214 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-19T19:03:11.451 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-19T19:03:11.460 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-19T19:03:11.460 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-19T19:03:11.464 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-19T19:03:11.539 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-19T19:03:11.548 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-19T19:03:11.548 DEBUG:teuthology.orchestra.run.smithi133:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T19:03:11.552 DEBUG:teuthology.orchestra.run.smithi138:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T19:03:11.564 INFO:teuthology.orchestra.run.smithi133.stdout: remote refid st t when poll reach delay offset jitter 2023-12-19T19:03:11.564 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================== 2023-12-19T19:03:11.564 INFO:teuthology.orchestra.run.smithi133.stdout:*hv01.front.sepi 44.4.53.2 2 u 36 64 377 0.129 -0.690 0.526 2023-12-19T19:03:11.564 INFO:teuthology.orchestra.run.smithi133.stdout:+hv02.front.sepi 63.231.80.2 3 u 34 64 377 0.090 -0.439 0.450 2023-12-19T19:03:11.564 INFO:teuthology.orchestra.run.smithi133.stdout:+hv03.front.sepi 74.6.168.72 3 u 33 64 377 0.097 -0.794 0.518 2023-12-19T19:03:11.564 INFO:teuthology.orchestra.run.smithi133.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T19:03:11.566 INFO:teuthology.orchestra.run.smithi138.stdout: remote refid st t when poll reach delay offset jitter 2023-12-19T19:03:11.566 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================== 2023-12-19T19:03:11.566 INFO:teuthology.orchestra.run.smithi138.stdout:*hv01.front.sepi 44.4.53.2 2 u 35 64 377 0.077 -1.242 0.633 2023-12-19T19:03:11.566 INFO:teuthology.orchestra.run.smithi138.stdout:+hv02.front.sepi 63.231.80.2 3 u 30 64 377 0.078 -2.018 1.461 2023-12-19T19:03:11.567 INFO:teuthology.orchestra.run.smithi138.stdout:+hv03.front.sepi 74.6.168.72 3 u 33 64 377 0.097 -1.407 0.653 2023-12-19T19:03:11.567 INFO:teuthology.orchestra.run.smithi138.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-19T19:03:11.568 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-19T19:03:11.617 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-19T19:03:11.617 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-19T19:03:11.652 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-19T19:03:11.685 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-19T19:03:11.718 INFO:teuthology.task.internal:Duration was 1022.312155 seconds 2023-12-19T19:03:11.719 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-19T19:03:11.752 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-19T19:03:11.752 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-19T19:03:11.756 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-19T19:03:11.841 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-19T19:03:11.841 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi133.front.sepia.ceph.com 2023-12-19T19:03:11.841 DEBUG:teuthology.orchestra.run.smithi133:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-19T19:03:11.863 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi138.front.sepia.ceph.com 2023-12-19T19:03:11.864 DEBUG:teuthology.orchestra.run.smithi138:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-19T19:03:11.885 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-19T19:03:11.885 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T19:03:11.910 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T19:03:11.962 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-19T19:03:11.963 DEBUG:teuthology.orchestra.run.smithi133:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-19T19:03:11.990 DEBUG:teuthology.orchestra.run.smithi138:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-19T19:03:12.072 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-19T19:03:12.083 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-19T19:03:12.083 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-19T19:03:12.104 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-19T19:03:12.124 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-19T19:03:12.145 DEBUG:teuthology.orchestra.run.smithi133:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-19T19:03:12.149 DEBUG:teuthology.orchestra.run.smithi138:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-19T19:03:12.164 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = core 2023-12-19T19:03:12.183 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = core 2023-12-19T19:03:12.203 DEBUG:teuthology.orchestra.run.smithi133:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-19T19:03:12.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T19:03:12.234 DEBUG:teuthology.orchestra.run.smithi138:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-19T19:03:12.252 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T19:03:12.253 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-19T19:03:12.263 INFO:teuthology.task.internal:Transferring archived files... 2023-12-19T19:03:12.264 DEBUG:teuthology.misc:Transferring archived files from smithi133:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497300/remote/smithi133 2023-12-19T19:03:12.264 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-19T19:03:12.303 DEBUG:teuthology.misc:Transferring archived files from smithi138:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497300/remote/smithi138 2023-12-19T19:03:12.303 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-19T19:03:12.328 INFO:teuthology.task.internal:Removing archive directory... 2023-12-19T19:03:12.328 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-19T19:03:12.345 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-19T19:03:12.374 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-19T19:03:12.384 INFO:teuthology.task.internal:Not uploading archives. 2023-12-19T19:03:12.384 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-19T19:03:12.428 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-19T19:03:12.428 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-19T19:03:12.432 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-19T19:03:12.437 INFO:teuthology.orchestra.run.smithi133.stdout: 658056 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 19:03 /home/ubuntu/cephtest 2023-12-19T19:03:12.440 INFO:teuthology.orchestra.run.smithi138.stdout: 655428 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 19:03 /home/ubuntu/cephtest 2023-12-19T19:03:12.442 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-19T19:03:12.461 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-19T19:03:12.528 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T19:03:12.555 DEBUG:teuthology.nuke:shortname: smithi133 2023-12-19T19:03:12.555 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T19:03:12.581 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497300', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 18:36:13.403409', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOiwAvMPqBpBT7+At01rwE1NfuL/yZnpe8bVCaNZkmAa8nNUD2uKTh04rt0lDa3nJ45uG412tRYK9uCA7+yz1I8='} 2023-12-19T19:03:12.582 DEBUG:teuthology.nuke:shortname: smithi138 2023-12-19T19:03:12.582 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T19:03:12.608 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-12-19_15:49:15-fs-wip-yuri8-testing-2023-12-15-0911-distro-default-smithi/7497300', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 18:36:13.401620', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDxgT3ZvKLV/Q68TqGAzAD69RmTsjiuEKXKuXDAL4WWESBTXsOez31TH+mGPRA2H2xO5NiDqWA0paTMeJMW3GvQ='} 2023-12-19T19:03:12.629 INFO:teuthology.orchestra.console.smithi133:Power off 2023-12-19T19:03:12.629 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T19:03:12.653 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-12-19T19:03:12.654 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T19:03:12.674 INFO:teuthology.orchestra.console.smithi138:Power off 2023-12-19T19:03:12.675 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T19:03:12.684 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-12-19T19:03:12.697 DEBUG:teuthology.orchestra.console.smithi138:power off output: Chassis Power Control: Down/Off 2023-12-19T19:03:12.697 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T19:03:12.719 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2023-12-19T19:03:16.685 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T19:03:16.720 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T19:03:16.795 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-12-19T19:03:16.830 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2023-12-19T19:03:20.797 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T19:03:20.831 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T19:03:20.909 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-12-19T19:03:20.942 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is on 2023-12-19T19:03:21.011 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-12-19T19:03:24.943 DEBUG:teuthology.orchestra.console.smithi138:pexpect command: ipmitool -H smithi138.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T19:03:25.054 DEBUG:teuthology.orchestra.console.smithi138:check power output: Chassis Power is off 2023-12-19T19:03:25.155 INFO:teuthology.orchestra.console.smithi138:Power off completed 2023-12-19T19:03:25.260 INFO:teuthology.run:Summary data: client.0-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c client.1-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} duration: 1022.312155008316 failure_reason: 'Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps)' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=f1ed950e0ff2437e81e43c5435b77ce8 status: fail success: false 2023-12-19T19:03:25.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T19:03:25.326 INFO:teuthology.run:FAIL